-- Logs begin at Mon 2022-07-18 01:15:58 UTC, end at Mon 2022-07-18 04:07:26 UTC. -- Jul 18 01:56:35.997221 n-d-465891-3 systemd[1]: Starting Devstack devstack@n-api.service... Jul 18 01:56:36.007441 n-d-465891-3 devstack@n-api.service[104167]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 18 01:56:36.009457 n-d-465891-3 devstack@n-api.service[104167]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 18 01:56:36 2022] *** Jul 18 01:56:36.009457 n-d-465891-3 devstack@n-api.service[104167]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 18 01:56:36.009457 n-d-465891-3 devstack@n-api.service[104167]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 18 01:56:36.009457 n-d-465891-3 devstack@n-api.service[104167]: nodename: n-d-465891-3 Jul 18 01:56:36.009457 n-d-465891-3 devstack@n-api.service[104167]: machine: x86_64 Jul 18 01:56:36.009457 n-d-465891-3 devstack@n-api.service[104167]: clock source: unix Jul 18 01:56:36.009457 n-d-465891-3 devstack@n-api.service[104167]: pcre jit disabled Jul 18 01:56:36.009457 n-d-465891-3 devstack@n-api.service[104167]: detected number of CPU cores: 4 Jul 18 01:56:36.009457 n-d-465891-3 devstack@n-api.service[104167]: current working directory: / Jul 18 01:56:36.009457 n-d-465891-3 devstack@n-api.service[104167]: detected binary path: /usr/bin/uwsgi-core Jul 18 01:56:36.010187 n-d-465891-3 devstack@n-api.service[104167]: your processes number limit is 47680 Jul 18 01:56:36.010187 n-d-465891-3 devstack@n-api.service[104167]: your memory page size is 4096 bytes Jul 18 01:56:36.010187 n-d-465891-3 devstack@n-api.service[104167]: detected max file descriptor number: 2048 Jul 18 01:56:36.010187 n-d-465891-3 devstack@n-api.service[104167]: lock engine: pthread robust mutexes Jul 18 01:56:36.010187 n-d-465891-3 devstack@n-api.service[104167]: thunder lock: enabled Jul 18 01:56:36.010187 n-d-465891-3 devstack@n-api.service[104167]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 18 01:56:36.010187 n-d-465891-3 devstack@n-api.service[104167]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 18 01:56:36.052900 n-d-465891-3 devstack@n-api.service[104167]: Python main interpreter initialized at 0x5586acead9c0 Jul 18 01:56:36.052900 n-d-465891-3 devstack@n-api.service[104167]: python threads support enabled Jul 18 01:56:36.052900 n-d-465891-3 devstack@n-api.service[104167]: your server socket listen backlog is limited to 100 connections Jul 18 01:56:36.052900 n-d-465891-3 devstack@n-api.service[104167]: your mercy for graceful operations on workers is 90 seconds Jul 18 01:56:36.053373 n-d-465891-3 devstack@n-api.service[104167]: mapped 403077 bytes (393 KB) for 2 cores Jul 18 01:56:36.053491 n-d-465891-3 devstack@n-api.service[104167]: *** Operational MODE: preforking *** Jul 18 01:56:36.053879 n-d-465891-3 devstack@n-api.service[104167]: *** uWSGI is running in multiple interpreter mode *** Jul 18 01:56:36.053879 n-d-465891-3 devstack@n-api.service[104167]: spawned uWSGI master process (pid: 104167) Jul 18 01:56:36.054101 n-d-465891-3 systemd[1]: Started Devstack devstack@n-api.service. Jul 18 01:56:36.057729 n-d-465891-3 devstack@n-api.service[104167]: spawned uWSGI worker 1 (pid: 104168, cores: 1) Jul 18 01:56:36.057729 n-d-465891-3 devstack@n-api.service[104167]: spawned uWSGI worker 2 (pid: 104169, cores: 1) Jul 18 01:56:36.057729 n-d-465891-3 devstack@n-api.service[104167]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 18 01:56:36.745609 n-d-465891-3 devstack@n-api.service[104169]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 01:56:36.769630 n-d-465891-3 devstack@n-api.service[104168]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 01:56:37.869737 n-d-465891-3 devstack@n-api.service[104169]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 01:56:37.869737 n-d-465891-3 devstack@n-api.service[104169]: from cryptography.utils import int_from_bytes Jul 18 01:56:37.870468 n-d-465891-3 devstack@n-api.service[104169]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 01:56:37.870468 n-d-465891-3 devstack@n-api.service[104169]: from cryptography.utils import int_from_bytes Jul 18 01:56:37.877554 n-d-465891-3 devstack@n-api.service[104168]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 01:56:37.877554 n-d-465891-3 devstack@n-api.service[104168]: from cryptography.utils import int_from_bytes Jul 18 01:56:37.878409 n-d-465891-3 devstack@n-api.service[104168]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 01:56:37.878409 n-d-465891-3 devstack@n-api.service[104168]: from cryptography.utils import int_from_bytes Jul 18 01:56:40.420154 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 01:56:40.420773 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 01:56:40.420773 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 01:56:40.421313 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 01:56:40.421458 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 01:56:40.421601 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 01:56:40.422264 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 01:56:40.422415 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 01:56:40.422561 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 01:56:40.422685 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 01:56:40.422685 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.422939 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.423080 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.423234 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.423374 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.423505 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.423627 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.423769 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.423892 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.424027 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.424157 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.424295 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.424424 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.424611 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.424773 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.424934 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.425103 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.425261 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.425400 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.425539 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.425679 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.425857 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.425955 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-465891-3 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.426159 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-465891-3 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.426300 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.426438 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.426597 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.426723 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.426873 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.427036 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.427169 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.427353 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.427482 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.427658 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.427796 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.427978 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.428103 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.428289 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.428521 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.428808 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.429053 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.429267 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.429492 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.429736 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.429966 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.430194 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.430405 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.430622 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.430801 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.430959 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.431143 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.431324 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.431503 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.431690 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.431872 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.432049 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.432228 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.432405 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.432581 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.432766 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.432954 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-465891-3 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.433141 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-465891-3 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.433332 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.433534 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.433760 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.433928 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.434101 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.434297 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.434476 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.434675 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.434858 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.435032 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.435216 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.435432 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.435620 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.435789 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.435957 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.436107 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.436257 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.436593 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.436757 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.436913 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.437074 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.437222 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.437376 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.438895 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.439052 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.439202 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.439352 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.439507 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.439655 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.439812 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.439966 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.440120 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.440269 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.440430 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.440587 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.440744 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.440899 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.440899 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.441215 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.441215 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.441506 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.441660 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.441837 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.441986 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.442149 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.442297 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.442479 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.442479 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.442798 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.442948 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.443104 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.443104 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.443404 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.443593 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.443761 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.443911 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.444069 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.444225 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.444373 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.444522 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.444675 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.444822 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.444984 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.445133 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.445286 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.445433 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.445607 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.445806 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.445974 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.446131 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.446278 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.446432 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.446624 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.446790 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.446951 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.447099 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.447255 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.447402 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.447548 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.447702 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.447870 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.448018 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.448173 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.448173 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.448457 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.448457 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.448754 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.448921 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.449154 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.449311 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.449465 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.449626 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.449806 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.449976 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.450130 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.450278 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.450425 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.450583 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.450737 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.450886 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.451040 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.451187 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.451341 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.451502 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.451651 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.451804 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.451961 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.452108 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.452264 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.452264 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.452552 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.452552 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.452841 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.452990 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.453147 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.454137 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.454327 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.454488 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.454646 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.454806 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.454966 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.455126 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.455276 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.455432 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.455581 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.455744 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.455926 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.456141 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.456334 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.456526 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.456713 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.456913 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.457107 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.457296 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.457493 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.457681 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.457892 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.458096 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.458263 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.458417 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.458584 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.458584 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.458918 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.459137 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.459468 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.459675 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.459899 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.460107 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.460314 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.460659 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.460870 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.461065 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.461232 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.461387 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.461589 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.461833 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.462004 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.462154 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.462309 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.462464 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.462612 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.462769 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.462918 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.463066 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.463220 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.463368 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.463368 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.463368 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.463368 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.463368 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.464119 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.464267 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.464415 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.464574 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.464722 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.464869 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.465025 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.465172 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.465333 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.465483 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.465629 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.465804 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.465997 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.466211 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.466211 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.466622 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.466837 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.467049 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.467258 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.467258 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.467766 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.467976 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.468174 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.468385 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.468577 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.468785 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.468996 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.468996 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.469349 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.469349 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.469962 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.470115 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.470279 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.470437 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.470437 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.470437 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.470437 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.470437 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.471143 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.471291 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.471448 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.471596 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.471744 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.471902 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.472050 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.472238 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.472388 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.472536 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.472696 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.472855 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.473049 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.473205 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.473352 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:56:40.473507 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.473665 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.473844 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.474042 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.474197 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.474355 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.474504 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.474668 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.474817 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.474817 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.474817 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.474817 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.474817 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.475523 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.475674 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.475674 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.475958 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.475958 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.476280 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.476447 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.476601 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.476754 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.476913 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.477068 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.477219 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.477382 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.477535 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.477695 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.477900 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.478051 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.478198 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.478392 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.478577 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.478765 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.478954 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.479131 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.479324 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.479533 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.479884 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.480093 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.480303 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.480523 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.480746 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.480933 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.481091 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.481243 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.481391 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.481551 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.481739 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.481911 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.482070 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.482222 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.482382 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.482382 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.482382 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.482382 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.482382 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.483086 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.483236 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.483398 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.483560 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.483712 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.483862 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.484013 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.484695 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.484916 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.485114 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.485323 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.485514 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.485695 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.485892 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.486053 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.486317 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.486317 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.486317 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.486856 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.487066 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.487290 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.487491 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.487694 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.487900 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.488107 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.488314 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.488534 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.488759 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.488965 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.489169 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.489354 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.489571 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.489571 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.489571 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.489571 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.489571 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.490718 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.490901 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.491027 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.491027 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.491271 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.491271 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.491546 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.491546 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.491800 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.491924 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.492046 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.492170 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.492293 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.492428 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.492551 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.492685 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.492685 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.492916 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.493129 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.493265 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.493389 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.493513 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.493636 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.493781 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.493922 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.494046 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.494181 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.494362 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.494515 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.494671 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.494671 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.494671 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.494671 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.494671 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.495434 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.495582 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.495739 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.495888 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.496037 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.496185 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.496332 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.496332 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.496628 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.496786 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.496943 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.497099 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.497247 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.497403 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.497403 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.497692 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.497874 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.498041 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.498193 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.498354 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.498504 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.498662 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.498817 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.498967 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.499117 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.499293 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.499480 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.499650 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.499836 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.500557 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.502012 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.502177 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.502327 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.502484 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.502647 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.502872 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.503042 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.503199 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.503350 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.503498 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.503646 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.503795 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.503959 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.504109 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.504257 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.504423 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.504423 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.504732 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.504890 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.505038 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.505185 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.505185 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.505467 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.505622 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.505807 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.505969 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.505969 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.506260 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.506412 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.506569 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.506732 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.506890 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.507040 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.507189 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.507344 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.507505 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.507655 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.507802 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.507963 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.508120 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.508270 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.508433 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.508590 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.508744 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.508896 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.509046 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.509210 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.509367 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.509550 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.509810 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.509964 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.510130 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.510130 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.510421 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.510571 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.510719 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.510881 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.511029 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.511190 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.511338 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.511485 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.511738 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.511895 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.512051 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.512214 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.512362 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.512510 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.512660 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.512660 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.512955 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.513104 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.513251 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.513406 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.513840 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.513996 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.514159 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.514317 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.514479 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.514658 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.514814 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.514973 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.515224 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.515388 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.515579 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.516038 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.516240 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.516381 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.516530 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.516675 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.516847 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.517036 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.517208 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.517372 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.517513 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.517639 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.517780 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.517920 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.518053 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.518186 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.518311 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.518425 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.518565 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.518778 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.518914 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.519049 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.519175 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.519314 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.519476 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.519593 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.519715 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.519848 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.519979 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.520152 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.520152 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.520152 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.520523 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.520683 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.520811 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.520943 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.521084 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.521249 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.521387 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.521522 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.521689 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.521873 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.522006 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.522132 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.522276 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.522443 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.522573 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.522696 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.522820 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.522942 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.523079 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.523206 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.523336 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.523460 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.523593 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.523717 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.523927 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.524053 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.524185 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.524309 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.524432 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.524565 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.524682 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.524876 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.524991 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.525096 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.525219 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.525359 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.525483 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.525605 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.525746 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.525892 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.526016 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.526151 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.526275 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.526397 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.526518 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.526639 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.526760 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.526889 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.527019 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.527149 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.527271 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.527393 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.527523 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.527645 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.527766 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.527886 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.528007 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.528128 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.528257 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.528387 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.528517 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.528638 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.528760 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.528881 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.529011 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.529133 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.529254 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.529375 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.529505 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.529627 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.529794 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.529912 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.530034 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.530161 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.530282 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.530403 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.530534 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.530664 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.530787 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.530907 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.531027 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.531027 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.531673 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.531806 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.531920 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.532025 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.532147 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.532279 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.532403 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.532529 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.532652 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.532777 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.532899 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.533030 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.533154 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.533278 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.533401 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.533533 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.533666 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.533810 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.533946 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.534071 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.534194 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.534325 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.534448 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.534572 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.534705 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.534819 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.534941 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.535065 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.535187 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.535318 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.535443 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.535566 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.535688 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.535813 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.535935 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.536067 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.536193 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.536316 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.536439 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.536562 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.536684 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.536817 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.536940 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.537063 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.537195 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.537325 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.537462 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.537597 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.537805 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.537933 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.538056 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.538179 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.538314 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.538446 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.538570 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.538693 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.538823 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.538823 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.539065 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.539197 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.539321 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.539427 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.539540 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.539653 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.539770 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.539877 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.539983 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.540088 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.540194 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.540306 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.540421 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.540528 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.540633 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.540737 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.540841 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.540961 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.541077 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.541192 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.541300 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.541405 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.541518 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.541633 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.541776 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.541895 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.542004 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.542109 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.542214 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.542318 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.542432 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.542539 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.542671 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.542830 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.542975 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.543089 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.543277 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.543385 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.543569 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.543682 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.543873 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.543993 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.544177 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.544298 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.544485 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.544605 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.544785 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.544896 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.545082 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.545194 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.545384 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.545459 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.545684 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.545851 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.546013 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.546159 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.546318 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.546406 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.546619 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.547229 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.547499 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.547645 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.547835 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.548050 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.548137 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.548358 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.548576 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.548664 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.548909 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.548994 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.549249 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.549335 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.549552 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.549638 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.549883 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.549978 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.550197 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.550361 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.550549 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.550754 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.550920 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.551047 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.551181 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.551312 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.551438 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.551559 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.551690 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.551875 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.552059 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.552194 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.552301 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.552404 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.552548 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.552673 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.552847 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.552961 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.553160 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.553339 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.553455 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.553577 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.553789 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.554035 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.554255 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.554416 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.554569 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.554722 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.554926 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.555119 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.555288 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.555433 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.555562 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.555729 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.555880 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.556087 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.556289 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.556422 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.556546 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.556670 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.556777 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.556900 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.557070 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.557249 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.557379 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.557487 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.557591 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.557748 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.557937 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.558085 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.558254 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.558419 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.558419 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.558638 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.558743 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.558849 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.558991 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.559129 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.559129 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.559385 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.559491 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.560357 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.560488 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.560613 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.560783 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.560955 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.561139 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.561268 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.561485 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.561666 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.561821 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.562002 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.562153 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.562288 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.562991 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.563129 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.563254 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.563377 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.563510 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.563641 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.563766 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.563889 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.564012 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.564012 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.564253 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.564253 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.564485 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.564615 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.564739 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.564870 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.565001 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.565134 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.565257 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.565381 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.565511 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.565649 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.565855 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.565981 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.566117 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.566242 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.566372 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.566505 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.566629 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.566752 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.566875 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.566997 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.567120 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.567253 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.567378 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.567501 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.567630 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.567754 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.567889 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.568014 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.568136 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.568322 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.568451 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.568627 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.568764 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.568953 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.569088 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.569262 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.569391 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.569564 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.569719 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.569896 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.570016 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.570199 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.570327 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.570501 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.570640 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.570802 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.570928 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.571118 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.571244 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.571435 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.571563 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.571742 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.571869 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.572052 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.572179 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.572387 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.572523 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.572674 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.572801 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.572989 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.573149 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.573312 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.573440 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.573613 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.573756 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.573980 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.574106 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.574287 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.574415 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.574599 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.574726 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.574910 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.575036 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.575220 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.575348 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.575519 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.575646 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.575828 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.575966 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.576148 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.576273 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.576452 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.576579 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.576756 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.576891 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.577058 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.577192 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.577368 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.577507 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.577669 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.577824 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.578044 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.578172 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.578356 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.578519 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.578660 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.578914 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.579042 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.579234 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.579369 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.579560 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.579699 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.579930 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.580059 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.580181 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.580313 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.580469 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.580605 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.580776 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.580904 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.581161 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.581294 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.581467 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.581604 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.581804 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.581935 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.582113 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.582258 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.582425 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.582553 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.582736 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.582871 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.583045 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.583171 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.583355 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.583482 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.583656 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.583789 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.583978 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.584108 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.584298 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.584433 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.584610 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.584737 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.584928 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.585057 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.585259 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.585386 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.585565 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.585692 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.585906 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.586048 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.586231 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.586367 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.586580 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.586720 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.586845 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.586969 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.587119 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.587248 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.587442 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.587572 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.587748 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.587876 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.588052 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.588193 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.588374 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.588502 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.588678 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.588805 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.588987 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.589123 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.589296 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.589466 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.589596 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.589800 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.589930 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.590139 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.590259 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.590425 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.590561 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.590747 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.590885 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.591070 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.591198 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.591377 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.591497 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.591692 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.591828 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.592002 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.592130 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.592309 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.592436 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.592627 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.592764 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.592937 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.593064 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.593239 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.593365 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.593542 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.593679 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.593920 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.594046 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.594246 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.594503 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.594642 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.594872 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.595017 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.595290 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.595580 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.595717 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.595852 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.595978 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.596101 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.596225 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.596347 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.596538 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.596674 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.596843 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.596978 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.597147 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.597274 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.597459 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.597596 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.597809 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.597936 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.598084 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.598210 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.598409 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.598538 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.598715 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.598841 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.599015 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.599140 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.599322 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.599450 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.599626 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.599753 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.599926 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.600058 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.600280 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.600415 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.600547 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.600672 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.600796 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.600919 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.601104 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.601232 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.601407 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.601534 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.601744 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.601889 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.602056 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.602196 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.602359 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.602486 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.602661 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.602796 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.602980 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.603170 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.603323 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.603459 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.603601 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.603750 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.603884 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.604019 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.604152 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.604282 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.604460 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.604563 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.604783 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.604878 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.605111 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.605239 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.605466 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.605605 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.605772 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.605911 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.606076 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.606205 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.606392 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.606521 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.606703 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.606831 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.607017 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.607146 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.607330 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.607458 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.607629 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.607754 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.607932 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.608062 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.608241 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.608377 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.608542 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.608669 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.608847 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.608989 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.609770 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.609972 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.610100 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.610330 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.610459 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.610620 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.610750 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.610922 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.611056 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.611243 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.611371 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.611545 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.611672 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.611865 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.611992 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.612172 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.612302 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.612507 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.612634 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.612759 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.612882 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.613055 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.613191 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.613396 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.613526 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.613741 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.613872 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.614049 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.614190 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.614369 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.614504 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.614685 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.614825 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.615001 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.615137 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.615309 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.615436 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.615623 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.615747 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.615940 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.616074 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.616253 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.616380 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.616569 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.616711 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.616889 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.617084 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.617255 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.617503 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.617653 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.617847 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.618139 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.618293 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.618477 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.618759 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.618904 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.619066 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.619313 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.619441 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.619680 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.619966 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.620094 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.620308 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.620624 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.620759 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.620954 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.621085 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.621250 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.621567 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.621911 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.622110 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.622459 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.622712 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.622878 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.623088 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.623305 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.623490 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.623722 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.623919 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.624123 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.624338 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.624476 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.624665 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.624905 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.625586 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.625736 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.625988 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.626123 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.626330 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.626486 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.626665 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.626807 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.626998 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.627180 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.627333 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.627470 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.627664 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.627824 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.628006 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.628194 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.628387 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.628578 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.628791 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.628940 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.628940 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.629178 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.629304 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.629428 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.629569 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.629752 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.629933 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.630077 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.630254 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.630397 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.630567 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.630704 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.630918 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.631048 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.631180 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.631326 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.631498 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.631634 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.631816 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.631950 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.632134 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.632271 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.632456 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.632584 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.632756 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.632881 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.633064 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.633191 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.633374 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.633507 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.633678 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.633823 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.634002 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.634130 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.634310 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.634439 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.634611 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.634746 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.634937 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.635066 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.635243 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.635380 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.635546 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.635687 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.635847 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.635975 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.636156 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.636458 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.636695 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.636910 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.637099 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.637288 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.637468 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.637659 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.637900 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.638135 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.638327 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.638816 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.639027 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.639243 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.639447 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.639666 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.639874 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.640065 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.640263 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.640511 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.640745 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.640954 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.641138 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.641345 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.641545 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.641775 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.641988 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.642158 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.642347 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.642532 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.642716 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.642890 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.643075 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.643240 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.643414 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.643608 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.643789 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.643959 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.644169 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.644368 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.644547 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.644547 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.644886 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.644886 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.645413 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.645413 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.645825 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.646000 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.646167 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.646469 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.646657 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.646847 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.647049 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.647294 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.647426 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.647588 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.647714 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.647835 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.647835 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.648080 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.648210 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.648347 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.648469 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.648591 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.648712 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.648832 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.648963 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.649085 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.649199 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.649322 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.649444 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.649564 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.649693 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.649834 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.649956 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.650077 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.650197 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.650318 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.650452 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.650583 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.650713 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.650835 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.650948 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.651063 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.651175 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.651296 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.651423 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.651548 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.651675 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.651806 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.651928 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.652048 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.652169 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.652281 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.652394 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.652524 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.652653 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.652775 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.652895 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.653015 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.653145 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.653276 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.653398 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.653518 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.653639 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.653874 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.654017 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.654151 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.654278 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.654403 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.654526 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.654649 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.654780 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.654905 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.655035 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.655168 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.655294 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.655424 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.655557 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.655682 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.655805 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.655929 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.656576 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.656715 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.656848 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.656971 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.657093 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.657217 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.657348 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.657480 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.657605 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.657807 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.657937 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.658243 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.658369 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.658582 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.658712 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.658909 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.659036 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.659233 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.659362 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.659539 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.659668 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.659844 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.659972 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.660148 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.660285 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.660455 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.660585 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.660775 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.660903 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.661083 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.661220 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.661385 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.661514 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.661749 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.661895 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.662021 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.662154 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.662308 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.662521 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.662650 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.662774 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.662898 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.663031 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.663193 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.663322 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.663500 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.663629 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.663801 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.663930 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.664101 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.664229 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.664401 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.664530 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.664703 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.664832 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.665003 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.665140 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.665303 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.665432 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.665609 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.665768 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.665934 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.666062 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.666239 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.666380 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.666538 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.666674 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.666838 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.666972 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.667140 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.667277 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.667462 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.667590 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.667778 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.667914 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.668093 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.668227 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.668414 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.668542 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.668725 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.668852 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.669030 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.669171 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.669337 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.669463 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.669656 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.669800 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.669999 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.670128 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.670364 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.670508 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.670634 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.670764 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.670941 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.671071 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.671250 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.671374 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.671560 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.672473 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.672623 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.672751 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.672876 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.673007 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.673173 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.673310 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.673436 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.673567 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.673692 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.673906 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.674032 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.674378 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.674522 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.674649 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.674773 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.674897 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.675028 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.675164 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.675290 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.675414 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.675537 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.675661 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.675801 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.675951 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.676080 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.676255 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.676383 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.676559 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.676695 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.676868 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.676996 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.677172 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.677301 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.677477 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.677613 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.677809 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.677946 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.678113 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.678241 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.678422 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.678560 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.678724 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.678852 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.679026 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.679161 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.679327 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.679457 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.679630 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.679758 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.679932 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.680066 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.680234 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.680370 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.680542 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.680677 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.680846 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.680974 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.681150 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.681279 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.681452 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.681580 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.681774 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.681917 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.682077 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.682205 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.682405 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.682541 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.682739 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.682875 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.683007 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 01:56:40.683138 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.683363 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.683677 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.684000 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.684310 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.684631 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.684952 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.685269 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.685579 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.685936 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.686250 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.686561 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.686871 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.687182 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.687602 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.687850 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.688179 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.688506 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.688812 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.689137 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.689454 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.689801 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.690120 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.690431 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.690759 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.691069 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.691381 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.691688 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.692000 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.692310 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.692625 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.692935 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.693243 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.693558 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.693894 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.694222 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.694546 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.694857 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.695180 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.695504 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.695851 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.696165 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.696507 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.696833 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.697149 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.697460 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.697795 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:56:40.698042 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 01:56:40.744627 n-d-465891-3 devstack@n-api.service[104169]: INFO dbcounter [None req-93fcdee9-e987-4bcf-aa37-d895da48232a None None] Registered counter for database nova_api Jul 18 01:56:40.760546 n-d-465891-3 devstack@n-api.service[104168]: INFO dbcounter [None req-f22397a3-e9c3-44a9-b426-33715125db9a None None] Registered counter for database nova_api Jul 18 01:56:40.862803 n-d-465891-3 devstack@n-api.service[104169]: DEBUG oslo_db.sqlalchemy.engines [None req-93fcdee9-e987-4bcf-aa37-d895da48232a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104169) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 01:56:40.869961 n-d-465891-3 devstack@n-api.service[104169]: DEBUG dbcounter [-] [104169] Writer thread running {{(pid=104169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 01:56:40.876705 n-d-465891-3 devstack@n-api.service[104168]: DEBUG oslo_db.sqlalchemy.engines [None req-f22397a3-e9c3-44a9-b426-33715125db9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104168) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 01:56:40.883950 n-d-465891-3 devstack@n-api.service[104168]: DEBUG dbcounter [-] [104168] Writer thread running {{(pid=104168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 01:56:40.929585 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.context [None req-93fcdee9-e987-4bcf-aa37-d895da48232a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2a4b42c4-bf71-4fae-804a-3632602c55fa(cell1) {{(pid=104169) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 01:56:40.933565 n-d-465891-3 devstack@n-api.service[104169]: DEBUG oslo_concurrency.lockutils [None req-93fcdee9-e987-4bcf-aa37-d895da48232a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 01:56:40.935191 n-d-465891-3 devstack@n-api.service[104169]: DEBUG oslo_concurrency.lockutils [None req-93fcdee9-e987-4bcf-aa37-d895da48232a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 01:56:40.936022 n-d-465891-3 devstack@n-api.service[104169]: DEBUG oslo_concurrency.lockutils [None req-93fcdee9-e987-4bcf-aa37-d895da48232a None None] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 01:56:40.939018 n-d-465891-3 devstack@n-api.service[104169]: DEBUG oslo_concurrency.lockutils [None req-93fcdee9-e987-4bcf-aa37-d895da48232a None None] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=104169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 01:56:40.941075 n-d-465891-3 devstack@n-api.service[104169]: INFO dbcounter [None req-93fcdee9-e987-4bcf-aa37-d895da48232a None None] Registered counter for database nova_cell0 Jul 18 01:56:40.943056 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.context [None req-f22397a3-e9c3-44a9-b426-33715125db9a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2a4b42c4-bf71-4fae-804a-3632602c55fa(cell1) {{(pid=104168) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 01:56:40.945111 n-d-465891-3 devstack@n-api.service[104169]: INFO dbcounter [None req-93fcdee9-e987-4bcf-aa37-d895da48232a None None] Registered counter for database nova_cell1 Jul 18 01:56:40.947125 n-d-465891-3 devstack@n-api.service[104168]: DEBUG oslo_concurrency.lockutils [None req-f22397a3-e9c3-44a9-b426-33715125db9a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 01:56:40.948696 n-d-465891-3 devstack@n-api.service[104168]: DEBUG oslo_concurrency.lockutils [None req-f22397a3-e9c3-44a9-b426-33715125db9a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 01:56:40.949504 n-d-465891-3 devstack@n-api.service[104168]: DEBUG oslo_concurrency.lockutils [None req-f22397a3-e9c3-44a9-b426-33715125db9a None None] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 01:56:40.951746 n-d-465891-3 devstack@n-api.service[104168]: DEBUG oslo_concurrency.lockutils [None req-f22397a3-e9c3-44a9-b426-33715125db9a None None] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 01:56:40.954292 n-d-465891-3 devstack@n-api.service[104169]: DEBUG oslo_db.sqlalchemy.engines [None req-93fcdee9-e987-4bcf-aa37-d895da48232a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104169) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 01:56:40.954597 n-d-465891-3 devstack@n-api.service[104168]: INFO dbcounter [None req-f22397a3-e9c3-44a9-b426-33715125db9a None None] Registered counter for database nova_cell0 Jul 18 01:56:40.956225 n-d-465891-3 devstack@n-api.service[104169]: DEBUG oslo_db.sqlalchemy.engines [None req-93fcdee9-e987-4bcf-aa37-d895da48232a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104169) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 01:56:40.958702 n-d-465891-3 devstack@n-api.service[104168]: INFO dbcounter [None req-f22397a3-e9c3-44a9-b426-33715125db9a None None] Registered counter for database nova_cell1 Jul 18 01:56:40.962602 n-d-465891-3 devstack@n-api.service[104169]: DEBUG dbcounter [-] [104169] Writer thread running {{(pid=104169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 01:56:40.963894 n-d-465891-3 devstack@n-api.service[104169]: DEBUG dbcounter [-] [104169] Writer thread running {{(pid=104169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 01:56:40.967564 n-d-465891-3 devstack@n-api.service[104168]: DEBUG oslo_db.sqlalchemy.engines [None req-f22397a3-e9c3-44a9-b426-33715125db9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104168) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 01:56:40.970135 n-d-465891-3 devstack@n-api.service[104168]: DEBUG oslo_db.sqlalchemy.engines [None req-f22397a3-e9c3-44a9-b426-33715125db9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104168) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 01:56:40.975352 n-d-465891-3 devstack@n-api.service[104168]: DEBUG dbcounter [-] [104168] Writer thread running {{(pid=104168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 01:56:40.977873 n-d-465891-3 devstack@n-api.service[104168]: DEBUG dbcounter [-] [104168] Writer thread running {{(pid=104168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 01:56:41.114587 n-d-465891-3 devstack@n-api.service[104169]: INFO dbcounter [None req-93fcdee9-e987-4bcf-aa37-d895da48232a None None] Registered counter for database nova_cell0 Jul 18 01:56:41.126013 n-d-465891-3 devstack@n-api.service[104169]: DEBUG oslo_db.sqlalchemy.engines [None req-93fcdee9-e987-4bcf-aa37-d895da48232a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104169) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 01:56:41.126862 n-d-465891-3 devstack@n-api.service[104168]: INFO dbcounter [None req-f22397a3-e9c3-44a9-b426-33715125db9a None None] Registered counter for database nova_cell0 Jul 18 01:56:41.131851 n-d-465891-3 devstack@n-api.service[104169]: DEBUG dbcounter [-] [104169] Writer thread running {{(pid=104169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 01:56:41.136689 n-d-465891-3 devstack@n-api.service[104168]: DEBUG oslo_db.sqlalchemy.engines [None req-f22397a3-e9c3-44a9-b426-33715125db9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104168) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 01:56:41.144807 n-d-465891-3 devstack@n-api.service[104168]: DEBUG dbcounter [-] [104168] Writer thread running {{(pid=104168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 01:56:41.474754 n-d-465891-3 devstack@n-api.service[104168]: WARNING keystonemiddleware.auth_token [None req-f22397a3-e9c3-44a9-b426-33715125db9a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 01:56:41.476897 n-d-465891-3 devstack@n-api.service[104169]: WARNING keystonemiddleware.auth_token [None req-93fcdee9-e987-4bcf-aa37-d895da48232a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 01:56:41.482262 n-d-465891-3 devstack@n-api.service[104168]: WARNING keystonemiddleware.auth_token [None req-f22397a3-e9c3-44a9-b426-33715125db9a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 01:56:41.484288 n-d-465891-3 devstack@n-api.service[104169]: WARNING keystonemiddleware.auth_token [None req-93fcdee9-e987-4bcf-aa37-d895da48232a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 01:56:41.828468 n-d-465891-3 devstack@n-api.service[104168]: WARNING keystonemiddleware.auth_token [None req-f22397a3-e9c3-44a9-b426-33715125db9a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 01:56:41.834691 n-d-465891-3 devstack@n-api.service[104168]: WARNING keystonemiddleware.auth_token [None req-f22397a3-e9c3-44a9-b426-33715125db9a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 01:56:41.838897 n-d-465891-3 devstack@n-api.service[104169]: WARNING keystonemiddleware.auth_token [None req-93fcdee9-e987-4bcf-aa37-d895da48232a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 01:56:41.839803 n-d-465891-3 devstack@n-api.service[104168]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5586acead9c0 pid: 104168 (default app) Jul 18 01:56:41.841920 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-f22397a3-e9c3-44a9-b426-33715125db9a None None] Calling method '>' {{(pid=104168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 01:56:41.843107 n-d-465891-3 devstack@n-api.service[104168]: INFO nova.api.openstack.requestlog [None req-f22397a3-e9c3-44a9-b426-33715125db9a None None] 10.222.0.57 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001784 Jul 18 01:56:41.843581 n-d-465891-3 devstack@n-api.service[104168]: [pid: 104168|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 788 bytes} [Mon Jul 18 01:56:41 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 01:56:41.845471 n-d-465891-3 devstack@n-api.service[104169]: WARNING keystonemiddleware.auth_token [None req-93fcdee9-e987-4bcf-aa37-d895da48232a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 01:56:41.850861 n-d-465891-3 devstack@n-api.service[104169]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5586acead9c0 pid: 104169 (default app) Jul 18 01:58:00.275719 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-f22397a3-e9c3-44a9-b426-33715125db9a None None] Calling method '>' {{(pid=104168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 01:58:00.276740 n-d-465891-3 devstack@n-api.service[104168]: INFO nova.api.openstack.requestlog [None req-f22397a3-e9c3-44a9-b426-33715125db9a None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jul 18 01:58:00.277487 n-d-465891-3 devstack@n-api.service[104168]: [pid: 104168|app: 0|req: 2/2] 10.222.0.57 () {54 vars in 930 bytes} [Mon Jul 18 01:58:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 01:58:00.289844 n-d-465891-3 devstack@n-api.service[104169]: DEBUG dbcounter [-] [104169] Writing DB stats nova_api:SELECT=3 {{(pid=104169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 01:58:00.291616 n-d-465891-3 devstack@n-api.service[104169]: DEBUG dbcounter [-] [104169] Writing DB stats nova_cell0:SELECT=3 {{(pid=104169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 01:58:00.292437 n-d-465891-3 devstack@n-api.service[104169]: DEBUG dbcounter [-] [104169] Writing DB stats nova_cell1:SELECT=3 {{(pid=104169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 01:58:00.293169 n-d-465891-3 devstack@n-api.service[104169]: DEBUG dbcounter [-] [104169] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 01:58:01.171215 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi [None req-380509c7-6197-4df9-9ca5-5274fa9143cc admin admin] Calling method '>' {{(pid=104169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 01:58:01.203452 n-d-465891-3 devstack@n-api.service[104169]: INFO nova.api.openstack.requestlog [None req-380509c7-6197-4df9-9ca5-5274fa9143cc admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.918785 Jul 18 01:58:01.204429 n-d-465891-3 devstack@n-api.service[104169]: [pid: 104169|app: 0|req: 1/3] 10.222.0.57 () {60 vars in 1291 bytes} [Mon Jul 18 01:58:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 01:58:03.505395 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-f22397a3-e9c3-44a9-b426-33715125db9a None None] Calling method '>' {{(pid=104168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 01:58:03.506447 n-d-465891-3 devstack@n-api.service[104168]: INFO nova.api.openstack.requestlog [None req-f22397a3-e9c3-44a9-b426-33715125db9a None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 18 01:58:03.507039 n-d-465891-3 devstack@n-api.service[104168]: [pid: 104168|app: 0|req: 3/4] 10.222.0.57 () {54 vars in 930 bytes} [Mon Jul 18 01:58:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 01:58:03.982008 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi [None req-5d73d1b4-b09d-40f3-8641-a1132c4e130c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "swap": 0, "rxtx_factor": 1.0, "name": "cirros256", "id": "c1", "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=104169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 01:58:04.000812 n-d-465891-3 devstack@n-api.service[104169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 01:58:04.000812 n-d-465891-3 devstack@n-api.service[104169]: warnings.warn(msg) Jul 18 01:58:04.030115 n-d-465891-3 devstack@n-api.service[104169]: INFO nova.api.openstack.requestlog [None req-5d73d1b4-b09d-40f3-8641-a1132c4e130c admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.516580 Jul 18 01:58:04.030970 n-d-465891-3 devstack@n-api.service[104169]: [pid: 104169|app: 0|req: 2/5] 10.222.0.57 () {64 vars in 1282 bytes} [Mon Jul 18 01:58:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 01:58:04.048063 n-d-465891-3 devstack@n-api.service[104168]: DEBUG dbcounter [-] [104168] Writing DB stats nova_api:SELECT=3 {{(pid=104168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 01:58:04.049195 n-d-465891-3 devstack@n-api.service[104168]: DEBUG dbcounter [-] [104168] Writing DB stats nova_cell1:SELECT=3 {{(pid=104168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 01:58:04.049989 n-d-465891-3 devstack@n-api.service[104168]: DEBUG dbcounter [-] [104168] Writing DB stats nova_cell0:SELECT=3 {{(pid=104168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 01:58:04.050773 n-d-465891-3 devstack@n-api.service[104168]: DEBUG dbcounter [-] [104168] Writing DB stats nova_cell0:SELECT=3 {{(pid=104168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 01:58:04.258596 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-a73a0d3e-46f3-4c4b-b990-ab4f3153af86 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 01:58:04.261485 n-d-465891-3 devstack@n-api.service[104168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 01:58:04.261485 n-d-465891-3 devstack@n-api.service[104168]: warnings.warn(msg) Jul 18 01:58:04.324922 n-d-465891-3 devstack@n-api.service[104168]: INFO nova.api.openstack.requestlog [None req-a73a0d3e-46f3-4c4b-b990-ab4f3153af86 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.285216 Jul 18 01:58:04.325836 n-d-465891-3 devstack@n-api.service[104168]: [pid: 104168|app: 0|req: 4/6] 10.222.0.57 () {64 vars in 1335 bytes} [Mon Jul 18 01:58:04 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 01:58:06.696182 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi [None req-5d73d1b4-b09d-40f3-8641-a1132c4e130c admin admin] Calling method '>' {{(pid=104169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 01:58:06.698159 n-d-465891-3 devstack@n-api.service[104169]: INFO nova.api.openstack.requestlog [None req-5d73d1b4-b09d-40f3-8641-a1132c4e130c admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jul 18 01:58:06.698546 n-d-465891-3 devstack@n-api.service[104169]: [pid: 104169|app: 0|req: 3/7] 10.222.0.57 () {54 vars in 930 bytes} [Mon Jul 18 01:58:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 01:58:07.601526 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-2a59f874-a2f4-46aa-bb63-407567814d56 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds512M", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "swap": 0, "disk": 5}} {{(pid=104168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 01:58:07.620226 n-d-465891-3 devstack@n-api.service[104168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 01:58:07.620226 n-d-465891-3 devstack@n-api.service[104168]: warnings.warn(msg) Jul 18 01:58:07.675536 n-d-465891-3 devstack@n-api.service[104168]: INFO nova.api.openstack.requestlog [None req-2a59f874-a2f4-46aa-bb63-407567814d56 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.970111 Jul 18 01:58:07.679160 n-d-465891-3 devstack@n-api.service[104168]: [pid: 104168|app: 0|req: 5/8] 10.222.0.57 () {64 vars in 1282 bytes} [Mon Jul 18 01:58:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 01:58:07.693325 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi [None req-9e3ea7b4-2904-4690-a85f-fa7fc2b4fce0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 01:58:07.695757 n-d-465891-3 devstack@n-api.service[104169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 01:58:07.695757 n-d-465891-3 devstack@n-api.service[104169]: warnings.warn(msg) Jul 18 01:58:07.731930 n-d-465891-3 devstack@n-api.service[104169]: INFO nova.api.openstack.requestlog [None req-9e3ea7b4-2904-4690-a85f-fa7fc2b4fce0 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043689 Jul 18 01:58:07.737863 n-d-465891-3 devstack@n-api.service[104169]: [pid: 104169|app: 0|req: 4/9] 10.222.0.57 () {64 vars in 1335 bytes} [Mon Jul 18 01:58:07 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 01:58:10.219735 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-2a59f874-a2f4-46aa-bb63-407567814d56 admin admin] Calling method '>' {{(pid=104168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 01:58:10.221308 n-d-465891-3 devstack@n-api.service[104168]: INFO nova.api.openstack.requestlog [None req-2a59f874-a2f4-46aa-bb63-407567814d56 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002158 Jul 18 01:58:10.221936 n-d-465891-3 devstack@n-api.service[104168]: [pid: 104168|app: 0|req: 6/10] 10.222.0.57 () {54 vars in 930 bytes} [Mon Jul 18 01:58:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 01:58:10.859761 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi [None req-a0ee4544-9da2-43a5-8096-ca47ac5707bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "disk": 10, "rxtx_factor": 1.0}} {{(pid=104169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 01:58:10.882936 n-d-465891-3 devstack@n-api.service[104169]: INFO nova.api.openstack.requestlog [None req-a0ee4544-9da2-43a5-8096-ca47ac5707bd admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.652756 Jul 18 01:58:10.898177 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-d6207251-8fd0-4bed-b275-035d8d44937b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 01:58:10.903785 n-d-465891-3 devstack@n-api.service[104169]: [pid: 104169|app: 0|req: 5/11] 10.222.0.57 () {64 vars in 1282 bytes} [Mon Jul 18 01:58:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 01:58:10.930336 n-d-465891-3 devstack@n-api.service[104168]: INFO nova.api.openstack.requestlog [None req-d6207251-8fd0-4bed-b275-035d8d44937b admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036262 Jul 18 01:58:10.941623 n-d-465891-3 devstack@n-api.service[104168]: [pid: 104168|app: 0|req: 7/12] 10.222.0.57 () {64 vars in 1335 bytes} [Mon Jul 18 01:58:10 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 01:58:13.457004 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi [None req-a0ee4544-9da2-43a5-8096-ca47ac5707bd admin admin] Calling method '>' {{(pid=104169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 01:58:13.458108 n-d-465891-3 devstack@n-api.service[104169]: INFO nova.api.openstack.requestlog [None req-a0ee4544-9da2-43a5-8096-ca47ac5707bd admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001747 Jul 18 01:58:13.459000 n-d-465891-3 devstack@n-api.service[104169]: [pid: 104169|app: 0|req: 6/13] 10.222.0.57 () {54 vars in 930 bytes} [Mon Jul 18 01:58:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 01:58:13.867542 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-c9a9b3e4-73ef-409a-b74d-9737a488548d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "d3", "disk": 10, "swap": 0, "rxtx_factor": 1.0, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2}} {{(pid=104168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 01:58:13.887373 n-d-465891-3 devstack@n-api.service[104168]: INFO nova.api.openstack.requestlog [None req-c9a9b3e4-73ef-409a-b74d-9737a488548d admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.421341 Jul 18 01:58:13.888025 n-d-465891-3 devstack@n-api.service[104168]: [pid: 104168|app: 0|req: 8/14] 10.222.0.57 () {64 vars in 1282 bytes} [Mon Jul 18 01:58:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 01:58:13.900366 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi [None req-ad083b85-804f-4324-af6f-ba82309eb214 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 01:58:13.924339 n-d-465891-3 devstack@n-api.service[104169]: INFO nova.api.openstack.requestlog [None req-ad083b85-804f-4324-af6f-ba82309eb214 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028117 Jul 18 01:58:13.925067 n-d-465891-3 devstack@n-api.service[104169]: [pid: 104169|app: 0|req: 7/15] 10.222.0.57 () {64 vars in 1335 bytes} [Mon Jul 18 01:58:13 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 01:58:16.254966 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-c9a9b3e4-73ef-409a-b74d-9737a488548d admin admin] Calling method '>' {{(pid=104168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 01:58:16.256559 n-d-465891-3 devstack@n-api.service[104168]: INFO nova.api.openstack.requestlog [None req-c9a9b3e4-73ef-409a-b74d-9737a488548d admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002046 Jul 18 01:58:16.261953 n-d-465891-3 devstack@n-api.service[104168]: [pid: 104168|app: 0|req: 9/16] 10.222.0.57 () {54 vars in 930 bytes} [Mon Jul 18 01:58:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 01:58:16.769283 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi [None req-cb2c6b1b-f590-423a-b71e-9f34fcc6be6f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "swap": 0, "ram": 4096, "id": "d4", "disk": 20, "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 01:58:16.788882 n-d-465891-3 devstack@n-api.service[104169]: INFO nova.api.openstack.requestlog [None req-cb2c6b1b-f590-423a-b71e-9f34fcc6be6f admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.525221 Jul 18 01:58:16.789435 n-d-465891-3 devstack@n-api.service[104169]: [pid: 104169|app: 0|req: 8/17] 10.222.0.57 () {64 vars in 1282 bytes} [Mon Jul 18 01:58:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 01:58:16.801534 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-4b00ed8c-5f66-4072-a0f5-7d5400e3781a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 01:58:16.827559 n-d-465891-3 devstack@n-api.service[104168]: INFO nova.api.openstack.requestlog [None req-4b00ed8c-5f66-4072-a0f5-7d5400e3781a admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029656 Jul 18 01:58:16.828395 n-d-465891-3 devstack@n-api.service[104168]: [pid: 104168|app: 0|req: 10/18] 10.222.0.57 () {64 vars in 1335 bytes} [Mon Jul 18 01:58:16 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 01:58:19.260451 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi [None req-cb2c6b1b-f590-423a-b71e-9f34fcc6be6f admin admin] Calling method '>' {{(pid=104169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 01:58:19.262239 n-d-465891-3 devstack@n-api.service[104169]: INFO nova.api.openstack.requestlog [None req-cb2c6b1b-f590-423a-b71e-9f34fcc6be6f admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002834 Jul 18 01:58:19.275848 n-d-465891-3 devstack@n-api.service[104169]: [pid: 104169|app: 0|req: 9/19] 10.222.0.57 () {54 vars in 930 bytes} [Mon Jul 18 01:58:19 2022] GET /compute/v2.1 => generated 388 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 01:58:19.771205 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-0848da9e-1385-4d7b-8711-e7694bc06dd2 admin admin] Calling method '>' {{(pid=104168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 01:58:19.798446 n-d-465891-3 devstack@n-api.service[104168]: INFO nova.api.openstack.requestlog [None req-0848da9e-1385-4d7b-8711-e7694bc06dd2 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.528472 Jul 18 01:58:19.813734 n-d-465891-3 devstack@n-api.service[104168]: [pid: 104168|app: 0|req: 11/20] 10.222.0.57 () {60 vars in 1291 bytes} [Mon Jul 18 01:58:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 01:58:22.575558 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi [None req-cb2c6b1b-f590-423a-b71e-9f34fcc6be6f admin admin] Calling method '>' {{(pid=104169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 01:58:22.576662 n-d-465891-3 devstack@n-api.service[104169]: INFO nova.api.openstack.requestlog [None req-cb2c6b1b-f590-423a-b71e-9f34fcc6be6f admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jul 18 01:58:22.576984 n-d-465891-3 devstack@n-api.service[104169]: [pid: 104169|app: 0|req: 10/21] 10.222.0.57 () {54 vars in 930 bytes} [Mon Jul 18 01:58:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 01:58:23.312117 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-4594ab53-cfb1-4cb6-b3bf-818845ceea5e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "1", "name": "m1.tiny", "vcpus": 1, "ram": 512, "disk": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=104168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 01:58:23.337409 n-d-465891-3 devstack@n-api.service[104168]: INFO nova.api.openstack.requestlog [None req-4594ab53-cfb1-4cb6-b3bf-818845ceea5e admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.753139 Jul 18 01:58:23.338270 n-d-465891-3 devstack@n-api.service[104168]: [pid: 104168|app: 0|req: 12/22] 10.222.0.57 () {64 vars in 1282 bytes} [Mon Jul 18 01:58:22 2022] POST /compute/v2.1/flavors => generated 402 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 01:58:23.354814 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi [None req-78be0d98-c6f1-4114-839e-fd4f778921b8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 01:58:23.389935 n-d-465891-3 devstack@n-api.service[104169]: INFO nova.api.openstack.requestlog [None req-78be0d98-c6f1-4114-839e-fd4f778921b8 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040483 Jul 18 01:58:23.390675 n-d-465891-3 devstack@n-api.service[104169]: [pid: 104169|app: 0|req: 11/23] 10.222.0.57 () {64 vars in 1332 bytes} [Mon Jul 18 01:58:23 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 01:58:26.615133 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-4594ab53-cfb1-4cb6-b3bf-818845ceea5e admin admin] Calling method '>' {{(pid=104168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 01:58:26.616155 n-d-465891-3 devstack@n-api.service[104168]: INFO nova.api.openstack.requestlog [None req-4594ab53-cfb1-4cb6-b3bf-818845ceea5e admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jul 18 01:58:26.616585 n-d-465891-3 devstack@n-api.service[104168]: [pid: 104168|app: 0|req: 13/24] 10.222.0.57 () {54 vars in 930 bytes} [Mon Jul 18 01:58:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 01:58:27.363593 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi [None req-86e82aab-661c-4fbe-ac91-644f057cbc60 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "2", "disk": 20, "swap": 0, "vcpus": 1, "name": "m1.small", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=104169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 01:58:27.391677 n-d-465891-3 devstack@n-api.service[104169]: INFO nova.api.openstack.requestlog [None req-86e82aab-661c-4fbe-ac91-644f057cbc60 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.767614 Jul 18 01:58:27.392731 n-d-465891-3 devstack@n-api.service[104169]: [pid: 104169|app: 0|req: 12/25] 10.222.0.57 () {64 vars in 1282 bytes} [Mon Jul 18 01:58:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 01:58:27.415789 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-9b9cc1b2-2838-4dbf-b4f0-15a56bf10cdf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 01:58:27.471765 n-d-465891-3 devstack@n-api.service[104168]: INFO nova.api.openstack.requestlog [None req-9b9cc1b2-2838-4dbf-b4f0-15a56bf10cdf admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.062892 Jul 18 01:58:27.472857 n-d-465891-3 devstack@n-api.service[104168]: [pid: 104168|app: 0|req: 14/26] 10.222.0.57 () {64 vars in 1332 bytes} [Mon Jul 18 01:58:27 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 01:58:29.844767 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi [None req-86e82aab-661c-4fbe-ac91-644f057cbc60 admin admin] Calling method '>' {{(pid=104169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 01:58:29.845882 n-d-465891-3 devstack@n-api.service[104169]: INFO nova.api.openstack.requestlog [None req-86e82aab-661c-4fbe-ac91-644f057cbc60 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jul 18 01:58:29.846252 n-d-465891-3 devstack@n-api.service[104169]: [pid: 104169|app: 0|req: 13/27] 10.222.0.57 () {54 vars in 930 bytes} [Mon Jul 18 01:58:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 01:58:30.402958 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-753e8596-9d15-4467-a36f-65bc829a4a79 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0, "id": "3", "name": "m1.medium", "disk": 40, "rxtx_factor": 1.0}} {{(pid=104168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 01:58:30.428168 n-d-465891-3 devstack@n-api.service[104168]: INFO nova.api.openstack.requestlog [None req-753e8596-9d15-4467-a36f-65bc829a4a79 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.574080 Jul 18 01:58:30.429198 n-d-465891-3 devstack@n-api.service[104168]: [pid: 104168|app: 0|req: 15/28] 10.222.0.57 () {64 vars in 1282 bytes} [Mon Jul 18 01:58:29 2022] POST /compute/v2.1/flavors => generated 406 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 01:58:30.443228 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi [None req-7ae85639-a056-42ac-ac1b-f331292858aa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 01:58:30.447791 n-d-465891-3 devstack@n-api.service[104169]: DEBUG dbcounter [-] [104169] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=104169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 01:58:30.476003 n-d-465891-3 devstack@n-api.service[104169]: INFO nova.api.openstack.requestlog [None req-7ae85639-a056-42ac-ac1b-f331292858aa admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036969 Jul 18 01:58:30.477180 n-d-465891-3 devstack@n-api.service[104169]: [pid: 104169|app: 0|req: 14/29] 10.222.0.57 () {64 vars in 1332 bytes} [Mon Jul 18 01:58:30 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 01:58:33.174739 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-753e8596-9d15-4467-a36f-65bc829a4a79 admin admin] Calling method '>' {{(pid=104168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 01:58:33.176989 n-d-465891-3 devstack@n-api.service[104168]: INFO nova.api.openstack.requestlog [None req-753e8596-9d15-4467-a36f-65bc829a4a79 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002516 Jul 18 01:58:33.177625 n-d-465891-3 devstack@n-api.service[104168]: [pid: 104168|app: 0|req: 16/30] 10.222.0.57 () {54 vars in 930 bytes} [Mon Jul 18 01:58:33 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 01:58:33.850266 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi [None req-eee56c47-7347-4316-9d56-0924791eb447 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "ram": 8192, "swap": 0, "id": "4", "name": "m1.large", "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 01:58:33.871725 n-d-465891-3 devstack@n-api.service[104169]: INFO nova.api.openstack.requestlog [None req-eee56c47-7347-4316-9d56-0924791eb447 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.683349 Jul 18 01:58:33.881832 n-d-465891-3 devstack@n-api.service[104169]: [pid: 104169|app: 0|req: 15/31] 10.222.0.57 () {64 vars in 1282 bytes} [Mon Jul 18 01:58:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 01:58:33.889558 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-59f2a817-96c2-419e-8fa2-e27a2cf79977 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 01:58:33.926588 n-d-465891-3 devstack@n-api.service[104168]: INFO nova.api.openstack.requestlog [None req-59f2a817-96c2-419e-8fa2-e27a2cf79977 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040844 Jul 18 01:58:33.927301 n-d-465891-3 devstack@n-api.service[104168]: [pid: 104168|app: 0|req: 17/32] 10.222.0.57 () {64 vars in 1332 bytes} [Mon Jul 18 01:58:33 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 01:58:36.449584 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi [None req-eee56c47-7347-4316-9d56-0924791eb447 admin admin] Calling method '>' {{(pid=104169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 01:58:36.452187 n-d-465891-3 devstack@n-api.service[104169]: INFO nova.api.openstack.requestlog [None req-eee56c47-7347-4316-9d56-0924791eb447 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003311 Jul 18 01:58:36.452753 n-d-465891-3 devstack@n-api.service[104169]: [pid: 104169|app: 0|req: 16/33] 10.222.0.57 () {54 vars in 930 bytes} [Mon Jul 18 01:58:36 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 01:58:37.044733 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-e57c99d4-e416-47b5-8bf6-39070b14f830 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "id": "5", "disk": 160, "vcpus": 8}} {{(pid=104168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 01:58:37.049772 n-d-465891-3 devstack@n-api.service[104168]: DEBUG dbcounter [-] [104168] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=104168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 01:58:37.066649 n-d-465891-3 devstack@n-api.service[104168]: INFO nova.api.openstack.requestlog [None req-e57c99d4-e416-47b5-8bf6-39070b14f830 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.607284 Jul 18 01:58:37.077790 n-d-465891-3 devstack@n-api.service[104168]: [pid: 104168|app: 0|req: 18/34] 10.222.0.57 () {64 vars in 1282 bytes} [Mon Jul 18 01:58:36 2022] POST /compute/v2.1/flavors => generated 408 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 01:58:37.092131 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi [None req-21c5e9d1-bc7f-40f1-a9fe-2ddbca03b542 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 01:58:37.130266 n-d-465891-3 devstack@n-api.service[104169]: INFO nova.api.openstack.requestlog [None req-21c5e9d1-bc7f-40f1-a9fe-2ddbca03b542 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046279 Jul 18 01:58:37.137743 n-d-465891-3 devstack@n-api.service[104169]: [pid: 104169|app: 0|req: 17/35] 10.222.0.57 () {64 vars in 1332 bytes} [Mon Jul 18 01:58:37 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 01:59:00.122443 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-e57c99d4-e416-47b5-8bf6-39070b14f830 admin admin] Calling method '>' {{(pid=104168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 01:59:00.123470 n-d-465891-3 devstack@n-api.service[104168]: INFO nova.api.openstack.requestlog [None req-e57c99d4-e416-47b5-8bf6-39070b14f830 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Jul 18 01:59:00.123884 n-d-465891-3 devstack@n-api.service[104168]: [pid: 104168|app: 0|req: 19/36] 10.222.0.57 () {54 vars in 930 bytes} [Mon Jul 18 01:59:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 01:59:00.134729 n-d-465891-3 devstack@n-api.service[104169]: DEBUG dbcounter [-] [104169] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=104169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 01:59:00.522217 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi [None req-6fd6c437-6b2c-4e59-8f88-28ee56297b5a admin admin] Calling method '>' {{(pid=104169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 01:59:00.538814 n-d-465891-3 devstack@n-api.service[104169]: INFO nova.api.openstack.requestlog [None req-6fd6c437-6b2c-4e59-8f88-28ee56297b5a admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.408830 Jul 18 01:59:00.539297 n-d-465891-3 devstack@n-api.service[104169]: [pid: 104169|app: 0|req: 18/37] 10.222.0.57 () {60 vars in 1291 bytes} [Mon Jul 18 01:59:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 01:59:01.673541 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-e57c99d4-e416-47b5-8bf6-39070b14f830 admin admin] Calling method '>' {{(pid=104168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 01:59:01.674576 n-d-465891-3 devstack@n-api.service[104168]: INFO nova.api.openstack.requestlog [None req-e57c99d4-e416-47b5-8bf6-39070b14f830 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jul 18 01:59:01.674971 n-d-465891-3 devstack@n-api.service[104168]: [pid: 104168|app: 0|req: 20/38] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Jul 18 01:59:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 01:59:02.226892 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi [None req-e1d3be84-1098-4b8e-b196-06deae628d52 admin admin] Calling method '>' {{(pid=104169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 01:59:02.232478 n-d-465891-3 devstack@n-api.service[104169]: INFO nova.api.openstack.wsgi [None req-e1d3be84-1098-4b8e-b196-06deae628d52 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 18 01:59:02.235715 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi [None req-e1d3be84-1098-4b8e-b196-06deae628d52 admin admin] Request method failure captured: Jul 18 01:59:02.235715 n-d-465891-3 devstack@n-api.service[104169]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 18 01:59:02.235715 n-d-465891-3 devstack@n-api.service[104169]: Accept: application/json Jul 18 01:59:02.235715 n-d-465891-3 devstack@n-api.service[104169]: Accept-Encoding: gzip, deflate Jul 18 01:59:02.235715 n-d-465891-3 devstack@n-api.service[104169]: Connection: keep-alive Jul 18 01:59:02.235715 n-d-465891-3 devstack@n-api.service[104169]: Content-Length: 0 Jul 18 01:59:02.235715 n-d-465891-3 devstack@n-api.service[104169]: Host: 10.222.0.57 Jul 18 01:59:02.235715 n-d-465891-3 devstack@n-api.service[104169]: Openstack-Api-Version: compute 2.90 Jul 18 01:59:02.235715 n-d-465891-3 devstack@n-api.service[104169]: Openstack-System-Scope: None Jul 18 01:59:02.235715 n-d-465891-3 devstack@n-api.service[104169]: User-Agent: python-novaclient Jul 18 01:59:02.235715 n-d-465891-3 devstack@n-api.service[104169]: X-Auth-Token: gAAAAABi1L5l8nUlpzVf__ddwmo24ccUJTKMVbxVUn8P7uMMZfMaF-kDuTfd--r-hlDOS4LAp-QEnesJhxrSPIJbYPEsY_fFEtlzHl54FN2DPXJDlpYwIJBtoPaa9T3v2oXloSzB2g4dds91a0w2X3u6XCGVLBth0AiBvdabicjd6-fW0G3ZN2A Jul 18 01:59:02.235715 n-d-465891-3 devstack@n-api.service[104169]: X-Domain-Id: None Jul 18 01:59:02.235715 n-d-465891-3 devstack@n-api.service[104169]: X-Domain-Name: None Jul 18 01:59:02.235715 n-d-465891-3 devstack@n-api.service[104169]: X-Identity-Status: Confirmed Jul 18 01:59:02.235715 n-d-465891-3 devstack@n-api.service[104169]: X-Is-Admin-Project: True Jul 18 01:59:02.235715 n-d-465891-3 devstack@n-api.service[104169]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 01:59:02.235715 n-d-465891-3 devstack@n-api.service[104169]: X-Project-Domain-Id: default Jul 18 01:59:02.235715 n-d-465891-3 devstack@n-api.service[104169]: X-Project-Domain-Name: Default Jul 18 01:59:02.235715 n-d-465891-3 devstack@n-api.service[104169]: X-Project-Id: 87535bebdabf4816b725392a7f6c7412 Jul 18 01:59:02.235715 n-d-465891-3 devstack@n-api.service[104169]: X-Project-Name: admin Jul 18 01:59:02.235715 n-d-465891-3 devstack@n-api.service[104169]: X-Role: member,admin,reader Jul 18 01:59:02.235715 n-d-465891-3 devstack@n-api.service[104169]: X-Roles: member,admin,reader Jul 18 01:59:02.237375 n-d-465891-3 devstack@n-api.service[104169]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_87535bebdabf4816b725392a7f6c7412"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/87535bebdabf4816b725392a7f6c7412"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/87535bebdabf4816b725392a7f6c7412"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/87535bebdabf4816b725392a7f6c7412"}]}] Jul 18 01:59:02.237375 n-d-465891-3 devstack@n-api.service[104169]: X-Tenant: admin Jul 18 01:59:02.237375 n-d-465891-3 devstack@n-api.service[104169]: X-Tenant-Id: 87535bebdabf4816b725392a7f6c7412 Jul 18 01:59:02.237375 n-d-465891-3 devstack@n-api.service[104169]: X-Tenant-Name: admin Jul 18 01:59:02.237375 n-d-465891-3 devstack@n-api.service[104169]: X-User: admin Jul 18 01:59:02.237375 n-d-465891-3 devstack@n-api.service[104169]: X-User-Domain-Id: default Jul 18 01:59:02.237375 n-d-465891-3 devstack@n-api.service[104169]: X-User-Domain-Name: Default Jul 18 01:59:02.237375 n-d-465891-3 devstack@n-api.service[104169]: X-User-Id: 17374655ba8a4b3a8999219e78b9d3e7 Jul 18 01:59:02.237375 n-d-465891-3 devstack@n-api.service[104169]: X-User-Name: admin Jul 18 01:59:02.237375 n-d-465891-3 devstack@n-api.service[104169]: method: > Jul 18 01:59:02.237375 n-d-465891-3 devstack@n-api.service[104169]: exception: Flavor 42 could not be found. Jul 18 01:59:02.237375 n-d-465891-3 devstack@n-api.service[104169]: action_args: {'id': '42'} Jul 18 01:59:02.237375 n-d-465891-3 devstack@n-api.service[104169]: {{(pid=104169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 01:59:02.237375 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 01:59:02.238335 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 01:59:02.238335 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 01:59:02.238335 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 01:59:02.238335 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 01:59:02.238335 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 01:59:02.238335 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 01:59:02.238335 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 01:59:02.238335 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 01:59:02.238335 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 01:59:02.238335 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 01:59:02.238335 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 01:59:02.238335 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 01:59:02.238335 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 18 01:59:02.238335 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi Jul 18 01:59:02.238335 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 01:59:02.238335 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi Jul 18 01:59:02.238335 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 01:59:02.238335 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 01:59:02.238335 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 01:59:02.240174 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 01:59:02.240174 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 01:59:02.240174 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 01:59:02.240174 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 01:59:02.240174 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 01:59:02.240174 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 01:59:02.240174 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 18 01:59:02.240174 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi Jul 18 01:59:02.240174 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 01:59:02.240174 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi Jul 18 01:59:02.240174 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 01:59:02.240174 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 01:59:02.240174 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 01:59:02.240174 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 01:59:02.240174 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 01:59:02.240174 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 18 01:59:02.240174 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi Jul 18 01:59:02.240174 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi [None req-e1d3be84-1098-4b8e-b196-06deae628d52 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 01:59:02.241656 n-d-465891-3 devstack@n-api.service[104169]: INFO nova.api.openstack.requestlog [None req-e1d3be84-1098-4b8e-b196-06deae628d52 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.401362 Jul 18 01:59:02.241656 n-d-465891-3 devstack@n-api.service[104169]: [pid: 104169|app: 0|req: 19/39] 10.222.0.57 () {60 vars in 1190 bytes} [Mon Jul 18 01:59:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 18 01:59:02.247336 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-a2a545d3-8968-4f29-91dd-7a6e6075da14 admin admin] Calling method '>' {{(pid=104168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 01:59:02.269565 n-d-465891-3 devstack@n-api.service[104168]: INFO nova.api.openstack.requestlog [None req-a2a545d3-8968-4f29-91dd-7a6e6075da14 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025809 Jul 18 01:59:02.270139 n-d-465891-3 devstack@n-api.service[104168]: [pid: 104168|app: 0|req: 21/40] 10.222.0.57 () {60 vars in 1210 bytes} [Mon Jul 18 01:59:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 01:59:02.290409 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi [None req-200515d3-f92d-41d8-8ef8-f9183f8d6f02 admin admin] Calling method '>' {{(pid=104169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 01:59:02.312118 n-d-465891-3 devstack@n-api.service[104169]: INFO nova.api.openstack.requestlog [None req-200515d3-f92d-41d8-8ef8-f9183f8d6f02 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025216 Jul 18 01:59:02.312675 n-d-465891-3 devstack@n-api.service[104169]: [pid: 104169|app: 0|req: 20/41] 10.222.0.57 () {60 vars in 1210 bytes} [Mon Jul 18 01:59:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 01:59:02.322747 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-46415f2a-4269-4e19-8733-5ecb2c2e355a admin admin] Calling method '>' {{(pid=104168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 01:59:02.328513 n-d-465891-3 devstack@n-api.service[104168]: INFO nova.api.openstack.wsgi [None req-46415f2a-4269-4e19-8733-5ecb2c2e355a admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 18 01:59:02.331796 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-46415f2a-4269-4e19-8733-5ecb2c2e355a admin admin] Request method failure captured: Jul 18 01:59:02.331796 n-d-465891-3 devstack@n-api.service[104168]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 18 01:59:02.331796 n-d-465891-3 devstack@n-api.service[104168]: Accept: application/json Jul 18 01:59:02.331796 n-d-465891-3 devstack@n-api.service[104168]: Accept-Encoding: gzip, deflate Jul 18 01:59:02.331796 n-d-465891-3 devstack@n-api.service[104168]: Connection: keep-alive Jul 18 01:59:02.331796 n-d-465891-3 devstack@n-api.service[104168]: Content-Length: 0 Jul 18 01:59:02.331796 n-d-465891-3 devstack@n-api.service[104168]: Host: 10.222.0.57 Jul 18 01:59:02.331796 n-d-465891-3 devstack@n-api.service[104168]: Openstack-Api-Version: compute 2.90 Jul 18 01:59:02.331796 n-d-465891-3 devstack@n-api.service[104168]: Openstack-System-Scope: None Jul 18 01:59:02.331796 n-d-465891-3 devstack@n-api.service[104168]: User-Agent: python-novaclient Jul 18 01:59:02.331796 n-d-465891-3 devstack@n-api.service[104168]: X-Auth-Token: gAAAAABi1L5l8nUlpzVf__ddwmo24ccUJTKMVbxVUn8P7uMMZfMaF-kDuTfd--r-hlDOS4LAp-QEnesJhxrSPIJbYPEsY_fFEtlzHl54FN2DPXJDlpYwIJBtoPaa9T3v2oXloSzB2g4dds91a0w2X3u6XCGVLBth0AiBvdabicjd6-fW0G3ZN2A Jul 18 01:59:02.331796 n-d-465891-3 devstack@n-api.service[104168]: X-Domain-Id: None Jul 18 01:59:02.331796 n-d-465891-3 devstack@n-api.service[104168]: X-Domain-Name: None Jul 18 01:59:02.331796 n-d-465891-3 devstack@n-api.service[104168]: X-Identity-Status: Confirmed Jul 18 01:59:02.331796 n-d-465891-3 devstack@n-api.service[104168]: X-Is-Admin-Project: True Jul 18 01:59:02.331796 n-d-465891-3 devstack@n-api.service[104168]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 01:59:02.331796 n-d-465891-3 devstack@n-api.service[104168]: X-Project-Domain-Id: default Jul 18 01:59:02.331796 n-d-465891-3 devstack@n-api.service[104168]: X-Project-Domain-Name: Default Jul 18 01:59:02.331796 n-d-465891-3 devstack@n-api.service[104168]: X-Project-Id: 87535bebdabf4816b725392a7f6c7412 Jul 18 01:59:02.331796 n-d-465891-3 devstack@n-api.service[104168]: X-Project-Name: admin Jul 18 01:59:02.331796 n-d-465891-3 devstack@n-api.service[104168]: X-Role: member,admin,reader Jul 18 01:59:02.331796 n-d-465891-3 devstack@n-api.service[104168]: X-Roles: member,admin,reader Jul 18 01:59:02.333429 n-d-465891-3 devstack@n-api.service[104168]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_87535bebdabf4816b725392a7f6c7412"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/87535bebdabf4816b725392a7f6c7412"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/87535bebdabf4816b725392a7f6c7412"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/87535bebdabf4816b725392a7f6c7412"}]}] Jul 18 01:59:02.333429 n-d-465891-3 devstack@n-api.service[104168]: X-Tenant: admin Jul 18 01:59:02.333429 n-d-465891-3 devstack@n-api.service[104168]: X-Tenant-Id: 87535bebdabf4816b725392a7f6c7412 Jul 18 01:59:02.333429 n-d-465891-3 devstack@n-api.service[104168]: X-Tenant-Name: admin Jul 18 01:59:02.333429 n-d-465891-3 devstack@n-api.service[104168]: X-User: admin Jul 18 01:59:02.333429 n-d-465891-3 devstack@n-api.service[104168]: X-User-Domain-Id: default Jul 18 01:59:02.333429 n-d-465891-3 devstack@n-api.service[104168]: X-User-Domain-Name: Default Jul 18 01:59:02.333429 n-d-465891-3 devstack@n-api.service[104168]: X-User-Id: 17374655ba8a4b3a8999219e78b9d3e7 Jul 18 01:59:02.333429 n-d-465891-3 devstack@n-api.service[104168]: X-User-Name: admin Jul 18 01:59:02.333429 n-d-465891-3 devstack@n-api.service[104168]: method: > Jul 18 01:59:02.333429 n-d-465891-3 devstack@n-api.service[104168]: exception: Flavor 42 could not be found. Jul 18 01:59:02.333429 n-d-465891-3 devstack@n-api.service[104168]: action_args: {'id': '42'} Jul 18 01:59:02.333429 n-d-465891-3 devstack@n-api.service[104168]: {{(pid=104168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 01:59:02.333429 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 01:59:02.334402 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 01:59:02.334402 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 01:59:02.334402 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 01:59:02.334402 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 01:59:02.334402 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 01:59:02.334402 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 01:59:02.334402 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 01:59:02.334402 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 01:59:02.334402 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 01:59:02.334402 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 01:59:02.334402 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 01:59:02.334402 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 01:59:02.334402 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 18 01:59:02.334402 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi Jul 18 01:59:02.334402 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 01:59:02.334402 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi Jul 18 01:59:02.334402 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 01:59:02.334402 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 01:59:02.334402 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 01:59:02.335744 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 01:59:02.335744 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 01:59:02.335744 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 01:59:02.335744 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 01:59:02.335744 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 01:59:02.335744 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 01:59:02.335744 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 18 01:59:02.335744 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi Jul 18 01:59:02.335744 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 01:59:02.335744 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi Jul 18 01:59:02.335744 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 01:59:02.335744 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 01:59:02.335744 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 01:59:02.335744 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 01:59:02.335744 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 01:59:02.335744 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 18 01:59:02.335744 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi Jul 18 01:59:02.335744 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-46415f2a-4269-4e19-8733-5ecb2c2e355a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 01:59:02.336947 n-d-465891-3 devstack@n-api.service[104168]: INFO nova.api.openstack.requestlog [None req-46415f2a-4269-4e19-8733-5ecb2c2e355a admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014016 Jul 18 01:59:02.336947 n-d-465891-3 devstack@n-api.service[104168]: [pid: 104168|app: 0|req: 22/42] 10.222.0.57 () {60 vars in 1190 bytes} [Mon Jul 18 01:59:02 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 18 01:59:03.310821 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi [None req-200515d3-f92d-41d8-8ef8-f9183f8d6f02 admin admin] Calling method '>' {{(pid=104169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 01:59:03.311838 n-d-465891-3 devstack@n-api.service[104169]: INFO nova.api.openstack.requestlog [None req-200515d3-f92d-41d8-8ef8-f9183f8d6f02 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jul 18 01:59:03.312241 n-d-465891-3 devstack@n-api.service[104169]: [pid: 104169|app: 0|req: 21/43] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Jul 18 01:59:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 01:59:03.910928 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-5f69f07c-9b75-4f1d-961f-cd7bc200ecd9 admin admin] Calling method '>' {{(pid=104168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 01:59:03.918297 n-d-465891-3 devstack@n-api.service[104168]: INFO nova.api.openstack.wsgi [None req-5f69f07c-9b75-4f1d-961f-cd7bc200ecd9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 18 01:59:03.919800 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-5f69f07c-9b75-4f1d-961f-cd7bc200ecd9 admin admin] Request method failure captured: Jul 18 01:59:03.919800 n-d-465891-3 devstack@n-api.service[104168]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 18 01:59:03.919800 n-d-465891-3 devstack@n-api.service[104168]: Accept: application/json Jul 18 01:59:03.919800 n-d-465891-3 devstack@n-api.service[104168]: Accept-Encoding: gzip, deflate Jul 18 01:59:03.919800 n-d-465891-3 devstack@n-api.service[104168]: Connection: keep-alive Jul 18 01:59:03.919800 n-d-465891-3 devstack@n-api.service[104168]: Content-Length: 0 Jul 18 01:59:03.919800 n-d-465891-3 devstack@n-api.service[104168]: Host: 10.222.0.57 Jul 18 01:59:03.919800 n-d-465891-3 devstack@n-api.service[104168]: Openstack-Api-Version: compute 2.90 Jul 18 01:59:03.919800 n-d-465891-3 devstack@n-api.service[104168]: Openstack-System-Scope: None Jul 18 01:59:03.919800 n-d-465891-3 devstack@n-api.service[104168]: User-Agent: python-novaclient Jul 18 01:59:03.919800 n-d-465891-3 devstack@n-api.service[104168]: X-Auth-Token: gAAAAABi1L5nM9pSEL_69C8PTBIuN_uhmhNTIabngMkZcWq2XfgrRQreFt7TGFR-c3ry0OIIeEEVzAdNEeKSMVZhiEBw40Lm-vSPfr7vwPlz6OhqN1tFo97mBAtk5y4VfDw8LQc3YzWJuJaT1trDTFuIq8DFXcnhHL2TudfIJjTO_lHQTyn4ZY8 Jul 18 01:59:03.919800 n-d-465891-3 devstack@n-api.service[104168]: X-Domain-Id: None Jul 18 01:59:03.919800 n-d-465891-3 devstack@n-api.service[104168]: X-Domain-Name: None Jul 18 01:59:03.919800 n-d-465891-3 devstack@n-api.service[104168]: X-Identity-Status: Confirmed Jul 18 01:59:03.919800 n-d-465891-3 devstack@n-api.service[104168]: X-Is-Admin-Project: True Jul 18 01:59:03.919800 n-d-465891-3 devstack@n-api.service[104168]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 01:59:03.919800 n-d-465891-3 devstack@n-api.service[104168]: X-Project-Domain-Id: default Jul 18 01:59:03.919800 n-d-465891-3 devstack@n-api.service[104168]: X-Project-Domain-Name: Default Jul 18 01:59:03.919800 n-d-465891-3 devstack@n-api.service[104168]: X-Project-Id: 87535bebdabf4816b725392a7f6c7412 Jul 18 01:59:03.919800 n-d-465891-3 devstack@n-api.service[104168]: X-Project-Name: admin Jul 18 01:59:03.919800 n-d-465891-3 devstack@n-api.service[104168]: X-Role: member,admin,reader Jul 18 01:59:03.919800 n-d-465891-3 devstack@n-api.service[104168]: X-Roles: member,admin,reader Jul 18 01:59:03.921308 n-d-465891-3 devstack@n-api.service[104168]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_87535bebdabf4816b725392a7f6c7412"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/87535bebdabf4816b725392a7f6c7412"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/87535bebdabf4816b725392a7f6c7412"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/87535bebdabf4816b725392a7f6c7412"}]}] Jul 18 01:59:03.921308 n-d-465891-3 devstack@n-api.service[104168]: X-Tenant: admin Jul 18 01:59:03.921308 n-d-465891-3 devstack@n-api.service[104168]: X-Tenant-Id: 87535bebdabf4816b725392a7f6c7412 Jul 18 01:59:03.921308 n-d-465891-3 devstack@n-api.service[104168]: X-Tenant-Name: admin Jul 18 01:59:03.921308 n-d-465891-3 devstack@n-api.service[104168]: X-User: admin Jul 18 01:59:03.921308 n-d-465891-3 devstack@n-api.service[104168]: X-User-Domain-Id: default Jul 18 01:59:03.921308 n-d-465891-3 devstack@n-api.service[104168]: X-User-Domain-Name: Default Jul 18 01:59:03.921308 n-d-465891-3 devstack@n-api.service[104168]: X-User-Id: 17374655ba8a4b3a8999219e78b9d3e7 Jul 18 01:59:03.921308 n-d-465891-3 devstack@n-api.service[104168]: X-User-Name: admin Jul 18 01:59:03.921308 n-d-465891-3 devstack@n-api.service[104168]: method: > Jul 18 01:59:03.921308 n-d-465891-3 devstack@n-api.service[104168]: exception: Flavor 84 could not be found. Jul 18 01:59:03.921308 n-d-465891-3 devstack@n-api.service[104168]: action_args: {'id': '84'} Jul 18 01:59:03.921308 n-d-465891-3 devstack@n-api.service[104168]: {{(pid=104168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 01:59:03.921308 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 01:59:03.922277 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 01:59:03.922277 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 01:59:03.922277 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 01:59:03.922277 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 01:59:03.922277 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 01:59:03.922277 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 01:59:03.922277 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 01:59:03.922277 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 01:59:03.922277 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 01:59:03.922277 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 01:59:03.922277 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 01:59:03.922277 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 01:59:03.922277 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 18 01:59:03.922277 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi Jul 18 01:59:03.922277 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 01:59:03.922277 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi Jul 18 01:59:03.922277 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 01:59:03.922277 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 01:59:03.922277 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 01:59:03.923557 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 01:59:03.923557 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 01:59:03.923557 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 01:59:03.923557 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 01:59:03.923557 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 01:59:03.923557 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 01:59:03.923557 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 18 01:59:03.923557 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi Jul 18 01:59:03.923557 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 01:59:03.923557 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi Jul 18 01:59:03.923557 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 01:59:03.923557 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 01:59:03.923557 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 01:59:03.923557 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 01:59:03.923557 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 01:59:03.923557 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 18 01:59:03.923557 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi Jul 18 01:59:03.923557 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-5f69f07c-9b75-4f1d-961f-cd7bc200ecd9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 01:59:03.924789 n-d-465891-3 devstack@n-api.service[104168]: INFO nova.api.openstack.requestlog [None req-5f69f07c-9b75-4f1d-961f-cd7bc200ecd9 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.470397 Jul 18 01:59:03.924789 n-d-465891-3 devstack@n-api.service[104168]: [pid: 104168|app: 0|req: 23/44] 10.222.0.57 () {60 vars in 1190 bytes} [Mon Jul 18 01:59:03 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 472 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 01:59:03.932090 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi [None req-ac7a0cc6-f9ae-42c7-b384-69d1f16fb910 admin admin] Calling method '>' {{(pid=104169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 01:59:03.945945 n-d-465891-3 devstack@n-api.service[104169]: INFO nova.api.openstack.requestlog [None req-ac7a0cc6-f9ae-42c7-b384-69d1f16fb910 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017430 Jul 18 01:59:03.946489 n-d-465891-3 devstack@n-api.service[104169]: [pid: 104169|app: 0|req: 22/45] 10.222.0.57 () {60 vars in 1210 bytes} [Mon Jul 18 01:59:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 01:59:03.956129 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-e1e61fef-2657-4b66-b143-fab6229eb535 admin admin] Calling method '>' {{(pid=104168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 01:59:03.970227 n-d-465891-3 devstack@n-api.service[104168]: INFO nova.api.openstack.requestlog [None req-e1e61fef-2657-4b66-b143-fab6229eb535 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017693 Jul 18 01:59:03.970767 n-d-465891-3 devstack@n-api.service[104168]: [pid: 104168|app: 0|req: 24/46] 10.222.0.57 () {60 vars in 1210 bytes} [Mon Jul 18 01:59:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 01:59:03.981470 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi [None req-00717de0-da0a-44ce-a217-3657d84ac7e8 admin admin] Calling method '>' {{(pid=104169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 01:59:03.986882 n-d-465891-3 devstack@n-api.service[104169]: INFO nova.api.openstack.wsgi [None req-00717de0-da0a-44ce-a217-3657d84ac7e8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 18 01:59:03.988381 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi [None req-00717de0-da0a-44ce-a217-3657d84ac7e8 admin admin] Request method failure captured: Jul 18 01:59:03.988381 n-d-465891-3 devstack@n-api.service[104169]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 18 01:59:03.988381 n-d-465891-3 devstack@n-api.service[104169]: Accept: application/json Jul 18 01:59:03.988381 n-d-465891-3 devstack@n-api.service[104169]: Accept-Encoding: gzip, deflate Jul 18 01:59:03.988381 n-d-465891-3 devstack@n-api.service[104169]: Connection: keep-alive Jul 18 01:59:03.988381 n-d-465891-3 devstack@n-api.service[104169]: Content-Length: 0 Jul 18 01:59:03.988381 n-d-465891-3 devstack@n-api.service[104169]: Host: 10.222.0.57 Jul 18 01:59:03.988381 n-d-465891-3 devstack@n-api.service[104169]: Openstack-Api-Version: compute 2.90 Jul 18 01:59:03.988381 n-d-465891-3 devstack@n-api.service[104169]: Openstack-System-Scope: None Jul 18 01:59:03.988381 n-d-465891-3 devstack@n-api.service[104169]: User-Agent: python-novaclient Jul 18 01:59:03.988381 n-d-465891-3 devstack@n-api.service[104169]: X-Auth-Token: gAAAAABi1L5nM9pSEL_69C8PTBIuN_uhmhNTIabngMkZcWq2XfgrRQreFt7TGFR-c3ry0OIIeEEVzAdNEeKSMVZhiEBw40Lm-vSPfr7vwPlz6OhqN1tFo97mBAtk5y4VfDw8LQc3YzWJuJaT1trDTFuIq8DFXcnhHL2TudfIJjTO_lHQTyn4ZY8 Jul 18 01:59:03.988381 n-d-465891-3 devstack@n-api.service[104169]: X-Domain-Id: None Jul 18 01:59:03.988381 n-d-465891-3 devstack@n-api.service[104169]: X-Domain-Name: None Jul 18 01:59:03.988381 n-d-465891-3 devstack@n-api.service[104169]: X-Identity-Status: Confirmed Jul 18 01:59:03.988381 n-d-465891-3 devstack@n-api.service[104169]: X-Is-Admin-Project: True Jul 18 01:59:03.988381 n-d-465891-3 devstack@n-api.service[104169]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 01:59:03.988381 n-d-465891-3 devstack@n-api.service[104169]: X-Project-Domain-Id: default Jul 18 01:59:03.988381 n-d-465891-3 devstack@n-api.service[104169]: X-Project-Domain-Name: Default Jul 18 01:59:03.988381 n-d-465891-3 devstack@n-api.service[104169]: X-Project-Id: 87535bebdabf4816b725392a7f6c7412 Jul 18 01:59:03.988381 n-d-465891-3 devstack@n-api.service[104169]: X-Project-Name: admin Jul 18 01:59:03.988381 n-d-465891-3 devstack@n-api.service[104169]: X-Role: member,admin,reader Jul 18 01:59:03.988381 n-d-465891-3 devstack@n-api.service[104169]: X-Roles: member,admin,reader Jul 18 01:59:03.990631 n-d-465891-3 devstack@n-api.service[104169]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_87535bebdabf4816b725392a7f6c7412"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/87535bebdabf4816b725392a7f6c7412"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/87535bebdabf4816b725392a7f6c7412"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/87535bebdabf4816b725392a7f6c7412"}]}] Jul 18 01:59:03.990631 n-d-465891-3 devstack@n-api.service[104169]: X-Tenant: admin Jul 18 01:59:03.990631 n-d-465891-3 devstack@n-api.service[104169]: X-Tenant-Id: 87535bebdabf4816b725392a7f6c7412 Jul 18 01:59:03.990631 n-d-465891-3 devstack@n-api.service[104169]: X-Tenant-Name: admin Jul 18 01:59:03.990631 n-d-465891-3 devstack@n-api.service[104169]: X-User: admin Jul 18 01:59:03.990631 n-d-465891-3 devstack@n-api.service[104169]: X-User-Domain-Id: default Jul 18 01:59:03.990631 n-d-465891-3 devstack@n-api.service[104169]: X-User-Domain-Name: Default Jul 18 01:59:03.990631 n-d-465891-3 devstack@n-api.service[104169]: X-User-Id: 17374655ba8a4b3a8999219e78b9d3e7 Jul 18 01:59:03.990631 n-d-465891-3 devstack@n-api.service[104169]: X-User-Name: admin Jul 18 01:59:03.990631 n-d-465891-3 devstack@n-api.service[104169]: method: > Jul 18 01:59:03.990631 n-d-465891-3 devstack@n-api.service[104169]: exception: Flavor 84 could not be found. Jul 18 01:59:03.990631 n-d-465891-3 devstack@n-api.service[104169]: action_args: {'id': '84'} Jul 18 01:59:03.990631 n-d-465891-3 devstack@n-api.service[104169]: {{(pid=104169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 01:59:03.990631 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 01:59:03.991531 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 01:59:03.991531 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 01:59:03.991531 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 01:59:03.991531 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 01:59:03.991531 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 01:59:03.991531 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 01:59:03.991531 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 01:59:03.991531 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 01:59:03.991531 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 01:59:03.991531 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 01:59:03.991531 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 01:59:03.991531 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 01:59:03.991531 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 18 01:59:03.991531 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi Jul 18 01:59:03.991531 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 01:59:03.991531 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi Jul 18 01:59:03.991531 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 01:59:03.991531 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 01:59:03.991531 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 01:59:03.992695 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 01:59:03.992695 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 01:59:03.992695 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 01:59:03.992695 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 01:59:03.992695 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 01:59:03.992695 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 01:59:03.992695 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 18 01:59:03.992695 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi Jul 18 01:59:03.992695 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 01:59:03.992695 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi Jul 18 01:59:03.992695 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 01:59:03.992695 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 01:59:03.992695 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 01:59:03.992695 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 01:59:03.992695 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 01:59:03.992695 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 18 01:59:03.992695 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi Jul 18 01:59:03.992695 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi [None req-00717de0-da0a-44ce-a217-3657d84ac7e8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 01:59:03.993994 n-d-465891-3 devstack@n-api.service[104169]: INFO nova.api.openstack.requestlog [None req-00717de0-da0a-44ce-a217-3657d84ac7e8 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011829 Jul 18 01:59:03.993994 n-d-465891-3 devstack@n-api.service[104169]: [pid: 104169|app: 0|req: 23/47] 10.222.0.57 () {60 vars in 1190 bytes} [Mon Jul 18 01:59:03 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 01:59:04.975913 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-e1e61fef-2657-4b66-b143-fab6229eb535 admin admin] Calling method '>' {{(pid=104168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 01:59:04.976921 n-d-465891-3 devstack@n-api.service[104168]: INFO nova.api.openstack.requestlog [None req-e1e61fef-2657-4b66-b143-fab6229eb535 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jul 18 01:59:04.977321 n-d-465891-3 devstack@n-api.service[104168]: [pid: 104168|app: 0|req: 25/48] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Jul 18 01:59:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 01:59:05.508678 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi [None req-8711b986-5d58-4d89-8ee5-4ceff27c0d90 admin admin] Calling method '>' {{(pid=104169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 01:59:05.514468 n-d-465891-3 devstack@n-api.service[104169]: INFO nova.api.openstack.wsgi [None req-8711b986-5d58-4d89-8ee5-4ceff27c0d90 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 18 01:59:05.515966 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi [None req-8711b986-5d58-4d89-8ee5-4ceff27c0d90 admin admin] Request method failure captured: Jul 18 01:59:05.515966 n-d-465891-3 devstack@n-api.service[104169]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 18 01:59:05.515966 n-d-465891-3 devstack@n-api.service[104169]: Accept: application/json Jul 18 01:59:05.515966 n-d-465891-3 devstack@n-api.service[104169]: Accept-Encoding: gzip, deflate Jul 18 01:59:05.515966 n-d-465891-3 devstack@n-api.service[104169]: Connection: keep-alive Jul 18 01:59:05.515966 n-d-465891-3 devstack@n-api.service[104169]: Content-Length: 0 Jul 18 01:59:05.515966 n-d-465891-3 devstack@n-api.service[104169]: Host: 10.222.0.57 Jul 18 01:59:05.515966 n-d-465891-3 devstack@n-api.service[104169]: Openstack-Api-Version: compute 2.90 Jul 18 01:59:05.515966 n-d-465891-3 devstack@n-api.service[104169]: Openstack-System-Scope: None Jul 18 01:59:05.515966 n-d-465891-3 devstack@n-api.service[104169]: User-Agent: python-novaclient Jul 18 01:59:05.515966 n-d-465891-3 devstack@n-api.service[104169]: X-Auth-Token: gAAAAABi1L5oR3q6TCNXGuf2WTimfKs3pseKNIHT56WbJZuIdGJh8MYtJtC1qGm7WCvsMRU9eUzskaPCZPcwYooDZh3xDdipmzRZaV9wnNLgAGMEwn4HGRjz4HrW3EBKr7zMALAX-Lwg_HrvYxm5w8RWEcMwShYBmscfNP3st1UR6uFlA_Lflsk Jul 18 01:59:05.515966 n-d-465891-3 devstack@n-api.service[104169]: X-Domain-Id: None Jul 18 01:59:05.515966 n-d-465891-3 devstack@n-api.service[104169]: X-Domain-Name: None Jul 18 01:59:05.515966 n-d-465891-3 devstack@n-api.service[104169]: X-Identity-Status: Confirmed Jul 18 01:59:05.515966 n-d-465891-3 devstack@n-api.service[104169]: X-Is-Admin-Project: True Jul 18 01:59:05.515966 n-d-465891-3 devstack@n-api.service[104169]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 01:59:05.515966 n-d-465891-3 devstack@n-api.service[104169]: X-Project-Domain-Id: default Jul 18 01:59:05.515966 n-d-465891-3 devstack@n-api.service[104169]: X-Project-Domain-Name: Default Jul 18 01:59:05.515966 n-d-465891-3 devstack@n-api.service[104169]: X-Project-Id: 87535bebdabf4816b725392a7f6c7412 Jul 18 01:59:05.515966 n-d-465891-3 devstack@n-api.service[104169]: X-Project-Name: admin Jul 18 01:59:05.515966 n-d-465891-3 devstack@n-api.service[104169]: X-Role: member,admin,reader Jul 18 01:59:05.515966 n-d-465891-3 devstack@n-api.service[104169]: X-Roles: member,admin,reader Jul 18 01:59:05.517504 n-d-465891-3 devstack@n-api.service[104169]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_87535bebdabf4816b725392a7f6c7412"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/87535bebdabf4816b725392a7f6c7412"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/87535bebdabf4816b725392a7f6c7412"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/87535bebdabf4816b725392a7f6c7412"}]}] Jul 18 01:59:05.517504 n-d-465891-3 devstack@n-api.service[104169]: X-Tenant: admin Jul 18 01:59:05.517504 n-d-465891-3 devstack@n-api.service[104169]: X-Tenant-Id: 87535bebdabf4816b725392a7f6c7412 Jul 18 01:59:05.517504 n-d-465891-3 devstack@n-api.service[104169]: X-Tenant-Name: admin Jul 18 01:59:05.517504 n-d-465891-3 devstack@n-api.service[104169]: X-User: admin Jul 18 01:59:05.517504 n-d-465891-3 devstack@n-api.service[104169]: X-User-Domain-Id: default Jul 18 01:59:05.517504 n-d-465891-3 devstack@n-api.service[104169]: X-User-Domain-Name: Default Jul 18 01:59:05.517504 n-d-465891-3 devstack@n-api.service[104169]: X-User-Id: 17374655ba8a4b3a8999219e78b9d3e7 Jul 18 01:59:05.517504 n-d-465891-3 devstack@n-api.service[104169]: X-User-Name: admin Jul 18 01:59:05.517504 n-d-465891-3 devstack@n-api.service[104169]: method: > Jul 18 01:59:05.517504 n-d-465891-3 devstack@n-api.service[104169]: exception: Flavor 451 could not be found. Jul 18 01:59:05.517504 n-d-465891-3 devstack@n-api.service[104169]: action_args: {'id': '451'} Jul 18 01:59:05.517504 n-d-465891-3 devstack@n-api.service[104169]: {{(pid=104169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 01:59:05.517504 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 01:59:05.522259 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 01:59:05.522259 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 01:59:05.522259 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 01:59:05.522259 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 01:59:05.522259 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 01:59:05.522259 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 01:59:05.522259 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 01:59:05.522259 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 01:59:05.522259 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 01:59:05.522259 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 01:59:05.522259 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 01:59:05.522259 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 01:59:05.522259 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 18 01:59:05.522259 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi Jul 18 01:59:05.522259 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 01:59:05.522259 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi Jul 18 01:59:05.522259 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 01:59:05.522259 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 01:59:05.522259 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 01:59:05.523436 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 01:59:05.523436 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 01:59:05.523436 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 01:59:05.523436 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 01:59:05.523436 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 01:59:05.523436 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 01:59:05.523436 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 18 01:59:05.523436 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi Jul 18 01:59:05.523436 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 01:59:05.523436 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi Jul 18 01:59:05.523436 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 01:59:05.523436 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 01:59:05.523436 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 01:59:05.523436 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 01:59:05.523436 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 01:59:05.523436 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 18 01:59:05.523436 n-d-465891-3 devstack@n-api.service[104169]: ERROR nova.api.openstack.wsgi Jul 18 01:59:05.523436 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi [None req-8711b986-5d58-4d89-8ee5-4ceff27c0d90 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 01:59:05.525400 n-d-465891-3 devstack@n-api.service[104169]: INFO nova.api.openstack.requestlog [None req-8711b986-5d58-4d89-8ee5-4ceff27c0d90 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.399047 Jul 18 01:59:05.525400 n-d-465891-3 devstack@n-api.service[104169]: [pid: 104169|app: 0|req: 24/49] 10.222.0.57 () {60 vars in 1193 bytes} [Mon Jul 18 01:59:05 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 01:59:05.528133 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-9e630016-1d9e-4e5b-a6a9-31792357eb9a admin admin] Calling method '>' {{(pid=104168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 01:59:05.542551 n-d-465891-3 devstack@n-api.service[104168]: INFO nova.api.openstack.requestlog [None req-9e630016-1d9e-4e5b-a6a9-31792357eb9a admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017941 Jul 18 01:59:05.543110 n-d-465891-3 devstack@n-api.service[104168]: [pid: 104168|app: 0|req: 26/50] 10.222.0.57 () {60 vars in 1210 bytes} [Mon Jul 18 01:59:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 01:59:05.553058 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi [None req-cab3664a-eba0-4902-a4e9-c18a3f8232ac admin admin] Calling method '>' {{(pid=104169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 01:59:05.568563 n-d-465891-3 devstack@n-api.service[104169]: INFO nova.api.openstack.requestlog [None req-cab3664a-eba0-4902-a4e9-c18a3f8232ac admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019206 Jul 18 01:59:05.569326 n-d-465891-3 devstack@n-api.service[104169]: [pid: 104169|app: 0|req: 25/51] 10.222.0.57 () {60 vars in 1210 bytes} [Mon Jul 18 01:59:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 01:59:05.578914 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-cc4c62c8-03c4-41e4-a59d-f6569289eca2 admin admin] Calling method '>' {{(pid=104168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 01:59:05.585165 n-d-465891-3 devstack@n-api.service[104168]: INFO nova.api.openstack.wsgi [None req-cc4c62c8-03c4-41e4-a59d-f6569289eca2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 18 01:59:05.586715 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-cc4c62c8-03c4-41e4-a59d-f6569289eca2 admin admin] Request method failure captured: Jul 18 01:59:05.586715 n-d-465891-3 devstack@n-api.service[104168]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 18 01:59:05.586715 n-d-465891-3 devstack@n-api.service[104168]: Accept: application/json Jul 18 01:59:05.586715 n-d-465891-3 devstack@n-api.service[104168]: Accept-Encoding: gzip, deflate Jul 18 01:59:05.586715 n-d-465891-3 devstack@n-api.service[104168]: Connection: keep-alive Jul 18 01:59:05.586715 n-d-465891-3 devstack@n-api.service[104168]: Content-Length: 0 Jul 18 01:59:05.586715 n-d-465891-3 devstack@n-api.service[104168]: Host: 10.222.0.57 Jul 18 01:59:05.586715 n-d-465891-3 devstack@n-api.service[104168]: Openstack-Api-Version: compute 2.90 Jul 18 01:59:05.586715 n-d-465891-3 devstack@n-api.service[104168]: Openstack-System-Scope: None Jul 18 01:59:05.586715 n-d-465891-3 devstack@n-api.service[104168]: User-Agent: python-novaclient Jul 18 01:59:05.586715 n-d-465891-3 devstack@n-api.service[104168]: X-Auth-Token: gAAAAABi1L5oR3q6TCNXGuf2WTimfKs3pseKNIHT56WbJZuIdGJh8MYtJtC1qGm7WCvsMRU9eUzskaPCZPcwYooDZh3xDdipmzRZaV9wnNLgAGMEwn4HGRjz4HrW3EBKr7zMALAX-Lwg_HrvYxm5w8RWEcMwShYBmscfNP3st1UR6uFlA_Lflsk Jul 18 01:59:05.586715 n-d-465891-3 devstack@n-api.service[104168]: X-Domain-Id: None Jul 18 01:59:05.586715 n-d-465891-3 devstack@n-api.service[104168]: X-Domain-Name: None Jul 18 01:59:05.586715 n-d-465891-3 devstack@n-api.service[104168]: X-Identity-Status: Confirmed Jul 18 01:59:05.586715 n-d-465891-3 devstack@n-api.service[104168]: X-Is-Admin-Project: True Jul 18 01:59:05.586715 n-d-465891-3 devstack@n-api.service[104168]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 01:59:05.586715 n-d-465891-3 devstack@n-api.service[104168]: X-Project-Domain-Id: default Jul 18 01:59:05.586715 n-d-465891-3 devstack@n-api.service[104168]: X-Project-Domain-Name: Default Jul 18 01:59:05.586715 n-d-465891-3 devstack@n-api.service[104168]: X-Project-Id: 87535bebdabf4816b725392a7f6c7412 Jul 18 01:59:05.586715 n-d-465891-3 devstack@n-api.service[104168]: X-Project-Name: admin Jul 18 01:59:05.586715 n-d-465891-3 devstack@n-api.service[104168]: X-Role: member,admin,reader Jul 18 01:59:05.586715 n-d-465891-3 devstack@n-api.service[104168]: X-Roles: member,admin,reader Jul 18 01:59:05.588310 n-d-465891-3 devstack@n-api.service[104168]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_87535bebdabf4816b725392a7f6c7412"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/87535bebdabf4816b725392a7f6c7412"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/87535bebdabf4816b725392a7f6c7412"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/87535bebdabf4816b725392a7f6c7412"}]}] Jul 18 01:59:05.588310 n-d-465891-3 devstack@n-api.service[104168]: X-Tenant: admin Jul 18 01:59:05.588310 n-d-465891-3 devstack@n-api.service[104168]: X-Tenant-Id: 87535bebdabf4816b725392a7f6c7412 Jul 18 01:59:05.588310 n-d-465891-3 devstack@n-api.service[104168]: X-Tenant-Name: admin Jul 18 01:59:05.588310 n-d-465891-3 devstack@n-api.service[104168]: X-User: admin Jul 18 01:59:05.588310 n-d-465891-3 devstack@n-api.service[104168]: X-User-Domain-Id: default Jul 18 01:59:05.588310 n-d-465891-3 devstack@n-api.service[104168]: X-User-Domain-Name: Default Jul 18 01:59:05.588310 n-d-465891-3 devstack@n-api.service[104168]: X-User-Id: 17374655ba8a4b3a8999219e78b9d3e7 Jul 18 01:59:05.588310 n-d-465891-3 devstack@n-api.service[104168]: X-User-Name: admin Jul 18 01:59:05.588310 n-d-465891-3 devstack@n-api.service[104168]: method: > Jul 18 01:59:05.588310 n-d-465891-3 devstack@n-api.service[104168]: exception: Flavor 451 could not be found. Jul 18 01:59:05.588310 n-d-465891-3 devstack@n-api.service[104168]: action_args: {'id': '451'} Jul 18 01:59:05.588310 n-d-465891-3 devstack@n-api.service[104168]: {{(pid=104168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 01:59:05.588310 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 01:59:05.589393 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 01:59:05.589393 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 01:59:05.589393 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 01:59:05.589393 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 01:59:05.589393 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 01:59:05.589393 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 01:59:05.589393 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 01:59:05.589393 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 01:59:05.589393 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 01:59:05.589393 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 01:59:05.589393 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 01:59:05.589393 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 01:59:05.589393 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 18 01:59:05.589393 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi Jul 18 01:59:05.589393 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 01:59:05.589393 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi Jul 18 01:59:05.589393 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 01:59:05.589393 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 01:59:05.589393 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 01:59:05.590632 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 01:59:05.590632 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 01:59:05.590632 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 01:59:05.590632 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 01:59:05.590632 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 01:59:05.590632 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 01:59:05.590632 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 18 01:59:05.590632 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi Jul 18 01:59:05.590632 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 01:59:05.590632 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi Jul 18 01:59:05.590632 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 01:59:05.590632 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 01:59:05.590632 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 01:59:05.590632 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 01:59:05.590632 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 01:59:05.590632 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 18 01:59:05.590632 n-d-465891-3 devstack@n-api.service[104168]: ERROR nova.api.openstack.wsgi Jul 18 01:59:05.590632 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-cc4c62c8-03c4-41e4-a59d-f6569289eca2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 01:59:05.591661 n-d-465891-3 devstack@n-api.service[104168]: INFO nova.api.openstack.requestlog [None req-cc4c62c8-03c4-41e4-a59d-f6569289eca2 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012804 Jul 18 01:59:05.591661 n-d-465891-3 devstack@n-api.service[104168]: [pid: 104168|app: 0|req: 27/52] 10.222.0.57 () {60 vars in 1193 bytes} [Mon Jul 18 01:59:05 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 01:59:06.586606 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi [None req-cab3664a-eba0-4902-a4e9-c18a3f8232ac admin admin] Calling method '>' {{(pid=104169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 01:59:06.587615 n-d-465891-3 devstack@n-api.service[104169]: INFO nova.api.openstack.requestlog [None req-cab3664a-eba0-4902-a4e9-c18a3f8232ac admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Jul 18 01:59:06.588018 n-d-465891-3 devstack@n-api.service[104169]: [pid: 104169|app: 0|req: 26/53] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Jul 18 01:59:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 01:59:07.124133 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-ab2d7771-9e50-48b5-845b-9ecd49d5a7a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 01:59:07.142539 n-d-465891-3 devstack@n-api.service[104168]: INFO nova.api.openstack.requestlog [None req-ab2d7771-9e50-48b5-845b-9ecd49d5a7a1 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.414788 Jul 18 01:59:07.143122 n-d-465891-3 devstack@n-api.service[104168]: [pid: 104168|app: 0|req: 28/54] 10.222.0.57 () {64 vars in 1235 bytes} [Mon Jul 18 01:59:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 01:59:08.125476 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi [None req-cab3664a-eba0-4902-a4e9-c18a3f8232ac admin admin] Calling method '>' {{(pid=104169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 01:59:08.126526 n-d-465891-3 devstack@n-api.service[104169]: INFO nova.api.openstack.requestlog [None req-cab3664a-eba0-4902-a4e9-c18a3f8232ac admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Jul 18 01:59:08.126928 n-d-465891-3 devstack@n-api.service[104169]: [pid: 104169|app: 0|req: 27/55] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Jul 18 01:59:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 01:59:08.662205 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-366bda7d-ac52-491d-86f7-258e338d3358 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 01:59:08.679392 n-d-465891-3 devstack@n-api.service[104168]: INFO nova.api.openstack.requestlog [None req-366bda7d-ac52-491d-86f7-258e338d3358 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.412998 Jul 18 01:59:08.679979 n-d-465891-3 devstack@n-api.service[104168]: [pid: 104168|app: 0|req: 29/56] 10.222.0.57 () {64 vars in 1235 bytes} [Mon Jul 18 01:59:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 01:59:09.677728 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi [None req-cab3664a-eba0-4902-a4e9-c18a3f8232ac admin admin] Calling method '>' {{(pid=104169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 01:59:09.678741 n-d-465891-3 devstack@n-api.service[104169]: INFO nova.api.openstack.requestlog [None req-cab3664a-eba0-4902-a4e9-c18a3f8232ac admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002003 Jul 18 01:59:09.679131 n-d-465891-3 devstack@n-api.service[104169]: [pid: 104169|app: 0|req: 28/57] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Jul 18 01:59:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 01:59:10.242248 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-df858f6d-66a9-4dc9-8c57-d50d4f361dec admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 01:59:10.264137 n-d-465891-3 devstack@n-api.service[104168]: INFO nova.api.openstack.requestlog [None req-df858f6d-66a9-4dc9-8c57-d50d4f361dec admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.447684 Jul 18 01:59:10.264989 n-d-465891-3 devstack@n-api.service[104168]: [pid: 104168|app: 0|req: 30/58] 10.222.0.57 () {64 vars in 1235 bytes} [Mon Jul 18 01:59:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 01:59:11.282255 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi [None req-cab3664a-eba0-4902-a4e9-c18a3f8232ac admin admin] Calling method '>' {{(pid=104169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 01:59:11.283302 n-d-465891-3 devstack@n-api.service[104169]: INFO nova.api.openstack.requestlog [None req-cab3664a-eba0-4902-a4e9-c18a3f8232ac admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Jul 18 01:59:11.283709 n-d-465891-3 devstack@n-api.service[104169]: [pid: 104169|app: 0|req: 29/59] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Jul 18 01:59:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 01:59:11.835200 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-95d785d7-7959-4de5-81fb-95d06b7d999d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 01:59:11.853855 n-d-465891-3 devstack@n-api.service[104168]: INFO nova.api.openstack.requestlog [None req-95d785d7-7959-4de5-81fb-95d06b7d999d admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.421085 Jul 18 01:59:11.854397 n-d-465891-3 devstack@n-api.service[104168]: [pid: 104168|app: 0|req: 31/60] 10.222.0.57 () {64 vars in 1235 bytes} [Mon Jul 18 01:59:11 2022] POST /compute/v2.1/flavors => generated 409 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 01:59:12.878439 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi [None req-cab3664a-eba0-4902-a4e9-c18a3f8232ac admin admin] Calling method '>' {{(pid=104169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 01:59:12.879484 n-d-465891-3 devstack@n-api.service[104169]: INFO nova.api.openstack.requestlog [None req-cab3664a-eba0-4902-a4e9-c18a3f8232ac admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Jul 18 01:59:12.879910 n-d-465891-3 devstack@n-api.service[104169]: [pid: 104169|app: 0|req: 30/61] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Jul 18 01:59:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 01:59:13.437298 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-82a82229-5a28-47b6-b6c9-5bb591700c17 admin admin] Calling method '>' {{(pid=104168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 01:59:13.457801 n-d-465891-3 devstack@n-api.service[104168]: INFO nova.api.openstack.requestlog [None req-82a82229-5a28-47b6-b6c9-5bb591700c17 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.440924 Jul 18 01:59:13.458448 n-d-465891-3 devstack@n-api.service[104168]: [pid: 104168|app: 0|req: 32/62] 10.222.0.57 () {60 vars in 1202 bytes} [Mon Jul 18 01:59:13 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:00:07.091168 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi [None req-cab3664a-eba0-4902-a4e9-c18a3f8232ac admin admin] Calling method '>' {{(pid=104169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:00:07.092178 n-d-465891-3 devstack@n-api.service[104169]: INFO nova.api.openstack.requestlog [None req-cab3664a-eba0-4902-a4e9-c18a3f8232ac admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jul 18 02:00:07.092577 n-d-465891-3 devstack@n-api.service[104169]: [pid: 104169|app: 0|req: 31/63] 10.222.0.57 () {54 vars in 930 bytes} [Mon Jul 18 02:00:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:00:07.105505 n-d-465891-3 devstack@n-api.service[104168]: DEBUG dbcounter [-] [104168] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=104168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:00:07.574749 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-ad3fff36-df48-43eb-9759-c8790974ce06 admin admin] Calling method '>' {{(pid=104168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:00:07.597258 n-d-465891-3 devstack@n-api.service[104168]: INFO nova.api.openstack.requestlog [None req-ad3fff36-df48-43eb-9759-c8790974ce06 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.496216 Jul 18 02:00:07.597844 n-d-465891-3 devstack@n-api.service[104168]: [pid: 104168|app: 0|req: 33/64] 10.222.0.57 () {60 vars in 1291 bytes} [Mon Jul 18 02:00:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:00:07.620102 n-d-465891-3 devstack@n-api.service[104169]: DEBUG dbcounter [-] [104169] Writing DB stats nova_api:SELECT=14 {{(pid=104169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:00:07.623987 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi [None req-2c3714bc-18bf-4438-9e85-e2f6a027f5fa admin admin] Calling method '>' {{(pid=104169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:00:07.632897 n-d-465891-3 devstack@n-api.service[104169]: INFO nova.api.openstack.requestlog [None req-2c3714bc-18bf-4438-9e85-e2f6a027f5fa admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014226 Jul 18 02:00:07.633528 n-d-465891-3 devstack@n-api.service[104169]: [pid: 104169|app: 0|req: 32/65] 10.222.0.57 () {60 vars in 1282 bytes} [Mon Jul 18 02:00:07 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:00:07.645668 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-3bb9022d-21bf-4737-a54b-de8f787ceb16 admin admin] Calling method '>' {{(pid=104168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:00:07.653911 n-d-465891-3 devstack@n-api.service[104168]: INFO nova.api.openstack.requestlog [None req-3bb9022d-21bf-4737-a54b-de8f787ceb16 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011825 Jul 18 02:00:07.654464 n-d-465891-3 devstack@n-api.service[104168]: [pid: 104168|app: 0|req: 34/66] 10.222.0.57 () {60 vars in 1285 bytes} [Mon Jul 18 02:00:07 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:00:07.667038 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi [None req-d13ceb7b-4709-4520-b55a-10141351ee35 admin admin] Calling method '>' {{(pid=104169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:00:07.679825 n-d-465891-3 devstack@n-api.service[104169]: INFO nova.api.openstack.requestlog [None req-d13ceb7b-4709-4520-b55a-10141351ee35 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016124 Jul 18 02:00:07.680453 n-d-465891-3 devstack@n-api.service[104169]: [pid: 104169|app: 0|req: 33/67] 10.222.0.57 () {60 vars in 1285 bytes} [Mon Jul 18 02:00:07 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:00:07.695313 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-8480a36f-b5fd-401a-a30f-ef3f7e501a5a admin admin] Calling method '>' {{(pid=104168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:00:07.703337 n-d-465891-3 devstack@n-api.service[104168]: INFO nova.api.openstack.requestlog [None req-8480a36f-b5fd-401a-a30f-ef3f7e501a5a admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011590 Jul 18 02:00:07.703894 n-d-465891-3 devstack@n-api.service[104168]: [pid: 104168|app: 0|req: 35/68] 10.222.0.57 () {60 vars in 1282 bytes} [Mon Jul 18 02:00:07 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:06:08.005064 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi [None req-d13ceb7b-4709-4520-b55a-10141351ee35 admin admin] Calling method '>' {{(pid=104169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:06:08.006094 n-d-465891-3 devstack@n-api.service[104169]: INFO nova.api.openstack.requestlog [None req-d13ceb7b-4709-4520-b55a-10141351ee35 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jul 18 02:06:08.006496 n-d-465891-3 devstack@n-api.service[104169]: [pid: 104169|app: 0|req: 34/69] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Jul 18 02:06:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:06:08.160072 n-d-465891-3 devstack@n-api.service[104168]: DEBUG dbcounter [-] [104168] Writing DB stats nova_api:SELECT=6 {{(pid=104168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:06:08.320017 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-59b653fa-7b9c-45ad-8f68-67cad4e7f25f admin admin] Calling method '>' {{(pid=104168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:06:08.321278 n-d-465891-3 devstack@n-api.service[104168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:06:08.321278 n-d-465891-3 devstack@n-api.service[104168]: warnings.warn(msg) Jul 18 02:06:08.322567 n-d-465891-3 devstack@n-api.service[104168]: DEBUG oslo_concurrency.lockutils [None req-59b653fa-7b9c-45ad-8f68-67cad4e7f25f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:06:08.323009 n-d-465891-3 devstack@n-api.service[104168]: DEBUG oslo_concurrency.lockutils [None req-59b653fa-7b9c-45ad-8f68-67cad4e7f25f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=104168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:06:08.323796 n-d-465891-3 devstack@n-api.service[104168]: DEBUG oslo_concurrency.lockutils [None req-59b653fa-7b9c-45ad-8f68-67cad4e7f25f admin admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:06:08.324283 n-d-465891-3 devstack@n-api.service[104168]: DEBUG oslo_concurrency.lockutils [None req-59b653fa-7b9c-45ad-8f68-67cad4e7f25f admin admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:06:08.369279 n-d-465891-3 devstack@n-api.service[104168]: INFO nova.api.openstack.requestlog [None req-59b653fa-7b9c-45ad-8f68-67cad4e7f25f admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.210459 Jul 18 02:06:08.370327 n-d-465891-3 devstack@n-api.service[104168]: [pid: 104168|app: 0|req: 36/70] 10.222.0.57 () {60 vars in 1193 bytes} [Mon Jul 18 02:06:08 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:06:09.228241 n-d-465891-3 devstack@n-api.service[104169]: DEBUG nova.api.openstack.wsgi [None req-d13ceb7b-4709-4520-b55a-10141351ee35 admin admin] Calling method '>' {{(pid=104169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:06:09.229178 n-d-465891-3 devstack@n-api.service[104169]: INFO nova.api.openstack.requestlog [None req-d13ceb7b-4709-4520-b55a-10141351ee35 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jul 18 02:06:09.229639 n-d-465891-3 devstack@n-api.service[104169]: [pid: 104169|app: 0|req: 35/71] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Jul 18 02:06:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:06:09.421035 n-d-465891-3 devstack@n-api.service[104168]: DEBUG nova.api.openstack.wsgi [None req-1a33c10d-0bae-40d8-a122-9be874b8440d admin admin] Calling method '>' {{(pid=104168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:06:09.422326 n-d-465891-3 devstack@n-api.service[104168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:06:09.422326 n-d-465891-3 devstack@n-api.service[104168]: warnings.warn(msg) Jul 18 02:06:09.423497 n-d-465891-3 devstack@n-api.service[104168]: DEBUG oslo_concurrency.lockutils [None req-1a33c10d-0bae-40d8-a122-9be874b8440d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:06:09.423935 n-d-465891-3 devstack@n-api.service[104168]: DEBUG oslo_concurrency.lockutils [None req-1a33c10d-0bae-40d8-a122-9be874b8440d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:06:09.424738 n-d-465891-3 devstack@n-api.service[104168]: DEBUG oslo_concurrency.lockutils [None req-1a33c10d-0bae-40d8-a122-9be874b8440d admin admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:06:09.425164 n-d-465891-3 devstack@n-api.service[104168]: DEBUG oslo_concurrency.lockutils [None req-1a33c10d-0bae-40d8-a122-9be874b8440d admin admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:06:09.448270 n-d-465891-3 devstack@n-api.service[104168]: INFO nova.api.openstack.requestlog [None req-1a33c10d-0bae-40d8-a122-9be874b8440d admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.079695 Jul 18 02:06:09.448746 n-d-465891-3 devstack@n-api.service[104168]: [pid: 104168|app: 0|req: 37/72] 10.222.0.57 () {60 vars in 1193 bytes} [Mon Jul 18 02:06:09 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:06:55.035151 n-d-465891-3 devstack@n-api.service[104167]: Mon Jul 18 02:06:55 2022 - graceful shutdown triggered... Jul 18 02:06:55.035700 n-d-465891-3 devstack@n-api.service[104168]: Gracefully killing worker 1 (pid: 104168)... Jul 18 02:06:55.037148 n-d-465891-3 devstack@n-api.service[104169]: Gracefully killing worker 2 (pid: 104169)... Jul 18 02:06:55.037853 n-d-465891-3 systemd[1]: Stopping Devstack devstack@n-api.service... Jul 18 02:06:56.036289 n-d-465891-3 devstack@n-api.service[104167]: worker 1 buried after 1 seconds Jul 18 02:06:56.036289 n-d-465891-3 devstack@n-api.service[104167]: worker 2 buried after 1 seconds Jul 18 02:06:56.036289 n-d-465891-3 devstack@n-api.service[104167]: goodbye to uWSGI. Jul 18 02:06:56.037979 n-d-465891-3 systemd[1]: devstack@n-api.service: Succeeded. Jul 18 02:06:56.038553 n-d-465891-3 systemd[1]: Stopped Devstack devstack@n-api.service. Jul 18 02:06:56.041303 n-d-465891-3 systemd[1]: Starting Devstack devstack@n-api.service... Jul 18 02:06:56.060648 n-d-465891-3 devstack@n-api.service[119532]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 18 02:06:56.078927 n-d-465891-3 devstack@n-api.service[119532]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 18 02:06:56 2022] *** Jul 18 02:06:56.078927 n-d-465891-3 devstack@n-api.service[119532]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 18 02:06:56.078927 n-d-465891-3 devstack@n-api.service[119532]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 18 02:06:56.078927 n-d-465891-3 devstack@n-api.service[119532]: nodename: n-d-465891-3 Jul 18 02:06:56.078927 n-d-465891-3 devstack@n-api.service[119532]: machine: x86_64 Jul 18 02:06:56.078927 n-d-465891-3 devstack@n-api.service[119532]: clock source: unix Jul 18 02:06:56.078927 n-d-465891-3 devstack@n-api.service[119532]: pcre jit disabled Jul 18 02:06:56.078927 n-d-465891-3 devstack@n-api.service[119532]: detected number of CPU cores: 4 Jul 18 02:06:56.078927 n-d-465891-3 devstack@n-api.service[119532]: current working directory: / Jul 18 02:06:56.078927 n-d-465891-3 devstack@n-api.service[119532]: detected binary path: /usr/bin/uwsgi-core Jul 18 02:06:56.078927 n-d-465891-3 devstack@n-api.service[119532]: your processes number limit is 47680 Jul 18 02:06:56.078927 n-d-465891-3 devstack@n-api.service[119532]: your memory page size is 4096 bytes Jul 18 02:06:56.078927 n-d-465891-3 devstack@n-api.service[119532]: detected max file descriptor number: 2048 Jul 18 02:06:56.078927 n-d-465891-3 devstack@n-api.service[119532]: lock engine: pthread robust mutexes Jul 18 02:06:56.078927 n-d-465891-3 devstack@n-api.service[119532]: thunder lock: enabled Jul 18 02:06:56.078927 n-d-465891-3 devstack@n-api.service[119532]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 18 02:06:56.078927 n-d-465891-3 devstack@n-api.service[119532]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 18 02:06:56.117592 n-d-465891-3 devstack@n-api.service[119532]: Python main interpreter initialized at 0x564c872089c0 Jul 18 02:06:56.117592 n-d-465891-3 devstack@n-api.service[119532]: python threads support enabled Jul 18 02:06:56.117592 n-d-465891-3 devstack@n-api.service[119532]: your server socket listen backlog is limited to 100 connections Jul 18 02:06:56.117592 n-d-465891-3 devstack@n-api.service[119532]: your mercy for graceful operations on workers is 90 seconds Jul 18 02:06:56.118074 n-d-465891-3 devstack@n-api.service[119532]: mapped 403077 bytes (393 KB) for 2 cores Jul 18 02:06:56.118074 n-d-465891-3 devstack@n-api.service[119532]: *** Operational MODE: preforking *** Jul 18 02:06:56.118332 n-d-465891-3 devstack@n-api.service[119532]: *** uWSGI is running in multiple interpreter mode *** Jul 18 02:06:56.118332 n-d-465891-3 devstack@n-api.service[119532]: spawned uWSGI master process (pid: 119532) Jul 18 02:06:56.118546 n-d-465891-3 systemd[1]: Started Devstack devstack@n-api.service. Jul 18 02:06:56.119163 n-d-465891-3 devstack@n-api.service[119532]: spawned uWSGI worker 1 (pid: 119543, cores: 1) Jul 18 02:06:56.119515 n-d-465891-3 devstack@n-api.service[119532]: spawned uWSGI worker 2 (pid: 119544, cores: 1) Jul 18 02:06:56.119663 n-d-465891-3 devstack@n-api.service[119532]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 18 02:06:56.794366 n-d-465891-3 devstack@n-api.service[119544]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 02:06:56.799604 n-d-465891-3 devstack@n-api.service[119543]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 02:06:57.969900 n-d-465891-3 devstack@n-api.service[119544]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 02:06:57.969900 n-d-465891-3 devstack@n-api.service[119544]: from cryptography.utils import int_from_bytes Jul 18 02:06:57.970600 n-d-465891-3 devstack@n-api.service[119544]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 02:06:57.970600 n-d-465891-3 devstack@n-api.service[119544]: from cryptography.utils import int_from_bytes Jul 18 02:06:58.018108 n-d-465891-3 devstack@n-api.service[119543]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 02:06:58.018108 n-d-465891-3 devstack@n-api.service[119543]: from cryptography.utils import int_from_bytes Jul 18 02:06:58.018729 n-d-465891-3 devstack@n-api.service[119543]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 02:06:58.018729 n-d-465891-3 devstack@n-api.service[119543]: from cryptography.utils import int_from_bytes Jul 18 02:07:00.303633 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 02:07:00.304180 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 02:07:00.304411 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 02:07:00.304833 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 02:07:00.305027 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 02:07:00.305418 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.305760 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.306088 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.306401 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.306733 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.307044 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.307361 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.307675 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.307999 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.308788 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.309104 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.309426 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-465891-3 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.309768 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.310080 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.310388 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.310705 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.311007 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.311326 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.311641 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.312134 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.312575 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.312881 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.313190 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.313525 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.313858 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.314168 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.314487 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.314795 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.315117 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.315428 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.315824 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-465891-3 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.316138 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.316472 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.316767 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.317180 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.317491 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.317825 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.318146 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.318468 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.318773 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.319096 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.319413 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.319731 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.320048 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.320350 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.320653 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.320960 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.321278 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.321583 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.321913 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.322162 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.322469 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.322789 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.323116 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.323439 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.324323 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.324646 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.324975 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.325304 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.325618 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.325954 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.326260 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.326568 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.326881 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.327186 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.327490 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.327794 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.328118 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.328434 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.328753 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.329059 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.329377 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.329799 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.330055 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.330363 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.330700 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.331020 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.331324 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.331640 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.331958 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.332263 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.332566 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.332867 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.333184 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.333516 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.333841 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.334090 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.334389 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.334692 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.335007 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.335314 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.335617 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.335926 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.336217 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.336518 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.336825 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.337128 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.337429 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.337750 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.338055 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.338356 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.338657 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.338957 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.339339 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.339625 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.340083 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.340405 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.340715 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.341018 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.341336 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.341643 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.341975 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.342294 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.342597 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.342900 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.343216 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.343523 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.343830 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.344149 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.344449 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.344755 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.345070 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.345373 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.345677 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.346006 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.346310 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.346609 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.346917 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.347217 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.347517 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.347817 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.348136 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.348458 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.348765 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.349071 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.349372 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.349687 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.350048 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.350381 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.350729 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.351045 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.351378 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.351708 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.352026 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.352339 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.352653 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.352975 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.353288 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.353599 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.353939 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.354257 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.354573 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.354902 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.356003 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.356329 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.356653 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.356964 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.357285 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.357621 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.357969 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.358282 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.358626 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.358974 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.359291 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.359618 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.359942 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.360254 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.360565 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.360904 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.361193 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.361524 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.361860 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.362178 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.362748 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.363064 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.363372 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.363681 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.363991 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.364328 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.364639 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.364950 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.365259 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.365571 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.365911 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.366222 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.366531 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.366832 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.367134 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.367548 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.367753 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.368055 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.368375 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.368704 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.369010 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.369343 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.369650 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.369984 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.370292 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.371297 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.371708 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.372161 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.372477 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.372784 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.373114 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.373430 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.373755 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.374081 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.374387 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.374692 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.375006 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.375317 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.375624 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.375933 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.376240 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.376566 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.376875 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.377186 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.377523 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.377876 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.378182 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.378505 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.378828 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.379142 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.379445 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.379752 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.380215 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.380381 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.380645 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.380952 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.381254 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.381556 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.381882 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.382188 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.382495 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.382810 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.383116 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.383416 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.383717 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.384012 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.384354 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.384659 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.385000 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.385336 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.385688 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.386000 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.386343 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.386830 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.387141 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.387455 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.387773 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.388082 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.388399 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.388707 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.389025 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.389332 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.389652 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.389990 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.390307 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.390610 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.390924 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.391264 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.391598 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.391912 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.392231 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.392539 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.392850 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.393159 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.393468 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.393857 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.394109 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.394425 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.394732 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.395045 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.395352 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.395672 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.395981 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.396298 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.396597 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.396909 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.397232 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.397568 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.397897 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.398211 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.398528 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.398836 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.399146 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.399454 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.399754 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.400056 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.400363 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.400676 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.400985 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.401290 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.401662 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.401971 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.402279 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.402584 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.402889 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.403197 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.403631 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.403947 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.404267 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.404590 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.404893 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.405196 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.405518 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.405850 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.406154 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.406457 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.406761 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.407101 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.407409 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.407719 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.408029 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.408347 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.408654 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.408963 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.409271 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.409577 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.409922 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.410235 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.410541 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.410847 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.411157 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.411463 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.411771 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.412087 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.412394 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.412699 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.413007 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.413307 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.413617 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.413953 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.414532 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.414860 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.415170 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.415485 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.415802 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.416122 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.416449 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.416772 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.417106 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.418051 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.418264 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.418569 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.418873 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.419184 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.419487 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.419790 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.420091 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.420399 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.420710 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.420999 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.421300 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.421600 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.421939 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.422239 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.422548 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.422850 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.423171 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.423479 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.423781 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.424080 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.424379 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.424718 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.425021 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.425358 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.425687 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.426048 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.426352 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.426655 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.426977 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.427281 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.427584 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.427886 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.428200 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.428509 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.428806 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.429112 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.429415 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.429737 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.430046 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.430342 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.430647 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.430945 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.431258 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.431562 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.431880 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.432165 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.432469 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.432772 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.433121 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.433960 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.434261 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.434574 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.434876 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.435177 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.435275 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 02:07:00.435707 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.435796 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 02:07:00.435881 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.436036 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 02:07:00.436137 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.436353 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.436453 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 02:07:00.436650 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 02:07:00.436750 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.436971 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.437141 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.437305 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.437447 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.437590 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.437763 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.437870 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.438001 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.438291 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.438400 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.438488 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.438637 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.438740 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.438959 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.439072 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.439280 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.439381 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.439607 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.439702 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.439869 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.439964 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.440186 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.440288 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.440514 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-465891-3 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.440615 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.440813 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.440918 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.441120 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.441222 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.441420 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.441514 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.441739 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.441838 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.442083 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.442192 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.442345 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.442453 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.442646 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.442741 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.442967 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.443158 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.443274 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.443470 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.443573 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.443775 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.443881 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.444085 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.444186 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.444426 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.444521 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.444741 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.444844 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.445050 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.445158 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.445372 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.445474 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.445680 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.445800 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.446017 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.446122 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.446324 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.446424 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.446629 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.446729 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-465891-3 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.446941 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.447043 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.447244 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.447349 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.447557 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.447662 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.447866 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.448039 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.448179 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.448380 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.448537 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.448701 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.448877 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.449043 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.449300 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.449467 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.449610 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.449752 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.449953 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.450068 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.450275 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.450378 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.450597 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.450707 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.450922 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.451017 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.451227 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.451328 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.451533 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.451638 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.451842 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.451937 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.452197 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.452313 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.452452 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.452558 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.452758 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.452858 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.453010 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.453105 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.453321 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.453416 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.453645 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.453760 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.453979 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.454093 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.454286 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.454383 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.454553 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.454658 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.454806 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.454912 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.455129 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.455224 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.455451 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.455546 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.455763 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.455936 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.456068 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.456171 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.456370 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.456473 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.456674 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.456779 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.456974 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.457070 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.457278 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.457378 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.457585 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.457721 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.457914 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.458149 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.458251 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.458465 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.458601 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.458772 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.458926 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.459066 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.459218 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.459383 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.459537 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.459688 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.459833 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.459985 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.460146 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.460298 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.460452 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.460594 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.460736 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.460942 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.461088 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.461251 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.461407 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.461577 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.461747 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.461866 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.461974 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.462170 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.462288 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.462475 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.462588 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.462780 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.462883 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.463101 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.463196 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.463402 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.463497 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.463705 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.463807 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.463959 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.464053 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.464319 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.464423 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.464628 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.464734 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.464976 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.465079 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.465287 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.465467 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.465595 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.465801 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.465955 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.466106 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.466210 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.466516 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.466617 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.466824 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.466927 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.467130 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.467250 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.467436 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.467573 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.467742 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.467880 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.468047 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.468142 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.468352 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.468445 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.468659 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.468814 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.468956 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.469046 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.469269 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.469422 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.469590 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.469683 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.469920 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.470014 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.470227 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.470337 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.470525 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.470629 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.470829 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.470937 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.471150 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.471244 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.471457 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.471549 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.471761 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.471862 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.472083 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.472185 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.472387 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.472553 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.472691 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.472787 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.473009 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.473110 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.473317 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.473482 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.473622 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.473776 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.473964 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.474060 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.474265 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.474374 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.474563 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.474656 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.474867 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.474961 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.475171 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.475273 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.475478 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.475580 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.475780 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.475876 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.476084 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.476188 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.476386 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.476478 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.476687 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.476789 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.476985 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.477091 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.477288 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.477390 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.477589 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.477691 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.478003 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.478110 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.478253 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.478355 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.478560 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.478653 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.478869 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.478982 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.479168 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.479264 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.479483 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:07:00.479577 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.479789 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.479882 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.480656 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.480762 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.480975 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.481140 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.481270 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.481373 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.481612 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.481737 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.481949 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.482058 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.482269 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.482364 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.482623 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.482771 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.482942 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.483051 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.483253 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.483355 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.483573 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.483674 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.483889 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.483992 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.484202 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.484307 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.484520 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.484614 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.484839 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.484933 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.485142 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.485234 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.485445 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.485547 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.485778 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.485894 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.486086 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.486187 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.486389 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.486492 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.486691 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.486794 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.486999 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.487102 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.487300 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.487730 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.487868 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.487964 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.488164 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.488290 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.488489 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.488608 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.488795 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.488925 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.489118 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.489224 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.489424 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.489529 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.489743 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.489840 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.490050 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.490153 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.490348 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.490458 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.490690 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.490793 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.490995 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.491096 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.491328 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.491423 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.491648 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.491754 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.491961 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.492054 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.492279 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.492374 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.492585 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.492725 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.492897 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.492993 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.493212 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.493309 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.493523 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.493617 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.493860 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.493958 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.494175 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.494271 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.494486 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.494588 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.494798 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.494893 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.495109 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.495214 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.495413 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.495517 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.496312 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.496457 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.496626 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.496772 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.496940 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.497092 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.497401 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.497508 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.497732 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.497844 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.498044 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.498139 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.498374 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.498505 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.498705 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.498811 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.499015 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.499151 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.499345 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.499463 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.499652 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.499747 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.499959 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.500062 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.500268 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.500364 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.500575 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.500669 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.500881 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.500984 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.501210 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.501304 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.501534 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.501639 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.501890 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.501985 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.502216 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.502310 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.502528 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.502622 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.502833 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.502989 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.503142 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.503236 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.503449 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.503548 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.503756 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.503864 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.504071 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.504173 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.504381 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.504483 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.504692 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.504787 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.505004 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.505105 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.505315 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.505417 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.505637 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.505753 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.505977 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.506083 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.506287 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.506388 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.506596 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.506701 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.506905 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.507006 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.507217 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.507319 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.507556 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.507650 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.507884 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.507986 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.508202 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.508309 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.508511 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.508631 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.508822 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.508936 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.509126 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.509266 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.509435 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.509548 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.509759 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.510043 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.510203 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.510348 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.510446 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.510657 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.510750 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.510963 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.511076 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.511298 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.511446 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.511773 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.511879 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.512092 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.512196 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.512404 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.512496 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.512709 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.512828 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.513012 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.513122 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.513313 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.513407 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.513617 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.513735 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.513947 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.514054 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.514270 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.514363 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.514577 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.514671 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.514878 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.514985 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.515196 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.515298 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.515500 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.515593 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.515853 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.516034 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.516164 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.516378 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.516480 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.516689 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.516798 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.517011 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.517112 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.517334 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.517429 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.517655 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.517790 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.517987 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.518081 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.518300 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.518424 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.518603 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.518707 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.518902 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.519004 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.519214 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.519307 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.519520 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.519689 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.519841 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.519999 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.520162 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.520316 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.520476 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.520628 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.520799 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.520952 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.521126 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.521290 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.521443 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.521540 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.521686 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.521803 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.521979 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.522088 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.522286 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.522394 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.522591 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.522686 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.522898 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.523084 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.523213 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.523321 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.523664 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.523778 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.523853 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.523953 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.524102 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.524197 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.524406 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.524506 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.524722 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.524915 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.525027 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.525130 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.525329 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.525423 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.525630 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.525798 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.525968 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.526075 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.526273 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.526375 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.526584 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.526686 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.526966 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.527392 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.527709 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.528009 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.528231 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.528396 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.528620 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.529975 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.530097 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.530208 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.530208 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.531952 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.532059 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.532150 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.532245 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.532341 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.532443 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.532539 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.532627 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.532712 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.532799 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.532898 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.532990 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.533088 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.533242 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.533242 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.533434 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.534467 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.534467 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.534657 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.534745 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.534745 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.534911 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.535006 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.535101 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.535188 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.535280 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.535368 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.535454 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.535549 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.535637 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.535738 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.535838 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.535934 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.536021 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.536115 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.536209 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.536297 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.536391 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.536491 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.536586 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.536681 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.536769 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.536866 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.537050 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.537187 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.537373 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.537481 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.537690 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.537849 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.538019 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.538126 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.538331 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.538440 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.538642 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.538749 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.539389 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.539503 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.539581 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.539654 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.539751 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.539826 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.539913 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.540003 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.540140 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.540264 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.540504 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.540728 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.540825 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.541061 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.541180 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.541382 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.541555 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.541724 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.541915 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.542139 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.542262 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.542985 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.543156 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.543434 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.543518 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.543601 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.543682 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.543908 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.544022 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.544218 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.544313 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.544541 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.544637 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.544850 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.544954 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.545170 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.545294 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.545477 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.545597 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.545810 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.545949 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.546127 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.546224 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.546446 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.546539 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.546774 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.547028 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.547122 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.547366 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.547469 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.547666 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.547773 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.547977 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.548080 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.548298 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.548391 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.548604 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.548781 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.548909 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.549003 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.549195 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.549300 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.549507 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.549695 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.549872 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.550033 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.550189 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.550363 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.550470 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.550600 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.550695 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.550791 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.550992 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.551096 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.551292 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.551397 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.551595 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.551719 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.555141 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.555300 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.555422 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.555539 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.555655 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.555784 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.555915 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.556040 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.556185 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.556391 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.556512 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.556637 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.556753 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.556868 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.557140 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.557240 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.557355 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.557447 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.557548 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.557637 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.557874 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.557984 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.558139 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.558749 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.558980 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.559086 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.559192 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.559291 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.559394 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.559489 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.559584 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.559666 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.559755 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.559855 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.559944 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.560018 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.560091 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.560172 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.560266 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.560361 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.560449 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.560537 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.560624 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.560718 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.560814 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.560911 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.561008 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.561103 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.561191 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.561284 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.561371 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.561472 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.561559 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.561646 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.561832 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.561944 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.562095 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.562188 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.562274 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.562361 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.562446 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.562532 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.562627 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.562715 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.562810 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.562898 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.562991 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.563078 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.563173 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.563260 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.563345 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.563439 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.563533 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.563630 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.563724 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.563824 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.563931 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.564083 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.564236 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.564389 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.564542 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.564700 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.564849 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.565009 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.565196 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.565310 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.565465 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.565612 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.565805 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.565938 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.566120 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.566255 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.566432 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.566562 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.566756 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.566851 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.567081 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.567178 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.567388 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.567483 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.567710 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.567812 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.568040 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.568155 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.568358 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.568454 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.568672 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.568766 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.568975 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.569079 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.569285 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.569386 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.569591 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.569688 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.569917 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.570016 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.570221 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.570367 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.570465 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 02:07:00.570608 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.570843 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.571166 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.571471 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.571782 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.572089 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.572393 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.572697 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.573006 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.573310 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.573617 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.574699 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.575131 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.575445 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.575778 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.576095 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.576405 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.576712 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.577019 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.577365 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.577673 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.578063 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.578377 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.578695 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.579022 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.579339 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.579651 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.579968 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.580278 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.580597 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.580914 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.581376 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.581541 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.581873 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.610444 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.610444 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.610444 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.610444 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.610444 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.610444 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.610444 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.610444 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.613721 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.613721 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.613721 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.613721 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.613721 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.613721 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.613721 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.613721 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.616702 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.616702 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.616702 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.616702 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.616702 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.616702 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.616702 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.616702 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.620388 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.620388 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.620388 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.620388 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.620388 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.620388 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.620388 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.620388 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.621875 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.621875 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.621875 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.621875 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.621875 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.621875 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.621875 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.621875 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.622619 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.622619 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.622619 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.622619 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.622619 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.622619 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.622619 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.622619 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.623408 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.623408 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.623408 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.623408 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.623408 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.623408 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.623408 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.623408 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.624582 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.624582 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.624582 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.624582 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.624582 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.624582 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.624582 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.624582 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.626500 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.626500 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.626500 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.626500 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.626500 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.626500 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.626500 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.626500 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.627002 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.627002 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.627002 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.627002 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.627002 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.627002 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.627002 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.627002 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.627421 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.627421 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.627421 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.627421 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.627421 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.627421 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.627421 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.627421 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.627781 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.627781 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.627781 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.627781 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.627781 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.627781 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.627781 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.627781 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.629054 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.629054 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.629054 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.629054 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.629054 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.629054 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.629054 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.629054 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.629536 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.629536 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.629536 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.629536 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.629536 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.629536 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.629536 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.629536 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.630065 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.630065 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.630065 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.630065 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.630825 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.631148 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.631572 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.631912 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.632235 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.632687 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.632897 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.633215 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.633549 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.633927 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.634224 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.634539 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.634851 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.635210 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.635521 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.635868 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.636783 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.637362 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.637936 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.638424 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.638949 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.639360 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.639687 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.640011 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.640334 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.640662 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.640985 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.641308 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.641626 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.641990 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.642310 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.642635 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.643229 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.643569 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.643952 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.644269 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.644533 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.644854 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.645191 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.645493 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.645848 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.646168 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.646484 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.646827 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.647158 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.647495 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.647840 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.648167 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.648486 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.648804 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.649125 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.649493 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.649844 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.650158 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.650477 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.650802 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.651118 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.651432 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.651750 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.652717 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.653053 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.653375 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.653694 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.654050 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.654374 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.654716 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.655063 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.655392 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.655713 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.656033 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.656353 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.656939 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.657262 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.657605 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.657966 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.658300 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.658627 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.658957 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.659292 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.659606 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.659919 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.660251 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.660550 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.660866 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.661191 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.662219 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.662219 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.662219 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.662668 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.663042 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.663393 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.663714 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.664045 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.664558 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.664712 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.664990 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.665321 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.665926 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.666083 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.666273 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.666591 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.666902 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.667210 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.667708 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.667933 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.668184 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.668502 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.668815 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.669157 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.669467 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.669803 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.670119 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.670439 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.670744 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.671644 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.671644 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.671644 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.672039 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.672301 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.672535 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.672843 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.673158 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.673467 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.673906 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.674189 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.674532 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.674840 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.675149 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.675475 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.675791 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.676121 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.676479 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.676771 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.677170 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.677589 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.678226 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.678564 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.678892 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.679240 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.679576 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.679886 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.680195 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.680507 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.680840 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.681152 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.681464 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.681887 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.682119 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.682573 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.682756 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.683105 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.683414 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.683723 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.684032 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.684349 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.684676 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.684990 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.685305 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.685664 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.686031 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.686362 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.686699 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.687067 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.687416 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.687703 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.688017 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.688327 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.688661 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.689003 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.689320 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.689628 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.690112 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.690428 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.690748 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.691070 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.691381 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.691705 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.692031 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.692348 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.692667 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.692978 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.693310 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.693652 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.694009 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.694335 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.694642 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.694953 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.695257 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.695569 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.695892 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.696203 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.696508 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.696811 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.697121 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.697424 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.697764 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.698072 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.698380 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.699231 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.699550 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.699835 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.700141 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.700448 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.700754 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.701061 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.701373 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.701677 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.701999 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.702301 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.702609 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.702908 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.703242 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.703579 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.703897 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.704219 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.704534 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.704857 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.705170 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.705493 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.705838 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.706160 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.706477 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.706808 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.707120 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.707431 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.707744 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.708055 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.708364 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.708680 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.709010 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.709338 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.709646 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.710019 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.710336 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.710658 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.710954 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.711272 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.711598 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.711911 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.712280 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.712528 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.712843 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.713167 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.713483 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.713816 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.716313 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.716313 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.716313 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.716313 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.716313 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.716841 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.716841 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.717067 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.717508 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.717751 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.718104 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.718446 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.718788 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.720168 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.720483 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:07:00.720739 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 02:07:00.757518 n-d-465891-3 devstack@n-api.service[119544]: INFO dbcounter [None req-788994fe-be69-466e-897c-66025be86bf9 None None] Registered counter for database nova_api Jul 18 02:07:00.780252 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_db.sqlalchemy.engines [None req-788994fe-be69-466e-897c-66025be86bf9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119544) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 02:07:00.788074 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writer thread running {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 02:07:00.850052 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.context [None req-788994fe-be69-466e-897c-66025be86bf9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2a4b42c4-bf71-4fae-804a-3632602c55fa(cell1) {{(pid=119544) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 02:07:00.857135 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-788994fe-be69-466e-897c-66025be86bf9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:07:00.860245 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-788994fe-be69-466e-897c-66025be86bf9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:07:00.861632 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-788994fe-be69-466e-897c-66025be86bf9 None None] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:07:00.864534 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-788994fe-be69-466e-897c-66025be86bf9 None None] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:07:00.866763 n-d-465891-3 devstack@n-api.service[119544]: INFO dbcounter [None req-788994fe-be69-466e-897c-66025be86bf9 None None] Registered counter for database nova_cell0 Jul 18 02:07:00.871799 n-d-465891-3 devstack@n-api.service[119544]: INFO dbcounter [None req-788994fe-be69-466e-897c-66025be86bf9 None None] Registered counter for database nova_cell1 Jul 18 02:07:00.875201 n-d-465891-3 devstack@n-api.service[119543]: INFO dbcounter [None req-4bd6d554-732e-462a-8e25-503551aca6fa None None] Registered counter for database nova_api Jul 18 02:07:00.879233 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_db.sqlalchemy.engines [None req-788994fe-be69-466e-897c-66025be86bf9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119544) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 02:07:00.882878 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_db.sqlalchemy.engines [None req-788994fe-be69-466e-897c-66025be86bf9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119544) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 02:07:00.890452 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writer thread running {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 02:07:00.891977 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writer thread running {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 02:07:00.896420 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_db.sqlalchemy.engines [None req-4bd6d554-732e-462a-8e25-503551aca6fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119543) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 02:07:00.904067 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writer thread running {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 02:07:00.962276 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.context [None req-4bd6d554-732e-462a-8e25-503551aca6fa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2a4b42c4-bf71-4fae-804a-3632602c55fa(cell1) {{(pid=119543) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 02:07:00.966789 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4bd6d554-732e-462a-8e25-503551aca6fa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:07:00.968366 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4bd6d554-732e-462a-8e25-503551aca6fa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:07:00.969173 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4bd6d554-732e-462a-8e25-503551aca6fa None None] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:07:00.971262 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4bd6d554-732e-462a-8e25-503551aca6fa None None] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:07:00.973256 n-d-465891-3 devstack@n-api.service[119543]: INFO dbcounter [None req-4bd6d554-732e-462a-8e25-503551aca6fa None None] Registered counter for database nova_cell0 Jul 18 02:07:00.977350 n-d-465891-3 devstack@n-api.service[119543]: INFO dbcounter [None req-4bd6d554-732e-462a-8e25-503551aca6fa None None] Registered counter for database nova_cell1 Jul 18 02:07:00.984923 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_db.sqlalchemy.engines [None req-4bd6d554-732e-462a-8e25-503551aca6fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119543) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 02:07:00.990589 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writer thread running {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 02:07:00.991235 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_db.sqlalchemy.engines [None req-4bd6d554-732e-462a-8e25-503551aca6fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119543) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 02:07:01.039015 n-d-465891-3 devstack@n-api.service[119544]: INFO dbcounter [None req-788994fe-be69-466e-897c-66025be86bf9 None None] Registered counter for database nova_cell0 Jul 18 02:07:01.046570 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_db.sqlalchemy.engines [None req-788994fe-be69-466e-897c-66025be86bf9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119544) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 02:07:01.051625 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writer thread running {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 02:07:01.136056 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writer thread running {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 02:07:01.145111 n-d-465891-3 devstack@n-api.service[119543]: INFO dbcounter [None req-4bd6d554-732e-462a-8e25-503551aca6fa None None] Registered counter for database nova_cell0 Jul 18 02:07:01.152553 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_db.sqlalchemy.engines [None req-4bd6d554-732e-462a-8e25-503551aca6fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119543) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 02:07:01.157453 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writer thread running {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 02:07:01.375342 n-d-465891-3 devstack@n-api.service[119544]: WARNING keystonemiddleware.auth_token [None req-788994fe-be69-466e-897c-66025be86bf9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 02:07:01.382711 n-d-465891-3 devstack@n-api.service[119544]: WARNING keystonemiddleware.auth_token [None req-788994fe-be69-466e-897c-66025be86bf9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 02:07:01.484716 n-d-465891-3 devstack@n-api.service[119543]: WARNING keystonemiddleware.auth_token [None req-4bd6d554-732e-462a-8e25-503551aca6fa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 02:07:01.492249 n-d-465891-3 devstack@n-api.service[119543]: WARNING keystonemiddleware.auth_token [None req-4bd6d554-732e-462a-8e25-503551aca6fa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 02:07:01.728421 n-d-465891-3 devstack@n-api.service[119544]: WARNING keystonemiddleware.auth_token [None req-788994fe-be69-466e-897c-66025be86bf9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 02:07:01.735340 n-d-465891-3 devstack@n-api.service[119544]: WARNING keystonemiddleware.auth_token [None req-788994fe-be69-466e-897c-66025be86bf9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 02:07:01.741249 n-d-465891-3 devstack@n-api.service[119544]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564c872089c0 pid: 119544 (default app) Jul 18 02:07:01.840486 n-d-465891-3 devstack@n-api.service[119543]: WARNING keystonemiddleware.auth_token [None req-4bd6d554-732e-462a-8e25-503551aca6fa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 02:07:01.846658 n-d-465891-3 devstack@n-api.service[119543]: WARNING keystonemiddleware.auth_token [None req-4bd6d554-732e-462a-8e25-503551aca6fa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 02:07:01.852063 n-d-465891-3 devstack@n-api.service[119543]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564c872089c0 pid: 119543 (default app) Jul 18 02:07:47.081122 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-788994fe-be69-466e-897c-66025be86bf9 None None] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:07:47.082331 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-788994fe-be69-466e-897c-66025be86bf9 None None] 10.222.0.57 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001822 Jul 18 02:07:47.082656 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1/1] 10.222.0.57 () {56 vars in 885 bytes} [Mon Jul 18 02:07:47 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 18 02:07:48.852468 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:07:48.854339 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:07:48.855373 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:07:48.858034 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:07:49.420135 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:07:49.423420 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:07:49.425410 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:07:49.426185 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:07:50.862025 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3db60a8e-6d7e-4574-859e-02d0ac098957 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:07:50.864877 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:50.864877 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:07:50.867174 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3db60a8e-6d7e-4574-859e-02d0ac098957 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:07:50.867969 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3db60a8e-6d7e-4574-859e-02d0ac098957 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:07:50.870008 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3db60a8e-6d7e-4574-859e-02d0ac098957 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:07:50.870873 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3db60a8e-6d7e-4574-859e-02d0ac098957 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:07:50.955498 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3db60a8e-6d7e-4574-859e-02d0ac098957 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 2.121493 Jul 18 02:07:50.956487 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1/2] 10.222.0.57 () {58 vars in 1175 bytes} [Mon Jul 18 02:07:48 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 2124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:07:51.202242 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d6aa964d-721c-4cf9-aeea-34230616dbbe tempest-AggregatesAdminTestV241-1626710147 tempest-AggregatesAdminTestV241-1626710147-project-admin] Calling method '.version_select at 0x7ff4ab4a2820>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:07:51.205242 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:51.205242 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:07:51.215965 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d6aa964d-721c-4cf9-aeea-34230616dbbe tempest-AggregatesAdminTestV241-1626710147 tempest-AggregatesAdminTestV241-1626710147-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2a4b42c4-bf71-4fae-804a-3632602c55fa(cell1) {{(pid=119544) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 18 02:07:51.217023 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d6aa964d-721c-4cf9-aeea-34230616dbbe tempest-AggregatesAdminTestV241-1626710147 tempest-AggregatesAdminTestV241-1626710147-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:07:51.217642 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d6aa964d-721c-4cf9-aeea-34230616dbbe tempest-AggregatesAdminTestV241-1626710147 tempest-AggregatesAdminTestV241-1626710147-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:07:51.262394 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d6aa964d-721c-4cf9-aeea-34230616dbbe tempest-AggregatesAdminTestV241-1626710147 tempest-AggregatesAdminTestV241-1626710147-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:07:51.264471 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d6aa964d-721c-4cf9-aeea-34230616dbbe tempest-AggregatesAdminTestV241-1626710147 tempest-AggregatesAdminTestV241-1626710147-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:07:51.291689 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d6aa964d-721c-4cf9-aeea-34230616dbbe tempest-AggregatesAdminTestV241-1626710147 tempest-AggregatesAdminTestV241-1626710147-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:07:51.292132 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d6aa964d-721c-4cf9-aeea-34230616dbbe tempest-AggregatesAdminTestV241-1626710147 tempest-AggregatesAdminTestV241-1626710147-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:07:51.317222 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d6aa964d-721c-4cf9-aeea-34230616dbbe tempest-AggregatesAdminTestV241-1626710147 tempest-AggregatesAdminTestV241-1626710147-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 1.904248 Jul 18 02:07:51.317953 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2/3] 10.222.0.57 () {60 vars in 1207 bytes} [Mon Jul 18 02:07:49 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 1906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:07:51.417931 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3475aef8-16b8-42cf-88c7-4bbc65503031 tempest-InstanceUsageAuditLogNegativeTestJSON-1661392273 tempest-InstanceUsageAuditLogNegativeTestJSON-1661392273-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:07:51.419022 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:51.419022 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:07:51.422862 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-3475aef8-16b8-42cf-88c7-4bbc65503031 tempest-InstanceUsageAuditLogNegativeTestJSON-1661392273 tempest-InstanceUsageAuditLogNegativeTestJSON-1661392273-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Jul 18 02:07:51.440353 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3475aef8-16b8-42cf-88c7-4bbc65503031 tempest-InstanceUsageAuditLogNegativeTestJSON-1661392273 tempest-InstanceUsageAuditLogNegativeTestJSON-1661392273-project-admin] Request method failure captured: Jul 18 02:07:51.440353 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Jul 18 02:07:51.440353 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:07:51.440353 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:07:51.440353 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:07:51.440353 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:07:51.440353 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:07:51.440353 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:07:51.440353 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:07:51.440353 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:07:51.440353 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MB1s7IgeWRmMOziLLOJ3X52aUWAYAwDBRfwLKwm2J6ZsQ6EqulUXdNVE8rS5X8pvfAVvZ3l1UahzbZnLKLea_lQnyEKfKGoyGW3BEt3gQYpI6iv26p_aqvq5gfGxJJ6cfU1Kv69wU6FOOSn6VK6cLZCzQJFw2__zzZeKMBZT9aLaXE Jul 18 02:07:51.440353 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:07:51.440353 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:07:51.440353 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:07:51.440353 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:07:51.440353 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:07:51.440353 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:07:51.440353 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: ac996c29c98c4286a9d65644c23ddedc Jul 18 02:07:51.440353 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1661392273 Jul 18 02:07:51.440353 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,admin,reader Jul 18 02:07:51.440353 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,admin,reader Jul 18 02:07:51.441570 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ac996c29c98c4286a9d65644c23ddedc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ac996c29c98c4286a9d65644c23ddedc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ac996c29c98c4286a9d65644c23ddedc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ac996c29c98c4286a9d65644c23ddedc"}]}] Jul 18 02:07:51.441570 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1661392273 Jul 18 02:07:51.441570 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: ac996c29c98c4286a9d65644c23ddedc Jul 18 02:07:51.441570 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1661392273 Jul 18 02:07:51.441570 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1661392273-project-admin Jul 18 02:07:51.441570 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:07:51.441570 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:07:51.441570 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 284fdc365a664471800d725b6075c423 Jul 18 02:07:51.441570 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1661392273-project-admin Jul 18 02:07:51.441570 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:07:51.441570 n-d-465891-3 devstack@n-api.service[119543]: exception: Invalid timestamp for date invalid_time Jul 18 02:07:51.442383 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'invalid_time'} Jul 18 02:07:51.442383 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:07:51.442383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:51.442383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Jul 18 02:07:51.442383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Jul 18 02:07:51.442383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Jul 18 02:07:51.442383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Jul 18 02:07:51.442383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Jul 18 02:07:51.442383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Jul 18 02:07:51.442383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Jul 18 02:07:51.442383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:07:51.442383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:07:51.442383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:07:51.442383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:51.442383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:07:51.442383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:07:51.442383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:07:51.442383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:07:51.442383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:07:51.442383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:07:51.443556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Jul 18 02:07:51.443556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Jul 18 02:07:51.443556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Jul 18 02:07:51.443556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:07:51.443556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:07:51.443556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:07:51.443556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:51.443556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:07:51.443556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:07:51.443556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:07:51.443556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:07:51.443556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Jul 18 02:07:51.443556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:07:51.443556 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3475aef8-16b8-42cf-88c7-4bbc65503031 tempest-InstanceUsageAuditLogNegativeTestJSON-1661392273 tempest-InstanceUsageAuditLogNegativeTestJSON-1661392273-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:07:51.443556 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3475aef8-16b8-42cf-88c7-4bbc65503031 tempest-InstanceUsageAuditLogNegativeTestJSON-1661392273 tempest-InstanceUsageAuditLogNegativeTestJSON-1661392273-project-admin] 10.222.0.57 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.483406 Jul 18 02:07:51.445933 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2/4] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Jul 18 02:07:50 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 485 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 18 02:07:51.834675 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0f524192-d1c0-483b-b2b5-48e258484c91 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Calling method '.version_select at 0x7ff4ab395310>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:07:51.835491 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:51.835491 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:07:51.837268 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f524192-d1c0-483b-b2b5-48e258484c91 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:07:51.837736 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f524192-d1c0-483b-b2b5-48e258484c91 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:07:51.878262 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f524192-d1c0-483b-b2b5-48e258484c91 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:07:51.880674 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f524192-d1c0-483b-b2b5-48e258484c91 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:07:51.882800 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-84b78f35-87cd-4538-bf0d-e434ff2b2d26 tempest-AZAdminV2TestJSON-401284900 tempest-AZAdminV2TestJSON-401284900-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:07:51.888089 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-84b78f35-87cd-4538-bf0d-e434ff2b2d26 tempest-AZAdminV2TestJSON-401284900 tempest-AZAdminV2TestJSON-401284900-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:07:51.889529 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-84b78f35-87cd-4538-bf0d-e434ff2b2d26 tempest-AZAdminV2TestJSON-401284900 tempest-AZAdminV2TestJSON-401284900-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:07:51.890561 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-84b78f35-87cd-4538-bf0d-e434ff2b2d26 tempest-AZAdminV2TestJSON-401284900 tempest-AZAdminV2TestJSON-401284900-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:07:51.892202 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-84b78f35-87cd-4538-bf0d-e434ff2b2d26 tempest-AZAdminV2TestJSON-401284900 tempest-AZAdminV2TestJSON-401284900-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:07:51.905747 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f524192-d1c0-483b-b2b5-48e258484c91 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:07:51.907947 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f524192-d1c0-483b-b2b5-48e258484c91 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:07:51.924596 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0f524192-d1c0-483b-b2b5-48e258484c91 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.603145 Jul 18 02:07:51.932484 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3/5] 10.222.0.57 () {58 vars in 1166 bytes} [Mon Jul 18 02:07:51 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:07:51.937476 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d5cdce18-6ee2-489b-8dbd-66498ed64f87 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1677540072"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:07:51.975214 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:51.975214 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:07:51.976518 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.aggregate [None req-d5cdce18-6ee2-489b-8dbd-66498ed64f87 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Generated uuid 75cd0644-7321-490a-9d47-3515eb3c58c2 for aggregate {{(pid=119544) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 02:07:51.987085 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-84b78f35-87cd-4538-bf0d-e434ff2b2d26 tempest-AZAdminV2TestJSON-401284900 tempest-AZAdminV2TestJSON-401284900-project-admin] 10.222.0.57 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.540551 Jul 18 02:07:51.993916 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3/6] 10.222.0.57 () {58 vars in 1163 bytes} [Mon Jul 18 02:07:51 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:07:52.125161 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d5cdce18-6ee2-489b-8dbd-66498ed64f87 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.191153 Jul 18 02:07:52.126489 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 4/7] 10.222.0.57 () {60 vars in 1163 bytes} [Mon Jul 18 02:07:51 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:07:52.137912 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ed03b0bd-6047-4222-ba31-52283217b4e5 tempest-AZAdminV2TestJSON-401284900 tempest-AZAdminV2TestJSON-401284900-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:07:52.138940 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:52.138940 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:07:52.140451 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ed03b0bd-6047-4222-ba31-52283217b4e5 tempest-AZAdminV2TestJSON-401284900 tempest-AZAdminV2TestJSON-401284900-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:07:52.141102 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ed03b0bd-6047-4222-ba31-52283217b4e5 tempest-AZAdminV2TestJSON-401284900 tempest-AZAdminV2TestJSON-401284900-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:07:52.142156 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ed03b0bd-6047-4222-ba31-52283217b4e5 tempest-AZAdminV2TestJSON-401284900 tempest-AZAdminV2TestJSON-401284900-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:07:52.144953 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ed03b0bd-6047-4222-ba31-52283217b4e5 tempest-AZAdminV2TestJSON-401284900 tempest-AZAdminV2TestJSON-401284900-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:07:52.217067 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ed03b0bd-6047-4222-ba31-52283217b4e5 tempest-AZAdminV2TestJSON-401284900 tempest-AZAdminV2TestJSON-401284900-project-admin] 10.222.0.57 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.089191 Jul 18 02:07:52.217836 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 5/8] 10.222.0.57 () {58 vars in 1184 bytes} [Mon Jul 18 02:07:52 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:07:52.223976 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ecf536d8-cc0c-4e9b-9025-e7bddb25bd48 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-465891-3"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:07:52.225107 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:52.225107 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:07:52.234278 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ecf536d8-cc0c-4e9b-9025-e7bddb25bd48 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:07:52.234820 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ecf536d8-cc0c-4e9b-9025-e7bddb25bd48 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:07:52.281256 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-15c3f0b5-cc6a-4341-b691-efdc9f6a84fc tempest-InstanceUsageAuditLogNegativeTestJSON-627843308 tempest-InstanceUsageAuditLogNegativeTestJSON-627843308-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:07:52.283011 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:52.283011 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:07:52.285173 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-15c3f0b5-cc6a-4341-b691-efdc9f6a84fc tempest-InstanceUsageAuditLogNegativeTestJSON-627843308 tempest-InstanceUsageAuditLogNegativeTestJSON-627843308-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'e73e16916bb44626b371cb80aa6f1cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcbb95f961394bb39b9b50ca55830776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:07:52.287647 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-15c3f0b5-cc6a-4341-b691-efdc9f6a84fc tempest-InstanceUsageAuditLogNegativeTestJSON-627843308 tempest-InstanceUsageAuditLogNegativeTestJSON-627843308-project] Request method failure captured: Jul 18 02:07:52.287647 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Jul 18 02:07:52.287647 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:07:52.287647 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:07:52.287647 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:07:52.287647 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:07:52.287647 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:07:52.287647 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:07:52.287647 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:07:52.287647 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:07:52.287647 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MByYolZZM8EguJOvZjgdjee0xlwM7_6ABPXuR-_i0lt3L7EHth8wyQ7vizog2UO5V-ZwkIJr_I3DuK-TOtsrQ74aj76M5NdvQbjYvFTQUo5ku_E7T2FyEIfPqRBmlC1ZkUO88GG2WJ538d_xqYijjOJWt60Co33iiSi5pUYRJ9T4hA Jul 18 02:07:52.287647 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:07:52.287647 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:07:52.287647 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:07:52.287647 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:07:52.287647 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:07:52.287647 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:07:52.287647 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: dcbb95f961394bb39b9b50ca55830776 Jul 18 02:07:52.287647 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-627843308 Jul 18 02:07:52.287647 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:07:52.287647 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:07:52.289358 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_dcbb95f961394bb39b9b50ca55830776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/dcbb95f961394bb39b9b50ca55830776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/dcbb95f961394bb39b9b50ca55830776"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/dcbb95f961394bb39b9b50ca55830776"}]}] Jul 18 02:07:52.289358 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-627843308 Jul 18 02:07:52.289358 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: dcbb95f961394bb39b9b50ca55830776 Jul 18 02:07:52.289358 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-627843308 Jul 18 02:07:52.289358 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-627843308-project Jul 18 02:07:52.289358 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:07:52.289358 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:07:52.289358 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: e73e16916bb44626b371cb80aa6f1cf6 Jul 18 02:07:52.289358 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-627843308-project Jul 18 02:07:52.289358 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:07:52.289358 n-d-465891-3 devstack@n-api.service[119543]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 18 02:07:52.290006 n-d-465891-3 devstack@n-api.service[119543]: action_args: {} Jul 18 02:07:52.290006 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:07:52.290006 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:52.290006 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:07:52.290006 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:07:52.290006 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:07:52.290006 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:07:52.290006 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:07:52.290006 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:07:52.290006 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Jul 18 02:07:52.290006 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Jul 18 02:07:52.290006 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:07:52.290006 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:07:52.290006 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:07:52.290006 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:07:52.290006 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:07:52.290006 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:07:52.290006 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:07:52.290006 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:07:52.290006 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:07:52.290972 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:07:52.290972 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:07:52.290972 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:07:52.290972 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:07:52.290972 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:07:52.290972 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 18 02:07:52.290972 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:07:52.290972 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:07:52.290972 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:07:52.290972 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:52.290972 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:07:52.290972 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:07:52.290972 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:07:52.290972 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:07:52.290972 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 18 02:07:52.290972 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:07:52.290972 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-15c3f0b5-cc6a-4341-b691-efdc9f6a84fc tempest-InstanceUsageAuditLogNegativeTestJSON-627843308 tempest-InstanceUsageAuditLogNegativeTestJSON-627843308-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:07:52.291806 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-15c3f0b5-cc6a-4341-b691-efdc9f6a84fc tempest-InstanceUsageAuditLogNegativeTestJSON-627843308 tempest-InstanceUsageAuditLogNegativeTestJSON-627843308-project] 10.222.0.57 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.290384 Jul 18 02:07:52.291806 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 4/9] 10.222.0.57 () {58 vars in 1184 bytes} [Mon Jul 18 02:07:51 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 294 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:07:52.317334 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-11afd84f-0a2b-4e81-90b4-fb498012ef0e tempest-InstanceUsageAuditLogNegativeTestJSON-627843308 tempest-InstanceUsageAuditLogNegativeTestJSON-627843308-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:07:52.318245 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:52.318245 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:07:52.319409 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-11afd84f-0a2b-4e81-90b4-fb498012ef0e tempest-InstanceUsageAuditLogNegativeTestJSON-627843308 tempest-InstanceUsageAuditLogNegativeTestJSON-627843308-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'e73e16916bb44626b371cb80aa6f1cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcbb95f961394bb39b9b50ca55830776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:07:52.321658 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-11afd84f-0a2b-4e81-90b4-fb498012ef0e tempest-InstanceUsageAuditLogNegativeTestJSON-627843308 tempest-InstanceUsageAuditLogNegativeTestJSON-627843308-project] Request method failure captured: Jul 18 02:07:52.321658 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-07-18%2002:07:52 HTTP/1.1 Jul 18 02:07:52.321658 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:07:52.321658 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:07:52.321658 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:07:52.321658 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:07:52.321658 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:07:52.321658 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:07:52.321658 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:07:52.321658 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:07:52.321658 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MByYolZZM8EguJOvZjgdjee0xlwM7_6ABPXuR-_i0lt3L7EHth8wyQ7vizog2UO5V-ZwkIJr_I3DuK-TOtsrQ74aj76M5NdvQbjYvFTQUo5ku_E7T2FyEIfPqRBmlC1ZkUO88GG2WJ538d_xqYijjOJWt60Co33iiSi5pUYRJ9T4hA Jul 18 02:07:52.321658 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:07:52.321658 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:07:52.321658 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:07:52.321658 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:07:52.321658 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:07:52.321658 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:07:52.321658 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: dcbb95f961394bb39b9b50ca55830776 Jul 18 02:07:52.321658 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-627843308 Jul 18 02:07:52.321658 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:07:52.321658 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:07:52.322718 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_dcbb95f961394bb39b9b50ca55830776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/dcbb95f961394bb39b9b50ca55830776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/dcbb95f961394bb39b9b50ca55830776"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/dcbb95f961394bb39b9b50ca55830776"}]}] Jul 18 02:07:52.322718 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-627843308 Jul 18 02:07:52.322718 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: dcbb95f961394bb39b9b50ca55830776 Jul 18 02:07:52.322718 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-627843308 Jul 18 02:07:52.322718 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-627843308-project Jul 18 02:07:52.322718 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:07:52.322718 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:07:52.322718 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: e73e16916bb44626b371cb80aa6f1cf6 Jul 18 02:07:52.322718 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-627843308-project Jul 18 02:07:52.322718 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:07:52.322718 n-d-465891-3 devstack@n-api.service[119543]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 18 02:07:52.323261 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '2022-07-18 02:07:52'} Jul 18 02:07:52.323261 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:07:52.323261 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:52.323261 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:07:52.323261 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:07:52.323261 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:07:52.323261 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:07:52.323261 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:07:52.323261 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:07:52.323261 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Jul 18 02:07:52.323261 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Jul 18 02:07:52.323261 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:07:52.323261 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:07:52.323261 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:07:52.323261 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:07:52.323261 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:07:52.323261 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:07:52.323261 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:07:52.323261 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:07:52.323261 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:07:52.324483 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:07:52.324483 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:07:52.324483 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:07:52.324483 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:07:52.324483 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:07:52.324483 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 18 02:07:52.324483 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:07:52.324483 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:07:52.324483 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:07:52.324483 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:52.324483 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:07:52.324483 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:07:52.324483 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:07:52.324483 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:07:52.324483 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 18 02:07:52.324483 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:07:52.327469 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-11afd84f-0a2b-4e81-90b4-fb498012ef0e tempest-InstanceUsageAuditLogNegativeTestJSON-627843308 tempest-InstanceUsageAuditLogNegativeTestJSON-627843308-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:07:52.328336 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-11afd84f-0a2b-4e81-90b4-fb498012ef0e tempest-InstanceUsageAuditLogNegativeTestJSON-627843308 tempest-InstanceUsageAuditLogNegativeTestJSON-627843308-project] 10.222.0.57 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-18 02:07:52" status: 403 len: 128 microversion: 2.1 time: 0.025357 Jul 18 02:07:52.334007 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 5/10] 10.222.0.57 () {58 vars in 1250 bytes} [Mon Jul 18 02:07:52 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-18%2002%3A07%3A52 => generated 128 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:07:53.918877 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ecf536d8-cc0c-4e9b-9025-e7bddb25bd48 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 242 microversion: 2.1 time: 1.699552 Jul 18 02:07:53.920200 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 6/11] 10.222.0.57 () {60 vars in 1190 bytes} [Mon Jul 18 02:07:52 2022] POST /compute/v2.1/os-aggregates/1/action => generated 242 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:07:53.931829 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5d92b164-2b8f-40c4-aa70-8531f29edd67 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-465891-3"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:07:53.933825 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:53.933825 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:07:53.946002 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5d92b164-2b8f-40c4-aa70-8531f29edd67 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:07:53.946963 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5d92b164-2b8f-40c4-aa70-8531f29edd67 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:07:53.983490 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-5d92b164-2b8f-40c4-aa70-8531f29edd67 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h2-465891-3. Jul 18 02:07:54.002472 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5d92b164-2b8f-40c4-aa70-8531f29edd67 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Request method failure captured: Jul 18 02:07:54.002472 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Jul 18 02:07:54.002472 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:07:54.002472 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:07:54.002472 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:07:54.002472 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 39 Jul 18 02:07:54.002472 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:07:54.002472 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:07:54.002472 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:07:54.002472 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:07:54.002472 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MB0ZxGk9u4Uk_EwyzhZO-OJJqjtv3dHSHNJs6VOqzVpp3jV4rjfgDkwV6YwPlwtkSjiFmmE32wRoMGsc0hgCLWJe8dj2F3Y2H4Zs5GwZIurm_-eDLpp5YSzNdObxQlVqDh7XFLyy9iEElHlhfauWrhlGnW0m-nLS1BE4HV78Iqrvu0 Jul 18 02:07:54.002472 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:07:54.002472 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:07:54.002472 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:07:54.002472 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:07:54.002472 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:07:54.002472 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:07:54.002472 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: ce404d6e42ea47ba9edefc4b54608c80 Jul 18 02:07:54.002472 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-850183465 Jul 18 02:07:54.002472 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,admin,reader Jul 18 02:07:54.002472 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,admin,reader Jul 18 02:07:54.003571 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ce404d6e42ea47ba9edefc4b54608c80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ce404d6e42ea47ba9edefc4b54608c80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ce404d6e42ea47ba9edefc4b54608c80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ce404d6e42ea47ba9edefc4b54608c80"}]}] Jul 18 02:07:54.003571 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-850183465 Jul 18 02:07:54.003571 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: ce404d6e42ea47ba9edefc4b54608c80 Jul 18 02:07:54.003571 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-850183465 Jul 18 02:07:54.003571 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin Jul 18 02:07:54.003571 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:07:54.003571 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:07:54.003571 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 7b848a7089f342e0a3211f32d59a087a Jul 18 02:07:54.003571 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin Jul 18 02:07:54.003571 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:07:54.003571 n-d-465891-3 devstack@n-api.service[119544]: {"add_host": {"host": "n-h2-465891-3"}} Jul 18 02:07:54.003571 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:07:54.003571 n-d-465891-3 devstack@n-api.service[119544]: exception: Aggregate 1 already has host n-h2-465891-3. Jul 18 02:07:54.004221 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h2-465891-3'}}} Jul 18 02:07:54.004221 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:07:54.004221 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:54.004221 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 02:07:54.004221 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 18 02:07:54.004221 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 02:07:54.004221 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 18 02:07:54.004221 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 02:07:54.004221 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 18 02:07:54.004221 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 02:07:54.004221 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 18 02:07:54.004221 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 02:07:54.004221 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 02:07:54.004221 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 02:07:54.004221 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result.read() Jul 18 02:07:54.004221 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 02:07:54.004221 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 18 02:07:54.004221 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 02:07:54.004221 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 18 02:07:54.005184 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 02:07:54.005184 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 18 02:07:54.005184 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 02:07:54.005184 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 18 02:07:54.005184 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-465891-3-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 18 02:07:54.005184 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:54.005184 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 18 02:07:54.005184 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:54.005184 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:54.005184 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Jul 18 02:07:54.005184 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Jul 18 02:07:54.005184 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 18 02:07:54.005184 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi session.flush() Jul 18 02:07:54.005184 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 18 02:07:54.005184 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 18 02:07:54.005184 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 18 02:07:54.005184 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 18 02:07:54.005184 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 18 02:07:54.005184 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 18 02:07:54.006175 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 02:07:54.006175 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception Jul 18 02:07:54.006175 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 18 02:07:54.006175 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 18 02:07:54.006175 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 18 02:07:54.006175 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 18 02:07:54.006175 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 18 02:07:54.006175 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 18 02:07:54.006175 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 18 02:07:54.006175 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 18 02:07:54.006175 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 18 02:07:54.006175 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 18 02:07:54.006175 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 18 02:07:54.006175 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 18 02:07:54.006175 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 18 02:07:54.006175 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 18 02:07:54.006175 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 18 02:07:54.006175 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 18 02:07:54.007932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 18 02:07:54.007932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 18 02:07:54.007932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 18 02:07:54.007932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 18 02:07:54.007932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 02:07:54.007932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception Jul 18 02:07:54.007932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 02:07:54.007932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 18 02:07:54.007932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 02:07:54.007932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 18 02:07:54.007932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 02:07:54.007932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 18 02:07:54.007932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 02:07:54.007932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 18 02:07:54.007932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 02:07:54.007932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 02:07:54.007932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 02:07:54.007932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result.read() Jul 18 02:07:54.010815 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 02:07:54.010815 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 18 02:07:54.010815 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 02:07:54.010815 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 18 02:07:54.010815 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 02:07:54.010815 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 18 02:07:54.010815 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 02:07:54.010815 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 18 02:07:54.010815 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-465891-3-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 18 02:07:54.010815 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Jul 18 02:07:54.010815 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 18, 2, 7, 53, 969231), 'updated_at': None, 'host': 'n-h2-465891-3', 'aggregate_id': 1}] Jul 18 02:07:54.010815 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 18 02:07:54.010815 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:54.010815 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:07:54.010815 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:54.010815 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:54.010815 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 18 02:07:54.014564 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 18 02:07:54.014564 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 02:07:54.014564 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 02:07:54.014564 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:07:54.014564 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:07:54.014564 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:07:54.014564 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:07:54.014564 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 02:07:54.014564 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 02:07:54.014564 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6513, in add_host_to_aggregate Jul 18 02:07:54.014564 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Jul 18 02:07:54.014564 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 18 02:07:54.014564 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 18 02:07:54.014564 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Jul 18 02:07:54.014564 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Jul 18 02:07:54.014564 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Jul 18 02:07:54.014564 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Jul 18 02:07:54.014564 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h2-465891-3. Jul 18 02:07:54.014564 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:54.014564 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:07:54.017302 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:54.017302 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:54.017302 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:07:54.017302 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:07:54.017302 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:07:54.017302 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:07:54.017302 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:07:54.017302 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:07:54.017302 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:07:54.017302 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:07:54.017302 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Jul 18 02:07:54.017302 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 18 02:07:54.017302 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h2-465891-3. Jul 18 02:07:54.017302 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:54.017302 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:07:54.017302 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:54.017302 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:54.017302 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:07:54.017302 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:07:54.017302 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:07:54.017302 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:07:54.019969 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h2-465891-3. Jul 18 02:07:54.019969 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:54.019969 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5d92b164-2b8f-40c4-aa70-8531f29edd67 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Returning 409 to user: Aggregate 1 already has host n-h2-465891-3. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:07:54.019969 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5d92b164-2b8f-40c4-aa70-8531f29edd67 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.083597 Jul 18 02:07:54.019969 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 7/12] 10.222.0.57 () {60 vars in 1190 bytes} [Mon Jul 18 02:07:53 2022] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 87 msecs (HTTP/1.1 409) 9 headers in 377 bytes (2 switches on core 0) Jul 18 02:07:54.029083 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-aa483335-375b-42ce-8733-9cd469b31bc1 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-465891-3"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:07:54.030846 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:54.030846 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:07:54.043488 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-385b4a24-7acd-4b4f-88cf-cc73e36cff59 tempest-AZAdminNegativeTestJSON-1281368844 tempest-AZAdminNegativeTestJSON-1281368844-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:07:54.045085 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:54.045085 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:07:54.046285 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-385b4a24-7acd-4b4f-88cf-cc73e36cff59 tempest-AZAdminNegativeTestJSON-1281368844 tempest-AZAdminNegativeTestJSON-1281368844-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'b933e7041a364355905805b9aca2a48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6eaee2bafd4d42a3dddc0d1742dc19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:07:54.048200 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aa483335-375b-42ce-8733-9cd469b31bc1 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:07:54.048526 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-385b4a24-7acd-4b4f-88cf-cc73e36cff59 tempest-AZAdminNegativeTestJSON-1281368844 tempest-AZAdminNegativeTestJSON-1281368844-project] Request method failure captured: Jul 18 02:07:54.048526 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Jul 18 02:07:54.048526 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:07:54.048526 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:07:54.048526 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:07:54.048526 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:07:54.048526 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:07:54.048526 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:07:54.048526 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:07:54.048526 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:07:54.048526 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MB3wqs3qDiEdBSI1J95QJ_tZtm76tgs-Lgtw23KMezglJwSwf6yKvEBV3CNemrZ6bxVbfLNapguFG9Sf3ThpOjm-v1uSUBLT-V6nFTRie19blWYT1gxNry48OGsoOCgL547XyHwdETOUCUoJm6zFlQaWn5jle2rVdo73wriRCcNUec Jul 18 02:07:54.048526 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:07:54.048526 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:07:54.048526 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:07:54.048526 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:07:54.048526 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:07:54.048526 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:07:54.048526 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: dc6eaee2bafd4d42a3dddc0d1742dc19 Jul 18 02:07:54.048526 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1281368844 Jul 18 02:07:54.048526 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:07:54.048526 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:07:54.049829 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_dc6eaee2bafd4d42a3dddc0d1742dc19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/dc6eaee2bafd4d42a3dddc0d1742dc19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/dc6eaee2bafd4d42a3dddc0d1742dc19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/dc6eaee2bafd4d42a3dddc0d1742dc19"}]}] Jul 18 02:07:54.049829 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-AZAdminNegativeTestJSON-1281368844 Jul 18 02:07:54.049829 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: dc6eaee2bafd4d42a3dddc0d1742dc19 Jul 18 02:07:54.049829 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1281368844 Jul 18 02:07:54.049829 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-AZAdminNegativeTestJSON-1281368844-project Jul 18 02:07:54.049829 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:07:54.049829 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:07:54.049829 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: b933e7041a364355905805b9aca2a48f Jul 18 02:07:54.049829 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-AZAdminNegativeTestJSON-1281368844-project Jul 18 02:07:54.049829 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:07:54.049829 n-d-465891-3 devstack@n-api.service[119543]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 18 02:07:54.049829 n-d-465891-3 devstack@n-api.service[119543]: action_args: {} Jul 18 02:07:54.050550 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:07:54.050550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:54.050550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:07:54.050550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:07:54.050550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:07:54.050550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:07:54.050550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:07:54.050550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:07:54.050550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Jul 18 02:07:54.050550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Jul 18 02:07:54.050550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:07:54.050550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:07:54.050550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:07:54.050550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:07:54.050550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:07:54.050550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:07:54.050550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:07:54.050550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:07:54.050550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:07:54.052195 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:07:54.052195 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:07:54.052195 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:07:54.052195 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:07:54.052195 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:07:54.052195 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 18 02:07:54.052195 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:07:54.052195 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:07:54.052195 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:07:54.052195 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:54.052195 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:07:54.052195 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:07:54.052195 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:07:54.052195 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:07:54.052195 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 18 02:07:54.052195 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:07:54.052195 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-385b4a24-7acd-4b4f-88cf-cc73e36cff59 tempest-AZAdminNegativeTestJSON-1281368844 tempest-AZAdminNegativeTestJSON-1281368844-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:07:54.053323 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aa483335-375b-42ce-8733-9cd469b31bc1 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:07:54.053414 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-385b4a24-7acd-4b4f-88cf-cc73e36cff59 tempest-AZAdminNegativeTestJSON-1281368844 tempest-AZAdminNegativeTestJSON-1281368844-project] 10.222.0.57 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.567147 Jul 18 02:07:54.057111 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 6/13] 10.222.0.57 () {58 vars in 1184 bytes} [Mon Jul 18 02:07:53 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 575 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:07:54.242735 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-aa483335-375b-42ce-8733-9cd469b31bc1 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 227 microversion: 2.1 time: 0.221737 Jul 18 02:07:54.243796 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 8/14] 10.222.0.57 () {60 vars in 1190 bytes} [Mon Jul 18 02:07:54 2022] POST /compute/v2.1/os-aggregates/1/action => generated 227 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:07:54.262564 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5e1f2044-f1ae-491c-8907-fe76bcf72803 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:07:54.263787 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:54.263787 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:07:54.436240 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5e1f2044-f1ae-491c-8907-fe76bcf72803 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.184575 Jul 18 02:07:54.438823 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 7/15] 10.222.0.57 () {58 vars in 1151 bytes} [Mon Jul 18 02:07:54 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 02:07:54.447635 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5ece649a-8c36-4b13-b513-bf93e6267e5d tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2133073138"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:07:54.451458 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:54.451458 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:07:54.459939 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.aggregate [None req-5ece649a-8c36-4b13-b513-bf93e6267e5d tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Generated uuid 9f83a8ea-9fee-4a10-9f0e-dd9ceaa86d14 for aggregate {{(pid=119544) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 02:07:54.492243 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-57ed3fde-d2b8-440e-9493-8bb6ea58791f tempest-AggregatesAdminTestV241-1626710147 tempest-AggregatesAdminTestV241-1626710147-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-269991553"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:07:54.512143 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5ece649a-8c36-4b13-b513-bf93e6267e5d tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.068332 Jul 18 02:07:54.516372 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 9/16] 10.222.0.57 () {60 vars in 1163 bytes} [Mon Jul 18 02:07:54 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:07:54.543312 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:54.543312 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:07:54.544373 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.aggregate [None req-57ed3fde-d2b8-440e-9493-8bb6ea58791f tempest-AggregatesAdminTestV241-1626710147 tempest-AggregatesAdminTestV241-1626710147-project-admin] Generated uuid fc52f3a2-77af-45fe-a7d2-00004a42433c for aggregate {{(pid=119543) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 02:07:54.611117 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-57ed3fde-d2b8-440e-9493-8bb6ea58791f tempest-AggregatesAdminTestV241-1626710147 tempest-AggregatesAdminTestV241-1626710147-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.122648 Jul 18 02:07:54.611665 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 8/17] 10.222.0.57 () {62 vars in 1204 bytes} [Mon Jul 18 02:07:54 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:07:54.622837 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6c26ee8e-1dd9-4be2-963a-af2c16d1bad1 tempest-AggregatesAdminTestV241-1626710147 tempest-AggregatesAdminTestV241-1626710147-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1142359699"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:07:54.734223 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:54.734223 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:07:54.775507 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6c26ee8e-1dd9-4be2-963a-af2c16d1bad1 tempest-AggregatesAdminTestV241-1626710147 tempest-AggregatesAdminTestV241-1626710147-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-aggregates/3" status: 200 len: 299 microversion: 2.41 time: 0.156671 Jul 18 02:07:54.776487 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 9/18] 10.222.0.57 () {62 vars in 1209 bytes} [Mon Jul 18 02:07:54 2022] PUT /compute/v2.1/os-aggregates/3 => generated 299 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 02:07:54.792015 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-35c3395e-bb3d-443d-a231-49209c3609ae tempest-AggregatesAdminTestV241-1626710147 tempest-AggregatesAdminTestV241-1626710147-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:07:54.792815 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:54.792815 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:07:54.803744 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-35c3395e-bb3d-443d-a231-49209c3609ae tempest-AggregatesAdminTestV241-1626710147 tempest-AggregatesAdminTestV241-1626710147-project-admin] 10.222.0.57 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 299 microversion: 2.41 time: 0.020118 Jul 18 02:07:54.804385 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 10/19] 10.222.0.57 () {60 vars in 1189 bytes} [Mon Jul 18 02:07:54 2022] GET /compute/v2.1/os-aggregates/3 => generated 299 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 02:07:54.821852 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-31d63d83-e5b1-4b8b-9cf0-5ccdb352d795 tempest-AggregatesAdminTestV241-1626710147 tempest-AggregatesAdminTestV241-1626710147-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-465891-3"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:07:54.821852 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:54.821852 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:07:54.843801 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-31d63d83-e5b1-4b8b-9cf0-5ccdb352d795 tempest-AggregatesAdminTestV241-1626710147 tempest-AggregatesAdminTestV241-1626710147-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:07:54.844479 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-31d63d83-e5b1-4b8b-9cf0-5ccdb352d795 tempest-AggregatesAdminTestV241-1626710147 tempest-AggregatesAdminTestV241-1626710147-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:07:55.151602 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0be02978-497f-4ec9-8e48-6c9a1d560a51 tempest-AggregatesAdminNegativeTestJSON-817538988 tempest-AggregatesAdminNegativeTestJSON-817538988-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-465891-3"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:07:55.152982 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:55.152982 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:07:55.153868 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0be02978-497f-4ec9-8e48-6c9a1d560a51 tempest-AggregatesAdminNegativeTestJSON-817538988 tempest-AggregatesAdminNegativeTestJSON-817538988-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '2446e24dbad94d68bc53e68994425219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06623d9175f84a2f855ea1a2608500cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:07:55.156243 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0be02978-497f-4ec9-8e48-6c9a1d560a51 tempest-AggregatesAdminNegativeTestJSON-817538988 tempest-AggregatesAdminNegativeTestJSON-817538988-project] Request method failure captured: Jul 18 02:07:55.156243 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Jul 18 02:07:55.156243 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:07:55.156243 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:07:55.156243 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:07:55.156243 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 39 Jul 18 02:07:55.156243 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:07:55.156243 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:07:55.156243 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:07:55.156243 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:07:55.156243 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MByRc4VXjOZoV01x3OdnWsXQswqB5DdqJzYLYdStk4XRPpgvD_Nco5d84c-ncA4XIELItWPebyNkPp7X2ZZWb9IUctL1w5F7C-Xuzl23qh88YB4Oiv0-vRXobPECoqF_AiuWWHHVVYw4BxcafTtQnwhjKuefqfWnrPDvh4Zl-EjdXA Jul 18 02:07:55.156243 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:07:55.156243 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:07:55.156243 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:07:55.156243 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:07:55.156243 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:07:55.156243 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:07:55.156243 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 06623d9175f84a2f855ea1a2608500cd Jul 18 02:07:55.156243 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-817538988 Jul 18 02:07:55.156243 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:07:55.156243 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:07:55.157417 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_06623d9175f84a2f855ea1a2608500cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/06623d9175f84a2f855ea1a2608500cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/06623d9175f84a2f855ea1a2608500cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/06623d9175f84a2f855ea1a2608500cd"}]}] Jul 18 02:07:55.157417 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-817538988 Jul 18 02:07:55.157417 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 06623d9175f84a2f855ea1a2608500cd Jul 18 02:07:55.157417 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-817538988 Jul 18 02:07:55.157417 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-AggregatesAdminNegativeTestJSON-817538988-project Jul 18 02:07:55.157417 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:07:55.157417 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:07:55.157417 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 2446e24dbad94d68bc53e68994425219 Jul 18 02:07:55.157417 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-817538988-project Jul 18 02:07:55.157417 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:07:55.157417 n-d-465891-3 devstack@n-api.service[119544]: {"add_host": {"host": "n-h2-465891-3"}} Jul 18 02:07:55.157417 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:07:55.157417 n-d-465891-3 devstack@n-api.service[119544]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 18 02:07:55.158124 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h2-465891-3'}}} Jul 18 02:07:55.158124 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:07:55.158124 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:55.158124 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:07:55.158124 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:07:55.158124 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:07:55.158124 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:07:55.158124 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:07:55.158124 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:07:55.158124 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:07:55.158124 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:07:55.158124 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Jul 18 02:07:55.158124 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Jul 18 02:07:55.158124 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:07:55.158124 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:07:55.158124 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:07:55.158124 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:07:55.158124 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:07:55.158124 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:07:55.159222 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:07:55.159222 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:07:55.159222 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:07:55.159222 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:07:55.159222 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:07:55.159222 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:07:55.159222 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:07:55.159222 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:07:55.159222 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 18 02:07:55.159222 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:55.159222 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:07:55.159222 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:55.159222 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:55.159222 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:07:55.159222 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:07:55.159222 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:07:55.159222 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:07:55.159222 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 18 02:07:55.159222 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:55.162785 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0be02978-497f-4ec9-8e48-6c9a1d560a51 tempest-AggregatesAdminNegativeTestJSON-817538988 tempest-AggregatesAdminNegativeTestJSON-817538988-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:07:55.164608 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0be02978-497f-4ec9-8e48-6c9a1d560a51 tempest-AggregatesAdminNegativeTestJSON-817538988 tempest-AggregatesAdminNegativeTestJSON-817538988-project] 10.222.0.57 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.636837 Jul 18 02:07:55.165689 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 10/20] 10.222.0.57 () {60 vars in 1190 bytes} [Mon Jul 18 02:07:54 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 639 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:07:55.177573 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-04c15c87-f4f3-4b93-80e4-d83233bb9e79 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:07:55.179146 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:55.179146 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:07:55.208468 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-04c15c87-f4f3-4b93-80e4-d83233bb9e79 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.038040 Jul 18 02:07:55.209809 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 11/21] 10.222.0.57 () {58 vars in 1151 bytes} [Mon Jul 18 02:07:55 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 02:07:55.223592 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-aa6acb8a-6322-4fce-8275-6b5b49b62998 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-784586736"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:07:55.228264 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:55.228264 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:07:55.231500 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.aggregate [None req-aa6acb8a-6322-4fce-8275-6b5b49b62998 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Generated uuid 0d641f2d-0c22-4e5a-8cc0-b87f8657f211 for aggregate {{(pid=119544) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 02:07:55.262926 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-aa6acb8a-6322-4fce-8275-6b5b49b62998 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.046127 Jul 18 02:07:55.264113 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 12/22] 10.222.0.57 () {60 vars in 1163 bytes} [Mon Jul 18 02:07:55 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:07:55.277958 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3b36667e-6ffb-4131-8eac-f00d1d7ece90 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1241746237"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:07:55.282500 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:55.282500 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:07:55.291887 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b36667e-6ffb-4131-8eac-f00d1d7ece90 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:07:55.292400 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b36667e-6ffb-4131-8eac-f00d1d7ece90 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:07:55.300535 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b36667e-6ffb-4131-8eac-f00d1d7ece90 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:07:55.301210 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b36667e-6ffb-4131-8eac-f00d1d7ece90 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:07:55.310692 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-3b36667e-6ffb-4131-8eac-f00d1d7ece90 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1241746237 could not be found. Jul 18 02:07:55.313859 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3b36667e-6ffb-4131-8eac-f00d1d7ece90 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Request method failure captured: Jul 18 02:07:55.313859 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Jul 18 02:07:55.313859 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:07:55.313859 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:07:55.313859 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:07:55.313859 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 58 Jul 18 02:07:55.313859 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:07:55.313859 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:07:55.313859 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:07:55.313859 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:07:55.313859 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MB0ZxGk9u4Uk_EwyzhZO-OJJqjtv3dHSHNJs6VOqzVpp3jV4rjfgDkwV6YwPlwtkSjiFmmE32wRoMGsc0hgCLWJe8dj2F3Y2H4Zs5GwZIurm_-eDLpp5YSzNdObxQlVqDh7XFLyy9iEElHlhfauWrhlGnW0m-nLS1BE4HV78Iqrvu0 Jul 18 02:07:55.313859 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:07:55.313859 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:07:55.313859 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:07:55.313859 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:07:55.313859 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:07:55.313859 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:07:55.313859 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: ce404d6e42ea47ba9edefc4b54608c80 Jul 18 02:07:55.313859 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-850183465 Jul 18 02:07:55.313859 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,admin,reader Jul 18 02:07:55.313859 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,admin,reader Jul 18 02:07:55.315212 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ce404d6e42ea47ba9edefc4b54608c80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ce404d6e42ea47ba9edefc4b54608c80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ce404d6e42ea47ba9edefc4b54608c80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ce404d6e42ea47ba9edefc4b54608c80"}]}] Jul 18 02:07:55.315212 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-850183465 Jul 18 02:07:55.315212 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: ce404d6e42ea47ba9edefc4b54608c80 Jul 18 02:07:55.315212 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-850183465 Jul 18 02:07:55.315212 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin Jul 18 02:07:55.315212 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:07:55.315212 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:07:55.315212 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 7b848a7089f342e0a3211f32d59a087a Jul 18 02:07:55.315212 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin Jul 18 02:07:55.315212 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:07:55.315212 n-d-465891-3 devstack@n-api.service[119544]: {"add_host": {"host": "tempest-nonexist_host-1241746237"}} Jul 18 02:07:55.315212 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:07:55.315212 n-d-465891-3 devstack@n-api.service[119544]: exception: Compute host tempest-nonexist_host-1241746237 could not be found. Jul 18 02:07:55.315906 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-1241746237'}}} Jul 18 02:07:55.315906 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:07:55.315906 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:55.315906 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 18 02:07:55.315906 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 18 02:07:55.315906 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:07:55.315906 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:07:55.315906 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 18 02:07:55.315906 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 18 02:07:55.315906 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:07:55.315906 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:07:55.315906 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 18 02:07:55.315906 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 18 02:07:55.315906 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1241746237' is not mapped to any cell Jul 18 02:07:55.315906 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:55.315906 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:07:55.315906 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:55.315906 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:55.315906 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 18 02:07:55.316964 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 18 02:07:55.316964 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 18 02:07:55.316964 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 18 02:07:55.316964 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 18 02:07:55.316964 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:55.316964 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:07:55.316964 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:55.316964 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:55.316964 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 18 02:07:55.316964 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 18 02:07:55.316964 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 02:07:55.316964 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 02:07:55.316964 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:07:55.316964 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:07:55.316964 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:07:55.316964 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:07:55.316964 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 02:07:55.316964 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 02:07:55.316964 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6493, in add_host_to_aggregate Jul 18 02:07:55.316964 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Jul 18 02:07:55.318085 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 18 02:07:55.318085 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 18 02:07:55.318085 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1241746237 could not be found. Jul 18 02:07:55.318085 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:55.318085 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:07:55.318085 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:55.318085 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:55.318085 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:07:55.318085 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:07:55.318085 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:07:55.318085 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:07:55.318085 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:07:55.318085 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:07:55.318085 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:07:55.318085 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:07:55.318085 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Jul 18 02:07:55.318085 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:07:55.318085 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1241746237 could not be found. Jul 18 02:07:55.318085 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:55.318085 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:07:55.318085 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:55.319471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:55.319471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:07:55.319471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:07:55.319471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:07:55.319471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:07:55.319471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1241746237 could not be found. Jul 18 02:07:55.319471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:55.319471 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3b36667e-6ffb-4131-8eac-f00d1d7ece90 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1241746237 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:07:55.319471 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3b36667e-6ffb-4131-8eac-f00d1d7ece90 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 111 microversion: 2.1 time: 0.047404 Jul 18 02:07:55.324332 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 13/23] 10.222.0.57 () {60 vars in 1190 bytes} [Mon Jul 18 02:07:55 2022] POST /compute/v2.1/os-aggregates/4/action => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:07:55.330137 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f5447551-b3c9-4103-970d-048f234d21aa tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:07:55.330900 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:55.330900 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:07:55.371530 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f5447551-b3c9-4103-970d-048f234d21aa tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.045966 Jul 18 02:07:55.372179 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 14/24] 10.222.0.57 () {58 vars in 1151 bytes} [Mon Jul 18 02:07:55 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 02:07:55.404361 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5973e79e-63d8-4ea3-a4cd-64058b50934f tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:07:55.435267 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5973e79e-63d8-4ea3-a4cd-64058b50934f tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Request method failure captured: Jul 18 02:07:55.435267 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 18 02:07:55.435267 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:07:55.435267 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:07:55.435267 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:07:55.435267 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 283 Jul 18 02:07:55.435267 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:07:55.435267 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:07:55.435267 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:07:55.435267 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:07:55.435267 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MB0ZxGk9u4Uk_EwyzhZO-OJJqjtv3dHSHNJs6VOqzVpp3jV4rjfgDkwV6YwPlwtkSjiFmmE32wRoMGsc0hgCLWJe8dj2F3Y2H4Zs5GwZIurm_-eDLpp5YSzNdObxQlVqDh7XFLyy9iEElHlhfauWrhlGnW0m-nLS1BE4HV78Iqrvu0 Jul 18 02:07:55.435267 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:07:55.435267 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:07:55.435267 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:07:55.435267 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:07:55.435267 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:07:55.435267 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:07:55.435267 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: ce404d6e42ea47ba9edefc4b54608c80 Jul 18 02:07:55.435267 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-850183465 Jul 18 02:07:55.435267 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,admin,reader Jul 18 02:07:55.435267 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,admin,reader Jul 18 02:07:55.436720 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ce404d6e42ea47ba9edefc4b54608c80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ce404d6e42ea47ba9edefc4b54608c80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ce404d6e42ea47ba9edefc4b54608c80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ce404d6e42ea47ba9edefc4b54608c80"}]}] Jul 18 02:07:55.436720 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-850183465 Jul 18 02:07:55.436720 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: ce404d6e42ea47ba9edefc4b54608c80 Jul 18 02:07:55.436720 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-850183465 Jul 18 02:07:55.436720 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin Jul 18 02:07:55.436720 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:07:55.436720 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:07:55.436720 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 7b848a7089f342e0a3211f32d59a087a Jul 18 02:07:55.436720 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin Jul 18 02:07:55.436720 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:07:55.436720 n-d-465891-3 devstack@n-api.service[119544]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 18 02:07:55.437442 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:07:55.437442 n-d-465891-3 devstack@n-api.service[119544]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 02:07:55.437442 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 18 02:07:55.437442 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:07:55.437442 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:55.437442 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:07:55.437442 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:07:55.437442 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:07:55.437442 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:07:55.437442 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 02:07:55.437442 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:55.438171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Jul 18 02:07:55.438171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 18 02:07:55.438171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:55.438171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 18 02:07:55.438171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 18 02:07:55.438171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:55.438171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:07:55.438171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:55.438171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:55.438171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:07:55.438171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:07:55.438171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:07:55.438171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:07:55.438171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:07:55.438171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:07:55.438171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:07:55.438171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:07:55.438171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:07:55.438171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:07:55.439328 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:07:55.439328 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:07:55.439328 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:07:55.439328 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:07:55.439328 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 02:07:55.439328 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:55.439328 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:07:55.439328 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:55.439328 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:55.439328 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:07:55.439328 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:07:55.439328 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:07:55.439328 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:07:55.440123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 02:07:55.440123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:55.440123 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5973e79e-63d8-4ea3-a4cd-64058b50934f tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:07:55.440123 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5973e79e-63d8-4ea3-a4cd-64058b50934f tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.060744 Jul 18 02:07:55.446124 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 15/25] 10.222.0.57 () {60 vars in 1164 bytes} [Mon Jul 18 02:07:55 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:07:55.451761 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8afc1336-448a-4ce4-b9a3-3e5e7aead179 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:07:55.456736 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8afc1336-448a-4ce4-b9a3-3e5e7aead179 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Request method failure captured: Jul 18 02:07:55.456736 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 18 02:07:55.456736 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:07:55.456736 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:07:55.456736 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:07:55.456736 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 27 Jul 18 02:07:55.456736 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:07:55.456736 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:07:55.456736 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:07:55.456736 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:07:55.456736 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MB0ZxGk9u4Uk_EwyzhZO-OJJqjtv3dHSHNJs6VOqzVpp3jV4rjfgDkwV6YwPlwtkSjiFmmE32wRoMGsc0hgCLWJe8dj2F3Y2H4Zs5GwZIurm_-eDLpp5YSzNdObxQlVqDh7XFLyy9iEElHlhfauWrhlGnW0m-nLS1BE4HV78Iqrvu0 Jul 18 02:07:55.456736 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:07:55.456736 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:07:55.456736 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:07:55.456736 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:07:55.456736 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:07:55.456736 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:07:55.456736 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: ce404d6e42ea47ba9edefc4b54608c80 Jul 18 02:07:55.456736 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-850183465 Jul 18 02:07:55.456736 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,admin,reader Jul 18 02:07:55.456736 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,admin,reader Jul 18 02:07:55.458123 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ce404d6e42ea47ba9edefc4b54608c80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ce404d6e42ea47ba9edefc4b54608c80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ce404d6e42ea47ba9edefc4b54608c80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ce404d6e42ea47ba9edefc4b54608c80"}]}] Jul 18 02:07:55.458123 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-850183465 Jul 18 02:07:55.458123 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: ce404d6e42ea47ba9edefc4b54608c80 Jul 18 02:07:55.458123 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-850183465 Jul 18 02:07:55.458123 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin Jul 18 02:07:55.458123 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:07:55.458123 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:07:55.458123 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 7b848a7089f342e0a3211f32d59a087a Jul 18 02:07:55.458123 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin Jul 18 02:07:55.458123 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:07:55.458123 n-d-465891-3 devstack@n-api.service[119544]: {"aggregate": {"name": ""}} Jul 18 02:07:55.458123 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:07:55.458123 n-d-465891-3 devstack@n-api.service[119544]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 18 02:07:55.458791 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'body': {'aggregate': {'name': ''}}} Jul 18 02:07:55.458791 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:07:55.458791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:55.458791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:07:55.458791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:07:55.458791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:07:55.458791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:07:55.458791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 18 02:07:55.458791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:55.458791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Jul 18 02:07:55.458791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 18 02:07:55.458791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:55.458791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 18 02:07:55.458791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi '' Jul 18 02:07:55.458791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:55.458791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:07:55.458791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:55.458791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:55.458791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:07:55.458791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:07:55.458791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:07:55.458791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:07:55.458791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:07:55.459918 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:07:55.459918 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:07:55.459918 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:07:55.459918 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:07:55.459918 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:07:55.459918 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:07:55.459918 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:07:55.459918 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:07:55.459918 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:07:55.459918 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 18 02:07:55.459918 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:55.459918 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:07:55.459918 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:55.459918 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:55.459918 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:07:55.459918 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:07:55.459918 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:07:55.459918 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:07:55.459918 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 18 02:07:55.459918 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:55.461050 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8afc1336-448a-4ce4-b9a3-3e5e7aead179 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:07:55.461323 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8afc1336-448a-4ce4-b9a3-3e5e7aead179 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.013737 Jul 18 02:07:55.463471 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 16/26] 10.222.0.57 () {60 vars in 1163 bytes} [Mon Jul 18 02:07:55 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:07:55.491023 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c5b0406f-9092-46b2-b371-01b539a3dcf7 tempest-AggregatesAdminNegativeTestJSON-817538988 tempest-AggregatesAdminNegativeTestJSON-817538988-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-297839910"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:07:55.494179 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:55.494179 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:07:55.496425 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c5b0406f-9092-46b2-b371-01b539a3dcf7 tempest-AggregatesAdminNegativeTestJSON-817538988 tempest-AggregatesAdminNegativeTestJSON-817538988-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '2446e24dbad94d68bc53e68994425219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06623d9175f84a2f855ea1a2608500cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:07:55.498993 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c5b0406f-9092-46b2-b371-01b539a3dcf7 tempest-AggregatesAdminNegativeTestJSON-817538988 tempest-AggregatesAdminNegativeTestJSON-817538988-project] Request method failure captured: Jul 18 02:07:55.498993 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 18 02:07:55.498993 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:07:55.498993 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:07:55.498993 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:07:55.498993 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 59 Jul 18 02:07:55.498993 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:07:55.498993 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:07:55.498993 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:07:55.498993 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:07:55.498993 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MByRc4VXjOZoV01x3OdnWsXQswqB5DdqJzYLYdStk4XRPpgvD_Nco5d84c-ncA4XIELItWPebyNkPp7X2ZZWb9IUctL1w5F7C-Xuzl23qh88YB4Oiv0-vRXobPECoqF_AiuWWHHVVYw4BxcafTtQnwhjKuefqfWnrPDvh4Zl-EjdXA Jul 18 02:07:55.498993 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:07:55.498993 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:07:55.498993 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:07:55.498993 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:07:55.498993 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:07:55.498993 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:07:55.498993 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 06623d9175f84a2f855ea1a2608500cd Jul 18 02:07:55.498993 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-817538988 Jul 18 02:07:55.498993 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:07:55.498993 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:07:55.500649 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_06623d9175f84a2f855ea1a2608500cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/06623d9175f84a2f855ea1a2608500cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/06623d9175f84a2f855ea1a2608500cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/06623d9175f84a2f855ea1a2608500cd"}]}] Jul 18 02:07:55.500649 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-817538988 Jul 18 02:07:55.500649 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 06623d9175f84a2f855ea1a2608500cd Jul 18 02:07:55.500649 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-817538988 Jul 18 02:07:55.500649 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-AggregatesAdminNegativeTestJSON-817538988-project Jul 18 02:07:55.500649 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:07:55.500649 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:07:55.500649 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 2446e24dbad94d68bc53e68994425219 Jul 18 02:07:55.500649 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-817538988-project Jul 18 02:07:55.500649 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:07:55.500649 n-d-465891-3 devstack@n-api.service[119544]: {"aggregate": {"name": "tempest-test_aggregate-297839910"}} Jul 18 02:07:55.500649 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:07:55.500649 n-d-465891-3 devstack@n-api.service[119544]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 18 02:07:55.501481 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-297839910'}}} Jul 18 02:07:55.501481 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:07:55.501481 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:55.501481 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:07:55.501481 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:07:55.501481 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:07:55.501481 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:07:55.501481 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:07:55.501481 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:07:55.501481 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:07:55.501481 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:07:55.501481 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:07:55.501481 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:07:55.501481 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Jul 18 02:07:55.501481 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Jul 18 02:07:55.501481 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:07:55.501481 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:07:55.501481 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:07:55.501481 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:07:55.502660 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:07:55.502660 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:07:55.502660 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:07:55.502660 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:07:55.502660 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:07:55.502660 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:07:55.502660 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:07:55.502660 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:07:55.502660 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:07:55.502660 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:07:55.502660 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 18 02:07:55.502660 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:55.502660 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:07:55.502660 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:55.502660 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:55.502660 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:07:55.502660 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:07:55.502660 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:07:55.502660 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:07:55.502660 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 18 02:07:55.503857 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:55.507724 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c5b0406f-9092-46b2-b371-01b539a3dcf7 tempest-AggregatesAdminNegativeTestJSON-817538988 tempest-AggregatesAdminNegativeTestJSON-817538988-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:07:55.509624 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c5b0406f-9092-46b2-b371-01b539a3dcf7 tempest-AggregatesAdminNegativeTestJSON-817538988 tempest-AggregatesAdminNegativeTestJSON-817538988-project] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.038672 Jul 18 02:07:55.510806 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 17/27] 10.222.0.57 () {60 vars in 1163 bytes} [Mon Jul 18 02:07:55 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:07:55.549072 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fd64532b-07c6-4014-ac08-f4cf687e5689 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1224630668"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:07:55.560289 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.aggregate [None req-fd64532b-07c6-4014-ac08-f4cf687e5689 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Generated uuid 4414fdad-5e12-4cfa-ae5b-93e4d26d1660 for aggregate {{(pid=119544) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 02:07:55.588888 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fd64532b-07c6-4014-ac08-f4cf687e5689 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.057132 Jul 18 02:07:55.590026 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 18/28] 10.222.0.57 () {60 vars in 1163 bytes} [Mon Jul 18 02:07:55 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:07:55.602067 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-44261d4a-3afe-41e4-9859-d673b5d6d9e4 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1224630668"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:07:55.603432 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:55.603432 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:07:55.604351 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.aggregate [None req-44261d4a-3afe-41e4-9859-d673b5d6d9e4 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Generated uuid f6355aa9-2992-4ff5-b1c9-fb7ee307290a for aggregate {{(pid=119544) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 02:07:55.617728 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-44261d4a-3afe-41e4-9859-d673b5d6d9e4 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1224630668 already exists. Jul 18 02:07:55.620351 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-44261d4a-3afe-41e4-9859-d673b5d6d9e4 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Request method failure captured: Jul 18 02:07:55.620351 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 18 02:07:55.620351 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:07:55.620351 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:07:55.620351 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:07:55.620351 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 60 Jul 18 02:07:55.620351 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:07:55.620351 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:07:55.620351 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:07:55.620351 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:07:55.620351 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MB0ZxGk9u4Uk_EwyzhZO-OJJqjtv3dHSHNJs6VOqzVpp3jV4rjfgDkwV6YwPlwtkSjiFmmE32wRoMGsc0hgCLWJe8dj2F3Y2H4Zs5GwZIurm_-eDLpp5YSzNdObxQlVqDh7XFLyy9iEElHlhfauWrhlGnW0m-nLS1BE4HV78Iqrvu0 Jul 18 02:07:55.620351 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:07:55.620351 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:07:55.620351 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:07:55.620351 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:07:55.620351 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:07:55.620351 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:07:55.620351 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: ce404d6e42ea47ba9edefc4b54608c80 Jul 18 02:07:55.620351 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-850183465 Jul 18 02:07:55.620351 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,admin,reader Jul 18 02:07:55.620351 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,admin,reader Jul 18 02:07:55.621488 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ce404d6e42ea47ba9edefc4b54608c80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ce404d6e42ea47ba9edefc4b54608c80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ce404d6e42ea47ba9edefc4b54608c80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ce404d6e42ea47ba9edefc4b54608c80"}]}] Jul 18 02:07:55.621488 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-850183465 Jul 18 02:07:55.621488 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: ce404d6e42ea47ba9edefc4b54608c80 Jul 18 02:07:55.621488 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-850183465 Jul 18 02:07:55.621488 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin Jul 18 02:07:55.621488 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:07:55.621488 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:07:55.621488 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 7b848a7089f342e0a3211f32d59a087a Jul 18 02:07:55.621488 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin Jul 18 02:07:55.621488 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:07:55.621488 n-d-465891-3 devstack@n-api.service[119544]: {"aggregate": {"name": "tempest-test_aggregate-1224630668"}} Jul 18 02:07:55.621488 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:07:55.621488 n-d-465891-3 devstack@n-api.service[119544]: exception: Aggregate tempest-test_aggregate-1224630668 already exists. Jul 18 02:07:55.622378 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1224630668'}}} Jul 18 02:07:55.622378 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:07:55.622378 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:55.622378 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Jul 18 02:07:55.622378 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Jul 18 02:07:55.622378 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 02:07:55.622378 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 02:07:55.622378 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:07:55.622378 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:07:55.622378 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:07:55.622378 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:07:55.622378 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 02:07:55.622378 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 02:07:55.622378 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6330, in create_aggregate Jul 18 02:07:55.622378 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi aggregate.create() Jul 18 02:07:55.622378 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 18 02:07:55.622378 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 18 02:07:55.622378 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Jul 18 02:07:55.622378 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Jul 18 02:07:55.623349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:07:55.623349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:07:55.623349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Jul 18 02:07:55.623349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Jul 18 02:07:55.623349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1224630668 already exists. Jul 18 02:07:55.623349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:55.623349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:07:55.623349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:55.623349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:55.623349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:07:55.623349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:07:55.623349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:07:55.623349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:07:55.623349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:07:55.623349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:07:55.623349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:07:55.623349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:07:55.623349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:07:55.623349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:07:55.623349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Jul 18 02:07:55.624357 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 18 02:07:55.624357 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1224630668 already exists. Jul 18 02:07:55.624357 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:55.624357 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:07:55.624357 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:55.624357 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:55.624357 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:07:55.624357 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:07:55.624357 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:07:55.624357 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:07:55.624357 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1224630668 already exists. Jul 18 02:07:55.624357 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:55.624357 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-44261d4a-3afe-41e4-9859-d673b5d6d9e4 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1224630668 already exists. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:07:55.624357 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-44261d4a-3afe-41e4-9859-d673b5d6d9e4 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.025968 Jul 18 02:07:55.625063 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 19/29] 10.222.0.57 () {60 vars in 1163 bytes} [Mon Jul 18 02:07:55 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 27 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 18 02:07:55.630217 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-046df1d0-ec7f-4993-8d2b-6e696d524216 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:07:55.630993 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:55.630993 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:07:55.683803 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-046df1d0-ec7f-4993-8d2b-6e696d524216 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.057160 Jul 18 02:07:55.686025 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 20/30] 10.222.0.57 () {58 vars in 1151 bytes} [Mon Jul 18 02:07:55 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 18 02:07:55.702119 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f3504b7a-3a45-4064-aa71-fc15d18183d8 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-415557127"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:07:55.703510 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:55.703510 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:07:55.704406 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.aggregate [None req-f3504b7a-3a45-4064-aa71-fc15d18183d8 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Generated uuid cd330720-9db9-4255-8c75-4363aa4b26b6 for aggregate {{(pid=119544) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 02:07:55.745689 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f3504b7a-3a45-4064-aa71-fc15d18183d8 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.053861 Jul 18 02:07:55.747213 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 21/31] 10.222.0.57 () {60 vars in 1163 bytes} [Mon Jul 18 02:07:55 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:07:55.762010 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6ac58caf-9417-4f42-8358-5208181d69d3 tempest-AggregatesAdminNegativeTestJSON-817538988 tempest-AggregatesAdminNegativeTestJSON-817538988-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:07:55.764626 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:55.764626 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:07:55.766400 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6ac58caf-9417-4f42-8358-5208181d69d3 tempest-AggregatesAdminNegativeTestJSON-817538988 tempest-AggregatesAdminNegativeTestJSON-817538988-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '2446e24dbad94d68bc53e68994425219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06623d9175f84a2f855ea1a2608500cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:07:55.769010 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6ac58caf-9417-4f42-8358-5208181d69d3 tempest-AggregatesAdminNegativeTestJSON-817538988 tempest-AggregatesAdminNegativeTestJSON-817538988-project] Request method failure captured: Jul 18 02:07:55.769010 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Jul 18 02:07:55.769010 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:07:55.769010 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:07:55.769010 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:07:55.769010 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:07:55.769010 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:07:55.769010 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:07:55.769010 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:07:55.769010 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:07:55.769010 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MByRc4VXjOZoV01x3OdnWsXQswqB5DdqJzYLYdStk4XRPpgvD_Nco5d84c-ncA4XIELItWPebyNkPp7X2ZZWb9IUctL1w5F7C-Xuzl23qh88YB4Oiv0-vRXobPECoqF_AiuWWHHVVYw4BxcafTtQnwhjKuefqfWnrPDvh4Zl-EjdXA Jul 18 02:07:55.769010 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:07:55.769010 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:07:55.769010 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:07:55.769010 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:07:55.769010 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:07:55.769010 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:07:55.769010 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 06623d9175f84a2f855ea1a2608500cd Jul 18 02:07:55.769010 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-817538988 Jul 18 02:07:55.769010 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:07:55.769010 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:07:55.770616 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_06623d9175f84a2f855ea1a2608500cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/06623d9175f84a2f855ea1a2608500cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/06623d9175f84a2f855ea1a2608500cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/06623d9175f84a2f855ea1a2608500cd"}]}] Jul 18 02:07:55.770616 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-817538988 Jul 18 02:07:55.770616 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 06623d9175f84a2f855ea1a2608500cd Jul 18 02:07:55.770616 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-817538988 Jul 18 02:07:55.770616 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-AggregatesAdminNegativeTestJSON-817538988-project Jul 18 02:07:55.770616 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:07:55.770616 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:07:55.770616 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 2446e24dbad94d68bc53e68994425219 Jul 18 02:07:55.770616 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-817538988-project Jul 18 02:07:55.770616 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:07:55.770616 n-d-465891-3 devstack@n-api.service[119544]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 18 02:07:55.770616 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '6'} Jul 18 02:07:55.771415 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:07:55.771415 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:55.771415 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:07:55.771415 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:07:55.771415 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:07:55.771415 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:07:55.771415 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:07:55.771415 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:07:55.771415 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Jul 18 02:07:55.771415 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Jul 18 02:07:55.771415 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:07:55.771415 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:07:55.771415 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:07:55.771415 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:07:55.771415 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:07:55.771415 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:07:55.771415 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:07:55.771415 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:07:55.771415 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:07:55.773876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:07:55.773876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:07:55.773876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:07:55.773876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:07:55.773876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:07:55.773876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 18 02:07:55.773876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:55.773876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:07:55.773876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:55.773876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:55.773876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:07:55.773876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:07:55.773876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:07:55.773876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:07:55.773876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 18 02:07:55.773876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:55.778709 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6ac58caf-9417-4f42-8358-5208181d69d3 tempest-AggregatesAdminNegativeTestJSON-817538988 tempest-AggregatesAdminNegativeTestJSON-817538988-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:07:55.780213 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6ac58caf-9417-4f42-8358-5208181d69d3 tempest-AggregatesAdminNegativeTestJSON-817538988 tempest-AggregatesAdminNegativeTestJSON-817538988-project] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/6" status: 403 len: 116 microversion: 2.1 time: 0.025883 Jul 18 02:07:55.785728 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 22/32] 10.222.0.57 () {58 vars in 1151 bytes} [Mon Jul 18 02:07:55 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 116 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:07:55.795228 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4e5299f5-de65-4d61-b1da-a374bcd24d2c tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:07:55.845747 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4e5299f5-de65-4d61-b1da-a374bcd24d2c tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.057971 Jul 18 02:07:55.849446 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 23/33] 10.222.0.57 () {58 vars in 1151 bytes} [Mon Jul 18 02:07:55 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 02:07:55.862976 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e4a18e92-9222-490f-898e-6b8bf0a606f4 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:07:55.864651 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:55.864651 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:07:55.892162 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-e4a18e92-9222-490f-898e-6b8bf0a606f4 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 18 02:07:55.894989 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e4a18e92-9222-490f-898e-6b8bf0a606f4 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Request method failure captured: Jul 18 02:07:55.894989 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 18 02:07:55.894989 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:07:55.894989 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:07:55.894989 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:07:55.894989 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:07:55.894989 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:07:55.894989 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:07:55.894989 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:07:55.894989 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:07:55.894989 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MB0ZxGk9u4Uk_EwyzhZO-OJJqjtv3dHSHNJs6VOqzVpp3jV4rjfgDkwV6YwPlwtkSjiFmmE32wRoMGsc0hgCLWJe8dj2F3Y2H4Zs5GwZIurm_-eDLpp5YSzNdObxQlVqDh7XFLyy9iEElHlhfauWrhlGnW0m-nLS1BE4HV78Iqrvu0 Jul 18 02:07:55.894989 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:07:55.894989 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:07:55.894989 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:07:55.894989 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:07:55.894989 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:07:55.894989 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:07:55.894989 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: ce404d6e42ea47ba9edefc4b54608c80 Jul 18 02:07:55.894989 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-850183465 Jul 18 02:07:55.894989 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,admin,reader Jul 18 02:07:55.894989 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,admin,reader Jul 18 02:07:55.897019 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ce404d6e42ea47ba9edefc4b54608c80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ce404d6e42ea47ba9edefc4b54608c80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ce404d6e42ea47ba9edefc4b54608c80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ce404d6e42ea47ba9edefc4b54608c80"}]}] Jul 18 02:07:55.897019 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-850183465 Jul 18 02:07:55.897019 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: ce404d6e42ea47ba9edefc4b54608c80 Jul 18 02:07:55.897019 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-850183465 Jul 18 02:07:55.897019 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin Jul 18 02:07:55.897019 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:07:55.897019 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:07:55.897019 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 7b848a7089f342e0a3211f32d59a087a Jul 18 02:07:55.897019 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin Jul 18 02:07:55.897019 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:07:55.897019 n-d-465891-3 devstack@n-api.service[119544]: exception: Aggregate -1 could not be found. Jul 18 02:07:55.897019 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '-1'} Jul 18 02:07:55.898269 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:07:55.898269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:55.898269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 18 02:07:55.898269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 18 02:07:55.898269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 02:07:55.898269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 02:07:55.898269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:07:55.898269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:07:55.898269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:07:55.898269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:07:55.898269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 02:07:55.898269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 02:07:55.898269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 18 02:07:55.898269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 18 02:07:55.898269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:07:55.898269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:07:55.898269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 18 02:07:55.898269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 18 02:07:55.898269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:07:55.900009 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:07:55.900009 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 18 02:07:55.900009 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 18 02:07:55.900009 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 18 02:07:55.900009 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:55.900009 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:07:55.900009 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:55.900009 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:55.900009 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:07:55.900009 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:07:55.900009 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:07:55.900009 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:07:55.900009 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:07:55.900009 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:07:55.900009 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 18 02:07:55.900009 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:07:55.900009 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 18 02:07:55.900009 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:55.900009 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:07:55.900009 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:55.900009 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:55.902018 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:07:55.902018 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:07:55.902018 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:07:55.902018 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:07:55.902018 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 18 02:07:55.902018 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:55.902018 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e4a18e92-9222-490f-898e-6b8bf0a606f4 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:07:55.902018 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e4a18e92-9222-490f-898e-6b8bf0a606f4 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.039376 Jul 18 02:07:55.911971 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 24/34] 10.222.0.57 () {58 vars in 1154 bytes} [Mon Jul 18 02:07:55 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:07:55.927642 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d54889d5-3fbf-43ed-ab6e-a3250a3e6cc5 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1729628518"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:07:55.935017 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:55.935017 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:07:55.938663 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.aggregate [None req-d54889d5-3fbf-43ed-ab6e-a3250a3e6cc5 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Generated uuid ba235538-4289-4287-bae3-ef2bf98c664d for aggregate {{(pid=119544) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 02:07:55.988130 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d54889d5-3fbf-43ed-ab6e-a3250a3e6cc5 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.072490 Jul 18 02:07:55.990210 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 25/35] 10.222.0.57 () {60 vars in 1163 bytes} [Mon Jul 18 02:07:55 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:07:56.001991 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cff2d413-fd36-4cf0-8c99-26f52936ac69 tempest-AggregatesAdminNegativeTestJSON-817538988 tempest-AggregatesAdminNegativeTestJSON-817538988-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:07:56.002904 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:56.002904 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:07:56.004194 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-cff2d413-fd36-4cf0-8c99-26f52936ac69 tempest-AggregatesAdminNegativeTestJSON-817538988 tempest-AggregatesAdminNegativeTestJSON-817538988-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '2446e24dbad94d68bc53e68994425219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06623d9175f84a2f855ea1a2608500cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:07:56.006552 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cff2d413-fd36-4cf0-8c99-26f52936ac69 tempest-AggregatesAdminNegativeTestJSON-817538988 tempest-AggregatesAdminNegativeTestJSON-817538988-project] Request method failure captured: Jul 18 02:07:56.006552 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Jul 18 02:07:56.006552 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:07:56.006552 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:07:56.006552 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:07:56.006552 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:07:56.006552 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:07:56.006552 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:07:56.006552 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:07:56.006552 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:07:56.006552 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MByRc4VXjOZoV01x3OdnWsXQswqB5DdqJzYLYdStk4XRPpgvD_Nco5d84c-ncA4XIELItWPebyNkPp7X2ZZWb9IUctL1w5F7C-Xuzl23qh88YB4Oiv0-vRXobPECoqF_AiuWWHHVVYw4BxcafTtQnwhjKuefqfWnrPDvh4Zl-EjdXA Jul 18 02:07:56.006552 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:07:56.006552 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:07:56.006552 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:07:56.006552 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:07:56.006552 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:07:56.006552 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:07:56.006552 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 06623d9175f84a2f855ea1a2608500cd Jul 18 02:07:56.006552 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-817538988 Jul 18 02:07:56.006552 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:07:56.006552 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:07:56.008255 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_06623d9175f84a2f855ea1a2608500cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/06623d9175f84a2f855ea1a2608500cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/06623d9175f84a2f855ea1a2608500cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/06623d9175f84a2f855ea1a2608500cd"}]}] Jul 18 02:07:56.008255 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-817538988 Jul 18 02:07:56.008255 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 06623d9175f84a2f855ea1a2608500cd Jul 18 02:07:56.008255 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-817538988 Jul 18 02:07:56.008255 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-AggregatesAdminNegativeTestJSON-817538988-project Jul 18 02:07:56.008255 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:07:56.008255 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:07:56.008255 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 2446e24dbad94d68bc53e68994425219 Jul 18 02:07:56.008255 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-817538988-project Jul 18 02:07:56.008255 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:07:56.008255 n-d-465891-3 devstack@n-api.service[119544]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 18 02:07:56.008255 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '7'} Jul 18 02:07:56.009621 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:07:56.009621 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:56.009621 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:07:56.009621 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:07:56.009621 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:07:56.009621 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:07:56.009621 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:07:56.009621 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:07:56.009621 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Jul 18 02:07:56.009621 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Jul 18 02:07:56.009621 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:07:56.009621 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:07:56.009621 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:07:56.009621 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:07:56.009621 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:07:56.009621 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:07:56.009621 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:07:56.009621 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:07:56.009621 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:07:56.011659 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:07:56.011659 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:07:56.011659 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:07:56.011659 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:07:56.011659 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:07:56.011659 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 18 02:07:56.011659 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:56.011659 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:07:56.011659 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:56.011659 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:56.011659 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:07:56.011659 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:07:56.011659 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:07:56.011659 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:07:56.011659 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 18 02:07:56.011659 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:56.018163 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cff2d413-fd36-4cf0-8c99-26f52936ac69 tempest-AggregatesAdminNegativeTestJSON-817538988 tempest-AggregatesAdminNegativeTestJSON-817538988-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:07:56.019862 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cff2d413-fd36-4cf0-8c99-26f52936ac69 tempest-AggregatesAdminNegativeTestJSON-817538988 tempest-AggregatesAdminNegativeTestJSON-817538988-project] 10.222.0.57 "GET /compute/v2.1/os-aggregates/7" status: 403 len: 114 microversion: 2.1 time: 0.023071 Jul 18 02:07:56.020897 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 26/36] 10.222.0.57 () {58 vars in 1148 bytes} [Mon Jul 18 02:07:55 2022] GET /compute/v2.1/os-aggregates/7 => generated 114 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:07:56.032190 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-284dd5da-0e21-464b-a4a5-7db8112d15d1 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:07:56.033398 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:56.033398 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:07:56.079651 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-284dd5da-0e21-464b-a4a5-7db8112d15d1 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.052970 Jul 18 02:07:56.080576 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 27/37] 10.222.0.57 () {58 vars in 1151 bytes} [Mon Jul 18 02:07:56 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 02:07:56.091097 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f1072514-9e20-4983-bde6-62c7b1b941cf tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:07:56.092409 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:56.092409 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:07:56.103779 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-f1072514-9e20-4983-bde6-62c7b1b941cf tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 18 02:07:56.108920 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f1072514-9e20-4983-bde6-62c7b1b941cf tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Request method failure captured: Jul 18 02:07:56.108920 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 18 02:07:56.108920 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:07:56.108920 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:07:56.108920 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:07:56.108920 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:07:56.108920 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:07:56.108920 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:07:56.108920 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:07:56.108920 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:07:56.108920 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MB0ZxGk9u4Uk_EwyzhZO-OJJqjtv3dHSHNJs6VOqzVpp3jV4rjfgDkwV6YwPlwtkSjiFmmE32wRoMGsc0hgCLWJe8dj2F3Y2H4Zs5GwZIurm_-eDLpp5YSzNdObxQlVqDh7XFLyy9iEElHlhfauWrhlGnW0m-nLS1BE4HV78Iqrvu0 Jul 18 02:07:56.108920 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:07:56.108920 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:07:56.108920 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:07:56.108920 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:07:56.108920 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:07:56.108920 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:07:56.108920 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: ce404d6e42ea47ba9edefc4b54608c80 Jul 18 02:07:56.108920 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-850183465 Jul 18 02:07:56.108920 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,admin,reader Jul 18 02:07:56.108920 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,admin,reader Jul 18 02:07:56.110778 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ce404d6e42ea47ba9edefc4b54608c80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ce404d6e42ea47ba9edefc4b54608c80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ce404d6e42ea47ba9edefc4b54608c80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ce404d6e42ea47ba9edefc4b54608c80"}]}] Jul 18 02:07:56.110778 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-850183465 Jul 18 02:07:56.110778 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: ce404d6e42ea47ba9edefc4b54608c80 Jul 18 02:07:56.110778 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-850183465 Jul 18 02:07:56.110778 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin Jul 18 02:07:56.110778 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:07:56.110778 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:07:56.110778 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 7b848a7089f342e0a3211f32d59a087a Jul 18 02:07:56.110778 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin Jul 18 02:07:56.110778 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:07:56.110778 n-d-465891-3 devstack@n-api.service[119544]: exception: Aggregate -1 could not be found. Jul 18 02:07:56.110778 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '-1'} Jul 18 02:07:56.111670 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:07:56.111670 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:56.111670 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 18 02:07:56.111670 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 18 02:07:56.111670 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 18 02:07:56.111670 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 18 02:07:56.111670 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:07:56.111670 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:07:56.111670 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 18 02:07:56.111670 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 18 02:07:56.111670 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:07:56.111670 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:07:56.111670 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 18 02:07:56.111670 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 18 02:07:56.111670 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 18 02:07:56.111670 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:56.111670 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:07:56.111670 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:56.111670 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:56.111670 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:07:56.113902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:07:56.113902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:07:56.113902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:07:56.113902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:07:56.113902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:07:56.113902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 18 02:07:56.113902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:07:56.113902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 18 02:07:56.113902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:56.113902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:07:56.113902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:56.113902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:56.113902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:07:56.113902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:07:56.113902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:07:56.113902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:07:56.113902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 18 02:07:56.113902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:56.126879 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f1072514-9e20-4983-bde6-62c7b1b941cf tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:07:56.128160 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f1072514-9e20-4983-bde6-62c7b1b941cf tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] 10.222.0.57 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.042220 Jul 18 02:07:56.129055 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 28/38] 10.222.0.57 () {58 vars in 1151 bytes} [Mon Jul 18 02:07:56 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:07:56.139864 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c10e11fd-824d-4d1b-b0af-4ee980e7b0ed tempest-AggregatesAdminNegativeTestJSON-817538988 tempest-AggregatesAdminNegativeTestJSON-817538988-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:07:56.140650 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:56.140650 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:07:56.141509 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c10e11fd-824d-4d1b-b0af-4ee980e7b0ed tempest-AggregatesAdminNegativeTestJSON-817538988 tempest-AggregatesAdminNegativeTestJSON-817538988-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '2446e24dbad94d68bc53e68994425219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06623d9175f84a2f855ea1a2608500cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:07:56.148626 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c10e11fd-824d-4d1b-b0af-4ee980e7b0ed tempest-AggregatesAdminNegativeTestJSON-817538988 tempest-AggregatesAdminNegativeTestJSON-817538988-project] Request method failure captured: Jul 18 02:07:56.148626 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Jul 18 02:07:56.148626 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:07:56.148626 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:07:56.148626 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:07:56.148626 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:07:56.148626 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:07:56.148626 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:07:56.148626 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:07:56.148626 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:07:56.148626 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MByRc4VXjOZoV01x3OdnWsXQswqB5DdqJzYLYdStk4XRPpgvD_Nco5d84c-ncA4XIELItWPebyNkPp7X2ZZWb9IUctL1w5F7C-Xuzl23qh88YB4Oiv0-vRXobPECoqF_AiuWWHHVVYw4BxcafTtQnwhjKuefqfWnrPDvh4Zl-EjdXA Jul 18 02:07:56.148626 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:07:56.148626 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:07:56.148626 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:07:56.148626 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:07:56.148626 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:07:56.148626 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:07:56.148626 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 06623d9175f84a2f855ea1a2608500cd Jul 18 02:07:56.148626 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-817538988 Jul 18 02:07:56.148626 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:07:56.148626 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:07:56.149967 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_06623d9175f84a2f855ea1a2608500cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/06623d9175f84a2f855ea1a2608500cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/06623d9175f84a2f855ea1a2608500cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/06623d9175f84a2f855ea1a2608500cd"}]}] Jul 18 02:07:56.149967 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-817538988 Jul 18 02:07:56.149967 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 06623d9175f84a2f855ea1a2608500cd Jul 18 02:07:56.149967 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-817538988 Jul 18 02:07:56.149967 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-AggregatesAdminNegativeTestJSON-817538988-project Jul 18 02:07:56.149967 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:07:56.149967 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:07:56.149967 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 2446e24dbad94d68bc53e68994425219 Jul 18 02:07:56.149967 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-817538988-project Jul 18 02:07:56.149967 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:07:56.149967 n-d-465891-3 devstack@n-api.service[119544]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 18 02:07:56.149967 n-d-465891-3 devstack@n-api.service[119544]: action_args: {} Jul 18 02:07:56.150610 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:07:56.150610 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:56.150610 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:07:56.150610 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:07:56.150610 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:07:56.150610 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:07:56.150610 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:07:56.150610 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:07:56.150610 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Jul 18 02:07:56.150610 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Jul 18 02:07:56.150610 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:07:56.150610 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:07:56.150610 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:07:56.150610 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:07:56.150610 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:07:56.150610 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:07:56.150610 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:07:56.150610 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:07:56.150610 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:07:56.152656 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:07:56.152656 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:07:56.152656 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:07:56.152656 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:07:56.152656 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:07:56.152656 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 18 02:07:56.152656 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:56.152656 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:07:56.152656 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:56.152656 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:07:56.152656 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:07:56.152656 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:07:56.152656 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:07:56.152656 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:07:56.152656 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 18 02:07:56.152656 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:07:56.152656 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c10e11fd-824d-4d1b-b0af-4ee980e7b0ed tempest-AggregatesAdminNegativeTestJSON-817538988 tempest-AggregatesAdminNegativeTestJSON-817538988-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:07:56.153512 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c10e11fd-824d-4d1b-b0af-4ee980e7b0ed tempest-AggregatesAdminNegativeTestJSON-817538988 tempest-AggregatesAdminNegativeTestJSON-817538988-project] 10.222.0.57 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.016229 Jul 18 02:07:56.153617 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 29/39] 10.222.0.57 () {58 vars in 1142 bytes} [Mon Jul 18 02:07:56 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:07:56.436528 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-31d63d83-e5b1-4b8b-9cf0-5ccdb352d795 tempest-AggregatesAdminTestV241-1626710147 tempest-AggregatesAdminTestV241-1626710147-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 314 microversion: 2.41 time: 1.625242 Jul 18 02:07:56.437215 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 11/40] 10.222.0.57 () {62 vars in 1231 bytes} [Mon Jul 18 02:07:54 2022] POST /compute/v2.1/os-aggregates/3/action => generated 314 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:07:56.450325 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7f35e937-3eaa-430e-929f-1a6b4775a9ae tempest-AggregatesAdminTestV241-1626710147 tempest-AggregatesAdminTestV241-1626710147-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-465891-3"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:07:56.452072 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:56.452072 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:07:56.474462 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=8,nova_api:DELETE=11 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:07:56.480332 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7f35e937-3eaa-430e-929f-1a6b4775a9ae tempest-AggregatesAdminTestV241-1626710147 tempest-AggregatesAdminTestV241-1626710147-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:07:56.481513 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7f35e937-3eaa-430e-929f-1a6b4775a9ae tempest-AggregatesAdminTestV241-1626710147 tempest-AggregatesAdminTestV241-1626710147-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:07:56.620326 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7f35e937-3eaa-430e-929f-1a6b4775a9ae tempest-AggregatesAdminTestV241-1626710147 tempest-AggregatesAdminTestV241-1626710147-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 299 microversion: 2.41 time: 0.176455 Jul 18 02:07:56.623790 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 30/41] 10.222.0.57 () {62 vars in 1231 bytes} [Mon Jul 18 02:07:56 2022] POST /compute/v2.1/os-aggregates/3/action => generated 299 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:07:56.636806 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-43ab953e-f128-4092-b1f6-ff7e7b576abf tempest-AggregatesAdminTestV241-1626710147 tempest-AggregatesAdminTestV241-1626710147-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:07:56.639280 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:56.639280 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:07:56.683363 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-43ab953e-f128-4092-b1f6-ff7e7b576abf tempest-AggregatesAdminTestV241-1626710147 tempest-AggregatesAdminTestV241-1626710147-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.41 time: 0.052071 Jul 18 02:07:56.685983 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 12/42] 10.222.0.57 () {60 vars in 1192 bytes} [Mon Jul 18 02:07:56 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:07:56.706387 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fd8954cc-f7d5-4fb6-91ca-7eb08e00ff76 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1984633297", "name": "tempest-test_aggregate-1013500439"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:07:56.738052 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:56.738052 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:07:56.739264 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.aggregate [None req-fd8954cc-f7d5-4fb6-91ca-7eb08e00ff76 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Generated uuid 32b79dd6-d6bf-4ad7-9c1a-0dd300c9a473 for aggregate {{(pid=119544) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 02:07:56.781258 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fd8954cc-f7d5-4fb6-91ca-7eb08e00ff76 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.082097 Jul 18 02:07:56.783051 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 31/43] 10.222.0.57 () {60 vars in 1164 bytes} [Mon Jul 18 02:07:56 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:07:56.800290 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c0bf54e6-a40e-48c1-8002-6da21b9d1186 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:07:56.802354 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:56.802354 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:07:56.823175 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c0bf54e6-a40e-48c1-8002-6da21b9d1186 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] 10.222.0.57 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.031971 Jul 18 02:07:56.824555 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 13/44] 10.222.0.57 () {58 vars in 1142 bytes} [Mon Jul 18 02:07:56 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:07:56.836269 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-79cfb1f6-6d95-43d6-866e-3ce1a2b8aee5 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-465891-3"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:07:56.838946 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:56.838946 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:07:56.854239 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-79cfb1f6-6d95-43d6-866e-3ce1a2b8aee5 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:07:56.855155 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-79cfb1f6-6d95-43d6-866e-3ce1a2b8aee5 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:07:57.052857 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-79cfb1f6-6d95-43d6-866e-3ce1a2b8aee5 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 315 microversion: 2.1 time: 0.221905 Jul 18 02:07:57.065792 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 32/45] 10.222.0.57 () {60 vars in 1190 bytes} [Mon Jul 18 02:07:56 2022] POST /compute/v2.1/os-aggregates/8/action => generated 315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:07:57.704405 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8335b02a-e472-4e78-b83a-0cf533ea6689 tempest-HypervisorAdminUnderV252Test-7147525 tempest-HypervisorAdminUnderV252Test-7147525-project-admin] Calling method '.version_select at 0x7ff4a9a57f70>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:07:57.705282 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:57.705282 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:07:57.713268 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8335b02a-e472-4e78-b83a-0cf533ea6689 tempest-HypervisorAdminUnderV252Test-7147525 tempest-HypervisorAdminUnderV252Test-7147525-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2a4b42c4-bf71-4fae-804a-3632602c55fa(cell1) {{(pid=119543) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 18 02:07:57.714348 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8335b02a-e472-4e78-b83a-0cf533ea6689 tempest-HypervisorAdminUnderV252Test-7147525 tempest-HypervisorAdminUnderV252Test-7147525-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:07:57.714940 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8335b02a-e472-4e78-b83a-0cf533ea6689 tempest-HypervisorAdminUnderV252Test-7147525 tempest-HypervisorAdminUnderV252Test-7147525-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:07:57.734944 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8335b02a-e472-4e78-b83a-0cf533ea6689 tempest-HypervisorAdminUnderV252Test-7147525 tempest-HypervisorAdminUnderV252Test-7147525-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:07:57.736170 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8335b02a-e472-4e78-b83a-0cf533ea6689 tempest-HypervisorAdminUnderV252Test-7147525 tempest-HypervisorAdminUnderV252Test-7147525-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:07:57.759825 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8335b02a-e472-4e78-b83a-0cf533ea6689 tempest-HypervisorAdminUnderV252Test-7147525 tempest-HypervisorAdminUnderV252Test-7147525-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:07:57.760938 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8335b02a-e472-4e78-b83a-0cf533ea6689 tempest-HypervisorAdminUnderV252Test-7147525 tempest-HypervisorAdminUnderV252Test-7147525-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:07:57.770063 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8335b02a-e472-4e78-b83a-0cf533ea6689 tempest-HypervisorAdminUnderV252Test-7147525 tempest-HypervisorAdminUnderV252Test-7147525-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.515160 Jul 18 02:07:57.777555 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 14/46] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:07:57 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:07:57.782754 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-03fb3cc5-d815-4f84-8a51-91471206d524 tempest-HypervisorAdminUnderV252Test-7147525 tempest-HypervisorAdminUnderV252Test-7147525-project-admin] Calling method '.version_select at 0x7ff4a9a57790>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:07:57.783741 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:57.783741 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:07:57.785059 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-03fb3cc5-d815-4f84-8a51-91471206d524 tempest-HypervisorAdminUnderV252Test-7147525 tempest-HypervisorAdminUnderV252Test-7147525-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:07:57.786324 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-03fb3cc5-d815-4f84-8a51-91471206d524 tempest-HypervisorAdminUnderV252Test-7147525 tempest-HypervisorAdminUnderV252Test-7147525-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:07:57.811336 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-03fb3cc5-d815-4f84-8a51-91471206d524 tempest-HypervisorAdminUnderV252Test-7147525 tempest-HypervisorAdminUnderV252Test-7147525-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:07:57.811804 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-03fb3cc5-d815-4f84-8a51-91471206d524 tempest-HypervisorAdminUnderV252Test-7147525 tempest-HypervisorAdminUnderV252Test-7147525-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:07:57.869772 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-03fb3cc5-d815-4f84-8a51-91471206d524 tempest-HypervisorAdminUnderV252Test-7147525 tempest-HypervisorAdminUnderV252Test-7147525-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:07:57.870345 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-03fb3cc5-d815-4f84-8a51-91471206d524 tempest-HypervisorAdminUnderV252Test-7147525 tempest-HypervisorAdminUnderV252Test-7147525-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:07:57.882136 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-03fb3cc5-d815-4f84-8a51-91471206d524 tempest-HypervisorAdminUnderV252Test-7147525 tempest-HypervisorAdminUnderV252Test-7147525-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/n-h2-465891-3/servers" status: 200 len: 104 microversion: 2.1 time: 0.102923 Jul 18 02:07:57.883626 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 15/47] 10.222.0.57 () {58 vars in 1211 bytes} [Mon Jul 18 02:07:57 2022] GET /compute/v2.1/os-hypervisors/n-h2-465891-3/servers => generated 104 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:07:57.894722 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8993d0a8-fe26-4d73-b34f-a95834803567 tempest-HypervisorAdminUnderV252Test-7147525 tempest-HypervisorAdminUnderV252Test-7147525-project-admin] Calling method '.version_select at 0x7ff4a9a57e50>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:07:57.895804 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:57.895804 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:07:57.897354 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8993d0a8-fe26-4d73-b34f-a95834803567 tempest-HypervisorAdminUnderV252Test-7147525 tempest-HypervisorAdminUnderV252Test-7147525-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:07:57.898859 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8993d0a8-fe26-4d73-b34f-a95834803567 tempest-HypervisorAdminUnderV252Test-7147525 tempest-HypervisorAdminUnderV252Test-7147525-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:07:57.919637 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8993d0a8-fe26-4d73-b34f-a95834803567 tempest-HypervisorAdminUnderV252Test-7147525 tempest-HypervisorAdminUnderV252Test-7147525-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:07:57.920103 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8993d0a8-fe26-4d73-b34f-a95834803567 tempest-HypervisorAdminUnderV252Test-7147525 tempest-HypervisorAdminUnderV252Test-7147525-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:07:57.934831 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8993d0a8-fe26-4d73-b34f-a95834803567 tempest-HypervisorAdminUnderV252Test-7147525 tempest-HypervisorAdminUnderV252Test-7147525-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:07:57.936383 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8993d0a8-fe26-4d73-b34f-a95834803567 tempest-HypervisorAdminUnderV252Test-7147525 tempest-HypervisorAdminUnderV252Test-7147525-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:07:57.947223 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8993d0a8-fe26-4d73-b34f-a95834803567 tempest-HypervisorAdminUnderV252Test-7147525 tempest-HypervisorAdminUnderV252Test-7147525-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.056760 Jul 18 02:07:57.948152 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 16/48] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:07:57 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:07:57.958657 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-23edff97-0167-4a7d-8f29-b6f179296f1d tempest-HypervisorAdminUnderV252Test-7147525 tempest-HypervisorAdminUnderV252Test-7147525-project-admin] Calling method '.version_select at 0x7ff4a99fcdc0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:07:57.959527 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:07:57.959527 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:07:57.961468 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-23edff97-0167-4a7d-8f29-b6f179296f1d tempest-HypervisorAdminUnderV252Test-7147525 tempest-HypervisorAdminUnderV252Test-7147525-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:07:57.963944 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-23edff97-0167-4a7d-8f29-b6f179296f1d tempest-HypervisorAdminUnderV252Test-7147525 tempest-HypervisorAdminUnderV252Test-7147525-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:07:57.985607 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-23edff97-0167-4a7d-8f29-b6f179296f1d tempest-HypervisorAdminUnderV252Test-7147525 tempest-HypervisorAdminUnderV252Test-7147525-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:07:57.985882 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-23edff97-0167-4a7d-8f29-b6f179296f1d tempest-HypervisorAdminUnderV252Test-7147525 tempest-HypervisorAdminUnderV252Test-7147525-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:07:57.999232 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-23edff97-0167-4a7d-8f29-b6f179296f1d tempest-HypervisorAdminUnderV252Test-7147525 tempest-HypervisorAdminUnderV252Test-7147525-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/n-h2-465891-3/search" status: 200 len: 104 microversion: 2.1 time: 0.045449 Jul 18 02:07:58.000544 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 17/49] 10.222.0.57 () {58 vars in 1208 bytes} [Mon Jul 18 02:07:57 2022] GET /compute/v2.1/os-hypervisors/n-h2-465891-3/search => generated 104 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:07:58.123098 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a310a90b-d573-4754-ab12-fff4aaba6fcd tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-477615522", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "availability_zone": "tempest-test_az-1984633297"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:07:58.153630 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a310a90b-d573-4754-ab12-fff4aaba6fcd tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:07:58.154457 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a310a90b-d573-4754-ab12-fff4aaba6fcd tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:07:58.155436 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a310a90b-d573-4754-ab12-fff4aaba6fcd tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:07:58.156024 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a310a90b-d573-4754-ab12-fff4aaba6fcd tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:07:59.591675 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-a310a90b-d573-4754-ab12-fff4aaba6fcd tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] validate_networks() for None {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:08:00.407390 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-a310a90b-d573-4754-ab12-fff4aaba6fcd tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:08:00.407922 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-a310a90b-d573-4754-ab12-fff4aaba6fcd tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:08:00.408414 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-a310a90b-d573-4754-ab12-fff4aaba6fcd tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:08:00.409017 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-a310a90b-d573-4754-ab12-fff4aaba6fcd tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:08:00.409403 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-a310a90b-d573-4754-ab12-fff4aaba6fcd tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:08:00.449632 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a310a90b-d573-4754-ab12-fff4aaba6fcd tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:00.451949 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a310a90b-d573-4754-ab12-fff4aaba6fcd tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:00.453650 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a310a90b-d573-4754-ab12-fff4aaba6fcd tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:00.454831 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a310a90b-d573-4754-ab12-fff4aaba6fcd tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:00.568514 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-a310a90b-d573-4754-ab12-fff4aaba6fcd tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Getting quotas for project cd036e434ea348338dfb0fed060b66d7. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:08:00.582359 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-a310a90b-d573-4754-ab12-fff4aaba6fcd tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Getting quotas for user c93a266d6b1f4d718af3724d8b78f6a4 and project cd036e434ea348338dfb0fed060b66d7. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:08:00.619313 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a310a90b-d573-4754-ab12-fff4aaba6fcd tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:08:00.624319 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a310a90b-d573-4754-ab12-fff4aaba6fcd tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] [instance: e5dbcad3-c8b1-4113-862a-6010a666b490] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:08:00.733590 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a310a90b-d573-4754-ab12-fff4aaba6fcd tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.312580 Jul 18 02:08:00.751215 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 33/50] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:07:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 3331 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:08:00.762757 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0446ce65-ecb3-4d82-911a-543eee67f2bf tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:00.763648 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0446ce65-ecb3-4d82-911a-543eee67f2bf tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] [instance: e5dbcad3-c8b1-4113-862a-6010a666b490] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:01.922946 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=4 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:08:02.742209 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0446ce65-ecb3-4d82-911a-543eee67f2bf tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93a266d6b1f4d718af3724d8b78f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd036e434ea348338dfb0fed060b66d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:02.771390 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0446ce65-ecb3-4d82-911a-543eee67f2bf tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] 10.222.0.57 "GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490" status: 200 len: 1242 microversion: 2.1 time: 2.009256 Jul 18 02:08:02.783042 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 18/51] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:00 2022] GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490 => generated 1242 bytes in 2027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:03.324179 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-776f083b-6d43-4a84-9320-2f0887e76383 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1636249567", "id": 845687378, "os-flavor-access:is_public": "True"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:03.327844 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:03.327844 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:03.376487 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-776f083b-6d43-4a84-9320-2f0887e76383 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.793893 Jul 18 02:08:03.384746 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 34/52] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:08:02 2022] POST /compute/v2.1/flavors => generated 427 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:08:03.392453 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-151a3fe3-41e1-4184-a6e3-27f629a3da69 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:03.393529 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:03.393529 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:03.448621 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-151a3fe3-41e1-4184-a6e3-27f629a3da69 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/845687378" status: 202 len: 0 microversion: 2.1 time: 0.061918 Jul 18 02:08:03.449935 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 19/53] 10.222.0.57 () {58 vars in 1157 bytes} [Mon Jul 18 02:08:03 2022] DELETE /compute/v2.1/flavors/845687378 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:08:03.464721 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-de56dcd7-f4a6-475f-92c5-cf60a1d887b8 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:03.521584 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-de56dcd7-f4a6-475f-92c5-cf60a1d887b8 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.066985 Jul 18 02:08:03.538586 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 35/54] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:08:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:03.544615 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ad85fe8d-d75b-46f1-940e-83411e1d32dd tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1597582202", "id": 1528900287, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:03.547128 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:03.547128 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:03.618656 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ad85fe8d-d75b-46f1-940e-83411e1d32dd tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.078839 Jul 18 02:08:03.619392 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 20/55] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:08:03 2022] POST /compute/v2.1/flavors => generated 417 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:08:03.630876 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b895ccba-dcf1-4c8d-bc85-93b885313c17 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:03.671682 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b895ccba-dcf1-4c8d-bc85-93b885313c17 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5398 microversion: 2.1 time: 0.045080 Jul 18 02:08:03.672675 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 21/56] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:08:03 2022] GET /compute/v2.1/flavors/detail => generated 5398 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:03.695280 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b376ec1c-87f2-4eaa-a27f-7fb37c8e1fa6 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:03.719449 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b376ec1c-87f2-4eaa-a27f-7fb37c8e1fa6 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/1528900287" status: 202 len: 0 microversion: 2.1 time: 0.036027 Jul 18 02:08:03.720204 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 22/57] 10.222.0.57 () {58 vars in 1160 bytes} [Mon Jul 18 02:08:03 2022] DELETE /compute/v2.1/flavors/1528900287 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:08:03.732983 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e7ffcfe5-4aed-41c8-a480-fa2488cabb6c tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:03.796024 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e7ffcfe5-4aed-41c8-a480-fa2488cabb6c tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.068608 Jul 18 02:08:03.799948 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 23/58] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:08:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:03.811197 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6bb3a5e8-bb42-4384-82da-c431ee8cdbb8 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:03.813073 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6bb3a5e8-bb42-4384-82da-c431ee8cdbb8 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] [instance: e5dbcad3-c8b1-4113-862a-6010a666b490] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:03.826797 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6bb3a5e8-bb42-4384-82da-c431ee8cdbb8 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:03.827607 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6bb3a5e8-bb42-4384-82da-c431ee8cdbb8 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:03.833327 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6bb3a5e8-bb42-4384-82da-c431ee8cdbb8 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:03.834215 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6bb3a5e8-bb42-4384-82da-c431ee8cdbb8 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:04.071065 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-84f9e5a2-46c8-4267-8d7c-42a6069d015c tempest-NetworksTest-353883163 tempest-NetworksTest-353883163-project-admin] Calling method '.version_select at 0x7ff4a96fb700>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:04.440058 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6bb3a5e8-bb42-4384-82da-c431ee8cdbb8 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93a266d6b1f4d718af3724d8b78f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd036e434ea348338dfb0fed060b66d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:04.466717 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6bb3a5e8-bb42-4384-82da-c431ee8cdbb8 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] 10.222.0.57 "GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490" status: 200 len: 1298 microversion: 2.1 time: 0.665412 Jul 18 02:08:04.477188 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 24/59] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:03 2022] GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490 => generated 1298 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:04.488134 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3cf88505-013a-4dd2-89f6-b63d118d3f36 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1927448630", "id": 1312945538, "os-flavor-access:is_public": "True"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:04.494085 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:04.494085 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:04.546856 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3cf88505-013a-4dd2-89f6-b63d118d3f36 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.077577 Jul 18 02:08:04.554437 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 25/60] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:08:04 2022] POST /compute/v2.1/flavors => generated 429 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:04.637926 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-84f9e5a2-46c8-4267-8d7c-42a6069d015c tempest-NetworksTest-353883163 tempest-NetworksTest-353883163-project-admin] 10.222.0.57 "GET /compute/v2.1/os-networks" status: 200 len: 3327 microversion: 2.1 time: 1.068600 Jul 18 02:08:04.639690 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 36/61] 10.222.0.57 () {58 vars in 1136 bytes} [Mon Jul 18 02:08:03 2022] GET /compute/v2.1/os-networks => generated 3327 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:08:04.648187 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-effa5caa-ff52-465f-a23c-5a3f5abcc6ef tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:04.650442 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:04.650442 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:04.736071 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-effa5caa-ff52-465f-a23c-5a3f5abcc6ef tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/1312945538" status: 202 len: 0 microversion: 2.1 time: 0.092933 Jul 18 02:08:04.762430 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 37/62] 10.222.0.57 () {58 vars in 1160 bytes} [Mon Jul 18 02:08:04 2022] DELETE /compute/v2.1/flavors/1312945538 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:08:04.809109 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-dd585f79-45bb-4c18-82fa-6079b4f1dd60 tempest-NetworksTest-353883163 tempest-NetworksTest-353883163-project-admin] Calling method '.version_select at 0x7ff4a96a9430>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:04.957553 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8fea4eb6-d1cf-4b89-8175-8138ec8fe893 tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] Calling method '.version_select at 0x7ff4a9922790>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:04.959015 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:04.959015 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:04.963438 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8fea4eb6-d1cf-4b89-8175-8138ec8fe893 tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:04.969691 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8fea4eb6-d1cf-4b89-8175-8138ec8fe893 tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:04.975522 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8fea4eb6-d1cf-4b89-8175-8138ec8fe893 tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:04.978133 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8fea4eb6-d1cf-4b89-8175-8138ec8fe893 tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:05.075310 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8fea4eb6-d1cf-4b89-8175-8138ec8fe893 tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.516098 Jul 18 02:08:05.077222 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-dd585f79-45bb-4c18-82fa-6079b4f1dd60 tempest-NetworksTest-353883163 tempest-NetworksTest-353883163-project-admin] 10.222.0.57 "GET /compute/v2.1/os-networks/9c68fd03-321e-4186-960a-dc0f5151c936" status: 200 len: 652 microversion: 2.1 time: 0.313598 Jul 18 02:08:05.079512 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 38/63] 10.222.0.57 () {58 vars in 1247 bytes} [Mon Jul 18 02:08:04 2022] GET /compute/v2.1/os-networks/9c68fd03-321e-4186-960a-dc0f5151c936 => generated 652 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:05.079512 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-276ae81c-c5e7-4d8d-bee7-aedaa93c1a17 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:05.085470 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 26/64] 10.222.0.57 () {58 vars in 1127 bytes} [Mon Jul 18 02:08:04 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:05.092998 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d8812c9d-b2aa-400a-a5eb-86faee4dc136 tempest-NetworksTest-353883163 tempest-NetworksTest-353883163-project-admin] Calling method '.version_select at 0x7ff4a9a574c0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:05.143990 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-276ae81c-c5e7-4d8d-bee7-aedaa93c1a17 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064113 Jul 18 02:08:05.147499 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 39/65] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:08:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:05.324865 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d8812c9d-b2aa-400a-a5eb-86faee4dc136 tempest-NetworksTest-353883163 tempest-NetworksTest-353883163-project-admin] 10.222.0.57 "GET /compute/v2.1/os-networks" status: 200 len: 3327 microversion: 2.1 time: 0.237372 Jul 18 02:08:05.325443 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 27/66] 10.222.0.57 () {58 vars in 1136 bytes} [Mon Jul 18 02:08:05 2022] GET /compute/v2.1/os-networks => generated 3327 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:05.337606 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0975a9b7-9ab4-479f-a60d-edeb014de035 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1669089765", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:05.339261 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:05.339261 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:05.368500 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0975a9b7-9ab4-479f-a60d-edeb014de035 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.035033 Jul 18 02:08:05.369424 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 28/67] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:08:05 2022] POST /compute/v2.1/flavors => generated 507 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:05.383549 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c3d76fa1-6cee-4793-bc55-f4c37a4f9a7f tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:05.385048 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:05.385048 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:05.399776 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=12,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:08:05.424535 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c3d76fa1-6cee-4793-bc55-f4c37a4f9a7f tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/72a05ea7-974f-46f5-add0-ee9dd26178a8" status: 202 len: 0 microversion: 2.1 time: 0.044779 Jul 18 02:08:05.425740 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 29/68] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:08:05 2022] DELETE /compute/v2.1/flavors/72a05ea7-974f-46f5-add0-ee9dd26178a8 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:08:05.436150 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4c795d8c-83cc-465e-bc36-a68d5753071f tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:05.461747 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4c795d8c-83cc-465e-bc36-a68d5753071f tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029160 Jul 18 02:08:05.463527 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 30/69] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:08:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:05.483105 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-774202b6-b183-4b95-8b89-59eecd109cef tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1626740484", "id": "93f5ffaf-09c3-4238-9aba-c638491a7893", "os-flavor-access:is_public": "True"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:05.519004 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-774202b6-b183-4b95-8b89-59eecd109cef tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.041823 Jul 18 02:08:05.520092 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 31/70] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:08:05 2022] POST /compute/v2.1/flavors => generated 507 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:05.546959 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-37901a8a-a6cf-4357-844d-8c2f42cd7e3a tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:05.547803 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-37901a8a-a6cf-4357-844d-8c2f42cd7e3a tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] [instance: e5dbcad3-c8b1-4113-862a-6010a666b490] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:05.562772 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-37901a8a-a6cf-4357-844d-8c2f42cd7e3a tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:05.567490 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-37901a8a-a6cf-4357-844d-8c2f42cd7e3a tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:05.570508 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-37901a8a-a6cf-4357-844d-8c2f42cd7e3a tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:05.572482 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-37901a8a-a6cf-4357-844d-8c2f42cd7e3a tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:05.897454 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8a8d9c2b-ff31-43d6-ae3c-fbf638208f74 tempest-HostsAdminNegativeTestJSON-893376805 tempest-HostsAdminNegativeTestJSON-893376805-project] Calling method '.version_select at 0x7ff4a96729d0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:05.898842 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:05.898842 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:05.900064 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8a8d9c2b-ff31-43d6-ae3c-fbf638208f74 tempest-HostsAdminNegativeTestJSON-893376805 tempest-HostsAdminNegativeTestJSON-893376805-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '34a81b5d7b5241ad878564b1e7a54dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5049a86fd20d494889bdf7fd8be5d22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:05.902759 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8a8d9c2b-ff31-43d6-ae3c-fbf638208f74 tempest-HostsAdminNegativeTestJSON-893376805 tempest-HostsAdminNegativeTestJSON-893376805-project] Request method failure captured: Jul 18 02:08:05.902759 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Jul 18 02:08:05.902759 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:08:05.902759 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:08:05.902759 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:08:05.902759 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:08:05.902759 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:08:05.902759 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:08:05.902759 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:08:05.902759 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:08:05.902759 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MCA9K6ukqvMBg1WFtHSc-dAV23D7fhrk2j3UU0WTa1hOsKEmJhtzQoRTlfUFaiZ4ZPdtSeX4zxTQ_lZcr2-xWIE7ktdeU5VLKycub9-HLJCJ5FLLYdCmGj_ZC0OyUBkG8P3Mk-7DYjE7bz6XuFkOE95ekbMj2TOhT-SNcoEf3iq-8o Jul 18 02:08:05.902759 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:08:05.902759 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:08:05.902759 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:08:05.902759 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:08:05.902759 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:08:05.902759 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:08:05.902759 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 5049a86fd20d494889bdf7fd8be5d22e Jul 18 02:08:05.902759 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-893376805 Jul 18 02:08:05.902759 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:08:05.902759 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:08:05.903923 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5049a86fd20d494889bdf7fd8be5d22e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5049a86fd20d494889bdf7fd8be5d22e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5049a86fd20d494889bdf7fd8be5d22e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5049a86fd20d494889bdf7fd8be5d22e"}]}] Jul 18 02:08:05.903923 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-HostsAdminNegativeTestJSON-893376805 Jul 18 02:08:05.903923 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 5049a86fd20d494889bdf7fd8be5d22e Jul 18 02:08:05.903923 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-893376805 Jul 18 02:08:05.903923 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-HostsAdminNegativeTestJSON-893376805-project Jul 18 02:08:05.903923 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:08:05.903923 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:08:05.903923 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 34a81b5d7b5241ad878564b1e7a54dcd Jul 18 02:08:05.903923 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-HostsAdminNegativeTestJSON-893376805-project Jul 18 02:08:05.903923 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:08:05.903923 n-d-465891-3 devstack@n-api.service[119544]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 18 02:08:05.903923 n-d-465891-3 devstack@n-api.service[119544]: action_args: {} Jul 18 02:08:05.903923 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:08:05.904737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:05.904737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:05.904737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:05.904737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:08:05.904737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:08:05.904737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:08:05.904737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:08:05.904737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:08:05.904737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:08:05.904737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:08:05.904737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:08:05.904737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Jul 18 02:08:05.904737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Jul 18 02:08:05.904737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:08:05.904737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:08:05.904737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:08:05.904737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:08:05.904737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:08:05.904737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:08:05.905718 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:08:05.905718 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:08:05.905718 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:08:05.905718 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:08:05.905718 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:08:05.905718 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:08:05.905718 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:08:05.905718 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:08:05.905718 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 18 02:08:05.905718 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:05.905718 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:05.905718 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:05.905718 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:05.905718 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:05.905718 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:05.905718 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:08:05.905718 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:08:05.905718 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 18 02:08:05.905718 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:05.907922 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8a8d9c2b-ff31-43d6-ae3c-fbf638208f74 tempest-HostsAdminNegativeTestJSON-893376805 tempest-HostsAdminNegativeTestJSON-893376805-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:08:05.910597 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8a8d9c2b-ff31-43d6-ae3c-fbf638208f74 tempest-HostsAdminNegativeTestJSON-893376805 tempest-HostsAdminNegativeTestJSON-893376805-project] 10.222.0.57 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.759478 Jul 18 02:08:05.912352 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 40/71] 10.222.0.57 () {58 vars in 1127 bytes} [Mon Jul 18 02:08:05 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 761 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:08:05.926420 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-003f8bcc-a8ec-4c89-8cbe-24dadbf6520a tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:05.950258 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-37901a8a-a6cf-4357-844d-8c2f42cd7e3a tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93a266d6b1f4d718af3724d8b78f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd036e434ea348338dfb0fed060b66d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:05.959892 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-37901a8a-a6cf-4357-844d-8c2f42cd7e3a tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] 10.222.0.57 "GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490" status: 200 len: 1296 microversion: 2.1 time: 0.438441 Jul 18 02:08:05.961172 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 32/72] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:05 2022] GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490 => generated 1296 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:05.975334 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a38d9dc2-3718-4142-be77-b06135cc6e8c tempest-HostsAdminNegativeTestJSON-893376805 tempest-HostsAdminNegativeTestJSON-893376805-project] Calling method '.version_select at 0x7ff4a9922ee0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:05.978298 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:05.978298 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:05.981150 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a38d9dc2-3718-4142-be77-b06135cc6e8c tempest-HostsAdminNegativeTestJSON-893376805 tempest-HostsAdminNegativeTestJSON-893376805-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '34a81b5d7b5241ad878564b1e7a54dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5049a86fd20d494889bdf7fd8be5d22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:05.983939 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a38d9dc2-3718-4142-be77-b06135cc6e8c tempest-HostsAdminNegativeTestJSON-893376805 tempest-HostsAdminNegativeTestJSON-893376805-project] Request method failure captured: Jul 18 02:08:05.983939 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/os-hosts/n-d-465891-3/reboot HTTP/1.1 Jul 18 02:08:05.983939 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:08:05.983939 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:08:05.983939 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:08:05.983939 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:08:05.983939 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:08:05.983939 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:08:05.983939 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:08:05.983939 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:08:05.983939 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MCA9K6ukqvMBg1WFtHSc-dAV23D7fhrk2j3UU0WTa1hOsKEmJhtzQoRTlfUFaiZ4ZPdtSeX4zxTQ_lZcr2-xWIE7ktdeU5VLKycub9-HLJCJ5FLLYdCmGj_ZC0OyUBkG8P3Mk-7DYjE7bz6XuFkOE95ekbMj2TOhT-SNcoEf3iq-8o Jul 18 02:08:05.983939 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:08:05.983939 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:08:05.983939 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:08:05.983939 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:08:05.983939 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:08:05.983939 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:08:05.983939 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 5049a86fd20d494889bdf7fd8be5d22e Jul 18 02:08:05.983939 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-893376805 Jul 18 02:08:05.983939 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:08:05.983939 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:08:05.985294 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5049a86fd20d494889bdf7fd8be5d22e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5049a86fd20d494889bdf7fd8be5d22e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5049a86fd20d494889bdf7fd8be5d22e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5049a86fd20d494889bdf7fd8be5d22e"}]}] Jul 18 02:08:05.985294 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-HostsAdminNegativeTestJSON-893376805 Jul 18 02:08:05.985294 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 5049a86fd20d494889bdf7fd8be5d22e Jul 18 02:08:05.985294 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-893376805 Jul 18 02:08:05.985294 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-HostsAdminNegativeTestJSON-893376805-project Jul 18 02:08:05.985294 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:08:05.985294 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:08:05.985294 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 34a81b5d7b5241ad878564b1e7a54dcd Jul 18 02:08:05.985294 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-HostsAdminNegativeTestJSON-893376805-project Jul 18 02:08:05.985294 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:08:05.985294 n-d-465891-3 devstack@n-api.service[119543]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 18 02:08:05.985294 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'n-d-465891-3'} Jul 18 02:08:05.985294 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:08:05.985961 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:05.985961 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:05.985961 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:05.985961 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:08:05.985961 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:08:05.985961 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:08:05.985961 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:08:05.985961 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:08:05.985961 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:08:05.985961 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Jul 18 02:08:05.985961 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Jul 18 02:08:05.985961 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:08:05.985961 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:08:05.985961 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:08:05.985961 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:08:05.985961 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:08:05.985961 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:08:05.985961 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:08:05.985961 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:08:05.986996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:08:05.986996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:08:05.986996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:08:05.986996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:08:05.986996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:08:05.986996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:08:05.986996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 18 02:08:05.986996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:05.986996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:05.986996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:05.986996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:05.986996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:05.986996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:05.986996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:08:05.986996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:08:05.986996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 18 02:08:05.986996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:05.989599 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a38d9dc2-3718-4142-be77-b06135cc6e8c tempest-HostsAdminNegativeTestJSON-893376805 tempest-HostsAdminNegativeTestJSON-893376805-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:08:05.990754 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a38d9dc2-3718-4142-be77-b06135cc6e8c tempest-HostsAdminNegativeTestJSON-893376805 tempest-HostsAdminNegativeTestJSON-893376805-project] 10.222.0.57 "GET /compute/v2.1/os-hosts/n-d-465891-3/reboot" status: 403 len: 111 microversion: 2.1 time: 0.028328 Jul 18 02:08:05.992639 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 33/73] 10.222.0.57 () {58 vars in 1187 bytes} [Mon Jul 18 02:08:05 2022] GET /compute/v2.1/os-hosts/n-d-465891-3/reboot => generated 111 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:08:05.996990 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-003f8bcc-a8ec-4c89-8cbe-24dadbf6520a tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/93f5ffaf-09c3-4238-9aba-c638491a7893" status: 202 len: 0 microversion: 2.1 time: 0.079505 Jul 18 02:08:05.998042 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 41/74] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:08:05 2022] DELETE /compute/v2.1/flavors/93f5ffaf-09c3-4238-9aba-c638491a7893 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:08:06.005195 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ccb764fd-8379-4286-87f8-d2edc4b55f40 tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] Calling method '.version_select at 0x7ff4a98ee4c0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:06.006114 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3dcb4724-1109-4879-a74d-8ccba55d25fc tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:06.023543 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-ccb764fd-8379-4286-87f8-d2edc4b55f40 tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:08:06.042344 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ccb764fd-8379-4286-87f8-d2edc4b55f40 tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] Request method failure captured: Jul 18 02:08:06.042344 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Jul 18 02:08:06.042344 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:08:06.042344 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:08:06.042344 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:08:06.042344 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:08:06.042344 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:08:06.042344 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:08:06.042344 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:08:06.042344 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:08:06.042344 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MCEJh3N5zVhWYM_CVSmf4CN7WR9wj86jhAy8q85IznZriP2DW5hmJRDgIzCTIgQy94DYsPKQk1ffNU5D0_rssCKFOxKFHin1MYmoGE0LV5JTmN_yjWL1l2jsuEgajhzg6RSAFXHVcF64by3b_tgaWe881pCnWyPYivLXUFXM4wuDLk Jul 18 02:08:06.042344 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:08:06.042344 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:08:06.042344 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:08:06.042344 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:08:06.042344 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:08:06.042344 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:08:06.042344 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 602525d4599c4fbdb20478088e43adbe Jul 18 02:08:06.042344 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1337439676 Jul 18 02:08:06.042344 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,admin,reader Jul 18 02:08:06.042344 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,admin,reader Jul 18 02:08:06.043760 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_602525d4599c4fbdb20478088e43adbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/602525d4599c4fbdb20478088e43adbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/602525d4599c4fbdb20478088e43adbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/602525d4599c4fbdb20478088e43adbe"}]}] Jul 18 02:08:06.043760 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1337439676 Jul 18 02:08:06.043760 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 602525d4599c4fbdb20478088e43adbe Jul 18 02:08:06.043760 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1337439676 Jul 18 02:08:06.043760 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-HostsAdminNegativeTestJSON-1337439676-project-admin Jul 18 02:08:06.043760 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:08:06.043760 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:08:06.043760 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 51178e93e01b4652a634e71c4efcbdf5 Jul 18 02:08:06.043760 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1337439676-project-admin Jul 18 02:08:06.043760 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:08:06.043760 n-d-465891-3 devstack@n-api.service[119543]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:08:06.043760 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'nonexistent_hostname'} Jul 18 02:08:06.043760 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:08:06.044752 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:06.044752 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 18 02:08:06.044752 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 18 02:08:06.044752 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 02:08:06.044752 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 02:08:06.044752 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:08:06.044752 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:08:06.044752 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:08:06.044752 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:08:06.044752 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 02:08:06.044752 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 02:08:06.044752 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 18 02:08:06.044752 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 18 02:08:06.044752 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:08:06.044752 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:08:06.044752 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 18 02:08:06.044752 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 18 02:08:06.044752 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:08:06.044752 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:08:06.045885 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 18 02:08:06.045885 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 18 02:08:06.045885 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:08:06.045885 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.045885 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:06.045885 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.045885 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:06.045885 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:06.045885 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:06.045885 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:08:06.045885 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:08:06.045885 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:08:06.045885 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:08:06.045885 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:08:06.045885 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:08:06.045885 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Jul 18 02:08:06.045885 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Jul 18 02:08:06.045885 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 18 02:08:06.045885 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:08:06.047045 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:08:06.047045 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.047045 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:06.047045 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.047045 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:06.047045 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:06.047045 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:06.047045 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:08:06.047045 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:08:06.047045 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:08:06.047045 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.047712 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3dcb4724-1109-4879-a74d-8ccba55d25fc tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040182 Jul 18 02:08:06.047712 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 42/75] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:08:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:06.048727 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ccb764fd-8379-4286-87f8-d2edc4b55f40 tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:08:06.052125 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ccb764fd-8379-4286-87f8-d2edc4b55f40 tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.051379 Jul 18 02:08:06.060853 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 34/76] 10.222.0.57 () {58 vars in 1211 bytes} [Mon Jul 18 02:08:05 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:08:06.066741 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6d35c476-0026-458a-bb92-feacc69045e6 tempest-HostsAdminNegativeTestJSON-893376805 tempest-HostsAdminNegativeTestJSON-893376805-project] Calling method '.version_select at 0x7ff4a9672d30>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:06.071414 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:06.071414 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:06.076478 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2363e936-7a77-4983-ba74-732029f3003b tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1003268645", "id": 1711250092, "os-flavor-access:is_public": "True"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:06.078027 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6d35c476-0026-458a-bb92-feacc69045e6 tempest-HostsAdminNegativeTestJSON-893376805 tempest-HostsAdminNegativeTestJSON-893376805-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '34a81b5d7b5241ad878564b1e7a54dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5049a86fd20d494889bdf7fd8be5d22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:06.080965 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:06.080965 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:06.086093 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6d35c476-0026-458a-bb92-feacc69045e6 tempest-HostsAdminNegativeTestJSON-893376805 tempest-HostsAdminNegativeTestJSON-893376805-project] Request method failure captured: Jul 18 02:08:06.086093 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/os-hosts/n-d-465891-3 HTTP/1.1 Jul 18 02:08:06.086093 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:08:06.086093 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:08:06.086093 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:08:06.086093 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:08:06.086093 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:08:06.086093 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:08:06.086093 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:08:06.086093 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:08:06.086093 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MCA9K6ukqvMBg1WFtHSc-dAV23D7fhrk2j3UU0WTa1hOsKEmJhtzQoRTlfUFaiZ4ZPdtSeX4zxTQ_lZcr2-xWIE7ktdeU5VLKycub9-HLJCJ5FLLYdCmGj_ZC0OyUBkG8P3Mk-7DYjE7bz6XuFkOE95ekbMj2TOhT-SNcoEf3iq-8o Jul 18 02:08:06.086093 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:08:06.086093 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:08:06.086093 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:08:06.086093 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:08:06.086093 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:08:06.086093 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:08:06.086093 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 5049a86fd20d494889bdf7fd8be5d22e Jul 18 02:08:06.086093 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-893376805 Jul 18 02:08:06.086093 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:08:06.086093 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:08:06.087199 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5049a86fd20d494889bdf7fd8be5d22e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5049a86fd20d494889bdf7fd8be5d22e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5049a86fd20d494889bdf7fd8be5d22e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5049a86fd20d494889bdf7fd8be5d22e"}]}] Jul 18 02:08:06.087199 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-HostsAdminNegativeTestJSON-893376805 Jul 18 02:08:06.087199 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 5049a86fd20d494889bdf7fd8be5d22e Jul 18 02:08:06.087199 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-893376805 Jul 18 02:08:06.087199 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-HostsAdminNegativeTestJSON-893376805-project Jul 18 02:08:06.087199 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:08:06.087199 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:08:06.087199 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 34a81b5d7b5241ad878564b1e7a54dcd Jul 18 02:08:06.087199 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-HostsAdminNegativeTestJSON-893376805-project Jul 18 02:08:06.087199 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:08:06.087199 n-d-465891-3 devstack@n-api.service[119544]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 18 02:08:06.087199 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'n-d-465891-3'} Jul 18 02:08:06.087199 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:08:06.087947 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:06.087947 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:06.087947 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:06.087947 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:08:06.087947 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:08:06.087947 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:08:06.087947 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:08:06.087947 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:08:06.087947 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:08:06.087947 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Jul 18 02:08:06.087947 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Jul 18 02:08:06.087947 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:08:06.087947 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:08:06.087947 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:08:06.087947 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:08:06.087947 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:08:06.087947 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:08:06.087947 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:08:06.087947 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:08:06.089147 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:08:06.089147 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:08:06.089147 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:08:06.089147 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:08:06.089147 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:08:06.089147 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:08:06.089147 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 18 02:08:06.089147 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.089147 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:06.089147 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.089147 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:06.089147 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:06.089147 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:06.089147 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:08:06.089147 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:08:06.089147 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 18 02:08:06.089147 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.096031 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6d35c476-0026-458a-bb92-feacc69045e6 tempest-HostsAdminNegativeTestJSON-893376805 tempest-HostsAdminNegativeTestJSON-893376805-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:08:06.102152 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6d35c476-0026-458a-bb92-feacc69045e6 tempest-HostsAdminNegativeTestJSON-893376805 tempest-HostsAdminNegativeTestJSON-893376805-project] 10.222.0.57 "GET /compute/v2.1/os-hosts/n-d-465891-3" status: 403 len: 109 microversion: 2.1 time: 0.035221 Jul 18 02:08:06.105217 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 43/77] 10.222.0.57 () {58 vars in 1166 bytes} [Mon Jul 18 02:08:06 2022] GET /compute/v2.1/os-hosts/n-d-465891-3 => generated 109 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:08:06.114540 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2363e936-7a77-4983-ba74-732029f3003b tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.050940 Jul 18 02:08:06.115471 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 35/78] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:08:06 2022] POST /compute/v2.1/flavors => generated 414 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:06.124596 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-744e83da-8565-4e4b-a78a-e8753a54e91c tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] Calling method '.version_select at 0x7ff4a9676310>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:06.128879 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0626293c-a7e0-4fc8-8fae-06084f5f2adb tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:06.151943 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-744e83da-8565-4e4b-a78a-e8753a54e91c tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:08:06.159352 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-744e83da-8565-4e4b-a78a-e8753a54e91c tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] Request method failure captured: Jul 18 02:08:06.159352 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 18 02:08:06.159352 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:08:06.159352 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:08:06.159352 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:08:06.159352 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:08:06.159352 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:08:06.159352 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:08:06.159352 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:08:06.159352 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:08:06.159352 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MCEJh3N5zVhWYM_CVSmf4CN7WR9wj86jhAy8q85IznZriP2DW5hmJRDgIzCTIgQy94DYsPKQk1ffNU5D0_rssCKFOxKFHin1MYmoGE0LV5JTmN_yjWL1l2jsuEgajhzg6RSAFXHVcF64by3b_tgaWe881pCnWyPYivLXUFXM4wuDLk Jul 18 02:08:06.159352 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:08:06.159352 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:08:06.159352 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:08:06.159352 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:08:06.159352 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:08:06.159352 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:08:06.159352 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 602525d4599c4fbdb20478088e43adbe Jul 18 02:08:06.159352 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1337439676 Jul 18 02:08:06.159352 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,admin,reader Jul 18 02:08:06.159352 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,admin,reader Jul 18 02:08:06.160585 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_602525d4599c4fbdb20478088e43adbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/602525d4599c4fbdb20478088e43adbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/602525d4599c4fbdb20478088e43adbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/602525d4599c4fbdb20478088e43adbe"}]}] Jul 18 02:08:06.160585 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1337439676 Jul 18 02:08:06.160585 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 602525d4599c4fbdb20478088e43adbe Jul 18 02:08:06.160585 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1337439676 Jul 18 02:08:06.160585 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-HostsAdminNegativeTestJSON-1337439676-project-admin Jul 18 02:08:06.160585 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:08:06.160585 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:08:06.160585 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 51178e93e01b4652a634e71c4efcbdf5 Jul 18 02:08:06.160585 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1337439676-project-admin Jul 18 02:08:06.160585 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:08:06.160585 n-d-465891-3 devstack@n-api.service[119544]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:08:06.160585 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'nonexistent_hostname'} Jul 18 02:08:06.160585 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:08:06.161296 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:06.161296 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Jul 18 02:08:06.161296 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 18 02:08:06.161296 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:08:06.161296 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:08:06.161296 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 18 02:08:06.161296 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 18 02:08:06.161296 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:08:06.161296 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:08:06.161296 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 18 02:08:06.161296 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 18 02:08:06.161296 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:08:06.161296 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.161296 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:06.161296 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.161296 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:06.161296 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:06.161296 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:06.161296 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:08:06.162320 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:08:06.162320 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:08:06.162320 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:08:06.162320 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:08:06.162320 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:08:06.162320 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Jul 18 02:08:06.162320 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:08:06.162320 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:08:06.162320 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.162320 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:06.162320 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.162320 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:06.162320 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:06.162320 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:06.162320 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:08:06.162320 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:08:06.162320 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:08:06.162320 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.167679 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-744e83da-8565-4e4b-a78a-e8753a54e91c tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:08:06.171603 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0626293c-a7e0-4fc8-8fae-06084f5f2adb tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/1711250092" status: 200 len: 414 microversion: 2.1 time: 0.047209 Jul 18 02:08:06.173291 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 36/79] 10.222.0.57 () {58 vars in 1157 bytes} [Mon Jul 18 02:08:06 2022] GET /compute/v2.1/flavors/1711250092 => generated 414 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:06.173649 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-744e83da-8565-4e4b-a78a-e8753a54e91c tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.059669 Jul 18 02:08:06.177077 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 44/80] 10.222.0.57 () {58 vars in 1190 bytes} [Mon Jul 18 02:08:06 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:08:06.217588 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-42a090b7-8992-4001-9401-25a18b798c8b tempest-HostsAdminNegativeTestJSON-893376805 tempest-HostsAdminNegativeTestJSON-893376805-project] Calling method '.version_select at 0x7ff4abd49820>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:06.223743 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:06.223743 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:06.228048 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-42a090b7-8992-4001-9401-25a18b798c8b tempest-HostsAdminNegativeTestJSON-893376805 tempest-HostsAdminNegativeTestJSON-893376805-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '34a81b5d7b5241ad878564b1e7a54dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5049a86fd20d494889bdf7fd8be5d22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:06.233080 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-42a090b7-8992-4001-9401-25a18b798c8b tempest-HostsAdminNegativeTestJSON-893376805 tempest-HostsAdminNegativeTestJSON-893376805-project] Request method failure captured: Jul 18 02:08:06.233080 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/os-hosts/n-d-465891-3/shutdown HTTP/1.1 Jul 18 02:08:06.233080 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:08:06.233080 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:08:06.233080 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:08:06.233080 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:08:06.233080 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:08:06.233080 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:08:06.233080 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:08:06.233080 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:08:06.233080 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MCA9K6ukqvMBg1WFtHSc-dAV23D7fhrk2j3UU0WTa1hOsKEmJhtzQoRTlfUFaiZ4ZPdtSeX4zxTQ_lZcr2-xWIE7ktdeU5VLKycub9-HLJCJ5FLLYdCmGj_ZC0OyUBkG8P3Mk-7DYjE7bz6XuFkOE95ekbMj2TOhT-SNcoEf3iq-8o Jul 18 02:08:06.233080 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:08:06.233080 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:08:06.233080 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:08:06.233080 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:08:06.233080 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:08:06.233080 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:08:06.233080 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 5049a86fd20d494889bdf7fd8be5d22e Jul 18 02:08:06.233080 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-893376805 Jul 18 02:08:06.233080 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:08:06.233080 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:08:06.234955 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5049a86fd20d494889bdf7fd8be5d22e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5049a86fd20d494889bdf7fd8be5d22e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5049a86fd20d494889bdf7fd8be5d22e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5049a86fd20d494889bdf7fd8be5d22e"}]}] Jul 18 02:08:06.234955 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-HostsAdminNegativeTestJSON-893376805 Jul 18 02:08:06.234955 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 5049a86fd20d494889bdf7fd8be5d22e Jul 18 02:08:06.234955 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-893376805 Jul 18 02:08:06.234955 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-HostsAdminNegativeTestJSON-893376805-project Jul 18 02:08:06.234955 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:08:06.234955 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:08:06.234955 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 34a81b5d7b5241ad878564b1e7a54dcd Jul 18 02:08:06.234955 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-HostsAdminNegativeTestJSON-893376805-project Jul 18 02:08:06.234955 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:08:06.234955 n-d-465891-3 devstack@n-api.service[119544]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 18 02:08:06.234955 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'n-d-465891-3'} Jul 18 02:08:06.234955 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:08:06.235796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:06.235796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:06.235796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:06.235796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:08:06.235796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:08:06.235796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:08:06.235796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:08:06.235796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:08:06.235796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:08:06.235796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Jul 18 02:08:06.235796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Jul 18 02:08:06.235796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:08:06.235796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:08:06.235796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:08:06.235796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:08:06.235796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:08:06.235796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:08:06.235796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:08:06.235796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:08:06.236767 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:08:06.236767 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:08:06.236767 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:08:06.236767 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:08:06.236767 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:08:06.236767 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:08:06.236767 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 18 02:08:06.236767 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.236767 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:06.236767 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.236767 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:06.236767 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:06.236767 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:06.236767 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:08:06.236767 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:08:06.236767 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 18 02:08:06.236767 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.243449 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-42a090b7-8992-4001-9401-25a18b798c8b tempest-HostsAdminNegativeTestJSON-893376805 tempest-HostsAdminNegativeTestJSON-893376805-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:08:06.245630 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-42a090b7-8992-4001-9401-25a18b798c8b tempest-HostsAdminNegativeTestJSON-893376805 tempest-HostsAdminNegativeTestJSON-893376805-project] 10.222.0.57 "GET /compute/v2.1/os-hosts/n-d-465891-3/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.062412 Jul 18 02:08:06.251726 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 45/81] 10.222.0.57 () {58 vars in 1193 bytes} [Mon Jul 18 02:08:06 2022] GET /compute/v2.1/os-hosts/n-d-465891-3/shutdown => generated 113 bytes in 69 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:08:06.261859 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e89f58cc-1744-48fd-8166-23de4e145a31 tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] Calling method '.version_select at 0x7ff4a9672a60>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:06.285499 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-e89f58cc-1744-48fd-8166-23de4e145a31 tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:08:06.289292 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e89f58cc-1744-48fd-8166-23de4e145a31 tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] Request method failure captured: Jul 18 02:08:06.289292 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Jul 18 02:08:06.289292 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:08:06.289292 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:08:06.289292 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:08:06.289292 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:08:06.289292 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:08:06.289292 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:08:06.289292 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:08:06.289292 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:08:06.289292 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MCEJh3N5zVhWYM_CVSmf4CN7WR9wj86jhAy8q85IznZriP2DW5hmJRDgIzCTIgQy94DYsPKQk1ffNU5D0_rssCKFOxKFHin1MYmoGE0LV5JTmN_yjWL1l2jsuEgajhzg6RSAFXHVcF64by3b_tgaWe881pCnWyPYivLXUFXM4wuDLk Jul 18 02:08:06.289292 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:08:06.289292 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:08:06.289292 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:08:06.289292 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:08:06.289292 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:08:06.289292 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:08:06.289292 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 602525d4599c4fbdb20478088e43adbe Jul 18 02:08:06.289292 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1337439676 Jul 18 02:08:06.289292 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,admin,reader Jul 18 02:08:06.289292 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,admin,reader Jul 18 02:08:06.290952 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_602525d4599c4fbdb20478088e43adbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/602525d4599c4fbdb20478088e43adbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/602525d4599c4fbdb20478088e43adbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/602525d4599c4fbdb20478088e43adbe"}]}] Jul 18 02:08:06.290952 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1337439676 Jul 18 02:08:06.290952 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 602525d4599c4fbdb20478088e43adbe Jul 18 02:08:06.290952 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1337439676 Jul 18 02:08:06.290952 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-HostsAdminNegativeTestJSON-1337439676-project-admin Jul 18 02:08:06.290952 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:08:06.290952 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:08:06.290952 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 51178e93e01b4652a634e71c4efcbdf5 Jul 18 02:08:06.290952 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1337439676-project-admin Jul 18 02:08:06.290952 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:08:06.290952 n-d-465891-3 devstack@n-api.service[119544]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:08:06.290952 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'nonexistent_hostname'} Jul 18 02:08:06.290952 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:08:06.291620 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:06.291620 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 18 02:08:06.291620 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 18 02:08:06.291620 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 02:08:06.291620 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 02:08:06.291620 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:08:06.291620 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:08:06.291620 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:08:06.291620 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:08:06.291620 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 02:08:06.291620 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 02:08:06.291620 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 18 02:08:06.291620 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 18 02:08:06.291620 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:08:06.291620 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:08:06.291620 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 18 02:08:06.291620 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 18 02:08:06.291620 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:08:06.291620 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:08:06.293593 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 18 02:08:06.293593 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 18 02:08:06.293593 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:08:06.293593 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.293593 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:06.293593 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.293593 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:06.293593 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:06.293593 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:06.293593 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:08:06.293593 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:08:06.293593 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:08:06.293593 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:08:06.293593 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:08:06.293593 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:08:06.293593 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Jul 18 02:08:06.293593 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Jul 18 02:08:06.293593 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 18 02:08:06.293593 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:08:06.294865 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:08:06.294865 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.294865 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:06.294865 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.294865 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:06.294865 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:06.294865 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:06.294865 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:08:06.294865 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:08:06.294865 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:08:06.294865 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.304510 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e89f58cc-1744-48fd-8166-23de4e145a31 tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:08:06.306419 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e89f58cc-1744-48fd-8166-23de4e145a31 tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.051027 Jul 18 02:08:06.310149 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 46/82] 10.222.0.57 () {58 vars in 1217 bytes} [Mon Jul 18 02:08:06 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:08:06.322794 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2814e6c5-0a0c-4381-9a30-ab1f06aff526 tempest-HostsAdminNegativeTestJSON-893376805 tempest-HostsAdminNegativeTestJSON-893376805-project] Calling method '.version_select at 0x7ff4a9676700>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:06.323592 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:06.323592 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:06.330028 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2814e6c5-0a0c-4381-9a30-ab1f06aff526 tempest-HostsAdminNegativeTestJSON-893376805 tempest-HostsAdminNegativeTestJSON-893376805-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '34a81b5d7b5241ad878564b1e7a54dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5049a86fd20d494889bdf7fd8be5d22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:06.338746 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2814e6c5-0a0c-4381-9a30-ab1f06aff526 tempest-HostsAdminNegativeTestJSON-893376805 tempest-HostsAdminNegativeTestJSON-893376805-project] Request method failure captured: Jul 18 02:08:06.338746 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/os-hosts/n-d-465891-3/startup HTTP/1.1 Jul 18 02:08:06.338746 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:08:06.338746 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:08:06.338746 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:08:06.338746 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:08:06.338746 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:08:06.338746 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:08:06.338746 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:08:06.338746 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:08:06.338746 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MCA9K6ukqvMBg1WFtHSc-dAV23D7fhrk2j3UU0WTa1hOsKEmJhtzQoRTlfUFaiZ4ZPdtSeX4zxTQ_lZcr2-xWIE7ktdeU5VLKycub9-HLJCJ5FLLYdCmGj_ZC0OyUBkG8P3Mk-7DYjE7bz6XuFkOE95ekbMj2TOhT-SNcoEf3iq-8o Jul 18 02:08:06.338746 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:08:06.338746 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:08:06.338746 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:08:06.338746 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:08:06.338746 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:08:06.338746 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:08:06.338746 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 5049a86fd20d494889bdf7fd8be5d22e Jul 18 02:08:06.338746 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-893376805 Jul 18 02:08:06.338746 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:08:06.338746 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:08:06.340417 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5049a86fd20d494889bdf7fd8be5d22e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5049a86fd20d494889bdf7fd8be5d22e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5049a86fd20d494889bdf7fd8be5d22e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5049a86fd20d494889bdf7fd8be5d22e"}]}] Jul 18 02:08:06.340417 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-HostsAdminNegativeTestJSON-893376805 Jul 18 02:08:06.340417 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 5049a86fd20d494889bdf7fd8be5d22e Jul 18 02:08:06.340417 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-893376805 Jul 18 02:08:06.340417 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-HostsAdminNegativeTestJSON-893376805-project Jul 18 02:08:06.340417 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:08:06.340417 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:08:06.340417 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 34a81b5d7b5241ad878564b1e7a54dcd Jul 18 02:08:06.340417 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-HostsAdminNegativeTestJSON-893376805-project Jul 18 02:08:06.340417 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:08:06.340417 n-d-465891-3 devstack@n-api.service[119544]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 18 02:08:06.340417 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'n-d-465891-3'} Jul 18 02:08:06.340417 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:08:06.341255 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:06.341255 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:06.341255 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:06.341255 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:08:06.341255 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:08:06.341255 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:08:06.341255 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:08:06.341255 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:08:06.341255 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:08:06.341255 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Jul 18 02:08:06.341255 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Jul 18 02:08:06.341255 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:08:06.341255 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:08:06.341255 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:08:06.341255 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:08:06.341255 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:08:06.341255 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:08:06.341255 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:08:06.341255 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:08:06.342338 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:08:06.342338 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:08:06.342338 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:08:06.342338 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:08:06.342338 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:08:06.342338 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:08:06.342338 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 18 02:08:06.342338 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.342338 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:06.342338 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.342338 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:06.342338 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:06.342338 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:06.342338 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:08:06.342338 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:08:06.342338 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 18 02:08:06.342338 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.343380 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2814e6c5-0a0c-4381-9a30-ab1f06aff526 tempest-HostsAdminNegativeTestJSON-893376805 tempest-HostsAdminNegativeTestJSON-893376805-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:08:06.343380 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2814e6c5-0a0c-4381-9a30-ab1f06aff526 tempest-HostsAdminNegativeTestJSON-893376805 tempest-HostsAdminNegativeTestJSON-893376805-project] 10.222.0.57 "GET /compute/v2.1/os-hosts/n-d-465891-3/startup" status: 403 len: 110 microversion: 2.1 time: 0.024819 Jul 18 02:08:06.355181 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 47/83] 10.222.0.57 () {58 vars in 1190 bytes} [Mon Jul 18 02:08:06 2022] GET /compute/v2.1/os-hosts/n-d-465891-3/startup => generated 110 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:08:06.361219 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ea552ebe-1b86-4217-935d-e9decde3f8ad tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] Calling method '.version_select at 0x7ff4a9672b80>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:06.388552 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-ea552ebe-1b86-4217-935d-e9decde3f8ad tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:08:06.394664 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ea552ebe-1b86-4217-935d-e9decde3f8ad tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] Request method failure captured: Jul 18 02:08:06.394664 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Jul 18 02:08:06.394664 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:08:06.394664 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:08:06.394664 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:08:06.394664 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:08:06.394664 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:08:06.394664 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:08:06.394664 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:08:06.394664 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:08:06.394664 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MCEJh3N5zVhWYM_CVSmf4CN7WR9wj86jhAy8q85IznZriP2DW5hmJRDgIzCTIgQy94DYsPKQk1ffNU5D0_rssCKFOxKFHin1MYmoGE0LV5JTmN_yjWL1l2jsuEgajhzg6RSAFXHVcF64by3b_tgaWe881pCnWyPYivLXUFXM4wuDLk Jul 18 02:08:06.394664 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:08:06.394664 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:08:06.394664 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:08:06.394664 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:08:06.394664 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:08:06.394664 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:08:06.394664 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 602525d4599c4fbdb20478088e43adbe Jul 18 02:08:06.394664 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1337439676 Jul 18 02:08:06.394664 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,admin,reader Jul 18 02:08:06.394664 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,admin,reader Jul 18 02:08:06.396195 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_602525d4599c4fbdb20478088e43adbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/602525d4599c4fbdb20478088e43adbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/602525d4599c4fbdb20478088e43adbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/602525d4599c4fbdb20478088e43adbe"}]}] Jul 18 02:08:06.396195 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1337439676 Jul 18 02:08:06.396195 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 602525d4599c4fbdb20478088e43adbe Jul 18 02:08:06.396195 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1337439676 Jul 18 02:08:06.396195 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-HostsAdminNegativeTestJSON-1337439676-project-admin Jul 18 02:08:06.396195 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:08:06.396195 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:08:06.396195 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 51178e93e01b4652a634e71c4efcbdf5 Jul 18 02:08:06.396195 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1337439676-project-admin Jul 18 02:08:06.396195 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:08:06.396195 n-d-465891-3 devstack@n-api.service[119544]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:08:06.396195 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'nonexistent_hostname'} Jul 18 02:08:06.396195 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:08:06.398361 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:06.398361 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 18 02:08:06.398361 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 18 02:08:06.398361 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 02:08:06.398361 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 02:08:06.398361 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:08:06.398361 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:08:06.398361 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:08:06.398361 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:08:06.398361 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 02:08:06.398361 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 02:08:06.398361 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 18 02:08:06.398361 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 18 02:08:06.398361 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:08:06.398361 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:08:06.398361 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 18 02:08:06.398361 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 18 02:08:06.398361 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:08:06.398361 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:08:06.399534 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 18 02:08:06.399534 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 18 02:08:06.399534 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:08:06.399534 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.399534 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:06.399534 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.399534 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:06.399534 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:06.399534 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:06.399534 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:08:06.399534 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:08:06.399534 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:08:06.399534 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:08:06.399534 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:08:06.399534 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:08:06.399534 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Jul 18 02:08:06.399534 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Jul 18 02:08:06.399534 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 18 02:08:06.399534 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:08:06.400650 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:08:06.400650 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.400650 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:06.400650 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.400650 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:06.400650 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:06.400650 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:06.400650 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:08:06.400650 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:08:06.400650 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:08:06.400650 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.400650 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ea552ebe-1b86-4217-935d-e9decde3f8ad tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:08:06.400650 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ea552ebe-1b86-4217-935d-e9decde3f8ad tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.039972 Jul 18 02:08:06.402044 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 48/84] 10.222.0.57 () {58 vars in 1214 bytes} [Mon Jul 18 02:08:06 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:08:06.422259 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ff4ef4fb-7e7c-46b7-b666-613299d4585c tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] Action: 'update', calling method: .version_select at 0x7ff4a9676af0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:06.424696 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ff4ef4fb-7e7c-46b7-b666-613299d4585c tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] Request method failure captured: Jul 18 02:08:06.424696 n-d-465891-3 devstack@n-api.service[119544]: request: PUT /compute/v2.1/os-hosts/n-d-465891-3 HTTP/1.1 Jul 18 02:08:06.424696 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:08:06.424696 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:08:06.424696 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:08:06.424696 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 51 Jul 18 02:08:06.424696 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:08:06.424696 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:08:06.424696 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:08:06.424696 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:08:06.424696 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MCEJh3N5zVhWYM_CVSmf4CN7WR9wj86jhAy8q85IznZriP2DW5hmJRDgIzCTIgQy94DYsPKQk1ffNU5D0_rssCKFOxKFHin1MYmoGE0LV5JTmN_yjWL1l2jsuEgajhzg6RSAFXHVcF64by3b_tgaWe881pCnWyPYivLXUFXM4wuDLk Jul 18 02:08:06.424696 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:08:06.424696 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:08:06.424696 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:08:06.424696 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:08:06.424696 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:08:06.424696 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:08:06.424696 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 602525d4599c4fbdb20478088e43adbe Jul 18 02:08:06.424696 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1337439676 Jul 18 02:08:06.424696 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,admin,reader Jul 18 02:08:06.424696 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,admin,reader Jul 18 02:08:06.426197 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_602525d4599c4fbdb20478088e43adbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/602525d4599c4fbdb20478088e43adbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/602525d4599c4fbdb20478088e43adbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/602525d4599c4fbdb20478088e43adbe"}]}] Jul 18 02:08:06.426197 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1337439676 Jul 18 02:08:06.426197 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 602525d4599c4fbdb20478088e43adbe Jul 18 02:08:06.426197 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1337439676 Jul 18 02:08:06.426197 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-HostsAdminNegativeTestJSON-1337439676-project-admin Jul 18 02:08:06.426197 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:08:06.426197 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:08:06.426197 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 51178e93e01b4652a634e71c4efcbdf5 Jul 18 02:08:06.426197 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1337439676-project-admin Jul 18 02:08:06.426197 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:08:06.426197 n-d-465891-3 devstack@n-api.service[119544]: {"status": "enable", "maintenance_mode": "invalid"} Jul 18 02:08:06.426197 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:08:06.426197 n-d-465891-3 devstack@n-api.service[119544]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 18 02:08:06.427069 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'n-d-465891-3', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Jul 18 02:08:06.427069 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:08:06.427069 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:06.427069 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:08:06.427069 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:08:06.427069 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:08:06.427069 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:08:06.427069 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 18 02:08:06.427069 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.427069 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Jul 18 02:08:06.427069 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 18 02:08:06.427069 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'disable', Jul 18 02:08:06.427069 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'Enable', Jul 18 02:08:06.427069 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'Disable', Jul 18 02:08:06.427069 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 18 02:08:06.427069 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 18 02:08:06.427069 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 18 02:08:06.427069 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.427069 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi On instance: Jul 18 02:08:06.427069 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'invalid' Jul 18 02:08:06.427069 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.427069 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:06.427069 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.427069 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:06.427069 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:06.429409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:06.429409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:08:06.429409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:08:06.429409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:08:06.429409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:08:06.429409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:08:06.429409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:08:06.429409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:08:06.429409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:08:06.429409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:08:06.429409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:08:06.429409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:08:06.429409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:08:06.429409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 18 02:08:06.429409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.429409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:06.429409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.429409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:06.429409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:06.430433 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:06.430433 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:08:06.430433 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:08:06.430433 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 18 02:08:06.430433 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.430433 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ff4ef4fb-7e7c-46b7-b666-613299d4585c tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:08:06.430433 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ff4ef4fb-7e7c-46b7-b666-613299d4585c tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-hosts/n-d-465891-3" status: 400 len: 199 microversion: 2.1 time: 0.008153 Jul 18 02:08:06.432318 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 49/85] 10.222.0.57 () {60 vars in 1186 bytes} [Mon Jul 18 02:08:06 2022] PUT /compute/v2.1/os-hosts/n-d-465891-3 => generated 199 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:08:06.441231 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d0a9ef9b-a417-40ed-8540-d8e1d2dac367 tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] Action: 'update', calling method: .version_select at 0x7ff4a96fbee0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:06.444175 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d0a9ef9b-a417-40ed-8540-d8e1d2dac367 tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] Request method failure captured: Jul 18 02:08:06.444175 n-d-465891-3 devstack@n-api.service[119544]: request: PUT /compute/v2.1/os-hosts/n-d-465891-3 HTTP/1.1 Jul 18 02:08:06.444175 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:08:06.444175 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:08:06.444175 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:08:06.444175 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 51 Jul 18 02:08:06.444175 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:08:06.444175 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:08:06.444175 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:08:06.444175 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:08:06.444175 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MCEJh3N5zVhWYM_CVSmf4CN7WR9wj86jhAy8q85IznZriP2DW5hmJRDgIzCTIgQy94DYsPKQk1ffNU5D0_rssCKFOxKFHin1MYmoGE0LV5JTmN_yjWL1l2jsuEgajhzg6RSAFXHVcF64by3b_tgaWe881pCnWyPYivLXUFXM4wuDLk Jul 18 02:08:06.444175 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:08:06.444175 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:08:06.444175 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:08:06.444175 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:08:06.444175 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:08:06.444175 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:08:06.444175 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 602525d4599c4fbdb20478088e43adbe Jul 18 02:08:06.444175 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1337439676 Jul 18 02:08:06.444175 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,admin,reader Jul 18 02:08:06.444175 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,admin,reader Jul 18 02:08:06.445666 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_602525d4599c4fbdb20478088e43adbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/602525d4599c4fbdb20478088e43adbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/602525d4599c4fbdb20478088e43adbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/602525d4599c4fbdb20478088e43adbe"}]}] Jul 18 02:08:06.445666 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1337439676 Jul 18 02:08:06.445666 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 602525d4599c4fbdb20478088e43adbe Jul 18 02:08:06.445666 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1337439676 Jul 18 02:08:06.445666 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-HostsAdminNegativeTestJSON-1337439676-project-admin Jul 18 02:08:06.445666 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:08:06.445666 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:08:06.445666 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 51178e93e01b4652a634e71c4efcbdf5 Jul 18 02:08:06.445666 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1337439676-project-admin Jul 18 02:08:06.445666 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:08:06.445666 n-d-465891-3 devstack@n-api.service[119544]: {"status": "invalid", "maintenance_mode": "enable"} Jul 18 02:08:06.445666 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:08:06.445666 n-d-465891-3 devstack@n-api.service[119544]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 18 02:08:06.446555 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'n-d-465891-3', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Jul 18 02:08:06.446555 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:08:06.446555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:06.446555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:08:06.446555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:08:06.446555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:08:06.446555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:08:06.446555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 18 02:08:06.446555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.446555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Jul 18 02:08:06.446555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 18 02:08:06.446555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'disable', Jul 18 02:08:06.446555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'Enable', Jul 18 02:08:06.446555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'Disable', Jul 18 02:08:06.446555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 18 02:08:06.446555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 18 02:08:06.446555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 18 02:08:06.446555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.446555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi On instance: Jul 18 02:08:06.446555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'invalid' Jul 18 02:08:06.446555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.446555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:06.446555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.446555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:06.446555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:06.447942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:06.447942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:08:06.447942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:08:06.447942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:08:06.447942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:08:06.447942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:08:06.447942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:08:06.447942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:08:06.447942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:08:06.447942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:08:06.447942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:08:06.447942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:08:06.447942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:08:06.447942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 18 02:08:06.447942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.447942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:06.447942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.447942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:06.447942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:06.449035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:06.449035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:08:06.449035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:08:06.449035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 18 02:08:06.449035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.450941 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d0a9ef9b-a417-40ed-8540-d8e1d2dac367 tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:08:06.451801 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d0a9ef9b-a417-40ed-8540-d8e1d2dac367 tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-hosts/n-d-465891-3" status: 400 len: 189 microversion: 2.1 time: 0.018801 Jul 18 02:08:06.459196 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 50/86] 10.222.0.57 () {60 vars in 1186 bytes} [Mon Jul 18 02:08:06 2022] PUT /compute/v2.1/os-hosts/n-d-465891-3 => generated 189 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:08:06.479182 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f2a607a8-1b0b-4fb8-b6b1-853064bea5cc tempest-HostsAdminNegativeTestJSON-893376805 tempest-HostsAdminNegativeTestJSON-893376805-project] Action: 'update', calling method: .version_select at 0x7ff4a9672310>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:06.488715 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:06.488715 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:06.490016 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f2a607a8-1b0b-4fb8-b6b1-853064bea5cc tempest-HostsAdminNegativeTestJSON-893376805 tempest-HostsAdminNegativeTestJSON-893376805-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '34a81b5d7b5241ad878564b1e7a54dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5049a86fd20d494889bdf7fd8be5d22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:06.493454 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f2a607a8-1b0b-4fb8-b6b1-853064bea5cc tempest-HostsAdminNegativeTestJSON-893376805 tempest-HostsAdminNegativeTestJSON-893376805-project] Request method failure captured: Jul 18 02:08:06.493454 n-d-465891-3 devstack@n-api.service[119544]: request: PUT /compute/v2.1/os-hosts/n-d-465891-3 HTTP/1.1 Jul 18 02:08:06.493454 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:08:06.493454 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:08:06.493454 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:08:06.493454 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 50 Jul 18 02:08:06.493454 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:08:06.493454 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:08:06.493454 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:08:06.493454 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:08:06.493454 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MCA9K6ukqvMBg1WFtHSc-dAV23D7fhrk2j3UU0WTa1hOsKEmJhtzQoRTlfUFaiZ4ZPdtSeX4zxTQ_lZcr2-xWIE7ktdeU5VLKycub9-HLJCJ5FLLYdCmGj_ZC0OyUBkG8P3Mk-7DYjE7bz6XuFkOE95ekbMj2TOhT-SNcoEf3iq-8o Jul 18 02:08:06.493454 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:08:06.493454 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:08:06.493454 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:08:06.493454 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:08:06.493454 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:08:06.493454 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:08:06.493454 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 5049a86fd20d494889bdf7fd8be5d22e Jul 18 02:08:06.493454 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-893376805 Jul 18 02:08:06.493454 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:08:06.493454 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:08:06.495171 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5049a86fd20d494889bdf7fd8be5d22e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5049a86fd20d494889bdf7fd8be5d22e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5049a86fd20d494889bdf7fd8be5d22e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5049a86fd20d494889bdf7fd8be5d22e"}]}] Jul 18 02:08:06.495171 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-HostsAdminNegativeTestJSON-893376805 Jul 18 02:08:06.495171 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 5049a86fd20d494889bdf7fd8be5d22e Jul 18 02:08:06.495171 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-893376805 Jul 18 02:08:06.495171 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-HostsAdminNegativeTestJSON-893376805-project Jul 18 02:08:06.495171 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:08:06.495171 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:08:06.495171 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 34a81b5d7b5241ad878564b1e7a54dcd Jul 18 02:08:06.495171 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-HostsAdminNegativeTestJSON-893376805-project Jul 18 02:08:06.495171 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:08:06.495171 n-d-465891-3 devstack@n-api.service[119544]: {"status": "enable", "maintenance_mode": "enable"} Jul 18 02:08:06.495171 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:08:06.495171 n-d-465891-3 devstack@n-api.service[119544]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 18 02:08:06.495171 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'n-d-465891-3', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 18 02:08:06.496136 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:08:06.496136 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:06.496136 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:06.496136 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:06.496136 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:08:06.496136 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:08:06.496136 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:08:06.496136 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:08:06.496136 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:08:06.496136 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:08:06.496136 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:08:06.496136 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:08:06.496136 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Jul 18 02:08:06.496136 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Jul 18 02:08:06.496136 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:08:06.496136 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:08:06.496136 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:08:06.496136 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:08:06.496136 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:08:06.496136 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:08:06.497311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:08:06.497311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:08:06.497311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:08:06.497311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:08:06.497311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:08:06.497311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:08:06.497311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:08:06.497311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:08:06.497311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 18 02:08:06.497311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.497311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:06.497311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.497311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:06.497311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:06.497311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:06.497311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:08:06.497311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:08:06.497311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 18 02:08:06.497311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.501045 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f2a607a8-1b0b-4fb8-b6b1-853064bea5cc tempest-HostsAdminNegativeTestJSON-893376805 tempest-HostsAdminNegativeTestJSON-893376805-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:08:06.502011 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f2a607a8-1b0b-4fb8-b6b1-853064bea5cc tempest-HostsAdminNegativeTestJSON-893376805 tempest-HostsAdminNegativeTestJSON-893376805-project] 10.222.0.57 "PUT /compute/v2.1/os-hosts/n-d-465891-3" status: 403 len: 111 microversion: 2.1 time: 0.037230 Jul 18 02:08:06.504532 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 51/87] 10.222.0.57 () {60 vars in 1186 bytes} [Mon Jul 18 02:08:06 2022] PUT /compute/v2.1/os-hosts/n-d-465891-3 => generated 111 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:08:06.526335 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d7e5e652-5d9b-4aae-b27c-f91b5f865c8a tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] Action: 'update', calling method: .version_select at 0x7ff4a968d160>, body: {"status": null, "maintenance_mode": null} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:06.546470 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d7e5e652-5d9b-4aae-b27c-f91b5f865c8a tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] Request method failure captured: Jul 18 02:08:06.546470 n-d-465891-3 devstack@n-api.service[119544]: request: PUT /compute/v2.1/os-hosts/n-d-465891-3 HTTP/1.1 Jul 18 02:08:06.546470 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:08:06.546470 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:08:06.546470 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:08:06.546470 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 42 Jul 18 02:08:06.546470 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:08:06.546470 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:08:06.546470 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:08:06.546470 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:08:06.546470 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MCEJh3N5zVhWYM_CVSmf4CN7WR9wj86jhAy8q85IznZriP2DW5hmJRDgIzCTIgQy94DYsPKQk1ffNU5D0_rssCKFOxKFHin1MYmoGE0LV5JTmN_yjWL1l2jsuEgajhzg6RSAFXHVcF64by3b_tgaWe881pCnWyPYivLXUFXM4wuDLk Jul 18 02:08:06.546470 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:08:06.546470 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:08:06.546470 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:08:06.546470 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:08:06.546470 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:08:06.546470 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:08:06.546470 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 602525d4599c4fbdb20478088e43adbe Jul 18 02:08:06.546470 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1337439676 Jul 18 02:08:06.546470 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,admin,reader Jul 18 02:08:06.546470 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,admin,reader Jul 18 02:08:06.547985 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_602525d4599c4fbdb20478088e43adbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/602525d4599c4fbdb20478088e43adbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/602525d4599c4fbdb20478088e43adbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/602525d4599c4fbdb20478088e43adbe"}]}] Jul 18 02:08:06.547985 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1337439676 Jul 18 02:08:06.547985 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 602525d4599c4fbdb20478088e43adbe Jul 18 02:08:06.547985 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1337439676 Jul 18 02:08:06.547985 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-HostsAdminNegativeTestJSON-1337439676-project-admin Jul 18 02:08:06.547985 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:08:06.547985 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:08:06.547985 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 51178e93e01b4652a634e71c4efcbdf5 Jul 18 02:08:06.547985 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1337439676-project-admin Jul 18 02:08:06.547985 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:08:06.547985 n-d-465891-3 devstack@n-api.service[119544]: {"status": null, "maintenance_mode": null} Jul 18 02:08:06.547985 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:08:06.547985 n-d-465891-3 devstack@n-api.service[119544]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 18 02:08:06.547985 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'n-d-465891-3', 'body': {'status': None, 'maintenance_mode': None}} Jul 18 02:08:06.548970 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:08:06.548970 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:06.548970 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:08:06.548970 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:08:06.548970 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:08:06.548970 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:08:06.548970 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Jul 18 02:08:06.548970 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.548970 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Jul 18 02:08:06.548970 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 18 02:08:06.548970 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'disable', Jul 18 02:08:06.548970 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'Enable', Jul 18 02:08:06.548970 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'Disable', Jul 18 02:08:06.548970 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 18 02:08:06.548970 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 18 02:08:06.548970 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 18 02:08:06.548970 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.548970 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi On instance: Jul 18 02:08:06.548970 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi None Jul 18 02:08:06.548970 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.548970 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:06.548970 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.548970 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:06.548970 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:06.548970 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:06.550667 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:08:06.550667 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:08:06.550667 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:08:06.550667 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:08:06.550667 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:08:06.550667 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:08:06.550667 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:08:06.550667 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:08:06.550667 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:08:06.550667 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:08:06.550667 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:08:06.550667 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:08:06.550667 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 18 02:08:06.550667 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.550667 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:06.550667 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.550667 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:06.550667 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:06.550667 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:06.551894 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:08:06.551894 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:08:06.551894 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 18 02:08:06.551894 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.566078 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d7e5e652-5d9b-4aae-b27c-f91b5f865c8a tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:08:06.567831 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d7e5e652-5d9b-4aae-b27c-f91b5f865c8a tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-hosts/n-d-465891-3" status: 400 len: 127 microversion: 2.1 time: 0.057267 Jul 18 02:08:06.577422 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 52/88] 10.222.0.57 () {60 vars in 1186 bytes} [Mon Jul 18 02:08:06 2022] PUT /compute/v2.1/os-hosts/n-d-465891-3 => generated 127 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:08:06.588673 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9d69fd04-054a-4f56-894d-8e488a89d4ae tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] Action: 'update', calling method: .version_select at 0x7ff4a9672c10>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:06.592654 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.hosts [None req-9d69fd04-054a-4f56-894d-8e488a89d4ae tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] Enabling host nonexistent_hostname. Jul 18 02:08:06.618055 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-9d69fd04-054a-4f56-894d-8e488a89d4ae tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:08:06.620163 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9d69fd04-054a-4f56-894d-8e488a89d4ae tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] Request method failure captured: Jul 18 02:08:06.620163 n-d-465891-3 devstack@n-api.service[119544]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 18 02:08:06.620163 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:08:06.620163 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:08:06.620163 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:08:06.620163 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 50 Jul 18 02:08:06.620163 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:08:06.620163 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:08:06.620163 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:08:06.620163 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:08:06.620163 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MCEJh3N5zVhWYM_CVSmf4CN7WR9wj86jhAy8q85IznZriP2DW5hmJRDgIzCTIgQy94DYsPKQk1ffNU5D0_rssCKFOxKFHin1MYmoGE0LV5JTmN_yjWL1l2jsuEgajhzg6RSAFXHVcF64by3b_tgaWe881pCnWyPYivLXUFXM4wuDLk Jul 18 02:08:06.620163 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:08:06.620163 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:08:06.620163 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:08:06.620163 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:08:06.620163 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:08:06.620163 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:08:06.620163 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 602525d4599c4fbdb20478088e43adbe Jul 18 02:08:06.620163 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1337439676 Jul 18 02:08:06.620163 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,admin,reader Jul 18 02:08:06.620163 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,admin,reader Jul 18 02:08:06.621377 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_602525d4599c4fbdb20478088e43adbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/602525d4599c4fbdb20478088e43adbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/602525d4599c4fbdb20478088e43adbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/602525d4599c4fbdb20478088e43adbe"}]}] Jul 18 02:08:06.621377 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1337439676 Jul 18 02:08:06.621377 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 602525d4599c4fbdb20478088e43adbe Jul 18 02:08:06.621377 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1337439676 Jul 18 02:08:06.621377 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-HostsAdminNegativeTestJSON-1337439676-project-admin Jul 18 02:08:06.621377 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:08:06.621377 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:08:06.621377 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 51178e93e01b4652a634e71c4efcbdf5 Jul 18 02:08:06.621377 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1337439676-project-admin Jul 18 02:08:06.621377 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:08:06.621377 n-d-465891-3 devstack@n-api.service[119544]: {"status": "enable", "maintenance_mode": "enable"} Jul 18 02:08:06.621377 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:08:06.621377 n-d-465891-3 devstack@n-api.service[119544]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:08:06.621377 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 18 02:08:06.622617 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:08:06.622617 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:06.622617 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Jul 18 02:08:06.622617 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Jul 18 02:08:06.622617 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 02:08:06.622617 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 02:08:06.622617 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:08:06.622617 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:08:06.622617 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:08:06.622617 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:08:06.622617 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 02:08:06.622617 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 02:08:06.622617 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 18 02:08:06.622617 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 18 02:08:06.622617 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:08:06.622617 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:08:06.622617 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 18 02:08:06.622617 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 18 02:08:06.624785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:08:06.624785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:08:06.624785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 18 02:08:06.624785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 18 02:08:06.624785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:08:06.624785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.624785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:06.624785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.624785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:06.624785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:06.624785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:06.624785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:08:06.624785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:08:06.624785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:08:06.624785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:08:06.624785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:08:06.624785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:08:06.624785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:08:06.624785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:08:06.624785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Jul 18 02:08:06.625968 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Jul 18 02:08:06.625968 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Jul 18 02:08:06.625968 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:08:06.625968 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:08:06.625968 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.625968 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:06.625968 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.625968 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:06.625968 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:06.625968 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:06.625968 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:08:06.625968 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:08:06.625968 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:08:06.625968 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:06.630575 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9d69fd04-054a-4f56-894d-8e488a89d4ae tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:08:06.632866 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9d69fd04-054a-4f56-894d-8e488a89d4ae tempest-HostsAdminNegativeTestJSON-1337439676 tempest-HostsAdminNegativeTestJSON-1337439676-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.049324 Jul 18 02:08:06.634226 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 53/89] 10.222.0.57 () {60 vars in 1210 bytes} [Mon Jul 18 02:08:06 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 18 02:08:07.131091 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f6edb9d3-d331-4596-b878-d004a6eb08ba tempest-FlavorsAdminTestJSON-1220046535 tempest-FlavorsAdminTestJSON-1220046535-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:07.195959 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f6edb9d3-d331-4596-b878-d004a6eb08ba tempest-FlavorsAdminTestJSON-1220046535 tempest-FlavorsAdminTestJSON-1220046535-project] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 1.012265 Jul 18 02:08:07.198567 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 37/90] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:08:06 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:07.204239 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b7b4ecc3-2244-4a1e-be98-6f0431ca0a24 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:07.205172 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b7b4ecc3-2244-4a1e-be98-6f0431ca0a24 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] [instance: e5dbcad3-c8b1-4113-862a-6010a666b490] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:07.236598 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b7b4ecc3-2244-4a1e-be98-6f0431ca0a24 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:07.237513 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b7b4ecc3-2244-4a1e-be98-6f0431ca0a24 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:07.239234 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b7b4ecc3-2244-4a1e-be98-6f0431ca0a24 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:07.239856 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b7b4ecc3-2244-4a1e-be98-6f0431ca0a24 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:07.632127 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-18405475-e7f3-476b-b1f0-aa81141af975 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:07.660430 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-18405475-e7f3-476b-b1f0-aa81141af975 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 1.024701 Jul 18 02:08:07.661336 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 54/91] 10.222.0.57 () {58 vars in 1136 bytes} [Mon Jul 18 02:08:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:07.667382 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4927af45-c4dd-4c9a-8d3f-593fc0a0aa0b tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:07.689216 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4927af45-c4dd-4c9a-8d3f-593fc0a0aa0b tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/1711250092" status: 202 len: 0 microversion: 2.1 time: 0.026413 Jul 18 02:08:07.690720 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 55/92] 10.222.0.57 () {58 vars in 1160 bytes} [Mon Jul 18 02:08:07 2022] DELETE /compute/v2.1/flavors/1711250092 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:08:07.825935 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b7b4ecc3-2244-4a1e-be98-6f0431ca0a24 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93a266d6b1f4d718af3724d8b78f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd036e434ea348338dfb0fed060b66d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:07.834921 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b7b4ecc3-2244-4a1e-be98-6f0431ca0a24 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] 10.222.0.57 "GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490" status: 200 len: 1338 microversion: 2.1 time: 0.634575 Jul 18 02:08:07.835626 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 38/93] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:07 2022] GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490 => generated 1338 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:07.849913 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e16f4347-5f0c-474d-8c0a-bff0fcd16cf5 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:07.884339 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e16f4347-5f0c-474d-8c0a-bff0fcd16cf5 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040350 Jul 18 02:08:07.907651 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 39/94] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:08:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:07.924551 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-935c46bb-5074-4d2d-9b6d-4da3d697d823 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-616454794", "id": 2138303185, "os-flavor-access:is_public": "False"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:07.926135 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:07.926135 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:07.962790 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-935c46bb-5074-4d2d-9b6d-4da3d697d823 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.042014 Jul 18 02:08:07.963781 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 40/95] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:08:07 2022] POST /compute/v2.1/flavors => generated 429 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:07.977795 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4400a47b-9ce4-47a6-ad69-91169e10b682 tempest-FlavorsAdminTestJSON-1220046535 tempest-FlavorsAdminTestJSON-1220046535-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "2138303185"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:08.049306 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-4400a47b-9ce4-47a6-ad69-91169e10b682 tempest-FlavorsAdminTestJSON-1220046535 tempest-FlavorsAdminTestJSON-1220046535-project] HTTP exception thrown: Flavor 2138303185 could not be found. Jul 18 02:08:08.060096 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4400a47b-9ce4-47a6-ad69-91169e10b682 tempest-FlavorsAdminTestJSON-1220046535 tempest-FlavorsAdminTestJSON-1220046535-project] Request method failure captured: Jul 18 02:08:08.060096 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:08:08.060096 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:08:08.060096 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:08:08.060096 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:08:08.060096 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 107 Jul 18 02:08:08.060096 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:08:08.060096 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:08:08.060096 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:08:08.060096 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:08:08.060096 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MB_mpr8XBAFRr4rdwQhpA6g2SSYYponE0ngITbTEzfUq3erT2e__5w6QIFaUtH3lOTCzKhPi4_C1luw_H_G5SewWyYr3k_DKzEvtzfielCHVlrXV3FPcYK8ZJ5fKe41GlrrOVpP_ZaFkwillbNZfSxbJQiv1G9ycfQ9KkVism3_6xk Jul 18 02:08:08.060096 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:08:08.060096 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:08:08.060096 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:08:08.060096 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:08:08.060096 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:08:08.060096 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:08:08.060096 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: fae7dd2ec1b94fa4b1df50ace79f56e7 Jul 18 02:08:08.060096 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-FlavorsAdminTestJSON-1220046535 Jul 18 02:08:08.060096 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:08:08.060096 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:08:08.061664 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fae7dd2ec1b94fa4b1df50ace79f56e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fae7dd2ec1b94fa4b1df50ace79f56e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fae7dd2ec1b94fa4b1df50ace79f56e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fae7dd2ec1b94fa4b1df50ace79f56e7"}]}] Jul 18 02:08:08.061664 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-FlavorsAdminTestJSON-1220046535 Jul 18 02:08:08.061664 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: fae7dd2ec1b94fa4b1df50ace79f56e7 Jul 18 02:08:08.061664 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1220046535 Jul 18 02:08:08.061664 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-FlavorsAdminTestJSON-1220046535-project Jul 18 02:08:08.061664 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:08:08.061664 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:08:08.061664 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 579e0a329b084718ac55cb708311b48d Jul 18 02:08:08.061664 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-FlavorsAdminTestJSON-1220046535-project Jul 18 02:08:08.061664 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 02:08:08.061664 n-d-465891-3 devstack@n-api.service[119543]: {"server": {"name": "test", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "2138303185"}} Jul 18 02:08:08.061664 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:08:08.061664 n-d-465891-3 devstack@n-api.service[119543]: exception: Flavor 2138303185 could not be found. Jul 18 02:08:08.062466 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '3bb0a19f-5b69-48ee-a771-8fd416f92f36', 'flavorRef': '2138303185'}}} Jul 18 02:08:08.062466 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:08:08.062466 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:08.062466 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 18 02:08:08.062466 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 18 02:08:08.062466 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 02:08:08.062466 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 02:08:08.062466 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:08:08.062466 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:08:08.062466 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 02:08:08.062466 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 02:08:08.062466 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 02:08:08.062466 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:08:08.062466 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 02:08:08.062466 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 02:08:08.062466 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 2138303185 could not be found. Jul 18 02:08:08.062466 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:08.062466 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:08.062466 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:08.062466 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:08.063734 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:08.063734 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:08.063734 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:08:08.063734 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:08:08.063734 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:08:08.063734 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:08:08.063734 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:08:08.063734 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:08:08.063734 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:08:08.063734 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:08:08.063734 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:08:08.063734 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:08:08.063734 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 18 02:08:08.063734 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 18 02:08:08.063734 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 18 02:08:08.063734 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 2138303185 could not be found. Jul 18 02:08:08.063734 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:08.063734 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:08.063734 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:08.063734 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:08.063734 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:08.064867 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:08.064867 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:08:08.064867 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:08:08.064867 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2138303185 could not be found. Jul 18 02:08:08.064867 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:08.064867 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4400a47b-9ce4-47a6-ad69-91169e10b682 tempest-FlavorsAdminTestJSON-1220046535 tempest-FlavorsAdminTestJSON-1220046535-project] Returning 400 to user: Flavor 2138303185 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:08:08.064867 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4400a47b-9ce4-47a6-ad69-91169e10b682 tempest-FlavorsAdminTestJSON-1220046535 tempest-FlavorsAdminTestJSON-1220046535-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.092568 Jul 18 02:08:08.068643 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 41/96] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:08:07 2022] POST /compute/v2.1/servers => generated 81 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 18 02:08:08.077838 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e7f9f287-729b-4a86-b90f-2615bdfbde26 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:08.079588 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:08.079588 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:08.120975 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e7f9f287-729b-4a86-b90f-2615bdfbde26 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/2138303185" status: 202 len: 0 microversion: 2.1 time: 0.049998 Jul 18 02:08:08.122115 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 42/97] 10.222.0.57 () {58 vars in 1160 bytes} [Mon Jul 18 02:08:08 2022] DELETE /compute/v2.1/flavors/2138303185 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:08:08.130851 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8efb03cd-078d-4e6a-9627-ae7a0079c27e tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:08.174334 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8efb03cd-078d-4e6a-9627-ae7a0079c27e tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047446 Jul 18 02:08:08.175050 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 43/98] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:08:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:08:08.200085 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8cc86b82-7c40-489a-92ac-eada21562401 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1594080982", "id": 1019728782, "os-flavor-access:is_public": "False"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:08.242782 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8cc86b82-7c40-489a-92ac-eada21562401 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.053551 Jul 18 02:08:08.245747 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 44/99] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:08:08 2022] POST /compute/v2.1/flavors => generated 415 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:08:08.265978 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9a66bdde-8782-4ba3-a0ed-c4c64260220e tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1906490340", "id": 1533484619, "os-flavor-access:is_public": "True"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:08.310079 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9a66bdde-8782-4ba3-a0ed-c4c64260220e tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.058044 Jul 18 02:08:08.313480 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 45/100] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:08:08 2022] POST /compute/v2.1/flavors => generated 414 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:08.335200 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bdc6c855-b403-4c8b-881c-05949eaf0d65 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:08.377523 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bdc6c855-b403-4c8b-881c-05949eaf0d65 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.049201 Jul 18 02:08:08.379335 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 46/101] 10.222.0.57 () {58 vars in 1168 bytes} [Mon Jul 18 02:08:08 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:08.398238 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-883c563d-5402-4d38-9e3d-73b158120af1 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:08.417116 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-883c563d-5402-4d38-9e3d-73b158120af1 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.028109 Jul 18 02:08:08.418803 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 47/102] 10.222.0.57 () {58 vars in 1176 bytes} [Mon Jul 18 02:08:08 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:08.438954 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-64bd6d7f-1c2b-4ffa-b1ec-ab4fdb97e633 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:08.473113 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-64bd6d7f-1c2b-4ffa-b1ec-ab4fdb97e633 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.042381 Jul 18 02:08:08.475661 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 48/103] 10.222.0.57 () {58 vars in 1170 bytes} [Mon Jul 18 02:08:08 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:08.500662 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ac90da1e-d81f-42bc-854e-0fa569c9f23e tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:08.521479 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ac90da1e-d81f-42bc-854e-0fa569c9f23e tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.035359 Jul 18 02:08:08.524651 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 49/104] 10.222.0.57 () {58 vars in 1168 bytes} [Mon Jul 18 02:08:08 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:08:08.538483 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-92bf802c-6131-4104-b366-6e22d7935abf tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:08.567441 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-92bf802c-6131-4104-b366-6e22d7935abf tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.034264 Jul 18 02:08:08.572056 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 50/105] 10.222.0.57 () {58 vars in 1168 bytes} [Mon Jul 18 02:08:08 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:08.588727 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5f350ade-43d5-4dcf-82ae-e7f984adbdf5 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:08.611711 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5f350ade-43d5-4dcf-82ae-e7f984adbdf5 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.026779 Jul 18 02:08:08.624359 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 51/106] 10.222.0.57 () {58 vars in 1174 bytes} [Mon Jul 18 02:08:08 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:08.632891 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8d430fbc-d374-4e5d-9c42-b8f791a54d15 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:08.649440 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b6040c8a-4721-4720-8f7b-9342b4a6a750 tempest-ServersWithSpecificFlavorTestJSON-122237826 tempest-ServersWithSpecificFlavorTestJSON-122237826-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1115409974", "id": 1539648143, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:08.663849 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8d430fbc-d374-4e5d-9c42-b8f791a54d15 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.036239 Jul 18 02:08:08.667620 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 52/107] 10.222.0.57 () {58 vars in 1172 bytes} [Mon Jul 18 02:08:08 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:08.684575 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5dbc5ea0-46b8-4f90-bc02-bde45a555943 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:08.686763 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b6040c8a-4721-4720-8f7b-9342b4a6a750 tempest-ServersWithSpecificFlavorTestJSON-122237826 tempest-ServersWithSpecificFlavorTestJSON-122237826-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.992979 Jul 18 02:08:08.690959 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 56/108] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:08:07 2022] POST /compute/v2.1/flavors => generated 425 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:08.704688 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3818b515-763d-4833-82f3-54176a05897a tempest-ServersWithSpecificFlavorTestJSON-122237826 tempest-ServersWithSpecificFlavorTestJSON-122237826-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:08.750926 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5dbc5ea0-46b8-4f90-bc02-bde45a555943 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5810 microversion: 2.1 time: 0.072204 Jul 18 02:08:08.751769 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 53/109] 10.222.0.57 () {58 vars in 1168 bytes} [Mon Jul 18 02:08:08 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5810 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:08:08.764956 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3818b515-763d-4833-82f3-54176a05897a tempest-ServersWithSpecificFlavorTestJSON-122237826 tempest-ServersWithSpecificFlavorTestJSON-122237826-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.067926 Jul 18 02:08:08.766426 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 57/110] 10.222.0.57 () {58 vars in 1181 bytes} [Mon Jul 18 02:08:08 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:08:08.777561 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a794b126-a03a-49ad-9670-ce58daef3ab9 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:08.782354 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-80f7867e-4b1f-4f2e-bd95-b8ee99db0579 tempest-ServersWithSpecificFlavorTestJSON-122237826 tempest-ServersWithSpecificFlavorTestJSON-122237826-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-615516460", "id": 1236876455, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:08.845790 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-80f7867e-4b1f-4f2e-bd95-b8ee99db0579 tempest-ServersWithSpecificFlavorTestJSON-122237826 tempest-ServersWithSpecificFlavorTestJSON-122237826-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.070421 Jul 18 02:08:08.848449 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 58/111] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:08:08 2022] POST /compute/v2.1/flavors => generated 424 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:08.854564 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a794b126-a03a-49ad-9670-ce58daef3ab9 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/1533484619" status: 202 len: 0 microversion: 2.1 time: 0.090461 Jul 18 02:08:08.857985 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 54/112] 10.222.0.57 () {58 vars in 1160 bytes} [Mon Jul 18 02:08:08 2022] DELETE /compute/v2.1/flavors/1533484619 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:08:08.871334 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f512e026-6792-4726-836c-0109b7dd64b8 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:08.875115 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f512e026-6792-4726-836c-0109b7dd64b8 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] [instance: e5dbcad3-c8b1-4113-862a-6010a666b490] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:08.876768 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-29bdbc31-c492-49fb-99a2-9f44d37b19c8 tempest-ServersWithSpecificFlavorTestJSON-122237826 tempest-ServersWithSpecificFlavorTestJSON-122237826-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:08.910866 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-29bdbc31-c492-49fb-99a2-9f44d37b19c8 tempest-ServersWithSpecificFlavorTestJSON-122237826 tempest-ServersWithSpecificFlavorTestJSON-122237826-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.048500 Jul 18 02:08:08.917186 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 55/113] 10.222.0.57 () {58 vars in 1181 bytes} [Mon Jul 18 02:08:08 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:08:08.924299 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f512e026-6792-4726-836c-0109b7dd64b8 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:08.926733 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f512e026-6792-4726-836c-0109b7dd64b8 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:08.928038 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f512e026-6792-4726-836c-0109b7dd64b8 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:08.929012 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f512e026-6792-4726-836c-0109b7dd64b8 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:08.935528 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-df005ec2-8b09-4edb-bfb3-877303beca76 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:08.969086 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-df005ec2-8b09-4edb-bfb3-877303beca76 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.037273 Jul 18 02:08:08.982715 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 56/114] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:08:08 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:08.988665 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-aca4bb5d-2a0a-4653-8d6c-c1e511afd26c tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Action: 'create', calling method: .version_select at 0x7ff4a98ee430>, body: {"keypair": {"name": "tempest-keypair-9024320", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqsLIpYcLG+h37AZNAMKi1gw2CYsM7tjLrfm53QuXQaEJKwlapFrJ6VKdJv9qDvHxkTVnIK277TksVsWPA3HrgbjYjR6l5lU0OUzmPSnRs6vSoQumUBou7BgaPxDQnRdw=="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:09.094321 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-aca4bb5d-2a0a-4653-8d6c-c1e511afd26c tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Getting quotas for project dd02ce642caf4529a6e65c184de0ad19. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:08:09.123624 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-aca4bb5d-2a0a-4653-8d6c-c1e511afd26c tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Getting quotas for user 60118d593f96437dbb2c68ad2fadd465 and project dd02ce642caf4529a6e65c184de0ad19. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:08:09.217691 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-aca4bb5d-2a0a-4653-8d6c-c1e511afd26c tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 383 microversion: 2.1 time: 0.231129 Jul 18 02:08:09.224472 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 57/115] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 02:08:08 2022] POST /compute/v2.1/os-keypairs => generated 383 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:09.234924 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ed881c8a-b663-4232-823f-1e2b4ed084ef tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:09.282250 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ed881c8a-b663-4232-823f-1e2b4ed084ef tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/1019728782" status: 202 len: 0 microversion: 2.1 time: 0.056744 Jul 18 02:08:09.284383 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 58/116] 10.222.0.57 () {58 vars in 1160 bytes} [Mon Jul 18 02:08:09 2022] DELETE /compute/v2.1/flavors/1019728782 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:08:09.295769 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-374975b7-7f44-40fd-a0bc-0b2eaf0752b8 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:09.371720 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-374975b7-7f44-40fd-a0bc-0b2eaf0752b8 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.080030 Jul 18 02:08:09.377104 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 59/117] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:08:09 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:09.392445 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b5b83be1-7504-488d-9887-24431b13ea5f tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-522721805", "id": 835550812, "os-flavor-access:is_public": "False"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:09.434310 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=10,nova_api:INSERT=7 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:08:09.446803 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b5b83be1-7504-488d-9887-24431b13ea5f tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.061164 Jul 18 02:08:09.454813 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 60/118] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:08:09 2022] POST /compute/v2.1/flavors => generated 411 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:08:09.459788 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-18531015-60fe-4d99-9df6-7abca82a234e tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:09.571183 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-18531015-60fe-4d99-9df6-7abca82a234e tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.114881 Jul 18 02:08:09.571821 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 61/119] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:08:09 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:09.603239 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2f328d62-6d08-4d67-bba7-de61f9dc7828 tempest-FlavorsAdminTestJSON-1220046535 tempest-FlavorsAdminTestJSON-1220046535-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:09.676237 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2f328d62-6d08-4d67-bba7-de61f9dc7828 tempest-FlavorsAdminTestJSON-1220046535 tempest-FlavorsAdminTestJSON-1220046535-project] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.093831 Jul 18 02:08:09.685583 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 62/120] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:08:09 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:08:09.719576 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7dcbaddf-38e1-458c-a978-be5cf60e7f3c tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:09.769847 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7dcbaddf-38e1-458c-a978-be5cf60e7f3c tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/835550812" status: 202 len: 0 microversion: 2.1 time: 0.068660 Jul 18 02:08:09.773466 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 63/121] 10.222.0.57 () {58 vars in 1157 bytes} [Mon Jul 18 02:08:09 2022] DELETE /compute/v2.1/flavors/835550812 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:08:09.942247 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f512e026-6792-4726-836c-0109b7dd64b8 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93a266d6b1f4d718af3724d8b78f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd036e434ea348338dfb0fed060b66d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:09.966378 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f512e026-6792-4726-836c-0109b7dd64b8 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] 10.222.0.57 "GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490" status: 200 len: 1338 microversion: 2.1 time: 1.116191 Jul 18 02:08:09.973352 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 59/122] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:08 2022] GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490 => generated 1338 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:09.983510 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5604cc83-5241-4812-a0e2-824b97c623ee tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:10.023599 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9c35baa9-fb8f-450d-9271-682f70bbb2b6 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-2020814645", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:10.027290 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5604cc83-5241-4812-a0e2-824b97c623ee tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.052490 Jul 18 02:08:10.045523 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 60/123] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:08:09 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:10.051257 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-da7ad995-d976-4f7a-9f15-2c9d6d33dd51 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-636799959", "id": 1867995194, "os-flavor-access:is_public": "True"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:10.053838 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:10.053838 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:10.057645 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=10,nova_api:INSERT=9 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:08:10.105828 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-da7ad995-d976-4f7a-9f15-2c9d6d33dd51 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.057057 Jul 18 02:08:10.118843 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 61/124] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:08:10 2022] POST /compute/v2.1/flavors => generated 413 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:10.127497 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8bd3434d-782f-42b7-b24c-fa655fd18342 tempest-FlavorsAdminTestJSON-1220046535 tempest-FlavorsAdminTestJSON-1220046535-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:10.168681 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8bd3434d-782f-42b7-b24c-fa655fd18342 tempest-FlavorsAdminTestJSON-1220046535 tempest-FlavorsAdminTestJSON-1220046535-project] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 6223 microversion: 2.1 time: 0.048434 Jul 18 02:08:10.169741 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 62/125] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:08:10 2022] GET /compute/v2.1/flavors/detail => generated 6223 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:10.180737 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-9c35baa9-fb8f-450d-9271-682f70bbb2b6 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] validate_networks() for None {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:08:10.186670 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3876cc17-61e8-44b4-a742-da99eb88dc06 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:10.187838 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:10.187838 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:10.243182 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3876cc17-61e8-44b4-a742-da99eb88dc06 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/1867995194" status: 202 len: 0 microversion: 2.1 time: 0.059999 Jul 18 02:08:10.244231 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 63/126] 10.222.0.57 () {58 vars in 1160 bytes} [Mon Jul 18 02:08:10 2022] DELETE /compute/v2.1/flavors/1867995194 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:08:10.255585 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7a57770f-7479-47bc-b98d-3dab0a305380 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:10.297145 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7a57770f-7479-47bc-b98d-3dab0a305380 tempest-FlavorsAdminTestJSON-1361141233 tempest-FlavorsAdminTestJSON-1361141233-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.048288 Jul 18 02:08:10.322922 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 64/127] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:08:10 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:10.802817 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-9c35baa9-fb8f-450d-9271-682f70bbb2b6 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:08:10.804613 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-9c35baa9-fb8f-450d-9271-682f70bbb2b6 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:08:10.805290 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-9c35baa9-fb8f-450d-9271-682f70bbb2b6 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:08:10.805914 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-9c35baa9-fb8f-450d-9271-682f70bbb2b6 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:08:10.806509 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-9c35baa9-fb8f-450d-9271-682f70bbb2b6 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:08:10.832294 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9c35baa9-fb8f-450d-9271-682f70bbb2b6 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:10.834263 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9c35baa9-fb8f-450d-9271-682f70bbb2b6 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:10.837854 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9c35baa9-fb8f-450d-9271-682f70bbb2b6 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:10.845989 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9c35baa9-fb8f-450d-9271-682f70bbb2b6 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:10.932239 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-9c35baa9-fb8f-450d-9271-682f70bbb2b6 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Getting quotas for project 5b0c0be2e96a499dbde6652cbc758a27. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:08:10.938615 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-9c35baa9-fb8f-450d-9271-682f70bbb2b6 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Getting quotas for user efe4f42523df4204b49c9c0899c93fc7 and project 5b0c0be2e96a499dbde6652cbc758a27. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:08:10.962317 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9c35baa9-fb8f-450d-9271-682f70bbb2b6 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:08:10.965794 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9c35baa9-fb8f-450d-9271-682f70bbb2b6 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: 34961834-de57-4c1c-9ace-7bf4c43f8af8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:08:10.980692 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=8 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:08:10.982268 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:08:11.122960 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9c35baa9-fb8f-450d-9271-682f70bbb2b6 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.337035 Jul 18 02:08:11.126871 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 64/128] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:08:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1353 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:08:11.154377 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b0cf6fc5-a2fe-451d-ad67-fdb53fe08a16 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:11.160718 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b0cf6fc5-a2fe-451d-ad67-fdb53fe08a16 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] [instance: e5dbcad3-c8b1-4113-862a-6010a666b490] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:11.196438 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b0cf6fc5-a2fe-451d-ad67-fdb53fe08a16 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:11.198239 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b0cf6fc5-a2fe-451d-ad67-fdb53fe08a16 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:11.202082 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b0cf6fc5-a2fe-451d-ad67-fdb53fe08a16 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:11.202868 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b0cf6fc5-a2fe-451d-ad67-fdb53fe08a16 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:11.380780 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-03ff0627-baa9-4479-85a4-e777e9f9c87a tempest-QuotaClassesAdmin257Test-1070786888 tempest-QuotaClassesAdmin257Test-1070786888-project-admin] Calling method '.version_select at 0x7ff4a959b940>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:11.382291 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:11.382291 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:11.418638 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-03ff0627-baa9-4479-85a4-e777e9f9c87a tempest-QuotaClassesAdmin257Test-1070786888 tempest-QuotaClassesAdmin257Test-1070786888-project-admin] 10.222.0.57 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.444815 Jul 18 02:08:11.425393 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 65/129] 10.222.0.57 () {60 vars in 1225 bytes} [Mon Jul 18 02:08:10 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 02:08:11.427460 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-027a3f97-7ad3-4dac-b824-b73116a83a7c tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:11.429019 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-027a3f97-7ad3-4dac-b824-b73116a83a7c tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: 34961834-de57-4c1c-9ace-7bf4c43f8af8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:11.698983 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-027a3f97-7ad3-4dac-b824-b73116a83a7c tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe4f42523df4204b49c9c0899c93fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0c0be2e96a499dbde6652cbc758a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:11.729764 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-027a3f97-7ad3-4dac-b824-b73116a83a7c tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8" status: 200 len: 1220 microversion: 2.1 time: 0.307861 Jul 18 02:08:11.740875 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 66/130] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:11 2022] GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8 => generated 1220 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:11.750267 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b262cf09-dc16-4d2d-af54-d576159ca086 tempest-QuotaClassesAdmin257Test-1070786888 tempest-QuotaClassesAdmin257Test-1070786888-project-admin] Action: 'update', calling method: .version_select at 0x7ff4abd49820>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:11.751930 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:11.751930 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:12.285990 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b262cf09-dc16-4d2d-af54-d576159ca086 tempest-QuotaClassesAdmin257Test-1070786888 tempest-QuotaClassesAdmin257Test-1070786888-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.552678 Jul 18 02:08:12.310767 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 67/131] 10.222.0.57 () {62 vars in 1246 bytes} [Mon Jul 18 02:08:11 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:08:12.340203 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-62ebbf09-56a1-4ab6-b3ec-69a351abb33a tempest-QuotaClassesAdmin257Test-1070786888 tempest-QuotaClassesAdmin257Test-1070786888-project-admin] Calling method '.version_select at 0x7ff4a9574b80>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:12.341172 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:12.341172 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:12.385318 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-62ebbf09-56a1-4ab6-b3ec-69a351abb33a tempest-QuotaClassesAdmin257Test-1070786888 tempest-QuotaClassesAdmin257Test-1070786888-project-admin] 10.222.0.57 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.073284 Jul 18 02:08:12.398825 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 68/132] 10.222.0.57 () {60 vars in 1225 bytes} [Mon Jul 18 02:08:12 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:08:12.415914 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5889c10a-ac51-462e-87f2-56b2c9d8ec49 tempest-QuotaClassesAdmin257Test-1070786888 tempest-QuotaClassesAdmin257Test-1070786888-project-admin] Action: 'update', calling method: .version_select at 0x7ff4a94d7ee0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:12.594433 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5889c10a-ac51-462e-87f2-56b2c9d8ec49 tempest-QuotaClassesAdmin257Test-1070786888 tempest-QuotaClassesAdmin257Test-1070786888-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.193946 Jul 18 02:08:12.600773 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 69/133] 10.222.0.57 () {62 vars in 1246 bytes} [Mon Jul 18 02:08:12 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:08:12.661625 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b0cf6fc5-a2fe-451d-ad67-fdb53fe08a16 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93a266d6b1f4d718af3724d8b78f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd036e434ea348338dfb0fed060b66d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:12.677361 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b0cf6fc5-a2fe-451d-ad67-fdb53fe08a16 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] 10.222.0.57 "GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490" status: 200 len: 1338 microversion: 2.1 time: 1.545969 Jul 18 02:08:12.690693 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 65/134] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:11 2022] GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490 => generated 1338 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:12.754438 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a4425b3a-acde-4de2-9f77-479ec49864f2 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:12.755587 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a4425b3a-acde-4de2-9f77-479ec49864f2 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: 34961834-de57-4c1c-9ace-7bf4c43f8af8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:13.591173 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a4425b3a-acde-4de2-9f77-479ec49864f2 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe4f42523df4204b49c9c0899c93fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0c0be2e96a499dbde6652cbc758a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:13.611539 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a4425b3a-acde-4de2-9f77-479ec49864f2 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8" status: 200 len: 1220 microversion: 2.1 time: 0.865712 Jul 18 02:08:13.618748 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 70/135] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:12 2022] GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8 => generated 1220 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:13.700271 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9d7174e4-4102-42e0-ba07-891534476e6c tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:13.700898 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9d7174e4-4102-42e0-ba07-891534476e6c tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] [instance: e5dbcad3-c8b1-4113-862a-6010a666b490] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:13.719724 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9d7174e4-4102-42e0-ba07-891534476e6c tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:13.720803 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9d7174e4-4102-42e0-ba07-891534476e6c tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:13.733392 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9d7174e4-4102-42e0-ba07-891534476e6c tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:13.733984 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9d7174e4-4102-42e0-ba07-891534476e6c tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:14.643690 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7ca8a223-9a99-44ce-9d1b-1065f669683e tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:14.644320 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7ca8a223-9a99-44ce-9d1b-1065f669683e tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: 34961834-de57-4c1c-9ace-7bf4c43f8af8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:14.676808 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7ca8a223-9a99-44ce-9d1b-1065f669683e tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:14.677271 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7ca8a223-9a99-44ce-9d1b-1065f669683e tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:14.678866 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7ca8a223-9a99-44ce-9d1b-1065f669683e tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:14.679314 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7ca8a223-9a99-44ce-9d1b-1065f669683e tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:15.326605 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7ca8a223-9a99-44ce-9d1b-1065f669683e tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe4f42523df4204b49c9c0899c93fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0c0be2e96a499dbde6652cbc758a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:15.352673 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7ca8a223-9a99-44ce-9d1b-1065f669683e tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8" status: 200 len: 1280 microversion: 2.1 time: 0.710324 Jul 18 02:08:15.356967 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 71/136] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:14 2022] GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8 => generated 1280 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:08:15.694277 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9d7174e4-4102-42e0-ba07-891534476e6c tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93a266d6b1f4d718af3724d8b78f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd036e434ea348338dfb0fed060b66d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:15.714354 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9d7174e4-4102-42e0-ba07-891534476e6c tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] 10.222.0.57 "GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490" status: 200 len: 1338 microversion: 2.1 time: 2.021435 Jul 18 02:08:15.715534 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 66/137] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:13 2022] GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490 => generated 1338 bytes in 2024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:16.350726 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-2fa7702b-94c3-4d9e-ab3f-b3a5ba8868c4 req-0b434617-af73-404e-973d-de4334607edc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5dbcad3-c8b1-4113-862a-6010a666b490", "tag": "4c701d52-ddf0-4101-83fe-267799e665cf"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:16.370833 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4e6218a3-954a-43ed-acb6-3381978bdaeb tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:16.371650 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4e6218a3-954a-43ed-acb6-3381978bdaeb tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: 34961834-de57-4c1c-9ace-7bf4c43f8af8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:16.384285 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4e6218a3-954a-43ed-acb6-3381978bdaeb tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:16.384747 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4e6218a3-954a-43ed-acb6-3381978bdaeb tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:16.385551 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4e6218a3-954a-43ed-acb6-3381978bdaeb tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:16.389955 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4e6218a3-954a-43ed-acb6-3381978bdaeb tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:16.431531 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-2fa7702b-94c3-4d9e-ab3f-b3a5ba8868c4 req-0b434617-af73-404e-973d-de4334607edc service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:16.431531 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-2fa7702b-94c3-4d9e-ab3f-b3a5ba8868c4 req-0b434617-af73-404e-973d-de4334607edc service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:16.496136 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-2fa7702b-94c3-4d9e-ab3f-b3a5ba8868c4 req-0b434617-af73-404e-973d-de4334607edc service nova] Creating event network-changed:4c701d52-ddf0-4101-83fe-267799e665cf for instance e5dbcad3-c8b1-4113-862a-6010a666b490 on n-h2-465891-3 Jul 18 02:08:16.497275 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-2fa7702b-94c3-4d9e-ab3f-b3a5ba8868c4 req-0b434617-af73-404e-973d-de4334607edc service nova] Acquired lock "compute-rpcapi-router" {{(pid=119544) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 02:08:16.498860 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-050ce595-e561-40e5-9193-7c0532b1c82f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:16.499731 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-050ce595-e561-40e5-9193-7c0532b1c82f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:16.501221 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-050ce595-e561-40e5-9193-7c0532b1c82f None None] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:16.502472 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-050ce595-e561-40e5-9193-7c0532b1c82f None None] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:16.515575 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.compute.rpcapi [None req-050ce595-e561-40e5-9193-7c0532b1c82f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 18 02:08:16.517568 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-050ce595-e561-40e5-9193-7c0532b1c82f None None] Releasing lock "compute-rpcapi-router" {{(pid=119544) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 02:08:16.564650 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-050ce595-e561-40e5-9193-7c0532b1c82f None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.824247 Jul 18 02:08:16.567096 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 72/138] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:16.577622 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4e6218a3-954a-43ed-acb6-3381978bdaeb tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe4f42523df4204b49c9c0899c93fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0c0be2e96a499dbde6652cbc758a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:16.595174 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4e6218a3-954a-43ed-acb6-3381978bdaeb tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8" status: 200 len: 1278 microversion: 2.1 time: 0.226425 Jul 18 02:08:16.596495 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 67/139] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:16 2022] GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8 => generated 1278 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:16.733136 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-71766162-3ef1-4e4b-8937-796e676e3547 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:16.734073 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-71766162-3ef1-4e4b-8937-796e676e3547 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] [instance: e5dbcad3-c8b1-4113-862a-6010a666b490] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:16.755289 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-71766162-3ef1-4e4b-8937-796e676e3547 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:16.757923 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-71766162-3ef1-4e4b-8937-796e676e3547 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:16.759635 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-71766162-3ef1-4e4b-8937-796e676e3547 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:16.760589 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-71766162-3ef1-4e4b-8937-796e676e3547 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:17.118318 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-71766162-3ef1-4e4b-8937-796e676e3547 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93a266d6b1f4d718af3724d8b78f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd036e434ea348338dfb0fed060b66d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:17.127027 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-71766162-3ef1-4e4b-8937-796e676e3547 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] 10.222.0.57 "GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490" status: 200 len: 1338 microversion: 2.1 time: 0.398631 Jul 18 02:08:17.132445 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 73/140] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:16 2022] GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490 => generated 1338 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:17.614480 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-53a10824-2fc3-42c1-9c9f-169b4207a456 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:17.615237 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-53a10824-2fc3-42c1-9c9f-169b4207a456 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: 34961834-de57-4c1c-9ace-7bf4c43f8af8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:17.646018 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-53a10824-2fc3-42c1-9c9f-169b4207a456 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:17.647135 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-53a10824-2fc3-42c1-9c9f-169b4207a456 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:17.651235 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-53a10824-2fc3-42c1-9c9f-169b4207a456 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:17.651806 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-53a10824-2fc3-42c1-9c9f-169b4207a456 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:17.793216 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-53a10824-2fc3-42c1-9c9f-169b4207a456 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe4f42523df4204b49c9c0899c93fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0c0be2e96a499dbde6652cbc758a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:17.803363 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-53a10824-2fc3-42c1-9c9f-169b4207a456 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8" status: 200 len: 1278 microversion: 2.1 time: 0.193107 Jul 18 02:08:17.808039 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 68/141] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:17 2022] GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8 => generated 1278 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:18.103092 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-30df092c-c442-43ec-bf2e-2d2a08b088d1 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1669115662", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "1236876455", "adminPass": "***", "networks": [{"uuid": "4c02df64-d6ca-44f4-bcfe-240d736ae88d"}], "security_groups": [{"name": "tempest-securitygroup--344219863"}], "key_name": "tempest-keypair-9024320", "user_data": "}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:18.148691 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8136b877-9170-408c-9aeb-bfed5e053727 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:18.149569 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8136b877-9170-408c-9aeb-bfed5e053727 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] [instance: e5dbcad3-c8b1-4113-862a-6010a666b490] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:18.165955 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8136b877-9170-408c-9aeb-bfed5e053727 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:18.166969 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8136b877-9170-408c-9aeb-bfed5e053727 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:18.167976 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8136b877-9170-408c-9aeb-bfed5e053727 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:18.169209 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8136b877-9170-408c-9aeb-bfed5e053727 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:18.913444 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8136b877-9170-408c-9aeb-bfed5e053727 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93a266d6b1f4d718af3724d8b78f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd036e434ea348338dfb0fed060b66d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:18.916262 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=81 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:08:18.942901 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8136b877-9170-408c-9aeb-bfed5e053727 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] 10.222.0.57 "GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490" status: 200 len: 1338 microversion: 2.1 time: 0.798378 Jul 18 02:08:18.950385 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 69/142] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:18 2022] GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490 => generated 1338 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:18.977228 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e5cf54a1-2055-460b-a8dd-4743dcc5ce44 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:18.985308 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e5cf54a1-2055-460b-a8dd-4743dcc5ce44 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: 34961834-de57-4c1c-9ace-7bf4c43f8af8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:19.018550 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e5cf54a1-2055-460b-a8dd-4743dcc5ce44 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:19.026558 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e5cf54a1-2055-460b-a8dd-4743dcc5ce44 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:19.030539 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e5cf54a1-2055-460b-a8dd-4743dcc5ce44 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:19.033670 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e5cf54a1-2055-460b-a8dd-4743dcc5ce44 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:19.191769 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e5cf54a1-2055-460b-a8dd-4743dcc5ce44 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe4f42523df4204b49c9c0899c93fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0c0be2e96a499dbde6652cbc758a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:19.201796 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e5cf54a1-2055-460b-a8dd-4743dcc5ce44 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8" status: 200 len: 1278 microversion: 2.1 time: 0.247796 Jul 18 02:08:19.202983 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 70/143] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:18 2022] GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8 => generated 1278 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:19.967900 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1868a688-4f16-4739-b167-b67e61ba862b tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Calling method '.version_select at 0x7ff4a968e1f0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:19.974962 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:19.974962 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:19.977040 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1868a688-4f16-4739-b167-b67e61ba862b tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:19.979521 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1868a688-4f16-4739-b167-b67e61ba862b tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:20.003362 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1868a688-4f16-4739-b167-b67e61ba862b tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:20.004068 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1868a688-4f16-4739-b167-b67e61ba862b tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:20.044368 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1868a688-4f16-4739-b167-b67e61ba862b tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:20.045056 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1868a688-4f16-4739-b167-b67e61ba862b tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:20.061289 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1868a688-4f16-4739-b167-b67e61ba862b tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.855398 Jul 18 02:08:20.069374 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 71/144] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:08:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:20.074445 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b17e9ca2-c318-46c5-b3df-d1220139d1b7 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:20.083151 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b17e9ca2-c318-46c5-b3df-d1220139d1b7 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] [instance: e5dbcad3-c8b1-4113-862a-6010a666b490] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:20.101317 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b17e9ca2-c318-46c5-b3df-d1220139d1b7 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:20.101805 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b17e9ca2-c318-46c5-b3df-d1220139d1b7 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:20.105744 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b17e9ca2-c318-46c5-b3df-d1220139d1b7 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:20.106259 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b17e9ca2-c318-46c5-b3df-d1220139d1b7 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:20.285074 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b17e9ca2-c318-46c5-b3df-d1220139d1b7 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93a266d6b1f4d718af3724d8b78f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd036e434ea348338dfb0fed060b66d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:20.294596 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b17e9ca2-c318-46c5-b3df-d1220139d1b7 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] 10.222.0.57 "GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490" status: 200 len: 1338 microversion: 2.1 time: 0.223854 Jul 18 02:08:20.295179 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 72/145] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:20 2022] GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490 => generated 1338 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:20.551873 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7192d6af-5339-416c-ac48-1d9d3b2c6f51 tempest-FlavorsExtraSpecsTestJSON-13525908 tempest-FlavorsExtraSpecsTestJSON-13525908-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1640773046", "ram": 512, "vcpus": 1, "disk": 10, "id": 831581795, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:20.554314 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:20.554314 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:20.582941 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7192d6af-5339-416c-ac48-1d9d3b2c6f51 tempest-FlavorsExtraSpecsTestJSON-13525908 tempest-FlavorsExtraSpecsTestJSON-13525908-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.286096 Jul 18 02:08:20.584139 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 73/146] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:08:20 2022] POST /compute/v2.1/flavors => generated 413 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:20.589237 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-20c10e34-52b1-4f96-ab79-214855b81f43 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Calling method '.version_select at 0x7ff4a9673430>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:20.590223 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:20.590223 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:20.591428 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20c10e34-52b1-4f96-ab79-214855b81f43 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:20.591973 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20c10e34-52b1-4f96-ab79-214855b81f43 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:20.613751 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20c10e34-52b1-4f96-ab79-214855b81f43 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:20.613751 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20c10e34-52b1-4f96-ab79-214855b81f43 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:20.642979 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20c10e34-52b1-4f96-ab79-214855b81f43 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:20.643427 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20c10e34-52b1-4f96-ab79-214855b81f43 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:20.651566 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-20c10e34-52b1-4f96-ab79-214855b81f43 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.066376 Jul 18 02:08:20.661217 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 74/147] 10.222.0.57 () {58 vars in 1166 bytes} [Mon Jul 18 02:08:20 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:20.666737 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-29f50ce9-dbcc-4130-aea9-b51a7c53f8e9 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:20.667352 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-29f50ce9-dbcc-4130-aea9-b51a7c53f8e9 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: 34961834-de57-4c1c-9ace-7bf4c43f8af8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:20.673619 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-29f50ce9-dbcc-4130-aea9-b51a7c53f8e9 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:20.674112 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-29f50ce9-dbcc-4130-aea9-b51a7c53f8e9 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:20.675170 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-29f50ce9-dbcc-4130-aea9-b51a7c53f8e9 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:20.675712 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-29f50ce9-dbcc-4130-aea9-b51a7c53f8e9 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:20.850914 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-29f50ce9-dbcc-4130-aea9-b51a7c53f8e9 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe4f42523df4204b49c9c0899c93fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0c0be2e96a499dbde6652cbc758a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:20.859673 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-29f50ce9-dbcc-4130-aea9-b51a7c53f8e9 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8" status: 200 len: 1320 microversion: 2.1 time: 0.197010 Jul 18 02:08:20.860823 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 75/148] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:20 2022] GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8 => generated 1320 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:20.867454 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4d095022-f5f3-42c8-a8cd-7a2c7d442793 tempest-FlavorsExtraSpecsTestJSON-13525908 tempest-FlavorsExtraSpecsTestJSON-13525908-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:20.869227 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:20.869227 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:20.919340 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=4 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:08:20.921189 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4d095022-f5f3-42c8-a8cd-7a2c7d442793 tempest-FlavorsExtraSpecsTestJSON-13525908 tempest-FlavorsExtraSpecsTestJSON-13525908-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors/831581795/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.059175 Jul 18 02:08:20.922184 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 76/149] 10.222.0.57 () {60 vars in 1220 bytes} [Mon Jul 18 02:08:20 2022] POST /compute/v2.1/flavors/831581795/os-extra_specs => generated 66 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:08:20.926758 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a2eaf2a1-f4c3-4467-98e3-6301b59b3463 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Calling method '.version_select at 0x7ff4a968e9d0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:20.927682 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:20.927682 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:20.928839 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a2eaf2a1-f4c3-4467-98e3-6301b59b3463 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:20.929274 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a2eaf2a1-f4c3-4467-98e3-6301b59b3463 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:20.943796 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a2eaf2a1-f4c3-4467-98e3-6301b59b3463 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:20.944855 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a2eaf2a1-f4c3-4467-98e3-6301b59b3463 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:20.954213 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=12 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:08:20.976164 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a2eaf2a1-f4c3-4467-98e3-6301b59b3463 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:20.976870 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a2eaf2a1-f4c3-4467-98e3-6301b59b3463 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:20.985412 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a2eaf2a1-f4c3-4467-98e3-6301b59b3463 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.062032 Jul 18 02:08:20.986188 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 77/150] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:08:20 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:21.330146 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7e83d3e5-edbc-4cfe-907d-731e61b5364f tempest-FlavorsExtraSpecsTestJSON-1512838787 tempest-FlavorsExtraSpecsTestJSON-1512838787-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:21.341251 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7e83d3e5-edbc-4cfe-907d-731e61b5364f tempest-FlavorsExtraSpecsTestJSON-1512838787 tempest-FlavorsExtraSpecsTestJSON-1512838787-project] 10.222.0.57 "GET /compute/v2.1/flavors/831581795/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.354002 Jul 18 02:08:21.341896 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 78/151] 10.222.0.57 () {58 vars in 1199 bytes} [Mon Jul 18 02:08:20 2022] GET /compute/v2.1/flavors/831581795/os-extra_specs => generated 66 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:08:21.352605 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-debe8005-3964-4b64-ac48-9b898ae73a6f tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Calling method '.version_select at 0x7ff4a96835e0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:21.353480 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:21.353480 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:21.360160 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-debe8005-3964-4b64-ac48-9b898ae73a6f tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:21.360613 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-debe8005-3964-4b64-ac48-9b898ae73a6f tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:21.378419 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-debe8005-3964-4b64-ac48-9b898ae73a6f tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:21.379058 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-debe8005-3964-4b64-ac48-9b898ae73a6f tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:21.389497 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-debe8005-3964-4b64-ac48-9b898ae73a6f tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.046355 Jul 18 02:08:21.399383 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 79/152] 10.222.0.57 () {58 vars in 1151 bytes} [Mon Jul 18 02:08:21 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:21.399383 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d1f7bcdb-95e1-48c7-a9f9-56825798ede9 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:21.399383 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d1f7bcdb-95e1-48c7-a9f9-56825798ede9 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] [instance: e5dbcad3-c8b1-4113-862a-6010a666b490] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:21.403358 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d1f7bcdb-95e1-48c7-a9f9-56825798ede9 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:21.403930 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d1f7bcdb-95e1-48c7-a9f9-56825798ede9 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:21.404572 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d1f7bcdb-95e1-48c7-a9f9-56825798ede9 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:21.405009 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d1f7bcdb-95e1-48c7-a9f9-56825798ede9 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:21.591992 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d1f7bcdb-95e1-48c7-a9f9-56825798ede9 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93a266d6b1f4d718af3724d8b78f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd036e434ea348338dfb0fed060b66d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:21.600080 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d1f7bcdb-95e1-48c7-a9f9-56825798ede9 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] 10.222.0.57 "GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490" status: 200 len: 1338 microversion: 2.1 time: 0.207937 Jul 18 02:08:21.600483 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 80/153] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:21 2022] GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490 => generated 1338 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:21.609679 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-753942c7-8e62-494c-a568-3f7b240e8e98 tempest-FlavorsExtraSpecsTestJSON-13525908 tempest-FlavorsExtraSpecsTestJSON-13525908-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:21.609679 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:21.609679 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:21.629028 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-753942c7-8e62-494c-a568-3f7b240e8e98 tempest-FlavorsExtraSpecsTestJSON-13525908 tempest-FlavorsExtraSpecsTestJSON-13525908-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors/831581795/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.027402 Jul 18 02:08:21.629931 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 81/154] 10.222.0.57 () {60 vars in 1220 bytes} [Mon Jul 18 02:08:21 2022] POST /compute/v2.1/flavors/831581795/os-extra_specs => generated 66 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:08:21.639288 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-febf2a7b-7ca7-4cf4-bbb3-0ea7551883b6 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Calling method '.version_select at 0x7ff4a970a310>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:21.640338 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:21.640338 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:21.641341 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-febf2a7b-7ca7-4cf4-bbb3-0ea7551883b6 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:21.641892 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-febf2a7b-7ca7-4cf4-bbb3-0ea7551883b6 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:21.658120 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-30df092c-c442-43ec-bf2e-2d2a08b088d1 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] validate_networks() for [('4c02df64-d6ca-44f4-bcfe-240d736ae88d', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:08:21.659456 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-febf2a7b-7ca7-4cf4-bbb3-0ea7551883b6 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.023659 Jul 18 02:08:21.660164 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 82/155] 10.222.0.57 () {58 vars in 1178 bytes} [Mon Jul 18 02:08:21 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:21.723913 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-82b62e0a-3ddc-4ac7-a9bf-93470da8b966 tempest-ServicesAdminNegativeTestJSON-1553117093 tempest-ServicesAdminNegativeTestJSON-1553117093-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:21.725515 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:21.725515 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:21.726869 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-82b62e0a-3ddc-4ac7-a9bf-93470da8b966 tempest-ServicesAdminNegativeTestJSON-1553117093 tempest-ServicesAdminNegativeTestJSON-1553117093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:21.727375 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-82b62e0a-3ddc-4ac7-a9bf-93470da8b966 tempest-ServicesAdminNegativeTestJSON-1553117093 tempest-ServicesAdminNegativeTestJSON-1553117093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:21.728248 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-82b62e0a-3ddc-4ac7-a9bf-93470da8b966 tempest-ServicesAdminNegativeTestJSON-1553117093 tempest-ServicesAdminNegativeTestJSON-1553117093-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:21.728753 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-82b62e0a-3ddc-4ac7-a9bf-93470da8b966 tempest-ServicesAdminNegativeTestJSON-1553117093 tempest-ServicesAdminNegativeTestJSON-1553117093-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:21.760814 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-82b62e0a-3ddc-4ac7-a9bf-93470da8b966 tempest-ServicesAdminNegativeTestJSON-1553117093 tempest-ServicesAdminNegativeTestJSON-1553117093-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 966 microversion: 2.1 time: 0.099525 Jul 18 02:08:21.761740 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 83/156] 10.222.0.57 () {58 vars in 1136 bytes} [Mon Jul 18 02:08:21 2022] GET /compute/v2.1/os-services => generated 966 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:21.766033 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-34b50bfe-b78a-4110-81bf-79be70323f25 tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] Calling method '.version_select at 0x7ff4a9673040>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:21.811950 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-34b50bfe-b78a-4110-81bf-79be70323f25 tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] 10.222.0.57 "GET /compute/v2.1/images/349d14b6-c0d4-4eff-bac1-a5b81b7fce25" status: 200 len: 637 microversion: 2.1 time: 0.049218 Jul 18 02:08:21.820174 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 84/157] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:08:21 2022] GET /compute/v2.1/images/349d14b6-c0d4-4eff-bac1-a5b81b7fce25 => generated 637 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:21.825322 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7f69023b-546d-4954-aa28-0ac5ba457ec1 tempest-FlavorsExtraSpecsTestJSON-1512838787 tempest-FlavorsExtraSpecsTestJSON-1512838787-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:21.835780 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7f69023b-546d-4954-aa28-0ac5ba457ec1 tempest-FlavorsExtraSpecsTestJSON-1512838787 tempest-FlavorsExtraSpecsTestJSON-1512838787-project] 10.222.0.57 "GET /compute/v2.1/flavors/831581795/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.014337 Jul 18 02:08:21.836364 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 85/158] 10.222.0.57 () {58 vars in 1241 bytes} [Mon Jul 18 02:08:21 2022] GET /compute/v2.1/flavors/831581795/os-extra_specs/hw:numa_nodes => generated 22 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:08:21.844747 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ee1fdc51-3dc9-4456-baba-67f62022f624 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Calling method '.version_select at 0x7ff4a9922a60>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:21.845940 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:21.845940 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:21.848049 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ee1fdc51-3dc9-4456-baba-67f62022f624 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:21.848937 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ee1fdc51-3dc9-4456-baba-67f62022f624 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:21.871058 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ee1fdc51-3dc9-4456-baba-67f62022f624 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:21.872775 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ee1fdc51-3dc9-4456-baba-67f62022f624 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:21.885193 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ee1fdc51-3dc9-4456-baba-67f62022f624 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:21.885619 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ee1fdc51-3dc9-4456-baba-67f62022f624 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:21.898047 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ee1fdc51-3dc9-4456-baba-67f62022f624 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.060500 Jul 18 02:08:21.901766 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 86/159] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:08:21 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:21.903882 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0aecebbb-348d-43b8-a7ed-543a410e4fa5 tempest-ServicesAdminNegativeTestJSON-1553117093 tempest-ServicesAdminNegativeTestJSON-1553117093-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:21.905188 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:21.905188 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:21.906442 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0aecebbb-348d-43b8-a7ed-543a410e4fa5 tempest-ServicesAdminNegativeTestJSON-1553117093 tempest-ServicesAdminNegativeTestJSON-1553117093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:21.906882 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0aecebbb-348d-43b8-a7ed-543a410e4fa5 tempest-ServicesAdminNegativeTestJSON-1553117093 tempest-ServicesAdminNegativeTestJSON-1553117093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:21.907673 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0aecebbb-348d-43b8-a7ed-543a410e4fa5 tempest-ServicesAdminNegativeTestJSON-1553117093 tempest-ServicesAdminNegativeTestJSON-1553117093-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:21.908097 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0aecebbb-348d-43b8-a7ed-543a410e4fa5 tempest-ServicesAdminNegativeTestJSON-1553117093 tempest-ServicesAdminNegativeTestJSON-1553117093-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:21.923157 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=3,nova_api:INSERT=6,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:08:21.935447 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0aecebbb-348d-43b8-a7ed-543a410e4fa5 tempest-ServicesAdminNegativeTestJSON-1553117093 tempest-ServicesAdminNegativeTestJSON-1553117093-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 966 microversion: 2.1 time: 0.035432 Jul 18 02:08:21.936062 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 87/160] 10.222.0.57 () {58 vars in 1169 bytes} [Mon Jul 18 02:08:21 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 966 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:21.940472 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-022c5870-f0cd-4f60-b434-7680eba3b31e tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] Action: 'update_all', calling method: .version_select at 0x7ff4a9673820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:22.002338 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-022c5870-f0cd-4f60-b434-7680eba3b31e tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] Getting quotas for project 055fdff712e14c1cac2a8599a80511f7. Resources: dict_keys(['metadata_items']) {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:08:22.008655 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-022c5870-f0cd-4f60-b434-7680eba3b31e tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] Getting quotas for user b2718878c4d246fab17241a331947a35 and project 055fdff712e14c1cac2a8599a80511f7. Resources: dict_keys(['metadata_items']) {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:08:22.383439 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-022c5870-f0cd-4f60-b434-7680eba3b31e tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] 10.222.0.57 "PUT /compute/v2.1/images/349d14b6-c0d4-4eff-bac1-a5b81b7fce25/metadata" status: 200 len: 61 microversion: 2.1 time: 0.446297 Jul 18 02:08:22.384582 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 88/161] 10.222.0.57 () {60 vars in 1279 bytes} [Mon Jul 18 02:08:21 2022] PUT /compute/v2.1/images/349d14b6-c0d4-4eff-bac1-a5b81b7fce25/metadata => generated 61 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:08:22.398132 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b6fb3fd9-5663-4d68-8931-e139f7041241 tempest-FlavorsExtraSpecsTestJSON-13525908 tempest-FlavorsExtraSpecsTestJSON-13525908-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:22.400083 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:22.400083 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:22.400915 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-30df092c-c442-43ec-bf2e-2d2a08b088d1 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:08:22.401343 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-30df092c-c442-43ec-bf2e-2d2a08b088d1 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:08:22.401876 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-30df092c-c442-43ec-bf2e-2d2a08b088d1 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:08:22.402460 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-30df092c-c442-43ec-bf2e-2d2a08b088d1 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:08:22.402875 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-30df092c-c442-43ec-bf2e-2d2a08b088d1 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:08:22.415076 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-30df092c-c442-43ec-bf2e-2d2a08b088d1 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:22.415766 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-30df092c-c442-43ec-bf2e-2d2a08b088d1 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:22.416763 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-30df092c-c442-43ec-bf2e-2d2a08b088d1 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:22.417247 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-30df092c-c442-43ec-bf2e-2d2a08b088d1 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:22.423119 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b6fb3fd9-5663-4d68-8931-e139f7041241 tempest-FlavorsExtraSpecsTestJSON-13525908 tempest-FlavorsExtraSpecsTestJSON-13525908-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors/831581795/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.032567 Jul 18 02:08:22.423714 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 89/162] 10.222.0.57 () {60 vars in 1220 bytes} [Mon Jul 18 02:08:22 2022] POST /compute/v2.1/flavors/831581795/os-extra_specs => generated 66 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:08:22.425262 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=61 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:08:22.428669 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-16655a54-ccf1-4e12-939d-a433a4e10585 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:22.429586 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-16655a54-ccf1-4e12-939d-a433a4e10585 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: 34961834-de57-4c1c-9ace-7bf4c43f8af8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:22.435773 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-16655a54-ccf1-4e12-939d-a433a4e10585 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:22.436450 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-16655a54-ccf1-4e12-939d-a433a4e10585 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:22.437231 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-16655a54-ccf1-4e12-939d-a433a4e10585 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:22.437666 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-16655a54-ccf1-4e12-939d-a433a4e10585 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:22.445662 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-30df092c-c442-43ec-bf2e-2d2a08b088d1 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Getting quotas for project dd02ce642caf4529a6e65c184de0ad19. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:08:22.452491 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-30df092c-c442-43ec-bf2e-2d2a08b088d1 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Getting quotas for user 60118d593f96437dbb2c68ad2fadd465 and project dd02ce642caf4529a6e65c184de0ad19. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:08:22.466570 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-30df092c-c442-43ec-bf2e-2d2a08b088d1 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:08:22.468921 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-30df092c-c442-43ec-bf2e-2d2a08b088d1 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: dbb215bf-6099-4dd5-b9af-d1bbfb55ef21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:08:22.483156 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=75,nova_api:DELETE=3,nova_api:UPDATE=14 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:08:22.522635 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-30df092c-c442-43ec-bf2e-2d2a08b088d1 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.425812 Jul 18 02:08:22.528500 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 74/163] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:08:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 4430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:08:22.532903 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cf16bada-d0cd-4023-b4e8-78926b00acb6 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Calling method '.version_select at 0x7ff4a94ec3a0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:22.534139 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:22.534139 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:22.535975 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cf16bada-d0cd-4023-b4e8-78926b00acb6 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:22.536632 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cf16bada-d0cd-4023-b4e8-78926b00acb6 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:22.571794 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cf16bada-d0cd-4023-b4e8-78926b00acb6 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:22.572457 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cf16bada-d0cd-4023-b4e8-78926b00acb6 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:22.580260 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cf16bada-d0cd-4023-b4e8-78926b00acb6 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.052488 Jul 18 02:08:22.580865 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 75/164] 10.222.0.57 () {58 vars in 1151 bytes} [Mon Jul 18 02:08:22 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:22.600301 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a1881740-7862-4e40-92d8-5b5a53b4734f tempest-ServicesAdminNegativeTestJSON-1553117093 tempest-ServicesAdminNegativeTestJSON-1553117093-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:22.601960 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:22.601960 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:22.603518 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a1881740-7862-4e40-92d8-5b5a53b4734f tempest-ServicesAdminNegativeTestJSON-1553117093 tempest-ServicesAdminNegativeTestJSON-1553117093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:22.603966 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a1881740-7862-4e40-92d8-5b5a53b4734f tempest-ServicesAdminNegativeTestJSON-1553117093 tempest-ServicesAdminNegativeTestJSON-1553117093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:22.604780 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a1881740-7862-4e40-92d8-5b5a53b4734f tempest-ServicesAdminNegativeTestJSON-1553117093 tempest-ServicesAdminNegativeTestJSON-1553117093-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:22.605218 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a1881740-7862-4e40-92d8-5b5a53b4734f tempest-ServicesAdminNegativeTestJSON-1553117093 tempest-ServicesAdminNegativeTestJSON-1553117093-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:22.633676 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a1881740-7862-4e40-92d8-5b5a53b4734f tempest-ServicesAdminNegativeTestJSON-1553117093 tempest-ServicesAdminNegativeTestJSON-1553117093-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 966 microversion: 2.1 time: 0.051366 Jul 18 02:08:22.634326 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 76/165] 10.222.0.57 () {58 vars in 1136 bytes} [Mon Jul 18 02:08:22 2022] GET /compute/v2.1/os-services => generated 966 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:22.636329 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-16655a54-ccf1-4e12-939d-a433a4e10585 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe4f42523df4204b49c9c0899c93fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0c0be2e96a499dbde6652cbc758a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:22.648098 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-16655a54-ccf1-4e12-939d-a433a4e10585 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8" status: 200 len: 1320 microversion: 2.1 time: 0.223313 Jul 18 02:08:22.648438 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1f162f0a-9273-4f6f-94f2-906060466b2e tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] Calling method '.version_select at 0x7ff4a94e6af0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:22.648911 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 90/166] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:22 2022] GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8 => generated 1320 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:22.654548 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-207b61bd-b4eb-4a2f-af43-36892d27bad7 tempest-FlavorsExtraSpecsTestJSON-13525908 tempest-FlavorsExtraSpecsTestJSON-13525908-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:22.680764 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-207b61bd-b4eb-4a2f-af43-36892d27bad7 tempest-FlavorsExtraSpecsTestJSON-13525908 tempest-FlavorsExtraSpecsTestJSON-13525908-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/831581795/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.029986 Jul 18 02:08:22.688517 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 91/167] 10.222.0.57 () {58 vars in 1199 bytes} [Mon Jul 18 02:08:22 2022] GET /compute/v2.1/flavors/831581795/os-extra_specs => generated 66 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:08:22.698759 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4e8168d9-d6a6-468e-827c-c0639a977689 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:22.700427 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4e8168d9-d6a6-468e-827c-c0639a977689 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: dbb215bf-6099-4dd5-b9af-d1bbfb55ef21] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:22.770821 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4e8168d9-d6a6-468e-827c-c0639a977689 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60118d593f96437dbb2c68ad2fadd465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd02ce642caf4529a6e65c184de0ad19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:22.781090 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4e8168d9-d6a6-468e-827c-c0639a977689 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "GET /compute/v2.1/servers/dbb215bf-6099-4dd5-b9af-d1bbfb55ef21" status: 200 len: 1262 microversion: 2.1 time: 0.091114 Jul 18 02:08:22.782020 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 92/168] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:22 2022] GET /compute/v2.1/servers/dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 => generated 1262 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:22.787823 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3deeb581-dad9-402e-94de-98c0a8c53aa1 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Calling method '.version_select at 0x7ff4a9673670>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:22.788831 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:22.788831 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:22.790805 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3deeb581-dad9-402e-94de-98c0a8c53aa1 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:22.791266 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3deeb581-dad9-402e-94de-98c0a8c53aa1 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:22.806888 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3deeb581-dad9-402e-94de-98c0a8c53aa1 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:22.807332 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3deeb581-dad9-402e-94de-98c0a8c53aa1 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:22.814501 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3deeb581-dad9-402e-94de-98c0a8c53aa1 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.031638 Jul 18 02:08:22.815141 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 93/169] 10.222.0.57 () {58 vars in 1151 bytes} [Mon Jul 18 02:08:22 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:22.820044 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-81e35a3a-9b27-45c2-a45e-4cb9d07b3036 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:22.820653 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-81e35a3a-9b27-45c2-a45e-4cb9d07b3036 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] [instance: e5dbcad3-c8b1-4113-862a-6010a666b490] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:22.827122 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-81e35a3a-9b27-45c2-a45e-4cb9d07b3036 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:22.827567 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-81e35a3a-9b27-45c2-a45e-4cb9d07b3036 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:22.828345 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-81e35a3a-9b27-45c2-a45e-4cb9d07b3036 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:22.828776 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-81e35a3a-9b27-45c2-a45e-4cb9d07b3036 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:23.034252 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-81e35a3a-9b27-45c2-a45e-4cb9d07b3036 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93a266d6b1f4d718af3724d8b78f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd036e434ea348338dfb0fed060b66d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:23.048901 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-81e35a3a-9b27-45c2-a45e-4cb9d07b3036 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] 10.222.0.57 "GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490" status: 200 len: 1338 microversion: 2.1 time: 0.232707 Jul 18 02:08:23.052212 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 94/170] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:22 2022] GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490 => generated 1338 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:23.057918 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6403dcf1-6fc3-483d-9c5f-eed34d744624 tempest-ServicesAdminNegativeTestJSON-1553117093 tempest-ServicesAdminNegativeTestJSON-1553117093-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:23.059596 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:23.059596 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:23.061688 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6403dcf1-6fc3-483d-9c5f-eed34d744624 tempest-ServicesAdminNegativeTestJSON-1553117093 tempest-ServicesAdminNegativeTestJSON-1553117093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:23.062323 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6403dcf1-6fc3-483d-9c5f-eed34d744624 tempest-ServicesAdminNegativeTestJSON-1553117093 tempest-ServicesAdminNegativeTestJSON-1553117093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:23.063285 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6403dcf1-6fc3-483d-9c5f-eed34d744624 tempest-ServicesAdminNegativeTestJSON-1553117093 tempest-ServicesAdminNegativeTestJSON-1553117093-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:23.064493 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6403dcf1-6fc3-483d-9c5f-eed34d744624 tempest-ServicesAdminNegativeTestJSON-1553117093 tempest-ServicesAdminNegativeTestJSON-1553117093-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:23.099785 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6403dcf1-6fc3-483d-9c5f-eed34d744624 tempest-ServicesAdminNegativeTestJSON-1553117093 tempest-ServicesAdminNegativeTestJSON-1553117093-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services?host=n-d-465891-3&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.044603 Jul 18 02:08:23.100946 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 95/171] 10.222.0.57 () {58 vars in 1193 bytes} [Mon Jul 18 02:08:23 2022] GET /compute/v2.1/os-services?host=n-d-465891-3&binary=xxx => generated 16 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:08:23.106200 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c331cdea-4b07-4301-89ce-46bfb0677542 tempest-FlavorsExtraSpecsTestJSON-13525908 tempest-FlavorsExtraSpecsTestJSON-13525908-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:23.107745 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:23.107745 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:23.139313 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c331cdea-4b07-4301-89ce-46bfb0677542 tempest-FlavorsExtraSpecsTestJSON-13525908 tempest-FlavorsExtraSpecsTestJSON-13525908-project-admin] 10.222.0.57 "PUT /compute/v2.1/flavors/831581795/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.036568 Jul 18 02:08:23.139583 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1f162f0a-9273-4f6f-94f2-906060466b2e tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] 10.222.0.57 "DELETE /compute/v2.1/images/349d14b6-c0d4-4eff-bac1-a5b81b7fce25/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.504162 Jul 18 02:08:23.140473 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 77/172] 10.222.0.57 () {58 vars in 1295 bytes} [Mon Jul 18 02:08:22 2022] DELETE /compute/v2.1/images/349d14b6-c0d4-4eff-bac1-a5b81b7fce25/metadata/os_version => generated 0 bytes in 505 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:08:23.143958 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 96/173] 10.222.0.57 () {60 vars in 1261 bytes} [Mon Jul 18 02:08:23 2022] PUT /compute/v2.1/flavors/831581795/os-extra_specs/hw:numa_nodes => generated 22 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:08:23.149131 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-848911a9-ab31-40d0-8210-24c1738c6537 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Calling method '.version_select at 0x7ff4a94c4790>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:23.150365 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:23.150365 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:23.151741 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-47b921d6-f320-43c2-83f2-eb2b0e506770 tempest-ServicesAdminNegativeTestJSON-1553117093 tempest-ServicesAdminNegativeTestJSON-1553117093-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:23.152374 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-848911a9-ab31-40d0-8210-24c1738c6537 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:23.152859 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-848911a9-ab31-40d0-8210-24c1738c6537 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:23.153183 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:23.153183 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:23.154561 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-47b921d6-f320-43c2-83f2-eb2b0e506770 tempest-ServicesAdminNegativeTestJSON-1553117093 tempest-ServicesAdminNegativeTestJSON-1553117093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:23.155071 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-47b921d6-f320-43c2-83f2-eb2b0e506770 tempest-ServicesAdminNegativeTestJSON-1553117093 tempest-ServicesAdminNegativeTestJSON-1553117093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:23.155943 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-47b921d6-f320-43c2-83f2-eb2b0e506770 tempest-ServicesAdminNegativeTestJSON-1553117093 tempest-ServicesAdminNegativeTestJSON-1553117093-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:23.156445 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-47b921d6-f320-43c2-83f2-eb2b0e506770 tempest-ServicesAdminNegativeTestJSON-1553117093 tempest-ServicesAdminNegativeTestJSON-1553117093-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:23.168670 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-848911a9-ab31-40d0-8210-24c1738c6537 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:23.169515 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-848911a9-ab31-40d0-8210-24c1738c6537 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:23.181326 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-848911a9-ab31-40d0-8210-24c1738c6537 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:23.182049 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-848911a9-ab31-40d0-8210-24c1738c6537 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:23.189324 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-47b921d6-f320-43c2-83f2-eb2b0e506770 tempest-ServicesAdminNegativeTestJSON-1553117093 tempest-ServicesAdminNegativeTestJSON-1553117093-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 966 microversion: 2.1 time: 0.043844 Jul 18 02:08:23.191966 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 97/174] 10.222.0.57 () {58 vars in 1136 bytes} [Mon Jul 18 02:08:23 2022] GET /compute/v2.1/os-services => generated 966 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:23.198669 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e64e863f-766a-4561-9a45-a4d5fbbc3ad4 tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] Calling method '.version_select at 0x7ff4a9673700>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:23.221112 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-848911a9-ab31-40d0-8210-24c1738c6537 tempest-HypervisorAdminTestJSON-1419450084 tempest-HypervisorAdminTestJSON-1419450084-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.079117 Jul 18 02:08:23.222167 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 78/175] 10.222.0.57 () {58 vars in 1172 bytes} [Mon Jul 18 02:08:23 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:23.235154 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e4c03dd3-8310-4dc3-9540-702837ad93b1 tempest-FlavorsExtraSpecsTestJSON-13525908 tempest-FlavorsExtraSpecsTestJSON-13525908-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:23.252010 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e4c03dd3-8310-4dc3-9540-702837ad93b1 tempest-FlavorsExtraSpecsTestJSON-13525908 tempest-FlavorsExtraSpecsTestJSON-13525908-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/831581795/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.022106 Jul 18 02:08:23.258092 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 79/176] 10.222.0.57 () {58 vars in 1199 bytes} [Mon Jul 18 02:08:23 2022] GET /compute/v2.1/flavors/831581795/os-extra_specs => generated 66 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:08:23.264313 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e64e863f-766a-4561-9a45-a4d5fbbc3ad4 tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] 10.222.0.57 "GET /compute/v2.1/images/349d14b6-c0d4-4eff-bac1-a5b81b7fce25/metadata" status: 200 len: 37 microversion: 2.1 time: 0.070426 Jul 18 02:08:23.265277 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 98/177] 10.222.0.57 () {58 vars in 1259 bytes} [Mon Jul 18 02:08:23 2022] GET /compute/v2.1/images/349d14b6-c0d4-4eff-bac1-a5b81b7fce25/metadata => generated 37 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:08:23.265769 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-73f48169-0a17-415f-87cd-1ed5abda6cc1 tempest-ServicesAdminNegativeTestJSON-1553117093 tempest-ServicesAdminNegativeTestJSON-1553117093-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:23.267309 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:23.267309 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:23.270147 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-73f48169-0a17-415f-87cd-1ed5abda6cc1 tempest-ServicesAdminNegativeTestJSON-1553117093 tempest-ServicesAdminNegativeTestJSON-1553117093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:23.270615 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-80f4083c-4086-4ef8-9729-dfa194378e4c tempest-FlavorsExtraSpecsTestJSON-13525908 tempest-FlavorsExtraSpecsTestJSON-13525908-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:23.271209 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-73f48169-0a17-415f-87cd-1ed5abda6cc1 tempest-ServicesAdminNegativeTestJSON-1553117093 tempest-ServicesAdminNegativeTestJSON-1553117093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:23.271629 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:23.271629 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:23.272710 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-73f48169-0a17-415f-87cd-1ed5abda6cc1 tempest-ServicesAdminNegativeTestJSON-1553117093 tempest-ServicesAdminNegativeTestJSON-1553117093-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:23.273437 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-73f48169-0a17-415f-87cd-1ed5abda6cc1 tempest-ServicesAdminNegativeTestJSON-1553117093 tempest-ServicesAdminNegativeTestJSON-1553117093-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:23.319817 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-73f48169-0a17-415f-87cd-1ed5abda6cc1 tempest-ServicesAdminNegativeTestJSON-1553117093 tempest-ServicesAdminNegativeTestJSON-1553117093-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor" status: 200 len: 16 microversion: 2.1 time: 0.060075 Jul 18 02:08:23.320952 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 80/178] 10.222.0.57 () {58 vars in 1197 bytes} [Mon Jul 18 02:08:23 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor => generated 16 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:08:23.327394 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-80f4083c-4086-4ef8-9729-dfa194378e4c tempest-FlavorsExtraSpecsTestJSON-13525908 tempest-FlavorsExtraSpecsTestJSON-13525908-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/831581795/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.057670 Jul 18 02:08:23.332363 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 99/179] 10.222.0.57 () {58 vars in 1244 bytes} [Mon Jul 18 02:08:23 2022] DELETE /compute/v2.1/flavors/831581795/os-extra_specs/hw:numa_nodes => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 02:08:23.334728 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-abe96438-4b52-4488-bf87-402ea2f23a63 tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] Action: 'update_all', calling method: .version_select at 0x7ff4a94e6e50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:23.407537 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-abe96438-4b52-4488-bf87-402ea2f23a63 tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] Getting quotas for project 055fdff712e14c1cac2a8599a80511f7. Resources: dict_keys(['metadata_items']) {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:08:23.418466 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-abe96438-4b52-4488-bf87-402ea2f23a63 tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] Getting quotas for user b2718878c4d246fab17241a331947a35 and project 055fdff712e14c1cac2a8599a80511f7. Resources: dict_keys(['metadata_items']) {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:08:23.589150 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a820396c-1b8f-4e2b-a984-1bf0e99b7493 tempest-ServicesAdminNegativeTestJSON-2053883111 tempest-ServicesAdminNegativeTestJSON-2053883111-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:23.591046 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:23.591046 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:23.598679 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a820396c-1b8f-4e2b-a984-1bf0e99b7493 tempest-ServicesAdminNegativeTestJSON-2053883111 tempest-ServicesAdminNegativeTestJSON-2053883111-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '30032f1bb10c4304af5a9976c46bfe5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1f60faadb42ceb52b57fbd98b5a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:23.603336 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a820396c-1b8f-4e2b-a984-1bf0e99b7493 tempest-ServicesAdminNegativeTestJSON-2053883111 tempest-ServicesAdminNegativeTestJSON-2053883111-project] Request method failure captured: Jul 18 02:08:23.603336 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 18 02:08:23.603336 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:08:23.603336 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:08:23.603336 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:08:23.603336 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:08:23.603336 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:08:23.603336 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:08:23.603336 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:08:23.603336 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:08:23.603336 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MCUNr-9IzSuHy_F-EJx5rtgiQyR3uoeub0U-oP-HgksHgqRwdF2jSgK2DKYpUXRXndRlWV2s7_QfvJBwA0FlXGKJCeJu6rtvDSEmeekl8vVkusmmEUuG8u_7mTWkRx64h0O3Rz5-KH-eeKG0t6lH-USThCvTv6aY39rMEO-OCk8-pU Jul 18 02:08:23.603336 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:08:23.603336 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:08:23.603336 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:08:23.603336 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:08:23.603336 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:08:23.603336 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:08:23.603336 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: e2f1f60faadb42ceb52b57fbd98b5a05 Jul 18 02:08:23.603336 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-2053883111 Jul 18 02:08:23.603336 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:08:23.603336 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:08:23.604896 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e2f1f60faadb42ceb52b57fbd98b5a05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e2f1f60faadb42ceb52b57fbd98b5a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e2f1f60faadb42ceb52b57fbd98b5a05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e2f1f60faadb42ceb52b57fbd98b5a05"}]}] Jul 18 02:08:23.604896 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-2053883111 Jul 18 02:08:23.604896 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: e2f1f60faadb42ceb52b57fbd98b5a05 Jul 18 02:08:23.604896 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-2053883111 Jul 18 02:08:23.604896 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServicesAdminNegativeTestJSON-2053883111-project Jul 18 02:08:23.604896 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:08:23.604896 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:08:23.604896 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 30032f1bb10c4304af5a9976c46bfe5c Jul 18 02:08:23.604896 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-2053883111-project Jul 18 02:08:23.604896 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:08:23.604896 n-d-465891-3 devstack@n-api.service[119543]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 18 02:08:23.604896 n-d-465891-3 devstack@n-api.service[119543]: action_args: {} Jul 18 02:08:23.605790 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:08:23.605790 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:23.605790 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:23.605790 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:23.605790 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:08:23.605790 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:08:23.605790 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:08:23.605790 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:08:23.605790 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:08:23.605790 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:08:23.605790 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:08:23.605790 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:08:23.605790 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 18 02:08:23.605790 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 18 02:08:23.605790 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:08:23.605790 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:08:23.605790 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:08:23.605790 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:08:23.605790 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:08:23.607698 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:08:23.607698 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:08:23.607698 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:08:23.607698 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:08:23.607698 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:08:23.607698 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:08:23.607698 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:08:23.607698 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:08:23.607698 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:08:23.607698 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 18 02:08:23.607698 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:23.607698 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:23.607698 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:23.607698 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:23.607698 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:23.607698 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:23.607698 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:08:23.607698 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:08:23.607698 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 18 02:08:23.607698 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:23.609535 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a820396c-1b8f-4e2b-a984-1bf0e99b7493 tempest-ServicesAdminNegativeTestJSON-2053883111 tempest-ServicesAdminNegativeTestJSON-2053883111-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:08:23.609535 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a820396c-1b8f-4e2b-a984-1bf0e99b7493 tempest-ServicesAdminNegativeTestJSON-2053883111 tempest-ServicesAdminNegativeTestJSON-2053883111-project] 10.222.0.57 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.271364 Jul 18 02:08:23.609535 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 100/180] 10.222.0.57 () {58 vars in 1136 bytes} [Mon Jul 18 02:08:23 2022] GET /compute/v2.1/os-services => generated 112 bytes in 276 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:08:23.625978 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0d62974f-f390-4398-b2e7-ca33e9085197 tempest-FlavorsExtraSpecsTestJSON-13525908 tempest-FlavorsExtraSpecsTestJSON-13525908-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:23.683807 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0d62974f-f390-4398-b2e7-ca33e9085197 tempest-FlavorsExtraSpecsTestJSON-13525908 tempest-FlavorsExtraSpecsTestJSON-13525908-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/831581795/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.069891 Jul 18 02:08:23.684398 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 101/181] 10.222.0.57 () {58 vars in 1244 bytes} [Mon Jul 18 02:08:23 2022] DELETE /compute/v2.1/flavors/831581795/os-extra_specs/hw:cpu_policy => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 02:08:23.688972 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-596380c2-3342-464e-91ac-d77f90e5d7c0 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:23.689583 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-596380c2-3342-464e-91ac-d77f90e5d7c0 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: 34961834-de57-4c1c-9ace-7bf4c43f8af8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:23.708305 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-596380c2-3342-464e-91ac-d77f90e5d7c0 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:23.709219 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-596380c2-3342-464e-91ac-d77f90e5d7c0 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:23.710207 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-596380c2-3342-464e-91ac-d77f90e5d7c0 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:23.710624 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-596380c2-3342-464e-91ac-d77f90e5d7c0 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:23.941518 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-596380c2-3342-464e-91ac-d77f90e5d7c0 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe4f42523df4204b49c9c0899c93fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0c0be2e96a499dbde6652cbc758a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:23.956933 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-596380c2-3342-464e-91ac-d77f90e5d7c0 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8" status: 200 len: 1320 microversion: 2.1 time: 0.271451 Jul 18 02:08:23.967385 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 102/182] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:23 2022] GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8 => generated 1320 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:23.967385 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6b685c87-5da5-47d9-a6ef-694c2f1282f0 tempest-FlavorsExtraSpecsTestJSON-13525908 tempest-FlavorsExtraSpecsTestJSON-13525908-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:23.984449 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6b685c87-5da5-47d9-a6ef-694c2f1282f0 tempest-FlavorsExtraSpecsTestJSON-13525908 tempest-FlavorsExtraSpecsTestJSON-13525908-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/831581795/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.025311 Jul 18 02:08:23.986261 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 103/183] 10.222.0.57 () {58 vars in 1199 bytes} [Mon Jul 18 02:08:23 2022] GET /compute/v2.1/flavors/831581795/os-extra_specs => generated 19 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:08:24.005838 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-57a974a2-2cda-43e5-9f74-cca501eb9274 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:24.010067 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-57a974a2-2cda-43e5-9f74-cca501eb9274 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: dbb215bf-6099-4dd5-b9af-d1bbfb55ef21] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:24.026319 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-57a974a2-2cda-43e5-9f74-cca501eb9274 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:24.027144 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-57a974a2-2cda-43e5-9f74-cca501eb9274 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:24.029118 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-57a974a2-2cda-43e5-9f74-cca501eb9274 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:24.031396 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-57a974a2-2cda-43e5-9f74-cca501eb9274 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:24.185414 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-abe96438-4b52-4488-bf87-402ea2f23a63 tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] 10.222.0.57 "PUT /compute/v2.1/images/349d14b6-c0d4-4eff-bac1-a5b81b7fce25/metadata" status: 200 len: 61 microversion: 2.1 time: 0.856424 Jul 18 02:08:24.186350 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 81/184] 10.222.0.57 () {60 vars in 1279 bytes} [Mon Jul 18 02:08:23 2022] PUT /compute/v2.1/images/349d14b6-c0d4-4eff-bac1-a5b81b7fce25/metadata => generated 61 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:08:24.195169 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4dbe4ff5-7b1d-440f-8e9a-efdbff45f7e9 tempest-FlavorsExtraSpecsTestJSON-13525908 tempest-FlavorsExtraSpecsTestJSON-13525908-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:24.198969 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:24.198969 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:24.217284 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-57a974a2-2cda-43e5-9f74-cca501eb9274 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60118d593f96437dbb2c68ad2fadd465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd02ce642caf4529a6e65c184de0ad19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:24.232256 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-57a974a2-2cda-43e5-9f74-cca501eb9274 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "GET /compute/v2.1/servers/dbb215bf-6099-4dd5-b9af-d1bbfb55ef21" status: 200 len: 1336 microversion: 2.1 time: 0.244046 Jul 18 02:08:24.245425 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 104/185] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:23 2022] GET /compute/v2.1/servers/dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 => generated 1336 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:24.258187 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-da9f7905-ba95-4f25-a8e1-63879924d08e tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:24.268606 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-da9f7905-ba95-4f25-a8e1-63879924d08e tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] [instance: e5dbcad3-c8b1-4113-862a-6010a666b490] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:24.279870 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-da9f7905-ba95-4f25-a8e1-63879924d08e tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:24.280171 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4dbe4ff5-7b1d-440f-8e9a-efdbff45f7e9 tempest-FlavorsExtraSpecsTestJSON-13525908 tempest-FlavorsExtraSpecsTestJSON-13525908-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/831581795" status: 202 len: 0 microversion: 2.1 time: 0.072680 Jul 18 02:08:24.280844 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 82/186] 10.222.0.57 () {58 vars in 1157 bytes} [Mon Jul 18 02:08:24 2022] DELETE /compute/v2.1/flavors/831581795 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:08:24.281121 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-da9f7905-ba95-4f25-a8e1-63879924d08e tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:24.282331 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-da9f7905-ba95-4f25-a8e1-63879924d08e tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:24.283073 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-da9f7905-ba95-4f25-a8e1-63879924d08e tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:24.294196 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-410fadfd-68a5-4bbf-a07a-d81fed252675 tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] Calling method '.version_select at 0x7ff4a94271f0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:24.377325 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-410fadfd-68a5-4bbf-a07a-d81fed252675 tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] 10.222.0.57 "GET /compute/v2.1/images/349d14b6-c0d4-4eff-bac1-a5b81b7fce25/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.095382 Jul 18 02:08:24.378448 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 83/187] 10.222.0.57 () {58 vars in 1289 bytes} [Mon Jul 18 02:08:24 2022] GET /compute/v2.1/images/349d14b6-c0d4-4eff-bac1-a5b81b7fce25/metadata/os_distro => generated 33 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:08:24.383898 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0649cb5c-417a-4966-bfcc-1483a36fbcd0 tempest-FlavorsExtraSpecsTestJSON-13525908 tempest-FlavorsExtraSpecsTestJSON-13525908-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:24.431993 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0649cb5c-417a-4966-bfcc-1483a36fbcd0 tempest-FlavorsExtraSpecsTestJSON-13525908 tempest-FlavorsExtraSpecsTestJSON-13525908-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.052204 Jul 18 02:08:24.433281 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 84/188] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:08:24 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:24.438136 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fe6c98d1-efd3-4f6c-9521-1fcba32bfa76 tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] Action: 'update_all', calling method: .version_select at 0x7ff4a9420700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:24.549840 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-fe6c98d1-efd3-4f6c-9521-1fcba32bfa76 tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] Getting quotas for project 055fdff712e14c1cac2a8599a80511f7. Resources: dict_keys(['metadata_items']) {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:08:24.573587 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-fe6c98d1-efd3-4f6c-9521-1fcba32bfa76 tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] Getting quotas for user b2718878c4d246fab17241a331947a35 and project 055fdff712e14c1cac2a8599a80511f7. Resources: dict_keys(['metadata_items']) {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:08:24.712324 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-da9f7905-ba95-4f25-a8e1-63879924d08e tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93a266d6b1f4d718af3724d8b78f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd036e434ea348338dfb0fed060b66d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:24.734602 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-da9f7905-ba95-4f25-a8e1-63879924d08e tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] 10.222.0.57 "GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490" status: 200 len: 1338 microversion: 2.1 time: 0.473442 Jul 18 02:08:24.736832 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 105/189] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:24 2022] GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490 => generated 1338 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:24.977658 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e3a4184b-9b31-49d0-b220-4fc542844580 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:24.978835 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e3a4184b-9b31-49d0-b220-4fc542844580 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: 34961834-de57-4c1c-9ace-7bf4c43f8af8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:25.012324 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e3a4184b-9b31-49d0-b220-4fc542844580 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:25.013220 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e3a4184b-9b31-49d0-b220-4fc542844580 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:25.014521 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e3a4184b-9b31-49d0-b220-4fc542844580 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:25.015224 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e3a4184b-9b31-49d0-b220-4fc542844580 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:25.068513 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:08:25.332320 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fe6c98d1-efd3-4f6c-9521-1fcba32bfa76 tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] 10.222.0.57 "PUT /compute/v2.1/images/349d14b6-c0d4-4eff-bac1-a5b81b7fce25/metadata" status: 200 len: 61 microversion: 2.1 time: 0.897794 Jul 18 02:08:25.334191 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 85/190] 10.222.0.57 () {60 vars in 1279 bytes} [Mon Jul 18 02:08:24 2022] PUT /compute/v2.1/images/349d14b6-c0d4-4eff-bac1-a5b81b7fce25/metadata => generated 61 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:08:25.340158 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-197d443b-1cfc-4d31-be5d-91e35d8358cc tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:25.341075 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-197d443b-1cfc-4d31-be5d-91e35d8358cc tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: dbb215bf-6099-4dd5-b9af-d1bbfb55ef21] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:25.364279 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-197d443b-1cfc-4d31-be5d-91e35d8358cc tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:25.365731 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-197d443b-1cfc-4d31-be5d-91e35d8358cc tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:25.366816 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-197d443b-1cfc-4d31-be5d-91e35d8358cc tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:25.369594 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-197d443b-1cfc-4d31-be5d-91e35d8358cc tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:25.819172 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e3a4184b-9b31-49d0-b220-4fc542844580 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe4f42523df4204b49c9c0899c93fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0c0be2e96a499dbde6652cbc758a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:25.828886 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-197d443b-1cfc-4d31-be5d-91e35d8358cc tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60118d593f96437dbb2c68ad2fadd465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd02ce642caf4529a6e65c184de0ad19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:25.840175 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e3a4184b-9b31-49d0-b220-4fc542844580 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8" status: 200 len: 1320 microversion: 2.1 time: 0.866848 Jul 18 02:08:25.840828 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 106/191] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:24 2022] GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8 => generated 1320 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:25.863094 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-197d443b-1cfc-4d31-be5d-91e35d8358cc tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "GET /compute/v2.1/servers/dbb215bf-6099-4dd5-b9af-d1bbfb55ef21" status: 200 len: 1342 microversion: 2.1 time: 0.527457 Jul 18 02:08:25.868097 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2054b7ad-fc45-4521-858e-9c4f4226d343 tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] Calling method '.version_select at 0x7ff4a968eee0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:25.871964 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 86/192] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:25 2022] GET /compute/v2.1/servers/dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 => generated 1342 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:25.884233 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bb4b6c46-d8d5-4e16-8308-fd9105341568 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:25.885122 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bb4b6c46-d8d5-4e16-8308-fd9105341568 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] [instance: e5dbcad3-c8b1-4113-862a-6010a666b490] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:25.905510 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb4b6c46-d8d5-4e16-8308-fd9105341568 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:25.906112 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb4b6c46-d8d5-4e16-8308-fd9105341568 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:25.910994 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb4b6c46-d8d5-4e16-8308-fd9105341568 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:25.912634 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb4b6c46-d8d5-4e16-8308-fd9105341568 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:26.005241 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2054b7ad-fc45-4521-858e-9c4f4226d343 tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] 10.222.0.57 "GET /compute/v2.1/images/349d14b6-c0d4-4eff-bac1-a5b81b7fce25/metadata" status: 200 len: 61 microversion: 2.1 time: 0.163176 Jul 18 02:08:26.007165 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 107/193] 10.222.0.57 () {58 vars in 1259 bytes} [Mon Jul 18 02:08:25 2022] GET /compute/v2.1/images/349d14b6-c0d4-4eff-bac1-a5b81b7fce25/metadata => generated 61 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:08:26.023564 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4093547d-2f58-412c-9ff5-880ed0cc6a3f tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] Action: 'update_all', calling method: .version_select at 0x7ff4a975a790>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:26.139871 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-4093547d-2f58-412c-9ff5-880ed0cc6a3f tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] Getting quotas for project 055fdff712e14c1cac2a8599a80511f7. Resources: dict_keys(['metadata_items']) {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:08:26.145254 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-4093547d-2f58-412c-9ff5-880ed0cc6a3f tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] Getting quotas for user b2718878c4d246fab17241a331947a35 and project 055fdff712e14c1cac2a8599a80511f7. Resources: dict_keys(['metadata_items']) {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:08:26.308796 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bb4b6c46-d8d5-4e16-8308-fd9105341568 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93a266d6b1f4d718af3724d8b78f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd036e434ea348338dfb0fed060b66d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:26.324623 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bb4b6c46-d8d5-4e16-8308-fd9105341568 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] 10.222.0.57 "GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490" status: 200 len: 1338 microversion: 2.1 time: 0.451393 Jul 18 02:08:26.325187 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 87/194] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:25 2022] GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490 => generated 1338 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:26.518917 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4093547d-2f58-412c-9ff5-880ed0cc6a3f tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] 10.222.0.57 "PUT /compute/v2.1/images/349d14b6-c0d4-4eff-bac1-a5b81b7fce25/metadata" status: 200 len: 61 microversion: 2.1 time: 0.504679 Jul 18 02:08:26.519583 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 108/195] 10.222.0.57 () {60 vars in 1279 bytes} [Mon Jul 18 02:08:26 2022] PUT /compute/v2.1/images/349d14b6-c0d4-4eff-bac1-a5b81b7fce25/metadata => generated 61 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:08:26.529529 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-981f499b-4e10-4763-814a-c1681e260bf2 tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] Action: 'update_all', calling method: .version_select at 0x7ff4a9471160>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:26.628799 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-981f499b-4e10-4763-814a-c1681e260bf2 tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] Getting quotas for project 055fdff712e14c1cac2a8599a80511f7. Resources: dict_keys(['metadata_items']) {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:08:26.635690 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-981f499b-4e10-4763-814a-c1681e260bf2 tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] Getting quotas for user b2718878c4d246fab17241a331947a35 and project 055fdff712e14c1cac2a8599a80511f7. Resources: dict_keys(['metadata_items']) {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:08:26.702622 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-7bfca06b-f4ac-475a-b201-e6f520c319a3 req-02333856-4cea-4904-b9f8-6883680f444c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5dbcad3-c8b1-4113-862a-6010a666b490", "name": "network-vif-plugged", "status": "completed", "tag": "4c701d52-ddf0-4101-83fe-267799e665cf"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:26.720945 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-7bfca06b-f4ac-475a-b201-e6f520c319a3 req-02333856-4cea-4904-b9f8-6883680f444c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:26.721675 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-7bfca06b-f4ac-475a-b201-e6f520c319a3 req-02333856-4cea-4904-b9f8-6883680f444c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:26.750596 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-7bfca06b-f4ac-475a-b201-e6f520c319a3 req-02333856-4cea-4904-b9f8-6883680f444c service nova] Creating event network-vif-plugged:4c701d52-ddf0-4101-83fe-267799e665cf for instance e5dbcad3-c8b1-4113-862a-6010a666b490 on n-h2-465891-3 Jul 18 02:08:26.751381 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-7bfca06b-f4ac-475a-b201-e6f520c319a3 req-02333856-4cea-4904-b9f8-6883680f444c service nova] Acquired lock "compute-rpcapi-router" {{(pid=119543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 02:08:26.752658 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-88453c94-877e-4dbf-b234-7f491eb6bb88 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:26.753408 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-88453c94-877e-4dbf-b234-7f491eb6bb88 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:26.756026 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-88453c94-877e-4dbf-b234-7f491eb6bb88 None None] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:26.756670 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-88453c94-877e-4dbf-b234-7f491eb6bb88 None None] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:26.773727 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.compute.rpcapi [None req-88453c94-877e-4dbf-b234-7f491eb6bb88 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 18 02:08:26.774901 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-88453c94-877e-4dbf-b234-7f491eb6bb88 None None] Releasing lock "compute-rpcapi-router" {{(pid=119543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 02:08:26.825116 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-88453c94-877e-4dbf-b234-7f491eb6bb88 None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.227186 Jul 18 02:08:26.828632 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 109/196] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:26.868574 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f267817f-3a67-43f2-b2f2-b473db9d4578 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:26.869811 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f267817f-3a67-43f2-b2f2-b473db9d4578 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: 34961834-de57-4c1c-9ace-7bf4c43f8af8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:26.887735 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f267817f-3a67-43f2-b2f2-b473db9d4578 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:26.888440 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f267817f-3a67-43f2-b2f2-b473db9d4578 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:26.889464 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f267817f-3a67-43f2-b2f2-b473db9d4578 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:26.890145 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f267817f-3a67-43f2-b2f2-b473db9d4578 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:27.401164 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-981f499b-4e10-4763-814a-c1681e260bf2 tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] 10.222.0.57 "PUT /compute/v2.1/images/349d14b6-c0d4-4eff-bac1-a5b81b7fce25/metadata" status: 200 len: 64 microversion: 2.1 time: 0.875661 Jul 18 02:08:27.406530 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 88/197] 10.222.0.57 () {60 vars in 1279 bytes} [Mon Jul 18 02:08:26 2022] PUT /compute/v2.1/images/349d14b6-c0d4-4eff-bac1-a5b81b7fce25/metadata => generated 64 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:08:27.412010 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-24fab0c1-7ee5-46e7-9313-d5145b963779 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:27.412720 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-24fab0c1-7ee5-46e7-9313-d5145b963779 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: dbb215bf-6099-4dd5-b9af-d1bbfb55ef21] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:27.420509 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-24fab0c1-7ee5-46e7-9313-d5145b963779 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:27.421246 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-24fab0c1-7ee5-46e7-9313-d5145b963779 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:27.422248 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-24fab0c1-7ee5-46e7-9313-d5145b963779 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:27.422899 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-24fab0c1-7ee5-46e7-9313-d5145b963779 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:27.667648 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f267817f-3a67-43f2-b2f2-b473db9d4578 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe4f42523df4204b49c9c0899c93fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0c0be2e96a499dbde6652cbc758a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:27.675738 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f267817f-3a67-43f2-b2f2-b473db9d4578 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8" status: 200 len: 1320 microversion: 2.1 time: 0.812409 Jul 18 02:08:27.677120 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 110/198] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:26 2022] GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8 => generated 1320 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:08:27.682332 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b6dcf1d0-ad8c-4168-9d04-c74e6d2c56b4 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:27.683246 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b6dcf1d0-ad8c-4168-9d04-c74e6d2c56b4 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] [instance: e5dbcad3-c8b1-4113-862a-6010a666b490] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:27.693355 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b6dcf1d0-ad8c-4168-9d04-c74e6d2c56b4 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:27.694055 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b6dcf1d0-ad8c-4168-9d04-c74e6d2c56b4 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:27.695293 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b6dcf1d0-ad8c-4168-9d04-c74e6d2c56b4 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:27.696285 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b6dcf1d0-ad8c-4168-9d04-c74e6d2c56b4 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:28.013204 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-24fab0c1-7ee5-46e7-9313-d5145b963779 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60118d593f96437dbb2c68ad2fadd465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd02ce642caf4529a6e65c184de0ad19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:28.025197 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-24fab0c1-7ee5-46e7-9313-d5145b963779 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "GET /compute/v2.1/servers/dbb215bf-6099-4dd5-b9af-d1bbfb55ef21" status: 200 len: 1409 microversion: 2.1 time: 0.617500 Jul 18 02:08:28.026853 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 89/199] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:27 2022] GET /compute/v2.1/servers/dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 => generated 1409 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:28.048633 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b14f929d-7378-4b13-b0d6-0e3ea1188d7f tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] Calling method '.version_select at 0x7ff4a9471310>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:28.136288 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b14f929d-7378-4b13-b0d6-0e3ea1188d7f tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] 10.222.0.57 "GET /compute/v2.1/images/349d14b6-c0d4-4eff-bac1-a5b81b7fce25/metadata" status: 200 len: 64 microversion: 2.1 time: 0.092641 Jul 18 02:08:28.137406 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 90/200] 10.222.0.57 () {58 vars in 1259 bytes} [Mon Jul 18 02:08:28 2022] GET /compute/v2.1/images/349d14b6-c0d4-4eff-bac1-a5b81b7fce25/metadata => generated 64 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:08:28.151763 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-12cf38d2-86e3-447f-b0c8-053549e9f5df tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] Action: 'update_all', calling method: .version_select at 0x7ff4a96a9ee0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:28.235230 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b6dcf1d0-ad8c-4168-9d04-c74e6d2c56b4 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93a266d6b1f4d718af3724d8b78f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd036e434ea348338dfb0fed060b66d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:28.235759 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-12cf38d2-86e3-447f-b0c8-053549e9f5df tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] Getting quotas for project 055fdff712e14c1cac2a8599a80511f7. Resources: dict_keys(['metadata_items']) {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:08:28.242736 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-12cf38d2-86e3-447f-b0c8-053549e9f5df tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] Getting quotas for user b2718878c4d246fab17241a331947a35 and project 055fdff712e14c1cac2a8599a80511f7. Resources: dict_keys(['metadata_items']) {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:08:28.243238 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b6dcf1d0-ad8c-4168-9d04-c74e6d2c56b4 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] 10.222.0.57 "GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490" status: 200 len: 1338 microversion: 2.1 time: 0.564748 Jul 18 02:08:28.243816 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 111/201] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:27 2022] GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490 => generated 1338 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:28.651854 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2b952e94-dda6-47e5-82fc-6a5cf532a5c2 tempest-FlavorsV2NegativeTest-1458887343 tempest-FlavorsV2NegativeTest-1458887343-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:28.662804 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2b952e94-dda6-47e5-82fc-6a5cf532a5c2 tempest-FlavorsV2NegativeTest-1458887343 tempest-FlavorsV2NegativeTest-1458887343-project] 10.222.0.57 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.411390 Jul 18 02:08:28.664095 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 112/202] 10.222.0.57 () {58 vars in 1136 bytes} [Mon Jul 18 02:08:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:28.669582 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-7a92d08c-4f64-445d-8f1a-9f87dd97c426 req-2636b316-aba0-4f42-90e2-629a43b79e56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34961834-de57-4c1c-9ace-7bf4c43f8af8", "tag": "e2c5d317-4ca7-4174-8082-778a84325c43"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:28.688977 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-7a92d08c-4f64-445d-8f1a-9f87dd97c426 req-2636b316-aba0-4f42-90e2-629a43b79e56 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:28.691053 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-7a92d08c-4f64-445d-8f1a-9f87dd97c426 req-2636b316-aba0-4f42-90e2-629a43b79e56 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:28.719375 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-7a92d08c-4f64-445d-8f1a-9f87dd97c426 req-2636b316-aba0-4f42-90e2-629a43b79e56 service nova] Creating event network-changed:e2c5d317-4ca7-4174-8082-778a84325c43 for instance 34961834-de57-4c1c-9ace-7bf4c43f8af8 on n-h1-465891-3 Jul 18 02:08:28.757414 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-7a92d08c-4f64-445d-8f1a-9f87dd97c426 req-2636b316-aba0-4f42-90e2-629a43b79e56 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091457 Jul 18 02:08:28.762897 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 113/203] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:28.781221 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-106de4a9-3136-4c41-84e5-30b6bd087c00 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:28.783215 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-106de4a9-3136-4c41-84e5-30b6bd087c00 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: 34961834-de57-4c1c-9ace-7bf4c43f8af8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:28.793600 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-106de4a9-3136-4c41-84e5-30b6bd087c00 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:28.794359 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-106de4a9-3136-4c41-84e5-30b6bd087c00 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:28.795321 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-106de4a9-3136-4c41-84e5-30b6bd087c00 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:28.796380 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-106de4a9-3136-4c41-84e5-30b6bd087c00 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:28.909741 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-12cf38d2-86e3-447f-b0c8-053549e9f5df tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] 10.222.0.57 "PUT /compute/v2.1/images/349d14b6-c0d4-4eff-bac1-a5b81b7fce25/metadata" status: 200 len: 61 microversion: 2.1 time: 0.766545 Jul 18 02:08:28.910435 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 91/204] 10.222.0.57 () {60 vars in 1279 bytes} [Mon Jul 18 02:08:28 2022] PUT /compute/v2.1/images/349d14b6-c0d4-4eff-bac1-a5b81b7fce25/metadata => generated 61 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 02:08:28.921480 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fafe4aa9-56fe-4455-9d30-66dfc23c9f19 tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] Action: 'update', calling method: .version_select at 0x7ff4a94c41f0>, body: {"meta": {"os_version": "alt"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:29.009730 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-fafe4aa9-56fe-4455-9d30-66dfc23c9f19 tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] Getting quotas for project 055fdff712e14c1cac2a8599a80511f7. Resources: dict_keys(['metadata_items']) {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:08:29.022591 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-fafe4aa9-56fe-4455-9d30-66dfc23c9f19 tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] Getting quotas for user b2718878c4d246fab17241a331947a35 and project 055fdff712e14c1cac2a8599a80511f7. Resources: dict_keys(['metadata_items']) {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:08:29.080208 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-106de4a9-3136-4c41-84e5-30b6bd087c00 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe4f42523df4204b49c9c0899c93fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0c0be2e96a499dbde6652cbc758a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:29.090971 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-106de4a9-3136-4c41-84e5-30b6bd087c00 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8" status: 200 len: 1320 microversion: 2.1 time: 0.324497 Jul 18 02:08:29.091755 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 114/205] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:28 2022] GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8 => generated 1320 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:29.107723 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ab52e488-c3ba-4ff2-9f2f-cb811e9127ef tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:29.113866 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ab52e488-c3ba-4ff2-9f2f-cb811e9127ef tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: dbb215bf-6099-4dd5-b9af-d1bbfb55ef21] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:29.130412 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ab52e488-c3ba-4ff2-9f2f-cb811e9127ef tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:29.131077 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ab52e488-c3ba-4ff2-9f2f-cb811e9127ef tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:29.132126 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ab52e488-c3ba-4ff2-9f2f-cb811e9127ef tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:29.133655 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ab52e488-c3ba-4ff2-9f2f-cb811e9127ef tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:29.582110 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fafe4aa9-56fe-4455-9d30-66dfc23c9f19 tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] 10.222.0.57 "PUT /compute/v2.1/images/349d14b6-c0d4-4eff-bac1-a5b81b7fce25/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.665545 Jul 18 02:08:29.583839 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 92/206] 10.222.0.57 () {60 vars in 1312 bytes} [Mon Jul 18 02:08:28 2022] PUT /compute/v2.1/images/349d14b6-c0d4-4eff-bac1-a5b81b7fce25/metadata/os_version => generated 31 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 02:08:29.590396 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1d428d64-6f75-467b-a05d-e942381f5af5 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:29.591016 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1d428d64-6f75-467b-a05d-e942381f5af5 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] [instance: e5dbcad3-c8b1-4113-862a-6010a666b490] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:29.598289 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1d428d64-6f75-467b-a05d-e942381f5af5 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:29.599590 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1d428d64-6f75-467b-a05d-e942381f5af5 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:29.600533 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1d428d64-6f75-467b-a05d-e942381f5af5 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:29.601208 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1d428d64-6f75-467b-a05d-e942381f5af5 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:29.876327 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ab52e488-c3ba-4ff2-9f2f-cb811e9127ef tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60118d593f96437dbb2c68ad2fadd465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd02ce642caf4529a6e65c184de0ad19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:29.886015 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ab52e488-c3ba-4ff2-9f2f-cb811e9127ef tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "GET /compute/v2.1/servers/dbb215bf-6099-4dd5-b9af-d1bbfb55ef21" status: 200 len: 1409 microversion: 2.1 time: 0.781981 Jul 18 02:08:29.892101 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 115/207] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:29 2022] GET /compute/v2.1/servers/dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 => generated 1409 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:29.897162 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4407dcdc-2088-41cc-b96d-9fba0a6a3c16 tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] Calling method '.version_select at 0x7ff4a9609820>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:29.988251 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4407dcdc-2088-41cc-b96d-9fba0a6a3c16 tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] 10.222.0.57 "GET /compute/v2.1/images/349d14b6-c0d4-4eff-bac1-a5b81b7fce25/metadata" status: 200 len: 58 microversion: 2.1 time: 0.094704 Jul 18 02:08:29.988834 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 116/208] 10.222.0.57 () {58 vars in 1259 bytes} [Mon Jul 18 02:08:29 2022] GET /compute/v2.1/images/349d14b6-c0d4-4eff-bac1-a5b81b7fce25/metadata => generated 58 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:08:29.995754 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-eb932a0b-f679-4901-b3a7-69c109369d10 tempest-FlavorsV2NegativeTest-1458887343 tempest-FlavorsV2NegativeTest-1458887343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-38509363", "imageRef": "de475629-9072-4e47-b0fc-4891eff63184", "flavorRef": "452"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:30.007809 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=87,nova_api:SAVEPOINT=5,nova_api:RELEASE=5,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:08:30.068111 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-eb932a0b-f679-4901-b3a7-69c109369d10 tempest-FlavorsV2NegativeTest-1458887343 tempest-FlavorsV2NegativeTest-1458887343-project] validate_networks() for None {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:08:30.126445 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1d428d64-6f75-467b-a05d-e942381f5af5 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93a266d6b1f4d718af3724d8b78f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd036e434ea348338dfb0fed060b66d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:30.134828 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1d428d64-6f75-467b-a05d-e942381f5af5 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] 10.222.0.57 "GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490" status: 200 len: 1487 microversion: 2.1 time: 0.548709 Jul 18 02:08:30.135703 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 93/209] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:29 2022] GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490 => generated 1487 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:30.140504 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9f69e256-a599-445f-b369-abd5c5d2c5b3 tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] Action: 'update_all', calling method: .version_select at 0x7ff4a9437820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:30.194430 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-9f69e256-a599-445f-b369-abd5c5d2c5b3 tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] Getting quotas for project 055fdff712e14c1cac2a8599a80511f7. Resources: dict_keys(['metadata_items']) {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:08:30.199379 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-9f69e256-a599-445f-b369-abd5c5d2c5b3 tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] Getting quotas for user b2718878c4d246fab17241a331947a35 and project 055fdff712e14c1cac2a8599a80511f7. Resources: dict_keys(['metadata_items']) {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:08:30.353032 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-eb932a0b-f679-4901-b3a7-69c109369d10 tempest-FlavorsV2NegativeTest-1458887343 tempest-FlavorsV2NegativeTest-1458887343-project] HTTP exception thrown: Flavor's memory is too small for requested image. Jul 18 02:08:30.355103 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-eb932a0b-f679-4901-b3a7-69c109369d10 tempest-FlavorsV2NegativeTest-1458887343 tempest-FlavorsV2NegativeTest-1458887343-project] Request method failure captured: Jul 18 02:08:30.355103 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:08:30.355103 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:08:30.355103 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:08:30.355103 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:08:30.355103 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 141 Jul 18 02:08:30.355103 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:08:30.355103 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:08:30.355103 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:08:30.355103 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:08:30.355103 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MCcNzSAh0teuJzSrpmztMx8dtaUk1oWpFwHrzZ9U4kSqVBeTB6s-TV-cjZ65UofwpjZzAT68cDVajuQsIfN8KuPclGCa2Iff1ZMoYzm22fgEUZzp5oB-TCekMMhO8tjEuEbhGYuwS1qnIe6lt-bFzJZPHK5INvHPiottj0YCUkp_14 Jul 18 02:08:30.355103 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:08:30.355103 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:08:30.355103 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:08:30.355103 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:08:30.355103 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:08:30.355103 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:08:30.355103 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 901a2e3ac5174a538c7a54c666690699 Jul 18 02:08:30.355103 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-FlavorsV2NegativeTest-1458887343 Jul 18 02:08:30.355103 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:08:30.355103 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:08:30.356275 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_901a2e3ac5174a538c7a54c666690699"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/901a2e3ac5174a538c7a54c666690699"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/901a2e3ac5174a538c7a54c666690699"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/901a2e3ac5174a538c7a54c666690699"}]}] Jul 18 02:08:30.356275 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-FlavorsV2NegativeTest-1458887343 Jul 18 02:08:30.356275 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 901a2e3ac5174a538c7a54c666690699 Jul 18 02:08:30.356275 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1458887343 Jul 18 02:08:30.356275 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-FlavorsV2NegativeTest-1458887343-project Jul 18 02:08:30.356275 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:08:30.356275 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:08:30.356275 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 4659b69dd8e94b839d499a5eb12c8061 Jul 18 02:08:30.356275 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-FlavorsV2NegativeTest-1458887343-project Jul 18 02:08:30.356275 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 02:08:30.356275 n-d-465891-3 devstack@n-api.service[119543]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-38509363", "imageRef": "de475629-9072-4e47-b0fc-4891eff63184", "flavorRef": "452"}} Jul 18 02:08:30.356275 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:08:30.356275 n-d-465891-3 devstack@n-api.service[119543]: exception: Flavor's memory is too small for requested image. Jul 18 02:08:30.357001 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-38509363', 'imageRef': 'de475629-9072-4e47-b0fc-4891eff63184', 'flavorRef': '452'}}} Jul 18 02:08:30.357001 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:08:30.357001 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:30.357001 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 18 02:08:30.357001 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 18 02:08:30.357001 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 18 02:08:30.357001 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 18 02:08:30.357001 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 18 02:08:30.357001 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 18 02:08:30.357001 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild Jul 18 02:08:30.357001 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Jul 18 02:08:30.357001 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 669, in _validate_flavor_image Jul 18 02:08:30.357001 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Jul 18 02:08:30.357001 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 737, in _validate_flavor_image_nostatus Jul 18 02:08:30.357001 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Jul 18 02:08:30.357001 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Jul 18 02:08:30.357001 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:30.357001 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:30.357001 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:30.357001 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:30.363165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:30.363165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:30.363165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:08:30.363165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:08:30.363165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:08:30.363165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:08:30.363165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:08:30.363165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:08:30.363165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:08:30.363165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:08:30.363165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:08:30.363165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:08:30.363165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 18 02:08:30.363165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jul 18 02:08:30.363165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 18 02:08:30.363165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Jul 18 02:08:30.363165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:30.363165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:30.363165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:30.363165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:30.366865 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:30.366865 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:30.366865 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:08:30.366865 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:08:30.366865 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Jul 18 02:08:30.366865 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:30.366865 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-eb932a0b-f679-4901-b3a7-69c109369d10 tempest-FlavorsV2NegativeTest-1458887343 tempest-FlavorsV2NegativeTest-1458887343-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:08:30.366865 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-eb932a0b-f679-4901-b3a7-69c109369d10 tempest-FlavorsV2NegativeTest-1458887343 tempest-FlavorsV2NegativeTest-1458887343-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.365739 Jul 18 02:08:30.366865 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 117/210] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:08:29 2022] POST /compute/v2.1/servers => generated 93 bytes in 368 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 18 02:08:30.595673 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9f69e256-a599-445f-b369-abd5c5d2c5b3 tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] 10.222.0.57 "PUT /compute/v2.1/images/349d14b6-c0d4-4eff-bac1-a5b81b7fce25/metadata" status: 200 len: 61 microversion: 2.1 time: 0.458586 Jul 18 02:08:30.596256 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 94/211] 10.222.0.57 () {60 vars in 1279 bytes} [Mon Jul 18 02:08:30 2022] PUT /compute/v2.1/images/349d14b6-c0d4-4eff-bac1-a5b81b7fce25/metadata => generated 61 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:08:30.599818 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-acf131d3-4789-46a0-8107-6617c2fea174 tempest-QuotaClassesAdminTestJSON-2066615533 tempest-QuotaClassesAdminTestJSON-2066615533-project-admin] Calling method '.version_select at 0x7ff4a9625e50>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:30.604020 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e5062499-9965-4edb-b279-7696852805cb tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:30.605102 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:30.605102 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:30.607896 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e5062499-9965-4edb-b279-7696852805cb tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: 34961834-de57-4c1c-9ace-7bf4c43f8af8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:30.623056 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e5062499-9965-4edb-b279-7696852805cb tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:30.623913 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e5062499-9965-4edb-b279-7696852805cb tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:30.624324 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e5062499-9965-4edb-b279-7696852805cb tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:30.629282 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e5062499-9965-4edb-b279-7696852805cb tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:30.636584 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-acf131d3-4789-46a0-8107-6617c2fea174 tempest-QuotaClassesAdminTestJSON-2066615533 tempest-QuotaClassesAdminTestJSON-2066615533-project-admin] 10.222.0.57 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.278277 Jul 18 02:08:30.644595 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 118/212] 10.222.0.57 () {58 vars in 1184 bytes} [Mon Jul 18 02:08:30 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:30.651908 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ce8cf69d-605c-436f-a353-47a607bf3b7f tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:30.652781 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ce8cf69d-605c-436f-a353-47a607bf3b7f tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] [instance: e5dbcad3-c8b1-4113-862a-6010a666b490] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:30.660488 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ce8cf69d-605c-436f-a353-47a607bf3b7f tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:30.661063 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ce8cf69d-605c-436f-a353-47a607bf3b7f tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:30.662513 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ce8cf69d-605c-436f-a353-47a607bf3b7f tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:30.663296 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ce8cf69d-605c-436f-a353-47a607bf3b7f tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:31.000839 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e5062499-9965-4edb-b279-7696852805cb tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe4f42523df4204b49c9c0899c93fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0c0be2e96a499dbde6652cbc758a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:31.009039 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e5062499-9965-4edb-b279-7696852805cb tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8" status: 200 len: 1320 microversion: 2.1 time: 0.411427 Jul 18 02:08:31.010010 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 95/213] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:30 2022] GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8 => generated 1320 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:31.015557 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-aa3b513f-49df-4e3b-aba1-a99f15d74746 tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] Action: 'create', calling method: .version_select at 0x7ff4a9437e50>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:31.078558 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-aa3b513f-49df-4e3b-aba1-a99f15d74746 tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] Getting quotas for project 055fdff712e14c1cac2a8599a80511f7. Resources: dict_keys(['metadata_items']) {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:08:31.084355 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-aa3b513f-49df-4e3b-aba1-a99f15d74746 tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] Getting quotas for user b2718878c4d246fab17241a331947a35 and project 055fdff712e14c1cac2a8599a80511f7. Resources: dict_keys(['metadata_items']) {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:08:31.241678 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ce8cf69d-605c-436f-a353-47a607bf3b7f tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490" status: 200 len: 1638 microversion: 2.1 time: 0.595107 Jul 18 02:08:31.242639 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 119/214] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:30 2022] GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490 => generated 1638 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:31.255397 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cfeaa224-e5a3-493c-9d64-37e369995272 tempest-QuotaClassesAdminTestJSON-2066615533 tempest-QuotaClassesAdminTestJSON-2066615533-project-admin] Action: 'update', calling method: .version_select at 0x7ff4a9683670>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:31.257151 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:31.257151 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:31.493259 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-aa3b513f-49df-4e3b-aba1-a99f15d74746 tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] 10.222.0.57 "POST /compute/v2.1/images/349d14b6-c0d4-4eff-bac1-a5b81b7fce25/metadata" status: 200 len: 85 microversion: 2.1 time: 0.481347 Jul 18 02:08:31.495007 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 96/215] 10.222.0.57 () {60 vars in 1280 bytes} [Mon Jul 18 02:08:31 2022] POST /compute/v2.1/images/349d14b6-c0d4-4eff-bac1-a5b81b7fce25/metadata => generated 85 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:08:31.499994 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-7d0a8a32-0f64-489b-a8eb-1ed82f30d43d req-946b32e6-0803-4ad2-86ba-da856f84af6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbb215bf-6099-4dd5-b9af-d1bbfb55ef21", "tag": "111c59e5-56e7-4304-b9bb-aa87d9966837"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:31.500767 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cfeaa224-e5a3-493c-9d64-37e369995272 tempest-QuotaClassesAdminTestJSON-2066615533 tempest-QuotaClassesAdminTestJSON-2066615533-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.256424 Jul 18 02:08:31.509460 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-7d0a8a32-0f64-489b-a8eb-1ed82f30d43d req-946b32e6-0803-4ad2-86ba-da856f84af6f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:31.510156 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-7d0a8a32-0f64-489b-a8eb-1ed82f30d43d req-946b32e6-0803-4ad2-86ba-da856f84af6f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:31.510548 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 120/216] 10.222.0.57 () {60 vars in 1205 bytes} [Mon Jul 18 02:08:31 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:31.520186 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3f027aa0-0dcd-4bf8-8742-15f6d7006c13 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:31.522191 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-7d0a8a32-0f64-489b-a8eb-1ed82f30d43d req-946b32e6-0803-4ad2-86ba-da856f84af6f service nova] Creating event network-changed:111c59e5-56e7-4304-b9bb-aa87d9966837 for instance dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 on n-h2-465891-3 Jul 18 02:08:31.522339 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3f027aa0-0dcd-4bf8-8742-15f6d7006c13 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: dbb215bf-6099-4dd5-b9af-d1bbfb55ef21] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:31.527857 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-7d0a8a32-0f64-489b-a8eb-1ed82f30d43d req-946b32e6-0803-4ad2-86ba-da856f84af6f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031371 Jul 18 02:08:31.529171 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 97/217] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:31.530854 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3f027aa0-0dcd-4bf8-8742-15f6d7006c13 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:31.531465 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3f027aa0-0dcd-4bf8-8742-15f6d7006c13 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:31.532300 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3f027aa0-0dcd-4bf8-8742-15f6d7006c13 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:31.532722 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3f027aa0-0dcd-4bf8-8742-15f6d7006c13 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:31.697558 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3f027aa0-0dcd-4bf8-8742-15f6d7006c13 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60118d593f96437dbb2c68ad2fadd465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd02ce642caf4529a6e65c184de0ad19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:31.706149 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3f027aa0-0dcd-4bf8-8742-15f6d7006c13 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "GET /compute/v2.1/servers/dbb215bf-6099-4dd5-b9af-d1bbfb55ef21" status: 200 len: 1409 microversion: 2.1 time: 0.193861 Jul 18 02:08:31.706732 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 121/218] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:31 2022] GET /compute/v2.1/servers/dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 => generated 1409 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:31.713350 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d9c9cd2a-95bc-4f81-abbd-771341781eb1 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:31.714042 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d9c9cd2a-95bc-4f81-abbd-771341781eb1 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] [instance: e5dbcad3-c8b1-4113-862a-6010a666b490] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:31.720314 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d9c9cd2a-95bc-4f81-abbd-771341781eb1 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:31.721125 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d9c9cd2a-95bc-4f81-abbd-771341781eb1 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:31.722020 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d9c9cd2a-95bc-4f81-abbd-771341781eb1 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:31.722556 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d9c9cd2a-95bc-4f81-abbd-771341781eb1 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:31.751665 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d9c9cd2a-95bc-4f81-abbd-771341781eb1 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] [instance: e5dbcad3-c8b1-4113-862a-6010a666b490] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:08:31.760292 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0e96da65-ad4e-4698-badd-dbc80903e6df tempest-FlavorsExtraSpecsNegativeTestJSON-834042926 tempest-FlavorsExtraSpecsNegativeTestJSON-834042926-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1364939541", "ram": 512, "vcpus": 1, "disk": 10, "id": 1967290512, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:31.762788 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:31.762788 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:31.779404 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=93,nova_api:DELETE=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:08:31.788519 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0e96da65-ad4e-4698-badd-dbc80903e6df tempest-FlavorsExtraSpecsNegativeTestJSON-834042926 tempest-FlavorsExtraSpecsNegativeTestJSON-834042926-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.254714 Jul 18 02:08:31.788519 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 98/219] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:08:31 2022] POST /compute/v2.1/flavors => generated 416 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:31.812690 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d8831194-c308-4cd4-ae3d-74b9685189ba tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] Calling method '.version_select at 0x7ff4a96729d0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:31.870743 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d8831194-c308-4cd4-ae3d-74b9685189ba tempest-ImagesMetadataTestJSON-211006168 tempest-ImagesMetadataTestJSON-211006168-project] 10.222.0.57 "GET /compute/v2.1/images/349d14b6-c0d4-4eff-bac1-a5b81b7fce25/metadata" status: 200 len: 85 microversion: 2.1 time: 0.068971 Jul 18 02:08:31.871706 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 99/220] 10.222.0.57 () {58 vars in 1259 bytes} [Mon Jul 18 02:08:31 2022] GET /compute/v2.1/images/349d14b6-c0d4-4eff-bac1-a5b81b7fce25/metadata => generated 85 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:08:31.884068 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-349bd0af-e794-40db-b514-7df9ab3ca057 tempest-QuotaClassesAdminTestJSON-2066615533 tempest-QuotaClassesAdminTestJSON-2066615533-project-admin] Calling method '.version_select at 0x7ff4a94ec160>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:31.885025 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:31.885025 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:31.897770 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-349bd0af-e794-40db-b514-7df9ab3ca057 tempest-QuotaClassesAdminTestJSON-2066615533 tempest-QuotaClassesAdminTestJSON-2066615533-project-admin] 10.222.0.57 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.018397 Jul 18 02:08:31.898789 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 100/221] 10.222.0.57 () {58 vars in 1184 bytes} [Mon Jul 18 02:08:31 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:32.065510 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d9c9cd2a-95bc-4f81-abbd-771341781eb1 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] 10.222.0.57 "DELETE /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490" status: 204 len: 0 microversion: 2.1 time: 0.357301 Jul 18 02:08:32.066150 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 122/222] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:08:31 2022] DELETE /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:08:32.073564 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-68b4952a-d8ca-414f-ad8f-b49542aefa20 tempest-QuotaClassesAdminTestJSON-2066615533 tempest-QuotaClassesAdminTestJSON-2066615533-project-admin] Action: 'update', calling method: .version_select at 0x7ff4a95389d0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:32.075412 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:32.075412 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:32.114253 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-045a2ce4-bff6-445c-8ad1-4ab4f23bfee7 tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325 tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:32.133227 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-045a2ce4-bff6-445c-8ad1-4ab4f23bfee7 tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325 tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325-project] HTTP exception thrown: Flavor 1967290512 has no extra specs with key hw:cpu_thread_policy. Jul 18 02:08:32.138013 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-045a2ce4-bff6-445c-8ad1-4ab4f23bfee7 tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325 tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325-project] Request method failure captured: Jul 18 02:08:32.138013 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/flavors/1967290512/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 18 02:08:32.138013 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:08:32.138013 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:08:32.138013 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:08:32.138013 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:08:32.138013 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:08:32.138013 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:08:32.138013 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:08:32.138013 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:08:32.138013 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MCeYy13qn52DHukHVy_7vebom5qME6tgJ0FOZ9IQ4blXpl-idQTp2j1I0dJdjlRwE4bDujCXgc_9XApKOOuoUy7SXG4c1CT4mDuY0pQ8jm41FAjd95EpJsqIg50RSsCdnZkKNBpmHg28LaceOHHB1_sDgWKju6CO71H3RMyBwd13Cw Jul 18 02:08:32.138013 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:08:32.138013 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:08:32.138013 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:08:32.138013 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:08:32.138013 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:08:32.138013 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:08:32.138013 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 26adb4d2e0334b44b2c568d181cf3ad2 Jul 18 02:08:32.138013 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325 Jul 18 02:08:32.138013 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:08:32.138013 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:08:32.139453 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_26adb4d2e0334b44b2c568d181cf3ad2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/26adb4d2e0334b44b2c568d181cf3ad2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/26adb4d2e0334b44b2c568d181cf3ad2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/26adb4d2e0334b44b2c568d181cf3ad2"}]}] Jul 18 02:08:32.139453 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325 Jul 18 02:08:32.139453 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 26adb4d2e0334b44b2c568d181cf3ad2 Jul 18 02:08:32.139453 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325 Jul 18 02:08:32.139453 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325-project Jul 18 02:08:32.139453 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:08:32.139453 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:08:32.139453 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: db8112fc9aaf4e2091057ecd2a0b51fc Jul 18 02:08:32.139453 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325-project Jul 18 02:08:32.139453 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:08:32.139453 n-d-465891-3 devstack@n-api.service[119544]: exception: Flavor 1967290512 has no extra specs with key hw:cpu_thread_policy. Jul 18 02:08:32.140191 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'flavor_id': '1967290512', 'id': 'hw:cpu_thread_policy'} Jul 18 02:08:32.140191 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:08:32.140191 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:32.140191 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Jul 18 02:08:32.140191 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Jul 18 02:08:32.140191 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 18 02:08:32.140191 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:32.140191 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:32.140191 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:32.140191 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:32.140191 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:32.140191 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:32.140191 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:08:32.140191 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:08:32.140191 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:08:32.140191 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:08:32.140191 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Jul 18 02:08:32.140191 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 18 02:08:32.140191 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1967290512 has no extra specs with key hw:cpu_thread_policy. Jul 18 02:08:32.140191 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:32.140191 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:32.140191 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:32.141487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:32.141487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:32.141487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:32.141487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:08:32.141487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:08:32.141487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1967290512 has no extra specs with key hw:cpu_thread_policy. Jul 18 02:08:32.141487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:32.143384 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-045a2ce4-bff6-445c-8ad1-4ab4f23bfee7 tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325 tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325-project] Returning 404 to user: Flavor 1967290512 has no extra specs with key hw:cpu_thread_policy. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:08:32.149242 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-045a2ce4-bff6-445c-8ad1-4ab4f23bfee7 tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325 tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325-project] 10.222.0.57 "GET /compute/v2.1/flavors/1967290512/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.247291 Jul 18 02:08:32.157470 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 101/223] 10.222.0.57 () {58 vars in 1265 bytes} [Mon Jul 18 02:08:31 2022] GET /compute/v2.1/flavors/1967290512/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 258 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:08:32.163780 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4a3ce225-e7ba-4d2b-b4a5-f43ed35df71f tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:32.164953 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4a3ce225-e7ba-4d2b-b4a5-f43ed35df71f tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: 34961834-de57-4c1c-9ace-7bf4c43f8af8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:32.174319 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4a3ce225-e7ba-4d2b-b4a5-f43ed35df71f tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:32.175041 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4a3ce225-e7ba-4d2b-b4a5-f43ed35df71f tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:32.176011 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4a3ce225-e7ba-4d2b-b4a5-f43ed35df71f tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:32.177170 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4a3ce225-e7ba-4d2b-b4a5-f43ed35df71f tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:32.212512 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-68b4952a-d8ca-414f-ad8f-b49542aefa20 tempest-QuotaClassesAdminTestJSON-2066615533 tempest-QuotaClassesAdminTestJSON-2066615533-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.144402 Jul 18 02:08:32.213105 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 123/224] 10.222.0.57 () {60 vars in 1205 bytes} [Mon Jul 18 02:08:32 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:32.231222 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b9a6d944-f98d-4fd9-be0c-f00c88384333 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:32.232066 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b9a6d944-f98d-4fd9-be0c-f00c88384333 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] [instance: e5dbcad3-c8b1-4113-862a-6010a666b490] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:32.244992 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b9a6d944-f98d-4fd9-be0c-f00c88384333 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:32.245656 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b9a6d944-f98d-4fd9-be0c-f00c88384333 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:32.246753 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b9a6d944-f98d-4fd9-be0c-f00c88384333 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:32.247436 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b9a6d944-f98d-4fd9-be0c-f00c88384333 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:32.373197 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4a3ce225-e7ba-4d2b-b4a5-f43ed35df71f tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe4f42523df4204b49c9c0899c93fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0c0be2e96a499dbde6652cbc758a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:32.384412 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4a3ce225-e7ba-4d2b-b4a5-f43ed35df71f tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8" status: 200 len: 1320 microversion: 2.1 time: 0.224981 Jul 18 02:08:32.385112 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 102/225] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:32 2022] GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8 => generated 1320 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:32.395760 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-500bf402-0f38-4bcc-844f-e081094180a1 tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325 tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:32.398922 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:32.398922 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:32.400162 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-500bf402-0f38-4bcc-844f-e081094180a1 tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325 tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'db8112fc9aaf4e2091057ecd2a0b51fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26adb4d2e0334b44b2c568d181cf3ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:32.401985 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-500bf402-0f38-4bcc-844f-e081094180a1 tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325 tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325-project] Request method failure captured: Jul 18 02:08:32.401985 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/flavors/1967290512/os-extra_specs HTTP/1.1 Jul 18 02:08:32.401985 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:08:32.401985 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:08:32.401985 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:08:32.401985 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 66 Jul 18 02:08:32.401985 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:08:32.401985 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:08:32.401985 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:08:32.401985 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:08:32.401985 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MCeYy13qn52DHukHVy_7vebom5qME6tgJ0FOZ9IQ4blXpl-idQTp2j1I0dJdjlRwE4bDujCXgc_9XApKOOuoUy7SXG4c1CT4mDuY0pQ8jm41FAjd95EpJsqIg50RSsCdnZkKNBpmHg28LaceOHHB1_sDgWKju6CO71H3RMyBwd13Cw Jul 18 02:08:32.401985 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:08:32.401985 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:08:32.401985 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:08:32.401985 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:08:32.401985 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:08:32.401985 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:08:32.401985 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 26adb4d2e0334b44b2c568d181cf3ad2 Jul 18 02:08:32.401985 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325 Jul 18 02:08:32.401985 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:08:32.401985 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:08:32.403461 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_26adb4d2e0334b44b2c568d181cf3ad2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/26adb4d2e0334b44b2c568d181cf3ad2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/26adb4d2e0334b44b2c568d181cf3ad2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/26adb4d2e0334b44b2c568d181cf3ad2"}]}] Jul 18 02:08:32.403461 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325 Jul 18 02:08:32.403461 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 26adb4d2e0334b44b2c568d181cf3ad2 Jul 18 02:08:32.403461 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325 Jul 18 02:08:32.403461 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325-project Jul 18 02:08:32.403461 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:08:32.403461 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:08:32.403461 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: db8112fc9aaf4e2091057ecd2a0b51fc Jul 18 02:08:32.403461 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325-project Jul 18 02:08:32.403461 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:08:32.403461 n-d-465891-3 devstack@n-api.service[119544]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Jul 18 02:08:32.403461 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:08:32.404201 n-d-465891-3 devstack@n-api.service[119544]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 18 02:08:32.404201 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'flavor_id': '1967290512', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Jul 18 02:08:32.404201 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:08:32.404201 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:32.404201 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:32.404201 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:32.404201 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:08:32.404201 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:08:32.404201 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:08:32.404201 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:08:32.404201 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:08:32.404201 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:08:32.404201 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Jul 18 02:08:32.404201 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Jul 18 02:08:32.404201 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:08:32.404201 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:08:32.404201 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:08:32.404201 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:08:32.404201 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:08:32.405202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:08:32.405202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:08:32.405202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:08:32.405202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:08:32.405202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:08:32.405202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:08:32.405202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:08:32.405202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:08:32.405202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:08:32.405202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 18 02:08:32.405202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:32.405202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:32.405202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:32.405202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:32.405202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:32.405202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:32.405202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:08:32.405202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:08:32.405202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 18 02:08:32.405202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:32.408136 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-500bf402-0f38-4bcc-844f-e081094180a1 tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325 tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:08:32.408136 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-500bf402-0f38-4bcc-844f-e081094180a1 tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325 tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325-project] 10.222.0.57 "POST /compute/v2.1/flavors/1967290512/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.016357 Jul 18 02:08:32.409920 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 103/226] 10.222.0.57 () {60 vars in 1223 bytes} [Mon Jul 18 02:08:32 2022] POST /compute/v2.1/flavors/1967290512/os-extra_specs => generated 124 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:08:32.417559 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3574d6db-939f-4897-82b3-00dec788301e tempest-FlavorsExtraSpecsNegativeTestJSON-834042926 tempest-FlavorsExtraSpecsNegativeTestJSON-834042926-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:32.470091 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3574d6db-939f-4897-82b3-00dec788301e tempest-FlavorsExtraSpecsNegativeTestJSON-834042926 tempest-FlavorsExtraSpecsNegativeTestJSON-834042926-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors/1967290512/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.057903 Jul 18 02:08:32.471080 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 104/227] 10.222.0.57 () {60 vars in 1223 bytes} [Mon Jul 18 02:08:32 2022] POST /compute/v2.1/flavors/1967290512/os-extra_specs => generated 66 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:08:32.482957 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8efd306e-2b93-4d7c-9efb-c8aa800c88fa tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325 tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:32.484844 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:32.484844 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:32.486048 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8efd306e-2b93-4d7c-9efb-c8aa800c88fa tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325 tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'db8112fc9aaf4e2091057ecd2a0b51fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26adb4d2e0334b44b2c568d181cf3ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:32.488174 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8efd306e-2b93-4d7c-9efb-c8aa800c88fa tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325 tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325-project] Request method failure captured: Jul 18 02:08:32.488174 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/flavors/1967290512/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 18 02:08:32.488174 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:08:32.488174 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:08:32.488174 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:08:32.488174 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:08:32.488174 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:08:32.488174 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:08:32.488174 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:08:32.488174 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:08:32.488174 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MCeYy13qn52DHukHVy_7vebom5qME6tgJ0FOZ9IQ4blXpl-idQTp2j1I0dJdjlRwE4bDujCXgc_9XApKOOuoUy7SXG4c1CT4mDuY0pQ8jm41FAjd95EpJsqIg50RSsCdnZkKNBpmHg28LaceOHHB1_sDgWKju6CO71H3RMyBwd13Cw Jul 18 02:08:32.488174 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:08:32.488174 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:08:32.488174 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:08:32.488174 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:08:32.488174 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:08:32.488174 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:08:32.488174 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 26adb4d2e0334b44b2c568d181cf3ad2 Jul 18 02:08:32.488174 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325 Jul 18 02:08:32.488174 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:08:32.488174 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:08:32.489443 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_26adb4d2e0334b44b2c568d181cf3ad2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/26adb4d2e0334b44b2c568d181cf3ad2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/26adb4d2e0334b44b2c568d181cf3ad2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/26adb4d2e0334b44b2c568d181cf3ad2"}]}] Jul 18 02:08:32.489443 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325 Jul 18 02:08:32.489443 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 26adb4d2e0334b44b2c568d181cf3ad2 Jul 18 02:08:32.489443 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325 Jul 18 02:08:32.489443 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325-project Jul 18 02:08:32.489443 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:08:32.489443 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:08:32.489443 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: db8112fc9aaf4e2091057ecd2a0b51fc Jul 18 02:08:32.489443 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325-project Jul 18 02:08:32.489443 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:08:32.489443 n-d-465891-3 devstack@n-api.service[119544]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 18 02:08:32.490244 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'flavor_id': '1967290512', 'id': 'hw:numa_nodes'} Jul 18 02:08:32.490244 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:08:32.490244 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:32.490244 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:32.490244 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:32.490244 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:08:32.490244 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:08:32.490244 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:08:32.490244 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:08:32.490244 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Jul 18 02:08:32.490244 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Jul 18 02:08:32.490244 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:08:32.490244 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:08:32.490244 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:08:32.490244 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:08:32.490244 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:08:32.490244 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:08:32.490244 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:08:32.490244 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:08:32.490244 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:08:32.491382 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:08:32.491382 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:08:32.491382 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:08:32.491382 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:08:32.491382 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:08:32.491382 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 18 02:08:32.491382 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:32.491382 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:32.491382 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:32.491382 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:32.491382 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:32.491382 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:32.491382 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:08:32.491382 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:08:32.491382 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 18 02:08:32.491382 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:32.492307 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b9a6d944-f98d-4fd9-be0c-f00c88384333 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93a266d6b1f4d718af3724d8b78f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd036e434ea348338dfb0fed060b66d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:32.494785 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8efd306e-2b93-4d7c-9efb-c8aa800c88fa tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325 tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:08:32.496486 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8efd306e-2b93-4d7c-9efb-c8aa800c88fa tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325 tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325-project] 10.222.0.57 "DELETE /compute/v2.1/flavors/1967290512/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.017945 Jul 18 02:08:32.497339 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 105/228] 10.222.0.57 () {58 vars in 1247 bytes} [Mon Jul 18 02:08:32 2022] DELETE /compute/v2.1/flavors/1967290512/os-extra_specs/hw:numa_nodes => generated 124 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:08:32.503666 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b9a6d944-f98d-4fd9-be0c-f00c88384333 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] 10.222.0.57 "GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490" status: 200 len: 1493 microversion: 2.1 time: 0.286439 Jul 18 02:08:32.505750 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 124/229] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:32 2022] GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490 => generated 1493 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:32.509117 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6347ebe6-030a-46b4-8726-9e3f7b391d93 tempest-FlavorsExtraSpecsNegativeTestJSON-834042926 tempest-FlavorsExtraSpecsNegativeTestJSON-834042926-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:32.567879 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6347ebe6-030a-46b4-8726-9e3f7b391d93 tempest-FlavorsExtraSpecsNegativeTestJSON-834042926 tempest-FlavorsExtraSpecsNegativeTestJSON-834042926-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors/1967290512/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.063742 Jul 18 02:08:32.570971 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 106/230] 10.222.0.57 () {60 vars in 1223 bytes} [Mon Jul 18 02:08:32 2022] POST /compute/v2.1/flavors/1967290512/os-extra_specs => generated 66 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:08:32.581332 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7e984aa6-3a48-483d-9601-0f8c64661665 tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325 tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:32.583431 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:32.583431 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:32.584301 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7e984aa6-3a48-483d-9601-0f8c64661665 tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325 tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'db8112fc9aaf4e2091057ecd2a0b51fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26adb4d2e0334b44b2c568d181cf3ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:32.588397 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7e984aa6-3a48-483d-9601-0f8c64661665 tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325 tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325-project] Request method failure captured: Jul 18 02:08:32.588397 n-d-465891-3 devstack@n-api.service[119543]: request: PUT /compute/v2.1/flavors/1967290512/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 18 02:08:32.588397 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:08:32.588397 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:08:32.588397 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:08:32.588397 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 22 Jul 18 02:08:32.588397 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:08:32.588397 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:08:32.588397 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:08:32.588397 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:08:32.588397 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MCeYy13qn52DHukHVy_7vebom5qME6tgJ0FOZ9IQ4blXpl-idQTp2j1I0dJdjlRwE4bDujCXgc_9XApKOOuoUy7SXG4c1CT4mDuY0pQ8jm41FAjd95EpJsqIg50RSsCdnZkKNBpmHg28LaceOHHB1_sDgWKju6CO71H3RMyBwd13Cw Jul 18 02:08:32.588397 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:08:32.588397 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:08:32.588397 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:08:32.588397 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:08:32.588397 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:08:32.588397 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:08:32.588397 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 26adb4d2e0334b44b2c568d181cf3ad2 Jul 18 02:08:32.588397 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325 Jul 18 02:08:32.588397 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:08:32.588397 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:08:32.590141 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_26adb4d2e0334b44b2c568d181cf3ad2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/26adb4d2e0334b44b2c568d181cf3ad2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/26adb4d2e0334b44b2c568d181cf3ad2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/26adb4d2e0334b44b2c568d181cf3ad2"}]}] Jul 18 02:08:32.590141 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325 Jul 18 02:08:32.590141 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 26adb4d2e0334b44b2c568d181cf3ad2 Jul 18 02:08:32.590141 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325 Jul 18 02:08:32.590141 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325-project Jul 18 02:08:32.590141 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:08:32.590141 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:08:32.590141 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: db8112fc9aaf4e2091057ecd2a0b51fc Jul 18 02:08:32.590141 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325-project Jul 18 02:08:32.590141 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 02:08:32.590141 n-d-465891-3 devstack@n-api.service[119543]: {"hw:numa_nodes": "1"} Jul 18 02:08:32.590141 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:08:32.590141 n-d-465891-3 devstack@n-api.service[119543]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 18 02:08:32.596108 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'flavor_id': '1967290512', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Jul 18 02:08:32.596108 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:08:32.596108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:32.596108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:32.596108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:32.596108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:08:32.596108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:08:32.596108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:08:32.596108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:08:32.596108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:08:32.596108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:08:32.596108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Jul 18 02:08:32.596108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Jul 18 02:08:32.596108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:08:32.596108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:08:32.596108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:08:32.596108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:08:32.596108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:08:32.596108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:08:32.599131 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:08:32.599131 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:08:32.599131 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:08:32.599131 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:08:32.599131 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:08:32.599131 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:08:32.599131 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:08:32.599131 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:08:32.599131 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 18 02:08:32.599131 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:32.599131 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:32.599131 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:32.599131 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:32.599131 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:32.599131 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:32.599131 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:08:32.599131 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:08:32.599131 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 18 02:08:32.599131 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:32.600555 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7e984aa6-3a48-483d-9601-0f8c64661665 tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325 tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:08:32.600555 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7e984aa6-3a48-483d-9601-0f8c64661665 tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325 tempest-FlavorsExtraSpecsNegativeTestJSON-1643301325-project] 10.222.0.57 "PUT /compute/v2.1/flavors/1967290512/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.012312 Jul 18 02:08:32.600555 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 125/231] 10.222.0.57 () {60 vars in 1264 bytes} [Mon Jul 18 02:08:32 2022] PUT /compute/v2.1/flavors/1967290512/os-extra_specs/hw:numa_nodes => generated 124 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:08:32.601409 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4e80e4e1-08d3-448d-bed2-19c1672f3be4 tempest-FlavorsExtraSpecsNegativeTestJSON-834042926 tempest-FlavorsExtraSpecsNegativeTestJSON-834042926-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:32.609023 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-4e80e4e1-08d3-448d-bed2-19c1672f3be4 tempest-FlavorsExtraSpecsNegativeTestJSON-834042926 tempest-FlavorsExtraSpecsNegativeTestJSON-834042926-project-admin] HTTP exception thrown: Flavor 1967290512 has no extra specs with key hw:cpu_thread_policy. Jul 18 02:08:32.610452 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4e80e4e1-08d3-448d-bed2-19c1672f3be4 tempest-FlavorsExtraSpecsNegativeTestJSON-834042926 tempest-FlavorsExtraSpecsNegativeTestJSON-834042926-project-admin] Request method failure captured: Jul 18 02:08:32.610452 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/flavors/1967290512/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 18 02:08:32.610452 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:08:32.610452 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:08:32.610452 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:08:32.610452 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:08:32.610452 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:08:32.610452 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:08:32.610452 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:08:32.610452 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:08:32.610452 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MCezuZmxxBsGKibkS7ua5OZJRumBFotP2rOrd7vi37FTd-kebDup-U3iqL7skiPnk1PJiQRxcUFzbCq1-uu849SjBCEPjFrywLmNddc4MXHsdcZKwVbZ1vsoDvUg9tGhT16ZZqXYUul29qD_BprBO6eymIXEAPHyckhaCwcLFEFmNo Jul 18 02:08:32.610452 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:08:32.610452 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:08:32.610452 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:08:32.610452 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:08:32.610452 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:08:32.610452 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:08:32.610452 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: c6525ef5a84d4dd58f3829f8c6cf29d2 Jul 18 02:08:32.610452 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-834042926 Jul 18 02:08:32.610452 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,admin,reader Jul 18 02:08:32.610452 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,admin,reader Jul 18 02:08:32.611908 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c6525ef5a84d4dd58f3829f8c6cf29d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c6525ef5a84d4dd58f3829f8c6cf29d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c6525ef5a84d4dd58f3829f8c6cf29d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c6525ef5a84d4dd58f3829f8c6cf29d2"}]}] Jul 18 02:08:32.611908 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-834042926 Jul 18 02:08:32.611908 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: c6525ef5a84d4dd58f3829f8c6cf29d2 Jul 18 02:08:32.611908 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-834042926 Jul 18 02:08:32.611908 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-834042926-project-admin Jul 18 02:08:32.611908 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:08:32.611908 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:08:32.611908 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 85aa154f47fa4c198a6c21c6355fb7eb Jul 18 02:08:32.611908 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-834042926-project-admin Jul 18 02:08:32.611908 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:08:32.611908 n-d-465891-3 devstack@n-api.service[119544]: exception: Flavor 1967290512 has no extra specs with key hw:cpu_thread_policy. Jul 18 02:08:32.612663 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'flavor_id': '1967290512', 'id': 'hw:cpu_thread_policy'} Jul 18 02:08:32.612663 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:08:32.612663 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:32.612663 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Jul 18 02:08:32.612663 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Jul 18 02:08:32.612663 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 18 02:08:32.612663 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:32.612663 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:32.612663 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:32.612663 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:32.612663 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:32.612663 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:32.612663 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:08:32.612663 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:08:32.612663 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:08:32.612663 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:08:32.612663 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Jul 18 02:08:32.612663 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 18 02:08:32.612663 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1967290512 has no extra specs with key hw:cpu_thread_policy. Jul 18 02:08:32.612663 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:32.612663 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:32.612663 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:32.614759 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:32.614759 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:32.614759 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:32.614759 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:08:32.614759 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:08:32.614759 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1967290512 has no extra specs with key hw:cpu_thread_policy. Jul 18 02:08:32.614759 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:32.616526 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4e80e4e1-08d3-448d-bed2-19c1672f3be4 tempest-FlavorsExtraSpecsNegativeTestJSON-834042926 tempest-FlavorsExtraSpecsNegativeTestJSON-834042926-project-admin] Returning 404 to user: Flavor 1967290512 has no extra specs with key hw:cpu_thread_policy. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:08:32.617582 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4e80e4e1-08d3-448d-bed2-19c1672f3be4 tempest-FlavorsExtraSpecsNegativeTestJSON-834042926 tempest-FlavorsExtraSpecsNegativeTestJSON-834042926-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/1967290512/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.021900 Jul 18 02:08:32.618359 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 107/232] 10.222.0.57 () {58 vars in 1268 bytes} [Mon Jul 18 02:08:32 2022] DELETE /compute/v2.1/flavors/1967290512/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:08:32.627951 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f8e4ecc6-3ab3-490c-91a7-af96984febf8 tempest-FlavorsExtraSpecsNegativeTestJSON-834042926 tempest-FlavorsExtraSpecsNegativeTestJSON-834042926-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:32.630582 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-f8e4ecc6-3ab3-490c-91a7-af96984febf8 tempest-FlavorsExtraSpecsNegativeTestJSON-834042926 tempest-FlavorsExtraSpecsNegativeTestJSON-834042926-project-admin] HTTP exception thrown: Request body and URI mismatch Jul 18 02:08:32.632825 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f8e4ecc6-3ab3-490c-91a7-af96984febf8 tempest-FlavorsExtraSpecsNegativeTestJSON-834042926 tempest-FlavorsExtraSpecsNegativeTestJSON-834042926-project-admin] Request method failure captured: Jul 18 02:08:32.632825 n-d-465891-3 devstack@n-api.service[119543]: request: PUT /compute/v2.1/flavors/1967290512/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 18 02:08:32.632825 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:08:32.632825 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:08:32.632825 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:08:32.632825 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 27 Jul 18 02:08:32.632825 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:08:32.632825 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:08:32.632825 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:08:32.632825 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:08:32.632825 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MCezuZmxxBsGKibkS7ua5OZJRumBFotP2rOrd7vi37FTd-kebDup-U3iqL7skiPnk1PJiQRxcUFzbCq1-uu849SjBCEPjFrywLmNddc4MXHsdcZKwVbZ1vsoDvUg9tGhT16ZZqXYUul29qD_BprBO6eymIXEAPHyckhaCwcLFEFmNo Jul 18 02:08:32.632825 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:08:32.632825 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:08:32.632825 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:08:32.632825 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:08:32.632825 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:08:32.632825 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:08:32.632825 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: c6525ef5a84d4dd58f3829f8c6cf29d2 Jul 18 02:08:32.632825 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-834042926 Jul 18 02:08:32.632825 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,admin,reader Jul 18 02:08:32.632825 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,admin,reader Jul 18 02:08:32.634300 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c6525ef5a84d4dd58f3829f8c6cf29d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c6525ef5a84d4dd58f3829f8c6cf29d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c6525ef5a84d4dd58f3829f8c6cf29d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c6525ef5a84d4dd58f3829f8c6cf29d2"}]}] Jul 18 02:08:32.634300 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-834042926 Jul 18 02:08:32.634300 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: c6525ef5a84d4dd58f3829f8c6cf29d2 Jul 18 02:08:32.634300 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-834042926 Jul 18 02:08:32.634300 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-834042926-project-admin Jul 18 02:08:32.634300 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:08:32.634300 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:08:32.634300 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 85aa154f47fa4c198a6c21c6355fb7eb Jul 18 02:08:32.634300 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-834042926-project-admin Jul 18 02:08:32.634300 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 02:08:32.634300 n-d-465891-3 devstack@n-api.service[119543]: {"hw:cpu_policy": "shared"} Jul 18 02:08:32.634300 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:08:32.634300 n-d-465891-3 devstack@n-api.service[119543]: exception: Request body and URI mismatch Jul 18 02:08:32.635175 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'flavor_id': '1967290512', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Jul 18 02:08:32.635175 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:08:32.635175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:32.635175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:32.635175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:32.635175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:08:32.635175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:08:32.635175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:08:32.635175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:08:32.635175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:08:32.635175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:08:32.635175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Jul 18 02:08:32.635175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Jul 18 02:08:32.635175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Jul 18 02:08:32.635175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:32.635175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:32.635175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:32.635175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:32.635175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:32.635175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:32.636494 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:08:32.636494 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:08:32.636494 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Jul 18 02:08:32.636494 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:32.636494 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f8e4ecc6-3ab3-490c-91a7-af96984febf8 tempest-FlavorsExtraSpecsNegativeTestJSON-834042926 tempest-FlavorsExtraSpecsNegativeTestJSON-834042926-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:08:32.636494 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f8e4ecc6-3ab3-490c-91a7-af96984febf8 tempest-FlavorsExtraSpecsNegativeTestJSON-834042926 tempest-FlavorsExtraSpecsNegativeTestJSON-834042926-project-admin] 10.222.0.57 "PUT /compute/v2.1/flavors/1967290512/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.011791 Jul 18 02:08:32.637782 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 126/233] 10.222.0.57 () {60 vars in 1264 bytes} [Mon Jul 18 02:08:32 2022] PUT /compute/v2.1/flavors/1967290512/os-extra_specs/hw:numa_nodes => generated 73 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jul 18 02:08:32.648232 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1b2e34c2-d6e1-44b0-a864-57e3b60fa3f9 tempest-FlavorsExtraSpecsNegativeTestJSON-834042926 tempest-FlavorsExtraSpecsNegativeTestJSON-834042926-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:32.652965 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1b2e34c2-d6e1-44b0-a864-57e3b60fa3f9 tempest-FlavorsExtraSpecsNegativeTestJSON-834042926 tempest-FlavorsExtraSpecsNegativeTestJSON-834042926-project-admin] Request method failure captured: Jul 18 02:08:32.652965 n-d-465891-3 devstack@n-api.service[119544]: request: PUT /compute/v2.1/flavors/1967290512/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 18 02:08:32.652965 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:08:32.652965 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:08:32.652965 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:08:32.652965 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 49 Jul 18 02:08:32.652965 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:08:32.652965 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:08:32.652965 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:08:32.652965 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:08:32.652965 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MCezuZmxxBsGKibkS7ua5OZJRumBFotP2rOrd7vi37FTd-kebDup-U3iqL7skiPnk1PJiQRxcUFzbCq1-uu849SjBCEPjFrywLmNddc4MXHsdcZKwVbZ1vsoDvUg9tGhT16ZZqXYUul29qD_BprBO6eymIXEAPHyckhaCwcLFEFmNo Jul 18 02:08:32.652965 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:08:32.652965 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:08:32.652965 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:08:32.652965 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:08:32.652965 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:08:32.652965 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:08:32.652965 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: c6525ef5a84d4dd58f3829f8c6cf29d2 Jul 18 02:08:32.652965 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-834042926 Jul 18 02:08:32.652965 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,admin,reader Jul 18 02:08:32.652965 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,admin,reader Jul 18 02:08:32.654254 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c6525ef5a84d4dd58f3829f8c6cf29d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c6525ef5a84d4dd58f3829f8c6cf29d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c6525ef5a84d4dd58f3829f8c6cf29d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c6525ef5a84d4dd58f3829f8c6cf29d2"}]}] Jul 18 02:08:32.654254 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-834042926 Jul 18 02:08:32.654254 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: c6525ef5a84d4dd58f3829f8c6cf29d2 Jul 18 02:08:32.654254 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-834042926 Jul 18 02:08:32.654254 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-834042926-project-admin Jul 18 02:08:32.654254 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:08:32.654254 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:08:32.654254 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 85aa154f47fa4c198a6c21c6355fb7eb Jul 18 02:08:32.654254 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-834042926-project-admin Jul 18 02:08:32.654254 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:08:32.654254 n-d-465891-3 devstack@n-api.service[119544]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Jul 18 02:08:32.654254 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:08:32.654992 n-d-465891-3 devstack@n-api.service[119544]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 18 02:08:32.654992 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'flavor_id': '1967290512', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Jul 18 02:08:32.654992 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:08:32.654992 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:32.654992 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:08:32.654992 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:08:32.654992 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:08:32.654992 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:08:32.654992 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 18 02:08:32.654992 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:32.654992 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Jul 18 02:08:32.654992 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 18 02:08:32.654992 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Jul 18 02:08:32.654992 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Jul 18 02:08:32.654992 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 18 02:08:32.654992 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'type': ['string', Jul 18 02:08:32.654992 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'number']}}, Jul 18 02:08:32.654992 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 18 02:08:32.654992 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:32.654992 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi On instance: Jul 18 02:08:32.654992 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Jul 18 02:08:32.654992 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:32.657041 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:32.657041 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:32.657041 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:32.657041 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:32.657041 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:32.657041 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:08:32.657041 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:08:32.657041 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:08:32.657041 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:08:32.657041 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:08:32.657041 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:08:32.657041 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:08:32.657041 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:08:32.657041 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:08:32.657041 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:08:32.657041 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 18 02:08:32.657041 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:32.657041 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:32.657041 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:32.657041 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:32.659362 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:32.659362 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:32.659362 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:08:32.659362 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:08:32.659362 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 18 02:08:32.659362 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:32.659362 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1b2e34c2-d6e1-44b0-a864-57e3b60fa3f9 tempest-FlavorsExtraSpecsNegativeTestJSON-834042926 tempest-FlavorsExtraSpecsNegativeTestJSON-834042926-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:08:32.659362 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1b2e34c2-d6e1-44b0-a864-57e3b60fa3f9 tempest-FlavorsExtraSpecsNegativeTestJSON-834042926 tempest-FlavorsExtraSpecsNegativeTestJSON-834042926-project-admin] 10.222.0.57 "PUT /compute/v2.1/flavors/1967290512/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.011605 Jul 18 02:08:32.659362 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 108/234] 10.222.0.57 () {60 vars in 1264 bytes} [Mon Jul 18 02:08:32 2022] PUT /compute/v2.1/flavors/1967290512/os-extra_specs/hw:numa_nodes => generated 117 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 18 02:08:32.667857 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d9ad7826-66b0-4378-bafb-8624aea4799d tempest-FlavorsExtraSpecsNegativeTestJSON-834042926 tempest-FlavorsExtraSpecsNegativeTestJSON-834042926-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:32.668953 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:32.668953 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:32.694686 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d9ad7826-66b0-4378-bafb-8624aea4799d tempest-FlavorsExtraSpecsNegativeTestJSON-834042926 tempest-FlavorsExtraSpecsNegativeTestJSON-834042926-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/1967290512" status: 202 len: 0 microversion: 2.1 time: 0.032096 Jul 18 02:08:32.695436 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 127/235] 10.222.0.57 () {58 vars in 1160 bytes} [Mon Jul 18 02:08:32 2022] DELETE /compute/v2.1/flavors/1967290512 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:08:32.705103 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-69b72adc-e94a-4f68-9dff-ecdf571e1d03 tempest-FlavorsExtraSpecsNegativeTestJSON-834042926 tempest-FlavorsExtraSpecsNegativeTestJSON-834042926-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:32.724900 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-24362cba-4f04-410d-b9bc-4bf066c142c0 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:32.725667 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-24362cba-4f04-410d-b9bc-4bf066c142c0 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: dbb215bf-6099-4dd5-b9af-d1bbfb55ef21] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:32.730734 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-69b72adc-e94a-4f68-9dff-ecdf571e1d03 tempest-FlavorsExtraSpecsNegativeTestJSON-834042926 tempest-FlavorsExtraSpecsNegativeTestJSON-834042926-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.030280 Jul 18 02:08:32.731409 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 109/236] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:08:32 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:32.733892 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-24362cba-4f04-410d-b9bc-4bf066c142c0 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:32.734379 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-24362cba-4f04-410d-b9bc-4bf066c142c0 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:32.735427 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-24362cba-4f04-410d-b9bc-4bf066c142c0 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:32.736663 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-24362cba-4f04-410d-b9bc-4bf066c142c0 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:32.987128 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-24362cba-4f04-410d-b9bc-4bf066c142c0 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60118d593f96437dbb2c68ad2fadd465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd02ce642caf4529a6e65c184de0ad19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:33.006269 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-24362cba-4f04-410d-b9bc-4bf066c142c0 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "GET /compute/v2.1/servers/dbb215bf-6099-4dd5-b9af-d1bbfb55ef21" status: 200 len: 1409 microversion: 2.1 time: 0.284140 Jul 18 02:08:33.017223 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 128/237] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:32 2022] GET /compute/v2.1/servers/dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 => generated 1409 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:08:33.404699 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bb63f06f-1bd7-4cc4-9a0e-cc9df0927115 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:33.405869 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bb63f06f-1bd7-4cc4-9a0e-cc9df0927115 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: 34961834-de57-4c1c-9ace-7bf4c43f8af8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:33.410198 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=8 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:08:33.420449 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb63f06f-1bd7-4cc4-9a0e-cc9df0927115 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:33.421880 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb63f06f-1bd7-4cc4-9a0e-cc9df0927115 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:33.426221 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb63f06f-1bd7-4cc4-9a0e-cc9df0927115 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:33.427117 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb63f06f-1bd7-4cc4-9a0e-cc9df0927115 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:33.525802 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1fada068-819c-43c3-bbeb-460a83171ccf tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:33.526625 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1fada068-819c-43c3-bbeb-460a83171ccf tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] [instance: e5dbcad3-c8b1-4113-862a-6010a666b490] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:33.532192 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=25,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:08:33.573284 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1fada068-819c-43c3-bbeb-460a83171ccf tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:33.575137 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1fada068-819c-43c3-bbeb-460a83171ccf tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:33.578601 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1fada068-819c-43c3-bbeb-460a83171ccf tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:33.579055 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1fada068-819c-43c3-bbeb-460a83171ccf tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:33.914664 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bb63f06f-1bd7-4cc4-9a0e-cc9df0927115 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe4f42523df4204b49c9c0899c93fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0c0be2e96a499dbde6652cbc758a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:33.924974 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bb63f06f-1bd7-4cc4-9a0e-cc9df0927115 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8" status: 200 len: 1320 microversion: 2.1 time: 0.526176 Jul 18 02:08:33.928782 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 110/238] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:33 2022] GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8 => generated 1320 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:34.024493 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7012f2f3-8339-4553-b987-c8238678fb69 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:34.025119 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7012f2f3-8339-4553-b987-c8238678fb69 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: dbb215bf-6099-4dd5-b9af-d1bbfb55ef21] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:34.031241 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7012f2f3-8339-4553-b987-c8238678fb69 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:34.032007 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7012f2f3-8339-4553-b987-c8238678fb69 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:34.033299 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7012f2f3-8339-4553-b987-c8238678fb69 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:34.034099 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7012f2f3-8339-4553-b987-c8238678fb69 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:34.042611 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1fada068-819c-43c3-bbeb-460a83171ccf tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93a266d6b1f4d718af3724d8b78f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd036e434ea348338dfb0fed060b66d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:34.054718 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1fada068-819c-43c3-bbeb-460a83171ccf tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] 10.222.0.57 "GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490" status: 200 len: 1493 microversion: 2.1 time: 0.533170 Jul 18 02:08:34.055821 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 129/239] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:33 2022] GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490 => generated 1493 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:08:34.680763 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7012f2f3-8339-4553-b987-c8238678fb69 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60118d593f96437dbb2c68ad2fadd465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd02ce642caf4529a6e65c184de0ad19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:34.706266 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7012f2f3-8339-4553-b987-c8238678fb69 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "GET /compute/v2.1/servers/dbb215bf-6099-4dd5-b9af-d1bbfb55ef21" status: 200 len: 1409 microversion: 2.1 time: 0.686078 Jul 18 02:08:34.707350 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 111/240] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:34 2022] GET /compute/v2.1/servers/dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 => generated 1409 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:08:34.959148 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8f1ea60d-e63b-45e2-ab69-147138498a87 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:34.959784 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8f1ea60d-e63b-45e2-ab69-147138498a87 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: 34961834-de57-4c1c-9ace-7bf4c43f8af8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:34.993297 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8f1ea60d-e63b-45e2-ab69-147138498a87 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:34.994862 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8f1ea60d-e63b-45e2-ab69-147138498a87 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:34.997192 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8f1ea60d-e63b-45e2-ab69-147138498a87 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:34.997994 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8f1ea60d-e63b-45e2-ab69-147138498a87 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:35.075020 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-947dacd5-375f-44e7-8ce9-35f23cf0d152 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:35.076385 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-947dacd5-375f-44e7-8ce9-35f23cf0d152 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] [instance: e5dbcad3-c8b1-4113-862a-6010a666b490] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:35.087316 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-947dacd5-375f-44e7-8ce9-35f23cf0d152 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:35.088492 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-947dacd5-375f-44e7-8ce9-35f23cf0d152 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:35.089789 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-947dacd5-375f-44e7-8ce9-35f23cf0d152 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:35.090509 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-947dacd5-375f-44e7-8ce9-35f23cf0d152 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:35.646142 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8f1ea60d-e63b-45e2-ab69-147138498a87 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe4f42523df4204b49c9c0899c93fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0c0be2e96a499dbde6652cbc758a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:35.655540 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-947dacd5-375f-44e7-8ce9-35f23cf0d152 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93a266d6b1f4d718af3724d8b78f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd036e434ea348338dfb0fed060b66d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:35.658669 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8f1ea60d-e63b-45e2-ab69-147138498a87 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8" status: 200 len: 1320 microversion: 2.1 time: 0.707537 Jul 18 02:08:35.659280 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 130/241] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:34 2022] GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8 => generated 1320 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:35.668232 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-947dacd5-375f-44e7-8ce9-35f23cf0d152 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] 10.222.0.57 "GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490" status: 200 len: 1493 microversion: 2.1 time: 0.599452 Jul 18 02:08:35.672379 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 112/242] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:35 2022] GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490 => generated 1493 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:35.727602 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a797384c-96a6-4202-a5a2-154bca3b078c tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:35.728712 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a797384c-96a6-4202-a5a2-154bca3b078c tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: dbb215bf-6099-4dd5-b9af-d1bbfb55ef21] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:35.743881 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a797384c-96a6-4202-a5a2-154bca3b078c tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:35.744454 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a797384c-96a6-4202-a5a2-154bca3b078c tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:35.745367 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a797384c-96a6-4202-a5a2-154bca3b078c tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:35.751578 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a797384c-96a6-4202-a5a2-154bca3b078c tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:35.953426 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-81caa3ba-3a35-4b3f-929c-71101b128b20 req-9bf2b734-1402-4415-9191-6150c65ec588 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbb215bf-6099-4dd5-b9af-d1bbfb55ef21", "name": "network-vif-plugged", "status": "completed", "tag": "111c59e5-56e7-4304-b9bb-aa87d9966837"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:35.972472 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-81caa3ba-3a35-4b3f-929c-71101b128b20 req-9bf2b734-1402-4415-9191-6150c65ec588 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:35.973464 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-81caa3ba-3a35-4b3f-929c-71101b128b20 req-9bf2b734-1402-4415-9191-6150c65ec588 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:35.998696 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-81caa3ba-3a35-4b3f-929c-71101b128b20 req-9bf2b734-1402-4415-9191-6150c65ec588 service nova] Creating event network-vif-plugged:111c59e5-56e7-4304-b9bb-aa87d9966837 for instance dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 on n-h2-465891-3 Jul 18 02:08:36.005615 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-81caa3ba-3a35-4b3f-929c-71101b128b20 req-9bf2b734-1402-4415-9191-6150c65ec588 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055276 Jul 18 02:08:36.006870 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 113/243] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:08:36.296588 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a797384c-96a6-4202-a5a2-154bca3b078c tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60118d593f96437dbb2c68ad2fadd465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd02ce642caf4529a6e65c184de0ad19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:36.313013 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a797384c-96a6-4202-a5a2-154bca3b078c tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "GET /compute/v2.1/servers/dbb215bf-6099-4dd5-b9af-d1bbfb55ef21" status: 200 len: 1409 microversion: 2.1 time: 0.587982 Jul 18 02:08:36.316092 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 131/244] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:35 2022] GET /compute/v2.1/servers/dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 => generated 1409 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:36.678199 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e766c8ef-82b3-4c49-9cce-a5c66e39dcf5 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:36.680547 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e766c8ef-82b3-4c49-9cce-a5c66e39dcf5 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: 34961834-de57-4c1c-9ace-7bf4c43f8af8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:36.692852 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e766c8ef-82b3-4c49-9cce-a5c66e39dcf5 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:36.693479 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e766c8ef-82b3-4c49-9cce-a5c66e39dcf5 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:36.694490 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e766c8ef-82b3-4c49-9cce-a5c66e39dcf5 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:36.695089 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e766c8ef-82b3-4c49-9cce-a5c66e39dcf5 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:36.766622 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=10 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:08:36.838827 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-9026173e-f45d-40a5-9539-aab11551491d req-9c3d98f1-17e3-4dab-bed0-cbfc754e0583 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5dbcad3-c8b1-4113-862a-6010a666b490", "name": "network-vif-deleted", "tag": "4c701d52-ddf0-4101-83fe-267799e665cf"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:36.858322 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-9026173e-f45d-40a5-9539-aab11551491d req-9c3d98f1-17e3-4dab-bed0-cbfc754e0583 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:36.859546 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-9026173e-f45d-40a5-9539-aab11551491d req-9c3d98f1-17e3-4dab-bed0-cbfc754e0583 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:36.891251 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-9026173e-f45d-40a5-9539-aab11551491d req-9c3d98f1-17e3-4dab-bed0-cbfc754e0583 service nova] Creating event network-vif-deleted:4c701d52-ddf0-4101-83fe-267799e665cf for instance e5dbcad3-c8b1-4113-862a-6010a666b490 on n-h2-465891-3 Jul 18 02:08:36.900012 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-9026173e-f45d-40a5-9539-aab11551491d req-9c3d98f1-17e3-4dab-bed0-cbfc754e0583 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.266408 Jul 18 02:08:36.900777 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 114/245] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:36.912003 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8b9d337e-556e-4387-91de-3e9537fdb3d4 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:36.914588 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8b9d337e-556e-4387-91de-3e9537fdb3d4 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] [instance: e5dbcad3-c8b1-4113-862a-6010a666b490] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:36.928710 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8b9d337e-556e-4387-91de-3e9537fdb3d4 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:36.935151 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8b9d337e-556e-4387-91de-3e9537fdb3d4 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:36.936284 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8b9d337e-556e-4387-91de-3e9537fdb3d4 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:36.936864 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8b9d337e-556e-4387-91de-3e9537fdb3d4 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:37.007121 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8b9d337e-556e-4387-91de-3e9537fdb3d4 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:37.007813 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8b9d337e-556e-4387-91de-3e9537fdb3d4 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:37.008462 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-8b9d337e-556e-4387-91de-3e9537fdb3d4 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lazy-loading 'fault' on Instance uuid e5dbcad3-c8b1-4113-862a-6010a666b490 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:08:37.129442 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e766c8ef-82b3-4c49-9cce-a5c66e39dcf5 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe4f42523df4204b49c9c0899c93fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0c0be2e96a499dbde6652cbc758a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:37.140231 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e766c8ef-82b3-4c49-9cce-a5c66e39dcf5 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8" status: 200 len: 1320 microversion: 2.1 time: 0.467631 Jul 18 02:08:37.140813 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 132/246] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:36 2022] GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8 => generated 1320 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:37.172335 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8b9d337e-556e-4387-91de-3e9537fdb3d4 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93a266d6b1f4d718af3724d8b78f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd036e434ea348338dfb0fed060b66d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:37.182658 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8b9d337e-556e-4387-91de-3e9537fdb3d4 tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] 10.222.0.57 "GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490" status: 200 len: 1328 microversion: 2.1 time: 0.280525 Jul 18 02:08:37.187557 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 115/247] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:36 2022] GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490 => generated 1328 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:37.336621 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-25a80ff6-432a-4b73-9c70-63100f6bf730 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:37.338063 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-25a80ff6-432a-4b73-9c70-63100f6bf730 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: dbb215bf-6099-4dd5-b9af-d1bbfb55ef21] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:37.375004 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-25a80ff6-432a-4b73-9c70-63100f6bf730 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:37.378373 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-25a80ff6-432a-4b73-9c70-63100f6bf730 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:37.381572 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-25a80ff6-432a-4b73-9c70-63100f6bf730 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:37.383204 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-25a80ff6-432a-4b73-9c70-63100f6bf730 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:37.442683 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:08:37.896752 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-25a80ff6-432a-4b73-9c70-63100f6bf730 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60118d593f96437dbb2c68ad2fadd465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd02ce642caf4529a6e65c184de0ad19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:37.908949 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-25a80ff6-432a-4b73-9c70-63100f6bf730 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "GET /compute/v2.1/servers/dbb215bf-6099-4dd5-b9af-d1bbfb55ef21" status: 200 len: 1409 microversion: 2.1 time: 0.581308 Jul 18 02:08:37.911042 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 133/248] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:37 2022] GET /compute/v2.1/servers/dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 => generated 1409 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:38.126466 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-e4f6df5d-592d-4304-8307-81dcfa44af93 req-c73834bb-a079-44cc-a2e3-5e103c1e6c7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34961834-de57-4c1c-9ace-7bf4c43f8af8", "name": "network-vif-plugged", "status": "completed", "tag": "e2c5d317-4ca7-4174-8082-778a84325c43"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:38.139420 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-e4f6df5d-592d-4304-8307-81dcfa44af93 req-c73834bb-a079-44cc-a2e3-5e103c1e6c7c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:38.149760 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-e4f6df5d-592d-4304-8307-81dcfa44af93 req-c73834bb-a079-44cc-a2e3-5e103c1e6c7c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:38.156613 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d311fe0b-52b9-4fb0-91b2-75c93d8bfb7b tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:38.157425 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d311fe0b-52b9-4fb0-91b2-75c93d8bfb7b tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: 34961834-de57-4c1c-9ace-7bf4c43f8af8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:38.165742 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d311fe0b-52b9-4fb0-91b2-75c93d8bfb7b tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:38.168459 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d311fe0b-52b9-4fb0-91b2-75c93d8bfb7b tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:38.173466 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d311fe0b-52b9-4fb0-91b2-75c93d8bfb7b tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:38.173992 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d311fe0b-52b9-4fb0-91b2-75c93d8bfb7b tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:38.184668 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-e4f6df5d-592d-4304-8307-81dcfa44af93 req-c73834bb-a079-44cc-a2e3-5e103c1e6c7c service nova] Creating event network-vif-plugged:e2c5d317-4ca7-4174-8082-778a84325c43 for instance 34961834-de57-4c1c-9ace-7bf4c43f8af8 on n-h1-465891-3 Jul 18 02:08:38.213857 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-e4f6df5d-592d-4304-8307-81dcfa44af93 req-c73834bb-a079-44cc-a2e3-5e103c1e6c7c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090744 Jul 18 02:08:38.218655 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 116/249] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:38.234574 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e4c22b29-0bdb-4cb7-aed7-faeff00aff3d tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:38.235297 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e4c22b29-0bdb-4cb7-aed7-faeff00aff3d tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] [instance: e5dbcad3-c8b1-4113-862a-6010a666b490] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:38.275751 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e4c22b29-0bdb-4cb7-aed7-faeff00aff3d tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:38.277571 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e4c22b29-0bdb-4cb7-aed7-faeff00aff3d tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:38.278901 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e4c22b29-0bdb-4cb7-aed7-faeff00aff3d tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:38.280073 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e4c22b29-0bdb-4cb7-aed7-faeff00aff3d tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:38.335505 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-e4c22b29-0bdb-4cb7-aed7-faeff00aff3d tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] HTTP exception thrown: Instance e5dbcad3-c8b1-4113-862a-6010a666b490 could not be found. Jul 18 02:08:38.342115 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e4c22b29-0bdb-4cb7-aed7-faeff00aff3d tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Request method failure captured: Jul 18 02:08:38.342115 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490 HTTP/1.1 Jul 18 02:08:38.342115 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:08:38.342115 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:08:38.342115 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:08:38.342115 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:08:38.342115 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:08:38.342115 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:08:38.342115 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:08:38.342115 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:08:38.342115 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MBzKUZ2yAchvKjG79tkBVmhNl99unW7exa88w7W1GiDVrDIc9bntu1HL3HG-0cS7XDUAaCsV1JSpJ3fJDbdeGWsNgwzlSd-6CnzQCcGNKTMiqL_ZQZngefsOq8bRReOxdHmpafPWTSdTfVKBd0JV26hzlEEgqao-XocRYYU7nPen4E Jul 18 02:08:38.342115 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:08:38.342115 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:08:38.342115 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:08:38.342115 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:08:38.342115 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:08:38.342115 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:08:38.342115 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: cd036e434ea348338dfb0fed060b66d7 Jul 18 02:08:38.342115 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-AggregatesAdminTestJSON-857543 Jul 18 02:08:38.342115 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:08:38.342115 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:08:38.343404 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_cd036e434ea348338dfb0fed060b66d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/cd036e434ea348338dfb0fed060b66d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/cd036e434ea348338dfb0fed060b66d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/cd036e434ea348338dfb0fed060b66d7"}]}] Jul 18 02:08:38.343404 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-AggregatesAdminTestJSON-857543 Jul 18 02:08:38.343404 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: cd036e434ea348338dfb0fed060b66d7 Jul 18 02:08:38.343404 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-857543 Jul 18 02:08:38.343404 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-AggregatesAdminTestJSON-857543-project Jul 18 02:08:38.343404 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:08:38.343404 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:08:38.343404 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: c93a266d6b1f4d718af3724d8b78f6a4 Jul 18 02:08:38.343404 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-AggregatesAdminTestJSON-857543-project Jul 18 02:08:38.343404 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:08:38.343404 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance e5dbcad3-c8b1-4113-862a-6010a666b490 could not be found. Jul 18 02:08:38.343404 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'e5dbcad3-c8b1-4113-862a-6010a666b490'} Jul 18 02:08:38.344076 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:08:38.344076 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:38.344076 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:08:38.344076 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:08:38.344076 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:08:38.344076 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:08:38.344076 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:08:38.344076 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:08:38.344076 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:08:38.344076 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:08:38.344076 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5dbcad3-c8b1-4113-862a-6010a666b490 could not be found. Jul 18 02:08:38.344076 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:38.344076 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:38.344076 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:38.344076 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:38.344076 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:38.344076 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:38.344076 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:08:38.344076 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:08:38.344076 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:08:38.345166 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:08:38.345166 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:08:38.345166 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:08:38.345166 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:08:38.345166 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:08:38.345166 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:08:38.345166 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:08:38.345166 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5dbcad3-c8b1-4113-862a-6010a666b490 could not be found. Jul 18 02:08:38.345166 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:38.345166 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:38.345166 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:38.345166 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:38.345166 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:38.345166 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:38.345166 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:08:38.345166 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:08:38.345166 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5dbcad3-c8b1-4113-862a-6010a666b490 could not be found. Jul 18 02:08:38.345166 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:38.347975 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e4c22b29-0bdb-4cb7-aed7-faeff00aff3d tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Returning 404 to user: Instance e5dbcad3-c8b1-4113-862a-6010a666b490 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:08:38.349043 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e4c22b29-0bdb-4cb7-aed7-faeff00aff3d tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] 10.222.0.57 "GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490" status: 404 len: 111 microversion: 2.1 time: 0.129010 Jul 18 02:08:38.352820 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 117/250] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:38 2022] GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:08:38.372112 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2e438b9f-3292-46ea-a06b-4199657e822b tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-465891-3"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:38.373927 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:38.373927 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:38.391739 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2e438b9f-3292-46ea-a06b-4199657e822b tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:38.392186 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2e438b9f-3292-46ea-a06b-4199657e822b tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:38.672054 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2e438b9f-3292-46ea-a06b-4199657e822b tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 300 microversion: 2.1 time: 0.310680 Jul 18 02:08:38.677872 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 118/251] 10.222.0.57 () {60 vars in 1190 bytes} [Mon Jul 18 02:08:38 2022] POST /compute/v2.1/os-aggregates/8/action => generated 300 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:38.688526 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-dde97ea6-e216-40b2-b17e-8dbe449af7eb tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:38.690535 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:38.690535 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:38.720075 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d311fe0b-52b9-4fb0-91b2-75c93d8bfb7b tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe4f42523df4204b49c9c0899c93fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0c0be2e96a499dbde6652cbc758a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:38.733998 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d311fe0b-52b9-4fb0-91b2-75c93d8bfb7b tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8" status: 200 len: 1320 microversion: 2.1 time: 0.579613 Jul 18 02:08:38.734969 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 134/252] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:38 2022] GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8 => generated 1320 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:08:38.751241 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-dde97ea6-e216-40b2-b17e-8dbe449af7eb tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.071426 Jul 18 02:08:38.752044 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 119/253] 10.222.0.57 () {58 vars in 1151 bytes} [Mon Jul 18 02:08:38 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 02:08:38.771146 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-006ff10f-1b61-4168-998e-617ebdfb76bd tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-323698479"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:38.772534 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:38.772534 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:38.773469 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.aggregate [None req-006ff10f-1b61-4168-998e-617ebdfb76bd tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Generated uuid 1da75649-0080-4503-b3d5-d013bbc9ac16 for aggregate {{(pid=119543) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 02:08:38.812301 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-006ff10f-1b61-4168-998e-617ebdfb76bd tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.045629 Jul 18 02:08:38.813138 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 135/254] 10.222.0.57 () {60 vars in 1163 bytes} [Mon Jul 18 02:08:38 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:38.824145 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4a60b693-8eb9-4556-93fe-c69757288fdc tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-465891-3"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:38.825446 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:38.825446 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:38.839817 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4a60b693-8eb9-4556-93fe-c69757288fdc tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:38.840270 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4a60b693-8eb9-4556-93fe-c69757288fdc tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:38.928418 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c6d3389e-a0f2-4262-b729-bac23aa6169e tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:38.929628 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c6d3389e-a0f2-4262-b729-bac23aa6169e tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: dbb215bf-6099-4dd5-b9af-d1bbfb55ef21] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:38.961333 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c6d3389e-a0f2-4262-b729-bac23aa6169e tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:38.962227 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c6d3389e-a0f2-4262-b729-bac23aa6169e tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:38.966783 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c6d3389e-a0f2-4262-b729-bac23aa6169e tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:38.967443 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c6d3389e-a0f2-4262-b729-bac23aa6169e tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:39.080876 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4a60b693-8eb9-4556-93fe-c69757288fdc tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 241 microversion: 2.1 time: 0.260383 Jul 18 02:08:39.081811 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 120/255] 10.222.0.57 () {60 vars in 1190 bytes} [Mon Jul 18 02:08:38 2022] POST /compute/v2.1/os-aggregates/9/action => generated 241 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:39.092567 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0406999d-d72e-4411-b00c-fbfab79785d6 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:39.095179 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:39.095179 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:39.116974 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0406999d-d72e-4411-b00c-fbfab79785d6 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] 10.222.0.57 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 241 microversion: 2.1 time: 0.027563 Jul 18 02:08:39.120405 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 121/256] 10.222.0.57 () {58 vars in 1148 bytes} [Mon Jul 18 02:08:39 2022] GET /compute/v2.1/os-aggregates/9 => generated 241 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:08:39.139506 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-34deb613-11a8-4b4b-8aa1-f43a4cdd049d tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-465891-3"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:39.143478 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:39.143478 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:39.173027 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-34deb613-11a8-4b4b-8aa1-f43a4cdd049d tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:39.173483 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-34deb613-11a8-4b4b-8aa1-f43a4cdd049d tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:39.371190 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c6d3389e-a0f2-4262-b729-bac23aa6169e tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60118d593f96437dbb2c68ad2fadd465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd02ce642caf4529a6e65c184de0ad19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:39.384789 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c6d3389e-a0f2-4262-b729-bac23aa6169e tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "GET /compute/v2.1/servers/dbb215bf-6099-4dd5-b9af-d1bbfb55ef21" status: 200 len: 1587 microversion: 2.1 time: 0.461579 Jul 18 02:08:39.391627 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-34deb613-11a8-4b4b-8aa1-f43a4cdd049d tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.264332 Jul 18 02:08:39.392243 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 122/257] 10.222.0.57 () {60 vars in 1190 bytes} [Mon Jul 18 02:08:39 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:39.398737 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 136/258] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:38 2022] GET /compute/v2.1/servers/dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 => generated 1587 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:08:39.420487 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-22ae2e8a-52d7-47e9-a88f-c41549c8703a tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:39.428487 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:39.428487 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:39.496369 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-22ae2e8a-52d7-47e9-a88f-c41549c8703a tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.088936 Jul 18 02:08:39.497120 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 137/259] 10.222.0.57 () {58 vars in 1151 bytes} [Mon Jul 18 02:08:39 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 02:08:39.508264 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7f42ab83-1b7a-4bf9-afea-06991374a685 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:39.511521 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7f42ab83-1b7a-4bf9-afea-06991374a685 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: dbb215bf-6099-4dd5-b9af-d1bbfb55ef21] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:39.529166 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7f42ab83-1b7a-4bf9-afea-06991374a685 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:39.529624 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7f42ab83-1b7a-4bf9-afea-06991374a685 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:39.535009 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7f42ab83-1b7a-4bf9-afea-06991374a685 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:39.542192 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7f42ab83-1b7a-4bf9-afea-06991374a685 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:39.752538 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3ac4eb4d-ac88-478f-9ede-4f96aafddde6 tempest-FlavorsV261TestJSON-299943281 tempest-FlavorsV261TestJSON-299943281-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1426816141", "id": 1324090732, "os-flavor-access:is_public": "True"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:39.756098 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:39.756098 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:39.781226 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3ac4eb4d-ac88-478f-9ede-4f96aafddde6 tempest-FlavorsV261TestJSON-299943281 tempest-FlavorsV261TestJSON-299943281-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.380586 Jul 18 02:08:39.782533 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 123/260] 10.222.0.57 () {62 vars in 1187 bytes} [Mon Jul 18 02:08:39 2022] POST /compute/v2.1/flavors => generated 468 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:08:39.790082 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-29cf55cf-3d39-4d6f-982c-80d7a2297c6f tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1618248575"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:39.791941 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:39.791941 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:39.793262 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.aggregate [None req-29cf55cf-3d39-4d6f-982c-80d7a2297c6f tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Generated uuid 3166bea9-1fcf-464e-83f1-6678c646695e for aggregate {{(pid=119544) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 02:08:39.822573 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-29cf55cf-3d39-4d6f-982c-80d7a2297c6f tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.038750 Jul 18 02:08:39.830195 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 124/261] 10.222.0.57 () {60 vars in 1163 bytes} [Mon Jul 18 02:08:39 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:39.953404 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4bab51cd-8804-40cc-bdc2-0f15e6f3b858 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] Calling method '.version_select at 0x7ff4a94c4310>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:40.058084 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7f42ab83-1b7a-4bf9-afea-06991374a685 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "GET /compute/v2.1/servers/dbb215bf-6099-4dd5-b9af-d1bbfb55ef21/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.559064 Jul 18 02:08:40.060551 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 138/262] 10.222.0.57 () {58 vars in 1274 bytes} [Mon Jul 18 02:08:39 2022] GET /compute/v2.1/servers/dbb215bf-6099-4dd5-b9af-d1bbfb55ef21/os-interface => generated 285 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:40.069056 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-069084f8-103f-44a0-afe6-30cd2a3bea01 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:40.069906 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-069084f8-103f-44a0-afe6-30cd2a3bea01 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: 34961834-de57-4c1c-9ace-7bf4c43f8af8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:40.083242 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4bab51cd-8804-40cc-bdc2-0f15e6f3b858 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] 10.222.0.57 "GET /compute/v2.1/os-quota-sets/5e781ace45744b9bacc8432c90d4f062" status: 200 len: 371 microversion: 2.1 time: 0.250825 Jul 18 02:08:40.084103 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 125/263] 10.222.0.57 () {58 vars in 1241 bytes} [Mon Jul 18 02:08:39 2022] GET /compute/v2.1/os-quota-sets/5e781ace45744b9bacc8432c90d4f062 => generated 371 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:40.093373 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-069084f8-103f-44a0-afe6-30cd2a3bea01 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:40.094027 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-069084f8-103f-44a0-afe6-30cd2a3bea01 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:40.097154 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-069084f8-103f-44a0-afe6-30cd2a3bea01 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:40.117113 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-069084f8-103f-44a0-afe6-30cd2a3bea01 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:40.338779 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cad46fb1-5712-4412-8d95-834210469dbd tempest-FlavorsV261TestJSON-58119109 tempest-FlavorsV261TestJSON-58119109-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:40.355442 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cad46fb1-5712-4412-8d95-834210469dbd tempest-FlavorsV261TestJSON-58119109 tempest-FlavorsV261TestJSON-58119109-project] 10.222.0.57 "GET /compute/v2.1/flavors/1324090732" status: 200 len: 468 microversion: 2.61 time: 0.257742 Jul 18 02:08:40.356818 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 126/264] 10.222.0.57 () {60 vars in 1198 bytes} [Mon Jul 18 02:08:40 2022] GET /compute/v2.1/flavors/1324090732 => generated 468 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:08:40.384643 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-281a1e50-320e-4b27-9207-7007dbd1a6a2 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-465891-3"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:40.387955 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:40.387955 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:40.410560 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-281a1e50-320e-4b27-9207-7007dbd1a6a2 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:40.411140 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-281a1e50-320e-4b27-9207-7007dbd1a6a2 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:40.423916 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=100 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:08:40.445370 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=83,nova_api:SAVEPOINT=4,nova_api:INSERT=5,nova_api:RELEASE=4,nova_api:DELETE=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:08:40.477635 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-069084f8-103f-44a0-afe6-30cd2a3bea01 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe4f42523df4204b49c9c0899c93fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0c0be2e96a499dbde6652cbc758a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:40.486312 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-069084f8-103f-44a0-afe6-30cd2a3bea01 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8" status: 200 len: 1320 microversion: 2.1 time: 0.424369 Jul 18 02:08:40.499652 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 139/265] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:40 2022] GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8 => generated 1320 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:40.509677 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7850425d-fd07-4b10-a3be-4abf81e6dff6 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] Action: 'update', calling method: .version_select at 0x7ff4a9922a60>, body: {"quota_set": {"ram": "5120"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:40.648053 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-281a1e50-320e-4b27-9207-7007dbd1a6a2 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 243 microversion: 2.1 time: 0.289574 Jul 18 02:08:40.648662 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 127/266] 10.222.0.57 () {60 vars in 1193 bytes} [Mon Jul 18 02:08:40 2022] POST /compute/v2.1/os-aggregates/10/action => generated 243 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:40.659652 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ded5ebed-dae5-40c6-a838-54031e7ab7c9 tempest-FlavorsV261TestJSON-299943281 tempest-FlavorsV261TestJSON-299943281-project-admin] Action: 'update', calling method: .version_select at 0x7ff4ab856a60>, body: {"flavor": {"description": "new"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:40.665741 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7850425d-fd07-4b10-a3be-4abf81e6dff6 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:40.666358 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7850425d-fd07-4b10-a3be-4abf81e6dff6 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:40.668760 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7850425d-fd07-4b10-a3be-4abf81e6dff6 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:40.669457 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7850425d-fd07-4b10-a3be-4abf81e6dff6 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:40.688634 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:40.688634 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:40.762966 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ded5ebed-dae5-40c6-a838-54031e7ab7c9 tempest-FlavorsV261TestJSON-299943281 tempest-FlavorsV261TestJSON-299943281-project-admin] 10.222.0.57 "PUT /compute/v2.1/flavors/1324090732" status: 200 len: 469 microversion: 2.61 time: 0.107162 Jul 18 02:08:40.764061 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 128/267] 10.222.0.57 () {62 vars in 1218 bytes} [Mon Jul 18 02:08:40 2022] PUT /compute/v2.1/flavors/1324090732 => generated 469 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:08:40.772386 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d713b2d6-5dde-434d-9623-11aa44ddeaef tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:40.774621 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:40.774621 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:40.823517 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7850425d-fd07-4b10-a3be-4abf81e6dff6 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-quota-sets/5e781ace45744b9bacc8432c90d4f062" status: 200 len: 328 microversion: 2.1 time: 0.324836 Jul 18 02:08:40.824424 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 140/268] 10.222.0.57 () {60 vars in 1261 bytes} [Mon Jul 18 02:08:40 2022] PUT /compute/v2.1/os-quota-sets/5e781ace45744b9bacc8432c90d4f062 => generated 328 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:40.831033 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f3572c91-e045-4d64-910c-ac1d7400253b tempest-FlavorsV261TestJSON-58119109 tempest-FlavorsV261TestJSON-58119109-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:40.833589 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d713b2d6-5dde-434d-9623-11aa44ddeaef tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] 10.222.0.57 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.067992 Jul 18 02:08:40.835740 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 129/269] 10.222.0.57 () {58 vars in 1142 bytes} [Mon Jul 18 02:08:40 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:40.844844 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-81df1f7e-d60d-4c99-af23-7f1ff69dade2 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:40.879519 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f3572c91-e045-4d64-910c-ac1d7400253b tempest-FlavorsV261TestJSON-58119109 tempest-FlavorsV261TestJSON-58119109-project] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 7159 microversion: 2.61 time: 0.053448 Jul 18 02:08:40.880132 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 141/270] 10.222.0.57 () {60 vars in 1186 bytes} [Mon Jul 18 02:08:40 2022] GET /compute/v2.1/flavors/detail => generated 7159 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:08:40.882164 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-81df1f7e-d60d-4c99-af23-7f1ff69dade2 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-quota-sets/5e781ace45744b9bacc8432c90d4f062" status: 202 len: 0 microversion: 2.1 time: 0.045051 Jul 18 02:08:40.884460 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 130/271] 10.222.0.57 () {58 vars in 1244 bytes} [Mon Jul 18 02:08:40 2022] DELETE /compute/v2.1/os-quota-sets/5e781ace45744b9bacc8432c90d4f062 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:08:40.896874 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a92b6e60-647a-45ac-b1a0-97aa8248b161 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-465891-3"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:40.901584 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-36bccdbb-0613-407b-9910-d66f1b62a7d7 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] Calling method '.version_select at 0x7ff4a94ec0d0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:40.906055 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:40.906055 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:40.932372 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a92b6e60-647a-45ac-b1a0-97aa8248b161 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:40.933104 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a92b6e60-647a-45ac-b1a0-97aa8248b161 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:41.022684 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=72,nova_cell0:UPDATE=7 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:08:41.043193 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-36bccdbb-0613-407b-9910-d66f1b62a7d7 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] 10.222.0.57 "GET /compute/v2.1/os-quota-sets/5e781ace45744b9bacc8432c90d4f062" status: 200 len: 371 microversion: 2.1 time: 0.146609 Jul 18 02:08:41.043804 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 131/272] 10.222.0.57 () {58 vars in 1241 bytes} [Mon Jul 18 02:08:40 2022] GET /compute/v2.1/os-quota-sets/5e781ace45744b9bacc8432c90d4f062 => generated 371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:08:41.071080 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8309f452-80c5-4126-84f5-324cd9bd1662 tempest-FlavorsV261TestJSON-58119109 tempest-FlavorsV261TestJSON-58119109-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:41.135912 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a92b6e60-647a-45ac-b1a0-97aa8248b161 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 228 microversion: 2.1 time: 0.245675 Jul 18 02:08:41.136480 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8309f452-80c5-4126-84f5-324cd9bd1662 tempest-FlavorsV261TestJSON-58119109 tempest-FlavorsV261TestJSON-58119109-project] 10.222.0.57 "GET /compute/v2.1/flavors" status: 200 len: 3686 microversion: 2.61 time: 0.091348 Jul 18 02:08:41.136841 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 132/273] 10.222.0.57 () {60 vars in 1165 bytes} [Mon Jul 18 02:08:41 2022] GET /compute/v2.1/flavors => generated 3686 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:08:41.150950 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a8129e44-e7f5-496e-974c-0ae2812c01ed tempest-FlavorsV261TestJSON-299943281 tempest-FlavorsV261TestJSON-299943281-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:41.151134 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 142/274] 10.222.0.57 () {60 vars in 1193 bytes} [Mon Jul 18 02:08:40 2022] POST /compute/v2.1/os-aggregates/10/action => generated 228 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:41.163879 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4efc458e-15fa-45bb-b14c-180c05255951 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:41.164633 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:41.164633 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:41.167243 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:41.167243 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:41.209505 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a8129e44-e7f5-496e-974c-0ae2812c01ed tempest-FlavorsV261TestJSON-299943281 tempest-FlavorsV261TestJSON-299943281-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/1324090732" status: 202 len: 0 microversion: 2.61 time: 0.062314 Jul 18 02:08:41.212562 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 133/275] 10.222.0.57 () {60 vars in 1201 bytes} [Mon Jul 18 02:08:41 2022] DELETE /compute/v2.1/flavors/1324090732 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:08:41.223097 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-21760787-ee2b-4f2e-a876-14fc92d06d55 tempest-FlavorsV261TestJSON-299943281 tempest-FlavorsV261TestJSON-299943281-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:41.233600 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4efc458e-15fa-45bb-b14c-180c05255951 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.073961 Jul 18 02:08:41.235394 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 143/276] 10.222.0.57 () {58 vars in 1154 bytes} [Mon Jul 18 02:08:41 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 02:08:41.246099 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-21760787-ee2b-4f2e-a876-14fc92d06d55 tempest-FlavorsV261TestJSON-299943281 tempest-FlavorsV261TestJSON-299943281-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 6700 microversion: 2.61 time: 0.027536 Jul 18 02:08:41.247025 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 134/277] 10.222.0.57 () {60 vars in 1186 bytes} [Mon Jul 18 02:08:41 2022] GET /compute/v2.1/flavors/detail => generated 6700 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:08:41.259688 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c5fd10e7-2ce7-4d8a-bc31-f0eccc6f250d tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-763221246"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:41.275206 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:41.275206 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:41.276140 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.aggregate [None req-c5fd10e7-2ce7-4d8a-bc31-f0eccc6f250d tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Generated uuid 744bd585-3b4c-421c-abc1-06d8a2468943 for aggregate {{(pid=119543) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 02:08:41.349596 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c5fd10e7-2ce7-4d8a-bc31-f0eccc6f250d tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.108267 Jul 18 02:08:41.355434 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 144/278] 10.222.0.57 () {60 vars in 1163 bytes} [Mon Jul 18 02:08:41 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:08:41.365750 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ef10c263-d173-4a8b-9bf5-43f055553b93 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-465891-3"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:41.367820 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:41.367820 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:41.387981 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ef10c263-d173-4a8b-9bf5-43f055553b93 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:41.390873 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ef10c263-d173-4a8b-9bf5-43f055553b93 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:41.419311 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1e53a696-cd7c-41bf-8a66-7ae7780c7dd8 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] Calling method '.version_select at 0x7ff4a95bee50>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:41.616788 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ef10c263-d173-4a8b-9bf5-43f055553b93 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 242 microversion: 2.1 time: 0.255714 Jul 18 02:08:41.617404 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 135/279] 10.222.0.57 () {60 vars in 1193 bytes} [Mon Jul 18 02:08:41 2022] POST /compute/v2.1/os-aggregates/11/action => generated 242 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:41.626306 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-432e83cd-f3ff-4d7e-bfd8-1dae802daa0a tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:41.626909 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-432e83cd-f3ff-4d7e-bfd8-1dae802daa0a tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: 34961834-de57-4c1c-9ace-7bf4c43f8af8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:41.636402 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-432e83cd-f3ff-4d7e-bfd8-1dae802daa0a tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:41.636858 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-432e83cd-f3ff-4d7e-bfd8-1dae802daa0a tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:41.637642 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-432e83cd-f3ff-4d7e-bfd8-1dae802daa0a tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:41.638103 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-432e83cd-f3ff-4d7e-bfd8-1dae802daa0a tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:41.853591 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1e53a696-cd7c-41bf-8a66-7ae7780c7dd8 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] 10.222.0.57 "GET /compute/v2.1/os-quota-sets/d405ec54fa60400f9e09547218477834/defaults" status: 200 len: 371 microversion: 2.1 time: 0.438071 Jul 18 02:08:41.854950 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 145/280] 10.222.0.57 () {58 vars in 1268 bytes} [Mon Jul 18 02:08:41 2022] GET /compute/v2.1/os-quota-sets/d405ec54fa60400f9e09547218477834/defaults => generated 371 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:08:41.862802 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-952c1838-202e-428c-aea5-939f9b2a2b54 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-465891-3"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:41.867829 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:41.867829 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:41.900150 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-952c1838-202e-428c-aea5-939f9b2a2b54 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:41.900603 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-952c1838-202e-428c-aea5-939f9b2a2b54 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:41.981317 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-432e83cd-f3ff-4d7e-bfd8-1dae802daa0a tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe4f42523df4204b49c9c0899c93fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0c0be2e96a499dbde6652cbc758a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:41.996971 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-432e83cd-f3ff-4d7e-bfd8-1dae802daa0a tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8" status: 200 len: 1470 microversion: 2.1 time: 0.377109 Jul 18 02:08:42.000036 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 136/281] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:41 2022] GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8 => generated 1470 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:42.072991 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-952c1838-202e-428c-aea5-939f9b2a2b54 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.216628 Jul 18 02:08:42.074829 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 146/282] 10.222.0.57 () {60 vars in 1193 bytes} [Mon Jul 18 02:08:41 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:42.095581 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d6405a48-f8d7-4fc5-8382-5814cbaaafe2 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:42.097738 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:42.097738 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:42.147633 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d6405a48-f8d7-4fc5-8382-5814cbaaafe2 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.060647 Jul 18 02:08:42.168182 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 147/283] 10.222.0.57 () {58 vars in 1154 bytes} [Mon Jul 18 02:08:42 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 02:08:42.180214 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9c88c9e6-3ba7-435b-b56c-52d903f0a8f6 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2096820277"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:42.181685 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:42.181685 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:42.182682 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.aggregate [None req-9c88c9e6-3ba7-435b-b56c-52d903f0a8f6 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Generated uuid 09ce60d4-423f-4513-8792-998879d885b6 for aggregate {{(pid=119543) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 02:08:42.246636 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9c88c9e6-3ba7-435b-b56c-52d903f0a8f6 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.077229 Jul 18 02:08:42.255959 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 148/284] 10.222.0.57 () {60 vars in 1163 bytes} [Mon Jul 18 02:08:42 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:42.271505 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4dcb1b8f-d938-49d3-bd8d-7e892f43405a tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-371330249"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:42.274773 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:42.274773 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:42.282480 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.aggregate [None req-4dcb1b8f-d938-49d3-bd8d-7e892f43405a tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Generated uuid 96960844-321f-47da-9c0c-78f5305e47f5 for aggregate {{(pid=119543) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 02:08:42.342503 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4dcb1b8f-d938-49d3-bd8d-7e892f43405a tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.085668 Jul 18 02:08:42.343462 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 149/285] 10.222.0.57 () {60 vars in 1163 bytes} [Mon Jul 18 02:08:42 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:42.354476 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2a135853-8baa-46f9-8351-41b61a4861e0 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:42.355245 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:42.355245 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:42.429716 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2a135853-8baa-46f9-8351-41b61a4861e0 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.082182 Jul 18 02:08:42.430330 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 150/286] 10.222.0.57 () {58 vars in 1154 bytes} [Mon Jul 18 02:08:42 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 02:08:42.435939 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-39d2f27e-909e-4dea-b91b-287729c0925f tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-465891-3"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:42.447278 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:42.447278 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:42.471486 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-39d2f27e-909e-4dea-b91b-287729c0925f tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:42.474875 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-39d2f27e-909e-4dea-b91b-287729c0925f tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:42.747690 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-39d2f27e-909e-4dea-b91b-287729c0925f tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 242 microversion: 2.1 time: 0.315637 Jul 18 02:08:42.748627 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 151/287] 10.222.0.57 () {60 vars in 1193 bytes} [Mon Jul 18 02:08:42 2022] POST /compute/v2.1/os-aggregates/13/action => generated 242 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:42.755904 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d9876761-1136-498a-8865-35367b35fe41 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:42.758613 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:42.758613 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:42.778429 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-d9876761-1136-498a-8865-35367b35fe41 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Jul 18 02:08:42.784682 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d9876761-1136-498a-8865-35367b35fe41 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Request method failure captured: Jul 18 02:08:42.784682 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Jul 18 02:08:42.784682 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:08:42.784682 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:08:42.784682 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:08:42.784682 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:08:42.784682 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:08:42.784682 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:08:42.784682 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:08:42.784682 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:08:42.784682 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MB21w9F4JhDDbKIGLkY2J_m1WjFi1fLoxzWCRAhWOMZKPJOPmgvnQvzjQAGav8QSVuXkZdzsbWCgIuA7VIqQwKgRLRLqQq4-I7t6n19Iv4zCaOlMctmAL7A1X-veyO5ZfqGg6BxvfrdUcouuLX7AuZv6k_ku3L4h_I2ztQRYx6lAqY Jul 18 02:08:42.784682 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:08:42.784682 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:08:42.784682 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:08:42.784682 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:08:42.784682 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:08:42.784682 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:08:42.784682 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 06f1499d14c64163a38974df4c6bfe10 Jul 18 02:08:42.784682 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-AggregatesAdminTestJSON-1480124188 Jul 18 02:08:42.784682 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,admin,reader Jul 18 02:08:42.784682 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,admin,reader Jul 18 02:08:42.786777 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_06f1499d14c64163a38974df4c6bfe10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/06f1499d14c64163a38974df4c6bfe10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/06f1499d14c64163a38974df4c6bfe10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/06f1499d14c64163a38974df4c6bfe10"}]}] Jul 18 02:08:42.786777 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-AggregatesAdminTestJSON-1480124188 Jul 18 02:08:42.786777 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 06f1499d14c64163a38974df4c6bfe10 Jul 18 02:08:42.786777 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1480124188 Jul 18 02:08:42.786777 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-AggregatesAdminTestJSON-1480124188-project-admin Jul 18 02:08:42.786777 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:08:42.786777 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:08:42.786777 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 5c1fdbd4cfa941f98ab25c588cacdc73 Jul 18 02:08:42.786777 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-AggregatesAdminTestJSON-1480124188-project-admin Jul 18 02:08:42.786777 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:08:42.786777 n-d-465891-3 devstack@n-api.service[119543]: exception: Aggregate 12 could not be found. Jul 18 02:08:42.786777 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '12'} Jul 18 02:08:42.786777 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:08:42.787581 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:42.787581 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 18 02:08:42.787581 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 18 02:08:42.787581 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 18 02:08:42.787581 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 18 02:08:42.787581 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:08:42.787581 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:08:42.787581 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 18 02:08:42.787581 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 18 02:08:42.787581 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:08:42.787581 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:08:42.787581 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 18 02:08:42.787581 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 18 02:08:42.787581 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Jul 18 02:08:42.787581 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:42.787581 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:42.787581 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:42.787581 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:42.787581 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:42.790163 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:42.790163 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:08:42.790163 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:08:42.790163 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:08:42.790163 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:08:42.790163 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 18 02:08:42.790163 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:08:42.790163 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Jul 18 02:08:42.790163 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:42.790163 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:42.790163 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:42.790163 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:42.790163 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:42.790163 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:42.790163 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:08:42.790163 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:08:42.790163 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Jul 18 02:08:42.790163 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:42.793976 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d9876761-1136-498a-8865-35367b35fe41 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:08:42.795337 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d9876761-1136-498a-8865-35367b35fe41 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] 10.222.0.57 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.045421 Jul 18 02:08:42.796501 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 152/288] 10.222.0.57 () {58 vars in 1151 bytes} [Mon Jul 18 02:08:42 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:08:42.805256 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-146e7dc8-a312-49c7-892e-684cb461fc5b tempest-AggregatesAdminNegativeTestJSON-817538988 tempest-AggregatesAdminNegativeTestJSON-817538988-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-465891-3"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:42.807505 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:42.807505 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:42.809160 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-146e7dc8-a312-49c7-892e-684cb461fc5b tempest-AggregatesAdminNegativeTestJSON-817538988 tempest-AggregatesAdminNegativeTestJSON-817538988-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '2446e24dbad94d68bc53e68994425219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06623d9175f84a2f855ea1a2608500cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:42.811129 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-146e7dc8-a312-49c7-892e-684cb461fc5b tempest-AggregatesAdminNegativeTestJSON-817538988 tempest-AggregatesAdminNegativeTestJSON-817538988-project] Request method failure captured: Jul 18 02:08:42.811129 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Jul 18 02:08:42.811129 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:08:42.811129 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:08:42.811129 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:08:42.811129 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 42 Jul 18 02:08:42.811129 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:08:42.811129 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:08:42.811129 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:08:42.811129 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:08:42.811129 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MByRc4VXjOZoV01x3OdnWsXQswqB5DdqJzYLYdStk4XRPpgvD_Nco5d84c-ncA4XIELItWPebyNkPp7X2ZZWb9IUctL1w5F7C-Xuzl23qh88YB4Oiv0-vRXobPECoqF_AiuWWHHVVYw4BxcafTtQnwhjKuefqfWnrPDvh4Zl-EjdXA Jul 18 02:08:42.811129 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:08:42.811129 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:08:42.811129 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:08:42.811129 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:08:42.811129 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:08:42.811129 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:08:42.811129 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 06623d9175f84a2f855ea1a2608500cd Jul 18 02:08:42.811129 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-817538988 Jul 18 02:08:42.811129 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:08:42.811129 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:08:42.812664 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_06623d9175f84a2f855ea1a2608500cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/06623d9175f84a2f855ea1a2608500cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/06623d9175f84a2f855ea1a2608500cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/06623d9175f84a2f855ea1a2608500cd"}]}] Jul 18 02:08:42.812664 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-817538988 Jul 18 02:08:42.812664 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 06623d9175f84a2f855ea1a2608500cd Jul 18 02:08:42.812664 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-817538988 Jul 18 02:08:42.812664 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-AggregatesAdminNegativeTestJSON-817538988-project Jul 18 02:08:42.812664 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:08:42.812664 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:08:42.812664 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 2446e24dbad94d68bc53e68994425219 Jul 18 02:08:42.812664 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-817538988-project Jul 18 02:08:42.812664 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 02:08:42.812664 n-d-465891-3 devstack@n-api.service[119543]: {"remove_host": {"host": "n-h2-465891-3"}} Jul 18 02:08:42.812664 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:08:42.812664 n-d-465891-3 devstack@n-api.service[119543]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 18 02:08:42.813476 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '13', 'body': {'remove_host': {'host': 'n-h2-465891-3'}}} Jul 18 02:08:42.813476 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:08:42.813476 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:42.813476 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:42.813476 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:42.813476 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:08:42.813476 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:08:42.813476 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:08:42.813476 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:08:42.813476 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:08:42.813476 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:08:42.813476 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Jul 18 02:08:42.813476 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Jul 18 02:08:42.813476 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:08:42.813476 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:08:42.813476 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:08:42.813476 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:08:42.813476 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:08:42.813476 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:08:42.814583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:08:42.814583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:08:42.814583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:08:42.814583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:08:42.814583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:08:42.814583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:08:42.814583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:08:42.814583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:08:42.814583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 18 02:08:42.814583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:42.814583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:42.814583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:42.814583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:42.814583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:42.814583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:42.814583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:08:42.814583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:08:42.814583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 18 02:08:42.814583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:42.818403 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-146e7dc8-a312-49c7-892e-684cb461fc5b tempest-AggregatesAdminNegativeTestJSON-817538988 tempest-AggregatesAdminNegativeTestJSON-817538988-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:08:42.819534 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-146e7dc8-a312-49c7-892e-684cb461fc5b tempest-AggregatesAdminNegativeTestJSON-817538988 tempest-AggregatesAdminNegativeTestJSON-817538988-project] 10.222.0.57 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.021714 Jul 18 02:08:42.821309 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 153/289] 10.222.0.57 () {60 vars in 1193 bytes} [Mon Jul 18 02:08:42 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:08:42.835351 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7fad3fbd-ecb1-4f19-a5ae-902633e91d8e tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:42.836454 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:42.836454 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:42.841811 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6,nova_api:DELETE=10 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:08:42.853058 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-7fad3fbd-ecb1-4f19-a5ae-902633e91d8e tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Jul 18 02:08:42.855512 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7fad3fbd-ecb1-4f19-a5ae-902633e91d8e tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Request method failure captured: Jul 18 02:08:42.855512 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 Jul 18 02:08:42.855512 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:08:42.855512 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:08:42.855512 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:08:42.855512 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:08:42.855512 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:08:42.855512 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:08:42.855512 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:08:42.855512 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:08:42.855512 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MB21w9F4JhDDbKIGLkY2J_m1WjFi1fLoxzWCRAhWOMZKPJOPmgvnQvzjQAGav8QSVuXkZdzsbWCgIuA7VIqQwKgRLRLqQq4-I7t6n19Iv4zCaOlMctmAL7A1X-veyO5ZfqGg6BxvfrdUcouuLX7AuZv6k_ku3L4h_I2ztQRYx6lAqY Jul 18 02:08:42.855512 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:08:42.855512 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:08:42.855512 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:08:42.855512 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:08:42.855512 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:08:42.855512 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:08:42.855512 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 06f1499d14c64163a38974df4c6bfe10 Jul 18 02:08:42.855512 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-AggregatesAdminTestJSON-1480124188 Jul 18 02:08:42.855512 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,admin,reader Jul 18 02:08:42.855512 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,admin,reader Jul 18 02:08:42.856717 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_06f1499d14c64163a38974df4c6bfe10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/06f1499d14c64163a38974df4c6bfe10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/06f1499d14c64163a38974df4c6bfe10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/06f1499d14c64163a38974df4c6bfe10"}]}] Jul 18 02:08:42.856717 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-AggregatesAdminTestJSON-1480124188 Jul 18 02:08:42.856717 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 06f1499d14c64163a38974df4c6bfe10 Jul 18 02:08:42.856717 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1480124188 Jul 18 02:08:42.856717 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-AggregatesAdminTestJSON-1480124188-project-admin Jul 18 02:08:42.856717 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:08:42.856717 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:08:42.856717 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 5c1fdbd4cfa941f98ab25c588cacdc73 Jul 18 02:08:42.856717 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-AggregatesAdminTestJSON-1480124188-project-admin Jul 18 02:08:42.856717 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:08:42.856717 n-d-465891-3 devstack@n-api.service[119543]: exception: Aggregate 12 could not be found. Jul 18 02:08:42.856717 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '12'} Jul 18 02:08:42.856717 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:08:42.857499 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:42.857499 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 18 02:08:42.857499 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 18 02:08:42.857499 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 02:08:42.857499 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 02:08:42.857499 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:08:42.857499 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:08:42.857499 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:08:42.857499 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:08:42.857499 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 02:08:42.857499 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 02:08:42.857499 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 18 02:08:42.857499 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 18 02:08:42.857499 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:08:42.857499 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:08:42.857499 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 18 02:08:42.857499 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 18 02:08:42.857499 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:08:42.857499 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:08:42.858855 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 18 02:08:42.858855 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 18 02:08:42.858855 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Jul 18 02:08:42.858855 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:42.858855 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:42.858855 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:42.858855 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:42.858855 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:42.858855 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:42.858855 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:08:42.858855 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:08:42.858855 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:08:42.858855 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:08:42.858855 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 18 02:08:42.858855 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:08:42.858855 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Jul 18 02:08:42.858855 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:42.858855 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:42.858855 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:42.858855 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:42.858855 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:42.859993 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:42.859993 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:08:42.859993 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:08:42.859993 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Jul 18 02:08:42.859993 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:42.862305 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7fad3fbd-ecb1-4f19-a5ae-902633e91d8e tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:08:42.864720 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7fad3fbd-ecb1-4f19-a5ae-902633e91d8e tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.039695 Jul 18 02:08:42.865609 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 154/290] 10.222.0.57 () {58 vars in 1154 bytes} [Mon Jul 18 02:08:42 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:08:42.875623 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9f888afc-440a-40f3-93d7-199fe2ecb661 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-465891-3"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:42.884012 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-986b7b17-8b50-487b-9f16-b38ca4a76acd tempest-DeleteServersAdminTestJSON-626887470 tempest-DeleteServersAdminTestJSON-626887470-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:42.885176 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-986b7b17-8b50-487b-9f16-b38ca4a76acd tempest-DeleteServersAdminTestJSON-626887470 tempest-DeleteServersAdminTestJSON-626887470-project-admin] [instance: 34961834-de57-4c1c-9ace-7bf4c43f8af8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:42.898643 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-986b7b17-8b50-487b-9f16-b38ca4a76acd tempest-DeleteServersAdminTestJSON-626887470 tempest-DeleteServersAdminTestJSON-626887470-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:42.902563 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-986b7b17-8b50-487b-9f16-b38ca4a76acd tempest-DeleteServersAdminTestJSON-626887470 tempest-DeleteServersAdminTestJSON-626887470-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:42.908673 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9f888afc-440a-40f3-93d7-199fe2ecb661 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:42.909754 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-986b7b17-8b50-487b-9f16-b38ca4a76acd tempest-DeleteServersAdminTestJSON-626887470 tempest-DeleteServersAdminTestJSON-626887470-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:42.911802 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-986b7b17-8b50-487b-9f16-b38ca4a76acd tempest-DeleteServersAdminTestJSON-626887470 tempest-DeleteServersAdminTestJSON-626887470-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:42.917937 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9f888afc-440a-40f3-93d7-199fe2ecb661 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:43.123476 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9f888afc-440a-40f3-93d7-199fe2ecb661 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 227 microversion: 2.1 time: 0.256427 Jul 18 02:08:43.124377 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 155/291] 10.222.0.57 () {60 vars in 1193 bytes} [Mon Jul 18 02:08:42 2022] POST /compute/v2.1/os-aggregates/13/action => generated 227 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:43.129889 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7395737e-5a02-442f-a55a-a1068b30743a tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-810456036", "name": "tempest-test_aggregate-1307386116"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:43.189936 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:43.189936 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:43.192071 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.aggregate [None req-7395737e-5a02-442f-a55a-a1068b30743a tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Generated uuid 9f55a70e-478a-4efe-95a2-e0d06dd92f98 for aggregate {{(pid=119543) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 02:08:43.246081 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7395737e-5a02-442f-a55a-a1068b30743a tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.120337 Jul 18 02:08:43.246699 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 156/292] 10.222.0.57 () {60 vars in 1164 bytes} [Mon Jul 18 02:08:43 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:43.251218 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ed463e79-deda-407d-85fa-aa072d09b525 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] Action: 'update', calling method: .version_select at 0x7ff4a96733a0>, body: {"quota_set": {"ram": "5120"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:43.359383 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-986b7b17-8b50-487b-9f16-b38ca4a76acd tempest-DeleteServersAdminTestJSON-626887470 tempest-DeleteServersAdminTestJSON-626887470-project-admin] [instance: 34961834-de57-4c1c-9ace-7bf4c43f8af8] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:08:43.404905 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ed463e79-deda-407d-85fa-aa072d09b525 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:43.405768 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ed463e79-deda-407d-85fa-aa072d09b525 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:43.407306 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ed463e79-deda-407d-85fa-aa072d09b525 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:43.408133 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ed463e79-deda-407d-85fa-aa072d09b525 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:43.529230 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ed463e79-deda-407d-85fa-aa072d09b525 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-quota-sets/3dd8515bf92e4202b6e14915399046b3" status: 200 len: 328 microversion: 2.1 time: 0.281443 Jul 18 02:08:43.535002 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 157/293] 10.222.0.57 () {60 vars in 1261 bytes} [Mon Jul 18 02:08:43 2022] PUT /compute/v2.1/os-quota-sets/3dd8515bf92e4202b6e14915399046b3 => generated 328 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:43.541148 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-296b3d32-3a61-4ac3-a998-2af7a0ccf6c1 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:43.549534 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:43.549534 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:43.593903 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-296b3d32-3a61-4ac3-a998-2af7a0ccf6c1 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.055358 Jul 18 02:08:43.597769 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 158/294] 10.222.0.57 () {58 vars in 1154 bytes} [Mon Jul 18 02:08:43 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 02:08:43.619443 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6bf9218f-edb7-4d53-a245-247fc2dc89db tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:43.620229 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:43.620229 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:43.668053 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6bf9218f-edb7-4d53-a245-247fc2dc89db tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.055366 Jul 18 02:08:43.668985 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 159/295] 10.222.0.57 () {58 vars in 1154 bytes} [Mon Jul 18 02:08:43 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 02:08:43.677401 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b24b8152-eb8a-4304-be7a-7c0b6c56811d tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] Calling method '.version_select at 0x7ff4a9625310>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:43.680139 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-986b7b17-8b50-487b-9f16-b38ca4a76acd tempest-DeleteServersAdminTestJSON-626887470 tempest-DeleteServersAdminTestJSON-626887470-project-admin] 10.222.0.57 "DELETE /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8" status: 204 len: 0 microversion: 2.1 time: 1.664057 Jul 18 02:08:43.684190 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 137/296] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:08:42 2022] DELETE /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8 => generated 0 bytes in 1666 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:08:43.693077 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8e98afd5-67b6-460d-986d-f2c85f733040 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-936157536"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:43.695065 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:43.695065 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:43.696539 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.aggregate [None req-8e98afd5-67b6-460d-986d-f2c85f733040 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Generated uuid 5d495a54-7e64-4096-a8ab-2c90538c7c4d for aggregate {{(pid=119544) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 02:08:43.740914 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8e98afd5-67b6-460d-986d-f2c85f733040 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.047182 Jul 18 02:08:43.742154 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 138/297] 10.222.0.57 () {60 vars in 1163 bytes} [Mon Jul 18 02:08:43 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:43.764090 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b5094a8f-abc4-480d-b884-9dedc6d38103 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:43.767402 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:43.767402 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:43.783682 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-b5094a8f-abc4-480d-b884-9dedc6d38103 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Jul 18 02:08:43.786443 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b5094a8f-abc4-480d-b884-9dedc6d38103 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Request method failure captured: Jul 18 02:08:43.786443 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Jul 18 02:08:43.786443 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:08:43.786443 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:08:43.786443 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:08:43.786443 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:08:43.786443 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:08:43.786443 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:08:43.786443 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:08:43.786443 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:08:43.786443 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MB21w9F4JhDDbKIGLkY2J_m1WjFi1fLoxzWCRAhWOMZKPJOPmgvnQvzjQAGav8QSVuXkZdzsbWCgIuA7VIqQwKgRLRLqQq4-I7t6n19Iv4zCaOlMctmAL7A1X-veyO5ZfqGg6BxvfrdUcouuLX7AuZv6k_ku3L4h_I2ztQRYx6lAqY Jul 18 02:08:43.786443 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:08:43.786443 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:08:43.786443 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:08:43.786443 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:08:43.786443 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:08:43.786443 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:08:43.786443 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 06f1499d14c64163a38974df4c6bfe10 Jul 18 02:08:43.786443 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-AggregatesAdminTestJSON-1480124188 Jul 18 02:08:43.786443 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,admin,reader Jul 18 02:08:43.786443 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,admin,reader Jul 18 02:08:43.787928 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_06f1499d14c64163a38974df4c6bfe10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/06f1499d14c64163a38974df4c6bfe10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/06f1499d14c64163a38974df4c6bfe10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/06f1499d14c64163a38974df4c6bfe10"}]}] Jul 18 02:08:43.787928 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-AggregatesAdminTestJSON-1480124188 Jul 18 02:08:43.787928 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 06f1499d14c64163a38974df4c6bfe10 Jul 18 02:08:43.787928 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1480124188 Jul 18 02:08:43.787928 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-AggregatesAdminTestJSON-1480124188-project-admin Jul 18 02:08:43.787928 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:08:43.787928 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:08:43.787928 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 5c1fdbd4cfa941f98ab25c588cacdc73 Jul 18 02:08:43.787928 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-AggregatesAdminTestJSON-1480124188-project-admin Jul 18 02:08:43.787928 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:08:43.787928 n-d-465891-3 devstack@n-api.service[119544]: exception: Aggregate 14 could not be found. Jul 18 02:08:43.787928 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '14'} Jul 18 02:08:43.787928 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:08:43.788925 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:43.788925 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 18 02:08:43.788925 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 18 02:08:43.788925 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 18 02:08:43.788925 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 18 02:08:43.788925 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:08:43.788925 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:08:43.788925 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 18 02:08:43.788925 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 18 02:08:43.788925 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:08:43.788925 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:08:43.788925 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 18 02:08:43.788925 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 18 02:08:43.788925 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Jul 18 02:08:43.788925 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:43.788925 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:43.788925 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:43.788925 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:43.788925 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:43.790071 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:43.790071 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:08:43.790071 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:08:43.790071 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:08:43.790071 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:08:43.790071 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 18 02:08:43.790071 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:08:43.790071 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Jul 18 02:08:43.790071 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:43.790071 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:43.790071 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:43.790071 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:43.790071 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:43.790071 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:43.790071 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:08:43.790071 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:08:43.790071 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Jul 18 02:08:43.790071 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:43.793048 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b5094a8f-abc4-480d-b884-9dedc6d38103 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:08:43.794256 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b5094a8f-abc4-480d-b884-9dedc6d38103 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] 10.222.0.57 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.050338 Jul 18 02:08:43.795582 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 139/298] 10.222.0.57 () {58 vars in 1151 bytes} [Mon Jul 18 02:08:43 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:08:43.816981 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-26b2d6f5-165c-40f5-b460-88f7a90d2a25 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:43.818053 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-26b2d6f5-165c-40f5-b460-88f7a90d2a25 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: 34961834-de57-4c1c-9ace-7bf4c43f8af8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:43.819238 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b24b8152-eb8a-4304-be7a-7c0b6c56811d tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:43.819815 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b24b8152-eb8a-4304-be7a-7c0b6c56811d tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:43.820778 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b24b8152-eb8a-4304-be7a-7c0b6c56811d tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:43.821280 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b24b8152-eb8a-4304-be7a-7c0b6c56811d tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:43.827612 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26b2d6f5-165c-40f5-b460-88f7a90d2a25 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:43.828311 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26b2d6f5-165c-40f5-b460-88f7a90d2a25 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:43.829510 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26b2d6f5-165c-40f5-b460-88f7a90d2a25 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:43.830246 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26b2d6f5-165c-40f5-b460-88f7a90d2a25 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:43.868075 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b24b8152-eb8a-4304-be7a-7c0b6c56811d tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] 10.222.0.57 "GET /compute/v2.1/os-quota-sets/3dd8515bf92e4202b6e14915399046b3/detail" status: 200 len: 916 microversion: 2.1 time: 0.197378 Jul 18 02:08:43.869623 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 160/299] 10.222.0.57 () {58 vars in 1262 bytes} [Mon Jul 18 02:08:43 2022] GET /compute/v2.1/os-quota-sets/3dd8515bf92e4202b6e14915399046b3/detail => generated 916 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:43.875646 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f300b8b0-e442-4f78-bf19-8949a1bcbee2 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:43.876926 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:43.876926 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:43.896960 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f300b8b0-e442-4f78-bf19-8949a1bcbee2 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:43.897410 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f300b8b0-e442-4f78-bf19-8949a1bcbee2 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:43.914668 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f300b8b0-e442-4f78-bf19-8949a1bcbee2 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:43.914668 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f300b8b0-e442-4f78-bf19-8949a1bcbee2 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:43.936237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.compute.aggregates [None req-f300b8b0-e442-4f78-bf19-8949a1bcbee2 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Failed to remove host nonexist_host from aggregate 15. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 18 02:08:43.936767 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-f300b8b0-e442-4f78-bf19-8949a1bcbee2 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 15 Jul 18 02:08:43.938737 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f300b8b0-e442-4f78-bf19-8949a1bcbee2 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Request method failure captured: Jul 18 02:08:43.938737 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/os-aggregates/15/action HTTP/1.1 Jul 18 02:08:43.938737 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:08:43.938737 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:08:43.938737 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:08:43.938737 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 42 Jul 18 02:08:43.938737 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:08:43.938737 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:08:43.938737 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:08:43.938737 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:08:43.938737 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MB0ZxGk9u4Uk_EwyzhZO-OJJqjtv3dHSHNJs6VOqzVpp3jV4rjfgDkwV6YwPlwtkSjiFmmE32wRoMGsc0hgCLWJe8dj2F3Y2H4Zs5GwZIurm_-eDLpp5YSzNdObxQlVqDh7XFLyy9iEElHlhfauWrhlGnW0m-nLS1BE4HV78Iqrvu0 Jul 18 02:08:43.938737 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:08:43.938737 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:08:43.938737 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:08:43.938737 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:08:43.938737 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:08:43.938737 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:08:43.938737 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: ce404d6e42ea47ba9edefc4b54608c80 Jul 18 02:08:43.938737 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-850183465 Jul 18 02:08:43.938737 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,admin,reader Jul 18 02:08:43.938737 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,admin,reader Jul 18 02:08:43.939999 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ce404d6e42ea47ba9edefc4b54608c80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ce404d6e42ea47ba9edefc4b54608c80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ce404d6e42ea47ba9edefc4b54608c80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ce404d6e42ea47ba9edefc4b54608c80"}]}] Jul 18 02:08:43.939999 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-850183465 Jul 18 02:08:43.939999 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: ce404d6e42ea47ba9edefc4b54608c80 Jul 18 02:08:43.939999 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-850183465 Jul 18 02:08:43.939999 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin Jul 18 02:08:43.939999 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:08:43.939999 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:08:43.939999 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 7b848a7089f342e0a3211f32d59a087a Jul 18 02:08:43.939999 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin Jul 18 02:08:43.939999 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 02:08:43.939999 n-d-465891-3 devstack@n-api.service[119543]: {"remove_host": {"host": "nonexist_host"}} Jul 18 02:08:43.939999 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:08:43.939999 n-d-465891-3 devstack@n-api.service[119543]: exception: Cannot remove host nonexist_host in aggregate 15 Jul 18 02:08:43.940706 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '15', 'body': {'remove_host': {'host': 'nonexist_host'}}} Jul 18 02:08:43.940706 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:08:43.940706 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:43.940706 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 18 02:08:43.940706 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 18 02:08:43.940706 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:08:43.940706 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:08:43.940706 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 18 02:08:43.940706 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 18 02:08:43.940706 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:08:43.940706 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:08:43.940706 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 18 02:08:43.940706 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 18 02:08:43.940706 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Jul 18 02:08:43.940706 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:43.940706 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:43.940706 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:43.940706 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:43.940706 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 18 02:08:43.940706 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 18 02:08:43.941905 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 18 02:08:43.941905 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 18 02:08:43.941905 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 18 02:08:43.941905 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:43.941905 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:43.941905 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:43.941905 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:43.941905 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Jul 18 02:08:43.941905 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Jul 18 02:08:43.941905 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 02:08:43.941905 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 02:08:43.941905 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:08:43.941905 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:08:43.941905 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:08:43.941905 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:08:43.941905 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 02:08:43.941905 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 02:08:43.941905 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6555, in remove_host_from_aggregate Jul 18 02:08:43.941905 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Jul 18 02:08:43.941905 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 18 02:08:43.943052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 18 02:08:43.943052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 18 02:08:43.943052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:43.943052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:43.943052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:43.943052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:43.943052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:43.943052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:43.943052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:08:43.943052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:08:43.943052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:08:43.943052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:08:43.943052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:08:43.943052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:08:43.943052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Jul 18 02:08:43.943052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 02:08:43.943052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 15 Jul 18 02:08:43.943052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:43.943052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:43.943052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:43.943052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:43.944147 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:43.944147 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:43.944147 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:08:43.944147 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:08:43.944147 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 15 Jul 18 02:08:43.944147 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:43.944147 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f300b8b0-e442-4f78-bf19-8949a1bcbee2 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 15 {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:08:43.944147 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f300b8b0-e442-4f78-bf19-8949a1bcbee2 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates/15/action" status: 404 len: 94 microversion: 2.1 time: 0.069380 Jul 18 02:08:43.946828 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 161/300] 10.222.0.57 () {60 vars in 1193 bytes} [Mon Jul 18 02:08:43 2022] POST /compute/v2.1/os-aggregates/15/action => generated 94 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:08:43.956023 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e7ed6714-d9d6-4996-bfcd-5acabec2b3e8 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:43.957139 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:43.957139 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:43.980949 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-e7ed6714-d9d6-4996-bfcd-5acabec2b3e8 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Jul 18 02:08:43.988943 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e7ed6714-d9d6-4996-bfcd-5acabec2b3e8 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Request method failure captured: Jul 18 02:08:43.988943 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Jul 18 02:08:43.988943 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:08:43.988943 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:08:43.988943 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:08:43.988943 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:08:43.988943 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:08:43.988943 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:08:43.988943 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:08:43.988943 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:08:43.988943 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MB21w9F4JhDDbKIGLkY2J_m1WjFi1fLoxzWCRAhWOMZKPJOPmgvnQvzjQAGav8QSVuXkZdzsbWCgIuA7VIqQwKgRLRLqQq4-I7t6n19Iv4zCaOlMctmAL7A1X-veyO5ZfqGg6BxvfrdUcouuLX7AuZv6k_ku3L4h_I2ztQRYx6lAqY Jul 18 02:08:43.988943 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:08:43.988943 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:08:43.988943 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:08:43.988943 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:08:43.988943 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:08:43.988943 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:08:43.988943 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 06f1499d14c64163a38974df4c6bfe10 Jul 18 02:08:43.988943 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-AggregatesAdminTestJSON-1480124188 Jul 18 02:08:43.988943 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,admin,reader Jul 18 02:08:43.988943 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,admin,reader Jul 18 02:08:43.990367 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_06f1499d14c64163a38974df4c6bfe10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/06f1499d14c64163a38974df4c6bfe10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/06f1499d14c64163a38974df4c6bfe10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/06f1499d14c64163a38974df4c6bfe10"}]}] Jul 18 02:08:43.990367 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-AggregatesAdminTestJSON-1480124188 Jul 18 02:08:43.990367 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 06f1499d14c64163a38974df4c6bfe10 Jul 18 02:08:43.990367 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1480124188 Jul 18 02:08:43.990367 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-AggregatesAdminTestJSON-1480124188-project-admin Jul 18 02:08:43.990367 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:08:43.990367 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:08:43.990367 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 5c1fdbd4cfa941f98ab25c588cacdc73 Jul 18 02:08:43.990367 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-AggregatesAdminTestJSON-1480124188-project-admin Jul 18 02:08:43.990367 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:08:43.990367 n-d-465891-3 devstack@n-api.service[119543]: exception: Aggregate 14 could not be found. Jul 18 02:08:43.990367 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '14'} Jul 18 02:08:43.990367 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:08:43.991070 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:43.991070 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 18 02:08:43.991070 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 18 02:08:43.991070 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 02:08:43.991070 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 02:08:43.991070 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:08:43.991070 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:08:43.991070 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:08:43.991070 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:08:43.991070 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 02:08:43.991070 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 02:08:43.991070 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 18 02:08:43.991070 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 18 02:08:43.991070 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:08:43.991070 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:08:43.991070 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 18 02:08:43.991070 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 18 02:08:43.991070 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:08:43.991070 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:08:43.992175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 18 02:08:43.992175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 18 02:08:43.992175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Jul 18 02:08:43.992175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:43.992175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:43.992175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:43.992175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:43.992175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:43.992175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:43.992175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:08:43.992175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:08:43.992175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:08:43.992175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:08:43.992175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 18 02:08:43.992175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:08:43.992175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Jul 18 02:08:43.992175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:43.992175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:43.992175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:43.992175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:43.992175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:43.994838 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:43.994838 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:08:43.994838 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:08:43.994838 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Jul 18 02:08:43.994838 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:43.994838 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e7ed6714-d9d6-4996-bfcd-5acabec2b3e8 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:08:43.994838 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e7ed6714-d9d6-4996-bfcd-5acabec2b3e8 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.043549 Jul 18 02:08:44.000646 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 162/301] 10.222.0.57 () {58 vars in 1154 bytes} [Mon Jul 18 02:08:43 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:08:44.010666 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9cbf2002-2317-43a0-92da-8d477fb9ae26 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:44.049164 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9cbf2002-2317-43a0-92da-8d477fb9ae26 tempest-AggregatesAdminNegativeTestJSON-850183465 tempest-AggregatesAdminNegativeTestJSON-850183465-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.044327 Jul 18 02:08:44.049808 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 163/302] 10.222.0.57 () {58 vars in 1154 bytes} [Mon Jul 18 02:08:44 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 02:08:44.109289 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6548dbbb-7635-4e34-bc5d-c1dff9e17dee tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-88444149"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:44.117737 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:44.117737 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:44.128508 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.aggregate [None req-6548dbbb-7635-4e34-bc5d-c1dff9e17dee tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Generated uuid bdfbb516-394e-4f40-8753-e9f2bf004525 for aggregate {{(pid=119543) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 02:08:44.226597 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6548dbbb-7635-4e34-bc5d-c1dff9e17dee tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.151154 Jul 18 02:08:44.238575 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 164/303] 10.222.0.57 () {60 vars in 1163 bytes} [Mon Jul 18 02:08:44 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:44.243522 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-63666f42-6bb6-45b4-a676-82b460aba180 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:44.268178 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-63666f42-6bb6-45b4-a676-82b460aba180 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: dbb215bf-6099-4dd5-b9af-d1bbfb55ef21] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:44.291442 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-63666f42-6bb6-45b4-a676-82b460aba180 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:44.291860 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-63666f42-6bb6-45b4-a676-82b460aba180 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:44.296893 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-63666f42-6bb6-45b4-a676-82b460aba180 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:44.297369 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-63666f42-6bb6-45b4-a676-82b460aba180 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:44.423788 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-26b2d6f5-165c-40f5-b460-88f7a90d2a25 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe4f42523df4204b49c9c0899c93fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0c0be2e96a499dbde6652cbc758a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:44.436437 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-26b2d6f5-165c-40f5-b460-88f7a90d2a25 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8" status: 200 len: 1476 microversion: 2.1 time: 0.639500 Jul 18 02:08:44.437145 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 140/304] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:43 2022] GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8 => generated 1476 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:44.443739 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c5b0b7ff-e511-4991-ace4-2734708d66b3 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:44.444503 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:44.444503 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:44.472784 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c5b0b7ff-e511-4991-ace4-2734708d66b3 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] 10.222.0.57 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 226 microversion: 2.1 time: 0.034159 Jul 18 02:08:44.478611 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 141/305] 10.222.0.57 () {58 vars in 1151 bytes} [Mon Jul 18 02:08:44 2022] GET /compute/v2.1/os-aggregates/16 => generated 226 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:44.482841 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-5fb0858a-65af-48cf-ac99-116490d2522c req-280fc8df-f200-4573-b97f-500971bcaace service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbb215bf-6099-4dd5-b9af-d1bbfb55ef21", "tag": "111c59e5-56e7-4304-b9bb-aa87d9966837"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:44.496816 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-5fb0858a-65af-48cf-ac99-116490d2522c req-280fc8df-f200-4573-b97f-500971bcaace service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:44.497327 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-5fb0858a-65af-48cf-ac99-116490d2522c req-280fc8df-f200-4573-b97f-500971bcaace service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:44.510825 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-5fb0858a-65af-48cf-ac99-116490d2522c req-280fc8df-f200-4573-b97f-500971bcaace service nova] Creating event network-changed:111c59e5-56e7-4304-b9bb-aa87d9966837 for instance dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 on n-h2-465891-3 Jul 18 02:08:44.520995 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-5fb0858a-65af-48cf-ac99-116490d2522c req-280fc8df-f200-4573-b97f-500971bcaace service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045454 Jul 18 02:08:44.522238 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 142/306] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:44.544690 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4a8e1a4c-4753-44ae-9343-3ea32c449245 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] Action: 'update', calling method: .version_select at 0x7ff4a94e6ee0>, body: {"quota_set": {"ram": "2048"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:44.978995 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4a8e1a4c-4753-44ae-9343-3ea32c449245 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:44.985204 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4a8e1a4c-4753-44ae-9343-3ea32c449245 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:44.988786 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4a8e1a4c-4753-44ae-9343-3ea32c449245 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:44.996306 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4a8e1a4c-4753-44ae-9343-3ea32c449245 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:45.112679 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4a8e1a4c-4753-44ae-9343-3ea32c449245 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:45.114335 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4a8e1a4c-4753-44ae-9343-3ea32c449245 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:45.118292 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4a8e1a4c-4753-44ae-9343-3ea32c449245 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:45.118937 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4a8e1a4c-4753-44ae-9343-3ea32c449245 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:45.289960 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4a8e1a4c-4753-44ae-9343-3ea32c449245 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-quota-sets/3dd8515bf92e4202b6e14915399046b3?user_id=ef686ec4b72948509a4f155f0d997315" status: 200 len: 328 microversion: 2.1 time: 0.755080 Jul 18 02:08:45.304466 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 143/307] 10.222.0.57 () {60 vars in 1342 bytes} [Mon Jul 18 02:08:44 2022] PUT /compute/v2.1/os-quota-sets/3dd8515bf92e4202b6e14915399046b3?user_id=ef686ec4b72948509a4f155f0d997315 => generated 328 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:45.311351 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-756c9606-be76-4e75-8aec-d83bb450a082 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:45.312778 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:45.312778 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:45.366748 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-756c9606-be76-4e75-8aec-d83bb450a082 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 264 microversion: 2.1 time: 0.059130 Jul 18 02:08:45.374911 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 144/308] 10.222.0.57 () {60 vars in 1193 bytes} [Mon Jul 18 02:08:45 2022] POST /compute/v2.1/os-aggregates/16/action => generated 264 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:45.382383 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a6456bef-83cd-424f-a79e-42ac1dfdb937 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] Calling method '.version_select at 0x7ff4a92f3940>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:45.562725 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-63666f42-6bb6-45b4-a676-82b460aba180 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60118d593f96437dbb2c68ad2fadd465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd02ce642caf4529a6e65c184de0ad19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:45.573154 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-63666f42-6bb6-45b4-a676-82b460aba180 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "GET /compute/v2.1/servers/dbb215bf-6099-4dd5-b9af-d1bbfb55ef21" status: 200 len: 1587 microversion: 2.1 time: 1.333415 Jul 18 02:08:45.590438 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 165/309] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:44 2022] GET /compute/v2.1/servers/dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 => generated 1587 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:45.595417 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cc6f67bf-ff1c-47b6-a707-9c4671404817 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:45.601218 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:45.601218 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:45.618787 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cc6f67bf-ff1c-47b6-a707-9c4671404817 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] 10.222.0.57 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 240 microversion: 2.1 time: 0.026882 Jul 18 02:08:45.619425 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 166/310] 10.222.0.57 () {58 vars in 1151 bytes} [Mon Jul 18 02:08:45 2022] GET /compute/v2.1/os-aggregates/16 => generated 240 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:45.637838 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cacd4ad2-30f6-40ef-806e-da12ab84aeb2 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:45.638706 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cacd4ad2-30f6-40ef-806e-da12ab84aeb2 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: 34961834-de57-4c1c-9ace-7bf4c43f8af8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:45.654248 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cacd4ad2-30f6-40ef-806e-da12ab84aeb2 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:45.656883 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cacd4ad2-30f6-40ef-806e-da12ab84aeb2 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:45.657748 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cacd4ad2-30f6-40ef-806e-da12ab84aeb2 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:45.658203 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cacd4ad2-30f6-40ef-806e-da12ab84aeb2 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:46.201549 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a6456bef-83cd-424f-a79e-42ac1dfdb937 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] 10.222.0.57 "GET /compute/v2.1/os-quota-sets/3dd8515bf92e4202b6e14915399046b3?user_id=ef686ec4b72948509a4f155f0d997315" status: 200 len: 370 microversion: 2.1 time: 0.825358 Jul 18 02:08:46.202444 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 145/311] 10.222.0.57 () {58 vars in 1322 bytes} [Mon Jul 18 02:08:45 2022] GET /compute/v2.1/os-quota-sets/3dd8515bf92e4202b6e14915399046b3?user_id=ef686ec4b72948509a4f155f0d997315 => generated 370 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:46.213977 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-40e0c6f2-94e0-418e-8013-74c207e429ad tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:46.217225 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:46.217225 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:46.263237 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-40e0c6f2-94e0-418e-8013-74c207e429ad tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.056338 Jul 18 02:08:46.263881 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 146/312] 10.222.0.57 () {58 vars in 1154 bytes} [Mon Jul 18 02:08:46 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 02:08:46.278106 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f01f28b8-7bd9-465f-bd82-7db4557bffb0 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-797167291", "availability_zone": "tempest-test_az-1741535364"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:46.284138 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:46.284138 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:46.289253 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.aggregate [None req-f01f28b8-7bd9-465f-bd82-7db4557bffb0 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Generated uuid 8668e831-c658-41d8-a324-7096522101a0 for aggregate {{(pid=119544) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 02:08:46.303823 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=5,nova_api:UPDATE=2,nova_api:DELETE=7 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:08:46.358546 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f01f28b8-7bd9-465f-bd82-7db4557bffb0 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.088621 Jul 18 02:08:46.360262 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 147/313] 10.222.0.57 () {60 vars in 1164 bytes} [Mon Jul 18 02:08:46 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:46.371620 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bfa762d3-f495-4c24-8c5a-f3e218aaa1f0 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-797167291_new", "availability_zone": "tempest-test_az-1741535364_new"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:46.583926 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:46.583926 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:46.672988 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bfa762d3-f495-4c24-8c5a-f3e218aaa1f0 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:46.674022 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bfa762d3-f495-4c24-8c5a-f3e218aaa1f0 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:46.752588 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bfa762d3-f495-4c24-8c5a-f3e218aaa1f0 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 336 microversion: 2.1 time: 0.385655 Jul 18 02:08:46.755843 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 148/314] 10.222.0.57 () {60 vars in 1172 bytes} [Mon Jul 18 02:08:46 2022] PUT /compute/v2.1/os-aggregates/17 => generated 336 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:08:46.768251 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-28502820-b400-4271-9175-12b063f2962f tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:46.771426 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:46.771426 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:46.790647 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-28502820-b400-4271-9175-12b063f2962f tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] 10.222.0.57 "GET /compute/v2.1/os-aggregates" status: 200 len: 339 microversion: 2.1 time: 0.026004 Jul 18 02:08:46.791885 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 149/315] 10.222.0.57 () {58 vars in 1142 bytes} [Mon Jul 18 02:08:46 2022] GET /compute/v2.1/os-aggregates => generated 339 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:08:46.807754 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1eb74d54-f542-4ebf-96a6-b9f267986548 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:46.808661 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:46.808661 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:46.884468 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1eb74d54-f542-4ebf-96a6-b9f267986548 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.082230 Jul 18 02:08:46.887466 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 150/316] 10.222.0.57 () {58 vars in 1154 bytes} [Mon Jul 18 02:08:46 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 18 02:08:46.908193 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6fc34c72-fb4c-49b7-bf8e-33fd7979b02b tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1913297925"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:46.909458 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:46.909458 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:46.918525 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.aggregate [None req-6fc34c72-fb4c-49b7-bf8e-33fd7979b02b tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Generated uuid 7e921f43-ce59-46da-9379-41013d7ce93f for aggregate {{(pid=119544) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 02:08:46.999664 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6fc34c72-fb4c-49b7-bf8e-33fd7979b02b tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.107723 Jul 18 02:08:47.004118 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 151/317] 10.222.0.57 () {60 vars in 1163 bytes} [Mon Jul 18 02:08:46 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:47.013959 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a9fe88e4-1c54-49bd-a144-060e6d1b1905 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:47.023517 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:47.023517 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:47.046031 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a9fe88e4-1c54-49bd-a144-060e6d1b1905 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] 10.222.0.57 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.038857 Jul 18 02:08:47.047279 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 152/318] 10.222.0.57 () {58 vars in 1142 bytes} [Mon Jul 18 02:08:47 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:47.058532 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0a1c2c67-af70-4bd7-8779-2b2ec9e02e26 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:47.060199 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:47.060199 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:47.071716 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cacd4ad2-30f6-40ef-806e-da12ab84aeb2 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe4f42523df4204b49c9c0899c93fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0c0be2e96a499dbde6652cbc758a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:47.085856 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cacd4ad2-30f6-40ef-806e-da12ab84aeb2 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8" status: 200 len: 1476 microversion: 2.1 time: 1.465343 Jul 18 02:08:47.094317 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 167/319] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:45 2022] GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8 => generated 1476 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:47.133955 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0a1c2c67-af70-4bd7-8779-2b2ec9e02e26 tempest-AggregatesAdminTestJSON-1480124188 tempest-AggregatesAdminTestJSON-1480124188-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.079093 Jul 18 02:08:47.144799 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cf02a10a-7111-4741-ab67-4c02fc885cec tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:47.148200 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 153/320] 10.222.0.57 () {58 vars in 1154 bytes} [Mon Jul 18 02:08:47 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 02:08:47.149590 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cf02a10a-7111-4741-ab67-4c02fc885cec tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] [instance: e5dbcad3-c8b1-4113-862a-6010a666b490] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:47.158701 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cf02a10a-7111-4741-ab67-4c02fc885cec tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:47.159205 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cf02a10a-7111-4741-ab67-4c02fc885cec tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:47.160401 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cf02a10a-7111-4741-ab67-4c02fc885cec tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:47.160971 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cf02a10a-7111-4741-ab67-4c02fc885cec tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:47.207692 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-cf02a10a-7111-4741-ab67-4c02fc885cec tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] HTTP exception thrown: Instance e5dbcad3-c8b1-4113-862a-6010a666b490 could not be found. Jul 18 02:08:47.209809 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cf02a10a-7111-4741-ab67-4c02fc885cec tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Request method failure captured: Jul 18 02:08:47.209809 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490 HTTP/1.1 Jul 18 02:08:47.209809 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:08:47.209809 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:08:47.209809 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:08:47.209809 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:08:47.209809 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:08:47.209809 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:08:47.209809 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:08:47.209809 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:08:47.209809 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MBzKUZ2yAchvKjG79tkBVmhNl99unW7exa88w7W1GiDVrDIc9bntu1HL3HG-0cS7XDUAaCsV1JSpJ3fJDbdeGWsNgwzlSd-6CnzQCcGNKTMiqL_ZQZngefsOq8bRReOxdHmpafPWTSdTfVKBd0JV26hzlEEgqao-XocRYYU7nPen4E Jul 18 02:08:47.209809 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:08:47.209809 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:08:47.209809 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:08:47.209809 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:08:47.209809 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:08:47.209809 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:08:47.209809 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: cd036e434ea348338dfb0fed060b66d7 Jul 18 02:08:47.209809 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-AggregatesAdminTestJSON-857543 Jul 18 02:08:47.209809 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:08:47.209809 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:08:47.211109 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_cd036e434ea348338dfb0fed060b66d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/cd036e434ea348338dfb0fed060b66d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/cd036e434ea348338dfb0fed060b66d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/cd036e434ea348338dfb0fed060b66d7"}]}] Jul 18 02:08:47.211109 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-AggregatesAdminTestJSON-857543 Jul 18 02:08:47.211109 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: cd036e434ea348338dfb0fed060b66d7 Jul 18 02:08:47.211109 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-857543 Jul 18 02:08:47.211109 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-AggregatesAdminTestJSON-857543-project Jul 18 02:08:47.211109 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:08:47.211109 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:08:47.211109 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: c93a266d6b1f4d718af3724d8b78f6a4 Jul 18 02:08:47.211109 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-AggregatesAdminTestJSON-857543-project Jul 18 02:08:47.211109 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:08:47.211109 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance e5dbcad3-c8b1-4113-862a-6010a666b490 could not be found. Jul 18 02:08:47.211109 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'e5dbcad3-c8b1-4113-862a-6010a666b490'} Jul 18 02:08:47.211745 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:08:47.211745 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:47.211745 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:08:47.211745 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:08:47.211745 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:08:47.211745 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:08:47.211745 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:08:47.211745 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:08:47.211745 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:08:47.211745 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:08:47.211745 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5dbcad3-c8b1-4113-862a-6010a666b490 could not be found. Jul 18 02:08:47.211745 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:47.211745 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:47.211745 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:47.211745 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:47.211745 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:47.211745 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:47.211745 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:08:47.211745 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:08:47.211745 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:08:47.212798 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:08:47.212798 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:08:47.212798 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:08:47.212798 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:08:47.212798 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:08:47.212798 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:08:47.212798 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:08:47.212798 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:08:47.212798 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:08:47.212798 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5dbcad3-c8b1-4113-862a-6010a666b490 could not be found. Jul 18 02:08:47.212798 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:47.212798 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:47.212798 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:47.212798 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:47.212798 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:47.212798 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:47.212798 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:08:47.212798 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:08:47.212798 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5dbcad3-c8b1-4113-862a-6010a666b490 could not be found. Jul 18 02:08:47.212798 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:47.213897 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cf02a10a-7111-4741-ab67-4c02fc885cec tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Returning 404 to user: Instance e5dbcad3-c8b1-4113-862a-6010a666b490 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:08:47.213897 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cf02a10a-7111-4741-ab67-4c02fc885cec tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] 10.222.0.57 "DELETE /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490" status: 404 len: 111 microversion: 2.1 time: 0.070845 Jul 18 02:08:47.213897 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 168/321] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:08:47 2022] DELETE /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:08:47.229603 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0afc52d0-d4f3-430d-8dbe-19dfd47a293b tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:47.230489 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0afc52d0-d4f3-430d-8dbe-19dfd47a293b tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] [instance: e5dbcad3-c8b1-4113-862a-6010a666b490] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:47.244562 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0afc52d0-d4f3-430d-8dbe-19dfd47a293b tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:47.245492 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0afc52d0-d4f3-430d-8dbe-19dfd47a293b tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:47.247773 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0afc52d0-d4f3-430d-8dbe-19dfd47a293b tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:47.249003 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0afc52d0-d4f3-430d-8dbe-19dfd47a293b tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:47.290310 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-0afc52d0-d4f3-430d-8dbe-19dfd47a293b tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] HTTP exception thrown: Instance e5dbcad3-c8b1-4113-862a-6010a666b490 could not be found. Jul 18 02:08:47.293228 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0afc52d0-d4f3-430d-8dbe-19dfd47a293b tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Request method failure captured: Jul 18 02:08:47.293228 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490 HTTP/1.1 Jul 18 02:08:47.293228 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:08:47.293228 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:08:47.293228 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:08:47.293228 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:08:47.293228 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:08:47.293228 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:08:47.293228 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:08:47.293228 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:08:47.293228 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MBzKUZ2yAchvKjG79tkBVmhNl99unW7exa88w7W1GiDVrDIc9bntu1HL3HG-0cS7XDUAaCsV1JSpJ3fJDbdeGWsNgwzlSd-6CnzQCcGNKTMiqL_ZQZngefsOq8bRReOxdHmpafPWTSdTfVKBd0JV26hzlEEgqao-XocRYYU7nPen4E Jul 18 02:08:47.293228 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:08:47.293228 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:08:47.293228 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:08:47.293228 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:08:47.293228 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:08:47.293228 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:08:47.293228 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: cd036e434ea348338dfb0fed060b66d7 Jul 18 02:08:47.293228 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-AggregatesAdminTestJSON-857543 Jul 18 02:08:47.293228 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:08:47.293228 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:08:47.294779 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_cd036e434ea348338dfb0fed060b66d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/cd036e434ea348338dfb0fed060b66d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/cd036e434ea348338dfb0fed060b66d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/cd036e434ea348338dfb0fed060b66d7"}]}] Jul 18 02:08:47.294779 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-AggregatesAdminTestJSON-857543 Jul 18 02:08:47.294779 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: cd036e434ea348338dfb0fed060b66d7 Jul 18 02:08:47.294779 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-857543 Jul 18 02:08:47.294779 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-AggregatesAdminTestJSON-857543-project Jul 18 02:08:47.294779 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:08:47.294779 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:08:47.294779 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: c93a266d6b1f4d718af3724d8b78f6a4 Jul 18 02:08:47.294779 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-AggregatesAdminTestJSON-857543-project Jul 18 02:08:47.294779 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:08:47.294779 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance e5dbcad3-c8b1-4113-862a-6010a666b490 could not be found. Jul 18 02:08:47.294779 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'e5dbcad3-c8b1-4113-862a-6010a666b490'} Jul 18 02:08:47.295579 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:08:47.295579 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:47.295579 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:08:47.295579 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:08:47.295579 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:08:47.295579 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:08:47.295579 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:08:47.295579 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:08:47.295579 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:08:47.295579 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:08:47.295579 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5dbcad3-c8b1-4113-862a-6010a666b490 could not be found. Jul 18 02:08:47.295579 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:47.295579 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:47.295579 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:47.295579 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:47.295579 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:47.295579 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:47.295579 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:08:47.295579 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:08:47.295579 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:08:47.298087 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:08:47.298087 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:08:47.298087 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:08:47.298087 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:08:47.298087 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:08:47.298087 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:08:47.298087 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:08:47.298087 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5dbcad3-c8b1-4113-862a-6010a666b490 could not be found. Jul 18 02:08:47.298087 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:47.298087 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:47.298087 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:47.298087 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:47.298087 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:47.298087 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:47.298087 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:08:47.298087 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:08:47.298087 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5dbcad3-c8b1-4113-862a-6010a666b490 could not be found. Jul 18 02:08:47.298087 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:08:47.301247 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0afc52d0-d4f3-430d-8dbe-19dfd47a293b tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] Returning 404 to user: Instance e5dbcad3-c8b1-4113-862a-6010a666b490 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:08:47.302987 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0afc52d0-d4f3-430d-8dbe-19dfd47a293b tempest-AggregatesAdminTestJSON-857543 tempest-AggregatesAdminTestJSON-857543-project] 10.222.0.57 "GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490" status: 404 len: 111 microversion: 2.1 time: 0.085068 Jul 18 02:08:47.311103 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 154/322] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:47 2022] GET /compute/v2.1/servers/e5dbcad3-c8b1-4113-862a-6010a666b490 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:08:47.349690 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-53d429cd-b1ca-4696-88db-e1716ece5572 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] Calling method '.version_select at 0x7ff4a94b6d30>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:48.113436 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-dfc34854-f3ec-41cc-875e-650c0a93b08d tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:48.114135 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-dfc34854-f3ec-41cc-875e-650c0a93b08d tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: 34961834-de57-4c1c-9ace-7bf4c43f8af8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:48.129796 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dfc34854-f3ec-41cc-875e-650c0a93b08d tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:48.131093 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dfc34854-f3ec-41cc-875e-650c0a93b08d tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:48.131919 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dfc34854-f3ec-41cc-875e-650c0a93b08d tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:48.132352 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dfc34854-f3ec-41cc-875e-650c0a93b08d tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:48.157508 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-53d429cd-b1ca-4696-88db-e1716ece5572 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] 10.222.0.57 "GET /compute/v2.1/os-quota-sets/d405ec54fa60400f9e09547218477834/defaults" status: 200 len: 371 microversion: 2.1 time: 0.812370 Jul 18 02:08:48.166199 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 169/323] 10.222.0.57 () {58 vars in 1268 bytes} [Mon Jul 18 02:08:47 2022] GET /compute/v2.1/os-quota-sets/d405ec54fa60400f9e09547218477834/defaults => generated 371 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:48.183527 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-88214799-1367-46e1-acff-ad1cdc2d5534 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] Action: 'update', calling method: .version_select at 0x7ff4a94c2160>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:48.277951 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-dfc34854-f3ec-41cc-875e-650c0a93b08d tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe4f42523df4204b49c9c0899c93fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0c0be2e96a499dbde6652cbc758a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:48.290386 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-dfc34854-f3ec-41cc-875e-650c0a93b08d tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8" status: 200 len: 1434 microversion: 2.1 time: 0.186030 Jul 18 02:08:48.290977 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 155/324] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:48 2022] GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8 => generated 1434 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:08:48.537289 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-88214799-1367-46e1-acff-ad1cdc2d5534 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:48.537759 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-88214799-1367-46e1-acff-ad1cdc2d5534 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:48.538570 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-88214799-1367-46e1-acff-ad1cdc2d5534 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:48.538998 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-88214799-1367-46e1-acff-ad1cdc2d5534 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:48.631813 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-8306586d-7501-4b6c-8390-edce1ba2f31b req-44561115-fe6d-43ba-bdfc-8ad1d680a015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34961834-de57-4c1c-9ace-7bf4c43f8af8", "name": "network-vif-deleted", "tag": "e2c5d317-4ca7-4174-8082-778a84325c43"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:48.696191 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-8306586d-7501-4b6c-8390-edce1ba2f31b req-44561115-fe6d-43ba-bdfc-8ad1d680a015 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:48.698488 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-8306586d-7501-4b6c-8390-edce1ba2f31b req-44561115-fe6d-43ba-bdfc-8ad1d680a015 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:48.748886 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-8306586d-7501-4b6c-8390-edce1ba2f31b req-44561115-fe6d-43ba-bdfc-8ad1d680a015 service nova] Creating event network-vif-deleted:e2c5d317-4ca7-4174-8082-778a84325c43 for instance 34961834-de57-4c1c-9ace-7bf4c43f8af8 on n-h1-465891-3 Jul 18 02:08:48.780935 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-8306586d-7501-4b6c-8390-edce1ba2f31b req-44561115-fe6d-43ba-bdfc-8ad1d680a015 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155002 Jul 18 02:08:48.784275 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 156/325] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:48.877310 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=7,nova_api:INSERT=14 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:08:49.055588 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-88214799-1367-46e1-acff-ad1cdc2d5534 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-quota-sets/d405ec54fa60400f9e09547218477834" status: 200 len: 329 microversion: 2.1 time: 0.886788 Jul 18 02:08:49.061903 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 170/326] 10.222.0.57 () {60 vars in 1262 bytes} [Mon Jul 18 02:08:48 2022] PUT /compute/v2.1/os-quota-sets/d405ec54fa60400f9e09547218477834 => generated 329 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:49.072355 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3daede83-4b43-443a-9461-5f50fa5b3bf9 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] Action: 'update', calling method: .version_select at 0x7ff4a92f88b0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:49.309564 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-615b9a3e-ce3a-4b4a-92a0-b4aab4a37ef5 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:49.311295 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-615b9a3e-ce3a-4b4a-92a0-b4aab4a37ef5 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: 34961834-de57-4c1c-9ace-7bf4c43f8af8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:49.325175 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-615b9a3e-ce3a-4b4a-92a0-b4aab4a37ef5 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:49.325835 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-615b9a3e-ce3a-4b4a-92a0-b4aab4a37ef5 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:49.326883 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-615b9a3e-ce3a-4b4a-92a0-b4aab4a37ef5 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:49.327576 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-615b9a3e-ce3a-4b4a-92a0-b4aab4a37ef5 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:49.406137 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-615b9a3e-ce3a-4b4a-92a0-b4aab4a37ef5 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:49.406137 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-615b9a3e-ce3a-4b4a-92a0-b4aab4a37ef5 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:49.407175 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-615b9a3e-ce3a-4b4a-92a0-b4aab4a37ef5 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lazy-loading 'fault' on Instance uuid 34961834-de57-4c1c-9ace-7bf4c43f8af8 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:08:49.564757 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-615b9a3e-ce3a-4b4a-92a0-b4aab4a37ef5 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe4f42523df4204b49c9c0899c93fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0c0be2e96a499dbde6652cbc758a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:49.585864 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-615b9a3e-ce3a-4b4a-92a0-b4aab4a37ef5 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8" status: 200 len: 1310 microversion: 2.1 time: 0.281499 Jul 18 02:08:49.611671 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 171/327] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:49 2022] GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8 => generated 1310 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:50.143734 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3daede83-4b43-443a-9461-5f50fa5b3bf9 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:50.145406 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3daede83-4b43-443a-9461-5f50fa5b3bf9 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:50.145989 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3daede83-4b43-443a-9461-5f50fa5b3bf9 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:50.148845 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3daede83-4b43-443a-9461-5f50fa5b3bf9 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:50.526467 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0fcb4427-e4af-44ef-b044-670f6a8c470a tempest-FloatingIPDetailsNegativeTestJSON-1269006266 tempest-FloatingIPDetailsNegativeTestJSON-1269006266-project] Calling method '.version_select at 0x7ff4a9434310>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:50.654616 n-d-465891-3 devstack@n-api.service[119543]: DEBUG neutronclient.v2_0.client [None req-0fcb4427-e4af-44ef-b044-670f6a8c470a tempest-FloatingIPDetailsNegativeTestJSON-1269006266 tempest-FloatingIPDetailsNegativeTestJSON-1269006266-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP e057005a-8f83-40de-88ff-0a9b9968a0a6 could not be found", "detail": ""}} {{(pid=119543) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:08:50.655326 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-0fcb4427-e4af-44ef-b044-670f6a8c470a tempest-FloatingIPDetailsNegativeTestJSON-1269006266 tempest-FloatingIPDetailsNegativeTestJSON-1269006266-project] HTTP exception thrown: Floating IP not found for ID e057005a-8f83-40de-88ff-0a9b9968a0a6 Jul 18 02:08:50.669913 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0fcb4427-e4af-44ef-b044-670f6a8c470a tempest-FloatingIPDetailsNegativeTestJSON-1269006266 tempest-FloatingIPDetailsNegativeTestJSON-1269006266-project] Request method failure captured: Jul 18 02:08:50.669913 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/os-floating-ips/e057005a-8f83-40de-88ff-0a9b9968a0a6 HTTP/1.1 Jul 18 02:08:50.669913 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:08:50.669913 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:08:50.669913 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:08:50.669913 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:08:50.669913 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:08:50.669913 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:08:50.669913 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:08:50.669913 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:08:50.669913 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MCxSGAmz_Si-ZXRlKkd-nouOgJE2MlU_eUewhxmuw6PgshWh3xCL4NRv7lJGDjaHYkvf9ugja5_QH5PJYMDkJ86NzgaKz6YCoyIy_eZ3Y6VOE1oSN3bi6ZMsG8S6ZGomFQXgSic4iZ32J7y8ZPjFnb0KPowDN0bOjZIBzu1f91gLkA Jul 18 02:08:50.669913 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:08:50.669913 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:08:50.669913 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:08:50.669913 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:08:50.669913 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:08:50.669913 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:08:50.669913 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: b7435e8916784881a09050e1928a44b4 Jul 18 02:08:50.669913 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1269006266 Jul 18 02:08:50.669913 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:08:50.669913 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:08:50.671251 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b7435e8916784881a09050e1928a44b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b7435e8916784881a09050e1928a44b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b7435e8916784881a09050e1928a44b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b7435e8916784881a09050e1928a44b4"}]}] Jul 18 02:08:50.671251 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1269006266 Jul 18 02:08:50.671251 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: b7435e8916784881a09050e1928a44b4 Jul 18 02:08:50.671251 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1269006266 Jul 18 02:08:50.671251 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1269006266-project Jul 18 02:08:50.671251 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:08:50.671251 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:08:50.671251 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 7c91eeed64a6439f890f4c76443a2d66 Jul 18 02:08:50.671251 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1269006266-project Jul 18 02:08:50.671251 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:08:50.671251 n-d-465891-3 devstack@n-api.service[119543]: exception: Floating IP not found for ID e057005a-8f83-40de-88ff-0a9b9968a0a6 Jul 18 02:08:50.671251 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'e057005a-8f83-40de-88ff-0a9b9968a0a6'} Jul 18 02:08:50.672003 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:08:50.672003 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:50.672003 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 18 02:08:50.672003 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 18 02:08:50.672003 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:08:50.672003 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:08:50.672003 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 18 02:08:50.672003 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 18 02:08:50.672003 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:08:50.672003 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:08:50.672003 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 02:08:50.672003 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 02:08:50.672003 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:08:50.672003 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:08:50.672003 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:08:50.672003 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:08:50.672003 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:08:50.672003 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:08:50.672003 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:08:50.673059 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:08:50.673059 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:08:50.673059 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:08:50.673059 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:08:50.673059 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:08:50.673059 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:08:50.673059 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:08:50.673059 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP e057005a-8f83-40de-88ff-0a9b9968a0a6 could not be found Jul 18 02:08:50.673059 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aeb4c875-2b36-42ce-94ff-f49ed4745f49'] Jul 18 02:08:50.673059 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:50.673059 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:50.673059 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:50.673059 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:50.673059 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 18 02:08:50.673059 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 18 02:08:50.673059 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 18 02:08:50.673059 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 18 02:08:50.673059 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID e057005a-8f83-40de-88ff-0a9b9968a0a6. Jul 18 02:08:50.673059 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:50.674263 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:50.674263 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:50.674263 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:50.674263 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:50.674263 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:50.674263 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:08:50.674263 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:08:50.674263 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:08:50.674263 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:08:50.674263 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:08:50.674263 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:08:50.674263 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 18 02:08:50.674263 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 18 02:08:50.674263 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID e057005a-8f83-40de-88ff-0a9b9968a0a6 Jul 18 02:08:50.674263 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:50.674263 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:50.674263 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:50.674263 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:50.674263 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:50.674263 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:50.674263 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:08:50.676103 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:08:50.676103 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID e057005a-8f83-40de-88ff-0a9b9968a0a6 Jul 18 02:08:50.676103 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:50.682952 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0fcb4427-e4af-44ef-b044-670f6a8c470a tempest-FloatingIPDetailsNegativeTestJSON-1269006266 tempest-FloatingIPDetailsNegativeTestJSON-1269006266-project] Returning 404 to user: Floating IP not found for ID e057005a-8f83-40de-88ff-0a9b9968a0a6 {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:08:50.687402 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0fcb4427-e4af-44ef-b044-670f6a8c470a tempest-FloatingIPDetailsNegativeTestJSON-1269006266 tempest-FloatingIPDetailsNegativeTestJSON-1269006266-project] 10.222.0.57 "GET /compute/v2.1/os-floating-ips/e057005a-8f83-40de-88ff-0a9b9968a0a6" status: 404 len: 111 microversion: 2.1 time: 1.067169 Jul 18 02:08:50.691917 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 172/328] 10.222.0.57 () {58 vars in 1259 bytes} [Mon Jul 18 02:08:49 2022] GET /compute/v2.1/os-floating-ips/e057005a-8f83-40de-88ff-0a9b9968a0a6 => generated 111 bytes in 1073 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:08:50.706590 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-97d36970-b591-4490-83e3-f36d9524259c tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:50.711986 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-97d36970-b591-4490-83e3-f36d9524259c tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: 34961834-de57-4c1c-9ace-7bf4c43f8af8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:50.713642 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:INSERT=16,nova_api:SELECT=66,nova_api:UPDATE=14,nova_api:DELETE=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:08:50.733516 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-97d36970-b591-4490-83e3-f36d9524259c tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:50.735553 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-97d36970-b591-4490-83e3-f36d9524259c tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:50.740167 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-97d36970-b591-4490-83e3-f36d9524259c tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:50.740787 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-97d36970-b591-4490-83e3-f36d9524259c tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:50.778320 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-97d36970-b591-4490-83e3-f36d9524259c tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] HTTP exception thrown: Instance 34961834-de57-4c1c-9ace-7bf4c43f8af8 could not be found. Jul 18 02:08:50.782625 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-97d36970-b591-4490-83e3-f36d9524259c tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Request method failure captured: Jul 18 02:08:50.782625 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8 HTTP/1.1 Jul 18 02:08:50.782625 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:08:50.782625 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:08:50.782625 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:08:50.782625 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:08:50.782625 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:08:50.782625 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:08:50.782625 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:08:50.782625 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:08:50.782625 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MCFGcQ62-kJ6tmwfnRCC6u10rWmhq7unKp06qv9ZCdAYGRVt2yNWxL8yl6uhfaq0Fdbz6CAN1dIrD86B_-Z7qDHMnNrqn3RnxLGcBc3_Vo4o-PyQQfVMWjWLPzih7wtecnh7BcHp8OhEzp4gQFdY-x6VOWWgHg0ta9Q54MYs2-Rdyo Jul 18 02:08:50.782625 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:08:50.782625 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:08:50.782625 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:08:50.782625 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:08:50.782625 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:08:50.782625 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:08:50.782625 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 5b0c0be2e96a499dbde6652cbc758a27 Jul 18 02:08:50.782625 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-DeleteServersAdminTestJSON-375900714 Jul 18 02:08:50.782625 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:08:50.782625 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:08:50.783977 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5b0c0be2e96a499dbde6652cbc758a27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5b0c0be2e96a499dbde6652cbc758a27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5b0c0be2e96a499dbde6652cbc758a27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5b0c0be2e96a499dbde6652cbc758a27"}]}] Jul 18 02:08:50.783977 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-DeleteServersAdminTestJSON-375900714 Jul 18 02:08:50.783977 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 5b0c0be2e96a499dbde6652cbc758a27 Jul 18 02:08:50.783977 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-375900714 Jul 18 02:08:50.783977 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-DeleteServersAdminTestJSON-375900714-project Jul 18 02:08:50.783977 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:08:50.783977 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:08:50.783977 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: efe4f42523df4204b49c9c0899c93fc7 Jul 18 02:08:50.783977 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-DeleteServersAdminTestJSON-375900714-project Jul 18 02:08:50.783977 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:08:50.783977 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 34961834-de57-4c1c-9ace-7bf4c43f8af8 could not be found. Jul 18 02:08:50.783977 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '34961834-de57-4c1c-9ace-7bf4c43f8af8'} Jul 18 02:08:50.785233 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:08:50.785233 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:50.785233 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:08:50.785233 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:08:50.785233 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:08:50.785233 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:08:50.785233 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:08:50.785233 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:08:50.785233 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:08:50.785233 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:08:50.785233 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34961834-de57-4c1c-9ace-7bf4c43f8af8 could not be found. Jul 18 02:08:50.785233 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:50.785233 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:50.785233 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:50.785233 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:50.785233 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:50.785233 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:50.785233 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:08:50.785233 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:08:50.785233 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:08:50.786488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:08:50.786488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:08:50.786488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:08:50.786488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:08:50.786488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:08:50.786488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:08:50.786488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:08:50.786488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34961834-de57-4c1c-9ace-7bf4c43f8af8 could not be found. Jul 18 02:08:50.786488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:50.786488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:08:50.786488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:50.786488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:08:50.786488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:08:50.786488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:08:50.786488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:08:50.786488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:08:50.786488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34961834-de57-4c1c-9ace-7bf4c43f8af8 could not be found. Jul 18 02:08:50.786488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:08:50.787487 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-97d36970-b591-4490-83e3-f36d9524259c tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Returning 404 to user: Instance 34961834-de57-4c1c-9ace-7bf4c43f8af8 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:08:50.787487 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-97d36970-b591-4490-83e3-f36d9524259c tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8" status: 404 len: 111 microversion: 2.1 time: 0.091577 Jul 18 02:08:50.792503 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 173/329] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:50 2022] GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:08:50.821005 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3daede83-4b43-443a-9461-5f50fa5b3bf9 tempest-QuotasAdminTestJSON-83147051 tempest-QuotasAdminTestJSON-83147051-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-quota-sets/d405ec54fa60400f9e09547218477834" status: 200 len: 329 microversion: 2.1 time: 1.754796 Jul 18 02:08:50.826324 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 157/330] 10.222.0.57 () {60 vars in 1262 bytes} [Mon Jul 18 02:08:49 2022] PUT /compute/v2.1/os-quota-sets/d405ec54fa60400f9e09547218477834 => generated 329 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:51.328346 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-07960af3-badb-4001-8489-efc764306f7a tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-584005116", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:51.453207 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-07960af3-badb-4001-8489-efc764306f7a tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] validate_networks() for None {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:08:51.923597 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-07960af3-badb-4001-8489-efc764306f7a tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:08:51.924919 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-07960af3-badb-4001-8489-efc764306f7a tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:08:51.926519 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-07960af3-badb-4001-8489-efc764306f7a tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:08:51.927757 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-07960af3-badb-4001-8489-efc764306f7a tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:08:51.929038 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-07960af3-badb-4001-8489-efc764306f7a tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:08:51.941831 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=90,nova_cell0:UPDATE=7 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:08:51.946084 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-07960af3-badb-4001-8489-efc764306f7a tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:51.947547 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-07960af3-badb-4001-8489-efc764306f7a tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:51.949588 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-07960af3-badb-4001-8489-efc764306f7a tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:51.950265 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-07960af3-badb-4001-8489-efc764306f7a tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:52.026518 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-07960af3-badb-4001-8489-efc764306f7a tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Getting quotas for project 5b0c0be2e96a499dbde6652cbc758a27. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:08:52.038392 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-07960af3-badb-4001-8489-efc764306f7a tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Getting quotas for user efe4f42523df4204b49c9c0899c93fc7 and project 5b0c0be2e96a499dbde6652cbc758a27. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:08:52.066772 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-07960af3-badb-4001-8489-efc764306f7a tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:08:52.074324 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-07960af3-badb-4001-8489-efc764306f7a tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: c71fb3ed-b430-443d-b16d-308cc483d3b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:08:52.177116 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-07960af3-badb-4001-8489-efc764306f7a tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.854038 Jul 18 02:08:52.186970 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 174/331] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:08:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 02:08:52.208767 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1d4dec2b-883b-4982-877a-81ff4f315721 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:52.209400 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1d4dec2b-883b-4982-877a-81ff4f315721 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: c71fb3ed-b430-443d-b16d-308cc483d3b2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:52.304939 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1d4dec2b-883b-4982-877a-81ff4f315721 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe4f42523df4204b49c9c0899c93fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0c0be2e96a499dbde6652cbc758a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:52.314224 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1d4dec2b-883b-4982-877a-81ff4f315721 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "GET /compute/v2.1/servers/c71fb3ed-b430-443d-b16d-308cc483d3b2" status: 200 len: 1219 microversion: 2.1 time: 0.125363 Jul 18 02:08:52.315407 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 175/332] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:52 2022] GET /compute/v2.1/servers/c71fb3ed-b430-443d-b16d-308cc483d3b2 => generated 1219 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:52.890709 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-644b91f1-b922-4cbb-a8ce-761552436cbf tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-994307737", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "9b9ef786-bd16-4bad-95f6-48c8b48d49f7"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:53.041595 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-644b91f1-b922-4cbb-a8ce-761552436cbf tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] validate_networks() for [('9b9ef786-bd16-4bad-95f6-48c8b48d49f7', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:08:53.332865 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-20165a05-55e3-492c-a4c6-5be30d935048 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:53.333488 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-20165a05-55e3-492c-a4c6-5be30d935048 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: c71fb3ed-b430-443d-b16d-308cc483d3b2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:53.341260 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20165a05-55e3-492c-a4c6-5be30d935048 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:53.355202 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20165a05-55e3-492c-a4c6-5be30d935048 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:53.368808 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20165a05-55e3-492c-a4c6-5be30d935048 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:53.369515 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20165a05-55e3-492c-a4c6-5be30d935048 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:53.609485 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-20165a05-55e3-492c-a4c6-5be30d935048 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe4f42523df4204b49c9c0899c93fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0c0be2e96a499dbde6652cbc758a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:53.624809 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-20165a05-55e3-492c-a4c6-5be30d935048 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "GET /compute/v2.1/servers/c71fb3ed-b430-443d-b16d-308cc483d3b2" status: 200 len: 1215 microversion: 2.1 time: 0.296463 Jul 18 02:08:53.634741 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 176/333] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:53 2022] GET /compute/v2.1/servers/c71fb3ed-b430-443d-b16d-308cc483d3b2 => generated 1215 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:08:54.037746 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-956fe1f2-138e-4fb6-8e9d-6430953ecc2c tempest-FlavorsAccessTestJSON-1536578329 tempest-FlavorsAccessTestJSON-1536578329-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-216540055", "id": 1046529079, "os-flavor-access:is_public": "False"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:54.039538 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:54.039538 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:54.089101 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-956fe1f2-138e-4fb6-8e9d-6430953ecc2c tempest-FlavorsAccessTestJSON-1536578329 tempest-FlavorsAccessTestJSON-1536578329-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.328315 Jul 18 02:08:54.098332 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 177/334] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:08:53 2022] POST /compute/v2.1/flavors => generated 430 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:54.111090 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c58dabed-c5e6-4aa8-918d-8f6108704d1d tempest-FlavorsAccessTestJSON-1536578329 tempest-FlavorsAccessTestJSON-1536578329-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "18ae1e84412049bb97a62a689882d57c"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:54.114763 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:54.114763 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:54.463024 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-644b91f1-b922-4cbb-a8ce-761552436cbf tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:08:54.464313 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-644b91f1-b922-4cbb-a8ce-761552436cbf tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:08:54.464997 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-644b91f1-b922-4cbb-a8ce-761552436cbf tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:08:54.465735 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-644b91f1-b922-4cbb-a8ce-761552436cbf tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:08:54.466235 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-644b91f1-b922-4cbb-a8ce-761552436cbf tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:08:54.494546 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-644b91f1-b922-4cbb-a8ce-761552436cbf tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:54.495221 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-644b91f1-b922-4cbb-a8ce-761552436cbf tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:54.496293 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-644b91f1-b922-4cbb-a8ce-761552436cbf tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:54.496952 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-644b91f1-b922-4cbb-a8ce-761552436cbf tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:54.536217 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-644b91f1-b922-4cbb-a8ce-761552436cbf tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Getting quotas for project 10c5b35052cd4a71a8254d01112f0496. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:08:54.565088 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-644b91f1-b922-4cbb-a8ce-761552436cbf tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Getting quotas for user a686fc833d964d88a022fae2932b5727 and project 10c5b35052cd4a71a8254d01112f0496. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:08:54.586184 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-644b91f1-b922-4cbb-a8ce-761552436cbf tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:08:54.589067 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-644b91f1-b922-4cbb-a8ce-761552436cbf tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: d8aad28a-a3d8-48d3-8fc7-50d65ab4e768] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:08:54.725951 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-644b91f1-b922-4cbb-a8ce-761552436cbf tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.634615 Jul 18 02:08:54.726600 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 158/335] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:08:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:08:55.133309 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c58dabed-c5e6-4aa8-918d-8f6108704d1d tempest-FlavorsAccessTestJSON-1536578329 tempest-FlavorsAccessTestJSON-1536578329-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors/1046529079/action" status: 200 len: 97 microversion: 2.1 time: 1.022528 Jul 18 02:08:55.144337 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 178/336] 10.222.0.57 () {60 vars in 1199 bytes} [Mon Jul 18 02:08:54 2022] POST /compute/v2.1/flavors/1046529079/action => generated 97 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 02:08:55.154908 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c635c9da-f545-4b5d-ab06-3da7701db85c tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:55.155915 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c635c9da-f545-4b5d-ab06-3da7701db85c tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: c71fb3ed-b430-443d-b16d-308cc483d3b2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:55.181124 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c635c9da-f545-4b5d-ab06-3da7701db85c tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:55.182239 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c635c9da-f545-4b5d-ab06-3da7701db85c tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:55.183803 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c635c9da-f545-4b5d-ab06-3da7701db85c tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:55.185347 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c635c9da-f545-4b5d-ab06-3da7701db85c tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:55.491567 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-16417cac-dd3c-409d-82c5-4fd1f597f089 tempest-QuotasAdminTestV257-919015670 tempest-QuotasAdminTestV257-919015670-project-admin] Action: 'update', calling method: .version_select at 0x7ff4a9230160>, body: {"quota_set": {"ram": "5120"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:56.187998 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c635c9da-f545-4b5d-ab06-3da7701db85c tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe4f42523df4204b49c9c0899c93fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0c0be2e96a499dbde6652cbc758a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:56.204152 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c635c9da-f545-4b5d-ab06-3da7701db85c tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "GET /compute/v2.1/servers/c71fb3ed-b430-443d-b16d-308cc483d3b2" status: 200 len: 1319 microversion: 2.1 time: 1.058340 Jul 18 02:08:56.214004 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 179/337] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:55 2022] GET /compute/v2.1/servers/c71fb3ed-b430-443d-b16d-308cc483d3b2 => generated 1319 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:56.223667 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b7d800a1-4d25-4550-8dff-7566a5444292 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:56.229260 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b7d800a1-4d25-4550-8dff-7566a5444292 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: d8aad28a-a3d8-48d3-8fc7-50d65ab4e768] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:56.253655 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b7d800a1-4d25-4550-8dff-7566a5444292 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:56.254393 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b7d800a1-4d25-4550-8dff-7566a5444292 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:56.257876 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b7d800a1-4d25-4550-8dff-7566a5444292 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:56.259320 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b7d800a1-4d25-4550-8dff-7566a5444292 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:56.328119 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-16417cac-dd3c-409d-82c5-4fd1f597f089 tempest-QuotasAdminTestV257-919015670 tempest-QuotasAdminTestV257-919015670-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:56.328712 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-16417cac-dd3c-409d-82c5-4fd1f597f089 tempest-QuotasAdminTestV257-919015670 tempest-QuotasAdminTestV257-919015670-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:56.336192 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-16417cac-dd3c-409d-82c5-4fd1f597f089 tempest-QuotasAdminTestV257-919015670 tempest-QuotasAdminTestV257-919015670-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:56.337045 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-16417cac-dd3c-409d-82c5-4fd1f597f089 tempest-QuotasAdminTestV257-919015670 tempest-QuotasAdminTestV257-919015670-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:56.465874 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-16417cac-dd3c-409d-82c5-4fd1f597f089 tempest-QuotasAdminTestV257-919015670 tempest-QuotasAdminTestV257-919015670-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-quota-sets/ee7b3d9ae8b44d1e902e01a0b2644109" status: 200 len: 148 microversion: 2.57 time: 1.736067 Jul 18 02:08:56.473918 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 159/338] 10.222.0.57 () {62 vars in 1302 bytes} [Mon Jul 18 02:08:54 2022] PUT /compute/v2.1/os-quota-sets/ee7b3d9ae8b44d1e902e01a0b2644109 => generated 148 bytes in 1744 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:08:56.711372 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b7d800a1-4d25-4550-8dff-7566a5444292 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:56.732953 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b7d800a1-4d25-4550-8dff-7566a5444292 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768" status: 200 len: 1259 microversion: 2.1 time: 0.509614 Jul 18 02:08:56.738269 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 180/339] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:56 2022] GET /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768 => generated 1259 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:56.754525 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5270c8e1-0d68-428f-bc3a-6d9cd466ff41 tempest-QuotasAdminTestV257-919015670 tempest-QuotasAdminTestV257-919015670-project-admin] Calling method '.version_select at 0x7ff4a9379a60>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:57.118706 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4af8b2b0-5e8b-4e4a-8587-ae6d87c034ea tempest-FlavorsAccessTestJSON-397066638 tempest-FlavorsAccessTestJSON-397066638-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:57.183940 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4af8b2b0-5e8b-4e4a-8587-ae6d87c034ea tempest-FlavorsAccessTestJSON-397066638 tempest-FlavorsAccessTestJSON-397066638-project] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 6240 microversion: 2.1 time: 0.708579 Jul 18 02:08:57.186311 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 160/340] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:08:56 2022] GET /compute/v2.1/flavors/detail => generated 6240 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:57.213063 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-86685fd1-332b-48df-ba7c-7f004a50c35c tempest-FlavorsAccessTestJSON-1536578329 tempest-FlavorsAccessTestJSON-1536578329-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "18ae1e84412049bb97a62a689882d57c"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:57.220939 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:57.220939 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:08:57.455108 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5270c8e1-0d68-428f-bc3a-6d9cd466ff41 tempest-QuotasAdminTestV257-919015670 tempest-QuotasAdminTestV257-919015670-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:57.457865 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5270c8e1-0d68-428f-bc3a-6d9cd466ff41 tempest-QuotasAdminTestV257-919015670 tempest-QuotasAdminTestV257-919015670-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:57.459258 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5270c8e1-0d68-428f-bc3a-6d9cd466ff41 tempest-QuotasAdminTestV257-919015670 tempest-QuotasAdminTestV257-919015670-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:57.459928 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5270c8e1-0d68-428f-bc3a-6d9cd466ff41 tempest-QuotasAdminTestV257-919015670 tempest-QuotasAdminTestV257-919015670-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:57.499285 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5270c8e1-0d68-428f-bc3a-6d9cd466ff41 tempest-QuotasAdminTestV257-919015670 tempest-QuotasAdminTestV257-919015670-project-admin] 10.222.0.57 "GET /compute/v2.1/os-quota-sets/ee7b3d9ae8b44d1e902e01a0b2644109/detail" status: 200 len: 463 microversion: 2.57 time: 0.759712 Jul 18 02:08:57.503685 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 181/341] 10.222.0.57 () {60 vars in 1303 bytes} [Mon Jul 18 02:08:56 2022] GET /compute/v2.1/os-quota-sets/ee7b3d9ae8b44d1e902e01a0b2644109/detail => generated 463 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:08:57.516314 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b4e1182e-d65f-49f6-a5da-7e03e22503d9 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:57.517062 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b4e1182e-d65f-49f6-a5da-7e03e22503d9 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: c71fb3ed-b430-443d-b16d-308cc483d3b2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:57.538529 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b4e1182e-d65f-49f6-a5da-7e03e22503d9 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:57.539771 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b4e1182e-d65f-49f6-a5da-7e03e22503d9 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:57.543776 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b4e1182e-d65f-49f6-a5da-7e03e22503d9 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:57.544450 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b4e1182e-d65f-49f6-a5da-7e03e22503d9 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:57.573876 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:08:57.941264 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-86685fd1-332b-48df-ba7c-7f004a50c35c tempest-FlavorsAccessTestJSON-1536578329 tempest-FlavorsAccessTestJSON-1536578329-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors/1046529079/action" status: 200 len: 21 microversion: 2.1 time: 0.739042 Jul 18 02:08:57.943710 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 161/342] 10.222.0.57 () {60 vars in 1199 bytes} [Mon Jul 18 02:08:57 2022] POST /compute/v2.1/flavors/1046529079/action => generated 21 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:08:57.953066 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a8090cc6-abcf-4a8b-9399-2f9f2dfbd0fb tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:57.957779 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a8090cc6-abcf-4a8b-9399-2f9f2dfbd0fb tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: d8aad28a-a3d8-48d3-8fc7-50d65ab4e768] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:57.968279 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a8090cc6-abcf-4a8b-9399-2f9f2dfbd0fb tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:57.969388 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a8090cc6-abcf-4a8b-9399-2f9f2dfbd0fb tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:57.978097 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a8090cc6-abcf-4a8b-9399-2f9f2dfbd0fb tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:57.984666 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a8090cc6-abcf-4a8b-9399-2f9f2dfbd0fb tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:58.330530 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a8090cc6-abcf-4a8b-9399-2f9f2dfbd0fb tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:58.352611 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a8090cc6-abcf-4a8b-9399-2f9f2dfbd0fb tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768" status: 200 len: 1265 microversion: 2.1 time: 0.407574 Jul 18 02:08:58.353231 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 162/343] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:57 2022] GET /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768 => generated 1265 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:58.368698 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-84149209-45d4-4e47-ad78-31d33b7b9680 tempest-FlavorsAccessTestJSON-397066638 tempest-FlavorsAccessTestJSON-397066638-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:58.406927 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-84149209-45d4-4e47-ad78-31d33b7b9680 tempest-FlavorsAccessTestJSON-397066638 tempest-FlavorsAccessTestJSON-397066638-project] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.052818 Jul 18 02:08:58.407849 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 163/344] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:08:58 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:58.411730 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b4e1182e-d65f-49f6-a5da-7e03e22503d9 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe4f42523df4204b49c9c0899c93fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0c0be2e96a499dbde6652cbc758a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:08:58.422811 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b4e1182e-d65f-49f6-a5da-7e03e22503d9 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "GET /compute/v2.1/servers/c71fb3ed-b430-443d-b16d-308cc483d3b2" status: 200 len: 1319 microversion: 2.1 time: 0.917264 Jul 18 02:08:58.435571 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b6442309-2b1c-4139-8046-e1a165d0be15 tempest-QuotasAdminTestV257-919015670 tempest-QuotasAdminTestV257-919015670-project-admin] Action: 'update', calling method: .version_select at 0x7ff4a9230dc0>, body: {"quota_set": {"ram": "2048"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:58.436828 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 182/345] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:57 2022] GET /compute/v2.1/servers/c71fb3ed-b430-443d-b16d-308cc483d3b2 => generated 1319 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:58.950102 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1fc18793-af15-4abb-bb88-8e4564fc589d tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1812969153", "id": 551919411, "os-flavor-access:is_public": "False"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:58.952488 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:58.952488 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:59.006727 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1fc18793-af15-4abb-bb88-8e4564fc589d tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.562725 Jul 18 02:08:59.015746 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 183/346] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:08:58 2022] POST /compute/v2.1/flavors => generated 436 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:59.030478 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6c073d94-4d5c-4a9b-b88f-2519671d1b37 tempest-FlavorsAccessTestJSON-1536578329 tempest-FlavorsAccessTestJSON-1536578329-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:59.031420 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:59.031420 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:59.101900 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6c073d94-4d5c-4a9b-b88f-2519671d1b37 tempest-FlavorsAccessTestJSON-1536578329 tempest-FlavorsAccessTestJSON-1536578329-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/1046529079" status: 202 len: 0 microversion: 2.1 time: 0.088359 Jul 18 02:08:59.105200 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 184/347] 10.222.0.57 () {58 vars in 1160 bytes} [Mon Jul 18 02:08:59 2022] DELETE /compute/v2.1/flavors/1046529079 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:08:59.128747 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-12cdacef-a051-47e1-a34c-a0cfa618799b req-6fb978a1-9755-413b-b8c1-d1ddde701ac2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c71fb3ed-b430-443d-b16d-308cc483d3b2", "tag": "0ddec30d-c681-4472-b329-e657ad12aef0"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:59.149107 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-12cdacef-a051-47e1-a34c-a0cfa618799b req-6fb978a1-9755-413b-b8c1-d1ddde701ac2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:59.150203 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-12cdacef-a051-47e1-a34c-a0cfa618799b req-6fb978a1-9755-413b-b8c1-d1ddde701ac2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:59.222160 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6442309-2b1c-4139-8046-e1a165d0be15 tempest-QuotasAdminTestV257-919015670 tempest-QuotasAdminTestV257-919015670-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:59.232234 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6442309-2b1c-4139-8046-e1a165d0be15 tempest-QuotasAdminTestV257-919015670 tempest-QuotasAdminTestV257-919015670-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:59.248892 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6442309-2b1c-4139-8046-e1a165d0be15 tempest-QuotasAdminTestV257-919015670 tempest-QuotasAdminTestV257-919015670-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:59.249845 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6442309-2b1c-4139-8046-e1a165d0be15 tempest-QuotasAdminTestV257-919015670 tempest-QuotasAdminTestV257-919015670-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:59.254857 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-12cdacef-a051-47e1-a34c-a0cfa618799b req-6fb978a1-9755-413b-b8c1-d1ddde701ac2 service nova] Creating event network-changed:0ddec30d-c681-4472-b329-e657ad12aef0 for instance c71fb3ed-b430-443d-b16d-308cc483d3b2 on n-h1-465891-3 Jul 18 02:08:59.296315 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-12cdacef-a051-47e1-a34c-a0cfa618799b req-6fb978a1-9755-413b-b8c1-d1ddde701ac2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184468 Jul 18 02:08:59.302179 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 185/348] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:08:59.342957 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8c19244e-7cc0-4070-9223-3a1ab9c68823 tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "99babb8db0e54c438e144b4ec1b46aff"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:08:59.351085 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:08:59.351085 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:08:59.389565 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6442309-2b1c-4139-8046-e1a165d0be15 tempest-QuotasAdminTestV257-919015670 tempest-QuotasAdminTestV257-919015670-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:59.389565 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6442309-2b1c-4139-8046-e1a165d0be15 tempest-QuotasAdminTestV257-919015670 tempest-QuotasAdminTestV257-919015670-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:59.389565 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6442309-2b1c-4139-8046-e1a165d0be15 tempest-QuotasAdminTestV257-919015670 tempest-QuotasAdminTestV257-919015670-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:59.389565 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6442309-2b1c-4139-8046-e1a165d0be15 tempest-QuotasAdminTestV257-919015670 tempest-QuotasAdminTestV257-919015670-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:59.514068 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b6442309-2b1c-4139-8046-e1a165d0be15 tempest-QuotasAdminTestV257-919015670 tempest-QuotasAdminTestV257-919015670-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-quota-sets/ee7b3d9ae8b44d1e902e01a0b2644109?user_id=0aea1c98f21c4fbd8f08c91e63f14258" status: 200 len: 148 microversion: 2.57 time: 1.100779 Jul 18 02:08:59.516913 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 164/349] 10.222.0.57 () {62 vars in 1383 bytes} [Mon Jul 18 02:08:58 2022] PUT /compute/v2.1/os-quota-sets/ee7b3d9ae8b44d1e902e01a0b2644109?user_id=0aea1c98f21c4fbd8f08c91e63f14258 => generated 148 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:08:59.528216 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-12a6e1d7-62d3-48c7-8960-f8d013d4c258 tempest-FlavorsAccessTestJSON-1536578329 tempest-FlavorsAccessTestJSON-1536578329-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:59.573316 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-12a6e1d7-62d3-48c7-8960-f8d013d4c258 tempest-FlavorsAccessTestJSON-1536578329 tempest-FlavorsAccessTestJSON-1536578329-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.048915 Jul 18 02:08:59.573932 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 165/350] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:08:59 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:08:59.592098 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-00c7e3a5-553c-4a48-b050-d861d1728970 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:59.592777 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-00c7e3a5-553c-4a48-b050-d861d1728970 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: d8aad28a-a3d8-48d3-8fc7-50d65ab4e768] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:59.600481 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-00c7e3a5-553c-4a48-b050-d861d1728970 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:59.600916 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-00c7e3a5-553c-4a48-b050-d861d1728970 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:59.601679 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-00c7e3a5-553c-4a48-b050-d861d1728970 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:59.602135 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-00c7e3a5-553c-4a48-b050-d861d1728970 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:59.926559 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8c19244e-7cc0-4070-9223-3a1ab9c68823 tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors/551919411/action" status: 200 len: 96 microversion: 2.1 time: 0.622232 Jul 18 02:08:59.927696 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 186/351] 10.222.0.57 () {60 vars in 1196 bytes} [Mon Jul 18 02:08:59 2022] POST /compute/v2.1/flavors/551919411/action => generated 96 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:08:59.936370 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dd225487-42f7-4577-b1fc-4db1168c1aac tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:08:59.946436 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-dd225487-42f7-4577-b1fc-4db1168c1aac tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: c71fb3ed-b430-443d-b16d-308cc483d3b2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:08:59.954777 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dd225487-42f7-4577-b1fc-4db1168c1aac tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:59.955424 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dd225487-42f7-4577-b1fc-4db1168c1aac tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:08:59.956733 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dd225487-42f7-4577-b1fc-4db1168c1aac tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:08:59.957176 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dd225487-42f7-4577-b1fc-4db1168c1aac tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:00.144866 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-00c7e3a5-553c-4a48-b050-d861d1728970 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:00.158513 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-00c7e3a5-553c-4a48-b050-d861d1728970 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768" status: 200 len: 1307 microversion: 2.1 time: 0.570718 Jul 18 02:09:00.160528 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 166/352] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:59 2022] GET /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768 => generated 1307 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:00.164897 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-644d3ff7-12ce-47d5-b0c6-e57d0c06bcea tempest-QuotasAdminTestV257-919015670 tempest-QuotasAdminTestV257-919015670-project-admin] Calling method '.version_select at 0x7ff4a9211c10>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:00.294934 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-dd225487-42f7-4577-b1fc-4db1168c1aac tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe4f42523df4204b49c9c0899c93fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0c0be2e96a499dbde6652cbc758a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:00.305821 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-dd225487-42f7-4577-b1fc-4db1168c1aac tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "GET /compute/v2.1/servers/c71fb3ed-b430-443d-b16d-308cc483d3b2" status: 200 len: 1319 microversion: 2.1 time: 0.376624 Jul 18 02:09:00.306360 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 187/353] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:08:59 2022] GET /compute/v2.1/servers/c71fb3ed-b430-443d-b16d-308cc483d3b2 => generated 1319 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:00.321956 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0293259c-c313-424a-b814-f55903f53812 tempest-FlavorsAccessTestJSON-1536578329 tempest-FlavorsAccessTestJSON-1536578329-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-430942126", "id": 551273848, "os-flavor-access:is_public": "False"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:00.323804 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:00.323804 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:09:00.345066 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0293259c-c313-424a-b814-f55903f53812 tempest-FlavorsAccessTestJSON-1536578329 tempest-FlavorsAccessTestJSON-1536578329-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.026463 Jul 18 02:09:00.346609 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 188/354] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:09:00 2022] POST /compute/v2.1/flavors => generated 427 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:00.352840 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5fb1010a-ecb3-4b94-8674-7640d378adff tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "99babb8db0e54c438e144b4ec1b46aff"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:00.354875 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:00.354875 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:09:00.583418 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-644d3ff7-12ce-47d5-b0c6-e57d0c06bcea tempest-QuotasAdminTestV257-919015670 tempest-QuotasAdminTestV257-919015670-project-admin] 10.222.0.57 "GET /compute/v2.1/os-quota-sets/ee7b3d9ae8b44d1e902e01a0b2644109?user_id=0aea1c98f21c4fbd8f08c91e63f14258" status: 200 len: 190 microversion: 2.57 time: 0.421822 Jul 18 02:09:00.584881 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 167/355] 10.222.0.57 () {60 vars in 1363 bytes} [Mon Jul 18 02:09:00 2022] GET /compute/v2.1/os-quota-sets/ee7b3d9ae8b44d1e902e01a0b2644109?user_id=0aea1c98f21c4fbd8f08c91e63f14258 => generated 190 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:09:00.598971 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fa2e2937-c399-4ec6-a29a-ba90418c5881 tempest-FlavorsAccessTestJSON-1536578329 tempest-FlavorsAccessTestJSON-1536578329-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:00.600041 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:00.600041 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:09:00.637735 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fa2e2937-c399-4ec6-a29a-ba90418c5881 tempest-FlavorsAccessTestJSON-1536578329 tempest-FlavorsAccessTestJSON-1536578329-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/551273848/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.047304 Jul 18 02:09:00.638357 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 168/356] 10.222.0.57 () {58 vars in 1205 bytes} [Mon Jul 18 02:09:00 2022] GET /compute/v2.1/flavors/551273848/os-flavor-access => generated 21 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:09:00.652463 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d81b4c39-ac8e-422e-9ae8-590ba1036313 tempest-FlavorsAccessTestJSON-1536578329 tempest-FlavorsAccessTestJSON-1536578329-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:00.654409 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:00.654409 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:09:00.689833 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d81b4c39-ac8e-422e-9ae8-590ba1036313 tempest-FlavorsAccessTestJSON-1536578329 tempest-FlavorsAccessTestJSON-1536578329-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/551273848" status: 202 len: 0 microversion: 2.1 time: 0.045879 Jul 18 02:09:00.693406 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 169/357] 10.222.0.57 () {58 vars in 1157 bytes} [Mon Jul 18 02:09:00 2022] DELETE /compute/v2.1/flavors/551273848 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:09:00.703199 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-18442eb1-948f-4d4c-8485-de8553815c06 tempest-FlavorsAccessTestJSON-1536578329 tempest-FlavorsAccessTestJSON-1536578329-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:00.729474 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-18442eb1-948f-4d4c-8485-de8553815c06 tempest-FlavorsAccessTestJSON-1536578329 tempest-FlavorsAccessTestJSON-1536578329-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.031799 Jul 18 02:09:00.745313 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 170/358] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:09:00 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:09:01.007355 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-5fb1010a-ecb3-4b94-8674-7640d378adff tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] HTTP exception thrown: Flavor access already exists for flavor 32 and project 99babb8db0e54c438e144b4ec1b46aff combination. Jul 18 02:09:01.026489 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5fb1010a-ecb3-4b94-8674-7640d378adff tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] Request method failure captured: Jul 18 02:09:01.026489 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/flavors/551919411/action HTTP/1.1 Jul 18 02:09:01.026489 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:09:01.026489 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:09:01.026489 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:09:01.026489 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 67 Jul 18 02:09:01.026489 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:09:01.026489 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:09:01.026489 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:09:01.026489 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:09:01.026489 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MC4Gf0cpXc0DD0jsqpenTDVfgOtPm8e1vv8jfSy8wRVkI6FzxDjELKfcobhzcSt3EAeJApYJZwiBYizZVLGyu_0Xnk_hyIuv6sEzu8x5tdZ7NSo1mHRLAGhkXcJcUZqaKCjDwbjpNrAbWJnWOrSlsHaDPXHxKQScu6j5rB4BCYU_Jg Jul 18 02:09:01.026489 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:09:01.026489 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:09:01.026489 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:09:01.026489 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:09:01.026489 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:09:01.026489 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:09:01.026489 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: da852784bbbc488683a59a853eedf376 Jul 18 02:09:01.026489 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1788166550 Jul 18 02:09:01.026489 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,admin,reader Jul 18 02:09:01.026489 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,admin,reader Jul 18 02:09:01.029275 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_da852784bbbc488683a59a853eedf376"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/da852784bbbc488683a59a853eedf376"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/da852784bbbc488683a59a853eedf376"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/da852784bbbc488683a59a853eedf376"}]}] Jul 18 02:09:01.029275 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1788166550 Jul 18 02:09:01.029275 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: da852784bbbc488683a59a853eedf376 Jul 18 02:09:01.029275 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1788166550 Jul 18 02:09:01.029275 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin Jul 18 02:09:01.029275 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:09:01.029275 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:09:01.029275 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 6c6e5c6057bf4e0289220d94b93b7fdd Jul 18 02:09:01.029275 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin Jul 18 02:09:01.029275 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 02:09:01.029275 n-d-465891-3 devstack@n-api.service[119543]: {"addTenantAccess": {"tenant": "99babb8db0e54c438e144b4ec1b46aff"}} Jul 18 02:09:01.029275 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:09:01.030791 n-d-465891-3 devstack@n-api.service[119543]: exception: Flavor access already exists for flavor 32 and project 99babb8db0e54c438e144b4ec1b46aff combination. Jul 18 02:09:01.030791 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '551919411', 'body': {'addTenantAccess': {'tenant': '99babb8db0e54c438e144b4ec1b46aff'}}} Jul 18 02:09:01.030791 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:09:01.030791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:01.030791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 02:09:01.030791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 18 02:09:01.030791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 02:09:01.030791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 18 02:09:01.030791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 02:09:01.030791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 18 02:09:01.030791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 02:09:01.030791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 18 02:09:01.030791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 02:09:01.030791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 02:09:01.030791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 02:09:01.030791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result.read() Jul 18 02:09:01.030791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 02:09:01.030791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 18 02:09:01.032962 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 02:09:01.032962 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 18 02:09:01.032962 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 02:09:01.032962 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 18 02:09:01.032962 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 02:09:01.032962 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 18 02:09:01.032962 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '32-99babb8db0e54c438e144b4ec1b46aff' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 18 02:09:01.032962 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:01.032962 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 18 02:09:01.032962 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:01.032962 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:01.032962 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Jul 18 02:09:01.032962 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi project.save(context.session) Jul 18 02:09:01.032962 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 18 02:09:01.032962 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi session.flush() Jul 18 02:09:01.032962 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 18 02:09:01.032962 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 18 02:09:01.032962 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 18 02:09:01.032962 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 18 02:09:01.037918 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 18 02:09:01.037918 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 18 02:09:01.037918 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 02:09:01.037918 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception Jul 18 02:09:01.037918 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 18 02:09:01.037918 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 18 02:09:01.037918 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 18 02:09:01.037918 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 18 02:09:01.037918 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 18 02:09:01.037918 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 18 02:09:01.037918 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 18 02:09:01.037918 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 18 02:09:01.037918 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 18 02:09:01.037918 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 18 02:09:01.037918 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 18 02:09:01.037918 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 18 02:09:01.037918 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 18 02:09:01.037918 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 18 02:09:01.040051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 18 02:09:01.040051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 18 02:09:01.040051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 18 02:09:01.040051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 18 02:09:01.040051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 18 02:09:01.040051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 18 02:09:01.040051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 02:09:01.040051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception Jul 18 02:09:01.040051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 02:09:01.040051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 18 02:09:01.040051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 02:09:01.040051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 18 02:09:01.040051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 02:09:01.040051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 18 02:09:01.040051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 02:09:01.040051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 18 02:09:01.040051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 02:09:01.040051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 02:09:01.043306 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 02:09:01.043306 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result.read() Jul 18 02:09:01.043306 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 02:09:01.043306 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 18 02:09:01.043306 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 02:09:01.043306 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 18 02:09:01.043306 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 02:09:01.043306 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 18 02:09:01.043306 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 02:09:01.043306 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 18 02:09:01.043306 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '32-99babb8db0e54c438e144b4ec1b46aff' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 18 02:09:01.043306 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Jul 18 02:09:01.043306 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 18, 2, 9, 1, 732), 'updated_at': None, 'flavor_id': 32, 'project_id': '99babb8db0e54c438e144b4ec1b46aff'}] Jul 18 02:09:01.043306 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 18 02:09:01.043306 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:01.043306 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:01.043306 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:01.045536 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:01.045536 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Jul 18 02:09:01.045536 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Jul 18 02:09:01.045536 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 18 02:09:01.045536 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 18 02:09:01.045536 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Jul 18 02:09:01.045536 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Jul 18 02:09:01.045536 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Jul 18 02:09:01.045536 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Jul 18 02:09:01.045536 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Jul 18 02:09:01.045536 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Jul 18 02:09:01.045536 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:09:01.045536 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:09:01.045536 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Jul 18 02:09:01.045536 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Jul 18 02:09:01.045536 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 32 and project 99babb8db0e54c438e144b4ec1b46aff combination. Jul 18 02:09:01.045536 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:01.045536 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:01.045536 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:01.048145 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:01.048145 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:01.048145 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:01.048145 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:09:01.048145 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:09:01.048145 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:09:01.048145 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:09:01.048145 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:09:01.048145 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:09:01.048145 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Jul 18 02:09:01.048145 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Jul 18 02:09:01.048145 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 32 and project 99babb8db0e54c438e144b4ec1b46aff combination. Jul 18 02:09:01.048145 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:01.048145 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:01.048145 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:01.048145 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:01.048145 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:01.048145 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:01.048145 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:09:01.048145 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:09:01.050655 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 32 and project 99babb8db0e54c438e144b4ec1b46aff combination. Jul 18 02:09:01.050655 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:01.050655 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5fb1010a-ecb3-4b94-8674-7640d378adff tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] Returning 409 to user: Flavor access already exists for flavor 32 and project 99babb8db0e54c438e144b4ec1b46aff combination. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:09:01.050655 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5fb1010a-ecb3-4b94-8674-7640d378adff tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors/551919411/action" status: 409 len: 152 microversion: 2.1 time: 0.679796 Jul 18 02:09:01.050655 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 189/359] 10.222.0.57 () {60 vars in 1196 bytes} [Mon Jul 18 02:09:00 2022] POST /compute/v2.1/flavors/551919411/action => generated 152 bytes in 681 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:09:01.051163 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1537e1f9-7fe5-4ac5-950f-695d66c563a1 tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "99babb8db0e54c438e144b4ec1b46aff"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:01.051163 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:01.051163 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:09:01.176479 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8425e03a-0305-4e14-9264-c8b5c5054b77 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:01.177549 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8425e03a-0305-4e14-9264-c8b5c5054b77 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: d8aad28a-a3d8-48d3-8fc7-50d65ab4e768] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:01.184028 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8425e03a-0305-4e14-9264-c8b5c5054b77 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:01.184481 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8425e03a-0305-4e14-9264-c8b5c5054b77 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:01.185276 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8425e03a-0305-4e14-9264-c8b5c5054b77 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:01.185734 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8425e03a-0305-4e14-9264-c8b5c5054b77 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:01.351437 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8425e03a-0305-4e14-9264-c8b5c5054b77 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:01.366226 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8425e03a-0305-4e14-9264-c8b5c5054b77 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768" status: 200 len: 1307 microversion: 2.1 time: 0.189678 Jul 18 02:09:01.366226 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 190/360] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:01 2022] GET /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768 => generated 1307 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:09:01.371083 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-959eee90-fa89-4307-8e56-74d7a58ec17b tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:01.372661 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-959eee90-fa89-4307-8e56-74d7a58ec17b tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: c71fb3ed-b430-443d-b16d-308cc483d3b2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:01.380306 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-959eee90-fa89-4307-8e56-74d7a58ec17b tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:01.380984 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-959eee90-fa89-4307-8e56-74d7a58ec17b tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:01.381778 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-959eee90-fa89-4307-8e56-74d7a58ec17b tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:01.382201 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-959eee90-fa89-4307-8e56-74d7a58ec17b tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:01.538413 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-959eee90-fa89-4307-8e56-74d7a58ec17b tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe4f42523df4204b49c9c0899c93fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0c0be2e96a499dbde6652cbc758a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:01.551826 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-959eee90-fa89-4307-8e56-74d7a58ec17b tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "GET /compute/v2.1/servers/c71fb3ed-b430-443d-b16d-308cc483d3b2" status: 200 len: 1319 microversion: 2.1 time: 0.186826 Jul 18 02:09:01.561475 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 191/361] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:01 2022] GET /compute/v2.1/servers/c71fb3ed-b430-443d-b16d-308cc483d3b2 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:01.564434 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-6bb89ed3-9440-4b87-9010-6b1d2a82010b req-9cfd1b0f-259d-476c-a723-0255d6b16cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8aad28a-a3d8-48d3-8fc7-50d65ab4e768", "tag": "6783749f-f883-4783-9465-179735e0eeb7"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:01.573260 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-6bb89ed3-9440-4b87-9010-6b1d2a82010b req-9cfd1b0f-259d-476c-a723-0255d6b16cb5 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:01.573719 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-6bb89ed3-9440-4b87-9010-6b1d2a82010b req-9cfd1b0f-259d-476c-a723-0255d6b16cb5 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:01.589036 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-6bb89ed3-9440-4b87-9010-6b1d2a82010b req-9cfd1b0f-259d-476c-a723-0255d6b16cb5 service nova] Creating event network-changed:6783749f-f883-4783-9465-179735e0eeb7 for instance d8aad28a-a3d8-48d3-8fc7-50d65ab4e768 on n-h1-465891-3 Jul 18 02:09:01.594379 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-6bb89ed3-9440-4b87-9010-6b1d2a82010b req-9cfd1b0f-259d-476c-a723-0255d6b16cb5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035337 Jul 18 02:09:01.595454 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 192/362] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:01.666336 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2,nova_api:INSERT=6,nova_api:DELETE=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:09:01.685993 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1537e1f9-7fe5-4ac5-950f-695d66c563a1 tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors/551919411/action" status: 200 len: 21 microversion: 2.1 time: 0.650532 Jul 18 02:09:01.686603 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 171/363] 10.222.0.57 () {60 vars in 1196 bytes} [Mon Jul 18 02:09:01 2022] POST /compute/v2.1/flavors/551919411/action => generated 21 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:09:01.696561 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0550e4a0-f67c-432d-8562-c99e249261a2 tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:01.718410 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0550e4a0-f67c-432d-8562-c99e249261a2 tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/551919411" status: 202 len: 0 microversion: 2.1 time: 0.025405 Jul 18 02:09:01.719257 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 172/364] 10.222.0.57 () {58 vars in 1157 bytes} [Mon Jul 18 02:09:01 2022] DELETE /compute/v2.1/flavors/551919411 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:09:01.728076 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5be7c45a-a758-4886-a266-871104a783e1 tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:01.749433 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5be7c45a-a758-4886-a266-871104a783e1 tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.024972 Jul 18 02:09:01.750071 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 173/365] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:09:01 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:01.766441 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4dc8998d-147f-4315-8e1c-f56c23e28746 tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-610824135", "id": 852349947, "os-flavor-access:is_public": "True"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:01.772478 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:01.772478 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:09:01.791412 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4dc8998d-147f-4315-8e1c-f56c23e28746 tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.028858 Jul 18 02:09:01.792850 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 174/366] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:09:01 2022] POST /compute/v2.1/flavors => generated 434 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:01.803914 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f807e216-fd45-4fd3-83b5-ceb5f6341e70 tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:01.811523 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-f807e216-fd45-4fd3-83b5-ceb5f6341e70 tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] HTTP exception thrown: Access list not available for public flavors. Jul 18 02:09:01.813262 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f807e216-fd45-4fd3-83b5-ceb5f6341e70 tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] Request method failure captured: Jul 18 02:09:01.813262 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/flavors/852349947/os-flavor-access HTTP/1.1 Jul 18 02:09:01.813262 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:09:01.813262 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:09:01.813262 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:09:01.813262 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:09:01.813262 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:09:01.813262 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:09:01.813262 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:09:01.813262 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:09:01.813262 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MC4Gf0cpXc0DD0jsqpenTDVfgOtPm8e1vv8jfSy8wRVkI6FzxDjELKfcobhzcSt3EAeJApYJZwiBYizZVLGyu_0Xnk_hyIuv6sEzu8x5tdZ7NSo1mHRLAGhkXcJcUZqaKCjDwbjpNrAbWJnWOrSlsHaDPXHxKQScu6j5rB4BCYU_Jg Jul 18 02:09:01.813262 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:09:01.813262 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:09:01.813262 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:09:01.813262 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:09:01.813262 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:09:01.813262 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:09:01.813262 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: da852784bbbc488683a59a853eedf376 Jul 18 02:09:01.813262 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1788166550 Jul 18 02:09:01.813262 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,admin,reader Jul 18 02:09:01.813262 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,admin,reader Jul 18 02:09:01.814961 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_da852784bbbc488683a59a853eedf376"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/da852784bbbc488683a59a853eedf376"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/da852784bbbc488683a59a853eedf376"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/da852784bbbc488683a59a853eedf376"}]}] Jul 18 02:09:01.814961 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1788166550 Jul 18 02:09:01.814961 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: da852784bbbc488683a59a853eedf376 Jul 18 02:09:01.814961 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1788166550 Jul 18 02:09:01.814961 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin Jul 18 02:09:01.814961 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:09:01.814961 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:09:01.814961 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 6c6e5c6057bf4e0289220d94b93b7fdd Jul 18 02:09:01.814961 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin Jul 18 02:09:01.814961 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:09:01.814961 n-d-465891-3 devstack@n-api.service[119544]: exception: Access list not available for public flavors. Jul 18 02:09:01.814961 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'flavor_id': '852349947'} Jul 18 02:09:01.817805 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:09:01.817805 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:01.817805 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:01.817805 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:01.817805 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:09:01.817805 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:09:01.817805 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:09:01.817805 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:09:01.817805 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Jul 18 02:09:01.817805 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 02:09:01.817805 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Jul 18 02:09:01.817805 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:01.817805 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:01.817805 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:01.817805 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:01.817805 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:01.817805 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:01.817805 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:09:01.817805 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:09:01.817805 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Jul 18 02:09:01.817805 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:01.821149 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f807e216-fd45-4fd3-83b5-ceb5f6341e70 tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:09:01.823043 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f807e216-fd45-4fd3-83b5-ceb5f6341e70 tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/852349947/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.023549 Jul 18 02:09:01.825820 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 175/367] 10.222.0.57 () {58 vars in 1205 bytes} [Mon Jul 18 02:09:01 2022] GET /compute/v2.1/flavors/852349947/os-flavor-access => generated 91 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:09:01.832230 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7ee7f605-70e9-4fcc-bbf7-62f2efbd3373 tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:01.851752 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7ee7f605-70e9-4fcc-bbf7-62f2efbd3373 tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/852349947" status: 202 len: 0 microversion: 2.1 time: 0.023609 Jul 18 02:09:01.852559 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 176/368] 10.222.0.57 () {58 vars in 1157 bytes} [Mon Jul 18 02:09:01 2022] DELETE /compute/v2.1/flavors/852349947 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:09:01.861505 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b1fb7db0-9815-4c6a-a235-d4b52e9fc2d7 tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:01.884270 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b1fb7db0-9815-4c6a-a235-d4b52e9fc2d7 tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.026577 Jul 18 02:09:01.885191 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 177/369] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:09:01 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:01.901414 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-22f3561b-e0be-4eab-99eb-79045cb41fe1 tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-287094669", "id": 1927701834, "os-flavor-access:is_public": "False"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:01.926356 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-22f3561b-e0be-4eab-99eb-79045cb41fe1 tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.026704 Jul 18 02:09:01.933646 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 178/370] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:09:01 2022] POST /compute/v2.1/flavors => generated 438 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:09:02.023878 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-83c851c3-8832-4f7f-b664-672c2043c32c tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1500167182", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": "none"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:02.111381 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-83c851c3-8832-4f7f-b664-672c2043c32c tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:09:02.112528 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-83c851c3-8832-4f7f-b664-672c2043c32c tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:09:02.113106 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-83c851c3-8832-4f7f-b664-672c2043c32c tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:09:02.113786 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-83c851c3-8832-4f7f-b664-672c2043c32c tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:09:02.114546 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-83c851c3-8832-4f7f-b664-672c2043c32c tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:09:02.122751 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=13,nova_api:DELETE=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:09:02.132769 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-83c851c3-8832-4f7f-b664-672c2043c32c tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:02.134604 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-83c851c3-8832-4f7f-b664-672c2043c32c tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:02.136591 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-83c851c3-8832-4f7f-b664-672c2043c32c tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:02.137272 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-83c851c3-8832-4f7f-b664-672c2043c32c tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:02.160057 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-83c851c3-8832-4f7f-b664-672c2043c32c tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Getting quotas for project 92018f8db7a44c73ac1a3badba60b51e. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:09:02.166382 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-83c851c3-8832-4f7f-b664-672c2043c32c tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Getting quotas for user c087c0142aef4b5fb9e9d911af80abdd and project 92018f8db7a44c73ac1a3badba60b51e. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:09:02.182537 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-83c851c3-8832-4f7f-b664-672c2043c32c tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:09:02.185363 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-83c851c3-8832-4f7f-b664-672c2043c32c tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:09:02.242623 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-83c851c3-8832-4f7f-b664-672c2043c32c tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.644349 Jul 18 02:09:02.245216 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 193/371] 10.222.0.57 () {62 vars in 1187 bytes} [Mon Jul 18 02:09:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 02:09:02.282741 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2e0d5934-3b63-465c-aeff-0ac93750101a tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:02.283981 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2e0d5934-3b63-465c-aeff-0ac93750101a tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:02.314087 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-334ee46e-24aa-439a-aaf8-b6eae01bad55 tempest-FlavorsAccessNegativeTestJSON-325871780 tempest-FlavorsAccessNegativeTestJSON-325871780-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "99babb8db0e54c438e144b4ec1b46aff"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:02.317137 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:02.317137 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:09:02.318481 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-334ee46e-24aa-439a-aaf8-b6eae01bad55 tempest-FlavorsAccessNegativeTestJSON-325871780 tempest-FlavorsAccessNegativeTestJSON-325871780-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '59a2fb8a5c374a46a90a7e767fe61ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99babb8db0e54c438e144b4ec1b46aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:02.320668 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-334ee46e-24aa-439a-aaf8-b6eae01bad55 tempest-FlavorsAccessNegativeTestJSON-325871780 tempest-FlavorsAccessNegativeTestJSON-325871780-project] Request method failure captured: Jul 18 02:09:02.320668 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/flavors/1927701834/action HTTP/1.1 Jul 18 02:09:02.320668 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:09:02.320668 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:09:02.320668 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:09:02.320668 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 67 Jul 18 02:09:02.320668 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:09:02.320668 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:09:02.320668 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:09:02.320668 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:09:02.320668 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MC2jvvv45vPZx40p6VQnSTOPUpWjNtyjFeIix_haIgb1kUgph-kxbUpgXmxkApn40VH2CW3XpzzVUJKsdIyelfpboq-LKpyv1S-I-UAAVkX-KYJ8c60vedOZSxQl8S16fbEVGvjfl-eHWjDiUue7ms8nDKvuAT_9uVZFyulLQq9n-I Jul 18 02:09:02.320668 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:09:02.320668 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:09:02.320668 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:09:02.320668 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:09:02.320668 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:09:02.320668 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:09:02.320668 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 99babb8db0e54c438e144b4ec1b46aff Jul 18 02:09:02.320668 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-325871780 Jul 18 02:09:02.320668 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:09:02.320668 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:09:02.322097 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_99babb8db0e54c438e144b4ec1b46aff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/99babb8db0e54c438e144b4ec1b46aff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/99babb8db0e54c438e144b4ec1b46aff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/99babb8db0e54c438e144b4ec1b46aff"}]}] Jul 18 02:09:02.322097 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-325871780 Jul 18 02:09:02.322097 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 99babb8db0e54c438e144b4ec1b46aff Jul 18 02:09:02.322097 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-325871780 Jul 18 02:09:02.322097 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-FlavorsAccessNegativeTestJSON-325871780-project Jul 18 02:09:02.322097 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:09:02.322097 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:09:02.322097 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 59a2fb8a5c374a46a90a7e767fe61ccb Jul 18 02:09:02.322097 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-325871780-project Jul 18 02:09:02.322097 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:09:02.322097 n-d-465891-3 devstack@n-api.service[119544]: {"addTenantAccess": {"tenant": "99babb8db0e54c438e144b4ec1b46aff"}} Jul 18 02:09:02.322097 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:09:02.322889 n-d-465891-3 devstack@n-api.service[119544]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 18 02:09:02.322889 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '1927701834', 'body': {'addTenantAccess': {'tenant': '99babb8db0e54c438e144b4ec1b46aff'}}} Jul 18 02:09:02.322889 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:09:02.322889 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:02.322889 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:02.322889 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:02.322889 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:09:02.322889 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:09:02.322889 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:09:02.322889 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:09:02.322889 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:09:02.322889 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:09:02.322889 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Jul 18 02:09:02.322889 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Jul 18 02:09:02.322889 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:09:02.322889 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:09:02.322889 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:09:02.322889 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:09:02.322889 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:09:02.324022 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:09:02.324022 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:09:02.324022 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:09:02.324022 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:09:02.324022 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:09:02.324022 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:09:02.324022 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:09:02.324022 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:09:02.324022 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:09:02.324022 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 18 02:09:02.324022 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:02.324022 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:02.324022 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:02.324022 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:02.324022 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:02.324022 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:02.324022 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:09:02.324022 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:09:02.324022 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 18 02:09:02.324022 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:02.329260 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-334ee46e-24aa-439a-aaf8-b6eae01bad55 tempest-FlavorsAccessNegativeTestJSON-325871780 tempest-FlavorsAccessNegativeTestJSON-325871780-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:09:02.330273 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-334ee46e-24aa-439a-aaf8-b6eae01bad55 tempest-FlavorsAccessNegativeTestJSON-325871780 tempest-FlavorsAccessNegativeTestJSON-325871780-project] 10.222.0.57 "POST /compute/v2.1/flavors/1927701834/action" status: 403 len: 130 microversion: 2.1 time: 0.395593 Jul 18 02:09:02.332940 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 179/372] 10.222.0.57 () {60 vars in 1199 bytes} [Mon Jul 18 02:09:01 2022] POST /compute/v2.1/flavors/1927701834/action => generated 130 bytes in 399 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:09:02.342404 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b0700fd7-8f46-4ae4-9314-684f09600f79 tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:02.378684 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b0700fd7-8f46-4ae4-9314-684f09600f79 tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/1927701834" status: 202 len: 0 microversion: 2.1 time: 0.039123 Jul 18 02:09:02.385951 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 180/373] 10.222.0.57 () {58 vars in 1160 bytes} [Mon Jul 18 02:09:02 2022] DELETE /compute/v2.1/flavors/1927701834 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:09:02.390549 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-77192050-568a-4eec-91ff-1166bc19e898 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:02.391156 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-77192050-568a-4eec-91ff-1166bc19e898 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: d8aad28a-a3d8-48d3-8fc7-50d65ab4e768] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:02.398722 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-77192050-568a-4eec-91ff-1166bc19e898 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:02.399390 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-77192050-568a-4eec-91ff-1166bc19e898 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:02.401206 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-77192050-568a-4eec-91ff-1166bc19e898 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:02.401912 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-77192050-568a-4eec-91ff-1166bc19e898 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:02.640609 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2e0d5934-3b63-465c-aeff-0ac93750101a tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:02.650634 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2e0d5934-3b63-465c-aeff-0ac93750101a tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:02.661841 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2e0d5934-3b63-465c-aeff-0ac93750101a tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:02.675900 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2e0d5934-3b63-465c-aeff-0ac93750101a tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] 10.222.0.57 "PUT /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 200 len: 1359 microversion: 2.75 time: 0.422092 Jul 18 02:09:02.676524 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 194/374] 10.222.0.57 () {62 vars in 1296 bytes} [Mon Jul 18 02:09:02 2022] PUT /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 1359 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:09:02.696292 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9c3a9cfb-c91c-4bfc-896a-a75903cb2954 tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:02.721990 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9c3a9cfb-c91c-4bfc-896a-a75903cb2954 tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.029576 Jul 18 02:09:02.722997 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 195/375] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:09:02 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:02.728436 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b6f2aa7b-2579-425d-8a02-9455091ff01f tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:02.729075 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b6f2aa7b-2579-425d-8a02-9455091ff01f tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: c71fb3ed-b430-443d-b16d-308cc483d3b2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:02.737278 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b6f2aa7b-2579-425d-8a02-9455091ff01f tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:02.737764 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b6f2aa7b-2579-425d-8a02-9455091ff01f tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:02.738517 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b6f2aa7b-2579-425d-8a02-9455091ff01f tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:02.739115 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b6f2aa7b-2579-425d-8a02-9455091ff01f tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:03.385228 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b6f2aa7b-2579-425d-8a02-9455091ff01f tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe4f42523df4204b49c9c0899c93fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0c0be2e96a499dbde6652cbc758a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:03.395532 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b6f2aa7b-2579-425d-8a02-9455091ff01f tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "GET /compute/v2.1/servers/c71fb3ed-b430-443d-b16d-308cc483d3b2" status: 200 len: 1319 microversion: 2.1 time: 0.671373 Jul 18 02:09:03.396836 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 196/376] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:02 2022] GET /compute/v2.1/servers/c71fb3ed-b430-443d-b16d-308cc483d3b2 => generated 1319 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:03.401623 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c0b3e101-efad-4367-b934-a426c827a5a2 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:03.402267 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c0b3e101-efad-4367-b934-a426c827a5a2 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:03.413611 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c0b3e101-efad-4367-b934-a426c827a5a2 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:03.414509 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c0b3e101-efad-4367-b934-a426c827a5a2 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:03.415407 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c0b3e101-efad-4367-b934-a426c827a5a2 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:03.415714 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c0b3e101-efad-4367-b934-a426c827a5a2 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:03.498683 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-77192050-568a-4eec-91ff-1166bc19e898 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:03.507546 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-77192050-568a-4eec-91ff-1166bc19e898 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768" status: 200 len: 1307 microversion: 2.1 time: 1.120691 Jul 18 02:09:03.519480 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 181/377] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:02 2022] GET /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768 => generated 1307 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:03.531992 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-31cfc251-492a-41c7-aa96-ee5a85361220 tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1992584841", "id": 408214795, "os-flavor-access:is_public": "False"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:03.534766 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:03.534766 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:09:03.570169 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-31cfc251-492a-41c7-aa96-ee5a85361220 tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.048995 Jul 18 02:09:03.571064 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 182/378] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:09:03 2022] POST /compute/v2.1/flavors => generated 436 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:03.586260 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e41b6f27-1f01-4de8-99f9-3173326e9e6e tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "99babb8db0e54c438e144b4ec1b46aff"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:03.589136 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:03.589136 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:09:03.701190 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c0b3e101-efad-4367-b934-a426c827a5a2 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:03.715224 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c0b3e101-efad-4367-b934-a426c827a5a2 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:03.720924 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c0b3e101-efad-4367-b934-a426c827a5a2 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:03.732685 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c0b3e101-efad-4367-b934-a426c827a5a2 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] 10.222.0.57 "GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 200 len: 1411 microversion: 2.75 time: 0.334213 Jul 18 02:09:03.734552 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 197/379] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:09:03 2022] GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 1411 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:09:04.131891 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e41b6f27-1f01-4de8-99f9-3173326e9e6e tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors/408214795/action" status: 200 len: 96 microversion: 2.1 time: 0.552727 Jul 18 02:09:04.138333 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 183/380] 10.222.0.57 () {60 vars in 1196 bytes} [Mon Jul 18 02:09:03 2022] POST /compute/v2.1/flavors/408214795/action => generated 96 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:09:04.144242 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fb5403a1-087b-4cbd-80f6-02c9529ecac5 tempest-FlavorsAccessNegativeTestJSON-325871780 tempest-FlavorsAccessNegativeTestJSON-325871780-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "99babb8db0e54c438e144b4ec1b46aff"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:04.145632 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:04.145632 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:09:04.146592 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fb5403a1-087b-4cbd-80f6-02c9529ecac5 tempest-FlavorsAccessNegativeTestJSON-325871780 tempest-FlavorsAccessNegativeTestJSON-325871780-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '59a2fb8a5c374a46a90a7e767fe61ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99babb8db0e54c438e144b4ec1b46aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:04.148303 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fb5403a1-087b-4cbd-80f6-02c9529ecac5 tempest-FlavorsAccessNegativeTestJSON-325871780 tempest-FlavorsAccessNegativeTestJSON-325871780-project] Request method failure captured: Jul 18 02:09:04.148303 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/flavors/408214795/action HTTP/1.1 Jul 18 02:09:04.148303 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:09:04.148303 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:09:04.148303 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:09:04.148303 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 70 Jul 18 02:09:04.148303 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:09:04.148303 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:09:04.148303 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:09:04.148303 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:09:04.148303 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MC2jvvv45vPZx40p6VQnSTOPUpWjNtyjFeIix_haIgb1kUgph-kxbUpgXmxkApn40VH2CW3XpzzVUJKsdIyelfpboq-LKpyv1S-I-UAAVkX-KYJ8c60vedOZSxQl8S16fbEVGvjfl-eHWjDiUue7ms8nDKvuAT_9uVZFyulLQq9n-I Jul 18 02:09:04.148303 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:09:04.148303 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:09:04.148303 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:09:04.148303 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:09:04.148303 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:09:04.148303 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:09:04.148303 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 99babb8db0e54c438e144b4ec1b46aff Jul 18 02:09:04.148303 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-325871780 Jul 18 02:09:04.148303 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:09:04.148303 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:09:04.149613 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_99babb8db0e54c438e144b4ec1b46aff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/99babb8db0e54c438e144b4ec1b46aff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/99babb8db0e54c438e144b4ec1b46aff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/99babb8db0e54c438e144b4ec1b46aff"}]}] Jul 18 02:09:04.149613 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-325871780 Jul 18 02:09:04.149613 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 99babb8db0e54c438e144b4ec1b46aff Jul 18 02:09:04.149613 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-325871780 Jul 18 02:09:04.149613 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-FlavorsAccessNegativeTestJSON-325871780-project Jul 18 02:09:04.149613 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:09:04.149613 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:09:04.149613 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 59a2fb8a5c374a46a90a7e767fe61ccb Jul 18 02:09:04.149613 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-325871780-project Jul 18 02:09:04.149613 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 02:09:04.149613 n-d-465891-3 devstack@n-api.service[119543]: {"removeTenantAccess": {"tenant": "99babb8db0e54c438e144b4ec1b46aff"}} Jul 18 02:09:04.149613 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:09:04.154260 n-d-465891-3 devstack@n-api.service[119543]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 18 02:09:04.154260 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '408214795', 'body': {'removeTenantAccess': {'tenant': '99babb8db0e54c438e144b4ec1b46aff'}}} Jul 18 02:09:04.154260 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:09:04.154260 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:04.154260 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:04.154260 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:04.154260 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:09:04.154260 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:09:04.154260 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:09:04.154260 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:09:04.154260 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:09:04.154260 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:09:04.154260 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Jul 18 02:09:04.154260 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi context.can( Jul 18 02:09:04.154260 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:09:04.154260 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:09:04.154260 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:09:04.154260 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:09:04.154260 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:09:04.154260 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:09:04.155550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:09:04.155550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:09:04.155550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:09:04.155550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:09:04.155550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:09:04.155550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:09:04.155550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:09:04.155550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:09:04.155550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 18 02:09:04.155550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:04.155550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:04.155550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:04.155550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:04.155550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:04.155550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:04.155550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:09:04.155550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:09:04.155550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 18 02:09:04.155550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:04.156576 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fb5403a1-087b-4cbd-80f6-02c9529ecac5 tempest-FlavorsAccessNegativeTestJSON-325871780 tempest-FlavorsAccessNegativeTestJSON-325871780-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:09:04.156576 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fb5403a1-087b-4cbd-80f6-02c9529ecac5 tempest-FlavorsAccessNegativeTestJSON-325871780 tempest-FlavorsAccessNegativeTestJSON-325871780-project] 10.222.0.57 "POST /compute/v2.1/flavors/408214795/action" status: 403 len: 133 microversion: 2.1 time: 0.011009 Jul 18 02:09:04.156576 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 198/381] 10.222.0.57 () {60 vars in 1196 bytes} [Mon Jul 18 02:09:04 2022] POST /compute/v2.1/flavors/408214795/action => generated 133 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:09:04.163934 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-65261fb6-272b-451d-9627-539251dea829 tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "99babb8db0e54c438e144b4ec1b46aff"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:04.165415 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:04.165415 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:09:04.413002 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bd0a609c-089f-4a2c-b11e-cd967b58c3f3 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:04.413601 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bd0a609c-089f-4a2c-b11e-cd967b58c3f3 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: c71fb3ed-b430-443d-b16d-308cc483d3b2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:04.420933 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bd0a609c-089f-4a2c-b11e-cd967b58c3f3 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:04.421627 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bd0a609c-089f-4a2c-b11e-cd967b58c3f3 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:04.422594 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bd0a609c-089f-4a2c-b11e-cd967b58c3f3 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:04.423186 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bd0a609c-089f-4a2c-b11e-cd967b58c3f3 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:04.605333 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-65261fb6-272b-451d-9627-539251dea829 tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors/408214795/action" status: 200 len: 21 microversion: 2.1 time: 0.449238 Jul 18 02:09:04.607554 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 184/382] 10.222.0.57 () {60 vars in 1196 bytes} [Mon Jul 18 02:09:04 2022] POST /compute/v2.1/flavors/408214795/action => generated 21 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:09:04.614358 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-54fd9eb1-6fd0-4838-85e8-c0401d09db8d tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:04.616248 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-54fd9eb1-6fd0-4838-85e8-c0401d09db8d tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: d8aad28a-a3d8-48d3-8fc7-50d65ab4e768] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:04.638946 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54fd9eb1-6fd0-4838-85e8-c0401d09db8d tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:04.640957 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54fd9eb1-6fd0-4838-85e8-c0401d09db8d tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:04.645157 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54fd9eb1-6fd0-4838-85e8-c0401d09db8d tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:04.646632 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54fd9eb1-6fd0-4838-85e8-c0401d09db8d tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:04.832297 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bd0a609c-089f-4a2c-b11e-cd967b58c3f3 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe4f42523df4204b49c9c0899c93fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0c0be2e96a499dbde6652cbc758a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:04.848197 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bd0a609c-089f-4a2c-b11e-cd967b58c3f3 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "GET /compute/v2.1/servers/c71fb3ed-b430-443d-b16d-308cc483d3b2" status: 200 len: 1319 microversion: 2.1 time: 0.439556 Jul 18 02:09:04.848899 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 199/383] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:04 2022] GET /compute/v2.1/servers/c71fb3ed-b430-443d-b16d-308cc483d3b2 => generated 1319 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:09:04.863937 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-20aeb30d-b242-41ba-bbf0-fdc7dd624d59 tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:04.865516 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:04.865516 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:09:04.895513 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-20aeb30d-b242-41ba-bbf0-fdc7dd624d59 tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/408214795" status: 202 len: 0 microversion: 2.1 time: 0.036023 Jul 18 02:09:04.900788 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 200/384] 10.222.0.57 () {58 vars in 1157 bytes} [Mon Jul 18 02:09:04 2022] DELETE /compute/v2.1/flavors/408214795 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:09:04.915521 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e10785ea-c7fe-413f-975f-ca8a1449eaa8 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:04.916425 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e10785ea-c7fe-413f-975f-ca8a1449eaa8 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:04.933892 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e10785ea-c7fe-413f-975f-ca8a1449eaa8 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:04.934411 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e10785ea-c7fe-413f-975f-ca8a1449eaa8 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:04.935217 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e10785ea-c7fe-413f-975f-ca8a1449eaa8 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:04.941981 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e10785ea-c7fe-413f-975f-ca8a1449eaa8 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:05.019006 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-54fd9eb1-6fd0-4838-85e8-c0401d09db8d tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:05.030082 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-54fd9eb1-6fd0-4838-85e8-c0401d09db8d tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768" status: 200 len: 1307 microversion: 2.1 time: 0.419719 Jul 18 02:09:05.040115 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 185/385] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:04 2022] GET /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768 => generated 1307 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:05.040115 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8b2f007a-6551-47aa-aa55-d92b5735c4b7 tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:05.065494 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8b2f007a-6551-47aa-aa55-d92b5735c4b7 tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.033086 Jul 18 02:09:05.077728 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 186/386] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:09:05 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:05.086497 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-aa7e6b59-6b53-4d0f-8363-97d24cfd38cf tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1258365391", "id": 1060224474, "os-flavor-access:is_public": "False"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:05.088379 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:05.088379 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:09:05.092953 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e10785ea-c7fe-413f-975f-ca8a1449eaa8 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:05.106671 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e10785ea-c7fe-413f-975f-ca8a1449eaa8 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:05.108786 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e10785ea-c7fe-413f-975f-ca8a1449eaa8 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:05.122261 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e10785ea-c7fe-413f-975f-ca8a1449eaa8 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] 10.222.0.57 "GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 200 len: 1417 microversion: 2.75 time: 0.219524 Jul 18 02:09:05.126370 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-aa7e6b59-6b53-4d0f-8363-97d24cfd38cf tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.044025 Jul 18 02:09:05.127966 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 201/387] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:09:04 2022] GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 1417 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:09:05.133760 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 187/388] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:09:05 2022] POST /compute/v2.1/flavors => generated 439 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:05.140942 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9c7633e7-cd5a-4a4a-8eeb-2264fbea064a tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "62dbc8ecfe874a2c933c5dc5454356f9"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:05.142273 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:05.142273 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:09:05.538701 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-9c7633e7-cd5a-4a4a-8eeb-2264fbea064a tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] HTTP exception thrown: Flavor access not found for 37 / 62dbc8ecfe874a2c933c5dc5454356f9 combination. Jul 18 02:09:05.541534 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9c7633e7-cd5a-4a4a-8eeb-2264fbea064a tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] Request method failure captured: Jul 18 02:09:05.541534 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/flavors/1060224474/action HTTP/1.1 Jul 18 02:09:05.541534 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:09:05.541534 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:09:05.541534 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:09:05.541534 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 70 Jul 18 02:09:05.541534 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:09:05.541534 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:09:05.541534 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:09:05.541534 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:09:05.541534 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MC4Gf0cpXc0DD0jsqpenTDVfgOtPm8e1vv8jfSy8wRVkI6FzxDjELKfcobhzcSt3EAeJApYJZwiBYizZVLGyu_0Xnk_hyIuv6sEzu8x5tdZ7NSo1mHRLAGhkXcJcUZqaKCjDwbjpNrAbWJnWOrSlsHaDPXHxKQScu6j5rB4BCYU_Jg Jul 18 02:09:05.541534 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:09:05.541534 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:09:05.541534 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:09:05.541534 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:09:05.541534 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:09:05.541534 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:09:05.541534 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: da852784bbbc488683a59a853eedf376 Jul 18 02:09:05.541534 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1788166550 Jul 18 02:09:05.541534 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,admin,reader Jul 18 02:09:05.541534 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,admin,reader Jul 18 02:09:05.543235 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_da852784bbbc488683a59a853eedf376"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/da852784bbbc488683a59a853eedf376"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/da852784bbbc488683a59a853eedf376"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/da852784bbbc488683a59a853eedf376"}]}] Jul 18 02:09:05.543235 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1788166550 Jul 18 02:09:05.543235 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: da852784bbbc488683a59a853eedf376 Jul 18 02:09:05.543235 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1788166550 Jul 18 02:09:05.543235 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin Jul 18 02:09:05.543235 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:09:05.543235 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:09:05.543235 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 6c6e5c6057bf4e0289220d94b93b7fdd Jul 18 02:09:05.543235 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin Jul 18 02:09:05.543235 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 02:09:05.543235 n-d-465891-3 devstack@n-api.service[119543]: {"removeTenantAccess": {"tenant": "62dbc8ecfe874a2c933c5dc5454356f9"}} Jul 18 02:09:05.543235 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:09:05.544124 n-d-465891-3 devstack@n-api.service[119543]: exception: Flavor access not found for 37 / 62dbc8ecfe874a2c933c5dc5454356f9 combination. Jul 18 02:09:05.544124 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '1060224474', 'body': {'removeTenantAccess': {'tenant': '62dbc8ecfe874a2c933c5dc5454356f9'}}} Jul 18 02:09:05.544124 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:09:05.544124 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:05.544124 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Jul 18 02:09:05.544124 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Jul 18 02:09:05.544124 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 18 02:09:05.544124 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 18 02:09:05.544124 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Jul 18 02:09:05.544124 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Jul 18 02:09:05.544124 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Jul 18 02:09:05.544124 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Jul 18 02:09:05.544124 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Jul 18 02:09:05.544124 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Jul 18 02:09:05.544124 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:09:05.544124 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:09:05.544124 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Jul 18 02:09:05.544124 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Jul 18 02:09:05.545301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 37 / 62dbc8ecfe874a2c933c5dc5454356f9 combination. Jul 18 02:09:05.545301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:05.545301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:05.545301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:05.545301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:05.545301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:05.545301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:05.545301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:09:05.545301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:09:05.545301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:09:05.545301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:09:05.545301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:09:05.545301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:09:05.545301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Jul 18 02:09:05.545301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:09:05.545301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 37 / 62dbc8ecfe874a2c933c5dc5454356f9 combination. Jul 18 02:09:05.545301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:05.545301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:05.545301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:05.545301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:05.546429 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:05.546429 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:05.546429 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:09:05.546429 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:09:05.546429 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 37 / 62dbc8ecfe874a2c933c5dc5454356f9 combination. Jul 18 02:09:05.546429 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:05.548326 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9c7633e7-cd5a-4a4a-8eeb-2264fbea064a tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] Returning 404 to user: Flavor access not found for 37 / 62dbc8ecfe874a2c933c5dc5454356f9 combination. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:09:05.550377 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9c7633e7-cd5a-4a4a-8eeb-2264fbea064a tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors/1060224474/action" status: 404 len: 124 microversion: 2.1 time: 0.413598 Jul 18 02:09:05.561445 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f6a0216b-d86b-40e6-bcd0-f5cb54aba4b2 tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:05.562328 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:05.562328 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:09:05.566925 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 202/389] 10.222.0.57 () {60 vars in 1199 bytes} [Mon Jul 18 02:09:05 2022] POST /compute/v2.1/flavors/1060224474/action => generated 124 bytes in 432 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:09:05.589472 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f6a0216b-d86b-40e6-bcd0-f5cb54aba4b2 tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/1060224474" status: 202 len: 0 microversion: 2.1 time: 0.032636 Jul 18 02:09:05.598049 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 188/390] 10.222.0.57 () {58 vars in 1160 bytes} [Mon Jul 18 02:09:05 2022] DELETE /compute/v2.1/flavors/1060224474 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:09:05.600784 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-76084c56-7d42-426a-b57f-086c3662e2a7 tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:05.625839 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-76084c56-7d42-426a-b57f-086c3662e2a7 tempest-FlavorsAccessNegativeTestJSON-1788166550 tempest-FlavorsAccessNegativeTestJSON-1788166550-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.030040 Jul 18 02:09:05.644367 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 203/391] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:09:05 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:05.854327 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-298c4eec-0b19-412a-af8f-a1202b8f235f req-62c64c4f-2784-4b2d-94fa-d2728dc2e87b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c71fb3ed-b430-443d-b16d-308cc483d3b2", "name": "network-vif-plugged", "status": "completed", "tag": "0ddec30d-c681-4472-b329-e657ad12aef0"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:05.869429 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-26a08bb9-99ea-402b-85ec-432f1a7d9ba3 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:05.872526 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-26a08bb9-99ea-402b-85ec-432f1a7d9ba3 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: c71fb3ed-b430-443d-b16d-308cc483d3b2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:05.885826 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-26a08bb9-99ea-402b-85ec-432f1a7d9ba3 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:05.886866 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-298c4eec-0b19-412a-af8f-a1202b8f235f req-62c64c4f-2784-4b2d-94fa-d2728dc2e87b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:05.889901 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-26a08bb9-99ea-402b-85ec-432f1a7d9ba3 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:05.892309 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-26a08bb9-99ea-402b-85ec-432f1a7d9ba3 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:05.892994 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-298c4eec-0b19-412a-af8f-a1202b8f235f req-62c64c4f-2784-4b2d-94fa-d2728dc2e87b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:05.895749 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-26a08bb9-99ea-402b-85ec-432f1a7d9ba3 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:05.934724 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-298c4eec-0b19-412a-af8f-a1202b8f235f req-62c64c4f-2784-4b2d-94fa-d2728dc2e87b service nova] Creating event network-vif-plugged:0ddec30d-c681-4472-b329-e657ad12aef0 for instance c71fb3ed-b430-443d-b16d-308cc483d3b2 on n-h1-465891-3 Jul 18 02:09:05.946313 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-298c4eec-0b19-412a-af8f-a1202b8f235f req-62c64c4f-2784-4b2d-94fa-d2728dc2e87b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096072 Jul 18 02:09:05.954152 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 189/392] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:06.209127 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-26a08bb9-99ea-402b-85ec-432f1a7d9ba3 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe4f42523df4204b49c9c0899c93fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0c0be2e96a499dbde6652cbc758a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:06.219981 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-26a08bb9-99ea-402b-85ec-432f1a7d9ba3 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "GET /compute/v2.1/servers/c71fb3ed-b430-443d-b16d-308cc483d3b2" status: 200 len: 1319 microversion: 2.1 time: 0.358218 Jul 18 02:09:06.224635 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 204/393] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:05 2022] GET /compute/v2.1/servers/c71fb3ed-b430-443d-b16d-308cc483d3b2 => generated 1319 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:09:06.236972 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d9e4b230-c89f-42d8-b615-fa79f18f32ed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:06.237099 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d9e4b230-c89f-42d8-b615-fa79f18f32ed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: d8aad28a-a3d8-48d3-8fc7-50d65ab4e768] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:06.256075 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d9e4b230-c89f-42d8-b615-fa79f18f32ed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:06.256075 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d9e4b230-c89f-42d8-b615-fa79f18f32ed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:06.256268 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d9e4b230-c89f-42d8-b615-fa79f18f32ed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:06.256570 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d9e4b230-c89f-42d8-b615-fa79f18f32ed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:06.510793 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-26a178c8-e42a-4932-a2d8-eb917d3c55ff tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] Calling method '.version_select at 0x7ff4a9298700>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:06.517526 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:06.517526 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:09:06.520031 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26a178c8-e42a-4932-a2d8-eb917d3c55ff tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:06.520483 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26a178c8-e42a-4932-a2d8-eb917d3c55ff tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:06.521278 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26a178c8-e42a-4932-a2d8-eb917d3c55ff tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:06.521723 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26a178c8-e42a-4932-a2d8-eb917d3c55ff tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:06.576370 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-26a178c8-e42a-4932-a2d8-eb917d3c55ff tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.620599 Jul 18 02:09:06.576970 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 190/394] 10.222.0.57 () {58 vars in 1127 bytes} [Mon Jul 18 02:09:05 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:06.585166 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a847f2aa-9f06-40df-85d1-1ea6c30d5781 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:06.588157 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a847f2aa-9f06-40df-85d1-1ea6c30d5781 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:06.597908 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a847f2aa-9f06-40df-85d1-1ea6c30d5781 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:06.599165 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a847f2aa-9f06-40df-85d1-1ea6c30d5781 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:06.600103 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a847f2aa-9f06-40df-85d1-1ea6c30d5781 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:06.600683 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a847f2aa-9f06-40df-85d1-1ea6c30d5781 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:06.713097 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d9e4b230-c89f-42d8-b615-fa79f18f32ed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:06.726528 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d9e4b230-c89f-42d8-b615-fa79f18f32ed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768" status: 200 len: 1307 microversion: 2.1 time: 0.500163 Jul 18 02:09:06.729639 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 205/395] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:06 2022] GET /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768 => generated 1307 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:06.744119 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c9f99141-7f6c-4c8a-bd72-4ff5c896b67f tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] Calling method '.version_select at 0x7ff4a9312670>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:06.747498 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:06.747498 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:09:06.748785 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c9f99141-7f6c-4c8a-bd72-4ff5c896b67f tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:06.749254 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c9f99141-7f6c-4c8a-bd72-4ff5c896b67f tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:06.750129 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c9f99141-7f6c-4c8a-bd72-4ff5c896b67f tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:06.754327 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c9f99141-7f6c-4c8a-bd72-4ff5c896b67f tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:06.818863 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a847f2aa-9f06-40df-85d1-1ea6c30d5781 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:06.823530 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c9f99141-7f6c-4c8a-bd72-4ff5c896b67f tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.089437 Jul 18 02:09:06.825689 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 206/396] 10.222.0.57 () {58 vars in 1138 bytes} [Mon Jul 18 02:09:06 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:06.841808 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a847f2aa-9f06-40df-85d1-1ea6c30d5781 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:06.845157 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0fccdf11-cbae-4857-9639-11f75a950e36 tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] Calling method '.version_select at 0x7ff4a94b68b0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:06.846889 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a847f2aa-9f06-40df-85d1-1ea6c30d5781 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:06.851426 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:06.851426 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:09:06.854512 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0fccdf11-cbae-4857-9639-11f75a950e36 tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:06.855355 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0fccdf11-cbae-4857-9639-11f75a950e36 tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:06.877309 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0fccdf11-cbae-4857-9639-11f75a950e36 tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:06.879871 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0fccdf11-cbae-4857-9639-11f75a950e36 tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:06.887849 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a847f2aa-9f06-40df-85d1-1ea6c30d5781 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] 10.222.0.57 "GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 200 len: 1438 microversion: 2.75 time: 0.309291 Jul 18 02:09:06.895101 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=19 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:09:06.896543 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 191/397] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:09:06 2022] GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 1438 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:09:06.915990 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-01b309e4-143e-402a-a39f-8d317f18b6de tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:06.917478 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-01b309e4-143e-402a-a39f-8d317f18b6de tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:06.927640 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-01b309e4-143e-402a-a39f-8d317f18b6de tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:06.928448 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-01b309e4-143e-402a-a39f-8d317f18b6de tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:06.929398 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-01b309e4-143e-402a-a39f-8d317f18b6de tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:06.930017 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-01b309e4-143e-402a-a39f-8d317f18b6de tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:06.946037 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0fccdf11-cbae-4857-9639-11f75a950e36 tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.111270 Jul 18 02:09:06.947726 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 207/398] 10.222.0.57 () {58 vars in 1144 bytes} [Mon Jul 18 02:09:06 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:09:06.962888 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-58991448-6ca8-4477-833c-7a0e32fa164d tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] Calling method '.version_select at 0x7ff4a915b820>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:06.965253 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:06.965253 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:09:06.968736 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-58991448-6ca8-4477-833c-7a0e32fa164d tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:06.969628 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-58991448-6ca8-4477-833c-7a0e32fa164d tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:06.970996 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-58991448-6ca8-4477-833c-7a0e32fa164d tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:06.972104 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-58991448-6ca8-4477-833c-7a0e32fa164d tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:07.008118 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-58991448-6ca8-4477-833c-7a0e32fa164d tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.051420 Jul 18 02:09:07.009623 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 208/399] 10.222.0.57 () {58 vars in 1127 bytes} [Mon Jul 18 02:09:06 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:07.014417 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:09:07.020384 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1d25edd6-6f42-490b-8db6-557f4b805b93 tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] Calling method '.version_select at 0x7ff4a91cbca0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:07.023206 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:07.023206 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:09:07.024786 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1d25edd6-6f42-490b-8db6-557f4b805b93 tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:07.025728 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1d25edd6-6f42-490b-8db6-557f4b805b93 tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:07.026794 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1d25edd6-6f42-490b-8db6-557f4b805b93 tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:07.027452 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1d25edd6-6f42-490b-8db6-557f4b805b93 tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:07.080776 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1d25edd6-6f42-490b-8db6-557f4b805b93 tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.065824 Jul 18 02:09:07.082697 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 209/400] 10.222.0.57 () {58 vars in 1154 bytes} [Mon Jul 18 02:09:07 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:07.096988 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-352638cc-6dbf-4a70-8040-9091c64ab21b tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] Calling method '.version_select at 0x7ff4a94b6940>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:07.098444 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:07.098444 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:09:07.099856 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-352638cc-6dbf-4a70-8040-9091c64ab21b tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:07.100547 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-352638cc-6dbf-4a70-8040-9091c64ab21b tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:07.103586 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-352638cc-6dbf-4a70-8040-9091c64ab21b tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:07.104245 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-352638cc-6dbf-4a70-8040-9091c64ab21b tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:07.145494 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-01b309e4-143e-402a-a39f-8d317f18b6de tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:09:07.147942 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-01b309e4-143e-402a-a39f-8d317f18b6de tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:09:07.150232 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-352638cc-6dbf-4a70-8040-9091c64ab21b tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.061521 Jul 18 02:09:07.151056 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 210/401] 10.222.0.57 () {58 vars in 1127 bytes} [Mon Jul 18 02:09:07 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:07.160054 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-01b309e4-143e-402a-a39f-8d317f18b6de tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:09:07.163585 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-01b309e4-143e-402a-a39f-8d317f18b6de tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:09:07.164372 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-01b309e4-143e-402a-a39f-8d317f18b6de tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:09:07.172546 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f561f632-8a78-4ab6-bb6c-5d51b80b2584 tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] Calling method '.version_select at 0x7ff4a91cbc10>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:07.175390 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:07.175390 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:09:07.188974 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f561f632-8a78-4ab6-bb6c-5d51b80b2584 tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:07.190338 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f561f632-8a78-4ab6-bb6c-5d51b80b2584 tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:07.236920 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f561f632-8a78-4ab6-bb6c-5d51b80b2584 tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:07.241255 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f561f632-8a78-4ab6-bb6c-5d51b80b2584 tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:07.273398 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f561f632-8a78-4ab6-bb6c-5d51b80b2584 tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hosts/n-h2-465891-3" status: 200 len: 598 microversion: 2.1 time: 0.111776 Jul 18 02:09:07.274461 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 211/402] 10.222.0.57 () {58 vars in 1169 bytes} [Mon Jul 18 02:09:07 2022] GET /compute/v2.1/os-hosts/n-h2-465891-3 => generated 598 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:07.280509 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1eb967ef-f317-4a73-8cad-cf2a3e7b2203 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:07.281468 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1eb967ef-f317-4a73-8cad-cf2a3e7b2203 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: c71fb3ed-b430-443d-b16d-308cc483d3b2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:07.306505 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1eb967ef-f317-4a73-8cad-cf2a3e7b2203 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:07.308451 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1eb967ef-f317-4a73-8cad-cf2a3e7b2203 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:07.311136 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1eb967ef-f317-4a73-8cad-cf2a3e7b2203 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:07.311841 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1eb967ef-f317-4a73-8cad-cf2a3e7b2203 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:07.373212 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-01b309e4-143e-402a-a39f-8d317f18b6de tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:07.383367 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-01b309e4-143e-402a-a39f-8d317f18b6de tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:07.384972 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-01b309e4-143e-402a-a39f-8d317f18b6de tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:07.386031 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-01b309e4-143e-402a-a39f-8d317f18b6de tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:07.386806 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-01b309e4-143e-402a-a39f-8d317f18b6de tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:07.523026 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-01b309e4-143e-402a-a39f-8d317f18b6de tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:07.531623 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-01b309e4-143e-402a-a39f-8d317f18b6de tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:07.533127 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-01b309e4-143e-402a-a39f-8d317f18b6de tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:07.550188 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-01b309e4-143e-402a-a39f-8d317f18b6de tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] 10.222.0.57 "POST /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a/action" status: 202 len: 1495 microversion: 2.75 time: 0.638426 Jul 18 02:09:07.551812 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 192/403] 10.222.0.57 () {62 vars in 1318 bytes} [Mon Jul 18 02:09:06 2022] POST /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a/action => generated 1495 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Jul 18 02:09:07.567351 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d23fed95-ca5a-43bf-bcbc-b1acc5f4c7ab tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] Calling method '.version_select at 0x7ff4a92f3790>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:07.568349 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:07.568349 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:09:07.576659 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d23fed95-ca5a-43bf-bcbc-b1acc5f4c7ab tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:07.577279 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d23fed95-ca5a-43bf-bcbc-b1acc5f4c7ab tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:07.599886 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d23fed95-ca5a-43bf-bcbc-b1acc5f4c7ab tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:07.600884 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d23fed95-ca5a-43bf-bcbc-b1acc5f4c7ab tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:07.665273 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d23fed95-ca5a-43bf-bcbc-b1acc5f4c7ab tempest-HostsAdminTestJSON-309654628 tempest-HostsAdminTestJSON-309654628-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hosts/n-h1-465891-3" status: 200 len: 598 microversion: 2.1 time: 0.102041 Jul 18 02:09:07.666391 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 193/404] 10.222.0.57 () {58 vars in 1169 bytes} [Mon Jul 18 02:09:07 2022] GET /compute/v2.1/os-hosts/n-h1-465891-3 => generated 598 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:07.675875 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a16a2676-5cf7-4344-9d06-0f507161a7e7 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:07.676731 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a16a2676-5cf7-4344-9d06-0f507161a7e7 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:07.683887 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a16a2676-5cf7-4344-9d06-0f507161a7e7 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:07.684934 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a16a2676-5cf7-4344-9d06-0f507161a7e7 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:07.685938 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a16a2676-5cf7-4344-9d06-0f507161a7e7 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:07.686644 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a16a2676-5cf7-4344-9d06-0f507161a7e7 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:07.752086 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1eb967ef-f317-4a73-8cad-cf2a3e7b2203 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe4f42523df4204b49c9c0899c93fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0c0be2e96a499dbde6652cbc758a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:07.762057 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1eb967ef-f317-4a73-8cad-cf2a3e7b2203 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "GET /compute/v2.1/servers/c71fb3ed-b430-443d-b16d-308cc483d3b2" status: 200 len: 1319 microversion: 2.1 time: 0.486384 Jul 18 02:09:07.762653 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 212/405] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:07 2022] GET /compute/v2.1/servers/c71fb3ed-b430-443d-b16d-308cc483d3b2 => generated 1319 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:07.778277 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1f6ca996-2561-47e7-9a7d-281074f80aed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:07.778967 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1f6ca996-2561-47e7-9a7d-281074f80aed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: d8aad28a-a3d8-48d3-8fc7-50d65ab4e768] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:07.802221 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1f6ca996-2561-47e7-9a7d-281074f80aed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:07.802814 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1f6ca996-2561-47e7-9a7d-281074f80aed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:07.804032 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1f6ca996-2561-47e7-9a7d-281074f80aed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:07.805047 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1f6ca996-2561-47e7-9a7d-281074f80aed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:07.809386 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a16a2676-5cf7-4344-9d06-0f507161a7e7 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:07.835247 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a16a2676-5cf7-4344-9d06-0f507161a7e7 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:07.840450 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a16a2676-5cf7-4344-9d06-0f507161a7e7 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:07.859095 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a16a2676-5cf7-4344-9d06-0f507161a7e7 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] 10.222.0.57 "GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 200 len: 1447 microversion: 2.75 time: 0.189732 Jul 18 02:09:07.862084 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 194/406] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:09:07 2022] GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 1447 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:09:08.180973 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1f6ca996-2561-47e7-9a7d-281074f80aed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:08.189023 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1f6ca996-2561-47e7-9a7d-281074f80aed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768" status: 200 len: 1307 microversion: 2.1 time: 0.415961 Jul 18 02:09:08.193018 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 213/407] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:07 2022] GET /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768 => generated 1307 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:08.781266 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-185cf1b4-84d8-4409-bd80-5ea079da070f tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:08.782728 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-185cf1b4-84d8-4409-bd80-5ea079da070f tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: c71fb3ed-b430-443d-b16d-308cc483d3b2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:08.792949 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=14,nova_api:INSERT=5 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:09:08.812406 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-185cf1b4-84d8-4409-bd80-5ea079da070f tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:08.824419 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-185cf1b4-84d8-4409-bd80-5ea079da070f tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:08.826195 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-185cf1b4-84d8-4409-bd80-5ea079da070f tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:08.830120 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-185cf1b4-84d8-4409-bd80-5ea079da070f tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:08.890909 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-47ac9876-1f9b-4983-b39b-74b54073dda4 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:08.893124 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-47ac9876-1f9b-4983-b39b-74b54073dda4 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:08.915435 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-47ac9876-1f9b-4983-b39b-74b54073dda4 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:08.917378 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-47ac9876-1f9b-4983-b39b-74b54073dda4 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:08.921344 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-47ac9876-1f9b-4983-b39b-74b54073dda4 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:08.922118 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-47ac9876-1f9b-4983-b39b-74b54073dda4 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:09.071343 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-47ac9876-1f9b-4983-b39b-74b54073dda4 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:09.080996 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-47ac9876-1f9b-4983-b39b-74b54073dda4 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:09.083331 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-47ac9876-1f9b-4983-b39b-74b54073dda4 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:09.089789 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-47ac9876-1f9b-4983-b39b-74b54073dda4 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] 10.222.0.57 "GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 200 len: 1447 microversion: 2.75 time: 0.214029 Jul 18 02:09:09.104138 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 214/408] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:09:08 2022] GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 1447 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:09:09.255520 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-185cf1b4-84d8-4409-bd80-5ea079da070f tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe4f42523df4204b49c9c0899c93fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0c0be2e96a499dbde6652cbc758a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:09.264272 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-185cf1b4-84d8-4409-bd80-5ea079da070f tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "GET /compute/v2.1/servers/c71fb3ed-b430-443d-b16d-308cc483d3b2" status: 200 len: 1469 microversion: 2.1 time: 0.487809 Jul 18 02:09:09.267397 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 195/409] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:08 2022] GET /compute/v2.1/servers/c71fb3ed-b430-443d-b16d-308cc483d3b2 => generated 1469 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:09.283551 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5daf7d09-611f-4c2a-aa0c-21768aeef385 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:09.284449 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5daf7d09-611f-4c2a-aa0c-21768aeef385 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: d8aad28a-a3d8-48d3-8fc7-50d65ab4e768] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:09.300467 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5daf7d09-611f-4c2a-aa0c-21768aeef385 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:09.303639 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5daf7d09-611f-4c2a-aa0c-21768aeef385 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:09.304684 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5daf7d09-611f-4c2a-aa0c-21768aeef385 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:09.307852 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5daf7d09-611f-4c2a-aa0c-21768aeef385 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:09.530641 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5cc0b69b-3b75-480a-851b-10597d563f1a tempest-SecurityGroupsTestAdminJSON-1149598485 tempest-SecurityGroupsTestAdminJSON-1149598485-project] Action: 'create', calling method: .version_select at 0x7ff4a9165550>, body: {"security_group": {"name": "tempest-securitygroup-1866802791", "description": "tempest-description-637140789"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:09.660540 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5daf7d09-611f-4c2a-aa0c-21768aeef385 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:09.668493 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5daf7d09-611f-4c2a-aa0c-21768aeef385 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768" status: 200 len: 1307 microversion: 2.1 time: 0.399231 Jul 18 02:09:09.669419 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 196/410] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:09 2022] GET /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768 => generated 1307 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:09.674486 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c493a6df-81e4-42e6-bf2b-54fc8e875b89 tempest-DeleteServersAdminTestJSON-626887470 tempest-DeleteServersAdminTestJSON-626887470-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:09.675820 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c493a6df-81e4-42e6-bf2b-54fc8e875b89 tempest-DeleteServersAdminTestJSON-626887470 tempest-DeleteServersAdminTestJSON-626887470-project-admin] [instance: c71fb3ed-b430-443d-b16d-308cc483d3b2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:09.683910 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c493a6df-81e4-42e6-bf2b-54fc8e875b89 tempest-DeleteServersAdminTestJSON-626887470 tempest-DeleteServersAdminTestJSON-626887470-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:09.684654 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c493a6df-81e4-42e6-bf2b-54fc8e875b89 tempest-DeleteServersAdminTestJSON-626887470 tempest-DeleteServersAdminTestJSON-626887470-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:09.685660 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c493a6df-81e4-42e6-bf2b-54fc8e875b89 tempest-DeleteServersAdminTestJSON-626887470 tempest-DeleteServersAdminTestJSON-626887470-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:09.686349 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c493a6df-81e4-42e6-bf2b-54fc8e875b89 tempest-DeleteServersAdminTestJSON-626887470 tempest-DeleteServersAdminTestJSON-626887470-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:09.842343 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c493a6df-81e4-42e6-bf2b-54fc8e875b89 tempest-DeleteServersAdminTestJSON-626887470 tempest-DeleteServersAdminTestJSON-626887470-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/c71fb3ed-b430-443d-b16d-308cc483d3b2/action" status: 202 len: 0 microversion: 2.1 time: 0.168553 Jul 18 02:09:09.843405 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 197/411] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:09:09 2022] POST /compute/v2.1/servers/c71fb3ed-b430-443d-b16d-308cc483d3b2/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:09:09.851691 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-74085254-3f93-4e75-a014-02ee9ed3c6e4 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:09.852725 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-74085254-3f93-4e75-a014-02ee9ed3c6e4 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: c71fb3ed-b430-443d-b16d-308cc483d3b2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:09.862000 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74085254-3f93-4e75-a014-02ee9ed3c6e4 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:09.862892 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74085254-3f93-4e75-a014-02ee9ed3c6e4 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:09.863869 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74085254-3f93-4e75-a014-02ee9ed3c6e4 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:09.864467 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74085254-3f93-4e75-a014-02ee9ed3c6e4 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:09.926341 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74085254-3f93-4e75-a014-02ee9ed3c6e4 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:09.927486 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74085254-3f93-4e75-a014-02ee9ed3c6e4 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:09.928478 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-74085254-3f93-4e75-a014-02ee9ed3c6e4 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lazy-loading 'fault' on Instance uuid c71fb3ed-b430-443d-b16d-308cc483d3b2 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:09:10.119509 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-74085254-3f93-4e75-a014-02ee9ed3c6e4 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe4f42523df4204b49c9c0899c93fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0c0be2e96a499dbde6652cbc758a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:10.141160 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5cc0b69b-3b75-480a-851b-10597d563f1a tempest-SecurityGroupsTestAdminJSON-1149598485 tempest-SecurityGroupsTestAdminJSON-1149598485-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.035382 Jul 18 02:09:10.142160 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 215/412] 10.222.0.57 () {60 vars in 1179 bytes} [Mon Jul 18 02:09:09 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:10.142919 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-74085254-3f93-4e75-a014-02ee9ed3c6e4 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "GET /compute/v2.1/servers/c71fb3ed-b430-443d-b16d-308cc483d3b2" status: 200 len: 1452 microversion: 2.1 time: 0.285097 Jul 18 02:09:10.150389 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 198/413] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:09 2022] GET /compute/v2.1/servers/c71fb3ed-b430-443d-b16d-308cc483d3b2 => generated 1452 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:09:10.154635 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6b1eec60-f5dc-44eb-92b8-910ef0e63df1 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:10.156157 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6b1eec60-f5dc-44eb-92b8-910ef0e63df1 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:10.165257 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-403bc93a-2c04-4c98-9896-96271bc11ff7 tempest-SecurityGroupsTestAdminJSON-1149598485 tempest-SecurityGroupsTestAdminJSON-1149598485-project] Action: 'create', calling method: .version_select at 0x7ff4a9211b80>, body: {"security_group": {"name": "tempest-securitygroup-572425598", "description": "tempest-description-2125302083"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:10.192860 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6b1eec60-f5dc-44eb-92b8-910ef0e63df1 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:10.193314 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6b1eec60-f5dc-44eb-92b8-910ef0e63df1 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:10.199739 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6b1eec60-f5dc-44eb-92b8-910ef0e63df1 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:10.200207 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6b1eec60-f5dc-44eb-92b8-910ef0e63df1 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:10.248662 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:09:10.426775 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6b1eec60-f5dc-44eb-92b8-910ef0e63df1 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:10.441143 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6b1eec60-f5dc-44eb-92b8-910ef0e63df1 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:10.443308 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6b1eec60-f5dc-44eb-92b8-910ef0e63df1 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:10.457740 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6b1eec60-f5dc-44eb-92b8-910ef0e63df1 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] 10.222.0.57 "GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 200 len: 1447 microversion: 2.75 time: 0.313336 Jul 18 02:09:10.472410 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 216/414] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:09:10 2022] GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 1447 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:09:10.485631 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-13f5b7c5-b093-4bb7-a755-f7e626e9ecbc tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:10.488315 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-13f5b7c5-b093-4bb7-a755-f7e626e9ecbc tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: c71fb3ed-b430-443d-b16d-308cc483d3b2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:10.500832 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-13f5b7c5-b093-4bb7-a755-f7e626e9ecbc tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:10.503029 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-13f5b7c5-b093-4bb7-a755-f7e626e9ecbc tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:10.505154 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-13f5b7c5-b093-4bb7-a755-f7e626e9ecbc tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:10.506858 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-13f5b7c5-b093-4bb7-a755-f7e626e9ecbc tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:10.570852 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=81 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:09:10.587859 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-13f5b7c5-b093-4bb7-a755-f7e626e9ecbc tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: c71fb3ed-b430-443d-b16d-308cc483d3b2] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:09:10.662668 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-403bc93a-2c04-4c98-9896-96271bc11ff7 tempest-SecurityGroupsTestAdminJSON-1149598485 tempest-SecurityGroupsTestAdminJSON-1149598485-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.511011 Jul 18 02:09:10.665026 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 199/415] 10.222.0.57 () {60 vars in 1179 bytes} [Mon Jul 18 02:09:10 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:10.732980 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-13f5b7c5-b093-4bb7-a755-f7e626e9ecbc tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c71fb3ed-b430-443d-b16d-308cc483d3b2" status: 204 len: 0 microversion: 2.1 time: 0.258541 Jul 18 02:09:10.734265 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 217/416] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:09:10 2022] DELETE /compute/v2.1/servers/c71fb3ed-b430-443d-b16d-308cc483d3b2 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:09:10.744524 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d22ba2ca-8b63-44f0-86da-5c7b02098f23 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:10.745520 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d22ba2ca-8b63-44f0-86da-5c7b02098f23 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: d8aad28a-a3d8-48d3-8fc7-50d65ab4e768] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:10.753591 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:09:10.755465 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d22ba2ca-8b63-44f0-86da-5c7b02098f23 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:10.756193 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d22ba2ca-8b63-44f0-86da-5c7b02098f23 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:10.757303 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d22ba2ca-8b63-44f0-86da-5c7b02098f23 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:10.758054 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d22ba2ca-8b63-44f0-86da-5c7b02098f23 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:10.946238 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d22ba2ca-8b63-44f0-86da-5c7b02098f23 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:10.959812 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d22ba2ca-8b63-44f0-86da-5c7b02098f23 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768" status: 200 len: 1307 microversion: 2.1 time: 0.223584 Jul 18 02:09:10.960833 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 218/417] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:10 2022] GET /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768 => generated 1307 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:10.982760 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-669a6fd7-b092-413d-8018-d8bf7326501e tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:10.983686 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-669a6fd7-b092-413d-8018-d8bf7326501e tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: c71fb3ed-b430-443d-b16d-308cc483d3b2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:10.999368 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-669a6fd7-b092-413d-8018-d8bf7326501e tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:10.999825 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-669a6fd7-b092-413d-8018-d8bf7326501e tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:11.000620 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-669a6fd7-b092-413d-8018-d8bf7326501e tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:11.001055 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-669a6fd7-b092-413d-8018-d8bf7326501e tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:11.086486 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-669a6fd7-b092-413d-8018-d8bf7326501e tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:11.086942 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-669a6fd7-b092-413d-8018-d8bf7326501e tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:11.087400 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-669a6fd7-b092-413d-8018-d8bf7326501e tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lazy-loading 'fault' on Instance uuid c71fb3ed-b430-443d-b16d-308cc483d3b2 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:09:11.278708 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9cbd2998-e728-430d-ad41-dd28d962ce69 tempest-SecurityGroupsTestAdminJSON-1949305494 tempest-SecurityGroupsTestAdminJSON-1949305494-project-admin] Action: 'create', calling method: .version_select at 0x7ff4a91889d0>, body: {"security_group": {"name": "tempest-securitygroup-1877997752", "description": "tempest-description-809787105"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:11.340049 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-669a6fd7-b092-413d-8018-d8bf7326501e tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe4f42523df4204b49c9c0899c93fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0c0be2e96a499dbde6652cbc758a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:11.351925 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-669a6fd7-b092-413d-8018-d8bf7326501e tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "GET /compute/v2.1/servers/c71fb3ed-b430-443d-b16d-308cc483d3b2" status: 200 len: 1458 microversion: 2.1 time: 0.379596 Jul 18 02:09:11.355631 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 219/418] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:10 2022] GET /compute/v2.1/servers/c71fb3ed-b430-443d-b16d-308cc483d3b2 => generated 1458 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:11.481909 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9ebd985d-bad5-4d04-9493-df590d07afa7 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:11.483125 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9ebd985d-bad5-4d04-9493-df590d07afa7 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:11.504716 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9ebd985d-bad5-4d04-9493-df590d07afa7 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:11.507924 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9ebd985d-bad5-4d04-9493-df590d07afa7 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:11.510970 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9ebd985d-bad5-4d04-9493-df590d07afa7 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:11.512047 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9ebd985d-bad5-4d04-9493-df590d07afa7 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:11.669736 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9ebd985d-bad5-4d04-9493-df590d07afa7 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:11.686101 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9ebd985d-bad5-4d04-9493-df590d07afa7 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:11.687594 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9ebd985d-bad5-4d04-9493-df590d07afa7 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:11.696436 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9ebd985d-bad5-4d04-9493-df590d07afa7 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] 10.222.0.57 "GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 200 len: 1447 microversion: 2.75 time: 0.220316 Jul 18 02:09:11.708745 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 220/419] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:09:11 2022] GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 1447 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:09:11.803050 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9cbd2998-e728-430d-ad41-dd28d962ce69 tempest-SecurityGroupsTestAdminJSON-1949305494 tempest-SecurityGroupsTestAdminJSON-1949305494-project-admin] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.130990 Jul 18 02:09:11.803971 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 200/420] 10.222.0.57 () {60 vars in 1179 bytes} [Mon Jul 18 02:09:10 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:11.815533 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7da22239-845b-481a-955a-68a91b70d567 tempest-SecurityGroupsTestAdminJSON-1949305494 tempest-SecurityGroupsTestAdminJSON-1949305494-project-admin] Action: 'create', calling method: .version_select at 0x7ff4a90b1280>, body: {"security_group": {"name": "tempest-securitygroup-997032834", "description": "tempest-description-1093901716"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:12.043650 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7da22239-845b-481a-955a-68a91b70d567 tempest-SecurityGroupsTestAdminJSON-1949305494 tempest-SecurityGroupsTestAdminJSON-1949305494-project-admin] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.232920 Jul 18 02:09:12.044277 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 221/421] 10.222.0.57 () {60 vars in 1179 bytes} [Mon Jul 18 02:09:11 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:12.050997 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-07f503f0-bd5e-428f-865f-b3a185e0019c tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:12.051615 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-07f503f0-bd5e-428f-865f-b3a185e0019c tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: d8aad28a-a3d8-48d3-8fc7-50d65ab4e768] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:12.067023 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-07f503f0-bd5e-428f-865f-b3a185e0019c tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:12.068004 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-07f503f0-bd5e-428f-865f-b3a185e0019c tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:12.071060 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-07f503f0-bd5e-428f-865f-b3a185e0019c tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:12.072070 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-07f503f0-bd5e-428f-865f-b3a185e0019c tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:12.307802 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0b2ec821-05db-4076-b02c-379169e50e88 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-842364023", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "18a8c0db-595b-4b61-b28a-ffc00975cfcb"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:12.324527 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-07f503f0-bd5e-428f-865f-b3a185e0019c tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:12.338290 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-07f503f0-bd5e-428f-865f-b3a185e0019c tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768" status: 200 len: 1307 microversion: 2.1 time: 0.287093 Jul 18 02:09:12.339529 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 222/422] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:12 2022] GET /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768 => generated 1307 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:12.350924 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-34f8d35f-9d14-4831-9b35-f848f29656ed tempest-SecurityGroupsTestAdminJSON-1949305494 tempest-SecurityGroupsTestAdminJSON-1949305494-project-admin] Calling method '.version_select at 0x7ff4a91cba60>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:12.402302 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-0b2ec821-05db-4076-b02c-379169e50e88 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] validate_networks() for [('18a8c0db-595b-4b61-b28a-ffc00975cfcb', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:09:12.649575 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=17 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:09:13.760018 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-0b2ec821-05db-4076-b02c-379169e50e88 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:09:13.760617 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-0b2ec821-05db-4076-b02c-379169e50e88 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:09:13.760977 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-0b2ec821-05db-4076-b02c-379169e50e88 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:09:13.761389 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-0b2ec821-05db-4076-b02c-379169e50e88 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:09:13.762161 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-0b2ec821-05db-4076-b02c-379169e50e88 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:09:13.788700 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0b2ec821-05db-4076-b02c-379169e50e88 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:13.789161 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0b2ec821-05db-4076-b02c-379169e50e88 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:13.800380 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0b2ec821-05db-4076-b02c-379169e50e88 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:13.800852 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0b2ec821-05db-4076-b02c-379169e50e88 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:13.829594 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=19 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:09:13.874934 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-0b2ec821-05db-4076-b02c-379169e50e88 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Getting quotas for project d6b1efcf9e224d66b7dbf31c8aa89f87. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:09:13.891521 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-0b2ec821-05db-4076-b02c-379169e50e88 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Getting quotas for user 625ab51af53042138e5335e3ae6e5dac and project d6b1efcf9e224d66b7dbf31c8aa89f87. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:09:13.912007 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0b2ec821-05db-4076-b02c-379169e50e88 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:09:13.916094 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0b2ec821-05db-4076-b02c-379169e50e88 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: bd14a732-a9ad-4dfd-af61-69b84eda8877] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:09:14.007823 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0b2ec821-05db-4076-b02c-379169e50e88 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.052596 Jul 18 02:09:14.009089 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 201/423] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:09:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 02:09:14.014578 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0468c279-7fe7-45a0-a76d-d7075501139a tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:14.015466 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0468c279-7fe7-45a0-a76d-d7075501139a tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: c71fb3ed-b430-443d-b16d-308cc483d3b2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:14.024613 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0468c279-7fe7-45a0-a76d-d7075501139a tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:14.025280 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0468c279-7fe7-45a0-a76d-d7075501139a tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:14.026390 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0468c279-7fe7-45a0-a76d-d7075501139a tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:14.027070 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0468c279-7fe7-45a0-a76d-d7075501139a tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:14.150415 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0468c279-7fe7-45a0-a76d-d7075501139a tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:14.150862 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0468c279-7fe7-45a0-a76d-d7075501139a tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:14.151528 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-0468c279-7fe7-45a0-a76d-d7075501139a tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lazy-loading 'fault' on Instance uuid c71fb3ed-b430-443d-b16d-308cc483d3b2 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:09:14.229312 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0468c279-7fe7-45a0-a76d-d7075501139a tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe4f42523df4204b49c9c0899c93fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0c0be2e96a499dbde6652cbc758a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:14.242076 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0468c279-7fe7-45a0-a76d-d7075501139a tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "GET /compute/v2.1/servers/c71fb3ed-b430-443d-b16d-308cc483d3b2" status: 200 len: 1287 microversion: 2.1 time: 0.231559 Jul 18 02:09:14.243767 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 202/424] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:14 2022] GET /compute/v2.1/servers/c71fb3ed-b430-443d-b16d-308cc483d3b2 => generated 1287 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:14.251190 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-96b2f44c-09f2-4a4a-8ac4-75e539e1967a tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:14.253585 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-96b2f44c-09f2-4a4a-8ac4-75e539e1967a tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:14.267018 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-96b2f44c-09f2-4a4a-8ac4-75e539e1967a tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:14.269105 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-96b2f44c-09f2-4a4a-8ac4-75e539e1967a tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:14.270144 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-96b2f44c-09f2-4a4a-8ac4-75e539e1967a tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:14.271058 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-96b2f44c-09f2-4a4a-8ac4-75e539e1967a tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:14.355783 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-96b2f44c-09f2-4a4a-8ac4-75e539e1967a tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:14.365745 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-96b2f44c-09f2-4a4a-8ac4-75e539e1967a tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:14.367658 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-96b2f44c-09f2-4a4a-8ac4-75e539e1967a tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:14.373250 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-96b2f44c-09f2-4a4a-8ac4-75e539e1967a tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] 10.222.0.57 "GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 200 len: 1447 microversion: 2.75 time: 0.127123 Jul 18 02:09:14.375098 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 203/425] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:09:14 2022] GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 1447 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:09:14.703893 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d8956f58-a4ca-49d9-b23b-fee1b9b69fa1 tempest-FlavorsV255TestJSON-537661632 tempest-FlavorsV255TestJSON-537661632-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1050607674", "id": 1361999542, "os-flavor-access:is_public": "True"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:14.706070 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:14.706070 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:09:14.737066 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d8956f58-a4ca-49d9-b23b-fee1b9b69fa1 tempest-FlavorsV255TestJSON-537661632 tempest-FlavorsV255TestJSON-537661632-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.359932 Jul 18 02:09:14.739320 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 204/426] 10.222.0.57 () {62 vars in 1187 bytes} [Mon Jul 18 02:09:14 2022] POST /compute/v2.1/flavors => generated 449 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:09:14.746044 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5fdec8cd-b720-4453-8b45-45c231f75eb9 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:14.747030 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5fdec8cd-b720-4453-8b45-45c231f75eb9 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: d8aad28a-a3d8-48d3-8fc7-50d65ab4e768] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:14.761363 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5fdec8cd-b720-4453-8b45-45c231f75eb9 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:14.762669 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5fdec8cd-b720-4453-8b45-45c231f75eb9 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:14.763713 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5fdec8cd-b720-4453-8b45-45c231f75eb9 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:14.764358 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5fdec8cd-b720-4453-8b45-45c231f75eb9 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:15.007610 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5fdec8cd-b720-4453-8b45-45c231f75eb9 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:15.016926 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5fdec8cd-b720-4453-8b45-45c231f75eb9 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768" status: 200 len: 1307 microversion: 2.1 time: 0.276301 Jul 18 02:09:15.018307 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 205/427] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:14 2022] GET /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768 => generated 1307 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:15.094520 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b103430c-331f-4583-9676-915656d7b57a tempest-HypervisorAdminNegativeUnderV252Test-553522777 tempest-HypervisorAdminNegativeUnderV252Test-553522777-project-admin] Calling method '.version_select at 0x7ff4a94d7280>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:15.095965 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:15.095965 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:09:15.097986 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b103430c-331f-4583-9676-915656d7b57a tempest-HypervisorAdminNegativeUnderV252Test-553522777 tempest-HypervisorAdminNegativeUnderV252Test-553522777-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:15.098439 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b103430c-331f-4583-9676-915656d7b57a tempest-HypervisorAdminNegativeUnderV252Test-553522777 tempest-HypervisorAdminNegativeUnderV252Test-553522777-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:15.113763 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b103430c-331f-4583-9676-915656d7b57a tempest-HypervisorAdminNegativeUnderV252Test-553522777 tempest-HypervisorAdminNegativeUnderV252Test-553522777-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:15.114707 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b103430c-331f-4583-9676-915656d7b57a tempest-HypervisorAdminNegativeUnderV252Test-553522777 tempest-HypervisorAdminNegativeUnderV252Test-553522777-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:15.125252 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b103430c-331f-4583-9676-915656d7b57a tempest-HypervisorAdminNegativeUnderV252Test-553522777 tempest-HypervisorAdminNegativeUnderV252Test-553522777-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:15.125619 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b103430c-331f-4583-9676-915656d7b57a tempest-HypervisorAdminNegativeUnderV252Test-553522777 tempest-HypervisorAdminNegativeUnderV252Test-553522777-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:15.131881 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b103430c-331f-4583-9676-915656d7b57a tempest-HypervisorAdminNegativeUnderV252Test-553522777 tempest-HypervisorAdminNegativeUnderV252Test-553522777-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.112273 Jul 18 02:09:15.132466 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 206/428] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:09:15 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:15.136996 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-21c5e83d-2565-495e-80c9-273b3e1f450b req-04359289-7865-4a3e-a30d-cec7fa4eeb7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8aad28a-a3d8-48d3-8fc7-50d65ab4e768", "name": "network-vif-plugged", "status": "completed", "tag": "6783749f-f883-4783-9465-179735e0eeb7"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:15.147148 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-21c5e83d-2565-495e-80c9-273b3e1f450b req-04359289-7865-4a3e-a30d-cec7fa4eeb7c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:15.147593 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-21c5e83d-2565-495e-80c9-273b3e1f450b req-04359289-7865-4a3e-a30d-cec7fa4eeb7c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:15.159691 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-21c5e83d-2565-495e-80c9-273b3e1f450b req-04359289-7865-4a3e-a30d-cec7fa4eeb7c service nova] Creating event network-vif-plugged:6783749f-f883-4783-9465-179735e0eeb7 for instance d8aad28a-a3d8-48d3-8fc7-50d65ab4e768 on n-h1-465891-3 Jul 18 02:09:15.164242 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-34f8d35f-9d14-4831-9b35-f848f29656ed tempest-SecurityGroupsTestAdminJSON-1949305494 tempest-SecurityGroupsTestAdminJSON-1949305494-project-admin] 10.222.0.57 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 8309 microversion: 2.1 time: 2.822423 Jul 18 02:09:15.165209 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-21c5e83d-2565-495e-80c9-273b3e1f450b req-04359289-7865-4a3e-a30d-cec7fa4eeb7c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031532 Jul 18 02:09:15.165867 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 207/429] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:15.171015 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-77b77c33-c003-4b6a-bb3d-04973e40a3d9 req-d55a0c4e-a5bb-4db7-8c19-d0c17cff6951 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c71fb3ed-b430-443d-b16d-308cc483d3b2", "name": "network-vif-deleted", "tag": "0ddec30d-c681-4472-b329-e657ad12aef0"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:15.182699 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 223/430] 10.222.0.57 () {58 vars in 1190 bytes} [Mon Jul 18 02:09:12 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 8309 bytes in 2832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:15.182699 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-12229057-b4f5-4529-9e34-87ee0a8bd329 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:15.182699 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-12229057-b4f5-4529-9e34-87ee0a8bd329 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: bd14a732-a9ad-4dfd-af61-69b84eda8877] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:15.183079 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-77b77c33-c003-4b6a-bb3d-04973e40a3d9 req-d55a0c4e-a5bb-4db7-8c19-d0c17cff6951 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:15.183079 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-77b77c33-c003-4b6a-bb3d-04973e40a3d9 req-d55a0c4e-a5bb-4db7-8c19-d0c17cff6951 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:15.185996 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-12229057-b4f5-4529-9e34-87ee0a8bd329 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:15.186447 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-12229057-b4f5-4529-9e34-87ee0a8bd329 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:15.187281 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-12229057-b4f5-4529-9e34-87ee0a8bd329 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:15.187918 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-12229057-b4f5-4529-9e34-87ee0a8bd329 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:15.194781 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-77b77c33-c003-4b6a-bb3d-04973e40a3d9 req-d55a0c4e-a5bb-4db7-8c19-d0c17cff6951 service nova] Creating event network-vif-deleted:0ddec30d-c681-4472-b329-e657ad12aef0 for instance c71fb3ed-b430-443d-b16d-308cc483d3b2 on n-h1-465891-3 Jul 18 02:09:15.200687 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-77b77c33-c003-4b6a-bb3d-04973e40a3d9 req-d55a0c4e-a5bb-4db7-8c19-d0c17cff6951 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032592 Jul 18 02:09:15.200687 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 208/431] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:15.209544 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-69be2b9e-8b88-4ca7-89e0-7d1de3be71a7 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:15.210100 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-69be2b9e-8b88-4ca7-89e0-7d1de3be71a7 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: dbb215bf-6099-4dd5-b9af-d1bbfb55ef21] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:15.218422 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69be2b9e-8b88-4ca7-89e0-7d1de3be71a7 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:15.218875 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69be2b9e-8b88-4ca7-89e0-7d1de3be71a7 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:15.219647 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69be2b9e-8b88-4ca7-89e0-7d1de3be71a7 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:15.220140 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69be2b9e-8b88-4ca7-89e0-7d1de3be71a7 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:15.226474 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:09:15.250462 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-69be2b9e-8b88-4ca7-89e0-7d1de3be71a7 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: dbb215bf-6099-4dd5-b9af-d1bbfb55ef21] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:09:15.266548 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-12229057-b4f5-4529-9e34-87ee0a8bd329 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:15.275681 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-12229057-b4f5-4529-9e34-87ee0a8bd329 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877" status: 200 len: 1276 microversion: 2.1 time: 0.102309 Jul 18 02:09:15.276263 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 224/432] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:15 2022] GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877 => generated 1276 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:15.359695 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-69be2b9e-8b88-4ca7-89e0-7d1de3be71a7 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "DELETE /compute/v2.1/servers/dbb215bf-6099-4dd5-b9af-d1bbfb55ef21" status: 204 len: 0 microversion: 2.1 time: 0.155415 Jul 18 02:09:15.370960 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 209/433] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:09:15 2022] DELETE /compute/v2.1/servers/dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:09:15.464261 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e30c6249-45e1-4f80-85b0-f1e6bc62373c tempest-FlavorsV255TestJSON-1476671340 tempest-FlavorsV255TestJSON-1476671340-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:15.508089 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e30c6249-45e1-4f80-85b0-f1e6bc62373c tempest-FlavorsV255TestJSON-1476671340 tempest-FlavorsV255TestJSON-1476671340-project] 10.222.0.57 "GET /compute/v2.1/flavors/1361999542" status: 200 len: 449 microversion: 2.55 time: 0.229883 Jul 18 02:09:15.518526 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 225/434] 10.222.0.57 () {60 vars in 1198 bytes} [Mon Jul 18 02:09:15 2022] GET /compute/v2.1/flavors/1361999542 => generated 449 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:09:15.523622 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ab2d83f0-d926-4f17-87ba-7832ae3cd781 tempest-SecurityGroupsTestAdminJSON-1149598485 tempest-SecurityGroupsTestAdminJSON-1149598485-project] Calling method '.version_select at 0x7ff4a9135a60>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:15.552070 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-63dedaac-df86-4674-8bf7-0967581646fe tempest-HypervisorAdminNegativeUnderV252Test-945340631 tempest-HypervisorAdminNegativeUnderV252Test-945340631-project] Calling method '.version_select at 0x7ff4a90ebc10>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:15.553614 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:15.553614 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:09:15.555604 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-63dedaac-df86-4674-8bf7-0967581646fe tempest-HypervisorAdminNegativeUnderV252Test-945340631 tempest-HypervisorAdminNegativeUnderV252Test-945340631-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'c4fbe1ebef0d4e62b78eeb5c02a0ee63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6984a723259742269a89a01d087d64c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:15.558572 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-63dedaac-df86-4674-8bf7-0967581646fe tempest-HypervisorAdminNegativeUnderV252Test-945340631 tempest-HypervisorAdminNegativeUnderV252Test-945340631-project] Request method failure captured: Jul 18 02:09:15.558572 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/os-hypervisors/n-h2-465891-3/search HTTP/1.1 Jul 18 02:09:15.558572 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:09:15.558572 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:09:15.558572 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:09:15.558572 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:09:15.558572 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:09:15.558572 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:09:15.558572 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:09:15.558572 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:09:15.558572 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MDIPLxwNKzZFYJSTFC-hmoZdP3sgljhMZzFgmt-DompGAmlmsqGU397TiUjsI3u-cSgshfC_KWF-JSUyMoIofteQzJufNFn_ZWx72m8REP0dij6BBDkpgTKR4M6ebSa7c9R1KR3dKmIffKNbODP2xBmpEEIz__tANbol2dwd5c6Hw8 Jul 18 02:09:15.558572 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:09:15.558572 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:09:15.558572 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:09:15.558572 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:09:15.558572 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:09:15.558572 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:09:15.558572 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 6984a723259742269a89a01d087d64c5 Jul 18 02:09:15.558572 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-945340631 Jul 18 02:09:15.558572 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:09:15.558572 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:09:15.559930 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6984a723259742269a89a01d087d64c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6984a723259742269a89a01d087d64c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6984a723259742269a89a01d087d64c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6984a723259742269a89a01d087d64c5"}]}] Jul 18 02:09:15.559930 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-945340631 Jul 18 02:09:15.559930 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 6984a723259742269a89a01d087d64c5 Jul 18 02:09:15.559930 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-945340631 Jul 18 02:09:15.559930 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-945340631-project Jul 18 02:09:15.559930 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:09:15.559930 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:09:15.559930 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: c4fbe1ebef0d4e62b78eeb5c02a0ee63 Jul 18 02:09:15.559930 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-945340631-project Jul 18 02:09:15.559930 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:09:15.559930 n-d-465891-3 devstack@n-api.service[119544]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 18 02:09:15.559930 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'n-h2-465891-3'} Jul 18 02:09:15.560643 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:09:15.560643 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:15.560643 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:15.560643 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:15.560643 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:09:15.560643 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:09:15.560643 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:09:15.560643 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:09:15.560643 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:09:15.560643 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:09:15.560643 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Jul 18 02:09:15.560643 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Jul 18 02:09:15.560643 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:09:15.560643 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:09:15.560643 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:09:15.560643 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:09:15.560643 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:09:15.560643 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:09:15.560643 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:09:15.562446 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:09:15.562446 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:09:15.562446 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:09:15.562446 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:09:15.562446 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:09:15.562446 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:09:15.562446 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:09:15.562446 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 18 02:09:15.562446 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:15.562446 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:15.562446 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:15.562446 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:15.562446 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:15.562446 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:15.562446 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:09:15.562446 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:09:15.562446 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 18 02:09:15.562446 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:15.563986 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-63dedaac-df86-4674-8bf7-0967581646fe tempest-HypervisorAdminNegativeUnderV252Test-945340631 tempest-HypervisorAdminNegativeUnderV252Test-945340631-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:09:15.563986 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-63dedaac-df86-4674-8bf7-0967581646fe tempest-HypervisorAdminNegativeUnderV252Test-945340631 tempest-HypervisorAdminNegativeUnderV252Test-945340631-project] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/n-h2-465891-3/search" status: 403 len: 117 microversion: 2.1 time: 0.196524 Jul 18 02:09:15.563986 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 210/435] 10.222.0.57 () {58 vars in 1208 bytes} [Mon Jul 18 02:09:15 2022] GET /compute/v2.1/os-hypervisors/n-h2-465891-3/search => generated 117 bytes in 198 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:09:15.569823 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-71aeb139-84db-4f74-bf65-7353137c2b77 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:15.571090 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-71aeb139-84db-4f74-bf65-7353137c2b77 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: c71fb3ed-b430-443d-b16d-308cc483d3b2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:15.581044 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-71aeb139-84db-4f74-bf65-7353137c2b77 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:15.581044 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-71aeb139-84db-4f74-bf65-7353137c2b77 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:15.587413 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-71aeb139-84db-4f74-bf65-7353137c2b77 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:15.587977 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-71aeb139-84db-4f74-bf65-7353137c2b77 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:15.605070 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-71aeb139-84db-4f74-bf65-7353137c2b77 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] HTTP exception thrown: Instance c71fb3ed-b430-443d-b16d-308cc483d3b2 could not be found. Jul 18 02:09:15.607074 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-71aeb139-84db-4f74-bf65-7353137c2b77 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Request method failure captured: Jul 18 02:09:15.607074 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/c71fb3ed-b430-443d-b16d-308cc483d3b2 HTTP/1.1 Jul 18 02:09:15.607074 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:09:15.607074 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:09:15.607074 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:09:15.607074 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:09:15.607074 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:09:15.607074 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:09:15.607074 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:09:15.607074 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:09:15.607074 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MCFGcQ62-kJ6tmwfnRCC6u10rWmhq7unKp06qv9ZCdAYGRVt2yNWxL8yl6uhfaq0Fdbz6CAN1dIrD86B_-Z7qDHMnNrqn3RnxLGcBc3_Vo4o-PyQQfVMWjWLPzih7wtecnh7BcHp8OhEzp4gQFdY-x6VOWWgHg0ta9Q54MYs2-Rdyo Jul 18 02:09:15.607074 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:09:15.607074 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:09:15.607074 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:09:15.607074 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:09:15.607074 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:09:15.607074 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:09:15.607074 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 5b0c0be2e96a499dbde6652cbc758a27 Jul 18 02:09:15.607074 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-DeleteServersAdminTestJSON-375900714 Jul 18 02:09:15.607074 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:09:15.607074 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:09:15.608326 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5b0c0be2e96a499dbde6652cbc758a27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5b0c0be2e96a499dbde6652cbc758a27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5b0c0be2e96a499dbde6652cbc758a27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5b0c0be2e96a499dbde6652cbc758a27"}]}] Jul 18 02:09:15.608326 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-DeleteServersAdminTestJSON-375900714 Jul 18 02:09:15.608326 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 5b0c0be2e96a499dbde6652cbc758a27 Jul 18 02:09:15.608326 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-375900714 Jul 18 02:09:15.608326 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-DeleteServersAdminTestJSON-375900714-project Jul 18 02:09:15.608326 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:09:15.608326 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:09:15.608326 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: efe4f42523df4204b49c9c0899c93fc7 Jul 18 02:09:15.608326 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-DeleteServersAdminTestJSON-375900714-project Jul 18 02:09:15.608326 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:09:15.608326 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance c71fb3ed-b430-443d-b16d-308cc483d3b2 could not be found. Jul 18 02:09:15.608326 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'c71fb3ed-b430-443d-b16d-308cc483d3b2'} Jul 18 02:09:15.609043 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:09:15.609043 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:15.609043 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:09:15.609043 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:09:15.609043 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:09:15.609043 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:09:15.609043 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:09:15.609043 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:09:15.609043 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:09:15.609043 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:09:15.609043 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c71fb3ed-b430-443d-b16d-308cc483d3b2 could not be found. Jul 18 02:09:15.609043 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:15.609043 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:15.609043 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:15.609043 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:15.609043 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:15.609043 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:15.609043 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:09:15.609043 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:09:15.609043 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:09:15.610189 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:09:15.610189 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:09:15.610189 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:09:15.610189 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:09:15.610189 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:09:15.610189 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:09:15.610189 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:09:15.610189 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c71fb3ed-b430-443d-b16d-308cc483d3b2 could not be found. Jul 18 02:09:15.610189 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:15.610189 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:15.610189 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:15.610189 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:15.610189 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:15.610189 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:15.610189 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:09:15.610189 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:09:15.610189 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c71fb3ed-b430-443d-b16d-308cc483d3b2 could not be found. Jul 18 02:09:15.610189 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:15.612079 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-71aeb139-84db-4f74-bf65-7353137c2b77 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Returning 404 to user: Instance c71fb3ed-b430-443d-b16d-308cc483d3b2 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:09:15.612079 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-71aeb139-84db-4f74-bf65-7353137c2b77 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "GET /compute/v2.1/servers/c71fb3ed-b430-443d-b16d-308cc483d3b2" status: 404 len: 111 microversion: 2.1 time: 0.045986 Jul 18 02:09:15.612079 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 211/436] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:15 2022] GET /compute/v2.1/servers/c71fb3ed-b430-443d-b16d-308cc483d3b2 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:09:15.619893 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-989f3f38-e5bc-48cd-a526-ba32cc30ef4a tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:15.620544 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-989f3f38-e5bc-48cd-a526-ba32cc30ef4a tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:15.628483 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-989f3f38-e5bc-48cd-a526-ba32cc30ef4a tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:15.628948 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-989f3f38-e5bc-48cd-a526-ba32cc30ef4a tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:15.629907 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-989f3f38-e5bc-48cd-a526-ba32cc30ef4a tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:15.630350 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-989f3f38-e5bc-48cd-a526-ba32cc30ef4a tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:15.747301 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-989f3f38-e5bc-48cd-a526-ba32cc30ef4a tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:15.756422 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-989f3f38-e5bc-48cd-a526-ba32cc30ef4a tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:15.757952 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-989f3f38-e5bc-48cd-a526-ba32cc30ef4a tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:15.763327 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-989f3f38-e5bc-48cd-a526-ba32cc30ef4a tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] 10.222.0.57 "GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 200 len: 1447 microversion: 2.75 time: 0.152617 Jul 18 02:09:15.764543 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 212/437] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:09:15 2022] GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 1447 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:09:15.769461 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1d1ab380-a582-46f8-a88d-704b33e86ab2 tempest-FlavorsV255TestJSON-537661632 tempest-FlavorsV255TestJSON-537661632-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:15.771261 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:15.771261 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:09:15.793426 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1d1ab380-a582-46f8-a88d-704b33e86ab2 tempest-FlavorsV255TestJSON-537661632 tempest-FlavorsV255TestJSON-537661632-project-admin] 10.222.0.57 "PUT /compute/v2.1/flavors/1361999542" status: 200 len: 450 microversion: 2.55 time: 0.027658 Jul 18 02:09:15.794381 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 213/438] 10.222.0.57 () {62 vars in 1218 bytes} [Mon Jul 18 02:09:15 2022] PUT /compute/v2.1/flavors/1361999542 => generated 450 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:09:15.799627 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7e33d08f-1bc4-401d-a1cf-6ed03410a295 tempest-HypervisorAdminNegativeUnderV252Test-553522777 tempest-HypervisorAdminNegativeUnderV252Test-553522777-project-admin] Calling method '.version_select at 0x7ff4a9188d30>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:15.800575 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:15.800575 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:09:15.801951 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7e33d08f-1bc4-401d-a1cf-6ed03410a295 tempest-HypervisorAdminNegativeUnderV252Test-553522777 tempest-HypervisorAdminNegativeUnderV252Test-553522777-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:15.802595 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7e33d08f-1bc4-401d-a1cf-6ed03410a295 tempest-HypervisorAdminNegativeUnderV252Test-553522777 tempest-HypervisorAdminNegativeUnderV252Test-553522777-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:15.817970 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-7e33d08f-1bc4-401d-a1cf-6ed03410a295 tempest-HypervisorAdminNegativeUnderV252Test-553522777 tempest-HypervisorAdminNegativeUnderV252Test-553522777-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 18 02:09:15.819378 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7e33d08f-1bc4-401d-a1cf-6ed03410a295 tempest-HypervisorAdminNegativeUnderV252Test-553522777 tempest-HypervisorAdminNegativeUnderV252Test-553522777-project-admin] Request method failure captured: Jul 18 02:09:15.819378 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Jul 18 02:09:15.819378 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:09:15.819378 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:09:15.819378 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:09:15.819378 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:09:15.819378 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:09:15.819378 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:09:15.819378 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:09:15.819378 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:09:15.819378 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MDJzfnwYxXo17rKqs3y5AJqRaTzSb9ZNDjPDMVwuHG3zX8nwZDKrxr3cL6J7k0gomCy4ESv-1mRrKFEypYv_PiaRvPOeFv72JH0RYLs20rTORNGG5EVoOjTEk7wSJKqMh2ifuFvqkAxFaGoA-Y8KGHdDXOmu4t8chPA5VDifavp5Ok Jul 18 02:09:15.819378 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:09:15.819378 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:09:15.819378 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:09:15.819378 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:09:15.819378 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:09:15.819378 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:09:15.819378 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: cba668ee865c42d68b3a135777ca30cb Jul 18 02:09:15.819378 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-553522777 Jul 18 02:09:15.819378 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,admin,reader Jul 18 02:09:15.819378 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,admin,reader Jul 18 02:09:15.820908 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_cba668ee865c42d68b3a135777ca30cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/cba668ee865c42d68b3a135777ca30cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/cba668ee865c42d68b3a135777ca30cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/cba668ee865c42d68b3a135777ca30cb"}]}] Jul 18 02:09:15.820908 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-553522777 Jul 18 02:09:15.820908 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: cba668ee865c42d68b3a135777ca30cb Jul 18 02:09:15.820908 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-553522777 Jul 18 02:09:15.820908 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-553522777-project-admin Jul 18 02:09:15.820908 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:09:15.820908 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:09:15.820908 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 96874d198e234f84beb90cb2f10904f8 Jul 18 02:09:15.820908 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-553522777-project-admin Jul 18 02:09:15.820908 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:09:15.820908 n-d-465891-3 devstack@n-api.service[119544]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 18 02:09:15.820908 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'nonexistent_hypervisor_name'} Jul 18 02:09:15.821752 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:09:15.821752 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:15.821752 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:15.821752 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:15.821752 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:09:15.821752 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:09:15.821752 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:09:15.821752 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:09:15.821752 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:09:15.821752 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:09:15.821752 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Jul 18 02:09:15.821752 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 18 02:09:15.821752 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 18 02:09:15.821752 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 18 02:09:15.821752 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 18 02:09:15.821752 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:15.821752 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:15.821752 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:15.821752 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:15.821752 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:15.823125 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:15.823125 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:09:15.823125 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:09:15.823125 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 18 02:09:15.823125 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:15.823125 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7e33d08f-1bc4-401d-a1cf-6ed03410a295 tempest-HypervisorAdminNegativeUnderV252Test-553522777 tempest-HypervisorAdminNegativeUnderV252Test-553522777-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:09:15.823125 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7e33d08f-1bc4-401d-a1cf-6ed03410a295 tempest-HypervisorAdminNegativeUnderV252Test-553522777 tempest-HypervisorAdminNegativeUnderV252Test-553522777-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.025313 Jul 18 02:09:15.823125 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 214/439] 10.222.0.57 () {58 vars in 1250 bytes} [Mon Jul 18 02:09:15 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:09:15.827983 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e89353f9-98ac-4980-a6bf-88e833abab72 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-530764897", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "1539648143", "adminPass": "***", "networks": [{"uuid": "4c02df64-d6ca-44f4-bcfe-240d736ae88d"}], "security_groups": [{"name": "tempest-securitygroup--344219863"}], "key_name": "tempest-keypair-9024320", "user_data": "}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:16.042187 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-e89353f9-98ac-4980-a6bf-88e833abab72 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] validate_networks() for [('4c02df64-d6ca-44f4-bcfe-240d736ae88d', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:09:16.186525 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ab2d83f0-d926-4f17-87ba-7832ae3cd781 tempest-SecurityGroupsTestAdminJSON-1149598485 tempest-SecurityGroupsTestAdminJSON-1149598485-project] 10.222.0.57 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.665382 Jul 18 02:09:16.188194 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 226/440] 10.222.0.57 () {58 vars in 1190 bytes} [Mon Jul 18 02:09:15 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:16.205591 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dc1cd3b1-72ea-4706-bd71-24039e6fccb6 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:16.208084 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-dc1cd3b1-72ea-4706-bd71-24039e6fccb6 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: c71fb3ed-b430-443d-b16d-308cc483d3b2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:16.218165 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dc1cd3b1-72ea-4706-bd71-24039e6fccb6 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:16.218957 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dc1cd3b1-72ea-4706-bd71-24039e6fccb6 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:16.220008 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dc1cd3b1-72ea-4706-bd71-24039e6fccb6 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:16.220734 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dc1cd3b1-72ea-4706-bd71-24039e6fccb6 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:16.237897 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-dc1cd3b1-72ea-4706-bd71-24039e6fccb6 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] HTTP exception thrown: Instance c71fb3ed-b430-443d-b16d-308cc483d3b2 could not be found. Jul 18 02:09:16.242033 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dc1cd3b1-72ea-4706-bd71-24039e6fccb6 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Request method failure captured: Jul 18 02:09:16.242033 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/servers/c71fb3ed-b430-443d-b16d-308cc483d3b2 HTTP/1.1 Jul 18 02:09:16.242033 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:09:16.242033 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:09:16.242033 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:09:16.242033 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:09:16.242033 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:09:16.242033 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:09:16.242033 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:09:16.242033 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:09:16.242033 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MCFGcQ62-kJ6tmwfnRCC6u10rWmhq7unKp06qv9ZCdAYGRVt2yNWxL8yl6uhfaq0Fdbz6CAN1dIrD86B_-Z7qDHMnNrqn3RnxLGcBc3_Vo4o-PyQQfVMWjWLPzih7wtecnh7BcHp8OhEzp4gQFdY-x6VOWWgHg0ta9Q54MYs2-Rdyo Jul 18 02:09:16.242033 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:09:16.242033 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:09:16.242033 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:09:16.242033 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:09:16.242033 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:09:16.242033 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:09:16.242033 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 5b0c0be2e96a499dbde6652cbc758a27 Jul 18 02:09:16.242033 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-DeleteServersAdminTestJSON-375900714 Jul 18 02:09:16.242033 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:09:16.242033 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:09:16.243287 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5b0c0be2e96a499dbde6652cbc758a27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5b0c0be2e96a499dbde6652cbc758a27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5b0c0be2e96a499dbde6652cbc758a27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5b0c0be2e96a499dbde6652cbc758a27"}]}] Jul 18 02:09:16.243287 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-DeleteServersAdminTestJSON-375900714 Jul 18 02:09:16.243287 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 5b0c0be2e96a499dbde6652cbc758a27 Jul 18 02:09:16.243287 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-375900714 Jul 18 02:09:16.243287 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-DeleteServersAdminTestJSON-375900714-project Jul 18 02:09:16.243287 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:09:16.243287 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:09:16.243287 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: efe4f42523df4204b49c9c0899c93fc7 Jul 18 02:09:16.243287 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-DeleteServersAdminTestJSON-375900714-project Jul 18 02:09:16.243287 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:09:16.243287 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance c71fb3ed-b430-443d-b16d-308cc483d3b2 could not be found. Jul 18 02:09:16.243287 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'c71fb3ed-b430-443d-b16d-308cc483d3b2'} Jul 18 02:09:16.243933 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:09:16.243933 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:16.243933 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:09:16.243933 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:09:16.243933 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:09:16.243933 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:09:16.243933 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:09:16.243933 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:09:16.243933 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:09:16.243933 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:09:16.243933 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c71fb3ed-b430-443d-b16d-308cc483d3b2 could not be found. Jul 18 02:09:16.243933 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:16.243933 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:16.243933 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:16.243933 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:16.243933 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:16.243933 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:16.243933 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:09:16.243933 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:09:16.243933 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:09:16.244987 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:09:16.244987 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:09:16.244987 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:09:16.244987 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:09:16.244987 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:09:16.244987 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:09:16.244987 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:09:16.244987 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:09:16.244987 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:09:16.244987 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c71fb3ed-b430-443d-b16d-308cc483d3b2 could not be found. Jul 18 02:09:16.244987 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:16.244987 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:16.244987 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:16.244987 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:16.244987 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:16.244987 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:16.244987 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:09:16.244987 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:09:16.244987 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c71fb3ed-b430-443d-b16d-308cc483d3b2 could not be found. Jul 18 02:09:16.244987 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:16.249228 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dc1cd3b1-72ea-4706-bd71-24039e6fccb6 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Returning 404 to user: Instance c71fb3ed-b430-443d-b16d-308cc483d3b2 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:09:16.250191 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-dc1cd3b1-72ea-4706-bd71-24039e6fccb6 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c71fb3ed-b430-443d-b16d-308cc483d3b2" status: 404 len: 111 microversion: 2.1 time: 0.051153 Jul 18 02:09:16.252272 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 227/441] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:09:16 2022] DELETE /compute/v2.1/servers/c71fb3ed-b430-443d-b16d-308cc483d3b2 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:09:16.265964 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0523f3ac-732f-4bc1-a615-0ab0dc9e097b tempest-FlavorsV255TestJSON-1476671340 tempest-FlavorsV255TestJSON-1476671340-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:16.301117 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0523f3ac-732f-4bc1-a615-0ab0dc9e097b tempest-FlavorsV255TestJSON-1476671340 tempest-FlavorsV255TestJSON-1476671340-project] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 6596 microversion: 2.55 time: 0.047364 Jul 18 02:09:16.302328 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 228/442] 10.222.0.57 () {60 vars in 1186 bytes} [Mon Jul 18 02:09:16 2022] GET /compute/v2.1/flavors/detail => generated 6596 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:09:16.307453 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ea5c2e65-3e64-493f-9788-fef49a9904ee tempest-HypervisorAdminNegativeUnderV252Test-553522777 tempest-HypervisorAdminNegativeUnderV252Test-553522777-project-admin] Calling method '.version_select at 0x7ff4a91cbee0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:16.308448 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:16.308448 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:09:16.309870 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ea5c2e65-3e64-493f-9788-fef49a9904ee tempest-HypervisorAdminNegativeUnderV252Test-553522777 tempest-HypervisorAdminNegativeUnderV252Test-553522777-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:16.310593 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ea5c2e65-3e64-493f-9788-fef49a9904ee tempest-HypervisorAdminNegativeUnderV252Test-553522777 tempest-HypervisorAdminNegativeUnderV252Test-553522777-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:16.333538 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ea5c2e65-3e64-493f-9788-fef49a9904ee tempest-HypervisorAdminNegativeUnderV252Test-553522777 tempest-HypervisorAdminNegativeUnderV252Test-553522777-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:16.334466 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ea5c2e65-3e64-493f-9788-fef49a9904ee tempest-HypervisorAdminNegativeUnderV252Test-553522777 tempest-HypervisorAdminNegativeUnderV252Test-553522777-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:16.351784 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ea5c2e65-3e64-493f-9788-fef49a9904ee tempest-HypervisorAdminNegativeUnderV252Test-553522777 tempest-HypervisorAdminNegativeUnderV252Test-553522777-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:16.352534 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ea5c2e65-3e64-493f-9788-fef49a9904ee tempest-HypervisorAdminNegativeUnderV252Test-553522777 tempest-HypervisorAdminNegativeUnderV252Test-553522777-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:16.359950 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ea5c2e65-3e64-493f-9788-fef49a9904ee tempest-HypervisorAdminNegativeUnderV252Test-553522777 tempest-HypervisorAdminNegativeUnderV252Test-553522777-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.056218 Jul 18 02:09:16.360937 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 229/443] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:09:16 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:16.370386 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-44732440-4e0a-4171-8881-77ad09547f7a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:16.371329 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-44732440-4e0a-4171-8881-77ad09547f7a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: d8aad28a-a3d8-48d3-8fc7-50d65ab4e768] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:16.380321 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-44732440-4e0a-4171-8881-77ad09547f7a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:16.381062 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-44732440-4e0a-4171-8881-77ad09547f7a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:16.382093 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-44732440-4e0a-4171-8881-77ad09547f7a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:16.382736 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-44732440-4e0a-4171-8881-77ad09547f7a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:16.712521 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-44732440-4e0a-4171-8881-77ad09547f7a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:16.725044 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-44732440-4e0a-4171-8881-77ad09547f7a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768" status: 200 len: 1307 microversion: 2.1 time: 0.361162 Jul 18 02:09:16.726422 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 230/444] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:16 2022] GET /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768 => generated 1307 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:16.744566 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e377d2f4-81ac-42e7-ae50-ebe8abf05b41 tempest-SecurityGroupsTestAdminJSON-1949305494 tempest-SecurityGroupsTestAdminJSON-1949305494-project-admin] Calling method '.version_select at 0x7ff4a91354c0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:17.118271 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=7 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:09:17.160749 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-e89353f9-98ac-4980-a6bf-88e833abab72 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:09:17.161253 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-e89353f9-98ac-4980-a6bf-88e833abab72 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:09:17.162020 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-e89353f9-98ac-4980-a6bf-88e833abab72 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:09:17.162541 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-e89353f9-98ac-4980-a6bf-88e833abab72 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:09:17.163057 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-e89353f9-98ac-4980-a6bf-88e833abab72 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:09:17.173083 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e89353f9-98ac-4980-a6bf-88e833abab72 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:17.174376 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e89353f9-98ac-4980-a6bf-88e833abab72 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:17.175398 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e89353f9-98ac-4980-a6bf-88e833abab72 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:17.175840 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e89353f9-98ac-4980-a6bf-88e833abab72 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:17.216703 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-e89353f9-98ac-4980-a6bf-88e833abab72 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Getting quotas for project dd02ce642caf4529a6e65c184de0ad19. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:09:17.224816 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-e89353f9-98ac-4980-a6bf-88e833abab72 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Getting quotas for user 60118d593f96437dbb2c68ad2fadd465 and project dd02ce642caf4529a6e65c184de0ad19. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:09:17.242414 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e89353f9-98ac-4980-a6bf-88e833abab72 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:09:17.245233 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e89353f9-98ac-4980-a6bf-88e833abab72 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: f77b267e-9a20-4943-aa8b-0c82b9d6d20e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:09:17.306969 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e89353f9-98ac-4980-a6bf-88e833abab72 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.484256 Jul 18 02:09:17.307647 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 215/445] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:09:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 1486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:09:17.313678 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1f9f44e6-d7dc-4b9d-bad9-30b32798f3db tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:17.315084 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1f9f44e6-d7dc-4b9d-bad9-30b32798f3db tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: c71fb3ed-b430-443d-b16d-308cc483d3b2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:17.323294 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1f9f44e6-d7dc-4b9d-bad9-30b32798f3db tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:17.323912 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1f9f44e6-d7dc-4b9d-bad9-30b32798f3db tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:17.325660 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1f9f44e6-d7dc-4b9d-bad9-30b32798f3db tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:17.326303 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1f9f44e6-d7dc-4b9d-bad9-30b32798f3db tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:17.352895 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-1f9f44e6-d7dc-4b9d-bad9-30b32798f3db tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] HTTP exception thrown: Instance c71fb3ed-b430-443d-b16d-308cc483d3b2 could not be found. Jul 18 02:09:17.355722 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1f9f44e6-d7dc-4b9d-bad9-30b32798f3db tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Request method failure captured: Jul 18 02:09:17.355722 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/c71fb3ed-b430-443d-b16d-308cc483d3b2 HTTP/1.1 Jul 18 02:09:17.355722 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:09:17.355722 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:09:17.355722 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:09:17.355722 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:09:17.355722 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:09:17.355722 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:09:17.355722 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:09:17.355722 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:09:17.355722 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MCFGcQ62-kJ6tmwfnRCC6u10rWmhq7unKp06qv9ZCdAYGRVt2yNWxL8yl6uhfaq0Fdbz6CAN1dIrD86B_-Z7qDHMnNrqn3RnxLGcBc3_Vo4o-PyQQfVMWjWLPzih7wtecnh7BcHp8OhEzp4gQFdY-x6VOWWgHg0ta9Q54MYs2-Rdyo Jul 18 02:09:17.355722 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:09:17.355722 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:09:17.355722 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:09:17.355722 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:09:17.355722 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:09:17.355722 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:09:17.355722 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 5b0c0be2e96a499dbde6652cbc758a27 Jul 18 02:09:17.355722 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-DeleteServersAdminTestJSON-375900714 Jul 18 02:09:17.355722 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:09:17.355722 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:09:17.357436 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5b0c0be2e96a499dbde6652cbc758a27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5b0c0be2e96a499dbde6652cbc758a27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5b0c0be2e96a499dbde6652cbc758a27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5b0c0be2e96a499dbde6652cbc758a27"}]}] Jul 18 02:09:17.357436 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-DeleteServersAdminTestJSON-375900714 Jul 18 02:09:17.357436 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 5b0c0be2e96a499dbde6652cbc758a27 Jul 18 02:09:17.357436 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-375900714 Jul 18 02:09:17.357436 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-DeleteServersAdminTestJSON-375900714-project Jul 18 02:09:17.357436 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:09:17.357436 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:09:17.357436 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: efe4f42523df4204b49c9c0899c93fc7 Jul 18 02:09:17.357436 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-DeleteServersAdminTestJSON-375900714-project Jul 18 02:09:17.357436 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:09:17.357436 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance c71fb3ed-b430-443d-b16d-308cc483d3b2 could not be found. Jul 18 02:09:17.357436 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'c71fb3ed-b430-443d-b16d-308cc483d3b2'} Jul 18 02:09:17.358304 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:09:17.358304 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:17.358304 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:09:17.358304 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:09:17.358304 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:09:17.358304 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:09:17.358304 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:09:17.358304 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:09:17.358304 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:09:17.358304 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:09:17.358304 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c71fb3ed-b430-443d-b16d-308cc483d3b2 could not be found. Jul 18 02:09:17.358304 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:17.358304 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:17.358304 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:17.358304 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:17.358304 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:17.358304 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:17.358304 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:09:17.358304 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:09:17.358304 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:09:17.359867 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:09:17.359867 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:09:17.359867 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:09:17.359867 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:09:17.359867 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:09:17.359867 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:09:17.359867 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:09:17.359867 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c71fb3ed-b430-443d-b16d-308cc483d3b2 could not be found. Jul 18 02:09:17.359867 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:17.359867 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:17.359867 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:17.359867 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:17.359867 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:17.359867 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:17.359867 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:09:17.359867 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:09:17.359867 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c71fb3ed-b430-443d-b16d-308cc483d3b2 could not be found. Jul 18 02:09:17.359867 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:17.365117 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1f9f44e6-d7dc-4b9d-bad9-30b32798f3db tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Returning 404 to user: Instance c71fb3ed-b430-443d-b16d-308cc483d3b2 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:09:17.365117 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1f9f44e6-d7dc-4b9d-bad9-30b32798f3db tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "GET /compute/v2.1/servers/c71fb3ed-b430-443d-b16d-308cc483d3b2" status: 404 len: 111 microversion: 2.1 time: 0.051193 Jul 18 02:09:17.365117 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 216/446] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:17 2022] GET /compute/v2.1/servers/c71fb3ed-b430-443d-b16d-308cc483d3b2 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:09:17.374989 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ca14de6a-3fd4-48d6-a336-da1e65af845a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:17.377219 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ca14de6a-3fd4-48d6-a336-da1e65af845a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: bd14a732-a9ad-4dfd-af61-69b84eda8877] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:17.391665 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ca14de6a-3fd4-48d6-a336-da1e65af845a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:17.393404 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ca14de6a-3fd4-48d6-a336-da1e65af845a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:17.394407 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ca14de6a-3fd4-48d6-a336-da1e65af845a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:17.394915 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ca14de6a-3fd4-48d6-a336-da1e65af845a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:17.900508 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e377d2f4-81ac-42e7-ae50-ebe8abf05b41 tempest-SecurityGroupsTestAdminJSON-1949305494 tempest-SecurityGroupsTestAdminJSON-1949305494-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/ad60f735-ad5d-4b1b-a051-3bcdc2a22b14" status: 202 len: 0 microversion: 2.1 time: 1.172351 Jul 18 02:09:17.903092 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 231/447] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 02:09:16 2022] DELETE /compute/v2.1/os-security-groups/ad60f735-ad5d-4b1b-a051-3bcdc2a22b14 => generated 0 bytes in 1175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:09:17.912230 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5ac7a6f9-80c6-4f82-863b-5ec1bae411e2 tempest-FlavorsV255TestJSON-1476671340 tempest-FlavorsV255TestJSON-1476671340-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:17.949119 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5ac7a6f9-80c6-4f82-863b-5ec1bae411e2 tempest-FlavorsV255TestJSON-1476671340 tempest-FlavorsV255TestJSON-1476671340-project] 10.222.0.57 "GET /compute/v2.1/flavors" status: 200 len: 3686 microversion: 2.55 time: 0.042336 Jul 18 02:09:17.950723 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 232/448] 10.222.0.57 () {60 vars in 1165 bytes} [Mon Jul 18 02:09:17 2022] GET /compute/v2.1/flavors => generated 3686 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:09:17.963815 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-995905a7-9694-43ed-8892-ae9419a8feff tempest-HypervisorAdminNegativeUnderV252Test-945340631 tempest-HypervisorAdminNegativeUnderV252Test-945340631-project] Calling method '.version_select at 0x7ff4a91350d0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:17.964807 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:17.964807 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:09:17.967460 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-995905a7-9694-43ed-8892-ae9419a8feff tempest-HypervisorAdminNegativeUnderV252Test-945340631 tempest-HypervisorAdminNegativeUnderV252Test-945340631-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'c4fbe1ebef0d4e62b78eeb5c02a0ee63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6984a723259742269a89a01d087d64c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:17.970595 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-995905a7-9694-43ed-8892-ae9419a8feff tempest-HypervisorAdminNegativeUnderV252Test-945340631 tempest-HypervisorAdminNegativeUnderV252Test-945340631-project] Request method failure captured: Jul 18 02:09:17.970595 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Jul 18 02:09:17.970595 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:09:17.970595 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:09:17.970595 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:09:17.970595 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:09:17.970595 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:09:17.970595 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:09:17.970595 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:09:17.970595 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:09:17.970595 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MDIPLxwNKzZFYJSTFC-hmoZdP3sgljhMZzFgmt-DompGAmlmsqGU397TiUjsI3u-cSgshfC_KWF-JSUyMoIofteQzJufNFn_ZWx72m8REP0dij6BBDkpgTKR4M6ebSa7c9R1KR3dKmIffKNbODP2xBmpEEIz__tANbol2dwd5c6Hw8 Jul 18 02:09:17.970595 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:09:17.970595 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:09:17.970595 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:09:17.970595 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:09:17.970595 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:09:17.970595 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:09:17.970595 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 6984a723259742269a89a01d087d64c5 Jul 18 02:09:17.970595 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-945340631 Jul 18 02:09:17.970595 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:09:17.970595 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:09:17.971949 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6984a723259742269a89a01d087d64c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6984a723259742269a89a01d087d64c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6984a723259742269a89a01d087d64c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6984a723259742269a89a01d087d64c5"}]}] Jul 18 02:09:17.971949 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-945340631 Jul 18 02:09:17.971949 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 6984a723259742269a89a01d087d64c5 Jul 18 02:09:17.971949 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-945340631 Jul 18 02:09:17.971949 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-945340631-project Jul 18 02:09:17.971949 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:09:17.971949 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:09:17.971949 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: c4fbe1ebef0d4e62b78eeb5c02a0ee63 Jul 18 02:09:17.971949 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-945340631-project Jul 18 02:09:17.971949 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:09:17.971949 n-d-465891-3 devstack@n-api.service[119543]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 18 02:09:17.971949 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '1'} Jul 18 02:09:17.971949 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:09:17.972955 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:17.972955 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:17.972955 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:17.972955 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:09:17.972955 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:09:17.972955 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:09:17.972955 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:09:17.972955 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:09:17.972955 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:09:17.972955 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Jul 18 02:09:17.972955 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Jul 18 02:09:17.972955 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:09:17.972955 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:09:17.972955 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:09:17.972955 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:09:17.972955 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:09:17.972955 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:09:17.972955 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:09:17.972955 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:09:17.974141 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:09:17.974141 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:09:17.974141 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:09:17.974141 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:09:17.974141 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:09:17.974141 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:09:17.974141 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 18 02:09:17.974141 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:17.974141 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:17.974141 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:17.974141 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:17.974141 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:17.974141 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:17.974141 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:09:17.974141 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:09:17.974141 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 18 02:09:17.974141 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:17.978082 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-995905a7-9694-43ed-8892-ae9419a8feff tempest-HypervisorAdminNegativeUnderV252Test-945340631 tempest-HypervisorAdminNegativeUnderV252Test-945340631-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:09:17.979197 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-995905a7-9694-43ed-8892-ae9419a8feff tempest-HypervisorAdminNegativeUnderV252Test-945340631 tempest-HypervisorAdminNegativeUnderV252Test-945340631-project] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.027178 Jul 18 02:09:17.985471 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 233/449] 10.222.0.57 () {58 vars in 1175 bytes} [Mon Jul 18 02:09:17 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:09:17.992396 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-48844535-543e-44e0-b1c0-122fb2e455ae tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:17.993093 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-48844535-543e-44e0-b1c0-122fb2e455ae tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:18.000537 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-48844535-543e-44e0-b1c0-122fb2e455ae tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:18.000926 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-48844535-543e-44e0-b1c0-122fb2e455ae tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:18.003046 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-48844535-543e-44e0-b1c0-122fb2e455ae tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:18.003660 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-48844535-543e-44e0-b1c0-122fb2e455ae tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:18.127092 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-48844535-543e-44e0-b1c0-122fb2e455ae tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:18.137175 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-48844535-543e-44e0-b1c0-122fb2e455ae tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:18.138804 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-48844535-543e-44e0-b1c0-122fb2e455ae tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:18.141240 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ca14de6a-3fd4-48d6-a336-da1e65af845a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:18.144939 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-48844535-543e-44e0-b1c0-122fb2e455ae tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] 10.222.0.57 "GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 200 len: 1447 microversion: 2.75 time: 0.156331 Jul 18 02:09:18.146485 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 234/450] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:09:17 2022] GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 1447 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:09:18.151248 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-561653bd-46cc-4e01-b79e-46912f081b58 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:18.152060 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-561653bd-46cc-4e01-b79e-46912f081b58 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: f77b267e-9a20-4943-aa8b-0c82b9d6d20e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:18.152443 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ca14de6a-3fd4-48d6-a336-da1e65af845a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877" status: 200 len: 1324 microversion: 2.1 time: 0.787035 Jul 18 02:09:18.161342 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-561653bd-46cc-4e01-b79e-46912f081b58 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:18.162160 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-561653bd-46cc-4e01-b79e-46912f081b58 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:18.163163 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-561653bd-46cc-4e01-b79e-46912f081b58 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:18.163639 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 217/451] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:17 2022] GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877 => generated 1324 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:18.164535 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-561653bd-46cc-4e01-b79e-46912f081b58 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:18.168724 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-87d97cbe-ba02-4cba-afd4-8d9510d717fa tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:18.169474 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-87d97cbe-ba02-4cba-afd4-8d9510d717fa tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: 34961834-de57-4c1c-9ace-7bf4c43f8af8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:18.177645 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-87d97cbe-ba02-4cba-afd4-8d9510d717fa tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:18.178127 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-87d97cbe-ba02-4cba-afd4-8d9510d717fa tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:18.178944 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-87d97cbe-ba02-4cba-afd4-8d9510d717fa tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:18.179553 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-87d97cbe-ba02-4cba-afd4-8d9510d717fa tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:18.198391 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-87d97cbe-ba02-4cba-afd4-8d9510d717fa tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] HTTP exception thrown: Instance 34961834-de57-4c1c-9ace-7bf4c43f8af8 could not be found. Jul 18 02:09:18.199969 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-87d97cbe-ba02-4cba-afd4-8d9510d717fa tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Request method failure captured: Jul 18 02:09:18.199969 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8 HTTP/1.1 Jul 18 02:09:18.199969 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:09:18.199969 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:09:18.199969 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:09:18.199969 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:09:18.199969 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:09:18.199969 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:09:18.199969 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:09:18.199969 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:09:18.199969 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MCFGcQ62-kJ6tmwfnRCC6u10rWmhq7unKp06qv9ZCdAYGRVt2yNWxL8yl6uhfaq0Fdbz6CAN1dIrD86B_-Z7qDHMnNrqn3RnxLGcBc3_Vo4o-PyQQfVMWjWLPzih7wtecnh7BcHp8OhEzp4gQFdY-x6VOWWgHg0ta9Q54MYs2-Rdyo Jul 18 02:09:18.199969 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:09:18.199969 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:09:18.199969 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:09:18.199969 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:09:18.199969 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:09:18.199969 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:09:18.199969 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 5b0c0be2e96a499dbde6652cbc758a27 Jul 18 02:09:18.199969 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-DeleteServersAdminTestJSON-375900714 Jul 18 02:09:18.199969 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:09:18.199969 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:09:18.201218 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5b0c0be2e96a499dbde6652cbc758a27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5b0c0be2e96a499dbde6652cbc758a27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5b0c0be2e96a499dbde6652cbc758a27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5b0c0be2e96a499dbde6652cbc758a27"}]}] Jul 18 02:09:18.201218 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-DeleteServersAdminTestJSON-375900714 Jul 18 02:09:18.201218 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 5b0c0be2e96a499dbde6652cbc758a27 Jul 18 02:09:18.201218 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-375900714 Jul 18 02:09:18.201218 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-DeleteServersAdminTestJSON-375900714-project Jul 18 02:09:18.201218 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:09:18.201218 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:09:18.201218 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: efe4f42523df4204b49c9c0899c93fc7 Jul 18 02:09:18.201218 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-DeleteServersAdminTestJSON-375900714-project Jul 18 02:09:18.201218 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:09:18.201218 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 34961834-de57-4c1c-9ace-7bf4c43f8af8 could not be found. Jul 18 02:09:18.201218 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '34961834-de57-4c1c-9ace-7bf4c43f8af8'} Jul 18 02:09:18.201960 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:09:18.201960 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:18.201960 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:09:18.201960 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:09:18.201960 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:09:18.201960 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:09:18.201960 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:09:18.201960 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:09:18.201960 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:09:18.201960 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:09:18.201960 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34961834-de57-4c1c-9ace-7bf4c43f8af8 could not be found. Jul 18 02:09:18.201960 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:18.201960 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:18.201960 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:18.201960 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:18.201960 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:18.201960 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:18.201960 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:09:18.201960 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:09:18.201960 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:09:18.203068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:09:18.203068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:09:18.203068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:09:18.203068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:09:18.203068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:09:18.203068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:09:18.203068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:09:18.203068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:09:18.203068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:09:18.203068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34961834-de57-4c1c-9ace-7bf4c43f8af8 could not be found. Jul 18 02:09:18.203068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:18.203068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:18.203068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:18.203068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:18.203068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:18.203068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:18.203068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:09:18.203068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:09:18.203068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34961834-de57-4c1c-9ace-7bf4c43f8af8 could not be found. Jul 18 02:09:18.203068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:18.204233 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-87d97cbe-ba02-4cba-afd4-8d9510d717fa tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Returning 404 to user: Instance 34961834-de57-4c1c-9ace-7bf4c43f8af8 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:09:18.204233 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-87d97cbe-ba02-4cba-afd4-8d9510d717fa tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "DELETE /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8" status: 404 len: 111 microversion: 2.1 time: 0.036779 Jul 18 02:09:18.204233 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 218/452] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:09:18 2022] DELETE /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:09:18.208489 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1ada6f07-7fb8-4ab4-a370-ee31b5fa5211 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:18.209130 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1ada6f07-7fb8-4ab4-a370-ee31b5fa5211 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: d8aad28a-a3d8-48d3-8fc7-50d65ab4e768] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:18.216416 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ada6f07-7fb8-4ab4-a370-ee31b5fa5211 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:18.216871 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ada6f07-7fb8-4ab4-a370-ee31b5fa5211 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:18.217856 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ada6f07-7fb8-4ab4-a370-ee31b5fa5211 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:18.218348 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ada6f07-7fb8-4ab4-a370-ee31b5fa5211 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:18.319263 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-561653bd-46cc-4e01-b79e-46912f081b58 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60118d593f96437dbb2c68ad2fadd465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd02ce642caf4529a6e65c184de0ad19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:18.328322 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-561653bd-46cc-4e01-b79e-46912f081b58 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e" status: 200 len: 1257 microversion: 2.1 time: 0.180588 Jul 18 02:09:18.329014 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 235/453] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:18 2022] GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e => generated 1257 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:18.334549 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-87241349-f765-420c-9c59-29f14fb5bbc1 tempest-SecurityGroupsTestAdminJSON-1949305494 tempest-SecurityGroupsTestAdminJSON-1949305494-project-admin] Calling method '.version_select at 0x7ff4a913ec10>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:18.709737 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1ada6f07-7fb8-4ab4-a370-ee31b5fa5211 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:18.718792 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1ada6f07-7fb8-4ab4-a370-ee31b5fa5211 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768" status: 200 len: 1486 microversion: 2.1 time: 0.515624 Jul 18 02:09:18.729743 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 219/454] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:18 2022] GET /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768 => generated 1486 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:18.729743 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-472a05f7-63ea-4447-84b1-9e488fb5ff0e tempest-FlavorsV255TestJSON-537661632 tempest-FlavorsV255TestJSON-537661632-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:18.729743 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:18.729743 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:09:18.742695 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:09:18.752134 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-472a05f7-63ea-4447-84b1-9e488fb5ff0e tempest-FlavorsV255TestJSON-537661632 tempest-FlavorsV255TestJSON-537661632-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/1361999542" status: 202 len: 0 microversion: 2.55 time: 0.030447 Jul 18 02:09:18.752968 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 220/455] 10.222.0.57 () {60 vars in 1201 bytes} [Mon Jul 18 02:09:18 2022] DELETE /compute/v2.1/flavors/1361999542 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:09:18.759240 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b56597c1-b57e-42d5-b086-7c322d52fd4c tempest-HypervisorAdminNegativeUnderV252Test-553522777 tempest-HypervisorAdminNegativeUnderV252Test-553522777-project-admin] Calling method '.version_select at 0x7ff4a90cda60>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:18.760224 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:18.760224 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:09:18.761625 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b56597c1-b57e-42d5-b086-7c322d52fd4c tempest-HypervisorAdminNegativeUnderV252Test-553522777 tempest-HypervisorAdminNegativeUnderV252Test-553522777-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:18.762560 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b56597c1-b57e-42d5-b086-7c322d52fd4c tempest-HypervisorAdminNegativeUnderV252Test-553522777 tempest-HypervisorAdminNegativeUnderV252Test-553522777-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:18.771299 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-b56597c1-b57e-42d5-b086-7c322d52fd4c tempest-HypervisorAdminNegativeUnderV252Test-553522777 tempest-HypervisorAdminNegativeUnderV252Test-553522777-project-admin] HTTP exception thrown: No hypervisor matching '53f3c746-bc93-483f-bf60-f051010775c9' could be found. Jul 18 02:09:18.773033 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b56597c1-b57e-42d5-b086-7c322d52fd4c tempest-HypervisorAdminNegativeUnderV252Test-553522777 tempest-HypervisorAdminNegativeUnderV252Test-553522777-project-admin] Request method failure captured: Jul 18 02:09:18.773033 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/os-hypervisors/53f3c746-bc93-483f-bf60-f051010775c9/servers HTTP/1.1 Jul 18 02:09:18.773033 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:09:18.773033 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:09:18.773033 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:09:18.773033 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:09:18.773033 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:09:18.773033 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:09:18.773033 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:09:18.773033 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:09:18.773033 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MDJzfnwYxXo17rKqs3y5AJqRaTzSb9ZNDjPDMVwuHG3zX8nwZDKrxr3cL6J7k0gomCy4ESv-1mRrKFEypYv_PiaRvPOeFv72JH0RYLs20rTORNGG5EVoOjTEk7wSJKqMh2ifuFvqkAxFaGoA-Y8KGHdDXOmu4t8chPA5VDifavp5Ok Jul 18 02:09:18.773033 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:09:18.773033 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:09:18.773033 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:09:18.773033 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:09:18.773033 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:09:18.773033 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:09:18.773033 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: cba668ee865c42d68b3a135777ca30cb Jul 18 02:09:18.773033 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-553522777 Jul 18 02:09:18.773033 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,admin,reader Jul 18 02:09:18.773033 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,admin,reader Jul 18 02:09:18.775306 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_cba668ee865c42d68b3a135777ca30cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/cba668ee865c42d68b3a135777ca30cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/cba668ee865c42d68b3a135777ca30cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/cba668ee865c42d68b3a135777ca30cb"}]}] Jul 18 02:09:18.775306 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-553522777 Jul 18 02:09:18.775306 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: cba668ee865c42d68b3a135777ca30cb Jul 18 02:09:18.775306 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-553522777 Jul 18 02:09:18.775306 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-553522777-project-admin Jul 18 02:09:18.775306 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:09:18.775306 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:09:18.775306 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 96874d198e234f84beb90cb2f10904f8 Jul 18 02:09:18.775306 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-553522777-project-admin Jul 18 02:09:18.775306 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:09:18.775306 n-d-465891-3 devstack@n-api.service[119544]: exception: No hypervisor matching '53f3c746-bc93-483f-bf60-f051010775c9' could be found. Jul 18 02:09:18.775306 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '53f3c746-bc93-483f-bf60-f051010775c9'} Jul 18 02:09:18.776262 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:09:18.776262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:18.776262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:18.776262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:18.776262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:09:18.776262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:09:18.776262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:09:18.776262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:09:18.776262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:09:18.776262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:09:18.776262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Jul 18 02:09:18.776262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 18 02:09:18.776262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 18 02:09:18.776262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 18 02:09:18.776262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '53f3c746-bc93-483f-bf60-f051010775c9' could be found. Jul 18 02:09:18.776262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:18.776262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:18.776262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:18.776262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:18.777532 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:18.777532 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:18.777532 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:09:18.777532 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:09:18.777532 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '53f3c746-bc93-483f-bf60-f051010775c9' could be found. Jul 18 02:09:18.777532 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:18.777532 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b56597c1-b57e-42d5-b086-7c322d52fd4c tempest-HypervisorAdminNegativeUnderV252Test-553522777 tempest-HypervisorAdminNegativeUnderV252Test-553522777-project-admin] Returning 404 to user: No hypervisor matching '53f3c746-bc93-483f-bf60-f051010775c9' could be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:09:18.777532 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b56597c1-b57e-42d5-b086-7c322d52fd4c tempest-HypervisorAdminNegativeUnderV252Test-553522777 tempest-HypervisorAdminNegativeUnderV252Test-553522777-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/53f3c746-bc93-483f-bf60-f051010775c9/servers" status: 404 len: 123 microversion: 2.1 time: 0.020604 Jul 18 02:09:18.781387 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 221/456] 10.222.0.57 () {58 vars in 1280 bytes} [Mon Jul 18 02:09:18 2022] GET /compute/v2.1/os-hypervisors/53f3c746-bc93-483f-bf60-f051010775c9/servers => generated 123 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:09:18.787272 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4b74ff29-1632-4da5-acc3-e9f00e585a30 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:18.788204 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4b74ff29-1632-4da5-acc3-e9f00e585a30 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] [instance: 34961834-de57-4c1c-9ace-7bf4c43f8af8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:18.796805 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4b74ff29-1632-4da5-acc3-e9f00e585a30 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:18.797268 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4b74ff29-1632-4da5-acc3-e9f00e585a30 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:18.798164 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4b74ff29-1632-4da5-acc3-e9f00e585a30 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:18.798675 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4b74ff29-1632-4da5-acc3-e9f00e585a30 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:18.817758 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-4b74ff29-1632-4da5-acc3-e9f00e585a30 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] HTTP exception thrown: Instance 34961834-de57-4c1c-9ace-7bf4c43f8af8 could not be found. Jul 18 02:09:18.819648 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4b74ff29-1632-4da5-acc3-e9f00e585a30 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Request method failure captured: Jul 18 02:09:18.819648 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8 HTTP/1.1 Jul 18 02:09:18.819648 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:09:18.819648 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:09:18.819648 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:09:18.819648 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:09:18.819648 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:09:18.819648 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:09:18.819648 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:09:18.819648 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:09:18.819648 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MCFGcQ62-kJ6tmwfnRCC6u10rWmhq7unKp06qv9ZCdAYGRVt2yNWxL8yl6uhfaq0Fdbz6CAN1dIrD86B_-Z7qDHMnNrqn3RnxLGcBc3_Vo4o-PyQQfVMWjWLPzih7wtecnh7BcHp8OhEzp4gQFdY-x6VOWWgHg0ta9Q54MYs2-Rdyo Jul 18 02:09:18.819648 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:09:18.819648 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:09:18.819648 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:09:18.819648 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:09:18.819648 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:09:18.819648 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:09:18.819648 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 5b0c0be2e96a499dbde6652cbc758a27 Jul 18 02:09:18.819648 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-DeleteServersAdminTestJSON-375900714 Jul 18 02:09:18.819648 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:09:18.819648 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:09:18.821128 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5b0c0be2e96a499dbde6652cbc758a27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5b0c0be2e96a499dbde6652cbc758a27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5b0c0be2e96a499dbde6652cbc758a27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5b0c0be2e96a499dbde6652cbc758a27"}]}] Jul 18 02:09:18.821128 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-DeleteServersAdminTestJSON-375900714 Jul 18 02:09:18.821128 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 5b0c0be2e96a499dbde6652cbc758a27 Jul 18 02:09:18.821128 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-375900714 Jul 18 02:09:18.821128 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-DeleteServersAdminTestJSON-375900714-project Jul 18 02:09:18.821128 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:09:18.821128 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:09:18.821128 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: efe4f42523df4204b49c9c0899c93fc7 Jul 18 02:09:18.821128 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-DeleteServersAdminTestJSON-375900714-project Jul 18 02:09:18.821128 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:09:18.821128 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 34961834-de57-4c1c-9ace-7bf4c43f8af8 could not be found. Jul 18 02:09:18.821128 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '34961834-de57-4c1c-9ace-7bf4c43f8af8'} Jul 18 02:09:18.821985 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:09:18.821985 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:18.821985 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:09:18.821985 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:09:18.821985 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:09:18.821985 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:09:18.821985 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:09:18.821985 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:09:18.821985 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:09:18.821985 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:09:18.821985 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34961834-de57-4c1c-9ace-7bf4c43f8af8 could not be found. Jul 18 02:09:18.821985 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:18.821985 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:18.821985 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:18.821985 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:18.821985 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:18.821985 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:18.821985 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:09:18.821985 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:09:18.821985 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:09:18.823318 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:09:18.823318 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:09:18.823318 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:09:18.823318 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:09:18.823318 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:09:18.823318 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:09:18.823318 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:09:18.823318 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34961834-de57-4c1c-9ace-7bf4c43f8af8 could not be found. Jul 18 02:09:18.823318 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:18.823318 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:18.823318 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:18.823318 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:18.823318 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:18.823318 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:18.823318 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:09:18.823318 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:09:18.823318 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34961834-de57-4c1c-9ace-7bf4c43f8af8 could not be found. Jul 18 02:09:18.823318 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:18.825674 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4b74ff29-1632-4da5-acc3-e9f00e585a30 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] Returning 404 to user: Instance 34961834-de57-4c1c-9ace-7bf4c43f8af8 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:09:18.826838 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4b74ff29-1632-4da5-acc3-e9f00e585a30 tempest-DeleteServersAdminTestJSON-375900714 tempest-DeleteServersAdminTestJSON-375900714-project] 10.222.0.57 "GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8" status: 404 len: 111 microversion: 2.1 time: 0.044323 Jul 18 02:09:18.827972 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 222/457] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:18 2022] GET /compute/v2.1/servers/34961834-de57-4c1c-9ace-7bf4c43f8af8 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:09:18.834228 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b581d839-fba1-4e0b-bf29-30a9b582f70e tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:18.834637 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b581d839-fba1-4e0b-bf29-30a9b582f70e tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: d8aad28a-a3d8-48d3-8fc7-50d65ab4e768] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:18.842005 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b581d839-fba1-4e0b-bf29-30a9b582f70e tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:18.842463 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b581d839-fba1-4e0b-bf29-30a9b582f70e tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:18.843442 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b581d839-fba1-4e0b-bf29-30a9b582f70e tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:18.844080 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b581d839-fba1-4e0b-bf29-30a9b582f70e tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:18.939502 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b581d839-fba1-4e0b-bf29-30a9b582f70e tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "POST /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768/action" status: 202 len: 0 microversion: 2.1 time: 0.110016 Jul 18 02:09:18.940251 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 223/458] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:09:18 2022] POST /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:09:18.947600 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fef8823a-a394-4da3-90d7-f3ca38103735 tempest-FlavorsV255TestJSON-537661632 tempest-FlavorsV255TestJSON-537661632-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:18.973431 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fef8823a-a394-4da3-90d7-f3ca38103735 tempest-FlavorsV255TestJSON-537661632 tempest-FlavorsV255TestJSON-537661632-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 6156 microversion: 2.55 time: 0.031343 Jul 18 02:09:18.974811 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 224/459] 10.222.0.57 () {60 vars in 1186 bytes} [Mon Jul 18 02:09:18 2022] GET /compute/v2.1/flavors/detail => generated 6156 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:09:18.991201 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3cebe70b-acc0-47de-b31e-9bb1e8badf7f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:18.991937 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3cebe70b-acc0-47de-b31e-9bb1e8badf7f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: d8aad28a-a3d8-48d3-8fc7-50d65ab4e768] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:19.001164 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3cebe70b-acc0-47de-b31e-9bb1e8badf7f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:19.002178 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3cebe70b-acc0-47de-b31e-9bb1e8badf7f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:19.005088 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3cebe70b-acc0-47de-b31e-9bb1e8badf7f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:19.005470 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3cebe70b-acc0-47de-b31e-9bb1e8badf7f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:19.264816 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-87241349-f765-420c-9c59-29f14fb5bbc1 tempest-SecurityGroupsTestAdminJSON-1949305494 tempest-SecurityGroupsTestAdminJSON-1949305494-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/1b7f0f2d-d2f2-4a5d-8a2a-f4a9f0f32714" status: 202 len: 0 microversion: 2.1 time: 0.933673 Jul 18 02:09:19.265984 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 236/460] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 02:09:18 2022] DELETE /compute/v2.1/os-security-groups/1b7f0f2d-d2f2-4a5d-8a2a-f4a9f0f32714 => generated 0 bytes in 936 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:09:19.274374 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0aa8a75d-003d-4e62-984b-e23b05b2f1f2 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:19.275438 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0aa8a75d-003d-4e62-984b-e23b05b2f1f2 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:19.293290 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0aa8a75d-003d-4e62-984b-e23b05b2f1f2 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:19.294014 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0aa8a75d-003d-4e62-984b-e23b05b2f1f2 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:19.294985 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0aa8a75d-003d-4e62-984b-e23b05b2f1f2 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:19.295571 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0aa8a75d-003d-4e62-984b-e23b05b2f1f2 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:19.545496 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0aa8a75d-003d-4e62-984b-e23b05b2f1f2 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:19.563123 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0aa8a75d-003d-4e62-984b-e23b05b2f1f2 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:19.565060 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0aa8a75d-003d-4e62-984b-e23b05b2f1f2 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:19.571885 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0aa8a75d-003d-4e62-984b-e23b05b2f1f2 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] 10.222.0.57 "GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 200 len: 1447 microversion: 2.75 time: 0.301392 Jul 18 02:09:19.580280 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 237/461] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:09:19 2022] GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 1447 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:09:19.585487 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-03a7557d-cdc6-49d5-86fd-de51822eec39 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:19.587846 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-03a7557d-cdc6-49d5-86fd-de51822eec39 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: bd14a732-a9ad-4dfd-af61-69b84eda8877] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:19.601974 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-03a7557d-cdc6-49d5-86fd-de51822eec39 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:19.602661 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-03a7557d-cdc6-49d5-86fd-de51822eec39 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:19.603632 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-03a7557d-cdc6-49d5-86fd-de51822eec39 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:19.604256 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-03a7557d-cdc6-49d5-86fd-de51822eec39 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:19.685188 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3cebe70b-acc0-47de-b31e-9bb1e8badf7f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:19.694924 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3cebe70b-acc0-47de-b31e-9bb1e8badf7f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768" status: 200 len: 1491 microversion: 2.1 time: 0.719000 Jul 18 02:09:19.695509 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 225/462] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:18 2022] GET /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768 => generated 1491 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:19.709658 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d2538f0b-23d6-4711-9002-032c7e45158a tempest-SecurityGroupsTestAdminJSON-1149598485 tempest-SecurityGroupsTestAdminJSON-1149598485-project] Calling method '.version_select at 0x7ff4a92c9310>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:20.216031 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-03a7557d-cdc6-49d5-86fd-de51822eec39 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:20.227078 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-03a7557d-cdc6-49d5-86fd-de51822eec39 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877" status: 200 len: 1324 microversion: 2.1 time: 0.645150 Jul 18 02:09:20.240740 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 238/463] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:19 2022] GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877 => generated 1324 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:20.247581 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-78e69dfa-0837-4753-9015-f4efbcf74fbf tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:20.248488 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-78e69dfa-0837-4753-9015-f4efbcf74fbf tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: f77b267e-9a20-4943-aa8b-0c82b9d6d20e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:20.262286 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-78e69dfa-0837-4753-9015-f4efbcf74fbf tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:20.263813 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-78e69dfa-0837-4753-9015-f4efbcf74fbf tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:20.265680 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-78e69dfa-0837-4753-9015-f4efbcf74fbf tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:20.268631 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-78e69dfa-0837-4753-9015-f4efbcf74fbf tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:21.044624 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-78e69dfa-0837-4753-9015-f4efbcf74fbf tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60118d593f96437dbb2c68ad2fadd465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd02ce642caf4529a6e65c184de0ad19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:21.065337 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-78e69dfa-0837-4753-9015-f4efbcf74fbf tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e" status: 200 len: 1319 microversion: 2.1 time: 0.818458 Jul 18 02:09:21.068691 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 239/464] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:20 2022] GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e => generated 1319 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:21.086462 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7f33fcf0-9dab-4fbc-92f8-cc25a23d22c7 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:21.087580 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7f33fcf0-9dab-4fbc-92f8-cc25a23d22c7 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:21.106876 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7f33fcf0-9dab-4fbc-92f8-cc25a23d22c7 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:21.109855 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7f33fcf0-9dab-4fbc-92f8-cc25a23d22c7 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:21.114920 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7f33fcf0-9dab-4fbc-92f8-cc25a23d22c7 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:21.115903 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7f33fcf0-9dab-4fbc-92f8-cc25a23d22c7 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:21.275100 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d2538f0b-23d6-4711-9002-032c7e45158a tempest-SecurityGroupsTestAdminJSON-1149598485 tempest-SecurityGroupsTestAdminJSON-1149598485-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/265bb0c0-b225-4a5c-b9a8-c8890f6366f0" status: 202 len: 0 microversion: 2.1 time: 1.573759 Jul 18 02:09:21.276361 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 226/465] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 02:09:19 2022] DELETE /compute/v2.1/os-security-groups/265bb0c0-b225-4a5c-b9a8-c8890f6366f0 => generated 0 bytes in 1580 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:09:21.283332 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-764b22f8-489f-4342-8ee0-5e373868d151 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:21.283946 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-764b22f8-489f-4342-8ee0-5e373868d151 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: d8aad28a-a3d8-48d3-8fc7-50d65ab4e768] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:21.296362 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-764b22f8-489f-4342-8ee0-5e373868d151 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:21.302457 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-764b22f8-489f-4342-8ee0-5e373868d151 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:21.303319 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-764b22f8-489f-4342-8ee0-5e373868d151 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:21.303770 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-764b22f8-489f-4342-8ee0-5e373868d151 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:21.400956 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7f33fcf0-9dab-4fbc-92f8-cc25a23d22c7 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:21.403342 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:09:21.429589 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7f33fcf0-9dab-4fbc-92f8-cc25a23d22c7 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:21.433491 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7f33fcf0-9dab-4fbc-92f8-cc25a23d22c7 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:21.449905 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7f33fcf0-9dab-4fbc-92f8-cc25a23d22c7 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] 10.222.0.57 "GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 200 len: 1447 microversion: 2.75 time: 0.379480 Jul 18 02:09:21.451482 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 240/466] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:09:21 2022] GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 1447 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:09:21.461211 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-cb4a9adc-28f3-4caa-a27b-9267d3e9f14a req-a9e92278-172f-451b-b4ff-982ae3a2a253 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd14a732-a9ad-4dfd-af61-69b84eda8877", "tag": "8bd503c0-d3d5-4bae-9611-ac0c479b1c99"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:21.472497 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-cb4a9adc-28f3-4caa-a27b-9267d3e9f14a req-a9e92278-172f-451b-b4ff-982ae3a2a253 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:21.473295 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-cb4a9adc-28f3-4caa-a27b-9267d3e9f14a req-a9e92278-172f-451b-b4ff-982ae3a2a253 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:21.491401 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-cb4a9adc-28f3-4caa-a27b-9267d3e9f14a req-a9e92278-172f-451b-b4ff-982ae3a2a253 service nova] Creating event network-changed:8bd503c0-d3d5-4bae-9611-ac0c479b1c99 for instance bd14a732-a9ad-4dfd-af61-69b84eda8877 on n-h1-465891-3 Jul 18 02:09:21.500325 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-cb4a9adc-28f3-4caa-a27b-9267d3e9f14a req-a9e92278-172f-451b-b4ff-982ae3a2a253 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046907 Jul 18 02:09:21.504081 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 241/467] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:21.512740 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f64747ee-f5e4-46a7-8bd6-d5f7a91cd8ba tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:21.513820 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f64747ee-f5e4-46a7-8bd6-d5f7a91cd8ba tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: bd14a732-a9ad-4dfd-af61-69b84eda8877] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:21.522486 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f64747ee-f5e4-46a7-8bd6-d5f7a91cd8ba tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:21.523290 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f64747ee-f5e4-46a7-8bd6-d5f7a91cd8ba tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:21.524371 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f64747ee-f5e4-46a7-8bd6-d5f7a91cd8ba tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:21.525343 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f64747ee-f5e4-46a7-8bd6-d5f7a91cd8ba tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:21.817078 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-764b22f8-489f-4342-8ee0-5e373868d151 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:21.831314 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-764b22f8-489f-4342-8ee0-5e373868d151 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768" status: 200 len: 1471 microversion: 2.1 time: 0.548548 Jul 18 02:09:21.832402 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 227/468] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:21 2022] GET /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768 => generated 1471 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:21.839140 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-551211b2-9b3f-4a3b-9144-c73816b5d5fb tempest-SecurityGroupsTestAdminJSON-1149598485 tempest-SecurityGroupsTestAdminJSON-1149598485-project] Calling method '.version_select at 0x7ff4a9188040>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:22.116681 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f64747ee-f5e4-46a7-8bd6-d5f7a91cd8ba tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:22.126253 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f64747ee-f5e4-46a7-8bd6-d5f7a91cd8ba tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877" status: 200 len: 1324 microversion: 2.1 time: 0.620477 Jul 18 02:09:22.148802 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 242/469] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:21 2022] GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877 => generated 1324 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:22.161632 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-26f6bef2-abc6-4c62-8d32-cdbc65f3d505 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1838279118"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:22.166013 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-26f6bef2-abc6-4c62-8d32-cdbc65f3d505 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: d8aad28a-a3d8-48d3-8fc7-50d65ab4e768] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:22.176870 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-26f6bef2-abc6-4c62-8d32-cdbc65f3d505 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:22.177644 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-26f6bef2-abc6-4c62-8d32-cdbc65f3d505 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:22.178851 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-26f6bef2-abc6-4c62-8d32-cdbc65f3d505 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:22.179692 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-26f6bef2-abc6-4c62-8d32-cdbc65f3d505 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:22.552383 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-26f6bef2-abc6-4c62-8d32-cdbc65f3d505 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "POST /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768/action" status: 202 len: 0 microversion: 2.1 time: 0.401196 Jul 18 02:09:22.559135 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 243/470] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:09:22 2022] POST /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768/action => generated 0 bytes in 410 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 18 02:09:22.568111 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-405303dc-28e1-4958-81f1-ea6ec8cb9064 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:22.569941 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-405303dc-28e1-4958-81f1-ea6ec8cb9064 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: f77b267e-9a20-4943-aa8b-0c82b9d6d20e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:22.581549 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-405303dc-28e1-4958-81f1-ea6ec8cb9064 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:22.583456 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-405303dc-28e1-4958-81f1-ea6ec8cb9064 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:22.585416 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-405303dc-28e1-4958-81f1-ea6ec8cb9064 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:22.586643 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-405303dc-28e1-4958-81f1-ea6ec8cb9064 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:23.217795 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-405303dc-28e1-4958-81f1-ea6ec8cb9064 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60118d593f96437dbb2c68ad2fadd465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd02ce642caf4529a6e65c184de0ad19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:23.231388 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-405303dc-28e1-4958-81f1-ea6ec8cb9064 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e" status: 200 len: 1386 microversion: 2.1 time: 0.668077 Jul 18 02:09:23.234488 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 244/471] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:22 2022] GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e => generated 1386 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:23.245104 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ddb8a10e-0347-4a49-9c28-5e6c2ffe35b9 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:23.246908 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ddb8a10e-0347-4a49-9c28-5e6c2ffe35b9 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:23.265632 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ddb8a10e-0347-4a49-9c28-5e6c2ffe35b9 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:23.265632 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ddb8a10e-0347-4a49-9c28-5e6c2ffe35b9 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:23.265632 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ddb8a10e-0347-4a49-9c28-5e6c2ffe35b9 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:23.268154 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ddb8a10e-0347-4a49-9c28-5e6c2ffe35b9 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:23.305989 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-551211b2-9b3f-4a3b-9144-c73816b5d5fb tempest-SecurityGroupsTestAdminJSON-1149598485 tempest-SecurityGroupsTestAdminJSON-1149598485-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/9cceabb5-cbe5-4b4d-8315-08b463594084" status: 202 len: 0 microversion: 2.1 time: 1.471764 Jul 18 02:09:23.307024 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 228/472] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 02:09:21 2022] DELETE /compute/v2.1/os-security-groups/9cceabb5-cbe5-4b4d-8315-08b463594084 => generated 0 bytes in 1474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:09:23.314273 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f0d32f52-8864-4b38-8514-aba99e34f877 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a90cdc10>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:23.371459 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f0d32f52-8864-4b38-8514-aba99e34f877 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a" status: 200 len: 1410 microversion: 2.1 time: 0.063010 Jul 18 02:09:23.377784 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 229/473] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:09:23 2022] GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a => generated 1410 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:23.380607 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ffc2bb90-08cf-43b7-8ec4-aed89aa87346 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:23.381224 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ffc2bb90-08cf-43b7-8ec4-aed89aa87346 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: bd14a732-a9ad-4dfd-af61-69b84eda8877] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:23.390650 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ffc2bb90-08cf-43b7-8ec4-aed89aa87346 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:23.391117 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ffc2bb90-08cf-43b7-8ec4-aed89aa87346 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:23.393635 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ffc2bb90-08cf-43b7-8ec4-aed89aa87346 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:23.394278 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ffc2bb90-08cf-43b7-8ec4-aed89aa87346 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:23.434701 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ddb8a10e-0347-4a49-9c28-5e6c2ffe35b9 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:23.445786 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ddb8a10e-0347-4a49-9c28-5e6c2ffe35b9 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:23.448671 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ddb8a10e-0347-4a49-9c28-5e6c2ffe35b9 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:23.455577 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ddb8a10e-0347-4a49-9c28-5e6c2ffe35b9 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] 10.222.0.57 "GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 200 len: 1447 microversion: 2.75 time: 0.220610 Jul 18 02:09:23.456407 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 245/474] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:09:23 2022] GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 1447 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:09:23.594229 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-d57b9756-808c-44e6-9df5-a3d84bb5f5d8 req-7bb0ff8d-0a6b-43c5-b617-066a4abbc058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbb215bf-6099-4dd5-b9af-d1bbfb55ef21", "name": "network-vif-deleted", "tag": "111c59e5-56e7-4304-b9bb-aa87d9966837"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:23.607929 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-d57b9756-808c-44e6-9df5-a3d84bb5f5d8 req-7bb0ff8d-0a6b-43c5-b617-066a4abbc058 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:23.608794 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-d57b9756-808c-44e6-9df5-a3d84bb5f5d8 req-7bb0ff8d-0a6b-43c5-b617-066a4abbc058 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:23.629930 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-d57b9756-808c-44e6-9df5-a3d84bb5f5d8 req-7bb0ff8d-0a6b-43c5-b617-066a4abbc058 service nova] Creating event network-vif-deleted:111c59e5-56e7-4304-b9bb-aa87d9966837 for instance dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 on n-h2-465891-3 Jul 18 02:09:23.639354 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-d57b9756-808c-44e6-9df5-a3d84bb5f5d8 req-7bb0ff8d-0a6b-43c5-b617-066a4abbc058 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047718 Jul 18 02:09:23.643938 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 246/475] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:23.697453 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ffc2bb90-08cf-43b7-8ec4-aed89aa87346 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:23.706869 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ffc2bb90-08cf-43b7-8ec4-aed89aa87346 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877" status: 200 len: 1324 microversion: 2.1 time: 0.333222 Jul 18 02:09:23.707833 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 230/476] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:23 2022] GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877 => generated 1324 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:24.252441 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-31a1705b-6176-408a-b3c4-cd562c8b3c0a tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:24.253351 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-31a1705b-6176-408a-b3c4-cd562c8b3c0a tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: f77b267e-9a20-4943-aa8b-0c82b9d6d20e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:24.263995 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-31a1705b-6176-408a-b3c4-cd562c8b3c0a tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:24.264746 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-31a1705b-6176-408a-b3c4-cd562c8b3c0a tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:24.266107 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-31a1705b-6176-408a-b3c4-cd562c8b3c0a tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:24.267399 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-31a1705b-6176-408a-b3c4-cd562c8b3c0a tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:24.384737 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8e2f99f6-fb4f-4f0f-b00b-4c477bf36dad tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a90cd9d0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:24.448880 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8e2f99f6-fb4f-4f0f-b00b-4c477bf36dad tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a" status: 200 len: 1410 microversion: 2.1 time: 0.066183 Jul 18 02:09:24.449765 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 231/477] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:09:24 2022] GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a => generated 1410 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:09:24.471430 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-31a1705b-6176-408a-b3c4-cd562c8b3c0a tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60118d593f96437dbb2c68ad2fadd465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd02ce642caf4529a6e65c184de0ad19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:24.475906 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b327d968-50d2-448e-a9f9-4138fe49697d tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:24.477165 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b327d968-50d2-448e-a9f9-4138fe49697d tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:24.487895 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-31a1705b-6176-408a-b3c4-cd562c8b3c0a tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e" status: 200 len: 1386 microversion: 2.1 time: 0.240060 Jul 18 02:09:24.497870 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 247/478] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:24 2022] GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e => generated 1386 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:09:24.501774 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b327d968-50d2-448e-a9f9-4138fe49697d tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:24.502425 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b327d968-50d2-448e-a9f9-4138fe49697d tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:24.503411 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b327d968-50d2-448e-a9f9-4138fe49697d tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:24.504044 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b327d968-50d2-448e-a9f9-4138fe49697d tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:24.587149 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b327d968-50d2-448e-a9f9-4138fe49697d tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:24.599371 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b327d968-50d2-448e-a9f9-4138fe49697d tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:24.602074 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b327d968-50d2-448e-a9f9-4138fe49697d tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:24.613037 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b327d968-50d2-448e-a9f9-4138fe49697d tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] 10.222.0.57 "GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 200 len: 1447 microversion: 2.75 time: 0.141393 Jul 18 02:09:24.614017 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 232/479] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:09:24 2022] GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 1447 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:09:24.724697 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b02819b7-b487-458f-b58f-c7fdd122b6ac tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:24.725448 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b02819b7-b487-458f-b58f-c7fdd122b6ac tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: bd14a732-a9ad-4dfd-af61-69b84eda8877] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:24.732050 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b02819b7-b487-458f-b58f-c7fdd122b6ac tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:24.732500 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b02819b7-b487-458f-b58f-c7fdd122b6ac tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:24.733459 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b02819b7-b487-458f-b58f-c7fdd122b6ac tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:24.733934 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b02819b7-b487-458f-b58f-c7fdd122b6ac tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:24.889057 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b02819b7-b487-458f-b58f-c7fdd122b6ac tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:24.899703 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b02819b7-b487-458f-b58f-c7fdd122b6ac tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877" status: 200 len: 1324 microversion: 2.1 time: 0.178985 Jul 18 02:09:24.900664 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 248/480] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:24 2022] GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877 => generated 1324 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:25.469399 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8fa05f59-5e08-46ff-9bf7-f899bb74ed2a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a915b9d0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:25.548681 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8fa05f59-5e08-46ff-9bf7-f899bb74ed2a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a" status: 200 len: 1410 microversion: 2.1 time: 0.088669 Jul 18 02:09:25.554768 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 249/481] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:09:25 2022] GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a => generated 1410 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:25.562727 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-09cbc6f2-0556-4e56-a11c-0285576263d8 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:25.564442 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-09cbc6f2-0556-4e56-a11c-0285576263d8 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: f77b267e-9a20-4943-aa8b-0c82b9d6d20e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:25.572918 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-09cbc6f2-0556-4e56-a11c-0285576263d8 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:25.573492 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-09cbc6f2-0556-4e56-a11c-0285576263d8 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:25.574706 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-09cbc6f2-0556-4e56-a11c-0285576263d8 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:25.575305 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-09cbc6f2-0556-4e56-a11c-0285576263d8 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:25.762978 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f7e94370-4ec6-4fa1-bc0c-5c8df11ef80b tempest-HypervisorAdminV228Test-1369836281 tempest-HypervisorAdminV228Test-1369836281-project-admin] Calling method '.version_select at 0x7ff4a92c9b80>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:25.765449 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:25.765449 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:09:25.767843 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f7e94370-4ec6-4fa1-bc0c-5c8df11ef80b tempest-HypervisorAdminV228Test-1369836281 tempest-HypervisorAdminV228Test-1369836281-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:25.768641 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f7e94370-4ec6-4fa1-bc0c-5c8df11ef80b tempest-HypervisorAdminV228Test-1369836281 tempest-HypervisorAdminV228Test-1369836281-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:25.786246 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f7e94370-4ec6-4fa1-bc0c-5c8df11ef80b tempest-HypervisorAdminV228Test-1369836281 tempest-HypervisorAdminV228Test-1369836281-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:25.787105 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f7e94370-4ec6-4fa1-bc0c-5c8df11ef80b tempest-HypervisorAdminV228Test-1369836281 tempest-HypervisorAdminV228Test-1369836281-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:25.805880 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f7e94370-4ec6-4fa1-bc0c-5c8df11ef80b tempest-HypervisorAdminV228Test-1369836281 tempest-HypervisorAdminV228Test-1369836281-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:25.806326 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f7e94370-4ec6-4fa1-bc0c-5c8df11ef80b tempest-HypervisorAdminV228Test-1369836281 tempest-HypervisorAdminV228Test-1369836281-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:25.814658 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f7e94370-4ec6-4fa1-bc0c-5c8df11ef80b tempest-HypervisorAdminV228Test-1369836281 tempest-HypervisorAdminV228Test-1369836281-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.373868 Jul 18 02:09:25.815924 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 233/482] 10.222.0.57 () {60 vars in 1186 bytes} [Mon Jul 18 02:09:25 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:09:25.825362 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ef2e1c58-a47e-4139-9bdc-c0b8b2539967 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:25.826264 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ef2e1c58-a47e-4139-9bdc-c0b8b2539967 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:25.835395 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ef2e1c58-a47e-4139-9bdc-c0b8b2539967 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:25.836284 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ef2e1c58-a47e-4139-9bdc-c0b8b2539967 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:25.838847 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ef2e1c58-a47e-4139-9bdc-c0b8b2539967 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:25.839760 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ef2e1c58-a47e-4139-9bdc-c0b8b2539967 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:26.058394 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ef2e1c58-a47e-4139-9bdc-c0b8b2539967 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:26.069740 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ef2e1c58-a47e-4139-9bdc-c0b8b2539967 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:26.073256 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ef2e1c58-a47e-4139-9bdc-c0b8b2539967 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:26.079870 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ef2e1c58-a47e-4139-9bdc-c0b8b2539967 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] 10.222.0.57 "GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 200 len: 1447 microversion: 2.75 time: 0.262074 Jul 18 02:09:26.081152 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 234/483] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:09:25 2022] GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 1447 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:09:26.086074 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-4a108094-7559-472a-9a13-1c3f343c4ee4 req-903f064d-2bc9-4665-bfcc-f8169bd241cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f77b267e-9a20-4943-aa8b-0c82b9d6d20e", "tag": "3cecd7e8-61af-4808-991a-e40ca83842b0"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:26.096647 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-4a108094-7559-472a-9a13-1c3f343c4ee4 req-903f064d-2bc9-4665-bfcc-f8169bd241cb service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:26.097281 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-4a108094-7559-472a-9a13-1c3f343c4ee4 req-903f064d-2bc9-4665-bfcc-f8169bd241cb service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:26.128911 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-4a108094-7559-472a-9a13-1c3f343c4ee4 req-903f064d-2bc9-4665-bfcc-f8169bd241cb service nova] Creating event network-changed:3cecd7e8-61af-4808-991a-e40ca83842b0 for instance f77b267e-9a20-4943-aa8b-0c82b9d6d20e on n-h1-465891-3 Jul 18 02:09:26.135246 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-4a108094-7559-472a-9a13-1c3f343c4ee4 req-903f064d-2bc9-4665-bfcc-f8169bd241cb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052691 Jul 18 02:09:26.137643 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 235/484] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:26.143042 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2e26a5d1-2967-45e5-9104-1f0fbed8e0d2 tempest-HypervisorAdminV228Test-1369836281 tempest-HypervisorAdminV228Test-1369836281-project-admin] Calling method '.version_select at 0x7ff4a90ebd30>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:26.144121 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:26.144121 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:09:26.145750 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2e26a5d1-2967-45e5-9104-1f0fbed8e0d2 tempest-HypervisorAdminV228Test-1369836281 tempest-HypervisorAdminV228Test-1369836281-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:26.146697 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2e26a5d1-2967-45e5-9104-1f0fbed8e0d2 tempest-HypervisorAdminV228Test-1369836281 tempest-HypervisorAdminV228Test-1369836281-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:26.162557 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2e26a5d1-2967-45e5-9104-1f0fbed8e0d2 tempest-HypervisorAdminV228Test-1369836281 tempest-HypervisorAdminV228Test-1369836281-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:26.163466 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2e26a5d1-2967-45e5-9104-1f0fbed8e0d2 tempest-HypervisorAdminV228Test-1369836281 tempest-HypervisorAdminV228Test-1369836281-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:26.167348 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:09:26.172386 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2e26a5d1-2967-45e5-9104-1f0fbed8e0d2 tempest-HypervisorAdminV228Test-1369836281 tempest-HypervisorAdminV228Test-1369836281-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.033301 Jul 18 02:09:26.174392 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 236/485] 10.222.0.57 () {60 vars in 1192 bytes} [Mon Jul 18 02:09:26 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:09:26.179284 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-063879ff-358e-45eb-a0a6-32365d36408d tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:26.181600 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-063879ff-358e-45eb-a0a6-32365d36408d tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: bd14a732-a9ad-4dfd-af61-69b84eda8877] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:26.191891 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-063879ff-358e-45eb-a0a6-32365d36408d tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:26.192609 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-063879ff-358e-45eb-a0a6-32365d36408d tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:26.193585 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-063879ff-358e-45eb-a0a6-32365d36408d tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:26.194244 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-063879ff-358e-45eb-a0a6-32365d36408d tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:26.199788 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-09cbc6f2-0556-4e56-a11c-0285576263d8 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60118d593f96437dbb2c68ad2fadd465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd02ce642caf4529a6e65c184de0ad19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:26.215893 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-09cbc6f2-0556-4e56-a11c-0285576263d8 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e" status: 200 len: 1386 microversion: 2.1 time: 0.657792 Jul 18 02:09:26.226365 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 250/486] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:25 2022] GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e => generated 1386 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:26.799453 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dc9c10f0-8833-40b9-93e1-bec944d0c70b tempest-HypervisorAdminNegativeTestJSON-1466552766 tempest-HypervisorAdminNegativeTestJSON-1466552766-project] Calling method '.version_select at 0x7ff4a913edc0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:26.801521 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:26.801521 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:09:26.805597 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-dc9c10f0-8833-40b9-93e1-bec944d0c70b tempest-HypervisorAdminNegativeTestJSON-1466552766 tempest-HypervisorAdminNegativeTestJSON-1466552766-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '04779b594fcf43a58d7273a260f03488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b946638b0e4949059908e0c29a0b15e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:26.810738 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dc9c10f0-8833-40b9-93e1-bec944d0c70b tempest-HypervisorAdminNegativeTestJSON-1466552766 tempest-HypervisorAdminNegativeTestJSON-1466552766-project] Request method failure captured: Jul 18 02:09:26.810738 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Jul 18 02:09:26.810738 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:09:26.810738 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:09:26.810738 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:09:26.810738 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:09:26.810738 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:09:26.810738 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:09:26.810738 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:09:26.810738 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:09:26.810738 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MDVV7nlXT8aGKsMpRL2hoVhi49OFwzLqMRJG1yE1S11GvqQmjoyjyGcUrZvzQbO2lt-vUZhz3c_JKK5LmqcaUTQKamEFKMOnJ73SYEl3BsBaWmi2jS3jgvF37ELQaSp01zXBoaAi5vOiF1hCQI5dtBKLBTkTuPnGXck-YhY5S42Cuk Jul 18 02:09:26.810738 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:09:26.810738 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:09:26.810738 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:09:26.810738 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:09:26.810738 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:09:26.810738 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:09:26.810738 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: b946638b0e4949059908e0c29a0b15e5 Jul 18 02:09:26.810738 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1466552766 Jul 18 02:09:26.810738 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:09:26.810738 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:09:26.812275 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b946638b0e4949059908e0c29a0b15e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b946638b0e4949059908e0c29a0b15e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b946638b0e4949059908e0c29a0b15e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b946638b0e4949059908e0c29a0b15e5"}]}] Jul 18 02:09:26.812275 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1466552766 Jul 18 02:09:26.812275 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: b946638b0e4949059908e0c29a0b15e5 Jul 18 02:09:26.812275 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1466552766 Jul 18 02:09:26.812275 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-HypervisorAdminNegativeTestJSON-1466552766-project Jul 18 02:09:26.812275 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:09:26.812275 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:09:26.812275 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 04779b594fcf43a58d7273a260f03488 Jul 18 02:09:26.812275 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1466552766-project Jul 18 02:09:26.812275 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:09:26.812275 n-d-465891-3 devstack@n-api.service[119543]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 18 02:09:26.812275 n-d-465891-3 devstack@n-api.service[119543]: action_args: {} Jul 18 02:09:26.812275 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:09:26.813828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:26.813828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:26.813828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:26.813828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:09:26.813828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:09:26.813828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:09:26.813828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:09:26.813828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:09:26.813828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:09:26.813828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Jul 18 02:09:26.813828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._detail(req) Jul 18 02:09:26.813828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Jul 18 02:09:26.813828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Jul 18 02:09:26.813828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:09:26.813828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:09:26.813828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:09:26.813828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:09:26.813828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:09:26.813828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:09:26.815233 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:09:26.815233 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:09:26.815233 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:09:26.815233 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:09:26.815233 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:09:26.815233 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:09:26.815233 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:09:26.815233 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:09:26.815233 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 18 02:09:26.815233 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:26.815233 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:26.815233 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:26.815233 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:26.815233 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:26.815233 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:26.815233 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:09:26.815233 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:09:26.815233 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 18 02:09:26.815233 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:26.819112 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dc9c10f0-8833-40b9-93e1-bec944d0c70b tempest-HypervisorAdminNegativeTestJSON-1466552766 tempest-HypervisorAdminNegativeTestJSON-1466552766-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:09:26.819994 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-dc9c10f0-8833-40b9-93e1-bec944d0c70b tempest-HypervisorAdminNegativeTestJSON-1466552766 tempest-HypervisorAdminNegativeTestJSON-1466552766-project] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.291247 Jul 18 02:09:26.820562 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 251/487] 10.222.0.57 () {58 vars in 1166 bytes} [Mon Jul 18 02:09:26 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 292 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:09:26.830871 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a14f0852-9beb-4ccd-9d00-32d7f45b8085 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a90b19d0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:26.888243 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a14f0852-9beb-4ccd-9d00-32d7f45b8085 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a" status: 200 len: 1410 microversion: 2.1 time: 0.065472 Jul 18 02:09:26.894287 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 252/488] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:09:26 2022] GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a => generated 1410 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:26.899874 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-708053a2-10ef-4671-b370-13512bd87480 tempest-HypervisorAdminNegativeTestJSON-1466552766 tempest-HypervisorAdminNegativeTestJSON-1466552766-project] Calling method '.version_select at 0x7ff4a93793a0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:26.905609 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:26.905609 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:09:26.909646 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-708053a2-10ef-4671-b370-13512bd87480 tempest-HypervisorAdminNegativeTestJSON-1466552766 tempest-HypervisorAdminNegativeTestJSON-1466552766-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '04779b594fcf43a58d7273a260f03488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b946638b0e4949059908e0c29a0b15e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:26.911445 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-708053a2-10ef-4671-b370-13512bd87480 tempest-HypervisorAdminNegativeTestJSON-1466552766 tempest-HypervisorAdminNegativeTestJSON-1466552766-project] Request method failure captured: Jul 18 02:09:26.911445 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Jul 18 02:09:26.911445 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:09:26.911445 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:09:26.911445 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:09:26.911445 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:09:26.911445 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:09:26.911445 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:09:26.911445 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:09:26.911445 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:09:26.911445 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MDVV7nlXT8aGKsMpRL2hoVhi49OFwzLqMRJG1yE1S11GvqQmjoyjyGcUrZvzQbO2lt-vUZhz3c_JKK5LmqcaUTQKamEFKMOnJ73SYEl3BsBaWmi2jS3jgvF37ELQaSp01zXBoaAi5vOiF1hCQI5dtBKLBTkTuPnGXck-YhY5S42Cuk Jul 18 02:09:26.911445 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:09:26.911445 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:09:26.911445 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:09:26.911445 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:09:26.911445 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:09:26.911445 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:09:26.911445 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: b946638b0e4949059908e0c29a0b15e5 Jul 18 02:09:26.911445 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1466552766 Jul 18 02:09:26.911445 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:09:26.911445 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:09:26.912714 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b946638b0e4949059908e0c29a0b15e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b946638b0e4949059908e0c29a0b15e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b946638b0e4949059908e0c29a0b15e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b946638b0e4949059908e0c29a0b15e5"}]}] Jul 18 02:09:26.912714 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1466552766 Jul 18 02:09:26.912714 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: b946638b0e4949059908e0c29a0b15e5 Jul 18 02:09:26.912714 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1466552766 Jul 18 02:09:26.912714 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-HypervisorAdminNegativeTestJSON-1466552766-project Jul 18 02:09:26.912714 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:09:26.912714 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:09:26.912714 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 04779b594fcf43a58d7273a260f03488 Jul 18 02:09:26.912714 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1466552766-project Jul 18 02:09:26.912714 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:09:26.912714 n-d-465891-3 devstack@n-api.service[119543]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 18 02:09:26.912714 n-d-465891-3 devstack@n-api.service[119543]: action_args: {} Jul 18 02:09:26.912714 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:09:26.913462 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:26.913462 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:26.913462 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:26.913462 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:09:26.913462 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:09:26.913462 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:09:26.913462 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:09:26.913462 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:09:26.913462 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:09:26.913462 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Jul 18 02:09:26.913462 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 18 02:09:26.913462 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Jul 18 02:09:26.913462 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Jul 18 02:09:26.913462 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:09:26.913462 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:09:26.913462 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:09:26.913462 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:09:26.913462 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:09:26.913462 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:09:26.914789 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:09:26.914789 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:09:26.914789 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:09:26.914789 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:09:26.914789 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:09:26.914789 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:09:26.914789 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:09:26.914789 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:09:26.914789 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 18 02:09:26.914789 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:26.914789 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:26.914789 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:26.914789 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:26.914789 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:26.914789 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:26.914789 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:09:26.914789 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:09:26.914789 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 18 02:09:26.914789 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:26.921038 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-708053a2-10ef-4671-b370-13512bd87480 tempest-HypervisorAdminNegativeTestJSON-1466552766 tempest-HypervisorAdminNegativeTestJSON-1466552766-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:09:26.921038 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-708053a2-10ef-4671-b370-13512bd87480 tempest-HypervisorAdminNegativeTestJSON-1466552766 tempest-HypervisorAdminNegativeTestJSON-1466552766-project] 10.222.0.57 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.019131 Jul 18 02:09:26.921038 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 253/489] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:09:26 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:09:26.924843 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cdb0b45c-b7b0-4b4c-bcce-ce4e0a4f7611 tempest-HypervisorAdminNegativeTestJSON-1466552766 tempest-HypervisorAdminNegativeTestJSON-1466552766-project] Calling method '.version_select at 0x7ff4a90ff160>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:26.925627 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:26.925627 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:09:26.926788 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cdb0b45c-b7b0-4b4c-bcce-ce4e0a4f7611 tempest-HypervisorAdminNegativeTestJSON-1466552766 tempest-HypervisorAdminNegativeTestJSON-1466552766-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '04779b594fcf43a58d7273a260f03488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b946638b0e4949059908e0c29a0b15e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:26.928446 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cdb0b45c-b7b0-4b4c-bcce-ce4e0a4f7611 tempest-HypervisorAdminNegativeTestJSON-1466552766 tempest-HypervisorAdminNegativeTestJSON-1466552766-project] Request method failure captured: Jul 18 02:09:26.928446 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Jul 18 02:09:26.928446 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:09:26.928446 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:09:26.928446 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:09:26.928446 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:09:26.928446 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:09:26.928446 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:09:26.928446 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:09:26.928446 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:09:26.928446 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MDVV7nlXT8aGKsMpRL2hoVhi49OFwzLqMRJG1yE1S11GvqQmjoyjyGcUrZvzQbO2lt-vUZhz3c_JKK5LmqcaUTQKamEFKMOnJ73SYEl3BsBaWmi2jS3jgvF37ELQaSp01zXBoaAi5vOiF1hCQI5dtBKLBTkTuPnGXck-YhY5S42Cuk Jul 18 02:09:26.928446 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:09:26.928446 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:09:26.928446 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:09:26.928446 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:09:26.928446 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:09:26.928446 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:09:26.928446 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: b946638b0e4949059908e0c29a0b15e5 Jul 18 02:09:26.928446 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1466552766 Jul 18 02:09:26.928446 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:09:26.928446 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:09:26.929677 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b946638b0e4949059908e0c29a0b15e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b946638b0e4949059908e0c29a0b15e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b946638b0e4949059908e0c29a0b15e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b946638b0e4949059908e0c29a0b15e5"}]}] Jul 18 02:09:26.929677 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1466552766 Jul 18 02:09:26.929677 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: b946638b0e4949059908e0c29a0b15e5 Jul 18 02:09:26.929677 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1466552766 Jul 18 02:09:26.929677 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-HypervisorAdminNegativeTestJSON-1466552766-project Jul 18 02:09:26.929677 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:09:26.929677 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:09:26.929677 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 04779b594fcf43a58d7273a260f03488 Jul 18 02:09:26.929677 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1466552766-project Jul 18 02:09:26.929677 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:09:26.929677 n-d-465891-3 devstack@n-api.service[119543]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 18 02:09:26.929677 n-d-465891-3 devstack@n-api.service[119543]: action_args: {} Jul 18 02:09:26.929677 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:09:26.930535 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:26.930535 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:26.930535 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:26.930535 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:09:26.930535 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:09:26.930535 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:09:26.930535 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:09:26.930535 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:09:26.930535 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:09:26.930535 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Jul 18 02:09:26.930535 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Jul 18 02:09:26.930535 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:09:26.930535 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:09:26.930535 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:09:26.930535 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:09:26.930535 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:09:26.930535 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:09:26.930535 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:09:26.930535 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:09:26.931917 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:09:26.931917 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:09:26.931917 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:09:26.931917 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:09:26.931917 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:09:26.931917 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:09:26.931917 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 18 02:09:26.931917 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:26.931917 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:26.931917 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:26.931917 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:26.931917 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:26.931917 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:26.931917 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:09:26.931917 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:09:26.931917 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 18 02:09:26.931917 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:26.933008 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cdb0b45c-b7b0-4b4c-bcce-ce4e0a4f7611 tempest-HypervisorAdminNegativeTestJSON-1466552766 tempest-HypervisorAdminNegativeTestJSON-1466552766-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:09:26.933008 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cdb0b45c-b7b0-4b4c-bcce-ce4e0a4f7611 tempest-HypervisorAdminNegativeTestJSON-1466552766 tempest-HypervisorAdminNegativeTestJSON-1466552766-project] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.009308 Jul 18 02:09:26.933008 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 254/490] 10.222.0.57 () {58 vars in 1178 bytes} [Mon Jul 18 02:09:26 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:09:26.949183 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-063879ff-358e-45eb-a0a6-32365d36408d tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:26.969152 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-063879ff-358e-45eb-a0a6-32365d36408d tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877" status: 200 len: 1324 microversion: 2.1 time: 0.789455 Jul 18 02:09:26.973867 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 237/491] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:26 2022] GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877 => generated 1324 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:27.100092 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-61bd0205-789d-4245-aa2f-c6a71f6c5caa tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:27.100807 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-61bd0205-789d-4245-aa2f-c6a71f6c5caa tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:27.131368 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-61bd0205-789d-4245-aa2f-c6a71f6c5caa tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:27.131765 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-61bd0205-789d-4245-aa2f-c6a71f6c5caa tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:27.134246 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-61bd0205-789d-4245-aa2f-c6a71f6c5caa tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:27.134691 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-61bd0205-789d-4245-aa2f-c6a71f6c5caa tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:27.199216 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:09:27.233909 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=12 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:09:27.238761 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7e282557-c42e-4bcc-967e-65f2fddc0bf7 tempest-HypervisorAdminNegativeTestJSON-701954883 tempest-HypervisorAdminNegativeTestJSON-701954883-project-admin] Calling method '.version_select at 0x7ff4a91cb9d0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:27.242259 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7e282557-c42e-4bcc-967e-65f2fddc0bf7 tempest-HypervisorAdminNegativeTestJSON-701954883 tempest-HypervisorAdminNegativeTestJSON-701954883-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:27.242932 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7e282557-c42e-4bcc-967e-65f2fddc0bf7 tempest-HypervisorAdminNegativeTestJSON-701954883 tempest-HypervisorAdminNegativeTestJSON-701954883-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:27.260376 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7e282557-c42e-4bcc-967e-65f2fddc0bf7 tempest-HypervisorAdminNegativeTestJSON-701954883 tempest-HypervisorAdminNegativeTestJSON-701954883-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:27.261743 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7e282557-c42e-4bcc-967e-65f2fddc0bf7 tempest-HypervisorAdminNegativeTestJSON-701954883 tempest-HypervisorAdminNegativeTestJSON-701954883-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:27.279702 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7e282557-c42e-4bcc-967e-65f2fddc0bf7 tempest-HypervisorAdminNegativeTestJSON-701954883 tempest-HypervisorAdminNegativeTestJSON-701954883-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:27.280796 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7e282557-c42e-4bcc-967e-65f2fddc0bf7 tempest-HypervisorAdminNegativeTestJSON-701954883 tempest-HypervisorAdminNegativeTestJSON-701954883-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:27.291194 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7e282557-c42e-4bcc-967e-65f2fddc0bf7 tempest-HypervisorAdminNegativeTestJSON-701954883 tempest-HypervisorAdminNegativeTestJSON-701954883-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.355244 Jul 18 02:09:27.291887 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 255/492] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:09:26 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:27.298256 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6a271a3d-33b0-42c7-be79-46890634748c tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:27.299256 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6a271a3d-33b0-42c7-be79-46890634748c tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: f77b267e-9a20-4943-aa8b-0c82b9d6d20e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:27.307817 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a271a3d-33b0-42c7-be79-46890634748c tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:27.308501 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a271a3d-33b0-42c7-be79-46890634748c tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:27.309562 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a271a3d-33b0-42c7-be79-46890634748c tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:27.310067 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a271a3d-33b0-42c7-be79-46890634748c tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:27.322804 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-61bd0205-789d-4245-aa2f-c6a71f6c5caa tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:27.332215 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-61bd0205-789d-4245-aa2f-c6a71f6c5caa tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:27.333722 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-61bd0205-789d-4245-aa2f-c6a71f6c5caa tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:27.349622 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-61bd0205-789d-4245-aa2f-c6a71f6c5caa tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] 10.222.0.57 "GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 200 len: 1447 microversion: 2.75 time: 0.254357 Jul 18 02:09:27.365259 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 238/493] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:09:27 2022] GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 1447 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:09:27.376551 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-012e2853-e4c7-4f05-9303-8cce595b8252 tempest-HypervisorAdminNegativeTestJSON-1466552766 tempest-HypervisorAdminNegativeTestJSON-1466552766-project] Calling method '.version_select at 0x7ff4a90dec10>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:27.377629 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:27.377629 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:09:27.378855 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-012e2853-e4c7-4f05-9303-8cce595b8252 tempest-HypervisorAdminNegativeTestJSON-1466552766 tempest-HypervisorAdminNegativeTestJSON-1466552766-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '04779b594fcf43a58d7273a260f03488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b946638b0e4949059908e0c29a0b15e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:27.380491 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-012e2853-e4c7-4f05-9303-8cce595b8252 tempest-HypervisorAdminNegativeTestJSON-1466552766 tempest-HypervisorAdminNegativeTestJSON-1466552766-project] Request method failure captured: Jul 18 02:09:27.380491 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Jul 18 02:09:27.380491 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:09:27.380491 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:09:27.380491 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:09:27.380491 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:09:27.380491 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:09:27.380491 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:09:27.380491 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:09:27.380491 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:09:27.380491 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MDVV7nlXT8aGKsMpRL2hoVhi49OFwzLqMRJG1yE1S11GvqQmjoyjyGcUrZvzQbO2lt-vUZhz3c_JKK5LmqcaUTQKamEFKMOnJ73SYEl3BsBaWmi2jS3jgvF37ELQaSp01zXBoaAi5vOiF1hCQI5dtBKLBTkTuPnGXck-YhY5S42Cuk Jul 18 02:09:27.380491 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:09:27.380491 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:09:27.380491 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:09:27.380491 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:09:27.380491 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:09:27.380491 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:09:27.380491 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: b946638b0e4949059908e0c29a0b15e5 Jul 18 02:09:27.380491 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1466552766 Jul 18 02:09:27.380491 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:09:27.380491 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:09:27.381781 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b946638b0e4949059908e0c29a0b15e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b946638b0e4949059908e0c29a0b15e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b946638b0e4949059908e0c29a0b15e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b946638b0e4949059908e0c29a0b15e5"}]}] Jul 18 02:09:27.381781 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1466552766 Jul 18 02:09:27.381781 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: b946638b0e4949059908e0c29a0b15e5 Jul 18 02:09:27.381781 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1466552766 Jul 18 02:09:27.381781 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-HypervisorAdminNegativeTestJSON-1466552766-project Jul 18 02:09:27.381781 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:09:27.381781 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:09:27.381781 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 04779b594fcf43a58d7273a260f03488 Jul 18 02:09:27.381781 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1466552766-project Jul 18 02:09:27.381781 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:09:27.381781 n-d-465891-3 devstack@n-api.service[119544]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 18 02:09:27.381781 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '1'} Jul 18 02:09:27.381781 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:09:27.382617 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:27.382617 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:27.382617 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:27.382617 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:09:27.382617 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:09:27.382617 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:09:27.382617 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:09:27.382617 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:09:27.382617 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:09:27.382617 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Jul 18 02:09:27.382617 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Jul 18 02:09:27.382617 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:09:27.382617 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:09:27.382617 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:09:27.382617 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:09:27.382617 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:09:27.382617 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:09:27.382617 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:09:27.382617 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:09:27.383701 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:09:27.383701 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:09:27.383701 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:09:27.383701 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:09:27.383701 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:09:27.383701 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:09:27.383701 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 18 02:09:27.383701 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:27.383701 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:27.383701 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:27.383701 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:27.383701 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:27.383701 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:27.383701 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:09:27.383701 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:09:27.383701 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 18 02:09:27.383701 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:27.389720 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-012e2853-e4c7-4f05-9303-8cce595b8252 tempest-HypervisorAdminNegativeTestJSON-1466552766 tempest-HypervisorAdminNegativeTestJSON-1466552766-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:09:27.390810 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-012e2853-e4c7-4f05-9303-8cce595b8252 tempest-HypervisorAdminNegativeTestJSON-1466552766 tempest-HypervisorAdminNegativeTestJSON-1466552766-project] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.024392 Jul 18 02:09:27.391487 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 239/494] 10.222.0.57 () {58 vars in 1172 bytes} [Mon Jul 18 02:09:27 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:09:27.400914 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7926bfc4-1adc-4353-9677-7ced527f422f tempest-HypervisorAdminNegativeTestJSON-701954883 tempest-HypervisorAdminNegativeTestJSON-701954883-project-admin] Calling method '.version_select at 0x7ff4a9054ee0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:27.408207 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-7926bfc4-1adc-4353-9677-7ced527f422f tempest-HypervisorAdminNegativeTestJSON-701954883 tempest-HypervisorAdminNegativeTestJSON-701954883-project-admin] HTTP exception thrown: Hypervisor with ID '40386400-0ed2-43c5-aeaa-4e8f1cb34a89' could not be found. Jul 18 02:09:27.411722 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7926bfc4-1adc-4353-9677-7ced527f422f tempest-HypervisorAdminNegativeTestJSON-701954883 tempest-HypervisorAdminNegativeTestJSON-701954883-project-admin] Request method failure captured: Jul 18 02:09:27.411722 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/os-hypervisors/40386400-0ed2-43c5-aeaa-4e8f1cb34a89/uptime HTTP/1.1 Jul 18 02:09:27.411722 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:09:27.411722 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:09:27.411722 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:09:27.411722 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:09:27.411722 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:09:27.411722 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:09:27.411722 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:09:27.411722 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:09:27.411722 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MDWVyzR-1c20CPMG_fZBmPXL9EJc9uXbILN6evc-PasLOQEwWA3xd0MHyUPUmbSi_Ewwr0JhDzKYq4YsOss2dJpaZeoGz-BK1oV_NDDTsPAhvF8mqFzAS1q_zNMqnlEkglbisTt-SIml0Q57Z-HwmuMZiq4RiXQ5wtn2num41U2rPA Jul 18 02:09:27.411722 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:09:27.411722 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:09:27.411722 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:09:27.411722 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:09:27.411722 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:09:27.411722 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:09:27.411722 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 403378709b024e6fa508741ca3bf67d4 Jul 18 02:09:27.411722 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-701954883 Jul 18 02:09:27.411722 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,admin,reader Jul 18 02:09:27.411722 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,admin,reader Jul 18 02:09:27.413035 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_403378709b024e6fa508741ca3bf67d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/403378709b024e6fa508741ca3bf67d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/403378709b024e6fa508741ca3bf67d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/403378709b024e6fa508741ca3bf67d4"}]}] Jul 18 02:09:27.413035 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-701954883 Jul 18 02:09:27.413035 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 403378709b024e6fa508741ca3bf67d4 Jul 18 02:09:27.413035 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-701954883 Jul 18 02:09:27.413035 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-HypervisorAdminNegativeTestJSON-701954883-project-admin Jul 18 02:09:27.413035 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:09:27.413035 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:09:27.413035 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: adb957eeb93d4bdcb4aae6e085d71e9e Jul 18 02:09:27.413035 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-701954883-project-admin Jul 18 02:09:27.413035 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:09:27.413035 n-d-465891-3 devstack@n-api.service[119544]: exception: Hypervisor with ID '40386400-0ed2-43c5-aeaa-4e8f1cb34a89' could not be found. Jul 18 02:09:27.413035 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '40386400-0ed2-43c5-aeaa-4e8f1cb34a89'} Jul 18 02:09:27.413766 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:09:27.413766 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:27.413766 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 18 02:09:27.413766 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 18 02:09:27.413766 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '40386400-0ed2-43c5-aeaa-4e8f1cb34a89' Jul 18 02:09:27.413766 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:27.413766 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:27.413766 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:27.413766 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:27.413766 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 18 02:09:27.413766 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 18 02:09:27.413766 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 18 02:09:27.413766 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 18 02:09:27.413766 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 18 02:09:27.413766 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:27.413766 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:27.413766 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:27.413766 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:27.413766 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 18 02:09:27.413766 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 18 02:09:27.413766 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 18 02:09:27.413766 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 18 02:09:27.415061 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 18 02:09:27.415061 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:27.415061 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:27.415061 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:27.415061 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:27.415061 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:27.415061 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:27.415061 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:09:27.415061 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:09:27.415061 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:09:27.415061 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:09:27.415061 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:09:27.415061 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:09:27.415061 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Jul 18 02:09:27.415061 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 18 02:09:27.415061 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 18 02:09:27.415061 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 18 02:09:27.415061 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '40386400-0ed2-43c5-aeaa-4e8f1cb34a89' could not be found. Jul 18 02:09:27.415061 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:27.415061 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:27.415061 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:27.416416 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:27.416416 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:27.416416 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:27.416416 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:09:27.416416 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:09:27.416416 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '40386400-0ed2-43c5-aeaa-4e8f1cb34a89' could not be found. Jul 18 02:09:27.416416 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:27.416416 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7926bfc4-1adc-4353-9677-7ced527f422f tempest-HypervisorAdminNegativeTestJSON-701954883 tempest-HypervisorAdminNegativeTestJSON-701954883-project-admin] Returning 404 to user: Hypervisor with ID '40386400-0ed2-43c5-aeaa-4e8f1cb34a89' could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:09:27.416416 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7926bfc4-1adc-4353-9677-7ced527f422f tempest-HypervisorAdminNegativeTestJSON-701954883 tempest-HypervisorAdminNegativeTestJSON-701954883-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/40386400-0ed2-43c5-aeaa-4e8f1cb34a89/uptime" status: 404 len: 123 microversion: 2.1 time: 0.016155 Jul 18 02:09:27.416416 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 240/495] 10.222.0.57 () {58 vars in 1277 bytes} [Mon Jul 18 02:09:27 2022] GET /compute/v2.1/os-hypervisors/40386400-0ed2-43c5-aeaa-4e8f1cb34a89/uptime => generated 123 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:09:27.429483 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3021c6dd-8d9a-41e5-aab5-76b95ac3cb92 tempest-HypervisorAdminNegativeTestJSON-701954883 tempest-HypervisorAdminNegativeTestJSON-701954883-project-admin] Calling method '.version_select at 0x7ff4abd49820>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:27.430367 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:27.430367 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:09:27.431688 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3021c6dd-8d9a-41e5-aab5-76b95ac3cb92 tempest-HypervisorAdminNegativeTestJSON-701954883 tempest-HypervisorAdminNegativeTestJSON-701954883-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:27.431977 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3021c6dd-8d9a-41e5-aab5-76b95ac3cb92 tempest-HypervisorAdminNegativeTestJSON-701954883 tempest-HypervisorAdminNegativeTestJSON-701954883-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:27.447474 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3021c6dd-8d9a-41e5-aab5-76b95ac3cb92 tempest-HypervisorAdminNegativeTestJSON-701954883 tempest-HypervisorAdminNegativeTestJSON-701954883-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:27.447923 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3021c6dd-8d9a-41e5-aab5-76b95ac3cb92 tempest-HypervisorAdminNegativeTestJSON-701954883 tempest-HypervisorAdminNegativeTestJSON-701954883-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:27.460385 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3021c6dd-8d9a-41e5-aab5-76b95ac3cb92 tempest-HypervisorAdminNegativeTestJSON-701954883 tempest-HypervisorAdminNegativeTestJSON-701954883-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:27.460832 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3021c6dd-8d9a-41e5-aab5-76b95ac3cb92 tempest-HypervisorAdminNegativeTestJSON-701954883 tempest-HypervisorAdminNegativeTestJSON-701954883-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:27.468259 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3021c6dd-8d9a-41e5-aab5-76b95ac3cb92 tempest-HypervisorAdminNegativeTestJSON-701954883 tempest-HypervisorAdminNegativeTestJSON-701954883-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.048115 Jul 18 02:09:27.469211 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 241/496] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:09:27 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:27.482275 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3b72ac14-daf8-4d73-8614-964c5795765f tempest-HypervisorAdminNegativeTestJSON-1466552766 tempest-HypervisorAdminNegativeTestJSON-1466552766-project] Calling method '.version_select at 0x7ff4a90deca0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:27.483409 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:27.483409 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:09:27.486446 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3b72ac14-daf8-4d73-8614-964c5795765f tempest-HypervisorAdminNegativeTestJSON-1466552766 tempest-HypervisorAdminNegativeTestJSON-1466552766-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '04779b594fcf43a58d7273a260f03488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b946638b0e4949059908e0c29a0b15e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:27.490275 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3b72ac14-daf8-4d73-8614-964c5795765f tempest-HypervisorAdminNegativeTestJSON-1466552766 tempest-HypervisorAdminNegativeTestJSON-1466552766-project] Request method failure captured: Jul 18 02:09:27.490275 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Jul 18 02:09:27.490275 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:09:27.490275 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:09:27.490275 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:09:27.490275 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:09:27.490275 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:09:27.490275 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:09:27.490275 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:09:27.490275 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:09:27.490275 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MDVV7nlXT8aGKsMpRL2hoVhi49OFwzLqMRJG1yE1S11GvqQmjoyjyGcUrZvzQbO2lt-vUZhz3c_JKK5LmqcaUTQKamEFKMOnJ73SYEl3BsBaWmi2jS3jgvF37ELQaSp01zXBoaAi5vOiF1hCQI5dtBKLBTkTuPnGXck-YhY5S42Cuk Jul 18 02:09:27.490275 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:09:27.490275 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:09:27.490275 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:09:27.490275 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:09:27.490275 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:09:27.490275 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:09:27.490275 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: b946638b0e4949059908e0c29a0b15e5 Jul 18 02:09:27.490275 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1466552766 Jul 18 02:09:27.490275 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:09:27.490275 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:09:27.491699 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b946638b0e4949059908e0c29a0b15e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b946638b0e4949059908e0c29a0b15e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b946638b0e4949059908e0c29a0b15e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b946638b0e4949059908e0c29a0b15e5"}]}] Jul 18 02:09:27.491699 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1466552766 Jul 18 02:09:27.491699 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: b946638b0e4949059908e0c29a0b15e5 Jul 18 02:09:27.491699 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1466552766 Jul 18 02:09:27.491699 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-HypervisorAdminNegativeTestJSON-1466552766-project Jul 18 02:09:27.491699 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:09:27.491699 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:09:27.491699 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 04779b594fcf43a58d7273a260f03488 Jul 18 02:09:27.491699 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1466552766-project Jul 18 02:09:27.491699 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:09:27.491699 n-d-465891-3 devstack@n-api.service[119544]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 18 02:09:27.491699 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '1'} Jul 18 02:09:27.491699 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:09:27.492520 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:27.492520 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:27.492520 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:27.492520 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:09:27.492520 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:09:27.492520 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:09:27.492520 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:09:27.492520 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:09:27.492520 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:09:27.492520 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 18 02:09:27.492520 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 18 02:09:27.492520 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Jul 18 02:09:27.492520 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Jul 18 02:09:27.492520 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:09:27.492520 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:09:27.492520 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:09:27.492520 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:09:27.492520 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:09:27.492520 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:09:27.493574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:09:27.493574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:09:27.493574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:09:27.493574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:09:27.493574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:09:27.493574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:09:27.493574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:09:27.493574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:09:27.493574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 18 02:09:27.493574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:27.493574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:27.493574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:27.493574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:27.493574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:27.493574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:27.493574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:09:27.493574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:09:27.493574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 18 02:09:27.493574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:27.495766 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3b72ac14-daf8-4d73-8614-964c5795765f tempest-HypervisorAdminNegativeTestJSON-1466552766 tempest-HypervisorAdminNegativeTestJSON-1466552766-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:09:27.496598 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3b72ac14-daf8-4d73-8614-964c5795765f tempest-HypervisorAdminNegativeTestJSON-1466552766 tempest-HypervisorAdminNegativeTestJSON-1466552766-project] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.021204 Jul 18 02:09:27.497540 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 242/497] 10.222.0.57 () {58 vars in 1151 bytes} [Mon Jul 18 02:09:27 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:09:27.508348 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-60981136-e7c1-49fe-b6e5-43f03bd296e9 tempest-HypervisorAdminNegativeTestJSON-701954883 tempest-HypervisorAdminNegativeTestJSON-701954883-project-admin] Calling method '.version_select at 0x7ff4a90cd430>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:27.511159 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-60981136-e7c1-49fe-b6e5-43f03bd296e9 tempest-HypervisorAdminNegativeTestJSON-701954883 tempest-HypervisorAdminNegativeTestJSON-701954883-project-admin] HTTP exception thrown: Hypervisor with ID 'c9251bf4-2d36-4764-ae09-cfa841b1a42e' could not be found. Jul 18 02:09:27.514195 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-60981136-e7c1-49fe-b6e5-43f03bd296e9 tempest-HypervisorAdminNegativeTestJSON-701954883 tempest-HypervisorAdminNegativeTestJSON-701954883-project-admin] Request method failure captured: Jul 18 02:09:27.514195 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/os-hypervisors/c9251bf4-2d36-4764-ae09-cfa841b1a42e HTTP/1.1 Jul 18 02:09:27.514195 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:09:27.514195 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:09:27.514195 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:09:27.514195 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:09:27.514195 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:09:27.514195 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:09:27.514195 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:09:27.514195 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:09:27.514195 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MDWVyzR-1c20CPMG_fZBmPXL9EJc9uXbILN6evc-PasLOQEwWA3xd0MHyUPUmbSi_Ewwr0JhDzKYq4YsOss2dJpaZeoGz-BK1oV_NDDTsPAhvF8mqFzAS1q_zNMqnlEkglbisTt-SIml0Q57Z-HwmuMZiq4RiXQ5wtn2num41U2rPA Jul 18 02:09:27.514195 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:09:27.514195 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:09:27.514195 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:09:27.514195 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:09:27.514195 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:09:27.514195 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:09:27.514195 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 403378709b024e6fa508741ca3bf67d4 Jul 18 02:09:27.514195 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-701954883 Jul 18 02:09:27.514195 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,admin,reader Jul 18 02:09:27.514195 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,admin,reader Jul 18 02:09:27.515495 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_403378709b024e6fa508741ca3bf67d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/403378709b024e6fa508741ca3bf67d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/403378709b024e6fa508741ca3bf67d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/403378709b024e6fa508741ca3bf67d4"}]}] Jul 18 02:09:27.515495 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-701954883 Jul 18 02:09:27.515495 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 403378709b024e6fa508741ca3bf67d4 Jul 18 02:09:27.515495 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-701954883 Jul 18 02:09:27.515495 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-HypervisorAdminNegativeTestJSON-701954883-project-admin Jul 18 02:09:27.515495 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:09:27.515495 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:09:27.515495 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: adb957eeb93d4bdcb4aae6e085d71e9e Jul 18 02:09:27.515495 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-701954883-project-admin Jul 18 02:09:27.515495 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:09:27.515495 n-d-465891-3 devstack@n-api.service[119544]: exception: Hypervisor with ID 'c9251bf4-2d36-4764-ae09-cfa841b1a42e' could not be found. Jul 18 02:09:27.515495 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'c9251bf4-2d36-4764-ae09-cfa841b1a42e'} Jul 18 02:09:27.516308 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:09:27.516308 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:27.516308 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 18 02:09:27.516308 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 18 02:09:27.516308 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'c9251bf4-2d36-4764-ae09-cfa841b1a42e' Jul 18 02:09:27.516308 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:27.516308 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:27.516308 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:27.516308 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:27.516308 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 18 02:09:27.516308 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 18 02:09:27.516308 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 18 02:09:27.516308 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 18 02:09:27.516308 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 18 02:09:27.516308 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:27.516308 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:27.516308 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:27.516308 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:27.516308 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 18 02:09:27.516308 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 18 02:09:27.516308 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 18 02:09:27.516308 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 18 02:09:27.521495 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 18 02:09:27.521495 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:27.521495 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:27.521495 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:27.521495 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:27.521495 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:27.521495 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:27.521495 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:09:27.521495 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:09:27.521495 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:09:27.521495 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:09:27.521495 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:09:27.521495 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:09:27.521495 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 18 02:09:27.521495 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 18 02:09:27.521495 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Jul 18 02:09:27.521495 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 18 02:09:27.521495 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 18 02:09:27.521495 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 18 02:09:27.521495 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'c9251bf4-2d36-4764-ae09-cfa841b1a42e' could not be found. Jul 18 02:09:27.525582 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:27.525582 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:27.525582 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:27.525582 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:27.525582 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:27.525582 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:27.525582 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:09:27.525582 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:09:27.525582 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'c9251bf4-2d36-4764-ae09-cfa841b1a42e' could not be found. Jul 18 02:09:27.525582 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:27.525582 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-60981136-e7c1-49fe-b6e5-43f03bd296e9 tempest-HypervisorAdminNegativeTestJSON-701954883 tempest-HypervisorAdminNegativeTestJSON-701954883-project-admin] Returning 404 to user: Hypervisor with ID 'c9251bf4-2d36-4764-ae09-cfa841b1a42e' could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:09:27.525582 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-60981136-e7c1-49fe-b6e5-43f03bd296e9 tempest-HypervisorAdminNegativeTestJSON-701954883 tempest-HypervisorAdminNegativeTestJSON-701954883-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/c9251bf4-2d36-4764-ae09-cfa841b1a42e" status: 404 len: 123 microversion: 2.1 time: 0.011861 Jul 18 02:09:27.525582 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 243/498] 10.222.0.57 () {58 vars in 1256 bytes} [Mon Jul 18 02:09:27 2022] GET /compute/v2.1/os-hypervisors/c9251bf4-2d36-4764-ae09-cfa841b1a42e => generated 123 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:09:27.569429 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6a271a3d-33b0-42c7-be79-46890634748c tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60118d593f96437dbb2c68ad2fadd465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd02ce642caf4529a6e65c184de0ad19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:27.577338 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6a271a3d-33b0-42c7-be79-46890634748c tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e" status: 200 len: 1386 microversion: 2.1 time: 0.283829 Jul 18 02:09:27.579430 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 256/499] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:27 2022] GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e => generated 1386 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:27.903839 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b2e030e6-72ab-4f37-8a40-f62a199c01bf tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a90dedc0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:27.991849 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-47af2a5d-da2f-4a9c-b463-c91217013c89 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:27.992538 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-47af2a5d-da2f-4a9c-b463-c91217013c89 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: bd14a732-a9ad-4dfd-af61-69b84eda8877] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:27.996092 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b2e030e6-72ab-4f37-8a40-f62a199c01bf tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a" status: 200 len: 1410 microversion: 2.1 time: 0.097977 Jul 18 02:09:27.997998 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 244/500] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:09:27 2022] GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a => generated 1410 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:28.010453 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-47af2a5d-da2f-4a9c-b463-c91217013c89 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:28.011258 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-47af2a5d-da2f-4a9c-b463-c91217013c89 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:28.013630 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-47af2a5d-da2f-4a9c-b463-c91217013c89 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:28.015442 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-47af2a5d-da2f-4a9c-b463-c91217013c89 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:28.288923 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e8280ba7-452d-407c-bfd2-93c95dbf2301 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1177511914", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:28.342139 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-47af2a5d-da2f-4a9c-b463-c91217013c89 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:28.353365 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-47af2a5d-da2f-4a9c-b463-c91217013c89 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877" status: 200 len: 1324 microversion: 2.1 time: 0.365414 Jul 18 02:09:28.365381 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 257/501] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:27 2022] GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877 => generated 1324 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:09:28.372079 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5ee377a7-28c5-417c-a9f4-e472549cffde tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:28.372875 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5ee377a7-28c5-417c-a9f4-e472549cffde tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:28.382157 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5ee377a7-28c5-417c-a9f4-e472549cffde tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:28.382877 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5ee377a7-28c5-417c-a9f4-e472549cffde tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:28.383968 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5ee377a7-28c5-417c-a9f4-e472549cffde tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:28.384624 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5ee377a7-28c5-417c-a9f4-e472549cffde tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:28.390135 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-e8280ba7-452d-407c-bfd2-93c95dbf2301 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] validate_networks() for None {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:09:28.508964 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5ee377a7-28c5-417c-a9f4-e472549cffde tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:28.535106 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5ee377a7-28c5-417c-a9f4-e472549cffde tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:28.540121 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5ee377a7-28c5-417c-a9f4-e472549cffde tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:28.551663 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5ee377a7-28c5-417c-a9f4-e472549cffde tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] 10.222.0.57 "GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 200 len: 1447 microversion: 2.75 time: 0.183353 Jul 18 02:09:28.557379 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 258/502] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:09:28 2022] GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 1447 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:09:28.597140 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-623914f5-33bb-440b-90df-3fad7da95cf4 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:28.598744 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-623914f5-33bb-440b-90df-3fad7da95cf4 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: f77b267e-9a20-4943-aa8b-0c82b9d6d20e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:28.609154 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-623914f5-33bb-440b-90df-3fad7da95cf4 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:28.610499 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-623914f5-33bb-440b-90df-3fad7da95cf4 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:28.611735 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-623914f5-33bb-440b-90df-3fad7da95cf4 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:28.612339 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-623914f5-33bb-440b-90df-3fad7da95cf4 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:28.873218 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-e8280ba7-452d-407c-bfd2-93c95dbf2301 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:09:28.873804 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-e8280ba7-452d-407c-bfd2-93c95dbf2301 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:09:28.874262 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-e8280ba7-452d-407c-bfd2-93c95dbf2301 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:09:28.874882 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-e8280ba7-452d-407c-bfd2-93c95dbf2301 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:09:28.876102 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-e8280ba7-452d-407c-bfd2-93c95dbf2301 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:09:28.892018 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e8280ba7-452d-407c-bfd2-93c95dbf2301 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:28.892826 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e8280ba7-452d-407c-bfd2-93c95dbf2301 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:28.894102 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e8280ba7-452d-407c-bfd2-93c95dbf2301 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:28.894718 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e8280ba7-452d-407c-bfd2-93c95dbf2301 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:28.942775 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-623914f5-33bb-440b-90df-3fad7da95cf4 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60118d593f96437dbb2c68ad2fadd465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd02ce642caf4529a6e65c184de0ad19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:28.956740 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-e8280ba7-452d-407c-bfd2-93c95dbf2301 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Getting quotas for project 37109e65d03f45c7be865364a9006ba6. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:09:28.958882 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-623914f5-33bb-440b-90df-3fad7da95cf4 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e" status: 200 len: 1386 microversion: 2.1 time: 0.367571 Jul 18 02:09:28.974737 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-e8280ba7-452d-407c-bfd2-93c95dbf2301 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Getting quotas for user efc0d0f9b4154bbbb7475009490b5998 and project 37109e65d03f45c7be865364a9006ba6. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:09:28.989609 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 259/503] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:28 2022] GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e => generated 1386 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:09:29.010335 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-72e924c1-a53f-4bb5-9d9a-f9ca067209d2 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a9135790>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:29.017289 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e8280ba7-452d-407c-bfd2-93c95dbf2301 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:09:29.029984 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e8280ba7-452d-407c-bfd2-93c95dbf2301 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:09:29.117925 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e8280ba7-452d-407c-bfd2-93c95dbf2301 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.085644 Jul 18 02:09:29.119740 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 245/504] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:09:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1089 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:09:29.126819 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-72e924c1-a53f-4bb5-9d9a-f9ca067209d2 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a" status: 200 len: 1410 microversion: 2.1 time: 0.107799 Jul 18 02:09:29.128652 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 260/505] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:09:29 2022] GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a => generated 1410 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:29.373646 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7ffce9d5-3c87-45a9-a98a-6f2c3e880ccd tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:29.374649 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7ffce9d5-3c87-45a9-a98a-6f2c3e880ccd tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: bd14a732-a9ad-4dfd-af61-69b84eda8877] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:29.388043 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7ffce9d5-3c87-45a9-a98a-6f2c3e880ccd tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:29.388500 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7ffce9d5-3c87-45a9-a98a-6f2c3e880ccd tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:29.389287 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7ffce9d5-3c87-45a9-a98a-6f2c3e880ccd tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:29.390619 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7ffce9d5-3c87-45a9-a98a-6f2c3e880ccd tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:29.447792 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a90f41b4-6ed6-4a41-8899-b3d60c5ab53e tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1998285604", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:29.560053 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-a90f41b4-6ed6-4a41-8899-b3d60c5ab53e tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] validate_networks() for None {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:09:29.993522 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-a90f41b4-6ed6-4a41-8899-b3d60c5ab53e tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:09:29.994516 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-a90f41b4-6ed6-4a41-8899-b3d60c5ab53e tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:09:29.995308 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-a90f41b4-6ed6-4a41-8899-b3d60c5ab53e tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:09:29.995723 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-a90f41b4-6ed6-4a41-8899-b3d60c5ab53e tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:09:29.996193 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-a90f41b4-6ed6-4a41-8899-b3d60c5ab53e tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:09:30.019229 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a90f41b4-6ed6-4a41-8899-b3d60c5ab53e tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:30.021060 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a90f41b4-6ed6-4a41-8899-b3d60c5ab53e tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:30.023107 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a90f41b4-6ed6-4a41-8899-b3d60c5ab53e tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:30.025400 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a90f41b4-6ed6-4a41-8899-b3d60c5ab53e tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:30.035057 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7ffce9d5-3c87-45a9-a98a-6f2c3e880ccd tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:30.043952 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7ffce9d5-3c87-45a9-a98a-6f2c3e880ccd tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877" status: 200 len: 1324 microversion: 2.1 time: 0.676254 Jul 18 02:09:30.056239 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 246/506] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:29 2022] GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877 => generated 1324 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:30.062703 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5e01fde1-e687-4e5a-a999-8238fe7af56b tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:30.064142 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5e01fde1-e687-4e5a-a999-8238fe7af56b tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:30.067587 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-a90f41b4-6ed6-4a41-8899-b3d60c5ab53e tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Getting quotas for project 37109e65d03f45c7be865364a9006ba6. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:09:30.071982 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5e01fde1-e687-4e5a-a999-8238fe7af56b tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:30.072667 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5e01fde1-e687-4e5a-a999-8238fe7af56b tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:30.073611 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5e01fde1-e687-4e5a-a999-8238fe7af56b tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:30.074426 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5e01fde1-e687-4e5a-a999-8238fe7af56b tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:30.077508 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-a90f41b4-6ed6-4a41-8899-b3d60c5ab53e tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Getting quotas for user efc0d0f9b4154bbbb7475009490b5998 and project 37109e65d03f45c7be865364a9006ba6. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:09:30.097985 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a90f41b4-6ed6-4a41-8899-b3d60c5ab53e tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:09:30.101742 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a90f41b4-6ed6-4a41-8899-b3d60c5ab53e tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: c3ac090d-3caa-404a-8f4d-5708f9fd04d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:09:30.182799 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5e01fde1-e687-4e5a-a999-8238fe7af56b tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:30.194767 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5e01fde1-e687-4e5a-a999-8238fe7af56b tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:30.197310 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5e01fde1-e687-4e5a-a999-8238fe7af56b tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:30.205629 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5e01fde1-e687-4e5a-a999-8238fe7af56b tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] 10.222.0.57 "GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 200 len: 1447 microversion: 2.75 time: 0.147971 Jul 18 02:09:30.206678 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 247/507] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:09:30 2022] GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 1447 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:09:30.216083 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b6343638-c86b-4a5d-904b-8816d9faeadc tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:30.218804 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b6343638-c86b-4a5d-904b-8816d9faeadc tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: f77b267e-9a20-4943-aa8b-0c82b9d6d20e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:30.233982 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a90f41b4-6ed6-4a41-8899-b3d60c5ab53e tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.790545 Jul 18 02:09:30.238190 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 261/508] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:09:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:09:30.246520 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b6a5c7d3-93d5-4e7f-a401-073186c83195 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a9135e50>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:30.252384 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6343638-c86b-4a5d-904b-8816d9faeadc tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:30.252851 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6343638-c86b-4a5d-904b-8816d9faeadc tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:30.254672 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6343638-c86b-4a5d-904b-8816d9faeadc tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:30.255418 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6343638-c86b-4a5d-904b-8816d9faeadc tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:30.356948 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b6a5c7d3-93d5-4e7f-a401-073186c83195 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a" status: 200 len: 1410 microversion: 2.1 time: 0.117141 Jul 18 02:09:30.361178 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 262/509] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:09:30 2022] GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a => generated 1410 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:30.372624 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0de45247-024b-4e21-ae86-caa9a9e3b200 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:30.373601 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0de45247-024b-4e21-ae86-caa9a9e3b200 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: c3ac090d-3caa-404a-8f4d-5708f9fd04d6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:30.471167 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b6343638-c86b-4a5d-904b-8816d9faeadc tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60118d593f96437dbb2c68ad2fadd465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd02ce642caf4529a6e65c184de0ad19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:30.483957 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b6343638-c86b-4a5d-904b-8816d9faeadc tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e" status: 200 len: 1386 microversion: 2.1 time: 0.275392 Jul 18 02:09:30.487599 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 248/510] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:30 2022] GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e => generated 1386 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:30.522065 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0de45247-024b-4e21-ae86-caa9a9e3b200 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:30.534230 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0de45247-024b-4e21-ae86-caa9a9e3b200 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/c3ac090d-3caa-404a-8f4d-5708f9fd04d6" status: 200 len: 1214 microversion: 2.1 time: 0.170236 Jul 18 02:09:30.535330 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 263/511] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:30 2022] GET /compute/v2.1/servers/c3ac090d-3caa-404a-8f4d-5708f9fd04d6 => generated 1214 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:31.061920 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3b1a3bbe-df7e-452a-a278-0a7309b84cca tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:31.063567 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3b1a3bbe-df7e-452a-a278-0a7309b84cca tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: bd14a732-a9ad-4dfd-af61-69b84eda8877] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:31.077770 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b1a3bbe-df7e-452a-a278-0a7309b84cca tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:31.086260 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b1a3bbe-df7e-452a-a278-0a7309b84cca tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:31.087963 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b1a3bbe-df7e-452a-a278-0a7309b84cca tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:31.096436 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b1a3bbe-df7e-452a-a278-0a7309b84cca tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:31.228492 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3b043db6-9069-4315-a11a-7495ae6a67fd tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:31.229437 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3b043db6-9069-4315-a11a-7495ae6a67fd tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:31.244451 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:09:31.253495 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3b043db6-9069-4315-a11a-7495ae6a67fd tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:31.254526 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3b043db6-9069-4315-a11a-7495ae6a67fd tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:31.259068 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3b043db6-9069-4315-a11a-7495ae6a67fd tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:31.260757 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3b043db6-9069-4315-a11a-7495ae6a67fd tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:31.533750 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3b043db6-9069-4315-a11a-7495ae6a67fd tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:31.551779 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3b043db6-9069-4315-a11a-7495ae6a67fd tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:31.559693 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3b043db6-9069-4315-a11a-7495ae6a67fd tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:31.565873 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3b043db6-9069-4315-a11a-7495ae6a67fd tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] 10.222.0.57 "GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 200 len: 1447 microversion: 2.75 time: 0.343277 Jul 18 02:09:31.579073 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 264/512] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:09:31 2022] GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 1447 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:09:31.585333 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5e36a54a-70f9-4218-9f61-01482e7aae62 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a90b19d0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:31.640008 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5e36a54a-70f9-4218-9f61-01482e7aae62 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a" status: 200 len: 1410 microversion: 2.1 time: 0.059096 Jul 18 02:09:31.641449 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 265/513] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:09:31 2022] GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a => generated 1410 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:31.646265 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-73e0f542-1e91-45d5-92f2-075f21ef2cdb tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:31.647139 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-73e0f542-1e91-45d5-92f2-075f21ef2cdb tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: f77b267e-9a20-4943-aa8b-0c82b9d6d20e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:31.654985 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-73e0f542-1e91-45d5-92f2-075f21ef2cdb tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:31.655771 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-73e0f542-1e91-45d5-92f2-075f21ef2cdb tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:31.657344 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-73e0f542-1e91-45d5-92f2-075f21ef2cdb tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:31.657988 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-73e0f542-1e91-45d5-92f2-075f21ef2cdb tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:32.055305 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3b1a3bbe-df7e-452a-a278-0a7309b84cca tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:32.091867 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3b1a3bbe-df7e-452a-a278-0a7309b84cca tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877" status: 200 len: 1324 microversion: 2.1 time: 1.034390 Jul 18 02:09:32.114092 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 249/514] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:31 2022] GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877 => generated 1324 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:32.126388 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-994d7955-184f-49f0-9214-326d23be427a tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:32.126931 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-994d7955-184f-49f0-9214-326d23be427a tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: c3ac090d-3caa-404a-8f4d-5708f9fd04d6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:32.144509 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-994d7955-184f-49f0-9214-326d23be427a tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:32.144971 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-994d7955-184f-49f0-9214-326d23be427a tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:32.155547 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-994d7955-184f-49f0-9214-326d23be427a tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:32.155999 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-994d7955-184f-49f0-9214-326d23be427a tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:32.476342 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-73e0f542-1e91-45d5-92f2-075f21ef2cdb tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60118d593f96437dbb2c68ad2fadd465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd02ce642caf4529a6e65c184de0ad19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:32.487315 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-73e0f542-1e91-45d5-92f2-075f21ef2cdb tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e" status: 200 len: 1386 microversion: 2.1 time: 0.844460 Jul 18 02:09:32.488363 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 266/515] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:31 2022] GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e => generated 1386 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:32.729822 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-994d7955-184f-49f0-9214-326d23be427a tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:32.743653 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-994d7955-184f-49f0-9214-326d23be427a tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/c3ac090d-3caa-404a-8f4d-5708f9fd04d6" status: 200 len: 1266 microversion: 2.1 time: 0.628289 Jul 18 02:09:32.744240 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 250/516] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:32 2022] GET /compute/v2.1/servers/c3ac090d-3caa-404a-8f4d-5708f9fd04d6 => generated 1266 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:32.759561 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9bd9a8de-5110-432a-bf4f-6c55de6b6393 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:32.760326 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9bd9a8de-5110-432a-bf4f-6c55de6b6393 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:32.774818 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9bd9a8de-5110-432a-bf4f-6c55de6b6393 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:32.776250 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9bd9a8de-5110-432a-bf4f-6c55de6b6393 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:32.777204 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9bd9a8de-5110-432a-bf4f-6c55de6b6393 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:32.777818 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9bd9a8de-5110-432a-bf4f-6c55de6b6393 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:32.983155 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cdb10ed2-d8aa-4186-9e5b-b3b6e8bb2237 tempest-KeyPairsV210TestJSON-407505270 tempest-KeyPairsV210TestJSON-407505270-project-admin] Action: 'create', calling method: .version_select at 0x7ff4a913e4c0>, body: {"keypair": {"name": "tempest-keypair-928534613", "type": "ssh", "user_id": "2599f3f53f5745ebbd8ad14b1fd9817f", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKo0OvW/bnULuWm7LlyTwRoRATw9ZF4eRmUb+UQ8tLi4eyBPfaO/zHZG5F+Gx2T8D0ElQec1AbA2B+C6sZPq9MU8DTW5CxtLhanxiIRZinIrze1iU6wvjq1JBQHUZ3H6Yg=="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:33.034146 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-cdb10ed2-d8aa-4186-9e5b-b3b6e8bb2237 tempest-KeyPairsV210TestJSON-407505270 tempest-KeyPairsV210TestJSON-407505270-project-admin] Getting quotas for project 9d34e675350247618ab09674619d0496. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:09:33.040686 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9bd9a8de-5110-432a-bf4f-6c55de6b6393 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:33.049427 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-cdb10ed2-d8aa-4186-9e5b-b3b6e8bb2237 tempest-KeyPairsV210TestJSON-407505270 tempest-KeyPairsV210TestJSON-407505270-project-admin] Getting quotas for user 32f06f2de33d4d048ac70a95d5d56a24 and project 9d34e675350247618ab09674619d0496. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:09:33.056515 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9bd9a8de-5110-432a-bf4f-6c55de6b6393 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:33.062253 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9bd9a8de-5110-432a-bf4f-6c55de6b6393 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:33.077965 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9bd9a8de-5110-432a-bf4f-6c55de6b6393 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] 10.222.0.57 "GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 200 len: 1447 microversion: 2.75 time: 0.322909 Jul 18 02:09:33.082005 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 251/517] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:09:32 2022] GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 1447 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:09:33.098035 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-10ff0fa7-cd7a-4f16-b8c1-86445a640a59 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a90cd1f0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:33.115546 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cdb10ed2-d8aa-4186-9e5b-b3b6e8bb2237 tempest-KeyPairsV210TestJSON-407505270 tempest-KeyPairsV210TestJSON-407505270-project-admin] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.623951 Jul 18 02:09:33.124875 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 267/518] 10.222.0.57 () {62 vars in 1199 bytes} [Mon Jul 18 02:09:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 636 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 18 02:09:33.131700 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-03342a49-def8-40e5-8ba2-ddadeb5758fe req-0f79bef6-051d-4772-b8fd-1bad61a0b490 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8aad28a-a3d8-48d3-8fc7-50d65ab4e768", "name": "network-vif-plugged", "status": "completed", "tag": "6783749f-f883-4783-9465-179735e0eeb7"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:33.152124 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-03342a49-def8-40e5-8ba2-ddadeb5758fe req-0f79bef6-051d-4772-b8fd-1bad61a0b490 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:33.153047 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-03342a49-def8-40e5-8ba2-ddadeb5758fe req-0f79bef6-051d-4772-b8fd-1bad61a0b490 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:33.162282 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:09:33.183601 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-03342a49-def8-40e5-8ba2-ddadeb5758fe req-0f79bef6-051d-4772-b8fd-1bad61a0b490 service nova] Creating event network-vif-plugged:6783749f-f883-4783-9465-179735e0eeb7 for instance d8aad28a-a3d8-48d3-8fc7-50d65ab4e768 on n-h1-465891-3 Jul 18 02:09:33.207365 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-03342a49-def8-40e5-8ba2-ddadeb5758fe req-0f79bef6-051d-4772-b8fd-1bad61a0b490 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080095 Jul 18 02:09:33.209955 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 268/519] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:33.222588 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9eb509df-e65d-4e11-bf23-6309f574577a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:33.223633 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9eb509df-e65d-4e11-bf23-6309f574577a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: bd14a732-a9ad-4dfd-af61-69b84eda8877] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:33.233692 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-10ff0fa7-cd7a-4f16-b8c1-86445a640a59 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a" status: 200 len: 1410 microversion: 2.1 time: 0.149337 Jul 18 02:09:33.235866 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 252/520] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:09:33 2022] GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a => generated 1410 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:33.242589 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9eb509df-e65d-4e11-bf23-6309f574577a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:33.242589 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9eb509df-e65d-4e11-bf23-6309f574577a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:33.243297 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9eb509df-e65d-4e11-bf23-6309f574577a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:33.243956 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9eb509df-e65d-4e11-bf23-6309f574577a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:33.251693 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4a36f3c7-cf21-4a12-998c-fc11adc12bf8 tempest-KeyPairsV210TestJSON-407505270 tempest-KeyPairsV210TestJSON-407505270-project-admin] Action: 'create', calling method: .version_select at 0x7ff4a9066f70>, body: {"keypair": {"name": "tempest-keypair-1788305842", "type": "ssh", "user_id": "2599f3f53f5745ebbd8ad14b1fd9817f", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMobvxuja0DVfflTrFuar8EOPF/Rjd3z32U1a/LTicYWhabzR3x5EJtTfA2PbHTCEhWVjSLuMoLP2GmsROELgQ9k19TKioyoh+GPVolA9WF7nruUtnDMqt96LLTwex9jYA=="}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:33.295023 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-4a36f3c7-cf21-4a12-998c-fc11adc12bf8 tempest-KeyPairsV210TestJSON-407505270 tempest-KeyPairsV210TestJSON-407505270-project-admin] Getting quotas for project 9d34e675350247618ab09674619d0496. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:09:33.312901 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-4a36f3c7-cf21-4a12-998c-fc11adc12bf8 tempest-KeyPairsV210TestJSON-407505270 tempest-KeyPairsV210TestJSON-407505270-project-admin] Getting quotas for user 32f06f2de33d4d048ac70a95d5d56a24 and project 9d34e675350247618ab09674619d0496. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:09:33.378428 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4a36f3c7-cf21-4a12-998c-fc11adc12bf8 tempest-KeyPairsV210TestJSON-407505270 tempest-KeyPairsV210TestJSON-407505270-project-admin] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.139850 Jul 18 02:09:33.382242 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 253/521] 10.222.0.57 () {62 vars in 1199 bytes} [Mon Jul 18 02:09:33 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 145 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 18 02:09:33.395814 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c9a8db3d-8d2a-4d5f-9abb-a22d0ee14f96 tempest-KeyPairsV210TestJSON-407505270 tempest-KeyPairsV210TestJSON-407505270-project-admin] Calling method '.version_select at 0x7ff4a90de700>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:33.404187 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c9a8db3d-8d2a-4d5f-9abb-a22d0ee14f96 tempest-KeyPairsV210TestJSON-407505270 tempest-KeyPairsV210TestJSON-407505270-project-admin] 10.222.0.57 "GET /compute/v2.1/os-keypairs/tempest-keypair-928534613?user_id=2599f3f53f5745ebbd8ad14b1fd9817f" status: 200 len: 511 microversion: 2.10 time: 0.018984 Jul 18 02:09:33.414425 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 254/522] 10.222.0.57 () {60 vars in 1336 bytes} [Mon Jul 18 02:09:33 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-928534613?user_id=2599f3f53f5745ebbd8ad14b1fd9817f => generated 511 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:09:33.419821 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-864b6148-7271-4bce-888b-eeed63afe846 tempest-KeyPairsV210TestJSON-407505270 tempest-KeyPairsV210TestJSON-407505270-project-admin] Action: 'create', calling method: .version_select at 0x7ff4a90de0d0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1774016947", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL726ZiNQaCDZvN1uPz2EbuTEzLmHoMsVn1mStIk6hXaUn1LcnOCLfBVmH5NOKdq+wYRcBoH9P0mn/9MxEDdbj9sqyJu6DYEXnOY9LAvTkPRVPMVYrZqUSQe9P3uvk2hFA=="}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:33.439832 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-864b6148-7271-4bce-888b-eeed63afe846 tempest-KeyPairsV210TestJSON-407505270 tempest-KeyPairsV210TestJSON-407505270-project-admin] Getting quotas for project 9d34e675350247618ab09674619d0496. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:09:33.447213 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-864b6148-7271-4bce-888b-eeed63afe846 tempest-KeyPairsV210TestJSON-407505270 tempest-KeyPairsV210TestJSON-407505270-project-admin] Getting quotas for user 32f06f2de33d4d048ac70a95d5d56a24 and project 9d34e675350247618ab09674619d0496. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:09:33.494435 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-864b6148-7271-4bce-888b-eeed63afe846 tempest-KeyPairsV210TestJSON-407505270 tempest-KeyPairsV210TestJSON-407505270-project-admin] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.078418 Jul 18 02:09:33.501209 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 255/523] 10.222.0.57 () {62 vars in 1199 bytes} [Mon Jul 18 02:09:33 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 86 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 18 02:09:33.508119 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fd318ea0-c744-4e6c-9bd4-83354ccdd1c6 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:33.509050 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fd318ea0-c744-4e6c-9bd4-83354ccdd1c6 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: f77b267e-9a20-4943-aa8b-0c82b9d6d20e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:33.517834 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd318ea0-c744-4e6c-9bd4-83354ccdd1c6 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:33.518992 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd318ea0-c744-4e6c-9bd4-83354ccdd1c6 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:33.520817 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd318ea0-c744-4e6c-9bd4-83354ccdd1c6 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:33.521472 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd318ea0-c744-4e6c-9bd4-83354ccdd1c6 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:34.073264 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9eb509df-e65d-4e11-bf23-6309f574577a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:34.082452 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9eb509df-e65d-4e11-bf23-6309f574577a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877" status: 200 len: 1324 microversion: 2.1 time: 0.871094 Jul 18 02:09:34.086129 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 269/524] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:33 2022] GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877 => generated 1324 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:34.099790 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-67d4583d-9f91-416d-97cd-905ba4e80acd tempest-KeyPairsV210TestJSON-407505270 tempest-KeyPairsV210TestJSON-407505270-project-admin] Calling method '.version_select at 0x7ff4a935d820>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:34.106926 n-d-465891-3 devstack@n-api.service[119543]: WARNING oslo_db.sqlalchemy.utils [None req-67d4583d-9f91-416d-97cd-905ba4e80acd tempest-KeyPairsV210TestJSON-407505270 tempest-KeyPairsV210TestJSON-407505270-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Jul 18 02:09:34.128807 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-67d4583d-9f91-416d-97cd-905ba4e80acd tempest-KeyPairsV210TestJSON-407505270 tempest-KeyPairsV210TestJSON-407505270-project-admin] 10.222.0.57 "GET /compute/v2.1/os-keypairs?user_id=2599f3f53f5745ebbd8ad14b1fd9817f" status: 200 len: 725 microversion: 2.10 time: 0.033248 Jul 18 02:09:34.135233 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 270/525] 10.222.0.57 () {60 vars in 1258 bytes} [Mon Jul 18 02:09:34 2022] GET /compute/v2.1/os-keypairs?user_id=2599f3f53f5745ebbd8ad14b1fd9817f => generated 725 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:09:34.140722 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-058fe43c-57ef-4fc9-aa15-32283c9c3b8c tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:34.146662 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-058fe43c-57ef-4fc9-aa15-32283c9c3b8c tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: c3ac090d-3caa-404a-8f4d-5708f9fd04d6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:34.159488 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-058fe43c-57ef-4fc9-aa15-32283c9c3b8c tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:34.160218 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-058fe43c-57ef-4fc9-aa15-32283c9c3b8c tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:34.165174 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-058fe43c-57ef-4fc9-aa15-32283c9c3b8c tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:34.165829 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-058fe43c-57ef-4fc9-aa15-32283c9c3b8c tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:34.349269 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-058fe43c-57ef-4fc9-aa15-32283c9c3b8c tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:34.368514 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fd318ea0-c744-4e6c-9bd4-83354ccdd1c6 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60118d593f96437dbb2c68ad2fadd465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd02ce642caf4529a6e65c184de0ad19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:34.373324 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-058fe43c-57ef-4fc9-aa15-32283c9c3b8c tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/c3ac090d-3caa-404a-8f4d-5708f9fd04d6" status: 200 len: 1272 microversion: 2.1 time: 0.236548 Jul 18 02:09:34.376912 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 271/526] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:34 2022] GET /compute/v2.1/servers/c3ac090d-3caa-404a-8f4d-5708f9fd04d6 => generated 1272 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:34.382395 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d8ce9acc-4346-4d65-b9d9-05e1b8b95a67 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:34.383237 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d8ce9acc-4346-4d65-b9d9-05e1b8b95a67 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:34.388563 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fd318ea0-c744-4e6c-9bd4-83354ccdd1c6 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e" status: 200 len: 1386 microversion: 2.1 time: 0.885686 Jul 18 02:09:34.389676 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 256/527] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:33 2022] GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e => generated 1386 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:34.405196 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-403f1651-0813-45bf-a448-e7f995bcd4ff tempest-KeyPairsV210TestJSON-407505270 tempest-KeyPairsV210TestJSON-407505270-project-admin] Calling method '.version_select at 0x7ff4a90cdd30>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:34.419413 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d8ce9acc-4346-4d65-b9d9-05e1b8b95a67 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:34.430454 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d8ce9acc-4346-4d65-b9d9-05e1b8b95a67 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:34.431504 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:09:34.432312 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d8ce9acc-4346-4d65-b9d9-05e1b8b95a67 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:34.432911 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d8ce9acc-4346-4d65-b9d9-05e1b8b95a67 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:34.473321 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-403f1651-0813-45bf-a448-e7f995bcd4ff tempest-KeyPairsV210TestJSON-407505270 tempest-KeyPairsV210TestJSON-407505270-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1774016947" status: 204 len: 0 microversion: 2.10 time: 0.082097 Jul 18 02:09:34.484690 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 257/528] 10.222.0.57 () {60 vars in 1324 bytes} [Mon Jul 18 02:09:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1774016947 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:09:34.495996 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-82dc1159-f42c-469e-a605-7c3c81e461b7 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a9054e50>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:34.616401 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-82dc1159-f42c-469e-a605-7c3c81e461b7 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a" status: 200 len: 1410 microversion: 2.1 time: 0.133500 Jul 18 02:09:34.620024 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 258/529] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:09:34 2022] GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a => generated 1410 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:34.651514 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d8ce9acc-4346-4d65-b9d9-05e1b8b95a67 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:34.667208 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d8ce9acc-4346-4d65-b9d9-05e1b8b95a67 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:34.668895 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d8ce9acc-4346-4d65-b9d9-05e1b8b95a67 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:34.696211 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d8ce9acc-4346-4d65-b9d9-05e1b8b95a67 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] 10.222.0.57 "GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 200 len: 1447 microversion: 2.75 time: 0.317487 Jul 18 02:09:34.696814 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 272/530] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:09:34 2022] GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 1447 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:09:34.703965 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-442eaa34-63bd-4dd5-8df7-06f965d861e9 tempest-KeyPairsV210TestJSON-407505270 tempest-KeyPairsV210TestJSON-407505270-project-admin] Calling method '.version_select at 0x7ff4a913eb80>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:34.741387 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-442eaa34-63bd-4dd5-8df7-06f965d861e9 tempest-KeyPairsV210TestJSON-407505270 tempest-KeyPairsV210TestJSON-407505270-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1788305842?user_id=2599f3f53f5745ebbd8ad14b1fd9817f" status: 204 len: 0 microversion: 2.10 time: 0.043372 Jul 18 02:09:34.741961 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 273/531] 10.222.0.57 () {60 vars in 1342 bytes} [Mon Jul 18 02:09:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1788305842?user_id=2599f3f53f5745ebbd8ad14b1fd9817f => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:09:34.754810 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-667fbf3d-f873-4119-b389-38e656aaf638 tempest-KeyPairsV210TestJSON-407505270 tempest-KeyPairsV210TestJSON-407505270-project-admin] Calling method '.version_select at 0x7ff4a90ff820>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:34.795388 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-667fbf3d-f873-4119-b389-38e656aaf638 tempest-KeyPairsV210TestJSON-407505270 tempest-KeyPairsV210TestJSON-407505270-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-928534613?user_id=2599f3f53f5745ebbd8ad14b1fd9817f" status: 204 len: 0 microversion: 2.10 time: 0.048615 Jul 18 02:09:34.798269 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 274/532] 10.222.0.57 () {60 vars in 1339 bytes} [Mon Jul 18 02:09:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-928534613?user_id=2599f3f53f5745ebbd8ad14b1fd9817f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:09:35.025478 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ee505d18-2674-4297-a9d8-157bd9f70fd4 tempest-InstanceUsageAuditLogTestJSON-2106113024 tempest-InstanceUsageAuditLogTestJSON-2106113024-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:35.026468 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:35.026468 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:09:35.093457 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ee505d18-2674-4297-a9d8-157bd9f70fd4 tempest-InstanceUsageAuditLogTestJSON-2106113024 tempest-InstanceUsageAuditLogTestJSON-2106113024-project-admin] 10.222.0.57 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-18 02:09:34" status: 200 len: 318 microversion: 2.1 time: 0.470423 Jul 18 02:09:35.099195 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 259/533] 10.222.0.57 () {58 vars in 1250 bytes} [Mon Jul 18 02:09:34 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-18%2002%3A09%3A34 => generated 318 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:35.109497 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-06fe50dc-bbc5-490c-9e75-93505c8c302f tempest-InstanceUsageAuditLogTestJSON-2106113024 tempest-InstanceUsageAuditLogTestJSON-2106113024-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:35.110309 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-08ef08a0-532e-4bb7-895d-dd9801fe2b1a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:35.110925 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-08ef08a0-532e-4bb7-895d-dd9801fe2b1a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: bd14a732-a9ad-4dfd-af61-69b84eda8877] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:35.115831 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:35.115831 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:09:35.127417 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-08ef08a0-532e-4bb7-895d-dd9801fe2b1a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:35.130622 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-08ef08a0-532e-4bb7-895d-dd9801fe2b1a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:35.131435 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-08ef08a0-532e-4bb7-895d-dd9801fe2b1a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:35.131869 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-08ef08a0-532e-4bb7-895d-dd9801fe2b1a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:35.141130 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-06fe50dc-bbc5-490c-9e75-93505c8c302f tempest-InstanceUsageAuditLogTestJSON-2106113024 tempest-InstanceUsageAuditLogTestJSON-2106113024-project-admin] 10.222.0.57 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.035534 Jul 18 02:09:35.147880 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 260/534] 10.222.0.57 () {58 vars in 1184 bytes} [Mon Jul 18 02:09:35 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:35.394212 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b4270c3b-b38b-4397-b842-e9e1d8ac0f17 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:35.395295 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b4270c3b-b38b-4397-b842-e9e1d8ac0f17 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: c3ac090d-3caa-404a-8f4d-5708f9fd04d6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:35.414783 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b4270c3b-b38b-4397-b842-e9e1d8ac0f17 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:35.415987 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b4270c3b-b38b-4397-b842-e9e1d8ac0f17 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:35.417156 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b4270c3b-b38b-4397-b842-e9e1d8ac0f17 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:35.424132 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b4270c3b-b38b-4397-b842-e9e1d8ac0f17 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:35.926789 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b4270c3b-b38b-4397-b842-e9e1d8ac0f17 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:35.936833 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b4270c3b-b38b-4397-b842-e9e1d8ac0f17 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/c3ac090d-3caa-404a-8f4d-5708f9fd04d6" status: 200 len: 1272 microversion: 2.1 time: 0.548180 Jul 18 02:09:35.938332 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 261/535] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:35 2022] GET /compute/v2.1/servers/c3ac090d-3caa-404a-8f4d-5708f9fd04d6 => generated 1272 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:09:35.949044 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-324284ce-2860-4779-ad84-54d1274c6f9c tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:35.957912 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-324284ce-2860-4779-ad84-54d1274c6f9c tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: f77b267e-9a20-4943-aa8b-0c82b9d6d20e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:35.975320 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-324284ce-2860-4779-ad84-54d1274c6f9c tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:35.975777 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-324284ce-2860-4779-ad84-54d1274c6f9c tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:35.976571 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-324284ce-2860-4779-ad84-54d1274c6f9c tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:35.976999 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-324284ce-2860-4779-ad84-54d1274c6f9c tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:36.305776 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-08ef08a0-532e-4bb7-895d-dd9801fe2b1a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:36.315360 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-08ef08a0-532e-4bb7-895d-dd9801fe2b1a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877" status: 200 len: 1324 microversion: 2.1 time: 1.209864 Jul 18 02:09:36.326509 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 275/536] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:35 2022] GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877 => generated 1324 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:09:36.339156 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-994e17a1-e556-40f3-910f-8e598e02fd44 req-44e550ad-25d6-4456-b37c-7a16b77621eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd14a732-a9ad-4dfd-af61-69b84eda8877", "name": "network-vif-plugged", "status": "completed", "tag": "8bd503c0-d3d5-4bae-9611-ac0c479b1c99"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:36.365694 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-994e17a1-e556-40f3-910f-8e598e02fd44 req-44e550ad-25d6-4456-b37c-7a16b77621eb service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:36.366568 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-994e17a1-e556-40f3-910f-8e598e02fd44 req-44e550ad-25d6-4456-b37c-7a16b77621eb service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:36.403158 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-994e17a1-e556-40f3-910f-8e598e02fd44 req-44e550ad-25d6-4456-b37c-7a16b77621eb service nova] Creating event network-vif-plugged:8bd503c0-d3d5-4bae-9611-ac0c479b1c99 for instance bd14a732-a9ad-4dfd-af61-69b84eda8877 on n-h1-465891-3 Jul 18 02:09:36.418999 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-994e17a1-e556-40f3-910f-8e598e02fd44 req-44e550ad-25d6-4456-b37c-7a16b77621eb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090809 Jul 18 02:09:36.420003 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 276/537] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:36.438824 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f455e20d-1443-4a3c-afd5-37cfbd5863f0 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a91654c0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:36.503664 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-324284ce-2860-4779-ad84-54d1274c6f9c tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60118d593f96437dbb2c68ad2fadd465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd02ce642caf4529a6e65c184de0ad19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:36.521225 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-324284ce-2860-4779-ad84-54d1274c6f9c tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e" status: 200 len: 1386 microversion: 2.1 time: 0.576176 Jul 18 02:09:36.527729 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 262/538] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:35 2022] GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e => generated 1386 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:36.538460 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-dc7e5461-58dd-44d0-b89a-c9ce24614da3 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:36.562438 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f455e20d-1443-4a3c-afd5-37cfbd5863f0 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a" status: 200 len: 1410 microversion: 2.1 time: 0.140911 Jul 18 02:09:36.564109 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-dc7e5461-58dd-44d0-b89a-c9ce24614da3 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:36.573896 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 277/539] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:09:36 2022] GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a => generated 1410 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:36.577886 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dc7e5461-58dd-44d0-b89a-c9ce24614da3 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:36.590501 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dc7e5461-58dd-44d0-b89a-c9ce24614da3 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:36.591746 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dc7e5461-58dd-44d0-b89a-c9ce24614da3 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:36.592439 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dc7e5461-58dd-44d0-b89a-c9ce24614da3 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:36.754357 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-dc7e5461-58dd-44d0-b89a-c9ce24614da3 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:36.763425 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-dc7e5461-58dd-44d0-b89a-c9ce24614da3 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:36.773845 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-dc7e5461-58dd-44d0-b89a-c9ce24614da3 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:36.789866 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-dc7e5461-58dd-44d0-b89a-c9ce24614da3 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] 10.222.0.57 "GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 200 len: 1453 microversion: 2.75 time: 0.260479 Jul 18 02:09:36.791985 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 263/540] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:09:36 2022] GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 1453 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:09:36.955719 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-86538ba5-29fa-4441-8c42-9b6d52553439 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:36.956677 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-86538ba5-29fa-4441-8c42-9b6d52553439 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: c3ac090d-3caa-404a-8f4d-5708f9fd04d6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:36.987042 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-86538ba5-29fa-4441-8c42-9b6d52553439 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:36.987691 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-86538ba5-29fa-4441-8c42-9b6d52553439 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:36.990311 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-86538ba5-29fa-4441-8c42-9b6d52553439 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:36.991028 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-86538ba5-29fa-4441-8c42-9b6d52553439 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:37.344233 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b818e244-b5be-404c-9ab8-34672b826108 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:37.346870 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b818e244-b5be-404c-9ab8-34672b826108 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: bd14a732-a9ad-4dfd-af61-69b84eda8877] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:37.353511 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-86538ba5-29fa-4441-8c42-9b6d52553439 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:37.361174 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b818e244-b5be-404c-9ab8-34672b826108 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:37.362071 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b818e244-b5be-404c-9ab8-34672b826108 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:37.362729 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-86538ba5-29fa-4441-8c42-9b6d52553439 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/c3ac090d-3caa-404a-8f4d-5708f9fd04d6" status: 200 len: 1272 microversion: 2.1 time: 0.412101 Jul 18 02:09:37.368211 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 278/541] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:36 2022] GET /compute/v2.1/servers/c3ac090d-3caa-404a-8f4d-5708f9fd04d6 => generated 1272 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:37.373278 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b818e244-b5be-404c-9ab8-34672b826108 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:37.378229 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b818e244-b5be-404c-9ab8-34672b826108 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:37.544705 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-11e137b0-2a7a-4aaf-a3a8-e62064fcbb1b tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:37.545324 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-11e137b0-2a7a-4aaf-a3a8-e62064fcbb1b tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: f77b267e-9a20-4943-aa8b-0c82b9d6d20e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:37.559846 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-11e137b0-2a7a-4aaf-a3a8-e62064fcbb1b tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:37.566060 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-11e137b0-2a7a-4aaf-a3a8-e62064fcbb1b tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:37.568226 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-11e137b0-2a7a-4aaf-a3a8-e62064fcbb1b tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:37.569086 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-11e137b0-2a7a-4aaf-a3a8-e62064fcbb1b tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:38.936667 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:09:38.940886 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-11e137b0-2a7a-4aaf-a3a8-e62064fcbb1b tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60118d593f96437dbb2c68ad2fadd465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd02ce642caf4529a6e65c184de0ad19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:38.949639 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-11e137b0-2a7a-4aaf-a3a8-e62064fcbb1b tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e" status: 200 len: 1386 microversion: 2.1 time: 1.409475 Jul 18 02:09:38.950959 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 279/542] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:37 2022] GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e => generated 1386 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:38.970781 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2d11badb-68ca-4b85-9b75-50d4813d3fc0 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a91653a0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:38.984011 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b818e244-b5be-404c-9ab8-34672b826108 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:39.003665 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b818e244-b5be-404c-9ab8-34672b826108 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877" status: 200 len: 1324 microversion: 2.1 time: 1.663637 Jul 18 02:09:39.007280 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 264/543] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:37 2022] GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877 => generated 1324 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:39.017071 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ea92f2fb-ad96-4420-ae56-c385983c5c77 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:39.023107 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ea92f2fb-ad96-4420-ae56-c385983c5c77 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:39.044598 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea92f2fb-ad96-4420-ae56-c385983c5c77 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:39.045048 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea92f2fb-ad96-4420-ae56-c385983c5c77 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:39.051168 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea92f2fb-ad96-4420-ae56-c385983c5c77 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:39.051624 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea92f2fb-ad96-4420-ae56-c385983c5c77 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:39.054239 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2d11badb-68ca-4b85-9b75-50d4813d3fc0 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a" status: 200 len: 1410 microversion: 2.1 time: 0.101902 Jul 18 02:09:39.055082 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 280/544] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:09:38 2022] GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a => generated 1410 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:39.059999 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-178cff5a-d12d-4366-bd64-638b6351bbe4 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:39.060902 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-178cff5a-d12d-4366-bd64-638b6351bbe4 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: c3ac090d-3caa-404a-8f4d-5708f9fd04d6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:39.074534 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-178cff5a-d12d-4366-bd64-638b6351bbe4 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:39.075413 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-178cff5a-d12d-4366-bd64-638b6351bbe4 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:39.078197 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-178cff5a-d12d-4366-bd64-638b6351bbe4 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:39.078901 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-178cff5a-d12d-4366-bd64-638b6351bbe4 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:39.274587 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ea92f2fb-ad96-4420-ae56-c385983c5c77 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:39.288984 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ea92f2fb-ad96-4420-ae56-c385983c5c77 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:39.293145 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ea92f2fb-ad96-4420-ae56-c385983c5c77 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:39.304252 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ea92f2fb-ad96-4420-ae56-c385983c5c77 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] 10.222.0.57 "GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 200 len: 1438 microversion: 2.75 time: 0.293534 Jul 18 02:09:39.319654 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 265/545] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:09:39 2022] GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 1438 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:09:39.327388 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-b7b9c2b7-f264-480c-b304-57463cf7cb70 req-06ea3a0b-f4cd-40b8-ab8d-11fae940144c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f77b267e-9a20-4943-aa8b-0c82b9d6d20e", "name": "network-vif-plugged", "status": "completed", "tag": "3cecd7e8-61af-4808-991a-e40ca83842b0"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:39.355139 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-b7b9c2b7-f264-480c-b304-57463cf7cb70 req-06ea3a0b-f4cd-40b8-ab8d-11fae940144c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:39.355586 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-b7b9c2b7-f264-480c-b304-57463cf7cb70 req-06ea3a0b-f4cd-40b8-ab8d-11fae940144c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:39.437896 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-b7b9c2b7-f264-480c-b304-57463cf7cb70 req-06ea3a0b-f4cd-40b8-ab8d-11fae940144c service nova] Creating event network-vif-plugged:3cecd7e8-61af-4808-991a-e40ca83842b0 for instance f77b267e-9a20-4943-aa8b-0c82b9d6d20e on n-h1-465891-3 Jul 18 02:09:39.462997 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-b7b9c2b7-f264-480c-b304-57463cf7cb70 req-06ea3a0b-f4cd-40b8-ab8d-11fae940144c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151070 Jul 18 02:09:39.470248 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 266/546] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:39.535762 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-178cff5a-d12d-4366-bd64-638b6351bbe4 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:39.557993 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-178cff5a-d12d-4366-bd64-638b6351bbe4 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/c3ac090d-3caa-404a-8f4d-5708f9fd04d6" status: 200 len: 1314 microversion: 2.1 time: 0.494993 Jul 18 02:09:39.567292 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 281/547] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:39 2022] GET /compute/v2.1/servers/c3ac090d-3caa-404a-8f4d-5708f9fd04d6 => generated 1314 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:39.974386 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b42b3a05-9e10-416b-a508-b092e3ff8efa tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:39.977355 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b42b3a05-9e10-416b-a508-b092e3ff8efa tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: f77b267e-9a20-4943-aa8b-0c82b9d6d20e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:39.992617 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b42b3a05-9e10-416b-a508-b092e3ff8efa tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:39.994639 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b42b3a05-9e10-416b-a508-b092e3ff8efa tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:39.999417 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b42b3a05-9e10-416b-a508-b092e3ff8efa tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:40.001163 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b42b3a05-9e10-416b-a508-b092e3ff8efa tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:40.086750 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:09:40.231478 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-163a6db7-3996-4b68-a560-10ebfae96ebc tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:40.234748 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-163a6db7-3996-4b68-a560-10ebfae96ebc tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:40.255775 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-163a6db7-3996-4b68-a560-10ebfae96ebc tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:40.257284 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-163a6db7-3996-4b68-a560-10ebfae96ebc tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:40.259421 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-163a6db7-3996-4b68-a560-10ebfae96ebc tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:40.261948 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-163a6db7-3996-4b68-a560-10ebfae96ebc tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:40.387180 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b42b3a05-9e10-416b-a508-b092e3ff8efa tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60118d593f96437dbb2c68ad2fadd465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd02ce642caf4529a6e65c184de0ad19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:40.401577 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b42b3a05-9e10-416b-a508-b092e3ff8efa tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e" status: 200 len: 1386 microversion: 2.1 time: 0.437799 Jul 18 02:09:40.412785 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 282/548] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:39 2022] GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e => generated 1386 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:09:40.436388 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b4013631-7a92-4ffe-bec7-d2b126b0716b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:40.437043 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b4013631-7a92-4ffe-bec7-d2b126b0716b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: bd14a732-a9ad-4dfd-af61-69b84eda8877] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:40.483553 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b4013631-7a92-4ffe-bec7-d2b126b0716b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:40.484657 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b4013631-7a92-4ffe-bec7-d2b126b0716b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:40.485727 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b4013631-7a92-4ffe-bec7-d2b126b0716b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:40.504579 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=100 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:09:40.504875 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b4013631-7a92-4ffe-bec7-d2b126b0716b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:40.549019 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-163a6db7-3996-4b68-a560-10ebfae96ebc tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:09:40.549019 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-163a6db7-3996-4b68-a560-10ebfae96ebc tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:09:40.549673 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-163a6db7-3996-4b68-a560-10ebfae96ebc tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:09:40.549673 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-163a6db7-3996-4b68-a560-10ebfae96ebc tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:09:40.560465 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-163a6db7-3996-4b68-a560-10ebfae96ebc tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:09:40.816557 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-163a6db7-3996-4b68-a560-10ebfae96ebc tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:40.828490 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-163a6db7-3996-4b68-a560-10ebfae96ebc tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:40.837875 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-163a6db7-3996-4b68-a560-10ebfae96ebc tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:40.838783 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-163a6db7-3996-4b68-a560-10ebfae96ebc tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:40.840046 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-163a6db7-3996-4b68-a560-10ebfae96ebc tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:41.055416 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b4013631-7a92-4ffe-bec7-d2b126b0716b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:41.065216 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b4013631-7a92-4ffe-bec7-d2b126b0716b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877" status: 200 len: 1522 microversion: 2.1 time: 0.650810 Jul 18 02:09:41.084280 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 283/549] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:40 2022] GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877 => generated 1522 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:41.092591 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-39df882c-556d-4d2c-8279-04abac699753 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a915b280>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:41.232385 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-39df882c-556d-4d2c-8279-04abac699753 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a" status: 200 len: 1410 microversion: 2.1 time: 0.146923 Jul 18 02:09:41.239488 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 284/550] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:09:41 2022] GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a => generated 1410 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:41.255858 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-239e66fa-0890-4b2f-8bbe-e7fe03a2a7e7 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:41.258522 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-239e66fa-0890-4b2f-8bbe-e7fe03a2a7e7 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: c3ac090d-3caa-404a-8f4d-5708f9fd04d6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:41.283089 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-239e66fa-0890-4b2f-8bbe-e7fe03a2a7e7 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:41.294893 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-239e66fa-0890-4b2f-8bbe-e7fe03a2a7e7 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:41.306466 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-239e66fa-0890-4b2f-8bbe-e7fe03a2a7e7 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:41.307943 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-239e66fa-0890-4b2f-8bbe-e7fe03a2a7e7 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:41.398395 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-163a6db7-3996-4b68-a560-10ebfae96ebc tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lazy-loading 'services' on Instance uuid a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:09:41.565829 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-163a6db7-3996-4b68-a560-10ebfae96ebc tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a/action" status: 202 len: 1942 microversion: 2.75 time: 2.094145 Jul 18 02:09:41.567121 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 267/551] 10.222.0.57 () {62 vars in 1318 bytes} [Mon Jul 18 02:09:39 2022] POST /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a/action => generated 1942 bytes in 2096 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 18 02:09:41.582987 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-7cfca55b-81da-4782-878b-d7df28b0afbc req-a4cefae4-3e1e-4eaf-aebb-495bd9e30579 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "092e9dd7-8734-42ae-9ad7-626438550736", "tag": "5653c487-e512-475c-8f13-aa4ee05e2542"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:41.617590 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-7cfca55b-81da-4782-878b-d7df28b0afbc req-a4cefae4-3e1e-4eaf-aebb-495bd9e30579 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:41.618332 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-7cfca55b-81da-4782-878b-d7df28b0afbc req-a4cefae4-3e1e-4eaf-aebb-495bd9e30579 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:41.646575 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-7cfca55b-81da-4782-878b-d7df28b0afbc req-a4cefae4-3e1e-4eaf-aebb-495bd9e30579 service nova] Creating event network-changed:5653c487-e512-475c-8f13-aa4ee05e2542 for instance 092e9dd7-8734-42ae-9ad7-626438550736 on n-h2-465891-3 Jul 18 02:09:41.660738 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-7cfca55b-81da-4782-878b-d7df28b0afbc req-a4cefae4-3e1e-4eaf-aebb-495bd9e30579 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086256 Jul 18 02:09:41.664641 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 268/552] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:41.672740 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3c060a66-0de4-4fdb-ac5c-d5f98b2c1f63 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:41.677843 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3c060a66-0de4-4fdb-ac5c-d5f98b2c1f63 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: bd14a732-a9ad-4dfd-af61-69b84eda8877] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:41.695084 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3c060a66-0de4-4fdb-ac5c-d5f98b2c1f63 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:41.695933 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3c060a66-0de4-4fdb-ac5c-d5f98b2c1f63 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:41.700226 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3c060a66-0de4-4fdb-ac5c-d5f98b2c1f63 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:41.702796 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3c060a66-0de4-4fdb-ac5c-d5f98b2c1f63 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:42.754253 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-239e66fa-0890-4b2f-8bbe-e7fe03a2a7e7 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:42.764970 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-239e66fa-0890-4b2f-8bbe-e7fe03a2a7e7 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/c3ac090d-3caa-404a-8f4d-5708f9fd04d6" status: 200 len: 1314 microversion: 2.1 time: 1.522274 Jul 18 02:09:42.782130 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 285/553] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:41 2022] GET /compute/v2.1/servers/c3ac090d-3caa-404a-8f4d-5708f9fd04d6 => generated 1314 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:42.782130 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d5aee9e6-d327-4d13-94d0-f120aa0709cd tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:42.782849 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d5aee9e6-d327-4d13-94d0-f120aa0709cd tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: f77b267e-9a20-4943-aa8b-0c82b9d6d20e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:42.809900 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5aee9e6-d327-4d13-94d0-f120aa0709cd tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:42.810075 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5aee9e6-d327-4d13-94d0-f120aa0709cd tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:42.813379 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5aee9e6-d327-4d13-94d0-f120aa0709cd tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:42.817002 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5aee9e6-d327-4d13-94d0-f120aa0709cd tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:43.069713 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=12 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:09:43.400991 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3c060a66-0de4-4fdb-ac5c-d5f98b2c1f63 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:43.423536 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3c060a66-0de4-4fdb-ac5c-d5f98b2c1f63 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877" status: 200 len: 1522 microversion: 2.1 time: 1.753756 Jul 18 02:09:43.430491 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 269/554] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:41 2022] GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877 => generated 1522 bytes in 1765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:43.439489 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1f30e8e2-a1a4-4119-8994-5f85eb9f351e tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:43.443416 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1f30e8e2-a1a4-4119-8994-5f85eb9f351e tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:43.462362 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1f30e8e2-a1a4-4119-8994-5f85eb9f351e tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:43.463375 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1f30e8e2-a1a4-4119-8994-5f85eb9f351e tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:43.464688 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1f30e8e2-a1a4-4119-8994-5f85eb9f351e tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:43.465288 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1f30e8e2-a1a4-4119-8994-5f85eb9f351e tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:43.740262 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d5aee9e6-d327-4d13-94d0-f120aa0709cd tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60118d593f96437dbb2c68ad2fadd465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd02ce642caf4529a6e65c184de0ad19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:43.792633 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d5aee9e6-d327-4d13-94d0-f120aa0709cd tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e" status: 200 len: 1586 microversion: 2.1 time: 0.997315 Jul 18 02:09:43.797938 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 286/555] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:42 2022] GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e => generated 1586 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:43.815898 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-afc49ae1-fde1-4738-ad20-90059275c810 req-5e08f6e3-f6b0-4ad6-90c4-c2ad62012bae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3ac090d-3caa-404a-8f4d-5708f9fd04d6", "tag": "3452aafc-709f-4bc0-87ce-db2523fa6dc8"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:43.870656 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-afc49ae1-fde1-4738-ad20-90059275c810 req-5e08f6e3-f6b0-4ad6-90c4-c2ad62012bae service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:43.872784 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-afc49ae1-fde1-4738-ad20-90059275c810 req-5e08f6e3-f6b0-4ad6-90c4-c2ad62012bae service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:43.915929 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-1f30e8e2-a1a4-4119-8994-5f85eb9f351e tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lazy-loading 'services' on Instance uuid a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:09:43.938870 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-afc49ae1-fde1-4738-ad20-90059275c810 req-5e08f6e3-f6b0-4ad6-90c4-c2ad62012bae service nova] Creating event network-changed:3452aafc-709f-4bc0-87ce-db2523fa6dc8 for instance c3ac090d-3caa-404a-8f4d-5708f9fd04d6 on n-h2-465891-3 Jul 18 02:09:43.956188 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-afc49ae1-fde1-4738-ad20-90059275c810 req-5e08f6e3-f6b0-4ad6-90c4-c2ad62012bae service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156565 Jul 18 02:09:43.959311 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 287/556] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:43.981689 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-92afa4fd-6f40-4af8-89ff-bb5382a489b7 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a90ff790>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:44.017579 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1f30e8e2-a1a4-4119-8994-5f85eb9f351e tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 200 len: 1929 microversion: 2.75 time: 0.584214 Jul 18 02:09:44.024610 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 270/557] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:09:43 2022] GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 1929 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:09:44.047726 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-85038b97-d766-4801-b664-1843e42e4f21 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-269697560", "metadata": {"": ""}}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:44.065531 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-85038b97-d766-4801-b664-1843e42e4f21 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Request method failure captured: Jul 18 02:09:44.065531 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877/action HTTP/1.1 Jul 18 02:09:44.065531 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:09:44.065531 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:09:44.065531 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:09:44.065531 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 106 Jul 18 02:09:44.065531 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:09:44.065531 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:09:44.065531 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:09:44.065531 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:09:44.065531 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MDHcKkxv785TruBaYZ9isdDskpkSTXS63FySdEQ2DQWlYCoBeefqvgfCQf6lXL0HIcBKCVhVPgBeigtx_Fr6JAMpyAfBIDaZdUpBEZ_ARmYr58LYp6mJVoQMeV86GVtrWumVWYiUwrWzpXpGhfDxCZstFRul6eTjV0GKZX_II9Blls Jul 18 02:09:44.065531 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:09:44.065531 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:09:44.065531 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:09:44.065531 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:09:44.065531 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:09:44.065531 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:09:44.065531 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: d6b1efcf9e224d66b7dbf31c8aa89f87 Jul 18 02:09:44.065531 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-872437023 Jul 18 02:09:44.065531 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:09:44.065531 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:09:44.067120 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d6b1efcf9e224d66b7dbf31c8aa89f87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d6b1efcf9e224d66b7dbf31c8aa89f87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d6b1efcf9e224d66b7dbf31c8aa89f87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d6b1efcf9e224d66b7dbf31c8aa89f87"}]}] Jul 18 02:09:44.067120 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-872437023 Jul 18 02:09:44.067120 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: d6b1efcf9e224d66b7dbf31c8aa89f87 Jul 18 02:09:44.067120 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-872437023 Jul 18 02:09:44.067120 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ImagesOneServerNegativeTestJSON-872437023-project Jul 18 02:09:44.067120 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:09:44.067120 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:09:44.067120 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 625ab51af53042138e5335e3ae6e5dac Jul 18 02:09:44.067120 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-872437023-project Jul 18 02:09:44.067120 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:09:44.067120 n-d-465891-3 devstack@n-api.service[119544]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-269697560", "metadata": {"": ""}}} Jul 18 02:09:44.067120 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:09:44.068109 n-d-465891-3 devstack@n-api.service[119544]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:09:44.068109 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'bd14a732-a9ad-4dfd-af61-69b84eda8877', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-269697560', 'metadata': {'': ''}}}} Jul 18 02:09:44.068109 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:09:44.068109 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:44.068109 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:09:44.068109 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:09:44.068109 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:09:44.068109 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:09:44.068109 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:09:44.068109 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:44.068109 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 18 02:09:44.068109 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 18 02:09:44.068109 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 18 02:09:44.068109 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 18 02:09:44.068109 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 18 02:09:44.068109 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:44.068109 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 18 02:09:44.068109 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi {'': ''} Jul 18 02:09:44.068109 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:44.068109 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:44.068109 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:44.069901 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:44.069901 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:44.069901 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:44.069901 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:09:44.069901 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:09:44.069901 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:09:44.069901 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:09:44.069901 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:09:44.069901 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:09:44.069901 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:09:44.069901 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:09:44.069901 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:09:44.069901 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:09:44.069901 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:09:44.069901 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:09:44.069901 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:09:44.069901 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:44.069901 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:44.069901 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:44.069901 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:44.071373 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:44.071373 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:44.071373 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:09:44.071373 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:09:44.071373 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:09:44.071373 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:44.071373 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-85038b97-d766-4801-b664-1843e42e4f21 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:09:44.071373 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-85038b97-d766-4801-b664-1843e42e4f21 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "POST /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877/action" status: 400 len: 170 microversion: 2.1 time: 0.040020 Jul 18 02:09:44.076815 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 271/558] 10.222.0.57 () {60 vars in 1278 bytes} [Mon Jul 18 02:09:44 2022] POST /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877/action => generated 170 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:09:44.091640 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-92afa4fd-6f40-4af8-89ff-bb5382a489b7 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a" status: 200 len: 1410 microversion: 2.1 time: 0.130669 Jul 18 02:09:44.098295 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 288/559] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:09:43 2022] GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a => generated 1410 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:44.101841 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c0eb4ef2-a152-45ab-bf0f-acb664da688e tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:44.103287 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-88b66009-6184-4851-bd64-4ed26dafe2b5 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:44.104111 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-88b66009-6184-4851-bd64-4ed26dafe2b5 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: f77b267e-9a20-4943-aa8b-0c82b9d6d20e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:44.108178 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c0eb4ef2-a152-45ab-bf0f-acb664da688e tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: c3ac090d-3caa-404a-8f4d-5708f9fd04d6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:44.153366 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-88b66009-6184-4851-bd64-4ed26dafe2b5 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:44.154047 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-88b66009-6184-4851-bd64-4ed26dafe2b5 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:44.155485 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-88b66009-6184-4851-bd64-4ed26dafe2b5 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:44.157635 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-88b66009-6184-4851-bd64-4ed26dafe2b5 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:44.161482 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c0eb4ef2-a152-45ab-bf0f-acb664da688e tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:44.171061 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c0eb4ef2-a152-45ab-bf0f-acb664da688e tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:44.172319 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c0eb4ef2-a152-45ab-bf0f-acb664da688e tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:44.180628 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c0eb4ef2-a152-45ab-bf0f-acb664da688e tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:44.631121 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-88b66009-6184-4851-bd64-4ed26dafe2b5 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.531580 Jul 18 02:09:44.632715 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 289/560] 10.222.0.57 () {58 vars in 1274 bytes} [Mon Jul 18 02:09:44 2022] GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e/os-interface => generated 285 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:44.639612 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dac9920f-1445-460a-9af3-c2bb88a36e69 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:44.642011 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-dac9920f-1445-460a-9af3-c2bb88a36e69 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: bd14a732-a9ad-4dfd-af61-69b84eda8877] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:44.656676 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dac9920f-1445-460a-9af3-c2bb88a36e69 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:44.661030 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dac9920f-1445-460a-9af3-c2bb88a36e69 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:44.662885 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dac9920f-1445-460a-9af3-c2bb88a36e69 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:44.664773 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dac9920f-1445-460a-9af3-c2bb88a36e69 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:44.940123 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c0eb4ef2-a152-45ab-bf0f-acb664da688e tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:44.960367 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c0eb4ef2-a152-45ab-bf0f-acb664da688e tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/c3ac090d-3caa-404a-8f4d-5708f9fd04d6" status: 200 len: 1314 microversion: 2.1 time: 0.882416 Jul 18 02:09:44.961521 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 272/561] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:44 2022] GET /compute/v2.1/servers/c3ac090d-3caa-404a-8f4d-5708f9fd04d6 => generated 1314 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:45.135938 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=22 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:09:45.266456 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8c1653e3-b669-4581-96c8-807625262777 tempest-QuotasAdminNegativeTest-1708561238 tempest-QuotasAdminNegativeTest-1708561238-project-admin] Calling method '.version_select at 0x7ff4a902dee0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:45.395252 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8c1653e3-b669-4581-96c8-807625262777 tempest-QuotasAdminNegativeTest-1708561238 tempest-QuotasAdminNegativeTest-1708561238-project-admin] 10.222.0.57 "GET /compute/v2.1/os-quota-sets/e38be15647d74a8dafa2f2def74baeb7" status: 200 len: 371 microversion: 2.1 time: 0.432468 Jul 18 02:09:45.396081 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 273/562] 10.222.0.57 () {58 vars in 1241 bytes} [Mon Jul 18 02:09:44 2022] GET /compute/v2.1/os-quota-sets/e38be15647d74a8dafa2f2def74baeb7 => generated 371 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:45.413259 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2e9d7beb-a791-45a6-94c7-ff39aa069dc8 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:45.416571 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2e9d7beb-a791-45a6-94c7-ff39aa069dc8 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:45.439434 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2e9d7beb-a791-45a6-94c7-ff39aa069dc8 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:45.440253 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2e9d7beb-a791-45a6-94c7-ff39aa069dc8 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:45.441263 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2e9d7beb-a791-45a6-94c7-ff39aa069dc8 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:45.444685 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2e9d7beb-a791-45a6-94c7-ff39aa069dc8 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:45.977967 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-dac9920f-1445-460a-9af3-c2bb88a36e69 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:45.982983 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-2e9d7beb-a791-45a6-94c7-ff39aa069dc8 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lazy-loading 'services' on Instance uuid a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:09:45.989935 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-dac9920f-1445-460a-9af3-c2bb88a36e69 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877" status: 200 len: 1522 microversion: 2.1 time: 1.355700 Jul 18 02:09:45.994690 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 290/563] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:44 2022] GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877 => generated 1522 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:46.016449 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-497039a8-eaea-4f05-bb76-61b8094f001d tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a90b1790>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:46.026356 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2e9d7beb-a791-45a6-94c7-ff39aa069dc8 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 200 len: 1929 microversion: 2.75 time: 0.626957 Jul 18 02:09:46.029310 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 274/564] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:09:45 2022] GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 1929 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:09:46.060621 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1bd4d9bf-df26-4237-991d-2351b11bdc16 tempest-QuotasAdminNegativeTest-1708561238 tempest-QuotasAdminNegativeTest-1708561238-project-admin] Action: 'update', calling method: .version_select at 0x7ff4a90668b0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:46.132776 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-497039a8-eaea-4f05-bb76-61b8094f001d tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a" status: 200 len: 1410 microversion: 2.1 time: 0.136226 Jul 18 02:09:46.133113 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 291/565] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:09:45 2022] GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a => generated 1410 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:46.147249 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bb793ac3-f153-4e0a-86d6-f0a473203ee4 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:46.151714 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bb793ac3-f153-4e0a-86d6-f0a473203ee4 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: c3ac090d-3caa-404a-8f4d-5708f9fd04d6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:46.169723 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bb793ac3-f153-4e0a-86d6-f0a473203ee4 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:46.172668 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bb793ac3-f153-4e0a-86d6-f0a473203ee4 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:46.173619 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bb793ac3-f153-4e0a-86d6-f0a473203ee4 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:46.174890 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bb793ac3-f153-4e0a-86d6-f0a473203ee4 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:46.217281 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1bd4d9bf-df26-4237-991d-2351b11bdc16 tempest-QuotasAdminNegativeTest-1708561238 tempest-QuotasAdminNegativeTest-1708561238-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:46.219967 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1bd4d9bf-df26-4237-991d-2351b11bdc16 tempest-QuotasAdminNegativeTest-1708561238 tempest-QuotasAdminNegativeTest-1708561238-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:46.220860 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1bd4d9bf-df26-4237-991d-2351b11bdc16 tempest-QuotasAdminNegativeTest-1708561238 tempest-QuotasAdminNegativeTest-1708561238-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:46.221311 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1bd4d9bf-df26-4237-991d-2351b11bdc16 tempest-QuotasAdminNegativeTest-1708561238 tempest-QuotasAdminNegativeTest-1708561238-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:46.395382 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1bd4d9bf-df26-4237-991d-2351b11bdc16 tempest-QuotasAdminNegativeTest-1708561238 tempest-QuotasAdminNegativeTest-1708561238-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-quota-sets/e38be15647d74a8dafa2f2def74baeb7" status: 200 len: 328 microversion: 2.1 time: 0.364467 Jul 18 02:09:46.429943 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 275/566] 10.222.0.57 () {60 vars in 1261 bytes} [Mon Jul 18 02:09:46 2022] PUT /compute/v2.1/os-quota-sets/e38be15647d74a8dafa2f2def74baeb7 => generated 328 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:46.439347 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9ad64b06-95c1-450e-a644-848137dce6fd tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:46.439970 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9ad64b06-95c1-450e-a644-848137dce6fd tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: bd14a732-a9ad-4dfd-af61-69b84eda8877] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:46.471301 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9ad64b06-95c1-450e-a644-848137dce6fd tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:46.471768 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9ad64b06-95c1-450e-a644-848137dce6fd tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:46.472548 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9ad64b06-95c1-450e-a644-848137dce6fd tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:46.472985 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9ad64b06-95c1-450e-a644-848137dce6fd tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:46.923380 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bb793ac3-f153-4e0a-86d6-f0a473203ee4 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:46.933266 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bb793ac3-f153-4e0a-86d6-f0a473203ee4 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/c3ac090d-3caa-404a-8f4d-5708f9fd04d6" status: 200 len: 1314 microversion: 2.1 time: 0.797077 Jul 18 02:09:46.940883 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 292/567] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:46 2022] GET /compute/v2.1/servers/c3ac090d-3caa-404a-8f4d-5708f9fd04d6 => generated 1314 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:47.131190 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-69a4bc76-a7b8-4b98-b691-0f3a1c3b752a tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-907613185", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:47.245670 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-69a4bc76-a7b8-4b98-b691-0f3a1c3b752a tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] validate_networks() for None {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:09:47.276952 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9ad64b06-95c1-450e-a644-848137dce6fd tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:47.294787 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9ad64b06-95c1-450e-a644-848137dce6fd tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877" status: 200 len: 1522 microversion: 2.1 time: 0.861197 Jul 18 02:09:47.296599 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 276/568] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:46 2022] GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877 => generated 1522 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:47.304139 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-05e0255b-e2dc-44b6-80c3-ef8b199bfe13 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:47.313981 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-05e0255b-e2dc-44b6-80c3-ef8b199bfe13 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:47.332257 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-05e0255b-e2dc-44b6-80c3-ef8b199bfe13 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:47.333218 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-05e0255b-e2dc-44b6-80c3-ef8b199bfe13 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:47.334310 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-05e0255b-e2dc-44b6-80c3-ef8b199bfe13 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:47.335012 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-05e0255b-e2dc-44b6-80c3-ef8b199bfe13 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:47.615673 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-05e0255b-e2dc-44b6-80c3-ef8b199bfe13 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lazy-loading 'services' on Instance uuid a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:09:47.684806 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-05e0255b-e2dc-44b6-80c3-ef8b199bfe13 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 200 len: 1929 microversion: 2.75 time: 0.384139 Jul 18 02:09:47.693369 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 277/569] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:09:47 2022] GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 1929 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:09:47.698836 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-568e04f7-2918-400f-aa85-e28e8dd75769 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a8f35940>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:47.768997 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-568e04f7-2918-400f-aa85-e28e8dd75769 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a" status: 200 len: 1410 microversion: 2.1 time: 0.074283 Jul 18 02:09:47.775874 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 278/570] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:09:47 2022] GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a => generated 1410 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:47.782337 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-445d0443-f2b4-4bd5-a4fc-eea1eb6d33cc tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1252834397", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:47.785492 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-445d0443-f2b4-4bd5-a4fc-eea1eb6d33cc tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Request method failure captured: Jul 18 02:09:47.785492 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877/action HTTP/1.1 Jul 18 02:09:47.785492 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:09:47.785492 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:09:47.785492 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:09:47.785492 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 619 Jul 18 02:09:47.785492 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:09:47.785492 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:09:47.785492 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:09:47.785492 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:09:47.785492 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MDHcKkxv785TruBaYZ9isdDskpkSTXS63FySdEQ2DQWlYCoBeefqvgfCQf6lXL0HIcBKCVhVPgBeigtx_Fr6JAMpyAfBIDaZdUpBEZ_ARmYr58LYp6mJVoQMeV86GVtrWumVWYiUwrWzpXpGhfDxCZstFRul6eTjV0GKZX_II9Blls Jul 18 02:09:47.785492 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:09:47.785492 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:09:47.785492 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:09:47.785492 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:09:47.785492 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:09:47.785492 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:09:47.785492 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: d6b1efcf9e224d66b7dbf31c8aa89f87 Jul 18 02:09:47.785492 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-872437023 Jul 18 02:09:47.785492 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:09:47.785492 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:09:47.787049 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d6b1efcf9e224d66b7dbf31c8aa89f87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d6b1efcf9e224d66b7dbf31c8aa89f87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d6b1efcf9e224d66b7dbf31c8aa89f87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d6b1efcf9e224d66b7dbf31c8aa89f87"}]}] Jul 18 02:09:47.787049 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-872437023 Jul 18 02:09:47.787049 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: d6b1efcf9e224d66b7dbf31c8aa89f87 Jul 18 02:09:47.787049 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-872437023 Jul 18 02:09:47.787049 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ImagesOneServerNegativeTestJSON-872437023-project Jul 18 02:09:47.787049 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:09:47.787049 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:09:47.787049 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 625ab51af53042138e5335e3ae6e5dac Jul 18 02:09:47.787049 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-872437023-project Jul 18 02:09:47.787049 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:09:47.787784 n-d-465891-3 devstack@n-api.service[119544]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1252834397", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Jul 18 02:09:47.787784 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:09:47.787784 n-d-465891-3 devstack@n-api.service[119544]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:09:47.788038 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'bd14a732-a9ad-4dfd-af61-69b84eda8877', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1252834397', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Jul 18 02:09:47.788038 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:09:47.788038 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:47.788038 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:09:47.788038 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:09:47.788038 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:09:47.788038 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:09:47.788038 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:09:47.788038 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:47.788038 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 18 02:09:47.788038 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 18 02:09:47.788831 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 18 02:09:47.788831 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 18 02:09:47.788831 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 18 02:09:47.788831 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:47.788831 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 18 02:09:47.788831 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Jul 18 02:09:47.788831 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:47.788831 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:47.788831 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:47.788831 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:47.788831 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:47.788831 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:47.788831 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:09:47.788831 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:09:47.788831 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:09:47.788831 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:09:47.788831 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:09:47.790088 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:09:47.790088 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:09:47.790088 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:09:47.790088 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:09:47.790088 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:09:47.790088 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:09:47.790088 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:09:47.790088 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:09:47.790088 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:47.790088 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:47.790088 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:47.790088 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:47.790924 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:47.790924 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:47.790924 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:09:47.790924 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:09:47.790924 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:09:47.790924 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:47.794931 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-445d0443-f2b4-4bd5-a4fc-eea1eb6d33cc tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:09:47.796148 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-445d0443-f2b4-4bd5-a4fc-eea1eb6d33cc tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "POST /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877/action" status: 400 len: 938 microversion: 2.1 time: 0.018970 Jul 18 02:09:47.801023 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 279/571] 10.222.0.57 () {60 vars in 1278 bytes} [Mon Jul 18 02:09:47 2022] POST /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877/action => generated 938 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:09:47.806308 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a9caa23e-7ea5-4ac2-ba13-4dfa6619d9a7 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:47.807143 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a9caa23e-7ea5-4ac2-ba13-4dfa6619d9a7 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: bd14a732-a9ad-4dfd-af61-69b84eda8877] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:47.822803 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a9caa23e-7ea5-4ac2-ba13-4dfa6619d9a7 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:47.823614 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a9caa23e-7ea5-4ac2-ba13-4dfa6619d9a7 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:47.824616 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a9caa23e-7ea5-4ac2-ba13-4dfa6619d9a7 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:47.825283 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a9caa23e-7ea5-4ac2-ba13-4dfa6619d9a7 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:48.902863 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a9caa23e-7ea5-4ac2-ba13-4dfa6619d9a7 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:48.912744 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a9caa23e-7ea5-4ac2-ba13-4dfa6619d9a7 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877" status: 200 len: 1522 microversion: 2.1 time: 1.110165 Jul 18 02:09:48.920815 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 280/572] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:47 2022] GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877 => generated 1522 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:48.927941 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b3f1f6ac-288a-4866-afdc-c9f8f3aa1d41 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:48.932529 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b3f1f6ac-288a-4866-afdc-c9f8f3aa1d41 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: c3ac090d-3caa-404a-8f4d-5708f9fd04d6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:48.943971 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b3f1f6ac-288a-4866-afdc-c9f8f3aa1d41 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:48.944420 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b3f1f6ac-288a-4866-afdc-c9f8f3aa1d41 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:48.945198 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b3f1f6ac-288a-4866-afdc-c9f8f3aa1d41 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:48.945628 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b3f1f6ac-288a-4866-afdc-c9f8f3aa1d41 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:49.095271 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-69a4bc76-a7b8-4b98-b691-0f3a1c3b752a tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:09:49.095888 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-69a4bc76-a7b8-4b98-b691-0f3a1c3b752a tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:09:49.096371 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-69a4bc76-a7b8-4b98-b691-0f3a1c3b752a tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:09:49.096827 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-69a4bc76-a7b8-4b98-b691-0f3a1c3b752a tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:09:49.097236 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-69a4bc76-a7b8-4b98-b691-0f3a1c3b752a tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:09:49.132619 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-69a4bc76-a7b8-4b98-b691-0f3a1c3b752a tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:49.135916 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-69a4bc76-a7b8-4b98-b691-0f3a1c3b752a tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:49.143874 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-69a4bc76-a7b8-4b98-b691-0f3a1c3b752a tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:49.144572 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-69a4bc76-a7b8-4b98-b691-0f3a1c3b752a tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:49.270066 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-69a4bc76-a7b8-4b98-b691-0f3a1c3b752a tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Getting quotas for project e38be15647d74a8dafa2f2def74baeb7. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:09:49.300875 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-69a4bc76-a7b8-4b98-b691-0f3a1c3b752a tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Getting quotas for user 688594ccf76e4d1aab525934d983df65 and project e38be15647d74a8dafa2f2def74baeb7. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:09:49.329450 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.utils [None req-69a4bc76-a7b8-4b98-b691-0f3a1c3b752a tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] cores quota exceeded for e38be15647d74a8dafa2f2def74baeb7, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119543) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 18 02:09:49.330216 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-69a4bc76-a7b8-4b98-b691-0f3a1c3b752a tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 18 02:09:49.342263 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-69a4bc76-a7b8-4b98-b691-0f3a1c3b752a tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Request method failure captured: Jul 18 02:09:49.342263 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:09:49.342263 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:09:49.342263 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:09:49.342263 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:09:49.342263 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 144 Jul 18 02:09:49.342263 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:09:49.342263 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:09:49.342263 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:09:49.342263 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:09:49.342263 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MDmJddQrtVMur52UTrdQpSh1RBnPEgFZd6UzfL_EqMlpEYFum4hwHRuOK2V2vSKfv7Sh_Xkx8yNe1_iNiB41JHR9HmkzCqhu_my9KzRUrhG7g8Om6kQWNbtiPiCbQnu9rZOSsVe-BeHuez5y-o82_0AVxfV3rVxHRfxhpzaXiWwxcA Jul 18 02:09:49.342263 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:09:49.342263 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:09:49.342263 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:09:49.342263 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:09:49.342263 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:09:49.342263 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:09:49.342263 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: e38be15647d74a8dafa2f2def74baeb7 Jul 18 02:09:49.342263 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-QuotasAdminNegativeTest-1264824889 Jul 18 02:09:49.342263 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:09:49.342263 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:09:49.344840 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e38be15647d74a8dafa2f2def74baeb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e38be15647d74a8dafa2f2def74baeb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e38be15647d74a8dafa2f2def74baeb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e38be15647d74a8dafa2f2def74baeb7"}]}] Jul 18 02:09:49.344840 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-QuotasAdminNegativeTest-1264824889 Jul 18 02:09:49.344840 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: e38be15647d74a8dafa2f2def74baeb7 Jul 18 02:09:49.344840 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1264824889 Jul 18 02:09:49.344840 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-QuotasAdminNegativeTest-1264824889-project Jul 18 02:09:49.344840 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:09:49.344840 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:09:49.344840 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 688594ccf76e4d1aab525934d983df65 Jul 18 02:09:49.344840 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-QuotasAdminNegativeTest-1264824889-project Jul 18 02:09:49.344840 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 02:09:49.344840 n-d-465891-3 devstack@n-api.service[119543]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-907613185", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452"}} Jul 18 02:09:49.344840 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:09:49.345907 n-d-465891-3 devstack@n-api.service[119543]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 18 02:09:49.345907 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-907613185', 'imageRef': '3bb0a19f-5b69-48ee-a771-8fd416f92f36', 'flavorRef': '452'}}} Jul 18 02:09:49.345907 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:09:49.345907 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:49.345907 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 18 02:09:49.345907 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 18 02:09:49.345907 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:09:49.345907 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:09:49.345907 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 18 02:09:49.345907 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc Jul 18 02:09:49.345907 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 18 02:09:49.345907 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 18 02:09:49.345907 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:09:49.345907 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:09:49.345907 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 18 02:09:49.345907 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 18 02:09:49.345907 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 18 02:09:49.345907 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 18 02:09:49.348020 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 18 02:09:49.348020 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 18 02:09:49.348020 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 18 02:09:49.348020 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:49.348020 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:49.348020 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:49.348020 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:49.348020 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 18 02:09:49.348020 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 18 02:09:49.348020 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 18 02:09:49.348020 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 18 02:09:49.348020 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 18 02:09:49.348020 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 18 02:09:49.348020 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 18 02:09:49.348020 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 18 02:09:49.348020 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 18 02:09:49.348020 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 18 02:09:49.348020 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 18 02:09:49.348020 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:49.348020 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:49.348020 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:49.349893 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:49.349893 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:49.349893 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:49.349893 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:09:49.349893 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:09:49.349893 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:09:49.349893 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:09:49.349893 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:09:49.349893 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:09:49.349893 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:09:49.349893 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:09:49.349893 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:09:49.349893 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:09:49.349893 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 18 02:09:49.349893 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 18 02:09:49.349893 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 18 02:09:49.349893 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 18 02:09:49.349893 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:49.349893 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:49.349893 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:49.349893 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:49.351562 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:49.351562 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:49.351562 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:09:49.351562 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:09:49.351562 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 18 02:09:49.351562 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:49.351562 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-69a4bc76-a7b8-4b98-b691-0f3a1c3b752a tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:09:49.351562 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-69a4bc76-a7b8-4b98-b691-0f3a1c3b752a tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 2.385276 Jul 18 02:09:49.351562 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 293/573] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:09:46 2022] POST /compute/v2.1/servers => generated 111 bytes in 2404 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:09:49.364262 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-208efdc8-c41f-4015-a4e2-2e1b25ba9ff9 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:49.364894 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-208efdc8-c41f-4015-a4e2-2e1b25ba9ff9 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:49.382036 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-208efdc8-c41f-4015-a4e2-2e1b25ba9ff9 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:49.382482 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-208efdc8-c41f-4015-a4e2-2e1b25ba9ff9 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:49.383269 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-208efdc8-c41f-4015-a4e2-2e1b25ba9ff9 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:49.383703 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-208efdc8-c41f-4015-a4e2-2e1b25ba9ff9 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:49.782973 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-208efdc8-c41f-4015-a4e2-2e1b25ba9ff9 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lazy-loading 'services' on Instance uuid a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:09:49.958174 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b3f1f6ac-288a-4866-afdc-c9f8f3aa1d41 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:49.966918 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b3f1f6ac-288a-4866-afdc-c9f8f3aa1d41 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/c3ac090d-3caa-404a-8f4d-5708f9fd04d6" status: 200 len: 1314 microversion: 2.1 time: 1.044672 Jul 18 02:09:49.969858 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 281/574] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:48 2022] GET /compute/v2.1/servers/c3ac090d-3caa-404a-8f4d-5708f9fd04d6 => generated 1314 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:49.979261 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-208efdc8-c41f-4015-a4e2-2e1b25ba9ff9 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 200 len: 1929 microversion: 2.75 time: 0.624056 Jul 18 02:09:49.983540 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1c1ecee8-065e-493d-aafb-c00dfc742175 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a8f1ff70>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:49.992283 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 294/575] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:09:49 2022] GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 1929 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:09:49.997853 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cb7c0eaa-a409-40f0-94d8-0f52b2708394 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:49.999407 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cb7c0eaa-a409-40f0-94d8-0f52b2708394 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: bd14a732-a9ad-4dfd-af61-69b84eda8877] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:50.007266 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cb7c0eaa-a409-40f0-94d8-0f52b2708394 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:50.007941 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cb7c0eaa-a409-40f0-94d8-0f52b2708394 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:50.008899 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cb7c0eaa-a409-40f0-94d8-0f52b2708394 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:50.009519 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cb7c0eaa-a409-40f0-94d8-0f52b2708394 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:50.025979 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:09:50.056472 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1c1ecee8-065e-493d-aafb-c00dfc742175 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a" status: 200 len: 1410 microversion: 2.1 time: 0.080331 Jul 18 02:09:50.070204 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 282/576] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:09:49 2022] GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a => generated 1410 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:50.083848 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-424387c1-9910-4f5e-9089-38cbb1568a5a req-3f2b0f6c-17d1-4d26-9cb0-5f642b8ba5b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "092e9dd7-8734-42ae-9ad7-626438550736", "name": "network-vif-plugged", "status": "completed", "tag": "5653c487-e512-475c-8f13-aa4ee05e2542"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:50.100954 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-424387c1-9910-4f5e-9089-38cbb1568a5a req-3f2b0f6c-17d1-4d26-9cb0-5f642b8ba5b9 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:50.101808 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-424387c1-9910-4f5e-9089-38cbb1568a5a req-3f2b0f6c-17d1-4d26-9cb0-5f642b8ba5b9 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:50.130114 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-424387c1-9910-4f5e-9089-38cbb1568a5a req-3f2b0f6c-17d1-4d26-9cb0-5f642b8ba5b9 service nova] Creating event network-vif-plugged:5653c487-e512-475c-8f13-aa4ee05e2542 for instance 092e9dd7-8734-42ae-9ad7-626438550736 on n-h2-465891-3 Jul 18 02:09:50.139467 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-424387c1-9910-4f5e-9089-38cbb1568a5a req-3f2b0f6c-17d1-4d26-9cb0-5f642b8ba5b9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067612 Jul 18 02:09:50.144578 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 283/577] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:50.162266 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d66e553e-148b-4e2a-b789-aab60991da78 tempest-QuotasAdminNegativeTest-1708561238 tempest-QuotasAdminNegativeTest-1708561238-project-admin] Action: 'update', calling method: .version_select at 0x7ff4a9049310>, body: {"quota_set": {"cores": 20}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:50.308653 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d66e553e-148b-4e2a-b789-aab60991da78 tempest-QuotasAdminNegativeTest-1708561238 tempest-QuotasAdminNegativeTest-1708561238-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:50.309397 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d66e553e-148b-4e2a-b789-aab60991da78 tempest-QuotasAdminNegativeTest-1708561238 tempest-QuotasAdminNegativeTest-1708561238-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:50.310388 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d66e553e-148b-4e2a-b789-aab60991da78 tempest-QuotasAdminNegativeTest-1708561238 tempest-QuotasAdminNegativeTest-1708561238-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:50.310996 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d66e553e-148b-4e2a-b789-aab60991da78 tempest-QuotasAdminNegativeTest-1708561238 tempest-QuotasAdminNegativeTest-1708561238-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:50.583951 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d66e553e-148b-4e2a-b789-aab60991da78 tempest-QuotasAdminNegativeTest-1708561238 tempest-QuotasAdminNegativeTest-1708561238-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-quota-sets/e38be15647d74a8dafa2f2def74baeb7" status: 200 len: 329 microversion: 2.1 time: 0.437665 Jul 18 02:09:50.602120 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 284/578] 10.222.0.57 () {60 vars in 1261 bytes} [Mon Jul 18 02:09:50 2022] PUT /compute/v2.1/os-quota-sets/e38be15647d74a8dafa2f2def74baeb7 => generated 329 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:50.621621 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b081adfa-07e8-412c-8cef-7cc30304018e tempest-QuotasAdminNegativeTest-1708561238 tempest-QuotasAdminNegativeTest-1708561238-project-admin] Calling method '.version_select at 0x7ff4a8f35dc0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:50.785827 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b081adfa-07e8-412c-8cef-7cc30304018e tempest-QuotasAdminNegativeTest-1708561238 tempest-QuotasAdminNegativeTest-1708561238-project-admin] 10.222.0.57 "GET /compute/v2.1/os-quota-sets/e38be15647d74a8dafa2f2def74baeb7" status: 200 len: 371 microversion: 2.1 time: 0.182696 Jul 18 02:09:50.792908 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 285/579] 10.222.0.57 () {58 vars in 1241 bytes} [Mon Jul 18 02:09:50 2022] GET /compute/v2.1/os-quota-sets/e38be15647d74a8dafa2f2def74baeb7 => generated 371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:50.815516 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e6004211-ef82-4fa5-8d36-bc45f8331c01 tempest-QuotasAdminNegativeTest-1708561238 tempest-QuotasAdminNegativeTest-1708561238-project-admin] Action: 'update', calling method: .version_select at 0x7ff4a90de670>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:50.919229 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cb7c0eaa-a409-40f0-94d8-0f52b2708394 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:50.931964 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cb7c0eaa-a409-40f0-94d8-0f52b2708394 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877" status: 200 len: 1522 microversion: 2.1 time: 0.938283 Jul 18 02:09:50.932555 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 295/580] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:49 2022] GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877 => generated 1522 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:50.959007 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0b515938-347b-455f-b26b-2944b6bc7c31 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:50.962597 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0b515938-347b-455f-b26b-2944b6bc7c31 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Request method failure captured: Jul 18 02:09:50.962597 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877/action HTTP/1.1 Jul 18 02:09:50.962597 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:09:50.962597 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:09:50.962597 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:09:50.962597 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 285 Jul 18 02:09:50.962597 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:09:50.962597 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:09:50.962597 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:09:50.962597 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:09:50.962597 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MDHcKkxv785TruBaYZ9isdDskpkSTXS63FySdEQ2DQWlYCoBeefqvgfCQf6lXL0HIcBKCVhVPgBeigtx_Fr6JAMpyAfBIDaZdUpBEZ_ARmYr58LYp6mJVoQMeV86GVtrWumVWYiUwrWzpXpGhfDxCZstFRul6eTjV0GKZX_II9Blls Jul 18 02:09:50.962597 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:09:50.962597 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:09:50.962597 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:09:50.962597 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:09:50.962597 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:09:50.962597 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:09:50.962597 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: d6b1efcf9e224d66b7dbf31c8aa89f87 Jul 18 02:09:50.962597 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-872437023 Jul 18 02:09:50.962597 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:09:50.962597 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:09:50.964028 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d6b1efcf9e224d66b7dbf31c8aa89f87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d6b1efcf9e224d66b7dbf31c8aa89f87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d6b1efcf9e224d66b7dbf31c8aa89f87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d6b1efcf9e224d66b7dbf31c8aa89f87"}]}] Jul 18 02:09:50.964028 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-872437023 Jul 18 02:09:50.964028 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: d6b1efcf9e224d66b7dbf31c8aa89f87 Jul 18 02:09:50.964028 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-872437023 Jul 18 02:09:50.964028 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ImagesOneServerNegativeTestJSON-872437023-project Jul 18 02:09:50.964028 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:09:50.964028 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:09:50.964028 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 625ab51af53042138e5335e3ae6e5dac Jul 18 02:09:50.964028 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-872437023-project Jul 18 02:09:50.964028 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 02:09:50.964028 n-d-465891-3 devstack@n-api.service[119543]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 18 02:09:50.964734 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:09:50.964734 n-d-465891-3 devstack@n-api.service[119543]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 02:09:50.964734 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'bd14a732-a9ad-4dfd-af61-69b84eda8877', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 18 02:09:50.964734 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:09:50.964734 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:50.964734 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:09:50.964734 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:09:50.964734 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:09:50.964734 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:09:50.964734 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 02:09:50.965450 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:50.965450 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Jul 18 02:09:50.965450 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 18 02:09:50.965450 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:50.965450 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 18 02:09:50.965450 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 18 02:09:50.965450 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:50.965450 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:50.965450 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:50.965450 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:50.965450 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:50.965450 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:50.965450 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:09:50.965450 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:09:50.965450 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:09:50.965450 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:09:50.965450 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:09:50.965450 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:09:50.965450 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:09:50.965450 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:09:50.969543 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:09:50.969543 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:09:50.969543 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:09:50.969543 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:09:50.969543 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 02:09:50.969543 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:50.969543 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:50.969543 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:50.969543 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:50.969543 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:50.969543 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:50.969543 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:09:50.969543 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:09:50.975341 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 02:09:50.975341 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:09:50.975341 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0b515938-347b-455f-b26b-2944b6bc7c31 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:09:50.975341 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0b515938-347b-455f-b26b-2944b6bc7c31 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "POST /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877/action" status: 400 len: 619 microversion: 2.1 time: 0.020992 Jul 18 02:09:50.975988 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 296/581] 10.222.0.57 () {60 vars in 1278 bytes} [Mon Jul 18 02:09:50 2022] POST /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877/action => generated 619 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:09:50.984964 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-54b42e3f-5ebd-4edb-8b46-5e3081610449 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:50.985940 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-54b42e3f-5ebd-4edb-8b46-5e3081610449 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: bd14a732-a9ad-4dfd-af61-69b84eda8877] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:51.003353 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-54b42e3f-5ebd-4edb-8b46-5e3081610449 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:51.021085 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-54b42e3f-5ebd-4edb-8b46-5e3081610449 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:51.025479 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-54b42e3f-5ebd-4edb-8b46-5e3081610449 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:51.026116 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-54b42e3f-5ebd-4edb-8b46-5e3081610449 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:51.051792 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e6004211-ef82-4fa5-8d36-bc45f8331c01 tempest-QuotasAdminNegativeTest-1708561238 tempest-QuotasAdminNegativeTest-1708561238-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:51.054292 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e6004211-ef82-4fa5-8d36-bc45f8331c01 tempest-QuotasAdminNegativeTest-1708561238 tempest-QuotasAdminNegativeTest-1708561238-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:51.057386 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e6004211-ef82-4fa5-8d36-bc45f8331c01 tempest-QuotasAdminNegativeTest-1708561238 tempest-QuotasAdminNegativeTest-1708561238-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:51.063011 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e6004211-ef82-4fa5-8d36-bc45f8331c01 tempest-QuotasAdminNegativeTest-1708561238 tempest-QuotasAdminNegativeTest-1708561238-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:51.207992 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:09:51.282843 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e6004211-ef82-4fa5-8d36-bc45f8331c01 tempest-QuotasAdminNegativeTest-1708561238 tempest-QuotasAdminNegativeTest-1708561238-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-quota-sets/e38be15647d74a8dafa2f2def74baeb7" status: 200 len: 328 microversion: 2.1 time: 0.482136 Jul 18 02:09:51.284227 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 286/582] 10.222.0.57 () {60 vars in 1261 bytes} [Mon Jul 18 02:09:50 2022] PUT /compute/v2.1/os-quota-sets/e38be15647d74a8dafa2f2def74baeb7 => generated 328 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:51.300450 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-51446326-f638-4555-b6e9-ad323a5cd218 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:51.304521 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-51446326-f638-4555-b6e9-ad323a5cd218 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: c3ac090d-3caa-404a-8f4d-5708f9fd04d6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:51.321359 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-51446326-f638-4555-b6e9-ad323a5cd218 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:51.321603 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-51446326-f638-4555-b6e9-ad323a5cd218 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:51.326507 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-51446326-f638-4555-b6e9-ad323a5cd218 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:51.327001 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-51446326-f638-4555-b6e9-ad323a5cd218 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:51.611634 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-54b42e3f-5ebd-4edb-8b46-5e3081610449 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:51.626218 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-54b42e3f-5ebd-4edb-8b46-5e3081610449 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877" status: 200 len: 1522 microversion: 2.1 time: 0.650941 Jul 18 02:09:51.640327 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 297/583] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:50 2022] GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877 => generated 1522 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:51.659269 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fb6cb2df-1fdd-41d8-8552-7f874f301a8a tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:51.661164 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fb6cb2df-1fdd-41d8-8552-7f874f301a8a tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:51.679507 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fb6cb2df-1fdd-41d8-8552-7f874f301a8a tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:51.680133 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fb6cb2df-1fdd-41d8-8552-7f874f301a8a tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:51.682068 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fb6cb2df-1fdd-41d8-8552-7f874f301a8a tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:51.687788 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fb6cb2df-1fdd-41d8-8552-7f874f301a8a tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:51.979797 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-fb6cb2df-1fdd-41d8-8552-7f874f301a8a tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lazy-loading 'services' on Instance uuid a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:09:52.004164 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-51446326-f638-4555-b6e9-ad323a5cd218 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:52.016999 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-51446326-f638-4555-b6e9-ad323a5cd218 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/c3ac090d-3caa-404a-8f4d-5708f9fd04d6" status: 200 len: 1314 microversion: 2.1 time: 0.727180 Jul 18 02:09:52.017885 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 287/584] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:51 2022] GET /compute/v2.1/servers/c3ac090d-3caa-404a-8f4d-5708f9fd04d6 => generated 1314 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:52.033517 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3a7fb81f-3ac9-44e1-91e3-67aeb6dc2163 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a90499d0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:52.110402 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fb6cb2df-1fdd-41d8-8552-7f874f301a8a tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 200 len: 1929 microversion: 2.75 time: 0.466789 Jul 18 02:09:52.113622 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 298/585] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:09:51 2022] GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 1929 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:09:52.142280 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-adf12650-e40d-44f3-be92-af76360968fa tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:52.142997 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-adf12650-e40d-44f3-be92-af76360968fa tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: f77b267e-9a20-4943-aa8b-0c82b9d6d20e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:52.195766 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3a7fb81f-3ac9-44e1-91e3-67aeb6dc2163 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a" status: 200 len: 1410 microversion: 2.1 time: 0.174683 Jul 18 02:09:52.197000 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 288/586] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:09:52 2022] GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a => generated 1410 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:52.200758 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-adf12650-e40d-44f3-be92-af76360968fa tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:52.203367 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-adf12650-e40d-44f3-be92-af76360968fa tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:52.208486 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-adf12650-e40d-44f3-be92-af76360968fa tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:52.210460 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-adf12650-e40d-44f3-be92-af76360968fa tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:52.216699 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-e9f0c548-f229-4feb-b105-4991cb946382 req-03386f95-37e2-406c-add5-d68f747dac10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f77b267e-9a20-4943-aa8b-0c82b9d6d20e", "tag": "3cecd7e8-61af-4808-991a-e40ca83842b0"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:52.258722 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-e9f0c548-f229-4feb-b105-4991cb946382 req-03386f95-37e2-406c-add5-d68f747dac10 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:52.259511 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-e9f0c548-f229-4feb-b105-4991cb946382 req-03386f95-37e2-406c-add5-d68f747dac10 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:52.311633 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-e9f0c548-f229-4feb-b105-4991cb946382 req-03386f95-37e2-406c-add5-d68f747dac10 service nova] Creating event network-changed:3cecd7e8-61af-4808-991a-e40ca83842b0 for instance f77b267e-9a20-4943-aa8b-0c82b9d6d20e on n-h1-465891-3 Jul 18 02:09:52.327710 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-e9f0c548-f229-4feb-b105-4991cb946382 req-03386f95-37e2-406c-add5-d68f747dac10 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128083 Jul 18 02:09:52.331482 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 289/587] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:52.346157 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b901f839-86d3-4942-87e8-26a706d5d1b8 tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-901434613", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:52.434162 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-b901f839-86d3-4942-87e8-26a706d5d1b8 tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] validate_networks() for None {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:09:53.743321 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-adf12650-e40d-44f3-be92-af76360968fa tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60118d593f96437dbb2c68ad2fadd465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd02ce642caf4529a6e65c184de0ad19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:53.755991 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-adf12650-e40d-44f3-be92-af76360968fa tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e" status: 200 len: 1586 microversion: 2.1 time: 1.641062 Jul 18 02:09:53.761598 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 299/588] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:52 2022] GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e => generated 1586 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:53.775231 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-931421c5-f37e-4542-aac8-c98708099e9e tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:53.784271 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-931421c5-f37e-4542-aac8-c98708099e9e tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: bd14a732-a9ad-4dfd-af61-69b84eda8877] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:53.796260 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-931421c5-f37e-4542-aac8-c98708099e9e tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:53.799077 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-931421c5-f37e-4542-aac8-c98708099e9e tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:53.802998 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-931421c5-f37e-4542-aac8-c98708099e9e tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:53.803822 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-931421c5-f37e-4542-aac8-c98708099e9e tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:54.000635 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-b901f839-86d3-4942-87e8-26a706d5d1b8 tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:09:54.001201 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-b901f839-86d3-4942-87e8-26a706d5d1b8 tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:09:54.001981 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-b901f839-86d3-4942-87e8-26a706d5d1b8 tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:09:54.002490 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-b901f839-86d3-4942-87e8-26a706d5d1b8 tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:09:54.003068 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-b901f839-86d3-4942-87e8-26a706d5d1b8 tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:09:54.035024 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b901f839-86d3-4942-87e8-26a706d5d1b8 tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:54.036179 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b901f839-86d3-4942-87e8-26a706d5d1b8 tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:54.038095 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b901f839-86d3-4942-87e8-26a706d5d1b8 tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:54.039757 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b901f839-86d3-4942-87e8-26a706d5d1b8 tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:54.092040 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-b901f839-86d3-4942-87e8-26a706d5d1b8 tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Getting quotas for project e38be15647d74a8dafa2f2def74baeb7. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:09:54.106922 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-b901f839-86d3-4942-87e8-26a706d5d1b8 tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Getting quotas for user 688594ccf76e4d1aab525934d983df65 and project e38be15647d74a8dafa2f2def74baeb7. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:09:54.143735 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.utils [None req-b901f839-86d3-4942-87e8-26a706d5d1b8 tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] instances quota exceeded for e38be15647d74a8dafa2f2def74baeb7, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119544) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 18 02:09:54.150137 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-b901f839-86d3-4942-87e8-26a706d5d1b8 tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 18 02:09:54.154005 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b901f839-86d3-4942-87e8-26a706d5d1b8 tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Request method failure captured: Jul 18 02:09:54.154005 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:09:54.154005 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:09:54.154005 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:09:54.154005 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:09:54.154005 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 144 Jul 18 02:09:54.154005 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:09:54.154005 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:09:54.154005 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:09:54.154005 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:09:54.154005 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MDmJddQrtVMur52UTrdQpSh1RBnPEgFZd6UzfL_EqMlpEYFum4hwHRuOK2V2vSKfv7Sh_Xkx8yNe1_iNiB41JHR9HmkzCqhu_my9KzRUrhG7g8Om6kQWNbtiPiCbQnu9rZOSsVe-BeHuez5y-o82_0AVxfV3rVxHRfxhpzaXiWwxcA Jul 18 02:09:54.154005 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:09:54.154005 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:09:54.154005 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:09:54.154005 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:09:54.154005 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:09:54.154005 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:09:54.154005 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: e38be15647d74a8dafa2f2def74baeb7 Jul 18 02:09:54.154005 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-QuotasAdminNegativeTest-1264824889 Jul 18 02:09:54.154005 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:09:54.154005 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:09:54.155886 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e38be15647d74a8dafa2f2def74baeb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e38be15647d74a8dafa2f2def74baeb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e38be15647d74a8dafa2f2def74baeb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e38be15647d74a8dafa2f2def74baeb7"}]}] Jul 18 02:09:54.155886 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-QuotasAdminNegativeTest-1264824889 Jul 18 02:09:54.155886 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: e38be15647d74a8dafa2f2def74baeb7 Jul 18 02:09:54.155886 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1264824889 Jul 18 02:09:54.155886 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-QuotasAdminNegativeTest-1264824889-project Jul 18 02:09:54.155886 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:09:54.155886 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:09:54.155886 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 688594ccf76e4d1aab525934d983df65 Jul 18 02:09:54.155886 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-QuotasAdminNegativeTest-1264824889-project Jul 18 02:09:54.155886 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:09:54.155886 n-d-465891-3 devstack@n-api.service[119544]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-901434613", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452"}} Jul 18 02:09:54.155886 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:09:54.156747 n-d-465891-3 devstack@n-api.service[119544]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 18 02:09:54.156747 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-901434613', 'imageRef': '3bb0a19f-5b69-48ee-a771-8fd416f92f36', 'flavorRef': '452'}}} Jul 18 02:09:54.156747 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:09:54.156747 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:54.156747 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 18 02:09:54.156747 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 18 02:09:54.156747 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:09:54.156747 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:09:54.156747 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 18 02:09:54.156747 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc Jul 18 02:09:54.156747 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 18 02:09:54.156747 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 18 02:09:54.156747 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:09:54.156747 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:09:54.156747 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 18 02:09:54.156747 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 18 02:09:54.156747 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 18 02:09:54.156747 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 18 02:09:54.158087 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 18 02:09:54.158087 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 18 02:09:54.158087 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Jul 18 02:09:54.158087 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:54.158087 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:54.158087 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:54.158087 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:54.158087 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 18 02:09:54.158087 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 18 02:09:54.158087 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 18 02:09:54.158087 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 18 02:09:54.158087 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 18 02:09:54.158087 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 18 02:09:54.158087 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 18 02:09:54.158087 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 18 02:09:54.158087 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 18 02:09:54.158087 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 18 02:09:54.158087 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 18 02:09:54.158087 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:54.158087 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:54.158087 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:54.159540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:54.159540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:54.159540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:54.159540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:09:54.159540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:09:54.159540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:09:54.159540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:09:54.159540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:09:54.159540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:09:54.159540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:09:54.159540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:09:54.159540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:09:54.159540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:09:54.159540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 18 02:09:54.159540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 18 02:09:54.159540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 18 02:09:54.159540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 18 02:09:54.159540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:54.159540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:54.159540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:54.159540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:54.161030 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:54.161030 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:54.161030 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:09:54.161030 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:09:54.161030 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 18 02:09:54.161030 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:54.169726 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b901f839-86d3-4942-87e8-26a706d5d1b8 tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:09:54.171385 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b901f839-86d3-4942-87e8-26a706d5d1b8 tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.838124 Jul 18 02:09:54.173306 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 290/589] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:09:52 2022] POST /compute/v2.1/servers => generated 119 bytes in 1841 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:09:54.186339 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2b88d44b-08da-47ca-84ff-29937cfe6467 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:54.188957 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2b88d44b-08da-47ca-84ff-29937cfe6467 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: c3ac090d-3caa-404a-8f4d-5708f9fd04d6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:54.211310 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2b88d44b-08da-47ca-84ff-29937cfe6467 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:54.212450 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2b88d44b-08da-47ca-84ff-29937cfe6467 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:54.214316 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2b88d44b-08da-47ca-84ff-29937cfe6467 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:54.215580 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2b88d44b-08da-47ca-84ff-29937cfe6467 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:54.486544 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-931421c5-f37e-4542-aac8-c98708099e9e tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:54.499291 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-931421c5-f37e-4542-aac8-c98708099e9e tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877" status: 200 len: 1522 microversion: 2.1 time: 0.734617 Jul 18 02:09:54.502666 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 300/590] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:53 2022] GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877 => generated 1522 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:54.518970 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-905bcf3d-9973-4b2b-b739-b42d19cb8b4b tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:54.522316 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-905bcf3d-9973-4b2b-b739-b42d19cb8b4b tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:54.549805 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-905bcf3d-9973-4b2b-b739-b42d19cb8b4b tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:54.550594 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-905bcf3d-9973-4b2b-b739-b42d19cb8b4b tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:54.554277 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-905bcf3d-9973-4b2b-b739-b42d19cb8b4b tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:54.555707 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-905bcf3d-9973-4b2b-b739-b42d19cb8b4b tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:54.798341 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2b88d44b-08da-47ca-84ff-29937cfe6467 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:54.813885 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2b88d44b-08da-47ca-84ff-29937cfe6467 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/c3ac090d-3caa-404a-8f4d-5708f9fd04d6" status: 200 len: 1314 microversion: 2.1 time: 0.638651 Jul 18 02:09:54.814610 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 291/591] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:54 2022] GET /compute/v2.1/servers/c3ac090d-3caa-404a-8f4d-5708f9fd04d6 => generated 1314 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:54.823520 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-53045037-e2f6-4cf8-8af5-fdce17424c24 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a9054d30>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:54.840501 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-905bcf3d-9973-4b2b-b739-b42d19cb8b4b tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lazy-loading 'services' on Instance uuid a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:09:54.883691 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-53045037-e2f6-4cf8-8af5-fdce17424c24 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a" status: 200 len: 1410 microversion: 2.1 time: 0.067569 Jul 18 02:09:54.886737 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 292/592] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:09:54 2022] GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a => generated 1410 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:54.894203 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-5b8a1203-c0d3-41b5-b245-a13a97ea5852 req-6480dc25-304e-4ca6-b492-19aabcd42c59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3ac090d-3caa-404a-8f4d-5708f9fd04d6", "name": "network-vif-plugged", "status": "completed", "tag": "3452aafc-709f-4bc0-87ce-db2523fa6dc8"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:54.899739 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-905bcf3d-9973-4b2b-b739-b42d19cb8b4b tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 200 len: 1929 microversion: 2.75 time: 0.395643 Jul 18 02:09:54.900716 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 301/593] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:09:54 2022] GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 1929 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:09:54.919275 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-5b8a1203-c0d3-41b5-b245-a13a97ea5852 req-6480dc25-304e-4ca6-b492-19aabcd42c59 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:54.921198 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-5b8a1203-c0d3-41b5-b245-a13a97ea5852 req-6480dc25-304e-4ca6-b492-19aabcd42c59 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:54.933467 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-88849fda-3d9d-4d3b-a5a1-ffb0655b9000 tempest-QuotasAdminNegativeTest-1708561238 tempest-QuotasAdminNegativeTest-1708561238-project-admin] Action: 'update', calling method: .version_select at 0x7ff4a8ff9310>, body: {"quota_set": {"instances": 10}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:54.941601 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-5b8a1203-c0d3-41b5-b245-a13a97ea5852 req-6480dc25-304e-4ca6-b492-19aabcd42c59 service nova] Creating event network-vif-plugged:3452aafc-709f-4bc0-87ce-db2523fa6dc8 for instance c3ac090d-3caa-404a-8f4d-5708f9fd04d6 on n-h2-465891-3 Jul 18 02:09:54.956941 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-5b8a1203-c0d3-41b5-b245-a13a97ea5852 req-6480dc25-304e-4ca6-b492-19aabcd42c59 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068623 Jul 18 02:09:54.969175 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 293/594] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:54.983974 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-92c13aee-09d5-49ef-a5bb-d7eec6051332 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-136455519"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:54.993200 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-92c13aee-09d5-49ef-a5bb-d7eec6051332 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: bd14a732-a9ad-4dfd-af61-69b84eda8877] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:55.005206 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-92c13aee-09d5-49ef-a5bb-d7eec6051332 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:55.008381 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-92c13aee-09d5-49ef-a5bb-d7eec6051332 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:55.011160 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-92c13aee-09d5-49ef-a5bb-d7eec6051332 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:55.012769 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-92c13aee-09d5-49ef-a5bb-d7eec6051332 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:55.019312 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:09:55.450222 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-88849fda-3d9d-4d3b-a5a1-ffb0655b9000 tempest-QuotasAdminNegativeTest-1708561238 tempest-QuotasAdminNegativeTest-1708561238-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:55.450971 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-88849fda-3d9d-4d3b-a5a1-ffb0655b9000 tempest-QuotasAdminNegativeTest-1708561238 tempest-QuotasAdminNegativeTest-1708561238-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:55.453299 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-88849fda-3d9d-4d3b-a5a1-ffb0655b9000 tempest-QuotasAdminNegativeTest-1708561238 tempest-QuotasAdminNegativeTest-1708561238-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:55.455111 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-88849fda-3d9d-4d3b-a5a1-ffb0655b9000 tempest-QuotasAdminNegativeTest-1708561238 tempest-QuotasAdminNegativeTest-1708561238-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:55.504062 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:DELETE=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:09:55.606761 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-88849fda-3d9d-4d3b-a5a1-ffb0655b9000 tempest-QuotasAdminNegativeTest-1708561238 tempest-QuotasAdminNegativeTest-1708561238-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-quota-sets/e38be15647d74a8dafa2f2def74baeb7" status: 200 len: 329 microversion: 2.1 time: 0.680843 Jul 18 02:09:55.624442 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 302/595] 10.222.0.57 () {60 vars in 1261 bytes} [Mon Jul 18 02:09:54 2022] PUT /compute/v2.1/os-quota-sets/e38be15647d74a8dafa2f2def74baeb7 => generated 329 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:55.636198 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-044a5e4c-efe0-43f3-87e3-f3cbadb9c2f6 tempest-QuotasAdminNegativeTest-1708561238 tempest-QuotasAdminNegativeTest-1708561238-project-admin] Calling method '.version_select at 0x7ff4a8ff9550>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:55.734183 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-92c13aee-09d5-49ef-a5bb-d7eec6051332 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "POST /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877/action" status: 202 len: 0 microversion: 2.1 time: 0.760211 Jul 18 02:09:55.738486 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 294/596] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:09:54 2022] POST /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877/action => generated 0 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 18 02:09:55.760067 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-044a5e4c-efe0-43f3-87e3-f3cbadb9c2f6 tempest-QuotasAdminNegativeTest-1708561238 tempest-QuotasAdminNegativeTest-1708561238-project-admin] 10.222.0.57 "GET /compute/v2.1/os-quota-sets/e38be15647d74a8dafa2f2def74baeb7" status: 200 len: 371 microversion: 2.1 time: 0.133968 Jul 18 02:09:55.761059 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 303/597] 10.222.0.57 () {58 vars in 1241 bytes} [Mon Jul 18 02:09:55 2022] GET /compute/v2.1/os-quota-sets/e38be15647d74a8dafa2f2def74baeb7 => generated 371 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:55.771690 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ddef2c04-5a93-4b2d-b2cb-022f8f05923a tempest-QuotasAdminNegativeTest-1708561238 tempest-QuotasAdminNegativeTest-1708561238-project-admin] Action: 'update', calling method: .version_select at 0x7ff4a8f23310>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:55.791934 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e5bef860-cc69-4b42-b72b-7fc19871bf90 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1358807729"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:55.794928 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e5bef860-cc69-4b42-b72b-7fc19871bf90 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: bd14a732-a9ad-4dfd-af61-69b84eda8877] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:55.810139 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e5bef860-cc69-4b42-b72b-7fc19871bf90 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:55.814968 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e5bef860-cc69-4b42-b72b-7fc19871bf90 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:55.818064 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e5bef860-cc69-4b42-b72b-7fc19871bf90 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:55.823687 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e5bef860-cc69-4b42-b72b-7fc19871bf90 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:55.917080 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-e5bef860-cc69-4b42-b72b-7fc19871bf90 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] HTTP exception thrown: Cannot 'createImage' instance bd14a732-a9ad-4dfd-af61-69b84eda8877 while it is in task_state image_snapshot_pending Jul 18 02:09:55.919363 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e5bef860-cc69-4b42-b72b-7fc19871bf90 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Request method failure captured: Jul 18 02:09:55.919363 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877/action HTTP/1.1 Jul 18 02:09:55.919363 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:09:55.919363 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:09:55.919363 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:09:55.919363 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 85 Jul 18 02:09:55.919363 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:09:55.919363 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:09:55.919363 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:09:55.919363 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:09:55.919363 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MDHcKkxv785TruBaYZ9isdDskpkSTXS63FySdEQ2DQWlYCoBeefqvgfCQf6lXL0HIcBKCVhVPgBeigtx_Fr6JAMpyAfBIDaZdUpBEZ_ARmYr58LYp6mJVoQMeV86GVtrWumVWYiUwrWzpXpGhfDxCZstFRul6eTjV0GKZX_II9Blls Jul 18 02:09:55.919363 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:09:55.919363 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:09:55.919363 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:09:55.919363 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:09:55.919363 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:09:55.919363 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:09:55.919363 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: d6b1efcf9e224d66b7dbf31c8aa89f87 Jul 18 02:09:55.919363 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-872437023 Jul 18 02:09:55.919363 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:09:55.919363 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:09:55.920903 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d6b1efcf9e224d66b7dbf31c8aa89f87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d6b1efcf9e224d66b7dbf31c8aa89f87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d6b1efcf9e224d66b7dbf31c8aa89f87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d6b1efcf9e224d66b7dbf31c8aa89f87"}]}] Jul 18 02:09:55.920903 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-872437023 Jul 18 02:09:55.920903 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: d6b1efcf9e224d66b7dbf31c8aa89f87 Jul 18 02:09:55.920903 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-872437023 Jul 18 02:09:55.920903 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ImagesOneServerNegativeTestJSON-872437023-project Jul 18 02:09:55.920903 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:09:55.920903 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:09:55.920903 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 625ab51af53042138e5335e3ae6e5dac Jul 18 02:09:55.920903 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-872437023-project Jul 18 02:09:55.920903 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:09:55.920903 n-d-465891-3 devstack@n-api.service[119544]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1358807729"}} Jul 18 02:09:55.920903 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:09:55.921682 n-d-465891-3 devstack@n-api.service[119544]: exception: Cannot 'createImage' instance bd14a732-a9ad-4dfd-af61-69b84eda8877 while it is in task_state image_snapshot_pending Jul 18 02:09:55.921682 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'bd14a732-a9ad-4dfd-af61-69b84eda8877', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1358807729'}}} Jul 18 02:09:55.921682 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:09:55.921682 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:55.921682 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Jul 18 02:09:55.921682 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Jul 18 02:09:55.921682 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Jul 18 02:09:55.921682 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 02:09:55.921682 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bd14a732-a9ad-4dfd-af61-69b84eda8877 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Jul 18 02:09:55.921682 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:55.921682 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:55.921682 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:55.921682 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:55.921682 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:55.921682 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:55.921682 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:09:55.921682 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:09:55.921682 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:09:55.921682 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:09:55.922878 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:09:55.922878 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:09:55.922878 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:09:55.922878 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:09:55.922878 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Jul 18 02:09:55.922878 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 02:09:55.922878 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 02:09:55.922878 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 02:09:55.922878 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance bd14a732-a9ad-4dfd-af61-69b84eda8877 while it is in task_state image_snapshot_pending Jul 18 02:09:55.922878 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:55.922878 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:55.922878 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:55.922878 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:55.922878 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:55.922878 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:55.922878 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:09:55.922878 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:09:55.922878 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance bd14a732-a9ad-4dfd-af61-69b84eda8877 while it is in task_state image_snapshot_pending Jul 18 02:09:55.922878 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:55.927171 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e5bef860-cc69-4b42-b72b-7fc19871bf90 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Returning 409 to user: Cannot 'createImage' instance bd14a732-a9ad-4dfd-af61-69b84eda8877 while it is in task_state image_snapshot_pending {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:09:55.928036 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e5bef860-cc69-4b42-b72b-7fc19871bf90 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "POST /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877/action" status: 409 len: 167 microversion: 2.1 time: 0.183498 Jul 18 02:09:55.930493 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ddef2c04-5a93-4b2d-b2cb-022f8f05923a tempest-QuotasAdminNegativeTest-1708561238 tempest-QuotasAdminNegativeTest-1708561238-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:55.937816 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ddef2c04-5a93-4b2d-b2cb-022f8f05923a tempest-QuotasAdminNegativeTest-1708561238 tempest-QuotasAdminNegativeTest-1708561238-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:55.943529 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 295/598] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:09:55 2022] POST /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877/action => generated 167 bytes in 200 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:09:55.946291 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ddef2c04-5a93-4b2d-b2cb-022f8f05923a tempest-QuotasAdminNegativeTest-1708561238 tempest-QuotasAdminNegativeTest-1708561238-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:55.947767 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ddef2c04-5a93-4b2d-b2cb-022f8f05923a tempest-QuotasAdminNegativeTest-1708561238 tempest-QuotasAdminNegativeTest-1708561238-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:55.954746 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-611cb7dd-7258-46d5-8709-040889c0e6e0 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:55.963138 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-611cb7dd-7258-46d5-8709-040889c0e6e0 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: c3ac090d-3caa-404a-8f4d-5708f9fd04d6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:55.985942 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-611cb7dd-7258-46d5-8709-040889c0e6e0 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:55.990366 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-611cb7dd-7258-46d5-8709-040889c0e6e0 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:55.991409 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-611cb7dd-7258-46d5-8709-040889c0e6e0 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:55.992010 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-611cb7dd-7258-46d5-8709-040889c0e6e0 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:56.142100 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ddef2c04-5a93-4b2d-b2cb-022f8f05923a tempest-QuotasAdminNegativeTest-1708561238 tempest-QuotasAdminNegativeTest-1708561238-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-quota-sets/e38be15647d74a8dafa2f2def74baeb7" status: 200 len: 325 microversion: 2.1 time: 0.370934 Jul 18 02:09:56.153724 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 304/599] 10.222.0.57 () {60 vars in 1261 bytes} [Mon Jul 18 02:09:55 2022] PUT /compute/v2.1/os-quota-sets/e38be15647d74a8dafa2f2def74baeb7 => generated 325 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:56.180165 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8d1e427f-a106-45cf-baa4-a39812f36553 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a8ff5700>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:56.258609 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8d1e427f-a106-45cf-baa4-a39812f36553 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a" status: 200 len: 1410 microversion: 2.1 time: 0.090201 Jul 18 02:09:56.259354 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 305/600] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:09:56 2022] GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a => generated 1410 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:56.278903 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2053abeb-e4af-44bf-9b37-c13ca6e1a0c8 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:56.283157 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2053abeb-e4af-44bf-9b37-c13ca6e1a0c8 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:56.300863 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2053abeb-e4af-44bf-9b37-c13ca6e1a0c8 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:56.303909 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2053abeb-e4af-44bf-9b37-c13ca6e1a0c8 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:56.305409 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2053abeb-e4af-44bf-9b37-c13ca6e1a0c8 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:56.307159 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2053abeb-e4af-44bf-9b37-c13ca6e1a0c8 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:56.622578 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-2053abeb-e4af-44bf-9b37-c13ca6e1a0c8 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lazy-loading 'services' on Instance uuid a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:09:56.721906 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2053abeb-e4af-44bf-9b37-c13ca6e1a0c8 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 200 len: 1929 microversion: 2.75 time: 0.455263 Jul 18 02:09:56.722757 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 306/601] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:09:56 2022] GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 1929 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:09:56.734985 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-703d1bb4-ed32-43bd-9313-1f82b7aaf2eb tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '.version_select at 0x7ff4a9165160>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:56.944366 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-611cb7dd-7258-46d5-8709-040889c0e6e0 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:56.975463 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-611cb7dd-7258-46d5-8709-040889c0e6e0 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/c3ac090d-3caa-404a-8f4d-5708f9fd04d6" status: 200 len: 1314 microversion: 2.1 time: 1.028498 Jul 18 02:09:56.980386 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 296/602] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:55 2022] GET /compute/v2.1/servers/c3ac090d-3caa-404a-8f4d-5708f9fd04d6 => generated 1314 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:57.001395 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-10ffd8fb-d67f-4830-be44-258e59d1a9f0 tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1028047386", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:57.197125 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-703d1bb4-ed32-43bd-9313-1f82b7aaf2eb tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "DELETE /compute/v2.1/images/668480f3-bcc3-45c8-bf15-a9c791e96fe2" status: 204 len: 0 microversion: 2.1 time: 0.470025 Jul 18 02:09:57.199973 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 307/603] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:56 2022] DELETE /compute/v2.1/images/668480f3-bcc3-45c8-bf15-a9c791e96fe2 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:09:57.211681 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3d57ed0d-84bd-4adb-bbd6-665f6f994037 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:57.212601 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3d57ed0d-84bd-4adb-bbd6-665f6f994037 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: bd14a732-a9ad-4dfd-af61-69b84eda8877] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:57.229197 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3d57ed0d-84bd-4adb-bbd6-665f6f994037 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:57.229940 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3d57ed0d-84bd-4adb-bbd6-665f6f994037 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:57.245971 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3d57ed0d-84bd-4adb-bbd6-665f6f994037 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:57.247097 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3d57ed0d-84bd-4adb-bbd6-665f6f994037 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:57.282259 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-10ffd8fb-d67f-4830-be44-258e59d1a9f0 tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] validate_networks() for None {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:09:58.724655 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3d57ed0d-84bd-4adb-bbd6-665f6f994037 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:58.748124 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3d57ed0d-84bd-4adb-bbd6-665f6f994037 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877" status: 200 len: 1534 microversion: 2.1 time: 1.542858 Jul 18 02:09:58.757891 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 308/604] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:57 2022] GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877 => generated 1534 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:58.800259 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7c17fbe6-1d28-4618-8bba-e644160e539e tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a8ff5940>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:58.838020 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-10ffd8fb-d67f-4830-be44-258e59d1a9f0 tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:09:58.838538 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-10ffd8fb-d67f-4830-be44-258e59d1a9f0 tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:09:58.841506 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-10ffd8fb-d67f-4830-be44-258e59d1a9f0 tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:09:58.845775 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-10ffd8fb-d67f-4830-be44-258e59d1a9f0 tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:09:58.846308 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-10ffd8fb-d67f-4830-be44-258e59d1a9f0 tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:09:58.891763 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-10ffd8fb-d67f-4830-be44-258e59d1a9f0 tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:58.893631 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-10ffd8fb-d67f-4830-be44-258e59d1a9f0 tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:58.901023 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-10ffd8fb-d67f-4830-be44-258e59d1a9f0 tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:58.901979 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-10ffd8fb-d67f-4830-be44-258e59d1a9f0 tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:58.937593 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7c17fbe6-1d28-4618-8bba-e644160e539e tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a" status: 200 len: 1410 microversion: 2.1 time: 0.187613 Jul 18 02:09:58.938592 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 309/605] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:09:58 2022] GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a => generated 1410 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:58.944639 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-649913be-5777-4aed-86cf-a06584f28f19 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:58.960515 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-649913be-5777-4aed-86cf-a06584f28f19 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:58.970661 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-10ffd8fb-d67f-4830-be44-258e59d1a9f0 tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Getting quotas for project e38be15647d74a8dafa2f2def74baeb7. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:09:58.987252 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-10ffd8fb-d67f-4830-be44-258e59d1a9f0 tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Getting quotas for user 688594ccf76e4d1aab525934d983df65 and project e38be15647d74a8dafa2f2def74baeb7. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:09:59.005279 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-649913be-5777-4aed-86cf-a06584f28f19 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:59.006339 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-649913be-5777-4aed-86cf-a06584f28f19 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:59.016529 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-649913be-5777-4aed-86cf-a06584f28f19 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:59.018080 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-649913be-5777-4aed-86cf-a06584f28f19 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:59.033213 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.utils [None req-10ffd8fb-d67f-4830-be44-258e59d1a9f0 tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] ram quota exceeded for e38be15647d74a8dafa2f2def74baeb7, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119544) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 18 02:09:59.033812 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-10ffd8fb-d67f-4830-be44-258e59d1a9f0 tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 18 02:09:59.043719 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-10ffd8fb-d67f-4830-be44-258e59d1a9f0 tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Request method failure captured: Jul 18 02:09:59.043719 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:09:59.043719 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:09:59.043719 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:09:59.043719 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:09:59.043719 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 145 Jul 18 02:09:59.043719 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:09:59.043719 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:09:59.043719 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:09:59.043719 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:09:59.043719 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MDmJddQrtVMur52UTrdQpSh1RBnPEgFZd6UzfL_EqMlpEYFum4hwHRuOK2V2vSKfv7Sh_Xkx8yNe1_iNiB41JHR9HmkzCqhu_my9KzRUrhG7g8Om6kQWNbtiPiCbQnu9rZOSsVe-BeHuez5y-o82_0AVxfV3rVxHRfxhpzaXiWwxcA Jul 18 02:09:59.043719 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:09:59.043719 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:09:59.043719 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:09:59.043719 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:09:59.043719 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:09:59.043719 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:09:59.043719 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: e38be15647d74a8dafa2f2def74baeb7 Jul 18 02:09:59.043719 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-QuotasAdminNegativeTest-1264824889 Jul 18 02:09:59.043719 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:09:59.043719 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:09:59.045456 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e38be15647d74a8dafa2f2def74baeb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e38be15647d74a8dafa2f2def74baeb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e38be15647d74a8dafa2f2def74baeb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e38be15647d74a8dafa2f2def74baeb7"}]}] Jul 18 02:09:59.045456 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-QuotasAdminNegativeTest-1264824889 Jul 18 02:09:59.045456 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: e38be15647d74a8dafa2f2def74baeb7 Jul 18 02:09:59.045456 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1264824889 Jul 18 02:09:59.045456 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-QuotasAdminNegativeTest-1264824889-project Jul 18 02:09:59.045456 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:09:59.045456 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:09:59.045456 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 688594ccf76e4d1aab525934d983df65 Jul 18 02:09:59.045456 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-QuotasAdminNegativeTest-1264824889-project Jul 18 02:09:59.045456 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:09:59.045456 n-d-465891-3 devstack@n-api.service[119544]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1028047386", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452"}} Jul 18 02:09:59.045456 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:09:59.046239 n-d-465891-3 devstack@n-api.service[119544]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 18 02:09:59.046239 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1028047386', 'imageRef': '3bb0a19f-5b69-48ee-a771-8fd416f92f36', 'flavorRef': '452'}}} Jul 18 02:09:59.046239 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:09:59.046239 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:59.046239 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 18 02:09:59.046239 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 18 02:09:59.046239 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:09:59.046239 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:09:59.046239 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 18 02:09:59.046239 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc Jul 18 02:09:59.046239 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 18 02:09:59.046239 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 18 02:09:59.046239 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:09:59.046239 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:09:59.046239 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 18 02:09:59.046239 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 18 02:09:59.046239 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 18 02:09:59.046239 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 18 02:09:59.047275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 18 02:09:59.047275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 18 02:09:59.047275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 18 02:09:59.047275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:59.047275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:59.047275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:59.047275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:59.047275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 18 02:09:59.047275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 18 02:09:59.047275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 18 02:09:59.047275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 18 02:09:59.047275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 18 02:09:59.047275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 18 02:09:59.047275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 18 02:09:59.047275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 18 02:09:59.047275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 18 02:09:59.047275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 18 02:09:59.047275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 18 02:09:59.047275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:59.047275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:59.047275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:59.048496 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:59.048496 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:59.048496 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:59.048496 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:09:59.048496 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:09:59.048496 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:09:59.048496 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:09:59.048496 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:09:59.048496 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:09:59.048496 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:09:59.048496 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:09:59.048496 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:09:59.048496 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:09:59.048496 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 18 02:09:59.048496 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 18 02:09:59.048496 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 18 02:09:59.048496 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 18 02:09:59.048496 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:59.048496 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:59.048496 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:59.048496 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:59.049866 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:59.049866 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:59.049866 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:09:59.049866 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:09:59.049866 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 18 02:09:59.049866 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:59.049866 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-10ffd8fb-d67f-4830-be44-258e59d1a9f0 tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:09:59.049866 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-10ffd8fb-d67f-4830-be44-258e59d1a9f0 tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 2.055472 Jul 18 02:09:59.049866 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 297/606] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:09:56 2022] POST /compute/v2.1/servers => generated 110 bytes in 2065 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:09:59.059001 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-46ce2674-9fac-467a-9941-d8e27806c713 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:59.059693 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-46ce2674-9fac-467a-9941-d8e27806c713 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: c3ac090d-3caa-404a-8f4d-5708f9fd04d6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:59.080917 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-46ce2674-9fac-467a-9941-d8e27806c713 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:59.081381 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-46ce2674-9fac-467a-9941-d8e27806c713 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:59.084116 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-46ce2674-9fac-467a-9941-d8e27806c713 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:59.084474 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-46ce2674-9fac-467a-9941-d8e27806c713 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:59.347333 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-649913be-5777-4aed-86cf-a06584f28f19 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lazy-loading 'services' on Instance uuid a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:09:59.378734 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-649913be-5777-4aed-86cf-a06584f28f19 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 200 len: 1929 microversion: 2.75 time: 0.437607 Jul 18 02:09:59.379326 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 310/607] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:09:58 2022] GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 1929 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:09:59.394782 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-46c4da8d-a918-4b49-a559-0fbc3723b949 tempest-QuotasAdminNegativeTest-1708561238 tempest-QuotasAdminNegativeTest-1708561238-project-admin] Action: 'update', calling method: .version_select at 0x7ff4a90ff670>, body: {"quota_set": {"ram": 51200}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:59.580740 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-46c4da8d-a918-4b49-a559-0fbc3723b949 tempest-QuotasAdminNegativeTest-1708561238 tempest-QuotasAdminNegativeTest-1708561238-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:59.581614 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-46c4da8d-a918-4b49-a559-0fbc3723b949 tempest-QuotasAdminNegativeTest-1708561238 tempest-QuotasAdminNegativeTest-1708561238-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:59.582988 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-46c4da8d-a918-4b49-a559-0fbc3723b949 tempest-QuotasAdminNegativeTest-1708561238 tempest-QuotasAdminNegativeTest-1708561238-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:59.583809 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-46c4da8d-a918-4b49-a559-0fbc3723b949 tempest-QuotasAdminNegativeTest-1708561238 tempest-QuotasAdminNegativeTest-1708561238-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:59.770676 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-46ce2674-9fac-467a-9941-d8e27806c713 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:59.795227 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-46c4da8d-a918-4b49-a559-0fbc3723b949 tempest-QuotasAdminNegativeTest-1708561238 tempest-QuotasAdminNegativeTest-1708561238-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-quota-sets/e38be15647d74a8dafa2f2def74baeb7" status: 200 len: 329 microversion: 2.1 time: 0.410188 Jul 18 02:09:59.796967 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-46ce2674-9fac-467a-9941-d8e27806c713 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/c3ac090d-3caa-404a-8f4d-5708f9fd04d6" status: 200 len: 1463 microversion: 2.1 time: 0.747524 Jul 18 02:09:59.799705 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 311/608] 10.222.0.57 () {60 vars in 1261 bytes} [Mon Jul 18 02:09:59 2022] PUT /compute/v2.1/os-quota-sets/e38be15647d74a8dafa2f2def74baeb7 => generated 329 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:59.805144 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 298/609] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:59 2022] GET /compute/v2.1/servers/c3ac090d-3caa-404a-8f4d-5708f9fd04d6 => generated 1463 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:59.814891 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-82957dd5-b29d-4108-b494-31806102a254 tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Action: 'update', calling method: .version_select at 0x7ff4a8ea8b80>, body: {"quota_set": {"ram": 0}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:09:59.816160 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-06b30833-a725-4d98-8726-06f276a48d6b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:59.816923 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-06b30833-a725-4d98-8726-06f276a48d6b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: bd14a732-a9ad-4dfd-af61-69b84eda8877] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:59.818609 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-82957dd5-b29d-4108-b494-31806102a254 tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '688594ccf76e4d1aab525934d983df65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38be15647d74a8dafa2f2def74baeb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:09:59.822555 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-82957dd5-b29d-4108-b494-31806102a254 tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Request method failure captured: Jul 18 02:09:59.822555 n-d-465891-3 devstack@n-api.service[119544]: request: PUT /compute/v2.1/os-quota-sets/e38be15647d74a8dafa2f2def74baeb7 HTTP/1.1 Jul 18 02:09:59.822555 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:09:59.822555 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:09:59.822555 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:09:59.822555 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 25 Jul 18 02:09:59.822555 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:09:59.822555 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:09:59.822555 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:09:59.822555 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:09:59.822555 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MDmJddQrtVMur52UTrdQpSh1RBnPEgFZd6UzfL_EqMlpEYFum4hwHRuOK2V2vSKfv7Sh_Xkx8yNe1_iNiB41JHR9HmkzCqhu_my9KzRUrhG7g8Om6kQWNbtiPiCbQnu9rZOSsVe-BeHuez5y-o82_0AVxfV3rVxHRfxhpzaXiWwxcA Jul 18 02:09:59.822555 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:09:59.822555 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:09:59.822555 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:09:59.822555 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:09:59.822555 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:09:59.822555 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:09:59.822555 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: e38be15647d74a8dafa2f2def74baeb7 Jul 18 02:09:59.822555 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-QuotasAdminNegativeTest-1264824889 Jul 18 02:09:59.822555 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:09:59.822555 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:09:59.824222 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e38be15647d74a8dafa2f2def74baeb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e38be15647d74a8dafa2f2def74baeb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e38be15647d74a8dafa2f2def74baeb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e38be15647d74a8dafa2f2def74baeb7"}]}] Jul 18 02:09:59.824222 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-QuotasAdminNegativeTest-1264824889 Jul 18 02:09:59.824222 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: e38be15647d74a8dafa2f2def74baeb7 Jul 18 02:09:59.824222 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1264824889 Jul 18 02:09:59.824222 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-QuotasAdminNegativeTest-1264824889-project Jul 18 02:09:59.824222 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:09:59.824222 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:09:59.824222 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 688594ccf76e4d1aab525934d983df65 Jul 18 02:09:59.824222 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-QuotasAdminNegativeTest-1264824889-project Jul 18 02:09:59.824222 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:09:59.824222 n-d-465891-3 devstack@n-api.service[119544]: {"quota_set": {"ram": 0}} Jul 18 02:09:59.824222 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:09:59.824222 n-d-465891-3 devstack@n-api.service[119544]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 18 02:09:59.824222 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'e38be15647d74a8dafa2f2def74baeb7', 'body': {'quota_set': {'ram': 0}}} Jul 18 02:09:59.825267 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:09:59.825267 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:59.825267 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:59.825267 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:59.825267 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:09:59.825267 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:09:59.825267 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:09:59.825267 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:09:59.825267 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:09:59.825267 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:09:59.825267 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:09:59.825267 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:09:59.825267 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Jul 18 02:09:59.825267 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Jul 18 02:09:59.825267 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:09:59.825267 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:09:59.825267 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:09:59.825267 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:09:59.825267 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Jul 18 02:09:59.827102 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Jul 18 02:09:59.827102 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:09:59.827102 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:09:59.827102 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:09:59.827102 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:09:59.827102 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:09:59.827102 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:09:59.827102 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:09:59.827102 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:09:59.827102 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:09:59.827102 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:09:59.827102 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:09:59.827102 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:09:59.827102 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:09:59.827102 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:09:59.827102 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 18 02:09:59.827102 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:59.827102 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:09:59.827102 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:59.827102 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:09:59.828426 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:09:59.828426 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:09:59.828426 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:09:59.828426 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:09:59.828426 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 18 02:09:59.828426 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:09:59.830891 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-82957dd5-b29d-4108-b494-31806102a254 tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:09:59.832905 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-82957dd5-b29d-4108-b494-31806102a254 tempest-QuotasAdminNegativeTest-1264824889 tempest-QuotasAdminNegativeTest-1264824889-project] 10.222.0.57 "PUT /compute/v2.1/os-quota-sets/e38be15647d74a8dafa2f2def74baeb7" status: 403 len: 116 microversion: 2.1 time: 0.025464 Jul 18 02:09:59.838321 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 299/610] 10.222.0.57 () {60 vars in 1261 bytes} [Mon Jul 18 02:09:59 2022] PUT /compute/v2.1/os-quota-sets/e38be15647d74a8dafa2f2def74baeb7 => generated 116 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:09:59.845463 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d52a87e0-c828-4dde-8400-02b2c78b113d tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:59.846362 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d52a87e0-c828-4dde-8400-02b2c78b113d tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:09:59.854728 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-06b30833-a725-4d98-8726-06f276a48d6b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:59.855769 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d52a87e0-c828-4dde-8400-02b2c78b113d tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:59.856504 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d52a87e0-c828-4dde-8400-02b2c78b113d tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:59.857616 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d52a87e0-c828-4dde-8400-02b2c78b113d tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:59.858617 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d52a87e0-c828-4dde-8400-02b2c78b113d tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:59.874785 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-06b30833-a725-4d98-8726-06f276a48d6b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:59.881502 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-06b30833-a725-4d98-8726-06f276a48d6b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:59.881969 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-06b30833-a725-4d98-8726-06f276a48d6b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:00.385170 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d52a87e0-c828-4dde-8400-02b2c78b113d tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:00.412433 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d52a87e0-c828-4dde-8400-02b2c78b113d tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1464 microversion: 2.1 time: 0.570875 Jul 18 02:10:00.413671 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 300/611] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:59 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1464 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:00.425081 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ee6681d8-f141-414c-afd4-eecf12c15dba tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a8ea8430>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:00.600334 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ee6681d8-f141-414c-afd4-eecf12c15dba tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a" status: 200 len: 1410 microversion: 2.1 time: 0.185250 Jul 18 02:10:00.601271 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 301/612] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:10:00 2022] GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a => generated 1410 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:00.604028 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-06b30833-a725-4d98-8726-06f276a48d6b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:00.617519 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-041d67a2-8211-48a3-9618-c45f463d03f8 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:00.619855 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-041d67a2-8211-48a3-9618-c45f463d03f8 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:00.625050 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-06b30833-a725-4d98-8726-06f276a48d6b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877" status: 200 len: 1540 microversion: 2.1 time: 0.821167 Jul 18 02:10:00.635840 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 312/613] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:09:59 2022] GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877 => generated 1540 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:00.655342 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-041d67a2-8211-48a3-9618-c45f463d03f8 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:00.656204 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-041d67a2-8211-48a3-9618-c45f463d03f8 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:00.659085 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-041d67a2-8211-48a3-9618-c45f463d03f8 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:00.661441 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-041d67a2-8211-48a3-9618-c45f463d03f8 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:00.916685 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0aa951c8-8942-405d-b662-9081ef10f83d tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1520007789", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "092e9dd7-8734-42ae-9ad7-626438550736"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:01.072721 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-0aa951c8-8942-405d-b662-9081ef10f83d tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] validate_networks() for None {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:10:01.221550 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-041d67a2-8211-48a3-9618-c45f463d03f8 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lazy-loading 'services' on Instance uuid a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:10:01.272004 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-041d67a2-8211-48a3-9618-c45f463d03f8 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 200 len: 1929 microversion: 2.75 time: 0.667634 Jul 18 02:10:01.274580 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 302/614] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:10:00 2022] GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 1929 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:10:01.632714 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-22e02c66-5220-44b9-96fe-4882075031df tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a94d7280>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:01.783350 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-22e02c66-5220-44b9-96fe-4882075031df tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a" status: 200 len: 1410 microversion: 2.1 time: 0.170489 Jul 18 02:10:01.792064 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 303/615] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:10:01 2022] GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a => generated 1410 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:01.834663 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ac37cf0c-fcf9-421e-9ecd-8c4bb83caa83 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:01.836560 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ac37cf0c-fcf9-421e-9ecd-8c4bb83caa83 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: bd14a732-a9ad-4dfd-af61-69b84eda8877] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:01.849860 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ac37cf0c-fcf9-421e-9ecd-8c4bb83caa83 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:01.851823 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ac37cf0c-fcf9-421e-9ecd-8c4bb83caa83 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:01.853344 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ac37cf0c-fcf9-421e-9ecd-8c4bb83caa83 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:01.854053 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ac37cf0c-fcf9-421e-9ecd-8c4bb83caa83 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:02.132440 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-0aa951c8-8942-405d-b662-9081ef10f83d tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:10:02.133404 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-0aa951c8-8942-405d-b662-9081ef10f83d tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:10:02.134212 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-0aa951c8-8942-405d-b662-9081ef10f83d tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:10:02.134859 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-0aa951c8-8942-405d-b662-9081ef10f83d tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:10:02.135436 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-0aa951c8-8942-405d-b662-9081ef10f83d tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:10:02.155886 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0aa951c8-8942-405d-b662-9081ef10f83d tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:02.160898 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0aa951c8-8942-405d-b662-9081ef10f83d tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:02.162016 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0aa951c8-8942-405d-b662-9081ef10f83d tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:02.162538 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0aa951c8-8942-405d-b662-9081ef10f83d tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:02.209975 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-0aa951c8-8942-405d-b662-9081ef10f83d tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Getting quotas for project 37109e65d03f45c7be865364a9006ba6. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:10:02.226344 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-0aa951c8-8942-405d-b662-9081ef10f83d tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Getting quotas for user efc0d0f9b4154bbbb7475009490b5998 and project 37109e65d03f45c7be865364a9006ba6. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:10:02.240981 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ac37cf0c-fcf9-421e-9ecd-8c4bb83caa83 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:02.249758 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ac37cf0c-fcf9-421e-9ecd-8c4bb83caa83 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877" status: 200 len: 1540 microversion: 2.1 time: 0.454711 Jul 18 02:10:02.253087 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 304/616] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:01 2022] GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877 => generated 1540 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:02.267956 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0aa951c8-8942-405d-b662-9081ef10f83d tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:10:02.270339 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0aa951c8-8942-405d-b662-9081ef10f83d tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 7f16fcdb-c2da-4a62-8393-e4977d34bd63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:10:02.307202 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7c2df770-4b10-4204-bea8-5f5ca776cc60 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:02.309193 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7c2df770-4b10-4204-bea8-5f5ca776cc60 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:02.320331 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7c2df770-4b10-4204-bea8-5f5ca776cc60 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:02.325358 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7c2df770-4b10-4204-bea8-5f5ca776cc60 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:02.328536 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7c2df770-4b10-4204-bea8-5f5ca776cc60 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:02.329074 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7c2df770-4b10-4204-bea8-5f5ca776cc60 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:02.375334 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0aa951c8-8942-405d-b662-9081ef10f83d tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.463172 Jul 18 02:10:02.376004 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 313/617] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:10:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1465 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:10:02.391558 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f0df20d2-43d6-4de6-a56f-a60dae2aa530 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:02.392145 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f0df20d2-43d6-4de6-a56f-a60dae2aa530 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 7f16fcdb-c2da-4a62-8393-e4977d34bd63] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:02.570862 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f0df20d2-43d6-4de6-a56f-a60dae2aa530 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:02.584520 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f0df20d2-43d6-4de6-a56f-a60dae2aa530 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/7f16fcdb-c2da-4a62-8393-e4977d34bd63" status: 200 len: 1214 microversion: 2.1 time: 0.193506 Jul 18 02:10:02.601225 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 314/618] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:02 2022] GET /compute/v2.1/servers/7f16fcdb-c2da-4a62-8393-e4977d34bd63 => generated 1214 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:02.700093 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-7c2df770-4b10-4204-bea8-5f5ca776cc60 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lazy-loading 'services' on Instance uuid a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:10:02.798064 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7041543c-d81b-4720-8033-a43d728e9c33 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a8ff9af0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:02.798317 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7c2df770-4b10-4204-bea8-5f5ca776cc60 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 200 len: 1929 microversion: 2.75 time: 0.497050 Jul 18 02:10:02.799012 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 305/619] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:10:02 2022] GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 1929 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:10:02.890087 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7041543c-d81b-4720-8033-a43d728e9c33 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a" status: 200 len: 1419 microversion: 2.1 time: 0.096381 Jul 18 02:10:02.890988 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 315/620] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:10:02 2022] GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a => generated 1419 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:10:02.903655 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-51ddab7c-3ee8-499b-a124-fb2e31238e44 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a8ea8dc0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:03.035217 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-51ddab7c-3ee8-499b-a124-fb2e31238e44 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a" status: 200 len: 1419 microversion: 2.1 time: 0.136197 Jul 18 02:10:03.036611 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 306/621] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:10:02 2022] GET /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a => generated 1419 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:03.052792 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-768bb269-d5e5-47c3-b5fe-fa0a00e6bf1e tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a9165160>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:03.269155 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b5abbbd2-9293-457c-9547-5dea63d5f1eb tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:03.269804 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b5abbbd2-9293-457c-9547-5dea63d5f1eb tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: bd14a732-a9ad-4dfd-af61-69b84eda8877] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:03.306892 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b5abbbd2-9293-457c-9547-5dea63d5f1eb tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:03.309474 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b5abbbd2-9293-457c-9547-5dea63d5f1eb tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:03.315581 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b5abbbd2-9293-457c-9547-5dea63d5f1eb tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:03.320193 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b5abbbd2-9293-457c-9547-5dea63d5f1eb tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:04.112311 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b5abbbd2-9293-457c-9547-5dea63d5f1eb tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:04.143881 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b5abbbd2-9293-457c-9547-5dea63d5f1eb tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877" status: 200 len: 1540 microversion: 2.1 time: 0.878373 Jul 18 02:10:04.145404 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 307/622] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:03 2022] GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877 => generated 1540 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:10:04.158842 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-858c43b8-c175-4b7b-9276-26b6e4450b59 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:04.162861 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-858c43b8-c175-4b7b-9276-26b6e4450b59 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 7f16fcdb-c2da-4a62-8393-e4977d34bd63] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:04.181226 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-858c43b8-c175-4b7b-9276-26b6e4450b59 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:04.182638 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-858c43b8-c175-4b7b-9276-26b6e4450b59 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:04.182829 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-858c43b8-c175-4b7b-9276-26b6e4450b59 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:04.183211 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-858c43b8-c175-4b7b-9276-26b6e4450b59 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:04.563224 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-858c43b8-c175-4b7b-9276-26b6e4450b59 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:04.583104 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-858c43b8-c175-4b7b-9276-26b6e4450b59 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/7f16fcdb-c2da-4a62-8393-e4977d34bd63" status: 200 len: 1266 microversion: 2.1 time: 0.436482 Jul 18 02:10:04.585569 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 308/623] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:04 2022] GET /compute/v2.1/servers/7f16fcdb-c2da-4a62-8393-e4977d34bd63 => generated 1266 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:04.597151 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3ab7791c-f1cb-4141-8ea0-afb1462b8dd4 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:04.602210 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3ab7791c-f1cb-4141-8ea0-afb1462b8dd4 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:04.626858 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3ab7791c-f1cb-4141-8ea0-afb1462b8dd4 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:04.630459 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3ab7791c-f1cb-4141-8ea0-afb1462b8dd4 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:04.633446 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3ab7791c-f1cb-4141-8ea0-afb1462b8dd4 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:04.634560 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3ab7791c-f1cb-4141-8ea0-afb1462b8dd4 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:04.759240 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-768bb269-d5e5-47c3-b5fe-fa0a00e6bf1e tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "DELETE /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a" status: 204 len: 0 microversion: 2.1 time: 1.709724 Jul 18 02:10:04.761496 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 316/624] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:03 2022] DELETE /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a => generated 0 bytes in 1715 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:10:04.772485 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-84199c72-f99a-49f0-bfd0-a0f6ba360f34 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:04.776525 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-84199c72-f99a-49f0-bfd0-a0f6ba360f34 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: d8aad28a-a3d8-48d3-8fc7-50d65ab4e768] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:04.795515 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-84199c72-f99a-49f0-bfd0-a0f6ba360f34 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:04.798139 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-84199c72-f99a-49f0-bfd0-a0f6ba360f34 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:04.803598 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-84199c72-f99a-49f0-bfd0-a0f6ba360f34 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:04.805767 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-84199c72-f99a-49f0-bfd0-a0f6ba360f34 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:04.875915 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-84199c72-f99a-49f0-bfd0-a0f6ba360f34 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: d8aad28a-a3d8-48d3-8fc7-50d65ab4e768] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:10:04.878440 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-3ab7791c-f1cb-4141-8ea0-afb1462b8dd4 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lazy-loading 'services' on Instance uuid a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:10:04.937844 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3ab7791c-f1cb-4141-8ea0-afb1462b8dd4 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 200 len: 1929 microversion: 2.75 time: 0.350157 Jul 18 02:10:04.942783 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 309/625] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:10:04 2022] GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 1929 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:10:05.030827 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-84199c72-f99a-49f0-bfd0-a0f6ba360f34 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768" status: 204 len: 0 microversion: 2.1 time: 0.263203 Jul 18 02:10:05.036346 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 317/626] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:10:04 2022] DELETE /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:10:05.171855 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7248bdba-eb44-46cf-8482-0220740e58c5 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:05.172491 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7248bdba-eb44-46cf-8482-0220740e58c5 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: bd14a732-a9ad-4dfd-af61-69b84eda8877] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:05.196536 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7248bdba-eb44-46cf-8482-0220740e58c5 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:05.197276 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7248bdba-eb44-46cf-8482-0220740e58c5 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:05.198682 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7248bdba-eb44-46cf-8482-0220740e58c5 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:05.199446 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7248bdba-eb44-46cf-8482-0220740e58c5 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:05.317143 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4604cb1b-921e-47bf-b9fc-32b8e8d11ad7 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1593320862", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "9b9ef786-bd16-4bad-95f6-48c8b48d49f7"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:05.417452 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-4604cb1b-921e-47bf-b9fc-32b8e8d11ad7 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] validate_networks() for [('9b9ef786-bd16-4bad-95f6-48c8b48d49f7', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:10:06.503729 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7248bdba-eb44-46cf-8482-0220740e58c5 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:06.535008 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7248bdba-eb44-46cf-8482-0220740e58c5 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877" status: 200 len: 1535 microversion: 2.1 time: 1.375380 Jul 18 02:10:06.550483 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 310/627] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:05 2022] GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877 => generated 1535 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:06.564385 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f1508431-db15-4b4c-868d-eabced620965 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:06.565861 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f1508431-db15-4b4c-868d-eabced620965 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 7f16fcdb-c2da-4a62-8393-e4977d34bd63] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:06.580250 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f1508431-db15-4b4c-868d-eabced620965 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:06.581872 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f1508431-db15-4b4c-868d-eabced620965 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:06.584050 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f1508431-db15-4b4c-868d-eabced620965 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:06.585183 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f1508431-db15-4b4c-868d-eabced620965 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:06.958954 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f1508431-db15-4b4c-868d-eabced620965 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:06.981684 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f1508431-db15-4b4c-868d-eabced620965 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/7f16fcdb-c2da-4a62-8393-e4977d34bd63" status: 200 len: 1272 microversion: 2.1 time: 0.429500 Jul 18 02:10:06.985349 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 311/628] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:06 2022] GET /compute/v2.1/servers/7f16fcdb-c2da-4a62-8393-e4977d34bd63 => generated 1272 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:07.000071 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-60b2e2b0-8361-4480-aa4d-ca56266dc43e tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:07.000071 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-60b2e2b0-8361-4480-aa4d-ca56266dc43e tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:07.015296 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-60b2e2b0-8361-4480-aa4d-ca56266dc43e tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:07.016907 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-60b2e2b0-8361-4480-aa4d-ca56266dc43e tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:07.027319 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-60b2e2b0-8361-4480-aa4d-ca56266dc43e tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:07.028371 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-60b2e2b0-8361-4480-aa4d-ca56266dc43e tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:07.329139 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-60b2e2b0-8361-4480-aa4d-ca56266dc43e tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lazy-loading 'services' on Instance uuid a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:10:07.336861 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:10:07.421375 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-60b2e2b0-8361-4480-aa4d-ca56266dc43e tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 200 len: 1929 microversion: 2.75 time: 0.431446 Jul 18 02:10:07.438890 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 312/629] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:10:06 2022] GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 1929 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:10:07.891380 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-16ed23d2-ca30-4c93-92ef-97785542c3a9 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1621285012", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "caec55b9-88ff-45af-a9ee-477b3847fbba"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:08.002152 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-16ed23d2-ca30-4c93-92ef-97785542c3a9 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] validate_networks() for [('caec55b9-88ff-45af-a9ee-477b3847fbba', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:10:08.909051 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-4604cb1b-921e-47bf-b9fc-32b8e8d11ad7 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:10:08.910228 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-4604cb1b-921e-47bf-b9fc-32b8e8d11ad7 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:10:08.910894 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-4604cb1b-921e-47bf-b9fc-32b8e8d11ad7 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:10:08.911576 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-4604cb1b-921e-47bf-b9fc-32b8e8d11ad7 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:10:08.912217 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-4604cb1b-921e-47bf-b9fc-32b8e8d11ad7 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:10:08.931481 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=10 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:10:08.947594 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4604cb1b-921e-47bf-b9fc-32b8e8d11ad7 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:08.948284 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4604cb1b-921e-47bf-b9fc-32b8e8d11ad7 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:08.949527 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4604cb1b-921e-47bf-b9fc-32b8e8d11ad7 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:08.951586 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4604cb1b-921e-47bf-b9fc-32b8e8d11ad7 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:08.988912 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-4604cb1b-921e-47bf-b9fc-32b8e8d11ad7 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Getting quotas for project 10c5b35052cd4a71a8254d01112f0496. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:10:09.000659 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-4604cb1b-921e-47bf-b9fc-32b8e8d11ad7 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Getting quotas for user a686fc833d964d88a022fae2932b5727 and project 10c5b35052cd4a71a8254d01112f0496. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:10:09.019352 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=40 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:10:09.051081 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4604cb1b-921e-47bf-b9fc-32b8e8d11ad7 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:10:09.058782 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4604cb1b-921e-47bf-b9fc-32b8e8d11ad7 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 25dfb6dd-6d5a-4399-a348-0a162ca907ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:10:09.143405 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=9,nova_api:UPDATE=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:10:09.227726 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4604cb1b-921e-47bf-b9fc-32b8e8d11ad7 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.915230 Jul 18 02:10:09.239682 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 318/630] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:10:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 3918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 02:10:09.275582 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-01e510a1-291d-44f5-bd0a-69d9e5ac2200 req-fff33c94-8f3a-48cf-a447-75ad23a2662a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd14a732-a9ad-4dfd-af61-69b84eda8877", "name": "network-vif-plugged", "status": "completed", "tag": "8bd503c0-d3d5-4bae-9611-ac0c479b1c99"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:09.328816 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-01e510a1-291d-44f5-bd0a-69d9e5ac2200 req-fff33c94-8f3a-48cf-a447-75ad23a2662a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:09.329761 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-01e510a1-291d-44f5-bd0a-69d9e5ac2200 req-fff33c94-8f3a-48cf-a447-75ad23a2662a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:09.380528 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-01e510a1-291d-44f5-bd0a-69d9e5ac2200 req-fff33c94-8f3a-48cf-a447-75ad23a2662a service nova] Creating event network-vif-plugged:8bd503c0-d3d5-4bae-9611-ac0c479b1c99 for instance bd14a732-a9ad-4dfd-af61-69b84eda8877 on n-h1-465891-3 Jul 18 02:10:09.411065 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-01e510a1-291d-44f5-bd0a-69d9e5ac2200 req-fff33c94-8f3a-48cf-a447-75ad23a2662a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167088 Jul 18 02:10:09.414313 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 319/631] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:10:09.431476 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3ef36641-b8ba-4244-b10b-c2369bddb988 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:09.436523 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3ef36641-b8ba-4244-b10b-c2369bddb988 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: bd14a732-a9ad-4dfd-af61-69b84eda8877] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:09.461017 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3ef36641-b8ba-4244-b10b-c2369bddb988 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:09.461435 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3ef36641-b8ba-4244-b10b-c2369bddb988 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:09.465721 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3ef36641-b8ba-4244-b10b-c2369bddb988 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:09.468078 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3ef36641-b8ba-4244-b10b-c2369bddb988 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:10.272415 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-16ed23d2-ca30-4c93-92ef-97785542c3a9 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:10:10.277350 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-16ed23d2-ca30-4c93-92ef-97785542c3a9 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:10:10.278388 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-16ed23d2-ca30-4c93-92ef-97785542c3a9 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:10:10.279983 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-16ed23d2-ca30-4c93-92ef-97785542c3a9 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:10:10.281512 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-16ed23d2-ca30-4c93-92ef-97785542c3a9 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:10:10.304864 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-16ed23d2-ca30-4c93-92ef-97785542c3a9 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:10.305571 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-16ed23d2-ca30-4c93-92ef-97785542c3a9 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:10.306562 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-16ed23d2-ca30-4c93-92ef-97785542c3a9 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:10.311568 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-16ed23d2-ca30-4c93-92ef-97785542c3a9 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:10.376245 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-16ed23d2-ca30-4c93-92ef-97785542c3a9 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Getting quotas for project e382977cb6bf4f358fb3245cb3768140. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:10:10.389855 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-16ed23d2-ca30-4c93-92ef-97785542c3a9 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Getting quotas for user 77381e85d31a4747acb08a8d4572eb1b and project e382977cb6bf4f358fb3245cb3768140. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:10:10.429237 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-16ed23d2-ca30-4c93-92ef-97785542c3a9 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:10:10.436901 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-16ed23d2-ca30-4c93-92ef-97785542c3a9 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:10:10.558391 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-16ed23d2-ca30-4c93-92ef-97785542c3a9 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.117329 Jul 18 02:10:10.559056 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 313/632] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:10:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 3119 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:10:10.582667 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4bcb65d4-6c00-46d4-af9f-83993e8fa9b2 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:10.585857 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4bcb65d4-6c00-46d4-af9f-83993e8fa9b2 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 7f16fcdb-c2da-4a62-8393-e4977d34bd63] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:10.602785 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4bcb65d4-6c00-46d4-af9f-83993e8fa9b2 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:10.603428 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4bcb65d4-6c00-46d4-af9f-83993e8fa9b2 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:10.604403 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4bcb65d4-6c00-46d4-af9f-83993e8fa9b2 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:10.605676 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4bcb65d4-6c00-46d4-af9f-83993e8fa9b2 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:10.781317 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3ef36641-b8ba-4244-b10b-c2369bddb988 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:10.799463 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3ef36641-b8ba-4244-b10b-c2369bddb988 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877" status: 200 len: 1522 microversion: 2.1 time: 1.381116 Jul 18 02:10:10.800108 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 320/633] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:09 2022] GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877 => generated 1522 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:10.813971 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b0f4ec83-c8b9-4b0a-9b0d-e86e76542618 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:10.814537 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b0f4ec83-c8b9-4b0a-9b0d-e86e76542618 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:10.831451 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b0f4ec83-c8b9-4b0a-9b0d-e86e76542618 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:10.840769 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b0f4ec83-c8b9-4b0a-9b0d-e86e76542618 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:10.842619 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b0f4ec83-c8b9-4b0a-9b0d-e86e76542618 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:10.844508 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b0f4ec83-c8b9-4b0a-9b0d-e86e76542618 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:10.925761 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:10:11.468250 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-b0f4ec83-c8b9-4b0a-9b0d-e86e76542618 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lazy-loading 'services' on Instance uuid a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:10:11.500690 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b0f4ec83-c8b9-4b0a-9b0d-e86e76542618 tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 200 len: 1929 microversion: 2.75 time: 0.696765 Jul 18 02:10:11.502042 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 321/634] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:10:10 2022] GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 1929 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:10:11.512847 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b12c38e0-ea78-4772-9850-af199263758f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:11.515284 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b12c38e0-ea78-4772-9850-af199263758f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 25dfb6dd-6d5a-4399-a348-0a162ca907ef] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:11.527225 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b12c38e0-ea78-4772-9850-af199263758f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:11.527905 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b12c38e0-ea78-4772-9850-af199263758f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:11.529776 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b12c38e0-ea78-4772-9850-af199263758f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:11.530660 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b12c38e0-ea78-4772-9850-af199263758f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:11.769463 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4bcb65d4-6c00-46d4-af9f-83993e8fa9b2 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:11.784520 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4bcb65d4-6c00-46d4-af9f-83993e8fa9b2 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/7f16fcdb-c2da-4a62-8393-e4977d34bd63" status: 200 len: 1314 microversion: 2.1 time: 1.207530 Jul 18 02:10:11.787807 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 314/635] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:10 2022] GET /compute/v2.1/servers/7f16fcdb-c2da-4a62-8393-e4977d34bd63 => generated 1314 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:11.813905 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4d89811c-c823-4efd-9c90-9ee9b7ae7a3f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:11.823188 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4d89811c-c823-4efd-9c90-9ee9b7ae7a3f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:11.861940 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4d89811c-c823-4efd-9c90-9ee9b7ae7a3f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:11.862330 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4d89811c-c823-4efd-9c90-9ee9b7ae7a3f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:11.866285 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4d89811c-c823-4efd-9c90-9ee9b7ae7a3f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:11.867114 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4d89811c-c823-4efd-9c90-9ee9b7ae7a3f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:12.314263 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b12c38e0-ea78-4772-9850-af199263758f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:12.326049 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b12c38e0-ea78-4772-9850-af199263758f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef" status: 200 len: 1268 microversion: 2.1 time: 0.821909 Jul 18 02:10:12.333932 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 322/636] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:11 2022] GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef => generated 1268 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:12.345741 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-4af987f2-55d9-4fe2-9079-9ff1349180b5 req-429b1791-5ca5-4cbd-8469-bd5038e41caf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8aad28a-a3d8-48d3-8fc7-50d65ab4e768", "name": "network-vif-deleted", "tag": "6783749f-f883-4783-9465-179735e0eeb7"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:12.368953 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-4af987f2-55d9-4fe2-9079-9ff1349180b5 req-429b1791-5ca5-4cbd-8469-bd5038e41caf service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:12.369993 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-4af987f2-55d9-4fe2-9079-9ff1349180b5 req-429b1791-5ca5-4cbd-8469-bd5038e41caf service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:12.404984 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-4af987f2-55d9-4fe2-9079-9ff1349180b5 req-429b1791-5ca5-4cbd-8469-bd5038e41caf service nova] Creating event network-vif-deleted:6783749f-f883-4783-9465-179735e0eeb7 for instance d8aad28a-a3d8-48d3-8fc7-50d65ab4e768 on n-h1-465891-3 Jul 18 02:10:12.415911 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-4af987f2-55d9-4fe2-9079-9ff1349180b5 req-429b1791-5ca5-4cbd-8469-bd5038e41caf service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080382 Jul 18 02:10:12.422626 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 323/637] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:10:12.453051 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d8cc64a5-4126-42c4-83ed-e0ab4ff3b16b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:12.454367 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d8cc64a5-4126-42c4-83ed-e0ab4ff3b16b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: bd14a732-a9ad-4dfd-af61-69b84eda8877] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:12.472194 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d8cc64a5-4126-42c4-83ed-e0ab4ff3b16b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:12.472974 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d8cc64a5-4126-42c4-83ed-e0ab4ff3b16b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:12.483633 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d8cc64a5-4126-42c4-83ed-e0ab4ff3b16b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:12.484467 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d8cc64a5-4126-42c4-83ed-e0ab4ff3b16b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:12.537922 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4d89811c-c823-4efd-9c90-9ee9b7ae7a3f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:12.563140 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4d89811c-c823-4efd-9c90-9ee9b7ae7a3f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 200 len: 1215 microversion: 2.1 time: 0.769712 Jul 18 02:10:12.567042 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 315/638] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:11 2022] GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 1215 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:12.580413 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-2b408deb-aeb2-49e5-a6b4-6e58b50b5e0e req-44abf0bf-b5a7-4f22-a5aa-5f0a8dce785e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8aad28a-a3d8-48d3-8fc7-50d65ab4e768", "name": "network-vif-unplugged", "status": "completed", "tag": "6783749f-f883-4783-9465-179735e0eeb7"}, {"server_uuid": "bd14a732-a9ad-4dfd-af61-69b84eda8877", "name": "network-vif-unplugged", "status": "completed", "tag": "8bd503c0-d3d5-4bae-9611-ac0c479b1c99"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:12.605777 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-2b408deb-aeb2-49e5-a6b4-6e58b50b5e0e req-44abf0bf-b5a7-4f22-a5aa-5f0a8dce785e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:12.606441 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-2b408deb-aeb2-49e5-a6b4-6e58b50b5e0e req-44abf0bf-b5a7-4f22-a5aa-5f0a8dce785e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:12.633256 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d8cc64a5-4126-42c4-83ed-e0ab4ff3b16b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: bd14a732-a9ad-4dfd-af61-69b84eda8877] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:10:12.681065 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-2b408deb-aeb2-49e5-a6b4-6e58b50b5e0e req-44abf0bf-b5a7-4f22-a5aa-5f0a8dce785e service nova] Creating event network-vif-unplugged:6783749f-f883-4783-9465-179735e0eeb7 for instance d8aad28a-a3d8-48d3-8fc7-50d65ab4e768 on n-h1-465891-3 Jul 18 02:10:12.681565 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-2b408deb-aeb2-49e5-a6b4-6e58b50b5e0e req-44abf0bf-b5a7-4f22-a5aa-5f0a8dce785e service nova] Creating event network-vif-unplugged:8bd503c0-d3d5-4bae-9611-ac0c479b1c99 for instance bd14a732-a9ad-4dfd-af61-69b84eda8877 on n-h1-465891-3 Jul 18 02:10:12.703494 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-2b408deb-aeb2-49e5-a6b4-6e58b50b5e0e req-44abf0bf-b5a7-4f22-a5aa-5f0a8dce785e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.130689 Jul 18 02:10:12.708833 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 316/639] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:10:12.717570 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bda5d0de-7b57-4fe6-a716-2331459ee98e tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:12.723551 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bda5d0de-7b57-4fe6-a716-2331459ee98e tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:12.739370 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bda5d0de-7b57-4fe6-a716-2331459ee98e tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:12.740378 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bda5d0de-7b57-4fe6-a716-2331459ee98e tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:12.744787 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bda5d0de-7b57-4fe6-a716-2331459ee98e tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:12.745744 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bda5d0de-7b57-4fe6-a716-2331459ee98e tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:12.943862 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d8cc64a5-4126-42c4-83ed-e0ab4ff3b16b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "DELETE /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877" status: 204 len: 0 microversion: 2.1 time: 0.518056 Jul 18 02:10:12.955671 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 324/640] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:10:12 2022] DELETE /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:10:12.963056 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f9654314-de37-4846-b46c-74bc7cbb1f28 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:12.963812 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f9654314-de37-4846-b46c-74bc7cbb1f28 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 7f16fcdb-c2da-4a62-8393-e4977d34bd63] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:12.980818 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f9654314-de37-4846-b46c-74bc7cbb1f28 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:12.981036 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f9654314-de37-4846-b46c-74bc7cbb1f28 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:12.983027 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f9654314-de37-4846-b46c-74bc7cbb1f28 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:12.983812 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f9654314-de37-4846-b46c-74bc7cbb1f28 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:13.145835 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-bda5d0de-7b57-4fe6-a716-2331459ee98e tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lazy-loading 'services' on Instance uuid a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:10:13.258230 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bda5d0de-7b57-4fe6-a716-2331459ee98e tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 200 len: 1929 microversion: 2.75 time: 0.547422 Jul 18 02:10:13.265284 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 317/641] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:10:12 2022] GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 1929 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:10:13.285175 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fc053bef-f2ba-45b5-8487-b47b25a4f21b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:13.288641 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fc053bef-f2ba-45b5-8487-b47b25a4f21b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: bd14a732-a9ad-4dfd-af61-69b84eda8877] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:13.295568 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:10:13.308520 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fc053bef-f2ba-45b5-8487-b47b25a4f21b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:13.310370 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fc053bef-f2ba-45b5-8487-b47b25a4f21b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:13.313127 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fc053bef-f2ba-45b5-8487-b47b25a4f21b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:13.314829 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fc053bef-f2ba-45b5-8487-b47b25a4f21b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:13.793183 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f9654314-de37-4846-b46c-74bc7cbb1f28 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:13.810311 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f9654314-de37-4846-b46c-74bc7cbb1f28 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/7f16fcdb-c2da-4a62-8393-e4977d34bd63" status: 200 len: 1314 microversion: 2.1 time: 0.852830 Jul 18 02:10:13.814071 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 325/642] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:12 2022] GET /compute/v2.1/servers/7f16fcdb-c2da-4a62-8393-e4977d34bd63 => generated 1314 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:13.824504 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-01b0e87d-6c01-4dfd-b253-9d192532759e tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:13.830951 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-01b0e87d-6c01-4dfd-b253-9d192532759e tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 25dfb6dd-6d5a-4399-a348-0a162ca907ef] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:13.853149 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-01b0e87d-6c01-4dfd-b253-9d192532759e tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:13.854745 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-01b0e87d-6c01-4dfd-b253-9d192532759e tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:13.858452 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-01b0e87d-6c01-4dfd-b253-9d192532759e tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:13.860472 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-01b0e87d-6c01-4dfd-b253-9d192532759e tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:14.105120 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-01b0e87d-6c01-4dfd-b253-9d192532759e tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:14.121797 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-01b0e87d-6c01-4dfd-b253-9d192532759e tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef" status: 200 len: 1266 microversion: 2.1 time: 0.306069 Jul 18 02:10:14.140941 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 326/643] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:13 2022] GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef => generated 1266 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:14.149756 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4588eb2f-534d-4265-9a32-3959328cc0fa tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:14.152038 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4588eb2f-534d-4265-9a32-3959328cc0fa tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:14.165813 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4588eb2f-534d-4265-9a32-3959328cc0fa tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:14.166717 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4588eb2f-534d-4265-9a32-3959328cc0fa tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:14.167796 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4588eb2f-534d-4265-9a32-3959328cc0fa tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:14.172776 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4588eb2f-534d-4265-9a32-3959328cc0fa tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:14.173063 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fc053bef-f2ba-45b5-8487-b47b25a4f21b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:14.185940 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fc053bef-f2ba-45b5-8487-b47b25a4f21b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877" status: 200 len: 1528 microversion: 2.1 time: 0.917114 Jul 18 02:10:14.188560 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 318/644] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:13 2022] GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877 => generated 1528 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:14.295625 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-90647ed6-b3ab-4a07-82ae-e5338db3187b tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:14.303034 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-90647ed6-b3ab-4a07-82ae-e5338db3187b tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:14.319556 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-90647ed6-b3ab-4a07-82ae-e5338db3187b tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:14.321052 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-90647ed6-b3ab-4a07-82ae-e5338db3187b tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:14.323491 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-90647ed6-b3ab-4a07-82ae-e5338db3187b tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:14.326161 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-90647ed6-b3ab-4a07-82ae-e5338db3187b tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:14.416240 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4588eb2f-534d-4265-9a32-3959328cc0fa tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:14.432130 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4588eb2f-534d-4265-9a32-3959328cc0fa tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 200 len: 1271 microversion: 2.1 time: 0.288637 Jul 18 02:10:14.432734 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 327/645] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:14 2022] GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 1271 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:14.837048 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ba86b721-e148-438e-b5f3-79e21a4291f1 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:14.837924 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ba86b721-e148-438e-b5f3-79e21a4291f1 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 7f16fcdb-c2da-4a62-8393-e4977d34bd63] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:14.858109 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ba86b721-e148-438e-b5f3-79e21a4291f1 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:14.858694 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ba86b721-e148-438e-b5f3-79e21a4291f1 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:14.860933 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ba86b721-e148-438e-b5f3-79e21a4291f1 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:14.861569 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ba86b721-e148-438e-b5f3-79e21a4291f1 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:15.198776 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-90647ed6-b3ab-4a07-82ae-e5338db3187b tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lazy-loading 'services' on Instance uuid a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:10:15.230947 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-90647ed6-b3ab-4a07-82ae-e5338db3187b tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 200 len: 1935 microversion: 2.75 time: 0.940810 Jul 18 02:10:15.232787 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 319/646] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:10:14 2022] GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 1935 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:10:15.398260 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d42455ae-3dd8-43af-b833-057f8bf61cf8 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1340691353", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:15.463869 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-d42455ae-3dd8-43af-b833-057f8bf61cf8 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] validate_networks() for None {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:10:15.917122 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ba86b721-e148-438e-b5f3-79e21a4291f1 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:15.933176 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ba86b721-e148-438e-b5f3-79e21a4291f1 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/7f16fcdb-c2da-4a62-8393-e4977d34bd63" status: 200 len: 1314 microversion: 2.1 time: 1.100079 Jul 18 02:10:15.934053 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 328/647] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:14 2022] GET /compute/v2.1/servers/7f16fcdb-c2da-4a62-8393-e4977d34bd63 => generated 1314 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:15.940245 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a988057e-6bbe-46a4-a00d-72bf9db96be8 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:15.940856 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a988057e-6bbe-46a4-a00d-72bf9db96be8 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 25dfb6dd-6d5a-4399-a348-0a162ca907ef] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:15.947114 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a988057e-6bbe-46a4-a00d-72bf9db96be8 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:15.947860 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a988057e-6bbe-46a4-a00d-72bf9db96be8 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:15.948896 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a988057e-6bbe-46a4-a00d-72bf9db96be8 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:15.949537 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a988057e-6bbe-46a4-a00d-72bf9db96be8 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:16.705933 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a988057e-6bbe-46a4-a00d-72bf9db96be8 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:16.714646 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a988057e-6bbe-46a4-a00d-72bf9db96be8 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef" status: 200 len: 1308 microversion: 2.1 time: 0.779200 Jul 18 02:10:16.715229 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 329/648] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:15 2022] GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef => generated 1308 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:16.724584 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-d42455ae-3dd8-43af-b833-057f8bf61cf8 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:10:16.725569 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-d42455ae-3dd8-43af-b833-057f8bf61cf8 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:10:16.726312 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-d42455ae-3dd8-43af-b833-057f8bf61cf8 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:10:16.726913 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-d42455ae-3dd8-43af-b833-057f8bf61cf8 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:10:16.728078 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-d42455ae-3dd8-43af-b833-057f8bf61cf8 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:10:16.737637 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-9c30006a-6507-4cc7-9990-bcda8fb097b2 req-ec043dea-ff94-4c09-b160-1f8f5cd0dbf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f16fcdb-c2da-4a62-8393-e4977d34bd63", "tag": "8178a5b6-596e-4fea-a484-79a9a9927b7d"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:16.744517 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d42455ae-3dd8-43af-b833-057f8bf61cf8 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:16.744973 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d42455ae-3dd8-43af-b833-057f8bf61cf8 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:16.746522 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d42455ae-3dd8-43af-b833-057f8bf61cf8 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:16.746796 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d42455ae-3dd8-43af-b833-057f8bf61cf8 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:16.751277 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-9c30006a-6507-4cc7-9990-bcda8fb097b2 req-ec043dea-ff94-4c09-b160-1f8f5cd0dbf7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:16.751895 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-9c30006a-6507-4cc7-9990-bcda8fb097b2 req-ec043dea-ff94-4c09-b160-1f8f5cd0dbf7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:16.765499 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-9c30006a-6507-4cc7-9990-bcda8fb097b2 req-ec043dea-ff94-4c09-b160-1f8f5cd0dbf7 service nova] Creating event network-changed:8178a5b6-596e-4fea-a484-79a9a9927b7d for instance 7f16fcdb-c2da-4a62-8393-e4977d34bd63 on n-h2-465891-3 Jul 18 02:10:16.770588 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-d42455ae-3dd8-43af-b833-057f8bf61cf8 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Getting quotas for project cdc1fb21b43343238f9e96d7dc003841. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:10:16.770938 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-9c30006a-6507-4cc7-9990-bcda8fb097b2 req-ec043dea-ff94-4c09-b160-1f8f5cd0dbf7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053557 Jul 18 02:10:16.772006 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 330/649] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:10:16.777032 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-d42455ae-3dd8-43af-b833-057f8bf61cf8 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Getting quotas for user b94d6f2c2d8b42d38d1149dab5ad2d9e and project cdc1fb21b43343238f9e96d7dc003841. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:10:16.777467 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4c0fb4f3-c62d-4715-a1d1-a13a00aa1082 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:16.779133 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4c0fb4f3-c62d-4715-a1d1-a13a00aa1082 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: bd14a732-a9ad-4dfd-af61-69b84eda8877] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:16.785941 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4c0fb4f3-c62d-4715-a1d1-a13a00aa1082 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:16.786671 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4c0fb4f3-c62d-4715-a1d1-a13a00aa1082 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:16.787644 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4c0fb4f3-c62d-4715-a1d1-a13a00aa1082 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:16.788269 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4c0fb4f3-c62d-4715-a1d1-a13a00aa1082 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:16.798868 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d42455ae-3dd8-43af-b833-057f8bf61cf8 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:10:16.801448 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d42455ae-3dd8-43af-b833-057f8bf61cf8 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] [instance: 716de5b7-33a8-45f4-bdab-ec12b4daa8c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:10:16.809049 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-4c0fb4f3-c62d-4715-a1d1-a13a00aa1082 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] HTTP exception thrown: Instance bd14a732-a9ad-4dfd-af61-69b84eda8877 could not be found. Jul 18 02:10:16.812653 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4c0fb4f3-c62d-4715-a1d1-a13a00aa1082 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Request method failure captured: Jul 18 02:10:16.812653 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877 HTTP/1.1 Jul 18 02:10:16.812653 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:10:16.812653 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:10:16.812653 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:10:16.812653 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:10:16.812653 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:10:16.812653 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:10:16.812653 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:10:16.812653 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:10:16.812653 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MDHcKkxv785TruBaYZ9isdDskpkSTXS63FySdEQ2DQWlYCoBeefqvgfCQf6lXL0HIcBKCVhVPgBeigtx_Fr6JAMpyAfBIDaZdUpBEZ_ARmYr58LYp6mJVoQMeV86GVtrWumVWYiUwrWzpXpGhfDxCZstFRul6eTjV0GKZX_II9Blls Jul 18 02:10:16.812653 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:10:16.812653 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:10:16.812653 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:10:16.812653 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:10:16.812653 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:10:16.812653 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:10:16.812653 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: d6b1efcf9e224d66b7dbf31c8aa89f87 Jul 18 02:10:16.812653 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-872437023 Jul 18 02:10:16.812653 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:10:16.812653 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:10:16.814175 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d6b1efcf9e224d66b7dbf31c8aa89f87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d6b1efcf9e224d66b7dbf31c8aa89f87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d6b1efcf9e224d66b7dbf31c8aa89f87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d6b1efcf9e224d66b7dbf31c8aa89f87"}]}] Jul 18 02:10:16.814175 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-872437023 Jul 18 02:10:16.814175 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: d6b1efcf9e224d66b7dbf31c8aa89f87 Jul 18 02:10:16.814175 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-872437023 Jul 18 02:10:16.814175 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ImagesOneServerNegativeTestJSON-872437023-project Jul 18 02:10:16.814175 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:10:16.814175 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:10:16.814175 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 625ab51af53042138e5335e3ae6e5dac Jul 18 02:10:16.814175 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-872437023-project Jul 18 02:10:16.814175 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:10:16.814175 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance bd14a732-a9ad-4dfd-af61-69b84eda8877 could not be found. Jul 18 02:10:16.814175 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'bd14a732-a9ad-4dfd-af61-69b84eda8877'} Jul 18 02:10:16.815051 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:10:16.815051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:10:16.815051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:10:16.815051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:10:16.815051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:10:16.815051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:10:16.815051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:10:16.815051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:10:16.815051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:10:16.815051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:10:16.815051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd14a732-a9ad-4dfd-af61-69b84eda8877 could not be found. Jul 18 02:10:16.815051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:10:16.815051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:10:16.815051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:10:16.815051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:10:16.815051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:10:16.815051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:10:16.815051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:10:16.815051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:10:16.815051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:10:16.816370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:10:16.816370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:10:16.816370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:10:16.816370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:10:16.816370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:10:16.816370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:10:16.816370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:10:16.816370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd14a732-a9ad-4dfd-af61-69b84eda8877 could not be found. Jul 18 02:10:16.816370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:10:16.816370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:10:16.816370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:10:16.816370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:10:16.816370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:10:16.816370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:10:16.816370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:10:16.816370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:10:16.816370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd14a732-a9ad-4dfd-af61-69b84eda8877 could not be found. Jul 18 02:10:16.816370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:10:16.818123 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4c0fb4f3-c62d-4715-a1d1-a13a00aa1082 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Returning 404 to user: Instance bd14a732-a9ad-4dfd-af61-69b84eda8877 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:10:16.818123 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4c0fb4f3-c62d-4715-a1d1-a13a00aa1082 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877" status: 404 len: 111 microversion: 2.1 time: 0.042077 Jul 18 02:10:16.818123 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 331/650] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:16 2022] GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:10:16.828235 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6f3ed633-c15e-4f84-9470-6de9fd45b914 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:16.829029 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6f3ed633-c15e-4f84-9470-6de9fd45b914 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:16.836080 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6f3ed633-c15e-4f84-9470-6de9fd45b914 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:16.836526 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6f3ed633-c15e-4f84-9470-6de9fd45b914 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:16.837423 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6f3ed633-c15e-4f84-9470-6de9fd45b914 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:16.838104 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6f3ed633-c15e-4f84-9470-6de9fd45b914 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:16.855504 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d42455ae-3dd8-43af-b833-057f8bf61cf8 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.621334 Jul 18 02:10:16.863017 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 320/651] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:10:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:10:16.863017 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-8a6aeadd-2cd1-4639-9efb-e23bbd4b41e6 req-d15da3f0-fe56-4049-a7b7-3df5a5868162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd14a732-a9ad-4dfd-af61-69b84eda8877", "name": "network-vif-deleted", "tag": "8bd503c0-d3d5-4bae-9611-ac0c479b1c99"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:16.871511 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-8a6aeadd-2cd1-4639-9efb-e23bbd4b41e6 req-d15da3f0-fe56-4049-a7b7-3df5a5868162 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:16.872172 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-8a6aeadd-2cd1-4639-9efb-e23bbd4b41e6 req-d15da3f0-fe56-4049-a7b7-3df5a5868162 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:16.884254 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-8a6aeadd-2cd1-4639-9efb-e23bbd4b41e6 req-d15da3f0-fe56-4049-a7b7-3df5a5868162 service nova] Creating event network-vif-deleted:8bd503c0-d3d5-4bae-9611-ac0c479b1c99 for instance bd14a732-a9ad-4dfd-af61-69b84eda8877 on n-h1-465891-3 Jul 18 02:10:16.890617 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-8a6aeadd-2cd1-4639-9efb-e23bbd4b41e6 req-d15da3f0-fe56-4049-a7b7-3df5a5868162 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031985 Jul 18 02:10:16.891191 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 321/652] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:10:16.896996 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-602998c4-fae0-45f4-87af-2f1cb2fc5e7d tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:16.897864 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-602998c4-fae0-45f4-87af-2f1cb2fc5e7d tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:16.905475 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-602998c4-fae0-45f4-87af-2f1cb2fc5e7d tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:16.906077 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-602998c4-fae0-45f4-87af-2f1cb2fc5e7d tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:16.907010 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-602998c4-fae0-45f4-87af-2f1cb2fc5e7d tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:16.907814 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-602998c4-fae0-45f4-87af-2f1cb2fc5e7d tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:17.068932 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6f3ed633-c15e-4f84-9470-6de9fd45b914 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:17.079746 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6f3ed633-c15e-4f84-9470-6de9fd45b914 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 200 len: 1269 microversion: 2.1 time: 0.262458 Jul 18 02:10:17.080680 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 332/653] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:16 2022] GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 1269 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:17.086145 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-076aeed8-c75a-4a49-901b-28d15e547da2 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Action: 'create', calling method: .version_select at 0x7ff4a8ff5310>, body: {"keypair": {"name": "tempest-keypair-1594031962", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGkg/QZ9G5knaVetJVoWZFbcafxsvLG+X8sSIfRwmOSbRb/zKuMddcWNBErZswECrOWBpmhRhE/7i1lLTafNstU1aDkNZBCY1vZml055fL9e76cnNexQxBRbXRqGp8pf7g=="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:17.105565 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=47 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:10:17.108676 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-076aeed8-c75a-4a49-901b-28d15e547da2 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Getting quotas for project d6b1efcf9e224d66b7dbf31c8aa89f87. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:10:17.115412 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-602998c4-fae0-45f4-87af-2f1cb2fc5e7d tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] Lazy-loading 'services' on Instance uuid a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:10:17.116040 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-076aeed8-c75a-4a49-901b-28d15e547da2 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Getting quotas for user 625ab51af53042138e5335e3ae6e5dac and project d6b1efcf9e224d66b7dbf31c8aa89f87. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:10:17.143087 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-602998c4-fae0-45f4-87af-2f1cb2fc5e7d tempest-ServersAdmin275Test-22690682 tempest-ServersAdmin275Test-22690682-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 200 len: 1920 microversion: 2.75 time: 0.249757 Jul 18 02:10:17.144813 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 322/654] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:10:16 2022] GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 1920 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:10:17.150189 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-910d48a4-7c9f-497b-9cd4-480d152586eb tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:17.150808 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-910d48a4-7c9f-497b-9cd4-480d152586eb tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] [instance: 716de5b7-33a8-45f4-bdab-ec12b4daa8c2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:17.170820 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-076aeed8-c75a-4a49-901b-28d15e547da2 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.088568 Jul 18 02:10:17.174042 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 333/655] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 02:10:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:10:17.189565 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4b6a84c6-ad34-4613-804d-34ff4408b5d2 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:17.190828 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4b6a84c6-ad34-4613-804d-34ff4408b5d2 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 7f16fcdb-c2da-4a62-8393-e4977d34bd63] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:17.199587 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4b6a84c6-ad34-4613-804d-34ff4408b5d2 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:17.200796 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4b6a84c6-ad34-4613-804d-34ff4408b5d2 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:17.202278 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4b6a84c6-ad34-4613-804d-34ff4408b5d2 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:17.203014 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4b6a84c6-ad34-4613-804d-34ff4408b5d2 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:17.360003 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-910d48a4-7c9f-497b-9cd4-480d152586eb tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b94d6f2c2d8b42d38d1149dab5ad2d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1fb21b43343238f9e96d7dc003841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:17.374836 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-910d48a4-7c9f-497b-9cd4-480d152586eb tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] 10.222.0.57 "GET /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2" status: 200 len: 1223 microversion: 2.1 time: 0.228646 Jul 18 02:10:17.381909 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 323/656] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:17 2022] GET /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2 => generated 1223 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:17.387072 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-61cf532e-e3dd-45ed-a8b9-b968199ee81b tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:17.399729 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-61cf532e-e3dd-45ed-a8b9-b968199ee81b tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:17.409108 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-61cf532e-e3dd-45ed-a8b9-b968199ee81b tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:17.410539 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-61cf532e-e3dd-45ed-a8b9-b968199ee81b tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:17.411345 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-61cf532e-e3dd-45ed-a8b9-b968199ee81b tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:17.412017 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-61cf532e-e3dd-45ed-a8b9-b968199ee81b tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:17.462091 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-61cf532e-e3dd-45ed-a8b9-b968199ee81b tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:10:17.580197 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-61cf532e-e3dd-45ed-a8b9-b968199ee81b tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 204 len: 0 microversion: 2.75 time: 0.196583 Jul 18 02:10:17.580989 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 324/657] 10.222.0.57 () {60 vars in 1279 bytes} [Mon Jul 18 02:10:17 2022] DELETE /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:10:17.597148 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-627d2e32-cbe8-4d86-942b-571226108899 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:17.598243 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-627d2e32-cbe8-4d86-942b-571226108899 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:17.609549 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-627d2e32-cbe8-4d86-942b-571226108899 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:17.610630 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-627d2e32-cbe8-4d86-942b-571226108899 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:17.611492 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-627d2e32-cbe8-4d86-942b-571226108899 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:17.612258 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-627d2e32-cbe8-4d86-942b-571226108899 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:17.955436 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-627d2e32-cbe8-4d86-942b-571226108899 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:17.965962 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-627d2e32-cbe8-4d86-942b-571226108899 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:17.968005 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-627d2e32-cbe8-4d86-942b-571226108899 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:17.973341 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-627d2e32-cbe8-4d86-942b-571226108899 tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] 10.222.0.57 "GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 200 len: 1444 microversion: 2.75 time: 0.387245 Jul 18 02:10:17.974275 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 325/658] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:10:17 2022] GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 1444 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:10:17.986915 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2c841d96-0c39-4a48-bf2e-4d6221507e52 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:17.987603 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2c841d96-0c39-4a48-bf2e-4d6221507e52 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 25dfb6dd-6d5a-4399-a348-0a162ca907ef] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:17.995464 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2c841d96-0c39-4a48-bf2e-4d6221507e52 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:17.996020 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2c841d96-0c39-4a48-bf2e-4d6221507e52 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:17.998204 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2c841d96-0c39-4a48-bf2e-4d6221507e52 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:17.998728 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2c841d96-0c39-4a48-bf2e-4d6221507e52 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:18.054293 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4b6a84c6-ad34-4613-804d-34ff4408b5d2 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:18.062467 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4b6a84c6-ad34-4613-804d-34ff4408b5d2 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/7f16fcdb-c2da-4a62-8393-e4977d34bd63" status: 200 len: 1314 microversion: 2.1 time: 0.886999 Jul 18 02:10:18.063688 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 334/659] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:17 2022] GET /compute/v2.1/servers/7f16fcdb-c2da-4a62-8393-e4977d34bd63 => generated 1314 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:18.097693 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-53b3062d-7893-4390-8f20-7e3904e32a39 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:18.099022 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-53b3062d-7893-4390-8f20-7e3904e32a39 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:18.108986 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-53b3062d-7893-4390-8f20-7e3904e32a39 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:18.111791 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-53b3062d-7893-4390-8f20-7e3904e32a39 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:18.112614 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-53b3062d-7893-4390-8f20-7e3904e32a39 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:18.113058 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-53b3062d-7893-4390-8f20-7e3904e32a39 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:18.316179 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-53b3062d-7893-4390-8f20-7e3904e32a39 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:18.330211 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-53b3062d-7893-4390-8f20-7e3904e32a39 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 200 len: 1269 microversion: 2.1 time: 0.236378 Jul 18 02:10:18.333743 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 335/660] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:18 2022] GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 1269 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:18.393927 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b5609091-6ca7-4a23-8464-6747dec545a0 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:18.394950 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b5609091-6ca7-4a23-8464-6747dec545a0 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] [instance: 716de5b7-33a8-45f4-bdab-ec12b4daa8c2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:18.402065 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b5609091-6ca7-4a23-8464-6747dec545a0 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:18.402606 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b5609091-6ca7-4a23-8464-6747dec545a0 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:18.404001 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b5609091-6ca7-4a23-8464-6747dec545a0 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:18.404669 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b5609091-6ca7-4a23-8464-6747dec545a0 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:18.558363 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2c841d96-0c39-4a48-bf2e-4d6221507e52 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:18.576451 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2c841d96-0c39-4a48-bf2e-4d6221507e52 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef" status: 200 len: 1308 microversion: 2.1 time: 0.593917 Jul 18 02:10:18.577048 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 326/661] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:17 2022] GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef => generated 1308 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:18.583512 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b5609091-6ca7-4a23-8464-6747dec545a0 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b94d6f2c2d8b42d38d1149dab5ad2d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1fb21b43343238f9e96d7dc003841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:18.595753 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b5609091-6ca7-4a23-8464-6747dec545a0 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] 10.222.0.57 "GET /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2" status: 200 len: 1281 microversion: 2.1 time: 0.205916 Jul 18 02:10:18.596493 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 336/662] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:18 2022] GET /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2 => generated 1281 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:19.003462 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6f24ce16-2a51-422a-a6d9-33ff13d343cd tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:19.004111 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6f24ce16-2a51-422a-a6d9-33ff13d343cd tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:19.020550 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6f24ce16-2a51-422a-a6d9-33ff13d343cd tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:19.021025 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6f24ce16-2a51-422a-a6d9-33ff13d343cd tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:19.028617 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6f24ce16-2a51-422a-a6d9-33ff13d343cd tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:19.030081 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6f24ce16-2a51-422a-a6d9-33ff13d343cd tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:19.083451 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ac5c713e-336c-442e-a58c-d275976a5085 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:19.084633 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ac5c713e-336c-442e-a58c-d275976a5085 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 7f16fcdb-c2da-4a62-8393-e4977d34bd63] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:19.087283 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=12 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:10:19.105784 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ac5c713e-336c-442e-a58c-d275976a5085 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:19.106490 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ac5c713e-336c-442e-a58c-d275976a5085 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:19.107174 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ac5c713e-336c-442e-a58c-d275976a5085 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:19.109795 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ac5c713e-336c-442e-a58c-d275976a5085 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:19.186705 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6f24ce16-2a51-422a-a6d9-33ff13d343cd tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:19.198953 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6f24ce16-2a51-422a-a6d9-33ff13d343cd tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:19.205671 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6f24ce16-2a51-422a-a6d9-33ff13d343cd tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c087c0142aef4b5fb9e9d911af80abdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92018f8db7a44c73ac1a3badba60b51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:19.236759 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6f24ce16-2a51-422a-a6d9-33ff13d343cd tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] 10.222.0.57 "GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 200 len: 1444 microversion: 2.75 time: 0.228049 Jul 18 02:10:19.239306 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 327/663] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:10:18 2022] GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 1444 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:10:19.347823 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1f9b4351-42f5-4aa8-b81c-d3c940916e97 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:19.348443 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1f9b4351-42f5-4aa8-b81c-d3c940916e97 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:19.366834 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1f9b4351-42f5-4aa8-b81c-d3c940916e97 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:19.367309 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1f9b4351-42f5-4aa8-b81c-d3c940916e97 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:19.368360 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1f9b4351-42f5-4aa8-b81c-d3c940916e97 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:19.369050 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1f9b4351-42f5-4aa8-b81c-d3c940916e97 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:19.585664 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ac5c713e-336c-442e-a58c-d275976a5085 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:19.594300 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ac5c713e-336c-442e-a58c-d275976a5085 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/7f16fcdb-c2da-4a62-8393-e4977d34bd63" status: 200 len: 1314 microversion: 2.1 time: 0.516533 Jul 18 02:10:19.598039 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 337/664] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:19 2022] GET /compute/v2.1/servers/7f16fcdb-c2da-4a62-8393-e4977d34bd63 => generated 1314 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:19.612655 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-b1af3624-676c-47c2-a38b-02fd6f56b0fb req-d5b2da17-b5e0-4b72-aebc-fb76a618317f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25dfb6dd-6d5a-4399-a348-0a162ca907ef", "tag": "c841be8a-afd4-4301-bb2a-8f0504345c0f"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:19.628999 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-b1af3624-676c-47c2-a38b-02fd6f56b0fb req-d5b2da17-b5e0-4b72-aebc-fb76a618317f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:19.629512 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-b1af3624-676c-47c2-a38b-02fd6f56b0fb req-d5b2da17-b5e0-4b72-aebc-fb76a618317f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:19.660407 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-b1af3624-676c-47c2-a38b-02fd6f56b0fb req-d5b2da17-b5e0-4b72-aebc-fb76a618317f service nova] Creating event network-changed:c841be8a-afd4-4301-bb2a-8f0504345c0f for instance 25dfb6dd-6d5a-4399-a348-0a162ca907ef on n-h1-465891-3 Jul 18 02:10:19.671230 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-b1af3624-676c-47c2-a38b-02fd6f56b0fb req-d5b2da17-b5e0-4b72-aebc-fb76a618317f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061189 Jul 18 02:10:19.672231 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 338/665] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:10:19.678376 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7037df8e-0340-4745-b5aa-785c60d11d06 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:19.679415 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7037df8e-0340-4745-b5aa-785c60d11d06 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 25dfb6dd-6d5a-4399-a348-0a162ca907ef] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:19.688149 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7037df8e-0340-4745-b5aa-785c60d11d06 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:19.688730 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7037df8e-0340-4745-b5aa-785c60d11d06 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:19.689880 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7037df8e-0340-4745-b5aa-785c60d11d06 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:19.690734 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7037df8e-0340-4745-b5aa-785c60d11d06 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:19.727983 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:10:20.085406 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1f9b4351-42f5-4aa8-b81c-d3c940916e97 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:20.101832 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1f9b4351-42f5-4aa8-b81c-d3c940916e97 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 200 len: 1311 microversion: 2.1 time: 0.758273 Jul 18 02:10:20.106507 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 328/666] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:19 2022] GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 1311 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:20.113982 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-69647c48-35f9-4393-9c43-759d415e6c5d tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:20.114849 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-69647c48-35f9-4393-9c43-759d415e6c5d tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] [instance: 716de5b7-33a8-45f4-bdab-ec12b4daa8c2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:20.122540 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69647c48-35f9-4393-9c43-759d415e6c5d tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:20.123444 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69647c48-35f9-4393-9c43-759d415e6c5d tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:20.124385 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69647c48-35f9-4393-9c43-759d415e6c5d tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:20.124982 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69647c48-35f9-4393-9c43-759d415e6c5d tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:20.334042 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7037df8e-0340-4745-b5aa-785c60d11d06 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:20.352602 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7037df8e-0340-4745-b5aa-785c60d11d06 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef" status: 200 len: 1308 microversion: 2.1 time: 0.678267 Jul 18 02:10:20.353445 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 339/667] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:19 2022] GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef => generated 1308 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:20.367935 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-38eaaa0b-8aca-4d89-a930-26fffa6b05b2 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-61122599", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:20.467499 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-38eaaa0b-8aca-4d89-a930-26fffa6b05b2 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] validate_networks() for [('18a8c0db-595b-4b61-b28a-ffc00975cfcb', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:10:20.793346 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-69647c48-35f9-4393-9c43-759d415e6c5d tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b94d6f2c2d8b42d38d1149dab5ad2d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1fb21b43343238f9e96d7dc003841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:20.808303 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-69647c48-35f9-4393-9c43-759d415e6c5d tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] 10.222.0.57 "GET /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2" status: 200 len: 1323 microversion: 2.1 time: 0.700480 Jul 18 02:10:20.819235 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 329/668] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:20 2022] GET /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2 => generated 1323 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:20.827773 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-11e1101b-9bb7-4e93-9009-96ea61519a2b tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:20.828392 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-11e1101b-9bb7-4e93-9009-96ea61519a2b tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] [instance: a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:20.855203 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-11e1101b-9bb7-4e93-9009-96ea61519a2b tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:20.856016 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-11e1101b-9bb7-4e93-9009-96ea61519a2b tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:20.862605 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-11e1101b-9bb7-4e93-9009-96ea61519a2b tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:20.863668 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-11e1101b-9bb7-4e93-9009-96ea61519a2b tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:20.921039 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-11e1101b-9bb7-4e93-9009-96ea61519a2b tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] HTTP exception thrown: Instance a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a could not be found. Jul 18 02:10:20.922832 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-11e1101b-9bb7-4e93-9009-96ea61519a2b tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Request method failure captured: Jul 18 02:10:20.922832 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a HTTP/1.1 Jul 18 02:10:20.922832 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:10:20.922832 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:10:20.922832 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:10:20.922832 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:10:20.922832 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:10:20.922832 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:10:20.922832 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:10:20.922832 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:10:20.922832 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MC7_UUB4n3ANWwusLNxh1Q82i22QEQ214TW-2cK_GlmQOv9BJK_bsxgNi0YiW23rshRW_GdBu-UU5_7QasiSDAsM87_JQgflcjv2VFAOFYdaWyETv4ly_RPMm5IgT3peTHW6sBcuwShfjeUed8sUXzhiSRtBTNdN2TR0ARf3FCBz7s Jul 18 02:10:20.922832 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:10:20.922832 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:10:20.922832 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:10:20.922832 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:10:20.922832 n-d-465891-3 devstack@n-api.service[119544]: X-Openstack-Nova-Api-Version: 2.75 Jul 18 02:10:20.922832 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:10:20.922832 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:10:20.922832 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 92018f8db7a44c73ac1a3badba60b51e Jul 18 02:10:20.922832 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersAdmin275Test-65892183 Jul 18 02:10:20.922832 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:10:20.922832 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:10:20.924537 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_92018f8db7a44c73ac1a3badba60b51e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/92018f8db7a44c73ac1a3badba60b51e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/92018f8db7a44c73ac1a3badba60b51e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/92018f8db7a44c73ac1a3badba60b51e"}]}] Jul 18 02:10:20.924537 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersAdmin275Test-65892183 Jul 18 02:10:20.924537 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 92018f8db7a44c73ac1a3badba60b51e Jul 18 02:10:20.924537 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersAdmin275Test-65892183 Jul 18 02:10:20.924537 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersAdmin275Test-65892183-project Jul 18 02:10:20.924537 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:10:20.924537 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:10:20.924537 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: c087c0142aef4b5fb9e9d911af80abdd Jul 18 02:10:20.924537 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersAdmin275Test-65892183-project Jul 18 02:10:20.924537 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:10:20.924537 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a could not be found. Jul 18 02:10:20.924537 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a'} Jul 18 02:10:20.925455 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:10:20.925455 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:10:20.925455 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:10:20.925455 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:10:20.925455 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:10:20.925455 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:10:20.925455 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:10:20.925455 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:10:20.925455 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:10:20.925455 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:10:20.925455 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a could not be found. Jul 18 02:10:20.925455 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:10:20.925455 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:10:20.925455 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:10:20.925455 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:10:20.925455 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:10:20.925455 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:10:20.925455 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:10:20.925455 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:10:20.925455 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:10:20.926941 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:10:20.926941 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:10:20.926941 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:10:20.926941 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:10:20.926941 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:10:20.926941 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:10:20.926941 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:10:20.926941 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a could not be found. Jul 18 02:10:20.926941 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:10:20.926941 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:10:20.926941 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:10:20.926941 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:10:20.926941 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:10:20.926941 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:10:20.926941 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:10:20.926941 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:10:20.926941 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a could not be found. Jul 18 02:10:20.926941 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:10:20.928223 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-11e1101b-9bb7-4e93-9009-96ea61519a2b tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] Returning 404 to user: Instance a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:10:20.928223 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-11e1101b-9bb7-4e93-9009-96ea61519a2b tempest-ServersAdmin275Test-65892183 tempest-ServersAdmin275Test-65892183-project] 10.222.0.57 "GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a" status: 404 len: 111 microversion: 2.75 time: 0.112117 Jul 18 02:10:20.931129 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 330/669] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:10:20 2022] GET /compute/v2.1/servers/a3f892a7-1cf1-44b8-b56a-dc18b30f8d1a => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:10:20.940097 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-faa4f78d-88ec-4708-9a94-4b016e5446b0 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:20.940956 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-faa4f78d-88ec-4708-9a94-4b016e5446b0 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 7f16fcdb-c2da-4a62-8393-e4977d34bd63] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:20.960708 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-faa4f78d-88ec-4708-9a94-4b016e5446b0 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:20.961335 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-faa4f78d-88ec-4708-9a94-4b016e5446b0 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:20.962364 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-faa4f78d-88ec-4708-9a94-4b016e5446b0 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:20.962959 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-faa4f78d-88ec-4708-9a94-4b016e5446b0 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:20.970098 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:10:21.898152 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-faa4f78d-88ec-4708-9a94-4b016e5446b0 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:21.911698 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-faa4f78d-88ec-4708-9a94-4b016e5446b0 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/7f16fcdb-c2da-4a62-8393-e4977d34bd63" status: 200 len: 1314 microversion: 2.1 time: 0.979430 Jul 18 02:10:21.913505 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 331/670] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:20 2022] GET /compute/v2.1/servers/7f16fcdb-c2da-4a62-8393-e4977d34bd63 => generated 1314 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:21.921025 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4fd9b1a7-7b9c-4538-939e-9e07839e3ef1 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:21.921662 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4fd9b1a7-7b9c-4538-939e-9e07839e3ef1 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:21.930415 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4fd9b1a7-7b9c-4538-939e-9e07839e3ef1 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:21.931216 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4fd9b1a7-7b9c-4538-939e-9e07839e3ef1 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:21.932267 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4fd9b1a7-7b9c-4538-939e-9e07839e3ef1 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:21.932869 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4fd9b1a7-7b9c-4538-939e-9e07839e3ef1 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:22.182258 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-38eaaa0b-8aca-4d89-a930-26fffa6b05b2 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:10:22.183951 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-38eaaa0b-8aca-4d89-a930-26fffa6b05b2 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:10:22.186155 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-38eaaa0b-8aca-4d89-a930-26fffa6b05b2 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:10:22.187919 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-38eaaa0b-8aca-4d89-a930-26fffa6b05b2 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:10:22.188744 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-38eaaa0b-8aca-4d89-a930-26fffa6b05b2 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:10:22.201980 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-38eaaa0b-8aca-4d89-a930-26fffa6b05b2 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:22.202797 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-38eaaa0b-8aca-4d89-a930-26fffa6b05b2 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:22.203847 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-38eaaa0b-8aca-4d89-a930-26fffa6b05b2 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:22.204541 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-38eaaa0b-8aca-4d89-a930-26fffa6b05b2 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:22.218844 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4fd9b1a7-7b9c-4538-939e-9e07839e3ef1 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:22.230881 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4fd9b1a7-7b9c-4538-939e-9e07839e3ef1 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 200 len: 1311 microversion: 2.1 time: 0.315549 Jul 18 02:10:22.234915 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 332/671] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:21 2022] GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 1311 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:22.249484 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-38eaaa0b-8aca-4d89-a930-26fffa6b05b2 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Getting quotas for project d6b1efcf9e224d66b7dbf31c8aa89f87. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:10:22.250215 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ff2a42e1-be79-42f8-982a-a5d36279e201 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:22.251206 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ff2a42e1-be79-42f8-982a-a5d36279e201 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 25dfb6dd-6d5a-4399-a348-0a162ca907ef] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:22.261013 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ff2a42e1-be79-42f8-982a-a5d36279e201 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:22.261273 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-38eaaa0b-8aca-4d89-a930-26fffa6b05b2 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Getting quotas for user 625ab51af53042138e5335e3ae6e5dac and project d6b1efcf9e224d66b7dbf31c8aa89f87. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:10:22.262042 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ff2a42e1-be79-42f8-982a-a5d36279e201 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:22.263968 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ff2a42e1-be79-42f8-982a-a5d36279e201 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:22.264780 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ff2a42e1-be79-42f8-982a-a5d36279e201 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:22.289619 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-38eaaa0b-8aca-4d89-a930-26fffa6b05b2 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:10:22.292015 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-38eaaa0b-8aca-4d89-a930-26fffa6b05b2 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 25f8645e-70fa-4fc4-ae8f-ee303c090469] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:10:22.377357 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-38eaaa0b-8aca-4d89-a930-26fffa6b05b2 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.022223 Jul 18 02:10:22.379243 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 340/672] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:10:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 2025 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:10:22.389342 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9c71baff-965a-45e4-8f79-63009241a4bb tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:22.390416 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9c71baff-965a-45e4-8f79-63009241a4bb tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] [instance: 716de5b7-33a8-45f4-bdab-ec12b4daa8c2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:22.399462 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9c71baff-965a-45e4-8f79-63009241a4bb tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:22.400385 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9c71baff-965a-45e4-8f79-63009241a4bb tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:22.402050 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9c71baff-965a-45e4-8f79-63009241a4bb tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:22.402696 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9c71baff-965a-45e4-8f79-63009241a4bb tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:22.613668 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ff2a42e1-be79-42f8-982a-a5d36279e201 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:22.630579 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ff2a42e1-be79-42f8-982a-a5d36279e201 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef" status: 200 len: 1308 microversion: 2.1 time: 0.396685 Jul 18 02:10:22.631438 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 333/673] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:22 2022] GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef => generated 1308 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:22.636351 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-2eeb6f19-0032-4c73-a09a-a5d71751edb2 req-e136fbf5-d729-4376-9781-af9d4bdb6a54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22002049-4347-47d8-a5a2-6d3f31ec8927", "tag": "83756a9c-0161-44d8-b50b-8a364a6fcada"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:22.647638 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-2eeb6f19-0032-4c73-a09a-a5d71751edb2 req-e136fbf5-d729-4376-9781-af9d4bdb6a54 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:22.648489 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-2eeb6f19-0032-4c73-a09a-a5d71751edb2 req-e136fbf5-d729-4376-9781-af9d4bdb6a54 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:22.665060 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-2eeb6f19-0032-4c73-a09a-a5d71751edb2 req-e136fbf5-d729-4376-9781-af9d4bdb6a54 service nova] Creating event network-changed:83756a9c-0161-44d8-b50b-8a364a6fcada for instance 22002049-4347-47d8-a5a2-6d3f31ec8927 on n-h1-465891-3 Jul 18 02:10:22.676433 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-2eeb6f19-0032-4c73-a09a-a5d71751edb2 req-e136fbf5-d729-4376-9781-af9d4bdb6a54 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040305 Jul 18 02:10:22.679605 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 334/674] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:10:22.688251 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-4c08e00c-61b7-4227-bcd9-bf103ac9890e req-c7621aba-d90e-4264-aeec-eaba6964049e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "716de5b7-33a8-45f4-bdab-ec12b4daa8c2", "tag": "af0af000-b5ca-4135-9374-8b1af4f9aa46"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:22.698499 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-4c08e00c-61b7-4227-bcd9-bf103ac9890e req-c7621aba-d90e-4264-aeec-eaba6964049e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:22.699138 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-4c08e00c-61b7-4227-bcd9-bf103ac9890e req-c7621aba-d90e-4264-aeec-eaba6964049e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:22.718134 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-4c08e00c-61b7-4227-bcd9-bf103ac9890e req-c7621aba-d90e-4264-aeec-eaba6964049e service nova] Creating event network-changed:af0af000-b5ca-4135-9374-8b1af4f9aa46 for instance 716de5b7-33a8-45f4-bdab-ec12b4daa8c2 on n-h1-465891-3 Jul 18 02:10:22.723733 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-4c08e00c-61b7-4227-bcd9-bf103ac9890e req-c7621aba-d90e-4264-aeec-eaba6964049e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042630 Jul 18 02:10:22.724879 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 335/675] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:10:22.734388 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9c71baff-965a-45e4-8f79-63009241a4bb tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b94d6f2c2d8b42d38d1149dab5ad2d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1fb21b43343238f9e96d7dc003841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:22.748487 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9f9f5f63-87a8-481d-b07c-397169afd618 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:22.749194 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9f9f5f63-87a8-481d-b07c-397169afd618 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 25f8645e-70fa-4fc4-ae8f-ee303c090469] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:22.753724 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9c71baff-965a-45e4-8f79-63009241a4bb tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] 10.222.0.57 "GET /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2" status: 200 len: 1323 microversion: 2.1 time: 0.372250 Jul 18 02:10:22.754319 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 341/676] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:22 2022] GET /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2 => generated 1323 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:22.817584 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9f9f5f63-87a8-481d-b07c-397169afd618 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:22.828739 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9f9f5f63-87a8-481d-b07c-397169afd618 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469" status: 200 len: 1223 microversion: 2.1 time: 0.101822 Jul 18 02:10:22.829109 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 336/677] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:22 2022] GET /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469 => generated 1223 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:22.930110 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-baf83882-dc4f-4af7-b889-5dce25f237ee tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:22.930958 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-baf83882-dc4f-4af7-b889-5dce25f237ee tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 7f16fcdb-c2da-4a62-8393-e4977d34bd63] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:22.940844 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-baf83882-dc4f-4af7-b889-5dce25f237ee tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:22.943416 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-baf83882-dc4f-4af7-b889-5dce25f237ee tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:22.944632 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-baf83882-dc4f-4af7-b889-5dce25f237ee tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:22.945091 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-baf83882-dc4f-4af7-b889-5dce25f237ee tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:23.049353 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-162915b9-2ed3-431c-99ca-218536a3dd18 req-624a94fa-f7cf-47d7-8782-ab6b2ba36e2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f16fcdb-c2da-4a62-8393-e4977d34bd63", "name": "network-vif-plugged", "status": "completed", "tag": "8178a5b6-596e-4fea-a484-79a9a9927b7d"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:23.065464 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-162915b9-2ed3-431c-99ca-218536a3dd18 req-624a94fa-f7cf-47d7-8782-ab6b2ba36e2e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:23.067860 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-162915b9-2ed3-431c-99ca-218536a3dd18 req-624a94fa-f7cf-47d7-8782-ab6b2ba36e2e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:23.096508 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-162915b9-2ed3-431c-99ca-218536a3dd18 req-624a94fa-f7cf-47d7-8782-ab6b2ba36e2e service nova] Creating event network-vif-plugged:8178a5b6-596e-4fea-a484-79a9a9927b7d for instance 7f16fcdb-c2da-4a62-8393-e4977d34bd63 on n-h2-465891-3 Jul 18 02:10:23.112660 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-162915b9-2ed3-431c-99ca-218536a3dd18 req-624a94fa-f7cf-47d7-8782-ab6b2ba36e2e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060763 Jul 18 02:10:23.116213 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 337/678] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:10:23.180402 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-baf83882-dc4f-4af7-b889-5dce25f237ee tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:23.193162 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-baf83882-dc4f-4af7-b889-5dce25f237ee tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/7f16fcdb-c2da-4a62-8393-e4977d34bd63" status: 200 len: 1314 microversion: 2.1 time: 0.267193 Jul 18 02:10:23.194612 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 342/679] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:22 2022] GET /compute/v2.1/servers/7f16fcdb-c2da-4a62-8393-e4977d34bd63 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:23.250215 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b64abc86-25a3-4901-b4c2-0ea84e11c618 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:23.252457 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b64abc86-25a3-4901-b4c2-0ea84e11c618 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:23.259760 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b64abc86-25a3-4901-b4c2-0ea84e11c618 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:23.261137 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b64abc86-25a3-4901-b4c2-0ea84e11c618 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:23.262837 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b64abc86-25a3-4901-b4c2-0ea84e11c618 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:23.264771 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b64abc86-25a3-4901-b4c2-0ea84e11c618 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:23.444327 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b64abc86-25a3-4901-b4c2-0ea84e11c618 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:23.453266 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b64abc86-25a3-4901-b4c2-0ea84e11c618 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 200 len: 1311 microversion: 2.1 time: 0.208212 Jul 18 02:10:23.463410 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 338/680] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:23 2022] GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 1311 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:23.649486 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7aee6457-6453-494e-a5e2-a2bce04ed431 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:23.650185 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7aee6457-6453-494e-a5e2-a2bce04ed431 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 25dfb6dd-6d5a-4399-a348-0a162ca907ef] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:23.659994 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7aee6457-6453-494e-a5e2-a2bce04ed431 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:23.660443 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7aee6457-6453-494e-a5e2-a2bce04ed431 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:23.661358 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7aee6457-6453-494e-a5e2-a2bce04ed431 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:23.661813 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7aee6457-6453-494e-a5e2-a2bce04ed431 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:23.774798 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ac417f57-f66c-4510-bd49-18753b41c66f tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:23.777300 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ac417f57-f66c-4510-bd49-18753b41c66f tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] [instance: 716de5b7-33a8-45f4-bdab-ec12b4daa8c2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:23.787928 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ac417f57-f66c-4510-bd49-18753b41c66f tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:23.788425 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ac417f57-f66c-4510-bd49-18753b41c66f tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:23.790414 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ac417f57-f66c-4510-bd49-18753b41c66f tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:23.790555 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ac417f57-f66c-4510-bd49-18753b41c66f tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:23.957587 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7aee6457-6453-494e-a5e2-a2bce04ed431 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:23.968504 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7aee6457-6453-494e-a5e2-a2bce04ed431 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef" status: 200 len: 1308 microversion: 2.1 time: 0.322853 Jul 18 02:10:23.978848 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 343/681] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:23 2022] GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef => generated 1308 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:10:23.987142 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-31fa770c-d7ad-4064-bb17-d06e81d0f0df tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:23.988523 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-31fa770c-d7ad-4064-bb17-d06e81d0f0df tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 25f8645e-70fa-4fc4-ae8f-ee303c090469] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:24.003802 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-31fa770c-d7ad-4064-bb17-d06e81d0f0df tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:24.004877 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-31fa770c-d7ad-4064-bb17-d06e81d0f0df tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:24.005906 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-31fa770c-d7ad-4064-bb17-d06e81d0f0df tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:24.006586 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-31fa770c-d7ad-4064-bb17-d06e81d0f0df tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:24.056275 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ac417f57-f66c-4510-bd49-18753b41c66f tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b94d6f2c2d8b42d38d1149dab5ad2d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1fb21b43343238f9e96d7dc003841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:24.072638 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ac417f57-f66c-4510-bd49-18753b41c66f tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] 10.222.0.57 "GET /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2" status: 200 len: 1323 microversion: 2.1 time: 0.304588 Jul 18 02:10:24.073889 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 339/682] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:23 2022] GET /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2 => generated 1323 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:24.135362 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-31fa770c-d7ad-4064-bb17-d06e81d0f0df tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:24.147576 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-31fa770c-d7ad-4064-bb17-d06e81d0f0df tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469" status: 200 len: 1275 microversion: 2.1 time: 0.166565 Jul 18 02:10:24.150007 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 344/683] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:23 2022] GET /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469 => generated 1275 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:24.221815 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-43f614a2-590d-4747-9f48-62755165125c tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:24.222687 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-43f614a2-590d-4747-9f48-62755165125c tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 7f16fcdb-c2da-4a62-8393-e4977d34bd63] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:24.231826 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-43f614a2-590d-4747-9f48-62755165125c tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:24.232578 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-43f614a2-590d-4747-9f48-62755165125c tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:24.233525 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-43f614a2-590d-4747-9f48-62755165125c tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:24.234219 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-43f614a2-590d-4747-9f48-62755165125c tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:24.474488 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a10e78f6-f370-43a1-afa1-1f5283c3c8e0 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:24.475144 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a10e78f6-f370-43a1-afa1-1f5283c3c8e0 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:24.485374 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a10e78f6-f370-43a1-afa1-1f5283c3c8e0 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:24.486157 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a10e78f6-f370-43a1-afa1-1f5283c3c8e0 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:24.487471 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a10e78f6-f370-43a1-afa1-1f5283c3c8e0 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:24.505751 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a10e78f6-f370-43a1-afa1-1f5283c3c8e0 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:24.818236 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-43f614a2-590d-4747-9f48-62755165125c tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:24.829189 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-43f614a2-590d-4747-9f48-62755165125c tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/7f16fcdb-c2da-4a62-8393-e4977d34bd63" status: 200 len: 1314 microversion: 2.1 time: 0.613725 Jul 18 02:10:24.840954 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 340/684] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:24 2022] GET /compute/v2.1/servers/7f16fcdb-c2da-4a62-8393-e4977d34bd63 => generated 1314 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:24.986666 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1a27759b-d40c-4bb2-b149-5b6f88d557f4 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:24.987856 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1a27759b-d40c-4bb2-b149-5b6f88d557f4 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 25dfb6dd-6d5a-4399-a348-0a162ca907ef] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:24.995709 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1a27759b-d40c-4bb2-b149-5b6f88d557f4 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:24.998184 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1a27759b-d40c-4bb2-b149-5b6f88d557f4 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:24.999313 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1a27759b-d40c-4bb2-b149-5b6f88d557f4 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:24.999872 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1a27759b-d40c-4bb2-b149-5b6f88d557f4 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:25.238368 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a10e78f6-f370-43a1-afa1-1f5283c3c8e0 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:25.246036 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a10e78f6-f370-43a1-afa1-1f5283c3c8e0 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 200 len: 1311 microversion: 2.1 time: 0.778007 Jul 18 02:10:25.252644 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 345/685] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:24 2022] GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 1311 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:25.259651 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3b0eb4e3-d2f8-46b9-a437-f529784298c5 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:25.262388 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3b0eb4e3-d2f8-46b9-a437-f529784298c5 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] [instance: 716de5b7-33a8-45f4-bdab-ec12b4daa8c2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:25.283873 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3b0eb4e3-d2f8-46b9-a437-f529784298c5 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:25.287178 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3b0eb4e3-d2f8-46b9-a437-f529784298c5 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:25.289418 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3b0eb4e3-d2f8-46b9-a437-f529784298c5 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:25.291329 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3b0eb4e3-d2f8-46b9-a437-f529784298c5 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:25.879168 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1a27759b-d40c-4bb2-b149-5b6f88d557f4 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:25.887460 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1a27759b-d40c-4bb2-b149-5b6f88d557f4 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef" status: 200 len: 1308 microversion: 2.1 time: 0.904752 Jul 18 02:10:25.888698 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 341/686] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:24 2022] GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef => generated 1308 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:25.893937 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6e046ea4-a1a7-4e5b-83e6-0a538a2c6941 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:25.894841 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6e046ea4-a1a7-4e5b-83e6-0a538a2c6941 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 25f8645e-70fa-4fc4-ae8f-ee303c090469] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:25.901228 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6e046ea4-a1a7-4e5b-83e6-0a538a2c6941 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:25.902032 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6e046ea4-a1a7-4e5b-83e6-0a538a2c6941 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:25.904651 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6e046ea4-a1a7-4e5b-83e6-0a538a2c6941 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:25.905437 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6e046ea4-a1a7-4e5b-83e6-0a538a2c6941 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:26.021718 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3b0eb4e3-d2f8-46b9-a437-f529784298c5 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b94d6f2c2d8b42d38d1149dab5ad2d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1fb21b43343238f9e96d7dc003841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:26.032424 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3b0eb4e3-d2f8-46b9-a437-f529784298c5 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] 10.222.0.57 "GET /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2" status: 200 len: 1323 microversion: 2.1 time: 0.778274 Jul 18 02:10:26.033647 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 346/687] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:25 2022] GET /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2 => generated 1323 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:26.038961 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a2cfc2da-3e26-4983-a11c-b1bc73fec8f4 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:26.039805 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a2cfc2da-3e26-4983-a11c-b1bc73fec8f4 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 7f16fcdb-c2da-4a62-8393-e4977d34bd63] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:26.047387 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a2cfc2da-3e26-4983-a11c-b1bc73fec8f4 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:26.048066 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a2cfc2da-3e26-4983-a11c-b1bc73fec8f4 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:26.050192 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a2cfc2da-3e26-4983-a11c-b1bc73fec8f4 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:26.050689 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a2cfc2da-3e26-4983-a11c-b1bc73fec8f4 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:26.071316 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6e046ea4-a1a7-4e5b-83e6-0a538a2c6941 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:26.086771 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6e046ea4-a1a7-4e5b-83e6-0a538a2c6941 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469" status: 200 len: 1281 microversion: 2.1 time: 0.196648 Jul 18 02:10:26.098093 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 342/688] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:25 2022] GET /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469 => generated 1281 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:26.264276 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-02bdbaa8-400d-432b-9ebd-e70a8e8f0709 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:26.265166 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-02bdbaa8-400d-432b-9ebd-e70a8e8f0709 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:26.274557 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-02bdbaa8-400d-432b-9ebd-e70a8e8f0709 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:26.277049 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-02bdbaa8-400d-432b-9ebd-e70a8e8f0709 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:26.278475 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-02bdbaa8-400d-432b-9ebd-e70a8e8f0709 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:26.282352 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-02bdbaa8-400d-432b-9ebd-e70a8e8f0709 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:26.757887 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:10:26.915261 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a2cfc2da-3e26-4983-a11c-b1bc73fec8f4 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:26.924559 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a2cfc2da-3e26-4983-a11c-b1bc73fec8f4 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/7f16fcdb-c2da-4a62-8393-e4977d34bd63" status: 200 len: 1463 microversion: 2.1 time: 0.889520 Jul 18 02:10:26.926032 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 347/689] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:26 2022] GET /compute/v2.1/servers/7f16fcdb-c2da-4a62-8393-e4977d34bd63 => generated 1463 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:26.963796 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-02bdbaa8-400d-432b-9ebd-e70a8e8f0709 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:26.981642 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-02bdbaa8-400d-432b-9ebd-e70a8e8f0709 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 200 len: 1311 microversion: 2.1 time: 0.718661 Jul 18 02:10:26.982694 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 343/690] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:26 2022] GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 1311 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:26.995546 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6c8adb0c-c9bb-4291-b636-652d3258e1bd tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:26.999238 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6c8adb0c-c9bb-4291-b636-652d3258e1bd tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 25dfb6dd-6d5a-4399-a348-0a162ca907ef] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:27.015950 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6c8adb0c-c9bb-4291-b636-652d3258e1bd tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:27.017907 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6c8adb0c-c9bb-4291-b636-652d3258e1bd tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:27.021785 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6c8adb0c-c9bb-4291-b636-652d3258e1bd tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:27.022388 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6c8adb0c-c9bb-4291-b636-652d3258e1bd tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:27.251505 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-77e9e5bd-53bd-4be9-b1eb-9cb83436b0a8 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-322043064", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:27.340801 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-77e9e5bd-53bd-4be9-b1eb-9cb83436b0a8 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] validate_networks() for None {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:10:27.570012 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6c8adb0c-c9bb-4291-b636-652d3258e1bd tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:27.586725 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6c8adb0c-c9bb-4291-b636-652d3258e1bd tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef" status: 200 len: 1308 microversion: 2.1 time: 0.599814 Jul 18 02:10:27.593534 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 344/691] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:26 2022] GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef => generated 1308 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:27.834535 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-77e9e5bd-53bd-4be9-b1eb-9cb83436b0a8 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:10:27.835700 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-77e9e5bd-53bd-4be9-b1eb-9cb83436b0a8 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:10:27.838733 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-77e9e5bd-53bd-4be9-b1eb-9cb83436b0a8 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:10:27.839735 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-77e9e5bd-53bd-4be9-b1eb-9cb83436b0a8 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:10:27.841155 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-77e9e5bd-53bd-4be9-b1eb-9cb83436b0a8 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:10:27.881129 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77e9e5bd-53bd-4be9-b1eb-9cb83436b0a8 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:27.882352 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77e9e5bd-53bd-4be9-b1eb-9cb83436b0a8 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:27.883937 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77e9e5bd-53bd-4be9-b1eb-9cb83436b0a8 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:27.884926 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77e9e5bd-53bd-4be9-b1eb-9cb83436b0a8 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:27.909618 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7bc739ea-9852-4d67-aed1-c51a318341c6 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:27.913841 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7bc739ea-9852-4d67-aed1-c51a318341c6 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Searching by: {'deleted': False, 'project_id': 'd28aa0cb826447f8ba1282fd794e2c11'} {{(pid=119544) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:10:27.922814 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7bc739ea-9852-4d67-aed1-c51a318341c6 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:27.923504 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7bc739ea-9852-4d67-aed1-c51a318341c6 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:27.924737 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7bc739ea-9852-4d67-aed1-c51a318341c6 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:27.925492 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7bc739ea-9852-4d67-aed1-c51a318341c6 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:27.959610 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-77e9e5bd-53bd-4be9-b1eb-9cb83436b0a8 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Getting quotas for project 3d8e996befd24b26b0371ad9cdb4a069. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:10:27.981370 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-77e9e5bd-53bd-4be9-b1eb-9cb83436b0a8 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Getting quotas for user b6962b97241f4c3a9960bb5fe52f8697 and project 3d8e996befd24b26b0371ad9cdb4a069. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:10:27.988509 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:10:28.017862 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-77e9e5bd-53bd-4be9-b1eb-9cb83436b0a8 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:10:28.027338 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-77e9e5bd-53bd-4be9-b1eb-9cb83436b0a8 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: 8c643d39-a6e1-41ec-a6f9-ffaf41421eb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:10:28.065906 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7bc739ea-9852-4d67-aed1-c51a318341c6 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.470439 Jul 18 02:10:28.068561 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 345/692] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:10:27 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:10:28.074953 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7aff16f1-6c7a-487e-91ec-f29980a36f26 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:28.076291 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7aff16f1-6c7a-487e-91ec-f29980a36f26 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] [instance: 716de5b7-33a8-45f4-bdab-ec12b4daa8c2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:28.085499 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7aff16f1-6c7a-487e-91ec-f29980a36f26 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:28.086536 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7aff16f1-6c7a-487e-91ec-f29980a36f26 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:28.087508 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7aff16f1-6c7a-487e-91ec-f29980a36f26 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:28.088098 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7aff16f1-6c7a-487e-91ec-f29980a36f26 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:28.165185 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-77e9e5bd-53bd-4be9-b1eb-9cb83436b0a8 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.236995 Jul 18 02:10:28.168205 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 348/693] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:10:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1241 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:10:28.200704 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d2e74fac-5a1a-4ea3-b973-44513ad07b65 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:28.211138 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d2e74fac-5a1a-4ea3-b973-44513ad07b65 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 25f8645e-70fa-4fc4-ae8f-ee303c090469] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:28.232473 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d2e74fac-5a1a-4ea3-b973-44513ad07b65 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:28.233988 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d2e74fac-5a1a-4ea3-b973-44513ad07b65 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:28.235672 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d2e74fac-5a1a-4ea3-b973-44513ad07b65 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:28.236708 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d2e74fac-5a1a-4ea3-b973-44513ad07b65 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:28.570665 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7aff16f1-6c7a-487e-91ec-f29980a36f26 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b94d6f2c2d8b42d38d1149dab5ad2d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1fb21b43343238f9e96d7dc003841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:28.582323 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7aff16f1-6c7a-487e-91ec-f29980a36f26 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] 10.222.0.57 "GET /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2" status: 200 len: 1323 microversion: 2.1 time: 0.512370 Jul 18 02:10:28.583658 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 346/694] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:28 2022] GET /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2 => generated 1323 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:28.602031 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2d13cf54-9d5c-4428-9797-a98e4d949ba8 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:28.602771 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2d13cf54-9d5c-4428-9797-a98e4d949ba8 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:28.623342 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2d13cf54-9d5c-4428-9797-a98e4d949ba8 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:28.623989 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2d13cf54-9d5c-4428-9797-a98e4d949ba8 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:28.624781 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2d13cf54-9d5c-4428-9797-a98e4d949ba8 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:28.625215 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2d13cf54-9d5c-4428-9797-a98e4d949ba8 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:28.679346 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d2e74fac-5a1a-4ea3-b973-44513ad07b65 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:28.702779 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d2e74fac-5a1a-4ea3-b973-44513ad07b65 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469" status: 200 len: 1323 microversion: 2.1 time: 0.531818 Jul 18 02:10:28.708265 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 349/695] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:28 2022] GET /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469 => generated 1323 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:28.714236 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-353b20ee-fa96-4476-bcd4-6b5512f0b858 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:28.721015 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-353b20ee-fa96-4476-bcd4-6b5512f0b858 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Searching by: {'deleted': False} {{(pid=119543) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:10:28.754638 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-353b20ee-fa96-4476-bcd4-6b5512f0b858 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:28.755512 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-353b20ee-fa96-4476-bcd4-6b5512f0b858 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:28.756511 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-353b20ee-fa96-4476-bcd4-6b5512f0b858 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:28.757100 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-353b20ee-fa96-4476-bcd4-6b5512f0b858 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:28.938487 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.multi_cell_list [None req-353b20ee-fa96-4476-bcd4-6b5512f0b858 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Listed batch of 9 results from cell out of 999 limit. Returned 9 total so far. {{(pid=119543) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:10:28.956973 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2d13cf54-9d5c-4428-9797-a98e4d949ba8 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:28.982930 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2d13cf54-9d5c-4428-9797-a98e4d949ba8 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 200 len: 1311 microversion: 2.1 time: 0.384651 Jul 18 02:10:28.985005 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 347/696] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:28 2022] GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 1311 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:29.015878 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b6a15e6f-2e0c-4acf-93e7-a6d5d89a1932 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:29.016690 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b6a15e6f-2e0c-4acf-93e7-a6d5d89a1932 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: 8c643d39-a6e1-41ec-a6f9-ffaf41421eb8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:29.030756 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6a15e6f-2e0c-4acf-93e7-a6d5d89a1932 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:29.036374 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6a15e6f-2e0c-4acf-93e7-a6d5d89a1932 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:29.037401 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6a15e6f-2e0c-4acf-93e7-a6d5d89a1932 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:29.038036 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6a15e6f-2e0c-4acf-93e7-a6d5d89a1932 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:29.081045 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-353b20ee-fa96-4476-bcd4-6b5512f0b858 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:29.081983 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-353b20ee-fa96-4476-bcd4-6b5512f0b858 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:29.208077 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b6a15e6f-2e0c-4acf-93e7-a6d5d89a1932 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6962b97241f4c3a9960bb5fe52f8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8e996befd24b26b0371ad9cdb4a069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:29.218446 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b6a15e6f-2e0c-4acf-93e7-a6d5d89a1932 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] 10.222.0.57 "GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8" status: 200 len: 1225 microversion: 2.1 time: 0.231619 Jul 18 02:10:29.220994 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 348/697] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:28 2022] GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8 => generated 1225 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:29.232197 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-062a9dce-5ca9-485e-8bcd-b6f409c3b386 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:29.235472 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-062a9dce-5ca9-485e-8bcd-b6f409c3b386 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 25dfb6dd-6d5a-4399-a348-0a162ca907ef] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:29.247946 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-062a9dce-5ca9-485e-8bcd-b6f409c3b386 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:29.248777 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-062a9dce-5ca9-485e-8bcd-b6f409c3b386 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:29.250661 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-062a9dce-5ca9-485e-8bcd-b6f409c3b386 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:29.251274 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-062a9dce-5ca9-485e-8bcd-b6f409c3b386 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:29.530337 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-062a9dce-5ca9-485e-8bcd-b6f409c3b386 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:29.538302 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-062a9dce-5ca9-485e-8bcd-b6f409c3b386 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef" status: 200 len: 1308 microversion: 2.1 time: 0.314025 Jul 18 02:10:29.539928 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 349/698] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:29 2022] GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef => generated 1308 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:29.545965 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-a85e5b3f-9b7b-42b0-bacb-0eddaff0d8de req-a44a1b77-c4c7-4990-a1ab-78507f1aa6c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25f8645e-70fa-4fc4-ae8f-ee303c090469", "tag": "d567144b-0be9-43a2-9a60-b4e7a7626110"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:29.555987 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-a85e5b3f-9b7b-42b0-bacb-0eddaff0d8de req-a44a1b77-c4c7-4990-a1ab-78507f1aa6c2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:29.556665 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-a85e5b3f-9b7b-42b0-bacb-0eddaff0d8de req-a44a1b77-c4c7-4990-a1ab-78507f1aa6c2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:29.573979 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-a85e5b3f-9b7b-42b0-bacb-0eddaff0d8de req-a44a1b77-c4c7-4990-a1ab-78507f1aa6c2 service nova] Creating event network-changed:d567144b-0be9-43a2-9a60-b4e7a7626110 for instance 25f8645e-70fa-4fc4-ae8f-ee303c090469 on n-h2-465891-3 Jul 18 02:10:29.580286 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-a85e5b3f-9b7b-42b0-bacb-0eddaff0d8de req-a44a1b77-c4c7-4990-a1ab-78507f1aa6c2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038957 Jul 18 02:10:29.580895 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 350/699] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:10:29.592465 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-8c775a09-3fc8-4c10-aaea-ea501a3d1bb5 req-840caeb9-3c56-4f7a-8126-588116ccecbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25dfb6dd-6d5a-4399-a348-0a162ca907ef", "name": "network-vif-plugged", "status": "completed", "tag": "c841be8a-afd4-4301-bb2a-8f0504345c0f"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:29.597731 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:10:29.604842 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-8c775a09-3fc8-4c10-aaea-ea501a3d1bb5 req-840caeb9-3c56-4f7a-8126-588116ccecbc service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:29.605471 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-8c775a09-3fc8-4c10-aaea-ea501a3d1bb5 req-840caeb9-3c56-4f7a-8126-588116ccecbc service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:29.623773 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-8c775a09-3fc8-4c10-aaea-ea501a3d1bb5 req-840caeb9-3c56-4f7a-8126-588116ccecbc service nova] Creating event network-vif-plugged:c841be8a-afd4-4301-bb2a-8f0504345c0f for instance 25dfb6dd-6d5a-4399-a348-0a162ca907ef on n-h1-465891-3 Jul 18 02:10:29.630147 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-8c775a09-3fc8-4c10-aaea-ea501a3d1bb5 req-840caeb9-3c56-4f7a-8126-588116ccecbc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046333 Jul 18 02:10:29.631049 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 351/700] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:10:29.637864 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3333774b-2d1b-4900-8943-98f580376ceb tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:29.638586 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3333774b-2d1b-4900-8943-98f580376ceb tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] [instance: 716de5b7-33a8-45f4-bdab-ec12b4daa8c2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:29.645091 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3333774b-2d1b-4900-8943-98f580376ceb tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:29.645799 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3333774b-2d1b-4900-8943-98f580376ceb tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:29.646765 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3333774b-2d1b-4900-8943-98f580376ceb tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:29.647362 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3333774b-2d1b-4900-8943-98f580376ceb tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:29.679618 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-353b20ee-fa96-4476-bcd4-6b5512f0b858 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 13824 microversion: 2.1 time: 0.969912 Jul 18 02:10:29.680690 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 350/701] 10.222.0.57 () {58 vars in 1170 bytes} [Mon Jul 18 02:10:28 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 13824 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:10:29.708254 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-744aa3c1-d171-41a3-9a9a-1f6e5f007168 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:29.712590 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-744aa3c1-d171-41a3-9a9a-1f6e5f007168 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Searching by: {'deleted': False, 'project_id': 'd28aa0cb826447f8ba1282fd794e2c11'} {{(pid=119543) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:10:29.719982 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-744aa3c1-d171-41a3-9a9a-1f6e5f007168 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:29.720673 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-744aa3c1-d171-41a3-9a9a-1f6e5f007168 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:29.721489 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-744aa3c1-d171-41a3-9a9a-1f6e5f007168 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:29.721938 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-744aa3c1-d171-41a3-9a9a-1f6e5f007168 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:29.804244 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3333774b-2d1b-4900-8943-98f580376ceb tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b94d6f2c2d8b42d38d1149dab5ad2d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1fb21b43343238f9e96d7dc003841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:29.808008 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=100 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:10:29.814378 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3333774b-2d1b-4900-8943-98f580376ceb tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] 10.222.0.57 "GET /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2" status: 200 len: 1323 microversion: 2.1 time: 0.182447 Jul 18 02:10:29.815072 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 352/702] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:29 2022] GET /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2 => generated 1323 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:29.817076 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-744aa3c1-d171-41a3-9a9a-1f6e5f007168 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/detail?tenant_id=37109e65d03f45c7be865364a9006ba6" status: 200 len: 15 microversion: 2.1 time: 0.112913 Jul 18 02:10:29.819883 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cca111ef-2e1e-48a1-a53e-37676912cdc8 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:29.820491 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cca111ef-2e1e-48a1-a53e-37676912cdc8 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 25f8645e-70fa-4fc4-ae8f-ee303c090469] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:29.821835 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 351/703] 10.222.0.57 () {58 vars in 1230 bytes} [Mon Jul 18 02:10:29 2022] GET /compute/v2.1/servers/detail?tenant_id=37109e65d03f45c7be865364a9006ba6 => generated 15 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 02:10:29.827408 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cca111ef-2e1e-48a1-a53e-37676912cdc8 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:29.827857 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cca111ef-2e1e-48a1-a53e-37676912cdc8 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:29.828647 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cca111ef-2e1e-48a1-a53e-37676912cdc8 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:29.829084 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cca111ef-2e1e-48a1-a53e-37676912cdc8 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:29.833148 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a3a3f4c6-a697-4882-8f18-ec42e8d1e5e1 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:29.838174 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a3a3f4c6-a697-4882-8f18-ec42e8d1e5e1 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Searching by: {'tenant_id': '37109e65d03f45c7be865364a9006ba6', 'deleted': False} {{(pid=119543) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:10:29.843974 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a3a3f4c6-a697-4882-8f18-ec42e8d1e5e1 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:29.844423 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a3a3f4c6-a697-4882-8f18-ec42e8d1e5e1 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:29.845250 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a3a3f4c6-a697-4882-8f18-ec42e8d1e5e1 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:29.845682 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a3a3f4c6-a697-4882-8f18-ec42e8d1e5e1 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:29.876789 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.multi_cell_list [None req-a3a3f4c6-a697-4882-8f18-ec42e8d1e5e1 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119543) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:10:29.958670 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a3a3f4c6-a697-4882-8f18-ec42e8d1e5e1 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:29.959244 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a3a3f4c6-a697-4882-8f18-ec42e8d1e5e1 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:29.978222 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-cca111ef-2e1e-48a1-a53e-37676912cdc8 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:29.988220 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cca111ef-2e1e-48a1-a53e-37676912cdc8 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469" status: 200 len: 1323 microversion: 2.1 time: 0.171873 Jul 18 02:10:29.998219 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 353/704] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:29 2022] GET /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469 => generated 1323 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:30.004960 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6a3e36d4-d477-44c4-9994-035f959e7127 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:30.005674 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6a3e36d4-d477-44c4-9994-035f959e7127 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:30.012762 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6a3e36d4-d477-44c4-9994-035f959e7127 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:30.013292 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6a3e36d4-d477-44c4-9994-035f959e7127 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:30.014314 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6a3e36d4-d477-44c4-9994-035f959e7127 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:30.014969 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6a3e36d4-d477-44c4-9994-035f959e7127 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:30.139483 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a3a3f4c6-a697-4882-8f18-ec42e8d1e5e1 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=37109e65d03f45c7be865364a9006ba6" status: 200 len: 4826 microversion: 2.1 time: 0.310344 Jul 18 02:10:30.140525 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 352/705] 10.222.0.57 () {58 vars in 1256 bytes} [Mon Jul 18 02:10:29 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=37109e65d03f45c7be865364a9006ba6 => generated 4826 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:30.159672 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5366148c-e5ea-48c1-9e38-62d1df134795 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:30.165505 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5366148c-e5ea-48c1-9e38-62d1df134795 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Searching by: {'tenant_id': 'd28aa0cb826447f8ba1282fd794e2c11', 'deleted': False} {{(pid=119543) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:10:30.173359 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5366148c-e5ea-48c1-9e38-62d1df134795 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:30.173834 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5366148c-e5ea-48c1-9e38-62d1df134795 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:30.174853 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5366148c-e5ea-48c1-9e38-62d1df134795 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:30.175274 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5366148c-e5ea-48c1-9e38-62d1df134795 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:30.196523 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6a3e36d4-d477-44c4-9994-035f959e7127 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:30.207774 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5366148c-e5ea-48c1-9e38-62d1df134795 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=d28aa0cb826447f8ba1282fd794e2c11" status: 200 len: 15 microversion: 2.1 time: 0.051792 Jul 18 02:10:30.208343 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 353/706] 10.222.0.57 () {58 vars in 1256 bytes} [Mon Jul 18 02:10:30 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=d28aa0cb826447f8ba1282fd794e2c11 => generated 15 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 02:10:30.213206 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6a3e36d4-d477-44c4-9994-035f959e7127 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 200 len: 1311 microversion: 2.1 time: 0.211622 Jul 18 02:10:30.214276 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 354/707] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:29 2022] GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 1311 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:10:30.229267 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a4e08694-2b0f-4f7f-b192-87c12ef68f62 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:30.233646 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a4e08694-2b0f-4f7f-b192-87c12ef68f62 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.008080 Jul 18 02:10:30.234681 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 354/708] 10.222.0.57 () {58 vars in 1188 bytes} [Mon Jul 18 02:10:30 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:10:30.237623 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-dda2ecfa-e1e5-4bf3-9028-312dfb90223b tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:30.238262 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-dda2ecfa-e1e5-4bf3-9028-312dfb90223b tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: 8c643d39-a6e1-41ec-a6f9-ffaf41421eb8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:30.245152 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dda2ecfa-e1e5-4bf3-9028-312dfb90223b tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:30.245606 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dda2ecfa-e1e5-4bf3-9028-312dfb90223b tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:30.246440 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dda2ecfa-e1e5-4bf3-9028-312dfb90223b tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:30.247043 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dda2ecfa-e1e5-4bf3-9028-312dfb90223b tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:30.251289 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d26296f8-a8ed-4d82-9810-43dee0ccf65b tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:30.252222 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d26296f8-a8ed-4d82-9810-43dee0ccf65b tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:30.258593 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d26296f8-a8ed-4d82-9810-43dee0ccf65b tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:30.259041 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d26296f8-a8ed-4d82-9810-43dee0ccf65b tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:30.259809 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d26296f8-a8ed-4d82-9810-43dee0ccf65b tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:30.260235 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d26296f8-a8ed-4d82-9810-43dee0ccf65b tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:30.318014 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-dda2ecfa-e1e5-4bf3-9028-312dfb90223b tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6962b97241f4c3a9960bb5fe52f8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8e996befd24b26b0371ad9cdb4a069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:30.327197 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-dda2ecfa-e1e5-4bf3-9028-312dfb90223b tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] 10.222.0.57 "GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8" status: 200 len: 1225 microversion: 2.1 time: 0.093435 Jul 18 02:10:30.332189 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 355/709] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:30 2022] GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:10:30.386481 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d26296f8-a8ed-4d82-9810-43dee0ccf65b tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736/action" status: 202 len: 0 microversion: 2.1 time: 0.140280 Jul 18 02:10:30.390268 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 355/710] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:10:30 2022] POST /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:10:30.395910 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-002b00ef-1058-47a6-b555-c25831b3c76f tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:30.401511 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-002b00ef-1058-47a6-b555-c25831b3c76f tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:30.402970 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-002b00ef-1058-47a6-b555-c25831b3c76f tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '37109e65d03f45c7be865364a9006ba6'} {{(pid=119544) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:10:30.414190 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-002b00ef-1058-47a6-b555-c25831b3c76f tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:30.414897 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-002b00ef-1058-47a6-b555-c25831b3c76f tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:30.425920 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-002b00ef-1058-47a6-b555-c25831b3c76f tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:30.426376 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-002b00ef-1058-47a6-b555-c25831b3c76f tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:30.522668 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.multi_cell_list [None req-002b00ef-1058-47a6-b555-c25831b3c76f tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119544) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:10:30.600376 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-45f5b83b-3ae9-44b5-87e4-a5d463a95681 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-873326533", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:30.656028 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-45f5b83b-3ae9-44b5-87e4-a5d463a95681 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] validate_networks() for None {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:10:30.828987 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-002b00ef-1058-47a6-b555-c25831b3c76f tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.437320 Jul 18 02:10:30.829580 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 356/711] 10.222.0.57 () {58 vars in 1149 bytes} [Mon Jul 18 02:10:30 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:10:30.834204 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2ba06553-4f4d-4715-b653-47cc88e02707 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:30.834935 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2ba06553-4f4d-4715-b653-47cc88e02707 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 25dfb6dd-6d5a-4399-a348-0a162ca907ef] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:30.842044 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ba06553-4f4d-4715-b653-47cc88e02707 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:30.842767 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ba06553-4f4d-4715-b653-47cc88e02707 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:30.843557 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ba06553-4f4d-4715-b653-47cc88e02707 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:30.844000 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ba06553-4f4d-4715-b653-47cc88e02707 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:31.056933 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-45f5b83b-3ae9-44b5-87e4-a5d463a95681 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:10:31.057468 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-45f5b83b-3ae9-44b5-87e4-a5d463a95681 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:10:31.057978 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-45f5b83b-3ae9-44b5-87e4-a5d463a95681 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:10:31.059597 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-45f5b83b-3ae9-44b5-87e4-a5d463a95681 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:10:31.060103 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-45f5b83b-3ae9-44b5-87e4-a5d463a95681 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:10:31.072847 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-45f5b83b-3ae9-44b5-87e4-a5d463a95681 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:31.073304 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-45f5b83b-3ae9-44b5-87e4-a5d463a95681 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:31.075671 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-45f5b83b-3ae9-44b5-87e4-a5d463a95681 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:31.076325 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-45f5b83b-3ae9-44b5-87e4-a5d463a95681 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:31.098654 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-45f5b83b-3ae9-44b5-87e4-a5d463a95681 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Getting quotas for project 66d7b11fb5cd420cb8dbb16208bccf91. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:10:31.104465 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-45f5b83b-3ae9-44b5-87e4-a5d463a95681 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Getting quotas for user c6698374ee5c4bf18440a2f382db3c37 and project 66d7b11fb5cd420cb8dbb16208bccf91. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:10:31.119373 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-45f5b83b-3ae9-44b5-87e4-a5d463a95681 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:10:31.122662 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-45f5b83b-3ae9-44b5-87e4-a5d463a95681 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] [instance: e5776c7b-6ae0-43da-a38f-b42e66c6596b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:10:31.128986 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2ba06553-4f4d-4715-b653-47cc88e02707 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:31.139167 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2ba06553-4f4d-4715-b653-47cc88e02707 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef" status: 200 len: 1308 microversion: 2.1 time: 0.308317 Jul 18 02:10:31.150298 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 357/712] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:30 2022] GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef => generated 1308 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:31.156860 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3d4140bf-03fc-4f65-be64-a60afffd4125 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:31.157475 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3d4140bf-03fc-4f65-be64-a60afffd4125 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] [instance: 716de5b7-33a8-45f4-bdab-ec12b4daa8c2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:31.164820 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3d4140bf-03fc-4f65-be64-a60afffd4125 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:31.165254 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3d4140bf-03fc-4f65-be64-a60afffd4125 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:31.166185 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3d4140bf-03fc-4f65-be64-a60afffd4125 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:31.166731 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3d4140bf-03fc-4f65-be64-a60afffd4125 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:31.197891 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-45f5b83b-3ae9-44b5-87e4-a5d463a95681 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.731234 Jul 18 02:10:31.198987 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 356/713] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:10:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 02:10:31.208379 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-58de6e4b-b139-43bc-96b3-ae4d3c6c48ad tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:31.209472 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-58de6e4b-b139-43bc-96b3-ae4d3c6c48ad tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:31.217637 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-58de6e4b-b139-43bc-96b3-ae4d3c6c48ad tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:31.220505 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-58de6e4b-b139-43bc-96b3-ae4d3c6c48ad tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:31.220505 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-58de6e4b-b139-43bc-96b3-ae4d3c6c48ad tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:31.220505 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-58de6e4b-b139-43bc-96b3-ae4d3c6c48ad tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:31.247493 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:10:31.319466 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-58de6e4b-b139-43bc-96b3-ae4d3c6c48ad tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736/action" status: 202 len: 0 microversion: 2.1 time: 0.119116 Jul 18 02:10:31.320265 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 357/714] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:10:31 2022] POST /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:10:31.326981 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-989c32ed-4213-45a1-91be-e55a7476b70f tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:31.327818 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-989c32ed-4213-45a1-91be-e55a7476b70f tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 25f8645e-70fa-4fc4-ae8f-ee303c090469] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:31.333893 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-989c32ed-4213-45a1-91be-e55a7476b70f tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:31.334582 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-989c32ed-4213-45a1-91be-e55a7476b70f tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:31.335551 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-989c32ed-4213-45a1-91be-e55a7476b70f tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:31.336153 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-989c32ed-4213-45a1-91be-e55a7476b70f tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:31.359247 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3d4140bf-03fc-4f65-be64-a60afffd4125 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b94d6f2c2d8b42d38d1149dab5ad2d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1fb21b43343238f9e96d7dc003841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:31.367853 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3d4140bf-03fc-4f65-be64-a60afffd4125 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] 10.222.0.57 "GET /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2" status: 200 len: 1323 microversion: 2.1 time: 0.215546 Jul 18 02:10:31.368342 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 358/715] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:31 2022] GET /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2 => generated 1323 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:31.376002 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-20fed0ea-3565-4398-8603-e1c17b5e515a tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:31.376697 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-20fed0ea-3565-4398-8603-e1c17b5e515a tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] [instance: e5776c7b-6ae0-43da-a38f-b42e66c6596b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:31.447558 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-20fed0ea-3565-4398-8603-e1c17b5e515a tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6698374ee5c4bf18440a2f382db3c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d7b11fb5cd420cb8dbb16208bccf91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:31.456097 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-20fed0ea-3565-4398-8603-e1c17b5e515a tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] 10.222.0.57 "GET /compute/v2.1/servers/e5776c7b-6ae0-43da-a38f-b42e66c6596b" status: 200 len: 1218 microversion: 2.1 time: 0.085714 Jul 18 02:10:31.457195 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 359/716] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:31 2022] GET /compute/v2.1/servers/e5776c7b-6ae0-43da-a38f-b42e66c6596b => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:31.461576 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c3556dda-cb00-48f5-8063-931958face02 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:31.462232 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c3556dda-cb00-48f5-8063-931958face02 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:31.470192 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c3556dda-cb00-48f5-8063-931958face02 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:31.470644 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c3556dda-cb00-48f5-8063-931958face02 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:31.471683 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c3556dda-cb00-48f5-8063-931958face02 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:31.472197 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c3556dda-cb00-48f5-8063-931958face02 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:31.532385 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-989c32ed-4213-45a1-91be-e55a7476b70f tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:31.541021 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-989c32ed-4213-45a1-91be-e55a7476b70f tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469" status: 200 len: 1323 microversion: 2.1 time: 0.219471 Jul 18 02:10:31.545873 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 358/717] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:31 2022] GET /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469 => generated 1323 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:31.550191 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8daff2f6-60ff-4bd9-bff0-3446ddbae7e2 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:31.550956 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8daff2f6-60ff-4bd9-bff0-3446ddbae7e2 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:31.558072 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8daff2f6-60ff-4bd9-bff0-3446ddbae7e2 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:31.558932 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8daff2f6-60ff-4bd9-bff0-3446ddbae7e2 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:31.560147 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8daff2f6-60ff-4bd9-bff0-3446ddbae7e2 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:31.560756 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8daff2f6-60ff-4bd9-bff0-3446ddbae7e2 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:31.676561 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c3556dda-cb00-48f5-8063-931958face02 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:31.686188 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c3556dda-cb00-48f5-8063-931958face02 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 200 len: 1311 microversion: 2.1 time: 0.228369 Jul 18 02:10:31.697993 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 360/718] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:31 2022] GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 1311 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:31.704319 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6b47e69b-343a-4259-9bca-6acef3922d82 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:31.705254 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6b47e69b-343a-4259-9bca-6acef3922d82 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: 8c643d39-a6e1-41ec-a6f9-ffaf41421eb8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:31.712578 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b47e69b-343a-4259-9bca-6acef3922d82 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:31.713054 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b47e69b-343a-4259-9bca-6acef3922d82 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:31.714423 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b47e69b-343a-4259-9bca-6acef3922d82 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:31.715798 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b47e69b-343a-4259-9bca-6acef3922d82 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:31.751828 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8daff2f6-60ff-4bd9-bff0-3446ddbae7e2 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1615 microversion: 2.1 time: 0.206941 Jul 18 02:10:31.752831 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 359/719] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:31 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1615 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:31.769547 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fb4e96c8-fe82-44cf-ae00-9fa2356304be tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:31.770476 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fb4e96c8-fe82-44cf-ae00-9fa2356304be tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:31.778379 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fb4e96c8-fe82-44cf-ae00-9fa2356304be tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:31.778921 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fb4e96c8-fe82-44cf-ae00-9fa2356304be tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:31.779901 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fb4e96c8-fe82-44cf-ae00-9fa2356304be tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:31.780483 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fb4e96c8-fe82-44cf-ae00-9fa2356304be tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:31.784929 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6b47e69b-343a-4259-9bca-6acef3922d82 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6962b97241f4c3a9960bb5fe52f8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8e996befd24b26b0371ad9cdb4a069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:31.793540 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6b47e69b-343a-4259-9bca-6acef3922d82 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] 10.222.0.57 "GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8" status: 200 len: 1225 microversion: 2.1 time: 0.093644 Jul 18 02:10:31.794406 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 361/720] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:31 2022] GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:31.909793 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fb4e96c8-fe82-44cf-ae00-9fa2356304be tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1615 microversion: 2.1 time: 0.143883 Jul 18 02:10:31.910444 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 360/721] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:31 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1615 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:10:31.926007 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0acf5319-b267-410f-94e8-6abe53989886 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:31.930653 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0acf5319-b267-410f-94e8-6abe53989886 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Searching by: {'host': 'n-h2-465891-3', 'deleted': False} {{(pid=119544) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:10:31.935687 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0acf5319-b267-410f-94e8-6abe53989886 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:31.936129 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0acf5319-b267-410f-94e8-6abe53989886 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:31.936946 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0acf5319-b267-410f-94e8-6abe53989886 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:31.937375 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0acf5319-b267-410f-94e8-6abe53989886 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:32.026596 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.multi_cell_list [None req-0acf5319-b267-410f-94e8-6abe53989886 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=119544) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:10:32.085153 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0acf5319-b267-410f-94e8-6abe53989886 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] 10.222.0.57 "GET /compute/v2.1/servers?host=n-h2-465891-3&all_tenants=1" status: 200 len: 1326 microversion: 2.1 time: 0.162604 Jul 18 02:10:32.085756 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 362/722] 10.222.0.57 () {58 vars in 1189 bytes} [Mon Jul 18 02:10:31 2022] GET /compute/v2.1/servers?host=n-h2-465891-3&all_tenants=1 => generated 1326 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:10:32.097447 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-051337d1-d2ee-494d-b6fe-35843d43b89d tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:32.104232 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-051337d1-d2ee-494d-b6fe-35843d43b89d tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=119543) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:10:32.111449 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-051337d1-d2ee-494d-b6fe-35843d43b89d tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:32.112348 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-051337d1-d2ee-494d-b6fe-35843d43b89d tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:32.113280 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-051337d1-d2ee-494d-b6fe-35843d43b89d tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:32.113729 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-051337d1-d2ee-494d-b6fe-35843d43b89d tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:32.159009 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-50359e2d-13bc-45f5-9e72-8c87a44bd793 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:32.160166 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-50359e2d-13bc-45f5-9e72-8c87a44bd793 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 25dfb6dd-6d5a-4399-a348-0a162ca907ef] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:32.168418 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-50359e2d-13bc-45f5-9e72-8c87a44bd793 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:32.169292 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-50359e2d-13bc-45f5-9e72-8c87a44bd793 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:32.171341 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-50359e2d-13bc-45f5-9e72-8c87a44bd793 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:32.172105 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-50359e2d-13bc-45f5-9e72-8c87a44bd793 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:32.222827 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-051337d1-d2ee-494d-b6fe-35843d43b89d tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] 10.222.0.57 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.129596 Jul 18 02:10:32.223451 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 361/723] 10.222.0.57 () {58 vars in 1195 bytes} [Mon Jul 18 02:10:32 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:10:32.236936 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a67c1b8e-1cd7-4f3e-bc69-ca34470a53b6 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:32.238178 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a67c1b8e-1cd7-4f3e-bc69-ca34470a53b6 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:32.244130 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a67c1b8e-1cd7-4f3e-bc69-ca34470a53b6 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:32.244572 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a67c1b8e-1cd7-4f3e-bc69-ca34470a53b6 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:32.245344 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a67c1b8e-1cd7-4f3e-bc69-ca34470a53b6 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:32.245801 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a67c1b8e-1cd7-4f3e-bc69-ca34470a53b6 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:32.336592 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a67c1b8e-1cd7-4f3e-bc69-ca34470a53b6 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736/action" status: 202 len: 0 microversion: 2.1 time: 0.105830 Jul 18 02:10:32.337238 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 362/724] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:10:32 2022] POST /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:10:32.347607 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-63c4e4d3-9f55-4c77-a51d-ac463b506d35 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:32.349109 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-63c4e4d3-9f55-4c77-a51d-ac463b506d35 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:32.355958 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-63c4e4d3-9f55-4c77-a51d-ac463b506d35 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:32.356694 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-63c4e4d3-9f55-4c77-a51d-ac463b506d35 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:32.357723 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-63c4e4d3-9f55-4c77-a51d-ac463b506d35 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:32.358157 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-63c4e4d3-9f55-4c77-a51d-ac463b506d35 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:32.388119 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-50359e2d-13bc-45f5-9e72-8c87a44bd793 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:32.397913 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-50359e2d-13bc-45f5-9e72-8c87a44bd793 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef" status: 200 len: 1308 microversion: 2.1 time: 0.244587 Jul 18 02:10:32.398504 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 363/725] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:32 2022] GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef => generated 1308 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:10:32.415688 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-faf92db8-7694-4a66-b12e-8083cf9b21af tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:32.416820 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-faf92db8-7694-4a66-b12e-8083cf9b21af tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] [instance: 716de5b7-33a8-45f4-bdab-ec12b4daa8c2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:32.424631 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-faf92db8-7694-4a66-b12e-8083cf9b21af tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:32.425564 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-faf92db8-7694-4a66-b12e-8083cf9b21af tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:32.426388 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-faf92db8-7694-4a66-b12e-8083cf9b21af tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:32.426834 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-faf92db8-7694-4a66-b12e-8083cf9b21af tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:32.462004 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-63c4e4d3-9f55-4c77-a51d-ac463b506d35 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:10:32.462432 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-63c4e4d3-9f55-4c77-a51d-ac463b506d35 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:10:32.462904 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-63c4e4d3-9f55-4c77-a51d-ac463b506d35 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:10:32.463308 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-63c4e4d3-9f55-4c77-a51d-ac463b506d35 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:10:32.463716 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-63c4e4d3-9f55-4c77-a51d-ac463b506d35 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:10:32.531298 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-63c4e4d3-9f55-4c77-a51d-ac463b506d35 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:32.538290 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-63c4e4d3-9f55-4c77-a51d-ac463b506d35 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:32.538967 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-63c4e4d3-9f55-4c77-a51d-ac463b506d35 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:32.546181 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-63c4e4d3-9f55-4c77-a51d-ac463b506d35 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:32.546700 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-63c4e4d3-9f55-4c77-a51d-ac463b506d35 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:32.573934 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-faf92db8-7694-4a66-b12e-8083cf9b21af tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b94d6f2c2d8b42d38d1149dab5ad2d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1fb21b43343238f9e96d7dc003841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:32.582808 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-faf92db8-7694-4a66-b12e-8083cf9b21af tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] 10.222.0.57 "GET /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2" status: 200 len: 1323 microversion: 2.1 time: 0.180073 Jul 18 02:10:32.582991 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 364/726] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:32 2022] GET /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2 => generated 1323 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:32.591999 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-16a8c17a-33c3-4c21-acd9-064c96a56658 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:32.591999 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-16a8c17a-33c3-4c21-acd9-064c96a56658 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] [instance: e5776c7b-6ae0-43da-a38f-b42e66c6596b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:32.592224 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-63c4e4d3-9f55-4c77-a51d-ac463b506d35 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "POST /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736/action" status: 202 len: 1068 microversion: 2.1 time: 0.248516 Jul 18 02:10:32.593533 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 363/727] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:10:32 2022] POST /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736/action => generated 1068 bytes in 251 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 18 02:10:32.599788 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-151b5a9d-e16c-42b4-8af1-f6007d4a42cb tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:32.601155 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-151b5a9d-e16c-42b4-8af1-f6007d4a42cb tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 25f8645e-70fa-4fc4-ae8f-ee303c090469] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:32.604851 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-16a8c17a-33c3-4c21-acd9-064c96a56658 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:32.605581 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-16a8c17a-33c3-4c21-acd9-064c96a56658 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:32.606585 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-16a8c17a-33c3-4c21-acd9-064c96a56658 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:32.607012 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-16a8c17a-33c3-4c21-acd9-064c96a56658 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:32.609882 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-151b5a9d-e16c-42b4-8af1-f6007d4a42cb tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:32.610448 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-151b5a9d-e16c-42b4-8af1-f6007d4a42cb tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:32.611318 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-151b5a9d-e16c-42b4-8af1-f6007d4a42cb tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:32.611821 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-151b5a9d-e16c-42b4-8af1-f6007d4a42cb tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:32.682521 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-16a8c17a-33c3-4c21-acd9-064c96a56658 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6698374ee5c4bf18440a2f382db3c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d7b11fb5cd420cb8dbb16208bccf91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:32.694715 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-16a8c17a-33c3-4c21-acd9-064c96a56658 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] 10.222.0.57 "GET /compute/v2.1/servers/e5776c7b-6ae0-43da-a38f-b42e66c6596b" status: 200 len: 1270 microversion: 2.1 time: 0.109719 Jul 18 02:10:32.695370 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 365/728] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:32 2022] GET /compute/v2.1/servers/e5776c7b-6ae0-43da-a38f-b42e66c6596b => generated 1270 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:32.701117 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fdaafe35-9e33-438b-8822-c685dd41ce8c tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:32.702072 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fdaafe35-9e33-438b-8822-c685dd41ce8c tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:32.708397 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fdaafe35-9e33-438b-8822-c685dd41ce8c tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:32.708856 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fdaafe35-9e33-438b-8822-c685dd41ce8c tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:32.709646 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fdaafe35-9e33-438b-8822-c685dd41ce8c tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:32.710152 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fdaafe35-9e33-438b-8822-c685dd41ce8c tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:32.842069 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-151b5a9d-e16c-42b4-8af1-f6007d4a42cb tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:32.850794 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-151b5a9d-e16c-42b4-8af1-f6007d4a42cb tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469" status: 200 len: 1323 microversion: 2.1 time: 0.256069 Jul 18 02:10:32.856353 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 364/729] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:32 2022] GET /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469 => generated 1323 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:32.869260 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-95288164-3551-4adf-a2a3-14c0f69d3883 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:32.869996 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-95288164-3551-4adf-a2a3-14c0f69d3883 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:32.884074 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-95288164-3551-4adf-a2a3-14c0f69d3883 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:32.884524 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-95288164-3551-4adf-a2a3-14c0f69d3883 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:32.885313 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-95288164-3551-4adf-a2a3-14c0f69d3883 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:32.890819 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-95288164-3551-4adf-a2a3-14c0f69d3883 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:32.921021 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fdaafe35-9e33-438b-8822-c685dd41ce8c tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:32.936244 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fdaafe35-9e33-438b-8822-c685dd41ce8c tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1472 microversion: 2.1 time: 0.239611 Jul 18 02:10:32.947542 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 366/730] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:32 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1472 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:32.953977 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-07c58657-fa8b-4472-8feb-9a057dba6863 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:32.955089 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-07c58657-fa8b-4472-8feb-9a057dba6863 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: 8c643d39-a6e1-41ec-a6f9-ffaf41421eb8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:32.973372 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-07c58657-fa8b-4472-8feb-9a057dba6863 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:32.974343 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-07c58657-fa8b-4472-8feb-9a057dba6863 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:32.975450 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-07c58657-fa8b-4472-8feb-9a057dba6863 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:32.976219 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-07c58657-fa8b-4472-8feb-9a057dba6863 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:33.077081 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-07c58657-fa8b-4472-8feb-9a057dba6863 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6962b97241f4c3a9960bb5fe52f8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8e996befd24b26b0371ad9cdb4a069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:33.086789 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-07c58657-fa8b-4472-8feb-9a057dba6863 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] 10.222.0.57 "GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8" status: 200 len: 1273 microversion: 2.1 time: 0.137791 Jul 18 02:10:33.087376 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 367/731] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:32 2022] GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8 => generated 1273 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:33.147909 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-95288164-3551-4adf-a2a3-14c0f69d3883 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:33.157445 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-95288164-3551-4adf-a2a3-14c0f69d3883 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 200 len: 1311 microversion: 2.1 time: 0.305023 Jul 18 02:10:33.158497 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 365/732] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:32 2022] GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 1311 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:33.368979 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-56cefcc8-ae38-4999-9bc9-b0b233260bff req-9ea8c229-1d7e-4bb0-86cf-13246f051026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "716de5b7-33a8-45f4-bdab-ec12b4daa8c2", "name": "network-vif-plugged", "status": "completed", "tag": "af0af000-b5ca-4135-9374-8b1af4f9aa46"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:33.381128 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-56cefcc8-ae38-4999-9bc9-b0b233260bff req-9ea8c229-1d7e-4bb0-86cf-13246f051026 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:33.381674 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-56cefcc8-ae38-4999-9bc9-b0b233260bff req-9ea8c229-1d7e-4bb0-86cf-13246f051026 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:33.395880 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-56cefcc8-ae38-4999-9bc9-b0b233260bff req-9ea8c229-1d7e-4bb0-86cf-13246f051026 service nova] Creating event network-vif-plugged:af0af000-b5ca-4135-9374-8b1af4f9aa46 for instance 716de5b7-33a8-45f4-bdab-ec12b4daa8c2 on n-h1-465891-3 Jul 18 02:10:33.400839 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-56cefcc8-ae38-4999-9bc9-b0b233260bff req-9ea8c229-1d7e-4bb0-86cf-13246f051026 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038428 Jul 18 02:10:33.401452 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 368/733] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:10:33.417106 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bdd0d349-c912-452d-8f34-fd692ccdfb22 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:33.417767 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bdd0d349-c912-452d-8f34-fd692ccdfb22 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 25dfb6dd-6d5a-4399-a348-0a162ca907ef] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:33.423977 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bdd0d349-c912-452d-8f34-fd692ccdfb22 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:33.424420 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bdd0d349-c912-452d-8f34-fd692ccdfb22 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:33.425216 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bdd0d349-c912-452d-8f34-fd692ccdfb22 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:33.425645 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bdd0d349-c912-452d-8f34-fd692ccdfb22 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:33.583649 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bdd0d349-c912-452d-8f34-fd692ccdfb22 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:33.593068 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bdd0d349-c912-452d-8f34-fd692ccdfb22 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef" status: 200 len: 1308 microversion: 2.1 time: 0.180719 Jul 18 02:10:33.598816 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 366/734] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:33 2022] GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef => generated 1308 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:33.602011 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-303102ac-f3c1-410b-bfcd-13265145ccc6 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:33.602854 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-303102ac-f3c1-410b-bfcd-13265145ccc6 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] [instance: 716de5b7-33a8-45f4-bdab-ec12b4daa8c2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:33.612025 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-303102ac-f3c1-410b-bfcd-13265145ccc6 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:33.612559 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-303102ac-f3c1-410b-bfcd-13265145ccc6 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:33.613587 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-303102ac-f3c1-410b-bfcd-13265145ccc6 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:33.614356 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-303102ac-f3c1-410b-bfcd-13265145ccc6 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:33.712506 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-82e8fcb4-c468-4dde-ad0e-4df783462f3c tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:33.713128 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-82e8fcb4-c468-4dde-ad0e-4df783462f3c tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] [instance: e5776c7b-6ae0-43da-a38f-b42e66c6596b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:33.720175 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-82e8fcb4-c468-4dde-ad0e-4df783462f3c tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:33.720627 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-82e8fcb4-c468-4dde-ad0e-4df783462f3c tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:33.721410 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-82e8fcb4-c468-4dde-ad0e-4df783462f3c tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:33.721876 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-82e8fcb4-c468-4dde-ad0e-4df783462f3c tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:33.776611 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-303102ac-f3c1-410b-bfcd-13265145ccc6 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b94d6f2c2d8b42d38d1149dab5ad2d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1fb21b43343238f9e96d7dc003841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:33.784883 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-303102ac-f3c1-410b-bfcd-13265145ccc6 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] 10.222.0.57 "GET /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2" status: 200 len: 1323 microversion: 2.1 time: 0.189018 Jul 18 02:10:33.785606 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 369/735] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:33 2022] GET /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2 => generated 1323 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:33.793285 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-82e8fcb4-c468-4dde-ad0e-4df783462f3c tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6698374ee5c4bf18440a2f382db3c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d7b11fb5cd420cb8dbb16208bccf91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:33.802582 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-82e8fcb4-c468-4dde-ad0e-4df783462f3c tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] 10.222.0.57 "GET /compute/v2.1/servers/e5776c7b-6ae0-43da-a38f-b42e66c6596b" status: 200 len: 1270 microversion: 2.1 time: 0.093807 Jul 18 02:10:33.803169 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 367/736] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:33 2022] GET /compute/v2.1/servers/e5776c7b-6ae0-43da-a38f-b42e66c6596b => generated 1270 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:33.868799 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ef8f2765-3af1-4737-aebb-12e4d250c02b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:33.869418 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ef8f2765-3af1-4737-aebb-12e4d250c02b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 25f8645e-70fa-4fc4-ae8f-ee303c090469] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:33.877150 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ef8f2765-3af1-4737-aebb-12e4d250c02b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:33.877690 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ef8f2765-3af1-4737-aebb-12e4d250c02b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:33.878558 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ef8f2765-3af1-4737-aebb-12e4d250c02b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:33.879036 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ef8f2765-3af1-4737-aebb-12e4d250c02b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:33.899076 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=100 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:10:33.959973 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-32de6750-c54e-47c4-a710-5955e8f6db6f tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:33.961031 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-32de6750-c54e-47c4-a710-5955e8f6db6f tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:33.974765 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-32de6750-c54e-47c4-a710-5955e8f6db6f tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:33.977635 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-32de6750-c54e-47c4-a710-5955e8f6db6f tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:33.978778 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-32de6750-c54e-47c4-a710-5955e8f6db6f tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:33.979231 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-32de6750-c54e-47c4-a710-5955e8f6db6f tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:34.039664 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ef8f2765-3af1-4737-aebb-12e4d250c02b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:34.050330 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ef8f2765-3af1-4737-aebb-12e4d250c02b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469" status: 200 len: 1323 microversion: 2.1 time: 0.185446 Jul 18 02:10:34.062076 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 370/737] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:33 2022] GET /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469 => generated 1323 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:34.108766 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-387a7d82-51d5-4ccc-9177-246777de9ea9 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:34.109845 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-387a7d82-51d5-4ccc-9177-246777de9ea9 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: 8c643d39-a6e1-41ec-a6f9-ffaf41421eb8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:34.117841 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-387a7d82-51d5-4ccc-9177-246777de9ea9 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:34.118739 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-387a7d82-51d5-4ccc-9177-246777de9ea9 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:34.119814 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-387a7d82-51d5-4ccc-9177-246777de9ea9 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:34.120465 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-387a7d82-51d5-4ccc-9177-246777de9ea9 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:34.250048 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-387a7d82-51d5-4ccc-9177-246777de9ea9 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6962b97241f4c3a9960bb5fe52f8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8e996befd24b26b0371ad9cdb4a069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:34.262818 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-387a7d82-51d5-4ccc-9177-246777de9ea9 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] 10.222.0.57 "GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8" status: 200 len: 1291 microversion: 2.1 time: 0.158252 Jul 18 02:10:34.274252 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 371/738] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:34 2022] GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8 => generated 1291 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:34.281125 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ce4f2e1b-b6d6-4aae-9ead-8a0992bb5fe5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:34.282459 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ce4f2e1b-b6d6-4aae-9ead-8a0992bb5fe5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:34.291728 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ce4f2e1b-b6d6-4aae-9ead-8a0992bb5fe5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:34.292251 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ce4f2e1b-b6d6-4aae-9ead-8a0992bb5fe5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:34.293270 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ce4f2e1b-b6d6-4aae-9ead-8a0992bb5fe5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:34.293879 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ce4f2e1b-b6d6-4aae-9ead-8a0992bb5fe5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:34.785508 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-32de6750-c54e-47c4-a710-5955e8f6db6f tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:34.798666 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-32de6750-c54e-47c4-a710-5955e8f6db6f tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1472 microversion: 2.1 time: 0.847334 Jul 18 02:10:34.811633 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 368/739] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:33 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1472 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:10:34.817903 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-993a4349-4b1d-43e4-8583-b84d60ffbd7b tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:34.819444 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-993a4349-4b1d-43e4-8583-b84d60ffbd7b tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 25dfb6dd-6d5a-4399-a348-0a162ca907ef] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:34.831372 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-993a4349-4b1d-43e4-8583-b84d60ffbd7b tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:34.832430 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-993a4349-4b1d-43e4-8583-b84d60ffbd7b tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:34.833892 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-993a4349-4b1d-43e4-8583-b84d60ffbd7b tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:34.836238 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-993a4349-4b1d-43e4-8583-b84d60ffbd7b tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:34.951648 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ce4f2e1b-b6d6-4aae-9ead-8a0992bb5fe5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:34.960787 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ce4f2e1b-b6d6-4aae-9ead-8a0992bb5fe5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 200 len: 1311 microversion: 2.1 time: 0.693649 Jul 18 02:10:34.961372 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 372/740] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:34 2022] GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 1311 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:34.967834 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b3759294-d9e3-48e5-b409-f1e76bc26cfc tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:34.968683 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b3759294-d9e3-48e5-b409-f1e76bc26cfc tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] [instance: 716de5b7-33a8-45f4-bdab-ec12b4daa8c2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:34.984322 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b3759294-d9e3-48e5-b409-f1e76bc26cfc tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:34.986005 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b3759294-d9e3-48e5-b409-f1e76bc26cfc tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:34.987468 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b3759294-d9e3-48e5-b409-f1e76bc26cfc tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:34.988578 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b3759294-d9e3-48e5-b409-f1e76bc26cfc tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:35.267717 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-993a4349-4b1d-43e4-8583-b84d60ffbd7b tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:35.270805 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:10:35.278879 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-993a4349-4b1d-43e4-8583-b84d60ffbd7b tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef" status: 200 len: 1488 microversion: 2.1 time: 0.465831 Jul 18 02:10:35.282466 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 369/741] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:34 2022] GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef => generated 1488 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:35.293535 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cf6d3482-2db9-43e9-be4a-0139257d7b1c tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:35.302724 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cf6d3482-2db9-43e9-be4a-0139257d7b1c tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] [instance: e5776c7b-6ae0-43da-a38f-b42e66c6596b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:35.311251 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cf6d3482-2db9-43e9-be4a-0139257d7b1c tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:35.311699 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cf6d3482-2db9-43e9-be4a-0139257d7b1c tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:35.312809 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cf6d3482-2db9-43e9-be4a-0139257d7b1c tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:35.313272 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cf6d3482-2db9-43e9-be4a-0139257d7b1c tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:35.415463 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b3759294-d9e3-48e5-b409-f1e76bc26cfc tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b94d6f2c2d8b42d38d1149dab5ad2d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1fb21b43343238f9e96d7dc003841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:35.426704 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b3759294-d9e3-48e5-b409-f1e76bc26cfc tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] 10.222.0.57 "GET /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2" status: 200 len: 1323 microversion: 2.1 time: 0.464069 Jul 18 02:10:35.427492 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 373/742] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:34 2022] GET /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2 => generated 1323 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:35.433184 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cae584e2-4ccf-4826-a657-878123d00f70 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:35.434892 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cae584e2-4ccf-4826-a657-878123d00f70 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 25f8645e-70fa-4fc4-ae8f-ee303c090469] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:35.441943 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cae584e2-4ccf-4826-a657-878123d00f70 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:35.442396 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cae584e2-4ccf-4826-a657-878123d00f70 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:35.443196 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cae584e2-4ccf-4826-a657-878123d00f70 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:35.443621 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cae584e2-4ccf-4826-a657-878123d00f70 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:35.686220 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cf6d3482-2db9-43e9-be4a-0139257d7b1c tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6698374ee5c4bf18440a2f382db3c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d7b11fb5cd420cb8dbb16208bccf91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:35.695549 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cf6d3482-2db9-43e9-be4a-0139257d7b1c tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] 10.222.0.57 "GET /compute/v2.1/servers/e5776c7b-6ae0-43da-a38f-b42e66c6596b" status: 200 len: 1318 microversion: 2.1 time: 0.411761 Jul 18 02:10:35.696230 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 370/743] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:35 2022] GET /compute/v2.1/servers/e5776c7b-6ae0-43da-a38f-b42e66c6596b => generated 1318 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:35.702218 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-394adaa7-c1d1-463e-ab51-7d60cac971ee tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:35.702833 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-394adaa7-c1d1-463e-ab51-7d60cac971ee tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: 8c643d39-a6e1-41ec-a6f9-ffaf41421eb8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:35.709294 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-394adaa7-c1d1-463e-ab51-7d60cac971ee tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:35.710000 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-394adaa7-c1d1-463e-ab51-7d60cac971ee tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:35.710983 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-394adaa7-c1d1-463e-ab51-7d60cac971ee tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:35.711512 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-394adaa7-c1d1-463e-ab51-7d60cac971ee tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:35.857993 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-394adaa7-c1d1-463e-ab51-7d60cac971ee tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6962b97241f4c3a9960bb5fe52f8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8e996befd24b26b0371ad9cdb4a069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:35.858531 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-cae584e2-4ccf-4826-a657-878123d00f70 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:35.867248 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cae584e2-4ccf-4826-a657-878123d00f70 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469" status: 200 len: 1323 microversion: 2.1 time: 0.438513 Jul 18 02:10:35.879683 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 374/744] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:35 2022] GET /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469 => generated 1323 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:35.887312 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5985217c-78f7-454c-bd04-1870f47c0f62 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:35.894548 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-394adaa7-c1d1-463e-ab51-7d60cac971ee tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] 10.222.0.57 "GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8" status: 200 len: 1279 microversion: 2.1 time: 0.195107 Jul 18 02:10:35.895089 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 371/745] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:35 2022] GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8 => generated 1279 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:35.896759 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5985217c-78f7-454c-bd04-1870f47c0f62 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:35.898101 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5985217c-78f7-454c-bd04-1870f47c0f62 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:35.926656 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-5d8e8baa-20b0-45a2-a1f0-a8d3cc01af1a req-8e81cdb4-257c-4d32-abcb-995d0a8ef8bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25f8645e-70fa-4fc4-ae8f-ee303c090469", "name": "network-vif-plugged", "status": "completed", "tag": "d567144b-0be9-43a2-9a60-b4e7a7626110"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:35.967644 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-5d8e8baa-20b0-45a2-a1f0-a8d3cc01af1a req-8e81cdb4-257c-4d32-abcb-995d0a8ef8bc service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:35.967999 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-5d8e8baa-20b0-45a2-a1f0-a8d3cc01af1a req-8e81cdb4-257c-4d32-abcb-995d0a8ef8bc service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:35.993961 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-5d8e8baa-20b0-45a2-a1f0-a8d3cc01af1a req-8e81cdb4-257c-4d32-abcb-995d0a8ef8bc service nova] Creating event network-vif-plugged:d567144b-0be9-43a2-9a60-b4e7a7626110 for instance 25f8645e-70fa-4fc4-ae8f-ee303c090469 on n-h2-465891-3 Jul 18 02:10:36.001253 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-5d8e8baa-20b0-45a2-a1f0-a8d3cc01af1a req-8e81cdb4-257c-4d32-abcb-995d0a8ef8bc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104748 Jul 18 02:10:36.006806 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 372/746] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:10:36.013571 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6141d261-d315-4527-b176-4c705deb627a tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:36.014514 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6141d261-d315-4527-b176-4c705deb627a tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:36.023149 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6141d261-d315-4527-b176-4c705deb627a tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:36.024070 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6141d261-d315-4527-b176-4c705deb627a tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:36.026092 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6141d261-d315-4527-b176-4c705deb627a tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:36.027361 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6141d261-d315-4527-b176-4c705deb627a tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:36.033647 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5985217c-78f7-454c-bd04-1870f47c0f62 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 25dfb6dd-6d5a-4399-a348-0a162ca907ef] Going to try to stop instance {{(pid=119544) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 02:10:36.095330 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5985217c-78f7-454c-bd04-1870f47c0f62 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "POST /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef/action" status: 202 len: 0 microversion: 2.1 time: 0.213367 Jul 18 02:10:36.095930 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 375/747] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:10:35 2022] POST /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:10:36.101409 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b6788584-f829-4f02-94ad-c8d763d6c8e6 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:36.102128 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b6788584-f829-4f02-94ad-c8d763d6c8e6 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:36.109876 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6788584-f829-4f02-94ad-c8d763d6c8e6 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:36.110323 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6788584-f829-4f02-94ad-c8d763d6c8e6 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:36.111093 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6788584-f829-4f02-94ad-c8d763d6c8e6 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:36.112013 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6788584-f829-4f02-94ad-c8d763d6c8e6 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:36.331259 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6141d261-d315-4527-b176-4c705deb627a tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:36.353080 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6141d261-d315-4527-b176-4c705deb627a tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1472 microversion: 2.1 time: 0.344594 Jul 18 02:10:36.365600 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 373/748] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:36 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1472 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:36.365843 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b6788584-f829-4f02-94ad-c8d763d6c8e6 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:36.365843 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b6788584-f829-4f02-94ad-c8d763d6c8e6 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 200 len: 1311 microversion: 2.1 time: 0.268685 Jul 18 02:10:36.366399 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 376/749] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:36 2022] GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 1311 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:36.370631 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b2be713a-193a-4b35-8b92-3b49215f397f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:36.372180 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b2be713a-193a-4b35-8b92-3b49215f397f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 25dfb6dd-6d5a-4399-a348-0a162ca907ef] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:36.381975 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b2be713a-193a-4b35-8b92-3b49215f397f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:36.382628 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b2be713a-193a-4b35-8b92-3b49215f397f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:36.383679 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b2be713a-193a-4b35-8b92-3b49215f397f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:36.384195 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b2be713a-193a-4b35-8b92-3b49215f397f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:36.444250 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-15ef733b-42f1-420a-8425-3349a5fbf3ec tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:36.445139 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-15ef733b-42f1-420a-8425-3349a5fbf3ec tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] [instance: 716de5b7-33a8-45f4-bdab-ec12b4daa8c2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:36.459028 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-15ef733b-42f1-420a-8425-3349a5fbf3ec tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:36.459615 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-15ef733b-42f1-420a-8425-3349a5fbf3ec tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:36.465451 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-15ef733b-42f1-420a-8425-3349a5fbf3ec tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:36.465810 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-15ef733b-42f1-420a-8425-3349a5fbf3ec tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:36.751895 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b2be713a-193a-4b35-8b92-3b49215f397f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:36.764234 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b2be713a-193a-4b35-8b92-3b49215f397f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef" status: 200 len: 1498 microversion: 2.1 time: 0.404871 Jul 18 02:10:36.765217 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 374/750] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:36 2022] GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef => generated 1498 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:36.788675 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-19caf84b-b49a-4a2b-bc22-9c23bc67d0d7 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:36.789430 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-19caf84b-b49a-4a2b-bc22-9c23bc67d0d7 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] [instance: e5776c7b-6ae0-43da-a38f-b42e66c6596b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:36.797223 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-19caf84b-b49a-4a2b-bc22-9c23bc67d0d7 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:36.797874 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-19caf84b-b49a-4a2b-bc22-9c23bc67d0d7 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:36.798811 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-19caf84b-b49a-4a2b-bc22-9c23bc67d0d7 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:36.799360 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-19caf84b-b49a-4a2b-bc22-9c23bc67d0d7 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:36.827458 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-15ef733b-42f1-420a-8425-3349a5fbf3ec tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b94d6f2c2d8b42d38d1149dab5ad2d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1fb21b43343238f9e96d7dc003841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:36.840087 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-15ef733b-42f1-420a-8425-3349a5fbf3ec tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] 10.222.0.57 "GET /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2" status: 200 len: 1472 microversion: 2.1 time: 0.399530 Jul 18 02:10:36.840849 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 377/751] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:36 2022] GET /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2 => generated 1472 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:10:36.859691 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-db8dac28-c965-4992-9e41-a691e795f7e5 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:36.860409 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-db8dac28-c965-4992-9e41-a691e795f7e5 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] [instance: 716de5b7-33a8-45f4-bdab-ec12b4daa8c2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:36.867957 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-db8dac28-c965-4992-9e41-a691e795f7e5 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:36.868685 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-db8dac28-c965-4992-9e41-a691e795f7e5 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:36.869542 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-db8dac28-c965-4992-9e41-a691e795f7e5 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:36.872208 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-db8dac28-c965-4992-9e41-a691e795f7e5 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:36.912674 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-db8dac28-c965-4992-9e41-a691e795f7e5 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'b94d6f2c2d8b42d38d1149dab5ad2d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1fb21b43343238f9e96d7dc003841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:36.915082 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-db8dac28-c965-4992-9e41-a691e795f7e5 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Request method failure captured: Jul 18 02:10:36.915082 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2/diagnostics HTTP/1.1 Jul 18 02:10:36.915082 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:10:36.915082 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:10:36.915082 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:10:36.915082 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:10:36.915082 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:10:36.915082 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:10:36.915082 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:10:36.915082 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:10:36.915082 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MEFJLZ6QtYlUy27aWE1m_tEjXjJWuY7Tax2ApqO7a7JhjI0Gvfj3AL4-ZtV0PmHxH_3hi1I_cwtNMQi0Jfg3ZqkJxtIjWYF1BxMepneBraiMxy2lpI8LC36jL1Q_wFLEm_5oziuTWgGGhcBp1_OEfYWaN7DVl4pKvW3xEuvIFQafeU Jul 18 02:10:36.915082 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:10:36.915082 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:10:36.915082 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:10:36.915082 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:10:36.915082 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:10:36.915082 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:10:36.915082 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: cdc1fb21b43343238f9e96d7dc003841 Jul 18 02:10:36.915082 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1857412722 Jul 18 02:10:36.915082 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:10:36.915082 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:10:36.916642 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_cdc1fb21b43343238f9e96d7dc003841"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/cdc1fb21b43343238f9e96d7dc003841"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/cdc1fb21b43343238f9e96d7dc003841"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/cdc1fb21b43343238f9e96d7dc003841"}]}] Jul 18 02:10:36.916642 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1857412722 Jul 18 02:10:36.916642 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: cdc1fb21b43343238f9e96d7dc003841 Jul 18 02:10:36.916642 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1857412722 Jul 18 02:10:36.916642 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServerDiagnosticsNegativeTest-1857412722-project Jul 18 02:10:36.916642 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:10:36.916642 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:10:36.916642 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: b94d6f2c2d8b42d38d1149dab5ad2d9e Jul 18 02:10:36.916642 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1857412722-project Jul 18 02:10:36.916642 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:10:36.916642 n-d-465891-3 devstack@n-api.service[119544]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 18 02:10:36.918079 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'server_id': '716de5b7-33a8-45f4-bdab-ec12b4daa8c2'} Jul 18 02:10:36.918079 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:10:36.918079 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:10:36.918079 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:10:36.918079 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:10:36.918079 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:10:36.918079 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:10:36.918079 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:10:36.918079 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:10:36.918079 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Jul 18 02:10:36.918079 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Jul 18 02:10:36.918079 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:10:36.918079 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:10:36.918079 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:10:36.918079 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:10:36.918079 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:10:36.918079 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:10:36.918079 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:10:36.918079 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:10:36.918079 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:10:36.921943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:10:36.921943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:10:36.921943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:10:36.921943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:10:36.921943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:10:36.921943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 18 02:10:36.921943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:10:36.921943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:10:36.921943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:10:36.921943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:10:36.921943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:10:36.921943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:10:36.921943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:10:36.921943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:10:36.921943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 18 02:10:36.921943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:10:36.921943 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-db8dac28-c965-4992-9e41-a691e795f7e5 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:10:36.923263 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-db8dac28-c965-4992-9e41-a691e795f7e5 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] 10.222.0.57 "GET /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.066705 Jul 18 02:10:36.923263 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 378/752] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 02:10:36 2022] GET /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2/diagnostics => generated 117 bytes in 69 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:10:36.928159 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ea12be98-fb35-4e25-a9b3-7c8b5cb64302 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:36.929156 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ea12be98-fb35-4e25-a9b3-7c8b5cb64302 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 25f8645e-70fa-4fc4-ae8f-ee303c090469] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:36.937695 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea12be98-fb35-4e25-a9b3-7c8b5cb64302 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:36.937695 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea12be98-fb35-4e25-a9b3-7c8b5cb64302 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:36.939131 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea12be98-fb35-4e25-a9b3-7c8b5cb64302 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:36.939720 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea12be98-fb35-4e25-a9b3-7c8b5cb64302 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:37.051258 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-19caf84b-b49a-4a2b-bc22-9c23bc67d0d7 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6698374ee5c4bf18440a2f382db3c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d7b11fb5cd420cb8dbb16208bccf91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:37.063267 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-19caf84b-b49a-4a2b-bc22-9c23bc67d0d7 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] 10.222.0.57 "GET /compute/v2.1/servers/e5776c7b-6ae0-43da-a38f-b42e66c6596b" status: 200 len: 1318 microversion: 2.1 time: 0.287408 Jul 18 02:10:37.067095 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 375/753] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:36 2022] GET /compute/v2.1/servers/e5776c7b-6ae0-43da-a38f-b42e66c6596b => generated 1318 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:37.076447 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9851ee46-9286-44cb-a110-473f4d689d09 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:37.077164 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9851ee46-9286-44cb-a110-473f4d689d09 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: 8c643d39-a6e1-41ec-a6f9-ffaf41421eb8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:37.093679 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9851ee46-9286-44cb-a110-473f4d689d09 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:37.094291 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9851ee46-9286-44cb-a110-473f4d689d09 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:37.095328 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9851ee46-9286-44cb-a110-473f4d689d09 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:37.095864 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9851ee46-9286-44cb-a110-473f4d689d09 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:37.470047 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ea12be98-fb35-4e25-a9b3-7c8b5cb64302 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:37.488265 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ea12be98-fb35-4e25-a9b3-7c8b5cb64302 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469" status: 200 len: 1323 microversion: 2.1 time: 0.564106 Jul 18 02:10:37.488864 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 379/754] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:36 2022] GET /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469 => generated 1323 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:37.499165 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9851ee46-9286-44cb-a110-473f4d689d09 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6962b97241f4c3a9960bb5fe52f8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8e996befd24b26b0371ad9cdb4a069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:37.503194 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b21c44d7-f954-4131-aba1-54720a235e18 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:37.504616 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b21c44d7-f954-4131-aba1-54720a235e18 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] [instance: 716de5b7-33a8-45f4-bdab-ec12b4daa8c2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:37.508385 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9851ee46-9286-44cb-a110-473f4d689d09 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] 10.222.0.57 "GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8" status: 200 len: 1321 microversion: 2.1 time: 0.440144 Jul 18 02:10:37.508973 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 376/755] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:37 2022] GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8 => generated 1321 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:37.513617 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b21c44d7-f954-4131-aba1-54720a235e18 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:37.514210 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b21c44d7-f954-4131-aba1-54720a235e18 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:37.514989 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b21c44d7-f954-4131-aba1-54720a235e18 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:37.515426 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b21c44d7-f954-4131-aba1-54720a235e18 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:37.525194 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-cd31114b-75b3-48cc-a228-7dd3b02b9afe req-91fd7722-6cc2-41a1-92a2-2f27d7413f6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5776c7b-6ae0-43da-a38f-b42e66c6596b", "tag": "b3a28d1b-5dd9-4c5b-9917-ed3720c2a542"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:37.535360 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-cd31114b-75b3-48cc-a228-7dd3b02b9afe req-91fd7722-6cc2-41a1-92a2-2f27d7413f6f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:37.535731 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-cd31114b-75b3-48cc-a228-7dd3b02b9afe req-91fd7722-6cc2-41a1-92a2-2f27d7413f6f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:37.550610 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b21c44d7-f954-4131-aba1-54720a235e18 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] [instance: 716de5b7-33a8-45f4-bdab-ec12b4daa8c2] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:10:37.553076 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-cd31114b-75b3-48cc-a228-7dd3b02b9afe req-91fd7722-6cc2-41a1-92a2-2f27d7413f6f service nova] Creating event network-changed:b3a28d1b-5dd9-4c5b-9917-ed3720c2a542 for instance e5776c7b-6ae0-43da-a38f-b42e66c6596b on n-h1-465891-3 Jul 18 02:10:37.559680 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-cd31114b-75b3-48cc-a228-7dd3b02b9afe req-91fd7722-6cc2-41a1-92a2-2f27d7413f6f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049217 Jul 18 02:10:37.560390 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 377/756] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:10:37.568571 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d9858926-af95-4a86-bb2b-9432e34c18ab tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:37.569885 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d9858926-af95-4a86-bb2b-9432e34c18ab tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:37.577813 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d9858926-af95-4a86-bb2b-9432e34c18ab tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:37.578362 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d9858926-af95-4a86-bb2b-9432e34c18ab tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:37.579338 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d9858926-af95-4a86-bb2b-9432e34c18ab tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:37.579901 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d9858926-af95-4a86-bb2b-9432e34c18ab tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:37.674316 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b21c44d7-f954-4131-aba1-54720a235e18 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] 10.222.0.57 "DELETE /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2" status: 204 len: 0 microversion: 2.1 time: 0.174250 Jul 18 02:10:37.676287 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 380/757] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:10:37 2022] DELETE /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:10:37.689080 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c27ca999-cb07-4f07-b605-09fddf867e83 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:37.690105 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c27ca999-cb07-4f07-b605-09fddf867e83 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:37.697575 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c27ca999-cb07-4f07-b605-09fddf867e83 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:37.698066 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c27ca999-cb07-4f07-b605-09fddf867e83 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:37.699440 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c27ca999-cb07-4f07-b605-09fddf867e83 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:37.700007 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c27ca999-cb07-4f07-b605-09fddf867e83 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:38.038640 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c27ca999-cb07-4f07-b605-09fddf867e83 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:38.050579 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c27ca999-cb07-4f07-b605-09fddf867e83 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 200 len: 1311 microversion: 2.1 time: 0.372279 Jul 18 02:10:38.051185 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 381/758] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:37 2022] GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 1311 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:38.062645 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8d01720f-5fc3-4ac3-896d-65e16320ae40 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:38.064875 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8d01720f-5fc3-4ac3-896d-65e16320ae40 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] [instance: 716de5b7-33a8-45f4-bdab-ec12b4daa8c2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:38.065550 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d9858926-af95-4a86-bb2b-9432e34c18ab tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:38.074274 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8d01720f-5fc3-4ac3-896d-65e16320ae40 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:38.074836 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8d01720f-5fc3-4ac3-896d-65e16320ae40 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:38.075791 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8d01720f-5fc3-4ac3-896d-65e16320ae40 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:38.076309 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8d01720f-5fc3-4ac3-896d-65e16320ae40 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:38.078958 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d9858926-af95-4a86-bb2b-9432e34c18ab tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1472 microversion: 2.1 time: 0.516936 Jul 18 02:10:38.079663 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 378/759] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:37 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1472 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:38.094912 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-41c5a09b-82d2-4cb9-9734-61a7bcbdf6ad tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:38.096309 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-41c5a09b-82d2-4cb9-9734-61a7bcbdf6ad tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 25dfb6dd-6d5a-4399-a348-0a162ca907ef] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:38.107463 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41c5a09b-82d2-4cb9-9734-61a7bcbdf6ad tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:38.107463 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41c5a09b-82d2-4cb9-9734-61a7bcbdf6ad tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:38.107463 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41c5a09b-82d2-4cb9-9734-61a7bcbdf6ad tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:38.107463 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41c5a09b-82d2-4cb9-9734-61a7bcbdf6ad tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:38.372887 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8d01720f-5fc3-4ac3-896d-65e16320ae40 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b94d6f2c2d8b42d38d1149dab5ad2d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1fb21b43343238f9e96d7dc003841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:38.375310 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-41c5a09b-82d2-4cb9-9734-61a7bcbdf6ad tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:38.381168 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8d01720f-5fc3-4ac3-896d-65e16320ae40 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] 10.222.0.57 "GET /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2" status: 200 len: 1478 microversion: 2.1 time: 0.328957 Jul 18 02:10:38.382306 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 382/760] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:38 2022] GET /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2 => generated 1478 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:38.383292 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-41c5a09b-82d2-4cb9-9734-61a7bcbdf6ad tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef" status: 200 len: 1498 microversion: 2.1 time: 0.299583 Jul 18 02:10:38.383860 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 379/761] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:38 2022] GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef => generated 1498 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:38.389304 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-34f9ca68-92bf-4652-a74a-f9e809588440 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:38.390185 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-34f9ca68-92bf-4652-a74a-f9e809588440 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] [instance: e5776c7b-6ae0-43da-a38f-b42e66c6596b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:38.396839 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-34f9ca68-92bf-4652-a74a-f9e809588440 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:38.397174 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-058e58a3-e7be-4682-af66-fdfd5ff8d944 req-9a9916d0-9f18-4e4b-94b2-1063967e38b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22002049-4347-47d8-a5a2-6d3f31ec8927", "name": "network-vif-plugged", "status": "completed", "tag": "83756a9c-0161-44d8-b50b-8a364a6fcada"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:38.397335 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-34f9ca68-92bf-4652-a74a-f9e809588440 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:38.398062 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-34f9ca68-92bf-4652-a74a-f9e809588440 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:38.398493 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-34f9ca68-92bf-4652-a74a-f9e809588440 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:38.407207 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-058e58a3-e7be-4682-af66-fdfd5ff8d944 req-9a9916d0-9f18-4e4b-94b2-1063967e38b1 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:38.407712 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-058e58a3-e7be-4682-af66-fdfd5ff8d944 req-9a9916d0-9f18-4e4b-94b2-1063967e38b1 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:38.424770 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-058e58a3-e7be-4682-af66-fdfd5ff8d944 req-9a9916d0-9f18-4e4b-94b2-1063967e38b1 service nova] Creating event network-vif-plugged:83756a9c-0161-44d8-b50b-8a364a6fcada for instance 22002049-4347-47d8-a5a2-6d3f31ec8927 on n-h1-465891-3 Jul 18 02:10:38.429870 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-058e58a3-e7be-4682-af66-fdfd5ff8d944 req-9a9916d0-9f18-4e4b-94b2-1063967e38b1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037072 Jul 18 02:10:38.430502 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 383/762] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:10:38.436904 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-fe909436-1560-476c-89c5-b69fd4be3e81 req-bdedd886-00c5-449e-b29d-267df0ac9d8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c643d39-a6e1-41ec-a6f9-ffaf41421eb8", "tag": "8715c030-4b8f-4b95-919f-e51fec1c48ce"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:38.445474 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-fe909436-1560-476c-89c5-b69fd4be3e81 req-bdedd886-00c5-449e-b29d-267df0ac9d8a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:38.445882 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-fe909436-1560-476c-89c5-b69fd4be3e81 req-bdedd886-00c5-449e-b29d-267df0ac9d8a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:38.457891 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-fe909436-1560-476c-89c5-b69fd4be3e81 req-bdedd886-00c5-449e-b29d-267df0ac9d8a service nova] Creating event network-changed:8715c030-4b8f-4b95-919f-e51fec1c48ce for instance 8c643d39-a6e1-41ec-a6f9-ffaf41421eb8 on n-h1-465891-3 Jul 18 02:10:38.462598 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-fe909436-1560-476c-89c5-b69fd4be3e81 req-bdedd886-00c5-449e-b29d-267df0ac9d8a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030863 Jul 18 02:10:38.463203 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 384/763] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:10:38.505220 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8b305f30-0d8a-400b-a956-91a2c4cfac33 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:38.505957 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8b305f30-0d8a-400b-a956-91a2c4cfac33 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 25f8645e-70fa-4fc4-ae8f-ee303c090469] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:38.513626 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8b305f30-0d8a-400b-a956-91a2c4cfac33 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:38.514102 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8b305f30-0d8a-400b-a956-91a2c4cfac33 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:38.514898 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8b305f30-0d8a-400b-a956-91a2c4cfac33 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:38.515337 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8b305f30-0d8a-400b-a956-91a2c4cfac33 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:38.541602 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-34f9ca68-92bf-4652-a74a-f9e809588440 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6698374ee5c4bf18440a2f382db3c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d7b11fb5cd420cb8dbb16208bccf91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:38.551637 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-34f9ca68-92bf-4652-a74a-f9e809588440 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] 10.222.0.57 "GET /compute/v2.1/servers/e5776c7b-6ae0-43da-a38f-b42e66c6596b" status: 200 len: 1318 microversion: 2.1 time: 0.166746 Jul 18 02:10:38.552213 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 380/764] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:38 2022] GET /compute/v2.1/servers/e5776c7b-6ae0-43da-a38f-b42e66c6596b => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:38.556971 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-00f91f08-2989-4ab9-ac53-fe9a0e7ee8ce tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:38.557789 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-00f91f08-2989-4ab9-ac53-fe9a0e7ee8ce tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: 8c643d39-a6e1-41ec-a6f9-ffaf41421eb8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:38.565372 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-00f91f08-2989-4ab9-ac53-fe9a0e7ee8ce tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:38.566169 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-00f91f08-2989-4ab9-ac53-fe9a0e7ee8ce tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:38.567179 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-00f91f08-2989-4ab9-ac53-fe9a0e7ee8ce tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:38.567765 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-00f91f08-2989-4ab9-ac53-fe9a0e7ee8ce tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:38.710767 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8b305f30-0d8a-400b-a956-91a2c4cfac33 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:38.719367 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8b305f30-0d8a-400b-a956-91a2c4cfac33 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469" status: 200 len: 1520 microversion: 2.1 time: 0.218305 Jul 18 02:10:38.719958 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 385/765] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:38 2022] GET /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469 => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:10:38.739675 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-00f91f08-2989-4ab9-ac53-fe9a0e7ee8ce tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6962b97241f4c3a9960bb5fe52f8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8e996befd24b26b0371ad9cdb4a069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:38.742886 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-dbc9dd47-1098-4231-87a4-8398386e9db5 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:38.743642 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-dbc9dd47-1098-4231-87a4-8398386e9db5 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 25f8645e-70fa-4fc4-ae8f-ee303c090469] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:38.750307 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-00f91f08-2989-4ab9-ac53-fe9a0e7ee8ce tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] 10.222.0.57 "GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8" status: 200 len: 1321 microversion: 2.1 time: 0.196672 Jul 18 02:10:38.750915 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 381/766] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:38 2022] GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8 => generated 1321 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:38.760360 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dbc9dd47-1098-4231-87a4-8398386e9db5 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:38.760924 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dbc9dd47-1098-4231-87a4-8398386e9db5 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:38.762420 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dbc9dd47-1098-4231-87a4-8398386e9db5 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:38.762859 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dbc9dd47-1098-4231-87a4-8398386e9db5 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:38.768335 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:10:38.900207 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-dbc9dd47-1098-4231-87a4-8398386e9db5 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:38.908590 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-dbc9dd47-1098-4231-87a4-8398386e9db5 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469" status: 200 len: 1520 microversion: 2.1 time: 0.169867 Jul 18 02:10:38.909158 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 386/767] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:38 2022] GET /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:38.925483 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-98adb048-90a2-4bc4-b1b3-ee4075f87d8a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1362003943"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:38.926605 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-98adb048-90a2-4bc4-b1b3-ee4075f87d8a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 25f8645e-70fa-4fc4-ae8f-ee303c090469] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:38.932908 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-98adb048-90a2-4bc4-b1b3-ee4075f87d8a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:38.933984 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-98adb048-90a2-4bc4-b1b3-ee4075f87d8a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:38.934768 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-98adb048-90a2-4bc4-b1b3-ee4075f87d8a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:38.935211 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-98adb048-90a2-4bc4-b1b3-ee4075f87d8a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:39.067830 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ce4e4169-6745-4c26-8d8b-695f36754ed4 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:39.068475 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ce4e4169-6745-4c26-8d8b-695f36754ed4 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:39.074633 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ce4e4169-6745-4c26-8d8b-695f36754ed4 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:39.075082 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ce4e4169-6745-4c26-8d8b-695f36754ed4 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:39.075885 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ce4e4169-6745-4c26-8d8b-695f36754ed4 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:39.076328 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ce4e4169-6745-4c26-8d8b-695f36754ed4 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:39.218517 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-98adb048-90a2-4bc4-b1b3-ee4075f87d8a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "POST /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469/action" status: 202 len: 0 microversion: 2.1 time: 0.296733 Jul 18 02:10:39.221857 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 382/768] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:10:38 2022] POST /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 18 02:10:39.226265 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ce4e4169-6745-4c26-8d8b-695f36754ed4 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:39.227927 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8f67c1da-62d5-4df6-a0fa-666e4bec2786 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:39.228866 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8f67c1da-62d5-4df6-a0fa-666e4bec2786 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:39.233932 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:10:39.239064 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8f67c1da-62d5-4df6-a0fa-666e4bec2786 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:39.239204 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8f67c1da-62d5-4df6-a0fa-666e4bec2786 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:39.240139 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8f67c1da-62d5-4df6-a0fa-666e4bec2786 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:39.240679 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8f67c1da-62d5-4df6-a0fa-666e4bec2786 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:39.243263 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ce4e4169-6745-4c26-8d8b-695f36754ed4 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 200 len: 1311 microversion: 2.1 time: 0.179177 Jul 18 02:10:39.255704 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 387/769] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:39 2022] GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 1311 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:10:39.264535 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7863b541-4cd0-42fd-86aa-8325b3d69c88 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '.version_select at 0x7ff4a92aa160>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:39.393794 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7863b541-4cd0-42fd-86aa-8325b3d69c88 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "DELETE /compute/v2.1/images/52ec26bb-06e3-4aa7-b31b-56eff33401de" status: 204 len: 0 microversion: 2.1 time: 0.136804 Jul 18 02:10:39.394492 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 388/770] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:39 2022] DELETE /compute/v2.1/images/52ec26bb-06e3-4aa7-b31b-56eff33401de => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:10:39.400899 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7798e4a2-95ab-429c-893d-3309a606cd71 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:39.401520 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7798e4a2-95ab-429c-893d-3309a606cd71 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] [instance: 716de5b7-33a8-45f4-bdab-ec12b4daa8c2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:39.406441 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8f67c1da-62d5-4df6-a0fa-666e4bec2786 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:39.408415 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7798e4a2-95ab-429c-893d-3309a606cd71 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:39.409088 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7798e4a2-95ab-429c-893d-3309a606cd71 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:39.409963 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7798e4a2-95ab-429c-893d-3309a606cd71 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:39.410703 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7798e4a2-95ab-429c-893d-3309a606cd71 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:39.415592 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8f67c1da-62d5-4df6-a0fa-666e4bec2786 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1472 microversion: 2.1 time: 0.192236 Jul 18 02:10:39.416384 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 383/771] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:39 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1472 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:39.434123 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e73f8541-d325-4fc2-a937-544938dfcb9b tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:39.434906 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e73f8541-d325-4fc2-a937-544938dfcb9b tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 25dfb6dd-6d5a-4399-a348-0a162ca907ef] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:39.441086 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e73f8541-d325-4fc2-a937-544938dfcb9b tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:39.441533 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e73f8541-d325-4fc2-a937-544938dfcb9b tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:39.442375 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e73f8541-d325-4fc2-a937-544938dfcb9b tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:39.442817 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e73f8541-d325-4fc2-a937-544938dfcb9b tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:39.624816 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7798e4a2-95ab-429c-893d-3309a606cd71 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b94d6f2c2d8b42d38d1149dab5ad2d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1fb21b43343238f9e96d7dc003841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:39.633085 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7798e4a2-95ab-429c-893d-3309a606cd71 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] 10.222.0.57 "GET /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2" status: 200 len: 1478 microversion: 2.1 time: 0.237164 Jul 18 02:10:39.633944 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 389/772] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:39 2022] GET /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2 => generated 1478 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:39.639322 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-036bef19-46df-4a5d-8a75-9c8dde786538 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '.version_select at 0x7ff4a9208940>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:39.640751 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e73f8541-d325-4fc2-a937-544938dfcb9b tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:39.649548 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e73f8541-d325-4fc2-a937-544938dfcb9b tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef" status: 200 len: 1498 microversion: 2.1 time: 0.220509 Jul 18 02:10:39.650494 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 384/773] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:39 2022] GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef => generated 1498 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:39.655344 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1b1934cb-262d-4265-bbe1-238f5e09d35d tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:39.655890 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1b1934cb-262d-4265-bbe1-238f5e09d35d tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] [instance: e5776c7b-6ae0-43da-a38f-b42e66c6596b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:39.661936 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1b1934cb-262d-4265-bbe1-238f5e09d35d tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:39.662378 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1b1934cb-262d-4265-bbe1-238f5e09d35d tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:39.663148 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1b1934cb-262d-4265-bbe1-238f5e09d35d tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:39.663578 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1b1934cb-262d-4265-bbe1-238f5e09d35d tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:39.670857 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-036bef19-46df-4a5d-8a75-9c8dde786538 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] HTTP exception thrown: Image not found. Jul 18 02:10:39.680720 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-036bef19-46df-4a5d-8a75-9c8dde786538 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Request method failure captured: Jul 18 02:10:39.680720 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/images/52ec26bb-06e3-4aa7-b31b-56eff33401de HTTP/1.1 Jul 18 02:10:39.680720 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:10:39.680720 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:10:39.680720 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:10:39.680720 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:10:39.680720 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:10:39.680720 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:10:39.680720 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:10:39.680720 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:10:39.680720 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MDHcKkxv785TruBaYZ9isdDskpkSTXS63FySdEQ2DQWlYCoBeefqvgfCQf6lXL0HIcBKCVhVPgBeigtx_Fr6JAMpyAfBIDaZdUpBEZ_ARmYr58LYp6mJVoQMeV86GVtrWumVWYiUwrWzpXpGhfDxCZstFRul6eTjV0GKZX_II9Blls Jul 18 02:10:39.680720 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:10:39.680720 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:10:39.680720 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:10:39.680720 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:10:39.680720 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:10:39.680720 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:10:39.680720 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: d6b1efcf9e224d66b7dbf31c8aa89f87 Jul 18 02:10:39.680720 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-872437023 Jul 18 02:10:39.680720 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:10:39.680720 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:10:39.682259 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d6b1efcf9e224d66b7dbf31c8aa89f87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d6b1efcf9e224d66b7dbf31c8aa89f87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d6b1efcf9e224d66b7dbf31c8aa89f87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d6b1efcf9e224d66b7dbf31c8aa89f87"}]}] Jul 18 02:10:39.682259 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-872437023 Jul 18 02:10:39.682259 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: d6b1efcf9e224d66b7dbf31c8aa89f87 Jul 18 02:10:39.682259 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-872437023 Jul 18 02:10:39.682259 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ImagesOneServerNegativeTestJSON-872437023-project Jul 18 02:10:39.682259 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:10:39.682259 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:10:39.682259 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 625ab51af53042138e5335e3ae6e5dac Jul 18 02:10:39.682259 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-872437023-project Jul 18 02:10:39.682259 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:10:39.682259 n-d-465891-3 devstack@n-api.service[119544]: exception: Image not found. Jul 18 02:10:39.682259 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '52ec26bb-06e3-4aa7-b31b-56eff33401de'} Jul 18 02:10:39.682259 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:10:39.683765 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:10:39.683765 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 02:10:39.683765 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 02:10:39.683765 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:10:39.683765 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:10:39.683765 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 02:10:39.683765 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 02:10:39.683765 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:10:39.683765 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:10:39.683765 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 02:10:39.683765 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 02:10:39.683765 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 02:10:39.683765 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 02:10:39.683765 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:10:39.683765 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:10:39.683765 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:10:39.683765 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:10:39.683765 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 52ec26bb-06e3-4aa7-b31b-56eff33401de Jul 18 02:10:39.685149 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:10:39.685149 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:10:39.685149 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:10:39.685149 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:10:39.685149 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 18 02:10:39.685149 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 18 02:10:39.685149 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 18 02:10:39.685149 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 18 02:10:39.685149 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 18 02:10:39.685149 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 18 02:10:39.685149 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 18 02:10:39.685149 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 18 02:10:39.685149 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 02:10:39.685149 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 02:10:39.685149 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:10:39.685149 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:10:39.685149 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 02:10:39.685149 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 02:10:39.685149 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:10:39.685149 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:10:39.686531 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 02:10:39.686531 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 02:10:39.686531 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 02:10:39.686531 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 02:10:39.686531 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:10:39.686531 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:10:39.686531 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:10:39.686531 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:10:39.686531 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 52ec26bb-06e3-4aa7-b31b-56eff33401de could not be found. Jul 18 02:10:39.686531 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:10:39.686531 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:10:39.686531 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:10:39.686531 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:10:39.686531 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:10:39.686531 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:10:39.686531 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:10:39.686531 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:10:39.686531 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:10:39.686531 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:10:39.687817 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:10:39.687817 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:10:39.687817 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 18 02:10:39.687817 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 02:10:39.687817 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:10:39.687817 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:10:39.687817 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:10:39.687817 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:10:39.687817 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:10:39.687817 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:10:39.687817 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:10:39.687817 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:10:39.687817 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:10:39.687817 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:10:39.687817 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:10:39.687817 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-036bef19-46df-4a5d-8a75-9c8dde786538 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Returning 404 to user: Image not found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:10:39.688970 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-036bef19-46df-4a5d-8a75-9c8dde786538 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/images/52ec26bb-06e3-4aa7-b31b-56eff33401de" status: 404 len: 62 microversion: 2.1 time: 0.047876 Jul 18 02:10:39.688970 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 390/774] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:10:39 2022] GET /compute/v2.1/images/52ec26bb-06e3-4aa7-b31b-56eff33401de => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:10:39.692333 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3f4960af-ba86-404b-bbfd-8dae89dbc846 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:39.693639 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3f4960af-ba86-404b-bbfd-8dae89dbc846 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 25f8645e-70fa-4fc4-ae8f-ee303c090469] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:39.700922 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3f4960af-ba86-404b-bbfd-8dae89dbc846 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:39.701376 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3f4960af-ba86-404b-bbfd-8dae89dbc846 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:39.702186 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3f4960af-ba86-404b-bbfd-8dae89dbc846 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:39.702622 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3f4960af-ba86-404b-bbfd-8dae89dbc846 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:40.115841 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1b1934cb-262d-4265-bbe1-238f5e09d35d tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6698374ee5c4bf18440a2f382db3c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d7b11fb5cd420cb8dbb16208bccf91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:40.124582 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1b1934cb-262d-4265-bbe1-238f5e09d35d tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] 10.222.0.57 "GET /compute/v2.1/servers/e5776c7b-6ae0-43da-a38f-b42e66c6596b" status: 200 len: 1318 microversion: 2.1 time: 0.473326 Jul 18 02:10:40.125172 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 385/775] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:39 2022] GET /compute/v2.1/servers/e5776c7b-6ae0-43da-a38f-b42e66c6596b => generated 1318 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:40.140062 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8e5b6a1f-e23b-4761-90e7-30cca4f617a8 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:40.140686 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8e5b6a1f-e23b-4761-90e7-30cca4f617a8 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: 8c643d39-a6e1-41ec-a6f9-ffaf41421eb8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:40.140787 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3f4960af-ba86-404b-bbfd-8dae89dbc846 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:40.146894 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8e5b6a1f-e23b-4761-90e7-30cca4f617a8 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:40.147349 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8e5b6a1f-e23b-4761-90e7-30cca4f617a8 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:40.148134 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8e5b6a1f-e23b-4761-90e7-30cca4f617a8 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:40.148263 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3f4960af-ba86-404b-bbfd-8dae89dbc846 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469" status: 200 len: 1532 microversion: 2.1 time: 0.459649 Jul 18 02:10:40.148572 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8e5b6a1f-e23b-4761-90e7-30cca4f617a8 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:40.148804 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 391/776] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:39 2022] GET /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469 => generated 1532 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:40.170925 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:10:40.268077 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6b13f95b-33b5-4d97-bf62-15e9346e97a0 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:40.268695 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6b13f95b-33b5-4d97-bf62-15e9346e97a0 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:40.274879 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b13f95b-33b5-4d97-bf62-15e9346e97a0 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:40.275336 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b13f95b-33b5-4d97-bf62-15e9346e97a0 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:40.276120 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b13f95b-33b5-4d97-bf62-15e9346e97a0 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:40.277365 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b13f95b-33b5-4d97-bf62-15e9346e97a0 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:40.293962 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8e5b6a1f-e23b-4761-90e7-30cca4f617a8 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6962b97241f4c3a9960bb5fe52f8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8e996befd24b26b0371ad9cdb4a069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:40.301742 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8e5b6a1f-e23b-4761-90e7-30cca4f617a8 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] 10.222.0.57 "GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8" status: 200 len: 1321 microversion: 2.1 time: 0.166779 Jul 18 02:10:40.302306 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 386/777] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:40 2022] GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:40.419741 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6b13f95b-33b5-4d97-bf62-15e9346e97a0 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:40.429563 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6b13f95b-33b5-4d97-bf62-15e9346e97a0 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 200 len: 1311 microversion: 2.1 time: 0.165393 Jul 18 02:10:40.430179 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 392/778] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:40 2022] GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 1311 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:10:40.435682 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-48cd7725-eab7-4af7-a5dd-901b52df22a1 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:40.436426 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-48cd7725-eab7-4af7-a5dd-901b52df22a1 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:40.442665 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-48cd7725-eab7-4af7-a5dd-901b52df22a1 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:40.443117 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-48cd7725-eab7-4af7-a5dd-901b52df22a1 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:40.443891 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-48cd7725-eab7-4af7-a5dd-901b52df22a1 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:40.444333 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-48cd7725-eab7-4af7-a5dd-901b52df22a1 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:40.578874 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-48cd7725-eab7-4af7-a5dd-901b52df22a1 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:40.586617 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-48cd7725-eab7-4af7-a5dd-901b52df22a1 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1472 microversion: 2.1 time: 0.156559 Jul 18 02:10:40.587201 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 387/779] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:40 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1472 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:10:40.652686 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b17db875-0daa-48e9-a3b6-e7c8f28f083a tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:40.653289 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b17db875-0daa-48e9-a3b6-e7c8f28f083a tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] [instance: 716de5b7-33a8-45f4-bdab-ec12b4daa8c2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:40.660513 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b17db875-0daa-48e9-a3b6-e7c8f28f083a tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:40.660955 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b17db875-0daa-48e9-a3b6-e7c8f28f083a tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:40.661744 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b17db875-0daa-48e9-a3b6-e7c8f28f083a tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:40.662177 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b17db875-0daa-48e9-a3b6-e7c8f28f083a tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:40.667744 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8bb15abe-f296-4544-b17d-37f2b43f401a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:40.668447 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8bb15abe-f296-4544-b17d-37f2b43f401a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 25dfb6dd-6d5a-4399-a348-0a162ca907ef] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:40.674631 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8bb15abe-f296-4544-b17d-37f2b43f401a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:40.675159 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8bb15abe-f296-4544-b17d-37f2b43f401a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:40.676052 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8bb15abe-f296-4544-b17d-37f2b43f401a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:40.676494 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8bb15abe-f296-4544-b17d-37f2b43f401a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:40.861794 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b17db875-0daa-48e9-a3b6-e7c8f28f083a tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b94d6f2c2d8b42d38d1149dab5ad2d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1fb21b43343238f9e96d7dc003841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:40.869260 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8bb15abe-f296-4544-b17d-37f2b43f401a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:40.869444 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b17db875-0daa-48e9-a3b6-e7c8f28f083a tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] 10.222.0.57 "GET /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2" status: 200 len: 1478 microversion: 2.1 time: 0.222147 Jul 18 02:10:40.870132 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 393/780] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:40 2022] GET /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2 => generated 1478 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:40.878477 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8bb15abe-f296-4544-b17d-37f2b43f401a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef" status: 200 len: 1498 microversion: 2.1 time: 0.214571 Jul 18 02:10:40.879190 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 388/781] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:40 2022] GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef => generated 1498 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:10:41.141890 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a2505d54-1309-453b-a2c9-fc456543a0fa tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:41.142504 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a2505d54-1309-453b-a2c9-fc456543a0fa tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] [instance: e5776c7b-6ae0-43da-a38f-b42e66c6596b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:41.148611 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a2505d54-1309-453b-a2c9-fc456543a0fa tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:41.149060 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a2505d54-1309-453b-a2c9-fc456543a0fa tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:41.149851 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a2505d54-1309-453b-a2c9-fc456543a0fa tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:41.150289 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a2505d54-1309-453b-a2c9-fc456543a0fa tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:41.166738 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4917f6c4-1431-43b2-bd92-8ee63fb18f4b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:41.167911 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4917f6c4-1431-43b2-bd92-8ee63fb18f4b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 25f8645e-70fa-4fc4-ae8f-ee303c090469] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:41.170038 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=25 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:10:41.175404 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4917f6c4-1431-43b2-bd92-8ee63fb18f4b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:41.175845 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4917f6c4-1431-43b2-bd92-8ee63fb18f4b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:41.176624 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4917f6c4-1431-43b2-bd92-8ee63fb18f4b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:41.177056 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4917f6c4-1431-43b2-bd92-8ee63fb18f4b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:41.349147 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a2505d54-1309-453b-a2c9-fc456543a0fa tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6698374ee5c4bf18440a2f382db3c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d7b11fb5cd420cb8dbb16208bccf91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:41.357823 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a2505d54-1309-453b-a2c9-fc456543a0fa tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] 10.222.0.57 "GET /compute/v2.1/servers/e5776c7b-6ae0-43da-a38f-b42e66c6596b" status: 200 len: 1318 microversion: 2.1 time: 0.219713 Jul 18 02:10:41.363670 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 394/782] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:41 2022] GET /compute/v2.1/servers/e5776c7b-6ae0-43da-a38f-b42e66c6596b => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:41.363670 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ed6bf180-1c69-4f1d-874d-b4677343e77d tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:41.363670 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ed6bf180-1c69-4f1d-874d-b4677343e77d tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: 8c643d39-a6e1-41ec-a6f9-ffaf41421eb8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:41.375592 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4917f6c4-1431-43b2-bd92-8ee63fb18f4b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:41.388595 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4917f6c4-1431-43b2-bd92-8ee63fb18f4b tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469" status: 200 len: 1538 microversion: 2.1 time: 0.225753 Jul 18 02:10:41.391295 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ed6bf180-1c69-4f1d-874d-b4677343e77d tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:41.391647 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 389/783] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:41 2022] GET /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469 => generated 1538 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:10:41.391754 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ed6bf180-1c69-4f1d-874d-b4677343e77d tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:41.392536 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ed6bf180-1c69-4f1d-874d-b4677343e77d tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:41.392989 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ed6bf180-1c69-4f1d-874d-b4677343e77d tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:41.446870 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-84b02764-93ac-4c77-96f7-496d24c7b5cc tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:41.447589 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-84b02764-93ac-4c77-96f7-496d24c7b5cc tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:41.454619 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-84b02764-93ac-4c77-96f7-496d24c7b5cc tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:41.455155 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-84b02764-93ac-4c77-96f7-496d24c7b5cc tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:41.456033 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-84b02764-93ac-4c77-96f7-496d24c7b5cc tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:41.456217 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=18 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:10:41.456589 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-84b02764-93ac-4c77-96f7-496d24c7b5cc tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:41.727650 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ed6bf180-1c69-4f1d-874d-b4677343e77d tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6962b97241f4c3a9960bb5fe52f8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8e996befd24b26b0371ad9cdb4a069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:41.738198 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ed6bf180-1c69-4f1d-874d-b4677343e77d tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] 10.222.0.57 "GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8" status: 200 len: 1321 microversion: 2.1 time: 0.378562 Jul 18 02:10:41.750383 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 395/784] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:41 2022] GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8 => generated 1321 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:41.756217 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-836067a1-369d-4f34-8444-b63da6dc8c11 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:41.757093 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-836067a1-369d-4f34-8444-b63da6dc8c11 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:41.764525 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-836067a1-369d-4f34-8444-b63da6dc8c11 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:41.764977 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-836067a1-369d-4f34-8444-b63da6dc8c11 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:41.765812 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-836067a1-369d-4f34-8444-b63da6dc8c11 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:41.766898 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-836067a1-369d-4f34-8444-b63da6dc8c11 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:41.822096 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-84b02764-93ac-4c77-96f7-496d24c7b5cc tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:41.830792 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-84b02764-93ac-4c77-96f7-496d24c7b5cc tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 200 len: 1311 microversion: 2.1 time: 0.387611 Jul 18 02:10:41.831629 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 390/785] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:41 2022] GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 1311 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:10:41.887889 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-71e46486-cc92-4fb1-9b13-e80e83565883 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:41.888505 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-71e46486-cc92-4fb1-9b13-e80e83565883 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] [instance: 716de5b7-33a8-45f4-bdab-ec12b4daa8c2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:41.895204 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-71e46486-cc92-4fb1-9b13-e80e83565883 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:41.895842 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-71e46486-cc92-4fb1-9b13-e80e83565883 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:41.896668 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-71e46486-cc92-4fb1-9b13-e80e83565883 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:41.897216 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-71e46486-cc92-4fb1-9b13-e80e83565883 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:41.961005 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-836067a1-369d-4f34-8444-b63da6dc8c11 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:41.963113 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:10:41.972419 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-836067a1-369d-4f34-8444-b63da6dc8c11 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1472 microversion: 2.1 time: 0.220466 Jul 18 02:10:41.973672 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 396/786] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:41 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1472 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:41.980101 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2f28a3de-6d8f-4cbe-8e7e-997a3604e5c8 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:41.981363 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2f28a3de-6d8f-4cbe-8e7e-997a3604e5c8 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 25dfb6dd-6d5a-4399-a348-0a162ca907ef] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:41.989038 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2f28a3de-6d8f-4cbe-8e7e-997a3604e5c8 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:41.989454 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2f28a3de-6d8f-4cbe-8e7e-997a3604e5c8 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:41.990298 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2f28a3de-6d8f-4cbe-8e7e-997a3604e5c8 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:41.990772 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2f28a3de-6d8f-4cbe-8e7e-997a3604e5c8 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:42.124213 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-71e46486-cc92-4fb1-9b13-e80e83565883 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b94d6f2c2d8b42d38d1149dab5ad2d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1fb21b43343238f9e96d7dc003841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:42.135074 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-71e46486-cc92-4fb1-9b13-e80e83565883 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] 10.222.0.57 "GET /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2" status: 200 len: 1478 microversion: 2.1 time: 0.251794 Jul 18 02:10:42.137045 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 391/787] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:41 2022] GET /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2 => generated 1478 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:42.163896 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2f28a3de-6d8f-4cbe-8e7e-997a3604e5c8 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:42.171272 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2f28a3de-6d8f-4cbe-8e7e-997a3604e5c8 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef" status: 200 len: 1498 microversion: 2.1 time: 0.196135 Jul 18 02:10:42.171945 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 397/788] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:41 2022] GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef => generated 1498 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:42.247766 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-b6c7c7f3-784a-4c30-9b68-de4fb7558d6a req-ca17e2bc-4fc5-4d32-98e4-fd508f257223 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "716de5b7-33a8-45f4-bdab-ec12b4daa8c2", "name": "network-vif-deleted", "tag": "af0af000-b5ca-4135-9374-8b1af4f9aa46"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:42.251858 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=16 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:10:42.258592 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-b6c7c7f3-784a-4c30-9b68-de4fb7558d6a req-ca17e2bc-4fc5-4d32-98e4-fd508f257223 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:42.259038 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-b6c7c7f3-784a-4c30-9b68-de4fb7558d6a req-ca17e2bc-4fc5-4d32-98e4-fd508f257223 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:42.272170 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-b6c7c7f3-784a-4c30-9b68-de4fb7558d6a req-ca17e2bc-4fc5-4d32-98e4-fd508f257223 service nova] Creating event network-vif-deleted:af0af000-b5ca-4135-9374-8b1af4f9aa46 for instance 716de5b7-33a8-45f4-bdab-ec12b4daa8c2 on n-h1-465891-3 Jul 18 02:10:42.277571 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-b6c7c7f3-784a-4c30-9b68-de4fb7558d6a req-ca17e2bc-4fc5-4d32-98e4-fd508f257223 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033882 Jul 18 02:10:42.279746 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 392/789] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:10:42.376774 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b82ea70b-885d-4d15-bcd4-c645e9f8cf89 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:42.377399 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b82ea70b-885d-4d15-bcd4-c645e9f8cf89 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] [instance: e5776c7b-6ae0-43da-a38f-b42e66c6596b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:42.383766 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b82ea70b-885d-4d15-bcd4-c645e9f8cf89 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:42.384223 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b82ea70b-885d-4d15-bcd4-c645e9f8cf89 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:42.385078 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b82ea70b-885d-4d15-bcd4-c645e9f8cf89 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:42.385521 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b82ea70b-885d-4d15-bcd4-c645e9f8cf89 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:42.408821 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ca792ce9-f29c-4c47-8018-7bf291d47775 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:42.409674 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ca792ce9-f29c-4c47-8018-7bf291d47775 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 25f8645e-70fa-4fc4-ae8f-ee303c090469] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:42.416206 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ca792ce9-f29c-4c47-8018-7bf291d47775 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:42.416647 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ca792ce9-f29c-4c47-8018-7bf291d47775 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:42.417876 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ca792ce9-f29c-4c47-8018-7bf291d47775 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:42.418245 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ca792ce9-f29c-4c47-8018-7bf291d47775 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:42.578532 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b82ea70b-885d-4d15-bcd4-c645e9f8cf89 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6698374ee5c4bf18440a2f382db3c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d7b11fb5cd420cb8dbb16208bccf91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:42.586690 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b82ea70b-885d-4d15-bcd4-c645e9f8cf89 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] 10.222.0.57 "GET /compute/v2.1/servers/e5776c7b-6ae0-43da-a38f-b42e66c6596b" status: 200 len: 1318 microversion: 2.1 time: 0.214001 Jul 18 02:10:42.587357 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 398/790] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:42 2022] GET /compute/v2.1/servers/e5776c7b-6ae0-43da-a38f-b42e66c6596b => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:42.606950 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ca792ce9-f29c-4c47-8018-7bf291d47775 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:42.615106 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ca792ce9-f29c-4c47-8018-7bf291d47775 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469" status: 200 len: 1520 microversion: 2.1 time: 0.210520 Jul 18 02:10:42.615737 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 393/791] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:42 2022] GET /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469 => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:10:42.632413 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f4547b56-39a7-46a7-a722-5da2b36884e8 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:42.632913 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f4547b56-39a7-46a7-a722-5da2b36884e8 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 25f8645e-70fa-4fc4-ae8f-ee303c090469] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:42.636496 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:10:42.640715 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f4547b56-39a7-46a7-a722-5da2b36884e8 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:42.641168 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f4547b56-39a7-46a7-a722-5da2b36884e8 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:42.641977 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f4547b56-39a7-46a7-a722-5da2b36884e8 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:42.642417 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f4547b56-39a7-46a7-a722-5da2b36884e8 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:42.670881 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f4547b56-39a7-46a7-a722-5da2b36884e8 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 25f8645e-70fa-4fc4-ae8f-ee303c090469] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:10:42.762953 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c983029b-3c78-49d3-9cf3-4940ea8fb800 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:42.763885 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c983029b-3c78-49d3-9cf3-4940ea8fb800 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: 8c643d39-a6e1-41ec-a6f9-ffaf41421eb8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:42.765260 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f4547b56-39a7-46a7-a722-5da2b36884e8 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "DELETE /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469" status: 204 len: 0 microversion: 2.1 time: 0.136393 Jul 18 02:10:42.769184 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 399/792] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:10:42 2022] DELETE /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:10:42.778749 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c983029b-3c78-49d3-9cf3-4940ea8fb800 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:42.779199 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c983029b-3c78-49d3-9cf3-4940ea8fb800 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:42.786438 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2a9194bc-94c6-46c5-b808-0a73fe8decef tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:42.786662 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c983029b-3c78-49d3-9cf3-4940ea8fb800 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:42.786662 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c983029b-3c78-49d3-9cf3-4940ea8fb800 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:42.786997 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2a9194bc-94c6-46c5-b808-0a73fe8decef tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 25f8645e-70fa-4fc4-ae8f-ee303c090469] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:42.799809 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2a9194bc-94c6-46c5-b808-0a73fe8decef tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:42.799809 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2a9194bc-94c6-46c5-b808-0a73fe8decef tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:42.799809 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2a9194bc-94c6-46c5-b808-0a73fe8decef tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:42.800357 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2a9194bc-94c6-46c5-b808-0a73fe8decef tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:43.142832 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c983029b-3c78-49d3-9cf3-4940ea8fb800 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6962b97241f4c3a9960bb5fe52f8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8e996befd24b26b0371ad9cdb4a069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:43.152155 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c983029b-3c78-49d3-9cf3-4940ea8fb800 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] 10.222.0.57 "GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8" status: 200 len: 1321 microversion: 2.1 time: 0.398549 Jul 18 02:10:43.152394 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2a9194bc-94c6-46c5-b808-0a73fe8decef tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:43.153672 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 394/793] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:42 2022] GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8 => generated 1321 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:10:43.158706 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-13de3651-2a37-48c9-8cd8-bcbc240b6d4a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:43.159310 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-13de3651-2a37-48c9-8cd8-bcbc240b6d4a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:43.161679 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2a9194bc-94c6-46c5-b808-0a73fe8decef tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469" status: 200 len: 1526 microversion: 2.1 time: 0.390865 Jul 18 02:10:43.162460 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 400/794] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:42 2022] GET /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469 => generated 1526 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:43.168352 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8d04c4d1-11d4-42bb-9a4e-04f2f6b4ff65 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:43.169366 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8d04c4d1-11d4-42bb-9a4e-04f2f6b4ff65 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:43.171358 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-13de3651-2a37-48c9-8cd8-bcbc240b6d4a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:43.172214 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-13de3651-2a37-48c9-8cd8-bcbc240b6d4a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:43.173255 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-13de3651-2a37-48c9-8cd8-bcbc240b6d4a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:43.174370 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-13de3651-2a37-48c9-8cd8-bcbc240b6d4a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:43.180217 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8d04c4d1-11d4-42bb-9a4e-04f2f6b4ff65 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:43.181354 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8d04c4d1-11d4-42bb-9a4e-04f2f6b4ff65 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:43.183424 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8d04c4d1-11d4-42bb-9a4e-04f2f6b4ff65 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:43.184533 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8d04c4d1-11d4-42bb-9a4e-04f2f6b4ff65 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:43.390570 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-13de3651-2a37-48c9-8cd8-bcbc240b6d4a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:43.400989 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-13de3651-2a37-48c9-8cd8-bcbc240b6d4a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 200 len: 1311 microversion: 2.1 time: 0.245944 Jul 18 02:10:43.402399 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 395/795] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:43 2022] GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 1311 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:43.407895 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-24cd6fd8-1d64-4d14-b425-bcb89ddde2f0 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:43.408737 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-24cd6fd8-1d64-4d14-b425-bcb89ddde2f0 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] [instance: 716de5b7-33a8-45f4-bdab-ec12b4daa8c2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:43.411549 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8d04c4d1-11d4-42bb-9a4e-04f2f6b4ff65 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:43.416369 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-24cd6fd8-1d64-4d14-b425-bcb89ddde2f0 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:43.418004 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-24cd6fd8-1d64-4d14-b425-bcb89ddde2f0 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:43.419036 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-24cd6fd8-1d64-4d14-b425-bcb89ddde2f0 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:43.419672 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-24cd6fd8-1d64-4d14-b425-bcb89ddde2f0 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:43.428849 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8d04c4d1-11d4-42bb-9a4e-04f2f6b4ff65 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1472 microversion: 2.1 time: 0.265123 Jul 18 02:10:43.435813 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 401/796] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:43 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1472 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:43.446784 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-74c1e60d-63ea-49e8-af76-5f9939f5ba4e tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:43.447720 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-74c1e60d-63ea-49e8-af76-5f9939f5ba4e tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 25dfb6dd-6d5a-4399-a348-0a162ca907ef] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:43.458672 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74c1e60d-63ea-49e8-af76-5f9939f5ba4e tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:43.466161 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74c1e60d-63ea-49e8-af76-5f9939f5ba4e tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:43.467846 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74c1e60d-63ea-49e8-af76-5f9939f5ba4e tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:43.468501 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74c1e60d-63ea-49e8-af76-5f9939f5ba4e tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:43.481604 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-24cd6fd8-1d64-4d14-b425-bcb89ddde2f0 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:43.492349 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-24cd6fd8-1d64-4d14-b425-bcb89ddde2f0 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:43.493373 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-24cd6fd8-1d64-4d14-b425-bcb89ddde2f0 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lazy-loading 'fault' on Instance uuid 716de5b7-33a8-45f4-bdab-ec12b4daa8c2 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:10:43.574145 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-24cd6fd8-1d64-4d14-b425-bcb89ddde2f0 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b94d6f2c2d8b42d38d1149dab5ad2d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1fb21b43343238f9e96d7dc003841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:43.581872 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-24cd6fd8-1d64-4d14-b425-bcb89ddde2f0 tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] 10.222.0.57 "GET /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2" status: 200 len: 1313 microversion: 2.1 time: 0.178217 Jul 18 02:10:43.582469 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 396/797] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:43 2022] GET /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:43.603986 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-46be5402-e5da-4a9b-92c9-50b4639d13bc tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:43.605153 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-46be5402-e5da-4a9b-92c9-50b4639d13bc tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] [instance: e5776c7b-6ae0-43da-a38f-b42e66c6596b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:43.611929 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-46be5402-e5da-4a9b-92c9-50b4639d13bc tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:43.612378 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-46be5402-e5da-4a9b-92c9-50b4639d13bc tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:43.613183 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-46be5402-e5da-4a9b-92c9-50b4639d13bc tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:43.613650 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-46be5402-e5da-4a9b-92c9-50b4639d13bc tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:43.941176 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-74c1e60d-63ea-49e8-af76-5f9939f5ba4e tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:43.953065 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-74c1e60d-63ea-49e8-af76-5f9939f5ba4e tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef" status: 200 len: 1498 microversion: 2.1 time: 0.515416 Jul 18 02:10:43.966158 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 402/798] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:43 2022] GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef => generated 1498 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:44.009928 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-46be5402-e5da-4a9b-92c9-50b4639d13bc tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6698374ee5c4bf18440a2f382db3c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d7b11fb5cd420cb8dbb16208bccf91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:44.018401 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-46be5402-e5da-4a9b-92c9-50b4639d13bc tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] 10.222.0.57 "GET /compute/v2.1/servers/e5776c7b-6ae0-43da-a38f-b42e66c6596b" status: 200 len: 1318 microversion: 2.1 time: 0.418536 Jul 18 02:10:44.019520 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 397/799] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:43 2022] GET /compute/v2.1/servers/e5776c7b-6ae0-43da-a38f-b42e66c6596b => generated 1318 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:44.171657 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-33c4d05c-f447-4c4f-a78d-1b38dcc78ad1 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:44.172294 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-33c4d05c-f447-4c4f-a78d-1b38dcc78ad1 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: 8c643d39-a6e1-41ec-a6f9-ffaf41421eb8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:44.179418 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-33c4d05c-f447-4c4f-a78d-1b38dcc78ad1 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:44.179878 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-33c4d05c-f447-4c4f-a78d-1b38dcc78ad1 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:44.180678 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-33c4d05c-f447-4c4f-a78d-1b38dcc78ad1 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:44.181119 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-33c4d05c-f447-4c4f-a78d-1b38dcc78ad1 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:44.185453 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a1201c9c-ec71-46d3-8fb1-e16e682fdab3 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:44.186287 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a1201c9c-ec71-46d3-8fb1-e16e682fdab3 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 25f8645e-70fa-4fc4-ae8f-ee303c090469] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:44.188882 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:10:44.194364 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a1201c9c-ec71-46d3-8fb1-e16e682fdab3 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:44.194809 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a1201c9c-ec71-46d3-8fb1-e16e682fdab3 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:44.195802 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a1201c9c-ec71-46d3-8fb1-e16e682fdab3 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:44.196237 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a1201c9c-ec71-46d3-8fb1-e16e682fdab3 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:44.399449 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-33c4d05c-f447-4c4f-a78d-1b38dcc78ad1 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6962b97241f4c3a9960bb5fe52f8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8e996befd24b26b0371ad9cdb4a069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:44.406565 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a1201c9c-ec71-46d3-8fb1-e16e682fdab3 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:44.407092 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-33c4d05c-f447-4c4f-a78d-1b38dcc78ad1 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] 10.222.0.57 "GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8" status: 200 len: 1321 microversion: 2.1 time: 0.241104 Jul 18 02:10:44.407882 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 403/800] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:44 2022] GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8 => generated 1321 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:44.414220 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a1201c9c-ec71-46d3-8fb1-e16e682fdab3 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469" status: 200 len: 1526 microversion: 2.1 time: 0.236147 Jul 18 02:10:44.415009 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 398/801] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:44 2022] GET /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469 => generated 1526 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:44.420082 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-16bc2e68-dc8a-4c13-ae21-4b57f709756f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:44.420697 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-16bc2e68-dc8a-4c13-ae21-4b57f709756f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:44.426920 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-16bc2e68-dc8a-4c13-ae21-4b57f709756f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:44.427373 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-16bc2e68-dc8a-4c13-ae21-4b57f709756f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:44.428181 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-16bc2e68-dc8a-4c13-ae21-4b57f709756f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:44.428618 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-16bc2e68-dc8a-4c13-ae21-4b57f709756f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:44.452188 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e8962c1a-7eb3-46db-9a7c-1175933d76e9 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:44.452800 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e8962c1a-7eb3-46db-9a7c-1175933d76e9 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:44.458873 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e8962c1a-7eb3-46db-9a7c-1175933d76e9 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:44.459322 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e8962c1a-7eb3-46db-9a7c-1175933d76e9 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:44.460120 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e8962c1a-7eb3-46db-9a7c-1175933d76e9 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:44.460561 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e8962c1a-7eb3-46db-9a7c-1175933d76e9 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:44.745534 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-16bc2e68-dc8a-4c13-ae21-4b57f709756f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:44.754884 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-16bc2e68-dc8a-4c13-ae21-4b57f709756f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 200 len: 1494 microversion: 2.1 time: 0.339262 Jul 18 02:10:44.760110 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 404/802] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:44 2022] GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 1494 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:44.760435 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f685db26-93c5-414d-a456-7b6c53da636e tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:44.761770 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f685db26-93c5-414d-a456-7b6c53da636e tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] [instance: 716de5b7-33a8-45f4-bdab-ec12b4daa8c2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:44.762595 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e8962c1a-7eb3-46db-9a7c-1175933d76e9 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:44.769217 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f685db26-93c5-414d-a456-7b6c53da636e tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:44.770656 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f685db26-93c5-414d-a456-7b6c53da636e tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:44.771558 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f685db26-93c5-414d-a456-7b6c53da636e tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:44.771684 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e8962c1a-7eb3-46db-9a7c-1175933d76e9 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1472 microversion: 2.1 time: 0.323355 Jul 18 02:10:44.772184 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f685db26-93c5-414d-a456-7b6c53da636e tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:44.772325 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 399/803] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:44 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1472 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:10:44.803362 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-f685db26-93c5-414d-a456-7b6c53da636e tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] HTTP exception thrown: Instance 716de5b7-33a8-45f4-bdab-ec12b4daa8c2 could not be found. Jul 18 02:10:44.805459 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f685db26-93c5-414d-a456-7b6c53da636e tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Request method failure captured: Jul 18 02:10:44.805459 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2 HTTP/1.1 Jul 18 02:10:44.805459 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:10:44.805459 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:10:44.805459 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:10:44.805459 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:10:44.805459 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:10:44.805459 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:10:44.805459 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:10:44.805459 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:10:44.805459 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MEFJLZ6QtYlUy27aWE1m_tEjXjJWuY7Tax2ApqO7a7JhjI0Gvfj3AL4-ZtV0PmHxH_3hi1I_cwtNMQi0Jfg3ZqkJxtIjWYF1BxMepneBraiMxy2lpI8LC36jL1Q_wFLEm_5oziuTWgGGhcBp1_OEfYWaN7DVl4pKvW3xEuvIFQafeU Jul 18 02:10:44.805459 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:10:44.805459 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:10:44.805459 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:10:44.805459 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:10:44.805459 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:10:44.805459 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:10:44.805459 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: cdc1fb21b43343238f9e96d7dc003841 Jul 18 02:10:44.805459 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1857412722 Jul 18 02:10:44.805459 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:10:44.805459 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:10:44.807002 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_cdc1fb21b43343238f9e96d7dc003841"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/cdc1fb21b43343238f9e96d7dc003841"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/cdc1fb21b43343238f9e96d7dc003841"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/cdc1fb21b43343238f9e96d7dc003841"}]}] Jul 18 02:10:44.807002 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1857412722 Jul 18 02:10:44.807002 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: cdc1fb21b43343238f9e96d7dc003841 Jul 18 02:10:44.807002 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1857412722 Jul 18 02:10:44.807002 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServerDiagnosticsNegativeTest-1857412722-project Jul 18 02:10:44.807002 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:10:44.807002 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:10:44.807002 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: b94d6f2c2d8b42d38d1149dab5ad2d9e Jul 18 02:10:44.807002 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1857412722-project Jul 18 02:10:44.807002 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:10:44.807002 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 716de5b7-33a8-45f4-bdab-ec12b4daa8c2 could not be found. Jul 18 02:10:44.807002 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '716de5b7-33a8-45f4-bdab-ec12b4daa8c2'} Jul 18 02:10:44.808428 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:10:44.808428 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:10:44.808428 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:10:44.808428 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:10:44.808428 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:10:44.808428 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:10:44.808428 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:10:44.808428 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:10:44.808428 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:10:44.808428 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:10:44.808428 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 716de5b7-33a8-45f4-bdab-ec12b4daa8c2 could not be found. Jul 18 02:10:44.808428 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:10:44.808428 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:10:44.808428 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:10:44.808428 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:10:44.808428 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:10:44.808428 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:10:44.808428 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:10:44.808428 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:10:44.808428 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:10:44.809985 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:10:44.809985 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:10:44.809985 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:10:44.809985 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:10:44.809985 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:10:44.809985 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:10:44.809985 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:10:44.809985 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 716de5b7-33a8-45f4-bdab-ec12b4daa8c2 could not be found. Jul 18 02:10:44.809985 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:10:44.809985 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:10:44.809985 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:10:44.809985 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:10:44.809985 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:10:44.809985 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:10:44.809985 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:10:44.809985 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:10:44.809985 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 716de5b7-33a8-45f4-bdab-ec12b4daa8c2 could not be found. Jul 18 02:10:44.809985 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:10:44.812484 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f685db26-93c5-414d-a456-7b6c53da636e tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] Returning 404 to user: Instance 716de5b7-33a8-45f4-bdab-ec12b4daa8c2 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:10:44.813487 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f685db26-93c5-414d-a456-7b6c53da636e tempest-ServerDiagnosticsNegativeTest-1857412722 tempest-ServerDiagnosticsNegativeTest-1857412722-project] 10.222.0.57 "GET /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2" status: 404 len: 111 microversion: 2.1 time: 0.056844 Jul 18 02:10:44.814532 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 405/804] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:44 2022] GET /compute/v2.1/servers/716de5b7-33a8-45f4-bdab-ec12b4daa8c2 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:10:44.869743 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-23095e88-7f62-4206-bdcf-3099cb684a91 req-9e1e8480-bc3b-4ca0-91ed-8aca27d8972a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25f8645e-70fa-4fc4-ae8f-ee303c090469", "name": "network-vif-plugged", "status": "completed", "tag": "d567144b-0be9-43a2-9a60-b4e7a7626110"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:44.887930 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-23095e88-7f62-4206-bdcf-3099cb684a91 req-9e1e8480-bc3b-4ca0-91ed-8aca27d8972a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:44.893357 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-23095e88-7f62-4206-bdcf-3099cb684a91 req-9e1e8480-bc3b-4ca0-91ed-8aca27d8972a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:44.920389 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-23095e88-7f62-4206-bdcf-3099cb684a91 req-9e1e8480-bc3b-4ca0-91ed-8aca27d8972a service nova] Creating event network-vif-plugged:d567144b-0be9-43a2-9a60-b4e7a7626110 for instance 25f8645e-70fa-4fc4-ae8f-ee303c090469 on n-h2-465891-3 Jul 18 02:10:44.932113 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-23095e88-7f62-4206-bdcf-3099cb684a91 req-9e1e8480-bc3b-4ca0-91ed-8aca27d8972a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065944 Jul 18 02:10:44.934482 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 406/805] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:10:44.938918 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-864908c7-099f-4cd9-a114-39a18c2175c3 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:44.939592 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-864908c7-099f-4cd9-a114-39a18c2175c3 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:44.950930 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-864908c7-099f-4cd9-a114-39a18c2175c3 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:44.951389 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-864908c7-099f-4cd9-a114-39a18c2175c3 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:44.954104 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-864908c7-099f-4cd9-a114-39a18c2175c3 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:44.955472 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-864908c7-099f-4cd9-a114-39a18c2175c3 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:44.973590 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b98ed4fe-c82c-486e-bb01-1b8e7a4b7bcb tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:44.974360 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b98ed4fe-c82c-486e-bb01-1b8e7a4b7bcb tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 25dfb6dd-6d5a-4399-a348-0a162ca907ef] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:44.985151 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b98ed4fe-c82c-486e-bb01-1b8e7a4b7bcb tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:44.985606 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b98ed4fe-c82c-486e-bb01-1b8e7a4b7bcb tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:44.986449 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b98ed4fe-c82c-486e-bb01-1b8e7a4b7bcb tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:44.986893 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b98ed4fe-c82c-486e-bb01-1b8e7a4b7bcb tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:45.240826 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-864908c7-099f-4cd9-a114-39a18c2175c3 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 200 len: 1645 microversion: 2.1 time: 0.467477 Jul 18 02:10:45.253035 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b98ed4fe-c82c-486e-bb01-1b8e7a4b7bcb tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:45.253560 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 400/806] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:44 2022] GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 1645 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:45.258522 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9780db4c-60af-4b32-b72d-27c70e890a30 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:45.259131 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9780db4c-60af-4b32-b72d-27c70e890a30 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] [instance: e5776c7b-6ae0-43da-a38f-b42e66c6596b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:45.266132 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9780db4c-60af-4b32-b72d-27c70e890a30 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:45.267173 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9780db4c-60af-4b32-b72d-27c70e890a30 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:45.268116 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9780db4c-60af-4b32-b72d-27c70e890a30 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:45.268706 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9780db4c-60af-4b32-b72d-27c70e890a30 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:45.281567 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b98ed4fe-c82c-486e-bb01-1b8e7a4b7bcb tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef" status: 200 len: 1498 microversion: 2.1 time: 0.312564 Jul 18 02:10:45.288495 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 407/807] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:44 2022] GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef => generated 1498 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:45.302236 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1f79b4d6-b2aa-44e2-b65f-d55b7e896ffd tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:45.303367 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1f79b4d6-b2aa-44e2-b65f-d55b7e896ffd tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:45.316016 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1f79b4d6-b2aa-44e2-b65f-d55b7e896ffd tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:45.316486 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1f79b4d6-b2aa-44e2-b65f-d55b7e896ffd tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:45.317678 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1f79b4d6-b2aa-44e2-b65f-d55b7e896ffd tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:45.318362 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1f79b4d6-b2aa-44e2-b65f-d55b7e896ffd tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:45.882391 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9780db4c-60af-4b32-b72d-27c70e890a30 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6698374ee5c4bf18440a2f382db3c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d7b11fb5cd420cb8dbb16208bccf91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:45.890048 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9780db4c-60af-4b32-b72d-27c70e890a30 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] 10.222.0.57 "GET /compute/v2.1/servers/e5776c7b-6ae0-43da-a38f-b42e66c6596b" status: 200 len: 1318 microversion: 2.1 time: 0.635277 Jul 18 02:10:45.900839 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 401/808] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:45 2022] GET /compute/v2.1/servers/e5776c7b-6ae0-43da-a38f-b42e66c6596b => generated 1318 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:45.907365 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6e8554d2-b15a-4c53-99ed-066a263225cb tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:45.907478 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6e8554d2-b15a-4c53-99ed-066a263225cb tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: 8c643d39-a6e1-41ec-a6f9-ffaf41421eb8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:45.909503 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1f79b4d6-b2aa-44e2-b65f-d55b7e896ffd tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 200 len: 1645 microversion: 2.1 time: 0.619401 Jul 18 02:10:45.914322 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e8554d2-b15a-4c53-99ed-066a263225cb tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:45.915098 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e8554d2-b15a-4c53-99ed-066a263225cb tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:45.915985 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e8554d2-b15a-4c53-99ed-066a263225cb tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:45.917343 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e8554d2-b15a-4c53-99ed-066a263225cb tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:45.922993 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 408/809] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:45 2022] GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 1645 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:45.927901 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-16617624-a7e3-49dd-bb0e-c56b58bbee08 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:45.928699 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-16617624-a7e3-49dd-bb0e-c56b58bbee08 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 25f8645e-70fa-4fc4-ae8f-ee303c090469] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:45.937794 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-16617624-a7e3-49dd-bb0e-c56b58bbee08 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:45.938995 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-16617624-a7e3-49dd-bb0e-c56b58bbee08 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:45.940757 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-16617624-a7e3-49dd-bb0e-c56b58bbee08 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:45.941428 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-16617624-a7e3-49dd-bb0e-c56b58bbee08 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:45.984248 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-16617624-a7e3-49dd-bb0e-c56b58bbee08 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:45.984906 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-16617624-a7e3-49dd-bb0e-c56b58bbee08 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:45.985318 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-16617624-a7e3-49dd-bb0e-c56b58bbee08 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lazy-loading 'fault' on Instance uuid 25f8645e-70fa-4fc4-ae8f-ee303c090469 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:10:46.059117 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-16617624-a7e3-49dd-bb0e-c56b58bbee08 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:46.067783 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-16617624-a7e3-49dd-bb0e-c56b58bbee08 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469" status: 200 len: 1313 microversion: 2.1 time: 0.144251 Jul 18 02:10:46.068352 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 409/810] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:45 2022] GET /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:46.083050 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fe547b1a-b182-4269-ae04-cb4bf6cc6213 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:46.083972 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fe547b1a-b182-4269-ae04-cb4bf6cc6213 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:46.091331 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fe547b1a-b182-4269-ae04-cb4bf6cc6213 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:46.091795 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fe547b1a-b182-4269-ae04-cb4bf6cc6213 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:46.092781 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6e8554d2-b15a-4c53-99ed-066a263225cb tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6962b97241f4c3a9960bb5fe52f8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8e996befd24b26b0371ad9cdb4a069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:46.093020 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fe547b1a-b182-4269-ae04-cb4bf6cc6213 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:46.093471 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fe547b1a-b182-4269-ae04-cb4bf6cc6213 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:46.103869 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6e8554d2-b15a-4c53-99ed-066a263225cb tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] 10.222.0.57 "GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8" status: 200 len: 1321 microversion: 2.1 time: 0.201428 Jul 18 02:10:46.105551 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 402/811] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:45 2022] GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8 => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:46.111430 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-3ff85d61-6ad0-4631-9e8e-ddb536375baf req-ae8373c1-abf7-4933-9408-a9ae480cb1ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25f8645e-70fa-4fc4-ae8f-ee303c090469", "name": "network-vif-deleted", "tag": "d567144b-0be9-43a2-9a60-b4e7a7626110"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:46.122093 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-3ff85d61-6ad0-4631-9e8e-ddb536375baf req-ae8373c1-abf7-4933-9408-a9ae480cb1ee service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:46.123778 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-3ff85d61-6ad0-4631-9e8e-ddb536375baf req-ae8373c1-abf7-4933-9408-a9ae480cb1ee service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:46.137034 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-3ff85d61-6ad0-4631-9e8e-ddb536375baf req-ae8373c1-abf7-4933-9408-a9ae480cb1ee service nova] Creating event network-vif-deleted:d567144b-0be9-43a2-9a60-b4e7a7626110 for instance 25f8645e-70fa-4fc4-ae8f-ee303c090469 on n-h2-465891-3 Jul 18 02:10:46.142363 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-3ff85d61-6ad0-4631-9e8e-ddb536375baf req-ae8373c1-abf7-4933-9408-a9ae480cb1ee service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035269 Jul 18 02:10:46.143233 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 403/812] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:10:46.148587 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6f6c5196-a59d-4dc7-88d8-9426dc4bcd10 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:46.150006 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:10:46.150006 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:10:46.152099 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6f6c5196-a59d-4dc7-88d8-9426dc4bcd10 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:46.152548 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6f6c5196-a59d-4dc7-88d8-9426dc4bcd10 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:46.153494 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6f6c5196-a59d-4dc7-88d8-9426dc4bcd10 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:46.154047 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6f6c5196-a59d-4dc7-88d8-9426dc4bcd10 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:46.161495 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:10:46.181577 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6f6c5196-a59d-4dc7-88d8-9426dc4bcd10 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.036874 Jul 18 02:10:46.189379 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 404/813] 10.222.0.57 () {58 vars in 1175 bytes} [Mon Jul 18 02:10:46 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:10:46.194529 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-58332838-ef93-46ea-b848-d1c83a6147d4 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-465891-3", "block_migration": true, "disk_over_commit": false}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:46.196069 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-58332838-ef93-46ea-b848-d1c83a6147d4 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:46.212837 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-58332838-ef93-46ea-b848-d1c83a6147d4 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:46.213289 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-58332838-ef93-46ea-b848-d1c83a6147d4 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:46.214153 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-58332838-ef93-46ea-b848-d1c83a6147d4 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:46.214766 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-58332838-ef93-46ea-b848-d1c83a6147d4 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:46.282239 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fe547b1a-b182-4269-ae04-cb4bf6cc6213 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:46.293773 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fe547b1a-b182-4269-ae04-cb4bf6cc6213 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1472 microversion: 2.1 time: 0.214623 Jul 18 02:10:46.313662 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 410/814] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:46 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1472 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:46.315940 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-58332838-ef93-46ea-b848-d1c83a6147d4 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lazy-loading 'flavor' on Instance uuid 22002049-4347-47d8-a5a2-6d3f31ec8927 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:10:46.321555 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0f5293de-b321-403c-b4c3-8c697b1326e7 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:46.327063 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0f5293de-b321-403c-b4c3-8c697b1326e7 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 25dfb6dd-6d5a-4399-a348-0a162ca907ef] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:46.336466 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f5293de-b321-403c-b4c3-8c697b1326e7 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:46.337620 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f5293de-b321-403c-b4c3-8c697b1326e7 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:46.338640 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f5293de-b321-403c-b4c3-8c697b1326e7 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:46.339790 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f5293de-b321-403c-b4c3-8c697b1326e7 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:46.376097 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-58332838-ef93-46ea-b848-d1c83a6147d4 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Going to try to live migrate instance to n-h2-465891-3 {{(pid=119543) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 18 02:10:46.533259 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0f5293de-b321-403c-b4c3-8c697b1326e7 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:46.541403 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0f5293de-b321-403c-b4c3-8c697b1326e7 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef" status: 200 len: 1498 microversion: 2.1 time: 0.226421 Jul 18 02:10:46.551683 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 411/815] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:46 2022] GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef => generated 1498 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:46.908522 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-da85f79b-7c5f-448d-b659-f9965b0e3759 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:46.909151 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-da85f79b-7c5f-448d-b659-f9965b0e3759 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] [instance: e5776c7b-6ae0-43da-a38f-b42e66c6596b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:46.921094 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-da85f79b-7c5f-448d-b659-f9965b0e3759 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:46.921614 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-da85f79b-7c5f-448d-b659-f9965b0e3759 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:46.922765 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-da85f79b-7c5f-448d-b659-f9965b0e3759 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:46.923264 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-da85f79b-7c5f-448d-b659-f9965b0e3759 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:47.103832 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-da85f79b-7c5f-448d-b659-f9965b0e3759 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6698374ee5c4bf18440a2f382db3c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d7b11fb5cd420cb8dbb16208bccf91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:47.113652 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-da85f79b-7c5f-448d-b659-f9965b0e3759 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] 10.222.0.57 "GET /compute/v2.1/servers/e5776c7b-6ae0-43da-a38f-b42e66c6596b" status: 200 len: 1318 microversion: 2.1 time: 0.209133 Jul 18 02:10:47.114474 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 412/816] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:46 2022] GET /compute/v2.1/servers/e5776c7b-6ae0-43da-a38f-b42e66c6596b => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:10:47.122651 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-ef2e5867-75e9-4051-bb20-fc3a34b9b52b req-782a02a3-d26b-472f-a29f-fa92f826fb36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5776c7b-6ae0-43da-a38f-b42e66c6596b", "name": "network-vif-plugged", "status": "completed", "tag": "b3a28d1b-5dd9-4c5b-9917-ed3720c2a542"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:47.131785 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-ef2e5867-75e9-4051-bb20-fc3a34b9b52b req-782a02a3-d26b-472f-a29f-fa92f826fb36 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:47.132231 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-ef2e5867-75e9-4051-bb20-fc3a34b9b52b req-782a02a3-d26b-472f-a29f-fa92f826fb36 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:47.144644 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-ef2e5867-75e9-4051-bb20-fc3a34b9b52b req-782a02a3-d26b-472f-a29f-fa92f826fb36 service nova] Creating event network-vif-plugged:b3a28d1b-5dd9-4c5b-9917-ed3720c2a542 for instance e5776c7b-6ae0-43da-a38f-b42e66c6596b on n-h1-465891-3 Jul 18 02:10:47.150347 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-ef2e5867-75e9-4051-bb20-fc3a34b9b52b req-782a02a3-d26b-472f-a29f-fa92f826fb36 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034232 Jul 18 02:10:47.150950 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 413/817] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:10:47.156219 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3ea0b966-5e87-4b6a-9623-909739906c52 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:47.156910 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3ea0b966-5e87-4b6a-9623-909739906c52 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 25f8645e-70fa-4fc4-ae8f-ee303c090469] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:47.163624 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3ea0b966-5e87-4b6a-9623-909739906c52 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:47.164071 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3ea0b966-5e87-4b6a-9623-909739906c52 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:47.164838 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3ea0b966-5e87-4b6a-9623-909739906c52 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:47.165454 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3ea0b966-5e87-4b6a-9623-909739906c52 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:47.184187 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-3ea0b966-5e87-4b6a-9623-909739906c52 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] HTTP exception thrown: Instance 25f8645e-70fa-4fc4-ae8f-ee303c090469 could not be found. Jul 18 02:10:47.185895 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3ea0b966-5e87-4b6a-9623-909739906c52 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Request method failure captured: Jul 18 02:10:47.185895 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469 HTTP/1.1 Jul 18 02:10:47.185895 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:10:47.185895 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:10:47.185895 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:10:47.185895 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:10:47.185895 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:10:47.185895 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:10:47.185895 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:10:47.185895 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:10:47.185895 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MDHcKkxv785TruBaYZ9isdDskpkSTXS63FySdEQ2DQWlYCoBeefqvgfCQf6lXL0HIcBKCVhVPgBeigtx_Fr6JAMpyAfBIDaZdUpBEZ_ARmYr58LYp6mJVoQMeV86GVtrWumVWYiUwrWzpXpGhfDxCZstFRul6eTjV0GKZX_II9Blls Jul 18 02:10:47.185895 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:10:47.185895 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:10:47.185895 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:10:47.185895 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:10:47.185895 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:10:47.185895 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:10:47.185895 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: d6b1efcf9e224d66b7dbf31c8aa89f87 Jul 18 02:10:47.185895 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-872437023 Jul 18 02:10:47.185895 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:10:47.185895 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:10:47.187298 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d6b1efcf9e224d66b7dbf31c8aa89f87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d6b1efcf9e224d66b7dbf31c8aa89f87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d6b1efcf9e224d66b7dbf31c8aa89f87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d6b1efcf9e224d66b7dbf31c8aa89f87"}]}] Jul 18 02:10:47.187298 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-872437023 Jul 18 02:10:47.187298 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: d6b1efcf9e224d66b7dbf31c8aa89f87 Jul 18 02:10:47.187298 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-872437023 Jul 18 02:10:47.187298 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ImagesOneServerNegativeTestJSON-872437023-project Jul 18 02:10:47.187298 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:10:47.187298 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:10:47.187298 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 625ab51af53042138e5335e3ae6e5dac Jul 18 02:10:47.187298 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-872437023-project Jul 18 02:10:47.187298 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:10:47.187298 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 25f8645e-70fa-4fc4-ae8f-ee303c090469 could not be found. Jul 18 02:10:47.187298 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '25f8645e-70fa-4fc4-ae8f-ee303c090469'} Jul 18 02:10:47.188414 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:10:47.188414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:10:47.188414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:10:47.188414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:10:47.188414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:10:47.188414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:10:47.188414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:10:47.188414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:10:47.188414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:10:47.188414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:10:47.188414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25f8645e-70fa-4fc4-ae8f-ee303c090469 could not be found. Jul 18 02:10:47.188414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:10:47.188414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:10:47.188414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:10:47.188414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:10:47.188414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:10:47.188414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:10:47.188414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:10:47.188414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:10:47.188414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:10:47.189859 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:10:47.189859 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:10:47.189859 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:10:47.189859 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:10:47.189859 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:10:47.189859 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:10:47.189859 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:10:47.189859 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25f8645e-70fa-4fc4-ae8f-ee303c090469 could not be found. Jul 18 02:10:47.189859 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:10:47.189859 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:10:47.189859 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:10:47.189859 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:10:47.189859 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:10:47.189859 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:10:47.189859 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:10:47.189859 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:10:47.189859 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25f8645e-70fa-4fc4-ae8f-ee303c090469 could not be found. Jul 18 02:10:47.189859 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:10:47.191046 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3ea0b966-5e87-4b6a-9623-909739906c52 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Returning 404 to user: Instance 25f8645e-70fa-4fc4-ae8f-ee303c090469 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:10:47.191046 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3ea0b966-5e87-4b6a-9623-909739906c52 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469" status: 404 len: 111 microversion: 2.1 time: 0.035089 Jul 18 02:10:47.191046 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 414/818] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:47 2022] GET /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:10:47.198697 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1416c6c2-b7d9-45d4-ade9-63c5b066c358 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:47.199311 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1416c6c2-b7d9-45d4-ade9-63c5b066c358 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: 8c643d39-a6e1-41ec-a6f9-ffaf41421eb8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:47.205854 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1416c6c2-b7d9-45d4-ade9-63c5b066c358 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:47.206182 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1416c6c2-b7d9-45d4-ade9-63c5b066c358 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:47.206950 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1416c6c2-b7d9-45d4-ade9-63c5b066c358 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:47.207542 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1416c6c2-b7d9-45d4-ade9-63c5b066c358 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:47.374964 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1416c6c2-b7d9-45d4-ade9-63c5b066c358 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6962b97241f4c3a9960bb5fe52f8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8e996befd24b26b0371ad9cdb4a069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:47.384068 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1416c6c2-b7d9-45d4-ade9-63c5b066c358 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] 10.222.0.57 "GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8" status: 200 len: 1321 microversion: 2.1 time: 0.194898 Jul 18 02:10:47.394324 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 415/819] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:47 2022] GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8 => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:47.399599 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-20343a67-0920-4639-8456-5d65e27a366d tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:47.400456 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-20343a67-0920-4639-8456-5d65e27a366d tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:47.410027 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-20343a67-0920-4639-8456-5d65e27a366d tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:47.410721 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-20343a67-0920-4639-8456-5d65e27a366d tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:47.411778 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-20343a67-0920-4639-8456-5d65e27a366d tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:47.412298 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-20343a67-0920-4639-8456-5d65e27a366d tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:47.578112 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-20343a67-0920-4639-8456-5d65e27a366d tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:47.587361 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-20343a67-0920-4639-8456-5d65e27a366d tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1472 microversion: 2.1 time: 0.191674 Jul 18 02:10:47.589362 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 416/820] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:47 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1472 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:47.594950 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-19e1e296-924d-4cc9-9bc2-bf7c69bac9a7 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1180893389", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:47.657573 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-19e1e296-924d-4cc9-9bc2-bf7c69bac9a7 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] validate_networks() for [('18a8c0db-595b-4b61-b28a-ffc00975cfcb', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:10:48.117510 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-19e1e296-924d-4cc9-9bc2-bf7c69bac9a7 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:10:48.118210 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-19e1e296-924d-4cc9-9bc2-bf7c69bac9a7 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:10:48.118808 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-19e1e296-924d-4cc9-9bc2-bf7c69bac9a7 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:10:48.119237 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-19e1e296-924d-4cc9-9bc2-bf7c69bac9a7 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:10:48.120810 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-19e1e296-924d-4cc9-9bc2-bf7c69bac9a7 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:10:48.134691 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-19e1e296-924d-4cc9-9bc2-bf7c69bac9a7 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:48.135525 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-19e1e296-924d-4cc9-9bc2-bf7c69bac9a7 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:48.136536 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-19e1e296-924d-4cc9-9bc2-bf7c69bac9a7 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:48.137172 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-19e1e296-924d-4cc9-9bc2-bf7c69bac9a7 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:48.158946 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-19e1e296-924d-4cc9-9bc2-bf7c69bac9a7 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Getting quotas for project d6b1efcf9e224d66b7dbf31c8aa89f87. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:10:48.164370 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-19e1e296-924d-4cc9-9bc2-bf7c69bac9a7 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Getting quotas for user 625ab51af53042138e5335e3ae6e5dac and project d6b1efcf9e224d66b7dbf31c8aa89f87. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:10:48.178154 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-19e1e296-924d-4cc9-9bc2-bf7c69bac9a7 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:10:48.181502 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-19e1e296-924d-4cc9-9bc2-bf7c69bac9a7 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 5f8ec100-c407-4029-b30e-f863e75b4a17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:10:48.230679 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-19e1e296-924d-4cc9-9bc2-bf7c69bac9a7 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.639666 Jul 18 02:10:48.231286 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 417/821] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:10:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:10:48.235872 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c94f372c-7d28-4d97-9825-9585b5203656 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:48.236631 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c94f372c-7d28-4d97-9825-9585b5203656 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 25dfb6dd-6d5a-4399-a348-0a162ca907ef] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:48.244294 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c94f372c-7d28-4d97-9825-9585b5203656 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:48.245123 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c94f372c-7d28-4d97-9825-9585b5203656 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:48.245969 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c94f372c-7d28-4d97-9825-9585b5203656 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:48.246424 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c94f372c-7d28-4d97-9825-9585b5203656 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:48.472662 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c94f372c-7d28-4d97-9825-9585b5203656 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:48.489539 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c94f372c-7d28-4d97-9825-9585b5203656 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef" status: 200 len: 1498 microversion: 2.1 time: 0.256867 Jul 18 02:10:48.490676 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 418/822] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:48 2022] GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef => generated 1498 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:48.500589 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-99c679c9-75d4-4508-9788-39a0fd676853 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:48.503084 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-99c679c9-75d4-4508-9788-39a0fd676853 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] [instance: e5776c7b-6ae0-43da-a38f-b42e66c6596b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:48.514378 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-99c679c9-75d4-4508-9788-39a0fd676853 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:48.515212 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-99c679c9-75d4-4508-9788-39a0fd676853 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:48.516406 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-99c679c9-75d4-4508-9788-39a0fd676853 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:48.517054 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-99c679c9-75d4-4508-9788-39a0fd676853 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:48.764872 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-99c679c9-75d4-4508-9788-39a0fd676853 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6698374ee5c4bf18440a2f382db3c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d7b11fb5cd420cb8dbb16208bccf91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:48.774277 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-99c679c9-75d4-4508-9788-39a0fd676853 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] 10.222.0.57 "GET /compute/v2.1/servers/e5776c7b-6ae0-43da-a38f-b42e66c6596b" status: 200 len: 1318 microversion: 2.1 time: 0.281976 Jul 18 02:10:48.775036 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 419/823] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:48 2022] GET /compute/v2.1/servers/e5776c7b-6ae0-43da-a38f-b42e66c6596b => generated 1318 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:48.834363 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-58332838-ef93-46ea-b848-d1c83a6147d4 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927/action" status: 202 len: 0 microversion: 2.1 time: 2.643363 Jul 18 02:10:48.835128 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 405/824] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:10:46 2022] POST /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927/action => generated 0 bytes in 2645 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:10:48.840054 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-948d3001-67ab-4cfe-9d84-dd48238571c2 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:48.840706 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-948d3001-67ab-4cfe-9d84-dd48238571c2 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 5f8ec100-c407-4029-b30e-f863e75b4a17] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:48.843277 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3064fe43-483f-4751-9607-e2934cb8c490 tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Action: 'update', calling method: .version_select at 0x7ff4a9aa3040>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:48.844704 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:10:48.844704 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:10:48.845866 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3064fe43-483f-4751-9607-e2934cb8c490 tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:48.846308 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3064fe43-483f-4751-9607-e2934cb8c490 tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:48.848590 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-948d3001-67ab-4cfe-9d84-dd48238571c2 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:48.849037 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-948d3001-67ab-4cfe-9d84-dd48238571c2 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:48.850073 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-948d3001-67ab-4cfe-9d84-dd48238571c2 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:48.850507 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-948d3001-67ab-4cfe-9d84-dd48238571c2 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:48.854786 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3064fe43-483f-4751-9607-e2934cb8c490 tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:48.855226 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3064fe43-483f-4751-9607-e2934cb8c490 tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:48.861769 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-3064fe43-483f-4751-9607-e2934cb8c490 tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] HTTP exception thrown: Service 9c87d00a-d193-4158-b76c-f584df87dcbc could not be found. Jul 18 02:10:48.863694 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3064fe43-483f-4751-9607-e2934cb8c490 tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Request method failure captured: Jul 18 02:10:48.863694 n-d-465891-3 devstack@n-api.service[119544]: request: PUT /compute/v2.1/os-services/9c87d00a-d193-4158-b76c-f584df87dcbc HTTP/1.1 Jul 18 02:10:48.863694 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:10:48.863694 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:10:48.863694 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:10:48.863694 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 56 Jul 18 02:10:48.863694 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:10:48.863694 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:10:48.863694 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:10:48.863694 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:10:48.863694 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MEoTiTc2b80D4OAaUFyuaMLX5vYGzIzzUdo7CrRsYhPZYMmhu0Zttp-xegdh4dYvcK1XRJOoKPIoQPzoefAJiSFqP_wczDuM9sYMtmSlrz2JL6RyG7RFRMsSHsslRAbDRN45ik-J8u1zYQoaxJTVNDfGJmoxB6kmxaIgaKK6RDWv6E Jul 18 02:10:48.863694 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:10:48.863694 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:10:48.863694 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:10:48.863694 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:10:48.863694 n-d-465891-3 devstack@n-api.service[119544]: X-Openstack-Nova-Api-Version: 2.53 Jul 18 02:10:48.863694 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:10:48.863694 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:10:48.863694 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: fd62099a4ede4178ba7592876deabdc3 Jul 18 02:10:48.863694 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1570238603 Jul 18 02:10:48.863694 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,admin,reader Jul 18 02:10:48.863694 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,admin,reader Jul 18 02:10:48.865294 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fd62099a4ede4178ba7592876deabdc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fd62099a4ede4178ba7592876deabdc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fd62099a4ede4178ba7592876deabdc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fd62099a4ede4178ba7592876deabdc3"}]}] Jul 18 02:10:48.865294 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1570238603 Jul 18 02:10:48.865294 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: fd62099a4ede4178ba7592876deabdc3 Jul 18 02:10:48.865294 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1570238603 Jul 18 02:10:48.865294 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin Jul 18 02:10:48.865294 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:10:48.865294 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:10:48.865294 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 7152fb456f4f410fbda9da37ac3e6c61 Jul 18 02:10:48.865294 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin Jul 18 02:10:48.865294 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:10:48.865294 n-d-465891-3 devstack@n-api.service[119544]: {"status": "disabled", "disabled_reason": "maintenance"} Jul 18 02:10:48.865294 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:10:48.865294 n-d-465891-3 devstack@n-api.service[119544]: exception: Service 9c87d00a-d193-4158-b76c-f584df87dcbc could not be found. Jul 18 02:10:48.866287 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '9c87d00a-d193-4158-b76c-f584df87dcbc', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Jul 18 02:10:48.866287 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:10:48.866287 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:10:48.866287 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 18 02:10:48.866287 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 18 02:10:48.866287 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 18 02:10:48.866287 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 18 02:10:48.866287 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 18 02:10:48.866287 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:10:48.866287 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:10:48.866287 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:10:48.866287 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:10:48.866287 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 18 02:10:48.866287 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 18 02:10:48.866287 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 18 02:10:48.866287 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:10:48.866287 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 9c87d00a-d193-4158-b76c-f584df87dcbc could not be found. Jul 18 02:10:48.866287 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:10:48.866287 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:10:48.866287 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:10:48.866287 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:10:48.867733 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:10:48.867733 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:10:48.867733 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:10:48.867733 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:10:48.867733 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:10:48.867733 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:10:48.867733 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:10:48.867733 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:10:48.867733 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:10:48.867733 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:10:48.867733 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 18 02:10:48.867733 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:10:48.867733 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 9c87d00a-d193-4158-b76c-f584df87dcbc could not be found. Jul 18 02:10:48.867733 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:10:48.867733 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:10:48.867733 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:10:48.867733 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:10:48.867733 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:10:48.867733 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:10:48.867733 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:10:48.869290 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:10:48.869290 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 9c87d00a-d193-4158-b76c-f584df87dcbc could not be found. Jul 18 02:10:48.869290 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:10:48.869290 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3064fe43-483f-4751-9607-e2934cb8c490 tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Returning 404 to user: Service 9c87d00a-d193-4158-b76c-f584df87dcbc could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:10:48.869290 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3064fe43-483f-4751-9607-e2934cb8c490 tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-services/9c87d00a-d193-4158-b76c-f584df87dcbc" status: 404 len: 110 microversion: 2.53 time: 0.091306 Jul 18 02:10:48.869290 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 420/825] 10.222.0.57 () {62 vars in 1308 bytes} [Mon Jul 18 02:10:48 2022] PUT /compute/v2.1/os-services/9c87d00a-d193-4158-b76c-f584df87dcbc => generated 110 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:10:48.875674 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-66495dd0-e2d0-4288-8a44-ebdc70edf455 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:48.876311 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-66495dd0-e2d0-4288-8a44-ebdc70edf455 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: 8c643d39-a6e1-41ec-a6f9-ffaf41421eb8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:48.883078 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-66495dd0-e2d0-4288-8a44-ebdc70edf455 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:48.883613 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-66495dd0-e2d0-4288-8a44-ebdc70edf455 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:48.884298 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-66495dd0-e2d0-4288-8a44-ebdc70edf455 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:48.884728 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-66495dd0-e2d0-4288-8a44-ebdc70edf455 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:48.947819 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-948d3001-67ab-4cfe-9d84-dd48238571c2 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:48.956031 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-948d3001-67ab-4cfe-9d84-dd48238571c2 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/5f8ec100-c407-4029-b30e-f863e75b4a17" status: 200 len: 1221 microversion: 2.1 time: 0.119775 Jul 18 02:10:48.956630 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 406/826] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:48 2022] GET /compute/v2.1/servers/5f8ec100-c407-4029-b30e-f863e75b4a17 => generated 1221 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:48.964524 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-666b644d-6462-4278-9df6-f9856251aaf6 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:48.965338 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-666b644d-6462-4278-9df6-f9856251aaf6 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:48.972913 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-666b644d-6462-4278-9df6-f9856251aaf6 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:48.973479 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-666b644d-6462-4278-9df6-f9856251aaf6 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:48.974362 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-666b644d-6462-4278-9df6-f9856251aaf6 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:48.974994 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-666b644d-6462-4278-9df6-f9856251aaf6 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:49.138484 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-66495dd0-e2d0-4288-8a44-ebdc70edf455 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6962b97241f4c3a9960bb5fe52f8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8e996befd24b26b0371ad9cdb4a069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:49.148177 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-66495dd0-e2d0-4288-8a44-ebdc70edf455 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] 10.222.0.57 "GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8" status: 200 len: 1321 microversion: 2.1 time: 0.278645 Jul 18 02:10:49.148854 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 421/827] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:48 2022] GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8 => generated 1321 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:49.163224 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b3fbc92a-00e0-4b7e-aadf-355b0c72808c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:49.164367 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b3fbc92a-00e0-4b7e-aadf-355b0c72808c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:49.171142 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-666b644d-6462-4278-9df6-f9856251aaf6 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:49.176796 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b3fbc92a-00e0-4b7e-aadf-355b0c72808c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:49.176796 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b3fbc92a-00e0-4b7e-aadf-355b0c72808c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:49.176796 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b3fbc92a-00e0-4b7e-aadf-355b0c72808c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:49.176796 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b3fbc92a-00e0-4b7e-aadf-355b0c72808c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:49.184150 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-666b644d-6462-4278-9df6-f9856251aaf6 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1472 microversion: 2.1 time: 0.223426 Jul 18 02:10:49.185149 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 407/828] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:48 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1472 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:49.191140 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ed83f1af-b3d9-41b0-a21c-e1b26b1bd79b tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Action: 'update', calling method: .version_select at 0x7ff4a913e1f0>, body: {"status": "disabled"} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:49.193982 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:10:49.193982 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:10:49.196466 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ed83f1af-b3d9-41b0-a21c-e1b26b1bd79b tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:49.197290 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ed83f1af-b3d9-41b0-a21c-e1b26b1bd79b tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:49.205874 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ed83f1af-b3d9-41b0-a21c-e1b26b1bd79b tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:49.206492 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ed83f1af-b3d9-41b0-a21c-e1b26b1bd79b tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:49.213755 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-ed83f1af-b3d9-41b0-a21c-e1b26b1bd79b tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] HTTP exception thrown: Service 9c87d00a-d193-4158-b76c-f584df87dcbc could not be found. Jul 18 02:10:49.215866 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ed83f1af-b3d9-41b0-a21c-e1b26b1bd79b tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Request method failure captured: Jul 18 02:10:49.215866 n-d-465891-3 devstack@n-api.service[119543]: request: PUT /compute/v2.1/os-services/9c87d00a-d193-4158-b76c-f584df87dcbc HTTP/1.1 Jul 18 02:10:49.215866 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:10:49.215866 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:10:49.215866 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:10:49.215866 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 22 Jul 18 02:10:49.215866 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:10:49.215866 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:10:49.215866 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:10:49.215866 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:10:49.215866 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MEoTiTc2b80D4OAaUFyuaMLX5vYGzIzzUdo7CrRsYhPZYMmhu0Zttp-xegdh4dYvcK1XRJOoKPIoQPzoefAJiSFqP_wczDuM9sYMtmSlrz2JL6RyG7RFRMsSHsslRAbDRN45ik-J8u1zYQoaxJTVNDfGJmoxB6kmxaIgaKK6RDWv6E Jul 18 02:10:49.215866 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:10:49.215866 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:10:49.215866 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:10:49.215866 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:10:49.215866 n-d-465891-3 devstack@n-api.service[119543]: X-Openstack-Nova-Api-Version: 2.53 Jul 18 02:10:49.215866 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:10:49.215866 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:10:49.215866 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: fd62099a4ede4178ba7592876deabdc3 Jul 18 02:10:49.215866 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1570238603 Jul 18 02:10:49.215866 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,admin,reader Jul 18 02:10:49.215866 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,admin,reader Jul 18 02:10:49.217242 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fd62099a4ede4178ba7592876deabdc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fd62099a4ede4178ba7592876deabdc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fd62099a4ede4178ba7592876deabdc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fd62099a4ede4178ba7592876deabdc3"}]}] Jul 18 02:10:49.217242 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1570238603 Jul 18 02:10:49.217242 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: fd62099a4ede4178ba7592876deabdc3 Jul 18 02:10:49.217242 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1570238603 Jul 18 02:10:49.217242 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin Jul 18 02:10:49.217242 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:10:49.217242 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:10:49.217242 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 7152fb456f4f410fbda9da37ac3e6c61 Jul 18 02:10:49.217242 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin Jul 18 02:10:49.217242 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 02:10:49.217242 n-d-465891-3 devstack@n-api.service[119543]: {"status": "disabled"} Jul 18 02:10:49.217242 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:10:49.217242 n-d-465891-3 devstack@n-api.service[119543]: exception: Service 9c87d00a-d193-4158-b76c-f584df87dcbc could not be found. Jul 18 02:10:49.217242 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '9c87d00a-d193-4158-b76c-f584df87dcbc', 'body': {'status': 'disabled'}} Jul 18 02:10:49.218088 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:10:49.218088 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:10:49.218088 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 18 02:10:49.218088 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 18 02:10:49.218088 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 18 02:10:49.218088 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 18 02:10:49.218088 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 18 02:10:49.218088 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:10:49.218088 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:10:49.218088 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:10:49.218088 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:10:49.218088 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 18 02:10:49.218088 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 18 02:10:49.218088 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 18 02:10:49.218088 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:10:49.218088 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 9c87d00a-d193-4158-b76c-f584df87dcbc could not be found. Jul 18 02:10:49.218088 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:10:49.218088 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:10:49.218088 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:10:49.218088 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:10:49.218088 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:10:49.219365 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:10:49.219365 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:10:49.219365 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:10:49.219365 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:10:49.219365 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:10:49.219365 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:10:49.219365 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:10:49.219365 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:10:49.219365 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:10:49.219365 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 18 02:10:49.219365 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:10:49.219365 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 9c87d00a-d193-4158-b76c-f584df87dcbc could not be found. Jul 18 02:10:49.219365 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:10:49.219365 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:10:49.219365 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:10:49.219365 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:10:49.219365 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:10:49.219365 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:10:49.219365 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:10:49.219365 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:10:49.220692 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 9c87d00a-d193-4158-b76c-f584df87dcbc could not be found. Jul 18 02:10:49.220692 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:10:49.224397 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ed83f1af-b3d9-41b0-a21c-e1b26b1bd79b tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Returning 404 to user: Service 9c87d00a-d193-4158-b76c-f584df87dcbc could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:10:49.225321 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ed83f1af-b3d9-41b0-a21c-e1b26b1bd79b tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-services/9c87d00a-d193-4158-b76c-f584df87dcbc" status: 404 len: 110 microversion: 2.53 time: 0.038777 Jul 18 02:10:49.230652 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 408/829] 10.222.0.57 () {62 vars in 1308 bytes} [Mon Jul 18 02:10:49 2022] PUT /compute/v2.1/os-services/9c87d00a-d193-4158-b76c-f584df87dcbc => generated 110 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:10:49.236409 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1ba5b707-54d8-44c8-b48d-cbabd6dfd981 tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Action: 'update', calling method: .version_select at 0x7ff4a8eedd30>, body: {"status": "enabled"} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:49.238834 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1ba5b707-54d8-44c8-b48d-cbabd6dfd981 tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:49.239360 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1ba5b707-54d8-44c8-b48d-cbabd6dfd981 tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:49.246091 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1ba5b707-54d8-44c8-b48d-cbabd6dfd981 tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:49.246636 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1ba5b707-54d8-44c8-b48d-cbabd6dfd981 tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:49.253494 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-1ba5b707-54d8-44c8-b48d-cbabd6dfd981 tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] HTTP exception thrown: Service 9c87d00a-d193-4158-b76c-f584df87dcbc could not be found. Jul 18 02:10:49.255409 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1ba5b707-54d8-44c8-b48d-cbabd6dfd981 tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Request method failure captured: Jul 18 02:10:49.255409 n-d-465891-3 devstack@n-api.service[119543]: request: PUT /compute/v2.1/os-services/9c87d00a-d193-4158-b76c-f584df87dcbc HTTP/1.1 Jul 18 02:10:49.255409 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:10:49.255409 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:10:49.255409 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:10:49.255409 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 21 Jul 18 02:10:49.255409 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:10:49.255409 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:10:49.255409 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:10:49.255409 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:10:49.255409 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MEoTiTc2b80D4OAaUFyuaMLX5vYGzIzzUdo7CrRsYhPZYMmhu0Zttp-xegdh4dYvcK1XRJOoKPIoQPzoefAJiSFqP_wczDuM9sYMtmSlrz2JL6RyG7RFRMsSHsslRAbDRN45ik-J8u1zYQoaxJTVNDfGJmoxB6kmxaIgaKK6RDWv6E Jul 18 02:10:49.255409 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:10:49.255409 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:10:49.255409 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:10:49.255409 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:10:49.255409 n-d-465891-3 devstack@n-api.service[119543]: X-Openstack-Nova-Api-Version: 2.53 Jul 18 02:10:49.255409 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:10:49.255409 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:10:49.255409 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: fd62099a4ede4178ba7592876deabdc3 Jul 18 02:10:49.255409 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1570238603 Jul 18 02:10:49.255409 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,admin,reader Jul 18 02:10:49.255409 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,admin,reader Jul 18 02:10:49.256857 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fd62099a4ede4178ba7592876deabdc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fd62099a4ede4178ba7592876deabdc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fd62099a4ede4178ba7592876deabdc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fd62099a4ede4178ba7592876deabdc3"}]}] Jul 18 02:10:49.256857 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1570238603 Jul 18 02:10:49.256857 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: fd62099a4ede4178ba7592876deabdc3 Jul 18 02:10:49.256857 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1570238603 Jul 18 02:10:49.256857 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin Jul 18 02:10:49.256857 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:10:49.256857 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:10:49.256857 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 7152fb456f4f410fbda9da37ac3e6c61 Jul 18 02:10:49.256857 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin Jul 18 02:10:49.256857 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 02:10:49.256857 n-d-465891-3 devstack@n-api.service[119543]: {"status": "enabled"} Jul 18 02:10:49.256857 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:10:49.256857 n-d-465891-3 devstack@n-api.service[119543]: exception: Service 9c87d00a-d193-4158-b76c-f584df87dcbc could not be found. Jul 18 02:10:49.256857 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '9c87d00a-d193-4158-b76c-f584df87dcbc', 'body': {'status': 'enabled'}} Jul 18 02:10:49.257804 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:10:49.257804 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:10:49.257804 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 18 02:10:49.257804 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 18 02:10:49.257804 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 18 02:10:49.257804 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 18 02:10:49.257804 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 18 02:10:49.257804 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:10:49.257804 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:10:49.257804 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:10:49.257804 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:10:49.257804 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 18 02:10:49.257804 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 18 02:10:49.257804 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 18 02:10:49.257804 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:10:49.257804 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 9c87d00a-d193-4158-b76c-f584df87dcbc could not be found. Jul 18 02:10:49.257804 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:10:49.257804 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:10:49.257804 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:10:49.257804 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:10:49.257804 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:10:49.259078 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:10:49.259078 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:10:49.259078 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:10:49.259078 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:10:49.259078 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:10:49.259078 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:10:49.259078 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:10:49.259078 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:10:49.259078 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:10:49.259078 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 18 02:10:49.259078 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:10:49.259078 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 9c87d00a-d193-4158-b76c-f584df87dcbc could not be found. Jul 18 02:10:49.259078 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:10:49.259078 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:10:49.259078 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:10:49.259078 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:10:49.259078 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:10:49.259078 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:10:49.259078 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:10:49.259078 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:10:49.262286 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 9c87d00a-d193-4158-b76c-f584df87dcbc could not be found. Jul 18 02:10:49.262286 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:10:49.262286 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1ba5b707-54d8-44c8-b48d-cbabd6dfd981 tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Returning 404 to user: Service 9c87d00a-d193-4158-b76c-f584df87dcbc could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:10:49.262286 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1ba5b707-54d8-44c8-b48d-cbabd6dfd981 tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-services/9c87d00a-d193-4158-b76c-f584df87dcbc" status: 404 len: 110 microversion: 2.53 time: 0.025217 Jul 18 02:10:49.262286 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 409/830] 10.222.0.57 () {62 vars in 1308 bytes} [Mon Jul 18 02:10:49 2022] PUT /compute/v2.1/os-services/9c87d00a-d193-4158-b76c-f584df87dcbc => generated 110 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:10:49.269737 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-db1b7e0a-8106-4015-a51b-619f39a14e29 tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:49.271906 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:10:49.271906 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:10:49.273693 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-db1b7e0a-8106-4015-a51b-619f39a14e29 tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:49.274501 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-db1b7e0a-8106-4015-a51b-619f39a14e29 tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:49.276394 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-db1b7e0a-8106-4015-a51b-619f39a14e29 tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:49.277037 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-db1b7e0a-8106-4015-a51b-619f39a14e29 tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:49.325657 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-db1b7e0a-8106-4015-a51b-619f39a14e29 tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.060718 Jul 18 02:10:49.326800 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 410/831] 10.222.0.57 () {60 vars in 1177 bytes} [Mon Jul 18 02:10:49 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:10:49.346782 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-717326d1-c594-476d-90ba-9d22c365fe7c tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:49.349231 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:10:49.349231 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:10:49.351690 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-717326d1-c594-476d-90ba-9d22c365fe7c tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:49.354121 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-717326d1-c594-476d-90ba-9d22c365fe7c tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:49.354351 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-717326d1-c594-476d-90ba-9d22c365fe7c tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:49.355131 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-717326d1-c594-476d-90ba-9d22c365fe7c tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:49.373312 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b3fbc92a-00e0-4b7e-aadf-355b0c72808c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:49.382605 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b3fbc92a-00e0-4b7e-aadf-355b0c72808c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 200 len: 1504 microversion: 2.1 time: 0.223135 Jul 18 02:10:49.383208 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 422/832] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:49 2022] GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 1504 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:49.402877 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-717326d1-c594-476d-90ba-9d22c365fe7c tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.062963 Jul 18 02:10:49.403696 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 411/833] 10.222.0.57 () {60 vars in 1210 bytes} [Mon Jul 18 02:10:49 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:10:49.427210 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-613bfea7-e327-4589-9191-ef92a8cd8646 tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:49.429106 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:10:49.429106 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:10:49.430762 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-613bfea7-e327-4589-9191-ef92a8cd8646 tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:49.431277 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-613bfea7-e327-4589-9191-ef92a8cd8646 tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:49.432684 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-613bfea7-e327-4589-9191-ef92a8cd8646 tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:49.433535 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-613bfea7-e327-4589-9191-ef92a8cd8646 tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:49.459197 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-613bfea7-e327-4589-9191-ef92a8cd8646 tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.036915 Jul 18 02:10:49.459735 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 423/834] 10.222.0.57 () {60 vars in 1177 bytes} [Mon Jul 18 02:10:49 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:10:49.478459 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-941bee20-8842-49ce-a340-f50def33a831 tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:49.481870 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:10:49.481870 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:10:49.484222 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-941bee20-8842-49ce-a340-f50def33a831 tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:49.485012 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-941bee20-8842-49ce-a340-f50def33a831 tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:49.486491 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-941bee20-8842-49ce-a340-f50def33a831 tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:49.487277 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-941bee20-8842-49ce-a340-f50def33a831 tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:49.508264 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2195b9d6-e62b-49e7-bd33-1dc3ff6c3db3 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:49.508875 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2195b9d6-e62b-49e7-bd33-1dc3ff6c3db3 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 25dfb6dd-6d5a-4399-a348-0a162ca907ef] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:49.516156 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2195b9d6-e62b-49e7-bd33-1dc3ff6c3db3 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:49.516605 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2195b9d6-e62b-49e7-bd33-1dc3ff6c3db3 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:49.517403 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2195b9d6-e62b-49e7-bd33-1dc3ff6c3db3 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:49.518012 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2195b9d6-e62b-49e7-bd33-1dc3ff6c3db3 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:49.522690 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=100 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:10:49.531173 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-941bee20-8842-49ce-a340-f50def33a831 tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services?host=n-d-465891-3&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.059412 Jul 18 02:10:49.532270 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 412/835] 10.222.0.57 () {60 vars in 1234 bytes} [Mon Jul 18 02:10:49 2022] GET /compute/v2.1/os-services?host=n-d-465891-3&binary=xxx => generated 16 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:49.550469 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7883f814-e5bd-45e9-8dd0-80fe1884d74c tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:49.560682 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:10:49.560682 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:10:49.560682 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7883f814-e5bd-45e9-8dd0-80fe1884d74c tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:49.560682 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7883f814-e5bd-45e9-8dd0-80fe1884d74c tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:49.560682 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7883f814-e5bd-45e9-8dd0-80fe1884d74c tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:49.561508 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7883f814-e5bd-45e9-8dd0-80fe1884d74c tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:49.603132 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7883f814-e5bd-45e9-8dd0-80fe1884d74c tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.059099 Jul 18 02:10:49.604278 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 413/836] 10.222.0.57 () {60 vars in 1177 bytes} [Mon Jul 18 02:10:49 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:10:49.622666 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fffc3ad9-f569-467e-93fd-74fb2c756d6c tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:49.625169 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:10:49.625169 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:10:49.627717 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fffc3ad9-f569-467e-93fd-74fb2c756d6c tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:49.628433 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fffc3ad9-f569-467e-93fd-74fb2c756d6c tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:49.630010 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fffc3ad9-f569-467e-93fd-74fb2c756d6c tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:49.630747 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fffc3ad9-f569-467e-93fd-74fb2c756d6c tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:49.677923 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fffc3ad9-f569-467e-93fd-74fb2c756d6c tempest-ServicesAdminNegativeV253TestJSON-1570238603 tempest-ServicesAdminNegativeV253TestJSON-1570238603-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.061759 Jul 18 02:10:49.679008 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 414/837] 10.222.0.57 () {60 vars in 1238 bytes} [Mon Jul 18 02:10:49 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:49.689601 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2195b9d6-e62b-49e7-bd33-1dc3ff6c3db3 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:49.706787 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2195b9d6-e62b-49e7-bd33-1dc3ff6c3db3 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef" status: 200 len: 1498 microversion: 2.1 time: 0.201866 Jul 18 02:10:49.709021 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 424/838] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:49 2022] GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef => generated 1498 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:10:49.799278 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-81bd614b-2af2-43fb-804b-aca7d55f4c6a tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:49.799969 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-81bd614b-2af2-43fb-804b-aca7d55f4c6a tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] [instance: e5776c7b-6ae0-43da-a38f-b42e66c6596b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:49.808308 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-81bd614b-2af2-43fb-804b-aca7d55f4c6a tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:49.809117 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-81bd614b-2af2-43fb-804b-aca7d55f4c6a tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:49.810251 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-81bd614b-2af2-43fb-804b-aca7d55f4c6a tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:49.810917 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-81bd614b-2af2-43fb-804b-aca7d55f4c6a tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:49.817057 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-999bc208-3e6b-4c60-a2d9-a1cdecfc8119 tempest-ServicesAdminNegativeV253TestJSON-1681880631 tempest-ServicesAdminNegativeV253TestJSON-1681880631-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:49.818538 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:10:49.818538 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:10:49.819663 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-999bc208-3e6b-4c60-a2d9-a1cdecfc8119 tempest-ServicesAdminNegativeV253TestJSON-1681880631 tempest-ServicesAdminNegativeV253TestJSON-1681880631-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '093033b3a5e44efab7a071013713dabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e7f15f388624cdbb7fcab8d1c5455c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:49.821284 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-999bc208-3e6b-4c60-a2d9-a1cdecfc8119 tempest-ServicesAdminNegativeV253TestJSON-1681880631 tempest-ServicesAdminNegativeV253TestJSON-1681880631-project] Request method failure captured: Jul 18 02:10:49.821284 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 18 02:10:49.821284 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:10:49.821284 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:10:49.821284 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:10:49.821284 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:10:49.821284 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:10:49.821284 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:10:49.821284 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:10:49.821284 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:10:49.821284 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MEnYYrx8rf16hRzi9X13RIuhpvCJhe7iX_VM5tSTflUE6OfZnkoOsdMOoFhVuXFwvvII_uJGoThIc8dZZGoUMCMRqdGtaXuMeW8ZHsT6EEsXRABhGUsn-Ya1LfwtDkTORcZ9kpxrAAxVN-HS2-lAgrrJ4zFnritgN-z-V-I5ijScq4 Jul 18 02:10:49.821284 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:10:49.821284 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:10:49.821284 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:10:49.821284 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:10:49.821284 n-d-465891-3 devstack@n-api.service[119543]: X-Openstack-Nova-Api-Version: 2.53 Jul 18 02:10:49.821284 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:10:49.821284 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:10:49.821284 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 3e7f15f388624cdbb7fcab8d1c5455c3 Jul 18 02:10:49.821284 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1681880631 Jul 18 02:10:49.821284 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:10:49.821284 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:10:49.824184 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3e7f15f388624cdbb7fcab8d1c5455c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3e7f15f388624cdbb7fcab8d1c5455c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3e7f15f388624cdbb7fcab8d1c5455c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3e7f15f388624cdbb7fcab8d1c5455c3"}]}] Jul 18 02:10:49.824184 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1681880631 Jul 18 02:10:49.824184 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 3e7f15f388624cdbb7fcab8d1c5455c3 Jul 18 02:10:49.824184 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1681880631 Jul 18 02:10:49.824184 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1681880631-project Jul 18 02:10:49.824184 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:10:49.824184 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:10:49.824184 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 093033b3a5e44efab7a071013713dabb Jul 18 02:10:49.824184 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1681880631-project Jul 18 02:10:49.824184 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:10:49.824184 n-d-465891-3 devstack@n-api.service[119543]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 18 02:10:49.824184 n-d-465891-3 devstack@n-api.service[119543]: action_args: {} Jul 18 02:10:49.825784 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:10:49.825784 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:10:49.825784 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:10:49.825784 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:10:49.825784 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:10:49.825784 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:10:49.825784 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:10:49.825784 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:10:49.825784 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:10:49.825784 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:10:49.825784 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:10:49.825784 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:10:49.825784 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 18 02:10:49.825784 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 18 02:10:49.825784 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:10:49.825784 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:10:49.825784 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:10:49.825784 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:10:49.825784 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:10:49.827990 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:10:49.827990 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:10:49.827990 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:10:49.827990 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:10:49.827990 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:10:49.827990 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:10:49.827990 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:10:49.827990 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:10:49.827990 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:10:49.827990 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 18 02:10:49.827990 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:10:49.827990 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:10:49.827990 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:10:49.827990 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:10:49.827990 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:10:49.827990 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:10:49.827990 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:10:49.827990 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:10:49.827990 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 18 02:10:49.827990 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:10:49.830940 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-999bc208-3e6b-4c60-a2d9-a1cdecfc8119 tempest-ServicesAdminNegativeV253TestJSON-1681880631 tempest-ServicesAdminNegativeV253TestJSON-1681880631-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:10:49.830940 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-999bc208-3e6b-4c60-a2d9-a1cdecfc8119 tempest-ServicesAdminNegativeV253TestJSON-1681880631 tempest-ServicesAdminNegativeV253TestJSON-1681880631-project] 10.222.0.57 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.132084 Jul 18 02:10:49.830940 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 415/839] 10.222.0.57 () {60 vars in 1177 bytes} [Mon Jul 18 02:10:49 2022] GET /compute/v2.1/os-services => generated 112 bytes in 133 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:10:49.976938 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6b535b40-8a19-4778-a1f3-8f08234a80cc tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:49.978560 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6b535b40-8a19-4778-a1f3-8f08234a80cc tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 5f8ec100-c407-4029-b30e-f863e75b4a17] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:49.997387 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6b535b40-8a19-4778-a1f3-8f08234a80cc tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:49.998803 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6b535b40-8a19-4778-a1f3-8f08234a80cc tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:50.001224 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6b535b40-8a19-4778-a1f3-8f08234a80cc tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:50.002684 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6b535b40-8a19-4778-a1f3-8f08234a80cc tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:50.077922 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-81bd614b-2af2-43fb-804b-aca7d55f4c6a tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6698374ee5c4bf18440a2f382db3c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d7b11fb5cd420cb8dbb16208bccf91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:50.099300 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-81bd614b-2af2-43fb-804b-aca7d55f4c6a tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] 10.222.0.57 "GET /compute/v2.1/servers/e5776c7b-6ae0-43da-a38f-b42e66c6596b" status: 200 len: 1467 microversion: 2.1 time: 0.309633 Jul 18 02:10:50.100746 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 425/840] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:49 2022] GET /compute/v2.1/servers/e5776c7b-6ae0-43da-a38f-b42e66c6596b => generated 1467 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:10:50.140391 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6b535b40-8a19-4778-a1f3-8f08234a80cc tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:50.155665 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6b535b40-8a19-4778-a1f3-8f08234a80cc tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/5f8ec100-c407-4029-b30e-f863e75b4a17" status: 200 len: 1277 microversion: 2.1 time: 0.184299 Jul 18 02:10:50.156628 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 416/841] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:49 2022] GET /compute/v2.1/servers/5f8ec100-c407-4029-b30e-f863e75b4a17 => generated 1277 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:50.174247 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f8c8ef0b-d61f-4ab4-88e9-c64a3fc5745f tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:50.175130 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f8c8ef0b-d61f-4ab4-88e9-c64a3fc5745f tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: 8c643d39-a6e1-41ec-a6f9-ffaf41421eb8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:50.184188 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f8c8ef0b-d61f-4ab4-88e9-c64a3fc5745f tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:50.184631 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f8c8ef0b-d61f-4ab4-88e9-c64a3fc5745f tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:50.185421 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f8c8ef0b-d61f-4ab4-88e9-c64a3fc5745f tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:50.185896 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f8c8ef0b-d61f-4ab4-88e9-c64a3fc5745f tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:50.332459 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e9e80a3a-6491-42da-b351-c5c41c4a5af3 tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1981237988", "block_migration": true, "disk_over_commit": false}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:50.334773 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e9e80a3a-6491-42da-b351-c5c41c4a5af3 tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] [instance: e5776c7b-6ae0-43da-a38f-b42e66c6596b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:50.343986 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e9e80a3a-6491-42da-b351-c5c41c4a5af3 tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:50.344557 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e9e80a3a-6491-42da-b351-c5c41c4a5af3 tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:50.345490 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e9e80a3a-6491-42da-b351-c5c41c4a5af3 tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:50.346082 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e9e80a3a-6491-42da-b351-c5c41c4a5af3 tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:50.362507 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f8c8ef0b-d61f-4ab4-88e9-c64a3fc5745f tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6962b97241f4c3a9960bb5fe52f8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8e996befd24b26b0371ad9cdb4a069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:50.376835 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f8c8ef0b-d61f-4ab4-88e9-c64a3fc5745f tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] 10.222.0.57 "GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8" status: 200 len: 1321 microversion: 2.1 time: 0.206834 Jul 18 02:10:50.378196 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 417/842] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:50 2022] GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8 => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:10:50.386987 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2a842d3a-1d53-4002-ae6c-585cd20be13d tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:50.388029 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2a842d3a-1d53-4002-ae6c-585cd20be13d tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:50.398702 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2a842d3a-1d53-4002-ae6c-585cd20be13d tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:50.399454 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2a842d3a-1d53-4002-ae6c-585cd20be13d tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:50.400723 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2a842d3a-1d53-4002-ae6c-585cd20be13d tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:50.402523 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2a842d3a-1d53-4002-ae6c-585cd20be13d tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:50.499850 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-e9e80a3a-6491-42da-b351-c5c41c4a5af3 tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] Lazy-loading 'flavor' on Instance uuid e5776c7b-6ae0-43da-a38f-b42e66c6596b {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:10:50.602183 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e9e80a3a-6491-42da-b351-c5c41c4a5af3 tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] [instance: e5776c7b-6ae0-43da-a38f-b42e66c6596b] Going to try to live migrate instance to tempest-host-1981237988 {{(pid=119544) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 18 02:10:50.613444 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-e9e80a3a-6491-42da-b351-c5c41c4a5af3 tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] HTTP exception thrown: Compute host tempest-host-1981237988 could not be found. Jul 18 02:10:50.618953 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e9e80a3a-6491-42da-b351-c5c41c4a5af3 tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] Request method failure captured: Jul 18 02:10:50.618953 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers/e5776c7b-6ae0-43da-a38f-b42e66c6596b/action HTTP/1.1 Jul 18 02:10:50.618953 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:10:50.618953 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:10:50.618953 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:10:50.618953 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 107 Jul 18 02:10:50.618953 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:10:50.618953 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:10:50.618953 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:10:50.618953 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:10:50.618953 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MEWobwXPX4Yvu3FA_Q8pjQEESmQLtEJ4m1IPcr9CLgkfivjVDx_hYp5YpPX8L3jGpJFshzwJrCmSMjDCWMGepqoZwg7TvNOR7A4NOODtNTclQab7KKACkTYxPo5mdF-zOtcXJuVlnQ2A1YBVoarNiR3joRoYgGHi9crwwPtQio-z4E Jul 18 02:10:50.618953 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:10:50.618953 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:10:50.618953 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:10:50.618953 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:10:50.618953 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:10:50.618953 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:10:50.618953 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: c005da9417c0410f9946e541e8c8252a Jul 18 02:10:50.618953 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-LiveMigrationNegativeTest-1887249387 Jul 18 02:10:50.618953 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,admin,reader Jul 18 02:10:50.618953 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,admin,reader Jul 18 02:10:50.622445 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c005da9417c0410f9946e541e8c8252a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c005da9417c0410f9946e541e8c8252a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c005da9417c0410f9946e541e8c8252a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c005da9417c0410f9946e541e8c8252a"}]}] Jul 18 02:10:50.622445 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-LiveMigrationNegativeTest-1887249387 Jul 18 02:10:50.622445 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: c005da9417c0410f9946e541e8c8252a Jul 18 02:10:50.622445 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1887249387 Jul 18 02:10:50.622445 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-LiveMigrationNegativeTest-1887249387-project-admin Jul 18 02:10:50.622445 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:10:50.622445 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:10:50.622445 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 1f83832452f6488689c894df62813e1b Jul 18 02:10:50.622445 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-LiveMigrationNegativeTest-1887249387-project-admin Jul 18 02:10:50.622445 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:10:50.622445 n-d-465891-3 devstack@n-api.service[119544]: {"os-migrateLive": {"host": "tempest-host-1981237988", "block_migration": true, "disk_over_commit": false}} Jul 18 02:10:50.622445 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:10:50.624020 n-d-465891-3 devstack@n-api.service[119544]: exception: Compute host tempest-host-1981237988 could not be found. Jul 18 02:10:50.624020 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'e5776c7b-6ae0-43da-a38f-b42e66c6596b', 'body': {'os-migrateLive': {'host': 'tempest-host-1981237988', 'block_migration': True, 'disk_over_commit': False}}} Jul 18 02:10:50.624020 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:10:50.624020 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:10:50.624020 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 18 02:10:50.624020 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 18 02:10:50.624020 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 18 02:10:50.624020 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 02:10:50.624020 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 18 02:10:50.624020 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 02:10:50.624020 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 18 02:10:50.624020 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 02:10:50.624020 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 18 02:10:50.624020 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 02:10:50.624020 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 18 02:10:50.624020 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 02:10:50.624020 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 18 02:10:50.624020 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 02:10:50.624020 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 02:10:50.626383 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 02:10:50.626383 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 02:10:50.626383 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 02:10:50.626383 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5355, in live_migrate Jul 18 02:10:50.626383 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Jul 18 02:10:50.626383 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:10:50.626383 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:10:50.626383 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Jul 18 02:10:50.626383 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Jul 18 02:10:50.626383 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Jul 18 02:10:50.626383 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:10:50.626383 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Jul 18 02:10:50.626383 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Jul 18 02:10:50.626383 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Jul 18 02:10:50.626383 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Jul 18 02:10:50.626383 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Jul 18 02:10:50.626383 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Jul 18 02:10:50.626383 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1981237988 could not be found. Jul 18 02:10:50.626383 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:10:50.628720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:10:50.628720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:10:50.628720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:10:50.628720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:10:50.628720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:10:50.628720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:10:50.628720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:10:50.628720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:10:50.628720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:10:50.628720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:10:50.628720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:10:50.628720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:10:50.628720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:10:50.628720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:10:50.628720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:10:50.628720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 18 02:10:50.628720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Jul 18 02:10:50.628720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 02:10:50.628720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1981237988 could not be found. Jul 18 02:10:50.628720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:10:50.631387 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:10:50.631387 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:10:50.631387 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:10:50.631387 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:10:50.631387 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:10:50.631387 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:10:50.631387 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:10:50.631387 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1981237988 could not be found. Jul 18 02:10:50.631387 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:10:50.631387 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e9e80a3a-6491-42da-b351-c5c41c4a5af3 tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] Returning 400 to user: Compute host tempest-host-1981237988 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:10:50.631387 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e9e80a3a-6491-42da-b351-c5c41c4a5af3 tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/e5776c7b-6ae0-43da-a38f-b42e66c6596b/action" status: 400 len: 100 microversion: 2.1 time: 0.502103 Jul 18 02:10:50.631387 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 426/843] 10.222.0.57 () {60 vars in 1278 bytes} [Mon Jul 18 02:10:50 2022] POST /compute/v2.1/servers/e5776c7b-6ae0-43da-a38f-b42e66c6596b/action => generated 100 bytes in 504 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 18 02:10:50.632853 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ea1570e8-0304-41d2-878e-872281f8b48f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:50.632853 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ea1570e8-0304-41d2-878e-872281f8b48f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:50.637541 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea1570e8-0304-41d2-878e-872281f8b48f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:50.638286 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea1570e8-0304-41d2-878e-872281f8b48f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:50.638954 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea1570e8-0304-41d2-878e-872281f8b48f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:50.639485 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea1570e8-0304-41d2-878e-872281f8b48f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:50.749579 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2a842d3a-1d53-4002-ae6c-585cd20be13d tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:50.778639 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2a842d3a-1d53-4002-ae6c-585cd20be13d tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1472 microversion: 2.1 time: 0.398595 Jul 18 02:10:50.794324 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 418/844] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:50 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1472 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:50.805351 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e9fe3f64-83d9-4dba-87a7-0abe915e9878 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:50.807747 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e9fe3f64-83d9-4dba-87a7-0abe915e9878 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] [instance: e5776c7b-6ae0-43da-a38f-b42e66c6596b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:50.818899 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e9fe3f64-83d9-4dba-87a7-0abe915e9878 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:50.820140 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e9fe3f64-83d9-4dba-87a7-0abe915e9878 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:50.821816 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e9fe3f64-83d9-4dba-87a7-0abe915e9878 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:50.822923 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e9fe3f64-83d9-4dba-87a7-0abe915e9878 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:51.163025 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ea1570e8-0304-41d2-878e-872281f8b48f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:51.184289 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ea1570e8-0304-41d2-878e-872281f8b48f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 200 len: 1504 microversion: 2.1 time: 0.558542 Jul 18 02:10:51.185655 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 427/845] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:50 2022] GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 1504 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:51.200754 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3180f642-30d3-4675-b212-e6d75348b5c1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:51.202189 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3180f642-30d3-4675-b212-e6d75348b5c1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 25dfb6dd-6d5a-4399-a348-0a162ca907ef] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:51.212999 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3180f642-30d3-4675-b212-e6d75348b5c1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:51.215375 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3180f642-30d3-4675-b212-e6d75348b5c1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:51.216472 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3180f642-30d3-4675-b212-e6d75348b5c1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:51.217054 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3180f642-30d3-4675-b212-e6d75348b5c1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:51.286583 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e9fe3f64-83d9-4dba-87a7-0abe915e9878 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6698374ee5c4bf18440a2f382db3c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d7b11fb5cd420cb8dbb16208bccf91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:51.307255 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e9fe3f64-83d9-4dba-87a7-0abe915e9878 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] 10.222.0.57 "GET /compute/v2.1/servers/e5776c7b-6ae0-43da-a38f-b42e66c6596b" status: 200 len: 1467 microversion: 2.1 time: 0.509888 Jul 18 02:10:51.310161 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 419/846] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:50 2022] GET /compute/v2.1/servers/e5776c7b-6ae0-43da-a38f-b42e66c6596b => generated 1467 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:51.320540 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2c9cd444-19ee-4d86-bdad-c34aafd2a352 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:51.322137 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2c9cd444-19ee-4d86-bdad-c34aafd2a352 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 5f8ec100-c407-4029-b30e-f863e75b4a17] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:51.343867 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2c9cd444-19ee-4d86-bdad-c34aafd2a352 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:51.345196 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2c9cd444-19ee-4d86-bdad-c34aafd2a352 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:51.347376 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2c9cd444-19ee-4d86-bdad-c34aafd2a352 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:51.348405 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2c9cd444-19ee-4d86-bdad-c34aafd2a352 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:51.550291 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2c9cd444-19ee-4d86-bdad-c34aafd2a352 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:51.571209 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2c9cd444-19ee-4d86-bdad-c34aafd2a352 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/5f8ec100-c407-4029-b30e-f863e75b4a17" status: 200 len: 1283 microversion: 2.1 time: 0.258887 Jul 18 02:10:51.572637 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 420/847] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:51 2022] GET /compute/v2.1/servers/5f8ec100-c407-4029-b30e-f863e75b4a17 => generated 1283 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:51.602351 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a35e2126-70cb-49a0-8cd3-b53a6cdf5d7f tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:51.603787 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a35e2126-70cb-49a0-8cd3-b53a6cdf5d7f tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: 8c643d39-a6e1-41ec-a6f9-ffaf41421eb8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:51.620082 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a35e2126-70cb-49a0-8cd3-b53a6cdf5d7f tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:51.621073 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a35e2126-70cb-49a0-8cd3-b53a6cdf5d7f tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:51.622669 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a35e2126-70cb-49a0-8cd3-b53a6cdf5d7f tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:51.623793 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a35e2126-70cb-49a0-8cd3-b53a6cdf5d7f tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:51.652895 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3180f642-30d3-4675-b212-e6d75348b5c1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:51.668956 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3180f642-30d3-4675-b212-e6d75348b5c1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef" status: 200 len: 1498 microversion: 2.1 time: 0.480812 Jul 18 02:10:51.681793 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 428/848] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:51 2022] GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef => generated 1498 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:51.681793 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-6063302a-b62b-42b1-b530-d77710245965 req-9b2e255a-1951-4313-b10a-bbcacfbce75a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c643d39-a6e1-41ec-a6f9-ffaf41421eb8", "name": "network-vif-plugged", "status": "completed", "tag": "8715c030-4b8f-4b95-919f-e51fec1c48ce"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:51.692878 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-6063302a-b62b-42b1-b530-d77710245965 req-9b2e255a-1951-4313-b10a-bbcacfbce75a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:51.693600 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-6063302a-b62b-42b1-b530-d77710245965 req-9b2e255a-1951-4313-b10a-bbcacfbce75a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:51.718310 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-6063302a-b62b-42b1-b530-d77710245965 req-9b2e255a-1951-4313-b10a-bbcacfbce75a service nova] Creating event network-vif-plugged:8715c030-4b8f-4b95-919f-e51fec1c48ce for instance 8c643d39-a6e1-41ec-a6f9-ffaf41421eb8 on n-h1-465891-3 Jul 18 02:10:51.725756 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-6063302a-b62b-42b1-b530-d77710245965 req-9b2e255a-1951-4313-b10a-bbcacfbce75a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053637 Jul 18 02:10:51.726893 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 429/849] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:10:51.738400 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1fd070e2-5a57-43ab-91ff-1d3640199b28 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-261014951", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:51.827343 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-1fd070e2-5a57-43ab-91ff-1d3640199b28 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] validate_networks() for None {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:10:51.909354 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a35e2126-70cb-49a0-8cd3-b53a6cdf5d7f tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6962b97241f4c3a9960bb5fe52f8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8e996befd24b26b0371ad9cdb4a069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:51.928675 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a35e2126-70cb-49a0-8cd3-b53a6cdf5d7f tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] 10.222.0.57 "GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8" status: 200 len: 1321 microversion: 2.1 time: 0.340667 Jul 18 02:10:51.929658 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 421/850] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:51 2022] GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8 => generated 1321 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:51.939453 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f46892f4-c20d-40a6-95bb-07af57b679cb tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:51.940986 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f46892f4-c20d-40a6-95bb-07af57b679cb tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:51.952973 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f46892f4-c20d-40a6-95bb-07af57b679cb tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:51.954555 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f46892f4-c20d-40a6-95bb-07af57b679cb tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:51.956294 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f46892f4-c20d-40a6-95bb-07af57b679cb tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:51.957205 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f46892f4-c20d-40a6-95bb-07af57b679cb tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:52.341899 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-1fd070e2-5a57-43ab-91ff-1d3640199b28 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:10:52.343056 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-1fd070e2-5a57-43ab-91ff-1d3640199b28 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:10:52.343925 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-1fd070e2-5a57-43ab-91ff-1d3640199b28 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:10:52.344895 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-1fd070e2-5a57-43ab-91ff-1d3640199b28 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:10:52.345653 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-1fd070e2-5a57-43ab-91ff-1d3640199b28 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:10:52.365097 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1fd070e2-5a57-43ab-91ff-1d3640199b28 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:52.366219 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1fd070e2-5a57-43ab-91ff-1d3640199b28 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:52.367910 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1fd070e2-5a57-43ab-91ff-1d3640199b28 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:52.368949 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1fd070e2-5a57-43ab-91ff-1d3640199b28 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:52.406598 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-1fd070e2-5a57-43ab-91ff-1d3640199b28 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Getting quotas for project 66d7b11fb5cd420cb8dbb16208bccf91. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:10:52.419505 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-1fd070e2-5a57-43ab-91ff-1d3640199b28 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Getting quotas for user c6698374ee5c4bf18440a2f382db3c37 and project 66d7b11fb5cd420cb8dbb16208bccf91. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:10:52.438380 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f46892f4-c20d-40a6-95bb-07af57b679cb tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:52.449577 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1fd070e2-5a57-43ab-91ff-1d3640199b28 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:10:52.455156 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1fd070e2-5a57-43ab-91ff-1d3640199b28 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] [instance: db3bcfcf-48cd-4f31-8adc-aee5c3e03184] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:10:52.464434 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f46892f4-c20d-40a6-95bb-07af57b679cb tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1478 microversion: 2.1 time: 0.532175 Jul 18 02:10:52.466836 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 422/851] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:51 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1478 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:52.485364 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c1cec05a-7d47-4d91-a184-6d267cc32774 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:52.487172 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c1cec05a-7d47-4d91-a184-6d267cc32774 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:52.508597 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c1cec05a-7d47-4d91-a184-6d267cc32774 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:52.509310 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c1cec05a-7d47-4d91-a184-6d267cc32774 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:52.513130 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c1cec05a-7d47-4d91-a184-6d267cc32774 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:52.516016 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c1cec05a-7d47-4d91-a184-6d267cc32774 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:52.591121 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1fd070e2-5a57-43ab-91ff-1d3640199b28 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.861365 Jul 18 02:10:52.593774 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 430/852] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:10:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:10:52.609195 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2dea9858-7fdd-42fd-b47d-d5ae7f59e96f tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:52.610870 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2dea9858-7fdd-42fd-b47d-d5ae7f59e96f tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 5f8ec100-c407-4029-b30e-f863e75b4a17] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:52.618700 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:10:52.630205 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2dea9858-7fdd-42fd-b47d-d5ae7f59e96f tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:52.630775 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2dea9858-7fdd-42fd-b47d-d5ae7f59e96f tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:52.632146 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2dea9858-7fdd-42fd-b47d-d5ae7f59e96f tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:52.633129 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2dea9858-7fdd-42fd-b47d-d5ae7f59e96f tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:52.815948 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2dea9858-7fdd-42fd-b47d-d5ae7f59e96f tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:52.852902 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2dea9858-7fdd-42fd-b47d-d5ae7f59e96f tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/5f8ec100-c407-4029-b30e-f863e75b4a17" status: 200 len: 1283 microversion: 2.1 time: 0.253757 Jul 18 02:10:52.868893 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 431/853] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:52 2022] GET /compute/v2.1/servers/5f8ec100-c407-4029-b30e-f863e75b4a17 => generated 1283 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:52.884811 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2d225870-e323-45fc-9b38-d25d3fa4a98d tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:52.886111 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2d225870-e323-45fc-9b38-d25d3fa4a98d tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] [instance: db3bcfcf-48cd-4f31-8adc-aee5c3e03184] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:53.004376 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c1cec05a-7d47-4d91-a184-6d267cc32774 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:53.006333 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2d225870-e323-45fc-9b38-d25d3fa4a98d tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6698374ee5c4bf18440a2f382db3c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d7b11fb5cd420cb8dbb16208bccf91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:53.019003 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c1cec05a-7d47-4d91-a184-6d267cc32774 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 200 len: 1504 microversion: 2.1 time: 0.549356 Jul 18 02:10:53.019611 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 423/854] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:52 2022] GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 1504 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:53.041461 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ad02c9ec-470f-4844-8487-c8cef8a185fa tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:53.042443 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ad02c9ec-470f-4844-8487-c8cef8a185fa tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 25dfb6dd-6d5a-4399-a348-0a162ca907ef] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:53.046638 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2d225870-e323-45fc-9b38-d25d3fa4a98d tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] 10.222.0.57 "GET /compute/v2.1/servers/db3bcfcf-48cd-4f31-8adc-aee5c3e03184" status: 200 len: 1218 microversion: 2.1 time: 0.188151 Jul 18 02:10:53.050953 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 432/855] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:52 2022] GET /compute/v2.1/servers/db3bcfcf-48cd-4f31-8adc-aee5c3e03184 => generated 1218 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:53.062253 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ad02c9ec-470f-4844-8487-c8cef8a185fa tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:53.062832 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ad02c9ec-470f-4844-8487-c8cef8a185fa tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:53.063703 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ad02c9ec-470f-4844-8487-c8cef8a185fa tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:53.064150 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ad02c9ec-470f-4844-8487-c8cef8a185fa tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:53.071651 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5661e44c-681f-45d3-a6a5-8a57d94a77ef tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:53.072773 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5661e44c-681f-45d3-a6a5-8a57d94a77ef tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: 8c643d39-a6e1-41ec-a6f9-ffaf41421eb8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:53.091723 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5661e44c-681f-45d3-a6a5-8a57d94a77ef tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:53.093096 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5661e44c-681f-45d3-a6a5-8a57d94a77ef tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:53.099079 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5661e44c-681f-45d3-a6a5-8a57d94a77ef tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:53.100689 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5661e44c-681f-45d3-a6a5-8a57d94a77ef tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:53.671064 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5661e44c-681f-45d3-a6a5-8a57d94a77ef tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6962b97241f4c3a9960bb5fe52f8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8e996befd24b26b0371ad9cdb4a069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:53.698264 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5661e44c-681f-45d3-a6a5-8a57d94a77ef tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] 10.222.0.57 "GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8" status: 200 len: 1321 microversion: 2.1 time: 0.640573 Jul 18 02:10:53.705726 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 433/856] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:53 2022] GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8 => generated 1321 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:53.720168 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cb47b742-d6aa-41d6-856e-404944bc78fe tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:53.721974 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cb47b742-d6aa-41d6-856e-404944bc78fe tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:53.734864 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ad02c9ec-470f-4844-8487-c8cef8a185fa tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:53.743347 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ad02c9ec-470f-4844-8487-c8cef8a185fa tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef" status: 200 len: 1498 microversion: 2.1 time: 0.722417 Jul 18 02:10:53.744890 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cb47b742-d6aa-41d6-856e-404944bc78fe tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:53.748438 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cb47b742-d6aa-41d6-856e-404944bc78fe tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:53.750346 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cb47b742-d6aa-41d6-856e-404944bc78fe tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:53.751278 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cb47b742-d6aa-41d6-856e-404944bc78fe tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:53.754309 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 424/857] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:53 2022] GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef => generated 1498 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:53.876806 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d4591645-0ad0-4be2-82da-ebf49798893e tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:53.878561 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d4591645-0ad0-4be2-82da-ebf49798893e tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 5f8ec100-c407-4029-b30e-f863e75b4a17] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:53.891119 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d4591645-0ad0-4be2-82da-ebf49798893e tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:53.891923 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d4591645-0ad0-4be2-82da-ebf49798893e tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:53.892969 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d4591645-0ad0-4be2-82da-ebf49798893e tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:53.898008 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d4591645-0ad0-4be2-82da-ebf49798893e tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:53.911390 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:10:54.375316 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-cb47b742-d6aa-41d6-856e-404944bc78fe tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:54.387412 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cb47b742-d6aa-41d6-856e-404944bc78fe tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1478 microversion: 2.1 time: 0.679785 Jul 18 02:10:54.388324 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 434/858] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:53 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1478 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:54.401617 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7cd5219e-ff23-40ce-8111-927fa47e75d5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:54.401978 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7cd5219e-ff23-40ce-8111-927fa47e75d5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:54.413744 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7cd5219e-ff23-40ce-8111-927fa47e75d5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:54.414194 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7cd5219e-ff23-40ce-8111-927fa47e75d5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:54.415622 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7cd5219e-ff23-40ce-8111-927fa47e75d5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:54.416075 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7cd5219e-ff23-40ce-8111-927fa47e75d5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:54.549153 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d4591645-0ad0-4be2-82da-ebf49798893e tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:54.564102 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d4591645-0ad0-4be2-82da-ebf49798893e tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/5f8ec100-c407-4029-b30e-f863e75b4a17" status: 200 len: 1325 microversion: 2.1 time: 0.687235 Jul 18 02:10:54.564470 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 425/859] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:53 2022] GET /compute/v2.1/servers/5f8ec100-c407-4029-b30e-f863e75b4a17 => generated 1325 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:54.579448 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-aee08870-6351-4952-a813-4c4c2bc7a7bb tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:54.580069 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-aee08870-6351-4952-a813-4c4c2bc7a7bb tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] [instance: db3bcfcf-48cd-4f31-8adc-aee5c3e03184] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:54.612240 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aee08870-6351-4952-a813-4c4c2bc7a7bb tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:54.613158 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aee08870-6351-4952-a813-4c4c2bc7a7bb tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:54.614298 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aee08870-6351-4952-a813-4c4c2bc7a7bb tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:54.615468 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aee08870-6351-4952-a813-4c4c2bc7a7bb tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:54.807724 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-aee08870-6351-4952-a813-4c4c2bc7a7bb tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6698374ee5c4bf18440a2f382db3c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d7b11fb5cd420cb8dbb16208bccf91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:54.826062 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-aee08870-6351-4952-a813-4c4c2bc7a7bb tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] 10.222.0.57 "GET /compute/v2.1/servers/db3bcfcf-48cd-4f31-8adc-aee5c3e03184" status: 200 len: 1270 microversion: 2.1 time: 0.241745 Jul 18 02:10:54.827097 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 426/860] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:54 2022] GET /compute/v2.1/servers/db3bcfcf-48cd-4f31-8adc-aee5c3e03184 => generated 1270 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:54.832045 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-ef3312eb-655e-47a3-bbbd-645d8d8c0171 req-a8999083-3bd8-49c2-822c-280d93c6f14f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f8ec100-c407-4029-b30e-f863e75b4a17", "tag": "c8ff716f-542d-47a0-8b54-f64ce60095ce"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:54.852180 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-ef3312eb-655e-47a3-bbbd-645d8d8c0171 req-a8999083-3bd8-49c2-822c-280d93c6f14f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:54.852860 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-ef3312eb-655e-47a3-bbbd-645d8d8c0171 req-a8999083-3bd8-49c2-822c-280d93c6f14f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:54.887187 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-ef3312eb-655e-47a3-bbbd-645d8d8c0171 req-a8999083-3bd8-49c2-822c-280d93c6f14f service nova] Creating event network-changed:c8ff716f-542d-47a0-8b54-f64ce60095ce for instance 5f8ec100-c407-4029-b30e-f863e75b4a17 on n-h2-465891-3 Jul 18 02:10:54.895630 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-ef3312eb-655e-47a3-bbbd-645d8d8c0171 req-a8999083-3bd8-49c2-822c-280d93c6f14f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067184 Jul 18 02:10:54.896414 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 427/861] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:10:54.907440 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7cd5219e-ff23-40ce-8111-927fa47e75d5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:54.920454 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ff22d9ae-d75a-48ed-b0b3-62bfd8e06432 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:54.927411 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7cd5219e-ff23-40ce-8111-927fa47e75d5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 200 len: 1504 microversion: 2.1 time: 0.537428 Jul 18 02:10:54.937039 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 435/862] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:54 2022] GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 1504 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:54.938689 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ff22d9ae-d75a-48ed-b0b3-62bfd8e06432 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: 8c643d39-a6e1-41ec-a6f9-ffaf41421eb8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:54.942215 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:10:54.961072 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ff22d9ae-d75a-48ed-b0b3-62bfd8e06432 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:54.961917 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ff22d9ae-d75a-48ed-b0b3-62bfd8e06432 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:54.963041 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ff22d9ae-d75a-48ed-b0b3-62bfd8e06432 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:54.963829 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ff22d9ae-d75a-48ed-b0b3-62bfd8e06432 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:54.973729 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8e8a75fa-bec0-45e3-acfe-d1e3dfd0f528 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:54.981207 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8e8a75fa-bec0-45e3-acfe-d1e3dfd0f528 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 25dfb6dd-6d5a-4399-a348-0a162ca907ef] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:55.007397 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8e8a75fa-bec0-45e3-acfe-d1e3dfd0f528 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:55.008546 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8e8a75fa-bec0-45e3-acfe-d1e3dfd0f528 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:55.010180 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8e8a75fa-bec0-45e3-acfe-d1e3dfd0f528 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:55.011239 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8e8a75fa-bec0-45e3-acfe-d1e3dfd0f528 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:55.463348 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8e8a75fa-bec0-45e3-acfe-d1e3dfd0f528 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:55.477056 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8e8a75fa-bec0-45e3-acfe-d1e3dfd0f528 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef" status: 200 len: 1498 microversion: 2.1 time: 0.543262 Jul 18 02:10:55.478013 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 436/863] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:54 2022] GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef => generated 1498 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:55.495458 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-0181fd42-6f9d-4dae-a26d-6208e0f41ff6 req-60d654fd-88df-45ee-a99d-9a0dfe3aeae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "092e9dd7-8734-42ae-9ad7-626438550736", "name": "network-vif-unplugged", "status": "completed", "tag": "5653c487-e512-475c-8f13-aa4ee05e2542"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:55.517381 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-0181fd42-6f9d-4dae-a26d-6208e0f41ff6 req-60d654fd-88df-45ee-a99d-9a0dfe3aeae2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:55.518282 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-0181fd42-6f9d-4dae-a26d-6208e0f41ff6 req-60d654fd-88df-45ee-a99d-9a0dfe3aeae2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:55.537672 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-0181fd42-6f9d-4dae-a26d-6208e0f41ff6 req-60d654fd-88df-45ee-a99d-9a0dfe3aeae2 service nova] Creating event network-vif-unplugged:5653c487-e512-475c-8f13-aa4ee05e2542 for instance 092e9dd7-8734-42ae-9ad7-626438550736 on n-h2-465891-3 Jul 18 02:10:55.544893 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-0181fd42-6f9d-4dae-a26d-6208e0f41ff6 req-60d654fd-88df-45ee-a99d-9a0dfe3aeae2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063572 Jul 18 02:10:55.545608 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 437/864] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:10:55.553366 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5f449335-c42e-49d3-8c62-dd700628ac12 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:55.554782 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5f449335-c42e-49d3-8c62-dd700628ac12 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:55.563991 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5f449335-c42e-49d3-8c62-dd700628ac12 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:55.564754 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5f449335-c42e-49d3-8c62-dd700628ac12 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:55.565664 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5f449335-c42e-49d3-8c62-dd700628ac12 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:55.566463 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5f449335-c42e-49d3-8c62-dd700628ac12 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:55.648121 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ff22d9ae-d75a-48ed-b0b3-62bfd8e06432 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6962b97241f4c3a9960bb5fe52f8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8e996befd24b26b0371ad9cdb4a069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:55.670156 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ff22d9ae-d75a-48ed-b0b3-62bfd8e06432 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] 10.222.0.57 "GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8" status: 200 len: 1471 microversion: 2.1 time: 0.771667 Jul 18 02:10:55.672791 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 428/865] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:54 2022] GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8 => generated 1471 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:55.682367 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-56ca1f75-e72f-4c20-9bc4-da9eec13c4dc tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:55.685107 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-56ca1f75-e72f-4c20-9bc4-da9eec13c4dc tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 5f8ec100-c407-4029-b30e-f863e75b4a17] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:55.708353 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56ca1f75-e72f-4c20-9bc4-da9eec13c4dc tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:55.715259 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56ca1f75-e72f-4c20-9bc4-da9eec13c4dc tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:55.718280 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56ca1f75-e72f-4c20-9bc4-da9eec13c4dc tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:55.720109 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56ca1f75-e72f-4c20-9bc4-da9eec13c4dc tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:56.091245 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5f449335-c42e-49d3-8c62-dd700628ac12 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:56.101841 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5f449335-c42e-49d3-8c62-dd700628ac12 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1478 microversion: 2.1 time: 0.554749 Jul 18 02:10:56.105900 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 438/866] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:55 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1478 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:56.116124 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-1e194593-9753-47ee-bfed-3b0d766fa5c6 req-66cf44aa-f7b3-46a4-bed0-26337231fb21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22002049-4347-47d8-a5a2-6d3f31ec8927", "name": "network-vif-unplugged", "status": "completed", "tag": "83756a9c-0161-44d8-b50b-8a364a6fcada"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:56.152404 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-56ca1f75-e72f-4c20-9bc4-da9eec13c4dc tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:56.155531 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-1e194593-9753-47ee-bfed-3b0d766fa5c6 req-66cf44aa-f7b3-46a4-bed0-26337231fb21 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:56.156724 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-1e194593-9753-47ee-bfed-3b0d766fa5c6 req-66cf44aa-f7b3-46a4-bed0-26337231fb21 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:56.163570 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-56ca1f75-e72f-4c20-9bc4-da9eec13c4dc tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/5f8ec100-c407-4029-b30e-f863e75b4a17" status: 200 len: 1325 microversion: 2.1 time: 0.486949 Jul 18 02:10:56.164382 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 429/867] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:55 2022] GET /compute/v2.1/servers/5f8ec100-c407-4029-b30e-f863e75b4a17 => generated 1325 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:56.207952 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-1e194593-9753-47ee-bfed-3b0d766fa5c6 req-66cf44aa-f7b3-46a4-bed0-26337231fb21 service nova] Creating event network-vif-unplugged:83756a9c-0161-44d8-b50b-8a364a6fcada for instance 22002049-4347-47d8-a5a2-6d3f31ec8927 on n-h1-465891-3 Jul 18 02:10:56.218434 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-1e194593-9753-47ee-bfed-3b0d766fa5c6 req-66cf44aa-f7b3-46a4-bed0-26337231fb21 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109824 Jul 18 02:10:56.219922 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 439/868] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:10:56.231323 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7295c177-32ad-4ebf-a4a2-83f7c2aab2cc tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:56.232415 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7295c177-32ad-4ebf-a4a2-83f7c2aab2cc tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] [instance: db3bcfcf-48cd-4f31-8adc-aee5c3e03184] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:56.246109 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7295c177-32ad-4ebf-a4a2-83f7c2aab2cc tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:56.246348 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7295c177-32ad-4ebf-a4a2-83f7c2aab2cc tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:56.247526 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7295c177-32ad-4ebf-a4a2-83f7c2aab2cc tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:56.257987 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7295c177-32ad-4ebf-a4a2-83f7c2aab2cc tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:56.585152 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7295c177-32ad-4ebf-a4a2-83f7c2aab2cc tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6698374ee5c4bf18440a2f382db3c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d7b11fb5cd420cb8dbb16208bccf91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:56.599186 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7295c177-32ad-4ebf-a4a2-83f7c2aab2cc tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] 10.222.0.57 "GET /compute/v2.1/servers/db3bcfcf-48cd-4f31-8adc-aee5c3e03184" status: 200 len: 1318 microversion: 2.1 time: 0.377235 Jul 18 02:10:56.600722 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 440/869] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:56 2022] GET /compute/v2.1/servers/db3bcfcf-48cd-4f31-8adc-aee5c3e03184 => generated 1318 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:56.607618 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7b35e74d-5079-45f4-ba0b-23adc0692b13 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:56.609528 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7b35e74d-5079-45f4-ba0b-23adc0692b13 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:56.628048 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7b35e74d-5079-45f4-ba0b-23adc0692b13 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:56.628944 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7b35e74d-5079-45f4-ba0b-23adc0692b13 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:56.630082 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7b35e74d-5079-45f4-ba0b-23adc0692b13 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:56.630943 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7b35e74d-5079-45f4-ba0b-23adc0692b13 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:56.761417 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3eb90772-2f67-4cd8-a3fb-d0829109cd39 tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:56.762420 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3eb90772-2f67-4cd8-a3fb-d0829109cd39 tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] [instance: 7254cf9f-525d-4a05-86b9-923ff2dc0fe7] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:56.773639 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-3eb90772-2f67-4cd8-a3fb-d0829109cd39 tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] HTTP exception thrown: Instance 7254cf9f-525d-4a05-86b9-923ff2dc0fe7 could not be found. Jul 18 02:10:56.776010 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3eb90772-2f67-4cd8-a3fb-d0829109cd39 tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] Request method failure captured: Jul 18 02:10:56.776010 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/servers/7254cf9f-525d-4a05-86b9-923ff2dc0fe7/action HTTP/1.1 Jul 18 02:10:56.776010 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:10:56.776010 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:10:56.776010 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:10:56.776010 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 15 Jul 18 02:10:56.776010 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:10:56.776010 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:10:56.776010 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:10:56.776010 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:10:56.776010 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MESFSMtePNL8GJf_VyMJPXhAx7y0IB0ZqXqObzdaZvbuflGpBBtq8vNjrIah9tPhaEp_76Fy2h-bZrLnckapqRCES7vHy1PJ9Om0frNRlMw-kb9dg6Dl8eYrr7DMOYtcj7F0YEupI2z-cIL72tlkQx-uIR0utT2YtCYya29hc8O_H8 Jul 18 02:10:56.776010 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:10:56.776010 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:10:56.776010 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:10:56.776010 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:10:56.776010 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:10:56.776010 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:10:56.776010 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 91b5c4b0af774fba9df99f55cfefbb85 Jul 18 02:10:56.776010 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1407282334 Jul 18 02:10:56.776010 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,admin,reader Jul 18 02:10:56.776010 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,admin,reader Jul 18 02:10:56.777344 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_91b5c4b0af774fba9df99f55cfefbb85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/91b5c4b0af774fba9df99f55cfefbb85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/91b5c4b0af774fba9df99f55cfefbb85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/91b5c4b0af774fba9df99f55cfefbb85"}]}] Jul 18 02:10:56.777344 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1407282334 Jul 18 02:10:56.777344 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 91b5c4b0af774fba9df99f55cfefbb85 Jul 18 02:10:56.777344 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1407282334 Jul 18 02:10:56.777344 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersAdminNegativeTestJSON-1407282334-project-admin Jul 18 02:10:56.777344 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:10:56.777344 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:10:56.777344 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 09f9d545b58f49daafec8939ba21725c Jul 18 02:10:56.777344 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1407282334-project-admin Jul 18 02:10:56.777344 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 02:10:56.777344 n-d-465891-3 devstack@n-api.service[119543]: {"migrate": {}} Jul 18 02:10:56.777344 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:10:56.777344 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 7254cf9f-525d-4a05-86b9-923ff2dc0fe7 could not be found. Jul 18 02:10:56.778194 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '7254cf9f-525d-4a05-86b9-923ff2dc0fe7', 'body': {'migrate': {}}} Jul 18 02:10:56.778194 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:10:56.778194 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:10:56.778194 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:10:56.778194 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:10:56.778194 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:10:56.778194 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:10:56.778194 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 02:10:56.778194 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 02:10:56.778194 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7254cf9f-525d-4a05-86b9-923ff2dc0fe7 could not be found. Jul 18 02:10:56.778194 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:10:56.778194 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:10:56.778194 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:10:56.778194 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:10:56.778194 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:10:56.778194 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:10:56.778194 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:10:56.778194 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:10:56.778194 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:10:56.778194 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:10:56.779343 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:10:56.779343 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:10:56.779343 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Jul 18 02:10:56.779343 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Jul 18 02:10:56.779343 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:10:56.779343 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:10:56.779343 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7254cf9f-525d-4a05-86b9-923ff2dc0fe7 could not be found. Jul 18 02:10:56.779343 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:10:56.779343 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:10:56.779343 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:10:56.779343 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:10:56.779343 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:10:56.779343 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:10:56.779343 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:10:56.779343 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:10:56.779343 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7254cf9f-525d-4a05-86b9-923ff2dc0fe7 could not be found. Jul 18 02:10:56.779343 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:10:56.782627 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3eb90772-2f67-4cd8-a3fb-d0829109cd39 tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] Returning 404 to user: Instance 7254cf9f-525d-4a05-86b9-923ff2dc0fe7 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:10:56.783722 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3eb90772-2f67-4cd8-a3fb-d0829109cd39 tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/7254cf9f-525d-4a05-86b9-923ff2dc0fe7/action" status: 404 len: 111 microversion: 2.1 time: 0.616576 Jul 18 02:10:56.784548 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 430/870] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:10:56 2022] POST /compute/v2.1/servers/7254cf9f-525d-4a05-86b9-923ff2dc0fe7/action => generated 111 bytes in 618 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:10:56.829575 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7b35e74d-5079-45f4-ba0b-23adc0692b13 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:56.878272 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7b35e74d-5079-45f4-ba0b-23adc0692b13 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 200 len: 1504 microversion: 2.1 time: 0.276113 Jul 18 02:10:56.887994 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 441/871] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:56 2022] GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 1504 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:56.902777 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-22b22dc6-a97c-4ba2-b8d3-4d52c1642ef8 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:56.903666 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-22b22dc6-a97c-4ba2-b8d3-4d52c1642ef8 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 25dfb6dd-6d5a-4399-a348-0a162ca907ef] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:56.911896 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-22b22dc6-a97c-4ba2-b8d3-4d52c1642ef8 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:56.912708 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-22b22dc6-a97c-4ba2-b8d3-4d52c1642ef8 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:56.915243 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-22b22dc6-a97c-4ba2-b8d3-4d52c1642ef8 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:56.916099 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-22b22dc6-a97c-4ba2-b8d3-4d52c1642ef8 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:56.976121 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c65b205f-928a-440e-bd97-220ad8c01608 tempest-TenantUsagesNegativeTestJSON-1066294623 tempest-TenantUsagesNegativeTestJSON-1066294623-project-admin] 10.222.0.57 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-17T02%3A10%3A56.202236&end=2022-07-19T02%3A10%3A56.202236" status: 404 len: 112 microversion: - time: 0.186442 Jul 18 02:10:56.998334 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 431/872] 10.222.0.57 () {58 vars in 1315 bytes} [Mon Jul 18 02:10:56 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-17T02%3A10%3A56.202236&end=2022-07-19T02%3A10%3A56.202236 => generated 112 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 18 02:10:57.013095 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-55aef83d-0846-47e0-a735-0c3cf3cc2532 tempest-TenantUsagesNegativeTestJSON-1066294623 tempest-TenantUsagesNegativeTestJSON-1066294623-project-admin] Calling method '.version_select at 0x7ff4a8c03430>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:57.023542 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-55aef83d-0846-47e0-a735-0c3cf3cc2532 tempest-TenantUsagesNegativeTestJSON-1066294623 tempest-TenantUsagesNegativeTestJSON-1066294623-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Jul 18 02:10:57.031512 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-55aef83d-0846-47e0-a735-0c3cf3cc2532 tempest-TenantUsagesNegativeTestJSON-1066294623 tempest-TenantUsagesNegativeTestJSON-1066294623-project-admin] Request method failure captured: Jul 18 02:10:57.031512 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/os-simple-tenant-usage/4b2fe5d935fd4e3188c7c30823f63d8f?start=2022-07-19T02%3A10%3A56.202236&end=2022-07-17T02%3A10%3A56.202236 HTTP/1.1 Jul 18 02:10:57.031512 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:10:57.031512 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:10:57.031512 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:10:57.031512 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:10:57.031512 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:10:57.031512 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:10:57.031512 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:10:57.031512 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:10:57.031512 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MEw3TwmmwlyIzcKNO3DzfdNAral7R_5u4tOFdu8skIVleAja0JeOvfK8lAHdETzudaPRcDbA9OEQB1cYHqL7i5J7ekweq75XsU4rJbEBn_uVmMX4XpJ7ZlnsELwjxi2cuZzcyD0XRteLky21AS-1RJfz1RTTcT2wWQVSid2jGgLXF0 Jul 18 02:10:57.031512 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:10:57.031512 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:10:57.031512 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:10:57.031512 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:10:57.031512 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:10:57.031512 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:10:57.031512 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: d3ff6a68a4b3444bbcc99e822a38ae29 Jul 18 02:10:57.031512 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1066294623 Jul 18 02:10:57.031512 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,admin,reader Jul 18 02:10:57.031512 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,admin,reader Jul 18 02:10:57.032962 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d3ff6a68a4b3444bbcc99e822a38ae29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d3ff6a68a4b3444bbcc99e822a38ae29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d3ff6a68a4b3444bbcc99e822a38ae29"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d3ff6a68a4b3444bbcc99e822a38ae29"}]}] Jul 18 02:10:57.032962 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1066294623 Jul 18 02:10:57.032962 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: d3ff6a68a4b3444bbcc99e822a38ae29 Jul 18 02:10:57.032962 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1066294623 Jul 18 02:10:57.032962 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-TenantUsagesNegativeTestJSON-1066294623-project-admin Jul 18 02:10:57.032962 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:10:57.032962 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:10:57.032962 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 0bace485f3924f4e91584196bee16c9d Jul 18 02:10:57.032962 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1066294623-project-admin Jul 18 02:10:57.032962 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:10:57.032962 n-d-465891-3 devstack@n-api.service[119543]: exception: Invalid start time. The start time cannot occur after the end time. Jul 18 02:10:57.032962 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '4b2fe5d935fd4e3188c7c30823f63d8f'} Jul 18 02:10:57.034408 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:10:57.034408 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:10:57.034408 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:10:57.034408 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:10:57.034408 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:10:57.034408 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:10:57.034408 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:10:57.034408 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:10:57.034408 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:10:57.034408 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:10:57.034408 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:10:57.034408 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:10:57.034408 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Jul 18 02:10:57.034408 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 18 02:10:57.034408 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Jul 18 02:10:57.034408 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Jul 18 02:10:57.034408 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Jul 18 02:10:57.034408 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 18 02:10:57.034408 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Jul 18 02:10:57.035621 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:10:57.035621 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:10:57.035621 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:10:57.035621 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:10:57.035621 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:10:57.035621 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:10:57.035621 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:10:57.035621 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:10:57.035621 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Jul 18 02:10:57.035621 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:10:57.035621 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-55aef83d-0846-47e0-a735-0c3cf3cc2532 tempest-TenantUsagesNegativeTestJSON-1066294623 tempest-TenantUsagesNegativeTestJSON-1066294623-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:10:57.035621 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-55aef83d-0846-47e0-a735-0c3cf3cc2532 tempest-TenantUsagesNegativeTestJSON-1066294623 tempest-TenantUsagesNegativeTestJSON-1066294623-project-admin] 10.222.0.57 "GET /compute/v2.1/os-simple-tenant-usage/4b2fe5d935fd4e3188c7c30823f63d8f?start=2022-07-19T02%3A10%3A56.202236&end=2022-07-17T02%3A10%3A56.202236" status: 400 len: 111 microversion: 2.1 time: 0.033334 Jul 18 02:10:57.040259 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 432/873] 10.222.0.57 () {58 vars in 1411 bytes} [Mon Jul 18 02:10:56 2022] GET /compute/v2.1/os-simple-tenant-usage/4b2fe5d935fd4e3188c7c30823f63d8f?start=2022-07-19T02%3A10%3A56.202236&end=2022-07-17T02%3A10%3A56.202236 => generated 111 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:10:57.334104 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2dc329a2-1c01-40bf-8e31-e88d34f38196 tempest-TenantUsagesNegativeTestJSON-126221242 tempest-TenantUsagesNegativeTestJSON-126221242-project] Calling method '.version_select at 0x7ff4a95be430>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:57.339000 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2dc329a2-1c01-40bf-8e31-e88d34f38196 tempest-TenantUsagesNegativeTestJSON-126221242 tempest-TenantUsagesNegativeTestJSON-126221242-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '59b3f0272f0548cda2563d0819f10a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2fe5d935fd4e3188c7c30823f63d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:57.341768 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2dc329a2-1c01-40bf-8e31-e88d34f38196 tempest-TenantUsagesNegativeTestJSON-126221242 tempest-TenantUsagesNegativeTestJSON-126221242-project] Request method failure captured: Jul 18 02:10:57.341768 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-17T02%3A10%3A56.202236&end=2022-07-19T02%3A10%3A56.202236&detailed=1 HTTP/1.1 Jul 18 02:10:57.341768 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:10:57.341768 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:10:57.341768 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:10:57.341768 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:10:57.341768 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:10:57.341768 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:10:57.341768 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:10:57.341768 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:10:57.341768 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MEuhGZxI109MExQ6I3c5Sugt2SOBVygnI32dg6OP3bZa5FfLM25SlcH3R2plE9b190aVE9ASVchCGgMVCCZs4_sZ__RzBp4sCeuhqwzNv6BFUEKjmZLyuA8UeeZhlCk70gGa85XE5EbNV1fTSZR1SWBAxRCpjdVAuyNeELPVdMTiZg Jul 18 02:10:57.341768 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:10:57.341768 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:10:57.341768 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:10:57.341768 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:10:57.341768 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:10:57.341768 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:10:57.341768 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 4b2fe5d935fd4e3188c7c30823f63d8f Jul 18 02:10:57.341768 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-126221242 Jul 18 02:10:57.341768 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:10:57.341768 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:10:57.343316 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4b2fe5d935fd4e3188c7c30823f63d8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4b2fe5d935fd4e3188c7c30823f63d8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4b2fe5d935fd4e3188c7c30823f63d8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4b2fe5d935fd4e3188c7c30823f63d8f"}]}] Jul 18 02:10:57.343316 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-126221242 Jul 18 02:10:57.343316 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 4b2fe5d935fd4e3188c7c30823f63d8f Jul 18 02:10:57.343316 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-126221242 Jul 18 02:10:57.343316 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-TenantUsagesNegativeTestJSON-126221242-project Jul 18 02:10:57.343316 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:10:57.343316 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:10:57.343316 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 59b3f0272f0548cda2563d0819f10a56 Jul 18 02:10:57.343316 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-126221242-project Jul 18 02:10:57.343316 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:10:57.343316 n-d-465891-3 devstack@n-api.service[119543]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 18 02:10:57.343316 n-d-465891-3 devstack@n-api.service[119543]: action_args: {} Jul 18 02:10:57.343316 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:10:57.344130 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:10:57.344130 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:10:57.344130 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:10:57.344130 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:10:57.344130 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:10:57.344130 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:10:57.344130 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:10:57.344130 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:10:57.344130 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:10:57.344130 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:10:57.344130 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:10:57.344130 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Jul 18 02:10:57.344130 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 18 02:10:57.344130 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Jul 18 02:10:57.344130 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Jul 18 02:10:57.344130 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:10:57.344130 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:10:57.344130 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:10:57.344130 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:10:57.345248 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:10:57.345248 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:10:57.345248 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:10:57.345248 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:10:57.345248 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:10:57.345248 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:10:57.345248 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:10:57.345248 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:10:57.345248 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:10:57.345248 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:10:57.345248 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 18 02:10:57.345248 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:10:57.345248 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:10:57.345248 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:10:57.345248 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:10:57.345248 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:10:57.345248 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:10:57.345248 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:10:57.345248 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:10:57.346482 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 18 02:10:57.346482 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:10:57.348922 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2dc329a2-1c01-40bf-8e31-e88d34f38196 tempest-TenantUsagesNegativeTestJSON-126221242 tempest-TenantUsagesNegativeTestJSON-126221242-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:10:57.350137 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2dc329a2-1c01-40bf-8e31-e88d34f38196 tempest-TenantUsagesNegativeTestJSON-126221242 tempest-TenantUsagesNegativeTestJSON-126221242-project] 10.222.0.57 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-17T02%3A10%3A56.202236&end=2022-07-19T02%3A10%3A56.202236&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.304292 Jul 18 02:10:57.351316 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 433/874] 10.222.0.57 () {58 vars in 1334 bytes} [Mon Jul 18 02:10:57 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-17T02%3A10%3A56.202236&end=2022-07-19T02%3A10%3A56.202236&detailed=1 => generated 123 bytes in 306 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:10:57.355676 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-22b22dc6-a97c-4ba2-b8d3-4d52c1642ef8 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:57.360063 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d26ca933-2ad6-401d-a964-3423f8451944 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-13667971", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:57.364538 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-22b22dc6-a97c-4ba2-b8d3-4d52c1642ef8 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef" status: 200 len: 1498 microversion: 2.1 time: 0.474980 Jul 18 02:10:57.365138 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 442/875] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:56 2022] GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef => generated 1498 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:57.370528 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3f8a11ad-ef0f-4617-80a0-a630e9eac914 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:57.372089 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3f8a11ad-ef0f-4617-80a0-a630e9eac914 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:57.391685 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3f8a11ad-ef0f-4617-80a0-a630e9eac914 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:57.394865 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3f8a11ad-ef0f-4617-80a0-a630e9eac914 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:57.395872 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3f8a11ad-ef0f-4617-80a0-a630e9eac914 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:57.402318 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3f8a11ad-ef0f-4617-80a0-a630e9eac914 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:57.460167 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-d26ca933-2ad6-401d-a964-3423f8451944 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] validate_networks() for None {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:10:57.970372 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3f8a11ad-ef0f-4617-80a0-a630e9eac914 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:57.979173 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3f8a11ad-ef0f-4617-80a0-a630e9eac914 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1478 microversion: 2.1 time: 0.612948 Jul 18 02:10:57.980182 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 443/876] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:57 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1478 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:57.985225 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-70ab59d2-8f6b-401e-a7b7-27ba8ab4c9a4 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:57.985864 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-70ab59d2-8f6b-401e-a7b7-27ba8ab4c9a4 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 5f8ec100-c407-4029-b30e-f863e75b4a17] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:57.998416 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-70ab59d2-8f6b-401e-a7b7-27ba8ab4c9a4 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:57.999159 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-70ab59d2-8f6b-401e-a7b7-27ba8ab4c9a4 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:58.000157 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-70ab59d2-8f6b-401e-a7b7-27ba8ab4c9a4 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:58.000815 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-70ab59d2-8f6b-401e-a7b7-27ba8ab4c9a4 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:58.027294 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=100 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:10:58.248294 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-d26ca933-2ad6-401d-a964-3423f8451944 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:10:58.248743 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-d26ca933-2ad6-401d-a964-3423f8451944 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:10:58.249610 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-d26ca933-2ad6-401d-a964-3423f8451944 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:10:58.250056 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-d26ca933-2ad6-401d-a964-3423f8451944 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:10:58.250509 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-d26ca933-2ad6-401d-a964-3423f8451944 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:10:58.271383 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d26ca933-2ad6-401d-a964-3423f8451944 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:58.271944 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d26ca933-2ad6-401d-a964-3423f8451944 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:58.273292 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d26ca933-2ad6-401d-a964-3423f8451944 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:58.274188 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d26ca933-2ad6-401d-a964-3423f8451944 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:58.306565 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-70ab59d2-8f6b-401e-a7b7-27ba8ab4c9a4 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:58.316910 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-d26ca933-2ad6-401d-a964-3423f8451944 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Getting quotas for project 3d8e996befd24b26b0371ad9cdb4a069. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:10:58.318501 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-70ab59d2-8f6b-401e-a7b7-27ba8ab4c9a4 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/5f8ec100-c407-4029-b30e-f863e75b4a17" status: 200 len: 1325 microversion: 2.1 time: 0.336903 Jul 18 02:10:58.319097 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 444/877] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:57 2022] GET /compute/v2.1/servers/5f8ec100-c407-4029-b30e-f863e75b4a17 => generated 1325 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:58.324619 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-20c21afa-9a8e-4671-a327-bc7b92b9ff30 req-6337b2ff-0276-4391-8f7c-c3c6c5f73b55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "092e9dd7-8734-42ae-9ad7-626438550736", "name": "network-vif-plugged", "status": "completed", "tag": "5653c487-e512-475c-8f13-aa4ee05e2542"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:58.330402 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-d26ca933-2ad6-401d-a964-3423f8451944 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Getting quotas for user b6962b97241f4c3a9960bb5fe52f8697 and project 3d8e996befd24b26b0371ad9cdb4a069. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:10:58.336268 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-20c21afa-9a8e-4671-a327-bc7b92b9ff30 req-6337b2ff-0276-4391-8f7c-c3c6c5f73b55 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:58.336710 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-20c21afa-9a8e-4671-a327-bc7b92b9ff30 req-6337b2ff-0276-4391-8f7c-c3c6c5f73b55 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:58.352230 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-20c21afa-9a8e-4671-a327-bc7b92b9ff30 req-6337b2ff-0276-4391-8f7c-c3c6c5f73b55 service nova] Creating event network-vif-plugged:5653c487-e512-475c-8f13-aa4ee05e2542 for instance 092e9dd7-8734-42ae-9ad7-626438550736 on n-h2-465891-3 Jul 18 02:10:58.355801 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d26ca933-2ad6-401d-a964-3423f8451944 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:10:58.358866 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-20c21afa-9a8e-4671-a327-bc7b92b9ff30 req-6337b2ff-0276-4391-8f7c-c3c6c5f73b55 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038294 Jul 18 02:10:58.359600 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 445/878] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:10:58.362695 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d26ca933-2ad6-401d-a964-3423f8451944 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: f19cf772-e042-4d44-96ef-6de52397472e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:10:58.366226 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b933f9cf-076d-4007-bd4e-0d66b8c2e401 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:58.367130 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b933f9cf-076d-4007-bd4e-0d66b8c2e401 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] [instance: db3bcfcf-48cd-4f31-8adc-aee5c3e03184] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:58.389584 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b933f9cf-076d-4007-bd4e-0d66b8c2e401 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:58.391070 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b933f9cf-076d-4007-bd4e-0d66b8c2e401 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:58.391998 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b933f9cf-076d-4007-bd4e-0d66b8c2e401 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:58.392439 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b933f9cf-076d-4007-bd4e-0d66b8c2e401 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:58.461149 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d26ca933-2ad6-401d-a964-3423f8451944 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.108218 Jul 18 02:10:58.463200 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 434/879] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:10:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:10:58.472924 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dc96e2c0-7a0f-4aba-9d9e-39caaa59e85c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:58.475335 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-dc96e2c0-7a0f-4aba-9d9e-39caaa59e85c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:58.493472 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dc96e2c0-7a0f-4aba-9d9e-39caaa59e85c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:58.495460 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dc96e2c0-7a0f-4aba-9d9e-39caaa59e85c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:58.496973 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dc96e2c0-7a0f-4aba-9d9e-39caaa59e85c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:58.497733 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dc96e2c0-7a0f-4aba-9d9e-39caaa59e85c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:58.784598 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b933f9cf-076d-4007-bd4e-0d66b8c2e401 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6698374ee5c4bf18440a2f382db3c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d7b11fb5cd420cb8dbb16208bccf91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:58.821382 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b933f9cf-076d-4007-bd4e-0d66b8c2e401 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] 10.222.0.57 "GET /compute/v2.1/servers/db3bcfcf-48cd-4f31-8adc-aee5c3e03184" status: 200 len: 1318 microversion: 2.1 time: 0.457300 Jul 18 02:10:58.822629 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 446/880] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:58 2022] GET /compute/v2.1/servers/db3bcfcf-48cd-4f31-8adc-aee5c3e03184 => generated 1318 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:58.856003 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-f24d1827-e639-42f6-b64a-b5636c81fe55 req-30c3042c-2232-4f51-a958-bb6bb509f15d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22002049-4347-47d8-a5a2-6d3f31ec8927", "tag": "83756a9c-0161-44d8-b50b-8a364a6fcada"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:58.902345 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-f24d1827-e639-42f6-b64a-b5636c81fe55 req-30c3042c-2232-4f51-a958-bb6bb509f15d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:58.902813 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-f24d1827-e639-42f6-b64a-b5636c81fe55 req-30c3042c-2232-4f51-a958-bb6bb509f15d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:58.916851 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-f24d1827-e639-42f6-b64a-b5636c81fe55 req-30c3042c-2232-4f51-a958-bb6bb509f15d service nova] Creating event network-changed:83756a9c-0161-44d8-b50b-8a364a6fcada for instance 22002049-4347-47d8-a5a2-6d3f31ec8927 on n-h1-465891-3 Jul 18 02:10:58.923572 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-f24d1827-e639-42f6-b64a-b5636c81fe55 req-30c3042c-2232-4f51-a958-bb6bb509f15d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093975 Jul 18 02:10:58.924535 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 447/881] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:10:58.930646 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bf970501-2de6-4d16-952d-7d7669ddd7a1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:58.932019 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bf970501-2de6-4d16-952d-7d7669ddd7a1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 25dfb6dd-6d5a-4399-a348-0a162ca907ef] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:58.941017 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bf970501-2de6-4d16-952d-7d7669ddd7a1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:58.941686 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bf970501-2de6-4d16-952d-7d7669ddd7a1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:58.942530 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bf970501-2de6-4d16-952d-7d7669ddd7a1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:58.943021 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bf970501-2de6-4d16-952d-7d7669ddd7a1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:58.961971 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-dc96e2c0-7a0f-4aba-9d9e-39caaa59e85c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:59.002490 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-dc96e2c0-7a0f-4aba-9d9e-39caaa59e85c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 200 len: 1504 microversion: 2.1 time: 0.537333 Jul 18 02:10:59.013184 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 435/882] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:58 2022] GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 1504 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:59.018732 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-2bdb37c9-1815-49c1-b348-7e88a7800946 req-6e4f9b4d-30ac-4a34-9a92-a81623b2c428 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db3bcfcf-48cd-4f31-8adc-aee5c3e03184", "tag": "444c1d13-78e9-4675-9114-9c1b7c480b55"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:10:59.030014 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-2bdb37c9-1815-49c1-b348-7e88a7800946 req-6e4f9b4d-30ac-4a34-9a92-a81623b2c428 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:59.031006 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-2bdb37c9-1815-49c1-b348-7e88a7800946 req-6e4f9b4d-30ac-4a34-9a92-a81623b2c428 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:59.044223 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-2bdb37c9-1815-49c1-b348-7e88a7800946 req-6e4f9b4d-30ac-4a34-9a92-a81623b2c428 service nova] Creating event network-changed:444c1d13-78e9-4675-9114-9c1b7c480b55 for instance db3bcfcf-48cd-4f31-8adc-aee5c3e03184 on n-h2-465891-3 Jul 18 02:10:59.050268 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-2bdb37c9-1815-49c1-b348-7e88a7800946 req-6e4f9b4d-30ac-4a34-9a92-a81623b2c428 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035268 Jul 18 02:10:59.051359 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 436/883] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:10:59.059433 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d80e1f85-772b-412c-9c6d-a696a01fe9e9 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:59.060800 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d80e1f85-772b-412c-9c6d-a696a01fe9e9 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: f19cf772-e042-4d44-96ef-6de52397472e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:59.202405 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d80e1f85-772b-412c-9c6d-a696a01fe9e9 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6962b97241f4c3a9960bb5fe52f8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8e996befd24b26b0371ad9cdb4a069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:59.211022 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d80e1f85-772b-412c-9c6d-a696a01fe9e9 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] 10.222.0.57 "GET /compute/v2.1/servers/f19cf772-e042-4d44-96ef-6de52397472e" status: 200 len: 1220 microversion: 2.1 time: 0.158139 Jul 18 02:10:59.216096 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 437/884] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:59 2022] GET /compute/v2.1/servers/f19cf772-e042-4d44-96ef-6de52397472e => generated 1220 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:59.237571 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ce39fdf1-2ccb-4baf-9305-5570a9c3d264 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:59.239681 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ce39fdf1-2ccb-4baf-9305-5570a9c3d264 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:59.262616 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ce39fdf1-2ccb-4baf-9305-5570a9c3d264 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:59.265597 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ce39fdf1-2ccb-4baf-9305-5570a9c3d264 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:59.267927 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ce39fdf1-2ccb-4baf-9305-5570a9c3d264 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:59.269045 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ce39fdf1-2ccb-4baf-9305-5570a9c3d264 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:59.343934 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bf970501-2de6-4d16-952d-7d7669ddd7a1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:59.372429 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bf970501-2de6-4d16-952d-7d7669ddd7a1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef" status: 200 len: 1498 microversion: 2.1 time: 0.443939 Jul 18 02:10:59.375950 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 448/885] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:58 2022] GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef => generated 1498 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:59.401117 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e9558df1-26fb-4bb0-b83d-b1a33c51e9a4 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:59.403073 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e9558df1-26fb-4bb0-b83d-b1a33c51e9a4 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 5f8ec100-c407-4029-b30e-f863e75b4a17] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:59.418140 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e9558df1-26fb-4bb0-b83d-b1a33c51e9a4 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:59.419423 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e9558df1-26fb-4bb0-b83d-b1a33c51e9a4 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:59.421275 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e9558df1-26fb-4bb0-b83d-b1a33c51e9a4 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:59.422510 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e9558df1-26fb-4bb0-b83d-b1a33c51e9a4 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:59.544196 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ce39fdf1-2ccb-4baf-9305-5570a9c3d264 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:59.552610 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ce39fdf1-2ccb-4baf-9305-5570a9c3d264 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1478 microversion: 2.1 time: 0.325517 Jul 18 02:10:59.554104 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 438/886] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:59 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1478 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:59.640403 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e9558df1-26fb-4bb0-b83d-b1a33c51e9a4 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:10:59.652374 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e9558df1-26fb-4bb0-b83d-b1a33c51e9a4 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/5f8ec100-c407-4029-b30e-f863e75b4a17" status: 200 len: 1325 microversion: 2.1 time: 0.274185 Jul 18 02:10:59.653097 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 449/887] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:59 2022] GET /compute/v2.1/servers/5f8ec100-c407-4029-b30e-f863e75b4a17 => generated 1325 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:10:59.841727 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7708bd0d-87d5-4ae1-b295-3d76c4d253ef tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:10:59.842911 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7708bd0d-87d5-4ae1-b295-3d76c4d253ef tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] [instance: db3bcfcf-48cd-4f31-8adc-aee5c3e03184] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:10:59.851087 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7708bd0d-87d5-4ae1-b295-3d76c4d253ef tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:59.851784 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7708bd0d-87d5-4ae1-b295-3d76c4d253ef tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:59.854689 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7708bd0d-87d5-4ae1-b295-3d76c4d253ef tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:59.863902 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7708bd0d-87d5-4ae1-b295-3d76c4d253ef tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:00.024240 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a28f1bac-4eff-4041-a722-acd23cee56c5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:00.026082 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a28f1bac-4eff-4041-a722-acd23cee56c5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:00.042451 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a28f1bac-4eff-4041-a722-acd23cee56c5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:00.046684 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a28f1bac-4eff-4041-a722-acd23cee56c5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:00.057188 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a28f1bac-4eff-4041-a722-acd23cee56c5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:00.059671 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a28f1bac-4eff-4041-a722-acd23cee56c5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:00.219852 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7708bd0d-87d5-4ae1-b295-3d76c4d253ef tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6698374ee5c4bf18440a2f382db3c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d7b11fb5cd420cb8dbb16208bccf91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:00.241878 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7708bd0d-87d5-4ae1-b295-3d76c4d253ef tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] 10.222.0.57 "GET /compute/v2.1/servers/db3bcfcf-48cd-4f31-8adc-aee5c3e03184" status: 200 len: 1318 microversion: 2.1 time: 0.406483 Jul 18 02:11:00.253479 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 439/888] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:10:59 2022] GET /compute/v2.1/servers/db3bcfcf-48cd-4f31-8adc-aee5c3e03184 => generated 1318 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:00.258855 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bf4d8a46-6ab5-4f16-9181-2c137a0dc711 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:00.260360 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bf4d8a46-6ab5-4f16-9181-2c137a0dc711 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: f19cf772-e042-4d44-96ef-6de52397472e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:00.267050 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bf4d8a46-6ab5-4f16-9181-2c137a0dc711 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:00.267494 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bf4d8a46-6ab5-4f16-9181-2c137a0dc711 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:00.268623 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bf4d8a46-6ab5-4f16-9181-2c137a0dc711 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:00.269377 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bf4d8a46-6ab5-4f16-9181-2c137a0dc711 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:00.366719 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bf4d8a46-6ab5-4f16-9181-2c137a0dc711 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6962b97241f4c3a9960bb5fe52f8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8e996befd24b26b0371ad9cdb4a069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:00.376874 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bf4d8a46-6ab5-4f16-9181-2c137a0dc711 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] 10.222.0.57 "GET /compute/v2.1/servers/f19cf772-e042-4d44-96ef-6de52397472e" status: 200 len: 1272 microversion: 2.1 time: 0.121868 Jul 18 02:11:00.377479 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 440/889] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:00 2022] GET /compute/v2.1/servers/f19cf772-e042-4d44-96ef-6de52397472e => generated 1272 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:00.408730 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a28f1bac-4eff-4041-a722-acd23cee56c5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:00.410533 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3c605cdb-c39c-445b-a24a-5e9bd47f6680 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:00.414591 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3c605cdb-c39c-445b-a24a-5e9bd47f6680 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 25dfb6dd-6d5a-4399-a348-0a162ca907ef] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:00.430547 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a28f1bac-4eff-4041-a722-acd23cee56c5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 200 len: 1504 microversion: 2.1 time: 0.412939 Jul 18 02:11:00.430889 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3c605cdb-c39c-445b-a24a-5e9bd47f6680 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:00.432129 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3c605cdb-c39c-445b-a24a-5e9bd47f6680 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:00.446510 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 450/890] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:00 2022] GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 1504 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:00.446682 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3c605cdb-c39c-445b-a24a-5e9bd47f6680 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:00.446682 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3c605cdb-c39c-445b-a24a-5e9bd47f6680 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:00.578861 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5a6b10d3-c4d9-4fe6-978b-7ae67dc29c3b tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:00.582243 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5a6b10d3-c4d9-4fe6-978b-7ae67dc29c3b tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:00.598856 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5a6b10d3-c4d9-4fe6-978b-7ae67dc29c3b tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:00.600050 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5a6b10d3-c4d9-4fe6-978b-7ae67dc29c3b tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:00.601860 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5a6b10d3-c4d9-4fe6-978b-7ae67dc29c3b tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:00.603180 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5a6b10d3-c4d9-4fe6-978b-7ae67dc29c3b tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:00.680042 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3c605cdb-c39c-445b-a24a-5e9bd47f6680 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:00.694330 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3c605cdb-c39c-445b-a24a-5e9bd47f6680 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef" status: 200 len: 1498 microversion: 2.1 time: 0.294833 Jul 18 02:11:00.695746 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 441/891] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:00 2022] GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef => generated 1498 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:00.707056 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ed21f72a-c81f-4efa-b108-94c1c0dd01eb tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:00.708632 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ed21f72a-c81f-4efa-b108-94c1c0dd01eb tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 5f8ec100-c407-4029-b30e-f863e75b4a17] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:00.722195 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ed21f72a-c81f-4efa-b108-94c1c0dd01eb tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:00.723471 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ed21f72a-c81f-4efa-b108-94c1c0dd01eb tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:00.725352 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ed21f72a-c81f-4efa-b108-94c1c0dd01eb tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:00.726506 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ed21f72a-c81f-4efa-b108-94c1c0dd01eb tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:00.969018 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5a6b10d3-c4d9-4fe6-978b-7ae67dc29c3b tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:00.992626 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5a6b10d3-c4d9-4fe6-978b-7ae67dc29c3b tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1478 microversion: 2.1 time: 0.423805 Jul 18 02:11:00.994244 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 451/892] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:00 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1478 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:11:01.089155 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ed21f72a-c81f-4efa-b108-94c1c0dd01eb tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:01.118615 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ed21f72a-c81f-4efa-b108-94c1c0dd01eb tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/5f8ec100-c407-4029-b30e-f863e75b4a17" status: 200 len: 1325 microversion: 2.1 time: 0.419087 Jul 18 02:11:01.122201 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 442/893] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:00 2022] GET /compute/v2.1/servers/5f8ec100-c407-4029-b30e-f863e75b4a17 => generated 1325 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:01.200511 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-b2815a45-8efb-4b7c-a31b-8a00e994c36c req-92510eb5-d2d7-4f1a-ae4a-3ed6ee60dca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f8ec100-c407-4029-b30e-f863e75b4a17", "name": "network-vif-plugged", "status": "completed", "tag": "c8ff716f-542d-47a0-8b54-f64ce60095ce"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:01.226536 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-b2815a45-8efb-4b7c-a31b-8a00e994c36c req-92510eb5-d2d7-4f1a-ae4a-3ed6ee60dca2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:01.229663 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-b2815a45-8efb-4b7c-a31b-8a00e994c36c req-92510eb5-d2d7-4f1a-ae4a-3ed6ee60dca2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:01.252479 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-b2815a45-8efb-4b7c-a31b-8a00e994c36c req-92510eb5-d2d7-4f1a-ae4a-3ed6ee60dca2 service nova] Creating event network-vif-plugged:c8ff716f-542d-47a0-8b54-f64ce60095ce for instance 5f8ec100-c407-4029-b30e-f863e75b4a17 on n-h2-465891-3 Jul 18 02:11:01.259302 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-b2815a45-8efb-4b7c-a31b-8a00e994c36c req-92510eb5-d2d7-4f1a-ae4a-3ed6ee60dca2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067898 Jul 18 02:11:01.261204 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 452/894] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:11:01.266998 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4405161a-a99f-482a-be92-437cc6809e99 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:01.287918 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4405161a-a99f-482a-be92-437cc6809e99 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] [instance: db3bcfcf-48cd-4f31-8adc-aee5c3e03184] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:01.333278 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4405161a-a99f-482a-be92-437cc6809e99 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:01.339777 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4405161a-a99f-482a-be92-437cc6809e99 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:01.341525 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4405161a-a99f-482a-be92-437cc6809e99 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:01.342521 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4405161a-a99f-482a-be92-437cc6809e99 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:01.406996 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-44b2b2b4-c59a-4070-8586-1c8adf4a7041 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:01.407698 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-44b2b2b4-c59a-4070-8586-1c8adf4a7041 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: f19cf772-e042-4d44-96ef-6de52397472e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:01.425376 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-44b2b2b4-c59a-4070-8586-1c8adf4a7041 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:01.426761 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-44b2b2b4-c59a-4070-8586-1c8adf4a7041 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:01.427768 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-44b2b2b4-c59a-4070-8586-1c8adf4a7041 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:01.428389 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-44b2b2b4-c59a-4070-8586-1c8adf4a7041 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:01.719397 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-44b2b2b4-c59a-4070-8586-1c8adf4a7041 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6962b97241f4c3a9960bb5fe52f8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8e996befd24b26b0371ad9cdb4a069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:01.726901 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-44b2b2b4-c59a-4070-8586-1c8adf4a7041 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] 10.222.0.57 "GET /compute/v2.1/servers/f19cf772-e042-4d44-96ef-6de52397472e" status: 200 len: 1280 microversion: 2.1 time: 0.326355 Jul 18 02:11:01.727837 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 453/895] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:01 2022] GET /compute/v2.1/servers/f19cf772-e042-4d44-96ef-6de52397472e => generated 1280 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:11:01.736558 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-480c6f21-20ff-41b1-9618-74cb3f79f65c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:01.737492 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-480c6f21-20ff-41b1-9618-74cb3f79f65c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:01.749818 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-480c6f21-20ff-41b1-9618-74cb3f79f65c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:01.750148 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-480c6f21-20ff-41b1-9618-74cb3f79f65c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:01.753003 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-480c6f21-20ff-41b1-9618-74cb3f79f65c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:01.753559 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-480c6f21-20ff-41b1-9618-74cb3f79f65c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:01.891397 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4405161a-a99f-482a-be92-437cc6809e99 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6698374ee5c4bf18440a2f382db3c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d7b11fb5cd420cb8dbb16208bccf91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:01.903549 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4405161a-a99f-482a-be92-437cc6809e99 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] 10.222.0.57 "GET /compute/v2.1/servers/db3bcfcf-48cd-4f31-8adc-aee5c3e03184" status: 200 len: 1318 microversion: 2.1 time: 0.645389 Jul 18 02:11:01.915298 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 443/896] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:01 2022] GET /compute/v2.1/servers/db3bcfcf-48cd-4f31-8adc-aee5c3e03184 => generated 1318 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:01.921444 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6644ecd0-4547-4b7d-8e26-66025128fc72 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:01.921994 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6644ecd0-4547-4b7d-8e26-66025128fc72 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 25dfb6dd-6d5a-4399-a348-0a162ca907ef] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:01.928741 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6644ecd0-4547-4b7d-8e26-66025128fc72 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:01.929497 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6644ecd0-4547-4b7d-8e26-66025128fc72 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:01.930531 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6644ecd0-4547-4b7d-8e26-66025128fc72 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:01.931145 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6644ecd0-4547-4b7d-8e26-66025128fc72 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:02.066369 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-480c6f21-20ff-41b1-9618-74cb3f79f65c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:02.082166 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-480c6f21-20ff-41b1-9618-74cb3f79f65c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 200 len: 1504 microversion: 2.1 time: 0.352375 Jul 18 02:11:02.102002 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 454/897] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:01 2022] GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 1504 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:02.112723 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-68c4deaf-295d-4351-bafe-284538e58972 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:02.114512 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-68c4deaf-295d-4351-bafe-284538e58972 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:02.128224 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-68c4deaf-295d-4351-bafe-284538e58972 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:02.129320 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-68c4deaf-295d-4351-bafe-284538e58972 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:02.131121 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-68c4deaf-295d-4351-bafe-284538e58972 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:02.132223 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-68c4deaf-295d-4351-bafe-284538e58972 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:02.161993 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6644ecd0-4547-4b7d-8e26-66025128fc72 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:02.172031 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6644ecd0-4547-4b7d-8e26-66025128fc72 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef" status: 200 len: 1498 microversion: 2.1 time: 0.254421 Jul 18 02:11:02.173297 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 444/898] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:01 2022] GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef => generated 1498 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:02.179314 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3637db7d-28f0-4b02-a57e-e0c127dde50a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:02.179944 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3637db7d-28f0-4b02-a57e-e0c127dde50a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 5f8ec100-c407-4029-b30e-f863e75b4a17] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:02.188596 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3637db7d-28f0-4b02-a57e-e0c127dde50a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:02.189352 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3637db7d-28f0-4b02-a57e-e0c127dde50a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:02.190385 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3637db7d-28f0-4b02-a57e-e0c127dde50a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:02.198831 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3637db7d-28f0-4b02-a57e-e0c127dde50a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:02.387745 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=8 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:11:02.488536 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-68c4deaf-295d-4351-bafe-284538e58972 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:02.503708 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-68c4deaf-295d-4351-bafe-284538e58972 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1464 microversion: 2.1 time: 0.398977 Jul 18 02:11:02.505454 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 455/899] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:02 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1464 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:02.527599 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a6ef5a37-f0ea-4593-adf3-b01aabb8d9c9 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:02.529105 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a6ef5a37-f0ea-4593-adf3-b01aabb8d9c9 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:02.543294 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3637db7d-28f0-4b02-a57e-e0c127dde50a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:02.549803 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a6ef5a37-f0ea-4593-adf3-b01aabb8d9c9 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:02.550974 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a6ef5a37-f0ea-4593-adf3-b01aabb8d9c9 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:02.557011 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3637db7d-28f0-4b02-a57e-e0c127dde50a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/5f8ec100-c407-4029-b30e-f863e75b4a17" status: 200 len: 1325 microversion: 2.1 time: 0.381265 Jul 18 02:11:02.569752 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a6ef5a37-f0ea-4593-adf3-b01aabb8d9c9 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:02.570972 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 445/900] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:02 2022] GET /compute/v2.1/servers/5f8ec100-c407-4029-b30e-f863e75b4a17 => generated 1325 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:02.571134 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a6ef5a37-f0ea-4593-adf3-b01aabb8d9c9 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:02.745562 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-af0d4182-a2bd-4caf-a1eb-5f980d1bde7c tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:02.746557 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-af0d4182-a2bd-4caf-a1eb-5f980d1bde7c tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: f19cf772-e042-4d44-96ef-6de52397472e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:02.754509 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-af0d4182-a2bd-4caf-a1eb-5f980d1bde7c tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:02.755164 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-af0d4182-a2bd-4caf-a1eb-5f980d1bde7c tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:02.756190 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-af0d4182-a2bd-4caf-a1eb-5f980d1bde7c tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:02.756813 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-af0d4182-a2bd-4caf-a1eb-5f980d1bde7c tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:02.803064 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a6ef5a37-f0ea-4593-adf3-b01aabb8d9c9 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:02.819929 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a6ef5a37-f0ea-4593-adf3-b01aabb8d9c9 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1464 microversion: 2.1 time: 0.300216 Jul 18 02:11:02.844099 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 456/901] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:02 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1464 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:02.907479 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3866df6c-cb12-4d1b-b00a-9d141c8faef0 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:02.910493 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3866df6c-cb12-4d1b-b00a-9d141c8faef0 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:02.932968 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3866df6c-cb12-4d1b-b00a-9d141c8faef0 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:02.933776 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3866df6c-cb12-4d1b-b00a-9d141c8faef0 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:02.935249 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3866df6c-cb12-4d1b-b00a-9d141c8faef0 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:02.936960 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3866df6c-cb12-4d1b-b00a-9d141c8faef0 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:03.019658 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=14 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:11:03.114856 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-af0d4182-a2bd-4caf-a1eb-5f980d1bde7c tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6962b97241f4c3a9960bb5fe52f8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8e996befd24b26b0371ad9cdb4a069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:03.125788 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-3866df6c-cb12-4d1b-b00a-9d141c8faef0 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:11:03.126961 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-3866df6c-cb12-4d1b-b00a-9d141c8faef0 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:11:03.128560 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-3866df6c-cb12-4d1b-b00a-9d141c8faef0 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:11:03.129614 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-3866df6c-cb12-4d1b-b00a-9d141c8faef0 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:11:03.131624 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-3866df6c-cb12-4d1b-b00a-9d141c8faef0 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:11:03.162135 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-af0d4182-a2bd-4caf-a1eb-5f980d1bde7c tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] 10.222.0.57 "GET /compute/v2.1/servers/f19cf772-e042-4d44-96ef-6de52397472e" status: 200 len: 1320 microversion: 2.1 time: 0.420888 Jul 18 02:11:03.180875 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 446/902] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:02 2022] GET /compute/v2.1/servers/f19cf772-e042-4d44-96ef-6de52397472e => generated 1320 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:03.189483 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7e00e57e-99ac-4cca-b477-86ffec95432a tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:03.190817 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7e00e57e-99ac-4cca-b477-86ffec95432a tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] [instance: db3bcfcf-48cd-4f31-8adc-aee5c3e03184] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:03.199801 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7e00e57e-99ac-4cca-b477-86ffec95432a tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:03.201036 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7e00e57e-99ac-4cca-b477-86ffec95432a tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:03.202535 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7e00e57e-99ac-4cca-b477-86ffec95432a tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:03.203179 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7e00e57e-99ac-4cca-b477-86ffec95432a tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:03.358517 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3866df6c-cb12-4d1b-b00a-9d141c8faef0 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:03.389301 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3866df6c-cb12-4d1b-b00a-9d141c8faef0 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:03.390105 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3866df6c-cb12-4d1b-b00a-9d141c8faef0 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:03.392478 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3866df6c-cb12-4d1b-b00a-9d141c8faef0 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:03.393287 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3866df6c-cb12-4d1b-b00a-9d141c8faef0 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:03.434594 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7e00e57e-99ac-4cca-b477-86ffec95432a tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6698374ee5c4bf18440a2f382db3c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d7b11fb5cd420cb8dbb16208bccf91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:03.451045 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7e00e57e-99ac-4cca-b477-86ffec95432a tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] 10.222.0.57 "GET /compute/v2.1/servers/db3bcfcf-48cd-4f31-8adc-aee5c3e03184" status: 200 len: 1318 microversion: 2.1 time: 0.267247 Jul 18 02:11:03.452358 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 447/903] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:03 2022] GET /compute/v2.1/servers/db3bcfcf-48cd-4f31-8adc-aee5c3e03184 => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:03.459504 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6ef98d43-5417-4f32-ab25-f44a6e1ad1d3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:03.460372 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6ef98d43-5417-4f32-ab25-f44a6e1ad1d3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:03.469035 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6ef98d43-5417-4f32-ab25-f44a6e1ad1d3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:03.470140 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6ef98d43-5417-4f32-ab25-f44a6e1ad1d3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:03.471107 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6ef98d43-5417-4f32-ab25-f44a6e1ad1d3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:03.471814 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6ef98d43-5417-4f32-ab25-f44a6e1ad1d3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:03.521574 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3866df6c-cb12-4d1b-b00a-9d141c8faef0 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "POST /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736/action" status: 202 len: 1068 microversion: 2.1 time: 0.654492 Jul 18 02:11:03.523274 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 457/904] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:11:02 2022] POST /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736/action => generated 1068 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 18 02:11:03.533326 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e416d771-fc51-4905-84ab-846a504af5d9 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:03.534776 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e416d771-fc51-4905-84ab-846a504af5d9 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 25dfb6dd-6d5a-4399-a348-0a162ca907ef] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:03.567654 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e416d771-fc51-4905-84ab-846a504af5d9 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:03.569543 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e416d771-fc51-4905-84ab-846a504af5d9 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:03.574654 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e416d771-fc51-4905-84ab-846a504af5d9 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:03.576060 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e416d771-fc51-4905-84ab-846a504af5d9 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:03.913157 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6ef98d43-5417-4f32-ab25-f44a6e1ad1d3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:03.918037 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:11:03.925119 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6ef98d43-5417-4f32-ab25-f44a6e1ad1d3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 200 len: 1504 microversion: 2.1 time: 0.471306 Jul 18 02:11:03.928380 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 448/905] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:03 2022] GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 1504 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:03.934718 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5007ac92-e7f6-41d1-930a-e79476c84658 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:03.936415 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5007ac92-e7f6-41d1-930a-e79476c84658 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:03.945947 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5007ac92-e7f6-41d1-930a-e79476c84658 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:03.947964 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5007ac92-e7f6-41d1-930a-e79476c84658 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:03.950131 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5007ac92-e7f6-41d1-930a-e79476c84658 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:03.951187 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5007ac92-e7f6-41d1-930a-e79476c84658 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:03.981953 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e416d771-fc51-4905-84ab-846a504af5d9 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:04.015052 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e416d771-fc51-4905-84ab-846a504af5d9 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef" status: 200 len: 1498 microversion: 2.1 time: 0.489798 Jul 18 02:11:04.050970 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 458/906] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:03 2022] GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef => generated 1498 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:04.068695 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d260f15d-feb3-4cb3-bbbd-299b013fbc34 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:04.070588 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d260f15d-feb3-4cb3-bbbd-299b013fbc34 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 5f8ec100-c407-4029-b30e-f863e75b4a17] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:04.079361 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d260f15d-feb3-4cb3-bbbd-299b013fbc34 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:04.079815 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d260f15d-feb3-4cb3-bbbd-299b013fbc34 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:04.081365 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d260f15d-feb3-4cb3-bbbd-299b013fbc34 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:04.081842 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d260f15d-feb3-4cb3-bbbd-299b013fbc34 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:05.042097 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5007ac92-e7f6-41d1-930a-e79476c84658 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:05.053534 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5007ac92-e7f6-41d1-930a-e79476c84658 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1473 microversion: 2.1 time: 1.123495 Jul 18 02:11:05.055032 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 449/907] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:03 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1473 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:05.067026 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7adcfc1d-dd44-410e-b8fe-1745e81cb6f8 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:05.072131 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7adcfc1d-dd44-410e-b8fe-1745e81cb6f8 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: f19cf772-e042-4d44-96ef-6de52397472e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:05.083654 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7adcfc1d-dd44-410e-b8fe-1745e81cb6f8 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:05.084411 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7adcfc1d-dd44-410e-b8fe-1745e81cb6f8 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:05.085410 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7adcfc1d-dd44-410e-b8fe-1745e81cb6f8 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:05.086488 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7adcfc1d-dd44-410e-b8fe-1745e81cb6f8 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:05.089736 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d260f15d-feb3-4cb3-bbbd-299b013fbc34 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:05.104745 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d260f15d-feb3-4cb3-bbbd-299b013fbc34 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/5f8ec100-c407-4029-b30e-f863e75b4a17" status: 200 len: 1523 microversion: 2.1 time: 1.052023 Jul 18 02:11:05.106999 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 459/908] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:04 2022] GET /compute/v2.1/servers/5f8ec100-c407-4029-b30e-f863e75b4a17 => generated 1523 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:05.117460 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-581a68f2-0abb-46d3-ad79-9f4d57cac2da tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:05.119712 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-581a68f2-0abb-46d3-ad79-9f4d57cac2da tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] [instance: db3bcfcf-48cd-4f31-8adc-aee5c3e03184] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:05.142055 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-581a68f2-0abb-46d3-ad79-9f4d57cac2da tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:05.143230 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-581a68f2-0abb-46d3-ad79-9f4d57cac2da tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:05.144933 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-581a68f2-0abb-46d3-ad79-9f4d57cac2da tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:05.146777 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-581a68f2-0abb-46d3-ad79-9f4d57cac2da tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:05.658960 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-581a68f2-0abb-46d3-ad79-9f4d57cac2da tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6698374ee5c4bf18440a2f382db3c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d7b11fb5cd420cb8dbb16208bccf91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:05.663075 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:11:05.664197 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7adcfc1d-dd44-410e-b8fe-1745e81cb6f8 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6962b97241f4c3a9960bb5fe52f8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8e996befd24b26b0371ad9cdb4a069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:05.669858 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-581a68f2-0abb-46d3-ad79-9f4d57cac2da tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] 10.222.0.57 "GET /compute/v2.1/servers/db3bcfcf-48cd-4f31-8adc-aee5c3e03184" status: 200 len: 1318 microversion: 2.1 time: 0.560758 Jul 18 02:11:05.670462 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 460/909] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:05 2022] GET /compute/v2.1/servers/db3bcfcf-48cd-4f31-8adc-aee5c3e03184 => generated 1318 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:05.676049 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7adcfc1d-dd44-410e-b8fe-1745e81cb6f8 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] 10.222.0.57 "GET /compute/v2.1/servers/f19cf772-e042-4d44-96ef-6de52397472e" status: 200 len: 1320 microversion: 2.1 time: 0.618237 Jul 18 02:11:05.677097 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 450/910] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:05 2022] GET /compute/v2.1/servers/f19cf772-e042-4d44-96ef-6de52397472e => generated 1320 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:05.685392 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-83fa56bd-3e9d-4394-be6a-27da7556b737 req-a8bbd3e8-7796-4e81-8fbe-8c049bb08f86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f19cf772-e042-4d44-96ef-6de52397472e", "tag": "52630cf0-3815-4f5f-9665-37e9a31ca48b"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:05.687159 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cb7d7ebf-0280-4cbc-a70b-ea0f3d5301c5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:05.689000 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cb7d7ebf-0280-4cbc-a70b-ea0f3d5301c5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:05.700304 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-83fa56bd-3e9d-4394-be6a-27da7556b737 req-a8bbd3e8-7796-4e81-8fbe-8c049bb08f86 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:05.700768 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-83fa56bd-3e9d-4394-be6a-27da7556b737 req-a8bbd3e8-7796-4e81-8fbe-8c049bb08f86 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:05.704609 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cb7d7ebf-0280-4cbc-a70b-ea0f3d5301c5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:05.705859 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cb7d7ebf-0280-4cbc-a70b-ea0f3d5301c5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:05.707734 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cb7d7ebf-0280-4cbc-a70b-ea0f3d5301c5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:05.709328 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cb7d7ebf-0280-4cbc-a70b-ea0f3d5301c5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:05.716168 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-83fa56bd-3e9d-4394-be6a-27da7556b737 req-a8bbd3e8-7796-4e81-8fbe-8c049bb08f86 service nova] Creating event network-changed:52630cf0-3815-4f5f-9665-37e9a31ca48b for instance f19cf772-e042-4d44-96ef-6de52397472e on n-h1-465891-3 Jul 18 02:11:05.722764 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-83fa56bd-3e9d-4394-be6a-27da7556b737 req-a8bbd3e8-7796-4e81-8fbe-8c049bb08f86 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041833 Jul 18 02:11:05.723390 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 461/911] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:05.731392 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-014126d2-6f58-4639-a495-e9379b47bffb tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:05.731392 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-014126d2-6f58-4639-a495-e9379b47bffb tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 25dfb6dd-6d5a-4399-a348-0a162ca907ef] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:05.741842 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-014126d2-6f58-4639-a495-e9379b47bffb tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:05.742337 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-014126d2-6f58-4639-a495-e9379b47bffb tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:05.743125 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-014126d2-6f58-4639-a495-e9379b47bffb tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:05.747289 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-014126d2-6f58-4639-a495-e9379b47bffb tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:06.151914 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cb7d7ebf-0280-4cbc-a70b-ea0f3d5301c5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:06.170151 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cb7d7ebf-0280-4cbc-a70b-ea0f3d5301c5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 200 len: 1504 microversion: 2.1 time: 0.490175 Jul 18 02:11:06.187146 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 451/912] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:05 2022] GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 1504 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:06.200754 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4088278d-cb47-4c81-99d6-efdb6b024a07 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:06.201721 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4088278d-cb47-4c81-99d6-efdb6b024a07 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 5f8ec100-c407-4029-b30e-f863e75b4a17] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:06.215594 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4088278d-cb47-4c81-99d6-efdb6b024a07 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:06.218262 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4088278d-cb47-4c81-99d6-efdb6b024a07 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:06.218744 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-014126d2-6f58-4639-a495-e9379b47bffb tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:06.220724 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4088278d-cb47-4c81-99d6-efdb6b024a07 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:06.222242 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4088278d-cb47-4c81-99d6-efdb6b024a07 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:06.233661 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-014126d2-6f58-4639-a495-e9379b47bffb tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef" status: 200 len: 1498 microversion: 2.1 time: 0.508947 Jul 18 02:11:06.234266 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 462/913] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:05 2022] GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef => generated 1498 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:06.239899 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-658659c4-478f-4da8-a88b-8e233adba7e2 req-ce2ba488-7d36-4cbb-b5ec-5b3c47e2ad7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db3bcfcf-48cd-4f31-8adc-aee5c3e03184", "name": "network-vif-plugged", "status": "completed", "tag": "444c1d13-78e9-4675-9114-9c1b7c480b55"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:06.260223 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-658659c4-478f-4da8-a88b-8e233adba7e2 req-ce2ba488-7d36-4cbb-b5ec-5b3c47e2ad7d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:06.267880 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-658659c4-478f-4da8-a88b-8e233adba7e2 req-ce2ba488-7d36-4cbb-b5ec-5b3c47e2ad7d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:06.289017 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-658659c4-478f-4da8-a88b-8e233adba7e2 req-ce2ba488-7d36-4cbb-b5ec-5b3c47e2ad7d service nova] Creating event network-vif-plugged:444c1d13-78e9-4675-9114-9c1b7c480b55 for instance db3bcfcf-48cd-4f31-8adc-aee5c3e03184 on n-h2-465891-3 Jul 18 02:11:06.301150 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4088278d-cb47-4c81-99d6-efdb6b024a07 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 5f8ec100-c407-4029-b30e-f863e75b4a17] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:11:06.311901 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-658659c4-478f-4da8-a88b-8e233adba7e2 req-ce2ba488-7d36-4cbb-b5ec-5b3c47e2ad7d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076247 Jul 18 02:11:06.313852 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 463/914] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:06.332599 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-f6b5a2fd-794d-486b-8d45-976672903860 req-e365458e-6c77-4edc-bde7-05af88ad360e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22002049-4347-47d8-a5a2-6d3f31ec8927", "name": "network-vif-unplugged", "status": "completed", "tag": "83756a9c-0161-44d8-b50b-8a364a6fcada"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:06.351163 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-f6b5a2fd-794d-486b-8d45-976672903860 req-e365458e-6c77-4edc-bde7-05af88ad360e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:06.351619 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-f6b5a2fd-794d-486b-8d45-976672903860 req-e365458e-6c77-4edc-bde7-05af88ad360e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:06.388158 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-f6b5a2fd-794d-486b-8d45-976672903860 req-e365458e-6c77-4edc-bde7-05af88ad360e service nova] Creating event network-vif-unplugged:83756a9c-0161-44d8-b50b-8a364a6fcada for instance 22002049-4347-47d8-a5a2-6d3f31ec8927 on n-h1-465891-3 Jul 18 02:11:06.398109 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-f6b5a2fd-794d-486b-8d45-976672903860 req-e365458e-6c77-4edc-bde7-05af88ad360e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082674 Jul 18 02:11:06.398744 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 464/915] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:06.404916 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5eddfbbe-438f-44d7-9e7b-3c2ad480b544 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:06.419434 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5eddfbbe-438f-44d7-9e7b-3c2ad480b544 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:06.438261 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5eddfbbe-438f-44d7-9e7b-3c2ad480b544 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:06.439107 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5eddfbbe-438f-44d7-9e7b-3c2ad480b544 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:06.440242 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5eddfbbe-438f-44d7-9e7b-3c2ad480b544 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:06.440946 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5eddfbbe-438f-44d7-9e7b-3c2ad480b544 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:06.537972 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4088278d-cb47-4c81-99d6-efdb6b024a07 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "DELETE /compute/v2.1/servers/5f8ec100-c407-4029-b30e-f863e75b4a17" status: 204 len: 0 microversion: 2.1 time: 0.348471 Jul 18 02:11:06.539060 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 452/916] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:11:06 2022] DELETE /compute/v2.1/servers/5f8ec100-c407-4029-b30e-f863e75b4a17 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:11:06.548647 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9b754192-6835-43c7-8683-89a0848cceec tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:06.549394 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9b754192-6835-43c7-8683-89a0848cceec tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 5f8ec100-c407-4029-b30e-f863e75b4a17] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:06.569880 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9b754192-6835-43c7-8683-89a0848cceec tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:06.570373 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9b754192-6835-43c7-8683-89a0848cceec tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:06.571227 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9b754192-6835-43c7-8683-89a0848cceec tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:06.572250 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9b754192-6835-43c7-8683-89a0848cceec tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:06.800575 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5eddfbbe-438f-44d7-9e7b-3c2ad480b544 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:06.816519 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5eddfbbe-438f-44d7-9e7b-3c2ad480b544 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1473 microversion: 2.1 time: 0.416384 Jul 18 02:11:06.835010 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 465/917] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:06 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1473 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:06.844032 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9b754192-6835-43c7-8683-89a0848cceec tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:06.855454 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9b754192-6835-43c7-8683-89a0848cceec tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/5f8ec100-c407-4029-b30e-f863e75b4a17" status: 200 len: 1529 microversion: 2.1 time: 0.311412 Jul 18 02:11:06.857331 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-00ee6181-f714-4afc-b186-e55497a4f442 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:06.857985 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-00ee6181-f714-4afc-b186-e55497a4f442 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] [instance: db3bcfcf-48cd-4f31-8adc-aee5c3e03184] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:06.858908 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 453/918] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:06 2022] GET /compute/v2.1/servers/5f8ec100-c407-4029-b30e-f863e75b4a17 => generated 1529 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:11:06.873156 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-60c740da-19f0-460d-b4d5-7cf23836eb21 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:06.873829 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-60c740da-19f0-460d-b4d5-7cf23836eb21 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: f19cf772-e042-4d44-96ef-6de52397472e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:06.876881 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-00ee6181-f714-4afc-b186-e55497a4f442 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:06.877499 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-00ee6181-f714-4afc-b186-e55497a4f442 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:06.878411 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-00ee6181-f714-4afc-b186-e55497a4f442 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:06.878861 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-00ee6181-f714-4afc-b186-e55497a4f442 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:06.891002 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60c740da-19f0-460d-b4d5-7cf23836eb21 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:06.892192 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60c740da-19f0-460d-b4d5-7cf23836eb21 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:06.894798 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60c740da-19f0-460d-b4d5-7cf23836eb21 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:06.895341 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60c740da-19f0-460d-b4d5-7cf23836eb21 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:07.112981 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-00ee6181-f714-4afc-b186-e55497a4f442 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6698374ee5c4bf18440a2f382db3c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d7b11fb5cd420cb8dbb16208bccf91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:07.125267 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-00ee6181-f714-4afc-b186-e55497a4f442 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] 10.222.0.57 "GET /compute/v2.1/servers/db3bcfcf-48cd-4f31-8adc-aee5c3e03184" status: 200 len: 1318 microversion: 2.1 time: 0.287892 Jul 18 02:11:07.128831 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-60c740da-19f0-460d-b4d5-7cf23836eb21 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6962b97241f4c3a9960bb5fe52f8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8e996befd24b26b0371ad9cdb4a069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:07.142763 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 466/919] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:06 2022] GET /compute/v2.1/servers/db3bcfcf-48cd-4f31-8adc-aee5c3e03184 => generated 1318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:07.148125 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3fa944b7-daf8-45b1-b683-b472d39213a4 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:07.148639 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3fa944b7-daf8-45b1-b683-b472d39213a4 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: f77b267e-9a20-4943-aa8b-0c82b9d6d20e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:07.157065 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3fa944b7-daf8-45b1-b683-b472d39213a4 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:07.157393 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3fa944b7-daf8-45b1-b683-b472d39213a4 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:07.158164 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3fa944b7-daf8-45b1-b683-b472d39213a4 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:07.158599 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3fa944b7-daf8-45b1-b683-b472d39213a4 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:07.164307 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-60c740da-19f0-460d-b4d5-7cf23836eb21 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] 10.222.0.57 "GET /compute/v2.1/servers/f19cf772-e042-4d44-96ef-6de52397472e" status: 200 len: 1320 microversion: 2.1 time: 0.299855 Jul 18 02:11:07.166330 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 454/920] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:06 2022] GET /compute/v2.1/servers/f19cf772-e042-4d44-96ef-6de52397472e => generated 1320 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:07.198433 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3fa944b7-daf8-45b1-b683-b472d39213a4 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: f77b267e-9a20-4943-aa8b-0c82b9d6d20e] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:11:07.206010 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7a1da814-d1ee-47e4-8dea-757627fb00b5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:07.207130 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7a1da814-d1ee-47e4-8dea-757627fb00b5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:07.232380 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7a1da814-d1ee-47e4-8dea-757627fb00b5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:07.233799 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7a1da814-d1ee-47e4-8dea-757627fb00b5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:07.234756 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7a1da814-d1ee-47e4-8dea-757627fb00b5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:07.235559 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7a1da814-d1ee-47e4-8dea-757627fb00b5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:07.316331 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3fa944b7-daf8-45b1-b683-b472d39213a4 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e" status: 204 len: 0 microversion: 2.1 time: 0.171978 Jul 18 02:11:07.320803 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 467/921] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:11:07 2022] DELETE /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:11:07.329246 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f1123e33-3980-4079-9e78-73f3848a5250 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:07.330283 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f1123e33-3980-4079-9e78-73f3848a5250 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 25dfb6dd-6d5a-4399-a348-0a162ca907ef] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:07.338520 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f1123e33-3980-4079-9e78-73f3848a5250 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:07.338978 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f1123e33-3980-4079-9e78-73f3848a5250 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:07.339774 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f1123e33-3980-4079-9e78-73f3848a5250 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:07.340215 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f1123e33-3980-4079-9e78-73f3848a5250 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:07.485269 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7a1da814-d1ee-47e4-8dea-757627fb00b5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:07.494510 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7a1da814-d1ee-47e4-8dea-757627fb00b5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 200 len: 1504 microversion: 2.1 time: 0.295888 Jul 18 02:11:07.495118 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 455/922] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:07 2022] GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 1504 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:11:07.501811 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ae7516cd-ba57-4834-a2f4-d963d3bcb376 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:07.502365 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ae7516cd-ba57-4834-a2f4-d963d3bcb376 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: f77b267e-9a20-4943-aa8b-0c82b9d6d20e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:07.526415 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ae7516cd-ba57-4834-a2f4-d963d3bcb376 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:07.526866 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ae7516cd-ba57-4834-a2f4-d963d3bcb376 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:07.528507 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ae7516cd-ba57-4834-a2f4-d963d3bcb376 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:07.529114 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ae7516cd-ba57-4834-a2f4-d963d3bcb376 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:07.596013 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f1123e33-3980-4079-9e78-73f3848a5250 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:07.605575 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f1123e33-3980-4079-9e78-73f3848a5250 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef" status: 200 len: 1498 microversion: 2.1 time: 0.282244 Jul 18 02:11:07.617747 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 468/923] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:07 2022] GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef => generated 1498 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:07.730910 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ae7516cd-ba57-4834-a2f4-d963d3bcb376 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60118d593f96437dbb2c68ad2fadd465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd02ce642caf4529a6e65c184de0ad19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:07.741040 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ae7516cd-ba57-4834-a2f4-d963d3bcb376 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e" status: 200 len: 1711 microversion: 2.1 time: 0.244824 Jul 18 02:11:07.741955 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 456/924] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:07 2022] GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e => generated 1711 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:07.835561 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d5bef965-eeb2-4610-b6a6-ef3edbb03572 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:07.836188 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d5bef965-eeb2-4610-b6a6-ef3edbb03572 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:07.848848 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d5bef965-eeb2-4610-b6a6-ef3edbb03572 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:07.849495 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d5bef965-eeb2-4610-b6a6-ef3edbb03572 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:07.850688 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d5bef965-eeb2-4610-b6a6-ef3edbb03572 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:07.851223 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d5bef965-eeb2-4610-b6a6-ef3edbb03572 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:07.877041 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ab35e770-5830-4274-b103-add6370ff234 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:07.878033 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ab35e770-5830-4274-b103-add6370ff234 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 5f8ec100-c407-4029-b30e-f863e75b4a17] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:07.887824 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ab35e770-5830-4274-b103-add6370ff234 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:07.888563 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ab35e770-5830-4274-b103-add6370ff234 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:07.890419 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ab35e770-5830-4274-b103-add6370ff234 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:07.891067 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ab35e770-5830-4274-b103-add6370ff234 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:08.288729 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=18 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:11:08.326078 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d5bef965-eeb2-4610-b6a6-ef3edbb03572 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:08.339538 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d5bef965-eeb2-4610-b6a6-ef3edbb03572 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1473 microversion: 2.1 time: 0.507914 Jul 18 02:11:08.350413 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 469/925] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:07 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1473 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:08.357816 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f1508fdd-e340-4972-815d-81c08b3df298 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:08.358801 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f1508fdd-e340-4972-815d-81c08b3df298 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] [instance: db3bcfcf-48cd-4f31-8adc-aee5c3e03184] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:08.374270 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f1508fdd-e340-4972-815d-81c08b3df298 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:08.375085 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f1508fdd-e340-4972-815d-81c08b3df298 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:08.376178 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f1508fdd-e340-4972-815d-81c08b3df298 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:08.376797 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f1508fdd-e340-4972-815d-81c08b3df298 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:08.428105 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ab35e770-5830-4274-b103-add6370ff234 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:08.444046 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ab35e770-5830-4274-b103-add6370ff234 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/5f8ec100-c407-4029-b30e-f863e75b4a17" status: 200 len: 1529 microversion: 2.1 time: 0.571116 Jul 18 02:11:08.445879 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 457/926] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:07 2022] GET /compute/v2.1/servers/5f8ec100-c407-4029-b30e-f863e75b4a17 => generated 1529 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:11:08.456710 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c4b0ba2c-3e9d-4e91-84f2-1e5a0718e1cd tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:08.458518 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c4b0ba2c-3e9d-4e91-84f2-1e5a0718e1cd tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: f19cf772-e042-4d44-96ef-6de52397472e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:08.467828 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c4b0ba2c-3e9d-4e91-84f2-1e5a0718e1cd tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:08.468427 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c4b0ba2c-3e9d-4e91-84f2-1e5a0718e1cd tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:08.469444 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c4b0ba2c-3e9d-4e91-84f2-1e5a0718e1cd tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:08.469922 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c4b0ba2c-3e9d-4e91-84f2-1e5a0718e1cd tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:08.677559 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f1508fdd-e340-4972-815d-81c08b3df298 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6698374ee5c4bf18440a2f382db3c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d7b11fb5cd420cb8dbb16208bccf91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:08.690189 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f1508fdd-e340-4972-815d-81c08b3df298 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] 10.222.0.57 "GET /compute/v2.1/servers/db3bcfcf-48cd-4f31-8adc-aee5c3e03184" status: 200 len: 1318 microversion: 2.1 time: 0.337399 Jul 18 02:11:08.691628 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 470/927] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:08 2022] GET /compute/v2.1/servers/db3bcfcf-48cd-4f31-8adc-aee5c3e03184 => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:08.706957 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-abaaeaca-678d-4b1b-9708-4c51997b9eb4 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:08.707575 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-abaaeaca-678d-4b1b-9708-4c51997b9eb4 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:08.715303 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-abaaeaca-678d-4b1b-9708-4c51997b9eb4 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:08.715757 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-abaaeaca-678d-4b1b-9708-4c51997b9eb4 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:08.716548 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-abaaeaca-678d-4b1b-9708-4c51997b9eb4 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:08.717044 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-abaaeaca-678d-4b1b-9708-4c51997b9eb4 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:08.851467 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c4b0ba2c-3e9d-4e91-84f2-1e5a0718e1cd tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6962b97241f4c3a9960bb5fe52f8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8e996befd24b26b0371ad9cdb4a069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:08.877287 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c4b0ba2c-3e9d-4e91-84f2-1e5a0718e1cd tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] 10.222.0.57 "GET /compute/v2.1/servers/f19cf772-e042-4d44-96ef-6de52397472e" status: 200 len: 1320 microversion: 2.1 time: 0.428458 Jul 18 02:11:08.880623 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 458/928] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:08 2022] GET /compute/v2.1/servers/f19cf772-e042-4d44-96ef-6de52397472e => generated 1320 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:08.893366 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-97422ff6-d5a0-485d-a85b-8f96b07d449b tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:08.897012 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-97422ff6-d5a0-485d-a85b-8f96b07d449b tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 25dfb6dd-6d5a-4399-a348-0a162ca907ef] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:08.916222 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-97422ff6-d5a0-485d-a85b-8f96b07d449b tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:08.918217 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-97422ff6-d5a0-485d-a85b-8f96b07d449b tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:08.921585 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-97422ff6-d5a0-485d-a85b-8f96b07d449b tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:08.924026 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-97422ff6-d5a0-485d-a85b-8f96b07d449b tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:08.978310 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-abaaeaca-678d-4b1b-9708-4c51997b9eb4 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:08.989420 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-abaaeaca-678d-4b1b-9708-4c51997b9eb4 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 200 len: 1504 microversion: 2.1 time: 0.287272 Jul 18 02:11:08.993094 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 471/929] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:08 2022] GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 1504 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:09.002674 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0a9d8303-711a-4771-a14e-5c67e1bbadf0 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:09.006320 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0a9d8303-711a-4771-a14e-5c67e1bbadf0 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: f77b267e-9a20-4943-aa8b-0c82b9d6d20e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:09.025525 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a9d8303-711a-4771-a14e-5c67e1bbadf0 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:09.027167 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a9d8303-711a-4771-a14e-5c67e1bbadf0 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:09.028261 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a9d8303-711a-4771-a14e-5c67e1bbadf0 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:09.031402 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a9d8303-711a-4771-a14e-5c67e1bbadf0 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:09.210620 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=8 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:11:09.658476 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0a9d8303-711a-4771-a14e-5c67e1bbadf0 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60118d593f96437dbb2c68ad2fadd465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd02ce642caf4529a6e65c184de0ad19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:09.694426 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0a9d8303-711a-4771-a14e-5c67e1bbadf0 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e" status: 200 len: 1711 microversion: 2.1 time: 0.698150 Jul 18 02:11:09.695969 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 472/930] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:08 2022] GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e => generated 1711 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:09.716182 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8ff43469-4a0b-40c4-9e6b-932a7d9ea38b tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:09.724221 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8ff43469-4a0b-40c4-9e6b-932a7d9ea38b tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:09.737979 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8ff43469-4a0b-40c4-9e6b-932a7d9ea38b tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:09.738185 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8ff43469-4a0b-40c4-9e6b-932a7d9ea38b tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:09.746748 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8ff43469-4a0b-40c4-9e6b-932a7d9ea38b tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:09.755805 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-97422ff6-d5a0-485d-a85b-8f96b07d449b tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:09.761868 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8ff43469-4a0b-40c4-9e6b-932a7d9ea38b tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:09.796638 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-97422ff6-d5a0-485d-a85b-8f96b07d449b tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef" status: 200 len: 1475 microversion: 2.1 time: 0.913196 Jul 18 02:11:09.804817 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 459/931] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:08 2022] GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef => generated 1475 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:09.827673 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ca6b06d5-9faf-412b-b0be-8ebaaed102d1 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:09.828744 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ca6b06d5-9faf-412b-b0be-8ebaaed102d1 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 5f8ec100-c407-4029-b30e-f863e75b4a17] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:09.841207 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ca6b06d5-9faf-412b-b0be-8ebaaed102d1 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:09.843735 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ca6b06d5-9faf-412b-b0be-8ebaaed102d1 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:09.854145 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ca6b06d5-9faf-412b-b0be-8ebaaed102d1 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:09.857080 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ca6b06d5-9faf-412b-b0be-8ebaaed102d1 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:10.067819 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ca6b06d5-9faf-412b-b0be-8ebaaed102d1 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ab51af53042138e5335e3ae6e5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1efcf9e224d66b7dbf31c8aa89f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:10.079061 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ca6b06d5-9faf-412b-b0be-8ebaaed102d1 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/5f8ec100-c407-4029-b30e-f863e75b4a17" status: 200 len: 1310 microversion: 2.1 time: 0.259809 Jul 18 02:11:10.080774 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 460/932] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:09 2022] GET /compute/v2.1/servers/5f8ec100-c407-4029-b30e-f863e75b4a17 => generated 1310 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:10.127579 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-22007607-9f55-44e0-83dd-0d4f96c5420a tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:10.129306 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-22007607-9f55-44e0-83dd-0d4f96c5420a tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] [instance: db3bcfcf-48cd-4f31-8adc-aee5c3e03184] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:10.138211 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-22007607-9f55-44e0-83dd-0d4f96c5420a tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:10.139255 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-22007607-9f55-44e0-83dd-0d4f96c5420a tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:10.140330 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-22007607-9f55-44e0-83dd-0d4f96c5420a tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:10.141010 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-22007607-9f55-44e0-83dd-0d4f96c5420a tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:10.150759 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8ff43469-4a0b-40c4-9e6b-932a7d9ea38b tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:10.166771 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8ff43469-4a0b-40c4-9e6b-932a7d9ea38b tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1473 microversion: 2.1 time: 0.462341 Jul 18 02:11:10.167322 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 473/933] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:09 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1473 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:10.182963 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-c5cf90ba-1ad0-443a-ba28-cff45c369127 req-cb220f4a-a931-4dbe-a54c-13f22d1d8da6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f8ec100-c407-4029-b30e-f863e75b4a17", "name": "network-vif-deleted", "tag": "c8ff716f-542d-47a0-8b54-f64ce60095ce"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:10.200460 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-c5cf90ba-1ad0-443a-ba28-cff45c369127 req-cb220f4a-a931-4dbe-a54c-13f22d1d8da6 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:10.201040 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-c5cf90ba-1ad0-443a-ba28-cff45c369127 req-cb220f4a-a931-4dbe-a54c-13f22d1d8da6 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:10.216504 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-c5cf90ba-1ad0-443a-ba28-cff45c369127 req-cb220f4a-a931-4dbe-a54c-13f22d1d8da6 service nova] Creating event network-vif-deleted:c8ff716f-542d-47a0-8b54-f64ce60095ce for instance 5f8ec100-c407-4029-b30e-f863e75b4a17 on n-h2-465891-3 Jul 18 02:11:10.226348 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-c5cf90ba-1ad0-443a-ba28-cff45c369127 req-cb220f4a-a931-4dbe-a54c-13f22d1d8da6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057575 Jul 18 02:11:10.227959 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 474/934] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:10.235325 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8dbd929a-c27a-4c8c-b711-6fdc60c9b8ed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1354452841"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:10.237024 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8dbd929a-c27a-4c8c-b711-6fdc60c9b8ed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 25dfb6dd-6d5a-4399-a348-0a162ca907ef] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:10.241077 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:11:10.247547 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8dbd929a-c27a-4c8c-b711-6fdc60c9b8ed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:10.249080 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8dbd929a-c27a-4c8c-b711-6fdc60c9b8ed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:10.250270 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8dbd929a-c27a-4c8c-b711-6fdc60c9b8ed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:10.251003 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8dbd929a-c27a-4c8c-b711-6fdc60c9b8ed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:10.728999 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8dbd929a-c27a-4c8c-b711-6fdc60c9b8ed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "POST /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef/action" status: 202 len: 0 microversion: 2.1 time: 0.497589 Jul 18 02:11:10.730285 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 475/935] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:11:10 2022] POST /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef/action => generated 0 bytes in 501 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 18 02:11:10.736995 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-521efaf1-109d-4b9f-9918-0743d2a3580c tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:10.737743 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-521efaf1-109d-4b9f-9918-0743d2a3580c tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: f19cf772-e042-4d44-96ef-6de52397472e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:10.762492 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-521efaf1-109d-4b9f-9918-0743d2a3580c tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:10.763054 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-521efaf1-109d-4b9f-9918-0743d2a3580c tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:10.764173 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-521efaf1-109d-4b9f-9918-0743d2a3580c tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:10.764634 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-521efaf1-109d-4b9f-9918-0743d2a3580c tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:10.908145 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-22007607-9f55-44e0-83dd-0d4f96c5420a tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6698374ee5c4bf18440a2f382db3c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d7b11fb5cd420cb8dbb16208bccf91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:10.952183 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-22007607-9f55-44e0-83dd-0d4f96c5420a tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] 10.222.0.57 "GET /compute/v2.1/servers/db3bcfcf-48cd-4f31-8adc-aee5c3e03184" status: 200 len: 1467 microversion: 2.1 time: 0.854750 Jul 18 02:11:10.967231 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 461/936] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:10 2022] GET /compute/v2.1/servers/db3bcfcf-48cd-4f31-8adc-aee5c3e03184 => generated 1467 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:10.979720 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cabecee2-efe2-4b09-996e-95141fdc2fad tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:10.981610 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cabecee2-efe2-4b09-996e-95141fdc2fad tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:11.002253 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cabecee2-efe2-4b09-996e-95141fdc2fad tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:11.002704 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cabecee2-efe2-4b09-996e-95141fdc2fad tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:11.003724 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cabecee2-efe2-4b09-996e-95141fdc2fad tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:11.004328 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cabecee2-efe2-4b09-996e-95141fdc2fad tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:11.170378 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-521efaf1-109d-4b9f-9918-0743d2a3580c tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6962b97241f4c3a9960bb5fe52f8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8e996befd24b26b0371ad9cdb4a069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:11.197729 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-521efaf1-109d-4b9f-9918-0743d2a3580c tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] 10.222.0.57 "GET /compute/v2.1/servers/f19cf772-e042-4d44-96ef-6de52397472e" status: 200 len: 1320 microversion: 2.1 time: 0.466037 Jul 18 02:11:11.209899 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 476/937] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:10 2022] GET /compute/v2.1/servers/f19cf772-e042-4d44-96ef-6de52397472e => generated 1320 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:11.229479 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-63a909b2-8409-416e-9e6c-de48b2486438 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:11.231676 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-63a909b2-8409-416e-9e6c-de48b2486438 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: f77b267e-9a20-4943-aa8b-0c82b9d6d20e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:11.253446 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-63a909b2-8409-416e-9e6c-de48b2486438 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:11.256229 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-63a909b2-8409-416e-9e6c-de48b2486438 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:11.262434 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-63a909b2-8409-416e-9e6c-de48b2486438 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:11.263319 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-63a909b2-8409-416e-9e6c-de48b2486438 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:11.327029 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:11:11.631757 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cabecee2-efe2-4b09-996e-95141fdc2fad tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:11.643668 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cabecee2-efe2-4b09-996e-95141fdc2fad tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 200 len: 1504 microversion: 2.1 time: 0.674854 Jul 18 02:11:11.645060 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 462/938] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:10 2022] GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 1504 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:11.651464 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fbb912ba-2f3c-4ee9-be08-dc4dcb499876 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a913ef70>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:11.726541 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fbb912ba-2f3c-4ee9-be08-dc4dcb499876 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/48443bda-c7c8-463b-b521-129df053a409" status: 200 len: 1410 microversion: 2.1 time: 0.080020 Jul 18 02:11:11.727452 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 463/939] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:11:11 2022] GET /compute/v2.1/images/48443bda-c7c8-463b-b521-129df053a409 => generated 1410 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:11.737835 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-06f72c16-0a50-48b1-a760-8db1b265ddb3 tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:11.738405 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-06f72c16-0a50-48b1-a760-8db1b265ddb3 tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] [instance: db3bcfcf-48cd-4f31-8adc-aee5c3e03184] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:11.836176 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-06f72c16-0a50-48b1-a760-8db1b265ddb3 tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:11.838732 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-06f72c16-0a50-48b1-a760-8db1b265ddb3 tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:11.839741 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-06f72c16-0a50-48b1-a760-8db1b265ddb3 tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:11.840304 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-06f72c16-0a50-48b1-a760-8db1b265ddb3 tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:11.861674 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-63a909b2-8409-416e-9e6c-de48b2486438 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60118d593f96437dbb2c68ad2fadd465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd02ce642caf4529a6e65c184de0ad19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:11.881834 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-63a909b2-8409-416e-9e6c-de48b2486438 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e" status: 200 len: 1711 microversion: 2.1 time: 0.669802 Jul 18 02:11:11.882754 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 477/940] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:11 2022] GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e => generated 1711 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:11.893000 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b4011d63-4bed-4ea9-b83b-9d38186c45cb tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:11.897353 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b4011d63-4bed-4ea9-b83b-9d38186c45cb tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 5f8ec100-c407-4029-b30e-f863e75b4a17] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:11.910018 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b4011d63-4bed-4ea9-b83b-9d38186c45cb tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:11.910882 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b4011d63-4bed-4ea9-b83b-9d38186c45cb tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:11.911968 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b4011d63-4bed-4ea9-b83b-9d38186c45cb tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:11.925963 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-06f72c16-0a50-48b1-a760-8db1b265ddb3 tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] Lazy-loading 'flavor' on Instance uuid db3bcfcf-48cd-4f31-8adc-aee5c3e03184 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:11:11.926861 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b4011d63-4bed-4ea9-b83b-9d38186c45cb tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:11.940143 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:11:11.959635 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-b4011d63-4bed-4ea9-b83b-9d38186c45cb tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] HTTP exception thrown: Instance 5f8ec100-c407-4029-b30e-f863e75b4a17 could not be found. Jul 18 02:11:11.961870 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b4011d63-4bed-4ea9-b83b-9d38186c45cb tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Request method failure captured: Jul 18 02:11:11.961870 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/5f8ec100-c407-4029-b30e-f863e75b4a17 HTTP/1.1 Jul 18 02:11:11.961870 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:11:11.961870 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:11:11.961870 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:11:11.961870 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:11:11.961870 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:11:11.961870 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:11:11.961870 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:11:11.961870 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:11:11.961870 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MDHcKkxv785TruBaYZ9isdDskpkSTXS63FySdEQ2DQWlYCoBeefqvgfCQf6lXL0HIcBKCVhVPgBeigtx_Fr6JAMpyAfBIDaZdUpBEZ_ARmYr58LYp6mJVoQMeV86GVtrWumVWYiUwrWzpXpGhfDxCZstFRul6eTjV0GKZX_II9Blls Jul 18 02:11:11.961870 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:11:11.961870 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:11:11.961870 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:11:11.961870 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:11:11.961870 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:11:11.961870 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:11:11.961870 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: d6b1efcf9e224d66b7dbf31c8aa89f87 Jul 18 02:11:11.961870 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-872437023 Jul 18 02:11:11.961870 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:11:11.961870 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:11:11.964026 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d6b1efcf9e224d66b7dbf31c8aa89f87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d6b1efcf9e224d66b7dbf31c8aa89f87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d6b1efcf9e224d66b7dbf31c8aa89f87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d6b1efcf9e224d66b7dbf31c8aa89f87"}]}] Jul 18 02:11:11.964026 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-872437023 Jul 18 02:11:11.964026 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: d6b1efcf9e224d66b7dbf31c8aa89f87 Jul 18 02:11:11.964026 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-872437023 Jul 18 02:11:11.964026 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ImagesOneServerNegativeTestJSON-872437023-project Jul 18 02:11:11.964026 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:11:11.964026 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:11:11.964026 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 625ab51af53042138e5335e3ae6e5dac Jul 18 02:11:11.964026 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-872437023-project Jul 18 02:11:11.964026 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:11:11.964026 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 5f8ec100-c407-4029-b30e-f863e75b4a17 could not be found. Jul 18 02:11:11.964026 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '5f8ec100-c407-4029-b30e-f863e75b4a17'} Jul 18 02:11:11.964799 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:11:11.964799 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:11.964799 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:11:11.964799 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:11:11.964799 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:11:11.964799 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:11:11.964799 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:11:11.964799 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:11:11.964799 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:11:11.964799 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:11:11.964799 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f8ec100-c407-4029-b30e-f863e75b4a17 could not be found. Jul 18 02:11:11.964799 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:11.964799 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:11.964799 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:11.964799 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:11.964799 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:11.964799 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:11.964799 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:11:11.964799 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:11:11.964799 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:11:11.967058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:11:11.967058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:11:11.967058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:11:11.967058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:11:11.967058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:11:11.967058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:11:11.967058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:11:11.967058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f8ec100-c407-4029-b30e-f863e75b4a17 could not be found. Jul 18 02:11:11.967058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:11.967058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:11.967058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:11.967058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:11.967058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:11.967058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:11.967058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:11:11.967058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:11:11.967058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f8ec100-c407-4029-b30e-f863e75b4a17 could not be found. Jul 18 02:11:11.967058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:11.970568 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b4011d63-4bed-4ea9-b83b-9d38186c45cb tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Returning 404 to user: Instance 5f8ec100-c407-4029-b30e-f863e75b4a17 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:11:11.971751 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b4011d63-4bed-4ea9-b83b-9d38186c45cb tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/5f8ec100-c407-4029-b30e-f863e75b4a17" status: 404 len: 111 microversion: 2.1 time: 0.087749 Jul 18 02:11:11.976433 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 478/941] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:11 2022] GET /compute/v2.1/servers/5f8ec100-c407-4029-b30e-f863e75b4a17 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:11:11.984384 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ebe0e777-2bc2-4ee9-9019-c99e0ee87c40 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:11.985373 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ebe0e777-2bc2-4ee9-9019-c99e0ee87c40 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:11.992723 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ebe0e777-2bc2-4ee9-9019-c99e0ee87c40 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:11.995063 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ebe0e777-2bc2-4ee9-9019-c99e0ee87c40 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:11.996280 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ebe0e777-2bc2-4ee9-9019-c99e0ee87c40 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:11.997108 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ebe0e777-2bc2-4ee9-9019-c99e0ee87c40 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:12.105604 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-06f72c16-0a50-48b1-a760-8db1b265ddb3 tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/db3bcfcf-48cd-4f31-8adc-aee5c3e03184/action" status: 202 len: 0 microversion: 2.1 time: 0.376793 Jul 18 02:11:12.110733 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 464/942] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:11:11 2022] POST /compute/v2.1/servers/db3bcfcf-48cd-4f31-8adc-aee5c3e03184/action => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:11:12.132741 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0b4c25a3-f61a-40e6-9460-f0005fca8b23 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '.version_select at 0x7ff4a95be280>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:12.210211 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-0b4c25a3-f61a-40e6-9460-f0005fca8b23 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] HTTP exception thrown: Image not found. Jul 18 02:11:12.217813 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0b4c25a3-f61a-40e6-9460-f0005fca8b23 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Request method failure captured: Jul 18 02:11:12.217813 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/images/52ec26bb-06e3-4aa7-b31b-56eff33401de HTTP/1.1 Jul 18 02:11:12.217813 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:11:12.217813 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:11:12.217813 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:11:12.217813 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:11:12.217813 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:11:12.217813 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:11:12.217813 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:11:12.217813 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:11:12.217813 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MDHcKkxv785TruBaYZ9isdDskpkSTXS63FySdEQ2DQWlYCoBeefqvgfCQf6lXL0HIcBKCVhVPgBeigtx_Fr6JAMpyAfBIDaZdUpBEZ_ARmYr58LYp6mJVoQMeV86GVtrWumVWYiUwrWzpXpGhfDxCZstFRul6eTjV0GKZX_II9Blls Jul 18 02:11:12.217813 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:11:12.217813 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:11:12.217813 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:11:12.217813 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:11:12.217813 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:11:12.217813 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:11:12.217813 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: d6b1efcf9e224d66b7dbf31c8aa89f87 Jul 18 02:11:12.217813 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-872437023 Jul 18 02:11:12.217813 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:11:12.217813 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:11:12.220883 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d6b1efcf9e224d66b7dbf31c8aa89f87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d6b1efcf9e224d66b7dbf31c8aa89f87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d6b1efcf9e224d66b7dbf31c8aa89f87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d6b1efcf9e224d66b7dbf31c8aa89f87"}]}] Jul 18 02:11:12.220883 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-872437023 Jul 18 02:11:12.220883 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: d6b1efcf9e224d66b7dbf31c8aa89f87 Jul 18 02:11:12.220883 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-872437023 Jul 18 02:11:12.220883 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ImagesOneServerNegativeTestJSON-872437023-project Jul 18 02:11:12.220883 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:11:12.220883 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:11:12.220883 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 625ab51af53042138e5335e3ae6e5dac Jul 18 02:11:12.220883 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-872437023-project Jul 18 02:11:12.220883 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:11:12.220883 n-d-465891-3 devstack@n-api.service[119543]: exception: Image not found. Jul 18 02:11:12.220883 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '52ec26bb-06e3-4aa7-b31b-56eff33401de'} Jul 18 02:11:12.220883 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:11:12.222703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:12.222703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 18 02:11:12.222703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 18 02:11:12.222703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:11:12.222703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:11:12.222703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:11:12.222703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:11:12.222703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 18 02:11:12.222703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 18 02:11:12.222703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 18 02:11:12.222703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 18 02:11:12.222703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:11:12.222703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:11:12.222703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:11:12.222703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:11:12.222703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 52ec26bb-06e3-4aa7-b31b-56eff33401de to delete Jul 18 02:11:12.222703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:12.222703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:12.222703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:12.227859 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:12.227859 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 18 02:11:12.227859 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 18 02:11:12.227859 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 18 02:11:12.227859 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 18 02:11:12.227859 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 18 02:11:12.227859 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 18 02:11:12.227859 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 52ec26bb-06e3-4aa7-b31b-56eff33401de could not be found. Jul 18 02:11:12.227859 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:12.227859 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:12.227859 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:12.227859 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:12.227859 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:12.227859 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:12.227859 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:11:12.227859 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:11:12.227859 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:11:12.227859 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:11:12.227859 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:11:12.227859 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:11:12.230611 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 18 02:11:12.230611 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 02:11:12.230611 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:11:12.230611 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:12.230611 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:12.230611 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:12.230611 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:12.230611 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:12.230611 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:12.230611 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:11:12.230611 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:11:12.230611 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:11:12.230611 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:12.235539 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0b4c25a3-f61a-40e6-9460-f0005fca8b23 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Returning 404 to user: Image not found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:11:12.236067 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0b4c25a3-f61a-40e6-9460-f0005fca8b23 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "DELETE /compute/v2.1/images/52ec26bb-06e3-4aa7-b31b-56eff33401de" status: 404 len: 62 microversion: 2.1 time: 0.119699 Jul 18 02:11:12.245308 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 465/943] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:12 2022] DELETE /compute/v2.1/images/52ec26bb-06e3-4aa7-b31b-56eff33401de => generated 62 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:11:12.260144 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c9c4ab48-a7c0-4711-af89-d94780e954e2 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:12.262605 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c9c4ab48-a7c0-4711-af89-d94780e954e2 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] [instance: db3bcfcf-48cd-4f31-8adc-aee5c3e03184] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:12.281544 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c9c4ab48-a7c0-4711-af89-d94780e954e2 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:12.282887 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c9c4ab48-a7c0-4711-af89-d94780e954e2 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:12.284924 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c9c4ab48-a7c0-4711-af89-d94780e954e2 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:12.286282 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c9c4ab48-a7c0-4711-af89-d94780e954e2 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:12.635020 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ebe0e777-2bc2-4ee9-9019-c99e0ee87c40 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:12.648029 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ebe0e777-2bc2-4ee9-9019-c99e0ee87c40 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1473 microversion: 2.1 time: 0.668782 Jul 18 02:11:12.649157 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 479/944] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:11 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1473 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:12.655638 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c9c4ab48-a7c0-4711-af89-d94780e954e2 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6698374ee5c4bf18440a2f382db3c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d7b11fb5cd420cb8dbb16208bccf91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:12.657763 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-efcefa79-03ff-43bc-bffc-539e95c1faae tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:12.658521 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-efcefa79-03ff-43bc-bffc-539e95c1faae tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: f19cf772-e042-4d44-96ef-6de52397472e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:12.665486 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-efcefa79-03ff-43bc-bffc-539e95c1faae tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:12.667194 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-efcefa79-03ff-43bc-bffc-539e95c1faae tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:12.667194 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-efcefa79-03ff-43bc-bffc-539e95c1faae tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:12.667194 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-efcefa79-03ff-43bc-bffc-539e95c1faae tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:12.671397 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c9c4ab48-a7c0-4711-af89-d94780e954e2 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] 10.222.0.57 "GET /compute/v2.1/servers/db3bcfcf-48cd-4f31-8adc-aee5c3e03184" status: 200 len: 1475 microversion: 2.1 time: 0.419173 Jul 18 02:11:12.682196 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 466/945] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:12 2022] GET /compute/v2.1/servers/db3bcfcf-48cd-4f31-8adc-aee5c3e03184 => generated 1475 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:12.682196 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cceaab46-4ca2-4353-938e-20296b9906d6 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:12.682196 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cceaab46-4ca2-4353-938e-20296b9906d6 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 25f8645e-70fa-4fc4-ae8f-ee303c090469] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:12.688680 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cceaab46-4ca2-4353-938e-20296b9906d6 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:12.689359 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cceaab46-4ca2-4353-938e-20296b9906d6 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:12.690304 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cceaab46-4ca2-4353-938e-20296b9906d6 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:12.690827 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cceaab46-4ca2-4353-938e-20296b9906d6 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:12.707962 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-cceaab46-4ca2-4353-938e-20296b9906d6 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] HTTP exception thrown: Instance 25f8645e-70fa-4fc4-ae8f-ee303c090469 could not be found. Jul 18 02:11:12.710581 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cceaab46-4ca2-4353-938e-20296b9906d6 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Request method failure captured: Jul 18 02:11:12.710581 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469 HTTP/1.1 Jul 18 02:11:12.710581 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:11:12.710581 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:11:12.710581 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:11:12.710581 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:11:12.710581 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:11:12.710581 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:11:12.710581 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:11:12.710581 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:11:12.710581 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MDHcKkxv785TruBaYZ9isdDskpkSTXS63FySdEQ2DQWlYCoBeefqvgfCQf6lXL0HIcBKCVhVPgBeigtx_Fr6JAMpyAfBIDaZdUpBEZ_ARmYr58LYp6mJVoQMeV86GVtrWumVWYiUwrWzpXpGhfDxCZstFRul6eTjV0GKZX_II9Blls Jul 18 02:11:12.710581 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:11:12.710581 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:11:12.710581 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:11:12.710581 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:11:12.710581 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:11:12.710581 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:11:12.710581 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: d6b1efcf9e224d66b7dbf31c8aa89f87 Jul 18 02:11:12.710581 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-872437023 Jul 18 02:11:12.710581 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:11:12.710581 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:11:12.712605 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d6b1efcf9e224d66b7dbf31c8aa89f87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d6b1efcf9e224d66b7dbf31c8aa89f87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d6b1efcf9e224d66b7dbf31c8aa89f87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d6b1efcf9e224d66b7dbf31c8aa89f87"}]}] Jul 18 02:11:12.712605 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-872437023 Jul 18 02:11:12.712605 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: d6b1efcf9e224d66b7dbf31c8aa89f87 Jul 18 02:11:12.712605 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-872437023 Jul 18 02:11:12.712605 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ImagesOneServerNegativeTestJSON-872437023-project Jul 18 02:11:12.712605 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:11:12.712605 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:11:12.712605 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 625ab51af53042138e5335e3ae6e5dac Jul 18 02:11:12.712605 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-872437023-project Jul 18 02:11:12.712605 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:11:12.712605 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 25f8645e-70fa-4fc4-ae8f-ee303c090469 could not be found. Jul 18 02:11:12.712605 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '25f8645e-70fa-4fc4-ae8f-ee303c090469'} Jul 18 02:11:12.713559 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:11:12.713559 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:12.713559 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:11:12.713559 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:11:12.713559 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:11:12.713559 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:11:12.713559 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:11:12.713559 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:11:12.713559 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:11:12.713559 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:11:12.713559 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25f8645e-70fa-4fc4-ae8f-ee303c090469 could not be found. Jul 18 02:11:12.713559 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:12.713559 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:12.713559 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:12.713559 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:12.713559 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:12.713559 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:12.713559 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:11:12.713559 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:11:12.713559 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:11:12.715374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:11:12.715374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:11:12.715374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:11:12.715374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:11:12.715374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:11:12.715374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:11:12.715374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:11:12.715374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:11:12.715374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:11:12.715374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25f8645e-70fa-4fc4-ae8f-ee303c090469 could not be found. Jul 18 02:11:12.715374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:12.715374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:12.715374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:12.715374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:12.715374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:12.715374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:12.715374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:11:12.715374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:11:12.715374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25f8645e-70fa-4fc4-ae8f-ee303c090469 could not be found. Jul 18 02:11:12.715374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:12.717501 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cceaab46-4ca2-4353-938e-20296b9906d6 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Returning 404 to user: Instance 25f8645e-70fa-4fc4-ae8f-ee303c090469 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:11:12.717501 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cceaab46-4ca2-4353-938e-20296b9906d6 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "DELETE /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469" status: 404 len: 111 microversion: 2.1 time: 0.040864 Jul 18 02:11:12.717501 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 467/946] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:11:12 2022] DELETE /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:11:12.723769 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3fed17aa-d40a-4626-a40a-7d1d29de313b tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:12.724624 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3fed17aa-d40a-4626-a40a-7d1d29de313b tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:12.735593 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3fed17aa-d40a-4626-a40a-7d1d29de313b tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:12.736253 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3fed17aa-d40a-4626-a40a-7d1d29de313b tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:12.737679 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3fed17aa-d40a-4626-a40a-7d1d29de313b tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:12.737679 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3fed17aa-d40a-4626-a40a-7d1d29de313b tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:13.073754 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-efcefa79-03ff-43bc-bffc-539e95c1faae tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6962b97241f4c3a9960bb5fe52f8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8e996befd24b26b0371ad9cdb4a069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:13.092572 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-efcefa79-03ff-43bc-bffc-539e95c1faae tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] 10.222.0.57 "GET /compute/v2.1/servers/f19cf772-e042-4d44-96ef-6de52397472e" status: 200 len: 1320 microversion: 2.1 time: 0.439164 Jul 18 02:11:13.093180 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 480/947] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:12 2022] GET /compute/v2.1/servers/f19cf772-e042-4d44-96ef-6de52397472e => generated 1320 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:13.118483 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3fed17aa-d40a-4626-a40a-7d1d29de313b tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:13.121053 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-26531dd5-910f-4b71-ae7f-729638cf76d3 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:13.122026 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-26531dd5-910f-4b71-ae7f-729638cf76d3 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: 25f8645e-70fa-4fc4-ae8f-ee303c090469] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:13.129408 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26531dd5-910f-4b71-ae7f-729638cf76d3 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:13.130380 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26531dd5-910f-4b71-ae7f-729638cf76d3 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:13.131409 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26531dd5-910f-4b71-ae7f-729638cf76d3 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:13.132029 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26531dd5-910f-4b71-ae7f-729638cf76d3 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:13.151058 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-26531dd5-910f-4b71-ae7f-729638cf76d3 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] HTTP exception thrown: Instance 25f8645e-70fa-4fc4-ae8f-ee303c090469 could not be found. Jul 18 02:11:13.153020 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-26531dd5-910f-4b71-ae7f-729638cf76d3 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Request method failure captured: Jul 18 02:11:13.153020 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469 HTTP/1.1 Jul 18 02:11:13.153020 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:11:13.153020 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:11:13.153020 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:11:13.153020 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:11:13.153020 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:11:13.153020 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:11:13.153020 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:11:13.153020 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:11:13.153020 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MDHcKkxv785TruBaYZ9isdDskpkSTXS63FySdEQ2DQWlYCoBeefqvgfCQf6lXL0HIcBKCVhVPgBeigtx_Fr6JAMpyAfBIDaZdUpBEZ_ARmYr58LYp6mJVoQMeV86GVtrWumVWYiUwrWzpXpGhfDxCZstFRul6eTjV0GKZX_II9Blls Jul 18 02:11:13.153020 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:11:13.153020 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:11:13.153020 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:11:13.153020 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:11:13.153020 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:11:13.153020 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:11:13.153020 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: d6b1efcf9e224d66b7dbf31c8aa89f87 Jul 18 02:11:13.153020 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-872437023 Jul 18 02:11:13.153020 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:11:13.153020 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:11:13.154455 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d6b1efcf9e224d66b7dbf31c8aa89f87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d6b1efcf9e224d66b7dbf31c8aa89f87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d6b1efcf9e224d66b7dbf31c8aa89f87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d6b1efcf9e224d66b7dbf31c8aa89f87"}]}] Jul 18 02:11:13.154455 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-872437023 Jul 18 02:11:13.154455 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: d6b1efcf9e224d66b7dbf31c8aa89f87 Jul 18 02:11:13.154455 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-872437023 Jul 18 02:11:13.154455 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ImagesOneServerNegativeTestJSON-872437023-project Jul 18 02:11:13.154455 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:11:13.154455 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:11:13.154455 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 625ab51af53042138e5335e3ae6e5dac Jul 18 02:11:13.154455 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-872437023-project Jul 18 02:11:13.154455 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:11:13.154455 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 25f8645e-70fa-4fc4-ae8f-ee303c090469 could not be found. Jul 18 02:11:13.154455 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '25f8645e-70fa-4fc4-ae8f-ee303c090469'} Jul 18 02:11:13.155977 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:11:13.155977 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:13.155977 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:11:13.155977 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:11:13.155977 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:11:13.155977 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:11:13.155977 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:11:13.155977 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:11:13.155977 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:11:13.155977 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:11:13.155977 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25f8645e-70fa-4fc4-ae8f-ee303c090469 could not be found. Jul 18 02:11:13.155977 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:13.155977 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:13.155977 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:13.155977 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:13.155977 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:13.155977 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:13.155977 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:11:13.155977 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:11:13.155977 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:11:13.157657 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:11:13.157657 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:11:13.157657 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:11:13.157657 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:11:13.157657 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:11:13.157657 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:11:13.157657 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:11:13.157657 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25f8645e-70fa-4fc4-ae8f-ee303c090469 could not be found. Jul 18 02:11:13.157657 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:13.157657 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:13.157657 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:13.157657 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:13.157657 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:13.157657 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:13.157657 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:11:13.157657 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:11:13.157657 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25f8645e-70fa-4fc4-ae8f-ee303c090469 could not be found. Jul 18 02:11:13.157657 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:13.161090 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-26531dd5-910f-4b71-ae7f-729638cf76d3 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Returning 404 to user: Instance 25f8645e-70fa-4fc4-ae8f-ee303c090469 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:11:13.162235 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-26531dd5-910f-4b71-ae7f-729638cf76d3 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469" status: 404 len: 111 microversion: 2.1 time: 0.048130 Jul 18 02:11:13.163294 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 481/948] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:13 2022] GET /compute/v2.1/servers/25f8645e-70fa-4fc4-ae8f-ee303c090469 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:11:13.168839 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-325edce7-98da-4590-bcec-a2d108766aab tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a8a13ca0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:13.169978 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3fed17aa-d40a-4626-a40a-7d1d29de313b tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 200 len: 1494 microversion: 2.1 time: 0.450607 Jul 18 02:11:13.193740 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 468/949] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:12 2022] GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 1494 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:13.214865 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8ef82233-24d5-4077-ba90-6c66e62ab2e0 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:13.217236 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8ef82233-24d5-4077-ba90-6c66e62ab2e0 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: f77b267e-9a20-4943-aa8b-0c82b9d6d20e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:13.232532 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8ef82233-24d5-4077-ba90-6c66e62ab2e0 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:13.234498 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8ef82233-24d5-4077-ba90-6c66e62ab2e0 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:13.235509 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-325edce7-98da-4590-bcec-a2d108766aab tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/48443bda-c7c8-463b-b521-129df053a409" status: 200 len: 1410 microversion: 2.1 time: 0.068575 Jul 18 02:11:13.241861 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 482/950] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:11:13 2022] GET /compute/v2.1/images/48443bda-c7c8-463b-b521-129df053a409 => generated 1410 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:13.245661 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8ef82233-24d5-4077-ba90-6c66e62ab2e0 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:13.246512 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8ef82233-24d5-4077-ba90-6c66e62ab2e0 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:13.248467 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-487d8d74-8939-4a83-bb5d-593812ea2cc1 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '.version_select at 0x7ff4a8a11700>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:13.284007 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-487d8d74-8939-4a83-bb5d-593812ea2cc1 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1594031962" status: 202 len: 0 microversion: 2.1 time: 0.040455 Jul 18 02:11:13.284989 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 483/951] 10.222.0.57 () {58 vars in 1220 bytes} [Mon Jul 18 02:11:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1594031962 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:11:13.291095 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a1345d65-18fb-48c4-bd62-a95639feac6a tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Calling method '.version_select at 0x7ff4a8a9c160>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:13.296748 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a1345d65-18fb-48c4-bd62-a95639feac6a tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:13.302101 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a1345d65-18fb-48c4-bd62-a95639feac6a tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:13.356891 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a1345d65-18fb-48c4-bd62-a95639feac6a tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] 10.222.0.57 "GET /compute/v2.1/os-migrations" status: 200 len: 398 microversion: 2.1 time: 0.070249 Jul 18 02:11:13.368934 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 484/952] 10.222.0.57 () {58 vars in 1142 bytes} [Mon Jul 18 02:11:13 2022] GET /compute/v2.1/os-migrations => generated 398 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:13.396554 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-26fe1ff1-d7be-4b7e-8191-b5621ed1d40d tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:13.397540 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-26fe1ff1-d7be-4b7e-8191-b5621ed1d40d tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:13.413178 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26fe1ff1-d7be-4b7e-8191-b5621ed1d40d tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:13.413931 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26fe1ff1-d7be-4b7e-8191-b5621ed1d40d tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:13.416166 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26fe1ff1-d7be-4b7e-8191-b5621ed1d40d tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:13.416958 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26fe1ff1-d7be-4b7e-8191-b5621ed1d40d tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:13.500564 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8ef82233-24d5-4077-ba90-6c66e62ab2e0 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60118d593f96437dbb2c68ad2fadd465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd02ce642caf4529a6e65c184de0ad19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:13.523547 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8ef82233-24d5-4077-ba90-6c66e62ab2e0 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e" status: 200 len: 1644 microversion: 2.1 time: 0.328209 Jul 18 02:11:13.526562 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 469/953] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:13 2022] GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e => generated 1644 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:13.599969 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-408a9a24-580c-49a3-8e27-2dd3bb404556 req-ae746e42-e9c4-43c6-9837-c90dfd3c76d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f77b267e-9a20-4943-aa8b-0c82b9d6d20e", "name": "network-vif-deleted", "tag": "3cecd7e8-61af-4808-991a-e40ca83842b0"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:13.624122 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-408a9a24-580c-49a3-8e27-2dd3bb404556 req-ae746e42-e9c4-43c6-9837-c90dfd3c76d6 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:13.627081 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-408a9a24-580c-49a3-8e27-2dd3bb404556 req-ae746e42-e9c4-43c6-9837-c90dfd3c76d6 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:13.660916 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-408a9a24-580c-49a3-8e27-2dd3bb404556 req-ae746e42-e9c4-43c6-9837-c90dfd3c76d6 service nova] Creating event network-vif-deleted:3cecd7e8-61af-4808-991a-e40ca83842b0 for instance f77b267e-9a20-4943-aa8b-0c82b9d6d20e on n-h1-465891-3 Jul 18 02:11:13.676927 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-408a9a24-580c-49a3-8e27-2dd3bb404556 req-ae746e42-e9c4-43c6-9837-c90dfd3c76d6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080870 Jul 18 02:11:13.678968 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 470/954] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:13.690803 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ca4f188d-4f0a-4fa6-b8b4-fd4783fa8532 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:13.696667 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ca4f188d-4f0a-4fa6-b8b4-fd4783fa8532 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:13.716556 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ca4f188d-4f0a-4fa6-b8b4-fd4783fa8532 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:13.717068 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ca4f188d-4f0a-4fa6-b8b4-fd4783fa8532 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:13.718634 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ca4f188d-4f0a-4fa6-b8b4-fd4783fa8532 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:13.719301 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ca4f188d-4f0a-4fa6-b8b4-fd4783fa8532 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:14.199707 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-26fe1ff1-d7be-4b7e-8191-b5621ed1d40d tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 200 len: 1645 microversion: 2.1 time: 0.819374 Jul 18 02:11:14.201194 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 485/955] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:13 2022] GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 1645 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:14.243971 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d7203fe5-f66e-4e4f-9d41-19a1f9033cc7 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:14.244868 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d7203fe5-f66e-4e4f-9d41-19a1f9033cc7 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] [instance: db3bcfcf-48cd-4f31-8adc-aee5c3e03184] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:14.278949 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d7203fe5-f66e-4e4f-9d41-19a1f9033cc7 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:14.279713 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ca4f188d-4f0a-4fa6-b8b4-fd4783fa8532 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:14.281218 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d7203fe5-f66e-4e4f-9d41-19a1f9033cc7 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:14.282722 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d7203fe5-f66e-4e4f-9d41-19a1f9033cc7 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:14.283566 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d7203fe5-f66e-4e4f-9d41-19a1f9033cc7 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:14.314526 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ca4f188d-4f0a-4fa6-b8b4-fd4783fa8532 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1473 microversion: 2.1 time: 0.628465 Jul 18 02:11:14.315505 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 471/956] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:13 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1473 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:14.320554 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-47f398c0-8885-4095-9ecf-7a64711027fb req-a0f53a9e-a33f-4df5-a4ec-a0d401ee4bfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f19cf772-e042-4d44-96ef-6de52397472e", "name": "network-vif-plugged", "status": "completed", "tag": "52630cf0-3815-4f5f-9665-37e9a31ca48b"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:14.347617 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:11:14.351705 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-47f398c0-8885-4095-9ecf-7a64711027fb req-a0f53a9e-a33f-4df5-a4ec-a0d401ee4bfe service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:14.353919 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-47f398c0-8885-4095-9ecf-7a64711027fb req-a0f53a9e-a33f-4df5-a4ec-a0d401ee4bfe service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:14.386327 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-47f398c0-8885-4095-9ecf-7a64711027fb req-a0f53a9e-a33f-4df5-a4ec-a0d401ee4bfe service nova] Creating event network-vif-plugged:52630cf0-3815-4f5f-9665-37e9a31ca48b for instance f19cf772-e042-4d44-96ef-6de52397472e on n-h1-465891-3 Jul 18 02:11:14.396948 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-47f398c0-8885-4095-9ecf-7a64711027fb req-a0f53a9e-a33f-4df5-a4ec-a0d401ee4bfe service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079638 Jul 18 02:11:14.398927 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 472/957] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:14.412157 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f12b8708-f7eb-4a6b-9823-5a73dc6a0db1 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:14.413600 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f12b8708-f7eb-4a6b-9823-5a73dc6a0db1 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: f19cf772-e042-4d44-96ef-6de52397472e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:14.428911 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f12b8708-f7eb-4a6b-9823-5a73dc6a0db1 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:14.430457 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f12b8708-f7eb-4a6b-9823-5a73dc6a0db1 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:14.432221 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f12b8708-f7eb-4a6b-9823-5a73dc6a0db1 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:14.433150 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f12b8708-f7eb-4a6b-9823-5a73dc6a0db1 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:14.706558 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d7203fe5-f66e-4e4f-9d41-19a1f9033cc7 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6698374ee5c4bf18440a2f382db3c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d7b11fb5cd420cb8dbb16208bccf91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:14.755067 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d7203fe5-f66e-4e4f-9d41-19a1f9033cc7 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] 10.222.0.57 "GET /compute/v2.1/servers/db3bcfcf-48cd-4f31-8adc-aee5c3e03184" status: 200 len: 1458 microversion: 2.1 time: 0.538050 Jul 18 02:11:14.755720 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 486/958] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:14 2022] GET /compute/v2.1/servers/db3bcfcf-48cd-4f31-8adc-aee5c3e03184 => generated 1458 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:14.773125 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-315289eb-f7c1-4847-9617-317ea1aad88f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a8a11d30>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:14.825484 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f12b8708-f7eb-4a6b-9823-5a73dc6a0db1 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6962b97241f4c3a9960bb5fe52f8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8e996befd24b26b0371ad9cdb4a069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:14.844839 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f12b8708-f7eb-4a6b-9823-5a73dc6a0db1 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] 10.222.0.57 "GET /compute/v2.1/servers/f19cf772-e042-4d44-96ef-6de52397472e" status: 200 len: 1320 microversion: 2.1 time: 0.440984 Jul 18 02:11:14.854164 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 473/959] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:14 2022] GET /compute/v2.1/servers/f19cf772-e042-4d44-96ef-6de52397472e => generated 1320 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:14.920223 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-315289eb-f7c1-4847-9617-317ea1aad88f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/48443bda-c7c8-463b-b521-129df053a409" status: 200 len: 1410 microversion: 2.1 time: 0.157016 Jul 18 02:11:14.926822 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 487/960] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:11:14 2022] GET /compute/v2.1/images/48443bda-c7c8-463b-b521-129df053a409 => generated 1410 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:14.945305 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6b048952-6aa2-41cb-a0f9-77cf60809ac5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-182996287", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "caec55b9-88ff-45af-a9ee-477b3847fbba"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:15.030896 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-6b048952-6aa2-41cb-a0f9-77cf60809ac5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] validate_networks() for [('caec55b9-88ff-45af-a9ee-477b3847fbba', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:11:15.172281 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-be1fdf3b-010b-46b5-9f8c-8aef662b5a2d tempest-FloatingIPsTestJSON-555414803 tempest-FloatingIPsTestJSON-555414803-project] Action: 'create', calling method: .version_select at 0x7ff4a8c03790>, body: {"pool": null} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:16.236876 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-6b048952-6aa2-41cb-a0f9-77cf60809ac5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:11:16.239530 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-6b048952-6aa2-41cb-a0f9-77cf60809ac5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:11:16.240637 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-6b048952-6aa2-41cb-a0f9-77cf60809ac5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:11:16.241579 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-6b048952-6aa2-41cb-a0f9-77cf60809ac5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:11:16.242469 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-6b048952-6aa2-41cb-a0f9-77cf60809ac5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:11:16.279444 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b048952-6aa2-41cb-a0f9-77cf60809ac5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:16.280373 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b048952-6aa2-41cb-a0f9-77cf60809ac5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:16.281857 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b048952-6aa2-41cb-a0f9-77cf60809ac5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:16.282617 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b048952-6aa2-41cb-a0f9-77cf60809ac5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:16.325339 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-6b048952-6aa2-41cb-a0f9-77cf60809ac5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Getting quotas for project e382977cb6bf4f358fb3245cb3768140. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:11:16.338922 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-6b048952-6aa2-41cb-a0f9-77cf60809ac5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Getting quotas for user 77381e85d31a4747acb08a8d4572eb1b and project e382977cb6bf4f358fb3245cb3768140. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:11:16.364676 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6b048952-6aa2-41cb-a0f9-77cf60809ac5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:11:16.370043 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6b048952-6aa2-41cb-a0f9-77cf60809ac5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: ae4f2139-250b-4a65-8436-702487cc1ded] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:11:16.460901 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6b048952-6aa2-41cb-a0f9-77cf60809ac5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.532146 Jul 18 02:11:16.463046 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 488/961] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:11:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:11:16.472796 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-02cbde0c-9b68-4844-9e47-1f762ab5a2da tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:16.474521 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-02cbde0c-9b68-4844-9e47-1f762ab5a2da tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: f77b267e-9a20-4943-aa8b-0c82b9d6d20e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:16.488639 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-02cbde0c-9b68-4844-9e47-1f762ab5a2da tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:16.489552 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-02cbde0c-9b68-4844-9e47-1f762ab5a2da tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:16.491158 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-02cbde0c-9b68-4844-9e47-1f762ab5a2da tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:16.492296 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-02cbde0c-9b68-4844-9e47-1f762ab5a2da tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:16.532321 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-02cbde0c-9b68-4844-9e47-1f762ab5a2da tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] HTTP exception thrown: Instance f77b267e-9a20-4943-aa8b-0c82b9d6d20e could not be found. Jul 18 02:11:16.536279 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-02cbde0c-9b68-4844-9e47-1f762ab5a2da tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Request method failure captured: Jul 18 02:11:16.536279 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e HTTP/1.1 Jul 18 02:11:16.536279 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:11:16.536279 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:11:16.536279 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:11:16.536279 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:11:16.536279 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:11:16.536279 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:11:16.536279 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:11:16.536279 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:11:16.536279 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MB7COb2JuWcBggx8F3RZhHpF3HmKukL5wat44qauvFX9I9fbUaPgwpOzFbwM46k0f0tpFqHUry-l1QFMuSRce3JaBQUiPzpfLP996GAGhI2YQmuWUvCiAyNv0kfyHpriwXDwB7iA8NZAO27MfFGqAoFxqJHYKvXtuFk21CUv3t-d-k Jul 18 02:11:16.536279 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:11:16.536279 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:11:16.536279 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:11:16.536279 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:11:16.536279 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:11:16.536279 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:11:16.536279 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: dd02ce642caf4529a6e65c184de0ad19 Jul 18 02:11:16.536279 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1663664076 Jul 18 02:11:16.536279 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:11:16.536279 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:11:16.539028 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_dd02ce642caf4529a6e65c184de0ad19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/dd02ce642caf4529a6e65c184de0ad19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/dd02ce642caf4529a6e65c184de0ad19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/dd02ce642caf4529a6e65c184de0ad19"}]}] Jul 18 02:11:16.539028 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1663664076 Jul 18 02:11:16.539028 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: dd02ce642caf4529a6e65c184de0ad19 Jul 18 02:11:16.539028 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1663664076 Jul 18 02:11:16.539028 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1663664076-project Jul 18 02:11:16.539028 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:11:16.539028 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:11:16.539028 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 60118d593f96437dbb2c68ad2fadd465 Jul 18 02:11:16.539028 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1663664076-project Jul 18 02:11:16.539028 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:11:16.539028 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance f77b267e-9a20-4943-aa8b-0c82b9d6d20e could not be found. Jul 18 02:11:16.539028 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'f77b267e-9a20-4943-aa8b-0c82b9d6d20e'} Jul 18 02:11:16.541232 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:11:16.541232 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:16.541232 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:11:16.541232 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:11:16.541232 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:11:16.541232 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:11:16.541232 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:11:16.541232 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:11:16.541232 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:11:16.541232 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:11:16.541232 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f77b267e-9a20-4943-aa8b-0c82b9d6d20e could not be found. Jul 18 02:11:16.541232 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:16.541232 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:16.541232 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:16.541232 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:16.541232 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:16.541232 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:16.541232 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:11:16.541232 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:11:16.541232 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:11:16.543501 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:11:16.543501 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:11:16.543501 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:11:16.543501 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:11:16.543501 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:11:16.543501 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:11:16.543501 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:11:16.543501 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f77b267e-9a20-4943-aa8b-0c82b9d6d20e could not be found. Jul 18 02:11:16.543501 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:16.543501 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:16.543501 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:16.543501 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:16.543501 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:16.543501 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:16.543501 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:11:16.543501 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:11:16.543501 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f77b267e-9a20-4943-aa8b-0c82b9d6d20e could not be found. Jul 18 02:11:16.543501 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:16.547848 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-02cbde0c-9b68-4844-9e47-1f762ab5a2da tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Returning 404 to user: Instance f77b267e-9a20-4943-aa8b-0c82b9d6d20e could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:11:16.549690 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-02cbde0c-9b68-4844-9e47-1f762ab5a2da tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e" status: 404 len: 111 microversion: 2.1 time: 0.084437 Jul 18 02:11:16.558310 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 489/962] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:16 2022] GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:11:16.574101 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bfca3442-c5c0-44e0-b561-ef3e36a05e66 tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:16.575890 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bfca3442-c5c0-44e0-b561-ef3e36a05e66 tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] [instance: db3bcfcf-48cd-4f31-8adc-aee5c3e03184] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:16.592211 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bfca3442-c5c0-44e0-b561-ef3e36a05e66 tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:16.593640 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bfca3442-c5c0-44e0-b561-ef3e36a05e66 tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:16.595457 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bfca3442-c5c0-44e0-b561-ef3e36a05e66 tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:16.596529 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bfca3442-c5c0-44e0-b561-ef3e36a05e66 tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:17.394158 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bfca3442-c5c0-44e0-b561-ef3e36a05e66 tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/db3bcfcf-48cd-4f31-8adc-aee5c3e03184" status: 200 len: 1609 microversion: 2.1 time: 0.833510 Jul 18 02:11:17.411316 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 490/963] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:16 2022] GET /compute/v2.1/servers/db3bcfcf-48cd-4f31-8adc-aee5c3e03184 => generated 1609 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:17.436438 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4721814c-47d0-4593-aabd-1e1a0972d9b9 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:17.438155 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4721814c-47d0-4593-aabd-1e1a0972d9b9 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:17.451594 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4721814c-47d0-4593-aabd-1e1a0972d9b9 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:17.452708 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4721814c-47d0-4593-aabd-1e1a0972d9b9 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:17.454490 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4721814c-47d0-4593-aabd-1e1a0972d9b9 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:17.455572 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4721814c-47d0-4593-aabd-1e1a0972d9b9 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:17.747664 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-be1fdf3b-010b-46b5-9f8c-8aef662b5a2d tempest-FloatingIPsTestJSON-555414803 tempest-FloatingIPsTestJSON-555414803-project] 10.222.0.57 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.891953 Jul 18 02:11:17.749561 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 474/964] 10.222.0.57 () {60 vars in 1169 bytes} [Mon Jul 18 02:11:14 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2894 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:17.756335 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-02b40902-b9df-472a-a9bb-928de6a7e316 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '.version_select at 0x7ff4a8ccdb80>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:17.832011 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4721814c-47d0-4593-aabd-1e1a0972d9b9 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:17.836026 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-02b40902-b9df-472a-a9bb-928de6a7e316 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] HTTP exception thrown: Image not found. Jul 18 02:11:17.847105 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4721814c-47d0-4593-aabd-1e1a0972d9b9 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1473 microversion: 2.1 time: 0.433752 Jul 18 02:11:17.858449 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 491/965] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:17 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1473 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:17.859153 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-02b40902-b9df-472a-a9bb-928de6a7e316 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Request method failure captured: Jul 18 02:11:17.859153 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/images/668480f3-bcc3-45c8-bf15-a9c791e96fe2 HTTP/1.1 Jul 18 02:11:17.859153 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:11:17.859153 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:11:17.859153 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:11:17.859153 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:11:17.859153 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:11:17.859153 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:11:17.859153 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:11:17.859153 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:11:17.859153 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MDHcKkxv785TruBaYZ9isdDskpkSTXS63FySdEQ2DQWlYCoBeefqvgfCQf6lXL0HIcBKCVhVPgBeigtx_Fr6JAMpyAfBIDaZdUpBEZ_ARmYr58LYp6mJVoQMeV86GVtrWumVWYiUwrWzpXpGhfDxCZstFRul6eTjV0GKZX_II9Blls Jul 18 02:11:17.859153 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:11:17.859153 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:11:17.859153 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:11:17.859153 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:11:17.859153 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:11:17.859153 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:11:17.859153 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: d6b1efcf9e224d66b7dbf31c8aa89f87 Jul 18 02:11:17.859153 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-872437023 Jul 18 02:11:17.859153 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:11:17.859153 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:11:17.860620 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d6b1efcf9e224d66b7dbf31c8aa89f87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d6b1efcf9e224d66b7dbf31c8aa89f87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d6b1efcf9e224d66b7dbf31c8aa89f87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d6b1efcf9e224d66b7dbf31c8aa89f87"}]}] Jul 18 02:11:17.860620 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-872437023 Jul 18 02:11:17.860620 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: d6b1efcf9e224d66b7dbf31c8aa89f87 Jul 18 02:11:17.860620 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-872437023 Jul 18 02:11:17.860620 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ImagesOneServerNegativeTestJSON-872437023-project Jul 18 02:11:17.860620 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:11:17.860620 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:11:17.860620 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 625ab51af53042138e5335e3ae6e5dac Jul 18 02:11:17.860620 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-872437023-project Jul 18 02:11:17.860620 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:11:17.860620 n-d-465891-3 devstack@n-api.service[119543]: exception: Image not found. Jul 18 02:11:17.860620 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '668480f3-bcc3-45c8-bf15-a9c791e96fe2'} Jul 18 02:11:17.860620 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:11:17.861502 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:17.861502 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 18 02:11:17.861502 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 18 02:11:17.861502 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:11:17.861502 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:11:17.861502 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:11:17.861502 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:11:17.861502 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 18 02:11:17.861502 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 18 02:11:17.861502 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 18 02:11:17.861502 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 18 02:11:17.861502 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:11:17.861502 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:11:17.861502 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:11:17.861502 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:11:17.861502 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 668480f3-bcc3-45c8-bf15-a9c791e96fe2 to delete Jul 18 02:11:17.861502 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:17.861502 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:17.861502 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:17.862870 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:17.862870 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 18 02:11:17.862870 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 18 02:11:17.862870 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 18 02:11:17.862870 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 18 02:11:17.862870 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 18 02:11:17.862870 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 18 02:11:17.862870 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 668480f3-bcc3-45c8-bf15-a9c791e96fe2 could not be found. Jul 18 02:11:17.862870 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:17.862870 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:17.862870 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:17.862870 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:17.862870 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:17.862870 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:17.862870 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:11:17.862870 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:11:17.862870 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:11:17.862870 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:11:17.862870 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:11:17.862870 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:11:17.864170 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 18 02:11:17.864170 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 02:11:17.864170 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:11:17.864170 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:17.864170 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:17.864170 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:17.864170 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:17.864170 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:17.864170 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:17.864170 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:11:17.864170 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:11:17.864170 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:11:17.864170 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:17.864170 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-02b40902-b9df-472a-a9bb-928de6a7e316 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Returning 404 to user: Image not found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:11:17.865405 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ad364e32-977e-4069-98d0-96c1a2bc46aa tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:17.865405 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ad364e32-977e-4069-98d0-96c1a2bc46aa tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: f19cf772-e042-4d44-96ef-6de52397472e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:17.873894 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-02b40902-b9df-472a-a9bb-928de6a7e316 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "DELETE /compute/v2.1/images/668480f3-bcc3-45c8-bf15-a9c791e96fe2" status: 404 len: 62 microversion: 2.1 time: 0.122112 Jul 18 02:11:17.877731 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 475/966] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:17 2022] DELETE /compute/v2.1/images/668480f3-bcc3-45c8-bf15-a9c791e96fe2 => generated 62 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:11:17.880374 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ad364e32-977e-4069-98d0-96c1a2bc46aa tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:17.880835 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ad364e32-977e-4069-98d0-96c1a2bc46aa tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:17.881638 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ad364e32-977e-4069-98d0-96c1a2bc46aa tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:17.887799 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ad364e32-977e-4069-98d0-96c1a2bc46aa tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:17.892707 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5a4b4de3-2d91-4a3e-97e2-a50832c7b979 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a8c599d0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:18.057653 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5a4b4de3-2d91-4a3e-97e2-a50832c7b979 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/48443bda-c7c8-463b-b521-129df053a409" status: 200 len: 1410 microversion: 2.1 time: 0.177295 Jul 18 02:11:18.059389 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 476/967] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:11:17 2022] GET /compute/v2.1/images/48443bda-c7c8-463b-b521-129df053a409 => generated 1410 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:18.087691 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ef74d4b9-5eb6-4bd1-840e-77b137f2d988 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:18.089324 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ef74d4b9-5eb6-4bd1-840e-77b137f2d988 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: ae4f2139-250b-4a65-8436-702487cc1ded] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:18.113162 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ef74d4b9-5eb6-4bd1-840e-77b137f2d988 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:18.126957 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ef74d4b9-5eb6-4bd1-840e-77b137f2d988 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:18.133902 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ef74d4b9-5eb6-4bd1-840e-77b137f2d988 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:18.134751 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ef74d4b9-5eb6-4bd1-840e-77b137f2d988 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:18.190447 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ad364e32-977e-4069-98d0-96c1a2bc46aa tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6962b97241f4c3a9960bb5fe52f8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8e996befd24b26b0371ad9cdb4a069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:18.201278 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ad364e32-977e-4069-98d0-96c1a2bc46aa tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] 10.222.0.57 "GET /compute/v2.1/servers/f19cf772-e042-4d44-96ef-6de52397472e" status: 200 len: 1469 microversion: 2.1 time: 0.343388 Jul 18 02:11:18.208171 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 492/968] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:17 2022] GET /compute/v2.1/servers/f19cf772-e042-4d44-96ef-6de52397472e => generated 1469 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:18.214374 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-76018c8c-5d26-43a8-b3aa-00a63738466a tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:18.221161 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-76018c8c-5d26-43a8-b3aa-00a63738466a tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: dbb215bf-6099-4dd5-b9af-d1bbfb55ef21] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:18.242210 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-76018c8c-5d26-43a8-b3aa-00a63738466a tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:18.244280 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-76018c8c-5d26-43a8-b3aa-00a63738466a tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:18.247873 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-76018c8c-5d26-43a8-b3aa-00a63738466a tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:18.248442 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-76018c8c-5d26-43a8-b3aa-00a63738466a tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:18.275788 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ef74d4b9-5eb6-4bd1-840e-77b137f2d988 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:18.280448 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-76018c8c-5d26-43a8-b3aa-00a63738466a tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] HTTP exception thrown: Instance dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 could not be found. Jul 18 02:11:18.282606 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-76018c8c-5d26-43a8-b3aa-00a63738466a tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Request method failure captured: Jul 18 02:11:18.282606 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/servers/dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 HTTP/1.1 Jul 18 02:11:18.282606 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:11:18.282606 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:11:18.282606 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:11:18.282606 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:11:18.282606 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:11:18.282606 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:11:18.282606 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:11:18.282606 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:11:18.282606 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MB7COb2JuWcBggx8F3RZhHpF3HmKukL5wat44qauvFX9I9fbUaPgwpOzFbwM46k0f0tpFqHUry-l1QFMuSRce3JaBQUiPzpfLP996GAGhI2YQmuWUvCiAyNv0kfyHpriwXDwB7iA8NZAO27MfFGqAoFxqJHYKvXtuFk21CUv3t-d-k Jul 18 02:11:18.282606 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:11:18.282606 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:11:18.282606 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:11:18.282606 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:11:18.282606 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:11:18.282606 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:11:18.282606 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: dd02ce642caf4529a6e65c184de0ad19 Jul 18 02:11:18.282606 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1663664076 Jul 18 02:11:18.282606 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:11:18.282606 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:11:18.285444 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_dd02ce642caf4529a6e65c184de0ad19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/dd02ce642caf4529a6e65c184de0ad19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/dd02ce642caf4529a6e65c184de0ad19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/dd02ce642caf4529a6e65c184de0ad19"}]}] Jul 18 02:11:18.285444 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1663664076 Jul 18 02:11:18.285444 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: dd02ce642caf4529a6e65c184de0ad19 Jul 18 02:11:18.285444 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1663664076 Jul 18 02:11:18.285444 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1663664076-project Jul 18 02:11:18.285444 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:11:18.285444 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:11:18.285444 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 60118d593f96437dbb2c68ad2fadd465 Jul 18 02:11:18.285444 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1663664076-project Jul 18 02:11:18.285444 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:11:18.285444 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 could not be found. Jul 18 02:11:18.285444 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'dbb215bf-6099-4dd5-b9af-d1bbfb55ef21'} Jul 18 02:11:18.287269 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:11:18.287269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:18.287269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:11:18.287269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:11:18.287269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:11:18.287269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:11:18.287269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:11:18.287269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:11:18.287269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:11:18.287269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:11:18.287269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 could not be found. Jul 18 02:11:18.287269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:18.287269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:18.287269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:18.287269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:18.287269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:18.287269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:18.287269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:11:18.287269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:11:18.287269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:11:18.290980 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:11:18.290980 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:11:18.290980 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:11:18.290980 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:11:18.290980 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:11:18.290980 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:11:18.290980 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:11:18.290980 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:11:18.290980 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:11:18.290980 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 could not be found. Jul 18 02:11:18.290980 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:18.290980 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:18.290980 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:18.290980 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:18.290980 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:18.290980 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:18.290980 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:11:18.290980 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:11:18.290980 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 could not be found. Jul 18 02:11:18.290980 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:18.297869 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-76018c8c-5d26-43a8-b3aa-00a63738466a tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Returning 404 to user: Instance dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:11:18.297869 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-76018c8c-5d26-43a8-b3aa-00a63738466a tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "DELETE /compute/v2.1/servers/dbb215bf-6099-4dd5-b9af-d1bbfb55ef21" status: 404 len: 111 microversion: 2.1 time: 0.074479 Jul 18 02:11:18.297869 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 493/969] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:11:18 2022] DELETE /compute/v2.1/servers/dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:11:18.298431 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ef74d4b9-5eb6-4bd1-840e-77b137f2d988 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded" status: 200 len: 1262 microversion: 2.1 time: 0.219254 Jul 18 02:11:18.298431 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 477/970] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:18 2022] GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded => generated 1262 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:18.298749 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-53a879b9-3b00-49f7-b186-952f11248983 tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:18.298749 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:18.298749 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:11:18.298749 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-53a879b9-3b00-49f7-b186-952f11248983 tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:18.298749 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-53a879b9-3b00-49f7-b186-952f11248983 tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:18.299519 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-53a879b9-3b00-49f7-b186-952f11248983 tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:18.299744 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-53a879b9-3b00-49f7-b186-952f11248983 tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:18.300534 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-ed80216c-353e-4ac3-ac9b-01d947085e6e req-311822b8-272d-4521-a716-8dc9c12fa36e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25dfb6dd-6d5a-4399-a348-0a162ca907ef", "name": "network-vif-plugged", "status": "completed", "tag": "c841be8a-afd4-4301-bb2a-8f0504345c0f"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:18.315584 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-ed80216c-353e-4ac3-ac9b-01d947085e6e req-311822b8-272d-4521-a716-8dc9c12fa36e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:18.316416 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-ed80216c-353e-4ac3-ac9b-01d947085e6e req-311822b8-272d-4521-a716-8dc9c12fa36e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:18.340620 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-ed80216c-353e-4ac3-ac9b-01d947085e6e req-311822b8-272d-4521-a716-8dc9c12fa36e service nova] Creating event network-vif-plugged:c841be8a-afd4-4301-bb2a-8f0504345c0f for instance 25dfb6dd-6d5a-4399-a348-0a162ca907ef on n-h1-465891-3 Jul 18 02:11:18.348145 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-ed80216c-353e-4ac3-ac9b-01d947085e6e req-311822b8-272d-4521-a716-8dc9c12fa36e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052572 Jul 18 02:11:18.349275 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 478/971] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:18.350553 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-53a879b9-3b00-49f7-b186-952f11248983 tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.059226 Jul 18 02:11:18.353204 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 494/972] 10.222.0.57 () {58 vars in 1175 bytes} [Mon Jul 18 02:11:18 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:18.358027 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a1bb3d30-c2ed-4142-844e-f974afc300f8 tempest-FloatingIPsTestJSON-555414803 tempest-FloatingIPsTestJSON-555414803-project] Calling method '.version_select at 0x7ff4a8b1d550>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:18.362177 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-42ea949b-bb65-4740-a429-f2d8d68f586a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:18.363105 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-42ea949b-bb65-4740-a429-f2d8d68f586a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: bd14a732-a9ad-4dfd-af61-69b84eda8877] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:18.376452 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-42ea949b-bb65-4740-a429-f2d8d68f586a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:18.377271 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-42ea949b-bb65-4740-a429-f2d8d68f586a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:18.380426 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-42ea949b-bb65-4740-a429-f2d8d68f586a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:18.381340 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-42ea949b-bb65-4740-a429-f2d8d68f586a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:18.412133 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-42ea949b-bb65-4740-a429-f2d8d68f586a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] HTTP exception thrown: Instance bd14a732-a9ad-4dfd-af61-69b84eda8877 could not be found. Jul 18 02:11:18.416156 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-42ea949b-bb65-4740-a429-f2d8d68f586a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Request method failure captured: Jul 18 02:11:18.416156 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877 HTTP/1.1 Jul 18 02:11:18.416156 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:11:18.416156 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:11:18.416156 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:11:18.416156 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:11:18.416156 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:11:18.416156 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:11:18.416156 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:11:18.416156 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:11:18.416156 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MDHcKkxv785TruBaYZ9isdDskpkSTXS63FySdEQ2DQWlYCoBeefqvgfCQf6lXL0HIcBKCVhVPgBeigtx_Fr6JAMpyAfBIDaZdUpBEZ_ARmYr58LYp6mJVoQMeV86GVtrWumVWYiUwrWzpXpGhfDxCZstFRul6eTjV0GKZX_II9Blls Jul 18 02:11:18.416156 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:11:18.416156 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:11:18.416156 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:11:18.416156 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:11:18.416156 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:11:18.416156 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:11:18.416156 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: d6b1efcf9e224d66b7dbf31c8aa89f87 Jul 18 02:11:18.416156 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-872437023 Jul 18 02:11:18.416156 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:11:18.416156 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:11:18.417630 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d6b1efcf9e224d66b7dbf31c8aa89f87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d6b1efcf9e224d66b7dbf31c8aa89f87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d6b1efcf9e224d66b7dbf31c8aa89f87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d6b1efcf9e224d66b7dbf31c8aa89f87"}]}] Jul 18 02:11:18.417630 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-872437023 Jul 18 02:11:18.417630 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: d6b1efcf9e224d66b7dbf31c8aa89f87 Jul 18 02:11:18.417630 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-872437023 Jul 18 02:11:18.417630 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ImagesOneServerNegativeTestJSON-872437023-project Jul 18 02:11:18.417630 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:11:18.417630 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:11:18.417630 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 625ab51af53042138e5335e3ae6e5dac Jul 18 02:11:18.417630 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-872437023-project Jul 18 02:11:18.417630 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:11:18.417630 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance bd14a732-a9ad-4dfd-af61-69b84eda8877 could not be found. Jul 18 02:11:18.417630 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'bd14a732-a9ad-4dfd-af61-69b84eda8877'} Jul 18 02:11:18.419331 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:11:18.419331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:18.419331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:11:18.419331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:11:18.419331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:11:18.419331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:11:18.419331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:11:18.419331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:11:18.419331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:11:18.419331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:11:18.419331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd14a732-a9ad-4dfd-af61-69b84eda8877 could not be found. Jul 18 02:11:18.419331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:18.419331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:18.419331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:18.419331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:18.419331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:18.419331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:18.419331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:11:18.419331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:11:18.419331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:11:18.420550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:11:18.420550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:11:18.420550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:11:18.420550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:11:18.420550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:11:18.420550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:11:18.420550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:11:18.420550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:11:18.420550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:11:18.420550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd14a732-a9ad-4dfd-af61-69b84eda8877 could not be found. Jul 18 02:11:18.420550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:18.420550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:18.420550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:18.420550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:18.420550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:18.420550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:18.420550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:11:18.420550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:11:18.420550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd14a732-a9ad-4dfd-af61-69b84eda8877 could not be found. Jul 18 02:11:18.420550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:18.424462 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-42ea949b-bb65-4740-a429-f2d8d68f586a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Returning 404 to user: Instance bd14a732-a9ad-4dfd-af61-69b84eda8877 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:11:18.424462 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-42ea949b-bb65-4740-a429-f2d8d68f586a tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "DELETE /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877" status: 404 len: 111 microversion: 2.1 time: 0.065144 Jul 18 02:11:18.424462 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 495/973] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:11:18 2022] DELETE /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:11:18.430939 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-83141968-0dc2-4183-8c7c-55014a74dc6f tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:18.431922 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-83141968-0dc2-4183-8c7c-55014a74dc6f tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] [instance: f19cf772-e042-4d44-96ef-6de52397472e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:18.443808 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-83141968-0dc2-4183-8c7c-55014a74dc6f tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:18.445088 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-83141968-0dc2-4183-8c7c-55014a74dc6f tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:18.447683 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-83141968-0dc2-4183-8c7c-55014a74dc6f tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:18.448827 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-83141968-0dc2-4183-8c7c-55014a74dc6f tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:18.513374 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-83141968-0dc2-4183-8c7c-55014a74dc6f tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] Lazy-loading 'flavor' on Instance uuid f19cf772-e042-4d44-96ef-6de52397472e {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:11:18.670623 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-83141968-0dc2-4183-8c7c-55014a74dc6f tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/f19cf772-e042-4d44-96ef-6de52397472e/action" status: 202 len: 0 microversion: 2.1 time: 0.246773 Jul 18 02:11:18.671622 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 496/974] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:11:18 2022] POST /compute/v2.1/servers/f19cf772-e042-4d44-96ef-6de52397472e/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:11:18.679586 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f89fc172-9fa7-48a4-92d8-ea87a9eab949 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:18.692649 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f89fc172-9fa7-48a4-92d8-ea87a9eab949 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: dbb215bf-6099-4dd5-b9af-d1bbfb55ef21] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:18.709041 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f89fc172-9fa7-48a4-92d8-ea87a9eab949 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:18.710100 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f89fc172-9fa7-48a4-92d8-ea87a9eab949 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:18.711493 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f89fc172-9fa7-48a4-92d8-ea87a9eab949 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:18.712579 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f89fc172-9fa7-48a4-92d8-ea87a9eab949 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:18.747326 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-f89fc172-9fa7-48a4-92d8-ea87a9eab949 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] HTTP exception thrown: Instance dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 could not be found. Jul 18 02:11:18.749318 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f89fc172-9fa7-48a4-92d8-ea87a9eab949 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Request method failure captured: Jul 18 02:11:18.749318 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 HTTP/1.1 Jul 18 02:11:18.749318 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:11:18.749318 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:11:18.749318 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:11:18.749318 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:11:18.749318 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:11:18.749318 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:11:18.749318 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:11:18.749318 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:11:18.749318 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MB7COb2JuWcBggx8F3RZhHpF3HmKukL5wat44qauvFX9I9fbUaPgwpOzFbwM46k0f0tpFqHUry-l1QFMuSRce3JaBQUiPzpfLP996GAGhI2YQmuWUvCiAyNv0kfyHpriwXDwB7iA8NZAO27MfFGqAoFxqJHYKvXtuFk21CUv3t-d-k Jul 18 02:11:18.749318 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:11:18.749318 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:11:18.749318 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:11:18.749318 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:11:18.749318 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:11:18.749318 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:11:18.749318 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: dd02ce642caf4529a6e65c184de0ad19 Jul 18 02:11:18.749318 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1663664076 Jul 18 02:11:18.749318 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:11:18.749318 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:11:18.750678 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_dd02ce642caf4529a6e65c184de0ad19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/dd02ce642caf4529a6e65c184de0ad19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/dd02ce642caf4529a6e65c184de0ad19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/dd02ce642caf4529a6e65c184de0ad19"}]}] Jul 18 02:11:18.750678 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1663664076 Jul 18 02:11:18.750678 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: dd02ce642caf4529a6e65c184de0ad19 Jul 18 02:11:18.750678 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1663664076 Jul 18 02:11:18.750678 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1663664076-project Jul 18 02:11:18.750678 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:11:18.750678 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:11:18.750678 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 60118d593f96437dbb2c68ad2fadd465 Jul 18 02:11:18.750678 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1663664076-project Jul 18 02:11:18.750678 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:11:18.750678 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 could not be found. Jul 18 02:11:18.750678 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'dbb215bf-6099-4dd5-b9af-d1bbfb55ef21'} Jul 18 02:11:18.751387 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:11:18.751387 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:18.751387 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:11:18.751387 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:11:18.751387 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:11:18.751387 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:11:18.751387 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:11:18.751387 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:11:18.751387 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:11:18.751387 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:11:18.751387 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 could not be found. Jul 18 02:11:18.751387 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:18.751387 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:18.751387 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:18.751387 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:18.751387 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:18.751387 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:18.751387 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:11:18.751387 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:11:18.751387 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:11:18.756263 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:11:18.756263 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:11:18.756263 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:11:18.756263 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:11:18.756263 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:11:18.756263 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:11:18.756263 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:11:18.756263 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 could not be found. Jul 18 02:11:18.756263 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:18.756263 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:18.756263 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:18.756263 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:18.756263 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:18.756263 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:18.756263 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:11:18.756263 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:11:18.756263 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 could not be found. Jul 18 02:11:18.756263 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:18.757328 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f89fc172-9fa7-48a4-92d8-ea87a9eab949 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Returning 404 to user: Instance dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:11:18.757328 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f89fc172-9fa7-48a4-92d8-ea87a9eab949 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "GET /compute/v2.1/servers/dbb215bf-6099-4dd5-b9af-d1bbfb55ef21" status: 404 len: 111 microversion: 2.1 time: 0.078121 Jul 18 02:11:18.757328 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 497/975] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:18 2022] GET /compute/v2.1/servers/dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:11:18.767159 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-925f519a-02f9-48d3-b043-790d4bfc788f tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-465891-3", "block_migration": true, "disk_over_commit": false}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:18.772955 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-925f519a-02f9-48d3-b043-790d4bfc788f tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] [instance: db3bcfcf-48cd-4f31-8adc-aee5c3e03184] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:18.792316 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-925f519a-02f9-48d3-b043-790d4bfc788f tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:18.792934 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-925f519a-02f9-48d3-b043-790d4bfc788f tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:18.793791 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-925f519a-02f9-48d3-b043-790d4bfc788f tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:18.794243 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-925f519a-02f9-48d3-b043-790d4bfc788f tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:18.818848 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a1bb3d30-c2ed-4142-844e-f974afc300f8 tempest-FloatingIPsTestJSON-555414803 tempest-FloatingIPsTestJSON-555414803-project] 10.222.0.57 "GET /compute/v2.1/os-floating-ips/42ca453a-b70e-4149-a731-c89af4f514ad" status: 200 len: 141 microversion: 2.1 time: 0.466696 Jul 18 02:11:18.820130 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 479/976] 10.222.0.57 () {58 vars in 1259 bytes} [Mon Jul 18 02:11:18 2022] GET /compute/v2.1/os-floating-ips/42ca453a-b70e-4149-a731-c89af4f514ad => generated 141 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:18.832249 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c5ecfd53-e5b3-42a8-bd0f-1dce7c33e972 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:18.837495 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c5ecfd53-e5b3-42a8-bd0f-1dce7c33e972 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] [instance: bd14a732-a9ad-4dfd-af61-69b84eda8877] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:18.850491 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c5ecfd53-e5b3-42a8-bd0f-1dce7c33e972 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:18.853657 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c5ecfd53-e5b3-42a8-bd0f-1dce7c33e972 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:18.855885 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c5ecfd53-e5b3-42a8-bd0f-1dce7c33e972 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:18.856339 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c5ecfd53-e5b3-42a8-bd0f-1dce7c33e972 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:18.872208 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-925f519a-02f9-48d3-b043-790d4bfc788f tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] Lazy-loading 'flavor' on Instance uuid db3bcfcf-48cd-4f31-8adc-aee5c3e03184 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:11:18.890074 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-c5ecfd53-e5b3-42a8-bd0f-1dce7c33e972 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] HTTP exception thrown: Instance bd14a732-a9ad-4dfd-af61-69b84eda8877 could not be found. Jul 18 02:11:18.892361 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c5ecfd53-e5b3-42a8-bd0f-1dce7c33e972 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Request method failure captured: Jul 18 02:11:18.892361 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877 HTTP/1.1 Jul 18 02:11:18.892361 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:11:18.892361 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:11:18.892361 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:11:18.892361 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:11:18.892361 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:11:18.892361 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:11:18.892361 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:11:18.892361 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:11:18.892361 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MDHcKkxv785TruBaYZ9isdDskpkSTXS63FySdEQ2DQWlYCoBeefqvgfCQf6lXL0HIcBKCVhVPgBeigtx_Fr6JAMpyAfBIDaZdUpBEZ_ARmYr58LYp6mJVoQMeV86GVtrWumVWYiUwrWzpXpGhfDxCZstFRul6eTjV0GKZX_II9Blls Jul 18 02:11:18.892361 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:11:18.892361 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:11:18.892361 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:11:18.892361 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:11:18.892361 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:11:18.892361 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:11:18.892361 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: d6b1efcf9e224d66b7dbf31c8aa89f87 Jul 18 02:11:18.892361 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-872437023 Jul 18 02:11:18.892361 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:11:18.892361 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:11:18.893799 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d6b1efcf9e224d66b7dbf31c8aa89f87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d6b1efcf9e224d66b7dbf31c8aa89f87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d6b1efcf9e224d66b7dbf31c8aa89f87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d6b1efcf9e224d66b7dbf31c8aa89f87"}]}] Jul 18 02:11:18.893799 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-872437023 Jul 18 02:11:18.893799 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: d6b1efcf9e224d66b7dbf31c8aa89f87 Jul 18 02:11:18.893799 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-872437023 Jul 18 02:11:18.893799 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ImagesOneServerNegativeTestJSON-872437023-project Jul 18 02:11:18.893799 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:11:18.893799 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:11:18.893799 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 625ab51af53042138e5335e3ae6e5dac Jul 18 02:11:18.893799 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-872437023-project Jul 18 02:11:18.893799 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:11:18.893799 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance bd14a732-a9ad-4dfd-af61-69b84eda8877 could not be found. Jul 18 02:11:18.893799 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'bd14a732-a9ad-4dfd-af61-69b84eda8877'} Jul 18 02:11:18.894570 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:11:18.894570 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:18.894570 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:11:18.894570 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:11:18.894570 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:11:18.894570 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:11:18.894570 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:11:18.894570 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:11:18.894570 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:11:18.894570 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:11:18.894570 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd14a732-a9ad-4dfd-af61-69b84eda8877 could not be found. Jul 18 02:11:18.894570 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:18.894570 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:18.894570 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:18.894570 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:18.894570 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:18.894570 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:18.894570 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:11:18.894570 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:11:18.894570 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:11:18.895746 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:11:18.895746 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:11:18.895746 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:11:18.895746 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:11:18.895746 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:11:18.895746 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:11:18.895746 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:11:18.895746 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd14a732-a9ad-4dfd-af61-69b84eda8877 could not be found. Jul 18 02:11:18.895746 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:18.895746 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:18.895746 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:18.895746 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:18.895746 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:18.895746 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:18.895746 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:11:18.895746 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:11:18.895746 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd14a732-a9ad-4dfd-af61-69b84eda8877 could not be found. Jul 18 02:11:18.895746 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:18.898498 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c5ecfd53-e5b3-42a8-bd0f-1dce7c33e972 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] Returning 404 to user: Instance bd14a732-a9ad-4dfd-af61-69b84eda8877 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:11:18.900363 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c5ecfd53-e5b3-42a8-bd0f-1dce7c33e972 tempest-ImagesOneServerNegativeTestJSON-872437023 tempest-ImagesOneServerNegativeTestJSON-872437023-project] 10.222.0.57 "GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877" status: 404 len: 111 microversion: 2.1 time: 0.078767 Jul 18 02:11:18.901595 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 480/977] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:18 2022] GET /compute/v2.1/servers/bd14a732-a9ad-4dfd-af61-69b84eda8877 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:11:18.908312 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-925f519a-02f9-48d3-b043-790d4bfc788f tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance db3bcfcf-48cd-4f31-8adc-aee5c3e03184 while it is in vm_state suspended Jul 18 02:11:18.914466 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-925f519a-02f9-48d3-b043-790d4bfc788f tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] Request method failure captured: Jul 18 02:11:18.914466 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers/db3bcfcf-48cd-4f31-8adc-aee5c3e03184/action HTTP/1.1 Jul 18 02:11:18.914466 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:11:18.914466 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:11:18.914466 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:11:18.914466 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 97 Jul 18 02:11:18.914466 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:11:18.914466 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:11:18.914466 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:11:18.914466 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:11:18.914466 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MEWobwXPX4Yvu3FA_Q8pjQEESmQLtEJ4m1IPcr9CLgkfivjVDx_hYp5YpPX8L3jGpJFshzwJrCmSMjDCWMGepqoZwg7TvNOR7A4NOODtNTclQab7KKACkTYxPo5mdF-zOtcXJuVlnQ2A1YBVoarNiR3joRoYgGHi9crwwPtQio-z4E Jul 18 02:11:18.914466 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:11:18.914466 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:11:18.914466 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:11:18.914466 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:11:18.914466 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:11:18.914466 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:11:18.914466 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: c005da9417c0410f9946e541e8c8252a Jul 18 02:11:18.914466 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-LiveMigrationNegativeTest-1887249387 Jul 18 02:11:18.914466 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,admin,reader Jul 18 02:11:18.914466 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,admin,reader Jul 18 02:11:18.916346 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c005da9417c0410f9946e541e8c8252a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c005da9417c0410f9946e541e8c8252a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c005da9417c0410f9946e541e8c8252a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c005da9417c0410f9946e541e8c8252a"}]}] Jul 18 02:11:18.916346 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-LiveMigrationNegativeTest-1887249387 Jul 18 02:11:18.916346 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: c005da9417c0410f9946e541e8c8252a Jul 18 02:11:18.916346 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1887249387 Jul 18 02:11:18.916346 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-LiveMigrationNegativeTest-1887249387-project-admin Jul 18 02:11:18.916346 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:11:18.916346 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:11:18.916346 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 1f83832452f6488689c894df62813e1b Jul 18 02:11:18.916346 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-LiveMigrationNegativeTest-1887249387-project-admin Jul 18 02:11:18.916346 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:11:18.916346 n-d-465891-3 devstack@n-api.service[119544]: {"os-migrateLive": {"host": "n-h1-465891-3", "block_migration": true, "disk_over_commit": false}} Jul 18 02:11:18.916346 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:11:18.917214 n-d-465891-3 devstack@n-api.service[119544]: exception: Cannot 'os-migrateLive' instance db3bcfcf-48cd-4f31-8adc-aee5c3e03184 while it is in vm_state suspended Jul 18 02:11:18.917214 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'db3bcfcf-48cd-4f31-8adc-aee5c3e03184', 'body': {'os-migrateLive': {'host': 'n-h1-465891-3', 'block_migration': True, 'disk_over_commit': False}}} Jul 18 02:11:18.917214 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:11:18.917214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:18.917214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 18 02:11:18.917214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 18 02:11:18.917214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 18 02:11:18.917214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 02:11:18.917214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 18 02:11:18.917214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 02:11:18.917214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 18 02:11:18.917214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 02:11:18.917214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 18 02:11:18.917214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 02:11:18.917214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 18 02:11:18.917214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 02:11:18.917214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 18 02:11:18.917214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 02:11:18.918506 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 02:11:18.918506 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 02:11:18.918506 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 02:11:18.918506 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 02:11:18.918506 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance db3bcfcf-48cd-4f31-8adc-aee5c3e03184 in vm_state suspended. Cannot live_migrate while the instance is in this state. Jul 18 02:11:18.918506 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:18.918506 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:18.918506 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:18.918506 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:18.918506 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:18.918506 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:18.918506 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:11:18.918506 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:11:18.918506 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:11:18.918506 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:11:18.918506 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:11:18.918506 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:11:18.918506 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:11:18.918506 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:11:18.918506 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:11:18.919932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:11:18.919932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 18 02:11:18.919932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Jul 18 02:11:18.919932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 02:11:18.919932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 02:11:18.919932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 02:11:18.919932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance db3bcfcf-48cd-4f31-8adc-aee5c3e03184 while it is in vm_state suspended Jul 18 02:11:18.919932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:18.919932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:18.919932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:18.919932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:18.919932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:18.919932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:18.919932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:11:18.919932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:11:18.919932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance db3bcfcf-48cd-4f31-8adc-aee5c3e03184 while it is in vm_state suspended Jul 18 02:11:18.919932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:18.925832 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-925f519a-02f9-48d3-b043-790d4bfc788f tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance db3bcfcf-48cd-4f31-8adc-aee5c3e03184 while it is in vm_state suspended {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:11:18.926792 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-210dae13-ec87-4193-af6c-124d2d600206 tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:18.927619 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-925f519a-02f9-48d3-b043-790d4bfc788f tempest-LiveMigrationNegativeTest-1887249387 tempest-LiveMigrationNegativeTest-1887249387-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/db3bcfcf-48cd-4f31-8adc-aee5c3e03184/action" status: 409 len: 155 microversion: 2.1 time: 0.173476 Jul 18 02:11:18.928826 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 498/978] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:11:18 2022] POST /compute/v2.1/servers/db3bcfcf-48cd-4f31-8adc-aee5c3e03184/action => generated 155 bytes in 176 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:11:18.933884 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-210dae13-ec87-4193-af6c-124d2d600206 tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] [instance: f19cf772-e042-4d44-96ef-6de52397472e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:18.946411 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-067db521-1e7a-46c1-9ef0-88d3b3931d35 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '.version_select at 0x7ff4a8a11b80>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:18.952157 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-210dae13-ec87-4193-af6c-124d2d600206 tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:18.958615 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-210dae13-ec87-4193-af6c-124d2d600206 tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:18.959943 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-210dae13-ec87-4193-af6c-124d2d600206 tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:18.961203 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-210dae13-ec87-4193-af6c-124d2d600206 tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:19.019515 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-067db521-1e7a-46c1-9ef0-88d3b3931d35 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-9024320" status: 202 len: 0 microversion: 2.1 time: 0.083921 Jul 18 02:11:19.026110 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 499/979] 10.222.0.57 () {58 vars in 1211 bytes} [Mon Jul 18 02:11:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-9024320 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:11:19.044276 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5aac6dc5-299e-4f7a-9849-5bc076113ac6 tempest-FloatingIPsTestJSON-555414803 tempest-FloatingIPsTestJSON-555414803-project] Calling method '.version_select at 0x7ff4a8a9cf70>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:20.607392 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5aac6dc5-299e-4f7a-9849-5bc076113ac6 tempest-FloatingIPsTestJSON-555414803 tempest-FloatingIPsTestJSON-555414803-project] 10.222.0.57 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 1.579661 Jul 18 02:11:20.609612 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 500/980] 10.222.0.57 () {58 vars in 1148 bytes} [Mon Jul 18 02:11:19 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:20.616248 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d6fccecd-cb5e-4946-8611-3e6d49059308 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:20.624199 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d6fccecd-cb5e-4946-8611-3e6d49059308 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:20.642566 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d6fccecd-cb5e-4946-8611-3e6d49059308 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:20.650746 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d6fccecd-cb5e-4946-8611-3e6d49059308 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:20.651985 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d6fccecd-cb5e-4946-8611-3e6d49059308 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:20.669085 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d6fccecd-cb5e-4946-8611-3e6d49059308 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:21.332419 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d6fccecd-cb5e-4946-8611-3e6d49059308 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:21.343259 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d6fccecd-cb5e-4946-8611-3e6d49059308 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1473 microversion: 2.1 time: 0.732432 Jul 18 02:11:21.350962 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 501/981] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:20 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1473 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:21.357747 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8e202c58-71b6-45b9-9e29-4b30e3809306 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:21.365217 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8e202c58-71b6-45b9-9e29-4b30e3809306 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] [instance: db3bcfcf-48cd-4f31-8adc-aee5c3e03184] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:21.386536 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8e202c58-71b6-45b9-9e29-4b30e3809306 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:21.387310 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8e202c58-71b6-45b9-9e29-4b30e3809306 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:21.389031 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8e202c58-71b6-45b9-9e29-4b30e3809306 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:21.389521 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8e202c58-71b6-45b9-9e29-4b30e3809306 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:21.451515 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8e202c58-71b6-45b9-9e29-4b30e3809306 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] [instance: db3bcfcf-48cd-4f31-8adc-aee5c3e03184] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:11:21.486331 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:11:21.670212 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8e202c58-71b6-45b9-9e29-4b30e3809306 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] 10.222.0.57 "DELETE /compute/v2.1/servers/db3bcfcf-48cd-4f31-8adc-aee5c3e03184" status: 204 len: 0 microversion: 2.1 time: 0.315912 Jul 18 02:11:21.671681 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 502/982] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:11:21 2022] DELETE /compute/v2.1/servers/db3bcfcf-48cd-4f31-8adc-aee5c3e03184 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:11:21.683676 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7d076f9e-4ca0-416f-8eef-5fab15bfa7fa tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a8a13940>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:21.796727 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7d076f9e-4ca0-416f-8eef-5fab15bfa7fa tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/48443bda-c7c8-463b-b521-129df053a409" status: 200 len: 1410 microversion: 2.1 time: 0.122542 Jul 18 02:11:21.808756 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 503/983] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:11:21 2022] GET /compute/v2.1/images/48443bda-c7c8-463b-b521-129df053a409 => generated 1410 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:21.822965 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d4eb5d5f-547c-4176-b703-96b23fb422e1 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:21.824635 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d4eb5d5f-547c-4176-b703-96b23fb422e1 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: ae4f2139-250b-4a65-8436-702487cc1ded] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:21.845349 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d4eb5d5f-547c-4176-b703-96b23fb422e1 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:21.846793 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d4eb5d5f-547c-4176-b703-96b23fb422e1 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:21.848677 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d4eb5d5f-547c-4176-b703-96b23fb422e1 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:21.850026 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d4eb5d5f-547c-4176-b703-96b23fb422e1 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:22.007823 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-210dae13-ec87-4193-af6c-124d2d600206 tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/f19cf772-e042-4d44-96ef-6de52397472e" status: 200 len: 1628 microversion: 2.1 time: 3.104479 Jul 18 02:11:22.026384 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 481/984] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:18 2022] GET /compute/v2.1/servers/f19cf772-e042-4d44-96ef-6de52397472e => generated 1628 bytes in 3124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:22.067207 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3d4ed746-9a49-4f69-9384-706474633a54 tempest-FloatingIPsTestJSON-555414803 tempest-FloatingIPsTestJSON-555414803-project] Calling method '.version_select at 0x7ff4a8b31670>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:22.394492 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d4eb5d5f-547c-4176-b703-96b23fb422e1 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:22.405149 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d4eb5d5f-547c-4176-b703-96b23fb422e1 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded" status: 200 len: 1310 microversion: 2.1 time: 0.594444 Jul 18 02:11:22.406739 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 504/985] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:21 2022] GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded => generated 1310 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:22.411852 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6181d174-4e19-4034-bfb9-d59b67bc9f9f tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:22.412760 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6181d174-4e19-4034-bfb9-d59b67bc9f9f tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] [instance: db3bcfcf-48cd-4f31-8adc-aee5c3e03184] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:22.420791 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6181d174-4e19-4034-bfb9-d59b67bc9f9f tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:22.421578 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6181d174-4e19-4034-bfb9-d59b67bc9f9f tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:22.422583 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6181d174-4e19-4034-bfb9-d59b67bc9f9f tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:22.423194 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6181d174-4e19-4034-bfb9-d59b67bc9f9f tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:22.943931 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6181d174-4e19-4034-bfb9-d59b67bc9f9f tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6698374ee5c4bf18440a2f382db3c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d7b11fb5cd420cb8dbb16208bccf91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:22.966225 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6181d174-4e19-4034-bfb9-d59b67bc9f9f tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] 10.222.0.57 "GET /compute/v2.1/servers/db3bcfcf-48cd-4f31-8adc-aee5c3e03184" status: 200 len: 1464 microversion: 2.1 time: 0.546017 Jul 18 02:11:22.967319 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 505/986] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:22 2022] GET /compute/v2.1/servers/db3bcfcf-48cd-4f31-8adc-aee5c3e03184 => generated 1464 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:22.972656 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b3185904-27b1-40ba-bd91-4a42733558ff tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:22.973668 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b3185904-27b1-40ba-bd91-4a42733558ff tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:22.982866 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b3185904-27b1-40ba-bd91-4a42733558ff tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:22.990911 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b3185904-27b1-40ba-bd91-4a42733558ff tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:22.992100 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b3185904-27b1-40ba-bd91-4a42733558ff tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:22.992925 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b3185904-27b1-40ba-bd91-4a42733558ff tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:23.490206 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b3185904-27b1-40ba-bd91-4a42733558ff tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:23.514292 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b3185904-27b1-40ba-bd91-4a42733558ff tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1473 microversion: 2.1 time: 0.537709 Jul 18 02:11:23.515241 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 506/987] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:22 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1473 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:23.530906 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-fe9b3cb9-2e85-4327-8ffd-fea12abdbba9 req-f7bfd90d-bfa7-419b-a532-47fefc873cfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae4f2139-250b-4a65-8436-702487cc1ded", "tag": "babbb140-0981-4a5e-b5a3-7f0cc8649998"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:23.548823 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-fe9b3cb9-2e85-4327-8ffd-fea12abdbba9 req-f7bfd90d-bfa7-419b-a532-47fefc873cfa service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:23.549561 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-fe9b3cb9-2e85-4327-8ffd-fea12abdbba9 req-f7bfd90d-bfa7-419b-a532-47fefc873cfa service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:23.576053 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-fe9b3cb9-2e85-4327-8ffd-fea12abdbba9 req-f7bfd90d-bfa7-419b-a532-47fefc873cfa service nova] Creating event network-changed:babbb140-0981-4a5e-b5a3-7f0cc8649998 for instance ae4f2139-250b-4a65-8436-702487cc1ded on n-h1-465891-3 Jul 18 02:11:23.581809 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-fe9b3cb9-2e85-4327-8ffd-fea12abdbba9 req-f7bfd90d-bfa7-419b-a532-47fefc873cfa service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064734 Jul 18 02:11:23.582780 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 507/988] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:23.592832 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d3c02bb7-3bda-4cd5-af2f-a80cd30a960a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a8a134c0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:23.662658 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d3c02bb7-3bda-4cd5-af2f-a80cd30a960a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/48443bda-c7c8-463b-b521-129df053a409" status: 200 len: 1410 microversion: 2.1 time: 0.078295 Jul 18 02:11:23.663694 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 508/989] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:11:23 2022] GET /compute/v2.1/images/48443bda-c7c8-463b-b521-129df053a409 => generated 1410 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:23.673035 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-caa07618-6924-4330-b31c-9f9d00ce0bae tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:23.674261 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-caa07618-6924-4330-b31c-9f9d00ce0bae tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] [instance: f19cf772-e042-4d44-96ef-6de52397472e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:23.687206 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-caa07618-6924-4330-b31c-9f9d00ce0bae tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:23.688352 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-caa07618-6924-4330-b31c-9f9d00ce0bae tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:23.694062 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-caa07618-6924-4330-b31c-9f9d00ce0bae tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:23.695140 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-caa07618-6924-4330-b31c-9f9d00ce0bae tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:24.239952 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-caa07618-6924-4330-b31c-9f9d00ce0bae tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/f19cf772-e042-4d44-96ef-6de52397472e" status: 200 len: 1611 microversion: 2.1 time: 0.565185 Jul 18 02:11:24.244654 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 509/990] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:23 2022] GET /compute/v2.1/servers/f19cf772-e042-4d44-96ef-6de52397472e => generated 1611 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:24.266616 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-27354b0d-68e4-4318-b1db-2f60f405edb7 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:24.268704 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-27354b0d-68e4-4318-b1db-2f60f405edb7 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: ae4f2139-250b-4a65-8436-702487cc1ded] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:24.296533 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-27354b0d-68e4-4318-b1db-2f60f405edb7 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:24.297549 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-27354b0d-68e4-4318-b1db-2f60f405edb7 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:24.299291 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-27354b0d-68e4-4318-b1db-2f60f405edb7 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:24.310587 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-27354b0d-68e4-4318-b1db-2f60f405edb7 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:24.857642 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3d4ed746-9a49-4f69-9384-706474633a54 tempest-FloatingIPsTestJSON-555414803 tempest-FloatingIPsTestJSON-555414803-project] 10.222.0.57 "DELETE /compute/v2.1/os-floating-ips/42ca453a-b70e-4149-a731-c89af4f514ad" status: 202 len: 0 microversion: 2.1 time: 2.828948 Jul 18 02:11:24.859927 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 482/991] 10.222.0.57 () {58 vars in 1262 bytes} [Mon Jul 18 02:11:22 2022] DELETE /compute/v2.1/os-floating-ips/42ca453a-b70e-4149-a731-c89af4f514ad => generated 0 bytes in 2833 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:11:24.868830 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dc7d1e08-7d72-41a9-b89a-c3b9be3da674 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:24.869855 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-dc7d1e08-7d72-41a9-b89a-c3b9be3da674 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] [instance: db3bcfcf-48cd-4f31-8adc-aee5c3e03184] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:24.877003 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dc7d1e08-7d72-41a9-b89a-c3b9be3da674 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:24.877934 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dc7d1e08-7d72-41a9-b89a-c3b9be3da674 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:24.879002 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dc7d1e08-7d72-41a9-b89a-c3b9be3da674 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:24.879668 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dc7d1e08-7d72-41a9-b89a-c3b9be3da674 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:24.973082 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-27354b0d-68e4-4318-b1db-2f60f405edb7 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:24.990883 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-27354b0d-68e4-4318-b1db-2f60f405edb7 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded" status: 200 len: 1310 microversion: 2.1 time: 0.743372 Jul 18 02:11:24.993310 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 510/992] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:24 2022] GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded => generated 1310 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:25.002833 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3a045f40-613f-47ea-ba03-d4572f936c80 tempest-ServersWithSpecificFlavorTestJSON-122237826 tempest-ServersWithSpecificFlavorTestJSON-122237826-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:25.005849 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:25.005849 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:11:25.054520 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3a045f40-613f-47ea-ba03-d4572f936c80 tempest-ServersWithSpecificFlavorTestJSON-122237826 tempest-ServersWithSpecificFlavorTestJSON-122237826-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/1236876455" status: 202 len: 0 microversion: 2.1 time: 0.058696 Jul 18 02:11:25.056568 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 511/993] 10.222.0.57 () {58 vars in 1160 bytes} [Mon Jul 18 02:11:24 2022] DELETE /compute/v2.1/flavors/1236876455 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:11:25.065185 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-756197d7-8b2a-4bf0-ae7d-edb62de33922 tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:25.066787 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-756197d7-8b2a-4bf0-ae7d-edb62de33922 tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] [instance: f19cf772-e042-4d44-96ef-6de52397472e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:25.081555 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-756197d7-8b2a-4bf0-ae7d-edb62de33922 tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:25.082676 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-756197d7-8b2a-4bf0-ae7d-edb62de33922 tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:25.084255 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-756197d7-8b2a-4bf0-ae7d-edb62de33922 tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:25.085243 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-756197d7-8b2a-4bf0-ae7d-edb62de33922 tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:25.276252 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-756197d7-8b2a-4bf0-ae7d-edb62de33922 tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] HTTP exception thrown: Cannot 'migrate' instance f19cf772-e042-4d44-96ef-6de52397472e while it is in vm_state suspended Jul 18 02:11:25.280885 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-756197d7-8b2a-4bf0-ae7d-edb62de33922 tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] Request method failure captured: Jul 18 02:11:25.280885 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers/f19cf772-e042-4d44-96ef-6de52397472e/action HTTP/1.1 Jul 18 02:11:25.280885 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:11:25.280885 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:11:25.280885 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:11:25.280885 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 15 Jul 18 02:11:25.280885 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:11:25.280885 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:11:25.280885 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:11:25.280885 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:11:25.280885 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MESFSMtePNL8GJf_VyMJPXhAx7y0IB0ZqXqObzdaZvbuflGpBBtq8vNjrIah9tPhaEp_76Fy2h-bZrLnckapqRCES7vHy1PJ9Om0frNRlMw-kb9dg6Dl8eYrr7DMOYtcj7F0YEupI2z-cIL72tlkQx-uIR0utT2YtCYya29hc8O_H8 Jul 18 02:11:25.280885 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:11:25.280885 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:11:25.280885 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:11:25.280885 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:11:25.280885 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:11:25.280885 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:11:25.280885 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 91b5c4b0af774fba9df99f55cfefbb85 Jul 18 02:11:25.280885 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1407282334 Jul 18 02:11:25.280885 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,admin,reader Jul 18 02:11:25.280885 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,admin,reader Jul 18 02:11:25.283923 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_91b5c4b0af774fba9df99f55cfefbb85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/91b5c4b0af774fba9df99f55cfefbb85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/91b5c4b0af774fba9df99f55cfefbb85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/91b5c4b0af774fba9df99f55cfefbb85"}]}] Jul 18 02:11:25.283923 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1407282334 Jul 18 02:11:25.283923 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 91b5c4b0af774fba9df99f55cfefbb85 Jul 18 02:11:25.283923 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1407282334 Jul 18 02:11:25.283923 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersAdminNegativeTestJSON-1407282334-project-admin Jul 18 02:11:25.283923 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:11:25.283923 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:11:25.283923 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 09f9d545b58f49daafec8939ba21725c Jul 18 02:11:25.283923 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1407282334-project-admin Jul 18 02:11:25.283923 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:11:25.283923 n-d-465891-3 devstack@n-api.service[119544]: {"migrate": {}} Jul 18 02:11:25.283923 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:11:25.283923 n-d-465891-3 devstack@n-api.service[119544]: exception: Cannot 'migrate' instance f19cf772-e042-4d44-96ef-6de52397472e while it is in vm_state suspended Jul 18 02:11:25.285799 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'f19cf772-e042-4d44-96ef-6de52397472e', 'body': {'migrate': {}}} Jul 18 02:11:25.285799 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:11:25.285799 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:25.285799 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Jul 18 02:11:25.285799 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Jul 18 02:11:25.285799 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 18 02:11:25.285799 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 02:11:25.285799 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 18 02:11:25.285799 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 02:11:25.285799 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 18 02:11:25.285799 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 02:11:25.285799 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 18 02:11:25.285799 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 02:11:25.285799 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 02:11:25.285799 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 02:11:25.285799 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 02:11:25.285799 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 02:11:25.285799 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f19cf772-e042-4d44-96ef-6de52397472e in vm_state suspended. Cannot resize while the instance is in this state. Jul 18 02:11:25.285799 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:25.288434 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:25.288434 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:25.288434 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:25.288434 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:25.288434 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:25.288434 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:11:25.288434 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:11:25.288434 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:11:25.288434 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:11:25.288434 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:11:25.288434 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:11:25.288434 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Jul 18 02:11:25.288434 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 02:11:25.288434 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 02:11:25.288434 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 02:11:25.288434 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance f19cf772-e042-4d44-96ef-6de52397472e while it is in vm_state suspended Jul 18 02:11:25.288434 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:25.288434 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:25.288434 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:25.288434 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:25.293417 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:25.293417 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:25.293417 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:11:25.293417 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:11:25.293417 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance f19cf772-e042-4d44-96ef-6de52397472e while it is in vm_state suspended Jul 18 02:11:25.293417 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:25.293417 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-756197d7-8b2a-4bf0-ae7d-edb62de33922 tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] Returning 409 to user: Cannot 'migrate' instance f19cf772-e042-4d44-96ef-6de52397472e while it is in vm_state suspended {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:11:25.298473 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-756197d7-8b2a-4bf0-ae7d-edb62de33922 tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/f19cf772-e042-4d44-96ef-6de52397472e/action" status: 409 len: 148 microversion: 2.1 time: 0.239253 Jul 18 02:11:25.310368 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 512/994] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:11:25 2022] POST /compute/v2.1/servers/f19cf772-e042-4d44-96ef-6de52397472e/action => generated 148 bytes in 253 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:11:25.319043 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e4292fbd-a6aa-474a-98e0-3b3fa492237e tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:25.320917 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e4292fbd-a6aa-474a-98e0-3b3fa492237e tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:25.331473 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e4292fbd-a6aa-474a-98e0-3b3fa492237e tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:25.332671 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e4292fbd-a6aa-474a-98e0-3b3fa492237e tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:25.335610 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e4292fbd-a6aa-474a-98e0-3b3fa492237e tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:25.337499 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e4292fbd-a6aa-474a-98e0-3b3fa492237e tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:26.084832 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e4292fbd-a6aa-474a-98e0-3b3fa492237e tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:26.116922 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e4292fbd-a6aa-474a-98e0-3b3fa492237e tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1473 microversion: 2.1 time: 0.804147 Jul 18 02:11:26.140964 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 513/995] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:25 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1473 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:26.158837 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-dc7d1e08-7d72-41a9-b89a-c3b9be3da674 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6698374ee5c4bf18440a2f382db3c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d7b11fb5cd420cb8dbb16208bccf91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:26.159704 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-249bf42c-1604-4125-9b90-a2a72af8072f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a8a13940>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:26.206837 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-dc7d1e08-7d72-41a9-b89a-c3b9be3da674 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] 10.222.0.57 "GET /compute/v2.1/servers/db3bcfcf-48cd-4f31-8adc-aee5c3e03184" status: 200 len: 1464 microversion: 2.1 time: 1.344531 Jul 18 02:11:26.208621 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 483/996] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:24 2022] GET /compute/v2.1/servers/db3bcfcf-48cd-4f31-8adc-aee5c3e03184 => generated 1464 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:26.225815 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0936a852-ddd3-4fca-bffc-30c344e9ff1a tempest-FloatingIPsTestJSON-555414803 tempest-FloatingIPsTestJSON-555414803-project] Action: 'create', calling method: .version_select at 0x7ff4a944a040>, body: {"pool": null} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:26.317168 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-249bf42c-1604-4125-9b90-a2a72af8072f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/48443bda-c7c8-463b-b521-129df053a409" status: 200 len: 1410 microversion: 2.1 time: 0.173778 Jul 18 02:11:26.318246 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 514/997] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:11:26 2022] GET /compute/v2.1/images/48443bda-c7c8-463b-b521-129df053a409 => generated 1410 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:26.327459 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0ed52713-55bf-4de8-9776-103feae67612 tempest-ServersWithSpecificFlavorTestJSON-122237826 tempest-ServersWithSpecificFlavorTestJSON-122237826-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:26.407960 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:11:26.432453 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0ed52713-55bf-4de8-9776-103feae67612 tempest-ServersWithSpecificFlavorTestJSON-122237826 tempest-ServersWithSpecificFlavorTestJSON-122237826-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.112124 Jul 18 02:11:26.456248 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 515/998] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:11:26 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:26.462550 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7fb75f32-ec37-4d5a-90d6-9d20c65e9166 tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:26.487397 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7fb75f32-ec37-4d5a-90d6-9d20c65e9166 tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] Request method failure captured: Jul 18 02:11:26.487397 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8/action HTTP/1.1 Jul 18 02:11:26.487397 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:11:26.487397 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:11:26.487397 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:11:26.487397 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 39 Jul 18 02:11:26.487397 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:11:26.487397 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:11:26.487397 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:11:26.487397 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:11:26.487397 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MESFSMtePNL8GJf_VyMJPXhAx7y0IB0ZqXqObzdaZvbuflGpBBtq8vNjrIah9tPhaEp_76Fy2h-bZrLnckapqRCES7vHy1PJ9Om0frNRlMw-kb9dg6Dl8eYrr7DMOYtcj7F0YEupI2z-cIL72tlkQx-uIR0utT2YtCYya29hc8O_H8 Jul 18 02:11:26.487397 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:11:26.487397 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:11:26.487397 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:11:26.487397 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:11:26.487397 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:11:26.487397 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:11:26.487397 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 91b5c4b0af774fba9df99f55cfefbb85 Jul 18 02:11:26.487397 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1407282334 Jul 18 02:11:26.487397 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,admin,reader Jul 18 02:11:26.487397 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,admin,reader Jul 18 02:11:26.488804 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_91b5c4b0af774fba9df99f55cfefbb85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/91b5c4b0af774fba9df99f55cfefbb85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/91b5c4b0af774fba9df99f55cfefbb85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/91b5c4b0af774fba9df99f55cfefbb85"}]}] Jul 18 02:11:26.488804 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1407282334 Jul 18 02:11:26.488804 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 91b5c4b0af774fba9df99f55cfefbb85 Jul 18 02:11:26.488804 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1407282334 Jul 18 02:11:26.488804 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersAdminNegativeTestJSON-1407282334-project-admin Jul 18 02:11:26.488804 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:11:26.488804 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:11:26.488804 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 09f9d545b58f49daafec8939ba21725c Jul 18 02:11:26.488804 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1407282334-project-admin Jul 18 02:11:26.488804 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:11:26.488804 n-d-465891-3 devstack@n-api.service[119544]: {"os-resetState": {"state": "invalid"}} Jul 18 02:11:26.488804 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:11:26.489549 n-d-465891-3 devstack@n-api.service[119544]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 18 02:11:26.489549 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '8c643d39-a6e1-41ec-a6f9-ffaf41421eb8', 'body': {'os-resetState': {'state': 'invalid'}}} Jul 18 02:11:26.489549 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:11:26.489549 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:26.489549 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:11:26.489549 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:11:26.489549 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:11:26.489549 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:11:26.489549 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Jul 18 02:11:26.489549 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:26.489549 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Jul 18 02:11:26.489549 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 18 02:11:26.489549 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:26.489549 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 18 02:11:26.489549 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'invalid' Jul 18 02:11:26.489549 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:26.489549 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:26.489549 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:26.489549 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:26.489549 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:26.489549 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:26.489549 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:11:26.491366 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:11:26.491366 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:11:26.491366 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:11:26.491366 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:11:26.491366 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:11:26.491366 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:11:26.491366 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:11:26.491366 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:11:26.491366 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:11:26.491366 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 18 02:11:26.491366 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:26.491366 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:26.491366 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:26.491366 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:26.491366 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:26.491366 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:26.491366 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:11:26.491366 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:11:26.491366 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 18 02:11:26.493536 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:26.498797 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7fb75f32-ec37-4d5a-90d6-9d20c65e9166 tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:11:26.500370 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7fb75f32-ec37-4d5a-90d6-9d20c65e9166 tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8/action" status: 400 len: 144 microversion: 2.1 time: 0.042420 Jul 18 02:11:26.506261 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 516/999] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:11:26 2022] POST /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8/action => generated 144 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:11:26.512889 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b07d45bd-1548-4fb6-b73f-f5158ca51b87 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:26.514008 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b07d45bd-1548-4fb6-b73f-f5158ca51b87 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: ae4f2139-250b-4a65-8436-702487cc1ded] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:26.525584 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b07d45bd-1548-4fb6-b73f-f5158ca51b87 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:26.526489 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b07d45bd-1548-4fb6-b73f-f5158ca51b87 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:26.527912 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b07d45bd-1548-4fb6-b73f-f5158ca51b87 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:26.528639 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b07d45bd-1548-4fb6-b73f-f5158ca51b87 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:27.193626 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b07d45bd-1548-4fb6-b73f-f5158ca51b87 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:27.207764 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b07d45bd-1548-4fb6-b73f-f5158ca51b87 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded" status: 200 len: 1310 microversion: 2.1 time: 0.698383 Jul 18 02:11:27.211264 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 517/1000] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:26 2022] GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded => generated 1310 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:27.223286 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-2b04b093-f97b-4715-9941-de4c91a997ed req-f5e9243f-9d5a-4418-b144-ad49a5977b66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db3bcfcf-48cd-4f31-8adc-aee5c3e03184", "name": "network-vif-deleted", "tag": "444c1d13-78e9-4675-9114-9c1b7c480b55"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:27.236539 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=5,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:11:27.250368 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-2b04b093-f97b-4715-9941-de4c91a997ed req-f5e9243f-9d5a-4418-b144-ad49a5977b66 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:27.252377 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-2b04b093-f97b-4715-9941-de4c91a997ed req-f5e9243f-9d5a-4418-b144-ad49a5977b66 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:27.293846 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-2b04b093-f97b-4715-9941-de4c91a997ed req-f5e9243f-9d5a-4418-b144-ad49a5977b66 service nova] Creating event network-vif-deleted:444c1d13-78e9-4675-9114-9c1b7c480b55 for instance db3bcfcf-48cd-4f31-8adc-aee5c3e03184 on n-h2-465891-3 Jul 18 02:11:27.303589 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-2b04b093-f97b-4715-9941-de4c91a997ed req-f5e9243f-9d5a-4418-b144-ad49a5977b66 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090760 Jul 18 02:11:27.304832 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 518/1001] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:27.319874 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5042b755-4a35-4a3b-8dc7-1552211ebacb tempest-ServersWithSpecificFlavorTestJSON-122237826 tempest-ServersWithSpecificFlavorTestJSON-122237826-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:27.323582 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:27.323582 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:11:27.394545 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5042b755-4a35-4a3b-8dc7-1552211ebacb tempest-ServersWithSpecificFlavorTestJSON-122237826 tempest-ServersWithSpecificFlavorTestJSON-122237826-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/1539648143" status: 202 len: 0 microversion: 2.1 time: 0.084561 Jul 18 02:11:27.400007 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 519/1002] 10.222.0.57 () {58 vars in 1160 bytes} [Mon Jul 18 02:11:27 2022] DELETE /compute/v2.1/flavors/1539648143 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:11:27.406411 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-795eaefa-796d-4604-9956-7e6be7f7a051 tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:27.417622 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-795eaefa-796d-4604-9956-7e6be7f7a051 tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] Request method failure captured: Jul 18 02:11:27.417622 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8/action HTTP/1.1 Jul 18 02:11:27.417622 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:11:27.417622 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:11:27.417622 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:11:27.417622 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 31 Jul 18 02:11:27.417622 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:11:27.417622 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:11:27.417622 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:11:27.417622 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:11:27.417622 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MESFSMtePNL8GJf_VyMJPXhAx7y0IB0ZqXqObzdaZvbuflGpBBtq8vNjrIah9tPhaEp_76Fy2h-bZrLnckapqRCES7vHy1PJ9Om0frNRlMw-kb9dg6Dl8eYrr7DMOYtcj7F0YEupI2z-cIL72tlkQx-uIR0utT2YtCYya29hc8O_H8 Jul 18 02:11:27.417622 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:11:27.417622 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:11:27.417622 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:11:27.417622 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:11:27.417622 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:11:27.417622 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:11:27.417622 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 91b5c4b0af774fba9df99f55cfefbb85 Jul 18 02:11:27.417622 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1407282334 Jul 18 02:11:27.417622 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,admin,reader Jul 18 02:11:27.417622 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,admin,reader Jul 18 02:11:27.419184 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_91b5c4b0af774fba9df99f55cfefbb85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/91b5c4b0af774fba9df99f55cfefbb85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/91b5c4b0af774fba9df99f55cfefbb85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/91b5c4b0af774fba9df99f55cfefbb85"}]}] Jul 18 02:11:27.419184 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1407282334 Jul 18 02:11:27.419184 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 91b5c4b0af774fba9df99f55cfefbb85 Jul 18 02:11:27.419184 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1407282334 Jul 18 02:11:27.419184 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersAdminNegativeTestJSON-1407282334-project-admin Jul 18 02:11:27.419184 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:11:27.419184 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:11:27.419184 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 09f9d545b58f49daafec8939ba21725c Jul 18 02:11:27.419184 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1407282334-project-admin Jul 18 02:11:27.419184 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:11:27.419184 n-d-465891-3 devstack@n-api.service[119544]: {"os-resetState": {"state": 1}} Jul 18 02:11:27.419184 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:11:27.419184 n-d-465891-3 devstack@n-api.service[119544]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 18 02:11:27.420057 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '8c643d39-a6e1-41ec-a6f9-ffaf41421eb8', 'body': {'os-resetState': {'state': 1}}} Jul 18 02:11:27.420057 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:11:27.420057 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:27.420057 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:11:27.420057 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:11:27.420057 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:11:27.420057 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:11:27.420057 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Jul 18 02:11:27.420057 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:27.420057 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Jul 18 02:11:27.420057 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 18 02:11:27.420057 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:27.420057 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 18 02:11:27.420057 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 1 Jul 18 02:11:27.420057 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:27.420057 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:27.420057 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:27.420057 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:27.420057 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:27.420057 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:27.420057 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:11:27.420057 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:11:27.421954 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:11:27.421954 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:11:27.421954 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:11:27.421954 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:11:27.421954 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:11:27.421954 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:11:27.421954 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:11:27.421954 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:11:27.421954 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 18 02:11:27.421954 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:27.421954 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:27.421954 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:27.421954 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:27.421954 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:27.421954 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:27.421954 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:11:27.421954 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:11:27.421954 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 18 02:11:27.421954 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:27.424391 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-795eaefa-796d-4604-9956-7e6be7f7a051 tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:11:27.428606 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-795eaefa-796d-4604-9956-7e6be7f7a051 tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8/action" status: 400 len: 120 microversion: 2.1 time: 0.025355 Jul 18 02:11:27.437950 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 520/1003] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:11:27 2022] POST /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8/action => generated 120 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:11:27.443388 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4c2dd5a7-1f91-47b3-84cb-1942d7787300 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:27.444458 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4c2dd5a7-1f91-47b3-84cb-1942d7787300 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:27.465331 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4c2dd5a7-1f91-47b3-84cb-1942d7787300 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:27.468398 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4c2dd5a7-1f91-47b3-84cb-1942d7787300 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:27.469626 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4c2dd5a7-1f91-47b3-84cb-1942d7787300 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:27.470315 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4c2dd5a7-1f91-47b3-84cb-1942d7787300 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:27.909413 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4c2dd5a7-1f91-47b3-84cb-1942d7787300 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:27.922156 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4c2dd5a7-1f91-47b3-84cb-1942d7787300 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1473 microversion: 2.1 time: 0.482658 Jul 18 02:11:27.927832 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 521/1004] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:27 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1473 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:27.933870 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8a53c9ea-0ef6-4d67-b62b-fe19a7728aad tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:27.939427 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8a53c9ea-0ef6-4d67-b62b-fe19a7728aad tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] [instance: db3bcfcf-48cd-4f31-8adc-aee5c3e03184] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:27.959333 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a53c9ea-0ef6-4d67-b62b-fe19a7728aad tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:27.961733 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a53c9ea-0ef6-4d67-b62b-fe19a7728aad tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:27.963090 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a53c9ea-0ef6-4d67-b62b-fe19a7728aad tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:27.964058 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a53c9ea-0ef6-4d67-b62b-fe19a7728aad tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:28.065603 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-8a53c9ea-0ef6-4d67-b62b-fe19a7728aad tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] HTTP exception thrown: Instance db3bcfcf-48cd-4f31-8adc-aee5c3e03184 could not be found. Jul 18 02:11:28.078086 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8a53c9ea-0ef6-4d67-b62b-fe19a7728aad tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Request method failure captured: Jul 18 02:11:28.078086 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/db3bcfcf-48cd-4f31-8adc-aee5c3e03184 HTTP/1.1 Jul 18 02:11:28.078086 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:11:28.078086 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:11:28.078086 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:11:28.078086 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:11:28.078086 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:11:28.078086 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:11:28.078086 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:11:28.078086 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:11:28.078086 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MEVfLfodZWhoHilfK1J7KVhJrGCxv3Ha9qn7krYB52gGi8O6ssbiHm3HBxQ4MyDMQkS95OGj9b-zjoRV6gLsrUPPFobPYHqAYMRv_Wh5EsQgTQJX1nfUGooacfai7Ts4FpmsLEQF_qPDjyfx8c_lMHKpHUPuUlMb6VwjfB58IXK1RY Jul 18 02:11:28.078086 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:11:28.078086 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:11:28.078086 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:11:28.078086 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:11:28.078086 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:11:28.078086 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:11:28.078086 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 66d7b11fb5cd420cb8dbb16208bccf91 Jul 18 02:11:28.078086 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-LiveMigrationNegativeTest-2111049051 Jul 18 02:11:28.078086 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:11:28.078086 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:11:28.081091 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_66d7b11fb5cd420cb8dbb16208bccf91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/66d7b11fb5cd420cb8dbb16208bccf91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/66d7b11fb5cd420cb8dbb16208bccf91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/66d7b11fb5cd420cb8dbb16208bccf91"}]}] Jul 18 02:11:28.081091 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-LiveMigrationNegativeTest-2111049051 Jul 18 02:11:28.081091 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 66d7b11fb5cd420cb8dbb16208bccf91 Jul 18 02:11:28.081091 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-2111049051 Jul 18 02:11:28.081091 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-LiveMigrationNegativeTest-2111049051-project Jul 18 02:11:28.081091 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:11:28.081091 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:11:28.081091 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: c6698374ee5c4bf18440a2f382db3c37 Jul 18 02:11:28.081091 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-LiveMigrationNegativeTest-2111049051-project Jul 18 02:11:28.081091 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:11:28.081091 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance db3bcfcf-48cd-4f31-8adc-aee5c3e03184 could not be found. Jul 18 02:11:28.081091 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'db3bcfcf-48cd-4f31-8adc-aee5c3e03184'} Jul 18 02:11:28.082844 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:11:28.082844 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:28.082844 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:11:28.082844 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:11:28.082844 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:11:28.082844 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:11:28.082844 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:11:28.082844 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:11:28.082844 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:11:28.082844 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:11:28.082844 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db3bcfcf-48cd-4f31-8adc-aee5c3e03184 could not be found. Jul 18 02:11:28.082844 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:28.082844 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:28.082844 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:28.082844 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:28.082844 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:28.082844 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:28.082844 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:11:28.082844 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:11:28.082844 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:11:28.086392 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:11:28.086392 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:11:28.086392 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:11:28.086392 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:11:28.086392 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:11:28.086392 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:11:28.086392 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:11:28.086392 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db3bcfcf-48cd-4f31-8adc-aee5c3e03184 could not be found. Jul 18 02:11:28.086392 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:28.086392 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:28.086392 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:28.086392 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:28.086392 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:28.086392 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:28.086392 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:11:28.086392 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:11:28.086392 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db3bcfcf-48cd-4f31-8adc-aee5c3e03184 could not be found. Jul 18 02:11:28.086392 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:28.088686 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8a53c9ea-0ef6-4d67-b62b-fe19a7728aad tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Returning 404 to user: Instance db3bcfcf-48cd-4f31-8adc-aee5c3e03184 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:11:28.091023 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8a53c9ea-0ef6-4d67-b62b-fe19a7728aad tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] 10.222.0.57 "GET /compute/v2.1/servers/db3bcfcf-48cd-4f31-8adc-aee5c3e03184" status: 404 len: 111 microversion: 2.1 time: 0.156756 Jul 18 02:11:28.091777 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 522/1005] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:27 2022] GET /compute/v2.1/servers/db3bcfcf-48cd-4f31-8adc-aee5c3e03184 => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:11:28.104129 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-79d068d9-348f-4d30-84c3-15df1437c146 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a8a4eb80>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:28.232275 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-79d068d9-348f-4d30-84c3-15df1437c146 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/48443bda-c7c8-463b-b521-129df053a409" status: 200 len: 1410 microversion: 2.1 time: 0.137687 Jul 18 02:11:28.246162 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 523/1006] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:11:28 2022] GET /compute/v2.1/images/48443bda-c7c8-463b-b521-129df053a409 => generated 1410 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:28.258303 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2fc59979-9f8a-46ec-8358-cd0d99e38b86 tempest-ServersWithSpecificFlavorTestJSON-122237826 tempest-ServersWithSpecificFlavorTestJSON-122237826-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:28.331416 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:11:28.379528 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2fc59979-9f8a-46ec-8358-cd0d99e38b86 tempest-ServersWithSpecificFlavorTestJSON-122237826 tempest-ServersWithSpecificFlavorTestJSON-122237826-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.105954 Jul 18 02:11:28.380722 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 524/1007] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:11:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:28.392106 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-284df6a8-f2bb-4373-8121-2dba947901c5 tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:28.406626 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-284df6a8-f2bb-4373-8121-2dba947901c5 tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] Failed to fetch instance by id 999 {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 18 02:11:28.412726 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-284df6a8-f2bb-4373-8121-2dba947901c5 tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] HTTP exception thrown: Instance 999 could not be found. Jul 18 02:11:28.421733 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-284df6a8-f2bb-4373-8121-2dba947901c5 tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] Request method failure captured: Jul 18 02:11:28.421733 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Jul 18 02:11:28.421733 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:11:28.421733 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:11:28.421733 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:11:28.421733 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 37 Jul 18 02:11:28.421733 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:11:28.421733 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:11:28.421733 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:11:28.421733 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:11:28.421733 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MESFSMtePNL8GJf_VyMJPXhAx7y0IB0ZqXqObzdaZvbuflGpBBtq8vNjrIah9tPhaEp_76Fy2h-bZrLnckapqRCES7vHy1PJ9Om0frNRlMw-kb9dg6Dl8eYrr7DMOYtcj7F0YEupI2z-cIL72tlkQx-uIR0utT2YtCYya29hc8O_H8 Jul 18 02:11:28.421733 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:11:28.421733 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:11:28.421733 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:11:28.421733 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:11:28.421733 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:11:28.421733 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:11:28.421733 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 91b5c4b0af774fba9df99f55cfefbb85 Jul 18 02:11:28.421733 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1407282334 Jul 18 02:11:28.421733 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,admin,reader Jul 18 02:11:28.421733 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,admin,reader Jul 18 02:11:28.423158 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_91b5c4b0af774fba9df99f55cfefbb85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/91b5c4b0af774fba9df99f55cfefbb85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/91b5c4b0af774fba9df99f55cfefbb85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/91b5c4b0af774fba9df99f55cfefbb85"}]}] Jul 18 02:11:28.423158 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1407282334 Jul 18 02:11:28.423158 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 91b5c4b0af774fba9df99f55cfefbb85 Jul 18 02:11:28.423158 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1407282334 Jul 18 02:11:28.423158 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersAdminNegativeTestJSON-1407282334-project-admin Jul 18 02:11:28.423158 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:11:28.423158 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:11:28.423158 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 09f9d545b58f49daafec8939ba21725c Jul 18 02:11:28.423158 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1407282334-project-admin Jul 18 02:11:28.423158 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:11:28.423158 n-d-465891-3 devstack@n-api.service[119544]: {"os-resetState": {"state": "error"}} Jul 18 02:11:28.423158 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:11:28.423158 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 999 could not be found. Jul 18 02:11:28.423987 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Jul 18 02:11:28.423987 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:11:28.423987 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:28.423987 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:11:28.423987 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:11:28.423987 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 18 02:11:28.423987 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 18 02:11:28.423987 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 18 02:11:28.423987 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:28.423987 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:28.423987 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:28.423987 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:28.423987 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:28.423987 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:28.423987 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:11:28.423987 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:11:28.423987 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:11:28.423987 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:11:28.423987 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:11:28.423987 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:11:28.423987 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Jul 18 02:11:28.427342 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 18 02:11:28.427342 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:11:28.427342 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:11:28.427342 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 18 02:11:28.427342 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:28.427342 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:28.427342 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:28.427342 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:28.427342 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:28.427342 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:28.427342 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:11:28.427342 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:11:28.427342 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 18 02:11:28.427342 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:28.429467 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-284df6a8-f2bb-4373-8121-2dba947901c5 tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:11:28.433893 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-284df6a8-f2bb-4373-8121-2dba947901c5 tempest-ServersAdminNegativeTestJSON-1407282334 tempest-ServersAdminNegativeTestJSON-1407282334-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.051593 Jul 18 02:11:28.435879 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 525/1008] 10.222.0.57 () {60 vars in 1178 bytes} [Mon Jul 18 02:11:28 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:11:28.456081 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-169df921-9c03-41ad-8d12-7cc4f376c382 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:28.459891 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-169df921-9c03-41ad-8d12-7cc4f376c382 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] [instance: e5776c7b-6ae0-43da-a38f-b42e66c6596b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:28.483078 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-169df921-9c03-41ad-8d12-7cc4f376c382 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:28.484159 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-169df921-9c03-41ad-8d12-7cc4f376c382 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:28.486500 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-169df921-9c03-41ad-8d12-7cc4f376c382 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:28.488736 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-169df921-9c03-41ad-8d12-7cc4f376c382 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:28.571445 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-169df921-9c03-41ad-8d12-7cc4f376c382 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] [instance: e5776c7b-6ae0-43da-a38f-b42e66c6596b] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:11:28.759637 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-169df921-9c03-41ad-8d12-7cc4f376c382 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] 10.222.0.57 "DELETE /compute/v2.1/servers/e5776c7b-6ae0-43da-a38f-b42e66c6596b" status: 204 len: 0 microversion: 2.1 time: 0.318771 Jul 18 02:11:28.760058 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 526/1009] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:11:28 2022] DELETE /compute/v2.1/servers/e5776c7b-6ae0-43da-a38f-b42e66c6596b => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:11:28.771987 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9e63f940-671c-4412-9d84-1a39b4440924 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:28.772782 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9e63f940-671c-4412-9d84-1a39b4440924 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: ae4f2139-250b-4a65-8436-702487cc1ded] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:28.784556 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9e63f940-671c-4412-9d84-1a39b4440924 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:28.785125 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9e63f940-671c-4412-9d84-1a39b4440924 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:28.786140 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9e63f940-671c-4412-9d84-1a39b4440924 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:28.786657 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9e63f940-671c-4412-9d84-1a39b4440924 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:29.197122 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9e63f940-671c-4412-9d84-1a39b4440924 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:29.217681 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9e63f940-671c-4412-9d84-1a39b4440924 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded" status: 200 len: 1310 microversion: 2.1 time: 0.453285 Jul 18 02:11:29.224028 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 527/1010] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:28 2022] GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded => generated 1310 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:29.228973 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-968698e8-41c2-4b28-a507-c6c64f9654ad tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:29.229681 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-968698e8-41c2-4b28-a507-c6c64f9654ad tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: f77b267e-9a20-4943-aa8b-0c82b9d6d20e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:29.241331 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-968698e8-41c2-4b28-a507-c6c64f9654ad tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:29.243092 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-968698e8-41c2-4b28-a507-c6c64f9654ad tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:29.247383 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-968698e8-41c2-4b28-a507-c6c64f9654ad tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:29.249147 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-968698e8-41c2-4b28-a507-c6c64f9654ad tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:29.279038 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-968698e8-41c2-4b28-a507-c6c64f9654ad tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] HTTP exception thrown: Instance f77b267e-9a20-4943-aa8b-0c82b9d6d20e could not be found. Jul 18 02:11:29.281537 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-968698e8-41c2-4b28-a507-c6c64f9654ad tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Request method failure captured: Jul 18 02:11:29.281537 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e HTTP/1.1 Jul 18 02:11:29.281537 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:11:29.281537 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:11:29.281537 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:11:29.281537 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:11:29.281537 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:11:29.281537 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:11:29.281537 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:11:29.281537 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:11:29.281537 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MB7COb2JuWcBggx8F3RZhHpF3HmKukL5wat44qauvFX9I9fbUaPgwpOzFbwM46k0f0tpFqHUry-l1QFMuSRce3JaBQUiPzpfLP996GAGhI2YQmuWUvCiAyNv0kfyHpriwXDwB7iA8NZAO27MfFGqAoFxqJHYKvXtuFk21CUv3t-d-k Jul 18 02:11:29.281537 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:11:29.281537 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:11:29.281537 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:11:29.281537 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:11:29.281537 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:11:29.281537 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:11:29.281537 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: dd02ce642caf4529a6e65c184de0ad19 Jul 18 02:11:29.281537 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1663664076 Jul 18 02:11:29.281537 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:11:29.281537 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:11:29.284471 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_dd02ce642caf4529a6e65c184de0ad19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/dd02ce642caf4529a6e65c184de0ad19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/dd02ce642caf4529a6e65c184de0ad19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/dd02ce642caf4529a6e65c184de0ad19"}]}] Jul 18 02:11:29.284471 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1663664076 Jul 18 02:11:29.284471 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: dd02ce642caf4529a6e65c184de0ad19 Jul 18 02:11:29.284471 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1663664076 Jul 18 02:11:29.284471 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1663664076-project Jul 18 02:11:29.284471 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:11:29.284471 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:11:29.284471 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 60118d593f96437dbb2c68ad2fadd465 Jul 18 02:11:29.284471 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1663664076-project Jul 18 02:11:29.284471 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:11:29.284471 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance f77b267e-9a20-4943-aa8b-0c82b9d6d20e could not be found. Jul 18 02:11:29.284471 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'f77b267e-9a20-4943-aa8b-0c82b9d6d20e'} Jul 18 02:11:29.286067 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:11:29.286067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:29.286067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:11:29.286067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:11:29.286067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:11:29.286067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:11:29.286067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:11:29.286067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:11:29.286067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:11:29.286067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:11:29.286067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f77b267e-9a20-4943-aa8b-0c82b9d6d20e could not be found. Jul 18 02:11:29.286067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:29.286067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:29.286067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:29.286067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:29.286067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:29.286067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:29.286067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:11:29.286067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:11:29.286067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:11:29.289289 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:11:29.289289 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:11:29.289289 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:11:29.289289 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:11:29.289289 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:11:29.289289 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:11:29.289289 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:11:29.289289 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:11:29.289289 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:11:29.289289 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f77b267e-9a20-4943-aa8b-0c82b9d6d20e could not be found. Jul 18 02:11:29.289289 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:29.289289 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:29.289289 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:29.289289 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:29.289289 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:29.289289 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:29.289289 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:11:29.289289 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:11:29.289289 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f77b267e-9a20-4943-aa8b-0c82b9d6d20e could not be found. Jul 18 02:11:29.289289 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:29.292182 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-968698e8-41c2-4b28-a507-c6c64f9654ad tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Returning 404 to user: Instance f77b267e-9a20-4943-aa8b-0c82b9d6d20e could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:11:29.292182 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-968698e8-41c2-4b28-a507-c6c64f9654ad tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e" status: 404 len: 111 microversion: 2.1 time: 0.064692 Jul 18 02:11:29.292182 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 528/1011] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:11:29 2022] DELETE /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:11:29.296976 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f91fe3a5-f339-4a24-9cbf-1c6299c4350a tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:29.297645 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f91fe3a5-f339-4a24-9cbf-1c6299c4350a tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: f19cf772-e042-4d44-96ef-6de52397472e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:29.309066 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f91fe3a5-f339-4a24-9cbf-1c6299c4350a tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:29.309865 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f91fe3a5-f339-4a24-9cbf-1c6299c4350a tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:29.311316 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f91fe3a5-f339-4a24-9cbf-1c6299c4350a tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:29.312233 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f91fe3a5-f339-4a24-9cbf-1c6299c4350a tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:29.367766 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f91fe3a5-f339-4a24-9cbf-1c6299c4350a tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: f19cf772-e042-4d44-96ef-6de52397472e] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:11:29.437974 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:11:29.588369 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f91fe3a5-f339-4a24-9cbf-1c6299c4350a tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f19cf772-e042-4d44-96ef-6de52397472e" status: 204 len: 0 microversion: 2.1 time: 0.291711 Jul 18 02:11:29.593799 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 529/1012] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:11:29 2022] DELETE /compute/v2.1/servers/f19cf772-e042-4d44-96ef-6de52397472e => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:11:29.620808 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c29ca702-5615-47e1-8e5d-7e625b803524 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:29.626048 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c29ca702-5615-47e1-8e5d-7e625b803524 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] [instance: e5776c7b-6ae0-43da-a38f-b42e66c6596b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:29.651125 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c29ca702-5615-47e1-8e5d-7e625b803524 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:29.652084 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c29ca702-5615-47e1-8e5d-7e625b803524 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:29.667522 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c29ca702-5615-47e1-8e5d-7e625b803524 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:29.668353 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c29ca702-5615-47e1-8e5d-7e625b803524 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:29.959334 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0936a852-ddd3-4fca-bffc-30c344e9ff1a tempest-FloatingIPsTestJSON-555414803 tempest-FloatingIPsTestJSON-555414803-project] 10.222.0.57 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.747747 Jul 18 02:11:29.959877 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 484/1013] 10.222.0.57 () {60 vars in 1169 bytes} [Mon Jul 18 02:11:26 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3750 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:29.968270 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3024d747-dd89-42d5-8134-d5ee333f00dd tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:29.969007 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3024d747-dd89-42d5-8134-d5ee333f00dd tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:29.999845 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3024d747-dd89-42d5-8134-d5ee333f00dd tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:30.000836 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3024d747-dd89-42d5-8134-d5ee333f00dd tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:30.002618 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3024d747-dd89-42d5-8134-d5ee333f00dd tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:30.003379 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3024d747-dd89-42d5-8134-d5ee333f00dd tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:30.268645 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3024d747-dd89-42d5-8134-d5ee333f00dd tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:30.285221 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c29ca702-5615-47e1-8e5d-7e625b803524 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6698374ee5c4bf18440a2f382db3c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d7b11fb5cd420cb8dbb16208bccf91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:30.315090 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3024d747-dd89-42d5-8134-d5ee333f00dd tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1473 microversion: 2.1 time: 0.344325 Jul 18 02:11:30.318089 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c29ca702-5615-47e1-8e5d-7e625b803524 tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] 10.222.0.57 "GET /compute/v2.1/servers/e5776c7b-6ae0-43da-a38f-b42e66c6596b" status: 200 len: 1473 microversion: 2.1 time: 0.721619 Jul 18 02:11:30.318820 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 485/1014] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:29 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1473 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:30.327458 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9f67270f-6c5c-4598-a505-5b059e8c206f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a8b3b550>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:30.328799 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 530/1015] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:29 2022] GET /compute/v2.1/servers/e5776c7b-6ae0-43da-a38f-b42e66c6596b => generated 1473 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:30.336160 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f032c7d8-7dbe-4151-81de-ba86a4381367 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:30.337949 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f032c7d8-7dbe-4151-81de-ba86a4381367 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: f77b267e-9a20-4943-aa8b-0c82b9d6d20e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:30.376151 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f032c7d8-7dbe-4151-81de-ba86a4381367 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:30.378457 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f032c7d8-7dbe-4151-81de-ba86a4381367 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:30.383318 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f032c7d8-7dbe-4151-81de-ba86a4381367 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:30.390908 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f032c7d8-7dbe-4151-81de-ba86a4381367 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:30.429845 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-f032c7d8-7dbe-4151-81de-ba86a4381367 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] HTTP exception thrown: Instance f77b267e-9a20-4943-aa8b-0c82b9d6d20e could not be found. Jul 18 02:11:30.433513 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f032c7d8-7dbe-4151-81de-ba86a4381367 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Request method failure captured: Jul 18 02:11:30.433513 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e HTTP/1.1 Jul 18 02:11:30.433513 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:11:30.433513 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:11:30.433513 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:11:30.433513 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:11:30.433513 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:11:30.433513 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:11:30.433513 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:11:30.433513 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:11:30.433513 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MB7COb2JuWcBggx8F3RZhHpF3HmKukL5wat44qauvFX9I9fbUaPgwpOzFbwM46k0f0tpFqHUry-l1QFMuSRce3JaBQUiPzpfLP996GAGhI2YQmuWUvCiAyNv0kfyHpriwXDwB7iA8NZAO27MfFGqAoFxqJHYKvXtuFk21CUv3t-d-k Jul 18 02:11:30.433513 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:11:30.433513 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:11:30.433513 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:11:30.433513 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:11:30.433513 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:11:30.433513 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:11:30.433513 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: dd02ce642caf4529a6e65c184de0ad19 Jul 18 02:11:30.433513 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1663664076 Jul 18 02:11:30.433513 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:11:30.433513 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:11:30.436608 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_dd02ce642caf4529a6e65c184de0ad19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/dd02ce642caf4529a6e65c184de0ad19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/dd02ce642caf4529a6e65c184de0ad19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/dd02ce642caf4529a6e65c184de0ad19"}]}] Jul 18 02:11:30.436608 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1663664076 Jul 18 02:11:30.436608 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: dd02ce642caf4529a6e65c184de0ad19 Jul 18 02:11:30.436608 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1663664076 Jul 18 02:11:30.436608 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1663664076-project Jul 18 02:11:30.436608 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:11:30.436608 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:11:30.436608 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 60118d593f96437dbb2c68ad2fadd465 Jul 18 02:11:30.436608 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1663664076-project Jul 18 02:11:30.436608 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:11:30.436608 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance f77b267e-9a20-4943-aa8b-0c82b9d6d20e could not be found. Jul 18 02:11:30.436608 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'f77b267e-9a20-4943-aa8b-0c82b9d6d20e'} Jul 18 02:11:30.438110 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:11:30.438110 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:30.438110 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:11:30.438110 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:11:30.438110 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:11:30.438110 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:11:30.438110 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:11:30.438110 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:11:30.438110 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:11:30.438110 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:11:30.438110 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f77b267e-9a20-4943-aa8b-0c82b9d6d20e could not be found. Jul 18 02:11:30.438110 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:30.438110 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:30.438110 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:30.438110 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:30.438110 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:30.438110 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:30.438110 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:11:30.438110 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:11:30.438110 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:11:30.442572 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:11:30.442572 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:11:30.442572 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:11:30.442572 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:11:30.442572 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:11:30.442572 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:11:30.442572 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:11:30.442572 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f77b267e-9a20-4943-aa8b-0c82b9d6d20e could not be found. Jul 18 02:11:30.442572 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:30.442572 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:30.442572 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:30.442572 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:30.442572 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:30.442572 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:30.442572 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:11:30.442572 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:11:30.442572 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f77b267e-9a20-4943-aa8b-0c82b9d6d20e could not be found. Jul 18 02:11:30.442572 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:30.446132 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f032c7d8-7dbe-4151-81de-ba86a4381367 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Returning 404 to user: Instance f77b267e-9a20-4943-aa8b-0c82b9d6d20e could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:11:30.446132 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f032c7d8-7dbe-4151-81de-ba86a4381367 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e" status: 404 len: 111 microversion: 2.1 time: 0.105367 Jul 18 02:11:30.446586 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9f67270f-6c5c-4598-a505-5b059e8c206f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/48443bda-c7c8-463b-b521-129df053a409" status: 200 len: 1410 microversion: 2.1 time: 0.116855 Jul 18 02:11:30.446825 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 531/1016] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:30 2022] GET /compute/v2.1/servers/f77b267e-9a20-4943-aa8b-0c82b9d6d20e => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:11:30.447262 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 486/1017] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:11:30 2022] GET /compute/v2.1/images/48443bda-c7c8-463b-b521-129df053a409 => generated 1410 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:30.452964 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bfb891dd-d7a7-4c60-a208-68e49f11c241 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:30.453241 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ab300b69-ac95-4018-9812-29f29799527c tempest-FloatingIPsTestJSON-555414803 tempest-FloatingIPsTestJSON-555414803-project] Calling method '.version_select at 0x7ff4a8c590d0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:30.454321 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bfb891dd-d7a7-4c60-a208-68e49f11c241 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: f19cf772-e042-4d44-96ef-6de52397472e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:30.472569 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bfb891dd-d7a7-4c60-a208-68e49f11c241 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:30.473352 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bfb891dd-d7a7-4c60-a208-68e49f11c241 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:30.475032 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bfb891dd-d7a7-4c60-a208-68e49f11c241 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:30.476040 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bfb891dd-d7a7-4c60-a208-68e49f11c241 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:30.902882 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bfb891dd-d7a7-4c60-a208-68e49f11c241 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6962b97241f4c3a9960bb5fe52f8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8e996befd24b26b0371ad9cdb4a069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:30.911323 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bfb891dd-d7a7-4c60-a208-68e49f11c241 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] 10.222.0.57 "GET /compute/v2.1/servers/f19cf772-e042-4d44-96ef-6de52397472e" status: 200 len: 1466 microversion: 2.1 time: 0.467121 Jul 18 02:11:30.918053 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 532/1018] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:30 2022] GET /compute/v2.1/servers/f19cf772-e042-4d44-96ef-6de52397472e => generated 1466 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:30.935745 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ee9b35bc-fce6-4441-be00-3e16bdeb726b tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:30.938647 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ee9b35bc-fce6-4441-be00-3e16bdeb726b tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: ae4f2139-250b-4a65-8436-702487cc1ded] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:30.962527 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ee9b35bc-fce6-4441-be00-3e16bdeb726b tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:30.963586 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ee9b35bc-fce6-4441-be00-3e16bdeb726b tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:30.964623 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ee9b35bc-fce6-4441-be00-3e16bdeb726b tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:30.966665 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ee9b35bc-fce6-4441-be00-3e16bdeb726b tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:31.322646 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ee9b35bc-fce6-4441-be00-3e16bdeb726b tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:31.357054 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ee9b35bc-fce6-4441-be00-3e16bdeb726b tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded" status: 200 len: 1310 microversion: 2.1 time: 0.437091 Jul 18 02:11:31.359951 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 533/1019] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:30 2022] GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded => generated 1310 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:31.371623 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-de27954c-db55-4399-98a4-4936d81d0188 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:31.372908 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-de27954c-db55-4399-98a4-4936d81d0188 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: dbb215bf-6099-4dd5-b9af-d1bbfb55ef21] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:31.396783 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-de27954c-db55-4399-98a4-4936d81d0188 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:31.399030 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-de27954c-db55-4399-98a4-4936d81d0188 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:31.401475 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-de27954c-db55-4399-98a4-4936d81d0188 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:31.402740 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-de27954c-db55-4399-98a4-4936d81d0188 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:31.451610 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-de27954c-db55-4399-98a4-4936d81d0188 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] HTTP exception thrown: Instance dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 could not be found. Jul 18 02:11:31.455866 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-de27954c-db55-4399-98a4-4936d81d0188 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Request method failure captured: Jul 18 02:11:31.455866 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/servers/dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 HTTP/1.1 Jul 18 02:11:31.455866 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:11:31.455866 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:11:31.455866 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:11:31.455866 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:11:31.455866 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:11:31.455866 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:11:31.455866 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:11:31.455866 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:11:31.455866 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MB7COb2JuWcBggx8F3RZhHpF3HmKukL5wat44qauvFX9I9fbUaPgwpOzFbwM46k0f0tpFqHUry-l1QFMuSRce3JaBQUiPzpfLP996GAGhI2YQmuWUvCiAyNv0kfyHpriwXDwB7iA8NZAO27MfFGqAoFxqJHYKvXtuFk21CUv3t-d-k Jul 18 02:11:31.455866 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:11:31.455866 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:11:31.455866 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:11:31.455866 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:11:31.455866 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:11:31.455866 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:11:31.455866 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: dd02ce642caf4529a6e65c184de0ad19 Jul 18 02:11:31.455866 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1663664076 Jul 18 02:11:31.455866 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:11:31.455866 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:11:31.459707 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_dd02ce642caf4529a6e65c184de0ad19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/dd02ce642caf4529a6e65c184de0ad19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/dd02ce642caf4529a6e65c184de0ad19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/dd02ce642caf4529a6e65c184de0ad19"}]}] Jul 18 02:11:31.459707 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1663664076 Jul 18 02:11:31.459707 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: dd02ce642caf4529a6e65c184de0ad19 Jul 18 02:11:31.459707 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1663664076 Jul 18 02:11:31.459707 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1663664076-project Jul 18 02:11:31.459707 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:11:31.459707 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:11:31.459707 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 60118d593f96437dbb2c68ad2fadd465 Jul 18 02:11:31.459707 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1663664076-project Jul 18 02:11:31.459707 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:11:31.459707 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 could not be found. Jul 18 02:11:31.459707 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'dbb215bf-6099-4dd5-b9af-d1bbfb55ef21'} Jul 18 02:11:31.461606 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:11:31.461606 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:31.461606 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:11:31.461606 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:11:31.461606 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:11:31.461606 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:11:31.461606 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:11:31.461606 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:11:31.461606 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:11:31.461606 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:11:31.461606 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 could not be found. Jul 18 02:11:31.461606 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:31.461606 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:31.461606 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:31.461606 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:31.461606 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:31.461606 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:31.461606 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:11:31.461606 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:11:31.461606 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:11:31.464385 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:11:31.464385 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:11:31.464385 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:11:31.464385 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:11:31.464385 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:11:31.464385 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:11:31.464385 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:11:31.464385 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:11:31.464385 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:11:31.464385 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 could not be found. Jul 18 02:11:31.464385 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:31.464385 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:31.464385 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:31.464385 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:31.464385 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:31.464385 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:31.464385 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:11:31.464385 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:11:31.464385 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 could not be found. Jul 18 02:11:31.464385 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:31.470569 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-de27954c-db55-4399-98a4-4936d81d0188 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Returning 404 to user: Instance dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:11:31.472386 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-de27954c-db55-4399-98a4-4936d81d0188 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "DELETE /compute/v2.1/servers/dbb215bf-6099-4dd5-b9af-d1bbfb55ef21" status: 404 len: 111 microversion: 2.1 time: 0.109866 Jul 18 02:11:31.474221 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 534/1020] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:11:31 2022] DELETE /compute/v2.1/servers/dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:11:31.489184 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a0e14327-971d-4290-8cbd-d4de1149e223 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:31.528122 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a0e14327-971d-4290-8cbd-d4de1149e223 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:31.553376 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a0e14327-971d-4290-8cbd-d4de1149e223 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:31.554291 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a0e14327-971d-4290-8cbd-d4de1149e223 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:31.555566 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a0e14327-971d-4290-8cbd-d4de1149e223 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:31.556144 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a0e14327-971d-4290-8cbd-d4de1149e223 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:32.164229 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a0e14327-971d-4290-8cbd-d4de1149e223 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:32.191285 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a0e14327-971d-4290-8cbd-d4de1149e223 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1473 microversion: 2.1 time: 0.714289 Jul 18 02:11:32.193624 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 535/1021] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:31 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1473 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:32.206009 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1cb115cf-212a-4e6d-a6e6-b8cb615bf3ad tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:32.207955 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1cb115cf-212a-4e6d-a6e6-b8cb615bf3ad tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] [instance: e5776c7b-6ae0-43da-a38f-b42e66c6596b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:32.220255 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1cb115cf-212a-4e6d-a6e6-b8cb615bf3ad tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:32.221083 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1cb115cf-212a-4e6d-a6e6-b8cb615bf3ad tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:32.222586 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1cb115cf-212a-4e6d-a6e6-b8cb615bf3ad tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:32.229022 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1cb115cf-212a-4e6d-a6e6-b8cb615bf3ad tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:32.832391 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1cb115cf-212a-4e6d-a6e6-b8cb615bf3ad tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6698374ee5c4bf18440a2f382db3c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d7b11fb5cd420cb8dbb16208bccf91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:32.843732 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1cb115cf-212a-4e6d-a6e6-b8cb615bf3ad tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] 10.222.0.57 "GET /compute/v2.1/servers/e5776c7b-6ae0-43da-a38f-b42e66c6596b" status: 200 len: 1473 microversion: 2.1 time: 0.648610 Jul 18 02:11:32.853590 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 536/1022] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:32 2022] GET /compute/v2.1/servers/e5776c7b-6ae0-43da-a38f-b42e66c6596b => generated 1473 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:32.861422 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-245080b9-d18a-4f0d-a8a0-07bdd12cf1f4 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a8987af0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:32.982653 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-245080b9-d18a-4f0d-a8a0-07bdd12cf1f4 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/48443bda-c7c8-463b-b521-129df053a409" status: 200 len: 1410 microversion: 2.1 time: 0.127593 Jul 18 02:11:32.990412 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 537/1023] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:11:32 2022] GET /compute/v2.1/images/48443bda-c7c8-463b-b521-129df053a409 => generated 1410 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:33.006578 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-245a1141-40a0-4493-8552-a2b01a414a40 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:33.012334 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-245a1141-40a0-4493-8552-a2b01a414a40 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] [instance: dbb215bf-6099-4dd5-b9af-d1bbfb55ef21] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:33.040567 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-245a1141-40a0-4493-8552-a2b01a414a40 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:33.041346 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-245a1141-40a0-4493-8552-a2b01a414a40 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:33.042390 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-245a1141-40a0-4493-8552-a2b01a414a40 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:33.043104 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-245a1141-40a0-4493-8552-a2b01a414a40 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:33.087885 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-245a1141-40a0-4493-8552-a2b01a414a40 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] HTTP exception thrown: Instance dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 could not be found. Jul 18 02:11:33.089888 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-245a1141-40a0-4493-8552-a2b01a414a40 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Request method failure captured: Jul 18 02:11:33.089888 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 HTTP/1.1 Jul 18 02:11:33.089888 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:11:33.089888 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:11:33.089888 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:11:33.089888 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:11:33.089888 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:11:33.089888 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:11:33.089888 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:11:33.089888 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:11:33.089888 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MB7COb2JuWcBggx8F3RZhHpF3HmKukL5wat44qauvFX9I9fbUaPgwpOzFbwM46k0f0tpFqHUry-l1QFMuSRce3JaBQUiPzpfLP996GAGhI2YQmuWUvCiAyNv0kfyHpriwXDwB7iA8NZAO27MfFGqAoFxqJHYKvXtuFk21CUv3t-d-k Jul 18 02:11:33.089888 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:11:33.089888 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:11:33.089888 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:11:33.089888 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:11:33.089888 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:11:33.089888 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:11:33.089888 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: dd02ce642caf4529a6e65c184de0ad19 Jul 18 02:11:33.089888 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1663664076 Jul 18 02:11:33.089888 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:11:33.089888 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:11:33.091267 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_dd02ce642caf4529a6e65c184de0ad19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/dd02ce642caf4529a6e65c184de0ad19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/dd02ce642caf4529a6e65c184de0ad19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/dd02ce642caf4529a6e65c184de0ad19"}]}] Jul 18 02:11:33.091267 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1663664076 Jul 18 02:11:33.091267 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: dd02ce642caf4529a6e65c184de0ad19 Jul 18 02:11:33.091267 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1663664076 Jul 18 02:11:33.091267 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1663664076-project Jul 18 02:11:33.091267 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:11:33.091267 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:11:33.091267 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 60118d593f96437dbb2c68ad2fadd465 Jul 18 02:11:33.091267 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1663664076-project Jul 18 02:11:33.091267 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:11:33.091267 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 could not be found. Jul 18 02:11:33.091267 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'dbb215bf-6099-4dd5-b9af-d1bbfb55ef21'} Jul 18 02:11:33.092018 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:11:33.092018 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:33.092018 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:11:33.092018 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:11:33.092018 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:11:33.092018 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:11:33.092018 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:11:33.092018 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:11:33.092018 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:11:33.092018 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:11:33.092018 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 could not be found. Jul 18 02:11:33.092018 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:33.092018 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:33.092018 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:33.092018 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:33.092018 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:33.092018 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:33.092018 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:11:33.092018 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:11:33.092018 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:11:33.093209 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:11:33.093209 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:11:33.093209 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:11:33.093209 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:11:33.093209 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:11:33.093209 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:11:33.093209 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:11:33.093209 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 could not be found. Jul 18 02:11:33.093209 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:33.093209 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:33.093209 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:33.093209 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:33.093209 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:33.093209 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:33.093209 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:11:33.093209 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:11:33.093209 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 could not be found. Jul 18 02:11:33.093209 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:33.095193 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-245a1141-40a0-4493-8552-a2b01a414a40 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] Returning 404 to user: Instance dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:11:33.096255 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-245a1141-40a0-4493-8552-a2b01a414a40 tempest-ServersWithSpecificFlavorTestJSON-1663664076 tempest-ServersWithSpecificFlavorTestJSON-1663664076-project] 10.222.0.57 "GET /compute/v2.1/servers/dbb215bf-6099-4dd5-b9af-d1bbfb55ef21" status: 404 len: 111 microversion: 2.1 time: 0.104614 Jul 18 02:11:33.106976 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 538/1024] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:32 2022] GET /compute/v2.1/servers/dbb215bf-6099-4dd5-b9af-d1bbfb55ef21 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:11:33.112571 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0f4d122d-5ff3-4158-ba96-e5718a709c4f tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:33.113481 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0f4d122d-5ff3-4158-ba96-e5718a709c4f tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: f19cf772-e042-4d44-96ef-6de52397472e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:33.136664 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f4d122d-5ff3-4158-ba96-e5718a709c4f tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:33.137319 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f4d122d-5ff3-4158-ba96-e5718a709c4f tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:33.138354 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f4d122d-5ff3-4158-ba96-e5718a709c4f tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:33.138981 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f4d122d-5ff3-4158-ba96-e5718a709c4f tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:33.271786 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ab300b69-ac95-4018-9812-29f29799527c tempest-FloatingIPsTestJSON-555414803 tempest-FloatingIPsTestJSON-555414803-project] 10.222.0.57 "DELETE /compute/v2.1/os-floating-ips/1f219eec-e5e9-4574-899e-d9768e04378f" status: 202 len: 0 microversion: 2.1 time: 2.820307 Jul 18 02:11:33.274751 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 487/1025] 10.222.0.57 () {58 vars in 1262 bytes} [Mon Jul 18 02:11:30 2022] DELETE /compute/v2.1/os-floating-ips/1f219eec-e5e9-4574-899e-d9768e04378f => generated 0 bytes in 2827 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:11:33.317966 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dd89de04-481e-4d8c-ac8b-48244b331ab8 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:33.321537 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-dd89de04-481e-4d8c-ac8b-48244b331ab8 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: ae4f2139-250b-4a65-8436-702487cc1ded] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:33.374385 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dd89de04-481e-4d8c-ac8b-48244b331ab8 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:33.375940 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dd89de04-481e-4d8c-ac8b-48244b331ab8 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:33.378386 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dd89de04-481e-4d8c-ac8b-48244b331ab8 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:33.379468 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dd89de04-481e-4d8c-ac8b-48244b331ab8 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:34.024744 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-dd89de04-481e-4d8c-ac8b-48244b331ab8 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:34.052214 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-dd89de04-481e-4d8c-ac8b-48244b331ab8 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded" status: 200 len: 1310 microversion: 2.1 time: 0.775257 Jul 18 02:11:34.086023 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 488/1026] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:33 2022] GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded => generated 1310 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:34.102670 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-d5792720-fb08-4275-9519-5f86ccc4ea73 req-5c15fc55-4976-44d1-bff3-2cb255af65f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5776c7b-6ae0-43da-a38f-b42e66c6596b", "name": "network-vif-deleted", "tag": "b3a28d1b-5dd9-4c5b-9917-ed3720c2a542"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:34.139789 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-d5792720-fb08-4275-9519-5f86ccc4ea73 req-5c15fc55-4976-44d1-bff3-2cb255af65f7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:34.143186 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-d5792720-fb08-4275-9519-5f86ccc4ea73 req-5c15fc55-4976-44d1-bff3-2cb255af65f7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:34.145248 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0f4d122d-5ff3-4158-ba96-e5718a709c4f tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6962b97241f4c3a9960bb5fe52f8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8e996befd24b26b0371ad9cdb4a069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:34.168106 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0f4d122d-5ff3-4158-ba96-e5718a709c4f tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] 10.222.0.57 "GET /compute/v2.1/servers/f19cf772-e042-4d44-96ef-6de52397472e" status: 200 len: 1466 microversion: 2.1 time: 1.059688 Jul 18 02:11:34.168714 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 539/1027] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:33 2022] GET /compute/v2.1/servers/f19cf772-e042-4d44-96ef-6de52397472e => generated 1466 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:34.174107 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a536ff97-2c3d-4a3d-864d-dee28c1c11be tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:34.180799 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a536ff97-2c3d-4a3d-864d-dee28c1c11be tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:34.196341 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a536ff97-2c3d-4a3d-864d-dee28c1c11be tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:34.197124 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a536ff97-2c3d-4a3d-864d-dee28c1c11be tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:34.202336 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a536ff97-2c3d-4a3d-864d-dee28c1c11be tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:34.206467 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a536ff97-2c3d-4a3d-864d-dee28c1c11be tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:34.207973 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-d5792720-fb08-4275-9519-5f86ccc4ea73 req-5c15fc55-4976-44d1-bff3-2cb255af65f7 service nova] Creating event network-vif-deleted:b3a28d1b-5dd9-4c5b-9917-ed3720c2a542 for instance e5776c7b-6ae0-43da-a38f-b42e66c6596b on n-h1-465891-3 Jul 18 02:11:34.235831 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-d5792720-fb08-4275-9519-5f86ccc4ea73 req-5c15fc55-4976-44d1-bff3-2cb255af65f7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147357 Jul 18 02:11:34.243877 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 489/1028] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:34.266879 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c78bbee9-f209-4b0f-a1f7-9988dbbbbbb1 tempest-FloatingIPsTestJSON-555414803 tempest-FloatingIPsTestJSON-555414803-project] Calling method '.version_select at 0x7ff4a8b3b4c0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:34.416252 n-d-465891-3 devstack@n-api.service[119543]: DEBUG neutronclient.v2_0.client [None req-c78bbee9-f209-4b0f-a1f7-9988dbbbbbb1 tempest-FloatingIPsTestJSON-555414803 tempest-FloatingIPsTestJSON-555414803-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 1f219eec-e5e9-4574-899e-d9768e04378f could not be found", "detail": ""}} {{(pid=119543) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:11:34.419077 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-c78bbee9-f209-4b0f-a1f7-9988dbbbbbb1 tempest-FloatingIPsTestJSON-555414803 tempest-FloatingIPsTestJSON-555414803-project] HTTP exception thrown: Floating IP not found for ID 1f219eec-e5e9-4574-899e-d9768e04378f Jul 18 02:11:34.425014 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c78bbee9-f209-4b0f-a1f7-9988dbbbbbb1 tempest-FloatingIPsTestJSON-555414803 tempest-FloatingIPsTestJSON-555414803-project] Request method failure captured: Jul 18 02:11:34.425014 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/os-floating-ips/1f219eec-e5e9-4574-899e-d9768e04378f HTTP/1.1 Jul 18 02:11:34.425014 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:11:34.425014 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:11:34.425014 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:11:34.425014 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:11:34.425014 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:11:34.425014 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:11:34.425014 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:11:34.425014 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:11:34.425014 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MFC6fHDLzAaH8USUvTWFAMBy7U7YaN2ibzrHdfrY5k_RcazKv-G_9Wefg5ATgpQnppCaCH4BjsQG25Z7p-9Lq7utsZrDSUepYdcezlyWQ8kBK4HuM53MgO0HbHh9mczbRLdOf7Gex_T0xf-FXwGdjnKSPZZGG8UglaC4ELMSJWCqgg Jul 18 02:11:34.425014 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:11:34.425014 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:11:34.425014 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:11:34.425014 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:11:34.425014 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:11:34.425014 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:11:34.425014 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 29b80b8f147145e8a193796a0cac9afc Jul 18 02:11:34.425014 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-FloatingIPsTestJSON-555414803 Jul 18 02:11:34.425014 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:11:34.425014 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:11:34.429396 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_29b80b8f147145e8a193796a0cac9afc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/29b80b8f147145e8a193796a0cac9afc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/29b80b8f147145e8a193796a0cac9afc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/29b80b8f147145e8a193796a0cac9afc"}]}] Jul 18 02:11:34.429396 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-FloatingIPsTestJSON-555414803 Jul 18 02:11:34.429396 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 29b80b8f147145e8a193796a0cac9afc Jul 18 02:11:34.429396 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-FloatingIPsTestJSON-555414803 Jul 18 02:11:34.429396 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-FloatingIPsTestJSON-555414803-project Jul 18 02:11:34.429396 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:11:34.429396 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:11:34.429396 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 257cb132a8ca4a808687d47afbd9d2d4 Jul 18 02:11:34.429396 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-FloatingIPsTestJSON-555414803-project Jul 18 02:11:34.429396 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:11:34.429396 n-d-465891-3 devstack@n-api.service[119543]: exception: Floating IP not found for ID 1f219eec-e5e9-4574-899e-d9768e04378f Jul 18 02:11:34.429396 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '1f219eec-e5e9-4574-899e-d9768e04378f'} Jul 18 02:11:34.429396 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:11:34.436366 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:34.436366 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 18 02:11:34.436366 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 18 02:11:34.436366 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:11:34.436366 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:11:34.436366 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 18 02:11:34.436366 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 18 02:11:34.436366 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:11:34.436366 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:11:34.436366 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 02:11:34.436366 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 02:11:34.436366 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:11:34.436366 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:11:34.436366 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:11:34.436366 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:11:34.436366 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:11:34.436366 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:11:34.436366 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:11:34.436366 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:11:34.442235 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:11:34.442235 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:11:34.442235 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:11:34.442235 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:11:34.442235 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:11:34.442235 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:11:34.442235 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 1f219eec-e5e9-4574-899e-d9768e04378f could not be found Jul 18 02:11:34.442235 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2b804ee5-2ff6-4688-ace9-a98c6667e403'] Jul 18 02:11:34.442235 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:34.442235 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:34.442235 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:34.442235 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:34.442235 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 18 02:11:34.442235 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 18 02:11:34.442235 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 18 02:11:34.442235 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 18 02:11:34.442235 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 1f219eec-e5e9-4574-899e-d9768e04378f. Jul 18 02:11:34.442235 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:34.442235 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:34.442235 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:34.448295 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:34.448295 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:34.448295 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:34.448295 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:11:34.448295 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:11:34.448295 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:11:34.448295 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:11:34.448295 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:11:34.448295 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:11:34.448295 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 18 02:11:34.448295 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 18 02:11:34.448295 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 1f219eec-e5e9-4574-899e-d9768e04378f Jul 18 02:11:34.448295 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:34.448295 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:34.448295 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:34.448295 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:34.448295 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:34.448295 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:34.448295 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:11:34.448295 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:11:34.454171 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 1f219eec-e5e9-4574-899e-d9768e04378f Jul 18 02:11:34.454171 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:34.454171 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c78bbee9-f209-4b0f-a1f7-9988dbbbbbb1 tempest-FloatingIPsTestJSON-555414803 tempest-FloatingIPsTestJSON-555414803-project] Returning 404 to user: Floating IP not found for ID 1f219eec-e5e9-4574-899e-d9768e04378f {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:11:34.454171 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c78bbee9-f209-4b0f-a1f7-9988dbbbbbb1 tempest-FloatingIPsTestJSON-555414803 tempest-FloatingIPsTestJSON-555414803-project] 10.222.0.57 "GET /compute/v2.1/os-floating-ips/1f219eec-e5e9-4574-899e-d9768e04378f" status: 404 len: 111 microversion: 2.1 time: 0.193659 Jul 18 02:11:34.454171 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 490/1029] 10.222.0.57 () {58 vars in 1259 bytes} [Mon Jul 18 02:11:34 2022] GET /compute/v2.1/os-floating-ips/1f219eec-e5e9-4574-899e-d9768e04378f => generated 111 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:11:34.463459 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-59722144-2858-4f06-bc13-548c7f171bef tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:34.479335 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-59722144-2858-4f06-bc13-548c7f171bef tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] [instance: e5776c7b-6ae0-43da-a38f-b42e66c6596b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:34.499153 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-59722144-2858-4f06-bc13-548c7f171bef tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:34.500852 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-59722144-2858-4f06-bc13-548c7f171bef tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:34.504772 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-59722144-2858-4f06-bc13-548c7f171bef tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:34.508739 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-59722144-2858-4f06-bc13-548c7f171bef tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:34.538134 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-59722144-2858-4f06-bc13-548c7f171bef tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] HTTP exception thrown: Instance e5776c7b-6ae0-43da-a38f-b42e66c6596b could not be found. Jul 18 02:11:34.540359 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-59722144-2858-4f06-bc13-548c7f171bef tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Request method failure captured: Jul 18 02:11:34.540359 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/e5776c7b-6ae0-43da-a38f-b42e66c6596b HTTP/1.1 Jul 18 02:11:34.540359 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:11:34.540359 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:11:34.540359 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:11:34.540359 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:11:34.540359 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:11:34.540359 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:11:34.540359 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:11:34.540359 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:11:34.540359 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MEVfLfodZWhoHilfK1J7KVhJrGCxv3Ha9qn7krYB52gGi8O6ssbiHm3HBxQ4MyDMQkS95OGj9b-zjoRV6gLsrUPPFobPYHqAYMRv_Wh5EsQgTQJX1nfUGooacfai7Ts4FpmsLEQF_qPDjyfx8c_lMHKpHUPuUlMb6VwjfB58IXK1RY Jul 18 02:11:34.540359 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:11:34.540359 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:11:34.540359 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:11:34.540359 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:11:34.540359 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:11:34.540359 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:11:34.540359 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 66d7b11fb5cd420cb8dbb16208bccf91 Jul 18 02:11:34.540359 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-LiveMigrationNegativeTest-2111049051 Jul 18 02:11:34.540359 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:11:34.540359 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:11:34.541844 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_66d7b11fb5cd420cb8dbb16208bccf91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/66d7b11fb5cd420cb8dbb16208bccf91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/66d7b11fb5cd420cb8dbb16208bccf91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/66d7b11fb5cd420cb8dbb16208bccf91"}]}] Jul 18 02:11:34.541844 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-LiveMigrationNegativeTest-2111049051 Jul 18 02:11:34.541844 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 66d7b11fb5cd420cb8dbb16208bccf91 Jul 18 02:11:34.541844 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-2111049051 Jul 18 02:11:34.541844 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-LiveMigrationNegativeTest-2111049051-project Jul 18 02:11:34.541844 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:11:34.541844 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:11:34.541844 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: c6698374ee5c4bf18440a2f382db3c37 Jul 18 02:11:34.541844 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-LiveMigrationNegativeTest-2111049051-project Jul 18 02:11:34.541844 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:11:34.541844 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance e5776c7b-6ae0-43da-a38f-b42e66c6596b could not be found. Jul 18 02:11:34.541844 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'e5776c7b-6ae0-43da-a38f-b42e66c6596b'} Jul 18 02:11:34.542598 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:11:34.542598 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:34.542598 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:11:34.542598 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:11:34.542598 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:11:34.542598 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:11:34.542598 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:11:34.542598 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:11:34.542598 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:11:34.542598 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:11:34.542598 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5776c7b-6ae0-43da-a38f-b42e66c6596b could not be found. Jul 18 02:11:34.542598 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:34.542598 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:34.542598 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:34.542598 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:34.542598 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:34.542598 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:34.542598 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:11:34.542598 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:11:34.542598 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:11:34.543810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:11:34.543810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:11:34.543810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:11:34.543810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:11:34.543810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:11:34.543810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:11:34.543810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:11:34.543810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5776c7b-6ae0-43da-a38f-b42e66c6596b could not be found. Jul 18 02:11:34.543810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:34.543810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:34.543810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:34.543810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:34.543810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:34.543810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:34.543810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:11:34.543810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:11:34.543810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5776c7b-6ae0-43da-a38f-b42e66c6596b could not be found. Jul 18 02:11:34.543810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:34.550736 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-59722144-2858-4f06-bc13-548c7f171bef tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] Returning 404 to user: Instance e5776c7b-6ae0-43da-a38f-b42e66c6596b could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:11:34.553124 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-59722144-2858-4f06-bc13-548c7f171bef tempest-LiveMigrationNegativeTest-2111049051 tempest-LiveMigrationNegativeTest-2111049051-project] 10.222.0.57 "GET /compute/v2.1/servers/e5776c7b-6ae0-43da-a38f-b42e66c6596b" status: 404 len: 111 microversion: 2.1 time: 0.104944 Jul 18 02:11:34.572204 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 491/1030] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:34 2022] GET /compute/v2.1/servers/e5776c7b-6ae0-43da-a38f-b42e66c6596b => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:11:34.592213 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-1a5d2aa1-863b-4045-bab1-ef8f8d1a0e4c req-a967c5dc-91c5-4087-8f96-f455aed537f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae4f2139-250b-4a65-8436-702487cc1ded", "name": "network-vif-plugged", "status": "completed", "tag": "babbb140-0981-4a5e-b5a3-7f0cc8649998"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:34.629161 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-1a5d2aa1-863b-4045-bab1-ef8f8d1a0e4c req-a967c5dc-91c5-4087-8f96-f455aed537f3 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:34.638711 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-1a5d2aa1-863b-4045-bab1-ef8f8d1a0e4c req-a967c5dc-91c5-4087-8f96-f455aed537f3 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:34.688671 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-1a5d2aa1-863b-4045-bab1-ef8f8d1a0e4c req-a967c5dc-91c5-4087-8f96-f455aed537f3 service nova] Creating event network-vif-plugged:babbb140-0981-4a5e-b5a3-7f0cc8649998 for instance ae4f2139-250b-4a65-8436-702487cc1ded on n-h1-465891-3 Jul 18 02:11:34.704832 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-1a5d2aa1-863b-4045-bab1-ef8f8d1a0e4c req-a967c5dc-91c5-4087-8f96-f455aed537f3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126316 Jul 18 02:11:34.708004 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 492/1031] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:34.728761 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-defa0a55-98eb-4ea2-90c7-d27a1e74a110 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a8b3bd30>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:34.826048 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a536ff97-2c3d-4a3d-864d-dee28c1c11be tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:34.849107 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a536ff97-2c3d-4a3d-864d-dee28c1c11be tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1473 microversion: 2.1 time: 0.678722 Jul 18 02:11:34.857160 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 540/1032] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:34 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1473 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:34.919856 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d0b4c881-7749-456d-a99f-f2f2c16399d1 tempest-FloatingIPsTestJSON-555414803 tempest-FloatingIPsTestJSON-555414803-project] Calling method '.version_select at 0x7ff4a8b033a0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:34.920116 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-defa0a55-98eb-4ea2-90c7-d27a1e74a110 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/48443bda-c7c8-463b-b521-129df053a409" status: 200 len: 1410 microversion: 2.1 time: 0.210314 Jul 18 02:11:34.920624 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 493/1033] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:11:34 2022] GET /compute/v2.1/images/48443bda-c7c8-463b-b521-129df053a409 => generated 1410 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:35.097798 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-445a838a-835f-4c97-952c-03ed96105426 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:35.102271 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-445a838a-835f-4c97-952c-03ed96105426 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: ae4f2139-250b-4a65-8436-702487cc1ded] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:35.132391 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-445a838a-835f-4c97-952c-03ed96105426 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:35.140489 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-445a838a-835f-4c97-952c-03ed96105426 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:35.142839 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-445a838a-835f-4c97-952c-03ed96105426 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:35.144941 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-445a838a-835f-4c97-952c-03ed96105426 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:35.321587 n-d-465891-3 devstack@n-api.service[119544]: DEBUG neutronclient.v2_0.client [None req-d0b4c881-7749-456d-a99f-f2f2c16399d1 tempest-FloatingIPsTestJSON-555414803 tempest-FloatingIPsTestJSON-555414803-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 1f219eec-e5e9-4574-899e-d9768e04378f could not be found", "detail": ""}} {{(pid=119544) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:11:35.322494 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-d0b4c881-7749-456d-a99f-f2f2c16399d1 tempest-FloatingIPsTestJSON-555414803 tempest-FloatingIPsTestJSON-555414803-project] HTTP exception thrown: Floating IP not found for ID 1f219eec-e5e9-4574-899e-d9768e04378f Jul 18 02:11:35.349889 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d0b4c881-7749-456d-a99f-f2f2c16399d1 tempest-FloatingIPsTestJSON-555414803 tempest-FloatingIPsTestJSON-555414803-project] Request method failure captured: Jul 18 02:11:35.349889 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/os-floating-ips/1f219eec-e5e9-4574-899e-d9768e04378f HTTP/1.1 Jul 18 02:11:35.349889 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:11:35.349889 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:11:35.349889 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:11:35.349889 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:11:35.349889 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:11:35.349889 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:11:35.349889 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:11:35.349889 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:11:35.349889 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MFC6fHDLzAaH8USUvTWFAMBy7U7YaN2ibzrHdfrY5k_RcazKv-G_9Wefg5ATgpQnppCaCH4BjsQG25Z7p-9Lq7utsZrDSUepYdcezlyWQ8kBK4HuM53MgO0HbHh9mczbRLdOf7Gex_T0xf-FXwGdjnKSPZZGG8UglaC4ELMSJWCqgg Jul 18 02:11:35.349889 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:11:35.349889 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:11:35.349889 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:11:35.349889 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:11:35.349889 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:11:35.349889 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:11:35.349889 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 29b80b8f147145e8a193796a0cac9afc Jul 18 02:11:35.349889 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-FloatingIPsTestJSON-555414803 Jul 18 02:11:35.349889 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:11:35.349889 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:11:35.352091 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_29b80b8f147145e8a193796a0cac9afc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/29b80b8f147145e8a193796a0cac9afc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/29b80b8f147145e8a193796a0cac9afc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/29b80b8f147145e8a193796a0cac9afc"}]}] Jul 18 02:11:35.352091 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-FloatingIPsTestJSON-555414803 Jul 18 02:11:35.352091 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 29b80b8f147145e8a193796a0cac9afc Jul 18 02:11:35.352091 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-FloatingIPsTestJSON-555414803 Jul 18 02:11:35.352091 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-FloatingIPsTestJSON-555414803-project Jul 18 02:11:35.352091 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:11:35.352091 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:11:35.352091 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 257cb132a8ca4a808687d47afbd9d2d4 Jul 18 02:11:35.352091 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-FloatingIPsTestJSON-555414803-project Jul 18 02:11:35.352091 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:11:35.352091 n-d-465891-3 devstack@n-api.service[119544]: exception: Floating IP not found for ID 1f219eec-e5e9-4574-899e-d9768e04378f Jul 18 02:11:35.352091 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '1f219eec-e5e9-4574-899e-d9768e04378f'} Jul 18 02:11:35.352091 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:11:35.353073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:35.353073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 18 02:11:35.353073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 18 02:11:35.353073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:11:35.353073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:11:35.353073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 18 02:11:35.353073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 18 02:11:35.353073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:11:35.353073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:11:35.353073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 02:11:35.353073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 02:11:35.353073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:11:35.353073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:11:35.353073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:11:35.353073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:11:35.353073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:11:35.353073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:11:35.353073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:11:35.353073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:11:35.354314 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:11:35.354314 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:11:35.354314 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:11:35.354314 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:11:35.354314 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:11:35.354314 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:11:35.354314 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 1f219eec-e5e9-4574-899e-d9768e04378f could not be found Jul 18 02:11:35.354314 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-546b16ab-d807-4a3a-b5bc-9194bff350b6'] Jul 18 02:11:35.354314 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:35.354314 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:35.354314 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:35.354314 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:35.354314 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 18 02:11:35.354314 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 18 02:11:35.354314 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 18 02:11:35.354314 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 18 02:11:35.354314 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 1f219eec-e5e9-4574-899e-d9768e04378f. Jul 18 02:11:35.354314 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:35.354314 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:35.354314 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:35.355540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:35.355540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:35.355540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:35.355540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:11:35.355540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:11:35.355540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:11:35.355540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:11:35.355540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:11:35.355540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:11:35.355540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 18 02:11:35.355540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 18 02:11:35.355540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 1f219eec-e5e9-4574-899e-d9768e04378f Jul 18 02:11:35.355540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:35.355540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:35.355540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:35.355540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:35.355540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:35.355540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:35.355540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:11:35.355540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:11:35.357022 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 1f219eec-e5e9-4574-899e-d9768e04378f Jul 18 02:11:35.357022 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:35.357022 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d0b4c881-7749-456d-a99f-f2f2c16399d1 tempest-FloatingIPsTestJSON-555414803 tempest-FloatingIPsTestJSON-555414803-project] Returning 404 to user: Floating IP not found for ID 1f219eec-e5e9-4574-899e-d9768e04378f {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:11:35.358105 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d0b4c881-7749-456d-a99f-f2f2c16399d1 tempest-FloatingIPsTestJSON-555414803 tempest-FloatingIPsTestJSON-555414803-project] 10.222.0.57 "DELETE /compute/v2.1/os-floating-ips/1f219eec-e5e9-4574-899e-d9768e04378f" status: 404 len: 111 microversion: 2.1 time: 0.495929 Jul 18 02:11:35.359340 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 541/1034] 10.222.0.57 () {58 vars in 1262 bytes} [Mon Jul 18 02:11:34 2022] DELETE /compute/v2.1/os-floating-ips/1f219eec-e5e9-4574-899e-d9768e04378f => generated 111 bytes in 501 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:11:35.388626 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0be7b0e8-af63-40a2-98ff-5b442e5d1a83 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:35.394146 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0be7b0e8-af63-40a2-98ff-5b442e5d1a83 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: f19cf772-e042-4d44-96ef-6de52397472e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:35.438908 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0be7b0e8-af63-40a2-98ff-5b442e5d1a83 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:35.440530 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0be7b0e8-af63-40a2-98ff-5b442e5d1a83 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:35.441808 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0be7b0e8-af63-40a2-98ff-5b442e5d1a83 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:35.442502 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0be7b0e8-af63-40a2-98ff-5b442e5d1a83 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:36.199965 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0be7b0e8-af63-40a2-98ff-5b442e5d1a83 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6962b97241f4c3a9960bb5fe52f8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8e996befd24b26b0371ad9cdb4a069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:36.242280 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0be7b0e8-af63-40a2-98ff-5b442e5d1a83 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] 10.222.0.57 "GET /compute/v2.1/servers/f19cf772-e042-4d44-96ef-6de52397472e" status: 200 len: 1296 microversion: 2.1 time: 0.869964 Jul 18 02:11:36.242280 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 542/1035] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:35 2022] GET /compute/v2.1/servers/f19cf772-e042-4d44-96ef-6de52397472e => generated 1296 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:36.255220 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-77fdcb91-bcea-4183-8209-619d9e7c569f req-36f788c1-c457-4afd-8654-2245a3ef02d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f19cf772-e042-4d44-96ef-6de52397472e", "name": "network-vif-deleted", "tag": "52630cf0-3815-4f5f-9665-37e9a31ca48b"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:36.286310 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-77fdcb91-bcea-4183-8209-619d9e7c569f req-36f788c1-c457-4afd-8654-2245a3ef02d1 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:36.287476 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-77fdcb91-bcea-4183-8209-619d9e7c569f req-36f788c1-c457-4afd-8654-2245a3ef02d1 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:36.364356 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-77fdcb91-bcea-4183-8209-619d9e7c569f req-36f788c1-c457-4afd-8654-2245a3ef02d1 service nova] Creating event network-vif-deleted:52630cf0-3815-4f5f-9665-37e9a31ca48b for instance f19cf772-e042-4d44-96ef-6de52397472e on n-h1-465891-3 Jul 18 02:11:36.380340 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-77fdcb91-bcea-4183-8209-619d9e7c569f req-36f788c1-c457-4afd-8654-2245a3ef02d1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146812 Jul 18 02:11:36.383373 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 543/1036] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:36.390305 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-53e3f851-5ee1-4cd4-ba8a-b90a951cd572 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:36.391244 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-53e3f851-5ee1-4cd4-ba8a-b90a951cd572 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:36.404027 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-53e3f851-5ee1-4cd4-ba8a-b90a951cd572 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:36.404999 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-53e3f851-5ee1-4cd4-ba8a-b90a951cd572 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:36.406650 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-53e3f851-5ee1-4cd4-ba8a-b90a951cd572 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:36.407307 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-53e3f851-5ee1-4cd4-ba8a-b90a951cd572 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:36.438198 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-445a838a-835f-4c97-952c-03ed96105426 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:36.457436 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-445a838a-835f-4c97-952c-03ed96105426 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded" status: 200 len: 1310 microversion: 2.1 time: 1.367771 Jul 18 02:11:36.459893 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 494/1037] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:35 2022] GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded => generated 1310 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:36.467474 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-33823b51-b1f5-46c9-8859-381208e23500 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a8b31280>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:36.535996 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-33823b51-b1f5-46c9-8859-381208e23500 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/48443bda-c7c8-463b-b521-129df053a409" status: 200 len: 1410 microversion: 2.1 time: 0.073050 Jul 18 02:11:36.537558 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 495/1038] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:11:36 2022] GET /compute/v2.1/images/48443bda-c7c8-463b-b521-129df053a409 => generated 1410 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:37.262166 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-74cb2687-d5c0-4e7f-9bf9-a4b498b2c515 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:37.263360 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-74cb2687-d5c0-4e7f-9bf9-a4b498b2c515 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: f19cf772-e042-4d44-96ef-6de52397472e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:37.287101 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-74cb2687-d5c0-4e7f-9bf9-a4b498b2c515 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:37.293331 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-74cb2687-d5c0-4e7f-9bf9-a4b498b2c515 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:37.295205 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-74cb2687-d5c0-4e7f-9bf9-a4b498b2c515 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:37.296138 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-74cb2687-d5c0-4e7f-9bf9-a4b498b2c515 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:37.331839 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-74cb2687-d5c0-4e7f-9bf9-a4b498b2c515 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] HTTP exception thrown: Instance f19cf772-e042-4d44-96ef-6de52397472e could not be found. Jul 18 02:11:37.338593 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-74cb2687-d5c0-4e7f-9bf9-a4b498b2c515 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Request method failure captured: Jul 18 02:11:37.338593 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/f19cf772-e042-4d44-96ef-6de52397472e HTTP/1.1 Jul 18 02:11:37.338593 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:11:37.338593 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:11:37.338593 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:11:37.338593 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:11:37.338593 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:11:37.338593 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:11:37.338593 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:11:37.338593 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:11:37.338593 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MERUXigAxQ_p6XGmixdg3mE9urlwuvvqGwO-yh-Eo5L9NUCvHK3ZQ8yB_ur4BdUf787Ptbt6WCHkWEpAhaQWeh8_0jH8WhwSTUD3Mn3HoP8OkzqOiA3GVcgZhjsN96MnvvmMiwKaxmsiLK7BC1-veiJzxozomft4nLz5028ymwQgr0 Jul 18 02:11:37.338593 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:11:37.338593 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:11:37.338593 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:11:37.338593 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:11:37.338593 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:11:37.338593 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:11:37.338593 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 3d8e996befd24b26b0371ad9cdb4a069 Jul 18 02:11:37.338593 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1737831982 Jul 18 02:11:37.338593 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:11:37.338593 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:11:37.340181 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3d8e996befd24b26b0371ad9cdb4a069"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3d8e996befd24b26b0371ad9cdb4a069"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3d8e996befd24b26b0371ad9cdb4a069"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3d8e996befd24b26b0371ad9cdb4a069"}]}] Jul 18 02:11:37.340181 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1737831982 Jul 18 02:11:37.340181 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 3d8e996befd24b26b0371ad9cdb4a069 Jul 18 02:11:37.340181 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1737831982 Jul 18 02:11:37.340181 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersAdminNegativeTestJSON-1737831982-project Jul 18 02:11:37.340181 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:11:37.340181 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:11:37.340181 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: b6962b97241f4c3a9960bb5fe52f8697 Jul 18 02:11:37.340181 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1737831982-project Jul 18 02:11:37.340181 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:11:37.340181 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance f19cf772-e042-4d44-96ef-6de52397472e could not be found. Jul 18 02:11:37.340181 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'f19cf772-e042-4d44-96ef-6de52397472e'} Jul 18 02:11:37.340940 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:11:37.340940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:37.340940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:11:37.340940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:11:37.340940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:11:37.340940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:11:37.340940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:11:37.340940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:11:37.340940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:11:37.340940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:11:37.340940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f19cf772-e042-4d44-96ef-6de52397472e could not be found. Jul 18 02:11:37.340940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:37.340940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:37.340940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:37.340940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:37.340940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:37.340940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:37.340940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:11:37.340940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:11:37.340940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:11:37.342260 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:11:37.342260 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:11:37.342260 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:11:37.342260 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:11:37.342260 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:11:37.342260 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:11:37.342260 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:11:37.342260 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f19cf772-e042-4d44-96ef-6de52397472e could not be found. Jul 18 02:11:37.342260 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:37.342260 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:37.342260 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:37.342260 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:37.342260 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:37.342260 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:37.342260 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:11:37.342260 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:11:37.342260 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f19cf772-e042-4d44-96ef-6de52397472e could not be found. Jul 18 02:11:37.342260 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:37.347359 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-74cb2687-d5c0-4e7f-9bf9-a4b498b2c515 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Returning 404 to user: Instance f19cf772-e042-4d44-96ef-6de52397472e could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:11:37.348672 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-74cb2687-d5c0-4e7f-9bf9-a4b498b2c515 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] 10.222.0.57 "GET /compute/v2.1/servers/f19cf772-e042-4d44-96ef-6de52397472e" status: 404 len: 111 microversion: 2.1 time: 0.092460 Jul 18 02:11:37.354185 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 496/1039] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:37 2022] GET /compute/v2.1/servers/f19cf772-e042-4d44-96ef-6de52397472e => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:11:37.360630 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a0dc530c-3146-4d3c-bfe0-a7a25ffb713d tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:37.374527 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a0dc530c-3146-4d3c-bfe0-a7a25ffb713d tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: 8c643d39-a6e1-41ec-a6f9-ffaf41421eb8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:37.383462 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a0dc530c-3146-4d3c-bfe0-a7a25ffb713d tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:37.384330 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a0dc530c-3146-4d3c-bfe0-a7a25ffb713d tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:37.386169 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a0dc530c-3146-4d3c-bfe0-a7a25ffb713d tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:37.386965 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a0dc530c-3146-4d3c-bfe0-a7a25ffb713d tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:37.486949 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a0dc530c-3146-4d3c-bfe0-a7a25ffb713d tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: 8c643d39-a6e1-41ec-a6f9-ffaf41421eb8] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:11:37.499379 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:11:37.760096 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-53e3f851-5ee1-4cd4-ba8a-b90a951cd572 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:37.792241 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a0dc530c-3146-4d3c-bfe0-a7a25ffb713d tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8" status: 204 len: 0 microversion: 2.1 time: 0.435753 Jul 18 02:11:37.797973 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-53e3f851-5ee1-4cd4-ba8a-b90a951cd572 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1479 microversion: 2.1 time: 1.409986 Jul 18 02:11:37.804910 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 497/1040] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:11:37 2022] DELETE /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:11:37.818213 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 544/1041] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:36 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1479 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:37.831195 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-38059c5e-6c44-47f0-9f73-2df1821d58ea tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:37.839178 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8f86d088-e631-4fb3-8e0f-2029debb140e tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a88c8b80>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:37.843772 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-38059c5e-6c44-47f0-9f73-2df1821d58ea tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: ae4f2139-250b-4a65-8436-702487cc1ded] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:37.865168 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-38059c5e-6c44-47f0-9f73-2df1821d58ea tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:37.867666 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-38059c5e-6c44-47f0-9f73-2df1821d58ea tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:37.869644 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-38059c5e-6c44-47f0-9f73-2df1821d58ea tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:37.871643 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-38059c5e-6c44-47f0-9f73-2df1821d58ea tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:37.961738 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8f86d088-e631-4fb3-8e0f-2029debb140e tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/48443bda-c7c8-463b-b521-129df053a409" status: 200 len: 1410 microversion: 2.1 time: 0.137117 Jul 18 02:11:37.963276 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 545/1042] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:11:37 2022] GET /compute/v2.1/images/48443bda-c7c8-463b-b521-129df053a409 => generated 1410 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:37.980853 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3fe778b2-d3ae-4eb9-9a4f-d782ab4ce201 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:37.987666 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3fe778b2-d3ae-4eb9-9a4f-d782ab4ce201 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: 8c643d39-a6e1-41ec-a6f9-ffaf41421eb8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:38.019898 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3fe778b2-d3ae-4eb9-9a4f-d782ab4ce201 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:38.021263 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3fe778b2-d3ae-4eb9-9a4f-d782ab4ce201 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:38.023955 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3fe778b2-d3ae-4eb9-9a4f-d782ab4ce201 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:38.025123 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3fe778b2-d3ae-4eb9-9a4f-d782ab4ce201 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:38.774415 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-38059c5e-6c44-47f0-9f73-2df1821d58ea tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:38.820430 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-38059c5e-6c44-47f0-9f73-2df1821d58ea tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded" status: 200 len: 1493 microversion: 2.1 time: 1.011161 Jul 18 02:11:38.839852 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 498/1043] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:37 2022] GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded => generated 1493 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:38.861276 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e7f87191-3b32-47a8-aba4-3985eebdc8a9 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:38.862804 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e7f87191-3b32-47a8-aba4-3985eebdc8a9 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:38.972699 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e7f87191-3b32-47a8-aba4-3985eebdc8a9 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:38.973893 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e7f87191-3b32-47a8-aba4-3985eebdc8a9 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:38.976116 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e7f87191-3b32-47a8-aba4-3985eebdc8a9 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:38.981966 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e7f87191-3b32-47a8-aba4-3985eebdc8a9 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:39.112390 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3fe778b2-d3ae-4eb9-9a4f-d782ab4ce201 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6962b97241f4c3a9960bb5fe52f8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8e996befd24b26b0371ad9cdb4a069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:39.155650 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3fe778b2-d3ae-4eb9-9a4f-d782ab4ce201 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] 10.222.0.57 "GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8" status: 200 len: 1477 microversion: 2.1 time: 1.186990 Jul 18 02:11:39.162116 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 546/1044] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:37 2022] GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8 => generated 1477 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:39.180545 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7aadd40b-ad17-423a-a94c-7729909b693f tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:39.188895 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7aadd40b-ad17-423a-a94c-7729909b693f tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] [instance: ae4f2139-250b-4a65-8436-702487cc1ded] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:39.215316 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7aadd40b-ad17-423a-a94c-7729909b693f tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:39.217917 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7aadd40b-ad17-423a-a94c-7729909b693f tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:39.219968 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7aadd40b-ad17-423a-a94c-7729909b693f tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:39.221245 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7aadd40b-ad17-423a-a94c-7729909b693f tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:39.716008 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e7f87191-3b32-47a8-aba4-3985eebdc8a9 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:39.736726 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e7f87191-3b32-47a8-aba4-3985eebdc8a9 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1479 microversion: 2.1 time: 0.894843 Jul 18 02:11:39.739367 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 499/1045] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:38 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1479 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:39.767762 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-01f9726f-e0d1-4bf4-9845-06261f8dba72 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a95a2ee0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:39.927414 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-01f9726f-e0d1-4bf4-9845-06261f8dba72 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/48443bda-c7c8-463b-b521-129df053a409" status: 200 len: 1410 microversion: 2.1 time: 0.183532 Jul 18 02:11:39.942090 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 500/1046] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:11:39 2022] GET /compute/v2.1/images/48443bda-c7c8-463b-b521-129df053a409 => generated 1410 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:40.128176 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7aadd40b-ad17-423a-a94c-7729909b693f tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded" status: 200 len: 1644 microversion: 2.1 time: 0.959930 Jul 18 02:11:40.131815 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 547/1047] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:39 2022] GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded => generated 1644 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:40.152343 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e2b8fe71-3eb0-4ad4-aaed-240e87cb156a tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:40.161540 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e2b8fe71-3eb0-4ad4-aaed-240e87cb156a tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] [instance: ae4f2139-250b-4a65-8436-702487cc1ded] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:40.185675 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b00f7dd4-36aa-4aa9-bf05-410bec299776 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:40.189969 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b00f7dd4-36aa-4aa9-bf05-410bec299776 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: 8c643d39-a6e1-41ec-a6f9-ffaf41421eb8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:40.195972 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e2b8fe71-3eb0-4ad4-aaed-240e87cb156a tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:40.197071 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e2b8fe71-3eb0-4ad4-aaed-240e87cb156a tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:40.198616 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e2b8fe71-3eb0-4ad4-aaed-240e87cb156a tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:40.199435 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e2b8fe71-3eb0-4ad4-aaed-240e87cb156a tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:40.210255 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b00f7dd4-36aa-4aa9-bf05-410bec299776 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:40.213015 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b00f7dd4-36aa-4aa9-bf05-410bec299776 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:40.230088 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b00f7dd4-36aa-4aa9-bf05-410bec299776 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:40.234618 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b00f7dd4-36aa-4aa9-bf05-410bec299776 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:41.319185 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b00f7dd4-36aa-4aa9-bf05-410bec299776 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6962b97241f4c3a9960bb5fe52f8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8e996befd24b26b0371ad9cdb4a069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:41.342058 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b00f7dd4-36aa-4aa9-bf05-410bec299776 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] 10.222.0.57 "GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8" status: 200 len: 1477 microversion: 2.1 time: 1.153143 Jul 18 02:11:41.343016 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e2b8fe71-3eb0-4ad4-aaed-240e87cb156a tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded" status: 200 len: 1644 microversion: 2.1 time: 1.198259 Jul 18 02:11:41.343978 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 548/1048] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:40 2022] GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8 => generated 1477 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:41.348129 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 501/1049] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:40 2022] GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded => generated 1644 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:41.378498 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-bb18fd05-1c85-4cb1-87b8-acefb7b4446b req-609dde4e-e43d-413c-a5ff-576272bb9f82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "092e9dd7-8734-42ae-9ad7-626438550736", "name": "network-vif-unplugged", "status": "completed", "tag": "5653c487-e512-475c-8f13-aa4ee05e2542"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:41.385396 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-43fcff5c-2edc-485d-b08c-16499b7590f8 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:41.386892 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-43fcff5c-2edc-485d-b08c-16499b7590f8 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:41.406333 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-bb18fd05-1c85-4cb1-87b8-acefb7b4446b req-609dde4e-e43d-413c-a5ff-576272bb9f82 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:41.408298 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-bb18fd05-1c85-4cb1-87b8-acefb7b4446b req-609dde4e-e43d-413c-a5ff-576272bb9f82 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:41.424819 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-43fcff5c-2edc-485d-b08c-16499b7590f8 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:41.432946 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-43fcff5c-2edc-485d-b08c-16499b7590f8 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:41.435276 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-43fcff5c-2edc-485d-b08c-16499b7590f8 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:41.438766 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-43fcff5c-2edc-485d-b08c-16499b7590f8 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:41.479057 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-bb18fd05-1c85-4cb1-87b8-acefb7b4446b req-609dde4e-e43d-413c-a5ff-576272bb9f82 service nova] Creating event network-vif-unplugged:5653c487-e512-475c-8f13-aa4ee05e2542 for instance 092e9dd7-8734-42ae-9ad7-626438550736 on n-h2-465891-3 Jul 18 02:11:41.500477 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-bb18fd05-1c85-4cb1-87b8-acefb7b4446b req-609dde4e-e43d-413c-a5ff-576272bb9f82 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.151739 Jul 18 02:11:41.505763 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 549/1050] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:41.527288 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7a0dd6e0-16c1-4da6-b395-04ebceeaf999 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a88c64c0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:41.643761 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7a0dd6e0-16c1-4da6-b395-04ebceeaf999 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/48443bda-c7c8-463b-b521-129df053a409" status: 200 len: 1419 microversion: 2.1 time: 0.130675 Jul 18 02:11:41.652554 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 550/1051] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:11:41 2022] GET /compute/v2.1/images/48443bda-c7c8-463b-b521-129df053a409 => generated 1419 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:41.667730 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-33558385-2d4b-4992-a8e1-6b3a30b3a667 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:41.671908 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:41.671908 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:11:41.678659 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-33558385-2d4b-4992-a8e1-6b3a30b3a667 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:41.680075 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-33558385-2d4b-4992-a8e1-6b3a30b3a667 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:41.681365 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-33558385-2d4b-4992-a8e1-6b3a30b3a667 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:41.682095 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-33558385-2d4b-4992-a8e1-6b3a30b3a667 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:41.774995 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-33558385-2d4b-4992-a8e1-6b3a30b3a667 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.115596 Jul 18 02:11:41.779030 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 551/1052] 10.222.0.57 () {58 vars in 1175 bytes} [Mon Jul 18 02:11:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:41.793588 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0c10a4dd-8c77-4bb9-bc53-9609c94b13f0 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a88c6550>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:41.928058 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0c10a4dd-8c77-4bb9-bc53-9609c94b13f0 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/48443bda-c7c8-463b-b521-129df053a409" status: 200 len: 1419 microversion: 2.1 time: 0.147093 Jul 18 02:11:41.930007 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 552/1053] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:11:41 2022] GET /compute/v2.1/images/48443bda-c7c8-463b-b521-129df053a409 => generated 1419 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:41.943865 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ae8a27e4-632b-4622-9303-63df21c2038e tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:41.947477 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ae8a27e4-632b-4622-9303-63df21c2038e tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] [instance: ae4f2139-250b-4a65-8436-702487cc1ded] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:41.970775 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ae8a27e4-632b-4622-9303-63df21c2038e tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:41.971398 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ae8a27e4-632b-4622-9303-63df21c2038e tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:41.972300 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ae8a27e4-632b-4622-9303-63df21c2038e tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:41.974493 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ae8a27e4-632b-4622-9303-63df21c2038e tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:42.150878 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:11:42.206509 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-43fcff5c-2edc-485d-b08c-16499b7590f8 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:42.252014 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-43fcff5c-2edc-485d-b08c-16499b7590f8 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1464 microversion: 2.1 time: 0.892561 Jul 18 02:11:42.273340 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 502/1054] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:41 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1464 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:42.281540 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-785fda82-31b8-422d-a837-2880f6c10242 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a8b311f0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:42.287421 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ae8a27e4-632b-4622-9303-63df21c2038e tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded/action" status: 202 len: 0 microversion: 2.1 time: 0.356089 Jul 18 02:11:42.289133 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 553/1055] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:11:41 2022] POST /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:11:42.329878 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ecfbecc2-fe8f-43b0-b1ed-c5d30ce029f5 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:42.341748 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ecfbecc2-fe8f-43b0-b1ed-c5d30ce029f5 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:42.380355 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ecfbecc2-fe8f-43b0-b1ed-c5d30ce029f5 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:42.380821 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ecfbecc2-fe8f-43b0-b1ed-c5d30ce029f5 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:42.382429 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ecfbecc2-fe8f-43b0-b1ed-c5d30ce029f5 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:42.383247 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ecfbecc2-fe8f-43b0-b1ed-c5d30ce029f5 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:42.710877 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ecfbecc2-fe8f-43b0-b1ed-c5d30ce029f5 tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736/action" status: 202 len: 0 microversion: 2.1 time: 0.419919 Jul 18 02:11:42.711640 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 554/1056] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:11:42 2022] POST /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736/action => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:11:42.717977 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-8dbdceca-99a1-4850-b62e-32464bd8beed req-f7d0ba38-0c43-46ce-b781-9b627c795af4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c643d39-a6e1-41ec-a6f9-ffaf41421eb8", "name": "network-vif-deleted", "tag": "8715c030-4b8f-4b95-919f-e51fec1c48ce"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:42.735215 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-8dbdceca-99a1-4850-b62e-32464bd8beed req-f7d0ba38-0c43-46ce-b781-9b627c795af4 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:42.737938 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-8dbdceca-99a1-4850-b62e-32464bd8beed req-f7d0ba38-0c43-46ce-b781-9b627c795af4 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:42.752569 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-8dbdceca-99a1-4850-b62e-32464bd8beed req-f7d0ba38-0c43-46ce-b781-9b627c795af4 service nova] Creating event network-vif-deleted:8715c030-4b8f-4b95-919f-e51fec1c48ce for instance 8c643d39-a6e1-41ec-a6f9-ffaf41421eb8 on n-h1-465891-3 Jul 18 02:11:42.760354 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-8dbdceca-99a1-4850-b62e-32464bd8beed req-f7d0ba38-0c43-46ce-b781-9b627c795af4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047173 Jul 18 02:11:42.761802 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 555/1057] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:42.769893 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5ec10842-0f06-42d9-b53b-0235959db6dd tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:42.771880 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5ec10842-0f06-42d9-b53b-0235959db6dd tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] [instance: ae4f2139-250b-4a65-8436-702487cc1ded] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:42.783074 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ec10842-0f06-42d9-b53b-0235959db6dd tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:42.783843 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ec10842-0f06-42d9-b53b-0235959db6dd tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:42.788402 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ec10842-0f06-42d9-b53b-0235959db6dd tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:42.789485 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ec10842-0f06-42d9-b53b-0235959db6dd tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:44.052453 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-785fda82-31b8-422d-a837-2880f6c10242 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "DELETE /compute/v2.1/images/48443bda-c7c8-463b-b521-129df053a409" status: 204 len: 0 microversion: 2.1 time: 1.786146 Jul 18 02:11:44.065977 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5ec10842-0f06-42d9-b53b-0235959db6dd tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded" status: 200 len: 1649 microversion: 2.1 time: 1.302591 Jul 18 02:11:44.066561 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 503/1058] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:42 2022] DELETE /compute/v2.1/images/48443bda-c7c8-463b-b521-129df053a409 => generated 0 bytes in 1796 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:11:44.073341 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 556/1059] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:42 2022] GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded => generated 1649 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:44.078797 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a0fbfa0a-b0e1-48d3-b397-1dc1dec244de tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:44.078797 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a0fbfa0a-b0e1-48d3-b397-1dc1dec244de tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:44.093553 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a0fbfa0a-b0e1-48d3-b397-1dc1dec244de tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:44.098749 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-be45b294-b31a-4f9d-b25e-4a7a953f8949 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:44.101892 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-be45b294-b31a-4f9d-b25e-4a7a953f8949 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] [instance: 8c643d39-a6e1-41ec-a6f9-ffaf41421eb8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:44.104109 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a0fbfa0a-b0e1-48d3-b397-1dc1dec244de tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:44.105080 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a0fbfa0a-b0e1-48d3-b397-1dc1dec244de tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:44.105549 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a0fbfa0a-b0e1-48d3-b397-1dc1dec244de tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:44.140336 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-be45b294-b31a-4f9d-b25e-4a7a953f8949 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:44.141258 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-be45b294-b31a-4f9d-b25e-4a7a953f8949 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:44.143130 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-be45b294-b31a-4f9d-b25e-4a7a953f8949 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:44.143929 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-be45b294-b31a-4f9d-b25e-4a7a953f8949 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:44.206226 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-be45b294-b31a-4f9d-b25e-4a7a953f8949 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] HTTP exception thrown: Instance 8c643d39-a6e1-41ec-a6f9-ffaf41421eb8 could not be found. Jul 18 02:11:44.213933 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-be45b294-b31a-4f9d-b25e-4a7a953f8949 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Request method failure captured: Jul 18 02:11:44.213933 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8 HTTP/1.1 Jul 18 02:11:44.213933 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:11:44.213933 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:11:44.213933 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:11:44.213933 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:11:44.213933 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:11:44.213933 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:11:44.213933 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:11:44.213933 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:11:44.213933 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MERUXigAxQ_p6XGmixdg3mE9urlwuvvqGwO-yh-Eo5L9NUCvHK3ZQ8yB_ur4BdUf787Ptbt6WCHkWEpAhaQWeh8_0jH8WhwSTUD3Mn3HoP8OkzqOiA3GVcgZhjsN96MnvvmMiwKaxmsiLK7BC1-veiJzxozomft4nLz5028ymwQgr0 Jul 18 02:11:44.213933 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:11:44.213933 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:11:44.213933 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:11:44.213933 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:11:44.213933 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:11:44.213933 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:11:44.213933 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 3d8e996befd24b26b0371ad9cdb4a069 Jul 18 02:11:44.213933 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1737831982 Jul 18 02:11:44.213933 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:11:44.213933 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:11:44.217010 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3d8e996befd24b26b0371ad9cdb4a069"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3d8e996befd24b26b0371ad9cdb4a069"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3d8e996befd24b26b0371ad9cdb4a069"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3d8e996befd24b26b0371ad9cdb4a069"}]}] Jul 18 02:11:44.217010 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1737831982 Jul 18 02:11:44.217010 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 3d8e996befd24b26b0371ad9cdb4a069 Jul 18 02:11:44.217010 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1737831982 Jul 18 02:11:44.217010 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersAdminNegativeTestJSON-1737831982-project Jul 18 02:11:44.217010 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:11:44.217010 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:11:44.217010 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: b6962b97241f4c3a9960bb5fe52f8697 Jul 18 02:11:44.217010 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1737831982-project Jul 18 02:11:44.217010 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:11:44.217010 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 8c643d39-a6e1-41ec-a6f9-ffaf41421eb8 could not be found. Jul 18 02:11:44.217010 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '8c643d39-a6e1-41ec-a6f9-ffaf41421eb8'} Jul 18 02:11:44.221620 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:11:44.221620 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:44.221620 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:11:44.221620 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:11:44.221620 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:11:44.221620 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:11:44.221620 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:11:44.221620 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:11:44.221620 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:11:44.221620 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:11:44.221620 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c643d39-a6e1-41ec-a6f9-ffaf41421eb8 could not be found. Jul 18 02:11:44.221620 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:44.221620 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:44.221620 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:44.221620 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:44.221620 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:44.221620 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:44.221620 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:11:44.221620 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:11:44.221620 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:11:44.224538 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:11:44.224538 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:11:44.224538 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:11:44.224538 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:11:44.224538 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:11:44.224538 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:11:44.224538 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:11:44.224538 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c643d39-a6e1-41ec-a6f9-ffaf41421eb8 could not be found. Jul 18 02:11:44.224538 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:44.224538 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:44.224538 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:44.224538 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:44.224538 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:44.224538 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:44.224538 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:11:44.224538 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:11:44.224538 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c643d39-a6e1-41ec-a6f9-ffaf41421eb8 could not be found. Jul 18 02:11:44.224538 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:11:44.229308 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a0fbfa0a-b0e1-48d3-b397-1dc1dec244de tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:44.229308 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a0fbfa0a-b0e1-48d3-b397-1dc1dec244de tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:44.229308 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-a0fbfa0a-b0e1-48d3-b397-1dc1dec244de tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lazy-loading 'fault' on Instance uuid 092e9dd7-8734-42ae-9ad7-626438550736 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:11:44.231591 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-be45b294-b31a-4f9d-b25e-4a7a953f8949 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] Returning 404 to user: Instance 8c643d39-a6e1-41ec-a6f9-ffaf41421eb8 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:11:44.234762 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-be45b294-b31a-4f9d-b25e-4a7a953f8949 tempest-ServersAdminNegativeTestJSON-1737831982 tempest-ServersAdminNegativeTestJSON-1737831982-project] 10.222.0.57 "GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8" status: 404 len: 111 microversion: 2.1 time: 0.150961 Jul 18 02:11:44.237238 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 504/1060] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:44 2022] GET /compute/v2.1/servers/8c643d39-a6e1-41ec-a6f9-ffaf41421eb8 => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:11:44.252750 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8c7ca27a-5070-4de5-b0b5-1bf6972eee4f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:44.254125 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8c7ca27a-5070-4de5-b0b5-1bf6972eee4f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 25dfb6dd-6d5a-4399-a348-0a162ca907ef] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:44.272984 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8c7ca27a-5070-4de5-b0b5-1bf6972eee4f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:44.274315 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8c7ca27a-5070-4de5-b0b5-1bf6972eee4f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:44.277517 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8c7ca27a-5070-4de5-b0b5-1bf6972eee4f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:44.279642 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8c7ca27a-5070-4de5-b0b5-1bf6972eee4f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:44.406061 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8c7ca27a-5070-4de5-b0b5-1bf6972eee4f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 25dfb6dd-6d5a-4399-a348-0a162ca907ef] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:11:44.598435 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:11:44.629299 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8c7ca27a-5070-4de5-b0b5-1bf6972eee4f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "DELETE /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef" status: 204 len: 0 microversion: 2.1 time: 0.389579 Jul 18 02:11:44.630459 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 505/1061] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:11:44 2022] DELETE /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:11:44.674580 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a0fbfa0a-b0e1-48d3-b397-1dc1dec244de tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1598 microversion: 2.1 time: 0.599969 Jul 18 02:11:44.679110 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 557/1062] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:44 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1598 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:44.700751 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-78a77307-2ae6-4df3-a6ad-96d6df8ce9dd tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:44.703746 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-78a77307-2ae6-4df3-a6ad-96d6df8ce9dd tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:44.721438 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-78a77307-2ae6-4df3-a6ad-96d6df8ce9dd tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:44.732996 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-78a77307-2ae6-4df3-a6ad-96d6df8ce9dd tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:44.738254 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-78a77307-2ae6-4df3-a6ad-96d6df8ce9dd tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:44.738634 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-78a77307-2ae6-4df3-a6ad-96d6df8ce9dd tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:44.943216 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-78a77307-2ae6-4df3-a6ad-96d6df8ce9dd tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736/action" status: 202 len: 0 microversion: 2.1 time: 0.247813 Jul 18 02:11:44.945600 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 558/1063] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:11:44 2022] POST /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:11:44.961391 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b631d966-0964-43b0-b282-42b724819c6f tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:44.962330 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b631d966-0964-43b0-b282-42b724819c6f tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:44.983030 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b631d966-0964-43b0-b282-42b724819c6f tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:44.983490 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b631d966-0964-43b0-b282-42b724819c6f tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:44.984444 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b631d966-0964-43b0-b282-42b724819c6f tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:44.984904 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b631d966-0964-43b0-b282-42b724819c6f tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:45.116602 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a3024683-7353-46b5-a21f-ee80d0f4ec3e tempest-QuotasAdminTestV236-1674484132 tempest-QuotasAdminTestV236-1674484132-project-admin] Action: 'update', calling method: .version_select at 0x7ff4a8b1dee0>, body: {"quota_set": {"ram": "5120"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:45.213191 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a3024683-7353-46b5-a21f-ee80d0f4ec3e tempest-QuotasAdminTestV236-1674484132 tempest-QuotasAdminTestV236-1674484132-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:45.214060 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a3024683-7353-46b5-a21f-ee80d0f4ec3e tempest-QuotasAdminTestV236-1674484132 tempest-QuotasAdminTestV236-1674484132-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:45.215521 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a3024683-7353-46b5-a21f-ee80d0f4ec3e tempest-QuotasAdminTestV236-1674484132 tempest-QuotasAdminTestV236-1674484132-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:45.216222 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a3024683-7353-46b5-a21f-ee80d0f4ec3e tempest-QuotasAdminTestV236-1674484132 tempest-QuotasAdminTestV236-1674484132-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:45.291290 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a3024683-7353-46b5-a21f-ee80d0f4ec3e tempest-QuotasAdminTestV236-1674484132 tempest-QuotasAdminTestV236-1674484132-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-quota-sets/917cc34520d74f7e86b543a47fa3f656" status: 200 len: 240 microversion: 2.36 time: 0.659491 Jul 18 02:11:45.300482 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 506/1064] 10.222.0.57 () {62 vars in 1302 bytes} [Mon Jul 18 02:11:44 2022] PUT /compute/v2.1/os-quota-sets/917cc34520d74f7e86b543a47fa3f656 => generated 240 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:11:45.300482 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-45ad67bc-2722-4107-b474-a29905af25d2 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1741353793", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "9b9ef786-bd16-4bad-95f6-48c8b48d49f7"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:45.374876 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-45ad67bc-2722-4107-b474-a29905af25d2 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] validate_networks() for [('9b9ef786-bd16-4bad-95f6-48c8b48d49f7', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:11:46.002442 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b631d966-0964-43b0-b282-42b724819c6f tempest-ServersAdminTestJSON-1095082398 tempest-ServersAdminTestJSON-1095082398-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1615 microversion: 2.1 time: 1.051945 Jul 18 02:11:46.007853 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 559/1065] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:44 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1615 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:11:46.013415 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bd0d31d7-5931-4d21-b0c1-aaf9c17e1ade tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:46.019168 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bd0d31d7-5931-4d21-b0c1-aaf9c17e1ade tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] [instance: ae4f2139-250b-4a65-8436-702487cc1ded] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:46.039213 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bd0d31d7-5931-4d21-b0c1-aaf9c17e1ade tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:46.049573 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bd0d31d7-5931-4d21-b0c1-aaf9c17e1ade tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:46.055095 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bd0d31d7-5931-4d21-b0c1-aaf9c17e1ade tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:46.056258 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bd0d31d7-5931-4d21-b0c1-aaf9c17e1ade tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:47.274004 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bd0d31d7-5931-4d21-b0c1-aaf9c17e1ade tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded" status: 200 len: 1629 microversion: 2.1 time: 1.263661 Jul 18 02:11:47.286730 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 560/1066] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:46 2022] GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded => generated 1629 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:47.301298 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a0371516-e291-474f-9128-6214b58f2d92 tempest-QuotasAdminTestV236-1674484132 tempest-QuotasAdminTestV236-1674484132-project-admin] Calling method '.version_select at 0x7ff4a88c81f0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:47.760205 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a0371516-e291-474f-9128-6214b58f2d92 tempest-QuotasAdminTestV236-1674484132 tempest-QuotasAdminTestV236-1674484132-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:47.762242 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a0371516-e291-474f-9128-6214b58f2d92 tempest-QuotasAdminTestV236-1674484132 tempest-QuotasAdminTestV236-1674484132-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:47.764682 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a0371516-e291-474f-9128-6214b58f2d92 tempest-QuotasAdminTestV236-1674484132 tempest-QuotasAdminTestV236-1674484132-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:47.765401 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a0371516-e291-474f-9128-6214b58f2d92 tempest-QuotasAdminTestV236-1674484132 tempest-QuotasAdminTestV236-1674484132-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:47.831065 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a0371516-e291-474f-9128-6214b58f2d92 tempest-QuotasAdminTestV236-1674484132 tempest-QuotasAdminTestV236-1674484132-project-admin] 10.222.0.57 "GET /compute/v2.1/os-quota-sets/917cc34520d74f7e86b543a47fa3f656/detail" status: 200 len: 672 microversion: 2.36 time: 0.542487 Jul 18 02:11:47.839306 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 561/1067] 10.222.0.57 () {60 vars in 1303 bytes} [Mon Jul 18 02:11:47 2022] GET /compute/v2.1/os-quota-sets/917cc34520d74f7e86b543a47fa3f656/detail => generated 672 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:11:47.859449 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-45ad67bc-2722-4107-b474-a29905af25d2 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:11:47.861153 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-45ad67bc-2722-4107-b474-a29905af25d2 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:11:47.861848 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-45ad67bc-2722-4107-b474-a29905af25d2 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:11:47.862438 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-45ad67bc-2722-4107-b474-a29905af25d2 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:11:47.863033 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-45ad67bc-2722-4107-b474-a29905af25d2 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:11:47.874702 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f69b8506-f218-44d8-a074-30737b0c35bb tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:47.876565 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f69b8506-f218-44d8-a074-30737b0c35bb tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 7f16fcdb-c2da-4a62-8393-e4977d34bd63] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:47.891008 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-45ad67bc-2722-4107-b474-a29905af25d2 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:47.892885 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-45ad67bc-2722-4107-b474-a29905af25d2 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:47.895866 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-45ad67bc-2722-4107-b474-a29905af25d2 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:47.899192 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-45ad67bc-2722-4107-b474-a29905af25d2 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:47.935046 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f69b8506-f218-44d8-a074-30737b0c35bb tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:47.935609 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f69b8506-f218-44d8-a074-30737b0c35bb tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:47.936667 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f69b8506-f218-44d8-a074-30737b0c35bb tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:47.951359 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f69b8506-f218-44d8-a074-30737b0c35bb tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:48.029270 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-45ad67bc-2722-4107-b474-a29905af25d2 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Getting quotas for project 10c5b35052cd4a71a8254d01112f0496. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:11:48.052375 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f69b8506-f218-44d8-a074-30737b0c35bb tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 7f16fcdb-c2da-4a62-8393-e4977d34bd63] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:11:48.058063 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-45ad67bc-2722-4107-b474-a29905af25d2 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Getting quotas for user a686fc833d964d88a022fae2932b5727 and project 10c5b35052cd4a71a8254d01112f0496. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:11:48.151372 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-45ad67bc-2722-4107-b474-a29905af25d2 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:11:48.161085 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-45ad67bc-2722-4107-b474-a29905af25d2 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 1df099cb-c253-4dd4-96a0-0652047390d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:11:48.213080 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:11:48.247610 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f69b8506-f218-44d8-a074-30737b0c35bb tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7f16fcdb-c2da-4a62-8393-e4977d34bd63" status: 204 len: 0 microversion: 2.1 time: 0.404283 Jul 18 02:11:48.254251 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 562/1068] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:11:47 2022] DELETE /compute/v2.1/servers/7f16fcdb-c2da-4a62-8393-e4977d34bd63 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:11:48.286639 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-90f4ea44-ec09-47a8-9b80-ed86d11a20b8 req-5ab03aca-f3ff-456b-876e-370cf7ca74fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "092e9dd7-8734-42ae-9ad7-626438550736", "name": "network-vif-plugged", "status": "completed", "tag": "5653c487-e512-475c-8f13-aa4ee05e2542"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:48.318872 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-90f4ea44-ec09-47a8-9b80-ed86d11a20b8 req-5ab03aca-f3ff-456b-876e-370cf7ca74fe service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:48.320440 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-90f4ea44-ec09-47a8-9b80-ed86d11a20b8 req-5ab03aca-f3ff-456b-876e-370cf7ca74fe service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:48.360296 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-90f4ea44-ec09-47a8-9b80-ed86d11a20b8 req-5ab03aca-f3ff-456b-876e-370cf7ca74fe service nova] Creating event network-vif-plugged:5653c487-e512-475c-8f13-aa4ee05e2542 for instance 092e9dd7-8734-42ae-9ad7-626438550736 on n-h2-465891-3 Jul 18 02:11:48.388151 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-45ad67bc-2722-4107-b474-a29905af25d2 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.094553 Jul 18 02:11:48.391403 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 507/1069] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:11:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 3098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:11:48.395479 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-90f4ea44-ec09-47a8-9b80-ed86d11a20b8 req-5ab03aca-f3ff-456b-876e-370cf7ca74fe service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136457 Jul 18 02:11:48.401380 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 563/1070] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:48.404318 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-41e010de-8c29-480f-a64f-7e0e7d382a65 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-465891-3", "block_migration": true, "disk_over_commit": false}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:48.415577 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-41e010de-8c29-480f-a64f-7e0e7d382a65 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] [instance: ae4f2139-250b-4a65-8436-702487cc1ded] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:48.419062 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-73fcbb1c-6cef-4e37-af89-5eaf927dc898 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:48.430943 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-73fcbb1c-6cef-4e37-af89-5eaf927dc898 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 7f16fcdb-c2da-4a62-8393-e4977d34bd63] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:48.448187 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41e010de-8c29-480f-a64f-7e0e7d382a65 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:48.449409 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41e010de-8c29-480f-a64f-7e0e7d382a65 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:48.452692 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-73fcbb1c-6cef-4e37-af89-5eaf927dc898 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:48.454388 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41e010de-8c29-480f-a64f-7e0e7d382a65 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:48.455465 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41e010de-8c29-480f-a64f-7e0e7d382a65 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:48.458607 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-73fcbb1c-6cef-4e37-af89-5eaf927dc898 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:48.461464 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-73fcbb1c-6cef-4e37-af89-5eaf927dc898 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:48.465890 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-73fcbb1c-6cef-4e37-af89-5eaf927dc898 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:48.533970 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-41e010de-8c29-480f-a64f-7e0e7d382a65 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lazy-loading 'flavor' on Instance uuid ae4f2139-250b-4a65-8436-702487cc1ded {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:11:48.584664 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-41e010de-8c29-480f-a64f-7e0e7d382a65 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] [instance: ae4f2139-250b-4a65-8436-702487cc1ded] Going to try to live migrate instance to n-h2-465891-3 {{(pid=119543) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 18 02:11:49.747375 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-73fcbb1c-6cef-4e37-af89-5eaf927dc898 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:49.757015 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-73fcbb1c-6cef-4e37-af89-5eaf927dc898 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/7f16fcdb-c2da-4a62-8393-e4977d34bd63" status: 200 len: 1469 microversion: 2.1 time: 1.347463 Jul 18 02:11:49.763409 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 564/1071] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:48 2022] GET /compute/v2.1/servers/7f16fcdb-c2da-4a62-8393-e4977d34bd63 => generated 1469 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:49.790260 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f8a72102-87f2-459c-9057-45f8ac4da689 tempest-QuotasAdminTestV236-1674484132 tempest-QuotasAdminTestV236-1674484132-project-admin] Action: 'update', calling method: .version_select at 0x7ff4a88c6430>, body: {"quota_set": {"ram": "2048"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:50.718318 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f8a72102-87f2-459c-9057-45f8ac4da689 tempest-QuotasAdminTestV236-1674484132 tempest-QuotasAdminTestV236-1674484132-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:50.720375 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f8a72102-87f2-459c-9057-45f8ac4da689 tempest-QuotasAdminTestV236-1674484132 tempest-QuotasAdminTestV236-1674484132-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:50.726179 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f8a72102-87f2-459c-9057-45f8ac4da689 tempest-QuotasAdminTestV236-1674484132 tempest-QuotasAdminTestV236-1674484132-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:50.728845 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f8a72102-87f2-459c-9057-45f8ac4da689 tempest-QuotasAdminTestV236-1674484132 tempest-QuotasAdminTestV236-1674484132-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:50.849081 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f8a72102-87f2-459c-9057-45f8ac4da689 tempest-QuotasAdminTestV236-1674484132 tempest-QuotasAdminTestV236-1674484132-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:50.852345 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f8a72102-87f2-459c-9057-45f8ac4da689 tempest-QuotasAdminTestV236-1674484132 tempest-QuotasAdminTestV236-1674484132-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:50.854603 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f8a72102-87f2-459c-9057-45f8ac4da689 tempest-QuotasAdminTestV236-1674484132 tempest-QuotasAdminTestV236-1674484132-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:50.856069 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f8a72102-87f2-459c-9057-45f8ac4da689 tempest-QuotasAdminTestV236-1674484132 tempest-QuotasAdminTestV236-1674484132-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:51.109073 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f8a72102-87f2-459c-9057-45f8ac4da689 tempest-QuotasAdminTestV236-1674484132 tempest-QuotasAdminTestV236-1674484132-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-quota-sets/917cc34520d74f7e86b543a47fa3f656?user_id=f485701f600a47e5872561b2f3ad836c" status: 200 len: 240 microversion: 2.36 time: 1.341125 Jul 18 02:11:51.119521 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 565/1072] 10.222.0.57 () {62 vars in 1383 bytes} [Mon Jul 18 02:11:49 2022] PUT /compute/v2.1/os-quota-sets/917cc34520d74f7e86b543a47fa3f656?user_id=f485701f600a47e5872561b2f3ad836c => generated 240 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:11:51.126348 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a495b560-1633-4a28-84bb-cf71fd2baf7a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:51.127830 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a495b560-1633-4a28-84bb-cf71fd2baf7a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 1df099cb-c253-4dd4-96a0-0652047390d8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:51.140132 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a495b560-1633-4a28-84bb-cf71fd2baf7a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:51.141919 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a495b560-1633-4a28-84bb-cf71fd2baf7a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:51.143845 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a495b560-1633-4a28-84bb-cf71fd2baf7a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:51.147440 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a495b560-1633-4a28-84bb-cf71fd2baf7a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:51.490013 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a495b560-1633-4a28-84bb-cf71fd2baf7a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:51.518323 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a495b560-1633-4a28-84bb-cf71fd2baf7a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/1df099cb-c253-4dd4-96a0-0652047390d8" status: 200 len: 1278 microversion: 2.1 time: 0.396841 Jul 18 02:11:51.520450 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 566/1073] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:51 2022] GET /compute/v2.1/servers/1df099cb-c253-4dd4-96a0-0652047390d8 => generated 1278 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:51.557361 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-34783ee3-806c-43ca-bd3c-3ed3e03b96c0 req-280493ca-21f6-4b87-9923-d265be185602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25dfb6dd-6d5a-4399-a348-0a162ca907ef", "name": "network-vif-deleted", "tag": "c841be8a-afd4-4301-bb2a-8f0504345c0f"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:51.597821 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-34783ee3-806c-43ca-bd3c-3ed3e03b96c0 req-280493ca-21f6-4b87-9923-d265be185602 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:51.602845 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-34783ee3-806c-43ca-bd3c-3ed3e03b96c0 req-280493ca-21f6-4b87-9923-d265be185602 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:51.657875 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-34783ee3-806c-43ca-bd3c-3ed3e03b96c0 req-280493ca-21f6-4b87-9923-d265be185602 service nova] Creating event network-vif-deleted:c841be8a-afd4-4301-bb2a-8f0504345c0f for instance 25dfb6dd-6d5a-4399-a348-0a162ca907ef on n-h1-465891-3 Jul 18 02:11:51.681158 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-34783ee3-806c-43ca-bd3c-3ed3e03b96c0 req-280493ca-21f6-4b87-9923-d265be185602 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154182 Jul 18 02:11:51.684609 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 567/1074] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:51.698906 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-b156d903-145a-4828-b780-46ba05573403 req-dbd30898-0f5c-4f02-952c-5a14dd117108 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25dfb6dd-6d5a-4399-a348-0a162ca907ef", "name": "network-vif-unplugged", "status": "completed", "tag": "c841be8a-afd4-4301-bb2a-8f0504345c0f"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:51.744795 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-b156d903-145a-4828-b780-46ba05573403 req-dbd30898-0f5c-4f02-952c-5a14dd117108 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:51.746006 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-b156d903-145a-4828-b780-46ba05573403 req-dbd30898-0f5c-4f02-952c-5a14dd117108 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:51.761340 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:11:51.841897 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-b156d903-145a-4828-b780-46ba05573403 req-dbd30898-0f5c-4f02-952c-5a14dd117108 service nova] Creating event network-vif-unplugged:c841be8a-afd4-4301-bb2a-8f0504345c0f for instance 25dfb6dd-6d5a-4399-a348-0a162ca907ef on n-h1-465891-3 Jul 18 02:11:51.884329 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-b156d903-145a-4828-b780-46ba05573403 req-dbd30898-0f5c-4f02-952c-5a14dd117108 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.194116 Jul 18 02:11:51.888969 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 568/1075] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:51.906395 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cb000e38-5d0b-45c6-bf86-0f927c7fffdd tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:51.908381 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cb000e38-5d0b-45c6-bf86-0f927c7fffdd tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 7f16fcdb-c2da-4a62-8393-e4977d34bd63] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:51.952406 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cb000e38-5d0b-45c6-bf86-0f927c7fffdd tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:51.960752 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cb000e38-5d0b-45c6-bf86-0f927c7fffdd tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:51.962603 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cb000e38-5d0b-45c6-bf86-0f927c7fffdd tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:51.963645 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cb000e38-5d0b-45c6-bf86-0f927c7fffdd tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:53.023282 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-cb000e38-5d0b-45c6-bf86-0f927c7fffdd tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:53.038395 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cb000e38-5d0b-45c6-bf86-0f927c7fffdd tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/7f16fcdb-c2da-4a62-8393-e4977d34bd63" status: 200 len: 1469 microversion: 2.1 time: 1.146068 Jul 18 02:11:53.057574 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 569/1076] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:51 2022] GET /compute/v2.1/servers/7f16fcdb-c2da-4a62-8393-e4977d34bd63 => generated 1469 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:53.067099 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-088c67c8-f260-4aef-94e7-26e2b5362e47 tempest-QuotasAdminTestV236-1674484132 tempest-QuotasAdminTestV236-1674484132-project-admin] Calling method '.version_select at 0x7ff4a88c8430>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:53.382366 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-088c67c8-f260-4aef-94e7-26e2b5362e47 tempest-QuotasAdminTestV236-1674484132 tempest-QuotasAdminTestV236-1674484132-project-admin] 10.222.0.57 "GET /compute/v2.1/os-quota-sets/917cc34520d74f7e86b543a47fa3f656?user_id=f485701f600a47e5872561b2f3ad836c" status: 200 len: 282 microversion: 2.36 time: 0.320359 Jul 18 02:11:53.392752 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 570/1077] 10.222.0.57 () {60 vars in 1363 bytes} [Mon Jul 18 02:11:53 2022] GET /compute/v2.1/os-quota-sets/917cc34520d74f7e86b543a47fa3f656?user_id=f485701f600a47e5872561b2f3ad836c => generated 282 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:11:53.524437 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b8e83221-b0c0-4ef1-9db8-cb1f300279c8 tempest-ServicesAdminTestJSON-887753969 tempest-ServicesAdminTestJSON-887753969-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:53.527924 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:53.527924 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:11:53.530677 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b8e83221-b0c0-4ef1-9db8-cb1f300279c8 tempest-ServicesAdminTestJSON-887753969 tempest-ServicesAdminTestJSON-887753969-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:53.531937 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b8e83221-b0c0-4ef1-9db8-cb1f300279c8 tempest-ServicesAdminTestJSON-887753969 tempest-ServicesAdminTestJSON-887753969-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:53.535213 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b8e83221-b0c0-4ef1-9db8-cb1f300279c8 tempest-ServicesAdminTestJSON-887753969 tempest-ServicesAdminTestJSON-887753969-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:53.536141 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b8e83221-b0c0-4ef1-9db8-cb1f300279c8 tempest-ServicesAdminTestJSON-887753969 tempest-ServicesAdminTestJSON-887753969-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:53.671001 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b8e83221-b0c0-4ef1-9db8-cb1f300279c8 tempest-ServicesAdminTestJSON-887753969 tempest-ServicesAdminTestJSON-887753969-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.276151 Jul 18 02:11:53.673271 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 571/1078] 10.222.0.57 () {58 vars in 1136 bytes} [Mon Jul 18 02:11:53 2022] GET /compute/v2.1/os-services => generated 944 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:53.685774 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-37c93867-a5ea-40f7-b87f-36b7bc0d432d tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:53.688205 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-37c93867-a5ea-40f7-b87f-36b7bc0d432d tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 1df099cb-c253-4dd4-96a0-0652047390d8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:53.704184 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-37c93867-a5ea-40f7-b87f-36b7bc0d432d tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:53.705739 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-37c93867-a5ea-40f7-b87f-36b7bc0d432d tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:53.707496 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-37c93867-a5ea-40f7-b87f-36b7bc0d432d tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:53.708573 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-37c93867-a5ea-40f7-b87f-36b7bc0d432d tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:56.105952 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-37c93867-a5ea-40f7-b87f-36b7bc0d432d tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:56.159929 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-37c93867-a5ea-40f7-b87f-36b7bc0d432d tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/1df099cb-c253-4dd4-96a0-0652047390d8" status: 200 len: 1308 microversion: 2.1 time: 2.483879 Jul 18 02:11:56.178823 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 572/1079] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:53 2022] GET /compute/v2.1/servers/1df099cb-c253-4dd4-96a0-0652047390d8 => generated 1308 bytes in 2504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:56.196469 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b13f0abc-c7ba-42ed-8ad5-27f6405cb6b6 tempest-ServicesAdminTestJSON-887753969 tempest-ServicesAdminTestJSON-887753969-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:56.200094 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:56.200094 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:11:56.202605 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b13f0abc-c7ba-42ed-8ad5-27f6405cb6b6 tempest-ServicesAdminTestJSON-887753969 tempest-ServicesAdminTestJSON-887753969-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:56.203707 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b13f0abc-c7ba-42ed-8ad5-27f6405cb6b6 tempest-ServicesAdminTestJSON-887753969 tempest-ServicesAdminTestJSON-887753969-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:56.215348 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b13f0abc-c7ba-42ed-8ad5-27f6405cb6b6 tempest-ServicesAdminTestJSON-887753969 tempest-ServicesAdminTestJSON-887753969-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:56.215801 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b13f0abc-c7ba-42ed-8ad5-27f6405cb6b6 tempest-ServicesAdminTestJSON-887753969 tempest-ServicesAdminTestJSON-887753969-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:56.319226 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b13f0abc-c7ba-42ed-8ad5-27f6405cb6b6 tempest-ServicesAdminTestJSON-887753969 tempest-ServicesAdminTestJSON-887753969-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services?host=n-d-465891-3" status: 200 len: 578 microversion: 2.1 time: 0.137612 Jul 18 02:11:56.334632 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 573/1080] 10.222.0.57 () {58 vars in 1171 bytes} [Mon Jul 18 02:11:56 2022] GET /compute/v2.1/os-services?host=n-d-465891-3 => generated 578 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:56.342675 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d98cb0bf-84f4-4dd9-983b-bc90199b1b40 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:56.343333 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d98cb0bf-84f4-4dd9-983b-bc90199b1b40 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 7f16fcdb-c2da-4a62-8393-e4977d34bd63] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:56.358185 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d98cb0bf-84f4-4dd9-983b-bc90199b1b40 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:56.358969 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d98cb0bf-84f4-4dd9-983b-bc90199b1b40 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:56.360014 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d98cb0bf-84f4-4dd9-983b-bc90199b1b40 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:56.360634 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d98cb0bf-84f4-4dd9-983b-bc90199b1b40 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:56.380159 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-41e010de-8c29-480f-a64f-7e0e7d382a65 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded/action" status: 202 len: 0 microversion: 2.1 time: 7.985864 Jul 18 02:11:56.382331 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 508/1081] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:11:48 2022] POST /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded/action => generated 0 bytes in 7990 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:11:56.384263 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-d98cb0bf-84f4-4dd9-983b-bc90199b1b40 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] HTTP exception thrown: Instance 7f16fcdb-c2da-4a62-8393-e4977d34bd63 could not be found. Jul 18 02:11:56.386420 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d98cb0bf-84f4-4dd9-983b-bc90199b1b40 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Request method failure captured: Jul 18 02:11:56.386420 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/7f16fcdb-c2da-4a62-8393-e4977d34bd63 HTTP/1.1 Jul 18 02:11:56.386420 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:11:56.386420 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:11:56.386420 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:11:56.386420 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:11:56.386420 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:11:56.386420 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:11:56.386420 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:11:56.386420 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:11:56.386420 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MDW0nsDOErQx1M5B--1CkeoP9T-S1TPizMmyq4r8fSb1gDGw2dJxAwr6V-mUR5DXzPuO9S3zODZIWFQBOampxpq6qf7V2eqzzfGaVRMNGt80oxveARuX3BnFZqv24pWcGIoka_QWrLCoLhUXu-GzicL8Q3hDIA1BmqZj0KN_A1YqYw Jul 18 02:11:56.386420 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:11:56.386420 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:11:56.386420 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:11:56.386420 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:11:56.386420 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:11:56.386420 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:11:56.386420 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 37109e65d03f45c7be865364a9006ba6 Jul 18 02:11:56.386420 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersAdminTestJSON-669774451 Jul 18 02:11:56.386420 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:11:56.386420 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:11:56.388021 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_37109e65d03f45c7be865364a9006ba6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/37109e65d03f45c7be865364a9006ba6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/37109e65d03f45c7be865364a9006ba6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/37109e65d03f45c7be865364a9006ba6"}]}] Jul 18 02:11:56.388021 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersAdminTestJSON-669774451 Jul 18 02:11:56.388021 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 37109e65d03f45c7be865364a9006ba6 Jul 18 02:11:56.388021 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersAdminTestJSON-669774451 Jul 18 02:11:56.388021 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersAdminTestJSON-669774451-project Jul 18 02:11:56.388021 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:11:56.388021 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:11:56.388021 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: efc0d0f9b4154bbbb7475009490b5998 Jul 18 02:11:56.388021 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersAdminTestJSON-669774451-project Jul 18 02:11:56.388021 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:11:56.388021 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 7f16fcdb-c2da-4a62-8393-e4977d34bd63 could not be found. Jul 18 02:11:56.388021 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '7f16fcdb-c2da-4a62-8393-e4977d34bd63'} Jul 18 02:11:56.389027 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:11:56.389027 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:56.389027 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:11:56.389027 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:11:56.389027 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:11:56.389027 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:11:56.389027 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:11:56.389027 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:11:56.389027 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:11:56.389027 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:11:56.389027 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f16fcdb-c2da-4a62-8393-e4977d34bd63 could not be found. Jul 18 02:11:56.389027 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:56.389027 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:56.389027 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:56.389027 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:56.389027 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:56.389027 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:56.389027 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:11:56.389027 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:11:56.389027 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:11:56.392614 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:11:56.392614 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:11:56.392614 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:11:56.392614 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:11:56.392614 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:11:56.392614 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:11:56.392614 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:11:56.392614 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f16fcdb-c2da-4a62-8393-e4977d34bd63 could not be found. Jul 18 02:11:56.392614 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:56.392614 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:56.392614 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:56.392614 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:56.392614 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:56.392614 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:56.392614 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:11:56.392614 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:11:56.392614 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f16fcdb-c2da-4a62-8393-e4977d34bd63 could not be found. Jul 18 02:11:56.392614 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:11:56.397128 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d98cb0bf-84f4-4dd9-983b-bc90199b1b40 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Returning 404 to user: Instance 7f16fcdb-c2da-4a62-8393-e4977d34bd63 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:11:56.397128 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d98cb0bf-84f4-4dd9-983b-bc90199b1b40 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/7f16fcdb-c2da-4a62-8393-e4977d34bd63" status: 404 len: 111 microversion: 2.1 time: 0.062459 Jul 18 02:11:56.401679 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 574/1082] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:56 2022] GET /compute/v2.1/servers/7f16fcdb-c2da-4a62-8393-e4977d34bd63 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:11:56.407521 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-ddbefc86-1c56-48e3-ae8b-fb13a7597e0e req-c405f33d-c890-4a61-9b16-a9e7ee02e10a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f16fcdb-c2da-4a62-8393-e4977d34bd63", "name": "network-vif-deleted", "tag": "8178a5b6-596e-4fea-a484-79a9a9927b7d"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:56.409110 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-fcd703e3-3cc1-4a5b-b181-7c05fdd8b67d req-7aa6592b-a788-4224-be49-d61619077700 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f16fcdb-c2da-4a62-8393-e4977d34bd63", "name": "network-vif-unplugged", "status": "completed", "tag": "8178a5b6-596e-4fea-a484-79a9a9927b7d"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:56.441171 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-ddbefc86-1c56-48e3-ae8b-fb13a7597e0e req-c405f33d-c890-4a61-9b16-a9e7ee02e10a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:56.442216 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-ddbefc86-1c56-48e3-ae8b-fb13a7597e0e req-c405f33d-c890-4a61-9b16-a9e7ee02e10a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:56.470204 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-fcd703e3-3cc1-4a5b-b181-7c05fdd8b67d req-7aa6592b-a788-4224-be49-d61619077700 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:56.471485 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-fcd703e3-3cc1-4a5b-b181-7c05fdd8b67d req-7aa6592b-a788-4224-be49-d61619077700 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:56.480076 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-ddbefc86-1c56-48e3-ae8b-fb13a7597e0e req-c405f33d-c890-4a61-9b16-a9e7ee02e10a service nova] Creating event network-vif-deleted:8178a5b6-596e-4fea-a484-79a9a9927b7d for instance 7f16fcdb-c2da-4a62-8393-e4977d34bd63 on n-h2-465891-3 Jul 18 02:11:56.504049 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-ddbefc86-1c56-48e3-ae8b-fb13a7597e0e req-c405f33d-c890-4a61-9b16-a9e7ee02e10a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095646 Jul 18 02:11:56.507757 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 575/1083] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:56.524003 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d5734bc9-ea60-47fe-b89e-af6aef5bf9be tempest-ServicesAdminTestJSON-887753969 tempest-ServicesAdminTestJSON-887753969-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:56.529321 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:56.529321 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:11:56.532867 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d5734bc9-ea60-47fe-b89e-af6aef5bf9be tempest-ServicesAdminTestJSON-887753969 tempest-ServicesAdminTestJSON-887753969-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:56.533611 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d5734bc9-ea60-47fe-b89e-af6aef5bf9be tempest-ServicesAdminTestJSON-887753969 tempest-ServicesAdminTestJSON-887753969-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:56.535219 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d5734bc9-ea60-47fe-b89e-af6aef5bf9be tempest-ServicesAdminTestJSON-887753969 tempest-ServicesAdminTestJSON-887753969-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:56.538361 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d5734bc9-ea60-47fe-b89e-af6aef5bf9be tempest-ServicesAdminTestJSON-887753969 tempest-ServicesAdminTestJSON-887753969-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:56.568852 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-fcd703e3-3cc1-4a5b-b181-7c05fdd8b67d req-7aa6592b-a788-4224-be49-d61619077700 service nova] Creating event network-vif-unplugged:8178a5b6-596e-4fea-a484-79a9a9927b7d for instance 7f16fcdb-c2da-4a62-8393-e4977d34bd63 on n-h2-465891-3 Jul 18 02:11:56.592213 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-fcd703e3-3cc1-4a5b-b181-7c05fdd8b67d req-7aa6592b-a788-4224-be49-d61619077700 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.207885 Jul 18 02:11:56.593167 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 509/1084] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:56.611935 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5721071d-3e60-49d2-a7e4-a296550b2dd3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:56.619325 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5721071d-3e60-49d2-a7e4-a296550b2dd3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: ae4f2139-250b-4a65-8436-702487cc1ded] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:56.642177 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d5734bc9-ea60-47fe-b89e-af6aef5bf9be tempest-ServicesAdminTestJSON-887753969 tempest-ServicesAdminTestJSON-887753969-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.128990 Jul 18 02:11:56.643872 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 576/1085] 10.222.0.57 () {58 vars in 1175 bytes} [Mon Jul 18 02:11:56 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:56.649666 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5721071d-3e60-49d2-a7e4-a296550b2dd3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:56.652871 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-839d00c0-6ac0-4be6-83c2-a90dae5f692f tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:56.653877 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5721071d-3e60-49d2-a7e4-a296550b2dd3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:56.657934 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5721071d-3e60-49d2-a7e4-a296550b2dd3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:56.659232 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5721071d-3e60-49d2-a7e4-a296550b2dd3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:56.659459 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-839d00c0-6ac0-4be6-83c2-a90dae5f692f tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: c3ac090d-3caa-404a-8f4d-5708f9fd04d6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:56.674980 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-839d00c0-6ac0-4be6-83c2-a90dae5f692f tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:56.676702 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-839d00c0-6ac0-4be6-83c2-a90dae5f692f tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:56.679257 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-839d00c0-6ac0-4be6-83c2-a90dae5f692f tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:56.680650 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-839d00c0-6ac0-4be6-83c2-a90dae5f692f tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:56.759340 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-839d00c0-6ac0-4be6-83c2-a90dae5f692f tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: c3ac090d-3caa-404a-8f4d-5708f9fd04d6] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:11:56.892486 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-839d00c0-6ac0-4be6-83c2-a90dae5f692f tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c3ac090d-3caa-404a-8f4d-5708f9fd04d6" status: 204 len: 0 microversion: 2.1 time: 0.246820 Jul 18 02:11:56.893534 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 577/1086] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:11:56 2022] DELETE /compute/v2.1/servers/c3ac090d-3caa-404a-8f4d-5708f9fd04d6 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:11:56.912934 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c334d089-a028-4dee-b9dc-c4d08093800c tempest-ServicesAdminTestJSON-887753969 tempest-ServicesAdminTestJSON-887753969-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:56.915987 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:56.915987 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:11:56.919132 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c334d089-a028-4dee-b9dc-c4d08093800c tempest-ServicesAdminTestJSON-887753969 tempest-ServicesAdminTestJSON-887753969-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:56.920283 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c334d089-a028-4dee-b9dc-c4d08093800c tempest-ServicesAdminTestJSON-887753969 tempest-ServicesAdminTestJSON-887753969-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:56.922338 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c334d089-a028-4dee-b9dc-c4d08093800c tempest-ServicesAdminTestJSON-887753969 tempest-ServicesAdminTestJSON-887753969-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:56.923143 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c334d089-a028-4dee-b9dc-c4d08093800c tempest-ServicesAdminTestJSON-887753969 tempest-ServicesAdminTestJSON-887753969-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:57.023677 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c334d089-a028-4dee-b9dc-c4d08093800c tempest-ServicesAdminTestJSON-887753969 tempest-ServicesAdminTestJSON-887753969-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.127997 Jul 18 02:11:57.029798 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 578/1087] 10.222.0.57 () {58 vars in 1136 bytes} [Mon Jul 18 02:11:56 2022] GET /compute/v2.1/os-services => generated 944 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:57.050949 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9322e9e9-a4d2-453a-9e20-9ceddda4fb80 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:57.053847 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9322e9e9-a4d2-453a-9e20-9ceddda4fb80 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: c3ac090d-3caa-404a-8f4d-5708f9fd04d6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:57.092741 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9322e9e9-a4d2-453a-9e20-9ceddda4fb80 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:57.093730 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9322e9e9-a4d2-453a-9e20-9ceddda4fb80 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:57.095476 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9322e9e9-a4d2-453a-9e20-9ceddda4fb80 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:57.096213 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9322e9e9-a4d2-453a-9e20-9ceddda4fb80 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:57.560936 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5721071d-3e60-49d2-a7e4-a296550b2dd3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:57.576726 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5721071d-3e60-49d2-a7e4-a296550b2dd3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded" status: 200 len: 1503 microversion: 2.1 time: 0.981868 Jul 18 02:11:57.578559 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 510/1088] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:56 2022] GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded => generated 1503 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:57.589723 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b47c8552-b927-487f-a1f7-4427391b7792 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:57.590781 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b47c8552-b927-487f-a1f7-4427391b7792 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 1df099cb-c253-4dd4-96a0-0652047390d8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:57.611981 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b47c8552-b927-487f-a1f7-4427391b7792 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:57.612904 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b47c8552-b927-487f-a1f7-4427391b7792 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:57.614627 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b47c8552-b927-487f-a1f7-4427391b7792 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:57.616182 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b47c8552-b927-487f-a1f7-4427391b7792 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:57.960450 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=4 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:11:58.011512 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9322e9e9-a4d2-453a-9e20-9ceddda4fb80 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:58.053452 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9322e9e9-a4d2-453a-9e20-9ceddda4fb80 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/c3ac090d-3caa-404a-8f4d-5708f9fd04d6" status: 200 len: 1469 microversion: 2.1 time: 1.014869 Jul 18 02:11:58.074886 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 579/1089] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:57 2022] GET /compute/v2.1/servers/c3ac090d-3caa-404a-8f4d-5708f9fd04d6 => generated 1469 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:58.087528 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=14 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:11:58.607695 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-08fa1b31-7e53-4997-806e-609066371e54 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:58.608737 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-08fa1b31-7e53-4997-806e-609066371e54 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: ae4f2139-250b-4a65-8436-702487cc1ded] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:58.619608 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-08fa1b31-7e53-4997-806e-609066371e54 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:58.620069 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-08fa1b31-7e53-4997-806e-609066371e54 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:58.620897 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-08fa1b31-7e53-4997-806e-609066371e54 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:58.621338 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-08fa1b31-7e53-4997-806e-609066371e54 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:59.003196 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b47c8552-b927-487f-a1f7-4427391b7792 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:59.017815 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b47c8552-b927-487f-a1f7-4427391b7792 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/1df099cb-c253-4dd4-96a0-0652047390d8" status: 200 len: 1308 microversion: 2.1 time: 1.436886 Jul 18 02:11:59.021005 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 511/1090] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:57 2022] GET /compute/v2.1/servers/1df099cb-c253-4dd4-96a0-0652047390d8 => generated 1308 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:59.126524 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-604cfa38-a367-49be-91d4-d3489febe236 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:59.128354 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-604cfa38-a367-49be-91d4-d3489febe236 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: c3ac090d-3caa-404a-8f4d-5708f9fd04d6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:59.153481 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-604cfa38-a367-49be-91d4-d3489febe236 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:59.155382 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-604cfa38-a367-49be-91d4-d3489febe236 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:59.158018 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-604cfa38-a367-49be-91d4-d3489febe236 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:59.159071 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-604cfa38-a367-49be-91d4-d3489febe236 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:59.482009 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-08fa1b31-7e53-4997-806e-609066371e54 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:59.492955 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-08fa1b31-7e53-4997-806e-609066371e54 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded" status: 200 len: 1503 microversion: 2.1 time: 0.888954 Jul 18 02:11:59.493606 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 580/1091] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:58 2022] GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded => generated 1503 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:00.274076 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-604cfa38-a367-49be-91d4-d3489febe236 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:00.300482 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-604cfa38-a367-49be-91d4-d3489febe236 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/c3ac090d-3caa-404a-8f4d-5708f9fd04d6" status: 200 len: 1469 microversion: 2.1 time: 1.199001 Jul 18 02:12:00.304516 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 512/1092] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:59 2022] GET /compute/v2.1/servers/c3ac090d-3caa-404a-8f4d-5708f9fd04d6 => generated 1469 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:00.311217 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-16306a19-558f-4965-9490-3369db91a114 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:00.321760 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-16306a19-558f-4965-9490-3369db91a114 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 1df099cb-c253-4dd4-96a0-0652047390d8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:00.338166 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-16306a19-558f-4965-9490-3369db91a114 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:00.339335 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-16306a19-558f-4965-9490-3369db91a114 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:00.340997 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-16306a19-558f-4965-9490-3369db91a114 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:00.343639 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-16306a19-558f-4965-9490-3369db91a114 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:00.553191 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ff40495a-b8cc-49c3-81e9-6c6b47b63b9f tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] Action: 'create', calling method: .version_select at 0x7ff4a8a4e550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-709352660", "description": "tempest-description-1145697247"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:01.623378 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-16306a19-558f-4965-9490-3369db91a114 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:01.627403 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:01.644494 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-16306a19-558f-4965-9490-3369db91a114 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/1df099cb-c253-4dd4-96a0-0652047390d8" status: 200 len: 1308 microversion: 2.1 time: 1.338502 Jul 18 02:12:01.647346 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 513/1093] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:00 2022] GET /compute/v2.1/servers/1df099cb-c253-4dd4-96a0-0652047390d8 => generated 1308 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:01.654997 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-563c3530-4075-45a4-b6cd-3240dea45ad7 req-7fcc71de-474f-470f-abd8-cc0c0aac92a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1df099cb-c253-4dd4-96a0-0652047390d8", "tag": "faa469e5-28b6-416c-8e4b-d5b6ab117a54"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:01.688827 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-563c3530-4075-45a4-b6cd-3240dea45ad7 req-7fcc71de-474f-470f-abd8-cc0c0aac92a1 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:01.696072 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-563c3530-4075-45a4-b6cd-3240dea45ad7 req-7fcc71de-474f-470f-abd8-cc0c0aac92a1 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:01.728265 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-563c3530-4075-45a4-b6cd-3240dea45ad7 req-7fcc71de-474f-470f-abd8-cc0c0aac92a1 service nova] Creating event network-changed:faa469e5-28b6-416c-8e4b-d5b6ab117a54 for instance 1df099cb-c253-4dd4-96a0-0652047390d8 on n-h1-465891-3 Jul 18 02:12:01.752125 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-563c3530-4075-45a4-b6cd-3240dea45ad7 req-7fcc71de-474f-470f-abd8-cc0c0aac92a1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103070 Jul 18 02:12:01.753247 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 514/1094] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:01.759141 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-87779be9-228f-4cd9-aa22-ea1392052257 req-878090ef-1d3d-4536-b301-18e7a942d95a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3ac090d-3caa-404a-8f4d-5708f9fd04d6", "name": "network-vif-deleted", "tag": "3452aafc-709f-4bc0-87ce-db2523fa6dc8"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:01.779721 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-87779be9-228f-4cd9-aa22-ea1392052257 req-878090ef-1d3d-4536-b301-18e7a942d95a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:01.780357 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-87779be9-228f-4cd9-aa22-ea1392052257 req-878090ef-1d3d-4536-b301-18e7a942d95a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:01.795197 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-87779be9-228f-4cd9-aa22-ea1392052257 req-878090ef-1d3d-4536-b301-18e7a942d95a service nova] Creating event network-vif-deleted:3452aafc-709f-4bc0-87ce-db2523fa6dc8 for instance c3ac090d-3caa-404a-8f4d-5708f9fd04d6 on n-h2-465891-3 Jul 18 02:12:01.816972 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-87779be9-228f-4cd9-aa22-ea1392052257 req-878090ef-1d3d-4536-b301-18e7a942d95a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062047 Jul 18 02:12:01.819125 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 515/1095] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:01.830517 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-658a1f3c-f254-494c-baeb-20ba821e2555 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:01.834495 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-658a1f3c-f254-494c-baeb-20ba821e2555 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: ae4f2139-250b-4a65-8436-702487cc1ded] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:01.854591 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-658a1f3c-f254-494c-baeb-20ba821e2555 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:01.855150 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-658a1f3c-f254-494c-baeb-20ba821e2555 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:01.856041 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-658a1f3c-f254-494c-baeb-20ba821e2555 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:01.856700 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-658a1f3c-f254-494c-baeb-20ba821e2555 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:02.111002 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ff40495a-b8cc-49c3-81e9-6c6b47b63b9f tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 2.531831 Jul 18 02:12:02.112813 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 581/1096] 10.222.0.57 () {60 vars in 1179 bytes} [Mon Jul 18 02:11:59 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 2534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:12:02.118663 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-55eb4621-6891-4ea9-8b5e-ca8b50eae250 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:02.120217 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-55eb4621-6891-4ea9-8b5e-ca8b50eae250 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: c3ac090d-3caa-404a-8f4d-5708f9fd04d6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:02.160204 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-55eb4621-6891-4ea9-8b5e-ca8b50eae250 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:02.169360 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-55eb4621-6891-4ea9-8b5e-ca8b50eae250 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:02.174081 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-55eb4621-6891-4ea9-8b5e-ca8b50eae250 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:02.175985 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-55eb4621-6891-4ea9-8b5e-ca8b50eae250 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:02.241665 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-55eb4621-6891-4ea9-8b5e-ca8b50eae250 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] HTTP exception thrown: Instance c3ac090d-3caa-404a-8f4d-5708f9fd04d6 could not be found. Jul 18 02:12:02.248569 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-55eb4621-6891-4ea9-8b5e-ca8b50eae250 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Request method failure captured: Jul 18 02:12:02.248569 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/c3ac090d-3caa-404a-8f4d-5708f9fd04d6 HTTP/1.1 Jul 18 02:12:02.248569 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:12:02.248569 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:12:02.248569 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:12:02.248569 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:12:02.248569 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:12:02.248569 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:12:02.248569 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:12:02.248569 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:02.248569 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MDW0nsDOErQx1M5B--1CkeoP9T-S1TPizMmyq4r8fSb1gDGw2dJxAwr6V-mUR5DXzPuO9S3zODZIWFQBOampxpq6qf7V2eqzzfGaVRMNGt80oxveARuX3BnFZqv24pWcGIoka_QWrLCoLhUXu-GzicL8Q3hDIA1BmqZj0KN_A1YqYw Jul 18 02:12:02.248569 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:12:02.248569 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:12:02.248569 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:12:02.248569 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:12:02.248569 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:12:02.248569 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:12:02.248569 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 37109e65d03f45c7be865364a9006ba6 Jul 18 02:12:02.248569 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersAdminTestJSON-669774451 Jul 18 02:12:02.248569 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:12:02.248569 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:12:02.251210 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_37109e65d03f45c7be865364a9006ba6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/37109e65d03f45c7be865364a9006ba6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/37109e65d03f45c7be865364a9006ba6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/37109e65d03f45c7be865364a9006ba6"}]}] Jul 18 02:12:02.251210 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersAdminTestJSON-669774451 Jul 18 02:12:02.251210 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 37109e65d03f45c7be865364a9006ba6 Jul 18 02:12:02.251210 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersAdminTestJSON-669774451 Jul 18 02:12:02.251210 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersAdminTestJSON-669774451-project Jul 18 02:12:02.251210 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:12:02.251210 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:12:02.251210 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: efc0d0f9b4154bbbb7475009490b5998 Jul 18 02:12:02.251210 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersAdminTestJSON-669774451-project Jul 18 02:12:02.251210 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:12:02.251210 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance c3ac090d-3caa-404a-8f4d-5708f9fd04d6 could not be found. Jul 18 02:12:02.251210 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'c3ac090d-3caa-404a-8f4d-5708f9fd04d6'} Jul 18 02:12:02.252681 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:02.252681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:02.252681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:12:02.252681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:12:02.252681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:12:02.252681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:12:02.252681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:12:02.252681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:12:02.252681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:12:02.252681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:12:02.252681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3ac090d-3caa-404a-8f4d-5708f9fd04d6 could not be found. Jul 18 02:12:02.252681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:12:02.252681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:02.252681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:12:02.252681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:02.252681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:02.252681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:02.252681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:02.252681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:02.252681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:02.255560 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:02.255560 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:12:02.255560 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:12:02.255560 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:12:02.255560 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:12:02.255560 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:12:02.255560 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:12:02.255560 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3ac090d-3caa-404a-8f4d-5708f9fd04d6 could not be found. Jul 18 02:12:02.255560 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:12:02.255560 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:02.255560 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:12:02.255560 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:02.255560 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:02.255560 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:02.255560 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:12:02.255560 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:12:02.255560 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3ac090d-3caa-404a-8f4d-5708f9fd04d6 could not be found. Jul 18 02:12:02.255560 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:12:02.261251 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-55eb4621-6891-4ea9-8b5e-ca8b50eae250 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Returning 404 to user: Instance c3ac090d-3caa-404a-8f4d-5708f9fd04d6 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:02.265892 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-55eb4621-6891-4ea9-8b5e-ca8b50eae250 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/c3ac090d-3caa-404a-8f4d-5708f9fd04d6" status: 404 len: 111 microversion: 2.1 time: 0.151255 Jul 18 02:12:02.271528 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 582/1097] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:02 2022] GET /compute/v2.1/servers/c3ac090d-3caa-404a-8f4d-5708f9fd04d6 => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:12:02.287018 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e5358a24-1086-48ff-b71e-3963e2804e04 tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] Action: 'create', calling method: .version_select at 0x7ff4a89d7040>, body: {"security_group_rule": {"parent_group_id": "b1694e2f-46d6-49fe-9917-09e7197de209", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:03.365378 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=18 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:03.688472 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-658a1f3c-f254-494c-baeb-20ba821e2555 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:03.703157 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-658a1f3c-f254-494c-baeb-20ba821e2555 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded" status: 200 len: 1503 microversion: 2.1 time: 1.881250 Jul 18 02:12:03.717469 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 516/1098] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:01 2022] GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded => generated 1503 bytes in 1898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:03.727158 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fd3fe139-4d6c-4ad6-a559-f5524d5fd2da tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:03.727963 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fd3fe139-4d6c-4ad6-a559-f5524d5fd2da tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:03.735426 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fd3fe139-4d6c-4ad6-a559-f5524d5fd2da tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:03.736254 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fd3fe139-4d6c-4ad6-a559-f5524d5fd2da tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:03.737649 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fd3fe139-4d6c-4ad6-a559-f5524d5fd2da tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:03.738149 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fd3fe139-4d6c-4ad6-a559-f5524d5fd2da tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:03.769133 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fd3fe139-4d6c-4ad6-a559-f5524d5fd2da tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:12:04.013995 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fd3fe139-4d6c-4ad6-a559-f5524d5fd2da tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "DELETE /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 204 len: 0 microversion: 2.1 time: 0.292141 Jul 18 02:12:04.015304 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 517/1099] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:12:03 2022] DELETE /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:12:04.040692 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b3154324-fe99-4ed1-989c-d86baa96506e tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:04.067910 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b3154324-fe99-4ed1-989c-d86baa96506e tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 1df099cb-c253-4dd4-96a0-0652047390d8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:04.080419 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b3154324-fe99-4ed1-989c-d86baa96506e tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:04.081567 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b3154324-fe99-4ed1-989c-d86baa96506e tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:04.085465 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b3154324-fe99-4ed1-989c-d86baa96506e tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:04.088244 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b3154324-fe99-4ed1-989c-d86baa96506e tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:04.771408 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e5358a24-1086-48ff-b71e-3963e2804e04 tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] 10.222.0.57 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 2.497539 Jul 18 02:12:04.780154 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 583/1100] 10.222.0.57 () {60 vars in 1194 bytes} [Mon Jul 18 02:12:02 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 2507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:04.785616 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-d8a9ccfe-3a2d-42fb-8c77-e7356733549c req-c7d9d444-5322-4b6e-991e-63e6ab3705aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae4f2139-250b-4a65-8436-702487cc1ded", "name": "network-vif-unplugged", "status": "completed", "tag": "babbb140-0981-4a5e-b5a3-7f0cc8649998"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:04.813994 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-d8a9ccfe-3a2d-42fb-8c77-e7356733549c req-c7d9d444-5322-4b6e-991e-63e6ab3705aa service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:04.821463 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-d8a9ccfe-3a2d-42fb-8c77-e7356733549c req-c7d9d444-5322-4b6e-991e-63e6ab3705aa service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:04.853330 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-d8a9ccfe-3a2d-42fb-8c77-e7356733549c req-c7d9d444-5322-4b6e-991e-63e6ab3705aa service nova] Creating event network-vif-unplugged:babbb140-0981-4a5e-b5a3-7f0cc8649998 for instance ae4f2139-250b-4a65-8436-702487cc1ded on n-h1-465891-3 Jul 18 02:12:04.860680 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-d8a9ccfe-3a2d-42fb-8c77-e7356733549c req-c7d9d444-5322-4b6e-991e-63e6ab3705aa service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078834 Jul 18 02:12:04.863245 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 584/1101] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:04.866651 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b3154324-fe99-4ed1-989c-d86baa96506e tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:04.881736 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ab9c2c49-d66b-45d0-8624-86dbad2d27a3 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:04.883332 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ab9c2c49-d66b-45d0-8624-86dbad2d27a3 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:04.889450 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b3154324-fe99-4ed1-989c-d86baa96506e tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/1df099cb-c253-4dd4-96a0-0652047390d8" status: 200 len: 1308 microversion: 2.1 time: 0.870760 Jul 18 02:12:04.896855 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ab9c2c49-d66b-45d0-8624-86dbad2d27a3 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:04.897612 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ab9c2c49-d66b-45d0-8624-86dbad2d27a3 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:04.899372 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ab9c2c49-d66b-45d0-8624-86dbad2d27a3 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:04.900057 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ab9c2c49-d66b-45d0-8624-86dbad2d27a3 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:04.915387 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 518/1102] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:04 2022] GET /compute/v2.1/servers/1df099cb-c253-4dd4-96a0-0652047390d8 => generated 1308 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:04.924236 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ea6f684f-9c71-4bac-8749-8731eec1988f tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a8b31040>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:05.035227 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ea6f684f-9c71-4bac-8749-8731eec1988f tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/2e3b2a4a-cc21-4e53-b850-4c9fca382b4b" status: 200 len: 662 microversion: 2.1 time: 0.117641 Jul 18 02:12:05.048915 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 519/1103] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:12:04 2022] GET /compute/v2.1/images/2e3b2a4a-cc21-4e53-b850-4c9fca382b4b => generated 662 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:05.059597 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f91948f1-6d50-484d-acfe-89116a1baadf tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:05.061169 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f91948f1-6d50-484d-acfe-89116a1baadf tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: ae4f2139-250b-4a65-8436-702487cc1ded] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:05.077236 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f91948f1-6d50-484d-acfe-89116a1baadf tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:05.078821 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f91948f1-6d50-484d-acfe-89116a1baadf tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:05.080248 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f91948f1-6d50-484d-acfe-89116a1baadf tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:05.083767 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f91948f1-6d50-484d-acfe-89116a1baadf tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:05.493852 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ab9c2c49-d66b-45d0-8624-86dbad2d27a3 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:05.548626 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ab9c2c49-d66b-45d0-8624-86dbad2d27a3 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1470 microversion: 2.1 time: 0.682023 Jul 18 02:12:05.552363 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 585/1104] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:04 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1470 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:05.573249 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b8f59247-49f1-439f-9f1c-947a877f33a6 tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] Action: 'create', calling method: .version_select at 0x7ff4a88b38b0>, body: {"security_group_rule": {"parent_group_id": "b1694e2f-46d6-49fe-9917-09e7197de209", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:05.656259 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f91948f1-6d50-484d-acfe-89116a1baadf tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:05.684139 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f91948f1-6d50-484d-acfe-89116a1baadf tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded" status: 200 len: 1503 microversion: 2.1 time: 0.635422 Jul 18 02:12:05.685191 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 520/1105] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:05 2022] GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded => generated 1503 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:05.720935 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8c4e5681-307a-42ec-86d1-c7f3738727e3 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a8b31dc0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:05.854561 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-b8f59247-49f1-439f-9f1c-947a877f33a6 tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] HTTP exception thrown: This rule already exists in group b1694e2f-46d6-49fe-9917-09e7197de209 Jul 18 02:12:05.858801 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b8f59247-49f1-439f-9f1c-947a877f33a6 tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] Request method failure captured: Jul 18 02:12:05.858801 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 18 02:12:05.858801 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:12:05.858801 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:12:05.858801 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:12:05.858801 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 138 Jul 18 02:12:05.858801 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:12:05.858801 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:12:05.858801 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:12:05.858801 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:05.858801 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MFvrwBa72eDoE-iV_AlXyD7DqJHia6Wl6kiIgNMmVqzhPQuDs0bhXtn_bKwSC7iCEZQA72xCkQl0U0A69IyWGybK9aTrkvgHQ0t6dupI1rUrh0W8zqEyp6PMZePn4_g97dngzKpo07MciZsZ3y_ChaSuRgcQ2OuO8RhRYXmBp5ZwrY Jul 18 02:12:05.858801 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:12:05.858801 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:12:05.858801 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:12:05.858801 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:12:05.858801 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:12:05.858801 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:12:05.858801 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: e8f1c5feb498408ab13b20a4b7675dc9 Jul 18 02:12:05.858801 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-304173729 Jul 18 02:12:05.858801 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:12:05.858801 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:12:05.861234 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e8f1c5feb498408ab13b20a4b7675dc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e8f1c5feb498408ab13b20a4b7675dc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e8f1c5feb498408ab13b20a4b7675dc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e8f1c5feb498408ab13b20a4b7675dc9"}]}] Jul 18 02:12:05.861234 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-304173729 Jul 18 02:12:05.861234 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: e8f1c5feb498408ab13b20a4b7675dc9 Jul 18 02:12:05.861234 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-304173729 Jul 18 02:12:05.861234 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-304173729-project Jul 18 02:12:05.861234 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:12:05.861234 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:12:05.861234 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: fcd4c56ad8c64672b329f1c9eeb26373 Jul 18 02:12:05.861234 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-304173729-project Jul 18 02:12:05.861234 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:12:05.861234 n-d-465891-3 devstack@n-api.service[119544]: {"security_group_rule": {"parent_group_id": "b1694e2f-46d6-49fe-9917-09e7197de209", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 18 02:12:05.861234 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:12:05.863198 n-d-465891-3 devstack@n-api.service[119544]: exception: This rule already exists in group b1694e2f-46d6-49fe-9917-09e7197de209 Jul 18 02:12:05.863198 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b1694e2f-46d6-49fe-9917-09e7197de209', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 18 02:12:05.863198 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:05.863198 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:05.863198 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Jul 18 02:12:05.863198 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Jul 18 02:12:05.863198 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Jul 18 02:12:05.863198 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 18 02:12:05.863198 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group b1694e2f-46d6-49fe-9917-09e7197de209 Jul 18 02:12:05.863198 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:12:05.863198 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:05.863198 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:12:05.863198 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:05.863198 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:05.863198 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:05.863198 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:05.863198 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:05.863198 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:12:05.863198 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:12:05.863198 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:05.866283 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:05.866283 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Jul 18 02:12:05.866283 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 18 02:12:05.866283 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group b1694e2f-46d6-49fe-9917-09e7197de209 Jul 18 02:12:05.866283 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:12:05.866283 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:05.866283 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:12:05.866283 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:05.866283 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:05.866283 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:05.866283 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:12:05.866283 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:12:05.866283 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group b1694e2f-46d6-49fe-9917-09e7197de209 Jul 18 02:12:05.866283 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:12:05.866283 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b8f59247-49f1-439f-9f1c-947a877f33a6 tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] Returning 400 to user: This rule already exists in group b1694e2f-46d6-49fe-9917-09e7197de209 {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:05.868737 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b8f59247-49f1-439f-9f1c-947a877f33a6 tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] 10.222.0.57 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.305726 Jul 18 02:12:05.868737 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 586/1106] 10.222.0.57 () {60 vars in 1194 bytes} [Mon Jul 18 02:12:05 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 310 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:12:05.883475 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4b06beab-83a1-4736-be7c-43677b1a8586 tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] Calling method '.version_select at 0x7ff4a8874310>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:05.898584 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8c4e5681-307a-42ec-86d1-c7f3738727e3 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/2e3b2a4a-cc21-4e53-b850-4c9fca382b4b" status: 200 len: 662 microversion: 2.1 time: 0.211429 Jul 18 02:12:05.903601 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 521/1107] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:12:05 2022] GET /compute/v2.1/images/2e3b2a4a-cc21-4e53-b850-4c9fca382b4b => generated 662 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:05.947328 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fdcbd84e-519e-4f40-8a4d-83109cb96c89 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:05.951589 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fdcbd84e-519e-4f40-8a4d-83109cb96c89 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 1df099cb-c253-4dd4-96a0-0652047390d8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:05.992983 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fdcbd84e-519e-4f40-8a4d-83109cb96c89 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:05.999696 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fdcbd84e-519e-4f40-8a4d-83109cb96c89 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:06.007342 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fdcbd84e-519e-4f40-8a4d-83109cb96c89 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:06.011927 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fdcbd84e-519e-4f40-8a4d-83109cb96c89 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:06.988265 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=17 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:07.017234 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fdcbd84e-519e-4f40-8a4d-83109cb96c89 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:07.042917 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fdcbd84e-519e-4f40-8a4d-83109cb96c89 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/1df099cb-c253-4dd4-96a0-0652047390d8" status: 200 len: 1308 microversion: 2.1 time: 1.122448 Jul 18 02:12:07.053123 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 522/1108] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:05 2022] GET /compute/v2.1/servers/1df099cb-c253-4dd4-96a0-0652047390d8 => generated 1308 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:07.088259 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a58f0b6e-72ba-4f10-a7a0-7069953c2ca2 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:07.095128 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a58f0b6e-72ba-4f10-a7a0-7069953c2ca2 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:07.135831 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a58f0b6e-72ba-4f10-a7a0-7069953c2ca2 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:07.143670 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a58f0b6e-72ba-4f10-a7a0-7069953c2ca2 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:07.159339 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a58f0b6e-72ba-4f10-a7a0-7069953c2ca2 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:07.159825 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a58f0b6e-72ba-4f10-a7a0-7069953c2ca2 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:07.193158 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4b06beab-83a1-4736-be7c-43677b1a8586 tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-group-rules/688426fd-fce1-45f1-9079-08c5e3b945e9" status: 202 len: 0 microversion: 2.1 time: 1.321270 Jul 18 02:12:07.194478 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 587/1109] 10.222.0.57 () {58 vars in 1286 bytes} [Mon Jul 18 02:12:05 2022] DELETE /compute/v2.1/os-security-group-rules/688426fd-fce1-45f1-9079-08c5e3b945e9 => generated 0 bytes in 1324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:12:07.201809 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d07c7177-fb60-4f00-887f-06b7b61a73c7 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:07.202601 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d07c7177-fb60-4f00-887f-06b7b61a73c7 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: ae4f2139-250b-4a65-8436-702487cc1ded] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:07.229476 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d07c7177-fb60-4f00-887f-06b7b61a73c7 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:07.231249 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d07c7177-fb60-4f00-887f-06b7b61a73c7 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:07.233950 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d07c7177-fb60-4f00-887f-06b7b61a73c7 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:07.236947 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d07c7177-fb60-4f00-887f-06b7b61a73c7 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:07.278640 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a58f0b6e-72ba-4f10-a7a0-7069953c2ca2 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:07.279101 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a58f0b6e-72ba-4f10-a7a0-7069953c2ca2 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:07.283692 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-a58f0b6e-72ba-4f10-a7a0-7069953c2ca2 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lazy-loading 'fault' on Instance uuid 092e9dd7-8734-42ae-9ad7-626438550736 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:12:07.581960 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a58f0b6e-72ba-4f10-a7a0-7069953c2ca2 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc0d0f9b4154bbbb7475009490b5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37109e65d03f45c7be865364a9006ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:07.626618 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a58f0b6e-72ba-4f10-a7a0-7069953c2ca2 tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 200 len: 1304 microversion: 2.1 time: 0.557777 Jul 18 02:12:07.628210 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 523/1110] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:07 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 1304 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:07.643291 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-036e7b98-c5d0-457f-9f1c-983401411299 req-0e6131c3-ce06-4818-a89f-4ac9f1c123e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "092e9dd7-8734-42ae-9ad7-626438550736", "name": "network-vif-deleted", "tag": "5653c487-e512-475c-8f13-aa4ee05e2542"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:07.677419 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-036e7b98-c5d0-457f-9f1c-983401411299 req-0e6131c3-ce06-4818-a89f-4ac9f1c123e4 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:07.678520 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-036e7b98-c5d0-457f-9f1c-983401411299 req-0e6131c3-ce06-4818-a89f-4ac9f1c123e4 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:07.717360 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-036e7b98-c5d0-457f-9f1c-983401411299 req-0e6131c3-ce06-4818-a89f-4ac9f1c123e4 service nova] Creating event network-vif-deleted:5653c487-e512-475c-8f13-aa4ee05e2542 for instance 092e9dd7-8734-42ae-9ad7-626438550736 on n-h2-465891-3 Jul 18 02:12:07.736966 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-036e7b98-c5d0-457f-9f1c-983401411299 req-0e6131c3-ce06-4818-a89f-4ac9f1c123e4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106022 Jul 18 02:12:07.738257 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 524/1111] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:07.757076 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-f7de930e-60b2-4df6-8039-00e6996438e3 req-9f9aadea-f4e8-45af-9679-b5ec71f8967e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae4f2139-250b-4a65-8436-702487cc1ded", "tag": "babbb140-0981-4a5e-b5a3-7f0cc8649998"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:07.783451 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-f7de930e-60b2-4df6-8039-00e6996438e3 req-9f9aadea-f4e8-45af-9679-b5ec71f8967e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:07.784851 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-f7de930e-60b2-4df6-8039-00e6996438e3 req-9f9aadea-f4e8-45af-9679-b5ec71f8967e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:07.813019 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-f7de930e-60b2-4df6-8039-00e6996438e3 req-9f9aadea-f4e8-45af-9679-b5ec71f8967e service nova] Creating event network-changed:babbb140-0981-4a5e-b5a3-7f0cc8649998 for instance ae4f2139-250b-4a65-8436-702487cc1ded on n-h1-465891-3 Jul 18 02:12:07.839470 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-f7de930e-60b2-4df6-8039-00e6996438e3 req-9f9aadea-f4e8-45af-9679-b5ec71f8967e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092086 Jul 18 02:12:07.840794 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 525/1112] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:07.866470 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4077aa1a-c951-4af3-87b6-fb6eda560903 tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] Action: 'create', calling method: .version_select at 0x7ff4a8b48790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-733329989", "description": "tempest-description-280555912"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:08.408035 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d07c7177-fb60-4f00-887f-06b7b61a73c7 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:08.423162 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d07c7177-fb60-4f00-887f-06b7b61a73c7 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded" status: 200 len: 1503 microversion: 2.1 time: 1.226809 Jul 18 02:12:08.454460 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 588/1113] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:07 2022] GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded => generated 1503 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:08.474926 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3eca2047-0b9c-42f2-bac0-62145fc8f7b6 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:08.476831 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3eca2047-0b9c-42f2-bac0-62145fc8f7b6 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 1df099cb-c253-4dd4-96a0-0652047390d8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:08.510399 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3eca2047-0b9c-42f2-bac0-62145fc8f7b6 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:08.511213 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3eca2047-0b9c-42f2-bac0-62145fc8f7b6 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:08.512618 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3eca2047-0b9c-42f2-bac0-62145fc8f7b6 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:08.513747 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3eca2047-0b9c-42f2-bac0-62145fc8f7b6 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:08.964022 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4077aa1a-c951-4af3-87b6-fb6eda560903 tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.120318 Jul 18 02:12:08.965365 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 526/1114] 10.222.0.57 () {60 vars in 1179 bytes} [Mon Jul 18 02:12:07 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:09.231863 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3eca2047-0b9c-42f2-bac0-62145fc8f7b6 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:09.258915 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3eca2047-0b9c-42f2-bac0-62145fc8f7b6 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/1df099cb-c253-4dd4-96a0-0652047390d8" status: 200 len: 1308 microversion: 2.1 time: 0.798944 Jul 18 02:12:09.260001 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 589/1115] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:08 2022] GET /compute/v2.1/servers/1df099cb-c253-4dd4-96a0-0652047390d8 => generated 1308 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:09.278982 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-251f941e-eb2f-451f-b530-a9595aa1b1be tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a9437310>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:09.396027 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-251f941e-eb2f-451f-b530-a9595aa1b1be tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/9dbaf0e4-95a4-4278-9954-659c13fc47dd" status: 200 len: 661 microversion: 2.1 time: 0.132457 Jul 18 02:12:09.407039 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 590/1116] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:12:09 2022] GET /compute/v2.1/images/9dbaf0e4-95a4-4278-9954-659c13fc47dd => generated 661 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:09.412354 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-281fbf57-3e5b-4c1b-b371-d749e0fa489b tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:09.413836 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-281fbf57-3e5b-4c1b-b371-d749e0fa489b tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] [instance: 092e9dd7-8734-42ae-9ad7-626438550736] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:09.421736 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-281fbf57-3e5b-4c1b-b371-d749e0fa489b tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:09.422629 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-281fbf57-3e5b-4c1b-b371-d749e0fa489b tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:09.423940 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-281fbf57-3e5b-4c1b-b371-d749e0fa489b tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:09.424673 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-281fbf57-3e5b-4c1b-b371-d749e0fa489b tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:09.453634 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-281fbf57-3e5b-4c1b-b371-d749e0fa489b tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] HTTP exception thrown: Instance 092e9dd7-8734-42ae-9ad7-626438550736 could not be found. Jul 18 02:12:09.455681 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-281fbf57-3e5b-4c1b-b371-d749e0fa489b tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Request method failure captured: Jul 18 02:12:09.455681 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 HTTP/1.1 Jul 18 02:12:09.455681 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:12:09.455681 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:12:09.455681 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:12:09.455681 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:12:09.455681 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:12:09.455681 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:12:09.455681 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:12:09.455681 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:09.455681 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MDW0nsDOErQx1M5B--1CkeoP9T-S1TPizMmyq4r8fSb1gDGw2dJxAwr6V-mUR5DXzPuO9S3zODZIWFQBOampxpq6qf7V2eqzzfGaVRMNGt80oxveARuX3BnFZqv24pWcGIoka_QWrLCoLhUXu-GzicL8Q3hDIA1BmqZj0KN_A1YqYw Jul 18 02:12:09.455681 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:12:09.455681 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:12:09.455681 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:12:09.455681 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:12:09.455681 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:12:09.455681 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:12:09.455681 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 37109e65d03f45c7be865364a9006ba6 Jul 18 02:12:09.455681 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersAdminTestJSON-669774451 Jul 18 02:12:09.455681 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:12:09.455681 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:12:09.457425 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_37109e65d03f45c7be865364a9006ba6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/37109e65d03f45c7be865364a9006ba6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/37109e65d03f45c7be865364a9006ba6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/37109e65d03f45c7be865364a9006ba6"}]}] Jul 18 02:12:09.457425 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersAdminTestJSON-669774451 Jul 18 02:12:09.457425 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 37109e65d03f45c7be865364a9006ba6 Jul 18 02:12:09.457425 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersAdminTestJSON-669774451 Jul 18 02:12:09.457425 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersAdminTestJSON-669774451-project Jul 18 02:12:09.457425 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:12:09.457425 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:12:09.457425 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: efc0d0f9b4154bbbb7475009490b5998 Jul 18 02:12:09.457425 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersAdminTestJSON-669774451-project Jul 18 02:12:09.457425 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:12:09.457425 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 092e9dd7-8734-42ae-9ad7-626438550736 could not be found. Jul 18 02:12:09.457425 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '092e9dd7-8734-42ae-9ad7-626438550736'} Jul 18 02:12:09.458992 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:09.458992 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:09.458992 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:12:09.458992 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:12:09.458992 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:12:09.458992 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:12:09.458992 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:12:09.458992 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:12:09.458992 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:12:09.458992 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:12:09.458992 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 092e9dd7-8734-42ae-9ad7-626438550736 could not be found. Jul 18 02:12:09.458992 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:12:09.458992 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:09.458992 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:12:09.458992 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:09.458992 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:09.458992 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:09.458992 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:09.458992 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:09.458992 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:09.460528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:09.460528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:12:09.460528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:12:09.460528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:12:09.460528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:12:09.460528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:12:09.460528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:12:09.460528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 092e9dd7-8734-42ae-9ad7-626438550736 could not be found. Jul 18 02:12:09.460528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:12:09.460528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:09.460528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:12:09.460528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:09.460528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:09.460528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:09.460528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:12:09.460528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:12:09.460528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 092e9dd7-8734-42ae-9ad7-626438550736 could not be found. Jul 18 02:12:09.460528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:12:09.463729 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-281fbf57-3e5b-4c1b-b371-d749e0fa489b tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] Returning 404 to user: Instance 092e9dd7-8734-42ae-9ad7-626438550736 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:09.464820 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-281fbf57-3e5b-4c1b-b371-d749e0fa489b tempest-ServersAdminTestJSON-669774451 tempest-ServersAdminTestJSON-669774451-project] 10.222.0.57 "GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736" status: 404 len: 111 microversion: 2.1 time: 0.056442 Jul 18 02:12:09.466079 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 591/1117] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:09 2022] GET /compute/v2.1/servers/092e9dd7-8734-42ae-9ad7-626438550736 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:12:09.478952 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-80060500-eec6-4888-880e-1e423d0d912c tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] Action: 'create', calling method: .version_select at 0x7ff4a8a9c4c0>, body: {"security_group_rule": {"parent_group_id": "8e82ae92-47be-42d4-866a-90491e355ca4", "ip_protocol": "tcp", "from_port": 1730666545, "to_port": 22}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:09.497662 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-545d1712-2834-4699-8cf2-d20ba2bbf159 tempest-FlavorMetadataValidation-84617980 tempest-FlavorMetadataValidation-84617980-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-717771103", "id": 1075512911, "os-flavor-access:is_public": "True"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:09.506417 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:09.506417 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:12:09.572163 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-545d1712-2834-4699-8cf2-d20ba2bbf159 tempest-FlavorMetadataValidation-84617980 tempest-FlavorMetadataValidation-84617980-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 470 microversion: 2.86 time: 0.605258 Jul 18 02:12:09.578141 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 527/1118] 10.222.0.57 () {62 vars in 1187 bytes} [Mon Jul 18 02:12:08 2022] POST /compute/v2.1/flavors => generated 470 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:12:09.583734 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-38916795-3520-42be-96b2-f11ddf9a4f73 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a8b48ca0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:09.652041 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-38916795-3520-42be-96b2-f11ddf9a4f73 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/9dbaf0e4-95a4-4278-9954-659c13fc47dd" status: 200 len: 661 microversion: 2.1 time: 0.072663 Jul 18 02:12:09.667007 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 528/1119] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:12:09 2022] GET /compute/v2.1/images/9dbaf0e4-95a4-4278-9954-659c13fc47dd => generated 661 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:09.675851 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-80060500-eec6-4888-880e-1e423d0d912c tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] HTTP exception thrown: Invalid port range 1730666545:22. Former value cannot be greater than the later Jul 18 02:12:09.678931 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-26d4e586-b366-4eeb-bcaf-b79c82a13a13 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:09.681631 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-80060500-eec6-4888-880e-1e423d0d912c tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] Request method failure captured: Jul 18 02:12:09.681631 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 18 02:12:09.681631 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:12:09.681631 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:12:09.681631 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:12:09.681631 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 146 Jul 18 02:12:09.681631 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:12:09.681631 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:12:09.681631 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:12:09.681631 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:09.681631 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MFvrwBa72eDoE-iV_AlXyD7DqJHia6Wl6kiIgNMmVqzhPQuDs0bhXtn_bKwSC7iCEZQA72xCkQl0U0A69IyWGybK9aTrkvgHQ0t6dupI1rUrh0W8zqEyp6PMZePn4_g97dngzKpo07MciZsZ3y_ChaSuRgcQ2OuO8RhRYXmBp5ZwrY Jul 18 02:12:09.681631 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:12:09.681631 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:12:09.681631 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:12:09.681631 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:12:09.681631 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:12:09.681631 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:12:09.681631 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: e8f1c5feb498408ab13b20a4b7675dc9 Jul 18 02:12:09.681631 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-304173729 Jul 18 02:12:09.681631 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:12:09.681631 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:12:09.683332 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e8f1c5feb498408ab13b20a4b7675dc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e8f1c5feb498408ab13b20a4b7675dc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e8f1c5feb498408ab13b20a4b7675dc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e8f1c5feb498408ab13b20a4b7675dc9"}]}] Jul 18 02:12:09.683332 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-304173729 Jul 18 02:12:09.683332 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: e8f1c5feb498408ab13b20a4b7675dc9 Jul 18 02:12:09.683332 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-304173729 Jul 18 02:12:09.683332 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-304173729-project Jul 18 02:12:09.683332 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:12:09.683332 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:12:09.683332 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: fcd4c56ad8c64672b329f1c9eeb26373 Jul 18 02:12:09.683332 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-304173729-project Jul 18 02:12:09.683332 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:12:09.683332 n-d-465891-3 devstack@n-api.service[119544]: {"security_group_rule": {"parent_group_id": "8e82ae92-47be-42d4-866a-90491e355ca4", "ip_protocol": "tcp", "from_port": 1730666545, "to_port": 22}} Jul 18 02:12:09.683332 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:12:09.684185 n-d-465891-3 devstack@n-api.service[119544]: exception: Invalid port range 1730666545:22. Former value cannot be greater than the later Jul 18 02:12:09.684185 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'body': {'security_group_rule': {'parent_group_id': '8e82ae92-47be-42d4-866a-90491e355ca4', 'ip_protocol': 'tcp', 'from_port': 1730666545, 'to_port': 22}}} Jul 18 02:12:09.684185 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:09.684185 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:09.684185 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 18 02:12:09.684185 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 18 02:12:09.684185 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 18 02:12:09.684185 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 18 02:12:09.684185 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 18 02:12:09.684185 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 18 02:12:09.684185 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 18 02:12:09.684185 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 18 02:12:09.684185 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1730666545:22. Former value cannot be greater than the later Jul 18 02:12:09.684185 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:12:09.684185 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:09.684185 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:12:09.684185 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:09.684185 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:09.684185 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:09.691232 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:09.691232 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:09.691232 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:12:09.691232 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:12:09.691232 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:09.691232 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:09.691232 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 18 02:12:09.691232 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 18 02:12:09.691232 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1730666545:22. Former value cannot be greater than the later Jul 18 02:12:09.691232 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:12:09.691232 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:09.691232 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:12:09.691232 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:09.691232 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:09.691232 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:09.691232 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:12:09.691232 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:12:09.691232 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1730666545:22. Former value cannot be greater than the later Jul 18 02:12:09.691232 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:12:09.694636 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-80060500-eec6-4888-880e-1e423d0d912c tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] Returning 400 to user: Invalid port range 1730666545:22. Former value cannot be greater than the later {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:09.694636 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-80060500-eec6-4888-880e-1e423d0d912c tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] 10.222.0.57 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.216846 Jul 18 02:12:09.694636 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 592/1120] 10.222.0.57 () {60 vars in 1194 bytes} [Mon Jul 18 02:12:09 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 218 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:12:09.698208 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-26d4e586-b366-4eeb-bcaf-b79c82a13a13 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: ae4f2139-250b-4a65-8436-702487cc1ded] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:09.702999 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fd54e237-4b15-4ff6-ad1c-c30270a7c71a tempest-FlavorMetadataValidation-84617980 tempest-FlavorMetadataValidation-84617980-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:09.706154 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:09.706154 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:12:09.719571 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-26d4e586-b366-4eeb-bcaf-b79c82a13a13 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:09.720261 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-26d4e586-b366-4eeb-bcaf-b79c82a13a13 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:09.722568 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-26d4e586-b366-4eeb-bcaf-b79c82a13a13 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:09.723740 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-26d4e586-b366-4eeb-bcaf-b79c82a13a13 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:09.997811 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-26d4e586-b366-4eeb-bcaf-b79c82a13a13 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:10.008726 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-26d4e586-b366-4eeb-bcaf-b79c82a13a13 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded" status: 200 len: 1503 microversion: 2.1 time: 0.338556 Jul 18 02:12:10.010068 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 529/1121] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:09 2022] GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded => generated 1503 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:10.012132 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:SAVEPOINT=2,nova_api:RELEASE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:10.038501 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fd54e237-4b15-4ff6-ad1c-c30270a7c71a tempest-FlavorMetadataValidation-84617980 tempest-FlavorMetadataValidation-84617980-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors/1075512911/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.348606 Jul 18 02:12:10.040499 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-25779d51-7f9b-4761-9ead-aff927b922d3 tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] Action: 'create', calling method: .version_select at 0x7ff4a8b31e50>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1918994903", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:10.044476 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-25779d51-7f9b-4761-9ead-aff927b922d3 tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] HTTP exception thrown: Security group id should be uuid Jul 18 02:12:10.048506 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-25779d51-7f9b-4761-9ead-aff927b922d3 tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] Request method failure captured: Jul 18 02:12:10.048506 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 18 02:12:10.048506 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:12:10.048506 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:12:10.048506 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:12:10.048506 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 131 Jul 18 02:12:10.048506 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:12:10.048506 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:12:10.048506 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:12:10.048506 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:10.048506 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MFvrwBa72eDoE-iV_AlXyD7DqJHia6Wl6kiIgNMmVqzhPQuDs0bhXtn_bKwSC7iCEZQA72xCkQl0U0A69IyWGybK9aTrkvgHQ0t6dupI1rUrh0W8zqEyp6PMZePn4_g97dngzKpo07MciZsZ3y_ChaSuRgcQ2OuO8RhRYXmBp5ZwrY Jul 18 02:12:10.048506 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:12:10.048506 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:12:10.048506 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:12:10.048506 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:12:10.048506 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:12:10.048506 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:12:10.048506 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: e8f1c5feb498408ab13b20a4b7675dc9 Jul 18 02:12:10.048506 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-304173729 Jul 18 02:12:10.048506 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:12:10.048506 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:12:10.050196 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e8f1c5feb498408ab13b20a4b7675dc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e8f1c5feb498408ab13b20a4b7675dc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e8f1c5feb498408ab13b20a4b7675dc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e8f1c5feb498408ab13b20a4b7675dc9"}]}] Jul 18 02:12:10.050196 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-304173729 Jul 18 02:12:10.050196 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: e8f1c5feb498408ab13b20a4b7675dc9 Jul 18 02:12:10.050196 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-304173729 Jul 18 02:12:10.050196 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-304173729-project Jul 18 02:12:10.050196 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:12:10.050196 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:12:10.050196 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: fcd4c56ad8c64672b329f1c9eeb26373 Jul 18 02:12:10.050196 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-304173729-project Jul 18 02:12:10.050196 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 02:12:10.050196 n-d-465891-3 devstack@n-api.service[119543]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1918994903", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 18 02:12:10.050196 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:12:10.050196 n-d-465891-3 devstack@n-api.service[119543]: exception: Security group id should be uuid Jul 18 02:12:10.051110 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1918994903', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 18 02:12:10.051110 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:10.051110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:10.051110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Jul 18 02:12:10.051110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Jul 18 02:12:10.051110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Jul 18 02:12:10.051110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 18 02:12:10.051110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Jul 18 02:12:10.051110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:12:10.051110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:10.051110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:12:10.051110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:10.051110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:10.051110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:10.051110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:10.051110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:10.051110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:12:10.051110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:12:10.051110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:10.051110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:10.052575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 18 02:12:10.052575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 18 02:12:10.052575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Jul 18 02:12:10.052575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:12:10.052575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:10.052575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:12:10.052575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:10.052575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:10.052575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:10.052575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:12:10.052575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:12:10.052575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Jul 18 02:12:10.052575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:12:10.055170 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-25779d51-7f9b-4761-9ead-aff927b922d3 tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] Returning 400 to user: Security group id should be uuid {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:10.063783 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 593/1122] 10.222.0.57 () {62 vars in 1264 bytes} [Mon Jul 18 02:12:09 2022] POST /compute/v2.1/flavors/1075512911/os-extra_specs => generated 62 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:10.069197 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-25779d51-7f9b-4761-9ead-aff927b922d3 tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] 10.222.0.57 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.053527 Jul 18 02:12:10.070518 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 530/1123] 10.222.0.57 () {60 vars in 1194 bytes} [Mon Jul 18 02:12:10 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 18 02:12:10.083371 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-683bb531-e007-48c7-89da-850f71c3f6fa tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] Action: 'create', calling method: .version_select at 0x7ff4a8b48ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1330805792", "description": "tempest-description-2078384340"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:10.087332 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-533b6be7-3162-4785-ad48-03c869aade4c tempest-FlavorMetadataValidation-84617980 tempest-FlavorMetadataValidation-84617980-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:10.089501 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:10.089501 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:12:10.142086 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-533b6be7-3162-4785-ad48-03c869aade4c tempest-FlavorMetadataValidation-84617980 tempest-FlavorMetadataValidation-84617980-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/1075512911" status: 202 len: 0 microversion: 2.86 time: 0.073999 Jul 18 02:12:10.150715 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 594/1124] 10.222.0.57 () {60 vars in 1201 bytes} [Mon Jul 18 02:12:10 2022] DELETE /compute/v2.1/flavors/1075512911 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:12:10.163966 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d43ad01c-22e9-433a-b52e-ab7a3099b0f3 tempest-FlavorMetadataValidation-84617980 tempest-FlavorMetadataValidation-84617980-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:10.217311 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d43ad01c-22e9-433a-b52e-ab7a3099b0f3 tempest-FlavorMetadataValidation-84617980 tempest-FlavorMetadataValidation-84617980-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.063747 Jul 18 02:12:10.220329 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 595/1125] 10.222.0.57 () {60 vars in 1186 bytes} [Mon Jul 18 02:12:10 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:12:10.288071 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-43850fbe-f210-401d-ae76-ec0dab9c02cd tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:10.290201 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-43850fbe-f210-401d-ae76-ec0dab9c02cd tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 1df099cb-c253-4dd4-96a0-0652047390d8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:10.320711 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-43850fbe-f210-401d-ae76-ec0dab9c02cd tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:10.323892 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-43850fbe-f210-401d-ae76-ec0dab9c02cd tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:10.327267 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-43850fbe-f210-401d-ae76-ec0dab9c02cd tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:10.331869 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-43850fbe-f210-401d-ae76-ec0dab9c02cd tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:10.652391 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-683bb531-e007-48c7-89da-850f71c3f6fa tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.575527 Jul 18 02:12:10.653457 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 531/1126] 10.222.0.57 () {60 vars in 1179 bytes} [Mon Jul 18 02:12:10 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:12:10.680966 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b8d0c661-4d67-4e30-bc57-5cea292f9b9d tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] Action: 'create', calling method: .version_select at 0x7ff4a8aecdc0>, body: {"security_group_rule": {"parent_group_id": "715bfe11-fc28-449b-b456-c2975c25daf6", "ip_protocol": "tempest-999-559839072", "from_port": 22, "to_port": 22}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:10.929672 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-b8d0c661-4d67-4e30-bc57-5cea292f9b9d tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] HTTP exception thrown: Invalid IP protocol tempest-999-559839072. Jul 18 02:12:10.933005 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b8d0c661-4d67-4e30-bc57-5cea292f9b9d tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] Request method failure captured: Jul 18 02:12:10.933005 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 18 02:12:10.933005 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:12:10.933005 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:12:10.933005 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:12:10.933005 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 156 Jul 18 02:12:10.933005 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:12:10.933005 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:12:10.933005 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:12:10.933005 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:10.933005 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MFvrwBa72eDoE-iV_AlXyD7DqJHia6Wl6kiIgNMmVqzhPQuDs0bhXtn_bKwSC7iCEZQA72xCkQl0U0A69IyWGybK9aTrkvgHQ0t6dupI1rUrh0W8zqEyp6PMZePn4_g97dngzKpo07MciZsZ3y_ChaSuRgcQ2OuO8RhRYXmBp5ZwrY Jul 18 02:12:10.933005 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:12:10.933005 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:12:10.933005 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:12:10.933005 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:12:10.933005 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:12:10.933005 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:12:10.933005 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: e8f1c5feb498408ab13b20a4b7675dc9 Jul 18 02:12:10.933005 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-304173729 Jul 18 02:12:10.933005 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:12:10.933005 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:12:10.936244 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e8f1c5feb498408ab13b20a4b7675dc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e8f1c5feb498408ab13b20a4b7675dc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e8f1c5feb498408ab13b20a4b7675dc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e8f1c5feb498408ab13b20a4b7675dc9"}]}] Jul 18 02:12:10.936244 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-304173729 Jul 18 02:12:10.936244 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: e8f1c5feb498408ab13b20a4b7675dc9 Jul 18 02:12:10.936244 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-304173729 Jul 18 02:12:10.936244 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-304173729-project Jul 18 02:12:10.936244 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:12:10.936244 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:12:10.936244 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: fcd4c56ad8c64672b329f1c9eeb26373 Jul 18 02:12:10.936244 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-304173729-project Jul 18 02:12:10.936244 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 02:12:10.936244 n-d-465891-3 devstack@n-api.service[119543]: {"security_group_rule": {"parent_group_id": "715bfe11-fc28-449b-b456-c2975c25daf6", "ip_protocol": "tempest-999-559839072", "from_port": 22, "to_port": 22}} Jul 18 02:12:10.936244 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:12:10.936244 n-d-465891-3 devstack@n-api.service[119543]: exception: Invalid IP protocol tempest-999-559839072. Jul 18 02:12:10.938288 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'body': {'security_group_rule': {'parent_group_id': '715bfe11-fc28-449b-b456-c2975c25daf6', 'ip_protocol': 'tempest-999-559839072', 'from_port': 22, 'to_port': 22}}} Jul 18 02:12:10.938288 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:10.938288 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:10.938288 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 18 02:12:10.938288 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 18 02:12:10.938288 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 18 02:12:10.938288 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 18 02:12:10.938288 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 18 02:12:10.938288 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 18 02:12:10.938288 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Jul 18 02:12:10.938288 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Jul 18 02:12:10.938288 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-559839072. Jul 18 02:12:10.938288 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:12:10.938288 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:10.938288 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:12:10.938288 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:10.938288 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:10.938288 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:10.938288 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:10.940845 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:10.940845 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:12:10.940845 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:12:10.940845 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:10.940845 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:10.940845 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 18 02:12:10.940845 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 18 02:12:10.940845 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-559839072. Jul 18 02:12:10.940845 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:12:10.940845 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:10.940845 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:12:10.940845 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:10.940845 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:10.940845 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:10.940845 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:12:10.940845 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:12:10.940845 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-559839072. Jul 18 02:12:10.940845 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:12:10.947344 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b8d0c661-4d67-4e30-bc57-5cea292f9b9d tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] Returning 400 to user: Invalid IP protocol tempest-999-559839072. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:10.947344 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b8d0c661-4d67-4e30-bc57-5cea292f9b9d tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] 10.222.0.57 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.270415 Jul 18 02:12:10.950715 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 532/1127] 10.222.0.57 () {60 vars in 1194 bytes} [Mon Jul 18 02:12:10 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 284 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 18 02:12:10.965612 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-43850fbe-f210-401d-ae76-ec0dab9c02cd tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:10.972267 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b5364ee9-5cf0-4d80-abbd-b6de68181b83 tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] Action: 'create', calling method: .version_select at 0x7ff4a8ccda60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-758806787", "description": "tempest-description-1997329516"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:10.979843 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-43850fbe-f210-401d-ae76-ec0dab9c02cd tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/1df099cb-c253-4dd4-96a0-0652047390d8" status: 200 len: 1308 microversion: 2.1 time: 0.704928 Jul 18 02:12:10.980852 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 596/1128] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:10 2022] GET /compute/v2.1/servers/1df099cb-c253-4dd4-96a0-0652047390d8 => generated 1308 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:11.028707 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f9a08d44-fee4-492f-a3bd-4ab93e4d0f8f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:11.029613 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f9a08d44-fee4-492f-a3bd-4ab93e4d0f8f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: ae4f2139-250b-4a65-8436-702487cc1ded] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:11.057654 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f9a08d44-fee4-492f-a3bd-4ab93e4d0f8f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:11.060151 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f9a08d44-fee4-492f-a3bd-4ab93e4d0f8f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:11.076748 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f9a08d44-fee4-492f-a3bd-4ab93e4d0f8f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:11.081370 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f9a08d44-fee4-492f-a3bd-4ab93e4d0f8f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:11.757588 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f9a08d44-fee4-492f-a3bd-4ab93e4d0f8f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:11.783407 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f9a08d44-fee4-492f-a3bd-4ab93e4d0f8f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded" status: 200 len: 1503 microversion: 2.1 time: 0.759431 Jul 18 02:12:11.795396 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 597/1129] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:11 2022] GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded => generated 1503 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:12:11.806447 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b6d0eb82-17b4-4189-9ad8-79a7ecae3162 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a89d7af0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:11.807304 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b5364ee9-5cf0-4d80-abbd-b6de68181b83 tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.850117 Jul 18 02:12:11.811423 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 533/1130] 10.222.0.57 () {60 vars in 1179 bytes} [Mon Jul 18 02:12:10 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:11.831028 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5ec61aff-56ca-494c-aead-adaad84157ab tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] Action: 'create', calling method: .version_select at 0x7ff4a9135550>, body: {"security_group_rule": {"parent_group_id": "7f2b72c9-9a33-4145-b174-da960554d468", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:11.887303 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b6d0eb82-17b4-4189-9ad8-79a7ecae3162 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/a4ab5dcd-67de-4bfa-8ea9-3b238dbac0ff" status: 200 len: 662 microversion: 2.1 time: 0.089935 Jul 18 02:12:11.898176 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 598/1131] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:12:11 2022] GET /compute/v2.1/images/a4ab5dcd-67de-4bfa-8ea9-3b238dbac0ff => generated 662 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:11.913847 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-35282337-d4e4-402e-a717-1b10bde0806d tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a8a4ee50>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:11.968755 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-5ec61aff-56ca-494c-aead-adaad84157ab tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Jul 18 02:12:11.971292 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5ec61aff-56ca-494c-aead-adaad84157ab tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] Request method failure captured: Jul 18 02:12:11.971292 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 18 02:12:11.971292 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:12:11.971292 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:12:11.971292 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:12:11.971292 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 138 Jul 18 02:12:11.971292 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:12:11.971292 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:12:11.971292 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:12:11.971292 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:11.971292 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MFvrwBa72eDoE-iV_AlXyD7DqJHia6Wl6kiIgNMmVqzhPQuDs0bhXtn_bKwSC7iCEZQA72xCkQl0U0A69IyWGybK9aTrkvgHQ0t6dupI1rUrh0W8zqEyp6PMZePn4_g97dngzKpo07MciZsZ3y_ChaSuRgcQ2OuO8RhRYXmBp5ZwrY Jul 18 02:12:11.971292 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:12:11.971292 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:12:11.971292 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:12:11.971292 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:12:11.971292 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:12:11.971292 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:12:11.971292 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: e8f1c5feb498408ab13b20a4b7675dc9 Jul 18 02:12:11.971292 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-304173729 Jul 18 02:12:11.971292 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:12:11.971292 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:12:11.972697 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e8f1c5feb498408ab13b20a4b7675dc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e8f1c5feb498408ab13b20a4b7675dc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e8f1c5feb498408ab13b20a4b7675dc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e8f1c5feb498408ab13b20a4b7675dc9"}]}] Jul 18 02:12:11.972697 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-304173729 Jul 18 02:12:11.972697 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: e8f1c5feb498408ab13b20a4b7675dc9 Jul 18 02:12:11.972697 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-304173729 Jul 18 02:12:11.972697 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-304173729-project Jul 18 02:12:11.972697 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:12:11.972697 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:12:11.972697 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: fcd4c56ad8c64672b329f1c9eeb26373 Jul 18 02:12:11.972697 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-304173729-project Jul 18 02:12:11.972697 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 02:12:11.972697 n-d-465891-3 devstack@n-api.service[119543]: {"security_group_rule": {"parent_group_id": "7f2b72c9-9a33-4145-b174-da960554d468", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Jul 18 02:12:11.972697 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:12:11.973517 n-d-465891-3 devstack@n-api.service[119543]: exception: Invalid port range 22:21. Former value cannot be greater than the later Jul 18 02:12:11.973517 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'body': {'security_group_rule': {'parent_group_id': '7f2b72c9-9a33-4145-b174-da960554d468', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Jul 18 02:12:11.973517 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:11.973517 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:11.973517 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 18 02:12:11.973517 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 18 02:12:11.973517 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 18 02:12:11.973517 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 18 02:12:11.973517 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 18 02:12:11.973517 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 18 02:12:11.973517 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 18 02:12:11.973517 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 18 02:12:11.973517 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Jul 18 02:12:11.973517 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:12:11.973517 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:11.973517 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:12:11.973517 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:11.973517 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:11.973517 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:11.974982 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:11.974982 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:11.974982 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:12:11.974982 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:12:11.974982 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:11.974982 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:11.974982 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 18 02:12:11.974982 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 18 02:12:11.974982 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Jul 18 02:12:11.974982 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:12:11.974982 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:11.974982 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:12:11.974982 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:11.974982 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:11.974982 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:11.974982 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:12:11.974982 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:12:11.974982 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Jul 18 02:12:11.974982 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:12:11.977347 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5ec61aff-56ca-494c-aead-adaad84157ab tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:11.978490 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5ec61aff-56ca-494c-aead-adaad84157ab tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] 10.222.0.57 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.154738 Jul 18 02:12:11.988057 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 534/1132] 10.222.0.57 () {60 vars in 1194 bytes} [Mon Jul 18 02:12:11 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 169 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 18 02:12:11.998567 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-98fea0d8-faa7-43e7-8ca1-6d7a29f4a80b tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] Action: 'create', calling method: .version_select at 0x7ff4a8aa0820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1176373028", "description": "tempest-description-671109196"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:12.012906 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-35282337-d4e4-402e-a717-1b10bde0806d tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/a4ab5dcd-67de-4bfa-8ea9-3b238dbac0ff" status: 200 len: 662 microversion: 2.1 time: 0.112675 Jul 18 02:12:12.026780 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 599/1133] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:12:11 2022] GET /compute/v2.1/images/a4ab5dcd-67de-4bfa-8ea9-3b238dbac0ff => generated 662 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:12.048675 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bb292f6e-f234-490c-8c2d-432f4dace888 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:12.049323 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bb292f6e-f234-490c-8c2d-432f4dace888 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 1df099cb-c253-4dd4-96a0-0652047390d8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:12.069135 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb292f6e-f234-490c-8c2d-432f4dace888 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:12.069836 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb292f6e-f234-490c-8c2d-432f4dace888 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:12.070905 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb292f6e-f234-490c-8c2d-432f4dace888 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:12.071514 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb292f6e-f234-490c-8c2d-432f4dace888 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:12.358954 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bb292f6e-f234-490c-8c2d-432f4dace888 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:12.390673 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bb292f6e-f234-490c-8c2d-432f4dace888 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/1df099cb-c253-4dd4-96a0-0652047390d8" status: 200 len: 1308 microversion: 2.1 time: 0.362463 Jul 18 02:12:12.406474 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 600/1134] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:12 2022] GET /compute/v2.1/servers/1df099cb-c253-4dd4-96a0-0652047390d8 => generated 1308 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:12.406474 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c0d70bb0-492f-4eb4-9154-7210c7419b7a tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1397282741", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:12.454732 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-98fea0d8-faa7-43e7-8ca1-6d7a29f4a80b tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.461226 Jul 18 02:12:12.462361 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 535/1135] 10.222.0.57 () {60 vars in 1179 bytes} [Mon Jul 18 02:12:11 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:12.467475 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-302f70ac-dbda-42d3-93ae-db35d9ff4293 req-6401b528-f614-4b65-ae4c-49375509f41d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1df099cb-c253-4dd4-96a0-0652047390d8", "name": "network-vif-plugged", "status": "completed", "tag": "faa469e5-28b6-416c-8e4b-d5b6ab117a54"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:12.491996 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-302f70ac-dbda-42d3-93ae-db35d9ff4293 req-6401b528-f614-4b65-ae4c-49375509f41d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:12.492438 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-302f70ac-dbda-42d3-93ae-db35d9ff4293 req-6401b528-f614-4b65-ae4c-49375509f41d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:12.534046 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-302f70ac-dbda-42d3-93ae-db35d9ff4293 req-6401b528-f614-4b65-ae4c-49375509f41d service nova] Creating event network-vif-plugged:faa469e5-28b6-416c-8e4b-d5b6ab117a54 for instance 1df099cb-c253-4dd4-96a0-0652047390d8 on n-h1-465891-3 Jul 18 02:12:12.543937 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-302f70ac-dbda-42d3-93ae-db35d9ff4293 req-6401b528-f614-4b65-ae4c-49375509f41d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080205 Jul 18 02:12:12.556493 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 536/1136] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:12.571145 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-87c2509a-2556-492f-8ad1-fed60a3a9b1c tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] Action: 'create', calling method: .version_select at 0x7ff4a8b484c0>, body: {"security_group_rule": {"parent_group_id": "bb48b5ed-37ac-47e9-b1bc-83b15be38a8e", "ip_protocol": "tcp", "from_port": 22, "to_port": 886424036}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:12.571409 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-c0d70bb0-492f-4eb4-9154-7210c7419b7a tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] validate_networks() for None {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:12:12.961977 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-87c2509a-2556-492f-8ad1-fed60a3a9b1c tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] HTTP exception thrown: Invalid port range 22:886424036. Valid TCP ports should be between 1-65535 Jul 18 02:12:12.964540 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-87c2509a-2556-492f-8ad1-fed60a3a9b1c tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] Request method failure captured: Jul 18 02:12:12.964540 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 18 02:12:12.964540 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:12:12.964540 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:12:12.964540 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:12:12.964540 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 145 Jul 18 02:12:12.964540 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:12:12.964540 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:12:12.964540 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:12:12.964540 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:12.964540 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MFvrwBa72eDoE-iV_AlXyD7DqJHia6Wl6kiIgNMmVqzhPQuDs0bhXtn_bKwSC7iCEZQA72xCkQl0U0A69IyWGybK9aTrkvgHQ0t6dupI1rUrh0W8zqEyp6PMZePn4_g97dngzKpo07MciZsZ3y_ChaSuRgcQ2OuO8RhRYXmBp5ZwrY Jul 18 02:12:12.964540 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:12:12.964540 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:12:12.964540 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:12:12.964540 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:12:12.964540 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:12:12.964540 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:12:12.964540 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: e8f1c5feb498408ab13b20a4b7675dc9 Jul 18 02:12:12.964540 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-304173729 Jul 18 02:12:12.964540 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:12:12.964540 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:12:12.966236 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e8f1c5feb498408ab13b20a4b7675dc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e8f1c5feb498408ab13b20a4b7675dc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e8f1c5feb498408ab13b20a4b7675dc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e8f1c5feb498408ab13b20a4b7675dc9"}]}] Jul 18 02:12:12.966236 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-304173729 Jul 18 02:12:12.966236 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: e8f1c5feb498408ab13b20a4b7675dc9 Jul 18 02:12:12.966236 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-304173729 Jul 18 02:12:12.966236 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-304173729-project Jul 18 02:12:12.966236 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:12:12.966236 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:12:12.966236 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: fcd4c56ad8c64672b329f1c9eeb26373 Jul 18 02:12:12.966236 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-304173729-project Jul 18 02:12:12.966236 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 02:12:12.966236 n-d-465891-3 devstack@n-api.service[119543]: {"security_group_rule": {"parent_group_id": "bb48b5ed-37ac-47e9-b1bc-83b15be38a8e", "ip_protocol": "tcp", "from_port": 22, "to_port": 886424036}} Jul 18 02:12:12.966236 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:12:12.967086 n-d-465891-3 devstack@n-api.service[119543]: exception: Invalid port range 22:886424036. Valid TCP ports should be between 1-65535 Jul 18 02:12:12.967086 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'bb48b5ed-37ac-47e9-b1bc-83b15be38a8e', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 886424036}}} Jul 18 02:12:12.967086 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:12.967086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:12.967086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 18 02:12:12.967086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 18 02:12:12.967086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 18 02:12:12.967086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 18 02:12:12.967086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 18 02:12:12.967086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 18 02:12:12.967086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Jul 18 02:12:12.967086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 18 02:12:12.967086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:886424036. Valid TCP ports should be between 1-65535 Jul 18 02:12:12.967086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:12:12.967086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:12.967086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:12:12.967086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:12.967086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:12.967086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:12.968380 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:12.968380 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:12.968380 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:12:12.968380 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:12:12.968380 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:12.968380 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:12.968380 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 18 02:12:12.968380 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 18 02:12:12.968380 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:886424036. Valid TCP ports should be between 1-65535 Jul 18 02:12:12.968380 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:12:12.968380 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:12.968380 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:12:12.968380 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:12.968380 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:12.968380 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:12.968380 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:12:12.968380 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:12:12.968380 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:886424036. Valid TCP ports should be between 1-65535 Jul 18 02:12:12.968380 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:12:12.971174 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-87c2509a-2556-492f-8ad1-fed60a3a9b1c tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] Returning 400 to user: Invalid port range 22:886424036. Valid TCP ports should be between 1-65535 {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:12.972054 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-87c2509a-2556-492f-8ad1-fed60a3a9b1c tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] 10.222.0.57 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.414160 Jul 18 02:12:12.973603 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 537/1137] 10.222.0.57 () {60 vars in 1194 bytes} [Mon Jul 18 02:12:12 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 416 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:12:12.983550 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-f0013c15-66a2-4222-90f2-7351f917ef01 req-3b7e1901-008e-4955-90d5-c7166b4ce85a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae4f2139-250b-4a65-8436-702487cc1ded", "name": "network-vif-unplugged", "status": "completed", "tag": "babbb140-0981-4a5e-b5a3-7f0cc8649998"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:13.003569 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-f0013c15-66a2-4222-90f2-7351f917ef01 req-3b7e1901-008e-4955-90d5-c7166b4ce85a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:13.004982 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-f0013c15-66a2-4222-90f2-7351f917ef01 req-3b7e1901-008e-4955-90d5-c7166b4ce85a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:13.033215 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-f0013c15-66a2-4222-90f2-7351f917ef01 req-3b7e1901-008e-4955-90d5-c7166b4ce85a service nova] Creating event network-vif-unplugged:babbb140-0981-4a5e-b5a3-7f0cc8649998 for instance ae4f2139-250b-4a65-8436-702487cc1ded on n-h1-465891-3 Jul 18 02:12:13.043985 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-f0013c15-66a2-4222-90f2-7351f917ef01 req-3b7e1901-008e-4955-90d5-c7166b4ce85a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065965 Jul 18 02:12:13.045595 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 538/1138] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:13.053605 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-01b305a7-4004-4be0-83a2-1403cafd8617 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:13.055501 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-01b305a7-4004-4be0-83a2-1403cafd8617 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: ae4f2139-250b-4a65-8436-702487cc1ded] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:13.084537 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-01b305a7-4004-4be0-83a2-1403cafd8617 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:13.086108 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-01b305a7-4004-4be0-83a2-1403cafd8617 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:13.089679 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-01b305a7-4004-4be0-83a2-1403cafd8617 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:13.089679 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-01b305a7-4004-4be0-83a2-1403cafd8617 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:13.320324 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-c0d70bb0-492f-4eb4-9154-7210c7419b7a tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:12:13.321138 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-c0d70bb0-492f-4eb4-9154-7210c7419b7a tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:12:13.321299 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-c0d70bb0-492f-4eb4-9154-7210c7419b7a tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:12:13.321651 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-c0d70bb0-492f-4eb4-9154-7210c7419b7a tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:12:13.322174 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-c0d70bb0-492f-4eb4-9154-7210c7419b7a tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:12:13.355138 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c0d70bb0-492f-4eb4-9154-7210c7419b7a tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:13.355425 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c0d70bb0-492f-4eb4-9154-7210c7419b7a tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:13.372791 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c0d70bb0-492f-4eb4-9154-7210c7419b7a tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:13.379336 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c0d70bb0-492f-4eb4-9154-7210c7419b7a tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:13.483384 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-c0d70bb0-492f-4eb4-9154-7210c7419b7a tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Getting quotas for project db5d1b19c84a4a9fa4595a5c84f4555c. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:12:13.510727 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-c0d70bb0-492f-4eb4-9154-7210c7419b7a tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Getting quotas for user 91a9dd4e239c4d73bdde1ced9cb90b46 and project db5d1b19c84a4a9fa4595a5c84f4555c. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:12:13.563734 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c0d70bb0-492f-4eb4-9154-7210c7419b7a tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:12:13.584071 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c0d70bb0-492f-4eb4-9154-7210c7419b7a tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] [instance: 697075ff-db42-4729-8faf-2c2935d72630] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:12:13.646939 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-01b305a7-4004-4be0-83a2-1403cafd8617 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:13.682340 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-01b305a7-4004-4be0-83a2-1403cafd8617 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded" status: 200 len: 1503 microversion: 2.1 time: 0.612910 Jul 18 02:12:13.686581 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 539/1139] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:13 2022] GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded => generated 1503 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:13.708730 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1f721ded-6d08-4ebe-8dff-02f6cd626bbd tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] Action: 'create', calling method: .version_select at 0x7ff4a8aa0670>, body: {"security_group_rule": {"parent_group_id": "40534208-3a57-4346-8cf7-043307f4adc4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:13.733030 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c0d70bb0-492f-4eb4-9154-7210c7419b7a tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.338009 Jul 18 02:12:13.735968 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 601/1140] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:12:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1342 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:12:13.742337 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e667b3fd-e57a-4474-a460-236f015dda32 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:13.743468 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e667b3fd-e57a-4474-a460-236f015dda32 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 1df099cb-c253-4dd4-96a0-0652047390d8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:13.767484 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e667b3fd-e57a-4474-a460-236f015dda32 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:13.767484 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e667b3fd-e57a-4474-a460-236f015dda32 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:13.767484 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e667b3fd-e57a-4474-a460-236f015dda32 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:13.767484 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e667b3fd-e57a-4474-a460-236f015dda32 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:13.789917 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:13.812921 n-d-465891-3 devstack@n-api.service[119543]: DEBUG neutronclient.v2_0.client [None req-1f721ded-6d08-4ebe-8dff-02f6cd626bbd tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 40534208-3a57-4346-8cf7-043307f4adc4 does not exist", "detail": ""}} {{(pid=119543) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:12:13.814304 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.security_group_api [None req-1f721ded-6d08-4ebe-8dff-02f6cd626bbd tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] Neutron security group 40534208-3a57-4346-8cf7-043307f4adc4 not found {{(pid=119543) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 02:12:13.815162 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-1f721ded-6d08-4ebe-8dff-02f6cd626bbd tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] HTTP exception thrown: Security group 40534208-3a57-4346-8cf7-043307f4adc4 does not exist Jul 18 02:12:13.815162 n-d-465891-3 devstack@n-api.service[119543]: Neutron server returns request_ids: ['req-1fc654ea-e475-4e2b-b17e-a16e816f9cb0'] Jul 18 02:12:13.818415 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1f721ded-6d08-4ebe-8dff-02f6cd626bbd tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] Request method failure captured: Jul 18 02:12:13.818415 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 18 02:12:13.818415 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:12:13.818415 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:12:13.818415 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:12:13.818415 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 138 Jul 18 02:12:13.818415 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:12:13.818415 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:12:13.818415 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:12:13.818415 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:13.818415 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MFvrwBa72eDoE-iV_AlXyD7DqJHia6Wl6kiIgNMmVqzhPQuDs0bhXtn_bKwSC7iCEZQA72xCkQl0U0A69IyWGybK9aTrkvgHQ0t6dupI1rUrh0W8zqEyp6PMZePn4_g97dngzKpo07MciZsZ3y_ChaSuRgcQ2OuO8RhRYXmBp5ZwrY Jul 18 02:12:13.818415 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:12:13.818415 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:12:13.818415 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:12:13.818415 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:12:13.818415 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:12:13.818415 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:12:13.818415 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: e8f1c5feb498408ab13b20a4b7675dc9 Jul 18 02:12:13.818415 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-304173729 Jul 18 02:12:13.818415 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:12:13.818415 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:12:13.819949 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e8f1c5feb498408ab13b20a4b7675dc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e8f1c5feb498408ab13b20a4b7675dc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e8f1c5feb498408ab13b20a4b7675dc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e8f1c5feb498408ab13b20a4b7675dc9"}]}] Jul 18 02:12:13.819949 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-304173729 Jul 18 02:12:13.819949 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: e8f1c5feb498408ab13b20a4b7675dc9 Jul 18 02:12:13.819949 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-304173729 Jul 18 02:12:13.819949 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-304173729-project Jul 18 02:12:13.819949 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:12:13.819949 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:12:13.819949 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: fcd4c56ad8c64672b329f1c9eeb26373 Jul 18 02:12:13.819949 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-304173729-project Jul 18 02:12:13.819949 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 02:12:13.819949 n-d-465891-3 devstack@n-api.service[119543]: {"security_group_rule": {"parent_group_id": "40534208-3a57-4346-8cf7-043307f4adc4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 18 02:12:13.819949 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:12:13.820792 n-d-465891-3 devstack@n-api.service[119543]: exception: Security group 40534208-3a57-4346-8cf7-043307f4adc4 does not exist Jul 18 02:12:13.820792 n-d-465891-3 devstack@n-api.service[119543]: Neutron server returns request_ids: ['req-1fc654ea-e475-4e2b-b17e-a16e816f9cb0'] Jul 18 02:12:13.820792 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'body': {'security_group_rule': {'parent_group_id': '40534208-3a57-4346-8cf7-043307f4adc4', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 18 02:12:13.820792 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:13.820792 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:13.820792 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 02:12:13.820792 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 02:12:13.820792 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:12:13.820792 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:12:13.820792 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 02:12:13.820792 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 02:12:13.820792 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:12:13.820792 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:12:13.820792 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 02:12:13.820792 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 02:12:13.820792 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:12:13.820792 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:12:13.820792 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:12:13.820792 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:12:13.822931 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:12:13.822931 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:12:13.822931 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:12:13.822931 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:12:13.822931 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:12:13.822931 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:12:13.822931 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:12:13.822931 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:12:13.822931 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:12:13.822931 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:12:13.822931 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 40534208-3a57-4346-8cf7-043307f4adc4 does not exist Jul 18 02:12:13.822931 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1fc654ea-e475-4e2b-b17e-a16e816f9cb0'] Jul 18 02:12:13.822931 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:12:13.822931 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:13.822931 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:12:13.822931 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:13.822931 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Jul 18 02:12:13.822931 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Jul 18 02:12:13.822931 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 02:12:13.826817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 02:12:13.826817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 40534208-3a57-4346-8cf7-043307f4adc4 does not exist Jul 18 02:12:13.826817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1fc654ea-e475-4e2b-b17e-a16e816f9cb0'] Jul 18 02:12:13.826817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:12:13.826817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:13.826817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:12:13.826817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:13.826817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:13.826817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:13.826817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:13.826817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:13.826817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:12:13.826817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:12:13.826817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:13.826817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:13.826817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Jul 18 02:12:13.826817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 02:12:13.826817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 40534208-3a57-4346-8cf7-043307f4adc4 does not exist Jul 18 02:12:13.826817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1fc654ea-e475-4e2b-b17e-a16e816f9cb0'] Jul 18 02:12:13.826817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:12:13.829645 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:13.829645 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:12:13.829645 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:13.829645 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:13.829645 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:13.829645 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:12:13.829645 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:12:13.829645 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 40534208-3a57-4346-8cf7-043307f4adc4 does not exist Jul 18 02:12:13.829645 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1fc654ea-e475-4e2b-b17e-a16e816f9cb0'] Jul 18 02:12:13.829645 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:12:13.835240 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1f721ded-6d08-4ebe-8dff-02f6cd626bbd tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] Returning 404 to user: Security group 40534208-3a57-4346-8cf7-043307f4adc4 does not exist Jul 18 02:12:13.835240 n-d-465891-3 devstack@n-api.service[119543]: Neutron server returns request_ids: ['req-1fc654ea-e475-4e2b-b17e-a16e816f9cb0'] {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:13.836409 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1f721ded-6d08-4ebe-8dff-02f6cd626bbd tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] 10.222.0.57 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.146422 Jul 18 02:12:13.837248 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 540/1141] 10.222.0.57 () {60 vars in 1194 bytes} [Mon Jul 18 02:12:13 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:12:13.849594 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cc04082b-35ad-4856-a7be-f7fa55f238ba tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] Calling method '.version_select at 0x7ff4a8aecf70>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:14.136671 n-d-465891-3 devstack@n-api.service[119543]: DEBUG neutronclient.v2_0.client [None req-cc04082b-35ad-4856-a7be-f7fa55f238ba tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 7ddc74f3-5c32-4e6b-809d-aaa9f5dcd6c4 does not exist", "detail": ""}} {{(pid=119543) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:12:14.138555 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.security_group_api [None req-cc04082b-35ad-4856-a7be-f7fa55f238ba tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] Neutron security group rule 7ddc74f3-5c32-4e6b-809d-aaa9f5dcd6c4 not found {{(pid=119543) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Jul 18 02:12:14.139656 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-cc04082b-35ad-4856-a7be-f7fa55f238ba tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] HTTP exception thrown: Security group rule 7ddc74f3-5c32-4e6b-809d-aaa9f5dcd6c4 does not exist Jul 18 02:12:14.139656 n-d-465891-3 devstack@n-api.service[119543]: Neutron server returns request_ids: ['req-0fae4fa9-d59d-46f3-9b89-2b5b8dc27f9d'] Jul 18 02:12:14.144290 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cc04082b-35ad-4856-a7be-f7fa55f238ba tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] Request method failure captured: Jul 18 02:12:14.144290 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/os-security-group-rules/7ddc74f3-5c32-4e6b-809d-aaa9f5dcd6c4 HTTP/1.1 Jul 18 02:12:14.144290 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:12:14.144290 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:12:14.144290 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:12:14.144290 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:12:14.144290 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:12:14.144290 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:12:14.144290 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:12:14.144290 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:14.144290 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MFvrwBa72eDoE-iV_AlXyD7DqJHia6Wl6kiIgNMmVqzhPQuDs0bhXtn_bKwSC7iCEZQA72xCkQl0U0A69IyWGybK9aTrkvgHQ0t6dupI1rUrh0W8zqEyp6PMZePn4_g97dngzKpo07MciZsZ3y_ChaSuRgcQ2OuO8RhRYXmBp5ZwrY Jul 18 02:12:14.144290 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:12:14.144290 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:12:14.144290 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:12:14.144290 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:12:14.144290 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:12:14.144290 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:12:14.144290 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: e8f1c5feb498408ab13b20a4b7675dc9 Jul 18 02:12:14.144290 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-304173729 Jul 18 02:12:14.144290 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:12:14.144290 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:12:14.146806 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e8f1c5feb498408ab13b20a4b7675dc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e8f1c5feb498408ab13b20a4b7675dc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e8f1c5feb498408ab13b20a4b7675dc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e8f1c5feb498408ab13b20a4b7675dc9"}]}] Jul 18 02:12:14.146806 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-304173729 Jul 18 02:12:14.146806 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: e8f1c5feb498408ab13b20a4b7675dc9 Jul 18 02:12:14.146806 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-304173729 Jul 18 02:12:14.146806 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-304173729-project Jul 18 02:12:14.146806 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:12:14.146806 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:12:14.146806 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: fcd4c56ad8c64672b329f1c9eeb26373 Jul 18 02:12:14.146806 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-304173729-project Jul 18 02:12:14.146806 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:12:14.146806 n-d-465891-3 devstack@n-api.service[119543]: exception: Security group rule 7ddc74f3-5c32-4e6b-809d-aaa9f5dcd6c4 does not exist Jul 18 02:12:14.146806 n-d-465891-3 devstack@n-api.service[119543]: Neutron server returns request_ids: ['req-0fae4fa9-d59d-46f3-9b89-2b5b8dc27f9d'] Jul 18 02:12:14.147820 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '7ddc74f3-5c32-4e6b-809d-aaa9f5dcd6c4'} Jul 18 02:12:14.147820 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:14.147820 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:14.147820 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Jul 18 02:12:14.147820 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Jul 18 02:12:14.147820 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:12:14.147820 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:12:14.147820 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Jul 18 02:12:14.147820 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Jul 18 02:12:14.147820 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:12:14.147820 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:12:14.147820 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 02:12:14.147820 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 02:12:14.147820 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:12:14.147820 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:12:14.147820 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:12:14.147820 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:12:14.147820 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:12:14.147820 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:12:14.148992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:12:14.148992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:12:14.148992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:12:14.148992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:12:14.148992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:12:14.148992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:12:14.148992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:12:14.148992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:12:14.148992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 7ddc74f3-5c32-4e6b-809d-aaa9f5dcd6c4 does not exist Jul 18 02:12:14.148992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0fae4fa9-d59d-46f3-9b89-2b5b8dc27f9d'] Jul 18 02:12:14.148992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:12:14.148992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:14.148992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:12:14.148992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:14.148992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Jul 18 02:12:14.148992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Jul 18 02:12:14.148992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Jul 18 02:12:14.148992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 02:12:14.151188 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 7ddc74f3-5c32-4e6b-809d-aaa9f5dcd6c4 does not exist Jul 18 02:12:14.151188 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0fae4fa9-d59d-46f3-9b89-2b5b8dc27f9d'] Jul 18 02:12:14.151188 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:12:14.151188 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:14.151188 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:12:14.151188 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:14.151188 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:14.151188 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:14.151188 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:14.151188 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:14.151188 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:12:14.151188 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:12:14.151188 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:14.151188 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:14.151188 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Jul 18 02:12:14.151188 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 02:12:14.151188 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 7ddc74f3-5c32-4e6b-809d-aaa9f5dcd6c4 does not exist Jul 18 02:12:14.151188 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0fae4fa9-d59d-46f3-9b89-2b5b8dc27f9d'] Jul 18 02:12:14.151188 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:12:14.151188 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:14.153643 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:12:14.153643 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:14.153643 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:14.153643 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:14.153643 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:12:14.153643 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:12:14.153643 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 7ddc74f3-5c32-4e6b-809d-aaa9f5dcd6c4 does not exist Jul 18 02:12:14.153643 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0fae4fa9-d59d-46f3-9b89-2b5b8dc27f9d'] Jul 18 02:12:14.153643 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:12:14.157963 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cc04082b-35ad-4856-a7be-f7fa55f238ba tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] Returning 404 to user: Security group rule 7ddc74f3-5c32-4e6b-809d-aaa9f5dcd6c4 does not exist Jul 18 02:12:14.157963 n-d-465891-3 devstack@n-api.service[119543]: Neutron server returns request_ids: ['req-0fae4fa9-d59d-46f3-9b89-2b5b8dc27f9d'] {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:14.159488 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cc04082b-35ad-4856-a7be-f7fa55f238ba tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-group-rules/7ddc74f3-5c32-4e6b-809d-aaa9f5dcd6c4" status: 404 len: 199 microversion: 2.1 time: 0.315601 Jul 18 02:12:14.160318 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 541/1142] 10.222.0.57 () {58 vars in 1286 bytes} [Mon Jul 18 02:12:13 2022] DELETE /compute/v2.1/os-security-group-rules/7ddc74f3-5c32-4e6b-809d-aaa9f5dcd6c4 => generated 199 bytes in 317 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:12:14.185290 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4d66ae95-88b5-4e34-a4d4-255c6be1c1a0 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-2026939751", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:14.314797 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-4d66ae95-88b5-4e34-a4d4-255c6be1c1a0 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] validate_networks() for None {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:12:14.692987 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e667b3fd-e57a-4474-a460-236f015dda32 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:14.734598 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e667b3fd-e57a-4474-a460-236f015dda32 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/1df099cb-c253-4dd4-96a0-0652047390d8" status: 200 len: 1308 microversion: 2.1 time: 0.993243 Jul 18 02:12:14.754097 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 602/1143] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:13 2022] GET /compute/v2.1/servers/1df099cb-c253-4dd4-96a0-0652047390d8 => generated 1308 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:14.778921 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6f6e4c98-03c2-4de4-8b00-c4af734e399d tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] Calling method '.version_select at 0x7ff4a87e2b80>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:14.975291 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-4d66ae95-88b5-4e34-a4d4-255c6be1c1a0 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:12:14.976910 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-4d66ae95-88b5-4e34-a4d4-255c6be1c1a0 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:12:14.976910 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-4d66ae95-88b5-4e34-a4d4-255c6be1c1a0 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:12:14.977880 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-4d66ae95-88b5-4e34-a4d4-255c6be1c1a0 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:12:14.978835 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-4d66ae95-88b5-4e34-a4d4-255c6be1c1a0 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:12:14.981752 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:INSERT=5 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:15.000273 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4d66ae95-88b5-4e34-a4d4-255c6be1c1a0 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:15.001141 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4d66ae95-88b5-4e34-a4d4-255c6be1c1a0 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:15.002380 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4d66ae95-88b5-4e34-a4d4-255c6be1c1a0 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:15.003119 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4d66ae95-88b5-4e34-a4d4-255c6be1c1a0 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:15.041290 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-4d66ae95-88b5-4e34-a4d4-255c6be1c1a0 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Getting quotas for project db5d1b19c84a4a9fa4595a5c84f4555c. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:12:15.048968 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-4d66ae95-88b5-4e34-a4d4-255c6be1c1a0 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Getting quotas for user 91a9dd4e239c4d73bdde1ced9cb90b46 and project db5d1b19c84a4a9fa4595a5c84f4555c. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:12:15.068532 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4d66ae95-88b5-4e34-a4d4-255c6be1c1a0 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:12:15.071812 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4d66ae95-88b5-4e34-a4d4-255c6be1c1a0 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] [instance: 32e81b5d-a507-4d47-b76e-699091d0e5bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:12:15.186319 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4d66ae95-88b5-4e34-a4d4-255c6be1c1a0 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.024099 Jul 18 02:12:15.196351 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 542/1144] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:12:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:12:15.222284 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1069063c-dcfb-4a53-b475-e2df68e541cf tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:15.230311 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1069063c-dcfb-4a53-b475-e2df68e541cf tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: ae4f2139-250b-4a65-8436-702487cc1ded] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:15.256647 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1069063c-dcfb-4a53-b475-e2df68e541cf tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:15.264495 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1069063c-dcfb-4a53-b475-e2df68e541cf tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:15.268914 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1069063c-dcfb-4a53-b475-e2df68e541cf tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:15.274624 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1069063c-dcfb-4a53-b475-e2df68e541cf tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:15.553213 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6f6e4c98-03c2-4de4-8b00-c4af734e399d tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/bb48b5ed-37ac-47e9-b1bc-83b15be38a8e" status: 202 len: 0 microversion: 2.1 time: 0.809400 Jul 18 02:12:15.556818 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 603/1145] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 02:12:14 2022] DELETE /compute/v2.1/os-security-groups/bb48b5ed-37ac-47e9-b1bc-83b15be38a8e => generated 0 bytes in 812 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:12:15.570201 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-038d88e4-6c2e-403f-9021-7ed698734551 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:15.573314 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-038d88e4-6c2e-403f-9021-7ed698734551 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] [instance: 32e81b5d-a507-4d47-b76e-699091d0e5bd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:15.957875 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-038d88e4-6c2e-403f-9021-7ed698734551 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a9dd4e239c4d73bdde1ced9cb90b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5d1b19c84a4a9fa4595a5c84f4555c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:15.989158 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-038d88e4-6c2e-403f-9021-7ed698734551 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd" status: 200 len: 1218 microversion: 2.1 time: 0.433666 Jul 18 02:12:15.991536 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 604/1146] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:15 2022] GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd => generated 1218 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:15.999802 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5a96ee82-f5f2-4f06-a501-306c30edf579 tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] Calling method '.version_select at 0x7ff4a88b3700>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:16.809646 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1069063c-dcfb-4a53-b475-e2df68e541cf tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:16.839826 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1069063c-dcfb-4a53-b475-e2df68e541cf tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded" status: 200 len: 1503 microversion: 2.1 time: 1.637221 Jul 18 02:12:16.855078 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 543/1147] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:15 2022] GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded => generated 1503 bytes in 1644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:16.861801 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-eab0d6a7-66bc-44b2-a00c-864201d0c7ac tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:16.862697 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-eab0d6a7-66bc-44b2-a00c-864201d0c7ac tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 1df099cb-c253-4dd4-96a0-0652047390d8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:16.871590 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eab0d6a7-66bc-44b2-a00c-864201d0c7ac tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:16.872407 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eab0d6a7-66bc-44b2-a00c-864201d0c7ac tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:16.873673 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eab0d6a7-66bc-44b2-a00c-864201d0c7ac tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:16.874433 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eab0d6a7-66bc-44b2-a00c-864201d0c7ac tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:17.333552 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5a96ee82-f5f2-4f06-a501-306c30edf579 tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/7f2b72c9-9a33-4145-b174-da960554d468" status: 202 len: 0 microversion: 2.1 time: 1.340349 Jul 18 02:12:17.334430 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 605/1148] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 02:12:15 2022] DELETE /compute/v2.1/os-security-groups/7f2b72c9-9a33-4145-b174-da960554d468 => generated 0 bytes in 1342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:12:17.341694 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9652e52c-16d5-499a-b8b6-d635b62376cf tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:17.341694 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9652e52c-16d5-499a-b8b6-d635b62376cf tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] [instance: 32e81b5d-a507-4d47-b76e-699091d0e5bd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:17.364146 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-eab0d6a7-66bc-44b2-a00c-864201d0c7ac tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:17.371211 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9652e52c-16d5-499a-b8b6-d635b62376cf tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:17.374061 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9652e52c-16d5-499a-b8b6-d635b62376cf tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:17.375598 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9652e52c-16d5-499a-b8b6-d635b62376cf tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:17.376299 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9652e52c-16d5-499a-b8b6-d635b62376cf tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:17.378645 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-eab0d6a7-66bc-44b2-a00c-864201d0c7ac tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/1df099cb-c253-4dd4-96a0-0652047390d8" status: 200 len: 1487 microversion: 2.1 time: 0.521869 Jul 18 02:12:17.394174 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 544/1149] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:16 2022] GET /compute/v2.1/servers/1df099cb-c253-4dd4-96a0-0652047390d8 => generated 1487 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:17.414559 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-de8d4ed2-e40a-475a-88b0-1908f3942831 tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] Calling method '.version_select at 0x7ff4a8b1da60>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:17.584881 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9652e52c-16d5-499a-b8b6-d635b62376cf tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a9dd4e239c4d73bdde1ced9cb90b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5d1b19c84a4a9fa4595a5c84f4555c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:17.640407 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9652e52c-16d5-499a-b8b6-d635b62376cf tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd" status: 200 len: 1270 microversion: 2.1 time: 0.304783 Jul 18 02:12:17.657521 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 606/1150] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:17 2022] GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd => generated 1270 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:17.703101 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-23ad731a-ec5a-4c25-9a84-257c315d1f17 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:17.706877 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-23ad731a-ec5a-4c25-9a84-257c315d1f17 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 1df099cb-c253-4dd4-96a0-0652047390d8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:17.753583 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-23ad731a-ec5a-4c25-9a84-257c315d1f17 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:17.755021 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-23ad731a-ec5a-4c25-9a84-257c315d1f17 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:17.766285 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-23ad731a-ec5a-4c25-9a84-257c315d1f17 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:17.773085 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-23ad731a-ec5a-4c25-9a84-257c315d1f17 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:17.826142 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-23ad731a-ec5a-4c25-9a84-257c315d1f17 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lazy-loading 'flavor' on Instance uuid 1df099cb-c253-4dd4-96a0-0652047390d8 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:12:17.994631 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-de8d4ed2-e40a-475a-88b0-1908f3942831 tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/715bfe11-fc28-449b-b456-c2975c25daf6" status: 202 len: 0 microversion: 2.1 time: 0.595354 Jul 18 02:12:17.997109 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 545/1151] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 02:12:17 2022] DELETE /compute/v2.1/os-security-groups/715bfe11-fc28-449b-b456-c2975c25daf6 => generated 0 bytes in 602 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:12:18.040265 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e85205d0-9caa-41fd-a85c-67b311c4f829 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:18.062643 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e85205d0-9caa-41fd-a85c-67b311c4f829 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: ae4f2139-250b-4a65-8436-702487cc1ded] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:18.085406 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e85205d0-9caa-41fd-a85c-67b311c4f829 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:18.085902 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e85205d0-9caa-41fd-a85c-67b311c4f829 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:18.086724 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e85205d0-9caa-41fd-a85c-67b311c4f829 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:18.087138 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e85205d0-9caa-41fd-a85c-67b311c4f829 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:18.102806 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-23ad731a-ec5a-4c25-9a84-257c315d1f17 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "POST /compute/v2.1/servers/1df099cb-c253-4dd4-96a0-0652047390d8/action" status: 202 len: 0 microversion: 2.1 time: 0.443462 Jul 18 02:12:18.104101 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 607/1152] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:12:17 2022] POST /compute/v2.1/servers/1df099cb-c253-4dd4-96a0-0652047390d8/action => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:12:18.138376 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1c9f6258-291e-4db4-b5a1-746d5655e74a tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] Calling method '.version_select at 0x7ff4a8999b80>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:18.760258 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e85205d0-9caa-41fd-a85c-67b311c4f829 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:18.780195 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e85205d0-9caa-41fd-a85c-67b311c4f829 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded" status: 200 len: 1503 microversion: 2.1 time: 0.781331 Jul 18 02:12:18.780973 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 546/1153] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:17 2022] GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded => generated 1503 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:18.787455 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bf4de3db-d34d-4f50-80b1-d0013454618c tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:18.788192 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bf4de3db-d34d-4f50-80b1-d0013454618c tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 1df099cb-c253-4dd4-96a0-0652047390d8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:18.810200 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bf4de3db-d34d-4f50-80b1-d0013454618c tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:18.810783 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bf4de3db-d34d-4f50-80b1-d0013454618c tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:18.811700 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bf4de3db-d34d-4f50-80b1-d0013454618c tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:18.812266 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bf4de3db-d34d-4f50-80b1-d0013454618c tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:19.067162 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1c9f6258-291e-4db4-b5a1-746d5655e74a tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/8e82ae92-47be-42d4-866a-90491e355ca4" status: 202 len: 0 microversion: 2.1 time: 0.946905 Jul 18 02:12:19.070880 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 608/1154] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 02:12:18 2022] DELETE /compute/v2.1/os-security-groups/8e82ae92-47be-42d4-866a-90491e355ca4 => generated 0 bytes in 966 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:12:19.091349 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b6f0aefb-c972-4577-b9dc-03642b09021f tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:19.096949 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b6f0aefb-c972-4577-b9dc-03642b09021f tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] [instance: 32e81b5d-a507-4d47-b76e-699091d0e5bd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:19.152951 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6f0aefb-c972-4577-b9dc-03642b09021f tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:19.154486 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6f0aefb-c972-4577-b9dc-03642b09021f tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:19.156355 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6f0aefb-c972-4577-b9dc-03642b09021f tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:19.161069 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6f0aefb-c972-4577-b9dc-03642b09021f tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:19.281038 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bf4de3db-d34d-4f50-80b1-d0013454618c tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:19.299726 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bf4de3db-d34d-4f50-80b1-d0013454618c tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/1df099cb-c253-4dd4-96a0-0652047390d8" status: 200 len: 1495 microversion: 2.1 time: 0.517556 Jul 18 02:12:19.304993 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 547/1155] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:18 2022] GET /compute/v2.1/servers/1df099cb-c253-4dd4-96a0-0652047390d8 => generated 1495 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:19.326579 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ad4a1bd7-bee4-4463-be91-83c66d20435b tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] Calling method '.version_select at 0x7ff4a8bc6700>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:19.406192 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b6f0aefb-c972-4577-b9dc-03642b09021f tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a9dd4e239c4d73bdde1ced9cb90b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5d1b19c84a4a9fa4595a5c84f4555c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:19.450346 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b6f0aefb-c972-4577-b9dc-03642b09021f tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd" status: 200 len: 1276 microversion: 2.1 time: 0.358613 Jul 18 02:12:19.456153 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 609/1156] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:19 2022] GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd => generated 1276 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:20.291632 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ad4a1bd7-bee4-4463-be91-83c66d20435b tempest-SecurityGroupRulesNegativeTestJSON-304173729 tempest-SecurityGroupRulesNegativeTestJSON-304173729-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/b1694e2f-46d6-49fe-9917-09e7197de209" status: 202 len: 0 microversion: 2.1 time: 0.984998 Jul 18 02:12:20.292396 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 548/1157] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 02:12:19 2022] DELETE /compute/v2.1/os-security-groups/b1694e2f-46d6-49fe-9917-09e7197de209 => generated 0 bytes in 987 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:12:20.297607 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6c3a1c75-395a-483c-9174-ae33419b5b03 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:20.298980 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6c3a1c75-395a-483c-9174-ae33419b5b03 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: ae4f2139-250b-4a65-8436-702487cc1ded] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:20.320928 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6c3a1c75-395a-483c-9174-ae33419b5b03 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:20.325012 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6c3a1c75-395a-483c-9174-ae33419b5b03 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:20.329086 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6c3a1c75-395a-483c-9174-ae33419b5b03 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:20.331218 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6c3a1c75-395a-483c-9174-ae33419b5b03 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:20.386709 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:20.388447 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8d4b48ea-74ae-448c-b5d7-1758f905734a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2105108026", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:20.547339 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-8d4b48ea-74ae-448c-b5d7-1758f905734a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] validate_networks() for None {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:12:21.469575 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6c3a1c75-395a-483c-9174-ae33419b5b03 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:21.492365 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6c3a1c75-395a-483c-9174-ae33419b5b03 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded" status: 200 len: 1503 microversion: 2.1 time: 1.198509 Jul 18 02:12:21.493818 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 549/1158] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:20 2022] GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded => generated 1503 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:21.499364 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-324c5ef4-5c54-4761-b996-8c16f42dd6c0 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:21.500419 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-324c5ef4-5c54-4761-b996-8c16f42dd6c0 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 1df099cb-c253-4dd4-96a0-0652047390d8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:21.510900 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-324c5ef4-5c54-4761-b996-8c16f42dd6c0 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:21.514474 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-324c5ef4-5c54-4761-b996-8c16f42dd6c0 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:21.515797 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-324c5ef4-5c54-4761-b996-8c16f42dd6c0 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:21.516497 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-324c5ef4-5c54-4761-b996-8c16f42dd6c0 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:21.892150 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-8d4b48ea-74ae-448c-b5d7-1758f905734a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:12:21.903847 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-8d4b48ea-74ae-448c-b5d7-1758f905734a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:12:21.908621 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-8d4b48ea-74ae-448c-b5d7-1758f905734a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:12:21.911027 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-8d4b48ea-74ae-448c-b5d7-1758f905734a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:12:21.913014 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-8d4b48ea-74ae-448c-b5d7-1758f905734a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:12:21.950824 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8d4b48ea-74ae-448c-b5d7-1758f905734a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:21.955735 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8d4b48ea-74ae-448c-b5d7-1758f905734a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:21.958133 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8d4b48ea-74ae-448c-b5d7-1758f905734a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:21.962838 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8d4b48ea-74ae-448c-b5d7-1758f905734a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:21.982892 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-324c5ef4-5c54-4761-b996-8c16f42dd6c0 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:21.988748 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-8d4b48ea-74ae-448c-b5d7-1758f905734a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Getting quotas for project 8f8bb1ebead3481f946ae7878c3cfc41. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:12:21.992360 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-324c5ef4-5c54-4761-b996-8c16f42dd6c0 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/1df099cb-c253-4dd4-96a0-0652047390d8" status: 200 len: 1478 microversion: 2.1 time: 0.497033 Jul 18 02:12:22.007613 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 550/1159] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:21 2022] GET /compute/v2.1/servers/1df099cb-c253-4dd4-96a0-0652047390d8 => generated 1478 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:22.014150 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3b203e94-63cc-490b-8c06-4a56bf0b9869 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:22.014991 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3b203e94-63cc-490b-8c06-4a56bf0b9869 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] [instance: 32e81b5d-a507-4d47-b76e-699091d0e5bd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:22.046217 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-8d4b48ea-74ae-448c-b5d7-1758f905734a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Getting quotas for user 100f65c0d9d3456fa177599821aed7ff and project 8f8bb1ebead3481f946ae7878c3cfc41. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:12:22.050533 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3b203e94-63cc-490b-8c06-4a56bf0b9869 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:22.051478 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3b203e94-63cc-490b-8c06-4a56bf0b9869 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:22.052582 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3b203e94-63cc-490b-8c06-4a56bf0b9869 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:22.055023 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3b203e94-63cc-490b-8c06-4a56bf0b9869 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:22.072900 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8d4b48ea-74ae-448c-b5d7-1758f905734a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:12:22.086165 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8d4b48ea-74ae-448c-b5d7-1758f905734a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c207a0eb-5ef9-4932-9f3a-22f2a11129e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:12:22.149658 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8d4b48ea-74ae-448c-b5d7-1758f905734a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.356149 Jul 18 02:12:22.152629 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 610/1160] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:12:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2360 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:12:22.279840 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3b203e94-63cc-490b-8c06-4a56bf0b9869 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a9dd4e239c4d73bdde1ced9cb90b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5d1b19c84a4a9fa4595a5c84f4555c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:22.308587 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3b203e94-63cc-490b-8c06-4a56bf0b9869 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd" status: 200 len: 1276 microversion: 2.1 time: 0.299277 Jul 18 02:12:22.321359 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 551/1161] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:22 2022] GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd => generated 1276 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:22.335784 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-732ef145-87de-45cc-9e2a-82c38dfdbb6a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-722524172"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:22.337331 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-732ef145-87de-45cc-9e2a-82c38dfdbb6a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 1df099cb-c253-4dd4-96a0-0652047390d8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:22.356918 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-732ef145-87de-45cc-9e2a-82c38dfdbb6a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:22.357401 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-732ef145-87de-45cc-9e2a-82c38dfdbb6a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:22.361322 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-732ef145-87de-45cc-9e2a-82c38dfdbb6a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:22.361671 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-732ef145-87de-45cc-9e2a-82c38dfdbb6a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:22.496735 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8c03d066-938e-4af8-8c20-00039a67858b tempest-HypervisorAdminV253TestBase-951928571 tempest-HypervisorAdminV253TestBase-951928571-project-admin] Calling method '.version_select at 0x7ff4a8856790>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:22.498407 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:22.498407 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:12:22.499843 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8c03d066-938e-4af8-8c20-00039a67858b tempest-HypervisorAdminV253TestBase-951928571 tempest-HypervisorAdminV253TestBase-951928571-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:22.500332 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8c03d066-938e-4af8-8c20-00039a67858b tempest-HypervisorAdminV253TestBase-951928571 tempest-HypervisorAdminV253TestBase-951928571-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:22.521917 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8c03d066-938e-4af8-8c20-00039a67858b tempest-HypervisorAdminV253TestBase-951928571 tempest-HypervisorAdminV253TestBase-951928571-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:22.522816 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8c03d066-938e-4af8-8c20-00039a67858b tempest-HypervisorAdminV253TestBase-951928571 tempest-HypervisorAdminV253TestBase-951928571-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:22.561772 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8c03d066-938e-4af8-8c20-00039a67858b tempest-HypervisorAdminV253TestBase-951928571 tempest-HypervisorAdminV253TestBase-951928571-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:22.562672 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8c03d066-938e-4af8-8c20-00039a67858b tempest-HypervisorAdminV253TestBase-951928571 tempest-HypervisorAdminV253TestBase-951928571-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:22.581519 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8c03d066-938e-4af8-8c20-00039a67858b tempest-HypervisorAdminV253TestBase-951928571 tempest-HypervisorAdminV253TestBase-951928571-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:22.583792 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8c03d066-938e-4af8-8c20-00039a67858b tempest-HypervisorAdminV253TestBase-951928571 tempest-HypervisorAdminV253TestBase-951928571-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:22.638691 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8c03d066-938e-4af8-8c20-00039a67858b tempest-HypervisorAdminV253TestBase-951928571 tempest-HypervisorAdminV253TestBase-951928571-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:22.639265 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8c03d066-938e-4af8-8c20-00039a67858b tempest-HypervisorAdminV253TestBase-951928571 tempest-HypervisorAdminV253TestBase-951928571-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:22.666735 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8c03d066-938e-4af8-8c20-00039a67858b tempest-HypervisorAdminV253TestBase-951928571 tempest-HypervisorAdminV253TestBase-951928571-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1994 microversion: 2.53 time: 0.512624 Jul 18 02:12:22.672386 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 611/1162] 10.222.0.57 () {60 vars in 1242 bytes} [Mon Jul 18 02:12:22 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1994 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:12:22.681301 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4a57e908-ef5c-4026-bd7d-40df6efad92b tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:22.681953 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4a57e908-ef5c-4026-bd7d-40df6efad92b tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c207a0eb-5ef9-4932-9f3a-22f2a11129e5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:23.167920 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-732ef145-87de-45cc-9e2a-82c38dfdbb6a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "POST /compute/v2.1/servers/1df099cb-c253-4dd4-96a0-0652047390d8/action" status: 202 len: 0 microversion: 2.1 time: 0.844859 Jul 18 02:12:23.191945 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 552/1163] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:12:22 2022] POST /compute/v2.1/servers/1df099cb-c253-4dd4-96a0-0652047390d8/action => generated 0 bytes in 870 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 18 02:12:23.216279 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-30fe38f3-7ec3-4b7b-8e11-957597a932f8 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:23.217028 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-30fe38f3-7ec3-4b7b-8e11-957597a932f8 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: ae4f2139-250b-4a65-8436-702487cc1ded] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:23.239296 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-30fe38f3-7ec3-4b7b-8e11-957597a932f8 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:23.240233 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-30fe38f3-7ec3-4b7b-8e11-957597a932f8 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:23.241295 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-30fe38f3-7ec3-4b7b-8e11-957597a932f8 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:23.243878 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-30fe38f3-7ec3-4b7b-8e11-957597a932f8 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:23.438732 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4a57e908-ef5c-4026-bd7d-40df6efad92b tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:23.460651 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4a57e908-ef5c-4026-bd7d-40df6efad92b tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5" status: 200 len: 1217 microversion: 2.1 time: 0.784559 Jul 18 02:12:23.461214 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 612/1164] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:22 2022] GET /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5 => generated 1217 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:23.474382 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-23cb8f2f-19e1-4d4b-822f-952d75d4de45 tempest-HypervisorAdminV253TestBase-951928571 tempest-HypervisorAdminV253TestBase-951928571-project-admin] Calling method '.version_select at 0x7ff4a8874310>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:23.475883 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:23.475883 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:12:23.477243 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-23cb8f2f-19e1-4d4b-822f-952d75d4de45 tempest-HypervisorAdminV253TestBase-951928571 tempest-HypervisorAdminV253TestBase-951928571-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:23.477694 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-23cb8f2f-19e1-4d4b-822f-952d75d4de45 tempest-HypervisorAdminV253TestBase-951928571 tempest-HypervisorAdminV253TestBase-951928571-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:23.541079 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-23cb8f2f-19e1-4d4b-822f-952d75d4de45 tempest-HypervisorAdminV253TestBase-951928571 tempest-HypervisorAdminV253TestBase-951928571-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:23.543146 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-23cb8f2f-19e1-4d4b-822f-952d75d4de45 tempest-HypervisorAdminV253TestBase-951928571 tempest-HypervisorAdminV253TestBase-951928571-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:23.664269 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-23cb8f2f-19e1-4d4b-822f-952d75d4de45 tempest-HypervisorAdminV253TestBase-951928571 tempest-HypervisorAdminV253TestBase-951928571-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:23.664939 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-23cb8f2f-19e1-4d4b-822f-952d75d4de45 tempest-HypervisorAdminV253TestBase-951928571 tempest-HypervisorAdminV253TestBase-951928571-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:23.700965 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-23cb8f2f-19e1-4d4b-822f-952d75d4de45 tempest-HypervisorAdminV253TestBase-951928571 tempest-HypervisorAdminV253TestBase-951928571-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:23.702505 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-23cb8f2f-19e1-4d4b-822f-952d75d4de45 tempest-HypervisorAdminV253TestBase-951928571 tempest-HypervisorAdminV253TestBase-951928571-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:23.771411 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-23cb8f2f-19e1-4d4b-822f-952d75d4de45 tempest-HypervisorAdminV253TestBase-951928571 tempest-HypervisorAdminV253TestBase-951928571-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:23.773489 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-23cb8f2f-19e1-4d4b-822f-952d75d4de45 tempest-HypervisorAdminV253TestBase-951928571 tempest-HypervisorAdminV253TestBase-951928571-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:23.797237 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-23cb8f2f-19e1-4d4b-822f-952d75d4de45 tempest-HypervisorAdminV253TestBase-951928571 tempest-HypervisorAdminV253TestBase-951928571-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 686 microversion: 2.53 time: 0.331236 Jul 18 02:12:23.799076 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 613/1165] 10.222.0.57 () {60 vars in 1221 bytes} [Mon Jul 18 02:12:23 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 686 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:12:23.837820 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-70ce42b5-46c5-4928-8510-5ad923cb5b0a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a8874820>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:23.970146 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-70ce42b5-46c5-4928-8510-5ad923cb5b0a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170" status: 200 len: 1435 microversion: 2.1 time: 0.155593 Jul 18 02:12:23.974601 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 614/1166] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:12:23 2022] GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170 => generated 1435 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:24.003168 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6c9a1ce1-22b5-430e-8b8a-94f58e14b402 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:24.010067 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6c9a1ce1-22b5-430e-8b8a-94f58e14b402 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] [instance: 32e81b5d-a507-4d47-b76e-699091d0e5bd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:24.036215 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6c9a1ce1-22b5-430e-8b8a-94f58e14b402 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:24.042811 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6c9a1ce1-22b5-430e-8b8a-94f58e14b402 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:24.043876 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-30fe38f3-7ec3-4b7b-8e11-957597a932f8 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:24.045798 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6c9a1ce1-22b5-430e-8b8a-94f58e14b402 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:24.051934 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6c9a1ce1-22b5-430e-8b8a-94f58e14b402 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:24.094737 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-30fe38f3-7ec3-4b7b-8e11-957597a932f8 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded" status: 200 len: 1478 microversion: 2.1 time: 0.898605 Jul 18 02:12:24.112609 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 553/1167] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:23 2022] GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded => generated 1478 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:24.148462 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1c19196b-e073-461a-aea6-d89407cf4554 tempest-HypervisorAdminV253TestBase-951928571 tempest-HypervisorAdminV253TestBase-951928571-project-admin] Calling method '.version_select at 0x7ff4a8b4e9d0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:24.161054 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:24.161054 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:12:24.175127 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c19196b-e073-461a-aea6-d89407cf4554 tempest-HypervisorAdminV253TestBase-951928571 tempest-HypervisorAdminV253TestBase-951928571-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:24.177256 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c19196b-e073-461a-aea6-d89407cf4554 tempest-HypervisorAdminV253TestBase-951928571 tempest-HypervisorAdminV253TestBase-951928571-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:24.239220 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c19196b-e073-461a-aea6-d89407cf4554 tempest-HypervisorAdminV253TestBase-951928571 tempest-HypervisorAdminV253TestBase-951928571-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:24.241726 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c19196b-e073-461a-aea6-d89407cf4554 tempest-HypervisorAdminV253TestBase-951928571 tempest-HypervisorAdminV253TestBase-951928571-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:24.263370 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1c19196b-e073-461a-aea6-d89407cf4554 tempest-HypervisorAdminV253TestBase-951928571 tempest-HypervisorAdminV253TestBase-951928571-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/8aa7d2db-8dbc-45ba-b868-d7b262b8b0ea" status: 200 len: 792 microversion: 2.53 time: 0.138103 Jul 18 02:12:24.266037 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 554/1168] 10.222.0.57 () {60 vars in 1297 bytes} [Mon Jul 18 02:12:24 2022] GET /compute/v2.1/os-hypervisors/8aa7d2db-8dbc-45ba-b868-d7b262b8b0ea => generated 792 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:12:24.278368 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-724c3016-8fca-478f-b4d3-4bbfb0ff875d tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Calling method '.version_select at 0x7ff4a8b48790>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:24.292181 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-724c3016-8fca-478f-b4d3-4bbfb0ff875d tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:24.294803 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-724c3016-8fca-478f-b4d3-4bbfb0ff875d tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:24.360708 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-724c3016-8fca-478f-b4d3-4bbfb0ff875d tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] 10.222.0.57 "GET /compute/v2.1/os-migrations" status: 200 len: 784 microversion: 2.1 time: 0.086403 Jul 18 02:12:24.362179 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 555/1169] 10.222.0.57 () {58 vars in 1142 bytes} [Mon Jul 18 02:12:24 2022] GET /compute/v2.1/os-migrations => generated 784 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:24.397551 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-285b85d2-95e1-4236-b5ef-1184376f7621 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:24.398689 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-285b85d2-95e1-4236-b5ef-1184376f7621 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] [instance: ae4f2139-250b-4a65-8436-702487cc1ded] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:24.413555 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-285b85d2-95e1-4236-b5ef-1184376f7621 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:24.415380 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-285b85d2-95e1-4236-b5ef-1184376f7621 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:24.417597 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-285b85d2-95e1-4236-b5ef-1184376f7621 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:24.418938 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-285b85d2-95e1-4236-b5ef-1184376f7621 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:25.026330 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:25.060634 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:25.586708 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6c9a1ce1-22b5-430e-8b8a-94f58e14b402 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a9dd4e239c4d73bdde1ced9cb90b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5d1b19c84a4a9fa4595a5c84f4555c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:25.604290 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6c9a1ce1-22b5-430e-8b8a-94f58e14b402 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd" status: 200 len: 1318 microversion: 2.1 time: 1.623843 Jul 18 02:12:25.605247 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 615/1170] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:23 2022] GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd => generated 1318 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:25.621151 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ccd47052-4822-4c24-8df8-3592d881c779 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:25.622344 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ccd47052-4822-4c24-8df8-3592d881c779 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c207a0eb-5ef9-4932-9f3a-22f2a11129e5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:25.630883 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ccd47052-4822-4c24-8df8-3592d881c779 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:25.631961 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ccd47052-4822-4c24-8df8-3592d881c779 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:25.634139 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ccd47052-4822-4c24-8df8-3592d881c779 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:25.634821 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ccd47052-4822-4c24-8df8-3592d881c779 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:25.668573 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-285b85d2-95e1-4236-b5ef-1184376f7621 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded" status: 200 len: 1629 microversion: 2.1 time: 1.282301 Jul 18 02:12:25.670400 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 556/1171] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:24 2022] GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded => generated 1629 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:25.704180 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6115ce43-4502-4283-a375-0ec9db513d3f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a8ac0310>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:25.832529 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ccd47052-4822-4c24-8df8-3592d881c779 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:25.849258 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ccd47052-4822-4c24-8df8-3592d881c779 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5" status: 200 len: 1275 microversion: 2.1 time: 0.240466 Jul 18 02:12:25.850388 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 616/1172] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:25 2022] GET /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5 => generated 1275 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:25.858301 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6115ce43-4502-4283-a375-0ec9db513d3f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170" status: 200 len: 1435 microversion: 2.1 time: 0.182659 Jul 18 02:12:25.859348 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 557/1173] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:12:25 2022] GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170 => generated 1435 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:25.860720 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b72538a6-e98e-46a9-941d-dc2e57bd10ee tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Action: 'create', calling method: .version_select at 0x7ff4a87e2dc0>, body: {"keypair": {"name": "tempest-keypair-1215991492", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIt0Gktn455CpCikvAjLX/YKsyI4tankn8XwAK1X281U6AyJ/ey65eUIm330T0RB9AbL/59hKLVo8lgGHw/QjRBFHxZ03aorW9OaZWZNCELFAyOIJal2VZr4m8wPjgUa5w=="}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:25.914290 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-b72538a6-e98e-46a9-941d-dc2e57bd10ee tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Getting quotas for project e382977cb6bf4f358fb3245cb3768140. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:12:25.933140 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-b72538a6-e98e-46a9-941d-dc2e57bd10ee tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Getting quotas for user 77381e85d31a4747acb08a8d4572eb1b and project e382977cb6bf4f358fb3245cb3768140. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:12:26.021038 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b72538a6-e98e-46a9-941d-dc2e57bd10ee tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.169033 Jul 18 02:12:26.022749 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 617/1174] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 02:12:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:26.146816 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-8dc5e3d5-dff4-4ecf-8cf6-38f549ee3375 req-fab39a4d-8a67-4600-ab06-a2ef0439dc42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "697075ff-db42-4729-8faf-2c2935d72630", "tag": "26b96c32-3f20-4f09-8e97-8a938a803c4c"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:26.198757 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-8dc5e3d5-dff4-4ecf-8cf6-38f549ee3375 req-fab39a4d-8a67-4600-ab06-a2ef0439dc42 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:26.200011 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-8dc5e3d5-dff4-4ecf-8cf6-38f549ee3375 req-fab39a4d-8a67-4600-ab06-a2ef0439dc42 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:26.223218 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-8dc5e3d5-dff4-4ecf-8cf6-38f549ee3375 req-fab39a4d-8a67-4600-ab06-a2ef0439dc42 service nova] Creating event network-changed:26b96c32-3f20-4f09-8e97-8a938a803c4c for instance 697075ff-db42-4729-8faf-2c2935d72630 on n-h2-465891-3 Jul 18 02:12:26.234317 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-8dc5e3d5-dff4-4ecf-8cf6-38f549ee3375 req-fab39a4d-8a67-4600-ab06-a2ef0439dc42 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099135 Jul 18 02:12:26.260426 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 558/1175] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:26.627720 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-816c70d6-12d4-4d4b-9c11-67af6d6760ed tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:26.628970 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-816c70d6-12d4-4d4b-9c11-67af6d6760ed tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] [instance: 32e81b5d-a507-4d47-b76e-699091d0e5bd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:26.639038 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:RELEASE=1,nova_api:SELECT=89,nova_api:DELETE=3,nova_api:INSERT=7 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:26.653870 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-816c70d6-12d4-4d4b-9c11-67af6d6760ed tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:26.658724 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-816c70d6-12d4-4d4b-9c11-67af6d6760ed tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:26.659638 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-816c70d6-12d4-4d4b-9c11-67af6d6760ed tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:26.660093 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-816c70d6-12d4-4d4b-9c11-67af6d6760ed tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:26.875377 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8ccd39a9-afc3-4b7d-9c53-549da47c2922 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:26.885431 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8ccd39a9-afc3-4b7d-9c53-549da47c2922 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c207a0eb-5ef9-4932-9f3a-22f2a11129e5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:26.912422 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8ccd39a9-afc3-4b7d-9c53-549da47c2922 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:26.918068 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8ccd39a9-afc3-4b7d-9c53-549da47c2922 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:26.920105 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8ccd39a9-afc3-4b7d-9c53-549da47c2922 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:26.930954 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8ccd39a9-afc3-4b7d-9c53-549da47c2922 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:27.296885 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8ccd39a9-afc3-4b7d-9c53-549da47c2922 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:27.333354 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8ccd39a9-afc3-4b7d-9c53-549da47c2922 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5" status: 200 len: 1275 microversion: 2.1 time: 0.457610 Jul 18 02:12:27.336064 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 559/1176] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:26 2022] GET /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5 => generated 1275 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:27.352728 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-31da9f75-a368-4561-be93-db417316d3c5 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a8a55670>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:27.512833 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-31da9f75-a368-4561-be93-db417316d3c5 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170" status: 200 len: 1435 microversion: 2.1 time: 0.168562 Jul 18 02:12:27.513981 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 560/1177] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:12:27 2022] GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170 => generated 1435 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:27.922949 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-816c70d6-12d4-4d4b-9c11-67af6d6760ed tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a9dd4e239c4d73bdde1ced9cb90b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5d1b19c84a4a9fa4595a5c84f4555c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:27.947401 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-816c70d6-12d4-4d4b-9c11-67af6d6760ed tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd" status: 200 len: 1318 microversion: 2.1 time: 1.327634 Jul 18 02:12:27.948351 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 618/1178] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:26 2022] GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd => generated 1318 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:28.012458 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-25500716-3569-4cd8-96e5-5f2b4b05e351 req-2c1c1126-c20a-4216-8d17-f787a6dbc0a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1df099cb-c253-4dd4-96a0-0652047390d8", "name": "network-vif-plugged", "status": "completed", "tag": "faa469e5-28b6-416c-8e4b-d5b6ab117a54"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:28.027143 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-25500716-3569-4cd8-96e5-5f2b4b05e351 req-2c1c1126-c20a-4216-8d17-f787a6dbc0a9 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:28.028052 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-25500716-3569-4cd8-96e5-5f2b4b05e351 req-2c1c1126-c20a-4216-8d17-f787a6dbc0a9 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:28.055159 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-25500716-3569-4cd8-96e5-5f2b4b05e351 req-2c1c1126-c20a-4216-8d17-f787a6dbc0a9 service nova] Creating event network-vif-plugged:faa469e5-28b6-416c-8e4b-d5b6ab117a54 for instance 1df099cb-c253-4dd4-96a0-0652047390d8 on n-h1-465891-3 Jul 18 02:12:28.069485 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-25500716-3569-4cd8-96e5-5f2b4b05e351 req-2c1c1126-c20a-4216-8d17-f787a6dbc0a9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061761 Jul 18 02:12:28.070143 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 561/1179] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:28.353681 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-01e0ade1-0492-40fa-b614-8ae49d7ad167 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:28.354383 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-01e0ade1-0492-40fa-b614-8ae49d7ad167 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c207a0eb-5ef9-4932-9f3a-22f2a11129e5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:28.366489 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-01e0ade1-0492-40fa-b614-8ae49d7ad167 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:28.366965 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-01e0ade1-0492-40fa-b614-8ae49d7ad167 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:28.370835 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-01e0ade1-0492-40fa-b614-8ae49d7ad167 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:28.371720 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-01e0ade1-0492-40fa-b614-8ae49d7ad167 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:28.528788 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1e3d82e4-d8db-4ee6-83cb-6611e9733087 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a8aecc10>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:28.589786 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-01e0ade1-0492-40fa-b614-8ae49d7ad167 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:28.614903 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1e3d82e4-d8db-4ee6-83cb-6611e9733087 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170" status: 200 len: 1435 microversion: 2.1 time: 0.090821 Jul 18 02:12:28.615902 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 562/1180] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:12:28 2022] GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170 => generated 1435 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:12:28.629733 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-01e0ade1-0492-40fa-b614-8ae49d7ad167 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5" status: 200 len: 1275 microversion: 2.1 time: 0.278813 Jul 18 02:12:28.642361 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 619/1181] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:28 2022] GET /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5 => generated 1275 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:12:28.980258 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dd592f23-95e7-44b7-9712-8820ec457a5a tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:28.981774 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-dd592f23-95e7-44b7-9712-8820ec457a5a tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] [instance: 32e81b5d-a507-4d47-b76e-699091d0e5bd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:29.025901 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dd592f23-95e7-44b7-9712-8820ec457a5a tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:29.026893 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dd592f23-95e7-44b7-9712-8820ec457a5a tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:29.028377 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dd592f23-95e7-44b7-9712-8820ec457a5a tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:29.039438 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dd592f23-95e7-44b7-9712-8820ec457a5a tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:29.151776 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-f83adecb-c9b8-4be8-b635-bee77ea126e2 req-d2a904f9-ae9b-4680-9a93-2fbbd2041103 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32e81b5d-a507-4d47-b76e-699091d0e5bd", "tag": "07f51000-5732-46e7-8e0e-0bd9c61e7698"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:29.230700 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-f83adecb-c9b8-4be8-b635-bee77ea126e2 req-d2a904f9-ae9b-4680-9a93-2fbbd2041103 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:29.236833 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-f83adecb-c9b8-4be8-b635-bee77ea126e2 req-d2a904f9-ae9b-4680-9a93-2fbbd2041103 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:29.306718 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-f83adecb-c9b8-4be8-b635-bee77ea126e2 req-d2a904f9-ae9b-4680-9a93-2fbbd2041103 service nova] Creating event network-changed:07f51000-5732-46e7-8e0e-0bd9c61e7698 for instance 32e81b5d-a507-4d47-b76e-699091d0e5bd on n-h2-465891-3 Jul 18 02:12:29.327128 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-f83adecb-c9b8-4be8-b635-bee77ea126e2 req-d2a904f9-ae9b-4680-9a93-2fbbd2041103 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.201200 Jul 18 02:12:29.329563 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 620/1182] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:12:29.638885 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5425ec4c-3181-4387-84fc-d81f1e22cc88 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a888ad30>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:29.742627 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5425ec4c-3181-4387-84fc-d81f1e22cc88 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170" status: 200 len: 1435 microversion: 2.1 time: 0.111645 Jul 18 02:12:29.743964 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 621/1183] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:12:29 2022] GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170 => generated 1435 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:29.758781 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7cbc1c9b-8305-40d6-ad36-47922a52293e tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:29.760633 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7cbc1c9b-8305-40d6-ad36-47922a52293e tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c207a0eb-5ef9-4932-9f3a-22f2a11129e5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:29.783476 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7cbc1c9b-8305-40d6-ad36-47922a52293e tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:29.784348 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7cbc1c9b-8305-40d6-ad36-47922a52293e tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:29.786705 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7cbc1c9b-8305-40d6-ad36-47922a52293e tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:29.787431 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7cbc1c9b-8305-40d6-ad36-47922a52293e tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:30.140110 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7cbc1c9b-8305-40d6-ad36-47922a52293e tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:30.174974 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7cbc1c9b-8305-40d6-ad36-47922a52293e tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5" status: 200 len: 1275 microversion: 2.1 time: 0.413831 Jul 18 02:12:30.177362 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 622/1184] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:29 2022] GET /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5 => generated 1275 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:30.341052 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-dd592f23-95e7-44b7-9712-8820ec457a5a tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a9dd4e239c4d73bdde1ced9cb90b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5d1b19c84a4a9fa4595a5c84f4555c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:30.379483 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-dd592f23-95e7-44b7-9712-8820ec457a5a tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd" status: 200 len: 1318 microversion: 2.1 time: 1.403758 Jul 18 02:12:30.384798 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 563/1185] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:28 2022] GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd => generated 1318 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:30.763097 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-aab9cd18-51a1-4e92-ae3f-2e23438e1633 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a8856310>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:30.892574 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-aab9cd18-51a1-4e92-ae3f-2e23438e1633 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170" status: 200 len: 1435 microversion: 2.1 time: 0.134687 Jul 18 02:12:30.894255 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 623/1186] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:12:30 2022] GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170 => generated 1435 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:31.202188 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3cfa620c-aefb-40d1-ae7a-1157fbf5ee8f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:31.210247 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3cfa620c-aefb-40d1-ae7a-1157fbf5ee8f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c207a0eb-5ef9-4932-9f3a-22f2a11129e5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:31.227263 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3cfa620c-aefb-40d1-ae7a-1157fbf5ee8f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:31.227723 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3cfa620c-aefb-40d1-ae7a-1157fbf5ee8f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:31.228542 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3cfa620c-aefb-40d1-ae7a-1157fbf5ee8f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:31.245676 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3cfa620c-aefb-40d1-ae7a-1157fbf5ee8f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:31.410216 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-eff613f9-46ca-4643-a996-13a699c37355 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:31.411749 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-eff613f9-46ca-4643-a996-13a699c37355 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] [instance: 32e81b5d-a507-4d47-b76e-699091d0e5bd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:31.432973 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eff613f9-46ca-4643-a996-13a699c37355 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:31.437169 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eff613f9-46ca-4643-a996-13a699c37355 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:31.442302 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eff613f9-46ca-4643-a996-13a699c37355 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:31.443094 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eff613f9-46ca-4643-a996-13a699c37355 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:31.976377 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:32.013259 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3cfa620c-aefb-40d1-ae7a-1157fbf5ee8f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:32.024870 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3cfa620c-aefb-40d1-ae7a-1157fbf5ee8f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5" status: 200 len: 1275 microversion: 2.1 time: 0.827038 Jul 18 02:12:32.034234 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 564/1187] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:31 2022] GET /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5 => generated 1275 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:12:32.045826 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3b8dae3f-fa70-4c9e-9ca9-40c8ca570e7c tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a8b48940>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:32.239553 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3b8dae3f-fa70-4c9e-9ca9-40c8ca570e7c tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170" status: 200 len: 1435 microversion: 2.1 time: 0.202896 Jul 18 02:12:32.242243 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 565/1188] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:12:32 2022] GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170 => generated 1435 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:33.044560 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2cf42462-ceb6-47af-99be-182fb83b7a1e tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:33.046085 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2cf42462-ceb6-47af-99be-182fb83b7a1e tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c207a0eb-5ef9-4932-9f3a-22f2a11129e5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:33.072117 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2cf42462-ceb6-47af-99be-182fb83b7a1e tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:33.079530 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2cf42462-ceb6-47af-99be-182fb83b7a1e tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:33.085185 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2cf42462-ceb6-47af-99be-182fb83b7a1e tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:33.086659 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2cf42462-ceb6-47af-99be-182fb83b7a1e tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:34.530136 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-eff613f9-46ca-4643-a996-13a699c37355 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a9dd4e239c4d73bdde1ced9cb90b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5d1b19c84a4a9fa4595a5c84f4555c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:34.596930 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-eff613f9-46ca-4643-a996-13a699c37355 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd" status: 200 len: 1318 microversion: 2.1 time: 3.191511 Jul 18 02:12:34.634499 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 624/1189] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:31 2022] GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd => generated 1318 bytes in 3228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:12:34.663504 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bdbb5612-156c-4cb7-b553-48bc71a14804 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a88b3820>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:34.902964 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bdbb5612-156c-4cb7-b553-48bc71a14804 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170" status: 200 len: 1435 microversion: 2.1 time: 0.266710 Jul 18 02:12:34.918265 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 625/1190] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:12:34 2022] GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170 => generated 1435 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:34.943000 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-aac72c84-e1a4-4ac4-8e3c-168ddf9f0ed7 req-7c7c579d-839f-47d7-9b6b-519d960e3179 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "697075ff-db42-4729-8faf-2c2935d72630", "name": "network-vif-plugged", "status": "completed", "tag": "26b96c32-3f20-4f09-8e97-8a938a803c4c"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:34.985616 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-aac72c84-e1a4-4ac4-8e3c-168ddf9f0ed7 req-7c7c579d-839f-47d7-9b6b-519d960e3179 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:34.989768 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-aac72c84-e1a4-4ac4-8e3c-168ddf9f0ed7 req-7c7c579d-839f-47d7-9b6b-519d960e3179 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:35.023103 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:35.029937 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-aac72c84-e1a4-4ac4-8e3c-168ddf9f0ed7 req-7c7c579d-839f-47d7-9b6b-519d960e3179 service nova] Creating event network-vif-plugged:26b96c32-3f20-4f09-8e97-8a938a803c4c for instance 697075ff-db42-4729-8faf-2c2935d72630 on n-h2-465891-3 Jul 18 02:12:35.052483 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-aac72c84-e1a4-4ac4-8e3c-168ddf9f0ed7 req-7c7c579d-839f-47d7-9b6b-519d960e3179 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129025 Jul 18 02:12:35.055953 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 626/1191] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:35.613254 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2cf42462-ceb6-47af-99be-182fb83b7a1e tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:35.626093 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7ed50f40-6511-445d-b033-a3e4d9da67a9 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:35.628482 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7ed50f40-6511-445d-b033-a3e4d9da67a9 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] [instance: 32e81b5d-a507-4d47-b76e-699091d0e5bd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:35.661977 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2cf42462-ceb6-47af-99be-182fb83b7a1e tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5" status: 200 len: 1317 microversion: 2.1 time: 2.618187 Jul 18 02:12:35.681348 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7ed50f40-6511-445d-b033-a3e4d9da67a9 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:35.681845 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7ed50f40-6511-445d-b033-a3e4d9da67a9 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:35.682666 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7ed50f40-6511-445d-b033-a3e4d9da67a9 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:35.683096 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7ed50f40-6511-445d-b033-a3e4d9da67a9 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:35.686434 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 566/1192] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:33 2022] GET /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5 => generated 1317 bytes in 2645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:35.968384 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=20 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:36.522341 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e50d6546-b20b-43d7-9776-db45eabce730 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-707050892", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "9c108108-5ed1-42f1-a1fc-37dc836711d5"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:36.789171 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-e50d6546-b20b-43d7-9776-db45eabce730 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] validate_networks() for [('9c108108-5ed1-42f1-a1fc-37dc836711d5', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:12:38.621851 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7ed50f40-6511-445d-b033-a3e4d9da67a9 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a9dd4e239c4d73bdde1ced9cb90b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5d1b19c84a4a9fa4595a5c84f4555c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:38.640189 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7ed50f40-6511-445d-b033-a3e4d9da67a9 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd" status: 200 len: 1318 microversion: 2.1 time: 3.019112 Jul 18 02:12:38.641188 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 627/1193] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:35 2022] GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd => generated 1318 bytes in 3021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:12:38.666855 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1dc04968-0f3c-4c8f-811b-57a81eba248a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a87e2dc0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:38.783932 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1dc04968-0f3c-4c8f-811b-57a81eba248a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170" status: 200 len: 1435 microversion: 2.1 time: 0.138735 Jul 18 02:12:38.785259 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 628/1194] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:12:38 2022] GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170 => generated 1435 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:38.794451 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cf8d01bf-cc6a-4165-a113-c93e88e4203f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:38.799146 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cf8d01bf-cc6a-4165-a113-c93e88e4203f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c207a0eb-5ef9-4932-9f3a-22f2a11129e5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:38.823983 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cf8d01bf-cc6a-4165-a113-c93e88e4203f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:38.826832 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cf8d01bf-cc6a-4165-a113-c93e88e4203f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:38.829457 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cf8d01bf-cc6a-4165-a113-c93e88e4203f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:38.850289 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cf8d01bf-cc6a-4165-a113-c93e88e4203f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:40.384824 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-cf8d01bf-cc6a-4165-a113-c93e88e4203f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:40.414576 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cf8d01bf-cc6a-4165-a113-c93e88e4203f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5" status: 200 len: 1317 microversion: 2.1 time: 1.627893 Jul 18 02:12:40.415182 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 629/1195] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:38 2022] GET /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5 => generated 1317 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:40.431285 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-71ad5c7f-f621-4e87-afcd-65518b7c433e req-2241e896-dadc-48e3-a5c1-b6ef3a5560e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c207a0eb-5ef9-4932-9f3a-22f2a11129e5", "tag": "e0557aa1-29d2-4268-a9d8-e4d7f46423d1"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:40.480369 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-71ad5c7f-f621-4e87-afcd-65518b7c433e req-2241e896-dadc-48e3-a5c1-b6ef3a5560e7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:40.481533 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-71ad5c7f-f621-4e87-afcd-65518b7c433e req-2241e896-dadc-48e3-a5c1-b6ef3a5560e7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:40.507131 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-71ad5c7f-f621-4e87-afcd-65518b7c433e req-2241e896-dadc-48e3-a5c1-b6ef3a5560e7 service nova] Creating event network-changed:e0557aa1-29d2-4268-a9d8-e4d7f46423d1 for instance c207a0eb-5ef9-4932-9f3a-22f2a11129e5 on n-h1-465891-3 Jul 18 02:12:40.518976 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-71ad5c7f-f621-4e87-afcd-65518b7c433e req-2241e896-dadc-48e3-a5c1-b6ef3a5560e7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101515 Jul 18 02:12:40.520515 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 630/1196] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:40.529786 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-69c42232-5b94-45c5-8597-4f055c14de39 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:40.540535 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-69c42232-5b94-45c5-8597-4f055c14de39 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] [instance: 32e81b5d-a507-4d47-b76e-699091d0e5bd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:40.576785 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69c42232-5b94-45c5-8597-4f055c14de39 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:40.576785 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69c42232-5b94-45c5-8597-4f055c14de39 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:40.579710 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69c42232-5b94-45c5-8597-4f055c14de39 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:40.580147 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69c42232-5b94-45c5-8597-4f055c14de39 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:40.982584 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-e50d6546-b20b-43d7-9776-db45eabce730 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:12:40.983518 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-e50d6546-b20b-43d7-9776-db45eabce730 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:12:40.983518 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-e50d6546-b20b-43d7-9776-db45eabce730 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:12:40.984225 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-e50d6546-b20b-43d7-9776-db45eabce730 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:12:40.984989 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-e50d6546-b20b-43d7-9776-db45eabce730 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:12:41.003250 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e50d6546-b20b-43d7-9776-db45eabce730 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:41.003708 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e50d6546-b20b-43d7-9776-db45eabce730 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:41.011720 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e50d6546-b20b-43d7-9776-db45eabce730 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:41.012480 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e50d6546-b20b-43d7-9776-db45eabce730 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:41.063969 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-e50d6546-b20b-43d7-9776-db45eabce730 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Getting quotas for project 3a94aaf6ca324e97aec2f6e982416f9b. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:12:41.089578 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-e50d6546-b20b-43d7-9776-db45eabce730 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Getting quotas for user c83428adc93d4dd9a3884659a73bd865 and project 3a94aaf6ca324e97aec2f6e982416f9b. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:12:41.119055 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e50d6546-b20b-43d7-9776-db45eabce730 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:12:41.130679 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e50d6546-b20b-43d7-9776-db45eabce730 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] [instance: 6a9311f2-f5f3-49f0-831e-728291d16d09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:12:41.217128 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e50d6546-b20b-43d7-9776-db45eabce730 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.396724 Jul 18 02:12:41.218671 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 567/1197] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:12:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 5399 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 02:12:41.228793 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ddec2b6b-4274-4d95-bac6-5d8fbdfd5062 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a8aa2ee0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:41.368185 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ddec2b6b-4274-4d95-bac6-5d8fbdfd5062 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170" status: 200 len: 1435 microversion: 2.1 time: 0.148100 Jul 18 02:12:41.369499 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 568/1198] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:12:41 2022] GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170 => generated 1435 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:41.399007 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1d56cf69-0f6d-4e4e-9181-4865030c4fba tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:41.399643 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1d56cf69-0f6d-4e4e-9181-4865030c4fba tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] [instance: 6a9311f2-f5f3-49f0-831e-728291d16d09] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:41.462458 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-69c42232-5b94-45c5-8597-4f055c14de39 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a9dd4e239c4d73bdde1ced9cb90b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5d1b19c84a4a9fa4595a5c84f4555c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:41.521124 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-69c42232-5b94-45c5-8597-4f055c14de39 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd" status: 200 len: 1318 microversion: 2.1 time: 0.998680 Jul 18 02:12:41.578651 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 631/1199] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:40 2022] GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd => generated 1318 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:41.597244 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a1e14cad-f8e1-4ee0-8a9e-f637725793b2 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:41.599260 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a1e14cad-f8e1-4ee0-8a9e-f637725793b2 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c207a0eb-5ef9-4932-9f3a-22f2a11129e5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:41.634510 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a1e14cad-f8e1-4ee0-8a9e-f637725793b2 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:41.635331 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a1e14cad-f8e1-4ee0-8a9e-f637725793b2 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:41.639131 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a1e14cad-f8e1-4ee0-8a9e-f637725793b2 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:41.642748 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a1e14cad-f8e1-4ee0-8a9e-f637725793b2 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:41.747854 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1d56cf69-0f6d-4e4e-9181-4865030c4fba tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83428adc93d4dd9a3884659a73bd865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a94aaf6ca324e97aec2f6e982416f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:41.755875 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1d56cf69-0f6d-4e4e-9181-4865030c4fba tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] 10.222.0.57 "GET /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09" status: 200 len: 1231 microversion: 2.1 time: 0.384982 Jul 18 02:12:41.762528 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 569/1200] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:41 2022] GET /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09 => generated 1231 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:41.768310 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3ae37050-2f59-4e3c-977a-a74b34648078 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-455856180", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "caec55b9-88ff-45af-a9ee-477b3847fbba"}], "security_groups": [{"name": "tempest-securitygroup--111773897"}], "key_name": "tempest-keypair-1215991492", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:42.318287 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-3ae37050-2f59-4e3c-977a-a74b34648078 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] validate_networks() for [('caec55b9-88ff-45af-a9ee-477b3847fbba', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:12:42.387449 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a1e14cad-f8e1-4ee0-8a9e-f637725793b2 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:42.416721 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a1e14cad-f8e1-4ee0-8a9e-f637725793b2 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5" status: 200 len: 1317 microversion: 2.1 time: 0.831688 Jul 18 02:12:42.434996 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 632/1201] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:41 2022] GET /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5 => generated 1317 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:42.455143 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-088638d7-8bae-4950-96e3-d0b8f7437ee0 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a8856940>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:42.605586 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-088638d7-8bae-4950-96e3-d0b8f7437ee0 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170" status: 200 len: 1435 microversion: 2.1 time: 0.168539 Jul 18 02:12:42.608152 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 633/1202] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:12:42 2022] GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170 => generated 1435 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:42.629137 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ea8dc83e-baaf-4d24-ab1e-644aeb687b20 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:42.630427 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ea8dc83e-baaf-4d24-ab1e-644aeb687b20 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] [instance: 32e81b5d-a507-4d47-b76e-699091d0e5bd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:42.650478 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea8dc83e-baaf-4d24-ab1e-644aeb687b20 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:42.652873 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea8dc83e-baaf-4d24-ab1e-644aeb687b20 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:42.654422 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea8dc83e-baaf-4d24-ab1e-644aeb687b20 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:42.655158 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea8dc83e-baaf-4d24-ab1e-644aeb687b20 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:43.080875 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ea8dc83e-baaf-4d24-ab1e-644aeb687b20 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a9dd4e239c4d73bdde1ced9cb90b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5d1b19c84a4a9fa4595a5c84f4555c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:43.115249 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ea8dc83e-baaf-4d24-ab1e-644aeb687b20 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd" status: 200 len: 1318 microversion: 2.1 time: 0.504819 Jul 18 02:12:43.119458 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 634/1203] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:42 2022] GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd => generated 1318 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:43.162670 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-774b84ec-03ef-416f-b101-8e86ad4116ca tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:43.165407 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-774b84ec-03ef-416f-b101-8e86ad4116ca tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] [instance: 6a9311f2-f5f3-49f0-831e-728291d16d09] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:43.196289 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-774b84ec-03ef-416f-b101-8e86ad4116ca tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:43.211488 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-774b84ec-03ef-416f-b101-8e86ad4116ca tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:43.218133 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-774b84ec-03ef-416f-b101-8e86ad4116ca tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:43.224656 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-774b84ec-03ef-416f-b101-8e86ad4116ca tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:43.502831 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-774b84ec-03ef-416f-b101-8e86ad4116ca tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83428adc93d4dd9a3884659a73bd865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a94aaf6ca324e97aec2f6e982416f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:43.522259 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-774b84ec-03ef-416f-b101-8e86ad4116ca tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] 10.222.0.57 "GET /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09" status: 200 len: 1235 microversion: 2.1 time: 0.397961 Jul 18 02:12:43.522864 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 635/1204] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:43 2022] GET /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09 => generated 1235 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:43.532592 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-3ae37050-2f59-4e3c-977a-a74b34648078 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:12:43.536184 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-3ae37050-2f59-4e3c-977a-a74b34648078 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:12:43.537413 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-3ae37050-2f59-4e3c-977a-a74b34648078 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:12:43.538394 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-3ae37050-2f59-4e3c-977a-a74b34648078 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:12:43.539044 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-3ae37050-2f59-4e3c-977a-a74b34648078 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:12:43.570975 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0c8ba9ce-ab1b-48f5-adfb-89b09ca54a55 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:43.572316 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0c8ba9ce-ab1b-48f5-adfb-89b09ca54a55 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c207a0eb-5ef9-4932-9f3a-22f2a11129e5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:43.578985 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3ae37050-2f59-4e3c-977a-a74b34648078 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:43.579448 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3ae37050-2f59-4e3c-977a-a74b34648078 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:43.580342 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3ae37050-2f59-4e3c-977a-a74b34648078 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:43.580779 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3ae37050-2f59-4e3c-977a-a74b34648078 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:43.602946 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c8ba9ce-ab1b-48f5-adfb-89b09ca54a55 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:43.604879 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c8ba9ce-ab1b-48f5-adfb-89b09ca54a55 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:43.608953 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c8ba9ce-ab1b-48f5-adfb-89b09ca54a55 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:43.610375 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c8ba9ce-ab1b-48f5-adfb-89b09ca54a55 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:43.746724 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-3ae37050-2f59-4e3c-977a-a74b34648078 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Getting quotas for project e382977cb6bf4f358fb3245cb3768140. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:12:43.764038 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-3ae37050-2f59-4e3c-977a-a74b34648078 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Getting quotas for user 77381e85d31a4747acb08a8d4572eb1b and project e382977cb6bf4f358fb3245cb3768140. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:12:43.821648 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3ae37050-2f59-4e3c-977a-a74b34648078 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:12:43.826436 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3ae37050-2f59-4e3c-977a-a74b34648078 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:12:43.939491 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3ae37050-2f59-4e3c-977a-a74b34648078 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.175581 Jul 18 02:12:43.941694 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 570/1205] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:12:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 2178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:12:43.955823 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-641da139-d76b-40b7-81ec-6698d1c58ffa tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a8b3bc10>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:44.126368 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-641da139-d76b-40b7-81ec-6698d1c58ffa tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170" status: 200 len: 1435 microversion: 2.1 time: 0.182400 Jul 18 02:12:44.127393 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 571/1206] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:12:43 2022] GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170 => generated 1435 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:44.132400 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e0cf3d68-bf2b-43cf-909b-3138991c6adf tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:44.133032 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e0cf3d68-bf2b-43cf-909b-3138991c6adf tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:44.337593 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e0cf3d68-bf2b-43cf-909b-3138991c6adf tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:44.352686 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e0cf3d68-bf2b-43cf-909b-3138991c6adf tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 200 len: 1234 microversion: 2.1 time: 0.220343 Jul 18 02:12:44.356822 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 572/1207] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:44 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 1234 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:44.362888 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0c8ba9ce-ab1b-48f5-adfb-89b09ca54a55 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:44.385528 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a27651fc-da98-4f13-8468-02a3518b4921 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:44.386193 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a27651fc-da98-4f13-8468-02a3518b4921 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] [instance: 32e81b5d-a507-4d47-b76e-699091d0e5bd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:44.393321 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0c8ba9ce-ab1b-48f5-adfb-89b09ca54a55 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5" status: 200 len: 1317 microversion: 2.1 time: 0.851432 Jul 18 02:12:44.394517 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 636/1208] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:43 2022] GET /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5 => generated 1317 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:44.408915 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a27651fc-da98-4f13-8468-02a3518b4921 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:44.420507 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a27651fc-da98-4f13-8468-02a3518b4921 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:44.421639 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a27651fc-da98-4f13-8468-02a3518b4921 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:44.422135 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a27651fc-da98-4f13-8468-02a3518b4921 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:44.541984 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8a9df2f4-ee59-41ff-a23d-5e42cc6dcb79 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:44.542137 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8a9df2f4-ee59-41ff-a23d-5e42cc6dcb79 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] [instance: 6a9311f2-f5f3-49f0-831e-728291d16d09] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:44.557498 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a9df2f4-ee59-41ff-a23d-5e42cc6dcb79 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:44.557950 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a9df2f4-ee59-41ff-a23d-5e42cc6dcb79 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:44.558777 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a9df2f4-ee59-41ff-a23d-5e42cc6dcb79 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:44.559264 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a9df2f4-ee59-41ff-a23d-5e42cc6dcb79 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:44.740208 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8a9df2f4-ee59-41ff-a23d-5e42cc6dcb79 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83428adc93d4dd9a3884659a73bd865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a94aaf6ca324e97aec2f6e982416f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:44.773265 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8a9df2f4-ee59-41ff-a23d-5e42cc6dcb79 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] 10.222.0.57 "GET /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09" status: 200 len: 1283 microversion: 2.1 time: 0.236213 Jul 18 02:12:44.792792 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 637/1209] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:44 2022] GET /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09 => generated 1283 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:44.890083 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a27651fc-da98-4f13-8468-02a3518b4921 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a9dd4e239c4d73bdde1ced9cb90b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5d1b19c84a4a9fa4595a5c84f4555c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:44.904229 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a27651fc-da98-4f13-8468-02a3518b4921 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd" status: 200 len: 1318 microversion: 2.1 time: 0.545466 Jul 18 02:12:44.905121 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 573/1210] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:44 2022] GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd => generated 1318 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:45.145563 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-95835e77-dc25-4392-83fb-bc5223a1820f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a8856670>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:45.284531 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-95835e77-dc25-4392-83fb-bc5223a1820f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170" status: 200 len: 1435 microversion: 2.1 time: 0.145585 Jul 18 02:12:45.306190 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 638/1211] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:12:45 2022] GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170 => generated 1435 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:12:45.394579 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8a55438b-e00f-4228-ae91-07e3f339c7cd tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:45.398830 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8a55438b-e00f-4228-ae91-07e3f339c7cd tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:45.428356 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-492ba925-1260-427a-92ef-fccfab637d9f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:45.432307 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-492ba925-1260-427a-92ef-fccfab637d9f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c207a0eb-5ef9-4932-9f3a-22f2a11129e5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:45.450233 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=9 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:45.478047 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-492ba925-1260-427a-92ef-fccfab637d9f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:45.479166 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-492ba925-1260-427a-92ef-fccfab637d9f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:45.485930 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-492ba925-1260-427a-92ef-fccfab637d9f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:45.488778 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-492ba925-1260-427a-92ef-fccfab637d9f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:46.007461 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8a55438b-e00f-4228-ae91-07e3f339c7cd tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:46.054496 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8a55438b-e00f-4228-ae91-07e3f339c7cd tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 200 len: 1234 microversion: 2.1 time: 0.676444 Jul 18 02:12:46.058398 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 574/1212] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:45 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 1234 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:46.069007 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-48d2c70d-f1ee-40cf-bd2a-aa6042e13261 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:46.069638 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-48d2c70d-f1ee-40cf-bd2a-aa6042e13261 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] [instance: 6a9311f2-f5f3-49f0-831e-728291d16d09] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:46.087436 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-48d2c70d-f1ee-40cf-bd2a-aa6042e13261 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:46.090799 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-48d2c70d-f1ee-40cf-bd2a-aa6042e13261 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:46.091879 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-48d2c70d-f1ee-40cf-bd2a-aa6042e13261 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:46.092336 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-48d2c70d-f1ee-40cf-bd2a-aa6042e13261 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:46.441093 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-48d2c70d-f1ee-40cf-bd2a-aa6042e13261 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83428adc93d4dd9a3884659a73bd865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a94aaf6ca324e97aec2f6e982416f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:46.460629 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-48d2c70d-f1ee-40cf-bd2a-aa6042e13261 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] 10.222.0.57 "GET /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09" status: 200 len: 1289 microversion: 2.1 time: 0.400978 Jul 18 02:12:46.465395 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 575/1213] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:46 2022] GET /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09 => generated 1289 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:46.477288 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bfae8439-e459-453a-ba43-d94a8a17b7c5 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:46.486876 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bfae8439-e459-453a-ba43-d94a8a17b7c5 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] [instance: 32e81b5d-a507-4d47-b76e-699091d0e5bd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:46.508156 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-492ba925-1260-427a-92ef-fccfab637d9f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:46.515697 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bfae8439-e459-453a-ba43-d94a8a17b7c5 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:46.519763 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bfae8439-e459-453a-ba43-d94a8a17b7c5 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:46.521081 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bfae8439-e459-453a-ba43-d94a8a17b7c5 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:46.524970 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bfae8439-e459-453a-ba43-d94a8a17b7c5 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:46.541136 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-492ba925-1260-427a-92ef-fccfab637d9f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5" status: 200 len: 1317 microversion: 2.1 time: 1.121028 Jul 18 02:12:46.553386 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 639/1214] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:45 2022] GET /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5 => generated 1317 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:46.576435 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-be1e9b39-2ea0-40de-9333-b2a44e630aed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a8856310>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:46.721289 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-be1e9b39-2ea0-40de-9333-b2a44e630aed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170" status: 200 len: 1435 microversion: 2.1 time: 0.159551 Jul 18 02:12:46.722708 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 640/1215] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:12:46 2022] GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170 => generated 1435 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:47.086387 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-52d09a0b-36ce-49eb-a622-eca4b64628f7 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:47.090867 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-52d09a0b-36ce-49eb-a622-eca4b64628f7 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:47.117388 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-52d09a0b-36ce-49eb-a622-eca4b64628f7 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:47.130160 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-52d09a0b-36ce-49eb-a622-eca4b64628f7 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:47.132534 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-52d09a0b-36ce-49eb-a622-eca4b64628f7 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:47.133637 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-52d09a0b-36ce-49eb-a622-eca4b64628f7 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:47.656732 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bfae8439-e459-453a-ba43-d94a8a17b7c5 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a9dd4e239c4d73bdde1ced9cb90b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5d1b19c84a4a9fa4595a5c84f4555c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:47.694049 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bfae8439-e459-453a-ba43-d94a8a17b7c5 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd" status: 200 len: 1318 microversion: 2.1 time: 1.222896 Jul 18 02:12:47.695595 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 576/1216] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:46 2022] GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd => generated 1318 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:47.724822 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fb867452-324c-4278-ac9b-afee492cc7db tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:47.726470 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fb867452-324c-4278-ac9b-afee492cc7db tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] [instance: 6a9311f2-f5f3-49f0-831e-728291d16d09] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:47.734970 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-52d09a0b-36ce-49eb-a622-eca4b64628f7 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:47.755274 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fb867452-324c-4278-ac9b-afee492cc7db tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:47.760063 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fb867452-324c-4278-ac9b-afee492cc7db tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:47.762058 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fb867452-324c-4278-ac9b-afee492cc7db tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:47.765763 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fb867452-324c-4278-ac9b-afee492cc7db tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:47.775551 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-52d09a0b-36ce-49eb-a622-eca4b64628f7 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 200 len: 1304 microversion: 2.1 time: 0.697197 Jul 18 02:12:47.791697 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 641/1217] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:47 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 1304 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:12:47.813518 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0b8fbc84-3fbc-4002-aa88-bad6c42f045b tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:47.815303 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0b8fbc84-3fbc-4002-aa88-bad6c42f045b tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c207a0eb-5ef9-4932-9f3a-22f2a11129e5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:47.845077 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0b8fbc84-3fbc-4002-aa88-bad6c42f045b tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:47.850689 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0b8fbc84-3fbc-4002-aa88-bad6c42f045b tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:47.852397 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0b8fbc84-3fbc-4002-aa88-bad6c42f045b tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:47.853415 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0b8fbc84-3fbc-4002-aa88-bad6c42f045b tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:47.853900 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:49.015571 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fb867452-324c-4278-ac9b-afee492cc7db tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83428adc93d4dd9a3884659a73bd865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a94aaf6ca324e97aec2f6e982416f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:49.035214 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fb867452-324c-4278-ac9b-afee492cc7db tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] 10.222.0.57 "GET /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09" status: 200 len: 1289 microversion: 2.1 time: 1.325698 Jul 18 02:12:49.036132 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 577/1218] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:47 2022] GET /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09 => generated 1289 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:49.050255 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f128c0e0-b4b0-402a-a08c-cc1cadfbba4e tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a8a55310>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:49.140878 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f128c0e0-b4b0-402a-a08c-cc1cadfbba4e tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170" status: 200 len: 1435 microversion: 2.1 time: 0.103045 Jul 18 02:12:49.141485 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 578/1219] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:12:49 2022] GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170 => generated 1435 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:49.154024 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0b8fbc84-3fbc-4002-aa88-bad6c42f045b tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:49.155651 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-67144b57-230b-492e-8aca-9c3a009b34a2 req-78aee09e-7fcf-4e4c-984e-6388d74833bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32e81b5d-a507-4d47-b76e-699091d0e5bd", "name": "network-vif-plugged", "status": "completed", "tag": "07f51000-5732-46e7-8e0e-0bd9c61e7698"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:49.167193 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0b8fbc84-3fbc-4002-aa88-bad6c42f045b tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5" status: 200 len: 1317 microversion: 2.1 time: 1.373901 Jul 18 02:12:49.167790 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 642/1220] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:47 2022] GET /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5 => generated 1317 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:49.172937 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e8269d7e-2917-4b87-b028-145ad47a3881 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:49.183165 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e8269d7e-2917-4b87-b028-145ad47a3881 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] [instance: 32e81b5d-a507-4d47-b76e-699091d0e5bd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:49.185221 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-67144b57-230b-492e-8aca-9c3a009b34a2 req-78aee09e-7fcf-4e4c-984e-6388d74833bb service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:49.186202 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-67144b57-230b-492e-8aca-9c3a009b34a2 req-78aee09e-7fcf-4e4c-984e-6388d74833bb service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:49.196563 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e8269d7e-2917-4b87-b028-145ad47a3881 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:49.197355 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e8269d7e-2917-4b87-b028-145ad47a3881 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:49.198778 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e8269d7e-2917-4b87-b028-145ad47a3881 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:49.199469 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e8269d7e-2917-4b87-b028-145ad47a3881 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:49.214561 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-67144b57-230b-492e-8aca-9c3a009b34a2 req-78aee09e-7fcf-4e4c-984e-6388d74833bb service nova] Creating event network-vif-plugged:07f51000-5732-46e7-8e0e-0bd9c61e7698 for instance 32e81b5d-a507-4d47-b76e-699091d0e5bd on n-h2-465891-3 Jul 18 02:12:49.228354 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-67144b57-230b-492e-8aca-9c3a009b34a2 req-78aee09e-7fcf-4e4c-984e-6388d74833bb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082059 Jul 18 02:12:49.229047 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 579/1221] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:49.244061 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-25f0df55-7dcc-440f-be85-bdf211287934 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:49.247737 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-25f0df55-7dcc-440f-be85-bdf211287934 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:49.264913 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-25f0df55-7dcc-440f-be85-bdf211287934 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:49.269268 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-25f0df55-7dcc-440f-be85-bdf211287934 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:49.273678 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-25f0df55-7dcc-440f-be85-bdf211287934 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:49.274439 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-25f0df55-7dcc-440f-be85-bdf211287934 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:50.215536 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-25f0df55-7dcc-440f-be85-bdf211287934 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:50.232107 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-25f0df55-7dcc-440f-be85-bdf211287934 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 200 len: 1292 microversion: 2.1 time: 0.998655 Jul 18 02:12:50.232732 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 580/1222] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:49 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 1292 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:50.246595 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ac7518b9-3dc2-4f6a-9180-e06c32d590c0 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:50.247563 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ac7518b9-3dc2-4f6a-9180-e06c32d590c0 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] [instance: 6a9311f2-f5f3-49f0-831e-728291d16d09] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:50.263555 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ac7518b9-3dc2-4f6a-9180-e06c32d590c0 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:50.264353 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ac7518b9-3dc2-4f6a-9180-e06c32d590c0 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:50.265401 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ac7518b9-3dc2-4f6a-9180-e06c32d590c0 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:50.266136 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ac7518b9-3dc2-4f6a-9180-e06c32d590c0 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:51.480683 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e8269d7e-2917-4b87-b028-145ad47a3881 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a9dd4e239c4d73bdde1ced9cb90b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5d1b19c84a4a9fa4595a5c84f4555c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:51.528207 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e8269d7e-2917-4b87-b028-145ad47a3881 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd" status: 200 len: 1318 microversion: 2.1 time: 2.358694 Jul 18 02:12:51.534031 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 643/1223] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:49 2022] GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd => generated 1318 bytes in 2365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:51.551300 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a825854e-961a-426e-a19b-bf19cae7f130 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a8999a60>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:51.706180 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a825854e-961a-426e-a19b-bf19cae7f130 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170" status: 200 len: 1435 microversion: 2.1 time: 0.170040 Jul 18 02:12:51.706978 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 644/1224] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:12:51 2022] GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170 => generated 1435 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:51.722170 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9a383488-3435-462a-8726-c5fa4dba4fe5 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:51.723663 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9a383488-3435-462a-8726-c5fa4dba4fe5 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c207a0eb-5ef9-4932-9f3a-22f2a11129e5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:51.751129 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9a383488-3435-462a-8726-c5fa4dba4fe5 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:51.755134 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9a383488-3435-462a-8726-c5fa4dba4fe5 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:51.756962 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9a383488-3435-462a-8726-c5fa4dba4fe5 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:51.757432 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9a383488-3435-462a-8726-c5fa4dba4fe5 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:51.777994 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ac7518b9-3dc2-4f6a-9180-e06c32d590c0 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83428adc93d4dd9a3884659a73bd865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a94aaf6ca324e97aec2f6e982416f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:51.824577 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ac7518b9-3dc2-4f6a-9180-e06c32d590c0 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] 10.222.0.57 "GET /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09" status: 200 len: 1331 microversion: 2.1 time: 1.590016 Jul 18 02:12:51.830616 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 581/1225] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:50 2022] GET /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09 => generated 1331 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:51.871106 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-41f3f5bc-e7da-4a4c-9f52-c8cb149262b6 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:51.872671 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-41f3f5bc-e7da-4a4c-9f52-c8cb149262b6 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:51.920356 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41f3f5bc-e7da-4a4c-9f52-c8cb149262b6 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:51.921755 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41f3f5bc-e7da-4a4c-9f52-c8cb149262b6 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:51.923529 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41f3f5bc-e7da-4a4c-9f52-c8cb149262b6 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:51.930022 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41f3f5bc-e7da-4a4c-9f52-c8cb149262b6 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:52.469178 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-41f3f5bc-e7da-4a4c-9f52-c8cb149262b6 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:52.506978 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-41f3f5bc-e7da-4a4c-9f52-c8cb149262b6 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 200 len: 1292 microversion: 2.1 time: 0.673994 Jul 18 02:12:52.515836 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 582/1226] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:51 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 1292 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:52.536532 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-b183ae48-7423-40e7-8610-0ca9ea967134 req-f314db9d-56ba-4b16-a041-78104f951682 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c207a0eb-5ef9-4932-9f3a-22f2a11129e5", "name": "network-vif-plugged", "status": "completed", "tag": "e0557aa1-29d2-4268-a9d8-e4d7f46423d1"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:52.587958 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-b183ae48-7423-40e7-8610-0ca9ea967134 req-f314db9d-56ba-4b16-a041-78104f951682 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:52.590889 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-b183ae48-7423-40e7-8610-0ca9ea967134 req-f314db9d-56ba-4b16-a041-78104f951682 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:52.664768 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-b183ae48-7423-40e7-8610-0ca9ea967134 req-f314db9d-56ba-4b16-a041-78104f951682 service nova] Creating event network-vif-plugged:e0557aa1-29d2-4268-a9d8-e4d7f46423d1 for instance c207a0eb-5ef9-4932-9f3a-22f2a11129e5 on n-h1-465891-3 Jul 18 02:12:52.692419 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-b183ae48-7423-40e7-8610-0ca9ea967134 req-f314db9d-56ba-4b16-a041-78104f951682 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167054 Jul 18 02:12:52.696259 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 583/1227] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:52.701605 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9a383488-3435-462a-8726-c5fa4dba4fe5 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:52.717072 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9a383488-3435-462a-8726-c5fa4dba4fe5 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5" status: 200 len: 1317 microversion: 2.1 time: 1.008683 Jul 18 02:12:52.725927 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c531d17e-4209-49a8-bd0a-e64e9f4f40e2 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:52.728538 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c531d17e-4209-49a8-bd0a-e64e9f4f40e2 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] [instance: 32e81b5d-a507-4d47-b76e-699091d0e5bd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:52.731897 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 645/1228] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:51 2022] GET /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5 => generated 1317 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:52.746052 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0a7549ac-26a0-4ef6-831d-7d0f422d9997 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a8856820>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:52.763763 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c531d17e-4209-49a8-bd0a-e64e9f4f40e2 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:52.768876 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c531d17e-4209-49a8-bd0a-e64e9f4f40e2 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:52.772344 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c531d17e-4209-49a8-bd0a-e64e9f4f40e2 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:52.776762 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c531d17e-4209-49a8-bd0a-e64e9f4f40e2 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:53.075370 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0a7549ac-26a0-4ef6-831d-7d0f422d9997 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170" status: 200 len: 1435 microversion: 2.1 time: 0.336503 Jul 18 02:12:53.077228 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 646/1229] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:12:52 2022] GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170 => generated 1435 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:53.099028 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c000e1e4-8a49-416d-bfc4-0497f04e829e tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:53.102954 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c000e1e4-8a49-416d-bfc4-0497f04e829e tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] [instance: 6a9311f2-f5f3-49f0-831e-728291d16d09] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:53.133926 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c000e1e4-8a49-416d-bfc4-0497f04e829e tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:53.135115 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c000e1e4-8a49-416d-bfc4-0497f04e829e tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:53.159410 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c000e1e4-8a49-416d-bfc4-0497f04e829e tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:53.160975 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c000e1e4-8a49-416d-bfc4-0497f04e829e tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:53.664966 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=4 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:54.334422 n-d-465891-3 devstack@n-api.service[119543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 02:12:54.334746 n-d-465891-3 devstack@n-api.service[119543]: Mon Jul 18 02:12:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd (ip 10.222.0.57) !!! Jul 18 02:12:54.950548 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c000e1e4-8a49-416d-bfc4-0497f04e829e tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83428adc93d4dd9a3884659a73bd865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a94aaf6ca324e97aec2f6e982416f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:55.002903 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c000e1e4-8a49-416d-bfc4-0497f04e829e tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] 10.222.0.57 "GET /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09" status: 200 len: 1331 microversion: 2.1 time: 1.917174 Jul 18 02:12:55.013960 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 647/1230] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:53 2022] GET /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09 => generated 1331 bytes in 1936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:55.056066 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4afe5df4-ecc3-41a7-bdd9-552aab86ef7c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:55.057282 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4afe5df4-ecc3-41a7-bdd9-552aab86ef7c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:55.102576 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4afe5df4-ecc3-41a7-bdd9-552aab86ef7c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:55.104869 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4afe5df4-ecc3-41a7-bdd9-552aab86ef7c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:55.113554 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4afe5df4-ecc3-41a7-bdd9-552aab86ef7c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:55.118036 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4afe5df4-ecc3-41a7-bdd9-552aab86ef7c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:55.213551 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c531d17e-4209-49a8-bd0a-e64e9f4f40e2 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a9dd4e239c4d73bdde1ced9cb90b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5d1b19c84a4a9fa4595a5c84f4555c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:55.255188 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c531d17e-4209-49a8-bd0a-e64e9f4f40e2 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd" status: 200 len: 1318 microversion: 2.1 time: 2.550991 Jul 18 02:12:55.270168 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 584/1231] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:52 2022] GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd => generated 1318 bytes in 2563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:55.316742 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-083c2650-adc5-43ad-ac0a-c2f1142701bb tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:55.324017 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-083c2650-adc5-43ad-ac0a-c2f1142701bb tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c207a0eb-5ef9-4932-9f3a-22f2a11129e5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:55.369419 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-083c2650-adc5-43ad-ac0a-c2f1142701bb tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:55.370897 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-083c2650-adc5-43ad-ac0a-c2f1142701bb tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:55.374045 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-083c2650-adc5-43ad-ac0a-c2f1142701bb tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:55.375356 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-083c2650-adc5-43ad-ac0a-c2f1142701bb tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:56.039409 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=18 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:57.609218 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-083c2650-adc5-43ad-ac0a-c2f1142701bb tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:57.624705 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-083c2650-adc5-43ad-ac0a-c2f1142701bb tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5" status: 200 len: 1317 microversion: 2.1 time: 2.351843 Jul 18 02:12:57.625322 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 585/1232] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:55 2022] GET /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5 => generated 1317 bytes in 2363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:57.682992 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6610173b-1595-4c4e-ac1b-1fadbc94ddf1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a8b3b430>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:57.854111 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6610173b-1595-4c4e-ac1b-1fadbc94ddf1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170" status: 200 len: 1435 microversion: 2.1 time: 0.204542 Jul 18 02:12:57.855505 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 586/1233] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:12:57 2022] GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170 => generated 1435 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:57.876813 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f704ef8f-6016-4c72-97f6-8381c1a2e3bc tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:57.878685 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f704ef8f-6016-4c72-97f6-8381c1a2e3bc tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] [instance: 6a9311f2-f5f3-49f0-831e-728291d16d09] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:57.911533 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f704ef8f-6016-4c72-97f6-8381c1a2e3bc tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:57.916429 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f704ef8f-6016-4c72-97f6-8381c1a2e3bc tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:57.918419 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f704ef8f-6016-4c72-97f6-8381c1a2e3bc tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:57.920437 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f704ef8f-6016-4c72-97f6-8381c1a2e3bc tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:58.267512 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4afe5df4-ecc3-41a7-bdd9-552aab86ef7c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:58.299838 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4afe5df4-ecc3-41a7-bdd9-552aab86ef7c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 200 len: 1359 microversion: 2.1 time: 3.283588 Jul 18 02:12:58.301792 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 648/1234] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:55 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 1359 bytes in 3287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:58.317662 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9f6baa64-6e2e-4e51-a4d0-6fc55042823c tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:58.319456 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9f6baa64-6e2e-4e51-a4d0-6fc55042823c tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] [instance: 32e81b5d-a507-4d47-b76e-699091d0e5bd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:58.326126 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=43 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:58.339622 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9f6baa64-6e2e-4e51-a4d0-6fc55042823c tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:58.341870 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9f6baa64-6e2e-4e51-a4d0-6fc55042823c tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:58.346049 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9f6baa64-6e2e-4e51-a4d0-6fc55042823c tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:58.354676 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9f6baa64-6e2e-4e51-a4d0-6fc55042823c tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:59.019058 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9f6baa64-6e2e-4e51-a4d0-6fc55042823c tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a9dd4e239c4d73bdde1ced9cb90b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5d1b19c84a4a9fa4595a5c84f4555c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:59.040928 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9f6baa64-6e2e-4e51-a4d0-6fc55042823c tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd" status: 200 len: 1468 microversion: 2.1 time: 0.731396 Jul 18 02:12:59.042053 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 649/1235] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:58 2022] GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd => generated 1468 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:59.057492 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5ebe7e03-a203-42a1-ba77-f11dc785ad3b tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:59.063540 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5ebe7e03-a203-42a1-ba77-f11dc785ad3b tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c207a0eb-5ef9-4932-9f3a-22f2a11129e5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:59.081771 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ebe7e03-a203-42a1-ba77-f11dc785ad3b tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:59.084010 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ebe7e03-a203-42a1-ba77-f11dc785ad3b tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:59.086489 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ebe7e03-a203-42a1-ba77-f11dc785ad3b tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:59.089181 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ebe7e03-a203-42a1-ba77-f11dc785ad3b tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:59.136840 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=100 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:59.670641 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f704ef8f-6016-4c72-97f6-8381c1a2e3bc tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83428adc93d4dd9a3884659a73bd865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a94aaf6ca324e97aec2f6e982416f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:59.708445 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f704ef8f-6016-4c72-97f6-8381c1a2e3bc tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] 10.222.0.57 "GET /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09" status: 200 len: 1331 microversion: 2.1 time: 1.850419 Jul 18 02:12:59.718803 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 587/1236] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:57 2022] GET /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09 => generated 1331 bytes in 1862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:59.749375 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-37b3019b-0d5f-4a16-ad00-241e672fe80c tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a8b31310>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:59.982561 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-37b3019b-0d5f-4a16-ad00-241e672fe80c tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170" status: 200 len: 1435 microversion: 2.1 time: 0.262068 Jul 18 02:12:59.983410 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 588/1237] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:12:59 2022] GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170 => generated 1435 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:00.008659 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d50e934d-094f-4441-b21d-8f35e689063f tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:00.009792 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d50e934d-094f-4441-b21d-8f35e689063f tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] [instance: 697075ff-db42-4729-8faf-2c2935d72630] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:00.019004 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d50e934d-094f-4441-b21d-8f35e689063f tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:00.020046 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d50e934d-094f-4441-b21d-8f35e689063f tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:00.021471 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d50e934d-094f-4441-b21d-8f35e689063f tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:00.022759 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d50e934d-094f-4441-b21d-8f35e689063f tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:01.641063 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5ebe7e03-a203-42a1-ba77-f11dc785ad3b tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:01.660713 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5ebe7e03-a203-42a1-ba77-f11dc785ad3b tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5" status: 200 len: 1467 microversion: 2.1 time: 2.617169 Jul 18 02:13:01.663868 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 650/1238] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:59 2022] GET /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5 => generated 1467 bytes in 2621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:01.680959 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-95628f58-b5c5-4448-84da-2305b5f09ffa tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:01.682008 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-95628f58-b5c5-4448-84da-2305b5f09ffa tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:01.696973 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d50e934d-094f-4441-b21d-8f35e689063f tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a9dd4e239c4d73bdde1ced9cb90b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5d1b19c84a4a9fa4595a5c84f4555c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:01.713223 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d50e934d-094f-4441-b21d-8f35e689063f tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/servers/697075ff-db42-4729-8faf-2c2935d72630" status: 200 len: 1468 microversion: 2.1 time: 1.724113 Jul 18 02:13:01.715246 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-95628f58-b5c5-4448-84da-2305b5f09ffa tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:01.716221 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-95628f58-b5c5-4448-84da-2305b5f09ffa tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:01.717134 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 589/1239] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:59 2022] GET /compute/v2.1/servers/697075ff-db42-4729-8faf-2c2935d72630 => generated 1468 bytes in 1729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:01.718346 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-95628f58-b5c5-4448-84da-2305b5f09ffa tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:01.721334 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-95628f58-b5c5-4448-84da-2305b5f09ffa tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:01.735625 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-4d9ec4ba-6929-46b3-8309-e54a2a44f71d req-5b3c6546-5ca8-416d-b490-5aa3ac41cb59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a9311f2-f5f3-49f0-831e-728291d16d09", "tag": "f691d4d0-5b03-4b49-81fe-72116c2da4cb"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:01.761196 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-4d9ec4ba-6929-46b3-8309-e54a2a44f71d req-5b3c6546-5ca8-416d-b490-5aa3ac41cb59 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:01.762889 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-4d9ec4ba-6929-46b3-8309-e54a2a44f71d req-5b3c6546-5ca8-416d-b490-5aa3ac41cb59 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:01.799791 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-4d9ec4ba-6929-46b3-8309-e54a2a44f71d req-5b3c6546-5ca8-416d-b490-5aa3ac41cb59 service nova] Creating event network-changed:f691d4d0-5b03-4b49-81fe-72116c2da4cb for instance 6a9311f2-f5f3-49f0-831e-728291d16d09 on n-h1-465891-3 Jul 18 02:13:01.815256 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-4d9ec4ba-6929-46b3-8309-e54a2a44f71d req-5b3c6546-5ca8-416d-b490-5aa3ac41cb59 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095303 Jul 18 02:13:01.816511 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 590/1240] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:01.827579 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8bb4272a-4a27-4959-a086-87e2576511ab tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:01.829899 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8bb4272a-4a27-4959-a086-87e2576511ab tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] [instance: 6a9311f2-f5f3-49f0-831e-728291d16d09] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:01.840438 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8bb4272a-4a27-4959-a086-87e2576511ab tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:01.841646 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8bb4272a-4a27-4959-a086-87e2576511ab tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:01.843465 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8bb4272a-4a27-4959-a086-87e2576511ab tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:01.844911 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8bb4272a-4a27-4959-a086-87e2576511ab tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:02.931118 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-95628f58-b5c5-4448-84da-2305b5f09ffa tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:02.982116 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-95628f58-b5c5-4448-84da-2305b5f09ffa tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 200 len: 1359 microversion: 2.1 time: 1.308939 Jul 18 02:13:02.983691 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 651/1241] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:01 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 1359 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:02.995157 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8bb4272a-4a27-4959-a086-87e2576511ab tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83428adc93d4dd9a3884659a73bd865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a94aaf6ca324e97aec2f6e982416f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:03.008569 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8bb4272a-4a27-4959-a086-87e2576511ab tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] 10.222.0.57 "GET /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09" status: 200 len: 1331 microversion: 2.1 time: 1.190501 Jul 18 02:13:03.011810 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 591/1242] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:01 2022] GET /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09 => generated 1331 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:03.014996 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-82038e80-cac7-4b2a-a930-75e4fce20d14 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a88c6430>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:03.082577 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-82038e80-cac7-4b2a-a930-75e4fce20d14 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170" status: 200 len: 1435 microversion: 2.1 time: 0.095634 Jul 18 02:13:03.083956 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 652/1243] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:13:02 2022] GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170 => generated 1435 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:03.090865 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8543d1c8-0245-4ba0-b782-6e414d5b3dbf tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-898477603"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:03.092605 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8543d1c8-0245-4ba0-b782-6e414d5b3dbf tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] [instance: 697075ff-db42-4729-8faf-2c2935d72630] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:03.104405 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8543d1c8-0245-4ba0-b782-6e414d5b3dbf tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:03.105291 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8543d1c8-0245-4ba0-b782-6e414d5b3dbf tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:03.106859 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8543d1c8-0245-4ba0-b782-6e414d5b3dbf tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:03.108313 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8543d1c8-0245-4ba0-b782-6e414d5b3dbf tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:03.614384 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6039948d-544d-43e0-bcc0-72b8232187f7 tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:03.616353 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6039948d-544d-43e0-bcc0-72b8232187f7 tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] [instance: c207a0eb-5ef9-4932-9f3a-22f2a11129e5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:03.635251 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6039948d-544d-43e0-bcc0-72b8232187f7 tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:03.641069 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6039948d-544d-43e0-bcc0-72b8232187f7 tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:03.646754 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6039948d-544d-43e0-bcc0-72b8232187f7 tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:03.649008 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6039948d-544d-43e0-bcc0-72b8232187f7 tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:03.664655 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8543d1c8-0245-4ba0-b782-6e414d5b3dbf tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "POST /compute/v2.1/servers/697075ff-db42-4729-8faf-2c2935d72630/action" status: 202 len: 0 microversion: 2.1 time: 0.577983 Jul 18 02:13:03.680831 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 653/1244] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:13:03 2022] POST /compute/v2.1/servers/697075ff-db42-4729-8faf-2c2935d72630/action => generated 0 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 18 02:13:03.696763 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-328fe138-4e90-4a72-b891-7f080fb30851 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a87a2700>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:03.895493 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-328fe138-4e90-4a72-b891-7f080fb30851 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/425813c1-df02-409a-9f52-bd406789b9d0" status: 200 len: 1454 microversion: 2.1 time: 0.206673 Jul 18 02:13:03.897204 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 654/1245] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:13:03 2022] GET /compute/v2.1/images/425813c1-df02-409a-9f52-bd406789b9d0 => generated 1454 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:03.932194 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-a3a7f52b-d770-42d9-a25d-c16e564c5c8f req-0d3e76a7-50d8-4c5d-b180-054f98b8cf59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19592434-cafa-4e79-a790-0674ab77672f", "tag": "4c9f9136-52be-4062-9d09-7fd94b7a5870"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:03.987098 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-a3a7f52b-d770-42d9-a25d-c16e564c5c8f req-0d3e76a7-50d8-4c5d-b180-054f98b8cf59 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:03.987612 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-a3a7f52b-d770-42d9-a25d-c16e564c5c8f req-0d3e76a7-50d8-4c5d-b180-054f98b8cf59 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:04.043500 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-a3a7f52b-d770-42d9-a25d-c16e564c5c8f req-0d3e76a7-50d8-4c5d-b180-054f98b8cf59 service nova] Creating event network-changed:4c9f9136-52be-4062-9d09-7fd94b7a5870 for instance 19592434-cafa-4e79-a790-0674ab77672f on n-h1-465891-3 Jul 18 02:13:04.057291 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-a3a7f52b-d770-42d9-a25d-c16e564c5c8f req-0d3e76a7-50d8-4c5d-b180-054f98b8cf59 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155465 Jul 18 02:13:04.057926 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 655/1246] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:04.078440 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0189b0b0-0973-44d4-ab8f-058f2a13f578 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:04.079947 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0189b0b0-0973-44d4-ab8f-058f2a13f578 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:04.115405 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0189b0b0-0973-44d4-ab8f-058f2a13f578 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:04.115859 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0189b0b0-0973-44d4-ab8f-058f2a13f578 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:04.118235 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0189b0b0-0973-44d4-ab8f-058f2a13f578 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:04.119400 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0189b0b0-0973-44d4-ab8f-058f2a13f578 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:04.553029 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0189b0b0-0973-44d4-ab8f-058f2a13f578 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:04.568506 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0189b0b0-0973-44d4-ab8f-058f2a13f578 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 200 len: 1359 microversion: 2.1 time: 0.504363 Jul 18 02:13:04.575910 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 656/1247] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:04 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 1359 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:04.590764 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b15ec79c-abb9-40e0-9860-8a58a7560446 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:04.591725 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b15ec79c-abb9-40e0-9860-8a58a7560446 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] [instance: 6a9311f2-f5f3-49f0-831e-728291d16d09] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:04.616839 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b15ec79c-abb9-40e0-9860-8a58a7560446 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:04.617518 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b15ec79c-abb9-40e0-9860-8a58a7560446 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:04.620094 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b15ec79c-abb9-40e0-9860-8a58a7560446 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:04.621454 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b15ec79c-abb9-40e0-9860-8a58a7560446 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:05.816285 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6039948d-544d-43e0-bcc0-72b8232187f7 tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5" status: 200 len: 1618 microversion: 2.1 time: 2.799018 Jul 18 02:13:05.819116 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 592/1248] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:03 2022] GET /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5 => generated 1618 bytes in 2806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:05.834045 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a8e3fc32-bd9e-48a6-b136-c27af89281db tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a8a55ca0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:05.872593 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b15ec79c-abb9-40e0-9860-8a58a7560446 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83428adc93d4dd9a3884659a73bd865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a94aaf6ca324e97aec2f6e982416f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:05.881019 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b15ec79c-abb9-40e0-9860-8a58a7560446 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] 10.222.0.57 "GET /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09" status: 200 len: 1331 microversion: 2.1 time: 1.303587 Jul 18 02:13:05.892113 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 657/1249] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:04 2022] GET /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09 => generated 1331 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:05.896180 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6d135be7-f717-441e-8790-c2b6876e0e85 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a8a13e50>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:05.925892 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a8e3fc32-bd9e-48a6-b136-c27af89281db tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170" status: 200 len: 1444 microversion: 2.1 time: 0.105010 Jul 18 02:13:05.927318 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 593/1250] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:13:05 2022] GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:05.932602 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e46a51b5-027e-4717-a8f8-81c050cab73a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:05.934129 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e46a51b5-027e-4717-a8f8-81c050cab73a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:05.942059 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e46a51b5-027e-4717-a8f8-81c050cab73a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:05.942791 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e46a51b5-027e-4717-a8f8-81c050cab73a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:05.944847 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e46a51b5-027e-4717-a8f8-81c050cab73a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:05.945397 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e46a51b5-027e-4717-a8f8-81c050cab73a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:06.001742 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6d135be7-f717-441e-8790-c2b6876e0e85 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/425813c1-df02-409a-9f52-bd406789b9d0" status: 200 len: 1454 microversion: 2.1 time: 0.113821 Jul 18 02:13:06.002389 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 658/1251] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:13:05 2022] GET /compute/v2.1/images/425813c1-df02-409a-9f52-bd406789b9d0 => generated 1454 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:06.020555 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-70dd001a-736d-4b32-a570-32110d026c04 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Action: 'create', calling method: .version_select at 0x7ff4a87a21f0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1145662403", "policies": ["affinity"]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:06.077637 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-70dd001a-736d-4b32-a570-32110d026c04 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Getting quotas for project 8f8bb1ebead3481f946ae7878c3cfc41. Resources: {'server_groups'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:13:06.089297 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-70dd001a-736d-4b32-a570-32110d026c04 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Getting quotas for user 100f65c0d9d3456fa177599821aed7ff and project 8f8bb1ebead3481f946ae7878c3cfc41. Resources: {'server_groups'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:13:06.194953 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-70dd001a-736d-4b32-a570-32110d026c04 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Getting quotas for project 8f8bb1ebead3481f946ae7878c3cfc41. Resources: {'server_groups'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:13:06.206524 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-70dd001a-736d-4b32-a570-32110d026c04 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Getting quotas for user 100f65c0d9d3456fa177599821aed7ff and project 8f8bb1ebead3481f946ae7878c3cfc41. Resources: {'server_groups'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:13:06.226996 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-70dd001a-736d-4b32-a570-32110d026c04 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.214668 Jul 18 02:13:06.228445 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 659/1252] 10.222.0.57 () {60 vars in 1173 bytes} [Mon Jul 18 02:13:06 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:06.234079 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-21a46467-d920-4051-8356-d92f9b29cf80 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a87e2790>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:06.310124 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-21a46467-d920-4051-8356-d92f9b29cf80 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170" status: 200 len: 1444 microversion: 2.1 time: 0.079818 Jul 18 02:13:06.311640 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 660/1253] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:13:06 2022] GET /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170 => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:06.337891 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5a0e1d2c-bc56-43fd-a901-a0a25ddac785 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a87a2ee0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:07.388608 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e46a51b5-027e-4717-a8f8-81c050cab73a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:07.422081 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e46a51b5-027e-4717-a8f8-81c050cab73a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 200 len: 1359 microversion: 2.1 time: 1.492910 Jul 18 02:13:07.431530 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 594/1254] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:05 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 1359 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:07.452382 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c5c7276d-08c6-4801-b1e2-8bcf026205b6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-281849279", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "79c8cde4-43d9-44ee-a52f-1013fc485b00"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:07.644210 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-c5c7276d-08c6-4801-b1e2-8bcf026205b6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] validate_networks() for None {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:13:07.846131 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5a0e1d2c-bc56-43fd-a901-a0a25ddac785 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "DELETE /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170" status: 204 len: 0 microversion: 2.1 time: 1.515137 Jul 18 02:13:07.852370 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 661/1255] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:06 2022] DELETE /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170 => generated 0 bytes in 1519 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:13:07.873684 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-120551d5-1130-44f5-8a51-7eb13f22eb48 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:07.880931 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-120551d5-1130-44f5-8a51-7eb13f22eb48 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] [instance: 6a9311f2-f5f3-49f0-831e-728291d16d09] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:07.921843 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-120551d5-1130-44f5-8a51-7eb13f22eb48 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:07.923530 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-120551d5-1130-44f5-8a51-7eb13f22eb48 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:07.925037 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-120551d5-1130-44f5-8a51-7eb13f22eb48 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:07.925840 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-120551d5-1130-44f5-8a51-7eb13f22eb48 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:08.857879 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-120551d5-1130-44f5-8a51-7eb13f22eb48 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83428adc93d4dd9a3884659a73bd865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a94aaf6ca324e97aec2f6e982416f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:08.882052 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-120551d5-1130-44f5-8a51-7eb13f22eb48 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] 10.222.0.57 "GET /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09" status: 200 len: 1331 microversion: 2.1 time: 1.032328 Jul 18 02:13:08.884742 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 662/1256] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:07 2022] GET /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09 => generated 1331 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:08.895703 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fa3dd315-6f46-4f0c-b8df-c0aeb920bfa5 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a87cdca0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:08.965999 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fa3dd315-6f46-4f0c-b8df-c0aeb920bfa5 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/425813c1-df02-409a-9f52-bd406789b9d0" status: 200 len: 1454 microversion: 2.1 time: 0.079609 Jul 18 02:13:08.966665 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 663/1257] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:13:08 2022] GET /compute/v2.1/images/425813c1-df02-409a-9f52-bd406789b9d0 => generated 1454 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:09.191887 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-06c730d7-5509-4f2c-84c4-07b4daec13df tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-861389333", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "e94427d9-3817-4c97-8760-c29504bd94db"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:09.419791 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-06c730d7-5509-4f2c-84c4-07b4daec13df tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] validate_networks() for [('e94427d9-3817-4c97-8760-c29504bd94db', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:13:10.383183 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-c5c7276d-08c6-4801-b1e2-8bcf026205b6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:13:10.383860 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-c5c7276d-08c6-4801-b1e2-8bcf026205b6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:13:10.384691 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-c5c7276d-08c6-4801-b1e2-8bcf026205b6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:13:10.385367 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-c5c7276d-08c6-4801-b1e2-8bcf026205b6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:13:10.386104 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-c5c7276d-08c6-4801-b1e2-8bcf026205b6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:13:10.489740 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c5c7276d-08c6-4801-b1e2-8bcf026205b6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:10.490568 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c5c7276d-08c6-4801-b1e2-8bcf026205b6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:10.492158 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c5c7276d-08c6-4801-b1e2-8bcf026205b6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:10.492945 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c5c7276d-08c6-4801-b1e2-8bcf026205b6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:10.572271 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-c5c7276d-08c6-4801-b1e2-8bcf026205b6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Getting quotas for project 8f8bb1ebead3481f946ae7878c3cfc41. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:13:10.584825 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-c5c7276d-08c6-4801-b1e2-8bcf026205b6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Getting quotas for user 100f65c0d9d3456fa177599821aed7ff and project 8f8bb1ebead3481f946ae7878c3cfc41. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:13:10.645930 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c5c7276d-08c6-4801-b1e2-8bcf026205b6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Going to run 2 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:13:10.687569 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c5c7276d-08c6-4801-b1e2-8bcf026205b6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: a6859225-d99c-41c5-a08b-dd4836bd82c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:13:10.851353 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-c5c7276d-08c6-4801-b1e2-8bcf026205b6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=119543) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 18 02:13:10.893964 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-c5c7276d-08c6-4801-b1e2-8bcf026205b6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Getting quotas for project 8f8bb1ebead3481f946ae7878c3cfc41. Resources: {'server_group_members'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:13:10.904038 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-c5c7276d-08c6-4801-b1e2-8bcf026205b6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Getting quotas for user 100f65c0d9d3456fa177599821aed7ff and project 8f8bb1ebead3481f946ae7878c3cfc41. Resources: {'server_group_members'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:13:11.025986 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-c5c7276d-08c6-4801-b1e2-8bcf026205b6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Getting quotas for project 8f8bb1ebead3481f946ae7878c3cfc41. Resources: {'server_group_members'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:13:11.035399 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-c5c7276d-08c6-4801-b1e2-8bcf026205b6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Getting quotas for user 100f65c0d9d3456fa177599821aed7ff and project 8f8bb1ebead3481f946ae7878c3cfc41. Resources: {'server_group_members'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:13:11.064141 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c5c7276d-08c6-4801-b1e2-8bcf026205b6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: a598ccda-c16b-45d8-aca0-d3d242ec0c23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=a6859225-d99c-41c5-a08b-dd4836bd82c4,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:13:11.169155 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-c5c7276d-08c6-4801-b1e2-8bcf026205b6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Getting quotas for project 8f8bb1ebead3481f946ae7878c3cfc41. Resources: {'server_group_members'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:13:11.179575 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-c5c7276d-08c6-4801-b1e2-8bcf026205b6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Getting quotas for user 100f65c0d9d3456fa177599821aed7ff and project 8f8bb1ebead3481f946ae7878c3cfc41. Resources: {'server_group_members'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:13:11.274954 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:13:11.297232 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-c5c7276d-08c6-4801-b1e2-8bcf026205b6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Getting quotas for project 8f8bb1ebead3481f946ae7878c3cfc41. Resources: {'server_group_members'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:13:11.344510 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-c5c7276d-08c6-4801-b1e2-8bcf026205b6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Getting quotas for user 100f65c0d9d3456fa177599821aed7ff and project 8f8bb1ebead3481f946ae7878c3cfc41. Resources: {'server_group_members'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:13:11.494371 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c5c7276d-08c6-4801-b1e2-8bcf026205b6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 4.060427 Jul 18 02:13:11.502344 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 595/1258] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:13:07 2022] POST /compute/v2.1/servers => generated 32 bytes in 4070 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 18 02:13:11.523514 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d4d01ed8-34b1-4ad7-a1af-8981335fa878 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:11.524096 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d4d01ed8-34b1-4ad7-a1af-8981335fa878 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 1df099cb-c253-4dd4-96a0-0652047390d8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:11.569595 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d4d01ed8-34b1-4ad7-a1af-8981335fa878 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:11.571353 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d4d01ed8-34b1-4ad7-a1af-8981335fa878 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:11.575585 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d4d01ed8-34b1-4ad7-a1af-8981335fa878 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:11.579602 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d4d01ed8-34b1-4ad7-a1af-8981335fa878 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:11.780226 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d4d01ed8-34b1-4ad7-a1af-8981335fa878 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 1df099cb-c253-4dd4-96a0-0652047390d8] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:13:12.156293 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d4d01ed8-34b1-4ad7-a1af-8981335fa878 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "DELETE /compute/v2.1/servers/1df099cb-c253-4dd4-96a0-0652047390d8" status: 204 len: 0 microversion: 2.1 time: 0.651722 Jul 18 02:13:12.157524 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 596/1259] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:13:11 2022] DELETE /compute/v2.1/servers/1df099cb-c253-4dd4-96a0-0652047390d8 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:13:12.185393 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a620d1d9-63fa-47ce-b4da-91a39bff6533 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:12.186980 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a620d1d9-63fa-47ce-b4da-91a39bff6533 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:12.223751 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a620d1d9-63fa-47ce-b4da-91a39bff6533 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:12.224498 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a620d1d9-63fa-47ce-b4da-91a39bff6533 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:12.229951 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a620d1d9-63fa-47ce-b4da-91a39bff6533 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:12.230712 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a620d1d9-63fa-47ce-b4da-91a39bff6533 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:13.775180 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-06c730d7-5509-4f2c-84c4-07b4daec13df tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:13:13.794150 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-06c730d7-5509-4f2c-84c4-07b4daec13df tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:13:13.799695 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-06c730d7-5509-4f2c-84c4-07b4daec13df tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:13:13.806883 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-06c730d7-5509-4f2c-84c4-07b4daec13df tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:13:13.814772 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-06c730d7-5509-4f2c-84c4-07b4daec13df tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:13:13.908812 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-06c730d7-5509-4f2c-84c4-07b4daec13df tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:13.912338 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-06c730d7-5509-4f2c-84c4-07b4daec13df tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:13.914022 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-06c730d7-5509-4f2c-84c4-07b4daec13df tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:13.918930 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-06c730d7-5509-4f2c-84c4-07b4daec13df tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:14.002496 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a620d1d9-63fa-47ce-b4da-91a39bff6533 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:14.026579 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-06c730d7-5509-4f2c-84c4-07b4daec13df tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Getting quotas for project 4cd338c0a2724ca999dc02d93f90860a. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:13:14.058637 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-06c730d7-5509-4f2c-84c4-07b4daec13df tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Getting quotas for user e5525cb28fdc490a8e1bafb732a70fc6 and project 4cd338c0a2724ca999dc02d93f90860a. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:13:14.071599 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a620d1d9-63fa-47ce-b4da-91a39bff6533 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 200 len: 1359 microversion: 2.1 time: 1.898589 Jul 18 02:13:14.096328 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-06c730d7-5509-4f2c-84c4-07b4daec13df tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:13:14.099626 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 597/1260] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:12 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 1359 bytes in 1941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:14.107424 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-06c730d7-5509-4f2c-84c4-07b4daec13df tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] [instance: c8ed62a2-40e8-40a5-8ec1-365add95911a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:13:14.287668 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-06c730d7-5509-4f2c-84c4-07b4daec13df tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.308561 Jul 18 02:13:14.291563 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 664/1261] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:13:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 5324 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:13:14.309452 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9c698b4f-72b6-466d-90af-fca9c187877a tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:14.314994 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9c698b4f-72b6-466d-90af-fca9c187877a tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] [instance: 6a9311f2-f5f3-49f0-831e-728291d16d09] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:14.344273 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9c698b4f-72b6-466d-90af-fca9c187877a tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:14.355489 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9c698b4f-72b6-466d-90af-fca9c187877a tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:14.356628 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9c698b4f-72b6-466d-90af-fca9c187877a tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:14.358989 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9c698b4f-72b6-466d-90af-fca9c187877a tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:14.714424 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-95b5397b-f97f-446b-93d7-86206505e9c9 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Action: 'create', calling method: .version_select at 0x7ff4a8a76940>, body: {"keypair": {"name": "tempest-keypair-1423110932", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDk+N3CukLQ+Q/mPolUAUpAPFdjwPbpibBFrDe6Lb3GbggexbNZED3H+ozP2PWStAXQ8AsWQi68B5WaLQvlbclVCu9I//3FP34PgKUai7iS0YvB528g+YAETcREc1d7+IQ=="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:14.784288 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-95b5397b-f97f-446b-93d7-86206505e9c9 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Getting quotas for project fb6b8514bba84ba8a09c64abbb2d1a2e. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:13:14.802826 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-95b5397b-f97f-446b-93d7-86206505e9c9 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Getting quotas for user fe79fa13328b4e40922d0e3e4551a8e8 and project fb6b8514bba84ba8a09c64abbb2d1a2e. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:13:14.916323 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-95b5397b-f97f-446b-93d7-86206505e9c9 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.798627 Jul 18 02:13:14.920757 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 598/1262] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 02:13:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:14.945497 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2696cb66-8b79-4575-a16b-8c68c9da0aec tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a8a55040>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:15.028165 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9c698b4f-72b6-466d-90af-fca9c187877a tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83428adc93d4dd9a3884659a73bd865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a94aaf6ca324e97aec2f6e982416f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:15.041836 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9c698b4f-72b6-466d-90af-fca9c187877a tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] 10.222.0.57 "GET /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09" status: 200 len: 1331 microversion: 2.1 time: 0.744950 Jul 18 02:13:15.063741 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 665/1263] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:14 2022] GET /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09 => generated 1331 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:15.131036 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-cae1482d-b87d-4ce8-ab1d-8225a9707634 req-8c445b96-9416-4aeb-bd65-c2341cb08d84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1df099cb-c253-4dd4-96a0-0652047390d8", "name": "network-vif-unplugged", "status": "completed", "tag": "faa469e5-28b6-416c-8e4b-d5b6ab117a54"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:15.230873 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2696cb66-8b79-4575-a16b-8c68c9da0aec tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/425813c1-df02-409a-9f52-bd406789b9d0" status: 200 len: 1454 microversion: 2.1 time: 0.306467 Jul 18 02:13:15.233414 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-cae1482d-b87d-4ce8-ab1d-8225a9707634 req-8c445b96-9416-4aeb-bd65-c2341cb08d84 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:15.233909 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-cae1482d-b87d-4ce8-ab1d-8225a9707634 req-8c445b96-9416-4aeb-bd65-c2341cb08d84 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:15.245299 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 599/1264] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:13:14 2022] GET /compute/v2.1/images/425813c1-df02-409a-9f52-bd406789b9d0 => generated 1454 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:15.257814 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7efe7495-13bc-4ab7-a531-9450898690d6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:15.261353 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7efe7495-13bc-4ab7-a531-9450898690d6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:15.277397 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7efe7495-13bc-4ab7-a531-9450898690d6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Searching by: {'deleted': False, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41'} {{(pid=119543) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:13:15.279990 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-cae1482d-b87d-4ce8-ab1d-8225a9707634 req-8c445b96-9416-4aeb-bd65-c2341cb08d84 service nova] Creating event network-vif-unplugged:faa469e5-28b6-416c-8e4b-d5b6ab117a54 for instance 1df099cb-c253-4dd4-96a0-0652047390d8 on n-h1-465891-3 Jul 18 02:13:15.321105 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-cae1482d-b87d-4ce8-ab1d-8225a9707634 req-8c445b96-9416-4aeb-bd65-c2341cb08d84 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.249233 Jul 18 02:13:15.322767 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 666/1265] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:15.327771 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7efe7495-13bc-4ab7-a531-9450898690d6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:15.329041 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7efe7495-13bc-4ab7-a531-9450898690d6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:15.342261 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7efe7495-13bc-4ab7-a531-9450898690d6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:15.342804 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7efe7495-13bc-4ab7-a531-9450898690d6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:15.357622 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9309ff08-1daf-4b19-bdea-64ddc3d1323f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1835308147", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "9b9ef786-bd16-4bad-95f6-48c8b48d49f7"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:15.710020 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-9309ff08-1daf-4b19-bdea-64ddc3d1323f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] validate_networks() for [('9b9ef786-bd16-4bad-95f6-48c8b48d49f7', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:13:15.833767 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.multi_cell_list [None req-7efe7495-13bc-4ab7-a531-9450898690d6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119543) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:13:15.905671 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:13:16.086480 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7efe7495-13bc-4ab7-a531-9450898690d6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.847849 Jul 18 02:13:16.090172 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 600/1266] 10.222.0.57 () {58 vars in 1124 bytes} [Mon Jul 18 02:13:15 2022] GET /compute/v2.1/servers => generated 1002 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:16.112643 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ca7bb2ab-80b2-4f36-a92e-122d2fb7478b tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:16.118409 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ca7bb2ab-80b2-4f36-a92e-122d2fb7478b tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] [instance: c8ed62a2-40e8-40a5-8ec1-365add95911a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:16.774775 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ca7bb2ab-80b2-4f36-a92e-122d2fb7478b tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5525cb28fdc490a8e1bafb732a70fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd338c0a2724ca999dc02d93f90860a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:16.803846 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ca7bb2ab-80b2-4f36-a92e-122d2fb7478b tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] 10.222.0.57 "GET /compute/v2.1/servers/c8ed62a2-40e8-40a5-8ec1-365add95911a" status: 200 len: 1223 microversion: 2.1 time: 0.711972 Jul 18 02:13:16.817992 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 601/1267] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:16 2022] GET /compute/v2.1/servers/c8ed62a2-40e8-40a5-8ec1-365add95911a => generated 1223 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:16.831046 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-91b4987b-14ee-48da-9f7b-189f9913fa7d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:16.832875 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-91b4987b-14ee-48da-9f7b-189f9913fa7d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:16.867233 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-91b4987b-14ee-48da-9f7b-189f9913fa7d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:16.869534 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-91b4987b-14ee-48da-9f7b-189f9913fa7d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:16.871973 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-91b4987b-14ee-48da-9f7b-189f9913fa7d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:16.873033 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-91b4987b-14ee-48da-9f7b-189f9913fa7d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:18.727785 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-91b4987b-14ee-48da-9f7b-189f9913fa7d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:18.757806 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-91b4987b-14ee-48da-9f7b-189f9913fa7d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 200 len: 1359 microversion: 2.1 time: 1.947602 Jul 18 02:13:18.761082 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 602/1268] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:16 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 1359 bytes in 1953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:18.809776 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c82d7c4b-aed8-4a72-94d0-7acee3435524 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:18.815024 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c82d7c4b-aed8-4a72-94d0-7acee3435524 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] [instance: 6a9311f2-f5f3-49f0-831e-728291d16d09] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:18.846931 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c82d7c4b-aed8-4a72-94d0-7acee3435524 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:18.848492 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c82d7c4b-aed8-4a72-94d0-7acee3435524 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:18.853933 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c82d7c4b-aed8-4a72-94d0-7acee3435524 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:18.855375 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c82d7c4b-aed8-4a72-94d0-7acee3435524 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:19.832369 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c82d7c4b-aed8-4a72-94d0-7acee3435524 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83428adc93d4dd9a3884659a73bd865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a94aaf6ca324e97aec2f6e982416f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:19.859475 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c82d7c4b-aed8-4a72-94d0-7acee3435524 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] 10.222.0.57 "GET /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09" status: 200 len: 1331 microversion: 2.1 time: 1.093119 Jul 18 02:13:19.861970 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 603/1269] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:18 2022] GET /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09 => generated 1331 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:19.867837 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-657f2749-f442-4b64-bf2c-bfd41fd227d1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:19.868752 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-657f2749-f442-4b64-bf2c-bfd41fd227d1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: a598ccda-c16b-45d8-aca0-d3d242ec0c23] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:19.877408 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-657f2749-f442-4b64-bf2c-bfd41fd227d1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:19.878203 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-657f2749-f442-4b64-bf2c-bfd41fd227d1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:19.879173 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-657f2749-f442-4b64-bf2c-bfd41fd227d1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:19.879759 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-657f2749-f442-4b64-bf2c-bfd41fd227d1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:19.971186 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-9309ff08-1daf-4b19-bdea-64ddc3d1323f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:13:19.971988 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-9309ff08-1daf-4b19-bdea-64ddc3d1323f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:13:19.972333 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-9309ff08-1daf-4b19-bdea-64ddc3d1323f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:13:19.972749 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-9309ff08-1daf-4b19-bdea-64ddc3d1323f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:13:19.973165 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-9309ff08-1daf-4b19-bdea-64ddc3d1323f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:13:19.997795 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9309ff08-1daf-4b19-bdea-64ddc3d1323f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:20.008690 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9309ff08-1daf-4b19-bdea-64ddc3d1323f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:20.010761 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9309ff08-1daf-4b19-bdea-64ddc3d1323f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:20.011673 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9309ff08-1daf-4b19-bdea-64ddc3d1323f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:20.060395 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-657f2749-f442-4b64-bf2c-bfd41fd227d1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:20.099323 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-657f2749-f442-4b64-bf2c-bfd41fd227d1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/a598ccda-c16b-45d8-aca0-d3d242ec0c23" status: 200 len: 1276 microversion: 2.1 time: 0.234580 Jul 18 02:13:20.124901 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 604/1270] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:19 2022] GET /compute/v2.1/servers/a598ccda-c16b-45d8-aca0-d3d242ec0c23 => generated 1276 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:20.142193 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-733b6161-c724-40d4-81da-a33e317b2e5d tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a8a43af0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:20.182548 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-9309ff08-1daf-4b19-bdea-64ddc3d1323f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Getting quotas for project 10c5b35052cd4a71a8254d01112f0496. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:13:20.202003 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-9309ff08-1daf-4b19-bdea-64ddc3d1323f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Getting quotas for user a686fc833d964d88a022fae2932b5727 and project 10c5b35052cd4a71a8254d01112f0496. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:13:20.247117 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9309ff08-1daf-4b19-bdea-64ddc3d1323f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:13:20.262376 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9309ff08-1daf-4b19-bdea-64ddc3d1323f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 2d8e0c47-5276-4d24-9cb3-fb36bb9b6400] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:13:20.327074 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-733b6161-c724-40d4-81da-a33e317b2e5d tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/425813c1-df02-409a-9f52-bd406789b9d0" status: 200 len: 1454 microversion: 2.1 time: 0.199680 Jul 18 02:13:20.345907 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 605/1271] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:13:20 2022] GET /compute/v2.1/images/425813c1-df02-409a-9f52-bd406789b9d0 => generated 1454 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:20.367887 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e9693f39-c42e-488f-832e-593400967209 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:20.370045 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e9693f39-c42e-488f-832e-593400967209 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] [instance: c8ed62a2-40e8-40a5-8ec1-365add95911a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:20.401119 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e9693f39-c42e-488f-832e-593400967209 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:20.402174 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9309ff08-1daf-4b19-bdea-64ddc3d1323f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.076628 Jul 18 02:13:20.403264 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 667/1272] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:13:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 5079 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:13:20.408307 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e9693f39-c42e-488f-832e-593400967209 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:20.409854 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e9693f39-c42e-488f-832e-593400967209 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:20.410642 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e9693f39-c42e-488f-832e-593400967209 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:20.417023 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-3d4f7cc4-1219-42e8-aa85-649be9ddd35f req-6df4a925-884c-44c5-8798-03a15e13dfe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a9311f2-f5f3-49f0-831e-728291d16d09", "name": "network-vif-plugged", "status": "completed", "tag": "f691d4d0-5b03-4b49-81fe-72116c2da4cb"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:20.451806 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-3d4f7cc4-1219-42e8-aa85-649be9ddd35f req-6df4a925-884c-44c5-8798-03a15e13dfe1 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:20.452807 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-3d4f7cc4-1219-42e8-aa85-649be9ddd35f req-6df4a925-884c-44c5-8798-03a15e13dfe1 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:20.510498 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-3d4f7cc4-1219-42e8-aa85-649be9ddd35f req-6df4a925-884c-44c5-8798-03a15e13dfe1 service nova] Creating event network-vif-plugged:f691d4d0-5b03-4b49-81fe-72116c2da4cb for instance 6a9311f2-f5f3-49f0-831e-728291d16d09 on n-h1-465891-3 Jul 18 02:13:20.526711 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-3d4f7cc4-1219-42e8-aa85-649be9ddd35f req-6df4a925-884c-44c5-8798-03a15e13dfe1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121537 Jul 18 02:13:20.531647 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 668/1273] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:20.826655 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-6dff7663-16da-4f9f-b4d6-642ae59d376f req-b39bb7b1-dd92-48bc-aa2e-c4de3363f20a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1df099cb-c253-4dd4-96a0-0652047390d8", "name": "network-vif-deleted", "tag": "faa469e5-28b6-416c-8e4b-d5b6ab117a54"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:20.859725 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-6dff7663-16da-4f9f-b4d6-642ae59d376f req-b39bb7b1-dd92-48bc-aa2e-c4de3363f20a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:20.860516 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-6dff7663-16da-4f9f-b4d6-642ae59d376f req-b39bb7b1-dd92-48bc-aa2e-c4de3363f20a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:20.904180 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-6dff7663-16da-4f9f-b4d6-642ae59d376f req-b39bb7b1-dd92-48bc-aa2e-c4de3363f20a service nova] Creating event network-vif-deleted:faa469e5-28b6-416c-8e4b-d5b6ab117a54 for instance 1df099cb-c253-4dd4-96a0-0652047390d8 on n-h1-465891-3 Jul 18 02:13:20.928377 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-6dff7663-16da-4f9f-b4d6-642ae59d376f req-b39bb7b1-dd92-48bc-aa2e-c4de3363f20a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.383560 Jul 18 02:13:20.936840 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 669/1274] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:20.949871 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4400d325-4fd5-4677-b168-ad8d299cfd8d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:20.951880 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4400d325-4fd5-4677-b168-ad8d299cfd8d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:20.967891 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4400d325-4fd5-4677-b168-ad8d299cfd8d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:20.969243 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4400d325-4fd5-4677-b168-ad8d299cfd8d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:20.974232 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4400d325-4fd5-4677-b168-ad8d299cfd8d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:20.975252 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4400d325-4fd5-4677-b168-ad8d299cfd8d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:21.035999 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e9693f39-c42e-488f-832e-593400967209 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5525cb28fdc490a8e1bafb732a70fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd338c0a2724ca999dc02d93f90860a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:21.082062 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e9693f39-c42e-488f-832e-593400967209 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] 10.222.0.57 "GET /compute/v2.1/servers/c8ed62a2-40e8-40a5-8ec1-365add95911a" status: 200 len: 1281 microversion: 2.1 time: 0.733511 Jul 18 02:13:21.102766 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 606/1275] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:20 2022] GET /compute/v2.1/servers/c8ed62a2-40e8-40a5-8ec1-365add95911a => generated 1281 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:21.133830 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7a6510f4-ffe5-46dd-8c91-5102454a1ae0 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:21.136152 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7a6510f4-ffe5-46dd-8c91-5102454a1ae0 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 2d8e0c47-5276-4d24-9cb3-fb36bb9b6400] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:21.887087 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7a6510f4-ffe5-46dd-8c91-5102454a1ae0 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:21.914399 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7a6510f4-ffe5-46dd-8c91-5102454a1ae0 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/2d8e0c47-5276-4d24-9cb3-fb36bb9b6400" status: 200 len: 1208 microversion: 2.1 time: 0.809462 Jul 18 02:13:21.915861 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 607/1276] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:21 2022] GET /compute/v2.1/servers/2d8e0c47-5276-4d24-9cb3-fb36bb9b6400 => generated 1208 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:21.962690 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cbbb4e39-41ef-453d-99bb-1b844603c54f tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:21.971364 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cbbb4e39-41ef-453d-99bb-1b844603c54f tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] [instance: 6a9311f2-f5f3-49f0-831e-728291d16d09] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:22.015181 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cbbb4e39-41ef-453d-99bb-1b844603c54f tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:22.015992 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cbbb4e39-41ef-453d-99bb-1b844603c54f tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:22.017499 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cbbb4e39-41ef-453d-99bb-1b844603c54f tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:22.046353 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cbbb4e39-41ef-453d-99bb-1b844603c54f tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:22.591581 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4400d325-4fd5-4677-b168-ad8d299cfd8d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:22.618091 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4400d325-4fd5-4677-b168-ad8d299cfd8d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 200 len: 1359 microversion: 2.1 time: 1.681182 Jul 18 02:13:22.634682 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 670/1277] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:20 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 1359 bytes in 1699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:22.646686 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fc51d2d6-fc42-4e17-b764-8fb379f728fa tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:22.648254 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fc51d2d6-fc42-4e17-b764-8fb379f728fa tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: a598ccda-c16b-45d8-aca0-d3d242ec0c23] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:22.668659 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fc51d2d6-fc42-4e17-b764-8fb379f728fa tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:22.670160 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fc51d2d6-fc42-4e17-b764-8fb379f728fa tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:22.672034 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fc51d2d6-fc42-4e17-b764-8fb379f728fa tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:22.673106 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fc51d2d6-fc42-4e17-b764-8fb379f728fa tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:24.774065 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cbbb4e39-41ef-453d-99bb-1b844603c54f tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83428adc93d4dd9a3884659a73bd865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a94aaf6ca324e97aec2f6e982416f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:24.852147 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cbbb4e39-41ef-453d-99bb-1b844603c54f tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] 10.222.0.57 "GET /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09" status: 200 len: 1331 microversion: 2.1 time: 2.900616 Jul 18 02:13:24.853131 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 608/1278] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:21 2022] GET /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09 => generated 1331 bytes in 2933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:24.922016 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-50c5a1e6-ba5b-459b-b846-1e1b4a465721 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a8a558b0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:25.125875 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-50c5a1e6-ba5b-459b-b846-1e1b4a465721 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/425813c1-df02-409a-9f52-bd406789b9d0" status: 200 len: 1454 microversion: 2.1 time: 0.258681 Jul 18 02:13:25.129242 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 609/1279] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:13:24 2022] GET /compute/v2.1/images/425813c1-df02-409a-9f52-bd406789b9d0 => generated 1454 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:25.157412 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-669c7beb-1a3a-44c8-a86e-37c8d2b6958f tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:25.162367 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-669c7beb-1a3a-44c8-a86e-37c8d2b6958f tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] [instance: c8ed62a2-40e8-40a5-8ec1-365add95911a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:25.217175 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-669c7beb-1a3a-44c8-a86e-37c8d2b6958f tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:25.223931 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-669c7beb-1a3a-44c8-a86e-37c8d2b6958f tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:25.225917 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-669c7beb-1a3a-44c8-a86e-37c8d2b6958f tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:25.226955 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-669c7beb-1a3a-44c8-a86e-37c8d2b6958f tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:25.398549 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fc51d2d6-fc42-4e17-b764-8fb379f728fa tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:25.461837 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fc51d2d6-fc42-4e17-b764-8fb379f728fa tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/a598ccda-c16b-45d8-aca0-d3d242ec0c23" status: 200 len: 1318 microversion: 2.1 time: 2.824720 Jul 18 02:13:25.463377 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 671/1280] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:22 2022] GET /compute/v2.1/servers/a598ccda-c16b-45d8-aca0-d3d242ec0c23 => generated 1318 bytes in 2827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:25.490998 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=4 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:13:25.519792 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-7acdc705-dc20-4f54-8acb-d3bee52aac09 req-a9a90a54-a5c3-4fcf-b24e-98eacb2857e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19592434-cafa-4e79-a790-0674ab77672f", "name": "network-vif-plugged", "status": "completed", "tag": "4c9f9136-52be-4062-9d09-7fd94b7a5870"}, {"server_uuid": "697075ff-db42-4729-8faf-2c2935d72630", "name": "network-vif-plugged", "status": "completed", "tag": "26b96c32-3f20-4f09-8e97-8a938a803c4c"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:25.565391 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-7acdc705-dc20-4f54-8acb-d3bee52aac09 req-a9a90a54-a5c3-4fcf-b24e-98eacb2857e6 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:25.570127 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-7acdc705-dc20-4f54-8acb-d3bee52aac09 req-a9a90a54-a5c3-4fcf-b24e-98eacb2857e6 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:25.607612 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-7acdc705-dc20-4f54-8acb-d3bee52aac09 req-a9a90a54-a5c3-4fcf-b24e-98eacb2857e6 service nova] Creating event network-vif-plugged:4c9f9136-52be-4062-9d09-7fd94b7a5870 for instance 19592434-cafa-4e79-a790-0674ab77672f on n-h1-465891-3 Jul 18 02:13:25.621123 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-7acdc705-dc20-4f54-8acb-d3bee52aac09 req-a9a90a54-a5c3-4fcf-b24e-98eacb2857e6 service nova] Creating event network-vif-plugged:26b96c32-3f20-4f09-8e97-8a938a803c4c for instance 697075ff-db42-4729-8faf-2c2935d72630 on n-h2-465891-3 Jul 18 02:13:25.636315 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-7acdc705-dc20-4f54-8acb-d3bee52aac09 req-a9a90a54-a5c3-4fcf-b24e-98eacb2857e6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.167844 Jul 18 02:13:25.637736 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 672/1281] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:25.654992 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3dafde4f-01f2-40f6-abb2-71121ad321a1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:25.660061 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3dafde4f-01f2-40f6-abb2-71121ad321a1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 2d8e0c47-5276-4d24-9cb3-fb36bb9b6400] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:25.680272 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3dafde4f-01f2-40f6-abb2-71121ad321a1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:25.681168 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3dafde4f-01f2-40f6-abb2-71121ad321a1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:25.684537 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3dafde4f-01f2-40f6-abb2-71121ad321a1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:25.687566 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3dafde4f-01f2-40f6-abb2-71121ad321a1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:28.243493 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3dafde4f-01f2-40f6-abb2-71121ad321a1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:28.284742 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3dafde4f-01f2-40f6-abb2-71121ad321a1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/2d8e0c47-5276-4d24-9cb3-fb36bb9b6400" status: 200 len: 1266 microversion: 2.1 time: 2.644545 Jul 18 02:13:28.301922 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 673/1282] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:25 2022] GET /compute/v2.1/servers/2d8e0c47-5276-4d24-9cb3-fb36bb9b6400 => generated 1266 bytes in 2651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:28.301922 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-82ae6151-b4ae-48c8-81b7-fd79372dbb8f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:28.301922 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-82ae6151-b4ae-48c8-81b7-fd79372dbb8f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:28.353112 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-82ae6151-b4ae-48c8-81b7-fd79372dbb8f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:28.354026 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-82ae6151-b4ae-48c8-81b7-fd79372dbb8f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:28.355363 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-82ae6151-b4ae-48c8-81b7-fd79372dbb8f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:28.356059 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-82ae6151-b4ae-48c8-81b7-fd79372dbb8f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:28.703102 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-669c7beb-1a3a-44c8-a86e-37c8d2b6958f tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5525cb28fdc490a8e1bafb732a70fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd338c0a2724ca999dc02d93f90860a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:28.731396 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-669c7beb-1a3a-44c8-a86e-37c8d2b6958f tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] 10.222.0.57 "GET /compute/v2.1/servers/c8ed62a2-40e8-40a5-8ec1-365add95911a" status: 200 len: 1323 microversion: 2.1 time: 3.597563 Jul 18 02:13:28.740039 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 610/1283] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:25 2022] GET /compute/v2.1/servers/c8ed62a2-40e8-40a5-8ec1-365add95911a => generated 1323 bytes in 3608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:28.770168 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ef1b4953-0184-4d49-a248-e16fc2ed6413 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:28.778562 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ef1b4953-0184-4d49-a248-e16fc2ed6413 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] [instance: 6a9311f2-f5f3-49f0-831e-728291d16d09] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:28.811601 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ef1b4953-0184-4d49-a248-e16fc2ed6413 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:28.812533 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ef1b4953-0184-4d49-a248-e16fc2ed6413 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:28.813644 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ef1b4953-0184-4d49-a248-e16fc2ed6413 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:28.814374 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ef1b4953-0184-4d49-a248-e16fc2ed6413 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:29.766937 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-82ae6151-b4ae-48c8-81b7-fd79372dbb8f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:29.777797 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:13:29.782620 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-82ae6151-b4ae-48c8-81b7-fd79372dbb8f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 200 len: 1541 microversion: 2.1 time: 1.491693 Jul 18 02:13:29.789331 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 674/1284] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:28 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 1541 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:29.795017 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-adecba3b-aace-4129-9fb1-901e1828eef9 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a88c80d0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:29.882453 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ef1b4953-0184-4d49-a248-e16fc2ed6413 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83428adc93d4dd9a3884659a73bd865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a94aaf6ca324e97aec2f6e982416f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:29.896877 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ef1b4953-0184-4d49-a248-e16fc2ed6413 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] 10.222.0.57 "GET /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09" status: 200 len: 1535 microversion: 2.1 time: 1.154789 Jul 18 02:13:29.901164 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 611/1285] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:28 2022] GET /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09 => generated 1535 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:29.908115 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-03fb996b-894e-4d0b-9e50-4e203952d5d2 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:29.915023 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-03fb996b-894e-4d0b-9e50-4e203952d5d2 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: a598ccda-c16b-45d8-aca0-d3d242ec0c23] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:29.923685 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-03fb996b-894e-4d0b-9e50-4e203952d5d2 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:29.931204 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-03fb996b-894e-4d0b-9e50-4e203952d5d2 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:29.933617 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-03fb996b-894e-4d0b-9e50-4e203952d5d2 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:29.934386 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-03fb996b-894e-4d0b-9e50-4e203952d5d2 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:29.952024 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-adecba3b-aace-4129-9fb1-901e1828eef9 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/425813c1-df02-409a-9f52-bd406789b9d0" status: 200 len: 1454 microversion: 2.1 time: 0.160951 Jul 18 02:13:29.955240 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 675/1286] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:13:29 2022] GET /compute/v2.1/images/425813c1-df02-409a-9f52-bd406789b9d0 => generated 1454 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:30.089923 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:13:30.099784 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-53adcaee-359a-427d-969d-fcb46310a847 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-863451280", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "e5432050-4fd3-426b-81bb-244a073d1cbe"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:30.114169 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=8 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:13:30.226539 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=20 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:13:30.289755 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-53adcaee-359a-427d-969d-fcb46310a847 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] validate_networks() for [('e5432050-4fd3-426b-81bb-244a073d1cbe', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:13:31.487756 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-03fb996b-894e-4d0b-9e50-4e203952d5d2 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:31.537863 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-03fb996b-894e-4d0b-9e50-4e203952d5d2 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/a598ccda-c16b-45d8-aca0-d3d242ec0c23" status: 200 len: 1318 microversion: 2.1 time: 1.634973 Jul 18 02:13:31.570706 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 612/1287] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:29 2022] GET /compute/v2.1/servers/a598ccda-c16b-45d8-aca0-d3d242ec0c23 => generated 1318 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:31.590898 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6011a9e7-029d-4679-8a6f-011f146ab986 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1411200262", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "7a5e7db6-e3f6-41d5-a093-718ef43d6b10"}], "security_groups": [{"name": "tempest-securitygroup--1953657121"}], "key_name": "tempest-keypair-1423110932", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:31.895822 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=30 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:13:32.636845 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-6011a9e7-029d-4679-8a6f-011f146ab986 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] validate_networks() for [('7a5e7db6-e3f6-41d5-a093-718ef43d6b10', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:13:32.816111 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-53adcaee-359a-427d-969d-fcb46310a847 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:13:32.816715 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-53adcaee-359a-427d-969d-fcb46310a847 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:13:32.816995 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-53adcaee-359a-427d-969d-fcb46310a847 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:13:32.818166 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-53adcaee-359a-427d-969d-fcb46310a847 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:13:32.818793 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-53adcaee-359a-427d-969d-fcb46310a847 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:13:32.855613 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-53adcaee-359a-427d-969d-fcb46310a847 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:32.857655 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-53adcaee-359a-427d-969d-fcb46310a847 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:32.859277 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-53adcaee-359a-427d-969d-fcb46310a847 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:32.860142 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-53adcaee-359a-427d-969d-fcb46310a847 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:32.885501 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-53adcaee-359a-427d-969d-fcb46310a847 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Getting quotas for project 9d0f5bbde58545fb9ccd1c2eb842ed49. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:13:32.900152 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-53adcaee-359a-427d-969d-fcb46310a847 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Getting quotas for user 575dd6743cff44678749d452329355d1 and project 9d0f5bbde58545fb9ccd1c2eb842ed49. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:13:32.987881 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-53adcaee-359a-427d-969d-fcb46310a847 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:13:32.990222 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-53adcaee-359a-427d-969d-fcb46310a847 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 49764b86-41da-4c6d-b069-aaccf92ef89f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:13:33.136076 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-53adcaee-359a-427d-969d-fcb46310a847 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.174929 Jul 18 02:13:33.145011 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 676/1288] 10.222.0.57 () {62 vars in 1187 bytes} [Mon Jul 18 02:13:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 3189 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 02:13:33.156118 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-d95aa01a-4e7e-4dad-bd64-a63f6bf30e00 req-ea8e40ae-646b-43af-b136-e49301f69632 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a598ccda-c16b-45d8-aca0-d3d242ec0c23", "tag": "cfb584b6-1349-4e2d-8d15-21ea1c84c96b"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:33.204602 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-d95aa01a-4e7e-4dad-bd64-a63f6bf30e00 req-ea8e40ae-646b-43af-b136-e49301f69632 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:33.218172 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-d95aa01a-4e7e-4dad-bd64-a63f6bf30e00 req-ea8e40ae-646b-43af-b136-e49301f69632 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:33.268546 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-d95aa01a-4e7e-4dad-bd64-a63f6bf30e00 req-ea8e40ae-646b-43af-b136-e49301f69632 service nova] Creating event network-changed:cfb584b6-1349-4e2d-8d15-21ea1c84c96b for instance a598ccda-c16b-45d8-aca0-d3d242ec0c23 on n-h2-465891-3 Jul 18 02:13:33.285687 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-d95aa01a-4e7e-4dad-bd64-a63f6bf30e00 req-ea8e40ae-646b-43af-b136-e49301f69632 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138778 Jul 18 02:13:33.290476 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 677/1289] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:33.311211 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3caa0e03-551f-48bc-b5f6-3aaa970d8019 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:33.313183 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3caa0e03-551f-48bc-b5f6-3aaa970d8019 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 2d8e0c47-5276-4d24-9cb3-fb36bb9b6400] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:33.336565 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3caa0e03-551f-48bc-b5f6-3aaa970d8019 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:33.339148 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3caa0e03-551f-48bc-b5f6-3aaa970d8019 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:33.342570 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3caa0e03-551f-48bc-b5f6-3aaa970d8019 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:33.344966 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3caa0e03-551f-48bc-b5f6-3aaa970d8019 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:35.771621 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3caa0e03-551f-48bc-b5f6-3aaa970d8019 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:35.788119 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3caa0e03-551f-48bc-b5f6-3aaa970d8019 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/2d8e0c47-5276-4d24-9cb3-fb36bb9b6400" status: 200 len: 1308 microversion: 2.1 time: 2.494896 Jul 18 02:13:35.788736 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 678/1290] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:33 2022] GET /compute/v2.1/servers/2d8e0c47-5276-4d24-9cb3-fb36bb9b6400 => generated 1308 bytes in 2498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:35.815102 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-838603ce-2b91-48f2-98c0-f4943b3f91eb tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:35.817627 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-838603ce-2b91-48f2-98c0-f4943b3f91eb tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] [instance: c8ed62a2-40e8-40a5-8ec1-365add95911a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:35.837310 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-838603ce-2b91-48f2-98c0-f4943b3f91eb tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:35.838415 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-838603ce-2b91-48f2-98c0-f4943b3f91eb tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:35.839458 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-838603ce-2b91-48f2-98c0-f4943b3f91eb tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:35.848538 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-838603ce-2b91-48f2-98c0-f4943b3f91eb tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:37.375024 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-838603ce-2b91-48f2-98c0-f4943b3f91eb tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5525cb28fdc490a8e1bafb732a70fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd338c0a2724ca999dc02d93f90860a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:37.387956 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-838603ce-2b91-48f2-98c0-f4943b3f91eb tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] 10.222.0.57 "GET /compute/v2.1/servers/c8ed62a2-40e8-40a5-8ec1-365add95911a" status: 200 len: 1323 microversion: 2.1 time: 1.593914 Jul 18 02:13:37.389791 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 679/1291] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:35 2022] GET /compute/v2.1/servers/c8ed62a2-40e8-40a5-8ec1-365add95911a => generated 1323 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:37.396558 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-09196121-8ce6-43fc-a470-7b5ffea8dc9a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:37.397548 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-09196121-8ce6-43fc-a470-7b5ffea8dc9a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:37.406741 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-09196121-8ce6-43fc-a470-7b5ffea8dc9a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:37.407603 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-09196121-8ce6-43fc-a470-7b5ffea8dc9a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:37.408777 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-09196121-8ce6-43fc-a470-7b5ffea8dc9a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:37.409453 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-09196121-8ce6-43fc-a470-7b5ffea8dc9a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:37.721954 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-6011a9e7-029d-4679-8a6f-011f146ab986 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:13:37.723110 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-6011a9e7-029d-4679-8a6f-011f146ab986 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:13:37.724008 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-6011a9e7-029d-4679-8a6f-011f146ab986 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:13:37.724776 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-6011a9e7-029d-4679-8a6f-011f146ab986 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:13:37.725571 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-6011a9e7-029d-4679-8a6f-011f146ab986 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:13:37.761032 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6011a9e7-029d-4679-8a6f-011f146ab986 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:37.765847 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6011a9e7-029d-4679-8a6f-011f146ab986 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:37.767200 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6011a9e7-029d-4679-8a6f-011f146ab986 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:37.770359 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6011a9e7-029d-4679-8a6f-011f146ab986 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:37.826902 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-6011a9e7-029d-4679-8a6f-011f146ab986 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Getting quotas for project fb6b8514bba84ba8a09c64abbb2d1a2e. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:13:37.841263 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-6011a9e7-029d-4679-8a6f-011f146ab986 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Getting quotas for user fe79fa13328b4e40922d0e3e4551a8e8 and project fb6b8514bba84ba8a09c64abbb2d1a2e. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:13:37.896429 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6011a9e7-029d-4679-8a6f-011f146ab986 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:13:37.906018 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6011a9e7-029d-4679-8a6f-011f146ab986 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: b74ae52f-6794-49d2-867e-be0996b090aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:13:38.039529 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-09196121-8ce6-43fc-a470-7b5ffea8dc9a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.648102 Jul 18 02:13:38.040074 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 680/1292] 10.222.0.57 () {58 vars in 1274 bytes} [Mon Jul 18 02:13:37 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f/os-interface => generated 284 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:38.045763 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9f5fe0ff-932c-4da3-bdf6-46fb64e2c1ab tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Action: 'create', calling method: .version_select at 0x7ff4a8ea83a0>, body: {"pool": "9c68fd03-321e-4186-960a-dc0f5151c936"} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:38.158223 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6011a9e7-029d-4679-8a6f-011f146ab986 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 6.585203 Jul 18 02:13:38.173395 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 613/1293] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:13:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 6601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:13:38.211918 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2d9084c7-c64b-404e-8ae6-74b509865bec tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a8a43c10>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:38.409069 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2d9084c7-c64b-404e-8ae6-74b509865bec tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/425813c1-df02-409a-9f52-bd406789b9d0" status: 200 len: 1454 microversion: 2.1 time: 0.233979 Jul 18 02:13:38.412207 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 614/1294] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:13:38 2022] GET /compute/v2.1/images/425813c1-df02-409a-9f52-bd406789b9d0 => generated 1454 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:38.443589 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8b9b56e3-ce2b-425d-97b6-a14143c32a0f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:38.450610 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8b9b56e3-ce2b-425d-97b6-a14143c32a0f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: a598ccda-c16b-45d8-aca0-d3d242ec0c23] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:38.464526 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8b9b56e3-ce2b-425d-97b6-a14143c32a0f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:38.465319 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8b9b56e3-ce2b-425d-97b6-a14143c32a0f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:38.466416 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8b9b56e3-ce2b-425d-97b6-a14143c32a0f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:38.468965 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8b9b56e3-ce2b-425d-97b6-a14143c32a0f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:39.255861 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8b9b56e3-ce2b-425d-97b6-a14143c32a0f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:39.276679 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8b9b56e3-ce2b-425d-97b6-a14143c32a0f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/a598ccda-c16b-45d8-aca0-d3d242ec0c23" status: 200 len: 1318 microversion: 2.1 time: 0.863116 Jul 18 02:13:39.291925 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 615/1295] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:38 2022] GET /compute/v2.1/servers/a598ccda-c16b-45d8-aca0-d3d242ec0c23 => generated 1318 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:39.305383 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f5c3a0de-91b6-4ad7-8a5f-7e4debd9ca6f tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:39.306547 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f5c3a0de-91b6-4ad7-8a5f-7e4debd9ca6f tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 49764b86-41da-4c6d-b069-aaccf92ef89f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:39.323583 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f5c3a0de-91b6-4ad7-8a5f-7e4debd9ca6f tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:39.324327 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f5c3a0de-91b6-4ad7-8a5f-7e4debd9ca6f tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:39.325365 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f5c3a0de-91b6-4ad7-8a5f-7e4debd9ca6f tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:39.333061 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f5c3a0de-91b6-4ad7-8a5f-7e4debd9ca6f tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:39.511168 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f5c3a0de-91b6-4ad7-8a5f-7e4debd9ca6f tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:39.526015 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f5c3a0de-91b6-4ad7-8a5f-7e4debd9ca6f tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:39.542022 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f5c3a0de-91b6-4ad7-8a5f-7e4debd9ca6f tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:39.546985 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f5c3a0de-91b6-4ad7-8a5f-7e4debd9ca6f tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f" status: 200 len: 1319 microversion: 2.25 time: 0.252907 Jul 18 02:13:39.549690 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 616/1296] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:13:39 2022] GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:13:39.569377 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-ff435c8c-ed07-40c1-bede-3150a6a1e04d req-aa552437-252a-4e52-90a0-cff4be775621 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6859225-d99c-41c5-a08b-dd4836bd82c4", "tag": "f5f50624-aa07-4d03-9784-f2cb3a5d94df"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:39.624542 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-ff435c8c-ed07-40c1-bede-3150a6a1e04d req-aa552437-252a-4e52-90a0-cff4be775621 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:39.626060 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-ff435c8c-ed07-40c1-bede-3150a6a1e04d req-aa552437-252a-4e52-90a0-cff4be775621 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:39.690758 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-ff435c8c-ed07-40c1-bede-3150a6a1e04d req-aa552437-252a-4e52-90a0-cff4be775621 service nova] Creating event network-changed:f5f50624-aa07-4d03-9784-f2cb3a5d94df for instance a6859225-d99c-41c5-a08b-dd4836bd82c4 on n-h2-465891-3 Jul 18 02:13:39.703326 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-ff435c8c-ed07-40c1-bede-3150a6a1e04d req-aa552437-252a-4e52-90a0-cff4be775621 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151379 Jul 18 02:13:39.703985 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 617/1297] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:39.835123 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-ab15b8d3-73c1-4dfe-ae8e-84e08cb229f1 req-2beb796b-b825-44f7-b0c2-823df305d06a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a598ccda-c16b-45d8-aca0-d3d242ec0c23", "name": "network-vif-plugged", "status": "completed", "tag": "cfb584b6-1349-4e2d-8d15-21ea1c84c96b"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:39.857238 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-ab15b8d3-73c1-4dfe-ae8e-84e08cb229f1 req-2beb796b-b825-44f7-b0c2-823df305d06a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:39.858157 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-ab15b8d3-73c1-4dfe-ae8e-84e08cb229f1 req-2beb796b-b825-44f7-b0c2-823df305d06a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:39.878480 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-ab15b8d3-73c1-4dfe-ae8e-84e08cb229f1 req-2beb796b-b825-44f7-b0c2-823df305d06a service nova] Creating event network-vif-plugged:cfb584b6-1349-4e2d-8d15-21ea1c84c96b for instance a598ccda-c16b-45d8-aca0-d3d242ec0c23 on n-h2-465891-3 Jul 18 02:13:39.897047 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-ab15b8d3-73c1-4dfe-ae8e-84e08cb229f1 req-2beb796b-b825-44f7-b0c2-823df305d06a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180896 Jul 18 02:13:39.905288 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 618/1298] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:39.921805 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a96b9b99-0fed-4c17-9c35-7ace80e3e5ed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:39.922537 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a96b9b99-0fed-4c17-9c35-7ace80e3e5ed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 2d8e0c47-5276-4d24-9cb3-fb36bb9b6400] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:39.942102 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a96b9b99-0fed-4c17-9c35-7ace80e3e5ed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:39.942514 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a96b9b99-0fed-4c17-9c35-7ace80e3e5ed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:39.943332 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a96b9b99-0fed-4c17-9c35-7ace80e3e5ed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:39.943823 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a96b9b99-0fed-4c17-9c35-7ace80e3e5ed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:41.333621 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a96b9b99-0fed-4c17-9c35-7ace80e3e5ed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:41.348462 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a96b9b99-0fed-4c17-9c35-7ace80e3e5ed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/2d8e0c47-5276-4d24-9cb3-fb36bb9b6400" status: 200 len: 1308 microversion: 2.1 time: 1.441409 Jul 18 02:13:41.352536 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 619/1299] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:39 2022] GET /compute/v2.1/servers/2d8e0c47-5276-4d24-9cb3-fb36bb9b6400 => generated 1308 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:41.366755 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9ee189fc-f9d1-449f-95f8-ef6184d722d9 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:41.367710 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9ee189fc-f9d1-449f-95f8-ef6184d722d9 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: b74ae52f-6794-49d2-867e-be0996b090aa] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:41.372269 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:13:41.394690 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9ee189fc-f9d1-449f-95f8-ef6184d722d9 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:41.395538 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9ee189fc-f9d1-449f-95f8-ef6184d722d9 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:41.397394 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9ee189fc-f9d1-449f-95f8-ef6184d722d9 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:41.398084 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9ee189fc-f9d1-449f-95f8-ef6184d722d9 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:41.567656 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9ee189fc-f9d1-449f-95f8-ef6184d722d9 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe79fa13328b4e40922d0e3e4551a8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6b8514bba84ba8a09c64abbb2d1a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:41.580609 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9ee189fc-f9d1-449f-95f8-ef6184d722d9 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "GET /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa" status: 200 len: 1312 microversion: 2.1 time: 0.226472 Jul 18 02:13:41.585807 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 620/1300] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:41 2022] GET /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa => generated 1312 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:41.590947 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e88f3917-41ce-4d64-a68e-885589cd1f06 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:41.598496 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e88f3917-41ce-4d64-a68e-885589cd1f06 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] [instance: c8ed62a2-40e8-40a5-8ec1-365add95911a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:41.610661 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e88f3917-41ce-4d64-a68e-885589cd1f06 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:41.616999 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e88f3917-41ce-4d64-a68e-885589cd1f06 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:41.618246 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e88f3917-41ce-4d64-a68e-885589cd1f06 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:41.618954 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e88f3917-41ce-4d64-a68e-885589cd1f06 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:42.235202 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e88f3917-41ce-4d64-a68e-885589cd1f06 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5525cb28fdc490a8e1bafb732a70fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd338c0a2724ca999dc02d93f90860a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:42.246513 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e88f3917-41ce-4d64-a68e-885589cd1f06 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] 10.222.0.57 "GET /compute/v2.1/servers/c8ed62a2-40e8-40a5-8ec1-365add95911a" status: 200 len: 1323 microversion: 2.1 time: 0.659329 Jul 18 02:13:42.255311 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 621/1301] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:41 2022] GET /compute/v2.1/servers/c8ed62a2-40e8-40a5-8ec1-365add95911a => generated 1323 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:42.265188 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e9b1216f-d340-40be-9cc6-cd5c9016065e tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a8a60940>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:42.396061 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e9b1216f-d340-40be-9cc6-cd5c9016065e tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/425813c1-df02-409a-9f52-bd406789b9d0" status: 200 len: 1454 microversion: 2.1 time: 0.138541 Jul 18 02:13:42.397104 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 622/1302] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:13:42 2022] GET /compute/v2.1/images/425813c1-df02-409a-9f52-bd406789b9d0 => generated 1454 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:42.410835 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-041f1c5d-fede-4325-9c02-5eb28f358df1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:42.414140 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-041f1c5d-fede-4325-9c02-5eb28f358df1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: a598ccda-c16b-45d8-aca0-d3d242ec0c23] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:42.429883 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-041f1c5d-fede-4325-9c02-5eb28f358df1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:42.431126 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-041f1c5d-fede-4325-9c02-5eb28f358df1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:42.434349 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-041f1c5d-fede-4325-9c02-5eb28f358df1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:42.436018 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-041f1c5d-fede-4325-9c02-5eb28f358df1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:42.874961 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:13:42.958477 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:13:43.090062 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-041f1c5d-fede-4325-9c02-5eb28f358df1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:43.105501 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-041f1c5d-fede-4325-9c02-5eb28f358df1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/a598ccda-c16b-45d8-aca0-d3d242ec0c23" status: 200 len: 1318 microversion: 2.1 time: 0.706391 Jul 18 02:13:43.111721 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 623/1303] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:42 2022] GET /compute/v2.1/servers/a598ccda-c16b-45d8-aca0-d3d242ec0c23 => generated 1318 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:43.123032 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6d8defdc-16d8-4bb8-814e-4ede730711d6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:43.125679 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6d8defdc-16d8-4bb8-814e-4ede730711d6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 49764b86-41da-4c6d-b069-aaccf92ef89f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:43.146385 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6d8defdc-16d8-4bb8-814e-4ede730711d6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:43.147153 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6d8defdc-16d8-4bb8-814e-4ede730711d6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:43.149977 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6d8defdc-16d8-4bb8-814e-4ede730711d6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:43.152508 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6d8defdc-16d8-4bb8-814e-4ede730711d6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:43.455274 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6d8defdc-16d8-4bb8-814e-4ede730711d6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:43.468302 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6d8defdc-16d8-4bb8-814e-4ede730711d6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:43.476302 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6d8defdc-16d8-4bb8-814e-4ede730711d6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:43.477870 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6d8defdc-16d8-4bb8-814e-4ede730711d6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f" status: 200 len: 1361 microversion: 2.25 time: 0.364127 Jul 18 02:13:43.479012 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 624/1304] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:13:43 2022] GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f => generated 1361 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:13:43.484042 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-dfc3b1cb-b3ef-40e5-a976-d74a9f66f087 req-84d3b5da-18fa-4a43-be78-f5785eff53bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8ed62a2-40e8-40a5-8ec1-365add95911a", "tag": "e1abec08-da7f-4a23-81d1-ba54d9237748"}, {"name": "network-changed", "server_uuid": "2d8e0c47-5276-4d24-9cb3-fb36bb9b6400", "tag": "d2e3884d-a86d-4462-b786-c48742d72cd5"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:43.500747 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-dfc3b1cb-b3ef-40e5-a976-d74a9f66f087 req-84d3b5da-18fa-4a43-be78-f5785eff53bf service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:43.501607 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-dfc3b1cb-b3ef-40e5-a976-d74a9f66f087 req-84d3b5da-18fa-4a43-be78-f5785eff53bf service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:43.527053 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:13:43.531243 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-dfc3b1cb-b3ef-40e5-a976-d74a9f66f087 req-84d3b5da-18fa-4a43-be78-f5785eff53bf service nova] Creating event network-changed:e1abec08-da7f-4a23-81d1-ba54d9237748 for instance c8ed62a2-40e8-40a5-8ec1-365add95911a on n-h1-465891-3 Jul 18 02:13:43.534271 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-dfc3b1cb-b3ef-40e5-a976-d74a9f66f087 req-84d3b5da-18fa-4a43-be78-f5785eff53bf service nova] Creating event network-changed:d2e3884d-a86d-4462-b786-c48742d72cd5 for instance 2d8e0c47-5276-4d24-9cb3-fb36bb9b6400 on n-h1-465891-3 Jul 18 02:13:43.552980 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-dfc3b1cb-b3ef-40e5-a976-d74a9f66f087 req-84d3b5da-18fa-4a43-be78-f5785eff53bf service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.072366 Jul 18 02:13:43.554411 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 625/1305] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:43.563828 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cf17cbe6-ac58-48bd-90eb-acb94e0d9eb2 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:43.564515 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cf17cbe6-ac58-48bd-90eb-acb94e0d9eb2 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 2d8e0c47-5276-4d24-9cb3-fb36bb9b6400] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:43.584130 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cf17cbe6-ac58-48bd-90eb-acb94e0d9eb2 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:43.584910 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cf17cbe6-ac58-48bd-90eb-acb94e0d9eb2 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:43.585937 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cf17cbe6-ac58-48bd-90eb-acb94e0d9eb2 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:43.592698 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cf17cbe6-ac58-48bd-90eb-acb94e0d9eb2 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:44.053958 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9f5fe0ff-932c-4da3-bdf6-46fb64e2c1ab tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] 10.222.0.57 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.010911 Jul 18 02:13:44.062207 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 681/1306] 10.222.0.57 () {60 vars in 1169 bytes} [Mon Jul 18 02:13:38 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6015 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:44.071626 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cf17cbe6-ac58-48bd-90eb-acb94e0d9eb2 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:44.096196 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-17f8ef8e-0546-4886-acfa-8ba0e5dc6f7f tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:44.096990 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cf17cbe6-ac58-48bd-90eb-acb94e0d9eb2 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/2d8e0c47-5276-4d24-9cb3-fb36bb9b6400" status: 200 len: 1308 microversion: 2.1 time: 0.540795 Jul 18 02:13:44.098367 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-17f8ef8e-0546-4886-acfa-8ba0e5dc6f7f tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: b74ae52f-6794-49d2-867e-be0996b090aa] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:44.112130 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-17f8ef8e-0546-4886-acfa-8ba0e5dc6f7f tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:44.113514 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-17f8ef8e-0546-4886-acfa-8ba0e5dc6f7f tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:44.115855 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-17f8ef8e-0546-4886-acfa-8ba0e5dc6f7f tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:44.117054 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-17f8ef8e-0546-4886-acfa-8ba0e5dc6f7f tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:44.118657 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 626/1307] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:43 2022] GET /compute/v2.1/servers/2d8e0c47-5276-4d24-9cb3-fb36bb9b6400 => generated 1308 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:44.320730 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-b50f95e7-6a82-4981-a5d0-7235280208e9 req-ea4cbdf9-7ff5-41c0-b4e5-31fc9635470b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19592434-cafa-4e79-a790-0674ab77672f", "tag": "4c9f9136-52be-4062-9d09-7fd94b7a5870"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:44.336402 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-b50f95e7-6a82-4981-a5d0-7235280208e9 req-ea4cbdf9-7ff5-41c0-b4e5-31fc9635470b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:44.337334 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-b50f95e7-6a82-4981-a5d0-7235280208e9 req-ea4cbdf9-7ff5-41c0-b4e5-31fc9635470b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:44.355583 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-b50f95e7-6a82-4981-a5d0-7235280208e9 req-ea4cbdf9-7ff5-41c0-b4e5-31fc9635470b service nova] Creating event network-changed:4c9f9136-52be-4062-9d09-7fd94b7a5870 for instance 19592434-cafa-4e79-a790-0674ab77672f on n-h1-465891-3 Jul 18 02:13:44.378700 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-b50f95e7-6a82-4981-a5d0-7235280208e9 req-ea4cbdf9-7ff5-41c0-b4e5-31fc9635470b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.258475 Jul 18 02:13:44.379335 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 627/1308] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:44.392719 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9d34b090-d364-4b94-8fdf-50d30e751347 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:44.393447 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9d34b090-d364-4b94-8fdf-50d30e751347 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] [instance: c8ed62a2-40e8-40a5-8ec1-365add95911a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:44.428032 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9d34b090-d364-4b94-8fdf-50d30e751347 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:44.428725 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9d34b090-d364-4b94-8fdf-50d30e751347 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:44.429896 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9d34b090-d364-4b94-8fdf-50d30e751347 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:44.430119 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9d34b090-d364-4b94-8fdf-50d30e751347 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:44.448960 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-17f8ef8e-0546-4886-acfa-8ba0e5dc6f7f tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe79fa13328b4e40922d0e3e4551a8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6b8514bba84ba8a09c64abbb2d1a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:44.468881 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-17f8ef8e-0546-4886-acfa-8ba0e5dc6f7f tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "GET /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa" status: 200 len: 1368 microversion: 2.1 time: 0.410794 Jul 18 02:13:44.478019 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 682/1309] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:44 2022] GET /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa => generated 1368 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:44.492661 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-db2be400-6624-4bca-87ab-5a341975e7bc tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a87a2940>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:44.600201 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-db2be400-6624-4bca-87ab-5a341975e7bc tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/425813c1-df02-409a-9f52-bd406789b9d0" status: 200 len: 1463 microversion: 2.1 time: 0.119254 Jul 18 02:13:44.601248 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 683/1310] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:13:44 2022] GET /compute/v2.1/images/425813c1-df02-409a-9f52-bd406789b9d0 => generated 1463 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:44.611230 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-22660c6c-ee29-4df2-ae38-824dce1e67b0 req-8173f22a-5403-45ff-a1f6-e44a2a723960 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6859225-d99c-41c5-a08b-dd4836bd82c4", "name": "network-vif-plugged", "status": "completed", "tag": "f5f50624-aa07-4d03-9784-f2cb3a5d94df"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:44.629743 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-22660c6c-ee29-4df2-ae38-824dce1e67b0 req-8173f22a-5403-45ff-a1f6-e44a2a723960 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:44.630232 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-22660c6c-ee29-4df2-ae38-824dce1e67b0 req-8173f22a-5403-45ff-a1f6-e44a2a723960 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:44.646218 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-22660c6c-ee29-4df2-ae38-824dce1e67b0 req-8173f22a-5403-45ff-a1f6-e44a2a723960 service nova] Creating event network-vif-plugged:f5f50624-aa07-4d03-9784-f2cb3a5d94df for instance a6859225-d99c-41c5-a08b-dd4836bd82c4 on n-h2-465891-3 Jul 18 02:13:44.654357 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-22660c6c-ee29-4df2-ae38-824dce1e67b0 req-8173f22a-5403-45ff-a1f6-e44a2a723960 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050171 Jul 18 02:13:44.655609 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 684/1311] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:44.668804 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9d34b090-d364-4b94-8fdf-50d30e751347 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5525cb28fdc490a8e1bafb732a70fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd338c0a2724ca999dc02d93f90860a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:44.673272 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-392e9489-8632-47b1-a511-664d401a408b tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Action: 'action', calling method: .version_select at 0x7ff4ab6c7700>, body: {"addFloatingIp": {"address": "172.25.3.119"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:44.675901 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-392e9489-8632-47b1-a511-664d401a408b tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] [instance: 6a9311f2-f5f3-49f0-831e-728291d16d09] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:44.686350 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9d34b090-d364-4b94-8fdf-50d30e751347 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] 10.222.0.57 "GET /compute/v2.1/servers/c8ed62a2-40e8-40a5-8ec1-365add95911a" status: 200 len: 1323 microversion: 2.1 time: 0.305504 Jul 18 02:13:44.687376 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 628/1312] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:44 2022] GET /compute/v2.1/servers/c8ed62a2-40e8-40a5-8ec1-365add95911a => generated 1323 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:44.696921 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-392e9489-8632-47b1-a511-664d401a408b tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:44.696921 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-392e9489-8632-47b1-a511-664d401a408b tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:44.696921 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-392e9489-8632-47b1-a511-664d401a408b tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:44.697337 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-392e9489-8632-47b1-a511-664d401a408b tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:44.710931 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ee052937-9454-4263-8c49-2111daa6e5a0 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:44.711980 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ee052937-9454-4263-8c49-2111daa6e5a0 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: a598ccda-c16b-45d8-aca0-d3d242ec0c23] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:44.737224 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ee052937-9454-4263-8c49-2111daa6e5a0 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:44.738199 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ee052937-9454-4263-8c49-2111daa6e5a0 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:44.739394 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ee052937-9454-4263-8c49-2111daa6e5a0 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:44.740869 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ee052937-9454-4263-8c49-2111daa6e5a0 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:44.877910 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-392e9489-8632-47b1-a511-664d401a408b tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Acquired lock "refresh_cache-6a9311f2-f5f3-49f0-831e-728291d16d09" {{(pid=119544) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 02:13:45.337633 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ee052937-9454-4263-8c49-2111daa6e5a0 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:45.365812 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ee052937-9454-4263-8c49-2111daa6e5a0 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/a598ccda-c16b-45d8-aca0-d3d242ec0c23" status: 200 len: 1468 microversion: 2.1 time: 0.663473 Jul 18 02:13:45.366898 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 629/1313] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:44 2022] GET /compute/v2.1/servers/a598ccda-c16b-45d8-aca0-d3d242ec0c23 => generated 1468 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:45.376824 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-85889828-c214-4757-a0ef-3a52367993a4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:45.377611 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-85889828-c214-4757-a0ef-3a52367993a4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 49764b86-41da-4c6d-b069-aaccf92ef89f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:45.394787 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85889828-c214-4757-a0ef-3a52367993a4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:45.395388 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85889828-c214-4757-a0ef-3a52367993a4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:45.396309 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85889828-c214-4757-a0ef-3a52367993a4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:45.397068 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85889828-c214-4757-a0ef-3a52367993a4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:45.856914 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-85889828-c214-4757-a0ef-3a52367993a4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:45.874749 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-85889828-c214-4757-a0ef-3a52367993a4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:45.877391 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-85889828-c214-4757-a0ef-3a52367993a4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:45.895535 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-85889828-c214-4757-a0ef-3a52367993a4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f" status: 200 len: 1361 microversion: 2.25 time: 0.525822 Jul 18 02:13:45.912681 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 630/1314] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:13:45 2022] GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f => generated 1361 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:13:45.924494 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5fa29944-a733-48cb-a17f-f09c97275ad1 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a89dc0d0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:45.990017 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5fa29944-a733-48cb-a17f-f09c97275ad1 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/425813c1-df02-409a-9f52-bd406789b9d0" status: 200 len: 1463 microversion: 2.1 time: 0.075722 Jul 18 02:13:45.990822 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 631/1315] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:13:45 2022] GET /compute/v2.1/images/425813c1-df02-409a-9f52-bd406789b9d0 => generated 1463 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:46.011669 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0e31b119-4ac7-4afb-a92e-3c0e1eafa8ed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:46.012325 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0e31b119-4ac7-4afb-a92e-3c0e1eafa8ed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 2d8e0c47-5276-4d24-9cb3-fb36bb9b6400] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:46.024650 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0e31b119-4ac7-4afb-a92e-3c0e1eafa8ed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:46.025567 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0e31b119-4ac7-4afb-a92e-3c0e1eafa8ed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:46.028206 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0e31b119-4ac7-4afb-a92e-3c0e1eafa8ed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:46.030155 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0e31b119-4ac7-4afb-a92e-3c0e1eafa8ed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:46.912582 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0e31b119-4ac7-4afb-a92e-3c0e1eafa8ed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:46.935474 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0e31b119-4ac7-4afb-a92e-3c0e1eafa8ed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/2d8e0c47-5276-4d24-9cb3-fb36bb9b6400" status: 200 len: 1308 microversion: 2.1 time: 0.939742 Jul 18 02:13:46.953965 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 632/1316] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:45 2022] GET /compute/v2.1/servers/2d8e0c47-5276-4d24-9cb3-fb36bb9b6400 => generated 1308 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:46.983200 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4e16b499-6b98-4f72-b3f3-36f6adf01d41 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:46.988783 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4e16b499-6b98-4f72-b3f3-36f6adf01d41 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: a6859225-d99c-41c5-a08b-dd4836bd82c4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:47.008733 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4e16b499-6b98-4f72-b3f3-36f6adf01d41 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:47.010589 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4e16b499-6b98-4f72-b3f3-36f6adf01d41 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:47.014244 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4e16b499-6b98-4f72-b3f3-36f6adf01d41 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:47.015959 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4e16b499-6b98-4f72-b3f3-36f6adf01d41 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:47.792334 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:13:47.847822 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4e16b499-6b98-4f72-b3f3-36f6adf01d41 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:47.860815 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:13:47.864140 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4e16b499-6b98-4f72-b3f3-36f6adf01d41 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/a6859225-d99c-41c5-a08b-dd4836bd82c4" status: 200 len: 1318 microversion: 2.1 time: 0.907893 Jul 18 02:13:47.877202 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 633/1317] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:46 2022] GET /compute/v2.1/servers/a6859225-d99c-41c5-a08b-dd4836bd82c4 => generated 1318 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:47.883426 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-249f8b4b-b908-4e43-81dd-53fb830e190e tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:47.884409 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-249f8b4b-b908-4e43-81dd-53fb830e190e tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: b74ae52f-6794-49d2-867e-be0996b090aa] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:47.894771 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-249f8b4b-b908-4e43-81dd-53fb830e190e tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:47.895478 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-249f8b4b-b908-4e43-81dd-53fb830e190e tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:47.897448 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-249f8b4b-b908-4e43-81dd-53fb830e190e tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:47.898211 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-249f8b4b-b908-4e43-81dd-53fb830e190e tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:48.362639 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-249f8b4b-b908-4e43-81dd-53fb830e190e tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe79fa13328b4e40922d0e3e4551a8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6b8514bba84ba8a09c64abbb2d1a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:48.374163 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-249f8b4b-b908-4e43-81dd-53fb830e190e tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "GET /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa" status: 200 len: 1368 microversion: 2.1 time: 0.494327 Jul 18 02:13:48.375025 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 634/1318] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:47 2022] GET /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa => generated 1368 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:48.386155 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-39d1e4fd-8d82-427b-aca1-c961994dc7de tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:48.386558 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-39d1e4fd-8d82-427b-aca1-c961994dc7de tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] [instance: c8ed62a2-40e8-40a5-8ec1-365add95911a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:48.397900 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-39d1e4fd-8d82-427b-aca1-c961994dc7de tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:48.398682 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-39d1e4fd-8d82-427b-aca1-c961994dc7de tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:48.399917 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-39d1e4fd-8d82-427b-aca1-c961994dc7de tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:48.400700 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-39d1e4fd-8d82-427b-aca1-c961994dc7de tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:48.778221 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-39d1e4fd-8d82-427b-aca1-c961994dc7de tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5525cb28fdc490a8e1bafb732a70fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd338c0a2724ca999dc02d93f90860a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:48.789631 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-39d1e4fd-8d82-427b-aca1-c961994dc7de tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] 10.222.0.57 "GET /compute/v2.1/servers/c8ed62a2-40e8-40a5-8ec1-365add95911a" status: 200 len: 1323 microversion: 2.1 time: 0.413004 Jul 18 02:13:48.807601 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 635/1319] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:48 2022] GET /compute/v2.1/servers/c8ed62a2-40e8-40a5-8ec1-365add95911a => generated 1323 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:48.807601 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e5082aa2-0497-4d79-b35d-969d2336f5bd tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:48.807601 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e5082aa2-0497-4d79-b35d-969d2336f5bd tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] [instance: 697075ff-db42-4729-8faf-2c2935d72630] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:48.810470 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e5082aa2-0497-4d79-b35d-969d2336f5bd tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:48.812142 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e5082aa2-0497-4d79-b35d-969d2336f5bd tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:48.812952 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e5082aa2-0497-4d79-b35d-969d2336f5bd tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:48.813393 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e5082aa2-0497-4d79-b35d-969d2336f5bd tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:48.845514 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-392e9489-8632-47b1-a511-664d401a408b tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] [instance: 6a9311f2-f5f3-49f0-831e-728291d16d09] Building network info cache for instance {{(pid=119544) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 18 02:13:49.228676 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e5082aa2-0497-4d79-b35d-969d2336f5bd tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a9dd4e239c4d73bdde1ced9cb90b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5d1b19c84a4a9fa4595a5c84f4555c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:49.239708 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e5082aa2-0497-4d79-b35d-969d2336f5bd tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/servers/697075ff-db42-4729-8faf-2c2935d72630" status: 200 len: 1468 microversion: 2.1 time: 0.448219 Jul 18 02:13:49.252965 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 636/1320] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:48 2022] GET /compute/v2.1/servers/697075ff-db42-4729-8faf-2c2935d72630 => generated 1468 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:49.258684 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-0f3287c0-fe6d-48cd-a032-40c773d548b8 req-3801ffdf-0d06-425a-b122-8aae34586454 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49764b86-41da-4c6d-b069-aaccf92ef89f", "tag": "91c20a21-2cb0-48df-99d9-8ab9275d0bc8"}, {"name": "network-changed", "server_uuid": "b74ae52f-6794-49d2-867e-be0996b090aa", "tag": "22d8b9d4-cdb4-4747-87c6-94168bb42281"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:49.271819 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-0f3287c0-fe6d-48cd-a032-40c773d548b8 req-3801ffdf-0d06-425a-b122-8aae34586454 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:49.272672 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-0f3287c0-fe6d-48cd-a032-40c773d548b8 req-3801ffdf-0d06-425a-b122-8aae34586454 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:49.291261 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-0f3287c0-fe6d-48cd-a032-40c773d548b8 req-3801ffdf-0d06-425a-b122-8aae34586454 service nova] Creating event network-changed:91c20a21-2cb0-48df-99d9-8ab9275d0bc8 for instance 49764b86-41da-4c6d-b069-aaccf92ef89f on n-h2-465891-3 Jul 18 02:13:49.292340 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-0f3287c0-fe6d-48cd-a032-40c773d548b8 req-3801ffdf-0d06-425a-b122-8aae34586454 service nova] Creating event network-changed:22d8b9d4-cdb4-4747-87c6-94168bb42281 for instance b74ae52f-6794-49d2-867e-be0996b090aa on n-h2-465891-3 Jul 18 02:13:49.301047 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-0f3287c0-fe6d-48cd-a032-40c773d548b8 req-3801ffdf-0d06-425a-b122-8aae34586454 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.045848 Jul 18 02:13:49.307758 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 637/1321] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:49.347711 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-7109ab1c-cdb3-4a26-8f92-42ae189a7977 req-e0531124-beac-4bf8-a745-ad364fadfdbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ed62a2-40e8-40a5-8ec1-365add95911a", "name": "network-vif-plugged", "status": "completed", "tag": "e1abec08-da7f-4a23-81d1-ba54d9237748"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:49.368379 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-7109ab1c-cdb3-4a26-8f92-42ae189a7977 req-e0531124-beac-4bf8-a745-ad364fadfdbc service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:49.374142 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-7109ab1c-cdb3-4a26-8f92-42ae189a7977 req-e0531124-beac-4bf8-a745-ad364fadfdbc service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:49.407873 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-7109ab1c-cdb3-4a26-8f92-42ae189a7977 req-e0531124-beac-4bf8-a745-ad364fadfdbc service nova] Creating event network-vif-plugged:e1abec08-da7f-4a23-81d1-ba54d9237748 for instance c8ed62a2-40e8-40a5-8ec1-365add95911a on n-h1-465891-3 Jul 18 02:13:49.416377 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-7109ab1c-cdb3-4a26-8f92-42ae189a7977 req-e0531124-beac-4bf8-a745-ad364fadfdbc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106527 Jul 18 02:13:49.423282 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 638/1322] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:49.436934 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d1927a2d-83e8-4adf-aefb-20c1dfb78531 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:49.438518 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d1927a2d-83e8-4adf-aefb-20c1dfb78531 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 49764b86-41da-4c6d-b069-aaccf92ef89f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:49.453459 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d1927a2d-83e8-4adf-aefb-20c1dfb78531 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:49.455365 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d1927a2d-83e8-4adf-aefb-20c1dfb78531 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:49.458132 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d1927a2d-83e8-4adf-aefb-20c1dfb78531 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:49.458388 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d1927a2d-83e8-4adf-aefb-20c1dfb78531 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:50.173900 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d1927a2d-83e8-4adf-aefb-20c1dfb78531 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:50.183999 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d1927a2d-83e8-4adf-aefb-20c1dfb78531 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:50.185759 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d1927a2d-83e8-4adf-aefb-20c1dfb78531 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:50.187108 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d1927a2d-83e8-4adf-aefb-20c1dfb78531 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f" status: 200 len: 1361 microversion: 2.25 time: 0.762551 Jul 18 02:13:50.187695 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 639/1323] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:13:49 2022] GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f => generated 1361 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:13:50.213567 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-95318897-62dd-4422-b6b7-77b224c9389b tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:50.218761 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-95318897-62dd-4422-b6b7-77b224c9389b tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 2d8e0c47-5276-4d24-9cb3-fb36bb9b6400] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:50.230495 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-95318897-62dd-4422-b6b7-77b224c9389b tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:50.231168 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-95318897-62dd-4422-b6b7-77b224c9389b tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:50.232473 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-95318897-62dd-4422-b6b7-77b224c9389b tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:50.233355 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-95318897-62dd-4422-b6b7-77b224c9389b tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:50.538127 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-95318897-62dd-4422-b6b7-77b224c9389b tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:50.554366 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-95318897-62dd-4422-b6b7-77b224c9389b tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/2d8e0c47-5276-4d24-9cb3-fb36bb9b6400" status: 200 len: 1308 microversion: 2.1 time: 0.344704 Jul 18 02:13:50.554969 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 640/1324] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:50 2022] GET /compute/v2.1/servers/2d8e0c47-5276-4d24-9cb3-fb36bb9b6400 => generated 1308 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:50.559915 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-ad259d3c-7b24-4b24-98fd-3bae94d32641 req-f55dca2d-5226-497e-badd-6d1bbbde2f2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a9311f2-f5f3-49f0-831e-728291d16d09", "tag": "f691d4d0-5b03-4b49-81fe-72116c2da4cb"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:50.577335 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-ad259d3c-7b24-4b24-98fd-3bae94d32641 req-f55dca2d-5226-497e-badd-6d1bbbde2f2b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:50.578161 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-ad259d3c-7b24-4b24-98fd-3bae94d32641 req-f55dca2d-5226-497e-badd-6d1bbbde2f2b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:50.587118 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-392e9489-8632-47b1-a511-664d401a408b tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] [instance: 6a9311f2-f5f3-49f0-831e-728291d16d09] Updating instance_info_cache with network_info: [{"id": "f691d4d0-5b03-4b49-81fe-72116c2da4cb", "address": "fa:16:3e:76:91:ab", "network": {"id": "9c108108-5ed1-42f1-a1fc-37dc836711d5", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-525633580-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3a94aaf6ca324e97aec2f6e982416f9b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf691d4d0-5b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119544) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 18 02:13:50.591843 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-ad259d3c-7b24-4b24-98fd-3bae94d32641 req-f55dca2d-5226-497e-badd-6d1bbbde2f2b service nova] Creating event network-changed:f691d4d0-5b03-4b49-81fe-72116c2da4cb for instance 6a9311f2-f5f3-49f0-831e-728291d16d09 on n-h1-465891-3 Jul 18 02:13:50.598109 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-ad259d3c-7b24-4b24-98fd-3bae94d32641 req-f55dca2d-5226-497e-badd-6d1bbbde2f2b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041627 Jul 18 02:13:50.602370 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 641/1325] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:50.608982 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-32ba9dbf-5a3f-40cd-9773-36f05dfeea50 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:50.609693 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-32ba9dbf-5a3f-40cd-9773-36f05dfeea50 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: a6859225-d99c-41c5-a08b-dd4836bd82c4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:50.616572 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-32ba9dbf-5a3f-40cd-9773-36f05dfeea50 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:50.617029 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-32ba9dbf-5a3f-40cd-9773-36f05dfeea50 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:50.617898 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-32ba9dbf-5a3f-40cd-9773-36f05dfeea50 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:50.618556 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-32ba9dbf-5a3f-40cd-9773-36f05dfeea50 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:50.621538 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-392e9489-8632-47b1-a511-664d401a408b tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Releasing lock "refresh_cache-6a9311f2-f5f3-49f0-831e-728291d16d09" {{(pid=119544) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 02:13:50.623700 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-392e9489-8632-47b1-a511-664d401a408b tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] 10.222.0.57 "POST /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09/action" status: 202 len: 0 microversion: 2.1 time: 5.965812 Jul 18 02:13:50.624783 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 685/1326] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:13:44 2022] POST /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09/action => generated 0 bytes in 5968 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 18 02:13:50.641740 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9a0c7d21-68a1-44c9-a1f9-d320319c6576 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2103753026"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:50.644356 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9a0c7d21-68a1-44c9-a1f9-d320319c6576 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] [instance: 32e81b5d-a507-4d47-b76e-699091d0e5bd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:50.660237 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9a0c7d21-68a1-44c9-a1f9-d320319c6576 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:50.673349 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9a0c7d21-68a1-44c9-a1f9-d320319c6576 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:50.679589 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9a0c7d21-68a1-44c9-a1f9-d320319c6576 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:50.680575 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9a0c7d21-68a1-44c9-a1f9-d320319c6576 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:50.800647 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-32ba9dbf-5a3f-40cd-9773-36f05dfeea50 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:50.810715 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-32ba9dbf-5a3f-40cd-9773-36f05dfeea50 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/a6859225-d99c-41c5-a08b-dd4836bd82c4" status: 200 len: 1468 microversion: 2.1 time: 0.206361 Jul 18 02:13:50.814251 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 642/1327] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:50 2022] GET /compute/v2.1/servers/a6859225-d99c-41c5-a08b-dd4836bd82c4 => generated 1468 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:50.819768 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ae9991bc-4ad5-4dd8-b451-8f18ef61c7b1 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:50.820533 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ae9991bc-4ad5-4dd8-b451-8f18ef61c7b1 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: b74ae52f-6794-49d2-867e-be0996b090aa] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:50.828686 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ae9991bc-4ad5-4dd8-b451-8f18ef61c7b1 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:50.829215 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ae9991bc-4ad5-4dd8-b451-8f18ef61c7b1 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:50.830178 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ae9991bc-4ad5-4dd8-b451-8f18ef61c7b1 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:50.830912 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ae9991bc-4ad5-4dd8-b451-8f18ef61c7b1 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:51.065943 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ae9991bc-4ad5-4dd8-b451-8f18ef61c7b1 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe79fa13328b4e40922d0e3e4551a8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6b8514bba84ba8a09c64abbb2d1a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:51.077974 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ae9991bc-4ad5-4dd8-b451-8f18ef61c7b1 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "GET /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa" status: 200 len: 1368 microversion: 2.1 time: 0.262290 Jul 18 02:13:51.079073 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 643/1328] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:50 2022] GET /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa => generated 1368 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:51.084398 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1fc47f48-2941-4b1d-8f2d-396d3377272e tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:51.085526 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1fc47f48-2941-4b1d-8f2d-396d3377272e tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] [instance: c8ed62a2-40e8-40a5-8ec1-365add95911a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:51.092956 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1fc47f48-2941-4b1d-8f2d-396d3377272e tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:51.094211 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1fc47f48-2941-4b1d-8f2d-396d3377272e tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:51.095672 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1fc47f48-2941-4b1d-8f2d-396d3377272e tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:51.096401 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1fc47f48-2941-4b1d-8f2d-396d3377272e tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:51.228480 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9a0c7d21-68a1-44c9-a1f9-d320319c6576 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "POST /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd/action" status: 202 len: 0 microversion: 2.1 time: 0.600595 Jul 18 02:13:51.230910 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 686/1329] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:13:50 2022] POST /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd/action => generated 0 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 18 02:13:51.245676 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-509f0804-204b-472a-91ab-9dd22a915665 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Action: 'create', calling method: .version_select at 0x7ff4a8714160>, body: {"pool": "9c68fd03-321e-4186-960a-dc0f5151c936"} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:51.267475 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1fc47f48-2941-4b1d-8f2d-396d3377272e tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5525cb28fdc490a8e1bafb732a70fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd338c0a2724ca999dc02d93f90860a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:51.284464 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1fc47f48-2941-4b1d-8f2d-396d3377272e tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] 10.222.0.57 "GET /compute/v2.1/servers/c8ed62a2-40e8-40a5-8ec1-365add95911a" status: 200 len: 1323 microversion: 2.1 time: 0.203563 Jul 18 02:13:51.304163 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 644/1330] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:51 2022] GET /compute/v2.1/servers/c8ed62a2-40e8-40a5-8ec1-365add95911a => generated 1323 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:51.310488 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3a98761d-e124-4b1b-8517-d86d310fde40 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:51.317931 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3a98761d-e124-4b1b-8517-d86d310fde40 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:51.319229 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3a98761d-e124-4b1b-8517-d86d310fde40 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Searching by: {'reservation_id': 'r-156qc5f5', 'deleted': False, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41'} {{(pid=119543) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:13:51.327203 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3a98761d-e124-4b1b-8517-d86d310fde40 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:51.328215 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3a98761d-e124-4b1b-8517-d86d310fde40 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:51.329616 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3a98761d-e124-4b1b-8517-d86d310fde40 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:51.330174 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3a98761d-e124-4b1b-8517-d86d310fde40 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:51.586282 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.multi_cell_list [None req-3a98761d-e124-4b1b-8517-d86d310fde40 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119543) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:13:51.677321 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:13:51.709375 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3a98761d-e124-4b1b-8517-d86d310fde40 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:51.718662 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3a98761d-e124-4b1b-8517-d86d310fde40 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:51.719116 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3a98761d-e124-4b1b-8517-d86d310fde40 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:51.969870 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3a98761d-e124-4b1b-8517-d86d310fde40 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/detail?reservation_id=r-156qc5f5" status: 200 len: 2929 microversion: 2.1 time: 0.663635 Jul 18 02:13:51.971734 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 645/1331] 10.222.0.57 () {58 vars in 1196 bytes} [Mon Jul 18 02:13:51 2022] GET /compute/v2.1/servers/detail?reservation_id=r-156qc5f5 => generated 2929 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:51.981318 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2ff3d65c-ace0-4af5-bf16-3196700fb8af tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:51.983193 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2ff3d65c-ace0-4af5-bf16-3196700fb8af tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 49764b86-41da-4c6d-b069-aaccf92ef89f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:52.000392 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2ff3d65c-ace0-4af5-bf16-3196700fb8af tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:52.000852 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2ff3d65c-ace0-4af5-bf16-3196700fb8af tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:52.001662 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2ff3d65c-ace0-4af5-bf16-3196700fb8af tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:52.002153 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2ff3d65c-ace0-4af5-bf16-3196700fb8af tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:52.488980 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2ff3d65c-ace0-4af5-bf16-3196700fb8af tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:52.504347 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2ff3d65c-ace0-4af5-bf16-3196700fb8af tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:52.506784 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2ff3d65c-ace0-4af5-bf16-3196700fb8af tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:52.508165 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2ff3d65c-ace0-4af5-bf16-3196700fb8af tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f" status: 200 len: 1361 microversion: 2.25 time: 0.535306 Jul 18 02:13:52.508842 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 646/1332] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:13:51 2022] GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f => generated 1361 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:13:52.514982 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-658cd45a-aa64-4b38-af10-f441601326b2 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a89dcaf0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:52.583769 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-658cd45a-aa64-4b38-af10-f441601326b2 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/9053bb1e-a3c0-4052-9d8d-7b964f899348" status: 200 len: 1455 microversion: 2.1 time: 0.072645 Jul 18 02:13:52.593634 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 647/1333] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:13:52 2022] GET /compute/v2.1/images/9053bb1e-a3c0-4052-9d8d-7b964f899348 => generated 1455 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:52.596097 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-72411308-9247-462f-a637-9a7eb0f6d457 req-1ad9cfe5-69dd-4a89-a488-33b8e8088884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "697075ff-db42-4729-8faf-2c2935d72630", "name": "network-vif-unplugged", "status": "completed", "tag": "26b96c32-3f20-4f09-8e97-8a938a803c4c"}, {"server_uuid": "2d8e0c47-5276-4d24-9cb3-fb36bb9b6400", "name": "network-vif-plugged", "status": "completed", "tag": "d2e3884d-a86d-4462-b786-c48742d72cd5"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:52.616586 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-72411308-9247-462f-a637-9a7eb0f6d457 req-1ad9cfe5-69dd-4a89-a488-33b8e8088884 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:52.617205 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-72411308-9247-462f-a637-9a7eb0f6d457 req-1ad9cfe5-69dd-4a89-a488-33b8e8088884 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:52.637403 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-72411308-9247-462f-a637-9a7eb0f6d457 req-1ad9cfe5-69dd-4a89-a488-33b8e8088884 service nova] Creating event network-vif-unplugged:26b96c32-3f20-4f09-8e97-8a938a803c4c for instance 697075ff-db42-4729-8faf-2c2935d72630 on n-h2-465891-3 Jul 18 02:13:52.638133 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-72411308-9247-462f-a637-9a7eb0f6d457 req-1ad9cfe5-69dd-4a89-a488-33b8e8088884 service nova] Creating event network-vif-plugged:d2e3884d-a86d-4462-b786-c48742d72cd5 for instance 2d8e0c47-5276-4d24-9cb3-fb36bb9b6400 on n-h1-465891-3 Jul 18 02:13:52.649085 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-72411308-9247-462f-a637-9a7eb0f6d457 req-1ad9cfe5-69dd-4a89-a488-33b8e8088884 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.062713 Jul 18 02:13:52.649985 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 648/1334] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:52.656347 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a8af83d9-06a8-4e4f-bfda-8baf4a6f7f49 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:52.657081 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a8af83d9-06a8-4e4f-bfda-8baf4a6f7f49 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 2d8e0c47-5276-4d24-9cb3-fb36bb9b6400] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:52.664562 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a8af83d9-06a8-4e4f-bfda-8baf4a6f7f49 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:52.665076 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a8af83d9-06a8-4e4f-bfda-8baf4a6f7f49 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:52.665942 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a8af83d9-06a8-4e4f-bfda-8baf4a6f7f49 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:52.666399 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a8af83d9-06a8-4e4f-bfda-8baf4a6f7f49 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:53.388404 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a8af83d9-06a8-4e4f-bfda-8baf4a6f7f49 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:53.406379 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a8af83d9-06a8-4e4f-bfda-8baf4a6f7f49 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/2d8e0c47-5276-4d24-9cb3-fb36bb9b6400" status: 200 len: 1308 microversion: 2.1 time: 0.753968 Jul 18 02:13:53.407774 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 649/1335] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:52 2022] GET /compute/v2.1/servers/2d8e0c47-5276-4d24-9cb3-fb36bb9b6400 => generated 1308 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:53.417870 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a8b8440d-6131-4387-9ae3-4d0067963995 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:53.447435 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.compute.server_groups [None req-a8b8440d-6131-4387-9ae3-4d0067963995 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Querying cell 2a4b42c4-bf71-4fae-804a-3632602c55fa(cell1) for 2 instances {{(pid=119543) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 18 02:13:53.448633 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a8b8440d-6131-4387-9ae3-4d0067963995 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:53.449679 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a8b8440d-6131-4387-9ae3-4d0067963995 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:53.501079 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a8b8440d-6131-4387-9ae3-4d0067963995 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/os-server-groups/79c8cde4-43d9-44ee-a52f-1013fc485b00" status: 200 len: 266 microversion: 2.1 time: 0.091113 Jul 18 02:13:53.502362 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 650/1336] 10.222.0.57 () {58 vars in 1262 bytes} [Mon Jul 18 02:13:53 2022] GET /compute/v2.1/os-server-groups/79c8cde4-43d9-44ee-a52f-1013fc485b00 => generated 266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:53.511383 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bd777c51-7abd-4c34-bf16-d2d110d10db3 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:53.512276 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bd777c51-7abd-4c34-bf16-d2d110d10db3 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: b74ae52f-6794-49d2-867e-be0996b090aa] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:53.525835 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bd777c51-7abd-4c34-bf16-d2d110d10db3 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:53.526484 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bd777c51-7abd-4c34-bf16-d2d110d10db3 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:53.528131 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bd777c51-7abd-4c34-bf16-d2d110d10db3 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:53.529669 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bd777c51-7abd-4c34-bf16-d2d110d10db3 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:53.814349 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bd777c51-7abd-4c34-bf16-d2d110d10db3 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe79fa13328b4e40922d0e3e4551a8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6b8514bba84ba8a09c64abbb2d1a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:53.831337 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bd777c51-7abd-4c34-bf16-d2d110d10db3 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "GET /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa" status: 200 len: 1368 microversion: 2.1 time: 0.327232 Jul 18 02:13:53.832762 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 651/1337] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:53 2022] GET /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa => generated 1368 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:53.842681 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-947d7eeb-3528-4ce5-9e4c-f3962c1a2f11 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:53.844188 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-947d7eeb-3528-4ce5-9e4c-f3962c1a2f11 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] [instance: c8ed62a2-40e8-40a5-8ec1-365add95911a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:53.856537 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-947d7eeb-3528-4ce5-9e4c-f3962c1a2f11 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:53.857364 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-947d7eeb-3528-4ce5-9e4c-f3962c1a2f11 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:53.858829 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-947d7eeb-3528-4ce5-9e4c-f3962c1a2f11 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:53.859615 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-947d7eeb-3528-4ce5-9e4c-f3962c1a2f11 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:54.158375 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-509f0804-204b-472a-91ab-9dd22a915665 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] 10.222.0.57 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.923094 Jul 18 02:13:54.159442 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 687/1338] 10.222.0.57 () {60 vars in 1169 bytes} [Mon Jul 18 02:13:51 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2928 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:54.167910 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-de28121b-0631-4000-95e3-04011cafad26 tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:54.170628 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-de28121b-0631-4000-95e3-04011cafad26 tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] [instance: a598ccda-c16b-45d8-aca0-d3d242ec0c23] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:54.181836 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-de28121b-0631-4000-95e3-04011cafad26 tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:54.182508 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-de28121b-0631-4000-95e3-04011cafad26 tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:54.183528 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-de28121b-0631-4000-95e3-04011cafad26 tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:54.184118 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-de28121b-0631-4000-95e3-04011cafad26 tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:54.200076 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-947d7eeb-3528-4ce5-9e4c-f3962c1a2f11 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5525cb28fdc490a8e1bafb732a70fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd338c0a2724ca999dc02d93f90860a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:54.213936 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-947d7eeb-3528-4ce5-9e4c-f3962c1a2f11 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] 10.222.0.57 "GET /compute/v2.1/servers/c8ed62a2-40e8-40a5-8ec1-365add95911a" status: 200 len: 1520 microversion: 2.1 time: 0.379259 Jul 18 02:13:54.215029 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 652/1339] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:53 2022] GET /compute/v2.1/servers/c8ed62a2-40e8-40a5-8ec1-365add95911a => generated 1520 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:54.224686 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4fb2fe6c-5be1-4e9e-9d89-089b53044d3e tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:54.225796 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4fb2fe6c-5be1-4e9e-9d89-089b53044d3e tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 49764b86-41da-4c6d-b069-aaccf92ef89f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:54.238088 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4fb2fe6c-5be1-4e9e-9d89-089b53044d3e tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:54.238502 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4fb2fe6c-5be1-4e9e-9d89-089b53044d3e tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:54.239910 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4fb2fe6c-5be1-4e9e-9d89-089b53044d3e tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:54.240701 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4fb2fe6c-5be1-4e9e-9d89-089b53044d3e tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:54.390452 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-de28121b-0631-4000-95e3-04011cafad26 tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/a598ccda-c16b-45d8-aca0-d3d242ec0c23" status: 200 len: 1619 microversion: 2.1 time: 0.229119 Jul 18 02:13:54.391054 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 688/1340] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:54 2022] GET /compute/v2.1/servers/a598ccda-c16b-45d8-aca0-d3d242ec0c23 => generated 1619 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:54.395799 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b46132f6-2564-4a17-bae9-3dda3b24d5b9 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a88b3550>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:54.445076 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4fb2fe6c-5be1-4e9e-9d89-089b53044d3e tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:54.457420 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b46132f6-2564-4a17-bae9-3dda3b24d5b9 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/9053bb1e-a3c0-4052-9d8d-7b964f899348" status: 200 len: 1455 microversion: 2.1 time: 0.065266 Jul 18 02:13:54.457783 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4fb2fe6c-5be1-4e9e-9d89-089b53044d3e tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:54.458058 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 689/1341] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:13:54 2022] GET /compute/v2.1/images/9053bb1e-a3c0-4052-9d8d-7b964f899348 => generated 1455 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:54.459006 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4fb2fe6c-5be1-4e9e-9d89-089b53044d3e tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:54.460182 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4fb2fe6c-5be1-4e9e-9d89-089b53044d3e tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f" status: 200 len: 1361 microversion: 2.25 time: 0.243173 Jul 18 02:13:54.460755 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 653/1342] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:13:54 2022] GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f => generated 1361 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:13:54.462930 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4bcf0e55-d7f5-4c95-a87a-83e6ad9d7a6d tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.226"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:54.464101 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4bcf0e55-d7f5-4c95-a87a-83e6ad9d7a6d tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] [instance: 6a9311f2-f5f3-49f0-831e-728291d16d09] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:54.466124 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e6a6bcc0-61af-4a4c-9063-9d37123996d8 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-152638126", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "e94427d9-3817-4c97-8760-c29504bd94db"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:54.469367 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e6a6bcc0-61af-4a4c-9063-9d37123996d8 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Request method failure captured: Jul 18 02:13:54.469367 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:13:54.469367 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:13:54.469367 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:13:54.469367 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:13:54.469367 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 242 Jul 18 02:13:54.469367 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:13:54.469367 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:13:54.469367 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:13:54.469367 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:13:54.469367 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MGyvmfvOW92_8EFRzjxzrpzIZh4SiXbkPCyi0rdQ7sO-bz1u6KTqOmvLLovRhlo2jvmO_hhmIzQNZ9Dayn2AL9gLkZBZsGHvGbiptq8pOSeqB-B5lxFErIGNamep1fiheOEGYzF2iaXbjVWuwOcVnTLYKDxJ4Lz32i7NEeT4IcA5FI Jul 18 02:13:54.469367 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:13:54.469367 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:13:54.469367 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:13:54.469367 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:13:54.469367 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:13:54.469367 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:13:54.469367 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 4cd338c0a2724ca999dc02d93f90860a Jul 18 02:13:54.469367 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-321384848 Jul 18 02:13:54.469367 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:13:54.469367 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:13:54.471376 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4cd338c0a2724ca999dc02d93f90860a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4cd338c0a2724ca999dc02d93f90860a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4cd338c0a2724ca999dc02d93f90860a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4cd338c0a2724ca999dc02d93f90860a"}]}] Jul 18 02:13:54.471376 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-321384848 Jul 18 02:13:54.471376 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 4cd338c0a2724ca999dc02d93f90860a Jul 18 02:13:54.471376 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-321384848 Jul 18 02:13:54.471376 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServerMetadataNegativeTestJSON-321384848-project Jul 18 02:13:54.471376 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:13:54.471376 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:13:54.471376 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: e5525cb28fdc490a8e1bafb732a70fc6 Jul 18 02:13:54.471376 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-321384848-project Jul 18 02:13:54.471376 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 02:13:54.471376 n-d-465891-3 devstack@n-api.service[119543]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-152638126", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "e94427d9-3817-4c97-8760-c29504bd94db"}]}} Jul 18 02:13:54.472314 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:13:54.472314 n-d-465891-3 devstack@n-api.service[119543]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:13:54.472314 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-152638126', 'imageRef': '3bb0a19f-5b69-48ee-a771-8fd416f92f36', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'e94427d9-3817-4c97-8760-c29504bd94db'}]}}} Jul 18 02:13:54.472314 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:13:54.472314 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:54.472314 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:13:54.472314 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:13:54.472314 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:13:54.472314 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:13:54.472314 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:13:54.472314 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:13:54.472314 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 18 02:13:54.472314 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 18 02:13:54.472314 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 18 02:13:54.472314 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 18 02:13:54.472314 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 18 02:13:54.472314 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:13:54.472314 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 02:13:54.472314 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi {'': 'data1'} Jul 18 02:13:54.473792 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:13:54.473792 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:13:54.473792 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:13:54.473792 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:54.473792 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:13:54.473792 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:13:54.473792 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:13:54.473792 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:13:54.473792 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:13:54.473792 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:13:54.473792 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:13:54.473792 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:13:54.473792 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:13:54.473792 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:13:54.473792 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:13:54.473792 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:13:54.473792 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:13:54.473792 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:13:54.473792 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:13:54.473792 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:13:54.475328 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:13:54.475328 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:13:54.475328 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:54.475328 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:13:54.475328 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:13:54.475328 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:13:54.475328 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:13:54.475328 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:13:54.475328 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:13:54.476082 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4bcf0e55-d7f5-4c95-a87a-83e6ad9d7a6d tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:54.476082 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4bcf0e55-d7f5-4c95-a87a-83e6ad9d7a6d tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:54.476082 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4bcf0e55-d7f5-4c95-a87a-83e6ad9d7a6d tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:54.476350 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4bcf0e55-d7f5-4c95-a87a-83e6ad9d7a6d tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:54.477258 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e6a6bcc0-61af-4a4c-9063-9d37123996d8 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:13:54.478291 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e6a6bcc0-61af-4a4c-9063-9d37123996d8 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.016449 Jul 18 02:13:54.479218 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 654/1343] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:13:54 2022] POST /compute/v2.1/servers => generated 175 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:13:54.484497 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a1fae12b-5dcd-4baf-8de3-906b96f7d94c tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:54.485377 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a1fae12b-5dcd-4baf-8de3-906b96f7d94c tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] [instance: a6859225-d99c-41c5-a08b-dd4836bd82c4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:54.498803 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a1fae12b-5dcd-4baf-8de3-906b96f7d94c tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:54.499576 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a1fae12b-5dcd-4baf-8de3-906b96f7d94c tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:54.500908 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a1fae12b-5dcd-4baf-8de3-906b96f7d94c tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:54.501664 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a1fae12b-5dcd-4baf-8de3-906b96f7d94c tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:54.526571 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4bcf0e55-d7f5-4c95-a87a-83e6ad9d7a6d tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Acquired lock "refresh_cache-6a9311f2-f5f3-49f0-831e-728291d16d09" {{(pid=119544) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 02:13:54.817829 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a1fae12b-5dcd-4baf-8de3-906b96f7d94c tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/a6859225-d99c-41c5-a08b-dd4836bd82c4" status: 200 len: 1619 microversion: 2.1 time: 0.336850 Jul 18 02:13:54.821081 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 655/1344] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:54 2022] GET /compute/v2.1/servers/a6859225-d99c-41c5-a08b-dd4836bd82c4 => generated 1619 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:54.836159 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-61f32424-3a0a-4899-8962-7d62735230b8 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:54.838366 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-61f32424-3a0a-4899-8962-7d62735230b8 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 2d8e0c47-5276-4d24-9cb3-fb36bb9b6400] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:54.858852 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-61f32424-3a0a-4899-8962-7d62735230b8 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:54.859719 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-61f32424-3a0a-4899-8962-7d62735230b8 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:54.861475 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-61f32424-3a0a-4899-8962-7d62735230b8 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:54.862582 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-61f32424-3a0a-4899-8962-7d62735230b8 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:55.202744 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-61f32424-3a0a-4899-8962-7d62735230b8 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:55.218037 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-61f32424-3a0a-4899-8962-7d62735230b8 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/2d8e0c47-5276-4d24-9cb3-fb36bb9b6400" status: 200 len: 1488 microversion: 2.1 time: 0.394062 Jul 18 02:13:55.229740 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 656/1345] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:54 2022] GET /compute/v2.1/servers/2d8e0c47-5276-4d24-9cb3-fb36bb9b6400 => generated 1488 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:55.229740 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-655a8c20-bfb9-4fa2-82b3-6f075c1e73f9 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:55.230275 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-655a8c20-bfb9-4fa2-82b3-6f075c1e73f9 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] [instance: e5616661-f5ef-46ad-9edb-ec5c12bacf46] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:55.244839 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-655a8c20-bfb9-4fa2-82b3-6f075c1e73f9 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] HTTP exception thrown: Instance e5616661-f5ef-46ad-9edb-ec5c12bacf46 could not be found. Jul 18 02:13:55.249057 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-655a8c20-bfb9-4fa2-82b3-6f075c1e73f9 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Request method failure captured: Jul 18 02:13:55.249057 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/e5616661-f5ef-46ad-9edb-ec5c12bacf46/metadata HTTP/1.1 Jul 18 02:13:55.249057 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:13:55.249057 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:13:55.249057 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:13:55.249057 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:13:55.249057 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:13:55.249057 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:13:55.249057 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:13:55.249057 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:13:55.249057 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MGyvmfvOW92_8EFRzjxzrpzIZh4SiXbkPCyi0rdQ7sO-bz1u6KTqOmvLLovRhlo2jvmO_hhmIzQNZ9Dayn2AL9gLkZBZsGHvGbiptq8pOSeqB-B5lxFErIGNamep1fiheOEGYzF2iaXbjVWuwOcVnTLYKDxJ4Lz32i7NEeT4IcA5FI Jul 18 02:13:55.249057 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:13:55.249057 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:13:55.249057 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:13:55.249057 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:13:55.249057 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:13:55.249057 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:13:55.249057 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 4cd338c0a2724ca999dc02d93f90860a Jul 18 02:13:55.249057 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-321384848 Jul 18 02:13:55.249057 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:13:55.249057 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:13:55.250816 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4cd338c0a2724ca999dc02d93f90860a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4cd338c0a2724ca999dc02d93f90860a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4cd338c0a2724ca999dc02d93f90860a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4cd338c0a2724ca999dc02d93f90860a"}]}] Jul 18 02:13:55.250816 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-321384848 Jul 18 02:13:55.250816 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 4cd338c0a2724ca999dc02d93f90860a Jul 18 02:13:55.250816 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-321384848 Jul 18 02:13:55.250816 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServerMetadataNegativeTestJSON-321384848-project Jul 18 02:13:55.250816 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:13:55.250816 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:13:55.250816 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: e5525cb28fdc490a8e1bafb732a70fc6 Jul 18 02:13:55.250816 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-321384848-project Jul 18 02:13:55.250816 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:13:55.250816 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance e5616661-f5ef-46ad-9edb-ec5c12bacf46 could not be found. Jul 18 02:13:55.250816 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'server_id': 'e5616661-f5ef-46ad-9edb-ec5c12bacf46'} Jul 18 02:13:55.251730 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:13:55.251730 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:55.251730 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:13:55.251730 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:13:55.251730 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:13:55.251730 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:13:55.251730 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 02:13:55.251730 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 02:13:55.251730 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5616661-f5ef-46ad-9edb-ec5c12bacf46 could not be found. Jul 18 02:13:55.251730 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:13:55.251730 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:13:55.251730 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:13:55.251730 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:55.251730 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:13:55.251730 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:13:55.251730 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:13:55.251730 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:13:55.251730 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:13:55.251730 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:13:55.251730 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Jul 18 02:13:55.253271 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 18 02:13:55.253271 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:13:55.253271 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:13:55.253271 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5616661-f5ef-46ad-9edb-ec5c12bacf46 could not be found. Jul 18 02:13:55.253271 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:13:55.253271 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:13:55.253271 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:13:55.253271 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:55.253271 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:13:55.253271 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:13:55.253271 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:13:55.253271 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:13:55.253271 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5616661-f5ef-46ad-9edb-ec5c12bacf46 could not be found. Jul 18 02:13:55.253271 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:13:55.254567 n-d-465891-3 devstack@n-api.service[119544]: DEBUG neutronclient.v2_0.client [None req-4bcf0e55-d7f5-4c95-a87a-83e6ad9d7a6d tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.3.226 (baf1c57f-b526-4040-bff6-69cfb344eaab) with port f691d4d0-5b03-4b49-81fe-72116c2da4cb using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 9c68fd03-321e-4186-960a-dc0f5151c936.", "detail": ""}} {{(pid=119544) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:13:55.255558 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-655a8c20-bfb9-4fa2-82b3-6f075c1e73f9 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Returning 404 to user: Instance e5616661-f5ef-46ad-9edb-ec5c12bacf46 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:13:55.257369 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-655a8c20-bfb9-4fa2-82b3-6f075c1e73f9 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] 10.222.0.57 "GET /compute/v2.1/servers/e5616661-f5ef-46ad-9edb-ec5c12bacf46/metadata" status: 404 len: 111 microversion: 2.1 time: 0.035632 Jul 18 02:13:55.258573 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 657/1346] 10.222.0.57 () {58 vars in 1262 bytes} [Mon Jul 18 02:13:55 2022] GET /compute/v2.1/servers/e5616661-f5ef-46ad-9edb-ec5c12bacf46/metadata => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:13:55.261434 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4bcf0e55-d7f5-4c95-a87a-83e6ad9d7a6d tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Releasing lock "refresh_cache-6a9311f2-f5f3-49f0-831e-728291d16d09" {{(pid=119544) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 02:13:55.262967 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-4bcf0e55-d7f5-4c95-a87a-83e6ad9d7a6d tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] HTTP exception thrown: Cannot associate floating IP 172.25.3.226 (baf1c57f-b526-4040-bff6-69cfb344eaab) with port f691d4d0-5b03-4b49-81fe-72116c2da4cb using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 9c68fd03-321e-4186-960a-dc0f5151c936. Jul 18 02:13:55.262967 n-d-465891-3 devstack@n-api.service[119544]: Neutron server returns request_ids: ['req-66980b5c-39d4-4f40-a0b3-af5d1095d412'] Jul 18 02:13:55.274609 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-a2d016c7-b5f9-45fe-880d-904f99e1fe7a req-71f7dfa1-9ea7-4683-81f2-65d2dc527235 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49764b86-41da-4c6d-b069-aaccf92ef89f", "name": "network-vif-plugged", "status": "completed", "tag": "91c20a21-2cb0-48df-99d9-8ab9275d0bc8"}, {"server_uuid": "b74ae52f-6794-49d2-867e-be0996b090aa", "name": "network-vif-plugged", "status": "completed", "tag": "22d8b9d4-cdb4-4747-87c6-94168bb42281"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:55.276441 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4bcf0e55-d7f5-4c95-a87a-83e6ad9d7a6d tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Request method failure captured: Jul 18 02:13:55.276441 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09/action HTTP/1.1 Jul 18 02:13:55.276441 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:13:55.276441 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:13:55.276441 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:13:55.276441 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 46 Jul 18 02:13:55.276441 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:13:55.276441 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:13:55.276441 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:13:55.276441 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:13:55.276441 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MGTGvtt_IEOf9uBOa0rn3DuCRCY0-R0WX9y8-LDCmVVy_XQ_NqlZenh4yE4xW6cr8CjfmzKHIY8E6j2QQ67LgHwFHRAJRt-fTfeUPVmSfiZoTgU5XLXYI8ER0gh6EQq8vzHpW9cw-4F19UXXFKa8SJW6umz8lZFTbXmx2f7ZJhPVYQ Jul 18 02:13:55.276441 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:13:55.276441 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:13:55.276441 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:13:55.276441 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:13:55.276441 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:13:55.276441 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:13:55.276441 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 3a94aaf6ca324e97aec2f6e982416f9b Jul 18 02:13:55.276441 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-819607396 Jul 18 02:13:55.276441 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:13:55.276441 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:13:55.279976 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3a94aaf6ca324e97aec2f6e982416f9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a94aaf6ca324e97aec2f6e982416f9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a94aaf6ca324e97aec2f6e982416f9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3a94aaf6ca324e97aec2f6e982416f9b"}]}] Jul 18 02:13:55.279976 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-819607396 Jul 18 02:13:55.279976 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 3a94aaf6ca324e97aec2f6e982416f9b Jul 18 02:13:55.279976 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-819607396 Jul 18 02:13:55.279976 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project Jul 18 02:13:55.279976 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:13:55.279976 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:13:55.279976 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: c83428adc93d4dd9a3884659a73bd865 Jul 18 02:13:55.279976 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project Jul 18 02:13:55.279976 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:13:55.279976 n-d-465891-3 devstack@n-api.service[119544]: {"addFloatingIp": {"address": "172.25.3.226"}} Jul 18 02:13:55.279976 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:13:55.283692 n-d-465891-3 devstack@n-api.service[119544]: exception: Cannot associate floating IP 172.25.3.226 (baf1c57f-b526-4040-bff6-69cfb344eaab) with port f691d4d0-5b03-4b49-81fe-72116c2da4cb using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 9c68fd03-321e-4186-960a-dc0f5151c936. Jul 18 02:13:55.283692 n-d-465891-3 devstack@n-api.service[119544]: Neutron server returns request_ids: ['req-66980b5c-39d4-4f40-a0b3-af5d1095d412'] Jul 18 02:13:55.283692 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '6a9311f2-f5f3-49f0-831e-728291d16d09', 'body': {'addFloatingIp': {'address': '172.25.3.226'}}} Jul 18 02:13:55.283692 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:13:55.283692 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:55.283692 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Jul 18 02:13:55.283692 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Jul 18 02:13:55.283692 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:13:55.283692 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:13:55.283692 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Jul 18 02:13:55.283692 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Jul 18 02:13:55.283692 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:13:55.283692 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:13:55.283692 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Jul 18 02:13:55.283692 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Jul 18 02:13:55.283692 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:13:55.283692 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:13:55.288517 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Jul 18 02:13:55.288517 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Jul 18 02:13:55.288517 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:13:55.288517 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:13:55.288517 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:13:55.288517 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:13:55.288517 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:13:55.288517 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:13:55.288517 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:13:55.288517 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:13:55.288517 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:13:55.288517 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:13:55.288517 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:13:55.288517 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:13:55.288517 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:13:55.288517 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:13:55.298094 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.3.226 (baf1c57f-b526-4040-bff6-69cfb344eaab) with port f691d4d0-5b03-4b49-81fe-72116c2da4cb using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 9c68fd03-321e-4186-960a-dc0f5151c936. Jul 18 02:13:55.298094 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66980b5c-39d4-4f40-a0b3-af5d1095d412'] Jul 18 02:13:55.298094 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:13:55.298094 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:13:55.298094 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:13:55.298094 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:55.298094 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 18 02:13:55.298094 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 18 02:13:55.298094 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 18 02:13:55.298094 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 18 02:13:55.298094 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Jul 18 02:13:55.298094 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Jul 18 02:13:55.298094 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.3.226 (baf1c57f-b526-4040-bff6-69cfb344eaab) with port f691d4d0-5b03-4b49-81fe-72116c2da4cb using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 9c68fd03-321e-4186-960a-dc0f5151c936. Jul 18 02:13:55.298094 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66980b5c-39d4-4f40-a0b3-af5d1095d412'] Jul 18 02:13:55.298094 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:13:55.298094 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:13:55.300458 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:13:55.300458 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:55.300458 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:13:55.300458 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:13:55.300458 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:13:55.300458 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:13:55.300458 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:13:55.300458 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:13:55.300458 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:13:55.300458 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:13:55.300458 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:13:55.300458 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:13:55.300458 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Jul 18 02:13:55.300458 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 02:13:55.300458 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.3.226 (baf1c57f-b526-4040-bff6-69cfb344eaab) with port f691d4d0-5b03-4b49-81fe-72116c2da4cb using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 9c68fd03-321e-4186-960a-dc0f5151c936. Jul 18 02:13:55.300458 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66980b5c-39d4-4f40-a0b3-af5d1095d412'] Jul 18 02:13:55.300458 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:13:55.300458 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:13:55.303149 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:13:55.303149 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:55.303149 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:13:55.303149 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:13:55.303149 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:13:55.303149 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:13:55.303149 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.3.226 (baf1c57f-b526-4040-bff6-69cfb344eaab) with port f691d4d0-5b03-4b49-81fe-72116c2da4cb using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 9c68fd03-321e-4186-960a-dc0f5151c936. Jul 18 02:13:55.303149 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66980b5c-39d4-4f40-a0b3-af5d1095d412'] Jul 18 02:13:55.303149 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:13:55.303149 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4bcf0e55-d7f5-4c95-a87a-83e6ad9d7a6d tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Returning 400 to user: Cannot associate floating IP 172.25.3.226 (baf1c57f-b526-4040-bff6-69cfb344eaab) with port f691d4d0-5b03-4b49-81fe-72116c2da4cb using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 9c68fd03-321e-4186-960a-dc0f5151c936. Jul 18 02:13:55.303149 n-d-465891-3 devstack@n-api.service[119544]: Neutron server returns request_ids: ['req-66980b5c-39d4-4f40-a0b3-af5d1095d412'] {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:13:55.304756 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4bcf0e55-d7f5-4c95-a87a-83e6ad9d7a6d tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] 10.222.0.57 "POST /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09/action" status: 400 len: 382 microversion: 2.1 time: 0.821732 Jul 18 02:13:55.304756 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 690/1347] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:13:54 2022] POST /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09/action => generated 382 bytes in 834 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:13:55.304756 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3fc9ffa8-011e-4d77-a997-31e2bdef6130 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Action: 'create', calling method: .version_select at 0x7ff4a88c8040>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1336583919", "policies": ["anti-affinity"]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:55.318086 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-a2d016c7-b5f9-45fe-880d-904f99e1fe7a req-71f7dfa1-9ea7-4683-81f2-65d2dc527235 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:55.319265 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-a2d016c7-b5f9-45fe-880d-904f99e1fe7a req-71f7dfa1-9ea7-4683-81f2-65d2dc527235 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:55.336491 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-3fc9ffa8-011e-4d77-a997-31e2bdef6130 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Getting quotas for project 8f8bb1ebead3481f946ae7878c3cfc41. Resources: {'server_groups'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:13:55.350239 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-a2d016c7-b5f9-45fe-880d-904f99e1fe7a req-71f7dfa1-9ea7-4683-81f2-65d2dc527235 service nova] Creating event network-vif-plugged:91c20a21-2cb0-48df-99d9-8ab9275d0bc8 for instance 49764b86-41da-4c6d-b069-aaccf92ef89f on n-h2-465891-3 Jul 18 02:13:55.350844 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-a2d016c7-b5f9-45fe-880d-904f99e1fe7a req-71f7dfa1-9ea7-4683-81f2-65d2dc527235 service nova] Creating event network-vif-plugged:22d8b9d4-cdb4-4747-87c6-94168bb42281 for instance b74ae52f-6794-49d2-867e-be0996b090aa on n-h2-465891-3 Jul 18 02:13:55.352052 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-3fc9ffa8-011e-4d77-a997-31e2bdef6130 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Getting quotas for user 100f65c0d9d3456fa177599821aed7ff and project 8f8bb1ebead3481f946ae7878c3cfc41. Resources: {'server_groups'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:13:55.361023 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-a2d016c7-b5f9-45fe-880d-904f99e1fe7a req-71f7dfa1-9ea7-4683-81f2-65d2dc527235 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.100363 Jul 18 02:13:55.363601 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 658/1348] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:55.371678 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-64a520df-e84a-4c02-8486-899e8add908a tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:55.373064 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-64a520df-e84a-4c02-8486-899e8add908a tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: b74ae52f-6794-49d2-867e-be0996b090aa] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:55.383259 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-64a520df-e84a-4c02-8486-899e8add908a tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:55.383815 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-64a520df-e84a-4c02-8486-899e8add908a tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:55.384853 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-64a520df-e84a-4c02-8486-899e8add908a tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:55.385425 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-64a520df-e84a-4c02-8486-899e8add908a tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:55.493797 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-3fc9ffa8-011e-4d77-a997-31e2bdef6130 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Getting quotas for project 8f8bb1ebead3481f946ae7878c3cfc41. Resources: {'server_groups'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:13:55.536814 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-3fc9ffa8-011e-4d77-a997-31e2bdef6130 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Getting quotas for user 100f65c0d9d3456fa177599821aed7ff and project 8f8bb1ebead3481f946ae7878c3cfc41. Resources: {'server_groups'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:13:55.582481 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3fc9ffa8-011e-4d77-a997-31e2bdef6130 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.287374 Jul 18 02:13:55.597009 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 691/1349] 10.222.0.57 () {60 vars in 1173 bytes} [Mon Jul 18 02:13:55 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:55.603341 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-914b9e4e-f6b8-41ae-ae77-7cbd534b5f35 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1071387118"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:55.604681 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-914b9e4e-f6b8-41ae-ae77-7cbd534b5f35 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 2d8e0c47-5276-4d24-9cb3-fb36bb9b6400] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:55.617578 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-914b9e4e-f6b8-41ae-ae77-7cbd534b5f35 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:55.625033 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-914b9e4e-f6b8-41ae-ae77-7cbd534b5f35 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:55.629095 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-914b9e4e-f6b8-41ae-ae77-7cbd534b5f35 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:55.630120 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-914b9e4e-f6b8-41ae-ae77-7cbd534b5f35 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:56.275497 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-64a520df-e84a-4c02-8486-899e8add908a tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe79fa13328b4e40922d0e3e4551a8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6b8514bba84ba8a09c64abbb2d1a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:56.304541 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-64a520df-e84a-4c02-8486-899e8add908a tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "GET /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa" status: 200 len: 1368 microversion: 2.1 time: 0.939118 Jul 18 02:13:56.314151 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 659/1350] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:55 2022] GET /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa => generated 1368 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:56.329947 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-82b53ad2-114b-443d-bf40-c3e66decb304 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Calling method '.version_select at 0x7ff4a8a43d30>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:56.481891 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-914b9e4e-f6b8-41ae-ae77-7cbd534b5f35 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "POST /compute/v2.1/servers/2d8e0c47-5276-4d24-9cb3-fb36bb9b6400/action" status: 202 len: 0 microversion: 2.1 time: 0.882050 Jul 18 02:13:56.484651 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 692/1351] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:13:55 2022] POST /compute/v2.1/servers/2d8e0c47-5276-4d24-9cb3-fb36bb9b6400/action => generated 0 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 18 02:13:56.503129 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9db7ee42-c39f-49c4-b7e3-bfdc4a0a8f2e tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1927690204", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "e94427d9-3817-4c97-8760-c29504bd94db"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:56.516126 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9db7ee42-c39f-49c4-b7e3-bfdc4a0a8f2e tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Request method failure captured: Jul 18 02:13:56.516126 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:13:56.516126 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:13:56.516126 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:13:56.516126 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:13:56.516126 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 499 Jul 18 02:13:56.516126 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:13:56.516126 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:13:56.516126 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:13:56.516126 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:13:56.516126 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MGyvmfvOW92_8EFRzjxzrpzIZh4SiXbkPCyi0rdQ7sO-bz1u6KTqOmvLLovRhlo2jvmO_hhmIzQNZ9Dayn2AL9gLkZBZsGHvGbiptq8pOSeqB-B5lxFErIGNamep1fiheOEGYzF2iaXbjVWuwOcVnTLYKDxJ4Lz32i7NEeT4IcA5FI Jul 18 02:13:56.516126 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:13:56.516126 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:13:56.516126 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:13:56.516126 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:13:56.516126 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:13:56.516126 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:13:56.516126 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 4cd338c0a2724ca999dc02d93f90860a Jul 18 02:13:56.516126 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-321384848 Jul 18 02:13:56.516126 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:13:56.516126 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:13:56.519100 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4cd338c0a2724ca999dc02d93f90860a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4cd338c0a2724ca999dc02d93f90860a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4cd338c0a2724ca999dc02d93f90860a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4cd338c0a2724ca999dc02d93f90860a"}]}] Jul 18 02:13:56.519100 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-321384848 Jul 18 02:13:56.519100 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 4cd338c0a2724ca999dc02d93f90860a Jul 18 02:13:56.519100 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-321384848 Jul 18 02:13:56.519100 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServerMetadataNegativeTestJSON-321384848-project Jul 18 02:13:56.519100 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:13:56.519100 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:13:56.519100 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: e5525cb28fdc490a8e1bafb732a70fc6 Jul 18 02:13:56.519100 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-321384848-project Jul 18 02:13:56.519100 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:13:56.520235 n-d-465891-3 devstack@n-api.service[119544]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1927690204", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "e94427d9-3817-4c97-8760-c29504bd94db"}]}} Jul 18 02:13:56.520235 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:13:56.520235 n-d-465891-3 devstack@n-api.service[119544]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:13:56.520235 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1927690204', 'imageRef': '3bb0a19f-5b69-48ee-a771-8fd416f92f36', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'e94427d9-3817-4c97-8760-c29504bd94db'}]}}} Jul 18 02:13:56.520235 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:13:56.520235 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:56.524720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:13:56.524720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:13:56.524720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:13:56.524720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:13:56.524720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:13:56.524720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:13:56.524720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 18 02:13:56.524720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 18 02:13:56.524720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 18 02:13:56.524720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 18 02:13:56.524720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 18 02:13:56.524720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:13:56.524720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 02:13:56.524720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 18 02:13:56.524720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:13:56.524720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:13:56.524720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:13:56.526468 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:56.526468 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:13:56.526468 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:13:56.526468 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:13:56.526468 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:13:56.526468 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:13:56.526468 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:13:56.526468 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:13:56.526468 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:13:56.526468 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:13:56.526468 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:13:56.526468 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:13:56.526468 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:13:56.526468 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:13:56.526468 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:13:56.528917 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:13:56.528917 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:13:56.528917 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:13:56.528917 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:13:56.528917 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:56.528917 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:13:56.528917 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:13:56.528917 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:13:56.528917 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:13:56.530175 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:13:56.530175 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:13:56.532303 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9db7ee42-c39f-49c4-b7e3-bfdc4a0a8f2e tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:13:56.534187 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9db7ee42-c39f-49c4-b7e3-bfdc4a0a8f2e tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.047196 Jul 18 02:13:56.535043 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 693/1352] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:13:56 2022] POST /compute/v2.1/servers => generated 687 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:13:56.569532 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-972c4f54-deac-4765-8765-5700ceb26efb tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a88c6700>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:56.694596 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-972c4f54-deac-4765-8765-5700ceb26efb tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/9053bb1e-a3c0-4052-9d8d-7b964f899348" status: 200 len: 1455 microversion: 2.1 time: 0.135259 Jul 18 02:13:56.695879 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 694/1353] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:13:56 2022] GET /compute/v2.1/images/9053bb1e-a3c0-4052-9d8d-7b964f899348 => generated 1455 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:56.708168 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-561594ae-cf7b-4c5a-bcf3-aa3c78bd03e7 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:56.709490 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-561594ae-cf7b-4c5a-bcf3-aa3c78bd03e7 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 49764b86-41da-4c6d-b069-aaccf92ef89f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:56.720900 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-561594ae-cf7b-4c5a-bcf3-aa3c78bd03e7 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:56.721624 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-561594ae-cf7b-4c5a-bcf3-aa3c78bd03e7 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:56.722969 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-561594ae-cf7b-4c5a-bcf3-aa3c78bd03e7 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:56.723562 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-561594ae-cf7b-4c5a-bcf3-aa3c78bd03e7 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:57.167314 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-561594ae-cf7b-4c5a-bcf3-aa3c78bd03e7 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:57.185335 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-561594ae-cf7b-4c5a-bcf3-aa3c78bd03e7 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:57.189205 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-561594ae-cf7b-4c5a-bcf3-aa3c78bd03e7 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:57.191714 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-561594ae-cf7b-4c5a-bcf3-aa3c78bd03e7 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f" status: 200 len: 1361 microversion: 2.25 time: 0.493799 Jul 18 02:13:57.207089 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 695/1354] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:13:56 2022] GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f => generated 1361 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:13:57.224357 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b41d2291-b001-4e6b-be9b-27d14d645b80 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1283084771", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "3f2188bf-ec0e-426f-8182-c941769ada5e"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:57.317412 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-b41d2291-b001-4e6b-be9b-27d14d645b80 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] validate_networks() for None {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:13:57.908264 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-b41d2291-b001-4e6b-be9b-27d14d645b80 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:13:57.909239 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-b41d2291-b001-4e6b-be9b-27d14d645b80 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:13:57.909407 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-b41d2291-b001-4e6b-be9b-27d14d645b80 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:13:57.910188 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-b41d2291-b001-4e6b-be9b-27d14d645b80 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:13:57.910727 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-b41d2291-b001-4e6b-be9b-27d14d645b80 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:13:57.959821 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b41d2291-b001-4e6b-be9b-27d14d645b80 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:57.960440 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b41d2291-b001-4e6b-be9b-27d14d645b80 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:57.962008 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b41d2291-b001-4e6b-be9b-27d14d645b80 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:57.962558 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b41d2291-b001-4e6b-be9b-27d14d645b80 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:58.006385 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-b41d2291-b001-4e6b-be9b-27d14d645b80 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Getting quotas for project 8f8bb1ebead3481f946ae7878c3cfc41. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:13:58.013853 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-b41d2291-b001-4e6b-be9b-27d14d645b80 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Getting quotas for user 100f65c0d9d3456fa177599821aed7ff and project 8f8bb1ebead3481f946ae7878c3cfc41. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:13:58.030505 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b41d2291-b001-4e6b-be9b-27d14d645b80 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Going to run 2 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:13:58.033963 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b41d2291-b001-4e6b-be9b-27d14d645b80 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 465df230-ba3a-430a-935d-dc0a7fb83462] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:13:58.082873 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-b41d2291-b001-4e6b-be9b-27d14d645b80 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=119544) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 18 02:13:58.109584 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-b41d2291-b001-4e6b-be9b-27d14d645b80 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Getting quotas for project 8f8bb1ebead3481f946ae7878c3cfc41. Resources: {'server_group_members'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:13:58.116944 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-b41d2291-b001-4e6b-be9b-27d14d645b80 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Getting quotas for user 100f65c0d9d3456fa177599821aed7ff and project 8f8bb1ebead3481f946ae7878c3cfc41. Resources: {'server_group_members'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:13:58.152769 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:13:58.179936 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-b41d2291-b001-4e6b-be9b-27d14d645b80 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Getting quotas for project 8f8bb1ebead3481f946ae7878c3cfc41. Resources: {'server_group_members'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:13:58.187412 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-82b53ad2-114b-443d-bf40-c3e66decb304 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] 10.222.0.57 "DELETE /compute/v2.1/os-floating-ips/baf1c57f-b526-4040-bff6-69cfb344eaab" status: 202 len: 0 microversion: 2.1 time: 1.871250 Jul 18 02:13:58.190838 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 660/1355] 10.222.0.57 () {58 vars in 1262 bytes} [Mon Jul 18 02:13:56 2022] DELETE /compute/v2.1/os-floating-ips/baf1c57f-b526-4040-bff6-69cfb344eaab => generated 0 bytes in 1876 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:13:58.192911 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-b41d2291-b001-4e6b-be9b-27d14d645b80 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Getting quotas for user 100f65c0d9d3456fa177599821aed7ff and project 8f8bb1ebead3481f946ae7878c3cfc41. Resources: {'server_group_members'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:13:58.197819 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7353f738-7033-42ef-b92e-6c173997df1f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a89dc0d0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:58.222270 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b41d2291-b001-4e6b-be9b-27d14d645b80 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c8ba5e49-8aa4-4b43-9273-16be87705a48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=465df230-ba3a-430a-935d-dc0a7fb83462,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:13:58.263545 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7353f738-7033-42ef-b92e-6c173997df1f tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/af962106-786e-4342-b328-b9899b0c9133" status: 200 len: 1410 microversion: 2.1 time: 0.070142 Jul 18 02:13:58.264726 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 661/1356] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:13:58 2022] GET /compute/v2.1/images/af962106-786e-4342-b328-b9899b0c9133 => generated 1410 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:58.270251 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-168185f0-e404-4085-bc81-8ce5b949061b tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-962860920", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "e94427d9-3817-4c97-8760-c29504bd94db"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:58.274798 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-168185f0-e404-4085-bc81-8ce5b949061b tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Request method failure captured: Jul 18 02:13:58.274798 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:13:58.274798 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:13:58.274798 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:13:58.274798 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:13:58.274798 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 499 Jul 18 02:13:58.274798 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:13:58.274798 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:13:58.274798 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:13:58.274798 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:13:58.274798 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MGyvmfvOW92_8EFRzjxzrpzIZh4SiXbkPCyi0rdQ7sO-bz1u6KTqOmvLLovRhlo2jvmO_hhmIzQNZ9Dayn2AL9gLkZBZsGHvGbiptq8pOSeqB-B5lxFErIGNamep1fiheOEGYzF2iaXbjVWuwOcVnTLYKDxJ4Lz32i7NEeT4IcA5FI Jul 18 02:13:58.274798 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:13:58.274798 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:13:58.274798 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:13:58.274798 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:13:58.274798 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:13:58.274798 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:13:58.274798 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 4cd338c0a2724ca999dc02d93f90860a Jul 18 02:13:58.274798 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-321384848 Jul 18 02:13:58.274798 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:13:58.274798 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:13:58.277005 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4cd338c0a2724ca999dc02d93f90860a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4cd338c0a2724ca999dc02d93f90860a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4cd338c0a2724ca999dc02d93f90860a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4cd338c0a2724ca999dc02d93f90860a"}]}] Jul 18 02:13:58.277005 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-321384848 Jul 18 02:13:58.277005 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 4cd338c0a2724ca999dc02d93f90860a Jul 18 02:13:58.277005 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-321384848 Jul 18 02:13:58.277005 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServerMetadataNegativeTestJSON-321384848-project Jul 18 02:13:58.277005 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:13:58.277005 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:13:58.277005 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: e5525cb28fdc490a8e1bafb732a70fc6 Jul 18 02:13:58.277005 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-321384848-project Jul 18 02:13:58.277005 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 02:13:58.277855 n-d-465891-3 devstack@n-api.service[119543]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-962860920", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "e94427d9-3817-4c97-8760-c29504bd94db"}]}} Jul 18 02:13:58.277855 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:13:58.277855 n-d-465891-3 devstack@n-api.service[119543]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:13:58.277855 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-962860920', 'imageRef': '3bb0a19f-5b69-48ee-a771-8fd416f92f36', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'e94427d9-3817-4c97-8760-c29504bd94db'}]}}} Jul 18 02:13:58.277855 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:13:58.277855 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:58.278399 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:13:58.278399 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:13:58.278399 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:13:58.278399 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:13:58.278399 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:13:58.278399 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:13:58.278399 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 18 02:13:58.278399 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 18 02:13:58.278399 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 18 02:13:58.278399 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 18 02:13:58.278399 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 18 02:13:58.278399 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:13:58.278399 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 02:13:58.278399 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 18 02:13:58.278399 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:13:58.278399 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:13:58.278399 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:13:58.279789 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:58.279789 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:13:58.279789 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:13:58.279789 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:13:58.279789 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:13:58.279789 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:13:58.279789 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:13:58.279789 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:13:58.279789 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:13:58.279789 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:13:58.279789 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:13:58.279789 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:13:58.279789 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:13:58.279789 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:13:58.279789 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:13:58.281620 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:13:58.281620 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:13:58.281620 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:13:58.281620 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:13:58.281620 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:58.281620 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:13:58.281620 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:13:58.281620 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:13:58.281620 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:13:58.282376 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:13:58.282376 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:13:58.284623 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-168185f0-e404-4085-bc81-8ce5b949061b tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:13:58.285787 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-168185f0-e404-4085-bc81-8ce5b949061b tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.019969 Jul 18 02:13:58.286913 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 662/1357] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:13:58 2022] POST /compute/v2.1/servers => generated 689 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:13:58.291902 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-180db1ea-c322-4466-87dc-b984fc86e645 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:58.293025 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-180db1ea-c322-4466-87dc-b984fc86e645 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: b74ae52f-6794-49d2-867e-be0996b090aa] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:58.300180 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-180db1ea-c322-4466-87dc-b984fc86e645 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:58.300917 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-180db1ea-c322-4466-87dc-b984fc86e645 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:58.301965 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-180db1ea-c322-4466-87dc-b984fc86e645 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:58.302566 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-180db1ea-c322-4466-87dc-b984fc86e645 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:58.341550 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-b41d2291-b001-4e6b-be9b-27d14d645b80 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Getting quotas for project 8f8bb1ebead3481f946ae7878c3cfc41. Resources: {'server_group_members'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:13:58.364240 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-b41d2291-b001-4e6b-be9b-27d14d645b80 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Getting quotas for user 100f65c0d9d3456fa177599821aed7ff and project 8f8bb1ebead3481f946ae7878c3cfc41. Resources: {'server_group_members'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:13:58.445044 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-b41d2291-b001-4e6b-be9b-27d14d645b80 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Getting quotas for project 8f8bb1ebead3481f946ae7878c3cfc41. Resources: {'server_group_members'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:13:58.452838 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-b41d2291-b001-4e6b-be9b-27d14d645b80 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Getting quotas for user 100f65c0d9d3456fa177599821aed7ff and project 8f8bb1ebead3481f946ae7878c3cfc41. Resources: {'server_group_members'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:13:58.518098 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b41d2291-b001-4e6b-be9b-27d14d645b80 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.309246 Jul 18 02:13:58.519513 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 696/1358] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:13:57 2022] POST /compute/v2.1/servers => generated 32 bytes in 1311 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 18 02:13:58.525142 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-b7fd68f0-cb1a-4474-9e41-788abcb0693d req-b4e9301c-08d4-43cb-883c-a72f39f2783d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32e81b5d-a507-4d47-b76e-699091d0e5bd", "name": "network-vif-plugged", "status": "completed", "tag": "07f51000-5732-46e7-8e0e-0bd9c61e7698"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:58.555374 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-b7fd68f0-cb1a-4474-9e41-788abcb0693d req-b4e9301c-08d4-43cb-883c-a72f39f2783d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:58.555823 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-b7fd68f0-cb1a-4474-9e41-788abcb0693d req-b4e9301c-08d4-43cb-883c-a72f39f2783d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:58.566641 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-180db1ea-c322-4466-87dc-b984fc86e645 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe79fa13328b4e40922d0e3e4551a8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6b8514bba84ba8a09c64abbb2d1a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:58.584641 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-180db1ea-c322-4466-87dc-b984fc86e645 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "GET /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa" status: 200 len: 1558 microversion: 2.1 time: 0.295986 Jul 18 02:13:58.587045 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 663/1359] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:58 2022] GET /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa => generated 1558 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:58.587461 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-b7fd68f0-cb1a-4474-9e41-788abcb0693d req-b4e9301c-08d4-43cb-883c-a72f39f2783d service nova] Creating event network-vif-plugged:07f51000-5732-46e7-8e0e-0bd9c61e7698 for instance 32e81b5d-a507-4d47-b76e-699091d0e5bd on n-h2-465891-3 Jul 18 02:13:58.597170 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-b7fd68f0-cb1a-4474-9e41-788abcb0693d req-b4e9301c-08d4-43cb-883c-a72f39f2783d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077100 Jul 18 02:13:58.599554 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-acd12643-ee2f-4a43-94a0-3c7fa6d8654e tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a8a43c10>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:58.610753 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 697/1360] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:58.633326 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-496b6b74-b54e-42ed-9f91-ad59e5d4620d tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Action: 'action', calling method: .version_select at 0x7ff4ab6c7040>, body: {"removeFloatingIp": {"address": "172.25.3.119"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:58.701170 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-acd12643-ee2f-4a43-94a0-3c7fa6d8654e tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/9053bb1e-a3c0-4052-9d8d-7b964f899348" status: 200 len: 1455 microversion: 2.1 time: 0.110972 Jul 18 02:13:58.702606 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 664/1361] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:13:58 2022] GET /compute/v2.1/images/9053bb1e-a3c0-4052-9d8d-7b964f899348 => generated 1455 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:58.711428 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a7733c54-2731-49db-b07a-2be98c9a96af tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:58.712981 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a7733c54-2731-49db-b07a-2be98c9a96af tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 49764b86-41da-4c6d-b069-aaccf92ef89f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:58.725587 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a7733c54-2731-49db-b07a-2be98c9a96af tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:58.726421 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a7733c54-2731-49db-b07a-2be98c9a96af tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:58.727835 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a7733c54-2731-49db-b07a-2be98c9a96af tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:58.728592 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a7733c54-2731-49db-b07a-2be98c9a96af tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:59.049048 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-496b6b74-b54e-42ed-9f91-ad59e5d4620d tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] [instance: 6a9311f2-f5f3-49f0-831e-728291d16d09] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:59.082768 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-496b6b74-b54e-42ed-9f91-ad59e5d4620d tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:59.085915 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-496b6b74-b54e-42ed-9f91-ad59e5d4620d tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:59.094143 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-496b6b74-b54e-42ed-9f91-ad59e5d4620d tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:59.097632 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-496b6b74-b54e-42ed-9f91-ad59e5d4620d tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:59.123563 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a7733c54-2731-49db-b07a-2be98c9a96af tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:59.142171 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a7733c54-2731-49db-b07a-2be98c9a96af tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:59.145090 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a7733c54-2731-49db-b07a-2be98c9a96af tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:59.147893 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a7733c54-2731-49db-b07a-2be98c9a96af tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f" status: 200 len: 1557 microversion: 2.25 time: 0.443503 Jul 18 02:13:59.149123 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 665/1362] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:13:58 2022] GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f => generated 1557 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:13:59.156808 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5fe95223-04b6-4e98-9262-f57b471589f5 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a8983ee0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:59.230538 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5fe95223-04b6-4e98-9262-f57b471589f5 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/af962106-786e-4342-b328-b9899b0c9133" status: 200 len: 1410 microversion: 2.1 time: 0.079982 Jul 18 02:13:59.240227 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 666/1363] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:13:59 2022] GET /compute/v2.1/images/af962106-786e-4342-b328-b9899b0c9133 => generated 1410 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:59.245974 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-212b142f-6c41-4bd1-abe3-0b12c37abc83 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-617568187", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "e94427d9-3817-4c97-8760-c29504bd94db"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:59.251860 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-212b142f-6c41-4bd1-abe3-0b12c37abc83 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Request method failure captured: Jul 18 02:13:59.251860 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:13:59.251860 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:13:59.251860 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:13:59.251860 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:13:59.251860 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 753 Jul 18 02:13:59.251860 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:13:59.251860 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:13:59.251860 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:13:59.251860 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:13:59.251860 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MGyvmfvOW92_8EFRzjxzrpzIZh4SiXbkPCyi0rdQ7sO-bz1u6KTqOmvLLovRhlo2jvmO_hhmIzQNZ9Dayn2AL9gLkZBZsGHvGbiptq8pOSeqB-B5lxFErIGNamep1fiheOEGYzF2iaXbjVWuwOcVnTLYKDxJ4Lz32i7NEeT4IcA5FI Jul 18 02:13:59.251860 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:13:59.251860 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:13:59.251860 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:13:59.251860 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:13:59.251860 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:13:59.251860 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:13:59.251860 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 4cd338c0a2724ca999dc02d93f90860a Jul 18 02:13:59.251860 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-321384848 Jul 18 02:13:59.251860 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:13:59.251860 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:13:59.254571 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4cd338c0a2724ca999dc02d93f90860a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4cd338c0a2724ca999dc02d93f90860a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4cd338c0a2724ca999dc02d93f90860a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4cd338c0a2724ca999dc02d93f90860a"}]}] Jul 18 02:13:59.254571 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-321384848 Jul 18 02:13:59.254571 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 4cd338c0a2724ca999dc02d93f90860a Jul 18 02:13:59.254571 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-321384848 Jul 18 02:13:59.254571 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServerMetadataNegativeTestJSON-321384848-project Jul 18 02:13:59.254571 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:13:59.254571 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:13:59.254571 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: e5525cb28fdc490a8e1bafb732a70fc6 Jul 18 02:13:59.254571 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-321384848-project Jul 18 02:13:59.254571 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 02:13:59.255444 n-d-465891-3 devstack@n-api.service[119543]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-617568187", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "e94427d9-3817-4c97-8760-c29504bd94db"}]}} Jul 18 02:13:59.255444 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:13:59.255444 n-d-465891-3 devstack@n-api.service[119543]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:13:59.255876 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-617568187', 'imageRef': '3bb0a19f-5b69-48ee-a771-8fd416f92f36', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'e94427d9-3817-4c97-8760-c29504bd94db'}]}}} Jul 18 02:13:59.255876 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:13:59.255876 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:59.255876 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:13:59.255876 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:13:59.255876 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:13:59.255876 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:13:59.255876 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:13:59.256948 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:13:59.256948 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 18 02:13:59.256948 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 18 02:13:59.256948 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 18 02:13:59.256948 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 18 02:13:59.256948 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 18 02:13:59.256948 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:13:59.256948 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 02:13:59.256948 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 18 02:13:59.256948 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:13:59.256948 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:13:59.256948 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:13:59.256948 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:59.256948 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:13:59.256948 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:13:59.256948 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:13:59.256948 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:13:59.258241 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:13:59.258241 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:13:59.258241 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:13:59.258241 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:13:59.258241 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:13:59.258241 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:13:59.258241 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:13:59.258241 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:13:59.258241 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:13:59.258241 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:13:59.258986 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:13:59.258986 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:13:59.258986 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:13:59.258986 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:13:59.258986 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:59.258986 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:13:59.258986 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:13:59.258986 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:13:59.258986 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:13:59.259676 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:13:59.259676 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:13:59.260915 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-212b142f-6c41-4bd1-abe3-0b12c37abc83 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:13:59.262617 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-212b142f-6c41-4bd1-abe3-0b12c37abc83 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.020927 Jul 18 02:13:59.264004 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 667/1364] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:13:59 2022] POST /compute/v2.1/servers => generated 1197 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 18 02:13:59.279219 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7e530e0f-1103-4afe-b221-84dcf8e137f0 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:59.287726 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7e530e0f-1103-4afe-b221-84dcf8e137f0 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:59.290036 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7e530e0f-1103-4afe-b221-84dcf8e137f0 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Searching by: {'deleted': False, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41'} {{(pid=119543) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:13:59.317199 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7e530e0f-1103-4afe-b221-84dcf8e137f0 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:59.317199 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7e530e0f-1103-4afe-b221-84dcf8e137f0 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:59.318003 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7e530e0f-1103-4afe-b221-84dcf8e137f0 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:59.320006 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7e530e0f-1103-4afe-b221-84dcf8e137f0 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:59.387745 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.multi_cell_list [None req-7e530e0f-1103-4afe-b221-84dcf8e137f0 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=119543) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:13:59.478242 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7e530e0f-1103-4afe-b221-84dcf8e137f0 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers" status: 200 len: 1664 microversion: 2.1 time: 0.211995 Jul 18 02:13:59.494898 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 668/1365] 10.222.0.57 () {58 vars in 1124 bytes} [Mon Jul 18 02:13:59 2022] GET /compute/v2.1/servers => generated 1664 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:59.515842 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2b0f9b26-c59d-4366-be01-ef5e3b7e6dd4 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:59.516517 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2b0f9b26-c59d-4366-be01-ef5e3b7e6dd4 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: b74ae52f-6794-49d2-867e-be0996b090aa] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:59.525236 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b0f9b26-c59d-4366-be01-ef5e3b7e6dd4 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:59.526480 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b0f9b26-c59d-4366-be01-ef5e3b7e6dd4 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:59.527498 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b0f9b26-c59d-4366-be01-ef5e3b7e6dd4 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:59.528248 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b0f9b26-c59d-4366-be01-ef5e3b7e6dd4 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:59.642278 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-496b6b74-b54e-42ed-9f91-ad59e5d4620d tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Acquired lock "refresh_cache-6a9311f2-f5f3-49f0-831e-728291d16d09" {{(pid=119544) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 02:13:59.764005 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2b0f9b26-c59d-4366-be01-ef5e3b7e6dd4 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "GET /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.264594 Jul 18 02:13:59.765525 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 669/1366] 10.222.0.57 () {58 vars in 1274 bytes} [Mon Jul 18 02:13:59 2022] GET /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa/os-interface => generated 284 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:59.861016 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3c407496-cf89-4418-a429-8117237652e8 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:59.862394 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3c407496-cf89-4418-a429-8117237652e8 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] [instance: 49764b86-41da-4c6d-b069-aaccf92ef89f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:59.872876 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3c407496-cf89-4418-a429-8117237652e8 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:59.874136 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3c407496-cf89-4418-a429-8117237652e8 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:59.875886 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3c407496-cf89-4418-a429-8117237652e8 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:59.876976 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3c407496-cf89-4418-a429-8117237652e8 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:00.387726 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-3c407496-cf89-4418-a429-8117237652e8 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lazy-loading 'services' on Instance uuid 49764b86-41da-4c6d-b069-aaccf92ef89f {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:14:00.420010 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3c407496-cf89-4418-a429-8117237652e8 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f" status: 200 len: 2049 microversion: 2.25 time: 0.652697 Jul 18 02:14:00.437480 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 670/1367] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:13:59 2022] GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f => generated 2049 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:14:00.448007 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-02ed5e8d-a734-4d1e-bc02-c0debf792c63 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a8971ca0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:00.860820 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-02ed5e8d-a734-4d1e-bc02-c0debf792c63 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "DELETE /compute/v2.1/images/af962106-786e-4342-b328-b9899b0c9133" status: 204 len: 0 microversion: 2.1 time: 0.421435 Jul 18 02:14:00.863439 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 671/1368] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:00 2022] DELETE /compute/v2.1/images/af962106-786e-4342-b328-b9899b0c9133 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:14:00.878436 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-eb3ff6cd-8364-4da1-b21f-480d54bfcdb4 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1764694554", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "e94427d9-3817-4c97-8760-c29504bd94db"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:00.891926 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-eb3ff6cd-8364-4da1-b21f-480d54bfcdb4 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Request method failure captured: Jul 18 02:14:00.891926 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:14:00.891926 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:14:00.891926 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:14:00.891926 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:14:00.891926 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 1266 Jul 18 02:14:00.891926 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:14:00.891926 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:14:00.891926 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:14:00.891926 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:14:00.891926 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MGyvmfvOW92_8EFRzjxzrpzIZh4SiXbkPCyi0rdQ7sO-bz1u6KTqOmvLLovRhlo2jvmO_hhmIzQNZ9Dayn2AL9gLkZBZsGHvGbiptq8pOSeqB-B5lxFErIGNamep1fiheOEGYzF2iaXbjVWuwOcVnTLYKDxJ4Lz32i7NEeT4IcA5FI Jul 18 02:14:00.891926 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:14:00.891926 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:14:00.891926 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:14:00.891926 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:14:00.891926 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:14:00.891926 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:14:00.891926 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 4cd338c0a2724ca999dc02d93f90860a Jul 18 02:14:00.891926 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-321384848 Jul 18 02:14:00.891926 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:14:00.891926 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:14:00.894968 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4cd338c0a2724ca999dc02d93f90860a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4cd338c0a2724ca999dc02d93f90860a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4cd338c0a2724ca999dc02d93f90860a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4cd338c0a2724ca999dc02d93f90860a"}]}] Jul 18 02:14:00.894968 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-321384848 Jul 18 02:14:00.894968 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 4cd338c0a2724ca999dc02d93f90860a Jul 18 02:14:00.894968 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-321384848 Jul 18 02:14:00.894968 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServerMetadataNegativeTestJSON-321384848-project Jul 18 02:14:00.894968 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:14:00.894968 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:14:00.894968 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: e5525cb28fdc490a8e1bafb732a70fc6 Jul 18 02:14:00.894968 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-321384848-project Jul 18 02:14:00.894968 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 02:14:00.896357 n-d-465891-3 devstack@n-api.service[119543]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1764694554", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "e94427d9-3817-4c97-8760-c29504bd94db"}]}} Jul 18 02:14:00.896357 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:14:00.896676 n-d-465891-3 devstack@n-api.service[119543]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:14:00.896676 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1764694554', 'imageRef': '3bb0a19f-5b69-48ee-a771-8fd416f92f36', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'e94427d9-3817-4c97-8760-c29504bd94db'}]}}} Jul 18 02:14:00.896676 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:14:00.896676 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:00.896676 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:14:00.896676 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:14:00.896676 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:14:00.896676 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:14:00.896676 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:14:00.896676 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:00.896676 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 18 02:14:00.896676 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 18 02:14:00.896676 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 18 02:14:00.896676 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 18 02:14:00.896676 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 18 02:14:00.896676 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:00.896676 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 02:14:00.899137 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 18 02:14:00.899137 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:00.899137 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:00.899137 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:00.899137 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:00.899137 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:00.899137 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:00.899137 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:14:00.899137 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:14:00.899137 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:14:00.899137 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:14:00.899137 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:14:00.899137 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:14:00.899137 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:14:00.899137 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:14:00.899137 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:14:00.899137 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:14:00.899137 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:14:00.899137 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:14:00.899137 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:14:00.899137 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:00.899137 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:00.899137 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:00.899137 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:00.899137 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:00.899137 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:00.899137 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:14:00.899137 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:14:00.903237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:14:00.903237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:00.904339 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-eb3ff6cd-8364-4da1-b21f-480d54bfcdb4 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:14:00.907909 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-eb3ff6cd-8364-4da1-b21f-480d54bfcdb4 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.042162 Jul 18 02:14:00.909101 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 672/1369] 10.222.0.57 () {60 vars in 1147 bytes} [Mon Jul 18 02:14:00 2022] POST /compute/v2.1/servers => generated 2221 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 18 02:14:00.930262 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0d8b607c-bc5a-416d-b6c4-61a6d0fee391 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:00.931167 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0d8b607c-bc5a-416d-b6c4-61a6d0fee391 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c8ba5e49-8aa4-4b43-9273-16be87705a48] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:00.943405 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0d8b607c-bc5a-416d-b6c4-61a6d0fee391 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:00.943405 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0d8b607c-bc5a-416d-b6c4-61a6d0fee391 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:00.944307 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0d8b607c-bc5a-416d-b6c4-61a6d0fee391 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:00.945011 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0d8b607c-bc5a-416d-b6c4-61a6d0fee391 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:01.053791 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0d8b607c-bc5a-416d-b6c4-61a6d0fee391 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:01.066383 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0d8b607c-bc5a-416d-b6c4-61a6d0fee391 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c8ba5e49-8aa4-4b43-9273-16be87705a48" status: 200 len: 1271 microversion: 2.1 time: 0.145661 Jul 18 02:14:01.079885 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 673/1370] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:00 2022] GET /compute/v2.1/servers/c8ba5e49-8aa4-4b43-9273-16be87705a48 => generated 1271 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:01.086151 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-87c9db3f-52db-4653-a475-95814e71c013 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a88718b0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:01.177984 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-87c9db3f-52db-4653-a475-95814e71c013 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/9053bb1e-a3c0-4052-9d8d-7b964f899348" status: 200 len: 1455 microversion: 2.1 time: 0.096391 Jul 18 02:14:01.178859 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 674/1371] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:14:01 2022] GET /compute/v2.1/images/9053bb1e-a3c0-4052-9d8d-7b964f899348 => generated 1455 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:01.195941 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4a239153-b5bd-4b42-a255-129f4b441db1 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:01.200831 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4a239153-b5bd-4b42-a255-129f4b441db1 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] [instance: 49764b86-41da-4c6d-b069-aaccf92ef89f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:01.217877 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4a239153-b5bd-4b42-a255-129f4b441db1 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:01.220199 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4a239153-b5bd-4b42-a255-129f4b441db1 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:01.221379 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4a239153-b5bd-4b42-a255-129f4b441db1 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:01.225637 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4a239153-b5bd-4b42-a255-129f4b441db1 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:01.296664 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:01.570108 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-496b6b74-b54e-42ed-9f91-ad59e5d4620d tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] [instance: 6a9311f2-f5f3-49f0-831e-728291d16d09] Building network info cache for instance {{(pid=119544) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 18 02:14:01.574120 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=86,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:01.706485 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:02.029616 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-4a239153-b5bd-4b42-a255-129f4b441db1 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lazy-loading 'services' on Instance uuid 49764b86-41da-4c6d-b069-aaccf92ef89f {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:14:02.097287 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4a239153-b5bd-4b42-a255-129f4b441db1 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f" status: 200 len: 2049 microversion: 2.25 time: 0.913815 Jul 18 02:14:02.106056 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 675/1372] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:14:01 2022] GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f => generated 2049 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:14:02.124903 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-db3d0195-d5dc-45a2-b5e6-a5dc95d642d1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a8964040>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:02.188276 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-db3d0195-d5dc-45a2-b5e6-a5dc95d642d1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] HTTP exception thrown: Image not found. Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-db3d0195-d5dc-45a2-b5e6-a5dc95d642d1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Request method failure captured: Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/images/af962106-786e-4342-b328-b9899b0c9133 HTTP/1.1 Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MCzvUiLjVPa9k5iRmWWr1F2ZyXX6RhQj-KxTNpVjPTd256MdgV8yuDLe9WLMkK_v1nEuuEud4Xy4MbeuUSjptygmIUcMLCmISLnRcYLgmO2plKsp9LFggv3C6frOpPwcaFoHgcExXMgtK5PyovbnA7Q594UMMNgAWnVF4ge4OjZi9A Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 10c5b35052cd4a71a8254d01112f0496 Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ImagesTestJSON-61947256 Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_10c5b35052cd4a71a8254d01112f0496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/10c5b35052cd4a71a8254d01112f0496"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/10c5b35052cd4a71a8254d01112f0496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/10c5b35052cd4a71a8254d01112f0496"}]}] Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ImagesTestJSON-61947256 Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 10c5b35052cd4a71a8254d01112f0496 Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ImagesTestJSON-61947256 Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ImagesTestJSON-61947256-project Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: a686fc833d964d88a022fae2932b5727 Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ImagesTestJSON-61947256-project Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: exception: Image not found. Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'af962106-786e-4342-b328-b9899b0c9133'} Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID af962106-786e-4342-b328-b9899b0c9133 Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 18 02:14:02.193111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image af962106-786e-4342-b328-b9899b0c9133 could not be found. Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:02.197583 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-db3d0195-d5dc-45a2-b5e6-a5dc95d642d1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Returning 404 to user: Image not found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:14:02.201267 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-db3d0195-d5dc-45a2-b5e6-a5dc95d642d1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/images/af962106-786e-4342-b328-b9899b0c9133" status: 404 len: 62 microversion: 2.1 time: 0.091280 Jul 18 02:14:02.209487 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 676/1373] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:14:02 2022] GET /compute/v2.1/images/af962106-786e-4342-b328-b9899b0c9133 => generated 62 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:14:02.237881 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7e2a498f-5b7b-4735-b417-4cd3dfc699f0 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:02.239607 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7e2a498f-5b7b-4735-b417-4cd3dfc699f0 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] [instance: a6e847b7-62ca-47a7-b0f6-693eb03112a6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:02.271889 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-7e2a498f-5b7b-4735-b417-4cd3dfc699f0 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] HTTP exception thrown: Instance a6e847b7-62ca-47a7-b0f6-693eb03112a6 could not be found. Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7e2a498f-5b7b-4735-b417-4cd3dfc699f0 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Request method failure captured: Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/a6e847b7-62ca-47a7-b0f6-693eb03112a6/metadata/test2 HTTP/1.1 Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MGyvmfvOW92_8EFRzjxzrpzIZh4SiXbkPCyi0rdQ7sO-bz1u6KTqOmvLLovRhlo2jvmO_hhmIzQNZ9Dayn2AL9gLkZBZsGHvGbiptq8pOSeqB-B5lxFErIGNamep1fiheOEGYzF2iaXbjVWuwOcVnTLYKDxJ4Lz32i7NEeT4IcA5FI Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 4cd338c0a2724ca999dc02d93f90860a Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-321384848 Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4cd338c0a2724ca999dc02d93f90860a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4cd338c0a2724ca999dc02d93f90860a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4cd338c0a2724ca999dc02d93f90860a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4cd338c0a2724ca999dc02d93f90860a"}]}] Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-321384848 Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 4cd338c0a2724ca999dc02d93f90860a Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-321384848 Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServerMetadataNegativeTestJSON-321384848-project Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: e5525cb28fdc490a8e1bafb732a70fc6 Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-321384848-project Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance a6e847b7-62ca-47a7-b0f6-693eb03112a6 could not be found. Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'server_id': 'a6e847b7-62ca-47a7-b0f6-693eb03112a6', 'id': 'test2'} Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6e847b7-62ca-47a7-b0f6-693eb03112a6 could not be found. Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6e847b7-62ca-47a7-b0f6-693eb03112a6 could not be found. Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:02.280493 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:02.295209 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:14:02.295209 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:14:02.295209 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6e847b7-62ca-47a7-b0f6-693eb03112a6 could not be found. Jul 18 02:14:02.295209 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:02.295209 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7e2a498f-5b7b-4735-b417-4cd3dfc699f0 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Returning 404 to user: Instance a6e847b7-62ca-47a7-b0f6-693eb03112a6 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:14:02.295209 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7e2a498f-5b7b-4735-b417-4cd3dfc699f0 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] 10.222.0.57 "GET /compute/v2.1/servers/a6e847b7-62ca-47a7-b0f6-693eb03112a6/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.080432 Jul 18 02:14:02.310465 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 677/1374] 10.222.0.57 () {58 vars in 1280 bytes} [Mon Jul 18 02:14:02 2022] GET /compute/v2.1/servers/a6e847b7-62ca-47a7-b0f6-693eb03112a6/metadata/test2 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:14:02.324344 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-0672f029-235e-4afc-9009-53a4a834303f req-004ac624-480b-4547-99ed-361a162cf1f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a9311f2-f5f3-49f0-831e-728291d16d09", "tag": "f691d4d0-5b03-4b49-81fe-72116c2da4cb"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:02.364293 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-0672f029-235e-4afc-9009-53a4a834303f req-004ac624-480b-4547-99ed-361a162cf1f7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:02.372710 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-0672f029-235e-4afc-9009-53a4a834303f req-004ac624-480b-4547-99ed-361a162cf1f7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:02.421684 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-0672f029-235e-4afc-9009-53a4a834303f req-004ac624-480b-4547-99ed-361a162cf1f7 service nova] Creating event network-changed:f691d4d0-5b03-4b49-81fe-72116c2da4cb for instance 6a9311f2-f5f3-49f0-831e-728291d16d09 on n-h1-465891-3 Jul 18 02:14:02.445606 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-0672f029-235e-4afc-9009-53a4a834303f req-004ac624-480b-4547-99ed-361a162cf1f7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129342 Jul 18 02:14:02.447583 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 678/1375] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:02.476699 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-85863a8d-e9cd-4f87-ace3-f5cad837d6f1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:02.480030 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-85863a8d-e9cd-4f87-ace3-f5cad837d6f1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c8ba5e49-8aa4-4b43-9273-16be87705a48] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:02.511434 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85863a8d-e9cd-4f87-ace3-f5cad837d6f1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:02.512905 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85863a8d-e9cd-4f87-ace3-f5cad837d6f1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:02.516949 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85863a8d-e9cd-4f87-ace3-f5cad837d6f1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:02.518106 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85863a8d-e9cd-4f87-ace3-f5cad837d6f1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:02.969570 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-85863a8d-e9cd-4f87-ace3-f5cad837d6f1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:02.980638 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-85863a8d-e9cd-4f87-ace3-f5cad837d6f1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c8ba5e49-8aa4-4b43-9273-16be87705a48" status: 200 len: 1277 microversion: 2.1 time: 0.527671 Jul 18 02:14:02.993157 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 679/1376] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:02 2022] GET /compute/v2.1/servers/c8ba5e49-8aa4-4b43-9273-16be87705a48 => generated 1277 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:03.000445 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3c2077ff-9ce7-4ab3-9ebe-17b625514e31 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:03.001961 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:14:03.001961 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:14:03.015124 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3c2077ff-9ce7-4ab3-9ebe-17b625514e31 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:03.015629 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3c2077ff-9ce7-4ab3-9ebe-17b625514e31 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:03.019125 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3c2077ff-9ce7-4ab3-9ebe-17b625514e31 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:03.021626 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3c2077ff-9ce7-4ab3-9ebe-17b625514e31 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:03.170715 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3c2077ff-9ce7-4ab3-9ebe-17b625514e31 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.175935 Jul 18 02:14:03.172925 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 680/1377] 10.222.0.57 () {60 vars in 1216 bytes} [Mon Jul 18 02:14:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:14:03.211568 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9380b084-bf9d-4608-be24-adc81a54512c tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a89713a0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:03.437526 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9380b084-bf9d-4608-be24-adc81a54512c tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/9053bb1e-a3c0-4052-9d8d-7b964f899348" status: 200 len: 1455 microversion: 2.1 time: 0.259760 Jul 18 02:14:03.443203 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 681/1378] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:14:03 2022] GET /compute/v2.1/images/9053bb1e-a3c0-4052-9d8d-7b964f899348 => generated 1455 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:03.474128 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-41ba160f-c9ca-4e86-a4fb-66d32692ce67 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:03.480644 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-41ba160f-c9ca-4e86-a4fb-66d32692ce67 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 2d8e0c47-5276-4d24-9cb3-fb36bb9b6400] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:03.521999 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:03.566907 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41ba160f-c9ca-4e86-a4fb-66d32692ce67 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:03.567896 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41ba160f-c9ca-4e86-a4fb-66d32692ce67 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.039s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:03.569293 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41ba160f-c9ca-4e86-a4fb-66d32692ce67 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:03.570020 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41ba160f-c9ca-4e86-a4fb-66d32692ce67 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:04.099367 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-496b6b74-b54e-42ed-9f91-ad59e5d4620d tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] [instance: 6a9311f2-f5f3-49f0-831e-728291d16d09] Updating instance_info_cache with network_info: [{"id": "f691d4d0-5b03-4b49-81fe-72116c2da4cb", "address": "fa:16:3e:76:91:ab", "network": {"id": "9c108108-5ed1-42f1-a1fc-37dc836711d5", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-525633580-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3a94aaf6ca324e97aec2f6e982416f9b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf691d4d0-5b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119544) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 18 02:14:04.133660 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-496b6b74-b54e-42ed-9f91-ad59e5d4620d tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Releasing lock "refresh_cache-6a9311f2-f5f3-49f0-831e-728291d16d09" {{(pid=119544) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 02:14:04.135078 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-496b6b74-b54e-42ed-9f91-ad59e5d4620d tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] 10.222.0.57 "POST /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09/action" status: 202 len: 0 microversion: 2.1 time: 5.509581 Jul 18 02:14:04.136388 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 698/1379] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:13:58 2022] POST /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09/action => generated 0 bytes in 5525 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 18 02:14:04.143696 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-72e3ee20-c676-4d5f-b8b2-87b0d3cefdb9 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:04.144648 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-72e3ee20-c676-4d5f-b8b2-87b0d3cefdb9 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] [instance: c8ed62a2-40e8-40a5-8ec1-365add95911a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:04.161408 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-72e3ee20-c676-4d5f-b8b2-87b0d3cefdb9 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:04.162751 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-72e3ee20-c676-4d5f-b8b2-87b0d3cefdb9 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:04.166557 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-72e3ee20-c676-4d5f-b8b2-87b0d3cefdb9 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:04.170817 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-72e3ee20-c676-4d5f-b8b2-87b0d3cefdb9 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:04.263869 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-72e3ee20-c676-4d5f-b8b2-87b0d3cefdb9 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] [instance: c8ed62a2-40e8-40a5-8ec1-365add95911a] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:14:04.474334 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-72e3ee20-c676-4d5f-b8b2-87b0d3cefdb9 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c8ed62a2-40e8-40a5-8ec1-365add95911a" status: 204 len: 0 microversion: 2.1 time: 0.333586 Jul 18 02:14:04.480145 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 699/1380] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:14:04 2022] DELETE /compute/v2.1/servers/c8ed62a2-40e8-40a5-8ec1-365add95911a => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:14:04.494527 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-320d963a-c858-4487-94af-1ef2df21dfac req-3c55b366-bfd6-43b1-b98c-5dcaae0c4f62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b74ae52f-6794-49d2-867e-be0996b090aa", "tag": "22d8b9d4-cdb4-4747-87c6-94168bb42281"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:04.515588 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-320d963a-c858-4487-94af-1ef2df21dfac req-3c55b366-bfd6-43b1-b98c-5dcaae0c4f62 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:04.518575 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-320d963a-c858-4487-94af-1ef2df21dfac req-3c55b366-bfd6-43b1-b98c-5dcaae0c4f62 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:04.544658 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-320d963a-c858-4487-94af-1ef2df21dfac req-3c55b366-bfd6-43b1-b98c-5dcaae0c4f62 service nova] Creating event network-changed:22d8b9d4-cdb4-4747-87c6-94168bb42281 for instance b74ae52f-6794-49d2-867e-be0996b090aa on n-h2-465891-3 Jul 18 02:14:04.565310 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-320d963a-c858-4487-94af-1ef2df21dfac req-3c55b366-bfd6-43b1-b98c-5dcaae0c4f62 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081683 Jul 18 02:14:04.566754 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 700/1381] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:04.578799 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a89ee496-568e-4bff-97eb-62b11c911781 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-465891-3", "block_migration": "auto"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:04.584932 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a89ee496-568e-4bff-97eb-62b11c911781 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] [instance: 49764b86-41da-4c6d-b069-aaccf92ef89f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:04.607700 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a89ee496-568e-4bff-97eb-62b11c911781 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:04.608814 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a89ee496-568e-4bff-97eb-62b11c911781 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:04.614095 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a89ee496-568e-4bff-97eb-62b11c911781 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:04.614742 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a89ee496-568e-4bff-97eb-62b11c911781 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:04.723498 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-a89ee496-568e-4bff-97eb-62b11c911781 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lazy-loading 'flavor' on Instance uuid 49764b86-41da-4c6d-b069-aaccf92ef89f {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:14:04.766233 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a89ee496-568e-4bff-97eb-62b11c911781 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] [instance: 49764b86-41da-4c6d-b069-aaccf92ef89f] Going to try to live migrate instance to n-h1-465891-3 {{(pid=119544) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 18 02:14:04.904377 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-41ba160f-c9ca-4e86-a4fb-66d32692ce67 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:04.920320 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-41ba160f-c9ca-4e86-a4fb-66d32692ce67 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/2d8e0c47-5276-4d24-9cb3-fb36bb9b6400" status: 200 len: 1506 microversion: 2.1 time: 1.467554 Jul 18 02:14:04.927155 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 682/1382] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:03 2022] GET /compute/v2.1/servers/2d8e0c47-5276-4d24-9cb3-fb36bb9b6400 => generated 1506 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:04.950307 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-58d58d6e-fe8c-41e4-b626-8814df4ff0f5 req-a70322ca-2b95-4409-b13c-c7a03e82e010 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d8e0c47-5276-4d24-9cb3-fb36bb9b6400", "name": "network-vif-plugged", "status": "completed", "tag": "d2e3884d-a86d-4462-b786-c48742d72cd5"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:04.983834 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-58d58d6e-fe8c-41e4-b626-8814df4ff0f5 req-a70322ca-2b95-4409-b13c-c7a03e82e010 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:04.984724 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-58d58d6e-fe8c-41e4-b626-8814df4ff0f5 req-a70322ca-2b95-4409-b13c-c7a03e82e010 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:05.019945 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-58d58d6e-fe8c-41e4-b626-8814df4ff0f5 req-a70322ca-2b95-4409-b13c-c7a03e82e010 service nova] Creating event network-vif-plugged:d2e3884d-a86d-4462-b786-c48742d72cd5 for instance 2d8e0c47-5276-4d24-9cb3-fb36bb9b6400 on n-h1-465891-3 Jul 18 02:14:05.036249 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-58d58d6e-fe8c-41e4-b626-8814df4ff0f5 req-a70322ca-2b95-4409-b13c-c7a03e82e010 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107093 Jul 18 02:14:05.039189 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 683/1383] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:05.058052 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dd206932-467c-4e23-b9b8-9197f1e935f5 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:05.059751 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-dd206932-467c-4e23-b9b8-9197f1e935f5 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c8ba5e49-8aa4-4b43-9273-16be87705a48] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:05.085880 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dd206932-467c-4e23-b9b8-9197f1e935f5 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:05.086844 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dd206932-467c-4e23-b9b8-9197f1e935f5 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:05.089119 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dd206932-467c-4e23-b9b8-9197f1e935f5 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:05.092332 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dd206932-467c-4e23-b9b8-9197f1e935f5 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:06.139869 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-dd206932-467c-4e23-b9b8-9197f1e935f5 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:06.158455 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-dd206932-467c-4e23-b9b8-9197f1e935f5 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c8ba5e49-8aa4-4b43-9273-16be87705a48" status: 200 len: 1319 microversion: 2.1 time: 1.113633 Jul 18 02:14:06.169656 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 684/1384] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:05 2022] GET /compute/v2.1/servers/c8ba5e49-8aa4-4b43-9273-16be87705a48 => generated 1319 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:06.183004 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4afcf7b7-4950-42e1-959b-bd62feeb148f tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Calling method '.version_select at 0x7ff4a8a34d30>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:07.995088 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:08.470507 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=30 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:08.637742 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4afcf7b7-4950-42e1-959b-bd62feeb148f tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] 10.222.0.57 "DELETE /compute/v2.1/os-floating-ips/9265a8e1-417f-4f0d-90d1-2c8e590652c0" status: 202 len: 0 microversion: 2.1 time: 2.465257 Jul 18 02:14:08.639158 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 685/1385] 10.222.0.57 () {58 vars in 1262 bytes} [Mon Jul 18 02:14:06 2022] DELETE /compute/v2.1/os-floating-ips/9265a8e1-417f-4f0d-90d1-2c8e590652c0 => generated 0 bytes in 2469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:14:08.668350 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c9359f8e-a6f0-4e03-8a81-8654422d84e1 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a89dcc10>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:08.829210 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a89ee496-568e-4bff-97eb-62b11c911781 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f/action" status: 202 len: 0 microversion: 2.25 time: 4.260596 Jul 18 02:14:08.835334 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 701/1386] 10.222.0.57 () {62 vars in 1318 bytes} [Mon Jul 18 02:14:04 2022] POST /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f/action => generated 0 bytes in 4263 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:14:08.853579 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7723e6e5-4215-4012-b8dc-f28a137f1be6 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:08.860416 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7723e6e5-4215-4012-b8dc-f28a137f1be6 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] [instance: c8ed62a2-40e8-40a5-8ec1-365add95911a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:08.907138 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c9359f8e-a6f0-4e03-8a81-8654422d84e1 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/9053bb1e-a3c0-4052-9d8d-7b964f899348" status: 200 len: 1455 microversion: 2.1 time: 0.265674 Jul 18 02:14:08.920865 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7723e6e5-4215-4012-b8dc-f28a137f1be6 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:08.942277 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 686/1387] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:14:08 2022] GET /compute/v2.1/images/9053bb1e-a3c0-4052-9d8d-7b964f899348 => generated 1455 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:08.950827 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7723e6e5-4215-4012-b8dc-f28a137f1be6 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:08.952872 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7723e6e5-4215-4012-b8dc-f28a137f1be6 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:08.954517 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7723e6e5-4215-4012-b8dc-f28a137f1be6 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:08.958439 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bbdc03ba-a2c4-4651-8baf-9486307311d1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:08.966839 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bbdc03ba-a2c4-4651-8baf-9486307311d1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 2d8e0c47-5276-4d24-9cb3-fb36bb9b6400] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:09.002504 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bbdc03ba-a2c4-4651-8baf-9486307311d1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:09.004097 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bbdc03ba-a2c4-4651-8baf-9486307311d1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:09.006196 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bbdc03ba-a2c4-4651-8baf-9486307311d1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:09.006919 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bbdc03ba-a2c4-4651-8baf-9486307311d1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:09.050097 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-7723e6e5-4215-4012-b8dc-f28a137f1be6 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] HTTP exception thrown: Instance c8ed62a2-40e8-40a5-8ec1-365add95911a could not be found. Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7723e6e5-4215-4012-b8dc-f28a137f1be6 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Request method failure captured: Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/c8ed62a2-40e8-40a5-8ec1-365add95911a HTTP/1.1 Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MGyvmfvOW92_8EFRzjxzrpzIZh4SiXbkPCyi0rdQ7sO-bz1u6KTqOmvLLovRhlo2jvmO_hhmIzQNZ9Dayn2AL9gLkZBZsGHvGbiptq8pOSeqB-B5lxFErIGNamep1fiheOEGYzF2iaXbjVWuwOcVnTLYKDxJ4Lz32i7NEeT4IcA5FI Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 4cd338c0a2724ca999dc02d93f90860a Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-321384848 Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4cd338c0a2724ca999dc02d93f90860a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4cd338c0a2724ca999dc02d93f90860a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4cd338c0a2724ca999dc02d93f90860a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4cd338c0a2724ca999dc02d93f90860a"}]}] Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-321384848 Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 4cd338c0a2724ca999dc02d93f90860a Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-321384848 Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServerMetadataNegativeTestJSON-321384848-project Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: e5525cb28fdc490a8e1bafb732a70fc6 Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-321384848-project Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance c8ed62a2-40e8-40a5-8ec1-365add95911a could not be found. Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'c8ed62a2-40e8-40a5-8ec1-365add95911a'} Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8ed62a2-40e8-40a5-8ec1-365add95911a could not be found. Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8ed62a2-40e8-40a5-8ec1-365add95911a could not be found. Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:09.053615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:09.071335 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:09.071335 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:09.071335 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:09.071335 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:09.071335 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:14:09.071335 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:14:09.071335 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8ed62a2-40e8-40a5-8ec1-365add95911a could not be found. Jul 18 02:14:09.071335 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:09.071335 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7723e6e5-4215-4012-b8dc-f28a137f1be6 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] Returning 404 to user: Instance c8ed62a2-40e8-40a5-8ec1-365add95911a could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:14:09.071335 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7723e6e5-4215-4012-b8dc-f28a137f1be6 tempest-ServerMetadataNegativeTestJSON-321384848 tempest-ServerMetadataNegativeTestJSON-321384848-project] 10.222.0.57 "GET /compute/v2.1/servers/c8ed62a2-40e8-40a5-8ec1-365add95911a" status: 404 len: 111 microversion: 2.1 time: 0.231297 Jul 18 02:14:09.077834 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 702/1388] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:08 2022] GET /compute/v2.1/servers/c8ed62a2-40e8-40a5-8ec1-365add95911a => generated 111 bytes in 240 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:14:09.081803 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0db603c4-ff19-46c0-ad23-a1b12907a5a5 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:09.092987 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0db603c4-ff19-46c0-ad23-a1b12907a5a5 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c8ba5e49-8aa4-4b43-9273-16be87705a48] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:09.115451 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0db603c4-ff19-46c0-ad23-a1b12907a5a5 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:09.126822 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0db603c4-ff19-46c0-ad23-a1b12907a5a5 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:09.128714 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0db603c4-ff19-46c0-ad23-a1b12907a5a5 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:09.129807 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0db603c4-ff19-46c0-ad23-a1b12907a5a5 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:09.862201 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0db603c4-ff19-46c0-ad23-a1b12907a5a5 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:09.893413 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0db603c4-ff19-46c0-ad23-a1b12907a5a5 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c8ba5e49-8aa4-4b43-9273-16be87705a48" status: 200 len: 1319 microversion: 2.1 time: 0.819316 Jul 18 02:14:09.910051 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 703/1389] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:09 2022] GET /compute/v2.1/servers/c8ba5e49-8aa4-4b43-9273-16be87705a48 => generated 1319 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:09.931283 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-0869733b-f7fd-4f96-bb77-cfaaa3117b33 req-357c1b36-e188-4937-a250-e3ba74314b50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ed62a2-40e8-40a5-8ec1-365add95911a", "name": "network-vif-deleted", "tag": "e1abec08-da7f-4a23-81d1-ba54d9237748"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:09.963216 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-0869733b-f7fd-4f96-bb77-cfaaa3117b33 req-357c1b36-e188-4937-a250-e3ba74314b50 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:09.965127 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-0869733b-f7fd-4f96-bb77-cfaaa3117b33 req-357c1b36-e188-4937-a250-e3ba74314b50 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:09.995614 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-0869733b-f7fd-4f96-bb77-cfaaa3117b33 req-357c1b36-e188-4937-a250-e3ba74314b50 service nova] Creating event network-vif-deleted:e1abec08-da7f-4a23-81d1-ba54d9237748 for instance c8ed62a2-40e8-40a5-8ec1-365add95911a on n-h1-465891-3 Jul 18 02:14:09.998972 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bbdc03ba-a2c4-4651-8baf-9486307311d1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:10.008816 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-0869733b-f7fd-4f96-bb77-cfaaa3117b33 req-357c1b36-e188-4937-a250-e3ba74314b50 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095877 Jul 18 02:14:10.010749 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 704/1390] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:10.024892 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a5021ae6-7b2f-480f-8058-469ef2b636ba tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a5021ae6-7b2f-480f-8058-469ef2b636ba tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Request method failure captured: Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09/action HTTP/1.1 Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 34 Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MGTGvtt_IEOf9uBOa0rn3DuCRCY0-R0WX9y8-LDCmVVy_XQ_NqlZenh4yE4xW6cr8CjfmzKHIY8E6j2QQ67LgHwFHRAJRt-fTfeUPVmSfiZoTgU5XLXYI8ER0gh6EQq8vzHpW9cw-4F19UXXFKa8SJW6umz8lZFTbXmx2f7ZJhPVYQ Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 3a94aaf6ca324e97aec2f6e982416f9b Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-819607396 Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3a94aaf6ca324e97aec2f6e982416f9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a94aaf6ca324e97aec2f6e982416f9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a94aaf6ca324e97aec2f6e982416f9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3a94aaf6ca324e97aec2f6e982416f9b"}]}] Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-819607396 Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 3a94aaf6ca324e97aec2f6e982416f9b Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-819607396 Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: c83428adc93d4dd9a3884659a73bd865 Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: {"addFloatingIp": {"address": ""}} Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '6a9311f2-f5f3-49f0-831e-728291d16d09', 'body': {'addFloatingIp': {'address': ''}}} Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi '' Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:14:10.033734 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:14:10.046401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:14:10.046401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 18 02:14:10.046401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:10.046401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:10.046401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:10.046401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:10.046401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:10.046401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:10.046401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:14:10.046401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:14:10.046401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 18 02:14:10.046401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:10.046401 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a5021ae6-7b2f-480f-8058-469ef2b636ba tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:14:10.050820 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a5021ae6-7b2f-480f-8058-469ef2b636ba tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] 10.222.0.57 "POST /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09/action" status: 400 len: 142 microversion: 2.1 time: 0.035714 Jul 18 02:14:10.063924 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 705/1391] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:14:10 2022] POST /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09/action => generated 142 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:14:10.074452 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-36707f4d-cf75-47bf-83ae-e62a0d8aa858 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:10.077539 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-36707f4d-cf75-47bf-83ae-e62a0d8aa858 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 49764b86-41da-4c6d-b069-aaccf92ef89f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:10.086139 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bbdc03ba-a2c4-4651-8baf-9486307311d1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/2d8e0c47-5276-4d24-9cb3-fb36bb9b6400" status: 200 len: 1488 microversion: 2.1 time: 1.136997 Jul 18 02:14:10.094857 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-36707f4d-cf75-47bf-83ae-e62a0d8aa858 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:10.096352 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-36707f4d-cf75-47bf-83ae-e62a0d8aa858 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:10.098285 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-36707f4d-cf75-47bf-83ae-e62a0d8aa858 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:10.098844 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 687/1392] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:08 2022] GET /compute/v2.1/servers/2d8e0c47-5276-4d24-9cb3-fb36bb9b6400 => generated 1488 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:10.099967 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-36707f4d-cf75-47bf-83ae-e62a0d8aa858 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:10.162921 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-d9dc2566-3ba7-4d13-a349-f7c26db53531 req-838d1888-1e16-4b50-a1fd-36fdaf3cace9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d8e0c47-5276-4d24-9cb3-fb36bb9b6400", "name": "network-vif-unplugged", "status": "completed", "tag": "d2e3884d-a86d-4462-b786-c48742d72cd5"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:10.184381 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-d9dc2566-3ba7-4d13-a349-f7c26db53531 req-838d1888-1e16-4b50-a1fd-36fdaf3cace9 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:10.197494 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-d9dc2566-3ba7-4d13-a349-f7c26db53531 req-838d1888-1e16-4b50-a1fd-36fdaf3cace9 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:10.234659 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-d9dc2566-3ba7-4d13-a349-f7c26db53531 req-838d1888-1e16-4b50-a1fd-36fdaf3cace9 service nova] Creating event network-vif-unplugged:d2e3884d-a86d-4462-b786-c48742d72cd5 for instance 2d8e0c47-5276-4d24-9cb3-fb36bb9b6400 on n-h1-465891-3 Jul 18 02:14:10.254954 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-d9dc2566-3ba7-4d13-a349-f7c26db53531 req-838d1888-1e16-4b50-a1fd-36fdaf3cace9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.154299 Jul 18 02:14:10.255913 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 688/1393] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:10.273218 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d4398fd1-d5d1-4690-9605-75bcdf7d2166 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a8871ee0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:10.383581 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d4398fd1-d5d1-4690-9605-75bcdf7d2166 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/9053bb1e-a3c0-4052-9d8d-7b964f899348" status: 200 len: 1455 microversion: 2.1 time: 0.126319 Jul 18 02:14:10.385010 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 689/1394] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:14:10 2022] GET /compute/v2.1/images/9053bb1e-a3c0-4052-9d8d-7b964f899348 => generated 1455 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:10.404005 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-836807fc-c6aa-4765-aeda-91f6d2302276 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Action: 'action', calling method: .version_select at 0x7ff4ab6c7040>, body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:10.407178 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-836807fc-c6aa-4765-aeda-91f6d2302276 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] [instance: 6a9311f2-f5f3-49f0-831e-728291d16d09] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:10.428814 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-836807fc-c6aa-4765-aeda-91f6d2302276 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:10.429611 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-836807fc-c6aa-4765-aeda-91f6d2302276 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:10.430717 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-836807fc-c6aa-4765-aeda-91f6d2302276 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:10.431396 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-836807fc-c6aa-4765-aeda-91f6d2302276 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:10.522585 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-836807fc-c6aa-4765-aeda-91f6d2302276 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Acquired lock "refresh_cache-6a9311f2-f5f3-49f0-831e-728291d16d09" {{(pid=119543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 02:14:10.865524 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-36707f4d-cf75-47bf-83ae-e62a0d8aa858 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:10.883931 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-36707f4d-cf75-47bf-83ae-e62a0d8aa858 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:10.885544 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-36707f4d-cf75-47bf-83ae-e62a0d8aa858 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:10.887397 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-36707f4d-cf75-47bf-83ae-e62a0d8aa858 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f" status: 200 len: 1567 microversion: 2.25 time: 0.821498 Jul 18 02:14:10.888190 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 706/1395] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:14:10 2022] GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f => generated 1567 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:14:10.893190 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4a654a6f-c796-467e-be95-3260b8d4aaf9 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:10.893983 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4a654a6f-c796-467e-be95-3260b8d4aaf9 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 2d8e0c47-5276-4d24-9cb3-fb36bb9b6400] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:10.914084 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4a654a6f-c796-467e-be95-3260b8d4aaf9 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:10.914870 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4a654a6f-c796-467e-be95-3260b8d4aaf9 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:10.915881 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4a654a6f-c796-467e-be95-3260b8d4aaf9 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:10.916518 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4a654a6f-c796-467e-be95-3260b8d4aaf9 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:10.976799 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4a654a6f-c796-467e-be95-3260b8d4aaf9 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 2d8e0c47-5276-4d24-9cb3-fb36bb9b6400] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:14:10.988741 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-836807fc-c6aa-4765-aeda-91f6d2302276 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Releasing lock "refresh_cache-6a9311f2-f5f3-49f0-831e-728291d16d09" {{(pid=119543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 02:14:10.989592 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-836807fc-c6aa-4765-aeda-91f6d2302276 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] HTTP exception thrown: floating IP not found Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-836807fc-c6aa-4765-aeda-91f6d2302276 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Request method failure captured: Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09/action HTTP/1.1 Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 41 Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MGTGvtt_IEOf9uBOa0rn3DuCRCY0-R0WX9y8-LDCmVVy_XQ_NqlZenh4yE4xW6cr8CjfmzKHIY8E6j2QQ67LgHwFHRAJRt-fTfeUPVmSfiZoTgU5XLXYI8ER0gh6EQq8vzHpW9cw-4F19UXXFKa8SJW6umz8lZFTbXmx2f7ZJhPVYQ Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 3a94aaf6ca324e97aec2f6e982416f9b Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-819607396 Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3a94aaf6ca324e97aec2f6e982416f9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a94aaf6ca324e97aec2f6e982416f9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a94aaf6ca324e97aec2f6e982416f9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3a94aaf6ca324e97aec2f6e982416f9b"}]}] Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-819607396 Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 3a94aaf6ca324e97aec2f6e982416f9b Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-819607396 Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: c83428adc93d4dd9a3884659a73bd865 Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: {"addFloatingIp": {"address": "0.0.0.0"}} Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: exception: floating IP not found Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '6a9311f2-f5f3-49f0-831e-728291d16d09', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Jul 18 02:14:10.992148 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:11.004954 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:11.004954 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:11.004954 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:11.004954 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:11.004954 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:11.004954 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:14:11.004954 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:14:11.004954 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Jul 18 02:14:11.004954 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:11.004954 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-836807fc-c6aa-4765-aeda-91f6d2302276 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Returning 404 to user: floating IP not found {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:14:11.004954 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-836807fc-c6aa-4765-aeda-91f6d2302276 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] 10.222.0.57 "POST /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09/action" status: 404 len: 67 microversion: 2.1 time: 0.597398 Jul 18 02:14:11.004954 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 690/1396] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:14:10 2022] POST /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09/action => generated 67 bytes in 612 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:14:11.013433 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e4f94383-3b71-464d-9a76-3a0bf027a76c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:11.014524 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e4f94383-3b71-464d-9a76-3a0bf027a76c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c8ba5e49-8aa4-4b43-9273-16be87705a48] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:11.026253 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e4f94383-3b71-464d-9a76-3a0bf027a76c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:11.033256 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e4f94383-3b71-464d-9a76-3a0bf027a76c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:11.034798 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e4f94383-3b71-464d-9a76-3a0bf027a76c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:11.035807 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e4f94383-3b71-464d-9a76-3a0bf027a76c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:11.133283 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4a654a6f-c796-467e-be95-3260b8d4aaf9 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2d8e0c47-5276-4d24-9cb3-fb36bb9b6400" status: 204 len: 0 microversion: 2.1 time: 0.243205 Jul 18 02:14:11.134820 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 707/1397] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:14:10 2022] DELETE /compute/v2.1/servers/2d8e0c47-5276-4d24-9cb3-fb36bb9b6400 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:14:11.144050 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-77f6017b-ea95-4f0a-8176-bf7c5a5acd4e tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:11.370088 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-77f6017b-ea95-4f0a-8176-bf7c5a5acd4e tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-77f6017b-ea95-4f0a-8176-bf7c5a5acd4e tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Request method failure captured: Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09/action HTTP/1.1 Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 44 Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MGTGvtt_IEOf9uBOa0rn3DuCRCY0-R0WX9y8-LDCmVVy_XQ_NqlZenh4yE4xW6cr8CjfmzKHIY8E6j2QQ67LgHwFHRAJRt-fTfeUPVmSfiZoTgU5XLXYI8ER0gh6EQq8vzHpW9cw-4F19UXXFKa8SJW6umz8lZFTbXmx2f7ZJhPVYQ Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 3a94aaf6ca324e97aec2f6e982416f9b Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-819607396 Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3a94aaf6ca324e97aec2f6e982416f9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a94aaf6ca324e97aec2f6e982416f9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a94aaf6ca324e97aec2f6e982416f9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3a94aaf6ca324e97aec2f6e982416f9b"}]}] Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-819607396 Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 3a94aaf6ca324e97aec2f6e982416f9b Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-819607396 Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: c83428adc93d4dd9a3884659a73bd865 Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: {"removeFloatingIp": {"address": "0.0.0.0"}} Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: exception: Floating IP not found for address 0.0.0.0. Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '6a9311f2-f5f3-49f0-831e-728291d16d09', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Jul 18 02:14:11.372796 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Jul 18 02:14:11.377814 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Jul 18 02:14:11.377814 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:11.377814 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:11.377814 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:11.377814 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:11.377814 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:11.377814 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:11.377814 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:14:11.377814 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:14:11.377814 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Jul 18 02:14:11.377814 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:11.379610 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-77f6017b-ea95-4f0a-8176-bf7c5a5acd4e tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:14:11.380493 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-77f6017b-ea95-4f0a-8176-bf7c5a5acd4e tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] 10.222.0.57 "POST /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09/action" status: 404 len: 88 microversion: 2.1 time: 0.243860 Jul 18 02:14:11.381299 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 708/1398] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:14:11 2022] POST /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09/action => generated 88 bytes in 246 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:14:11.398505 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0e11ea77-97c1-41df-b82e-fa7376040eda tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a8a11a60>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:11.443362 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-0e11ea77-97c1-41df-b82e-fa7376040eda tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] HTTP exception thrown: Image not found. Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0e11ea77-97c1-41df-b82e-fa7376040eda tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Request method failure captured: Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/images/af962106-786e-4342-b328-b9899b0c9133 HTTP/1.1 Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MCzvUiLjVPa9k5iRmWWr1F2ZyXX6RhQj-KxTNpVjPTd256MdgV8yuDLe9WLMkK_v1nEuuEud4Xy4MbeuUSjptygmIUcMLCmISLnRcYLgmO2plKsp9LFggv3C6frOpPwcaFoHgcExXMgtK5PyovbnA7Q594UMMNgAWnVF4ge4OjZi9A Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 10c5b35052cd4a71a8254d01112f0496 Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ImagesTestJSON-61947256 Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_10c5b35052cd4a71a8254d01112f0496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/10c5b35052cd4a71a8254d01112f0496"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/10c5b35052cd4a71a8254d01112f0496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/10c5b35052cd4a71a8254d01112f0496"}]}] Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ImagesTestJSON-61947256 Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 10c5b35052cd4a71a8254d01112f0496 Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ImagesTestJSON-61947256 Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ImagesTestJSON-61947256-project Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: a686fc833d964d88a022fae2932b5727 Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ImagesTestJSON-61947256-project Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: exception: Image not found. Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'af962106-786e-4342-b328-b9899b0c9133'} Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image af962106-786e-4342-b328-b9899b0c9133 to delete Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image af962106-786e-4342-b328-b9899b0c9133 could not be found. Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:11.445172 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:11.450352 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:11.450352 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:11.450352 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:14:11.450352 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:14:11.450352 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:14:11.450352 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:14:11.450352 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:14:11.450352 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:14:11.450352 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 18 02:14:11.450352 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 02:14:11.450352 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:14:11.450352 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:11.450352 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:11.450352 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:11.450352 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:11.450352 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:11.450352 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:11.450352 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:14:11.450352 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:14:11.450352 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:14:11.450352 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:11.453297 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0e11ea77-97c1-41df-b82e-fa7376040eda tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Returning 404 to user: Image not found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:14:11.456499 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0e11ea77-97c1-41df-b82e-fa7376040eda tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "DELETE /compute/v2.1/images/af962106-786e-4342-b328-b9899b0c9133" status: 404 len: 62 microversion: 2.1 time: 0.073555 Jul 18 02:14:11.457866 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 709/1399] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:11 2022] DELETE /compute/v2.1/images/af962106-786e-4342-b328-b9899b0c9133 => generated 62 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:14:11.479186 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f603a4ff-0940-471a-a086-e58ab419ac20 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:11.481061 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f603a4ff-0940-471a-a086-e58ab419ac20 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] [instance: 6a9311f2-f5f3-49f0-831e-728291d16d09] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:11.510280 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f603a4ff-0940-471a-a086-e58ab419ac20 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:11.510998 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f603a4ff-0940-471a-a086-e58ab419ac20 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:11.516033 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f603a4ff-0940-471a-a086-e58ab419ac20 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:11.516774 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f603a4ff-0940-471a-a086-e58ab419ac20 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:11.587629 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f603a4ff-0940-471a-a086-e58ab419ac20 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] [instance: 6a9311f2-f5f3-49f0-831e-728291d16d09] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:14:11.638611 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e4f94383-3b71-464d-9a76-3a0bf027a76c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:11.662054 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e4f94383-3b71-464d-9a76-3a0bf027a76c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c8ba5e49-8aa4-4b43-9273-16be87705a48" status: 200 len: 1319 microversion: 2.1 time: 0.662088 Jul 18 02:14:11.664913 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 691/1400] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:10 2022] GET /compute/v2.1/servers/c8ba5e49-8aa4-4b43-9273-16be87705a48 => generated 1319 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:11.676085 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f3955330-e9d4-4c34-8838-90c593cebd02 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a8824700>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:11.813165 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f3955330-e9d4-4c34-8838-90c593cebd02 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/9053bb1e-a3c0-4052-9d8d-7b964f899348" status: 200 len: 1455 microversion: 2.1 time: 0.145674 Jul 18 02:14:11.818319 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 692/1401] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:14:11 2022] GET /compute/v2.1/images/9053bb1e-a3c0-4052-9d8d-7b964f899348 => generated 1455 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:11.833582 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7d5357c9-291c-48c4-b721-474211e47fed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:11.844080 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7d5357c9-291c-48c4-b721-474211e47fed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 2d8e0c47-5276-4d24-9cb3-fb36bb9b6400] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:11.877544 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7d5357c9-291c-48c4-b721-474211e47fed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:11.879856 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7d5357c9-291c-48c4-b721-474211e47fed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:11.882800 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7d5357c9-291c-48c4-b721-474211e47fed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:11.883071 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f603a4ff-0940-471a-a086-e58ab419ac20 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] 10.222.0.57 "DELETE /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09" status: 204 len: 0 microversion: 2.1 time: 0.422991 Jul 18 02:14:11.887204 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7d5357c9-291c-48c4-b721-474211e47fed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:11.889641 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 710/1402] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:14:11 2022] DELETE /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:14:11.921805 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b8dab50e-71d2-4784-8ac7-565b8d45f0ca tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:11.923943 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b8dab50e-71d2-4784-8ac7-565b8d45f0ca tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] [instance: 6a9311f2-f5f3-49f0-831e-728291d16d09] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:11.954844 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b8dab50e-71d2-4784-8ac7-565b8d45f0ca tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:11.960916 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b8dab50e-71d2-4784-8ac7-565b8d45f0ca tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:11.965068 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7d5357c9-291c-48c4-b721-474211e47fed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 2d8e0c47-5276-4d24-9cb3-fb36bb9b6400] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:14:11.967957 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b8dab50e-71d2-4784-8ac7-565b8d45f0ca tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:11.969000 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b8dab50e-71d2-4784-8ac7-565b8d45f0ca tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:12.188600 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.compute.api [None req-7d5357c9-291c-48c4-b721-474211e47fed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 2d8e0c47-5276-4d24-9cb3-fb36bb9b6400] Instance is already in deleting state, ignoring this request Jul 18 02:14:12.193874 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7d5357c9-291c-48c4-b721-474211e47fed tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2d8e0c47-5276-4d24-9cb3-fb36bb9b6400" status: 204 len: 0 microversion: 2.1 time: 0.373637 Jul 18 02:14:12.195750 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 693/1403] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:14:11 2022] DELETE /compute/v2.1/servers/2d8e0c47-5276-4d24-9cb3-fb36bb9b6400 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:14:12.208616 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f1ef5310-d5fd-4465-bce9-c3e8b949813d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:12.212103 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f1ef5310-d5fd-4465-bce9-c3e8b949813d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 49764b86-41da-4c6d-b069-aaccf92ef89f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:12.240474 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f1ef5310-d5fd-4465-bce9-c3e8b949813d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:12.243308 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f1ef5310-d5fd-4465-bce9-c3e8b949813d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:12.247022 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f1ef5310-d5fd-4465-bce9-c3e8b949813d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:12.248573 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f1ef5310-d5fd-4465-bce9-c3e8b949813d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:13.048274 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:13.118843 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b8dab50e-71d2-4784-8ac7-565b8d45f0ca tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83428adc93d4dd9a3884659a73bd865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a94aaf6ca324e97aec2f6e982416f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:13.136837 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b8dab50e-71d2-4784-8ac7-565b8d45f0ca tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] 10.222.0.57 "GET /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09" status: 200 len: 1541 microversion: 2.1 time: 1.244392 Jul 18 02:14:13.139320 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 711/1404] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:11 2022] GET /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09 => generated 1541 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:13.161239 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-6e390253-e799-48aa-a12b-74691ac1a602 req-0ee39de2-cfbf-4f5a-8241-f070be78ade7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "465df230-ba3a-430a-935d-dc0a7fb83462", "tag": "874a12e1-9707-47fe-86d6-8d8a405eab15"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:13.205240 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-6e390253-e799-48aa-a12b-74691ac1a602 req-0ee39de2-cfbf-4f5a-8241-f070be78ade7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:13.212408 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-6e390253-e799-48aa-a12b-74691ac1a602 req-0ee39de2-cfbf-4f5a-8241-f070be78ade7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:13.252616 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-6e390253-e799-48aa-a12b-74691ac1a602 req-0ee39de2-cfbf-4f5a-8241-f070be78ade7 service nova] Creating event network-changed:874a12e1-9707-47fe-86d6-8d8a405eab15 for instance 465df230-ba3a-430a-935d-dc0a7fb83462 on n-h1-465891-3 Jul 18 02:14:13.264292 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-6e390253-e799-48aa-a12b-74691ac1a602 req-0ee39de2-cfbf-4f5a-8241-f070be78ade7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121570 Jul 18 02:14:13.266224 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 712/1405] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:13.276372 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-805f78d5-c83d-4ba8-ab4f-8641e1493a98 req-26146bf6-e4af-46f9-b033-6c48257245a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8ba5e49-8aa4-4b43-9273-16be87705a48", "tag": "e6e21fca-05de-4332-a05b-960df4333930"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:13.313374 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f1ef5310-d5fd-4465-bce9-c3e8b949813d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:13.315667 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-805f78d5-c83d-4ba8-ab4f-8641e1493a98 req-26146bf6-e4af-46f9-b033-6c48257245a7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:13.317260 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-805f78d5-c83d-4ba8-ab4f-8641e1493a98 req-26146bf6-e4af-46f9-b033-6c48257245a7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:13.353768 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=6,nova_cell1:RELEASE=1,nova_cell1:INSERT=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:13.359785 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f1ef5310-d5fd-4465-bce9-c3e8b949813d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:13.362756 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-805f78d5-c83d-4ba8-ab4f-8641e1493a98 req-26146bf6-e4af-46f9-b033-6c48257245a7 service nova] Creating event network-changed:e6e21fca-05de-4332-a05b-960df4333930 for instance c8ba5e49-8aa4-4b43-9273-16be87705a48 on n-h2-465891-3 Jul 18 02:14:13.373873 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f1ef5310-d5fd-4465-bce9-c3e8b949813d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:13.375324 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f1ef5310-d5fd-4465-bce9-c3e8b949813d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f" status: 200 len: 1567 microversion: 2.25 time: 1.177746 Jul 18 02:14:13.379454 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-805f78d5-c83d-4ba8-ab4f-8641e1493a98 req-26146bf6-e4af-46f9-b033-6c48257245a7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110829 Jul 18 02:14:13.380440 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 694/1406] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:14:12 2022] GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f => generated 1567 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:14:13.382231 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 713/1407] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:13.391944 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f5079f60-0e06-4bd6-8fa2-202838ed0a2b tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:13.392740 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f5079f60-0e06-4bd6-8fa2-202838ed0a2b tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 2d8e0c47-5276-4d24-9cb3-fb36bb9b6400] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:13.395558 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6bd8b192-2e4a-477d-9d33-af5838fa91da tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:13.396841 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6bd8b192-2e4a-477d-9d33-af5838fa91da tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c8ba5e49-8aa4-4b43-9273-16be87705a48] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:13.408467 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f5079f60-0e06-4bd6-8fa2-202838ed0a2b tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:13.408948 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f5079f60-0e06-4bd6-8fa2-202838ed0a2b tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:13.409845 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f5079f60-0e06-4bd6-8fa2-202838ed0a2b tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:13.410300 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f5079f60-0e06-4bd6-8fa2-202838ed0a2b tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:13.420228 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6bd8b192-2e4a-477d-9d33-af5838fa91da tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:13.420691 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6bd8b192-2e4a-477d-9d33-af5838fa91da tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:13.425173 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6bd8b192-2e4a-477d-9d33-af5838fa91da tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:13.426767 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6bd8b192-2e4a-477d-9d33-af5838fa91da tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:14.050316 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f5079f60-0e06-4bd6-8fa2-202838ed0a2b tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:14.065209 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6bd8b192-2e4a-477d-9d33-af5838fa91da tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:14.074666 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6bd8b192-2e4a-477d-9d33-af5838fa91da tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c8ba5e49-8aa4-4b43-9273-16be87705a48" status: 200 len: 1319 microversion: 2.1 time: 0.691105 Jul 18 02:14:14.089967 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 714/1408] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:13 2022] GET /compute/v2.1/servers/c8ba5e49-8aa4-4b43-9273-16be87705a48 => generated 1319 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:14.100563 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-267f879f-7963-4974-9181-5136a214c3fc tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a88c8550>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:14.118931 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f5079f60-0e06-4bd6-8fa2-202838ed0a2b tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/2d8e0c47-5276-4d24-9cb3-fb36bb9b6400" status: 200 len: 1494 microversion: 2.1 time: 0.733534 Jul 18 02:14:14.169302 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 695/1409] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:13 2022] GET /compute/v2.1/servers/2d8e0c47-5276-4d24-9cb3-fb36bb9b6400 => generated 1494 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:14.193473 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b2794cea-390d-41e1-9961-081fdba2ee85 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:14.203902 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b2794cea-390d-41e1-9961-081fdba2ee85 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] [instance: 6a9311f2-f5f3-49f0-831e-728291d16d09] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:14.242267 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b2794cea-390d-41e1-9961-081fdba2ee85 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:14.247072 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b2794cea-390d-41e1-9961-081fdba2ee85 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:14.248676 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b2794cea-390d-41e1-9961-081fdba2ee85 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:14.252798 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b2794cea-390d-41e1-9961-081fdba2ee85 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:14.284342 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-267f879f-7963-4974-9181-5136a214c3fc tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/9053bb1e-a3c0-4052-9d8d-7b964f899348" status: 200 len: 1455 microversion: 2.1 time: 0.192852 Jul 18 02:14:14.287841 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 715/1410] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:14:14 2022] GET /compute/v2.1/images/9053bb1e-a3c0-4052-9d8d-7b964f899348 => generated 1455 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:14.409617 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ff13bacb-ca79-47fe-a423-87cbdc83bc1d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:14.410966 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ff13bacb-ca79-47fe-a423-87cbdc83bc1d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 49764b86-41da-4c6d-b069-aaccf92ef89f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:14.423545 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ff13bacb-ca79-47fe-a423-87cbdc83bc1d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:14.424240 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ff13bacb-ca79-47fe-a423-87cbdc83bc1d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:14.425202 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ff13bacb-ca79-47fe-a423-87cbdc83bc1d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:14.425954 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ff13bacb-ca79-47fe-a423-87cbdc83bc1d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:15.196894 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ff13bacb-ca79-47fe-a423-87cbdc83bc1d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:15.208824 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ff13bacb-ca79-47fe-a423-87cbdc83bc1d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:15.210772 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ff13bacb-ca79-47fe-a423-87cbdc83bc1d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:15.212250 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ff13bacb-ca79-47fe-a423-87cbdc83bc1d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f" status: 200 len: 1567 microversion: 2.25 time: 0.807271 Jul 18 02:14:15.213371 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 716/1411] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:14:14 2022] GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f => generated 1567 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:14:15.220259 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-40159290-4438-46dd-8f22-c054edb24232 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:15.221154 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-40159290-4438-46dd-8f22-c054edb24232 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c8ba5e49-8aa4-4b43-9273-16be87705a48] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:15.246433 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-40159290-4438-46dd-8f22-c054edb24232 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:15.253647 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-40159290-4438-46dd-8f22-c054edb24232 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:15.258406 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-40159290-4438-46dd-8f22-c054edb24232 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:15.262647 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-40159290-4438-46dd-8f22-c054edb24232 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:15.709348 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b2794cea-390d-41e1-9961-081fdba2ee85 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83428adc93d4dd9a3884659a73bd865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a94aaf6ca324e97aec2f6e982416f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:15.726057 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b2794cea-390d-41e1-9961-081fdba2ee85 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] 10.222.0.57 "GET /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09" status: 200 len: 1541 microversion: 2.1 time: 1.554102 Jul 18 02:14:15.750362 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 696/1412] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:14 2022] GET /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09 => generated 1541 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:15.765870 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c54df86c-afaf-4e27-aae0-c8a8924dbcbf tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:15.766784 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c54df86c-afaf-4e27-aae0-c8a8924dbcbf tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 2d8e0c47-5276-4d24-9cb3-fb36bb9b6400] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:15.774882 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c54df86c-afaf-4e27-aae0-c8a8924dbcbf tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:15.775760 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c54df86c-afaf-4e27-aae0-c8a8924dbcbf tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:15.777507 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c54df86c-afaf-4e27-aae0-c8a8924dbcbf tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:15.778172 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c54df86c-afaf-4e27-aae0-c8a8924dbcbf tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:16.101610 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-40159290-4438-46dd-8f22-c054edb24232 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:16.114736 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-40159290-4438-46dd-8f22-c054edb24232 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c8ba5e49-8aa4-4b43-9273-16be87705a48" status: 200 len: 1319 microversion: 2.1 time: 0.899941 Jul 18 02:14:16.131040 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 717/1413] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:15 2022] GET /compute/v2.1/servers/c8ba5e49-8aa4-4b43-9273-16be87705a48 => generated 1319 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:16.136547 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e9c5a650-0407-4662-9d53-d2a14b165098 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a88c8040>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:16.227915 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e9c5a650-0407-4662-9d53-d2a14b165098 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/9053bb1e-a3c0-4052-9d8d-7b964f899348" status: 200 len: 1455 microversion: 2.1 time: 0.095373 Jul 18 02:14:16.228523 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 718/1414] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:14:16 2022] GET /compute/v2.1/images/9053bb1e-a3c0-4052-9d8d-7b964f899348 => generated 1455 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:16.253616 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-3311542d-a8ea-4a1f-8e33-3f72bf5c3c9a req-5ca48864-04b8-4342-9cfe-d1eef7e4cd4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49764b86-41da-4c6d-b069-aaccf92ef89f", "name": "network-vif-unplugged", "status": "completed", "tag": "91c20a21-2cb0-48df-99d9-8ab9275d0bc8"}, {"name": "network-changed", "server_uuid": "49764b86-41da-4c6d-b069-aaccf92ef89f", "tag": "91c20a21-2cb0-48df-99d9-8ab9275d0bc8"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:16.275889 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-3311542d-a8ea-4a1f-8e33-3f72bf5c3c9a req-5ca48864-04b8-4342-9cfe-d1eef7e4cd4c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:16.276956 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-3311542d-a8ea-4a1f-8e33-3f72bf5c3c9a req-5ca48864-04b8-4342-9cfe-d1eef7e4cd4c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:16.303887 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-3311542d-a8ea-4a1f-8e33-3f72bf5c3c9a req-5ca48864-04b8-4342-9cfe-d1eef7e4cd4c service nova] Creating event network-vif-unplugged:91c20a21-2cb0-48df-99d9-8ab9275d0bc8 for instance 49764b86-41da-4c6d-b069-aaccf92ef89f on n-h2-465891-3 Jul 18 02:14:16.310480 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-3311542d-a8ea-4a1f-8e33-3f72bf5c3c9a req-5ca48864-04b8-4342-9cfe-d1eef7e4cd4c service nova] Creating event network-changed:91c20a21-2cb0-48df-99d9-8ab9275d0bc8 for instance 49764b86-41da-4c6d-b069-aaccf92ef89f on n-h2-465891-3 Jul 18 02:14:16.319906 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-3311542d-a8ea-4a1f-8e33-3f72bf5c3c9a req-5ca48864-04b8-4342-9cfe-d1eef7e4cd4c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.090101 Jul 18 02:14:16.320836 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 719/1415] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:16.332343 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-081f931c-1dca-4e74-9c7e-f9e9c5f511a9 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:16.333161 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-081f931c-1dca-4e74-9c7e-f9e9c5f511a9 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 49764b86-41da-4c6d-b069-aaccf92ef89f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:16.359078 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-081f931c-1dca-4e74-9c7e-f9e9c5f511a9 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:16.359820 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-081f931c-1dca-4e74-9c7e-f9e9c5f511a9 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:16.360846 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-081f931c-1dca-4e74-9c7e-f9e9c5f511a9 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:16.361694 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-081f931c-1dca-4e74-9c7e-f9e9c5f511a9 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:17.030874 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c54df86c-afaf-4e27-aae0-c8a8924dbcbf tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:17.041572 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c54df86c-afaf-4e27-aae0-c8a8924dbcbf tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/2d8e0c47-5276-4d24-9cb3-fb36bb9b6400" status: 200 len: 1494 microversion: 2.1 time: 1.289682 Jul 18 02:14:17.059277 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 697/1416] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:15 2022] GET /compute/v2.1/servers/2d8e0c47-5276-4d24-9cb3-fb36bb9b6400 => generated 1494 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:17.072408 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-8a918809-f5d2-45de-b6a5-75e2427029c8 req-6a557d67-1c18-44e1-9439-9bb897d321a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ba5e49-8aa4-4b43-9273-16be87705a48", "name": "network-vif-plugged", "status": "completed", "tag": "e6e21fca-05de-4332-a05b-960df4333930"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:17.107423 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-8a918809-f5d2-45de-b6a5-75e2427029c8 req-6a557d67-1c18-44e1-9439-9bb897d321a1 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:17.110480 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-8a918809-f5d2-45de-b6a5-75e2427029c8 req-6a557d67-1c18-44e1-9439-9bb897d321a1 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:17.188303 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-8a918809-f5d2-45de-b6a5-75e2427029c8 req-6a557d67-1c18-44e1-9439-9bb897d321a1 service nova] Creating event network-vif-plugged:e6e21fca-05de-4332-a05b-960df4333930 for instance c8ba5e49-8aa4-4b43-9273-16be87705a48 on n-h2-465891-3 Jul 18 02:14:17.228131 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-8a918809-f5d2-45de-b6a5-75e2427029c8 req-6a557d67-1c18-44e1-9439-9bb897d321a1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166573 Jul 18 02:14:17.249804 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 698/1417] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:17.326519 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-60621fd6-2806-4485-915a-0447eaeeaf59 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:17.343066 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-60621fd6-2806-4485-915a-0447eaeeaf59 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] [instance: 6a9311f2-f5f3-49f0-831e-728291d16d09] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:17.413822 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-081f931c-1dca-4e74-9c7e-f9e9c5f511a9 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:17.479030 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60621fd6-2806-4485-915a-0447eaeeaf59 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:17.512248 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60621fd6-2806-4485-915a-0447eaeeaf59 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:17.532972 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-081f931c-1dca-4e74-9c7e-f9e9c5f511a9 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:17.538465 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60621fd6-2806-4485-915a-0447eaeeaf59 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:17.539421 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60621fd6-2806-4485-915a-0447eaeeaf59 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:17.546171 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-081f931c-1dca-4e74-9c7e-f9e9c5f511a9 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:17.555357 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-081f931c-1dca-4e74-9c7e-f9e9c5f511a9 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f" status: 200 len: 1567 microversion: 2.25 time: 1.229082 Jul 18 02:14:17.564532 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 720/1418] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:14:16 2022] GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f => generated 1567 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:14:17.587564 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-23c6ac5a-9a2f-4668-a039-7d0119d32800 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:17.588195 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-23c6ac5a-9a2f-4668-a039-7d0119d32800 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c8ba5e49-8aa4-4b43-9273-16be87705a48] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:17.627591 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-23c6ac5a-9a2f-4668-a039-7d0119d32800 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:17.635757 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-23c6ac5a-9a2f-4668-a039-7d0119d32800 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:17.637178 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-23c6ac5a-9a2f-4668-a039-7d0119d32800 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:17.637888 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-23c6ac5a-9a2f-4668-a039-7d0119d32800 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:17.699072 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60621fd6-2806-4485-915a-0447eaeeaf59 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:17.703726 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60621fd6-2806-4485-915a-0447eaeeaf59 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:17.704510 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-60621fd6-2806-4485-915a-0447eaeeaf59 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lazy-loading 'fault' on Instance uuid 6a9311f2-f5f3-49f0-831e-728291d16d09 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:14:18.012407 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-60621fd6-2806-4485-915a-0447eaeeaf59 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83428adc93d4dd9a3884659a73bd865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a94aaf6ca324e97aec2f6e982416f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:18.024276 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-60621fd6-2806-4485-915a-0447eaeeaf59 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] 10.222.0.57 "GET /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09" status: 200 len: 1321 microversion: 2.1 time: 0.771882 Jul 18 02:14:18.031347 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 699/1419] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:17 2022] GET /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09 => generated 1321 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:18.044524 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-33c7a5c3-de2d-4f99-a209-ef410b335b98 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a89dc550>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:18.201296 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-33c7a5c3-de2d-4f99-a209-ef410b335b98 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/9053bb1e-a3c0-4052-9d8d-7b964f899348" status: 200 len: 1455 microversion: 2.1 time: 0.165688 Jul 18 02:14:18.201932 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 700/1420] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:14:18 2022] GET /compute/v2.1/images/9053bb1e-a3c0-4052-9d8d-7b964f899348 => generated 1455 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:18.217631 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-f6478542-b5f8-4808-81fa-aad0ad6db50e req-f7747e09-f469-4717-9b3b-029fb29ba36c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d8e0c47-5276-4d24-9cb3-fb36bb9b6400", "name": "network-vif-deleted", "tag": "d2e3884d-a86d-4462-b786-c48742d72cd5"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:18.253521 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-f6478542-b5f8-4808-81fa-aad0ad6db50e req-f7747e09-f469-4717-9b3b-029fb29ba36c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:18.254744 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-f6478542-b5f8-4808-81fa-aad0ad6db50e req-f7747e09-f469-4717-9b3b-029fb29ba36c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:18.308461 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-f6478542-b5f8-4808-81fa-aad0ad6db50e req-f7747e09-f469-4717-9b3b-029fb29ba36c service nova] Creating event network-vif-deleted:d2e3884d-a86d-4462-b786-c48742d72cd5 for instance 2d8e0c47-5276-4d24-9cb3-fb36bb9b6400 on n-h1-465891-3 Jul 18 02:14:18.328034 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-f6478542-b5f8-4808-81fa-aad0ad6db50e req-f7747e09-f469-4717-9b3b-029fb29ba36c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124257 Jul 18 02:14:18.335783 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 701/1421] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:18.364177 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-016903b2-5d99-44d4-b380-bcab560abb60 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:18.368722 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-016903b2-5d99-44d4-b380-bcab560abb60 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 2d8e0c47-5276-4d24-9cb3-fb36bb9b6400] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:18.405343 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-016903b2-5d99-44d4-b380-bcab560abb60 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:18.406163 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-016903b2-5d99-44d4-b380-bcab560abb60 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:18.409402 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-016903b2-5d99-44d4-b380-bcab560abb60 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:18.410271 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-016903b2-5d99-44d4-b380-bcab560abb60 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:18.431452 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-23c6ac5a-9a2f-4668-a039-7d0119d32800 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:18.444874 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-23c6ac5a-9a2f-4668-a039-7d0119d32800 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c8ba5e49-8aa4-4b43-9273-16be87705a48" status: 200 len: 1319 microversion: 2.1 time: 0.878908 Jul 18 02:14:18.455987 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 721/1422] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:17 2022] GET /compute/v2.1/servers/c8ba5e49-8aa4-4b43-9273-16be87705a48 => generated 1319 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:18.466798 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:18.474327 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-e8078cf4-5ccc-46e6-9753-c4b92a8ec73d req-4c16d8cd-7547-424a-af3c-e17bb8d7c91e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a9311f2-f5f3-49f0-831e-728291d16d09", "name": "network-vif-deleted", "tag": "f691d4d0-5b03-4b49-81fe-72116c2da4cb"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:18.484034 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:18.489186 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-e8078cf4-5ccc-46e6-9753-c4b92a8ec73d req-4c16d8cd-7547-424a-af3c-e17bb8d7c91e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:18.489996 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-e8078cf4-5ccc-46e6-9753-c4b92a8ec73d req-4c16d8cd-7547-424a-af3c-e17bb8d7c91e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:18.518186 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-e8078cf4-5ccc-46e6-9753-c4b92a8ec73d req-4c16d8cd-7547-424a-af3c-e17bb8d7c91e service nova] Creating event network-vif-deleted:f691d4d0-5b03-4b49-81fe-72116c2da4cb for instance 6a9311f2-f5f3-49f0-831e-728291d16d09 on n-h1-465891-3 Jul 18 02:14:18.526678 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-e8078cf4-5ccc-46e6-9753-c4b92a8ec73d req-4c16d8cd-7547-424a-af3c-e17bb8d7c91e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068469 Jul 18 02:14:18.527820 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 722/1423] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:18.602523 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-92ed3caa-e46f-4358-8833-6360dca8b075 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:18.603256 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-92ed3caa-e46f-4358-8833-6360dca8b075 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 49764b86-41da-4c6d-b069-aaccf92ef89f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:18.622405 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-92ed3caa-e46f-4358-8833-6360dca8b075 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:18.623929 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-92ed3caa-e46f-4358-8833-6360dca8b075 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:18.625806 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-92ed3caa-e46f-4358-8833-6360dca8b075 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:18.626134 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-016903b2-5d99-44d4-b380-bcab560abb60 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:18.627436 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-92ed3caa-e46f-4358-8833-6360dca8b075 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:18.637920 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-016903b2-5d99-44d4-b380-bcab560abb60 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/2d8e0c47-5276-4d24-9cb3-fb36bb9b6400" status: 200 len: 1452 microversion: 2.1 time: 0.299638 Jul 18 02:14:18.643635 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 702/1424] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:18 2022] GET /compute/v2.1/servers/2d8e0c47-5276-4d24-9cb3-fb36bb9b6400 => generated 1452 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:19.066042 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e77d7e2f-2389-41c5-9635-6fbee3f18ee1 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:19.068533 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e77d7e2f-2389-41c5-9635-6fbee3f18ee1 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] [instance: 6a9311f2-f5f3-49f0-831e-728291d16d09] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:19.081385 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e77d7e2f-2389-41c5-9635-6fbee3f18ee1 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:19.085284 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e77d7e2f-2389-41c5-9635-6fbee3f18ee1 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:19.086541 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e77d7e2f-2389-41c5-9635-6fbee3f18ee1 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:19.090007 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e77d7e2f-2389-41c5-9635-6fbee3f18ee1 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:19.138442 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-92ed3caa-e46f-4358-8833-6360dca8b075 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:19.206028 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e77d7e2f-2389-41c5-9635-6fbee3f18ee1 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:19.208103 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e77d7e2f-2389-41c5-9635-6fbee3f18ee1 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:19.208731 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-e77d7e2f-2389-41c5-9635-6fbee3f18ee1 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lazy-loading 'fault' on Instance uuid 6a9311f2-f5f3-49f0-831e-728291d16d09 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:14:19.209945 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-92ed3caa-e46f-4358-8833-6360dca8b075 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:19.211859 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-92ed3caa-e46f-4358-8833-6360dca8b075 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:19.213551 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-92ed3caa-e46f-4358-8833-6360dca8b075 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f" status: 200 len: 1567 microversion: 2.25 time: 0.615698 Jul 18 02:14:19.230492 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 723/1425] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:14:18 2022] GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f => generated 1567 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:14:19.234978 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9e29e85e-1e5a-43e3-ab2e-b3d795e9ab39 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a8a4e9d0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:19.312828 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9e29e85e-1e5a-43e3-ab2e-b3d795e9ab39 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/9053bb1e-a3c0-4052-9d8d-7b964f899348" status: 200 len: 1455 microversion: 2.1 time: 0.082405 Jul 18 02:14:19.312828 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 724/1426] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:14:19 2022] GET /compute/v2.1/images/9053bb1e-a3c0-4052-9d8d-7b964f899348 => generated 1455 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:19.321560 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e77d7e2f-2389-41c5-9635-6fbee3f18ee1 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83428adc93d4dd9a3884659a73bd865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a94aaf6ca324e97aec2f6e982416f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:19.343595 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e77d7e2f-2389-41c5-9635-6fbee3f18ee1 tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] 10.222.0.57 "GET /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09" status: 200 len: 1321 microversion: 2.1 time: 0.281489 Jul 18 02:14:19.346232 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 703/1427] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:19 2022] GET /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09 => generated 1321 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:14:19.465420 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bd57070d-faa5-431e-8e04-47ba0df94921 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:19.466863 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bd57070d-faa5-431e-8e04-47ba0df94921 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c8ba5e49-8aa4-4b43-9273-16be87705a48] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:19.474226 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bd57070d-faa5-431e-8e04-47ba0df94921 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:19.474695 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bd57070d-faa5-431e-8e04-47ba0df94921 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:19.475502 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bd57070d-faa5-431e-8e04-47ba0df94921 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:19.476188 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bd57070d-faa5-431e-8e04-47ba0df94921 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:19.670422 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-faf35902-6d41-4e39-896e-c524082ff884 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:19.670925 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-faf35902-6d41-4e39-896e-c524082ff884 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 2d8e0c47-5276-4d24-9cb3-fb36bb9b6400] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:19.680555 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-faf35902-6d41-4e39-896e-c524082ff884 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:19.682410 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-faf35902-6d41-4e39-896e-c524082ff884 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:19.684081 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-faf35902-6d41-4e39-896e-c524082ff884 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:19.684721 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-faf35902-6d41-4e39-896e-c524082ff884 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:19.842884 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-faf35902-6d41-4e39-896e-c524082ff884 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:19.856858 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-faf35902-6d41-4e39-896e-c524082ff884 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/2d8e0c47-5276-4d24-9cb3-fb36bb9b6400" status: 200 len: 1452 microversion: 2.1 time: 0.190312 Jul 18 02:14:19.857932 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 704/1428] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:19 2022] GET /compute/v2.1/servers/2d8e0c47-5276-4d24-9cb3-fb36bb9b6400 => generated 1452 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:20.041506 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bd57070d-faa5-431e-8e04-47ba0df94921 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:20.050257 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bd57070d-faa5-431e-8e04-47ba0df94921 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c8ba5e49-8aa4-4b43-9273-16be87705a48" status: 200 len: 1319 microversion: 2.1 time: 0.590945 Jul 18 02:14:20.051178 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 725/1429] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:19 2022] GET /compute/v2.1/servers/c8ba5e49-8aa4-4b43-9273-16be87705a48 => generated 1319 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:20.241658 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9505a89b-9bd0-4e63-b37c-6a9bd14f3955 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:20.251649 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9505a89b-9bd0-4e63-b37c-6a9bd14f3955 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 49764b86-41da-4c6d-b069-aaccf92ef89f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:20.288304 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9505a89b-9bd0-4e63-b37c-6a9bd14f3955 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:20.288877 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9505a89b-9bd0-4e63-b37c-6a9bd14f3955 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:20.289743 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9505a89b-9bd0-4e63-b37c-6a9bd14f3955 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:20.296785 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9505a89b-9bd0-4e63-b37c-6a9bd14f3955 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:20.331519 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0cac36ab-7a6d-4a67-bf8f-ceaf21f013b3 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a876d0d0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:20.488254 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0cac36ab-7a6d-4a67-bf8f-ceaf21f013b3 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/9053bb1e-a3c0-4052-9d8d-7b964f899348" status: 200 len: 1464 microversion: 2.1 time: 0.155298 Jul 18 02:14:20.490521 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 726/1430] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:14:20 2022] GET /compute/v2.1/images/9053bb1e-a3c0-4052-9d8d-7b964f899348 => generated 1464 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:20.500621 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fd7dca46-f896-4674-8c23-af1085be89ee tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:20.501807 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fd7dca46-f896-4674-8c23-af1085be89ee tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] [instance: 6a9311f2-f5f3-49f0-831e-728291d16d09] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:20.516466 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd7dca46-f896-4674-8c23-af1085be89ee tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:20.518009 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd7dca46-f896-4674-8c23-af1085be89ee tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:20.519887 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd7dca46-f896-4674-8c23-af1085be89ee tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:20.520988 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd7dca46-f896-4674-8c23-af1085be89ee tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:20.570646 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-fd7dca46-f896-4674-8c23-af1085be89ee tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] HTTP exception thrown: Instance 6a9311f2-f5f3-49f0-831e-728291d16d09 could not be found. Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fd7dca46-f896-4674-8c23-af1085be89ee tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Request method failure captured: Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09 HTTP/1.1 Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MGTGvtt_IEOf9uBOa0rn3DuCRCY0-R0WX9y8-LDCmVVy_XQ_NqlZenh4yE4xW6cr8CjfmzKHIY8E6j2QQ67LgHwFHRAJRt-fTfeUPVmSfiZoTgU5XLXYI8ER0gh6EQq8vzHpW9cw-4F19UXXFKa8SJW6umz8lZFTbXmx2f7ZJhPVYQ Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 3a94aaf6ca324e97aec2f6e982416f9b Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-819607396 Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3a94aaf6ca324e97aec2f6e982416f9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a94aaf6ca324e97aec2f6e982416f9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a94aaf6ca324e97aec2f6e982416f9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3a94aaf6ca324e97aec2f6e982416f9b"}]}] Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-819607396 Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 3a94aaf6ca324e97aec2f6e982416f9b Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-819607396 Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: c83428adc93d4dd9a3884659a73bd865 Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 6a9311f2-f5f3-49f0-831e-728291d16d09 could not be found. Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '6a9311f2-f5f3-49f0-831e-728291d16d09'} Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a9311f2-f5f3-49f0-831e-728291d16d09 could not be found. Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a9311f2-f5f3-49f0-831e-728291d16d09 could not be found. Jul 18 02:14:20.575086 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:20.582932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:20.582932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:20.582932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:20.582932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:20.582932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:20.582932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:14:20.582932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:14:20.582932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a9311f2-f5f3-49f0-831e-728291d16d09 could not be found. Jul 18 02:14:20.582932 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:20.582932 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fd7dca46-f896-4674-8c23-af1085be89ee tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] Returning 404 to user: Instance 6a9311f2-f5f3-49f0-831e-728291d16d09 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:14:20.582932 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fd7dca46-f896-4674-8c23-af1085be89ee tempest-FloatingIPsAssociationNegativeTestJSON-819607396 tempest-FloatingIPsAssociationNegativeTestJSON-819607396-project] 10.222.0.57 "GET /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09" status: 404 len: 111 microversion: 2.1 time: 0.085231 Jul 18 02:14:20.584972 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 727/1431] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:20 2022] GET /compute/v2.1/servers/6a9311f2-f5f3-49f0-831e-728291d16d09 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:14:20.595304 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-64b49fbb-a36c-4a9c-9695-f00e7cd0d57e tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a8a4c670>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:20.710470 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-64b49fbb-a36c-4a9c-9695-f00e7cd0d57e tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/9053bb1e-a3c0-4052-9d8d-7b964f899348" status: 200 len: 1464 microversion: 2.1 time: 0.123080 Jul 18 02:14:20.715173 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 728/1432] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:14:20 2022] GET /compute/v2.1/images/9053bb1e-a3c0-4052-9d8d-7b964f899348 => generated 1464 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:20.734877 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4791d2be-8dd7-4160-801d-f22004215eb6 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:20.736549 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4791d2be-8dd7-4160-801d-f22004215eb6 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] [instance: 32e81b5d-a507-4d47-b76e-699091d0e5bd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:20.749575 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4791d2be-8dd7-4160-801d-f22004215eb6 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:20.749959 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9505a89b-9bd0-4e63-b37c-6a9bd14f3955 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:20.750639 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4791d2be-8dd7-4160-801d-f22004215eb6 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:20.752264 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4791d2be-8dd7-4160-801d-f22004215eb6 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:20.753268 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4791d2be-8dd7-4160-801d-f22004215eb6 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:20.758786 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9505a89b-9bd0-4e63-b37c-6a9bd14f3955 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:20.760333 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9505a89b-9bd0-4e63-b37c-6a9bd14f3955 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:20.762224 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9505a89b-9bd0-4e63-b37c-6a9bd14f3955 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f" status: 200 len: 1567 microversion: 2.25 time: 0.533060 Jul 18 02:14:20.773904 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 705/1433] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:14:20 2022] GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f => generated 1567 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:14:20.888980 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a1b0a490-9b7a-404a-8e96-f0d2057f6c6c tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:20.890182 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a1b0a490-9b7a-404a-8e96-f0d2057f6c6c tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 2d8e0c47-5276-4d24-9cb3-fb36bb9b6400] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:20.903227 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a1b0a490-9b7a-404a-8e96-f0d2057f6c6c tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:20.904127 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a1b0a490-9b7a-404a-8e96-f0d2057f6c6c tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:20.905640 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a1b0a490-9b7a-404a-8e96-f0d2057f6c6c tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:20.906917 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a1b0a490-9b7a-404a-8e96-f0d2057f6c6c tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:21.005302 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a1b0a490-9b7a-404a-8e96-f0d2057f6c6c tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:21.006310 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a1b0a490-9b7a-404a-8e96-f0d2057f6c6c tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:21.007105 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-a1b0a490-9b7a-404a-8e96-f0d2057f6c6c tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lazy-loading 'fault' on Instance uuid 2d8e0c47-5276-4d24-9cb3-fb36bb9b6400 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:14:21.216409 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a1b0a490-9b7a-404a-8e96-f0d2057f6c6c tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686fc833d964d88a022fae2932b5727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5b35052cd4a71a8254d01112f0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:21.244312 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a1b0a490-9b7a-404a-8e96-f0d2057f6c6c tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/2d8e0c47-5276-4d24-9cb3-fb36bb9b6400" status: 200 len: 1298 microversion: 2.1 time: 0.364187 Jul 18 02:14:21.248451 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 706/1434] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:20 2022] GET /compute/v2.1/servers/2d8e0c47-5276-4d24-9cb3-fb36bb9b6400 => generated 1298 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:14:21.254038 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f4694697-5dda-43c8-a394-dece6a384d3f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:21.255007 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f4694697-5dda-43c8-a394-dece6a384d3f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c8ba5e49-8aa4-4b43-9273-16be87705a48] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:21.263766 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f4694697-5dda-43c8-a394-dece6a384d3f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:21.265406 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f4694697-5dda-43c8-a394-dece6a384d3f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:21.273937 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f4694697-5dda-43c8-a394-dece6a384d3f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:21.274887 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f4694697-5dda-43c8-a394-dece6a384d3f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:21.431397 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4791d2be-8dd7-4160-801d-f22004215eb6 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a9dd4e239c4d73bdde1ced9cb90b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5d1b19c84a4a9fa4595a5c84f4555c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:21.446419 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4791d2be-8dd7-4160-801d-f22004215eb6 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd" status: 200 len: 1468 microversion: 2.1 time: 0.719483 Jul 18 02:14:21.452089 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 729/1435] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:20 2022] GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd => generated 1468 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:21.475324 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-044b9d42-14a1-4020-ba8f-81fdff108a5e tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-785847903"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:21.485407 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-044b9d42-14a1-4020-ba8f-81fdff108a5e tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] [instance: 697075ff-db42-4729-8faf-2c2935d72630] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:21.497046 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-044b9d42-14a1-4020-ba8f-81fdff108a5e tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:21.500666 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-044b9d42-14a1-4020-ba8f-81fdff108a5e tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:21.503436 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-044b9d42-14a1-4020-ba8f-81fdff108a5e tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:21.504333 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-044b9d42-14a1-4020-ba8f-81fdff108a5e tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:21.822305 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f4694697-5dda-43c8-a394-dece6a384d3f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:21.832603 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f4694697-5dda-43c8-a394-dece6a384d3f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c8ba5e49-8aa4-4b43-9273-16be87705a48" status: 200 len: 1468 microversion: 2.1 time: 0.582526 Jul 18 02:14:21.845846 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 707/1436] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:21 2022] GET /compute/v2.1/servers/c8ba5e49-8aa4-4b43-9273-16be87705a48 => generated 1468 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:21.863576 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-609c8b54-a36e-4694-9022-dbe26ea31bf4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:21.873536 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-609c8b54-a36e-4694-9022-dbe26ea31bf4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 49764b86-41da-4c6d-b069-aaccf92ef89f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:21.880953 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-609c8b54-a36e-4694-9022-dbe26ea31bf4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:21.883069 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-609c8b54-a36e-4694-9022-dbe26ea31bf4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:21.886400 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-609c8b54-a36e-4694-9022-dbe26ea31bf4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:21.887342 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-609c8b54-a36e-4694-9022-dbe26ea31bf4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:21.951999 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-044b9d42-14a1-4020-ba8f-81fdff108a5e tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "POST /compute/v2.1/servers/697075ff-db42-4729-8faf-2c2935d72630/action" status: 202 len: 0 microversion: 2.1 time: 0.487181 Jul 18 02:14:21.952815 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 730/1437] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:14:21 2022] POST /compute/v2.1/servers/697075ff-db42-4729-8faf-2c2935d72630/action => generated 0 bytes in 490 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 18 02:14:21.975311 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9eb81468-e985-4688-b87f-e01e24f5ae8d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:21.976187 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9eb81468-e985-4688-b87f-e01e24f5ae8d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 465df230-ba3a-430a-935d-dc0a7fb83462] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:21.987907 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9eb81468-e985-4688-b87f-e01e24f5ae8d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:21.988364 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9eb81468-e985-4688-b87f-e01e24f5ae8d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:21.989388 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9eb81468-e985-4688-b87f-e01e24f5ae8d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:21.989854 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9eb81468-e985-4688-b87f-e01e24f5ae8d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:22.349682 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-609c8b54-a36e-4694-9022-dbe26ea31bf4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:22.363421 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-609c8b54-a36e-4694-9022-dbe26ea31bf4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:22.367650 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-609c8b54-a36e-4694-9022-dbe26ea31bf4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:22.371900 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-609c8b54-a36e-4694-9022-dbe26ea31bf4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f" status: 200 len: 1567 microversion: 2.25 time: 0.514817 Jul 18 02:14:22.382571 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 708/1438] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:14:21 2022] GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f => generated 1567 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:14:22.388330 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-032cce23-bfa7-4c0c-823d-48a02ae2c589 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a89dc550>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:22.435324 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9eb81468-e985-4688-b87f-e01e24f5ae8d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:22.452936 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9eb81468-e985-4688-b87f-e01e24f5ae8d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/465df230-ba3a-430a-935d-dc0a7fb83462" status: 200 len: 1319 microversion: 2.1 time: 0.492772 Jul 18 02:14:22.453822 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 731/1439] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:21 2022] GET /compute/v2.1/servers/465df230-ba3a-430a-935d-dc0a7fb83462 => generated 1319 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:22.459694 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-be1361f4-500f-4bc0-be93-0862fc7f19f1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:22.460957 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-be1361f4-500f-4bc0-be93-0862fc7f19f1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 2d8e0c47-5276-4d24-9cb3-fb36bb9b6400] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:22.469272 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-be1361f4-500f-4bc0-be93-0862fc7f19f1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:22.470324 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-be1361f4-500f-4bc0-be93-0862fc7f19f1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:22.471154 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-be1361f4-500f-4bc0-be93-0862fc7f19f1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:22.471630 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-be1361f4-500f-4bc0-be93-0862fc7f19f1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:22.477508 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-032cce23-bfa7-4c0c-823d-48a02ae2c589 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b" status: 200 len: 1454 microversion: 2.1 time: 0.092391 Jul 18 02:14:22.478942 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 709/1440] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:14:22 2022] GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b => generated 1454 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:22.489064 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-be1361f4-500f-4bc0-be93-0862fc7f19f1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] HTTP exception thrown: Instance 2d8e0c47-5276-4d24-9cb3-fb36bb9b6400 could not be found. Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-be1361f4-500f-4bc0-be93-0862fc7f19f1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Request method failure captured: Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/2d8e0c47-5276-4d24-9cb3-fb36bb9b6400 HTTP/1.1 Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MCzvUiLjVPa9k5iRmWWr1F2ZyXX6RhQj-KxTNpVjPTd256MdgV8yuDLe9WLMkK_v1nEuuEud4Xy4MbeuUSjptygmIUcMLCmISLnRcYLgmO2plKsp9LFggv3C6frOpPwcaFoHgcExXMgtK5PyovbnA7Q594UMMNgAWnVF4ge4OjZi9A Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 10c5b35052cd4a71a8254d01112f0496 Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ImagesTestJSON-61947256 Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_10c5b35052cd4a71a8254d01112f0496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/10c5b35052cd4a71a8254d01112f0496"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/10c5b35052cd4a71a8254d01112f0496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/10c5b35052cd4a71a8254d01112f0496"}]}] Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ImagesTestJSON-61947256 Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 10c5b35052cd4a71a8254d01112f0496 Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ImagesTestJSON-61947256 Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ImagesTestJSON-61947256-project Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: a686fc833d964d88a022fae2932b5727 Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ImagesTestJSON-61947256-project Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 2d8e0c47-5276-4d24-9cb3-fb36bb9b6400 could not be found. Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '2d8e0c47-5276-4d24-9cb3-fb36bb9b6400'} Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d8e0c47-5276-4d24-9cb3-fb36bb9b6400 could not be found. Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d8e0c47-5276-4d24-9cb3-fb36bb9b6400 could not be found. Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.491211 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:22.502086 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:22.502086 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:22.502086 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:14:22.502086 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:14:22.502086 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d8e0c47-5276-4d24-9cb3-fb36bb9b6400 could not be found. Jul 18 02:14:22.502086 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.502086 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-be1361f4-500f-4bc0-be93-0862fc7f19f1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Returning 404 to user: Instance 2d8e0c47-5276-4d24-9cb3-fb36bb9b6400 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:14:22.502086 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-be1361f4-500f-4bc0-be93-0862fc7f19f1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/2d8e0c47-5276-4d24-9cb3-fb36bb9b6400" status: 404 len: 111 microversion: 2.1 time: 0.037874 Jul 18 02:14:22.502086 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 732/1441] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:22 2022] GET /compute/v2.1/servers/2d8e0c47-5276-4d24-9cb3-fb36bb9b6400 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:14:22.513636 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b6f3888f-f0a1-4679-abb4-b9a00f631303 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a89711f0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:22.563511 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-b6f3888f-f0a1-4679-abb4-b9a00f631303 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] HTTP exception thrown: Image not found. Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b6f3888f-f0a1-4679-abb4-b9a00f631303 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Request method failure captured: Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170 HTTP/1.1 Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MCzvUiLjVPa9k5iRmWWr1F2ZyXX6RhQj-KxTNpVjPTd256MdgV8yuDLe9WLMkK_v1nEuuEud4Xy4MbeuUSjptygmIUcMLCmISLnRcYLgmO2plKsp9LFggv3C6frOpPwcaFoHgcExXMgtK5PyovbnA7Q594UMMNgAWnVF4ge4OjZi9A Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 10c5b35052cd4a71a8254d01112f0496 Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ImagesTestJSON-61947256 Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_10c5b35052cd4a71a8254d01112f0496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/10c5b35052cd4a71a8254d01112f0496"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/10c5b35052cd4a71a8254d01112f0496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/10c5b35052cd4a71a8254d01112f0496"}]}] Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ImagesTestJSON-61947256 Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 10c5b35052cd4a71a8254d01112f0496 Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ImagesTestJSON-61947256 Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ImagesTestJSON-61947256-project Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: a686fc833d964d88a022fae2932b5727 Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ImagesTestJSON-61947256-project Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: exception: Image not found. Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '23307ff4-5642-4ea9-bb24-10a1a475a170'} Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 23307ff4-5642-4ea9-bb24-10a1a475a170 to delete Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 23307ff4-5642-4ea9-bb24-10a1a475a170 could not be found. Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.571240 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:22.580689 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:22.580689 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:22.580689 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:14:22.580689 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:14:22.580689 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:14:22.580689 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:14:22.580689 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:14:22.580689 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:14:22.580689 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 18 02:14:22.580689 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 02:14:22.580689 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:14:22.580689 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.580689 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:22.580689 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.580689 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:22.580689 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:22.580689 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:22.580689 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:14:22.580689 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:14:22.580689 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:14:22.580689 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.587638 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b6f3888f-f0a1-4679-abb4-b9a00f631303 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Returning 404 to user: Image not found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:14:22.587638 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b6f3888f-f0a1-4679-abb4-b9a00f631303 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "DELETE /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170" status: 404 len: 62 microversion: 2.1 time: 0.078460 Jul 18 02:14:22.588846 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 710/1442] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:22 2022] DELETE /compute/v2.1/images/23307ff4-5642-4ea9-bb24-10a1a475a170 => generated 62 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:14:22.603590 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-33fbd048-c3ef-46ac-85a0-a41a50dae49a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:22.604899 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-33fbd048-c3ef-46ac-85a0-a41a50dae49a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 1df099cb-c253-4dd4-96a0-0652047390d8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:22.618378 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-33fbd048-c3ef-46ac-85a0-a41a50dae49a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:22.619197 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-33fbd048-c3ef-46ac-85a0-a41a50dae49a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:22.622280 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-33fbd048-c3ef-46ac-85a0-a41a50dae49a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:22.623139 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-33fbd048-c3ef-46ac-85a0-a41a50dae49a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:22.654462 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-33fbd048-c3ef-46ac-85a0-a41a50dae49a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] HTTP exception thrown: Instance 1df099cb-c253-4dd4-96a0-0652047390d8 could not be found. Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-33fbd048-c3ef-46ac-85a0-a41a50dae49a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Request method failure captured: Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/servers/1df099cb-c253-4dd4-96a0-0652047390d8 HTTP/1.1 Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MCzvUiLjVPa9k5iRmWWr1F2ZyXX6RhQj-KxTNpVjPTd256MdgV8yuDLe9WLMkK_v1nEuuEud4Xy4MbeuUSjptygmIUcMLCmISLnRcYLgmO2plKsp9LFggv3C6frOpPwcaFoHgcExXMgtK5PyovbnA7Q594UMMNgAWnVF4ge4OjZi9A Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 10c5b35052cd4a71a8254d01112f0496 Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ImagesTestJSON-61947256 Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_10c5b35052cd4a71a8254d01112f0496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/10c5b35052cd4a71a8254d01112f0496"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/10c5b35052cd4a71a8254d01112f0496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/10c5b35052cd4a71a8254d01112f0496"}]}] Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ImagesTestJSON-61947256 Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 10c5b35052cd4a71a8254d01112f0496 Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ImagesTestJSON-61947256 Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ImagesTestJSON-61947256-project Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: a686fc833d964d88a022fae2932b5727 Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ImagesTestJSON-61947256-project Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 1df099cb-c253-4dd4-96a0-0652047390d8 could not be found. Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '1df099cb-c253-4dd4-96a0-0652047390d8'} Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1df099cb-c253-4dd4-96a0-0652047390d8 could not be found. Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1df099cb-c253-4dd4-96a0-0652047390d8 could not be found. Jul 18 02:14:22.657818 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.662467 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:22.662467 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.662467 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:22.662467 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:22.662467 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:22.662467 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:14:22.662467 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:14:22.662467 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1df099cb-c253-4dd4-96a0-0652047390d8 could not be found. Jul 18 02:14:22.662467 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.662467 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-33fbd048-c3ef-46ac-85a0-a41a50dae49a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Returning 404 to user: Instance 1df099cb-c253-4dd4-96a0-0652047390d8 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:14:22.662467 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-33fbd048-c3ef-46ac-85a0-a41a50dae49a tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "DELETE /compute/v2.1/servers/1df099cb-c253-4dd4-96a0-0652047390d8" status: 404 len: 111 microversion: 2.1 time: 0.064017 Jul 18 02:14:22.662467 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 733/1443] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:14:22 2022] DELETE /compute/v2.1/servers/1df099cb-c253-4dd4-96a0-0652047390d8 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:14:22.672874 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f4a6f62d-81b8-4f6e-9a72-fd5e56636302 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:22.673958 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f4a6f62d-81b8-4f6e-9a72-fd5e56636302 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 1df099cb-c253-4dd4-96a0-0652047390d8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:22.684195 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f4a6f62d-81b8-4f6e-9a72-fd5e56636302 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:22.684195 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f4a6f62d-81b8-4f6e-9a72-fd5e56636302 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:22.686126 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f4a6f62d-81b8-4f6e-9a72-fd5e56636302 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:22.686584 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f4a6f62d-81b8-4f6e-9a72-fd5e56636302 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:22.711886 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-f4a6f62d-81b8-4f6e-9a72-fd5e56636302 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] HTTP exception thrown: Instance 1df099cb-c253-4dd4-96a0-0652047390d8 could not be found. Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f4a6f62d-81b8-4f6e-9a72-fd5e56636302 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Request method failure captured: Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/1df099cb-c253-4dd4-96a0-0652047390d8 HTTP/1.1 Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MCzvUiLjVPa9k5iRmWWr1F2ZyXX6RhQj-KxTNpVjPTd256MdgV8yuDLe9WLMkK_v1nEuuEud4Xy4MbeuUSjptygmIUcMLCmISLnRcYLgmO2plKsp9LFggv3C6frOpPwcaFoHgcExXMgtK5PyovbnA7Q594UMMNgAWnVF4ge4OjZi9A Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 10c5b35052cd4a71a8254d01112f0496 Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ImagesTestJSON-61947256 Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_10c5b35052cd4a71a8254d01112f0496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/10c5b35052cd4a71a8254d01112f0496"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/10c5b35052cd4a71a8254d01112f0496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/10c5b35052cd4a71a8254d01112f0496"}]}] Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ImagesTestJSON-61947256 Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 10c5b35052cd4a71a8254d01112f0496 Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ImagesTestJSON-61947256 Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ImagesTestJSON-61947256-project Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: a686fc833d964d88a022fae2932b5727 Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ImagesTestJSON-61947256-project Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 1df099cb-c253-4dd4-96a0-0652047390d8 could not be found. Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '1df099cb-c253-4dd4-96a0-0652047390d8'} Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1df099cb-c253-4dd4-96a0-0652047390d8 could not be found. Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1df099cb-c253-4dd4-96a0-0652047390d8 could not be found. Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.716575 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:22.721189 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:22.721189 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:22.721189 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:14:22.721189 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:14:22.721189 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1df099cb-c253-4dd4-96a0-0652047390d8 could not be found. Jul 18 02:14:22.721189 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.721189 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f4a6f62d-81b8-4f6e-9a72-fd5e56636302 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Returning 404 to user: Instance 1df099cb-c253-4dd4-96a0-0652047390d8 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:14:22.721189 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f4a6f62d-81b8-4f6e-9a72-fd5e56636302 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/1df099cb-c253-4dd4-96a0-0652047390d8" status: 404 len: 111 microversion: 2.1 time: 0.052370 Jul 18 02:14:22.726866 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 711/1444] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:22 2022] GET /compute/v2.1/servers/1df099cb-c253-4dd4-96a0-0652047390d8 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:14:22.737364 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b484aa07-8419-4f4b-a1ca-abce974ccd80 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a888af70>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:22.786464 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-b484aa07-8419-4f4b-a1ca-abce974ccd80 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] HTTP exception thrown: Image not found. Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b484aa07-8419-4f4b-a1ca-abce974ccd80 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Request method failure captured: Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/images/48443bda-c7c8-463b-b521-129df053a409 HTTP/1.1 Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MCzvUiLjVPa9k5iRmWWr1F2ZyXX6RhQj-KxTNpVjPTd256MdgV8yuDLe9WLMkK_v1nEuuEud4Xy4MbeuUSjptygmIUcMLCmISLnRcYLgmO2plKsp9LFggv3C6frOpPwcaFoHgcExXMgtK5PyovbnA7Q594UMMNgAWnVF4ge4OjZi9A Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 10c5b35052cd4a71a8254d01112f0496 Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ImagesTestJSON-61947256 Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_10c5b35052cd4a71a8254d01112f0496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/10c5b35052cd4a71a8254d01112f0496"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/10c5b35052cd4a71a8254d01112f0496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/10c5b35052cd4a71a8254d01112f0496"}]}] Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ImagesTestJSON-61947256 Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 10c5b35052cd4a71a8254d01112f0496 Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ImagesTestJSON-61947256 Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ImagesTestJSON-61947256-project Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: a686fc833d964d88a022fae2932b5727 Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ImagesTestJSON-61947256-project Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: exception: Image not found. Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '48443bda-c7c8-463b-b521-129df053a409'} Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 48443bda-c7c8-463b-b521-129df053a409 to delete Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 48443bda-c7c8-463b-b521-129df053a409 could not be found. Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.790499 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:22.796164 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:22.796164 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:22.796164 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:14:22.796164 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:14:22.796164 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:14:22.796164 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:14:22.796164 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:14:22.796164 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:14:22.796164 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 18 02:14:22.796164 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 02:14:22.796164 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:14:22.796164 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.796164 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:22.796164 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.796164 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:22.796164 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:22.796164 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:22.796164 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:14:22.796164 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:14:22.796164 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:14:22.796164 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.796164 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b484aa07-8419-4f4b-a1ca-abce974ccd80 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Returning 404 to user: Image not found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:14:22.796164 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b484aa07-8419-4f4b-a1ca-abce974ccd80 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "DELETE /compute/v2.1/images/48443bda-c7c8-463b-b521-129df053a409" status: 404 len: 62 microversion: 2.1 time: 0.065550 Jul 18 02:14:22.796164 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 734/1445] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:22 2022] DELETE /compute/v2.1/images/48443bda-c7c8-463b-b521-129df053a409 => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:14:22.806222 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0647c885-28f9-4b2c-aa61-839b8951640d tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:22.807331 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0647c885-28f9-4b2c-aa61-839b8951640d tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 25dfb6dd-6d5a-4399-a348-0a162ca907ef] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:22.814826 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0647c885-28f9-4b2c-aa61-839b8951640d tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:22.815599 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0647c885-28f9-4b2c-aa61-839b8951640d tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:22.816693 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0647c885-28f9-4b2c-aa61-839b8951640d tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:22.817384 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0647c885-28f9-4b2c-aa61-839b8951640d tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:22.843295 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-0647c885-28f9-4b2c-aa61-839b8951640d tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] HTTP exception thrown: Instance 25dfb6dd-6d5a-4399-a348-0a162ca907ef could not be found. Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0647c885-28f9-4b2c-aa61-839b8951640d tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Request method failure captured: Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef HTTP/1.1 Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MCzvUiLjVPa9k5iRmWWr1F2ZyXX6RhQj-KxTNpVjPTd256MdgV8yuDLe9WLMkK_v1nEuuEud4Xy4MbeuUSjptygmIUcMLCmISLnRcYLgmO2plKsp9LFggv3C6frOpPwcaFoHgcExXMgtK5PyovbnA7Q594UMMNgAWnVF4ge4OjZi9A Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 10c5b35052cd4a71a8254d01112f0496 Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ImagesTestJSON-61947256 Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_10c5b35052cd4a71a8254d01112f0496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/10c5b35052cd4a71a8254d01112f0496"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/10c5b35052cd4a71a8254d01112f0496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/10c5b35052cd4a71a8254d01112f0496"}]}] Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ImagesTestJSON-61947256 Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 10c5b35052cd4a71a8254d01112f0496 Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ImagesTestJSON-61947256 Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ImagesTestJSON-61947256-project Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: a686fc833d964d88a022fae2932b5727 Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ImagesTestJSON-61947256-project Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 25dfb6dd-6d5a-4399-a348-0a162ca907ef could not be found. Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '25dfb6dd-6d5a-4399-a348-0a162ca907ef'} Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25dfb6dd-6d5a-4399-a348-0a162ca907ef could not be found. Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25dfb6dd-6d5a-4399-a348-0a162ca907ef could not be found. Jul 18 02:14:22.846567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.851073 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:22.851073 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.851073 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:22.851073 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:22.851073 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:22.851073 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:14:22.851073 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:14:22.851073 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25dfb6dd-6d5a-4399-a348-0a162ca907ef could not be found. Jul 18 02:14:22.851073 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.851073 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0647c885-28f9-4b2c-aa61-839b8951640d tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Returning 404 to user: Instance 25dfb6dd-6d5a-4399-a348-0a162ca907ef could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:14:22.851073 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0647c885-28f9-4b2c-aa61-839b8951640d tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "DELETE /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef" status: 404 len: 111 microversion: 2.1 time: 0.046257 Jul 18 02:14:22.853871 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 712/1446] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:14:22 2022] DELETE /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:14:22.861473 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-be755ce5-0778-41d5-aa03-10e78d88d45d tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:22.862923 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-be755ce5-0778-41d5-aa03-10e78d88d45d tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: 25dfb6dd-6d5a-4399-a348-0a162ca907ef] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:22.874107 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-be755ce5-0778-41d5-aa03-10e78d88d45d tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:22.874714 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-be755ce5-0778-41d5-aa03-10e78d88d45d tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:22.875624 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-be755ce5-0778-41d5-aa03-10e78d88d45d tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:22.876170 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-be755ce5-0778-41d5-aa03-10e78d88d45d tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:22.900179 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-be755ce5-0778-41d5-aa03-10e78d88d45d tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] HTTP exception thrown: Instance 25dfb6dd-6d5a-4399-a348-0a162ca907ef could not be found. Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-be755ce5-0778-41d5-aa03-10e78d88d45d tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Request method failure captured: Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef HTTP/1.1 Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MCzvUiLjVPa9k5iRmWWr1F2ZyXX6RhQj-KxTNpVjPTd256MdgV8yuDLe9WLMkK_v1nEuuEud4Xy4MbeuUSjptygmIUcMLCmISLnRcYLgmO2plKsp9LFggv3C6frOpPwcaFoHgcExXMgtK5PyovbnA7Q594UMMNgAWnVF4ge4OjZi9A Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 10c5b35052cd4a71a8254d01112f0496 Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ImagesTestJSON-61947256 Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_10c5b35052cd4a71a8254d01112f0496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/10c5b35052cd4a71a8254d01112f0496"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/10c5b35052cd4a71a8254d01112f0496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/10c5b35052cd4a71a8254d01112f0496"}]}] Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ImagesTestJSON-61947256 Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 10c5b35052cd4a71a8254d01112f0496 Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ImagesTestJSON-61947256 Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ImagesTestJSON-61947256-project Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: a686fc833d964d88a022fae2932b5727 Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ImagesTestJSON-61947256-project Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 25dfb6dd-6d5a-4399-a348-0a162ca907ef could not be found. Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '25dfb6dd-6d5a-4399-a348-0a162ca907ef'} Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25dfb6dd-6d5a-4399-a348-0a162ca907ef could not be found. Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25dfb6dd-6d5a-4399-a348-0a162ca907ef could not be found. Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.902445 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:22.915739 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:22.915739 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:22.915739 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:14:22.915739 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:14:22.915739 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25dfb6dd-6d5a-4399-a348-0a162ca907ef could not be found. Jul 18 02:14:22.915739 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.915739 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-be755ce5-0778-41d5-aa03-10e78d88d45d tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Returning 404 to user: Instance 25dfb6dd-6d5a-4399-a348-0a162ca907ef could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:14:22.915739 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-be755ce5-0778-41d5-aa03-10e78d88d45d tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef" status: 404 len: 111 microversion: 2.1 time: 0.048206 Jul 18 02:14:22.915739 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 735/1447] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:22 2022] GET /compute/v2.1/servers/25dfb6dd-6d5a-4399-a348-0a162ca907ef => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:14:22.920624 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6ce3f8e5-5030-4037-bb40-0bc728aeb2f1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '.version_select at 0x7ff4a8831dc0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:22.955882 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-6ce3f8e5-5030-4037-bb40-0bc728aeb2f1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] HTTP exception thrown: Image not found. Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6ce3f8e5-5030-4037-bb40-0bc728aeb2f1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Request method failure captured: Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a HTTP/1.1 Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MCzvUiLjVPa9k5iRmWWr1F2ZyXX6RhQj-KxTNpVjPTd256MdgV8yuDLe9WLMkK_v1nEuuEud4Xy4MbeuUSjptygmIUcMLCmISLnRcYLgmO2plKsp9LFggv3C6frOpPwcaFoHgcExXMgtK5PyovbnA7Q594UMMNgAWnVF4ge4OjZi9A Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 10c5b35052cd4a71a8254d01112f0496 Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ImagesTestJSON-61947256 Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_10c5b35052cd4a71a8254d01112f0496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/10c5b35052cd4a71a8254d01112f0496"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/10c5b35052cd4a71a8254d01112f0496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/10c5b35052cd4a71a8254d01112f0496"}]}] Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ImagesTestJSON-61947256 Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 10c5b35052cd4a71a8254d01112f0496 Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ImagesTestJSON-61947256 Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ImagesTestJSON-61947256-project Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: a686fc833d964d88a022fae2932b5727 Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ImagesTestJSON-61947256-project Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: exception: Image not found. Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '9cfba505-d64d-40d0-a3fa-65964601495a'} Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9cfba505-d64d-40d0-a3fa-65964601495a to delete Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9cfba505-d64d-40d0-a3fa-65964601495a could not be found. Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.957665 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:22.967812 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:22.967812 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:22.967812 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:14:22.967812 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:14:22.967812 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:14:22.967812 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:14:22.967812 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:14:22.967812 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:14:22.967812 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 18 02:14:22.967812 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 02:14:22.967812 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:14:22.967812 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.967812 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:22.967812 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.967812 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:22.967812 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:22.967812 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:22.967812 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:14:22.967812 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:14:22.967812 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:14:22.967812 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.967812 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6ce3f8e5-5030-4037-bb40-0bc728aeb2f1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Returning 404 to user: Image not found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:14:22.967812 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6ce3f8e5-5030-4037-bb40-0bc728aeb2f1 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "DELETE /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a" status: 404 len: 62 microversion: 2.1 time: 0.046903 Jul 18 02:14:22.967812 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 713/1448] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:22 2022] DELETE /compute/v2.1/images/9cfba505-d64d-40d0-a3fa-65964601495a => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:14:22.973663 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cb1fc256-03eb-4fcd-9fae-16506c1de3e8 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:22.973663 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cb1fc256-03eb-4fcd-9fae-16506c1de3e8 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: d8aad28a-a3d8-48d3-8fc7-50d65ab4e768] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:22.985828 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cb1fc256-03eb-4fcd-9fae-16506c1de3e8 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:22.986288 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cb1fc256-03eb-4fcd-9fae-16506c1de3e8 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:22.987395 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cb1fc256-03eb-4fcd-9fae-16506c1de3e8 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:22.988021 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cb1fc256-03eb-4fcd-9fae-16506c1de3e8 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:23.009205 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-cb1fc256-03eb-4fcd-9fae-16506c1de3e8 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] HTTP exception thrown: Instance d8aad28a-a3d8-48d3-8fc7-50d65ab4e768 could not be found. Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cb1fc256-03eb-4fcd-9fae-16506c1de3e8 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Request method failure captured: Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768 HTTP/1.1 Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MCzvUiLjVPa9k5iRmWWr1F2ZyXX6RhQj-KxTNpVjPTd256MdgV8yuDLe9WLMkK_v1nEuuEud4Xy4MbeuUSjptygmIUcMLCmISLnRcYLgmO2plKsp9LFggv3C6frOpPwcaFoHgcExXMgtK5PyovbnA7Q594UMMNgAWnVF4ge4OjZi9A Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 10c5b35052cd4a71a8254d01112f0496 Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ImagesTestJSON-61947256 Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_10c5b35052cd4a71a8254d01112f0496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/10c5b35052cd4a71a8254d01112f0496"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/10c5b35052cd4a71a8254d01112f0496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/10c5b35052cd4a71a8254d01112f0496"}]}] Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ImagesTestJSON-61947256 Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 10c5b35052cd4a71a8254d01112f0496 Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ImagesTestJSON-61947256 Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ImagesTestJSON-61947256-project Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: a686fc833d964d88a022fae2932b5727 Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ImagesTestJSON-61947256-project Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance d8aad28a-a3d8-48d3-8fc7-50d65ab4e768 could not be found. Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'd8aad28a-a3d8-48d3-8fc7-50d65ab4e768'} Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8aad28a-a3d8-48d3-8fc7-50d65ab4e768 could not be found. Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8aad28a-a3d8-48d3-8fc7-50d65ab4e768 could not be found. Jul 18 02:14:23.011896 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:23.024000 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:23.024000 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:23.024000 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:23.024000 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:23.024000 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:23.024000 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:14:23.024000 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:14:23.024000 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8aad28a-a3d8-48d3-8fc7-50d65ab4e768 could not be found. Jul 18 02:14:23.024000 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:14:23.024000 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cb1fc256-03eb-4fcd-9fae-16506c1de3e8 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Returning 404 to user: Instance d8aad28a-a3d8-48d3-8fc7-50d65ab4e768 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:14:23.024000 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cb1fc256-03eb-4fcd-9fae-16506c1de3e8 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768" status: 404 len: 111 microversion: 2.1 time: 0.049464 Jul 18 02:14:23.024000 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 736/1449] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:14:22 2022] DELETE /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:14:23.029302 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cd7b120f-1a12-4710-8bfa-4733d785d883 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:23.029302 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cd7b120f-1a12-4710-8bfa-4733d785d883 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] [instance: d8aad28a-a3d8-48d3-8fc7-50d65ab4e768] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:23.030999 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cd7b120f-1a12-4710-8bfa-4733d785d883 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:23.031456 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cd7b120f-1a12-4710-8bfa-4733d785d883 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:23.032254 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cd7b120f-1a12-4710-8bfa-4733d785d883 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:23.032700 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cd7b120f-1a12-4710-8bfa-4733d785d883 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:23.050002 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-cd7b120f-1a12-4710-8bfa-4733d785d883 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] HTTP exception thrown: Instance d8aad28a-a3d8-48d3-8fc7-50d65ab4e768 could not be found. Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cd7b120f-1a12-4710-8bfa-4733d785d883 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Request method failure captured: Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768 HTTP/1.1 Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MCzvUiLjVPa9k5iRmWWr1F2ZyXX6RhQj-KxTNpVjPTd256MdgV8yuDLe9WLMkK_v1nEuuEud4Xy4MbeuUSjptygmIUcMLCmISLnRcYLgmO2plKsp9LFggv3C6frOpPwcaFoHgcExXMgtK5PyovbnA7Q594UMMNgAWnVF4ge4OjZi9A Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 10c5b35052cd4a71a8254d01112f0496 Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ImagesTestJSON-61947256 Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_10c5b35052cd4a71a8254d01112f0496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/10c5b35052cd4a71a8254d01112f0496"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/10c5b35052cd4a71a8254d01112f0496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/10c5b35052cd4a71a8254d01112f0496"}]}] Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ImagesTestJSON-61947256 Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 10c5b35052cd4a71a8254d01112f0496 Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ImagesTestJSON-61947256 Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ImagesTestJSON-61947256-project Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: a686fc833d964d88a022fae2932b5727 Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ImagesTestJSON-61947256-project Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance d8aad28a-a3d8-48d3-8fc7-50d65ab4e768 could not be found. Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'd8aad28a-a3d8-48d3-8fc7-50d65ab4e768'} Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8aad28a-a3d8-48d3-8fc7-50d65ab4e768 could not be found. Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8aad28a-a3d8-48d3-8fc7-50d65ab4e768 could not be found. Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:23.051607 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:23.061569 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:23.061569 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:23.061569 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:14:23.061569 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:14:23.061569 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8aad28a-a3d8-48d3-8fc7-50d65ab4e768 could not be found. Jul 18 02:14:23.061569 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:14:23.061569 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cd7b120f-1a12-4710-8bfa-4733d785d883 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] Returning 404 to user: Instance d8aad28a-a3d8-48d3-8fc7-50d65ab4e768 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:14:23.061569 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cd7b120f-1a12-4710-8bfa-4733d785d883 tempest-ImagesTestJSON-61947256 tempest-ImagesTestJSON-61947256-project] 10.222.0.57 "GET /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768" status: 404 len: 111 microversion: 2.1 time: 0.034683 Jul 18 02:14:23.061569 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 714/1450] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:23 2022] GET /compute/v2.1/servers/d8aad28a-a3d8-48d3-8fc7-50d65ab4e768 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:14:23.415763 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f568ad12-aee3-487b-893e-7e368b082da9 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:23.417318 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f568ad12-aee3-487b-893e-7e368b082da9 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 49764b86-41da-4c6d-b069-aaccf92ef89f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:23.426955 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f568ad12-aee3-487b-893e-7e368b082da9 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:23.427639 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f568ad12-aee3-487b-893e-7e368b082da9 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:23.428974 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f568ad12-aee3-487b-893e-7e368b082da9 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:23.429648 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f568ad12-aee3-487b-893e-7e368b082da9 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:23.471263 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2b8f3c67-8eac-4647-8548-9f54de37ea58 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:23.472085 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2b8f3c67-8eac-4647-8548-9f54de37ea58 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 465df230-ba3a-430a-935d-dc0a7fb83462] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:23.489411 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b8f3c67-8eac-4647-8548-9f54de37ea58 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:23.489906 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b8f3c67-8eac-4647-8548-9f54de37ea58 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:23.490698 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b8f3c67-8eac-4647-8548-9f54de37ea58 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:23.491131 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b8f3c67-8eac-4647-8548-9f54de37ea58 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:23.815360 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f568ad12-aee3-487b-893e-7e368b082da9 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:23.856157 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f568ad12-aee3-487b-893e-7e368b082da9 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:23.870737 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f568ad12-aee3-487b-893e-7e368b082da9 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:23.875849 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f568ad12-aee3-487b-893e-7e368b082da9 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f" status: 200 len: 1567 microversion: 2.25 time: 0.465691 Jul 18 02:14:23.889141 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2b8f3c67-8eac-4647-8548-9f54de37ea58 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:23.899077 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2b8f3c67-8eac-4647-8548-9f54de37ea58 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/465df230-ba3a-430a-935d-dc0a7fb83462" status: 200 len: 1319 microversion: 2.1 time: 0.432035 Jul 18 02:14:23.903797 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 737/1451] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:14:23 2022] GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f => generated 1567 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:14:23.904752 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 715/1452] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:23 2022] GET /compute/v2.1/servers/465df230-ba3a-430a-935d-dc0a7fb83462 => generated 1319 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:14:23.909586 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-0e24908e-1ab6-485d-93b3-c71c0e3d8e3d req-1e991489-4250-4f67-8cee-f54fc4c85d74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49764b86-41da-4c6d-b069-aaccf92ef89f", "name": "network-vif-unplugged", "status": "completed", "tag": "91c20a21-2cb0-48df-99d9-8ab9275d0bc8"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:23.928330 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-79c62fb2-543c-4a14-aef8-c2eeede29c02 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a86bb4c0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:23.933295 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-0e24908e-1ab6-485d-93b3-c71c0e3d8e3d req-1e991489-4250-4f67-8cee-f54fc4c85d74 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:23.933658 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-0e24908e-1ab6-485d-93b3-c71c0e3d8e3d req-1e991489-4250-4f67-8cee-f54fc4c85d74 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:23.959467 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-0e24908e-1ab6-485d-93b3-c71c0e3d8e3d req-1e991489-4250-4f67-8cee-f54fc4c85d74 service nova] Creating event network-vif-unplugged:91c20a21-2cb0-48df-99d9-8ab9275d0bc8 for instance 49764b86-41da-4c6d-b069-aaccf92ef89f on n-h2-465891-3 Jul 18 02:14:23.978896 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-0e24908e-1ab6-485d-93b3-c71c0e3d8e3d req-1e991489-4250-4f67-8cee-f54fc4c85d74 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072564 Jul 18 02:14:23.980789 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 716/1453] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:24.027730 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-0cf2bfc6-ae4f-4e94-9883-26ebb9b14888 req-3e02b935-aebe-4b15-9c56-b7283edcb3bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "465df230-ba3a-430a-935d-dc0a7fb83462", "name": "network-vif-plugged", "status": "completed", "tag": "874a12e1-9707-47fe-86d6-8d8a405eab15"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:24.046420 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-0cf2bfc6-ae4f-4e94-9883-26ebb9b14888 req-3e02b935-aebe-4b15-9c56-b7283edcb3bc service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:24.047072 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-0cf2bfc6-ae4f-4e94-9883-26ebb9b14888 req-3e02b935-aebe-4b15-9c56-b7283edcb3bc service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:24.079242 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-0cf2bfc6-ae4f-4e94-9883-26ebb9b14888 req-3e02b935-aebe-4b15-9c56-b7283edcb3bc service nova] Creating event network-vif-plugged:874a12e1-9707-47fe-86d6-8d8a405eab15 for instance 465df230-ba3a-430a-935d-dc0a7fb83462 on n-h1-465891-3 Jul 18 02:14:24.086721 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-0cf2bfc6-ae4f-4e94-9883-26ebb9b14888 req-3e02b935-aebe-4b15-9c56-b7283edcb3bc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064528 Jul 18 02:14:24.095913 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 717/1454] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:14:24.169250 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-79c62fb2-543c-4a14-aef8-c2eeede29c02 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b" status: 200 len: 1454 microversion: 2.1 time: 0.263155 Jul 18 02:14:24.176702 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 738/1455] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:14:23 2022] GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b => generated 1454 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:24.938854 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d229f1ef-6d44-4a48-94bc-6f2e927c5b59 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:24.940205 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d229f1ef-6d44-4a48-94bc-6f2e927c5b59 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 465df230-ba3a-430a-935d-dc0a7fb83462] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:24.944575 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a6e79aa9-9850-45b4-93d4-0ae7ba784b94 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:24.947625 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a6e79aa9-9850-45b4-93d4-0ae7ba784b94 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 49764b86-41da-4c6d-b069-aaccf92ef89f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:24.962541 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d229f1ef-6d44-4a48-94bc-6f2e927c5b59 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:24.963651 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d229f1ef-6d44-4a48-94bc-6f2e927c5b59 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:24.965075 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d229f1ef-6d44-4a48-94bc-6f2e927c5b59 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:24.966056 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d229f1ef-6d44-4a48-94bc-6f2e927c5b59 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:24.980743 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a6e79aa9-9850-45b4-93d4-0ae7ba784b94 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:24.982219 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a6e79aa9-9850-45b4-93d4-0ae7ba784b94 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:24.984449 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a6e79aa9-9850-45b4-93d4-0ae7ba784b94 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:24.985819 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a6e79aa9-9850-45b4-93d4-0ae7ba784b94 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:25.669800 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d229f1ef-6d44-4a48-94bc-6f2e927c5b59 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:25.693171 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a6e79aa9-9850-45b4-93d4-0ae7ba784b94 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:25.702736 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d229f1ef-6d44-4a48-94bc-6f2e927c5b59 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/465df230-ba3a-430a-935d-dc0a7fb83462" status: 200 len: 1319 microversion: 2.1 time: 0.784048 Jul 18 02:14:25.713208 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 718/1456] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:24 2022] GET /compute/v2.1/servers/465df230-ba3a-430a-935d-dc0a7fb83462 => generated 1319 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:25.722919 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a6e79aa9-9850-45b4-93d4-0ae7ba784b94 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:25.728292 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a6e79aa9-9850-45b4-93d4-0ae7ba784b94 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:25.732321 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a6e79aa9-9850-45b4-93d4-0ae7ba784b94 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f" status: 200 len: 1567 microversion: 2.25 time: 0.813264 Jul 18 02:14:25.733433 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 739/1457] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:14:24 2022] GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f => generated 1567 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:14:25.741336 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6c4e1752-bbc6-47c8-8393-8bb4c698dd1e tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a879e4c0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:25.936165 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6c4e1752-bbc6-47c8-8393-8bb4c698dd1e tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b" status: 200 len: 1454 microversion: 2.1 time: 0.219790 Jul 18 02:14:25.947625 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 719/1458] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:14:25 2022] GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b => generated 1454 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:26.212288 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-cf2ab040-2d45-469a-b3a1-c5099e2a85f6 req-bdcd8528-939c-4a61-897d-6d44ab3777d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32e81b5d-a507-4d47-b76e-699091d0e5bd", "name": "network-vif-unplugged", "status": "completed", "tag": "07f51000-5732-46e7-8e0e-0bd9c61e7698"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:26.301965 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-cf2ab040-2d45-469a-b3a1-c5099e2a85f6 req-bdcd8528-939c-4a61-897d-6d44ab3777d2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:26.302424 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-cf2ab040-2d45-469a-b3a1-c5099e2a85f6 req-bdcd8528-939c-4a61-897d-6d44ab3777d2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:26.352275 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-cf2ab040-2d45-469a-b3a1-c5099e2a85f6 req-bdcd8528-939c-4a61-897d-6d44ab3777d2 service nova] Creating event network-vif-unplugged:07f51000-5732-46e7-8e0e-0bd9c61e7698 for instance 32e81b5d-a507-4d47-b76e-699091d0e5bd on n-h2-465891-3 Jul 18 02:14:26.368415 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-cf2ab040-2d45-469a-b3a1-c5099e2a85f6 req-bdcd8528-939c-4a61-897d-6d44ab3777d2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.175341 Jul 18 02:14:26.369052 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 740/1459] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:26.737692 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a00c753b-4d5c-4f5e-89cf-88cf37a2a313 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:26.738809 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a00c753b-4d5c-4f5e-89cf-88cf37a2a313 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 465df230-ba3a-430a-935d-dc0a7fb83462] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:26.752602 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a00c753b-4d5c-4f5e-89cf-88cf37a2a313 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:26.753997 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a00c753b-4d5c-4f5e-89cf-88cf37a2a313 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:26.755652 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a00c753b-4d5c-4f5e-89cf-88cf37a2a313 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:26.756582 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a00c753b-4d5c-4f5e-89cf-88cf37a2a313 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:26.762460 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-87028f9a-6257-4f57-af52-b264208f38b0 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:26.764716 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-87028f9a-6257-4f57-af52-b264208f38b0 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 49764b86-41da-4c6d-b069-aaccf92ef89f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:26.783892 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-87028f9a-6257-4f57-af52-b264208f38b0 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:26.785724 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-87028f9a-6257-4f57-af52-b264208f38b0 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:26.796960 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-87028f9a-6257-4f57-af52-b264208f38b0 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:26.801922 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-87028f9a-6257-4f57-af52-b264208f38b0 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:26.909430 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:27.759425 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-87028f9a-6257-4f57-af52-b264208f38b0 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:27.778159 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-87028f9a-6257-4f57-af52-b264208f38b0 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:27.785316 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-87028f9a-6257-4f57-af52-b264208f38b0 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:27.789076 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-87028f9a-6257-4f57-af52-b264208f38b0 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f" status: 200 len: 1567 microversion: 2.25 time: 1.040233 Jul 18 02:14:27.790255 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 741/1460] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:14:26 2022] GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f => generated 1567 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:14:27.820763 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a04ae976-7fa7-465b-8fdd-998c882342d4 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a89998b0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:27.925447 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a04ae976-7fa7-465b-8fdd-998c882342d4 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b" status: 200 len: 1454 microversion: 2.1 time: 0.133782 Jul 18 02:14:27.927693 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 742/1461] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:14:27 2022] GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b => generated 1454 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:27.943199 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a00c753b-4d5c-4f5e-89cf-88cf37a2a313 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:27.959704 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a00c753b-4d5c-4f5e-89cf-88cf37a2a313 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/465df230-ba3a-430a-935d-dc0a7fb83462" status: 200 len: 1468 microversion: 2.1 time: 1.231488 Jul 18 02:14:27.960668 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 720/1462] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:26 2022] GET /compute/v2.1/servers/465df230-ba3a-430a-935d-dc0a7fb83462 => generated 1468 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:27.980555 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-822ea6f6-8e01-4c14-bd1c-123c8c018064 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:27.989922 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-822ea6f6-8e01-4c14-bd1c-123c8c018064 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:27.991980 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-822ea6f6-8e01-4c14-bd1c-123c8c018064 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Searching by: {'reservation_id': 'r-bqss7qrn', 'deleted': False, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41'} {{(pid=119544) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:14:27.999484 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-822ea6f6-8e01-4c14-bd1c-123c8c018064 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:28.000249 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-822ea6f6-8e01-4c14-bd1c-123c8c018064 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:28.001267 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-822ea6f6-8e01-4c14-bd1c-123c8c018064 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:28.001944 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-822ea6f6-8e01-4c14-bd1c-123c8c018064 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:28.283473 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.multi_cell_list [None req-822ea6f6-8e01-4c14-bd1c-123c8c018064 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119544) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:14:28.572346 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-0e021ad1-0755-4da1-a9ee-6f169d70be2b req-246d6ccc-6ffc-4a25-b2a1-f428bae500ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "697075ff-db42-4729-8faf-2c2935d72630", "name": "network-vif-plugged", "status": "completed", "tag": "26b96c32-3f20-4f09-8e97-8a938a803c4c"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:28.597592 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-822ea6f6-8e01-4c14-bd1c-123c8c018064 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:28.626426 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-822ea6f6-8e01-4c14-bd1c-123c8c018064 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:28.628298 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-822ea6f6-8e01-4c14-bd1c-123c8c018064 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:28.653524 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-0e021ad1-0755-4da1-a9ee-6f169d70be2b req-246d6ccc-6ffc-4a25-b2a1-f428bae500ff service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:28.655312 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-0e021ad1-0755-4da1-a9ee-6f169d70be2b req-246d6ccc-6ffc-4a25-b2a1-f428bae500ff service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:28.694486 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-0e021ad1-0755-4da1-a9ee-6f169d70be2b req-246d6ccc-6ffc-4a25-b2a1-f428bae500ff service nova] Creating event network-vif-plugged:26b96c32-3f20-4f09-8e97-8a938a803c4c for instance 697075ff-db42-4729-8faf-2c2935d72630 on n-h2-465891-3 Jul 18 02:14:28.704044 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-0e021ad1-0755-4da1-a9ee-6f169d70be2b req-246d6ccc-6ffc-4a25-b2a1-f428bae500ff service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141721 Jul 18 02:14:28.706879 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 721/1463] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:14:28.826494 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e6e70f4c-0dc3-4fc5-bb11-97cb668e3d94 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:28.828541 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e6e70f4c-0dc3-4fc5-bb11-97cb668e3d94 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 49764b86-41da-4c6d-b069-aaccf92ef89f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:28.849259 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e6e70f4c-0dc3-4fc5-bb11-97cb668e3d94 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:28.849823 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e6e70f4c-0dc3-4fc5-bb11-97cb668e3d94 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:28.851916 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e6e70f4c-0dc3-4fc5-bb11-97cb668e3d94 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:28.852370 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e6e70f4c-0dc3-4fc5-bb11-97cb668e3d94 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:29.312478 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-822ea6f6-8e01-4c14-bd1c-123c8c018064 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/detail?reservation_id=r-bqss7qrn" status: 200 len: 2929 microversion: 2.1 time: 1.334872 Jul 18 02:14:29.314959 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 743/1464] 10.222.0.57 () {58 vars in 1196 bytes} [Mon Jul 18 02:14:27 2022] GET /compute/v2.1/servers/detail?reservation_id=r-bqss7qrn => generated 2929 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:14:29.334069 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e7979273-dffd-4dda-802f-00fccf9c98f2 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a888a940>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:29.515427 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e7979273-dffd-4dda-802f-00fccf9c98f2 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b" status: 200 len: 1454 microversion: 2.1 time: 0.197984 Jul 18 02:14:29.529263 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 744/1465] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:14:29 2022] GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b => generated 1454 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:29.578021 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f1fc6b28-95fe-4552-ada5-512f25e62894 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:29.632565 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.compute.server_groups [None req-f1fc6b28-95fe-4552-ada5-512f25e62894 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Querying cell 2a4b42c4-bf71-4fae-804a-3632602c55fa(cell1) for 2 instances {{(pid=119544) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 18 02:14:29.659148 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f1fc6b28-95fe-4552-ada5-512f25e62894 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:29.663922 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f1fc6b28-95fe-4552-ada5-512f25e62894 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:29.837031 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f1fc6b28-95fe-4552-ada5-512f25e62894 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/os-server-groups/3f2188bf-ec0e-426f-8182-c941769ada5e" status: 200 len: 271 microversion: 2.1 time: 0.305916 Jul 18 02:14:29.840357 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 745/1466] 10.222.0.57 () {58 vars in 1262 bytes} [Mon Jul 18 02:14:29 2022] GET /compute/v2.1/os-server-groups/3f2188bf-ec0e-426f-8182-c941769ada5e => generated 271 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:29.852152 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-338c654e-7e5b-4157-95b7-1f114c1a89cb tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:29.854899 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-338c654e-7e5b-4157-95b7-1f114c1a89cb tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] [instance: 465df230-ba3a-430a-935d-dc0a7fb83462] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:29.872725 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-338c654e-7e5b-4157-95b7-1f114c1a89cb tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:29.873499 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-338c654e-7e5b-4157-95b7-1f114c1a89cb tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:29.878681 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-338c654e-7e5b-4157-95b7-1f114c1a89cb tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:29.879475 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-338c654e-7e5b-4157-95b7-1f114c1a89cb tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:30.094569 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e6e70f4c-0dc3-4fc5-bb11-97cb668e3d94 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:30.141201 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e6e70f4c-0dc3-4fc5-bb11-97cb668e3d94 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:30.147152 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e6e70f4c-0dc3-4fc5-bb11-97cb668e3d94 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:30.151552 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e6e70f4c-0dc3-4fc5-bb11-97cb668e3d94 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f" status: 200 len: 1567 microversion: 2.25 time: 1.329579 Jul 18 02:14:30.153425 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 722/1467] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:14:28 2022] GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f => generated 1567 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:14:30.317549 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-338c654e-7e5b-4157-95b7-1f114c1a89cb tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/465df230-ba3a-430a-935d-dc0a7fb83462" status: 200 len: 1619 microversion: 2.1 time: 0.469386 Jul 18 02:14:30.318391 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 746/1468] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:29 2022] GET /compute/v2.1/servers/465df230-ba3a-430a-935d-dc0a7fb83462 => generated 1619 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:30.363659 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-039bd0c8-0329-4a6c-9dbc-66be41d8eb84 tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:30.364842 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-039bd0c8-0329-4a6c-9dbc-66be41d8eb84 tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] [instance: c8ba5e49-8aa4-4b43-9273-16be87705a48] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:30.390547 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-039bd0c8-0329-4a6c-9dbc-66be41d8eb84 tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:30.391745 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-039bd0c8-0329-4a6c-9dbc-66be41d8eb84 tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:30.393506 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-039bd0c8-0329-4a6c-9dbc-66be41d8eb84 tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:30.394963 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-039bd0c8-0329-4a6c-9dbc-66be41d8eb84 tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:30.549388 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ed228869-a774-4410-8002-b6464cde47cd tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a8999c10>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:30.692954 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ed228869-a774-4410-8002-b6464cde47cd tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b" status: 200 len: 1454 microversion: 2.1 time: 0.155039 Jul 18 02:14:30.700265 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 747/1469] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:14:30 2022] GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b => generated 1454 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:14:31.122999 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-039bd0c8-0329-4a6c-9dbc-66be41d8eb84 tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/c8ba5e49-8aa4-4b43-9273-16be87705a48" status: 200 len: 1619 microversion: 2.1 time: 0.775532 Jul 18 02:14:31.184518 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6ba7434c-2d26-441f-9443-1e8b89ad91a2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:31.185837 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6ba7434c-2d26-441f-9443-1e8b89ad91a2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 49764b86-41da-4c6d-b069-aaccf92ef89f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:31.190677 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 723/1470] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:30 2022] GET /compute/v2.1/servers/c8ba5e49-8aa4-4b43-9273-16be87705a48 => generated 1619 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:31.211764 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6ba7434c-2d26-441f-9443-1e8b89ad91a2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:31.218077 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6ba7434c-2d26-441f-9443-1e8b89ad91a2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:31.219328 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6ba7434c-2d26-441f-9443-1e8b89ad91a2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:31.219783 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6ba7434c-2d26-441f-9443-1e8b89ad91a2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:31.439384 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4ae040b6-2a83-4b0c-b118-209cf0dbc4ad tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-337186865", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "c207a0eb-5ef9-4932-9f3a-22f2a11129e5"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:31.565316 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-4ae040b6-2a83-4b0c-b118-209cf0dbc4ad tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] validate_networks() for None {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:14:31.828022 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6ba7434c-2d26-441f-9443-1e8b89ad91a2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:31.839433 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6ba7434c-2d26-441f-9443-1e8b89ad91a2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:31.849485 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6ba7434c-2d26-441f-9443-1e8b89ad91a2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:31.851942 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6ba7434c-2d26-441f-9443-1e8b89ad91a2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f" status: 200 len: 1557 microversion: 2.25 time: 0.672408 Jul 18 02:14:31.858492 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 748/1471] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:14:31 2022] GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f => generated 1557 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:14:31.864489 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8240bb0f-34f4-4934-9665-f3586ec22ceb tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a86bb820>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:31.955482 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8240bb0f-34f4-4934-9665-f3586ec22ceb tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b" status: 200 len: 1454 microversion: 2.1 time: 0.095293 Jul 18 02:14:31.966441 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 749/1472] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:14:31 2022] GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b => generated 1454 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:31.982280 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8117d19e-3cf2-4c15-a5cb-2f2b6955392e tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Calling method '.version_select at 0x7ff4a8a68e50>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:31.988863 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8117d19e-3cf2-4c15-a5cb-2f2b6955392e tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:31.994541 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8117d19e-3cf2-4c15-a5cb-2f2b6955392e tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:32.014780 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8117d19e-3cf2-4c15-a5cb-2f2b6955392e tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] 10.222.0.57 "GET /compute/v2.1/os-migrations" status: 200 len: 1520 microversion: 2.25 time: 0.039092 Jul 18 02:14:32.015734 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 750/1473] 10.222.0.57 () {60 vars in 1183 bytes} [Mon Jul 18 02:14:31 2022] GET /compute/v2.1/os-migrations => generated 1520 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:14:32.028814 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-29492ec7-72d7-49b2-a535-24f38af14cd6 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:32.038720 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-29492ec7-72d7-49b2-a535-24f38af14cd6 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] [instance: 49764b86-41da-4c6d-b069-aaccf92ef89f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:32.056700 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-29492ec7-72d7-49b2-a535-24f38af14cd6 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:32.062005 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-29492ec7-72d7-49b2-a535-24f38af14cd6 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:32.063093 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-29492ec7-72d7-49b2-a535-24f38af14cd6 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:32.063729 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-29492ec7-72d7-49b2-a535-24f38af14cd6 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:32.730497 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-4ae040b6-2a83-4b0c-b118-209cf0dbc4ad tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:14:32.733001 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-4ae040b6-2a83-4b0c-b118-209cf0dbc4ad tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:14:32.735191 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-4ae040b6-2a83-4b0c-b118-209cf0dbc4ad tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:14:32.735978 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-4ae040b6-2a83-4b0c-b118-209cf0dbc4ad tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:14:32.736731 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-4ae040b6-2a83-4b0c-b118-209cf0dbc4ad tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:14:32.770364 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4ae040b6-2a83-4b0c-b118-209cf0dbc4ad tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:32.771160 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4ae040b6-2a83-4b0c-b118-209cf0dbc4ad tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:32.787630 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4ae040b6-2a83-4b0c-b118-209cf0dbc4ad tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:32.788992 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4ae040b6-2a83-4b0c-b118-209cf0dbc4ad tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:32.862781 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-4ae040b6-2a83-4b0c-b118-209cf0dbc4ad tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Getting quotas for project 8f8bb1ebead3481f946ae7878c3cfc41. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:14:32.882080 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-4ae040b6-2a83-4b0c-b118-209cf0dbc4ad tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Getting quotas for user 100f65c0d9d3456fa177599821aed7ff and project 8f8bb1ebead3481f946ae7878c3cfc41. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:14:32.992699 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4ae040b6-2a83-4b0c-b118-209cf0dbc4ad tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:14:33.000927 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4ae040b6-2a83-4b0c-b118-209cf0dbc4ad tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 89bd86f8-830e-44ed-82a9-7b77e67606f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:14:33.080054 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-29492ec7-72d7-49b2-a535-24f38af14cd6 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lazy-loading 'services' on Instance uuid 49764b86-41da-4c6d-b069-aaccf92ef89f {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:14:33.154492 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-29492ec7-72d7-49b2-a535-24f38af14cd6 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f" status: 200 len: 2049 microversion: 2.25 time: 1.124997 Jul 18 02:14:33.158018 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 751/1474] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:14:32 2022] GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f => generated 2049 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:14:33.177756 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fb2eae52-ea31-4014-9e1c-3f5dd4ee662b tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a87e2dc0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:33.178541 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4ae040b6-2a83-4b0c-b118-209cf0dbc4ad tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.743833 Jul 18 02:14:33.200798 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 724/1475] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:14:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 02:14:33.230260 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c90bfdf8-b25d-43a6-8ae2-e531c4a5884a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:33.233383 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c90bfdf8-b25d-43a6-8ae2-e531c4a5884a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 89bd86f8-830e-44ed-82a9-7b77e67606f8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:33.321241 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fb2eae52-ea31-4014-9e1c-3f5dd4ee662b tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b" status: 200 len: 1454 microversion: 2.1 time: 0.160658 Jul 18 02:14:33.323002 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 752/1476] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:14:33 2022] GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b => generated 1454 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:33.427238 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-feb5ea31-0926-43db-89ef-993013188195 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1222562853", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "e5432050-4fd3-426b-81bb-244a073d1cbe"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:33.529171 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c90bfdf8-b25d-43a6-8ae2-e531c4a5884a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:33.562053 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c90bfdf8-b25d-43a6-8ae2-e531c4a5884a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/89bd86f8-830e-44ed-82a9-7b77e67606f8" status: 200 len: 1216 microversion: 2.1 time: 0.356395 Jul 18 02:14:33.565118 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 725/1477] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:33 2022] GET /compute/v2.1/servers/89bd86f8-830e-44ed-82a9-7b77e67606f8 => generated 1216 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:33.636762 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-feb5ea31-0926-43db-89ef-993013188195 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] validate_networks() for [('e5432050-4fd3-426b-81bb-244a073d1cbe', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:14:34.337134 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c0a4f60d-460a-4fec-9835-901e95219204 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a89dc3a0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:34.457805 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c0a4f60d-460a-4fec-9835-901e95219204 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b" status: 200 len: 1454 microversion: 2.1 time: 0.124819 Jul 18 02:14:34.465864 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 726/1478] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:14:34 2022] GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b => generated 1454 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:34.603647 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-982eaa78-d6df-46e5-ad2f-3d91dc75fe0c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:34.620147 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-982eaa78-d6df-46e5-ad2f-3d91dc75fe0c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 89bd86f8-830e-44ed-82a9-7b77e67606f8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:34.632844 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:34.711761 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-982eaa78-d6df-46e5-ad2f-3d91dc75fe0c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:34.713553 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-982eaa78-d6df-46e5-ad2f-3d91dc75fe0c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:34.714463 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-982eaa78-d6df-46e5-ad2f-3d91dc75fe0c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:34.714914 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-982eaa78-d6df-46e5-ad2f-3d91dc75fe0c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:35.046238 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-982eaa78-d6df-46e5-ad2f-3d91dc75fe0c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:35.054633 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-982eaa78-d6df-46e5-ad2f-3d91dc75fe0c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/89bd86f8-830e-44ed-82a9-7b77e67606f8" status: 200 len: 1220 microversion: 2.1 time: 0.460046 Jul 18 02:14:35.065117 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 727/1479] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:34 2022] GET /compute/v2.1/servers/89bd86f8-830e-44ed-82a9-7b77e67606f8 => generated 1220 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:35.479252 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-58c54bb7-6f72-4a86-a266-24979983d599 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a8964ca0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:35.587562 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-58c54bb7-6f72-4a86-a266-24979983d599 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b" status: 200 len: 1454 microversion: 2.1 time: 0.112272 Jul 18 02:14:35.604936 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 728/1480] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:14:35 2022] GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b => generated 1454 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:14:36.087572 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0deaf7d6-0cce-4675-9757-b76e8f527c19 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:36.088761 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0deaf7d6-0cce-4675-9757-b76e8f527c19 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 89bd86f8-830e-44ed-82a9-7b77e67606f8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:36.098312 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-feb5ea31-0926-43db-89ef-993013188195 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:14:36.099142 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-feb5ea31-0926-43db-89ef-993013188195 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:14:36.099305 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-feb5ea31-0926-43db-89ef-993013188195 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:14:36.099600 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-feb5ea31-0926-43db-89ef-993013188195 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:14:36.100218 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-feb5ea31-0926-43db-89ef-993013188195 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:14:36.113916 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0deaf7d6-0cce-4675-9757-b76e8f527c19 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:36.114248 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0deaf7d6-0cce-4675-9757-b76e8f527c19 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:36.121272 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0deaf7d6-0cce-4675-9757-b76e8f527c19 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:36.126734 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-feb5ea31-0926-43db-89ef-993013188195 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:36.127676 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0deaf7d6-0cce-4675-9757-b76e8f527c19 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:36.131509 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-feb5ea31-0926-43db-89ef-993013188195 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:36.132763 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-feb5ea31-0926-43db-89ef-993013188195 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:36.133205 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-feb5ea31-0926-43db-89ef-993013188195 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:36.217747 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-feb5ea31-0926-43db-89ef-993013188195 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Getting quotas for project 9d0f5bbde58545fb9ccd1c2eb842ed49. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:14:36.251029 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-feb5ea31-0926-43db-89ef-993013188195 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Getting quotas for user 575dd6743cff44678749d452329355d1 and project 9d0f5bbde58545fb9ccd1c2eb842ed49. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:14:36.302365 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-feb5ea31-0926-43db-89ef-993013188195 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:14:36.317278 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-feb5ea31-0926-43db-89ef-993013188195 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2b4a452c-dd09-4dd6-ab90-bd7d584343e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:14:36.369683 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0deaf7d6-0cce-4675-9757-b76e8f527c19 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:36.383599 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0deaf7d6-0cce-4675-9757-b76e8f527c19 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/89bd86f8-830e-44ed-82a9-7b77e67606f8" status: 200 len: 1276 microversion: 2.1 time: 0.300210 Jul 18 02:14:36.386442 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 729/1481] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:36 2022] GET /compute/v2.1/servers/89bd86f8-830e-44ed-82a9-7b77e67606f8 => generated 1276 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:36.589362 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-feb5ea31-0926-43db-89ef-993013188195 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.170097 Jul 18 02:14:36.591075 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 753/1482] 10.222.0.57 () {62 vars in 1187 bytes} [Mon Jul 18 02:14:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 3175 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 18 02:14:36.604105 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ecd4bbe6-a24a-45d6-8e91-ce722a13bbee tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:36.605286 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ecd4bbe6-a24a-45d6-8e91-ce722a13bbee tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2b4a452c-dd09-4dd6-ab90-bd7d584343e5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:36.671744 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f9a2f245-ff2b-44ae-ad2e-79acbdb6bf99 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a8b03430>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:36.829679 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f9a2f245-ff2b-44ae-ad2e-79acbdb6bf99 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b" status: 200 len: 1454 microversion: 2.1 time: 0.212929 Jul 18 02:14:36.830920 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 754/1483] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:14:36 2022] GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b => generated 1454 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:36.895882 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ecd4bbe6-a24a-45d6-8e91-ce722a13bbee tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:36.907820 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ecd4bbe6-a24a-45d6-8e91-ce722a13bbee tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:36.909645 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ecd4bbe6-a24a-45d6-8e91-ce722a13bbee tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:36.911368 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ecd4bbe6-a24a-45d6-8e91-ce722a13bbee tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5" status: 200 len: 1262 microversion: 2.25 time: 0.313958 Jul 18 02:14:36.912712 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 730/1484] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:14:36 2022] GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5 => generated 1262 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:14:37.420941 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-04a6e718-d5f2-4643-9708-30425c03b285 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:37.422639 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-04a6e718-d5f2-4643-9708-30425c03b285 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 89bd86f8-830e-44ed-82a9-7b77e67606f8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:37.440851 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-04a6e718-d5f2-4643-9708-30425c03b285 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:37.441842 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-04a6e718-d5f2-4643-9708-30425c03b285 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:37.443197 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-04a6e718-d5f2-4643-9708-30425c03b285 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:37.443961 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-04a6e718-d5f2-4643-9708-30425c03b285 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:37.591404 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-04a6e718-d5f2-4643-9708-30425c03b285 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:37.609077 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-04a6e718-d5f2-4643-9708-30425c03b285 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/89bd86f8-830e-44ed-82a9-7b77e67606f8" status: 200 len: 1274 microversion: 2.1 time: 0.196009 Jul 18 02:14:37.610243 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 755/1485] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:37 2022] GET /compute/v2.1/servers/89bd86f8-830e-44ed-82a9-7b77e67606f8 => generated 1274 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:14:37.844930 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-25d9852a-0509-4252-9be8-cc6644bebdfe tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a87af700>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:37.932468 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-086970ef-f3f1-4a55-8e58-1165ed087a25 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:37.933766 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-086970ef-f3f1-4a55-8e58-1165ed087a25 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2b4a452c-dd09-4dd6-ab90-bd7d584343e5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:37.952160 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-086970ef-f3f1-4a55-8e58-1165ed087a25 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:37.958498 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-25d9852a-0509-4252-9be8-cc6644bebdfe tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b" status: 200 len: 1454 microversion: 2.1 time: 0.117947 Jul 18 02:14:37.959385 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-086970ef-f3f1-4a55-8e58-1165ed087a25 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:37.960644 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-086970ef-f3f1-4a55-8e58-1165ed087a25 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:37.961385 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-086970ef-f3f1-4a55-8e58-1165ed087a25 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:37.968902 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 731/1486] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:14:37 2022] GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b => generated 1454 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:38.374549 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-086970ef-f3f1-4a55-8e58-1165ed087a25 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:38.396421 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-086970ef-f3f1-4a55-8e58-1165ed087a25 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:38.406237 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-086970ef-f3f1-4a55-8e58-1165ed087a25 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:38.412496 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-086970ef-f3f1-4a55-8e58-1165ed087a25 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5" status: 200 len: 1266 microversion: 2.25 time: 0.485112 Jul 18 02:14:38.425876 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 756/1487] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:14:37 2022] GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5 => generated 1266 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:14:38.627828 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-671d19ac-269b-4650-98f9-90717aaae461 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:38.628438 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-671d19ac-269b-4650-98f9-90717aaae461 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 89bd86f8-830e-44ed-82a9-7b77e67606f8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:38.640229 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-671d19ac-269b-4650-98f9-90717aaae461 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:38.641185 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-671d19ac-269b-4650-98f9-90717aaae461 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:38.642911 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-671d19ac-269b-4650-98f9-90717aaae461 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:38.646927 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-671d19ac-269b-4650-98f9-90717aaae461 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:38.663683 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:38.984660 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d185db92-4b2a-47b2-88ca-5440e5b0f70b tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a93b8dc0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:39.071429 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d185db92-4b2a-47b2-88ca-5440e5b0f70b tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b" status: 200 len: 1454 microversion: 2.1 time: 0.091377 Jul 18 02:14:39.073613 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 757/1488] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:14:38 2022] GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b => generated 1454 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:39.311528 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-671d19ac-269b-4650-98f9-90717aaae461 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:39.319983 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-671d19ac-269b-4650-98f9-90717aaae461 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/89bd86f8-830e-44ed-82a9-7b77e67606f8" status: 200 len: 1274 microversion: 2.1 time: 0.695949 Jul 18 02:14:39.329039 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 732/1489] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:38 2022] GET /compute/v2.1/servers/89bd86f8-830e-44ed-82a9-7b77e67606f8 => generated 1274 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:39.449269 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9cb81204-ab4b-413b-b901-4b4514ecd064 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:39.450464 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9cb81204-ab4b-413b-b901-4b4514ecd064 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2b4a452c-dd09-4dd6-ab90-bd7d584343e5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:39.530317 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9cb81204-ab4b-413b-b901-4b4514ecd064 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:39.531475 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9cb81204-ab4b-413b-b901-4b4514ecd064 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:39.533106 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9cb81204-ab4b-413b-b901-4b4514ecd064 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:39.534123 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9cb81204-ab4b-413b-b901-4b4514ecd064 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:40.086118 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f258107e-a70a-4ba0-afa8-38eaf36478b7 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a89640d0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:40.167689 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f258107e-a70a-4ba0-afa8-38eaf36478b7 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b" status: 200 len: 1454 microversion: 2.1 time: 0.085374 Jul 18 02:14:40.173954 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 733/1490] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:14:40 2022] GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b => generated 1454 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:40.213340 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9cb81204-ab4b-413b-b901-4b4514ecd064 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:40.238442 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9cb81204-ab4b-413b-b901-4b4514ecd064 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:40.241986 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9cb81204-ab4b-413b-b901-4b4514ecd064 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:40.247663 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9cb81204-ab4b-413b-b901-4b4514ecd064 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5" status: 200 len: 1332 microversion: 2.25 time: 0.807759 Jul 18 02:14:40.248626 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 758/1491] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:14:39 2022] GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5 => generated 1332 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:14:40.348684 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a89c85b9-3928-4b4e-8a42-77906ba5137f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:40.350109 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a89c85b9-3928-4b4e-8a42-77906ba5137f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 89bd86f8-830e-44ed-82a9-7b77e67606f8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:40.375964 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a89c85b9-3928-4b4e-8a42-77906ba5137f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:40.376732 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a89c85b9-3928-4b4e-8a42-77906ba5137f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:40.377861 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a89c85b9-3928-4b4e-8a42-77906ba5137f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:40.378520 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a89c85b9-3928-4b4e-8a42-77906ba5137f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:40.612386 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a89c85b9-3928-4b4e-8a42-77906ba5137f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:40.628685 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a89c85b9-3928-4b4e-8a42-77906ba5137f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/89bd86f8-830e-44ed-82a9-7b77e67606f8" status: 200 len: 1274 microversion: 2.1 time: 0.283310 Jul 18 02:14:40.649181 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 734/1492] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:40 2022] GET /compute/v2.1/servers/89bd86f8-830e-44ed-82a9-7b77e67606f8 => generated 1274 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:41.180469 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a9c203e1-68ab-4c74-bf32-fcb5c35c8a76 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a93b8c10>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:41.266444 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-781fe110-b859-41e5-b425-b226f0314a78 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:41.267071 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-781fe110-b859-41e5-b425-b226f0314a78 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2b4a452c-dd09-4dd6-ab90-bd7d584343e5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:41.292320 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-781fe110-b859-41e5-b425-b226f0314a78 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:41.293278 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-781fe110-b859-41e5-b425-b226f0314a78 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:41.293577 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-781fe110-b859-41e5-b425-b226f0314a78 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:41.294968 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a9c203e1-68ab-4c74-bf32-fcb5c35c8a76 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b" status: 200 len: 1454 microversion: 2.1 time: 0.118374 Jul 18 02:14:41.295588 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 759/1493] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:14:41 2022] GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b => generated 1454 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:41.302342 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-781fe110-b859-41e5-b425-b226f0314a78 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:41.643963 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-781fe110-b859-41e5-b425-b226f0314a78 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:41.647438 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3840c2dc-5b3a-42dc-86f9-b0e2b4377532 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:41.648118 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3840c2dc-5b3a-42dc-86f9-b0e2b4377532 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 89bd86f8-830e-44ed-82a9-7b77e67606f8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:41.661247 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3840c2dc-5b3a-42dc-86f9-b0e2b4377532 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:41.661614 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-781fe110-b859-41e5-b425-b226f0314a78 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:41.662815 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3840c2dc-5b3a-42dc-86f9-b0e2b4377532 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:41.663764 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3840c2dc-5b3a-42dc-86f9-b0e2b4377532 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:41.667004 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3840c2dc-5b3a-42dc-86f9-b0e2b4377532 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:41.669153 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-781fe110-b859-41e5-b425-b226f0314a78 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:41.671550 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-781fe110-b859-41e5-b425-b226f0314a78 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5" status: 200 len: 1320 microversion: 2.25 time: 0.407951 Jul 18 02:14:41.684476 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 735/1494] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:14:41 2022] GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5 => generated 1320 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:14:42.311025 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e557ed9b-0e52-4944-8e69-7feb41286e4f tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a89833a0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:42.408259 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e557ed9b-0e52-4944-8e69-7feb41286e4f tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b" status: 200 len: 1454 microversion: 2.1 time: 0.100495 Jul 18 02:14:42.409307 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 736/1495] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:14:42 2022] GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b => generated 1454 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:42.690858 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-159b2751-0a16-44e3-b6c6-29a461840852 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:42.691708 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-159b2751-0a16-44e3-b6c6-29a461840852 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2b4a452c-dd09-4dd6-ab90-bd7d584343e5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:42.703417 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-159b2751-0a16-44e3-b6c6-29a461840852 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:42.703990 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-159b2751-0a16-44e3-b6c6-29a461840852 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:42.706554 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-159b2751-0a16-44e3-b6c6-29a461840852 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:42.707104 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-159b2751-0a16-44e3-b6c6-29a461840852 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:42.733200 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3840c2dc-5b3a-42dc-86f9-b0e2b4377532 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:42.743045 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3840c2dc-5b3a-42dc-86f9-b0e2b4377532 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/89bd86f8-830e-44ed-82a9-7b77e67606f8" status: 200 len: 1316 microversion: 2.1 time: 1.100590 Jul 18 02:14:42.762141 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 760/1496] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:41 2022] GET /compute/v2.1/servers/89bd86f8-830e-44ed-82a9-7b77e67606f8 => generated 1316 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:14:42.818739 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:42.910526 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-159b2751-0a16-44e3-b6c6-29a461840852 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:42.927538 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-159b2751-0a16-44e3-b6c6-29a461840852 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:42.941584 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-159b2751-0a16-44e3-b6c6-29a461840852 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:42.957580 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-159b2751-0a16-44e3-b6c6-29a461840852 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5" status: 200 len: 1320 microversion: 2.25 time: 0.270669 Jul 18 02:14:42.964789 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 737/1497] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:14:42 2022] GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5 => generated 1320 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:14:43.426868 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3ae534c3-ba8c-4aa7-b032-056f8a03e883 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a8e89550>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:43.596331 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3ae534c3-ba8c-4aa7-b032-056f8a03e883 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b" status: 200 len: 1454 microversion: 2.1 time: 0.176965 Jul 18 02:14:43.602820 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 761/1498] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:14:43 2022] GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b => generated 1454 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:43.765273 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a7eb5e06-ae4e-4b0b-8e6c-d94c4bbb5bb6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:43.765963 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a7eb5e06-ae4e-4b0b-8e6c-d94c4bbb5bb6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 89bd86f8-830e-44ed-82a9-7b77e67606f8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:43.784137 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a7eb5e06-ae4e-4b0b-8e6c-d94c4bbb5bb6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:43.784614 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a7eb5e06-ae4e-4b0b-8e6c-d94c4bbb5bb6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:43.785406 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a7eb5e06-ae4e-4b0b-8e6c-d94c4bbb5bb6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:43.785898 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a7eb5e06-ae4e-4b0b-8e6c-d94c4bbb5bb6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:43.980977 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-07536606-96a0-49f8-93cf-de31374c7f93 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:43.981782 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-07536606-96a0-49f8-93cf-de31374c7f93 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2b4a452c-dd09-4dd6-ab90-bd7d584343e5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:44.031080 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-07536606-96a0-49f8-93cf-de31374c7f93 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:44.032000 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-07536606-96a0-49f8-93cf-de31374c7f93 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:44.033030 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-07536606-96a0-49f8-93cf-de31374c7f93 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:44.033659 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-07536606-96a0-49f8-93cf-de31374c7f93 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:44.937031 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a7eb5e06-ae4e-4b0b-8e6c-d94c4bbb5bb6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:44.984713 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a7eb5e06-ae4e-4b0b-8e6c-d94c4bbb5bb6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/89bd86f8-830e-44ed-82a9-7b77e67606f8" status: 200 len: 1316 microversion: 2.1 time: 1.214049 Jul 18 02:14:44.996329 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 738/1499] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:43 2022] GET /compute/v2.1/servers/89bd86f8-830e-44ed-82a9-7b77e67606f8 => generated 1316 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:45.441180 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-97e39e9d-8c61-4547-b9e4-72c9f4092271 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1725171419", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:45.729147 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-97e39e9d-8c61-4547-b9e4-72c9f4092271 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] validate_networks() for None {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:14:46.167589 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:46.247409 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-07536606-96a0-49f8-93cf-de31374c7f93 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:46.260628 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-07536606-96a0-49f8-93cf-de31374c7f93 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:46.288495 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-07536606-96a0-49f8-93cf-de31374c7f93 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:46.291920 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-07536606-96a0-49f8-93cf-de31374c7f93 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5" status: 200 len: 1362 microversion: 2.25 time: 2.316010 Jul 18 02:14:46.298961 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 762/1500] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:14:43 2022] GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5 => generated 1362 bytes in 2324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:14:46.337824 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-14834573-1031-4d49-82cb-3df361f707bb tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a93b8790>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:46.370089 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=8 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:46.612586 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-14834573-1031-4d49-82cb-3df361f707bb tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b" status: 200 len: 1454 microversion: 2.1 time: 0.307224 Jul 18 02:14:46.613783 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 763/1501] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:14:46 2022] GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b => generated 1454 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:46.646827 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-b66c130c-7db1-4976-a0ea-d0768930c934 req-33848c1c-5ad7-49b4-bda5-32a66fb27203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89bd86f8-830e-44ed-82a9-7b77e67606f8", "tag": "98d74ed7-ac53-4ee9-ba76-5139d7273944"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:46.693277 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-b66c130c-7db1-4976-a0ea-d0768930c934 req-33848c1c-5ad7-49b4-bda5-32a66fb27203 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:46.694204 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-b66c130c-7db1-4976-a0ea-d0768930c934 req-33848c1c-5ad7-49b4-bda5-32a66fb27203 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:46.741542 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-b66c130c-7db1-4976-a0ea-d0768930c934 req-33848c1c-5ad7-49b4-bda5-32a66fb27203 service nova] Creating event network-changed:98d74ed7-ac53-4ee9-ba76-5139d7273944 for instance 89bd86f8-830e-44ed-82a9-7b77e67606f8 on n-h2-465891-3 Jul 18 02:14:46.780471 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-b66c130c-7db1-4976-a0ea-d0768930c934 req-33848c1c-5ad7-49b4-bda5-32a66fb27203 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157659 Jul 18 02:14:46.781595 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 764/1502] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:46.787779 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f70c983f-8448-410e-90dc-a4516c958c5d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:46.788897 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f70c983f-8448-410e-90dc-a4516c958c5d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 89bd86f8-830e-44ed-82a9-7b77e67606f8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:46.797605 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f70c983f-8448-410e-90dc-a4516c958c5d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:46.798621 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f70c983f-8448-410e-90dc-a4516c958c5d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:46.799703 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f70c983f-8448-410e-90dc-a4516c958c5d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:46.800840 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f70c983f-8448-410e-90dc-a4516c958c5d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:46.906368 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=10 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:47.695002 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-97e39e9d-8c61-4547-b9e4-72c9f4092271 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:14:47.695935 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-97e39e9d-8c61-4547-b9e4-72c9f4092271 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:14:47.696925 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-97e39e9d-8c61-4547-b9e4-72c9f4092271 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:14:47.697782 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-97e39e9d-8c61-4547-b9e4-72c9f4092271 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:14:47.698523 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-97e39e9d-8c61-4547-b9e4-72c9f4092271 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:14:47.753642 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-97e39e9d-8c61-4547-b9e4-72c9f4092271 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:47.758361 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-97e39e9d-8c61-4547-b9e4-72c9f4092271 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:47.761693 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-97e39e9d-8c61-4547-b9e4-72c9f4092271 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:47.762530 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-97e39e9d-8c61-4547-b9e4-72c9f4092271 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:47.836939 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-97e39e9d-8c61-4547-b9e4-72c9f4092271 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Getting quotas for project f0c8e07f8a9b4a398614fcf02c561416. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:14:47.858324 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-97e39e9d-8c61-4547-b9e4-72c9f4092271 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Getting quotas for user 9ca28fb70d1545b087bce52f2975a1ea and project f0c8e07f8a9b4a398614fcf02c561416. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:14:47.893942 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-97e39e9d-8c61-4547-b9e4-72c9f4092271 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:14:47.899101 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-97e39e9d-8c61-4547-b9e4-72c9f4092271 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] [instance: 32361df9-4e50-409c-9cc7-6f70ba6ce26e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:14:48.027701 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-97e39e9d-8c61-4547-b9e4-72c9f4092271 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.025022 Jul 18 02:14:48.038535 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 739/1503] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:14:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 3037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:14:48.050624 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0ad628db-43c6-4629-8edb-66033b0eac15 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:48.061984 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0ad628db-43c6-4629-8edb-66033b0eac15 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2b4a452c-dd09-4dd6-ab90-bd7d584343e5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:48.080473 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f70c983f-8448-410e-90dc-a4516c958c5d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:48.083753 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0ad628db-43c6-4629-8edb-66033b0eac15 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:48.089073 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0ad628db-43c6-4629-8edb-66033b0eac15 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:48.094942 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0ad628db-43c6-4629-8edb-66033b0eac15 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:48.098060 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0ad628db-43c6-4629-8edb-66033b0eac15 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:48.148346 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f70c983f-8448-410e-90dc-a4516c958c5d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/89bd86f8-830e-44ed-82a9-7b77e67606f8" status: 200 len: 1316 microversion: 2.1 time: 1.364713 Jul 18 02:14:48.166932 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 765/1504] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:46 2022] GET /compute/v2.1/servers/89bd86f8-830e-44ed-82a9-7b77e67606f8 => generated 1316 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:48.409433 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ebd1225f-3fc5-45fa-9a75-e767c9b2c60a tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-904405666", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:48.702232 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-ebd1225f-3fc5-45fa-9a75-e767c9b2c60a tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] validate_networks() for [('52a44372-961a-4af7-89e6-8796aa5e1c76', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:14:49.047021 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0ad628db-43c6-4629-8edb-66033b0eac15 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:49.108098 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0ad628db-43c6-4629-8edb-66033b0eac15 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:49.111896 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0ad628db-43c6-4629-8edb-66033b0eac15 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:49.120765 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0ad628db-43c6-4629-8edb-66033b0eac15 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5" status: 200 len: 1362 microversion: 2.25 time: 1.075854 Jul 18 02:14:49.142374 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 740/1505] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:14:48 2022] GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5 => generated 1362 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:14:49.175578 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fbea2f50-aea4-45a8-9fda-a58bc8a37ad5 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a880b3a0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:49.302497 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fbea2f50-aea4-45a8-9fda-a58bc8a37ad5 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b" status: 200 len: 1454 microversion: 2.1 time: 0.145639 Jul 18 02:14:49.326202 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 741/1506] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:14:49 2022] GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b => generated 1454 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:49.335301 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-57732841-a128-4e7b-99fc-94463174497a tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:49.336881 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-57732841-a128-4e7b-99fc-94463174497a tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] [instance: 32361df9-4e50-409c-9cc7-6f70ba6ce26e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:49.951279 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-57732841-a128-4e7b-99fc-94463174497a tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28fb70d1545b087bce52f2975a1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c8e07f8a9b4a398614fcf02c561416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:49.964827 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-57732841-a128-4e7b-99fc-94463174497a tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e" status: 200 len: 1217 microversion: 2.1 time: 0.636641 Jul 18 02:14:49.965440 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 742/1507] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:49 2022] GET /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e => generated 1217 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:49.995149 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-709827f2-7992-4278-a662-2f9bae2bc268 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:49.995149 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-709827f2-7992-4278-a662-2f9bae2bc268 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 89bd86f8-830e-44ed-82a9-7b77e67606f8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:50.042902 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-709827f2-7992-4278-a662-2f9bae2bc268 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:50.049729 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-709827f2-7992-4278-a662-2f9bae2bc268 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:50.052241 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-709827f2-7992-4278-a662-2f9bae2bc268 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:50.052661 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-709827f2-7992-4278-a662-2f9bae2bc268 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:51.434667 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-ebd1225f-3fc5-45fa-9a75-e767c9b2c60a tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:14:51.436439 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-ebd1225f-3fc5-45fa-9a75-e767c9b2c60a tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:14:51.437470 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-ebd1225f-3fc5-45fa-9a75-e767c9b2c60a tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:14:51.438179 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-ebd1225f-3fc5-45fa-9a75-e767c9b2c60a tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:14:51.438951 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-ebd1225f-3fc5-45fa-9a75-e767c9b2c60a tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:14:51.452039 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:51.473793 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ebd1225f-3fc5-45fa-9a75-e767c9b2c60a tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:51.474700 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ebd1225f-3fc5-45fa-9a75-e767c9b2c60a tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:51.475903 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ebd1225f-3fc5-45fa-9a75-e767c9b2c60a tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:51.476560 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ebd1225f-3fc5-45fa-9a75-e767c9b2c60a tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:51.542863 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-ebd1225f-3fc5-45fa-9a75-e767c9b2c60a tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Getting quotas for project 5ab10eb9b4cc4b13a640f5479056ab79. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:14:51.558668 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-ebd1225f-3fc5-45fa-9a75-e767c9b2c60a tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Getting quotas for user 9472908374c94355ada94f4947c99f6a and project 5ab10eb9b4cc4b13a640f5479056ab79. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:14:51.595420 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ebd1225f-3fc5-45fa-9a75-e767c9b2c60a tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:14:51.600708 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ebd1225f-3fc5-45fa-9a75-e767c9b2c60a tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:14:51.819978 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ebd1225f-3fc5-45fa-9a75-e767c9b2c60a tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.651368 Jul 18 02:14:51.821107 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 766/1508] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:14:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 3654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:14:51.832173 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-709827f2-7992-4278-a662-2f9bae2bc268 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:51.835403 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7a330bcd-630c-4ffe-846e-7d550ab33957 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:51.841455 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7a330bcd-630c-4ffe-846e-7d550ab33957 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2b4a452c-dd09-4dd6-ab90-bd7d584343e5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:51.858488 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7a330bcd-630c-4ffe-846e-7d550ab33957 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:51.859407 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7a330bcd-630c-4ffe-846e-7d550ab33957 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:51.860430 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-709827f2-7992-4278-a662-2f9bae2bc268 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/89bd86f8-830e-44ed-82a9-7b77e67606f8" status: 200 len: 1316 microversion: 2.1 time: 1.889295 Jul 18 02:14:51.860688 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7a330bcd-630c-4ffe-846e-7d550ab33957 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:51.861047 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 743/1509] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:49 2022] GET /compute/v2.1/servers/89bd86f8-830e-44ed-82a9-7b77e67606f8 => generated 1316 bytes in 1891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:51.861587 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7a330bcd-630c-4ffe-846e-7d550ab33957 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:51.923948 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e432349f-6058-472c-8fca-a82ea3e5ebf0 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a8a43f70>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:52.240335 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e432349f-6058-472c-8fca-a82ea3e5ebf0 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b" status: 200 len: 1454 microversion: 2.1 time: 0.354224 Jul 18 02:14:52.241419 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 744/1510] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:14:51 2022] GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b => generated 1454 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:52.256282 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-20d3a8c4-6c44-43b1-8321-9c9d9ae1f376 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:52.265355 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-20d3a8c4-6c44-43b1-8321-9c9d9ae1f376 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] [instance: 32361df9-4e50-409c-9cc7-6f70ba6ce26e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:52.304828 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20d3a8c4-6c44-43b1-8321-9c9d9ae1f376 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:52.305451 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20d3a8c4-6c44-43b1-8321-9c9d9ae1f376 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:52.310523 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20d3a8c4-6c44-43b1-8321-9c9d9ae1f376 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:52.310987 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20d3a8c4-6c44-43b1-8321-9c9d9ae1f376 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:53.810283 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-20d3a8c4-6c44-43b1-8321-9c9d9ae1f376 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28fb70d1545b087bce52f2975a1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c8e07f8a9b4a398614fcf02c561416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:53.848962 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-20d3a8c4-6c44-43b1-8321-9c9d9ae1f376 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e" status: 200 len: 1275 microversion: 2.1 time: 1.606057 Jul 18 02:14:53.856657 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 745/1511] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:52 2022] GET /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e => generated 1275 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:53.894001 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-84302224-0518-4d5e-a6c4-5f35df05d26c tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:53.895119 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-84302224-0518-4d5e-a6c4-5f35df05d26c tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:53.905909 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-84302224-0518-4d5e-a6c4-5f35df05d26c tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:53.906776 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-84302224-0518-4d5e-a6c4-5f35df05d26c tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:53.908321 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-84302224-0518-4d5e-a6c4-5f35df05d26c tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:53.909487 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-84302224-0518-4d5e-a6c4-5f35df05d26c tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:54.201288 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7a330bcd-630c-4ffe-846e-7d550ab33957 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:54.250197 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7a330bcd-630c-4ffe-846e-7d550ab33957 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:54.255940 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7a330bcd-630c-4ffe-846e-7d550ab33957 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:54.270879 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7a330bcd-630c-4ffe-846e-7d550ab33957 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5" status: 200 len: 1362 microversion: 2.25 time: 2.435955 Jul 18 02:14:54.272991 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 767/1512] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:14:51 2022] GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5 => generated 1362 bytes in 2451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:14:54.286726 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-e8cffe23-f6ed-45ea-a028-e0064b2d0d32 req-df043c1d-56be-4bdd-9a54-2a1f850b4c0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b4a452c-dd09-4dd6-ab90-bd7d584343e5", "tag": "a4f23488-d99c-41fb-8662-75c98bd2a84e"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:54.310837 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-e8cffe23-f6ed-45ea-a028-e0064b2d0d32 req-df043c1d-56be-4bdd-9a54-2a1f850b4c0c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:54.313056 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-e8cffe23-f6ed-45ea-a028-e0064b2d0d32 req-df043c1d-56be-4bdd-9a54-2a1f850b4c0c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:54.374461 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-e8cffe23-f6ed-45ea-a028-e0064b2d0d32 req-df043c1d-56be-4bdd-9a54-2a1f850b4c0c service nova] Creating event network-changed:a4f23488-d99c-41fb-8662-75c98bd2a84e for instance 2b4a452c-dd09-4dd6-ab90-bd7d584343e5 on n-h1-465891-3 Jul 18 02:14:54.403165 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-e8cffe23-f6ed-45ea-a028-e0064b2d0d32 req-df043c1d-56be-4bdd-9a54-2a1f850b4c0c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124962 Jul 18 02:14:54.407639 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 768/1513] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:54.437309 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2b1c3bea-3716-4959-a7af-7bb0892817bb tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:54.439314 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2b1c3bea-3716-4959-a7af-7bb0892817bb tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 89bd86f8-830e-44ed-82a9-7b77e67606f8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:54.460890 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2b1c3bea-3716-4959-a7af-7bb0892817bb tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:54.469188 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2b1c3bea-3716-4959-a7af-7bb0892817bb tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:54.478233 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2b1c3bea-3716-4959-a7af-7bb0892817bb tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:54.479421 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2b1c3bea-3716-4959-a7af-7bb0892817bb tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:54.723187 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-84302224-0518-4d5e-a6c4-5f35df05d26c tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9472908374c94355ada94f4947c99f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab10eb9b4cc4b13a640f5479056ab79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:54.746181 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-84302224-0518-4d5e-a6c4-5f35df05d26c tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] 10.222.0.57 "GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee" status: 200 len: 1226 microversion: 2.1 time: 0.870001 Jul 18 02:14:54.769204 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 746/1514] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:53 2022] GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee => generated 1226 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:54.778582 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dc7a5076-7a51-4e67-b73e-2f3a22bfb5ec tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a879e3a0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:54.957681 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-dc7a5076-7a51-4e67-b73e-2f3a22bfb5ec tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b" status: 200 len: 1454 microversion: 2.1 time: 0.186779 Jul 18 02:14:54.963746 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 747/1515] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:14:54 2022] GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b => generated 1454 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:54.980594 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dc724caf-38fb-4ca5-986f-20a99737b215 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "284d37b1-7db7-4c72-9ce2-af39cb505e9e"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:55.002933 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-dc724caf-38fb-4ca5-986f-20a99737b215 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: b74ae52f-6794-49d2-867e-be0996b090aa] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:55.032885 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dc724caf-38fb-4ca5-986f-20a99737b215 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:55.040719 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dc724caf-38fb-4ca5-986f-20a99737b215 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:55.043991 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dc724caf-38fb-4ca5-986f-20a99737b215 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:55.049221 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dc724caf-38fb-4ca5-986f-20a99737b215 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:55.846022 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2b1c3bea-3716-4959-a7af-7bb0892817bb tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:55.898961 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2b1c3bea-3716-4959-a7af-7bb0892817bb tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/89bd86f8-830e-44ed-82a9-7b77e67606f8" status: 200 len: 1316 microversion: 2.1 time: 1.485632 Jul 18 02:14:55.904763 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 769/1516] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:54 2022] GET /compute/v2.1/servers/89bd86f8-830e-44ed-82a9-7b77e67606f8 => generated 1316 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:55.938817 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-eef9c02f-28f1-4305-81e0-f26225ea2c0b tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:55.942231 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-eef9c02f-28f1-4305-81e0-f26225ea2c0b tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:55.968352 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eef9c02f-28f1-4305-81e0-f26225ea2c0b tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:55.971250 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eef9c02f-28f1-4305-81e0-f26225ea2c0b tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:55.981001 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eef9c02f-28f1-4305-81e0-f26225ea2c0b tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:55.982105 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eef9c02f-28f1-4305-81e0-f26225ea2c0b tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:56.223029 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-dc724caf-38fb-4ca5-986f-20a99737b215 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "POST /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.256372 Jul 18 02:14:56.226609 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 748/1517] 10.222.0.57 () {60 vars in 1322 bytes} [Mon Jul 18 02:14:54 2022] POST /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa/os-volume_attachments => generated 194 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:56.246782 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-56c7a0ab-aaf8-453a-937d-bbd93d1e9758 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:56.248556 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-56c7a0ab-aaf8-453a-937d-bbd93d1e9758 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] [instance: 32361df9-4e50-409c-9cc7-6f70ba6ce26e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:56.280847 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56c7a0ab-aaf8-453a-937d-bbd93d1e9758 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:56.283908 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56c7a0ab-aaf8-453a-937d-bbd93d1e9758 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:56.286634 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56c7a0ab-aaf8-453a-937d-bbd93d1e9758 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:56.288777 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56c7a0ab-aaf8-453a-937d-bbd93d1e9758 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:57.238932 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=99 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:57.250493 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-eef9c02f-28f1-4305-81e0-f26225ea2c0b tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 200 len: 1811 microversion: 2.1 time: 1.343224 Jul 18 02:14:57.266726 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 770/1518] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:55 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 1811 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:57.274172 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f7c87880-23dc-43c4-8fca-79b4bd3ea2c1 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:57.276008 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f7c87880-23dc-43c4-8fca-79b4bd3ea2c1 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2b4a452c-dd09-4dd6-ab90-bd7d584343e5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:57.284985 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f7c87880-23dc-43c4-8fca-79b4bd3ea2c1 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:57.286469 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f7c87880-23dc-43c4-8fca-79b4bd3ea2c1 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:57.288226 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f7c87880-23dc-43c4-8fca-79b4bd3ea2c1 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:57.288946 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f7c87880-23dc-43c4-8fca-79b4bd3ea2c1 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:57.318758 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-56c7a0ab-aaf8-453a-937d-bbd93d1e9758 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28fb70d1545b087bce52f2975a1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c8e07f8a9b4a398614fcf02c561416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:57.330504 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-56c7a0ab-aaf8-453a-937d-bbd93d1e9758 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e" status: 200 len: 1317 microversion: 2.1 time: 1.100807 Jul 18 02:14:57.331579 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 749/1519] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:56 2022] GET /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e => generated 1317 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:57.348946 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ab7737fc-7200-4939-a971-85ec9c34d907 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:57.350295 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ab7737fc-7200-4939-a971-85ec9c34d907 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:57.373520 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ab7737fc-7200-4939-a971-85ec9c34d907 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:57.376741 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ab7737fc-7200-4939-a971-85ec9c34d907 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:57.378672 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ab7737fc-7200-4939-a971-85ec9c34d907 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:57.382499 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ab7737fc-7200-4939-a971-85ec9c34d907 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:57.601248 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ab7737fc-7200-4939-a971-85ec9c34d907 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9472908374c94355ada94f4947c99f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab10eb9b4cc4b13a640f5479056ab79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:57.624179 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ab7737fc-7200-4939-a971-85ec9c34d907 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] 10.222.0.57 "GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee" status: 200 len: 1280 microversion: 2.1 time: 0.289796 Jul 18 02:14:57.625368 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 750/1520] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:57 2022] GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee => generated 1280 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:57.671814 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-dd37c05b-1518-4781-9a08-784d7516883c req-caf556cc-ae78-4aa8-b336-19508b7eabbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89bd86f8-830e-44ed-82a9-7b77e67606f8", "name": "network-vif-plugged", "status": "completed", "tag": "98d74ed7-ac53-4ee9-ba76-5139d7273944"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:57.711034 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-dd37c05b-1518-4781-9a08-784d7516883c req-caf556cc-ae78-4aa8-b336-19508b7eabbe service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:57.726185 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-dd37c05b-1518-4781-9a08-784d7516883c req-caf556cc-ae78-4aa8-b336-19508b7eabbe service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:57.778241 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-dd37c05b-1518-4781-9a08-784d7516883c req-caf556cc-ae78-4aa8-b336-19508b7eabbe service nova] Creating event network-vif-plugged:98d74ed7-ac53-4ee9-ba76-5139d7273944 for instance 89bd86f8-830e-44ed-82a9-7b77e67606f8 on n-h2-465891-3 Jul 18 02:14:57.793389 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-dd37c05b-1518-4781-9a08-784d7516883c req-caf556cc-ae78-4aa8-b336-19508b7eabbe service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157537 Jul 18 02:14:57.794440 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 751/1521] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:57.800034 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d3b1868d-48b1-4312-9935-58155a606a1a tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4add804c0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:57.814542 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:57.889676 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d3b1868d-48b1-4312-9935-58155a606a1a tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b" status: 200 len: 1454 microversion: 2.1 time: 0.094060 Jul 18 02:14:57.894205 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 752/1522] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:14:57 2022] GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b => generated 1454 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:57.903669 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7a7f8b13-82d2-4327-be0e-7a30dbd4a395 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:57.903669 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7a7f8b13-82d2-4327-be0e-7a30dbd4a395 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 89bd86f8-830e-44ed-82a9-7b77e67606f8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:57.911345 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7a7f8b13-82d2-4327-be0e-7a30dbd4a395 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:57.911800 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7a7f8b13-82d2-4327-be0e-7a30dbd4a395 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:57.912796 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7a7f8b13-82d2-4327-be0e-7a30dbd4a395 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:57.913413 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7a7f8b13-82d2-4327-be0e-7a30dbd4a395 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:58.566613 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7a7f8b13-82d2-4327-be0e-7a30dbd4a395 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:58.575873 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7a7f8b13-82d2-4327-be0e-7a30dbd4a395 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/89bd86f8-830e-44ed-82a9-7b77e67606f8" status: 200 len: 1316 microversion: 2.1 time: 0.680475 Jul 18 02:14:58.582053 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 753/1523] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:57 2022] GET /compute/v2.1/servers/89bd86f8-830e-44ed-82a9-7b77e67606f8 => generated 1316 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:58.590859 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-85e8f628-da2d-418f-a4f8-6c32617714a0 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:58.594012 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:14:58.594012 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:14:58.602687 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85e8f628-da2d-418f-a4f8-6c32617714a0 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:58.606470 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85e8f628-da2d-418f-a4f8-6c32617714a0 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:58.607714 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85e8f628-da2d-418f-a4f8-6c32617714a0 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:58.608835 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85e8f628-da2d-418f-a4f8-6c32617714a0 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:58.685749 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-85e8f628-da2d-418f-a4f8-6c32617714a0 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.102416 Jul 18 02:14:58.692230 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 754/1524] 10.222.0.57 () {58 vars in 1175 bytes} [Mon Jul 18 02:14:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:58.713830 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6c762215-246b-4710-a54f-1a87c501b3fd tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:58.714727 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6c762215-246b-4710-a54f-1a87c501b3fd tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] [instance: 32361df9-4e50-409c-9cc7-6f70ba6ce26e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:58.747131 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6c762215-246b-4710-a54f-1a87c501b3fd tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:58.764418 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6c762215-246b-4710-a54f-1a87c501b3fd tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:58.770379 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6c762215-246b-4710-a54f-1a87c501b3fd tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:58.778021 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6c762215-246b-4710-a54f-1a87c501b3fd tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:58.974807 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f7c87880-23dc-43c4-8fca-79b4bd3ea2c1 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:59.033031 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f7c87880-23dc-43c4-8fca-79b4bd3ea2c1 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:59.042148 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f7c87880-23dc-43c4-8fca-79b4bd3ea2c1 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:59.049613 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f7c87880-23dc-43c4-8fca-79b4bd3ea2c1 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5" status: 200 len: 1362 microversion: 2.25 time: 1.780347 Jul 18 02:14:59.052943 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 771/1525] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:14:57 2022] GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5 => generated 1362 bytes in 1785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:14:59.076297 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-42d49f57-25b0-4c41-8131-6289c22ff552 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:59.094817 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-42d49f57-25b0-4c41-8131-6289c22ff552 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:59.131929 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-42d49f57-25b0-4c41-8131-6289c22ff552 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:59.134557 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-42d49f57-25b0-4c41-8131-6289c22ff552 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:59.157016 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-42d49f57-25b0-4c41-8131-6289c22ff552 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:59.160513 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-42d49f57-25b0-4c41-8131-6289c22ff552 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:59.339265 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6c762215-246b-4710-a54f-1a87c501b3fd tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28fb70d1545b087bce52f2975a1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c8e07f8a9b4a398614fcf02c561416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:59.374973 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6c762215-246b-4710-a54f-1a87c501b3fd tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e" status: 200 len: 1317 microversion: 2.1 time: 0.672335 Jul 18 02:14:59.384917 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 755/1526] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:58 2022] GET /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e => generated 1317 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:59.397734 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-80bdf7e4-fd49-4ab6-9f32-e3d773bd5af1 req-1ba0d5a2-da0d-4614-ba51-db8709fbfbd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32361df9-4e50-409c-9cc7-6f70ba6ce26e", "tag": "7c604958-4d5c-4ace-8013-9827944aa0c6"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:59.452616 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-80bdf7e4-fd49-4ab6-9f32-e3d773bd5af1 req-1ba0d5a2-da0d-4614-ba51-db8709fbfbd3 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:59.458665 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-80bdf7e4-fd49-4ab6-9f32-e3d773bd5af1 req-1ba0d5a2-da0d-4614-ba51-db8709fbfbd3 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:59.541530 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-80bdf7e4-fd49-4ab6-9f32-e3d773bd5af1 req-1ba0d5a2-da0d-4614-ba51-db8709fbfbd3 service nova] Creating event network-changed:7c604958-4d5c-4ace-8013-9827944aa0c6 for instance 32361df9-4e50-409c-9cc7-6f70ba6ce26e on n-h1-465891-3 Jul 18 02:14:59.589758 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-80bdf7e4-fd49-4ab6-9f32-e3d773bd5af1 req-1ba0d5a2-da0d-4614-ba51-db8709fbfbd3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.202013 Jul 18 02:14:59.601539 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 756/1527] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:59.621829 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-42d49f57-25b0-4c41-8131-6289c22ff552 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9472908374c94355ada94f4947c99f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab10eb9b4cc4b13a640f5479056ab79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:59.628464 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ce1f6d3f-9db3-49d8-a97a-750f7f5626f8 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4add7cdc0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:59.660439 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-42d49f57-25b0-4c41-8131-6289c22ff552 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] 10.222.0.57 "GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee" status: 200 len: 1280 microversion: 2.1 time: 0.596834 Jul 18 02:14:59.675519 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 772/1528] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:59 2022] GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee => generated 1280 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:59.732974 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-82ac9369-62a4-46b9-a820-f72769eacf09 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:59.736694 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-82ac9369-62a4-46b9-a820-f72769eacf09 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 89bd86f8-830e-44ed-82a9-7b77e67606f8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:59.788562 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-82ac9369-62a4-46b9-a820-f72769eacf09 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:59.794577 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-82ac9369-62a4-46b9-a820-f72769eacf09 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:59.798428 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-82ac9369-62a4-46b9-a820-f72769eacf09 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:59.803474 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-82ac9369-62a4-46b9-a820-f72769eacf09 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:59.956569 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=8 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:59.989170 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ce1f6d3f-9db3-49d8-a97a-750f7f5626f8 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b" status: 200 len: 1454 microversion: 2.1 time: 0.377310 Jul 18 02:14:59.998864 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 757/1529] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:14:59 2022] GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b => generated 1454 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:00.072652 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7c7a4dd6-23b0-45b7-af57-fb10004850a6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:00.073669 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7c7a4dd6-23b0-45b7-af57-fb10004850a6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2b4a452c-dd09-4dd6-ab90-bd7d584343e5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:00.109847 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7c7a4dd6-23b0-45b7-af57-fb10004850a6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:00.110305 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7c7a4dd6-23b0-45b7-af57-fb10004850a6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:00.118321 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7c7a4dd6-23b0-45b7-af57-fb10004850a6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:00.125979 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7c7a4dd6-23b0-45b7-af57-fb10004850a6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:00.158248 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:01.381442 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-82ac9369-62a4-46b9-a820-f72769eacf09 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:01.399774 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-82ac9369-62a4-46b9-a820-f72769eacf09 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/89bd86f8-830e-44ed-82a9-7b77e67606f8" status: 200 len: 1316 microversion: 2.1 time: 1.722456 Jul 18 02:15:01.401677 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 773/1530] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:59 2022] GET /compute/v2.1/servers/89bd86f8-830e-44ed-82a9-7b77e67606f8 => generated 1316 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:01.497929 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:01.556947 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-56bd495a-91eb-488b-ab81-3bcab0827aa0 tempest-FloatingIPsNegativeTestJSON-1682617385 tempest-FloatingIPsNegativeTestJSON-1682617385-project] Calling method '.version_select at 0x7ff4a88c8160>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:01.572899 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7c7a4dd6-23b0-45b7-af57-fb10004850a6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:01.581200 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:01.603931 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7c7a4dd6-23b0-45b7-af57-fb10004850a6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:01.614459 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7c7a4dd6-23b0-45b7-af57-fb10004850a6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:01.618517 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7c7a4dd6-23b0-45b7-af57-fb10004850a6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5" status: 200 len: 1362 microversion: 2.25 time: 1.549716 Jul 18 02:15:01.636396 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 758/1531] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:15:00 2022] GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5 => generated 1362 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:15:01.655514 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b3f8f146-b18e-4e61-a6a1-c2993991ef05 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:01.658418 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b3f8f146-b18e-4e61-a6a1-c2993991ef05 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] [instance: 32361df9-4e50-409c-9cc7-6f70ba6ce26e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:01.685329 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b3f8f146-b18e-4e61-a6a1-c2993991ef05 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:01.688735 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b3f8f146-b18e-4e61-a6a1-c2993991ef05 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:01.692937 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b3f8f146-b18e-4e61-a6a1-c2993991ef05 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:01.694132 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b3f8f146-b18e-4e61-a6a1-c2993991ef05 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:01.915657 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-56bd495a-91eb-488b-ab81-3bcab0827aa0 tempest-FloatingIPsNegativeTestJSON-1682617385 tempest-FloatingIPsNegativeTestJSON-1682617385-project] 10.222.0.57 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.512143 Jul 18 02:15:01.918934 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 774/1532] 10.222.0.57 () {58 vars in 1148 bytes} [Mon Jul 18 02:15:01 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:15:01.931791 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c59f58b2-8252-415f-8e6d-1cf04cb22c1f tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:01.935208 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c59f58b2-8252-415f-8e6d-1cf04cb22c1f tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:01.962330 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c59f58b2-8252-415f-8e6d-1cf04cb22c1f tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:01.966385 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c59f58b2-8252-415f-8e6d-1cf04cb22c1f tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:01.967966 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c59f58b2-8252-415f-8e6d-1cf04cb22c1f tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:01.971687 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c59f58b2-8252-415f-8e6d-1cf04cb22c1f tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:02.392894 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b3f8f146-b18e-4e61-a6a1-c2993991ef05 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28fb70d1545b087bce52f2975a1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c8e07f8a9b4a398614fcf02c561416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:02.404125 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b3f8f146-b18e-4e61-a6a1-c2993991ef05 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e" status: 200 len: 1317 microversion: 2.1 time: 0.765522 Jul 18 02:15:02.419383 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 759/1533] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:01 2022] GET /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e => generated 1317 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:02.426179 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b774cb6f-0f1f-4b5a-803a-b1e28f5b5986 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a87afd30>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:02.511374 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b774cb6f-0f1f-4b5a-803a-b1e28f5b5986 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b" status: 200 len: 1463 microversion: 2.1 time: 0.090444 Jul 18 02:15:02.511925 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 760/1534] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:15:02 2022] GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b => generated 1463 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:02.524636 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4ce06056-a43e-426f-b132-4b3634c6bb84 tempest-FloatingIPsNegativeTestJSON-1682617385 tempest-FloatingIPsNegativeTestJSON-1682617385-project] Action: 'create', calling method: .version_select at 0x7ff4a885be50>, body: {"pool": "non_exist_pool"} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:02.543401 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c59f58b2-8252-415f-8e6d-1cf04cb22c1f tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9472908374c94355ada94f4947c99f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab10eb9b4cc4b13a640f5479056ab79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:02.558458 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c59f58b2-8252-415f-8e6d-1cf04cb22c1f tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] 10.222.0.57 "GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee" status: 200 len: 1322 microversion: 2.1 time: 0.636471 Jul 18 02:15:02.559444 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 775/1535] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:01 2022] GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee => generated 1322 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:02.572734 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cdc17c49-3e6b-40ab-99d2-a87c5cc53556 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:02.576554 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cdc17c49-3e6b-40ab-99d2-a87c5cc53556 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 89bd86f8-830e-44ed-82a9-7b77e67606f8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:02.587734 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cdc17c49-3e6b-40ab-99d2-a87c5cc53556 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:02.589159 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cdc17c49-3e6b-40ab-99d2-a87c5cc53556 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:02.591703 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cdc17c49-3e6b-40ab-99d2-a87c5cc53556 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:02.592888 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cdc17c49-3e6b-40ab-99d2-a87c5cc53556 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:02.613285 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-4ce06056-a43e-426f-b132-4b3634c6bb84 tempest-FloatingIPsNegativeTestJSON-1682617385 tempest-FloatingIPsNegativeTestJSON-1682617385-project] HTTP exception thrown: Floating IP pool not found. Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4ce06056-a43e-426f-b132-4b3634c6bb84 tempest-FloatingIPsNegativeTestJSON-1682617385 tempest-FloatingIPsNegativeTestJSON-1682617385-project] Request method failure captured: Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 26 Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MIjD-rsJcipMLyOpecnqoLgdwTeB0llA0dy77oymaK5Vx8hJDhvQeR6e8yEIVHUB5lqdpgI8FZW9uvLdSn6NiOqEMW3JhJkR-xOiuN5kAbE4AVOFnUSjBS6eo1ZKrC99kgcyWKYKVm4_lmrsCg_dm1aJGQF8YqKMzGNLzWR5Q69o_k Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: bdf68d9d6b634c74b8e8f3961e52b92c Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1682617385 Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_bdf68d9d6b634c74b8e8f3961e52b92c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bdf68d9d6b634c74b8e8f3961e52b92c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bdf68d9d6b634c74b8e8f3961e52b92c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/bdf68d9d6b634c74b8e8f3961e52b92c"}]}] Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1682617385 Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: bdf68d9d6b634c74b8e8f3961e52b92c Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1682617385 Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-FloatingIPsNegativeTestJSON-1682617385-project Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: cd60ec4f80594ea0b604cf4dc010f833 Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1682617385-project Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: {"pool": "non_exist_pool"} Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: exception: Floating IP pool not found. Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'body': {'pool': 'non_exist_pool'}} Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:15:02.615701 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:15:02.622355 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Jul 18 02:15:02.622355 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:15:02.622355 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4ce06056-a43e-426f-b132-4b3634c6bb84 tempest-FloatingIPsNegativeTestJSON-1682617385 tempest-FloatingIPsNegativeTestJSON-1682617385-project] Returning 404 to user: Floating IP pool not found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:15:02.622355 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4ce06056-a43e-426f-b132-4b3634c6bb84 tempest-FloatingIPsNegativeTestJSON-1682617385 tempest-FloatingIPsNegativeTestJSON-1682617385-project] 10.222.0.57 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.097531 Jul 18 02:15:02.623372 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 761/1536] 10.222.0.57 () {60 vars in 1169 bytes} [Mon Jul 18 02:15:02 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:15:02.631761 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3a07221f-2a61-4b2c-a593-5c5ce703ed60 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4add80dc0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:02.719587 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3a07221f-2a61-4b2c-a593-5c5ce703ed60 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b" status: 200 len: 1463 microversion: 2.1 time: 0.094956 Jul 18 02:15:02.727879 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 762/1537] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:15:02 2022] GET /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b => generated 1463 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:02.727879 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-76773fee-a062-4734-91b9-67df7141b299 tempest-FloatingIPsNegativeTestJSON-1682617385 tempest-FloatingIPsNegativeTestJSON-1682617385-project] Calling method '.version_select at 0x7ff4a885b0d0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:02.835524 n-d-465891-3 devstack@n-api.service[119543]: DEBUG neutronclient.v2_0.client [None req-76773fee-a062-4734-91b9-67df7141b299 tempest-FloatingIPsNegativeTestJSON-1682617385 tempest-FloatingIPsNegativeTestJSON-1682617385-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP bbbbd15e-678f-42ff-8a48-cf2ea24746d1 could not be found", "detail": ""}} {{(pid=119543) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:15:02.837486 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-76773fee-a062-4734-91b9-67df7141b299 tempest-FloatingIPsNegativeTestJSON-1682617385 tempest-FloatingIPsNegativeTestJSON-1682617385-project] HTTP exception thrown: Floating IP not found for ID bbbbd15e-678f-42ff-8a48-cf2ea24746d1 Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-76773fee-a062-4734-91b9-67df7141b299 tempest-FloatingIPsNegativeTestJSON-1682617385 tempest-FloatingIPsNegativeTestJSON-1682617385-project] Request method failure captured: Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/os-floating-ips/bbbbd15e-678f-42ff-8a48-cf2ea24746d1 HTTP/1.1 Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MIjD-rsJcipMLyOpecnqoLgdwTeB0llA0dy77oymaK5Vx8hJDhvQeR6e8yEIVHUB5lqdpgI8FZW9uvLdSn6NiOqEMW3JhJkR-xOiuN5kAbE4AVOFnUSjBS6eo1ZKrC99kgcyWKYKVm4_lmrsCg_dm1aJGQF8YqKMzGNLzWR5Q69o_k Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: bdf68d9d6b634c74b8e8f3961e52b92c Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1682617385 Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_bdf68d9d6b634c74b8e8f3961e52b92c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bdf68d9d6b634c74b8e8f3961e52b92c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bdf68d9d6b634c74b8e8f3961e52b92c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/bdf68d9d6b634c74b8e8f3961e52b92c"}]}] Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1682617385 Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: bdf68d9d6b634c74b8e8f3961e52b92c Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1682617385 Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-FloatingIPsNegativeTestJSON-1682617385-project Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: cd60ec4f80594ea0b604cf4dc010f833 Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1682617385-project Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: exception: Floating IP not found for ID bbbbd15e-678f-42ff-8a48-cf2ea24746d1 Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'bbbbd15e-678f-42ff-8a48-cf2ea24746d1'} Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP bbbbd15e-678f-42ff-8a48-cf2ea24746d1 could not be found Jul 18 02:15:02.838451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1de5e207-c154-4ff2-9e32-37b115fb838e'] Jul 18 02:15:02.850593 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:15:02.850593 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:02.850593 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:15:02.850593 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:02.850593 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 18 02:15:02.850593 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 18 02:15:02.850593 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 18 02:15:02.850593 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 18 02:15:02.850593 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID bbbbd15e-678f-42ff-8a48-cf2ea24746d1. Jul 18 02:15:02.850593 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:15:02.850593 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:02.850593 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:15:02.850593 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:02.850593 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:15:02.850593 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:15:02.850593 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:15:02.850593 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:15:02.850593 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:15:02.850593 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:15:02.850593 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:15:02.850593 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:15:02.850593 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 18 02:15:02.850593 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 18 02:15:02.850593 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID bbbbd15e-678f-42ff-8a48-cf2ea24746d1 Jul 18 02:15:02.850593 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:15:02.850593 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:02.850593 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:15:02.850593 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:02.850593 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:15:02.850593 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:15:02.850593 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:15:02.850593 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:15:02.850593 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID bbbbd15e-678f-42ff-8a48-cf2ea24746d1 Jul 18 02:15:02.850593 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:15:02.850593 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-76773fee-a062-4734-91b9-67df7141b299 tempest-FloatingIPsNegativeTestJSON-1682617385 tempest-FloatingIPsNegativeTestJSON-1682617385-project] Returning 404 to user: Floating IP not found for ID bbbbd15e-678f-42ff-8a48-cf2ea24746d1 {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:15:02.850593 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-76773fee-a062-4734-91b9-67df7141b299 tempest-FloatingIPsNegativeTestJSON-1682617385 tempest-FloatingIPsNegativeTestJSON-1682617385-project] 10.222.0.57 "DELETE /compute/v2.1/os-floating-ips/bbbbd15e-678f-42ff-8a48-cf2ea24746d1" status: 404 len: 111 microversion: 2.1 time: 0.121403 Jul 18 02:15:02.850593 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 763/1538] 10.222.0.57 () {58 vars in 1262 bytes} [Mon Jul 18 02:15:02 2022] DELETE /compute/v2.1/os-floating-ips/bbbbd15e-678f-42ff-8a48-cf2ea24746d1 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:15:02.892563 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-df3e9c0a-b187-4b88-a8cb-93beb468e7f3 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:02.893352 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-df3e9c0a-b187-4b88-a8cb-93beb468e7f3 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2b4a452c-dd09-4dd6-ab90-bd7d584343e5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:02.947327 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-df3e9c0a-b187-4b88-a8cb-93beb468e7f3 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:02.947841 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-df3e9c0a-b187-4b88-a8cb-93beb468e7f3 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:02.954517 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-df3e9c0a-b187-4b88-a8cb-93beb468e7f3 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:02.957630 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-df3e9c0a-b187-4b88-a8cb-93beb468e7f3 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:03.200138 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-cdc17c49-3e6b-40ab-99d2-a87c5cc53556 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:03.212810 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cdc17c49-3e6b-40ab-99d2-a87c5cc53556 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/89bd86f8-830e-44ed-82a9-7b77e67606f8" status: 200 len: 1465 microversion: 2.1 time: 0.651703 Jul 18 02:15:03.217076 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 776/1539] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:02 2022] GET /compute/v2.1/servers/89bd86f8-830e-44ed-82a9-7b77e67606f8 => generated 1465 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:03.243992 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4c43c695-2d5d-40be-991a-45bb0956c971 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:03.247496 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4c43c695-2d5d-40be-991a-45bb0956c971 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] [instance: 697075ff-db42-4729-8faf-2c2935d72630] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:03.266971 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4c43c695-2d5d-40be-991a-45bb0956c971 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:03.268184 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4c43c695-2d5d-40be-991a-45bb0956c971 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:03.270052 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4c43c695-2d5d-40be-991a-45bb0956c971 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:03.271340 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4c43c695-2d5d-40be-991a-45bb0956c971 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:03.458629 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-df3e9c0a-b187-4b88-a8cb-93beb468e7f3 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:03.484908 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-df3e9c0a-b187-4b88-a8cb-93beb468e7f3 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:03.492859 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-df3e9c0a-b187-4b88-a8cb-93beb468e7f3 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:03.494888 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-df3e9c0a-b187-4b88-a8cb-93beb468e7f3 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5" status: 200 len: 1362 microversion: 2.25 time: 0.649281 Jul 18 02:15:03.497976 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 764/1540] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:15:02 2022] GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5 => generated 1362 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:15:03.505090 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-174a7894-3401-4f4e-b026-69de4b16a652 tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:03.506139 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-174a7894-3401-4f4e-b026-69de4b16a652 tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] [instance: 89bd86f8-830e-44ed-82a9-7b77e67606f8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:03.516953 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-174a7894-3401-4f4e-b026-69de4b16a652 tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:03.518923 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-174a7894-3401-4f4e-b026-69de4b16a652 tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:03.522405 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-174a7894-3401-4f4e-b026-69de4b16a652 tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:03.523165 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-174a7894-3401-4f4e-b026-69de4b16a652 tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:03.745903 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4c43c695-2d5d-40be-991a-45bb0956c971 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a9dd4e239c4d73bdde1ced9cb90b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5d1b19c84a4a9fa4595a5c84f4555c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:03.771583 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4c43c695-2d5d-40be-991a-45bb0956c971 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/servers/697075ff-db42-4729-8faf-2c2935d72630" status: 200 len: 1468 microversion: 2.1 time: 0.537680 Jul 18 02:15:03.788259 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 777/1541] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:03 2022] GET /compute/v2.1/servers/697075ff-db42-4729-8faf-2c2935d72630 => generated 1468 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:03.800117 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7df1ab0c-8629-4552-a6a8-6cea5339daca tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:03.801131 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7df1ab0c-8629-4552-a6a8-6cea5339daca tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] [instance: 32361df9-4e50-409c-9cc7-6f70ba6ce26e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:03.843326 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7df1ab0c-8629-4552-a6a8-6cea5339daca tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:03.844500 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7df1ab0c-8629-4552-a6a8-6cea5339daca tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:03.846299 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7df1ab0c-8629-4552-a6a8-6cea5339daca tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:03.847330 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7df1ab0c-8629-4552-a6a8-6cea5339daca tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:04.169824 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-174a7894-3401-4f4e-b026-69de4b16a652 tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/89bd86f8-830e-44ed-82a9-7b77e67606f8" status: 200 len: 1616 microversion: 2.1 time: 0.670054 Jul 18 02:15:04.170970 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 765/1542] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:03 2022] GET /compute/v2.1/servers/89bd86f8-830e-44ed-82a9-7b77e67606f8 => generated 1616 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:04.181132 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bd713f6a-8426-41fb-8b0e-16c7af30b711 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:04.181968 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bd713f6a-8426-41fb-8b0e-16c7af30b711 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:04.223727 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bd713f6a-8426-41fb-8b0e-16c7af30b711 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:04.232463 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bd713f6a-8426-41fb-8b0e-16c7af30b711 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:04.240358 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bd713f6a-8426-41fb-8b0e-16c7af30b711 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:04.241167 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bd713f6a-8426-41fb-8b0e-16c7af30b711 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:04.788827 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7df1ab0c-8629-4552-a6a8-6cea5339daca tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28fb70d1545b087bce52f2975a1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c8e07f8a9b4a398614fcf02c561416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:04.803188 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7df1ab0c-8629-4552-a6a8-6cea5339daca tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e" status: 200 len: 1317 microversion: 2.1 time: 1.011717 Jul 18 02:15:04.815427 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 778/1543] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:03 2022] GET /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e => generated 1317 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:04.821456 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-4241e651-7cf7-4ee5-95b5-2d6eba24709e req-3d8d7703-e391-4f00-9163-7d9cd57f716b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ddcf97f-5c13-4ed6-ac5b-17368a126dee", "tag": "4d6c976a-bead-4367-8b9a-e4a14283ef03"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:04.831971 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-4241e651-7cf7-4ee5-95b5-2d6eba24709e req-3d8d7703-e391-4f00-9163-7d9cd57f716b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:04.832816 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-4241e651-7cf7-4ee5-95b5-2d6eba24709e req-3d8d7703-e391-4f00-9163-7d9cd57f716b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:04.849994 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-4241e651-7cf7-4ee5-95b5-2d6eba24709e req-3d8d7703-e391-4f00-9163-7d9cd57f716b service nova] Creating event network-changed:4d6c976a-bead-4367-8b9a-e4a14283ef03 for instance 7ddcf97f-5c13-4ed6-ac5b-17368a126dee on n-h2-465891-3 Jul 18 02:15:04.859529 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-4241e651-7cf7-4ee5-95b5-2d6eba24709e req-3d8d7703-e391-4f00-9163-7d9cd57f716b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041893 Jul 18 02:15:04.861354 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 779/1544] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:04.871981 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3fe6ce4a-270b-4b9b-a862-a4687a0f9a59 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a92f8e50>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:05.118918 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3fe6ce4a-270b-4b9b-a862-a4687a0f9a59 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images?changes-since=2022-07-18T02%3A12%3A10Z" status: 200 len: 1902 microversion: 2.1 time: 0.255353 Jul 18 02:15:05.124135 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 780/1545] 10.222.0.57 () {58 vars in 1198 bytes} [Mon Jul 18 02:15:04 2022] GET /compute/v2.1/images?changes-since=2022-07-18T02%3A12%3A10Z => generated 1902 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:05.137227 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-31fdde02-aaeb-459f-98fc-09d917e7979d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e0d785f-a071-4a01-b6aa-b3319594b5f1", "device": "/dev/xvdb"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:05.139613 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-31fdde02-aaeb-459f-98fc-09d917e7979d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:05.162120 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-31fdde02-aaeb-459f-98fc-09d917e7979d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:05.162926 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-31fdde02-aaeb-459f-98fc-09d917e7979d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:05.164526 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-31fdde02-aaeb-459f-98fc-09d917e7979d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:05.165211 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-31fdde02-aaeb-459f-98fc-09d917e7979d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:05.383886 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bd713f6a-8426-41fb-8b0e-16c7af30b711 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9472908374c94355ada94f4947c99f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab10eb9b4cc4b13a640f5479056ab79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:05.425216 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bd713f6a-8426-41fb-8b0e-16c7af30b711 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] 10.222.0.57 "GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee" status: 200 len: 1322 microversion: 2.1 time: 1.252723 Jul 18 02:15:05.432154 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 766/1546] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:04 2022] GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee => generated 1322 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:05.458182 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f20ab021-fc99-4200-a89a-f96fc581b037 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:05.459727 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f20ab021-fc99-4200-a89a-f96fc581b037 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2b4a452c-dd09-4dd6-ab90-bd7d584343e5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:05.474476 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:05.495501 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f20ab021-fc99-4200-a89a-f96fc581b037 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:05.499700 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f20ab021-fc99-4200-a89a-f96fc581b037 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:05.504654 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f20ab021-fc99-4200-a89a-f96fc581b037 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:05.506321 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f20ab021-fc99-4200-a89a-f96fc581b037 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:06.049349 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-31fdde02-aaeb-459f-98fc-09d917e7979d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "POST /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.919235 Jul 18 02:15:06.068953 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 781/1547] 10.222.0.57 () {60 vars in 1322 bytes} [Mon Jul 18 02:15:05 2022] POST /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f/os-volume_attachments => generated 194 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:06.100550 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-32c83562-3514-4517-a61c-e574d0ea3614 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1704829402", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["c207a0eb-5ef9-4932-9f3a-22f2a11129e5"]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:06.230083 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-32c83562-3514-4517-a61c-e574d0ea3614 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] validate_networks() for None {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:15:06.497066 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f20ab021-fc99-4200-a89a-f96fc581b037 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:06.510869 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f20ab021-fc99-4200-a89a-f96fc581b037 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:06.512503 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f20ab021-fc99-4200-a89a-f96fc581b037 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:06.514026 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f20ab021-fc99-4200-a89a-f96fc581b037 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5" status: 200 len: 1362 microversion: 2.25 time: 1.079499 Jul 18 02:15:06.526361 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 767/1548] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:15:05 2022] GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5 => generated 1362 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:15:06.534716 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-cd1026b1-7104-44e7-8027-87cc65d4fc8e req-0e932904-2afa-4411-a5cf-7a9f0b5ff9f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b4a452c-dd09-4dd6-ab90-bd7d584343e5", "name": "network-vif-plugged", "status": "completed", "tag": "a4f23488-d99c-41fb-8662-75c98bd2a84e"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:06.545044 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-cd1026b1-7104-44e7-8027-87cc65d4fc8e req-0e932904-2afa-4411-a5cf-7a9f0b5ff9f7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:06.545485 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-cd1026b1-7104-44e7-8027-87cc65d4fc8e req-0e932904-2afa-4411-a5cf-7a9f0b5ff9f7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:06.568491 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-cd1026b1-7104-44e7-8027-87cc65d4fc8e req-0e932904-2afa-4411-a5cf-7a9f0b5ff9f7 service nova] Creating event network-vif-plugged:a4f23488-d99c-41fb-8662-75c98bd2a84e for instance 2b4a452c-dd09-4dd6-ab90-bd7d584343e5 on n-h1-465891-3 Jul 18 02:15:06.587820 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-cd1026b1-7104-44e7-8027-87cc65d4fc8e req-0e932904-2afa-4411-a5cf-7a9f0b5ff9f7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058641 Jul 18 02:15:06.589137 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 768/1549] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:06.603776 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-39a9732b-ac59-4ad9-97a0-43007b829972 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4adced670>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:06.731739 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-39a9732b-ac59-4ad9-97a0-43007b829972 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1191470163" status: 200 len: 485 microversion: 2.1 time: 0.133850 Jul 18 02:15:06.734877 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 769/1550] 10.222.0.57 () {58 vars in 1230 bytes} [Mon Jul 18 02:15:06 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1191470163 => generated 485 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:06.752328 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-970bb101-995c-4a0f-8577-f0e625a454c9 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:06.754663 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-970bb101-995c-4a0f-8577-f0e625a454c9 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] [instance: 32361df9-4e50-409c-9cc7-6f70ba6ce26e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:06.789352 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-970bb101-995c-4a0f-8577-f0e625a454c9 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:06.790593 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-970bb101-995c-4a0f-8577-f0e625a454c9 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:06.792288 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-970bb101-995c-4a0f-8577-f0e625a454c9 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:06.798050 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-970bb101-995c-4a0f-8577-f0e625a454c9 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:07.048679 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-32c83562-3514-4517-a61c-e574d0ea3614 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:15:07.049416 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-32c83562-3514-4517-a61c-e574d0ea3614 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:15:07.050461 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-32c83562-3514-4517-a61c-e574d0ea3614 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:15:07.051048 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-32c83562-3514-4517-a61c-e574d0ea3614 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:15:07.051767 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-32c83562-3514-4517-a61c-e574d0ea3614 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:15:07.101091 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-32c83562-3514-4517-a61c-e574d0ea3614 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:07.101958 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-32c83562-3514-4517-a61c-e574d0ea3614 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:07.104007 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-32c83562-3514-4517-a61c-e574d0ea3614 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:07.104967 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-32c83562-3514-4517-a61c-e574d0ea3614 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:07.167975 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-32c83562-3514-4517-a61c-e574d0ea3614 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Getting quotas for project 8f8bb1ebead3481f946ae7878c3cfc41. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:15:07.191792 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-32c83562-3514-4517-a61c-e574d0ea3614 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Getting quotas for user 100f65c0d9d3456fa177599821aed7ff and project 8f8bb1ebead3481f946ae7878c3cfc41. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:15:07.235265 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-32c83562-3514-4517-a61c-e574d0ea3614 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:15:07.241525 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-32c83562-3514-4517-a61c-e574d0ea3614 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 85cf0fec-3e12-4af3-9525-925901fc41d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:15:07.383166 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-32c83562-3514-4517-a61c-e574d0ea3614 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.306025 Jul 18 02:15:07.384411 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 782/1551] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:15:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1314 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:15:07.396757 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-703d93d1-39ab-4598-a948-8f210e71e755 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:07.397864 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-703d93d1-39ab-4598-a948-8f210e71e755 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:07.408085 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-703d93d1-39ab-4598-a948-8f210e71e755 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:07.408940 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-703d93d1-39ab-4598-a948-8f210e71e755 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:07.410345 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-703d93d1-39ab-4598-a948-8f210e71e755 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:07.411839 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-703d93d1-39ab-4598-a948-8f210e71e755 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:07.748502 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-970bb101-995c-4a0f-8577-f0e625a454c9 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28fb70d1545b087bce52f2975a1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c8e07f8a9b4a398614fcf02c561416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:07.763876 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-970bb101-995c-4a0f-8577-f0e625a454c9 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e" status: 200 len: 1317 microversion: 2.1 time: 1.027124 Jul 18 02:15:07.765148 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 770/1552] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:06 2022] GET /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e => generated 1317 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:07.771775 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b032829d-1720-40c9-9a72-8d856c37d47c tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4add80430>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:07.953284 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b032829d-1720-40c9-9a72-8d856c37d47c tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images?server=697075ff-db42-4729-8faf-2c2935d72630" status: 200 len: 956 microversion: 2.1 time: 0.185092 Jul 18 02:15:07.954224 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 771/1553] 10.222.0.57 () {58 vars in 1208 bytes} [Mon Jul 18 02:15:07 2022] GET /compute/v2.1/images?server=697075ff-db42-4729-8faf-2c2935d72630 => generated 956 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:07.966449 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-77c0dd1d-da7b-4bfa-b015-e69a38966bfc tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:07.967548 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-77c0dd1d-da7b-4bfa-b015-e69a38966bfc tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 85cf0fec-3e12-4af3-9525-925901fc41d9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:07.999084 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-703d93d1-39ab-4598-a948-8f210e71e755 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9472908374c94355ada94f4947c99f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab10eb9b4cc4b13a640f5479056ab79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:08.012935 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-703d93d1-39ab-4598-a948-8f210e71e755 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] 10.222.0.57 "GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee" status: 200 len: 1322 microversion: 2.1 time: 0.616852 Jul 18 02:15:08.015058 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 783/1554] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:07 2022] GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee => generated 1322 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:08.026308 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f1366eea-45a6-445c-8752-8c95d4be662d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:08.032925 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f1366eea-45a6-445c-8752-8c95d4be662d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2b4a452c-dd09-4dd6-ab90-bd7d584343e5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:08.044873 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f1366eea-45a6-445c-8752-8c95d4be662d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:08.044873 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f1366eea-45a6-445c-8752-8c95d4be662d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:08.048931 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f1366eea-45a6-445c-8752-8c95d4be662d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:08.050951 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f1366eea-45a6-445c-8752-8c95d4be662d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:08.099255 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-77c0dd1d-da7b-4bfa-b015-e69a38966bfc tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:08.107576 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-77c0dd1d-da7b-4bfa-b015-e69a38966bfc tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/85cf0fec-3e12-4af3-9525-925901fc41d9" status: 200 len: 1217 microversion: 2.1 time: 0.151983 Jul 18 02:15:08.119944 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 772/1555] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:07 2022] GET /compute/v2.1/servers/85cf0fec-3e12-4af3-9525-925901fc41d9 => generated 1217 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:08.125977 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-40f7295f-8046-4f41-a68b-dcf7fd76894d tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4add805e0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:08.190049 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-40f7295f-8046-4f41-a68b-dcf7fd76894d tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.57%2Fcompute%2Fv2.1%2Fservers%2F32e81b5d-a507-4d47-b76e-699091d0e5bd" status: 200 len: 485 microversion: 2.1 time: 0.068576 Jul 18 02:15:08.192914 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 773/1556] 10.222.0.57 () {58 vars in 1316 bytes} [Mon Jul 18 02:15:08 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.57%2Fcompute%2Fv2.1%2Fservers%2F32e81b5d-a507-4d47-b76e-699091d0e5bd => generated 485 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:08.206979 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ee11e0f0-8a65-4f9a-8f7e-bdef75c319d0 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4adced820>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:08.291852 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ee11e0f0-8a65-4f9a-8f7e-bdef75c319d0 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.57%2Fcompute%2Fservers%2F32e81b5d-a507-4d47-b76e-699091d0e5bd" status: 200 len: 485 microversion: 2.1 time: 0.088529 Jul 18 02:15:08.292763 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 774/1557] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Jul 18 02:15:08 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.57%2Fcompute%2Fservers%2F32e81b5d-a507-4d47-b76e-699091d0e5bd => generated 485 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:08.318529 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-81e65bfc-e4a2-44b9-a3be-847d387a722d tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4add7c700>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:08.535552 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-81e65bfc-e4a2-44b9-a3be-847d387a722d tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.227845 Jul 18 02:15:08.550226 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 775/1558] 10.222.0.57 () {58 vars in 1148 bytes} [Mon Jul 18 02:15:08 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:15:08.562044 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9d6dcc09-640a-4d06-800a-0fc548014941 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4add69430>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:08.607978 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f1366eea-45a6-445c-8752-8c95d4be662d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:08.622831 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f1366eea-45a6-445c-8752-8c95d4be662d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:08.624381 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f1366eea-45a6-445c-8752-8c95d4be662d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:08.625555 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f1366eea-45a6-445c-8752-8c95d4be662d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5" status: 200 len: 1362 microversion: 2.25 time: 0.609813 Jul 18 02:15:08.626190 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 784/1559] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:15:08 2022] GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5 => generated 1362 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:15:08.629001 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:08.665377 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-31b6f923-e5fa-41b2-8fbb-cfa078beaae0 req-1349a012-8be1-4e0f-814d-5ebe6b67e19d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "697075ff-db42-4729-8faf-2c2935d72630", "name": "network-vif-unplugged", "status": "completed", "tag": "26b96c32-3f20-4f09-8e97-8a938a803c4c"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:08.681312 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-31b6f923-e5fa-41b2-8fbb-cfa078beaae0 req-1349a012-8be1-4e0f-814d-5ebe6b67e19d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:08.681789 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-31b6f923-e5fa-41b2-8fbb-cfa078beaae0 req-1349a012-8be1-4e0f-814d-5ebe6b67e19d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:08.687454 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9d6dcc09-640a-4d06-800a-0fc548014941 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.133276 Jul 18 02:15:08.695299 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 776/1560] 10.222.0.57 () {58 vars in 1148 bytes} [Mon Jul 18 02:15:08 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:08.700820 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-156864f4-35a9-4a03-9f13-ea23e4ab9fe9 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4add80700>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:08.724787 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-31b6f923-e5fa-41b2-8fbb-cfa078beaae0 req-1349a012-8be1-4e0f-814d-5ebe6b67e19d service nova] Creating event network-vif-unplugged:26b96c32-3f20-4f09-8e97-8a938a803c4c for instance 697075ff-db42-4729-8faf-2c2935d72630 on n-h2-465891-3 Jul 18 02:15:08.731440 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-31b6f923-e5fa-41b2-8fbb-cfa078beaae0 req-1349a012-8be1-4e0f-814d-5ebe6b67e19d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071078 Jul 18 02:15:08.732731 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 785/1561] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:15:08.800534 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ad268a2c-710d-47a1-9c40-71f02cee979b tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:08.801940 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-156864f4-35a9-4a03-9f13-ea23e4ab9fe9 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.104565 Jul 18 02:15:08.802448 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ad268a2c-710d-47a1-9c40-71f02cee979b tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] [instance: 32361df9-4e50-409c-9cc7-6f70ba6ce26e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:08.812180 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 777/1562] 10.222.0.57 () {58 vars in 1136 bytes} [Mon Jul 18 02:15:08 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:08.817854 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-570cad82-b6f8-4f8e-aef1-0257aacb148d tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4add77550>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:08.822842 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ad268a2c-710d-47a1-9c40-71f02cee979b tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:08.823443 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ad268a2c-710d-47a1-9c40-71f02cee979b tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:08.824285 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ad268a2c-710d-47a1-9c40-71f02cee979b tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:08.830110 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ad268a2c-710d-47a1-9c40-71f02cee979b tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:08.947044 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-570cad82-b6f8-4f8e-aef1-0257aacb148d tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/detail?changes-since=2022-07-18T02%3A12%3A02Z" status: 200 len: 6333 microversion: 2.1 time: 0.133278 Jul 18 02:15:08.958808 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 778/1563] 10.222.0.57 () {58 vars in 1219 bytes} [Mon Jul 18 02:15:08 2022] GET /compute/v2.1/images/detail?changes-since=2022-07-18T02%3A12%3A02Z => generated 6333 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:08.967669 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3d264d33-aebe-4d45-846a-d3e66f5480d7 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a880ba60>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:09.034045 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3d264d33-aebe-4d45-846a-d3e66f5480d7 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1191470163" status: 200 len: 665 microversion: 2.1 time: 0.071687 Jul 18 02:15:09.045913 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 779/1564] 10.222.0.57 () {58 vars in 1251 bytes} [Mon Jul 18 02:15:08 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1191470163 => generated 665 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:15:09.053548 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-14c5bec9-2bf1-4a8c-9af3-327204a8f223 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:09.056113 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-14c5bec9-2bf1-4a8c-9af3-327204a8f223 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:09.064412 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14c5bec9-2bf1-4a8c-9af3-327204a8f223 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:09.066344 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14c5bec9-2bf1-4a8c-9af3-327204a8f223 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:09.067640 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14c5bec9-2bf1-4a8c-9af3-327204a8f223 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:09.068428 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14c5bec9-2bf1-4a8c-9af3-327204a8f223 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:09.161077 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ad268a2c-710d-47a1-9c40-71f02cee979b tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28fb70d1545b087bce52f2975a1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c8e07f8a9b4a398614fcf02c561416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:09.170595 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ad268a2c-710d-47a1-9c40-71f02cee979b tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e" status: 200 len: 1317 microversion: 2.1 time: 0.380728 Jul 18 02:15:09.173892 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 786/1565] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:08 2022] GET /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e => generated 1317 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:09.194399 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9c18e720-dcd1-4eaa-9df8-0d7962b2d2b8 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a85dd700>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:09.320316 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9c18e720-dcd1-4eaa-9df8-0d7962b2d2b8 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.57%2Fcompute%2Fv2.1%2Fservers%2F32e81b5d-a507-4d47-b76e-699091d0e5bd" status: 200 len: 1467 microversion: 2.1 time: 0.144571 Jul 18 02:15:09.322164 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 787/1566] 10.222.0.57 () {58 vars in 1337 bytes} [Mon Jul 18 02:15:09 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.57%2Fcompute%2Fv2.1%2Fservers%2F32e81b5d-a507-4d47-b76e-699091d0e5bd => generated 1467 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:09.329967 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-81e1fcc7-0846-43a2-a6ba-8dd2297e95c4 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:09.331609 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-81e1fcc7-0846-43a2-a6ba-8dd2297e95c4 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 85cf0fec-3e12-4af3-9525-925901fc41d9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:09.386624 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-81e1fcc7-0846-43a2-a6ba-8dd2297e95c4 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:09.388111 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-81e1fcc7-0846-43a2-a6ba-8dd2297e95c4 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:09.395294 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-81e1fcc7-0846-43a2-a6ba-8dd2297e95c4 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:09.398448 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-81e1fcc7-0846-43a2-a6ba-8dd2297e95c4 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:09.478148 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-14c5bec9-2bf1-4a8c-9af3-327204a8f223 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9472908374c94355ada94f4947c99f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab10eb9b4cc4b13a640f5479056ab79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:09.491947 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-14c5bec9-2bf1-4a8c-9af3-327204a8f223 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] 10.222.0.57 "GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee" status: 200 len: 1322 microversion: 2.1 time: 0.443606 Jul 18 02:15:09.493197 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 780/1567] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:09 2022] GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee => generated 1322 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:09.498171 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-031fe272-1c33-41f2-a50a-765ffc312340 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4add3c550>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:09.545815 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-81e1fcc7-0846-43a2-a6ba-8dd2297e95c4 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:09.556622 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-81e1fcc7-0846-43a2-a6ba-8dd2297e95c4 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/85cf0fec-3e12-4af3-9525-925901fc41d9" status: 200 len: 1275 microversion: 2.1 time: 0.232782 Jul 18 02:15:09.558751 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 788/1568] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:09 2022] GET /compute/v2.1/servers/85cf0fec-3e12-4af3-9525-925901fc41d9 => generated 1275 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:09.606190 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-031fe272-1c33-41f2-a50a-765ffc312340 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.57%2Fcompute%2Fservers%2F32e81b5d-a507-4d47-b76e-699091d0e5bd" status: 200 len: 1467 microversion: 2.1 time: 0.111281 Jul 18 02:15:09.606891 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 781/1569] 10.222.0.57 () {58 vars in 1323 bytes} [Mon Jul 18 02:15:09 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.57%2Fcompute%2Fservers%2F32e81b5d-a507-4d47-b76e-699091d0e5bd => generated 1467 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:09.620265 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ad26f2d9-245f-46c9-ba9c-18fa9f32ad73 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a85dd9d0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:09.645923 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1268d095-8b8b-4e94-acc6-a39f641d1e00 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:09.646626 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1268d095-8b8b-4e94-acc6-a39f641d1e00 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2b4a452c-dd09-4dd6-ab90-bd7d584343e5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:09.658291 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1268d095-8b8b-4e94-acc6-a39f641d1e00 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:09.658798 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1268d095-8b8b-4e94-acc6-a39f641d1e00 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:09.659555 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1268d095-8b8b-4e94-acc6-a39f641d1e00 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:09.659996 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1268d095-8b8b-4e94-acc6-a39f641d1e00 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:09.841032 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ad26f2d9-245f-46c9-ba9c-18fa9f32ad73 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7108 microversion: 2.1 time: 0.224238 Jul 18 02:15:09.842460 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 789/1570] 10.222.0.57 () {58 vars in 1169 bytes} [Mon Jul 18 02:15:09 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7108 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:09.868680 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6f307170-74e5-439c-a345-7d74cfe37d4e tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a88c8b80>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:09.993884 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1268d095-8b8b-4e94-acc6-a39f641d1e00 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:10.003418 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1268d095-8b8b-4e94-acc6-a39f641d1e00 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:10.004982 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1268d095-8b8b-4e94-acc6-a39f641d1e00 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:10.009583 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1268d095-8b8b-4e94-acc6-a39f641d1e00 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5" status: 200 len: 1558 microversion: 2.25 time: 0.365534 Jul 18 02:15:10.010674 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 782/1571] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:15:09 2022] GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5 => generated 1558 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:15:10.011935 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6f307170-74e5-439c-a345-7d74cfe37d4e tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4375 microversion: 2.1 time: 0.151843 Jul 18 02:15:10.024232 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 790/1572] 10.222.0.57 () {58 vars in 1169 bytes} [Mon Jul 18 02:15:09 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:10.033669 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4e85e77b-c44e-4cef-9794-73a84b7d6d69 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a8831790>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:10.044154 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-84cad1b3-068b-409e-80a9-fb212ca29cfe tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:10.045619 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-84cad1b3-068b-409e-80a9-fb212ca29cfe tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] [instance: 2b4a452c-dd09-4dd6-ab90-bd7d584343e5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:10.082580 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-84cad1b3-068b-409e-80a9-fb212ca29cfe tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:10.084148 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-84cad1b3-068b-409e-80a9-fb212ca29cfe tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:10.087649 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-84cad1b3-068b-409e-80a9-fb212ca29cfe tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:10.090514 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-84cad1b3-068b-409e-80a9-fb212ca29cfe tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:10.121415 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4e85e77b-c44e-4cef-9794-73a84b7d6d69 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/3bb0a19f-5b69-48ee-a771-8fd416f92f36" status: 200 len: 784 microversion: 2.1 time: 0.088173 Jul 18 02:15:10.123421 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 783/1573] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:15:10 2022] GET /compute/v2.1/images/3bb0a19f-5b69-48ee-a771-8fd416f92f36 => generated 784 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:10.145081 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6c074751-efed-4127-abea-87d64900e1b2 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a87af310>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:10.261013 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6c074751-efed-4127-abea-87d64900e1b2 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.126488 Jul 18 02:15:10.271357 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 784/1574] 10.222.0.57 () {58 vars in 1157 bytes} [Mon Jul 18 02:15:10 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:15:10.292990 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a5d8d1ad-37cc-4bfd-ab47-a33b0b90f359 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:10.297984 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a5d8d1ad-37cc-4bfd-ab47-a33b0b90f359 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] [instance: 32361df9-4e50-409c-9cc7-6f70ba6ce26e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:10.321024 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a5d8d1ad-37cc-4bfd-ab47-a33b0b90f359 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:10.322004 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a5d8d1ad-37cc-4bfd-ab47-a33b0b90f359 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:10.323224 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a5d8d1ad-37cc-4bfd-ab47-a33b0b90f359 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:10.328643 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a5d8d1ad-37cc-4bfd-ab47-a33b0b90f359 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:10.577158 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-84cad1b3-068b-409e-80a9-fb212ca29cfe tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lazy-loading 'services' on Instance uuid 2b4a452c-dd09-4dd6-ab90-bd7d584343e5 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:15:10.615198 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-84cad1b3-068b-409e-80a9-fb212ca29cfe tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5" status: 200 len: 2051 microversion: 2.25 time: 0.581830 Jul 18 02:15:10.618001 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 791/1575] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:15:10 2022] GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5 => generated 2051 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:15:10.623145 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f389888a-6be2-42cb-9105-4d84aace955d tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a88c8670>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:10.748694 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a5d8d1ad-37cc-4bfd-ab47-a33b0b90f359 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28fb70d1545b087bce52f2975a1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c8e07f8a9b4a398614fcf02c561416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:10.760325 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a5d8d1ad-37cc-4bfd-ab47-a33b0b90f359 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e" status: 200 len: 1317 microversion: 2.1 time: 0.485127 Jul 18 02:15:10.760936 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 785/1576] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:10 2022] GET /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e => generated 1317 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:10.778338 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d94f32cb-781f-451c-aa3d-51deffe79ae9 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:10.779022 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d94f32cb-781f-451c-aa3d-51deffe79ae9 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:10.788375 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d94f32cb-781f-451c-aa3d-51deffe79ae9 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:10.788801 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d94f32cb-781f-451c-aa3d-51deffe79ae9 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:10.794116 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d94f32cb-781f-451c-aa3d-51deffe79ae9 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:10.795014 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d94f32cb-781f-451c-aa3d-51deffe79ae9 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:11.064417 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d94f32cb-781f-451c-aa3d-51deffe79ae9 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9472908374c94355ada94f4947c99f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab10eb9b4cc4b13a640f5479056ab79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:11.080525 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d94f32cb-781f-451c-aa3d-51deffe79ae9 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] 10.222.0.57 "GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee" status: 200 len: 1322 microversion: 2.1 time: 0.318430 Jul 18 02:15:11.081856 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 786/1577] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:10 2022] GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee => generated 1322 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:11.087451 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7130a228-8042-4dcd-bae9-855dfb78cc2c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:11.088328 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7130a228-8042-4dcd-bae9-855dfb78cc2c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 85cf0fec-3e12-4af3-9525-925901fc41d9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:11.095464 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7130a228-8042-4dcd-bae9-855dfb78cc2c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:11.096171 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7130a228-8042-4dcd-bae9-855dfb78cc2c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:11.097116 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7130a228-8042-4dcd-bae9-855dfb78cc2c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:11.097745 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7130a228-8042-4dcd-bae9-855dfb78cc2c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:11.209252 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7130a228-8042-4dcd-bae9-855dfb78cc2c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:11.218594 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7130a228-8042-4dcd-bae9-855dfb78cc2c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/85cf0fec-3e12-4af3-9525-925901fc41d9" status: 200 len: 1275 microversion: 2.1 time: 0.135355 Jul 18 02:15:11.219184 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 787/1578] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:11 2022] GET /compute/v2.1/servers/85cf0fec-3e12-4af3-9525-925901fc41d9 => generated 1275 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:11.226688 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6d114812-9046-4568-8712-42bc0f851e54 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:11.227622 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6d114812-9046-4568-8712-42bc0f851e54 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] [instance: 2b4a452c-dd09-4dd6-ab90-bd7d584343e5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:11.234720 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6d114812-9046-4568-8712-42bc0f851e54 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:11.235414 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6d114812-9046-4568-8712-42bc0f851e54 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:11.236353 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6d114812-9046-4568-8712-42bc0f851e54 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:11.236951 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6d114812-9046-4568-8712-42bc0f851e54 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:11.567805 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-6d114812-9046-4568-8712-42bc0f851e54 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lazy-loading 'services' on Instance uuid 2b4a452c-dd09-4dd6-ab90-bd7d584343e5 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:15:11.609882 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6d114812-9046-4568-8712-42bc0f851e54 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5" status: 200 len: 2051 microversion: 2.25 time: 0.384181 Jul 18 02:15:11.622558 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 788/1579] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:15:11 2022] GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5 => generated 2051 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:15:11.633894 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-bedeb365-c2be-4a4e-b34c-d93619badb51 req-de18447e-3516-4e8d-80ce-bcb7273eeaee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32361df9-4e50-409c-9cc7-6f70ba6ce26e", "name": "network-vif-plugged", "status": "completed", "tag": "7c604958-4d5c-4ace-8013-9827944aa0c6"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:11.657142 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-bedeb365-c2be-4a4e-b34c-d93619badb51 req-de18447e-3516-4e8d-80ce-bcb7273eeaee service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:11.657374 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-bedeb365-c2be-4a4e-b34c-d93619badb51 req-de18447e-3516-4e8d-80ce-bcb7273eeaee service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:11.693878 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-bedeb365-c2be-4a4e-b34c-d93619badb51 req-de18447e-3516-4e8d-80ce-bcb7273eeaee service nova] Creating event network-vif-plugged:7c604958-4d5c-4ace-8013-9827944aa0c6 for instance 32361df9-4e50-409c-9cc7-6f70ba6ce26e on n-h1-465891-3 Jul 18 02:15:11.705571 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-bedeb365-c2be-4a4e-b34c-d93619badb51 req-de18447e-3516-4e8d-80ce-bcb7273eeaee service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081541 Jul 18 02:15:11.708179 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 789/1580] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:11.724954 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-482c10f6-5934-4c00-89f6-610acbf4222f tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:11.727881 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:15:11.727881 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:15:11.762063 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-482c10f6-5934-4c00-89f6-610acbf4222f tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:11.766113 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-482c10f6-5934-4c00-89f6-610acbf4222f tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:11.771342 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-482c10f6-5934-4c00-89f6-610acbf4222f tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:11.771911 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-482c10f6-5934-4c00-89f6-610acbf4222f tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:11.850467 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-482c10f6-5934-4c00-89f6-610acbf4222f tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.137792 Jul 18 02:15:11.859942 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 790/1581] 10.222.0.57 () {60 vars in 1216 bytes} [Mon Jul 18 02:15:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:15:11.868582 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8fb6ee37-c6b0-4765-a2e9-a59e5a8c593b tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:11.869867 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8fb6ee37-c6b0-4765-a2e9-a59e5a8c593b tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] [instance: 32361df9-4e50-409c-9cc7-6f70ba6ce26e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:11.889991 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8fb6ee37-c6b0-4765-a2e9-a59e5a8c593b tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:11.890749 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8fb6ee37-c6b0-4765-a2e9-a59e5a8c593b tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:11.904566 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8fb6ee37-c6b0-4765-a2e9-a59e5a8c593b tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:11.905045 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8fb6ee37-c6b0-4765-a2e9-a59e5a8c593b tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:12.057630 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f389888a-6be2-42cb-9105-4d84aace955d tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "DELETE /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b" status: 204 len: 0 microversion: 2.1 time: 1.438127 Jul 18 02:15:12.059026 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 792/1582] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:10 2022] DELETE /compute/v2.1/images/d3bcb552-0ed9-4900-a50f-4b36df520b9b => generated 0 bytes in 1440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:15:12.079546 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-376e2d3f-f2c7-4c74-bb11-2eeb8a279416 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:12.083092 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-376e2d3f-f2c7-4c74-bb11-2eeb8a279416 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] [instance: 2b4a452c-dd09-4dd6-ab90-bd7d584343e5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:12.097107 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-376e2d3f-f2c7-4c74-bb11-2eeb8a279416 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:12.097579 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-376e2d3f-f2c7-4c74-bb11-2eeb8a279416 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:12.098437 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-376e2d3f-f2c7-4c74-bb11-2eeb8a279416 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:12.101504 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-376e2d3f-f2c7-4c74-bb11-2eeb8a279416 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:12.226868 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:12.346181 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-376e2d3f-f2c7-4c74-bb11-2eeb8a279416 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5/action" status: 202 len: 0 microversion: 2.25 time: 0.284985 Jul 18 02:15:12.350410 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 793/1583] 10.222.0.57 () {62 vars in 1318 bytes} [Mon Jul 18 02:15:12 2022] POST /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:15:12.379202 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-31d8d065-ffbc-451a-a690-e55294eed102 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a85ea8b0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:12.538876 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8fb6ee37-c6b0-4765-a2e9-a59e5a8c593b tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28fb70d1545b087bce52f2975a1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c8e07f8a9b4a398614fcf02c561416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:12.578000 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8fb6ee37-c6b0-4765-a2e9-a59e5a8c593b tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e" status: 200 len: 1317 microversion: 2.1 time: 0.713742 Jul 18 02:15:12.581368 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 791/1584] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:11 2022] GET /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e => generated 1317 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:12.612623 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-73602d5b-8e34-4ae2-91b6-2a573cb6bea5 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:12.621114 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-73602d5b-8e34-4ae2-91b6-2a573cb6bea5 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:12.648988 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-73602d5b-8e34-4ae2-91b6-2a573cb6bea5 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:12.650990 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-73602d5b-8e34-4ae2-91b6-2a573cb6bea5 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:12.652845 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-73602d5b-8e34-4ae2-91b6-2a573cb6bea5 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:12.654359 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-73602d5b-8e34-4ae2-91b6-2a573cb6bea5 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:13.116151 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-73602d5b-8e34-4ae2-91b6-2a573cb6bea5 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9472908374c94355ada94f4947c99f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab10eb9b4cc4b13a640f5479056ab79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:13.153171 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-73602d5b-8e34-4ae2-91b6-2a573cb6bea5 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] 10.222.0.57 "GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee" status: 200 len: 1322 microversion: 2.1 time: 0.565359 Jul 18 02:15:13.155462 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 792/1585] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:12 2022] GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee => generated 1322 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:13.165909 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d0b28065-787b-4a37-bf04-e0320e49e609 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:13.169202 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d0b28065-787b-4a37-bf04-e0320e49e609 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 85cf0fec-3e12-4af3-9525-925901fc41d9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:13.186391 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d0b28065-787b-4a37-bf04-e0320e49e609 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:13.187782 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d0b28065-787b-4a37-bf04-e0320e49e609 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:13.189825 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d0b28065-787b-4a37-bf04-e0320e49e609 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:13.190287 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d0b28065-787b-4a37-bf04-e0320e49e609 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:13.254354 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:13.423742 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-31d8d065-ffbc-451a-a690-e55294eed102 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "DELETE /compute/v2.1/images/9053bb1e-a3c0-4052-9d8d-7b964f899348" status: 204 len: 0 microversion: 2.1 time: 1.059940 Jul 18 02:15:13.424468 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 794/1586] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:12 2022] DELETE /compute/v2.1/images/9053bb1e-a3c0-4052-9d8d-7b964f899348 => generated 0 bytes in 1065 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:15:13.434287 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-54e10c45-be7a-44bc-b9e7-e33f1d8d6c51 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:13.435037 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-54e10c45-be7a-44bc-b9e7-e33f1d8d6c51 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] [instance: 2b4a452c-dd09-4dd6-ab90-bd7d584343e5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:13.445722 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54e10c45-be7a-44bc-b9e7-e33f1d8d6c51 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:13.446545 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54e10c45-be7a-44bc-b9e7-e33f1d8d6c51 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:13.447558 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54e10c45-be7a-44bc-b9e7-e33f1d8d6c51 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:13.448349 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54e10c45-be7a-44bc-b9e7-e33f1d8d6c51 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:13.745886 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d0b28065-787b-4a37-bf04-e0320e49e609 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:13.781855 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d0b28065-787b-4a37-bf04-e0320e49e609 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/85cf0fec-3e12-4af3-9525-925901fc41d9" status: 200 len: 1317 microversion: 2.1 time: 0.622900 Jul 18 02:15:13.793751 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 793/1587] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:13 2022] GET /compute/v2.1/servers/85cf0fec-3e12-4af3-9525-925901fc41d9 => generated 1317 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:13.822037 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4a0cb000-b7d2-49fd-8781-726aa937913c tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4add4f040>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:14.215590 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-54e10c45-be7a-44bc-b9e7-e33f1d8d6c51 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lazy-loading 'services' on Instance uuid 2b4a452c-dd09-4dd6-ab90-bd7d584343e5 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:15:14.289313 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-54e10c45-be7a-44bc-b9e7-e33f1d8d6c51 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5" status: 200 len: 2036 microversion: 2.25 time: 0.860338 Jul 18 02:15:14.299967 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 795/1588] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:15:13 2022] GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5 => generated 2036 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:15:14.343320 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2cbd0712-45fc-46da-b400-76cc2aba41f4 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:14.344516 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2cbd0712-45fc-46da-b400-76cc2aba41f4 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] [instance: 32361df9-4e50-409c-9cc7-6f70ba6ce26e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:14.380059 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2cbd0712-45fc-46da-b400-76cc2aba41f4 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:14.380914 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2cbd0712-45fc-46da-b400-76cc2aba41f4 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:14.392741 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2cbd0712-45fc-46da-b400-76cc2aba41f4 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:14.393960 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2cbd0712-45fc-46da-b400-76cc2aba41f4 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:14.872995 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2cbd0712-45fc-46da-b400-76cc2aba41f4 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28fb70d1545b087bce52f2975a1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c8e07f8a9b4a398614fcf02c561416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:14.899967 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2cbd0712-45fc-46da-b400-76cc2aba41f4 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e" status: 200 len: 1317 microversion: 2.1 time: 0.594132 Jul 18 02:15:14.900641 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 796/1589] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:14 2022] GET /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e => generated 1317 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:14.915205 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-fbc44929-6147-4fc1-a56e-fee0953aa798 req-0b94a568-5d32-46a2-9313-ca56fa0511e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85cf0fec-3e12-4af3-9525-925901fc41d9", "tag": "6d4cd1b3-4941-4b7c-ae0f-5cb58271177c"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:14.937679 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-fbc44929-6147-4fc1-a56e-fee0953aa798 req-0b94a568-5d32-46a2-9313-ca56fa0511e8 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:14.938155 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-fbc44929-6147-4fc1-a56e-fee0953aa798 req-0b94a568-5d32-46a2-9313-ca56fa0511e8 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:14.966998 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-fbc44929-6147-4fc1-a56e-fee0953aa798 req-0b94a568-5d32-46a2-9313-ca56fa0511e8 service nova] Creating event network-changed:6d4cd1b3-4941-4b7c-ae0f-5cb58271177c for instance 85cf0fec-3e12-4af3-9525-925901fc41d9 on n-h2-465891-3 Jul 18 02:15:14.982428 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-fbc44929-6147-4fc1-a56e-fee0953aa798 req-0b94a568-5d32-46a2-9313-ca56fa0511e8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071300 Jul 18 02:15:14.986894 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 797/1590] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:14.998399 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4ec5e4ad-fd7c-413f-93aa-6d92561d168e tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:15.002835 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4ec5e4ad-fd7c-413f-93aa-6d92561d168e tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:15.023233 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4ec5e4ad-fd7c-413f-93aa-6d92561d168e tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:15.024135 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4ec5e4ad-fd7c-413f-93aa-6d92561d168e tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:15.025148 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4ec5e4ad-fd7c-413f-93aa-6d92561d168e tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:15.026825 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4ec5e4ad-fd7c-413f-93aa-6d92561d168e tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:15.041741 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4a0cb000-b7d2-49fd-8781-726aa937913c tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "DELETE /compute/v2.1/images/425813c1-df02-409a-9f52-bd406789b9d0" status: 204 len: 0 microversion: 2.1 time: 1.252742 Jul 18 02:15:15.042545 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 794/1591] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:13 2022] DELETE /compute/v2.1/images/425813c1-df02-409a-9f52-bd406789b9d0 => generated 0 bytes in 1256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:15:15.050349 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4331cffa-8a2c-4d9a-9a3c-964b73bde2e9 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-465891-3", "block_migration": "auto"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:15.052137 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4331cffa-8a2c-4d9a-9a3c-964b73bde2e9 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] [instance: 2b4a452c-dd09-4dd6-ab90-bd7d584343e5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:15.067855 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4331cffa-8a2c-4d9a-9a3c-964b73bde2e9 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:15.068662 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4331cffa-8a2c-4d9a-9a3c-964b73bde2e9 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:15.070874 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4331cffa-8a2c-4d9a-9a3c-964b73bde2e9 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:15.071861 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4331cffa-8a2c-4d9a-9a3c-964b73bde2e9 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:15.114761 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-4331cffa-8a2c-4d9a-9a3c-964b73bde2e9 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lazy-loading 'flavor' on Instance uuid 2b4a452c-dd09-4dd6-ab90-bd7d584343e5 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:15:15.132121 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4331cffa-8a2c-4d9a-9a3c-964b73bde2e9 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] [instance: 2b4a452c-dd09-4dd6-ab90-bd7d584343e5] Going to try to live migrate instance to n-h2-465891-3 {{(pid=119543) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 18 02:15:15.286998 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4ec5e4ad-fd7c-413f-93aa-6d92561d168e tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9472908374c94355ada94f4947c99f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab10eb9b4cc4b13a640f5479056ab79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:15.302895 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4ec5e4ad-fd7c-413f-93aa-6d92561d168e tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] 10.222.0.57 "GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee" status: 200 len: 1322 microversion: 2.1 time: 0.313994 Jul 18 02:15:15.306380 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 798/1592] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:14 2022] GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee => generated 1322 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:15.331197 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-cea66551-6849-4b0f-ba33-48a7c234d8f9 req-68104c67-8a25-4b6b-8786-30e075c12039 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ddcf97f-5c13-4ed6-ac5b-17368a126dee", "name": "network-vif-plugged", "status": "completed", "tag": "4d6c976a-bead-4367-8b9a-e4a14283ef03"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:15.343732 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-cea66551-6849-4b0f-ba33-48a7c234d8f9 req-68104c67-8a25-4b6b-8786-30e075c12039 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:15.344324 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-cea66551-6849-4b0f-ba33-48a7c234d8f9 req-68104c67-8a25-4b6b-8786-30e075c12039 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:15.359654 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-cea66551-6849-4b0f-ba33-48a7c234d8f9 req-68104c67-8a25-4b6b-8786-30e075c12039 service nova] Creating event network-vif-plugged:4d6c976a-bead-4367-8b9a-e4a14283ef03 for instance 7ddcf97f-5c13-4ed6-ac5b-17368a126dee on n-h2-465891-3 Jul 18 02:15:15.365980 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-cea66551-6849-4b0f-ba33-48a7c234d8f9 req-68104c67-8a25-4b6b-8786-30e075c12039 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057369 Jul 18 02:15:15.371813 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 799/1593] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:15.379703 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-59748a6e-4fa4-4e62-927a-8d303177b06d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:15.380653 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-59748a6e-4fa4-4e62-927a-8d303177b06d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 85cf0fec-3e12-4af3-9525-925901fc41d9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:15.388945 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-59748a6e-4fa4-4e62-927a-8d303177b06d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:15.389782 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-59748a6e-4fa4-4e62-927a-8d303177b06d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:15.390711 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-59748a6e-4fa4-4e62-927a-8d303177b06d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:15.391264 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-59748a6e-4fa4-4e62-927a-8d303177b06d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:15.686052 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-59748a6e-4fa4-4e62-927a-8d303177b06d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:15.702296 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-59748a6e-4fa4-4e62-927a-8d303177b06d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/85cf0fec-3e12-4af3-9525-925901fc41d9" status: 200 len: 1317 microversion: 2.1 time: 0.328429 Jul 18 02:15:15.704107 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 800/1594] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:15 2022] GET /compute/v2.1/servers/85cf0fec-3e12-4af3-9525-925901fc41d9 => generated 1317 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:15.713061 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e4806acb-48d9-492e-9222-05433239ff5f tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:15.713831 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e4806acb-48d9-492e-9222-05433239ff5f tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] [instance: 32e81b5d-a507-4d47-b76e-699091d0e5bd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:15.727051 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e4806acb-48d9-492e-9222-05433239ff5f tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:15.727611 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e4806acb-48d9-492e-9222-05433239ff5f tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:15.728864 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e4806acb-48d9-492e-9222-05433239ff5f tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:15.729386 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e4806acb-48d9-492e-9222-05433239ff5f tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:15.764306 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e4806acb-48d9-492e-9222-05433239ff5f tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] [instance: 32e81b5d-a507-4d47-b76e-699091d0e5bd] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:15:15.892987 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e4806acb-48d9-492e-9222-05433239ff5f tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "DELETE /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd" status: 204 len: 0 microversion: 2.1 time: 0.185271 Jul 18 02:15:15.902730 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 801/1595] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:15:15 2022] DELETE /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:15:15.918870 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d2e42ca8-3f42-4d31-9c9e-6740bd3c6533 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:15.920052 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d2e42ca8-3f42-4d31-9c9e-6740bd3c6533 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] [instance: 32e81b5d-a507-4d47-b76e-699091d0e5bd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:15.957849 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d2e42ca8-3f42-4d31-9c9e-6740bd3c6533 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:15.958334 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d2e42ca8-3f42-4d31-9c9e-6740bd3c6533 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:15.959130 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d2e42ca8-3f42-4d31-9c9e-6740bd3c6533 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:15.959576 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d2e42ca8-3f42-4d31-9c9e-6740bd3c6533 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:16.228025 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d2e42ca8-3f42-4d31-9c9e-6740bd3c6533 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a9dd4e239c4d73bdde1ced9cb90b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5d1b19c84a4a9fa4595a5c84f4555c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:16.239536 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d2e42ca8-3f42-4d31-9c9e-6740bd3c6533 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd" status: 200 len: 1474 microversion: 2.1 time: 0.332013 Jul 18 02:15:16.243589 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 802/1596] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:15 2022] GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd => generated 1474 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:15:16.253340 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bfa8683e-10a3-4f4b-9897-0b5229562e83 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:16.254178 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bfa8683e-10a3-4f4b-9897-0b5229562e83 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] [instance: 32361df9-4e50-409c-9cc7-6f70ba6ce26e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:16.263182 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bfa8683e-10a3-4f4b-9897-0b5229562e83 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:16.263823 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bfa8683e-10a3-4f4b-9897-0b5229562e83 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:16.264862 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bfa8683e-10a3-4f4b-9897-0b5229562e83 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:16.265480 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bfa8683e-10a3-4f4b-9897-0b5229562e83 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:16.555643 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bfa8683e-10a3-4f4b-9897-0b5229562e83 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28fb70d1545b087bce52f2975a1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c8e07f8a9b4a398614fcf02c561416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:16.570415 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bfa8683e-10a3-4f4b-9897-0b5229562e83 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e" status: 200 len: 1465 microversion: 2.1 time: 0.324817 Jul 18 02:15:16.571365 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 803/1597] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:16 2022] GET /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e => generated 1465 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:16.595586 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ddfff9a4-af4b-4fc7-9bb7-59e0109d8ca6 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:16.597985 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ddfff9a4-af4b-4fc7-9bb7-59e0109d8ca6 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:16.610078 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ddfff9a4-af4b-4fc7-9bb7-59e0109d8ca6 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:16.610886 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ddfff9a4-af4b-4fc7-9bb7-59e0109d8ca6 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:16.612258 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ddfff9a4-af4b-4fc7-9bb7-59e0109d8ca6 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:16.613010 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ddfff9a4-af4b-4fc7-9bb7-59e0109d8ca6 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:16.839932 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ddfff9a4-af4b-4fc7-9bb7-59e0109d8ca6 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9472908374c94355ada94f4947c99f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab10eb9b4cc4b13a640f5479056ab79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:16.856072 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ddfff9a4-af4b-4fc7-9bb7-59e0109d8ca6 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] 10.222.0.57 "GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee" status: 200 len: 1322 microversion: 2.1 time: 0.283274 Jul 18 02:15:16.857496 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 804/1598] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:16 2022] GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee => generated 1322 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:16.865847 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0a7c6081-16d1-4c5b-9f05-7403be2142d0 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-707374346", "metadata": {"image_type": "test"}}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:16.867991 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0a7c6081-16d1-4c5b-9f05-7403be2142d0 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] [instance: 32361df9-4e50-409c-9cc7-6f70ba6ce26e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:16.880035 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a7c6081-16d1-4c5b-9f05-7403be2142d0 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:16.881217 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a7c6081-16d1-4c5b-9f05-7403be2142d0 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:16.889935 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a7c6081-16d1-4c5b-9f05-7403be2142d0 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:16.890756 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a7c6081-16d1-4c5b-9f05-7403be2142d0 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:16.939245 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-0a7c6081-16d1-4c5b-9f05-7403be2142d0 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Getting quotas for project f0c8e07f8a9b4a398614fcf02c561416. Resources: dict_keys(['metadata_items']) {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:15:16.942701 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:16.948229 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-0a7c6081-16d1-4c5b-9f05-7403be2142d0 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Getting quotas for user 9ca28fb70d1545b087bce52f2975a1ea and project f0c8e07f8a9b4a398614fcf02c561416. Resources: dict_keys(['metadata_items']) {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:15:17.140576 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:17.227471 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:17.308312 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0a7c6081-16d1-4c5b-9f05-7403be2142d0 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "POST /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e/action" status: 202 len: 0 microversion: 2.1 time: 0.448526 Jul 18 02:15:17.310064 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 805/1599] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:15:16 2022] POST /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e/action => generated 0 bytes in 451 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 18 02:15:17.320713 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f940befb-5b02-4b16-9811-ab128a6e9cc5 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:17.322077 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f940befb-5b02-4b16-9811-ab128a6e9cc5 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 85cf0fec-3e12-4af3-9525-925901fc41d9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:17.329420 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f940befb-5b02-4b16-9811-ab128a6e9cc5 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:17.329914 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f940befb-5b02-4b16-9811-ab128a6e9cc5 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:17.330729 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f940befb-5b02-4b16-9811-ab128a6e9cc5 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:17.331171 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f940befb-5b02-4b16-9811-ab128a6e9cc5 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:17.574232 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f940befb-5b02-4b16-9811-ab128a6e9cc5 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:17.582988 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f940befb-5b02-4b16-9811-ab128a6e9cc5 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/85cf0fec-3e12-4af3-9525-925901fc41d9" status: 200 len: 1317 microversion: 2.1 time: 0.270811 Jul 18 02:15:17.583761 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 806/1600] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:17 2022] GET /compute/v2.1/servers/85cf0fec-3e12-4af3-9525-925901fc41d9 => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:17.778970 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6fc92b8f-bdf5-4934-b1a7-e2decdcb798c tempest-ImagesMetadataNegativeTestJSON-1770531084 tempest-ImagesMetadataNegativeTestJSON-1770531084-project] Calling method '.version_select at 0x7ff4a8591ee0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:17.807989 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-6fc92b8f-bdf5-4934-b1a7-e2decdcb798c tempest-ImagesMetadataNegativeTestJSON-1770531084 tempest-ImagesMetadataNegativeTestJSON-1770531084-project] HTTP exception thrown: Image not found. Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6fc92b8f-bdf5-4934-b1a7-e2decdcb798c tempest-ImagesMetadataNegativeTestJSON-1770531084 tempest-ImagesMetadataNegativeTestJSON-1770531084-project] Request method failure captured: Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/images/8dd5b20b-c403-486c-85eb-b557a10499d4/metadata/os_distro HTTP/1.1 Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MI0aZGoLFbq-esrFtQ7KvtYkemDQ0iBT_TfaJCYTJDSaopkDZRdr--gCz3xPza5pvrwd662_Em-dt7flmzbqtpo5pkzJyEbfCBnpgqxiW6Y1sIRpp37rMQ-hHyJOlM-PJex6akN0dUhHKnQHNjSFXTRxfwsFC2HH6x1Qh6z_tb5QUE Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 7955701ff30f4933be7a17c662ff1002 Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1770531084 Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_7955701ff30f4933be7a17c662ff1002"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7955701ff30f4933be7a17c662ff1002"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7955701ff30f4933be7a17c662ff1002"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/7955701ff30f4933be7a17c662ff1002"}]}] Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1770531084 Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 7955701ff30f4933be7a17c662ff1002 Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1770531084 Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ImagesMetadataNegativeTestJSON-1770531084-project Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: cd2364d8c86e4361839573604f8dbccc Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1770531084-project Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: exception: Image not found. Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'image_id': '8dd5b20b-c403-486c-85eb-b557a10499d4', 'id': 'os_distro'} Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8dd5b20b-c403-486c-85eb-b557a10499d4 Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 18 02:15:17.818062 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8dd5b20b-c403-486c-85eb-b557a10499d4 could not be found. Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6fc92b8f-bdf5-4934-b1a7-e2decdcb798c tempest-ImagesMetadataNegativeTestJSON-1770531084 tempest-ImagesMetadataNegativeTestJSON-1770531084-project] Returning 404 to user: Image not found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6fc92b8f-bdf5-4934-b1a7-e2decdcb798c tempest-ImagesMetadataNegativeTestJSON-1770531084 tempest-ImagesMetadataNegativeTestJSON-1770531084-project] 10.222.0.57 "DELETE /compute/v2.1/images/8dd5b20b-c403-486c-85eb-b557a10499d4/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.233305 Jul 18 02:15:17.826339 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 807/1601] 10.222.0.57 () {58 vars in 1292 bytes} [Mon Jul 18 02:15:17 2022] DELETE /compute/v2.1/images/8dd5b20b-c403-486c-85eb-b557a10499d4/metadata/os_distro => generated 62 bytes in 236 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:15:17.838258 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8bf80960-5569-45a4-b4cf-fa98fce52fc6 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:17.838886 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8bf80960-5569-45a4-b4cf-fa98fce52fc6 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] [instance: 32e81b5d-a507-4d47-b76e-699091d0e5bd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:17.848646 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8bf80960-5569-45a4-b4cf-fa98fce52fc6 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:17.849014 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8bf80960-5569-45a4-b4cf-fa98fce52fc6 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:17.849922 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8bf80960-5569-45a4-b4cf-fa98fce52fc6 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:17.852020 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8bf80960-5569-45a4-b4cf-fa98fce52fc6 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:18.049587 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8bf80960-5569-45a4-b4cf-fa98fce52fc6 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a9dd4e239c4d73bdde1ced9cb90b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5d1b19c84a4a9fa4595a5c84f4555c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:18.055263 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:18.065217 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8bf80960-5569-45a4-b4cf-fa98fce52fc6 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd" status: 200 len: 1474 microversion: 2.1 time: 0.243875 Jul 18 02:15:18.066673 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 808/1602] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:17 2022] GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd => generated 1474 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:18.074529 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8d4dcc6c-ef66-4a5f-9303-967a6dd5ef10 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a8609280>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:18.107712 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:18.142402 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8d4dcc6c-ef66-4a5f-9303-967a6dd5ef10 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372" status: 200 len: 1423 microversion: 2.1 time: 0.074322 Jul 18 02:15:18.142999 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 809/1603] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:15:18 2022] GET /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372 => generated 1423 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:18.149172 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-60b57d9b-3327-4b89-aa2b-88c87d7d98d9 tempest-ImagesMetadataNegativeTestJSON-1770531084 tempest-ImagesMetadataNegativeTestJSON-1770531084-project] Calling method '.version_select at 0x7ff4a9230af0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:18.171381 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-60b57d9b-3327-4b89-aa2b-88c87d7d98d9 tempest-ImagesMetadataNegativeTestJSON-1770531084 tempest-ImagesMetadataNegativeTestJSON-1770531084-project] HTTP exception thrown: Image not found. Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-60b57d9b-3327-4b89-aa2b-88c87d7d98d9 tempest-ImagesMetadataNegativeTestJSON-1770531084 tempest-ImagesMetadataNegativeTestJSON-1770531084-project] Request method failure captured: Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/images/80ea27fe-1484-4b81-b60c-78c2b84a23e1/metadata/os_version HTTP/1.1 Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MI0aZGoLFbq-esrFtQ7KvtYkemDQ0iBT_TfaJCYTJDSaopkDZRdr--gCz3xPza5pvrwd662_Em-dt7flmzbqtpo5pkzJyEbfCBnpgqxiW6Y1sIRpp37rMQ-hHyJOlM-PJex6akN0dUhHKnQHNjSFXTRxfwsFC2HH6x1Qh6z_tb5QUE Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 7955701ff30f4933be7a17c662ff1002 Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1770531084 Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_7955701ff30f4933be7a17c662ff1002"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7955701ff30f4933be7a17c662ff1002"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7955701ff30f4933be7a17c662ff1002"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/7955701ff30f4933be7a17c662ff1002"}]}] Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1770531084 Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 7955701ff30f4933be7a17c662ff1002 Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1770531084 Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ImagesMetadataNegativeTestJSON-1770531084-project Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: cd2364d8c86e4361839573604f8dbccc Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1770531084-project Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: exception: Image not found. Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'image_id': '80ea27fe-1484-4b81-b60c-78c2b84a23e1', 'id': 'os_version'} Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 80ea27fe-1484-4b81-b60c-78c2b84a23e1 Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 18 02:15:18.173479 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 80ea27fe-1484-4b81-b60c-78c2b84a23e1 could not be found. Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-60b57d9b-3327-4b89-aa2b-88c87d7d98d9 tempest-ImagesMetadataNegativeTestJSON-1770531084 tempest-ImagesMetadataNegativeTestJSON-1770531084-project] Returning 404 to user: Image not found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-60b57d9b-3327-4b89-aa2b-88c87d7d98d9 tempest-ImagesMetadataNegativeTestJSON-1770531084 tempest-ImagesMetadataNegativeTestJSON-1770531084-project] 10.222.0.57 "GET /compute/v2.1/images/80ea27fe-1484-4b81-b60c-78c2b84a23e1/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.031011 Jul 18 02:15:18.179123 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 810/1604] 10.222.0.57 () {58 vars in 1292 bytes} [Mon Jul 18 02:15:18 2022] GET /compute/v2.1/images/80ea27fe-1484-4b81-b60c-78c2b84a23e1/metadata/os_version => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:15:18.183677 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-17a37650-118f-4000-bbcd-284743b2615f tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:18.185210 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-17a37650-118f-4000-bbcd-284743b2615f tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:18.193452 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-17a37650-118f-4000-bbcd-284743b2615f tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:18.194580 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-17a37650-118f-4000-bbcd-284743b2615f tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:18.195740 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-17a37650-118f-4000-bbcd-284743b2615f tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:18.196195 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-17a37650-118f-4000-bbcd-284743b2615f tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:18.355787 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-17a37650-118f-4000-bbcd-284743b2615f tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9472908374c94355ada94f4947c99f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab10eb9b4cc4b13a640f5479056ab79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:18.363849 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-17a37650-118f-4000-bbcd-284743b2615f tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] 10.222.0.57 "GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee" status: 200 len: 1322 microversion: 2.1 time: 0.187214 Jul 18 02:15:18.364549 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 811/1605] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:18 2022] GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:18.373999 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-318d71b7-47b9-48e4-8cbe-e9761af884f9 tempest-ImagesMetadataNegativeTestJSON-1770531084 tempest-ImagesMetadataNegativeTestJSON-1770531084-project] Calling method '.version_select at 0x7ff4a8609ca0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:18.404672 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-318d71b7-47b9-48e4-8cbe-e9761af884f9 tempest-ImagesMetadataNegativeTestJSON-1770531084 tempest-ImagesMetadataNegativeTestJSON-1770531084-project] HTTP exception thrown: Image not found. Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-318d71b7-47b9-48e4-8cbe-e9761af884f9 tempest-ImagesMetadataNegativeTestJSON-1770531084 tempest-ImagesMetadataNegativeTestJSON-1770531084-project] Request method failure captured: Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/images/99225ee9-e2c5-4407-8011-1d3d8c2de872/metadata HTTP/1.1 Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MI0aZGoLFbq-esrFtQ7KvtYkemDQ0iBT_TfaJCYTJDSaopkDZRdr--gCz3xPza5pvrwd662_Em-dt7flmzbqtpo5pkzJyEbfCBnpgqxiW6Y1sIRpp37rMQ-hHyJOlM-PJex6akN0dUhHKnQHNjSFXTRxfwsFC2HH6x1Qh6z_tb5QUE Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 7955701ff30f4933be7a17c662ff1002 Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1770531084 Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_7955701ff30f4933be7a17c662ff1002"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7955701ff30f4933be7a17c662ff1002"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7955701ff30f4933be7a17c662ff1002"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/7955701ff30f4933be7a17c662ff1002"}]}] Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1770531084 Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 7955701ff30f4933be7a17c662ff1002 Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1770531084 Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ImagesMetadataNegativeTestJSON-1770531084-project Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: cd2364d8c86e4361839573604f8dbccc Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1770531084-project Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: exception: Image not found. Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'image_id': '99225ee9-e2c5-4407-8011-1d3d8c2de872'} Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 99225ee9-e2c5-4407-8011-1d3d8c2de872 Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 18 02:15:18.406779 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 99225ee9-e2c5-4407-8011-1d3d8c2de872 could not be found. Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-318d71b7-47b9-48e4-8cbe-e9761af884f9 tempest-ImagesMetadataNegativeTestJSON-1770531084 tempest-ImagesMetadataNegativeTestJSON-1770531084-project] Returning 404 to user: Image not found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-318d71b7-47b9-48e4-8cbe-e9761af884f9 tempest-ImagesMetadataNegativeTestJSON-1770531084 tempest-ImagesMetadataNegativeTestJSON-1770531084-project] 10.222.0.57 "GET /compute/v2.1/images/99225ee9-e2c5-4407-8011-1d3d8c2de872/metadata" status: 404 len: 62 microversion: 2.1 time: 0.042321 Jul 18 02:15:18.411504 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 812/1606] 10.222.0.57 () {58 vars in 1259 bytes} [Mon Jul 18 02:15:18 2022] GET /compute/v2.1/images/99225ee9-e2c5-4407-8011-1d3d8c2de872/metadata => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:15:18.421176 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ba4846de-adcf-486b-b599-6eb1104fa6aa tempest-ImagesMetadataNegativeTestJSON-1770531084 tempest-ImagesMetadataNegativeTestJSON-1770531084-project] Action: 'update_all', calling method: .version_select at 0x7ff4a8609430>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:18.444928 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-ba4846de-adcf-486b-b599-6eb1104fa6aa tempest-ImagesMetadataNegativeTestJSON-1770531084 tempest-ImagesMetadataNegativeTestJSON-1770531084-project] HTTP exception thrown: Image not found. Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ba4846de-adcf-486b-b599-6eb1104fa6aa tempest-ImagesMetadataNegativeTestJSON-1770531084 tempest-ImagesMetadataNegativeTestJSON-1770531084-project] Request method failure captured: Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: request: PUT /compute/v2.1/images/af0d9738-48b3-4778-ba47-3402f45870f4/metadata HTTP/1.1 Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 57 Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MI0aZGoLFbq-esrFtQ7KvtYkemDQ0iBT_TfaJCYTJDSaopkDZRdr--gCz3xPza5pvrwd662_Em-dt7flmzbqtpo5pkzJyEbfCBnpgqxiW6Y1sIRpp37rMQ-hHyJOlM-PJex6akN0dUhHKnQHNjSFXTRxfwsFC2HH6x1Qh6z_tb5QUE Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 7955701ff30f4933be7a17c662ff1002 Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1770531084 Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_7955701ff30f4933be7a17c662ff1002"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7955701ff30f4933be7a17c662ff1002"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7955701ff30f4933be7a17c662ff1002"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/7955701ff30f4933be7a17c662ff1002"}]}] Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1770531084 Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 7955701ff30f4933be7a17c662ff1002 Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1770531084 Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ImagesMetadataNegativeTestJSON-1770531084-project Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: cd2364d8c86e4361839573604f8dbccc Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1770531084-project Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: exception: Image not found. Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'image_id': 'af0d9738-48b3-4778-ba47-3402f45870f4', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID af0d9738-48b3-4778-ba47-3402f45870f4 Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 18 02:15:18.447389 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image af0d9738-48b3-4778-ba47-3402f45870f4 could not be found. Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ba4846de-adcf-486b-b599-6eb1104fa6aa tempest-ImagesMetadataNegativeTestJSON-1770531084 tempest-ImagesMetadataNegativeTestJSON-1770531084-project] Returning 404 to user: Image not found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ba4846de-adcf-486b-b599-6eb1104fa6aa tempest-ImagesMetadataNegativeTestJSON-1770531084 tempest-ImagesMetadataNegativeTestJSON-1770531084-project] 10.222.0.57 "PUT /compute/v2.1/images/af0d9738-48b3-4778-ba47-3402f45870f4/metadata" status: 404 len: 62 microversion: 2.1 time: 0.032058 Jul 18 02:15:18.452737 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 813/1607] 10.222.0.57 () {60 vars in 1279 bytes} [Mon Jul 18 02:15:18 2022] PUT /compute/v2.1/images/af0d9738-48b3-4778-ba47-3402f45870f4/metadata => generated 62 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 18 02:15:18.462027 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-52f4da4f-8ed0-4349-bc55-ecf07c5664d3 tempest-ImagesMetadataNegativeTestJSON-1770531084 tempest-ImagesMetadataNegativeTestJSON-1770531084-project] Action: 'update', calling method: .version_select at 0x7ff4a8591dc0>, body: {"meta": {"os_distro": "alt"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:18.484508 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-52f4da4f-8ed0-4349-bc55-ecf07c5664d3 tempest-ImagesMetadataNegativeTestJSON-1770531084 tempest-ImagesMetadataNegativeTestJSON-1770531084-project] HTTP exception thrown: Image not found. Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-52f4da4f-8ed0-4349-bc55-ecf07c5664d3 tempest-ImagesMetadataNegativeTestJSON-1770531084 tempest-ImagesMetadataNegativeTestJSON-1770531084-project] Request method failure captured: Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: request: PUT /compute/v2.1/images/f78229f0-2d6b-4107-9f56-c967f7675d3b/metadata/os_distro HTTP/1.1 Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 30 Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MI0aZGoLFbq-esrFtQ7KvtYkemDQ0iBT_TfaJCYTJDSaopkDZRdr--gCz3xPza5pvrwd662_Em-dt7flmzbqtpo5pkzJyEbfCBnpgqxiW6Y1sIRpp37rMQ-hHyJOlM-PJex6akN0dUhHKnQHNjSFXTRxfwsFC2HH6x1Qh6z_tb5QUE Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 7955701ff30f4933be7a17c662ff1002 Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1770531084 Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_7955701ff30f4933be7a17c662ff1002"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7955701ff30f4933be7a17c662ff1002"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7955701ff30f4933be7a17c662ff1002"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/7955701ff30f4933be7a17c662ff1002"}]}] Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1770531084 Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 7955701ff30f4933be7a17c662ff1002 Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1770531084 Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ImagesMetadataNegativeTestJSON-1770531084-project Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: cd2364d8c86e4361839573604f8dbccc Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1770531084-project Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: {"meta": {"os_distro": "alt"}} Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: exception: Image not found. Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'image_id': 'f78229f0-2d6b-4107-9f56-c967f7675d3b', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f78229f0-2d6b-4107-9f56-c967f7675d3b Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 18 02:15:18.486750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f78229f0-2d6b-4107-9f56-c967f7675d3b could not be found. Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-52f4da4f-8ed0-4349-bc55-ecf07c5664d3 tempest-ImagesMetadataNegativeTestJSON-1770531084 tempest-ImagesMetadataNegativeTestJSON-1770531084-project] Returning 404 to user: Image not found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-52f4da4f-8ed0-4349-bc55-ecf07c5664d3 tempest-ImagesMetadataNegativeTestJSON-1770531084 tempest-ImagesMetadataNegativeTestJSON-1770531084-project] 10.222.0.57 "PUT /compute/v2.1/images/f78229f0-2d6b-4107-9f56-c967f7675d3b/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.031103 Jul 18 02:15:18.496511 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 814/1608] 10.222.0.57 () {60 vars in 1309 bytes} [Mon Jul 18 02:15:18 2022] PUT /compute/v2.1/images/f78229f0-2d6b-4107-9f56-c967f7675d3b/metadata/os_distro => generated 62 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:15:18.502926 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7661e704-0706-4d42-9c3d-f73d2c332c52 tempest-ImagesMetadataNegativeTestJSON-1770531084 tempest-ImagesMetadataNegativeTestJSON-1770531084-project] Action: 'create', calling method: .version_select at 0x7ff4a888a940>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:18.523424 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-7661e704-0706-4d42-9c3d-f73d2c332c52 tempest-ImagesMetadataNegativeTestJSON-1770531084 tempest-ImagesMetadataNegativeTestJSON-1770531084-project] HTTP exception thrown: Image not found. Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7661e704-0706-4d42-9c3d-f73d2c332c52 tempest-ImagesMetadataNegativeTestJSON-1770531084 tempest-ImagesMetadataNegativeTestJSON-1770531084-project] Request method failure captured: Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/images/107d9717-325e-49f7-ac6e-62e321749eab/metadata HTTP/1.1 Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 57 Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MI0aZGoLFbq-esrFtQ7KvtYkemDQ0iBT_TfaJCYTJDSaopkDZRdr--gCz3xPza5pvrwd662_Em-dt7flmzbqtpo5pkzJyEbfCBnpgqxiW6Y1sIRpp37rMQ-hHyJOlM-PJex6akN0dUhHKnQHNjSFXTRxfwsFC2HH6x1Qh6z_tb5QUE Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 7955701ff30f4933be7a17c662ff1002 Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1770531084 Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_7955701ff30f4933be7a17c662ff1002"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7955701ff30f4933be7a17c662ff1002"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7955701ff30f4933be7a17c662ff1002"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/7955701ff30f4933be7a17c662ff1002"}]}] Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1770531084 Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 7955701ff30f4933be7a17c662ff1002 Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1770531084 Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ImagesMetadataNegativeTestJSON-1770531084-project Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: cd2364d8c86e4361839573604f8dbccc Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1770531084-project Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: exception: Image not found. Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'image_id': '107d9717-325e-49f7-ac6e-62e321749eab', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 107d9717-325e-49f7-ac6e-62e321749eab Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 18 02:15:18.525842 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 107d9717-325e-49f7-ac6e-62e321749eab could not be found. Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7661e704-0706-4d42-9c3d-f73d2c332c52 tempest-ImagesMetadataNegativeTestJSON-1770531084 tempest-ImagesMetadataNegativeTestJSON-1770531084-project] Returning 404 to user: Image not found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7661e704-0706-4d42-9c3d-f73d2c332c52 tempest-ImagesMetadataNegativeTestJSON-1770531084 tempest-ImagesMetadataNegativeTestJSON-1770531084-project] 10.222.0.57 "POST /compute/v2.1/images/107d9717-325e-49f7-ac6e-62e321749eab/metadata" status: 404 len: 62 microversion: 2.1 time: 0.030606 Jul 18 02:15:18.535512 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 815/1609] 10.222.0.57 () {60 vars in 1280 bytes} [Mon Jul 18 02:15:18 2022] POST /compute/v2.1/images/107d9717-325e-49f7-ac6e-62e321749eab/metadata => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 18 02:15:18.606472 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-63f127a8-013e-42c9-b585-f9f2c7167b50 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:18.607467 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-63f127a8-013e-42c9-b585-f9f2c7167b50 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 85cf0fec-3e12-4af3-9525-925901fc41d9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:18.617776 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-63f127a8-013e-42c9-b585-f9f2c7167b50 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:18.618392 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-63f127a8-013e-42c9-b585-f9f2c7167b50 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:18.619635 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-63f127a8-013e-42c9-b585-f9f2c7167b50 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:18.620283 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-63f127a8-013e-42c9-b585-f9f2c7167b50 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:18.825119 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-63f127a8-013e-42c9-b585-f9f2c7167b50 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:18.833992 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-63f127a8-013e-42c9-b585-f9f2c7167b50 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/85cf0fec-3e12-4af3-9525-925901fc41d9" status: 200 len: 1317 microversion: 2.1 time: 0.233880 Jul 18 02:15:18.835230 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 816/1610] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:18 2022] GET /compute/v2.1/servers/85cf0fec-3e12-4af3-9525-925901fc41d9 => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:15:19.090418 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-80a9026b-7b52-4e3b-bd02-059da03f152c tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:19.092329 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-80a9026b-7b52-4e3b-bd02-059da03f152c tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] [instance: 32e81b5d-a507-4d47-b76e-699091d0e5bd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:19.103871 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-80a9026b-7b52-4e3b-bd02-059da03f152c tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:19.104693 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-80a9026b-7b52-4e3b-bd02-059da03f152c tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:19.106063 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-80a9026b-7b52-4e3b-bd02-059da03f152c tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:19.106681 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-80a9026b-7b52-4e3b-bd02-059da03f152c tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:19.349533 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-80a9026b-7b52-4e3b-bd02-059da03f152c tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a9dd4e239c4d73bdde1ced9cb90b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5d1b19c84a4a9fa4595a5c84f4555c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:19.360761 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-80a9026b-7b52-4e3b-bd02-059da03f152c tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd" status: 200 len: 1474 microversion: 2.1 time: 0.277728 Jul 18 02:15:19.361862 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 817/1611] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:19 2022] GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd => generated 1474 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:15:19.367888 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3f7fd38e-2ca3-4ab5-b1a0-52ba80c3cd74 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a85eaee0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:19.423487 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3f7fd38e-2ca3-4ab5-b1a0-52ba80c3cd74 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372" status: 200 len: 1423 microversion: 2.1 time: 0.060468 Jul 18 02:15:19.424075 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 818/1612] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:15:19 2022] GET /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372 => generated 1423 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:19.429932 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-869b19b4-7ced-4fff-9be7-c544a23bf86a tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:19.430817 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-869b19b4-7ced-4fff-9be7-c544a23bf86a tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:19.438900 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-869b19b4-7ced-4fff-9be7-c544a23bf86a tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:19.439365 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-869b19b4-7ced-4fff-9be7-c544a23bf86a tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:19.440647 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-869b19b4-7ced-4fff-9be7-c544a23bf86a tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:19.441295 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-869b19b4-7ced-4fff-9be7-c544a23bf86a tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:19.741426 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-869b19b4-7ced-4fff-9be7-c544a23bf86a tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9472908374c94355ada94f4947c99f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab10eb9b4cc4b13a640f5479056ab79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:19.773651 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-869b19b4-7ced-4fff-9be7-c544a23bf86a tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] 10.222.0.57 "GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee" status: 200 len: 1322 microversion: 2.1 time: 0.343840 Jul 18 02:15:19.776358 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 819/1613] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:19 2022] GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee => generated 1322 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:19.854687 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c4f3258d-bec2-4269-9e11-a2fb5e3e316a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:19.855329 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c4f3258d-bec2-4269-9e11-a2fb5e3e316a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 85cf0fec-3e12-4af3-9525-925901fc41d9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:19.873358 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c4f3258d-bec2-4269-9e11-a2fb5e3e316a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:19.876200 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c4f3258d-bec2-4269-9e11-a2fb5e3e316a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:19.888490 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c4f3258d-bec2-4269-9e11-a2fb5e3e316a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:19.904905 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c4f3258d-bec2-4269-9e11-a2fb5e3e316a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:20.138502 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c4f3258d-bec2-4269-9e11-a2fb5e3e316a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:20.173729 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c4f3258d-bec2-4269-9e11-a2fb5e3e316a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/85cf0fec-3e12-4af3-9525-925901fc41d9" status: 200 len: 1317 microversion: 2.1 time: 0.321574 Jul 18 02:15:20.175574 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 820/1614] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:19 2022] GET /compute/v2.1/servers/85cf0fec-3e12-4af3-9525-925901fc41d9 => generated 1317 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:15:20.401034 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-18b6c198-8de3-41af-92bf-d578144d4b55 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:20.410579 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-18b6c198-8de3-41af-92bf-d578144d4b55 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] [instance: 32e81b5d-a507-4d47-b76e-699091d0e5bd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:20.431132 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-18b6c198-8de3-41af-92bf-d578144d4b55 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:20.431843 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-18b6c198-8de3-41af-92bf-d578144d4b55 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:20.433183 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-18b6c198-8de3-41af-92bf-d578144d4b55 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:20.433967 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-18b6c198-8de3-41af-92bf-d578144d4b55 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:20.854873 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-18b6c198-8de3-41af-92bf-d578144d4b55 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a9dd4e239c4d73bdde1ced9cb90b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5d1b19c84a4a9fa4595a5c84f4555c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:20.872820 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-18b6c198-8de3-41af-92bf-d578144d4b55 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd" status: 200 len: 1474 microversion: 2.1 time: 0.494717 Jul 18 02:15:20.874904 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 821/1615] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:20 2022] GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd => generated 1474 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:20.886213 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7b797e5c-ef48-417b-ac4e-e9b858e5abd0 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a85e5430>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:20.956823 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7b797e5c-ef48-417b-ac4e-e9b858e5abd0 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372" status: 200 len: 1423 microversion: 2.1 time: 0.079696 Jul 18 02:15:20.964201 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 822/1616] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:15:20 2022] GET /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372 => generated 1423 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:21.247666 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4331cffa-8a2c-4d9a-9a3c-964b73bde2e9 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5/action" status: 202 len: 0 microversion: 2.25 time: 6.203801 Jul 18 02:15:21.248305 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 795/1617] 10.222.0.57 () {62 vars in 1318 bytes} [Mon Jul 18 02:15:15 2022] POST /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5/action => generated 0 bytes in 6205 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:15:21.255804 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0c04ec03-43ec-4d22-8cfb-e15d18845564 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:21.256572 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0c04ec03-43ec-4d22-8cfb-e15d18845564 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:21.295943 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c04ec03-43ec-4d22-8cfb-e15d18845564 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:21.296702 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c04ec03-43ec-4d22-8cfb-e15d18845564 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:21.297403 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c04ec03-43ec-4d22-8cfb-e15d18845564 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:21.297904 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c04ec03-43ec-4d22-8cfb-e15d18845564 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:21.523009 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c74b0bb1-dbe4-47df-845f-89a1caa0c80e tempest-VolumesAdminNegativeTest-1236398612 tempest-VolumesAdminNegativeTest-1236398612-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "9c003147-873d-4c6b-a140-6a01cb17197c"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:21.524470 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c74b0bb1-dbe4-47df-845f-89a1caa0c80e tempest-VolumesAdminNegativeTest-1236398612 tempest-VolumesAdminNegativeTest-1236398612-project-admin] [instance: b74ae52f-6794-49d2-867e-be0996b090aa] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:21.536060 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c74b0bb1-dbe4-47df-845f-89a1caa0c80e tempest-VolumesAdminNegativeTest-1236398612 tempest-VolumesAdminNegativeTest-1236398612-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:21.536848 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c74b0bb1-dbe4-47df-845f-89a1caa0c80e tempest-VolumesAdminNegativeTest-1236398612 tempest-VolumesAdminNegativeTest-1236398612-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:21.538651 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c74b0bb1-dbe4-47df-845f-89a1caa0c80e tempest-VolumesAdminNegativeTest-1236398612 tempest-VolumesAdminNegativeTest-1236398612-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:21.539391 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c74b0bb1-dbe4-47df-845f-89a1caa0c80e tempest-VolumesAdminNegativeTest-1236398612 tempest-VolumesAdminNegativeTest-1236398612-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:21.787379 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0c04ec03-43ec-4d22-8cfb-e15d18845564 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9472908374c94355ada94f4947c99f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab10eb9b4cc4b13a640f5479056ab79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:21.806600 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0c04ec03-43ec-4d22-8cfb-e15d18845564 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] 10.222.0.57 "GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee" status: 200 len: 1322 microversion: 2.1 time: 0.557065 Jul 18 02:15:21.807237 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 796/1618] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:21 2022] GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee => generated 1322 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:21.820400 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-14b2d240-dfb5-476d-a0f5-14772841433a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:21.822640 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-14b2d240-dfb5-476d-a0f5-14772841433a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 85cf0fec-3e12-4af3-9525-925901fc41d9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:21.850458 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:21.858619 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14b2d240-dfb5-476d-a0f5-14772841433a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:21.859211 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14b2d240-dfb5-476d-a0f5-14772841433a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:21.861817 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14b2d240-dfb5-476d-a0f5-14772841433a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:21.867714 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14b2d240-dfb5-476d-a0f5-14772841433a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:22.019453 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-c74b0bb1-dbe4-47df-845f-89a1caa0c80e tempest-VolumesAdminNegativeTest-1236398612 tempest-VolumesAdminNegativeTest-1236398612-project-admin] HTTP exception thrown: Volume 9c003147-873d-4c6b-a140-6a01cb17197c could not be found. Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c74b0bb1-dbe4-47df-845f-89a1caa0c80e tempest-VolumesAdminNegativeTest-1236398612 tempest-VolumesAdminNegativeTest-1236398612-project-admin] Request method failure captured: Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: request: PUT /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa/os-volume_attachments/284d37b1-7db7-4c72-9ce2-af39cb505e9e HTTP/1.1 Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 74 Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MG0mBhXEn4ldFlGgEaGffCrImpCXLFviLmGEX5WwFzPdbA2D2vzb8_skSNDflnGLUH2Y0yDSTFPLalLQQ0BXYMH1UeK2AJPF7-gcD7I0m0gecHZi6aCcwgj8Uc2_O_JqqK91L6ZZv7dHFH7p6OAF7IUHiwVaaXNG44l5l4RKrb0_As Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: b3c8847b00274283bc0a80503bc0bb80 Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-VolumesAdminNegativeTest-1236398612 Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,admin,reader Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,admin,reader Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b3c8847b00274283bc0a80503bc0bb80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b3c8847b00274283bc0a80503bc0bb80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b3c8847b00274283bc0a80503bc0bb80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b3c8847b00274283bc0a80503bc0bb80"}]}] Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-VolumesAdminNegativeTest-1236398612 Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: b3c8847b00274283bc0a80503bc0bb80 Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1236398612 Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-VolumesAdminNegativeTest-1236398612-project-admin Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: a6cd390b445b4dd28d1d9bc1aa3a9455 Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-VolumesAdminNegativeTest-1236398612-project-admin Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: {"volumeAttachment": {"volumeId": "9c003147-873d-4c6b-a140-6a01cb17197c"}} Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: exception: Volume 9c003147-873d-4c6b-a140-6a01cb17197c could not be found. Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'server_id': 'b74ae52f-6794-49d2-867e-be0996b090aa', 'id': '284d37b1-7db7-4c72-9ce2-af39cb505e9e', 'body': {'volumeAttachment': {'volumeId': '9c003147-873d-4c6b-a140-6a01cb17197c'}}} Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9c003147-873d-4c6b-a140-6a01cb17197c could not be found. (HTTP 404) (Request-ID: req-0dc2476e-0f75-42ca-8a57-64fd3cff1238) Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 02:15:22.041337 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9c003147-873d-4c6b-a140-6a01cb17197c could not be found. Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 9c003147-873d-4c6b-a140-6a01cb17197c could not be found. Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9c003147-873d-4c6b-a140-6a01cb17197c could not be found. Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:22.047051 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c74b0bb1-dbe4-47df-845f-89a1caa0c80e tempest-VolumesAdminNegativeTest-1236398612 tempest-VolumesAdminNegativeTest-1236398612-project-admin] Returning 400 to user: Volume 9c003147-873d-4c6b-a140-6a01cb17197c could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:15:22.051844 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c74b0bb1-dbe4-47df-845f-89a1caa0c80e tempest-VolumesAdminNegativeTest-1236398612 tempest-VolumesAdminNegativeTest-1236398612-project-admin] 10.222.0.57 "PUT /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa/os-volume_attachments/284d37b1-7db7-4c72-9ce2-af39cb505e9e" status: 400 len: 107 microversion: 2.1 time: 1.078487 Jul 18 02:15:22.052900 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 823/1619] 10.222.0.57 () {60 vars in 1432 bytes} [Mon Jul 18 02:15:20 2022] PUT /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa/os-volume_attachments/284d37b1-7db7-4c72-9ce2-af39cb505e9e => generated 107 bytes in 1093 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:15:22.059134 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-44a0421b-161e-4f60-b833-f024deb0b26a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:22.060303 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-44a0421b-161e-4f60-b833-f024deb0b26a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2b4a452c-dd09-4dd6-ab90-bd7d584343e5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:22.070285 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-44a0421b-161e-4f60-b833-f024deb0b26a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:22.071594 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-44a0421b-161e-4f60-b833-f024deb0b26a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:22.072578 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-44a0421b-161e-4f60-b833-f024deb0b26a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:22.073332 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-44a0421b-161e-4f60-b833-f024deb0b26a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:22.171474 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-14b2d240-dfb5-476d-a0f5-14772841433a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:22.194036 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-14b2d240-dfb5-476d-a0f5-14772841433a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/85cf0fec-3e12-4af3-9525-925901fc41d9" status: 200 len: 1317 microversion: 2.1 time: 0.378868 Jul 18 02:15:22.210324 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 797/1620] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:21 2022] GET /compute/v2.1/servers/85cf0fec-3e12-4af3-9525-925901fc41d9 => generated 1317 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:22.223446 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-77336eb6-6433-40e7-8f4a-2fe1e4e9f765 req-32d041ca-f4e8-4995-b583-47d25858d0e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32e81b5d-a507-4d47-b76e-699091d0e5bd", "name": "network-vif-deleted", "tag": "07f51000-5732-46e7-8e0e-0bd9c61e7698"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:22.243073 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-77336eb6-6433-40e7-8f4a-2fe1e4e9f765 req-32d041ca-f4e8-4995-b583-47d25858d0e0 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:22.244479 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-77336eb6-6433-40e7-8f4a-2fe1e4e9f765 req-32d041ca-f4e8-4995-b583-47d25858d0e0 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:22.268619 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-77336eb6-6433-40e7-8f4a-2fe1e4e9f765 req-32d041ca-f4e8-4995-b583-47d25858d0e0 service nova] Creating event network-vif-deleted:07f51000-5732-46e7-8e0e-0bd9c61e7698 for instance 32e81b5d-a507-4d47-b76e-699091d0e5bd on n-h2-465891-3 Jul 18 02:15:22.281053 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-77336eb6-6433-40e7-8f4a-2fe1e4e9f765 req-32d041ca-f4e8-4995-b583-47d25858d0e0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067884 Jul 18 02:15:22.282858 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 798/1621] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:22.323262 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-409ddd22-3064-403d-ab80-399a4d72fe17 req-a78aaf66-a88a-4926-a93b-cf1ddf15e8ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85cf0fec-3e12-4af3-9525-925901fc41d9", "name": "network-vif-plugged", "status": "completed", "tag": "6d4cd1b3-4941-4b7c-ae0f-5cb58271177c"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:22.354901 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-409ddd22-3064-403d-ab80-399a4d72fe17 req-a78aaf66-a88a-4926-a93b-cf1ddf15e8ac service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:22.355360 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-409ddd22-3064-403d-ab80-399a4d72fe17 req-a78aaf66-a88a-4926-a93b-cf1ddf15e8ac service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:22.382322 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-409ddd22-3064-403d-ab80-399a4d72fe17 req-a78aaf66-a88a-4926-a93b-cf1ddf15e8ac service nova] Creating event network-vif-plugged:6d4cd1b3-4941-4b7c-ae0f-5cb58271177c for instance 85cf0fec-3e12-4af3-9525-925901fc41d9 on n-h2-465891-3 Jul 18 02:15:22.392328 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-409ddd22-3064-403d-ab80-399a4d72fe17 req-a78aaf66-a88a-4926-a93b-cf1ddf15e8ac service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100332 Jul 18 02:15:22.398799 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 799/1622] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:22.404850 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1246fe47-8fe0-459a-ae78-72a57bcf508c tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:22.405318 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1246fe47-8fe0-459a-ae78-72a57bcf508c tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] [instance: 32e81b5d-a507-4d47-b76e-699091d0e5bd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:22.431092 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1246fe47-8fe0-459a-ae78-72a57bcf508c tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:22.431923 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1246fe47-8fe0-459a-ae78-72a57bcf508c tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:22.433093 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1246fe47-8fe0-459a-ae78-72a57bcf508c tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:22.433742 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1246fe47-8fe0-459a-ae78-72a57bcf508c tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:22.450906 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-1246fe47-8fe0-459a-ae78-72a57bcf508c tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] HTTP exception thrown: Instance 32e81b5d-a507-4d47-b76e-699091d0e5bd could not be found. Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1246fe47-8fe0-459a-ae78-72a57bcf508c tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Request method failure captured: Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd HTTP/1.1 Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MFwV5bRdZluXbBPx6A4z7PSYNFOFZ9QdVwb3y3KaIFsfdKHzw-86PrzyizLYKF833OnddStfccsruqpjt3Vs6y1R--Bgco10Cwj-o-EYReyJBqJTXbas5TNu8JtlTNy1ySnaqgRU_4rLZmzll8XztOgdsWQF5ZnMML7D5wRmnqNcu4 Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: db5d1b19c84a4a9fa4595a5c84f4555c Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ListImageFiltersTestJSON-2100098285 Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_db5d1b19c84a4a9fa4595a5c84f4555c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/db5d1b19c84a4a9fa4595a5c84f4555c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/db5d1b19c84a4a9fa4595a5c84f4555c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/db5d1b19c84a4a9fa4595a5c84f4555c"}]}] Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ListImageFiltersTestJSON-2100098285 Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: db5d1b19c84a4a9fa4595a5c84f4555c Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-2100098285 Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ListImageFiltersTestJSON-2100098285-project Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 91a9dd4e239c4d73bdde1ced9cb90b46 Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ListImageFiltersTestJSON-2100098285-project Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 32e81b5d-a507-4d47-b76e-699091d0e5bd could not be found. Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '32e81b5d-a507-4d47-b76e-699091d0e5bd'} Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32e81b5d-a507-4d47-b76e-699091d0e5bd could not be found. Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32e81b5d-a507-4d47-b76e-699091d0e5bd could not be found. Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:22.452594 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:15:22.458334 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:22.458334 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:15:22.458334 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:15:22.458334 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:15:22.458334 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:15:22.458334 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32e81b5d-a507-4d47-b76e-699091d0e5bd could not be found. Jul 18 02:15:22.458334 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:15:22.458334 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1246fe47-8fe0-459a-ae78-72a57bcf508c tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Returning 404 to user: Instance 32e81b5d-a507-4d47-b76e-699091d0e5bd could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:15:22.458334 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1246fe47-8fe0-459a-ae78-72a57bcf508c tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd" status: 404 len: 111 microversion: 2.1 time: 0.053918 Jul 18 02:15:22.458334 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 800/1623] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:22 2022] GET /compute/v2.1/servers/32e81b5d-a507-4d47-b76e-699091d0e5bd => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:15:22.474651 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f95794a6-84e9-4380-945d-a18c17d3cb85 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4adcfc4c0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:22.536788 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f95794a6-84e9-4380-945d-a18c17d3cb85 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372" status: 200 len: 1423 microversion: 2.1 time: 0.077346 Jul 18 02:15:22.537622 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 801/1624] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:15:22 2022] GET /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372 => generated 1423 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:22.543177 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-94690764-3d9a-4d48-b360-29643ea8ec4b tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:22.543948 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-94690764-3d9a-4d48-b360-29643ea8ec4b tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: b74ae52f-6794-49d2-867e-be0996b090aa] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:22.555019 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-94690764-3d9a-4d48-b360-29643ea8ec4b tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:22.555774 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-94690764-3d9a-4d48-b360-29643ea8ec4b tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:22.556870 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-94690764-3d9a-4d48-b360-29643ea8ec4b tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:22.557577 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-94690764-3d9a-4d48-b360-29643ea8ec4b tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:22.745932 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-94690764-3d9a-4d48-b360-29643ea8ec4b tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lazy-loading 'services' on Instance uuid b74ae52f-6794-49d2-867e-be0996b090aa {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:15:23.033021 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-44a0421b-161e-4f60-b833-f024deb0b26a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:23.051310 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-44a0421b-161e-4f60-b833-f024deb0b26a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:23.058536 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-44a0421b-161e-4f60-b833-f024deb0b26a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:23.064189 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-44a0421b-161e-4f60-b833-f024deb0b26a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5" status: 200 len: 1568 microversion: 2.25 time: 1.010670 Jul 18 02:15:23.079186 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 824/1625] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:15:22 2022] GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5 => generated 1568 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:15:23.087858 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-90287bb4-25f7-473f-9c67-32cd66e620cf tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:23.088960 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-90287bb4-25f7-473f-9c67-32cd66e620cf tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] [instance: 697075ff-db42-4729-8faf-2c2935d72630] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:23.098335 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-90287bb4-25f7-473f-9c67-32cd66e620cf tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:23.099173 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-90287bb4-25f7-473f-9c67-32cd66e620cf tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:23.100947 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-90287bb4-25f7-473f-9c67-32cd66e620cf tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:23.101786 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-90287bb4-25f7-473f-9c67-32cd66e620cf tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:23.151324 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-90287bb4-25f7-473f-9c67-32cd66e620cf tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] [instance: 697075ff-db42-4729-8faf-2c2935d72630] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:15:23.151914 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-94690764-3d9a-4d48-b360-29643ea8ec4b tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa/os-volume_attachments/284d37b1-7db7-4c72-9ce2-af39cb505e9e" status: 202 len: 0 microversion: 2.1 time: 0.612559 Jul 18 02:15:23.156493 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 802/1626] 10.222.0.57 () {58 vars in 1415 bytes} [Mon Jul 18 02:15:22 2022] DELETE /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa/os-volume_attachments/284d37b1-7db7-4c72-9ce2-af39cb505e9e => generated 0 bytes in 614 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:15:23.160968 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0a328a7f-278c-4c00-9597-7eae80745b4b tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:23.161786 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0a328a7f-278c-4c00-9597-7eae80745b4b tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:23.169107 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0a328a7f-278c-4c00-9597-7eae80745b4b tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:23.169626 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0a328a7f-278c-4c00-9597-7eae80745b4b tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:23.170615 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0a328a7f-278c-4c00-9597-7eae80745b4b tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:23.171070 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0a328a7f-278c-4c00-9597-7eae80745b4b tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:23.271639 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-90287bb4-25f7-473f-9c67-32cd66e620cf tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "DELETE /compute/v2.1/servers/697075ff-db42-4729-8faf-2c2935d72630" status: 204 len: 0 microversion: 2.1 time: 0.190637 Jul 18 02:15:23.272518 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 825/1627] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:15:23 2022] DELETE /compute/v2.1/servers/697075ff-db42-4729-8faf-2c2935d72630 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:15:23.281482 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1154a5db-d5c8-4901-98db-934c84582125 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:23.283579 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1154a5db-d5c8-4901-98db-934c84582125 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: b74ae52f-6794-49d2-867e-be0996b090aa] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:23.291047 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1154a5db-d5c8-4901-98db-934c84582125 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:23.291499 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1154a5db-d5c8-4901-98db-934c84582125 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:23.292286 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1154a5db-d5c8-4901-98db-934c84582125 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:23.292728 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1154a5db-d5c8-4901-98db-934c84582125 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:23.354561 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1154a5db-d5c8-4901-98db-934c84582125 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "GET /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077822 Jul 18 02:15:23.355647 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 826/1628] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:15:23 2022] GET /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:23.361652 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-94132499-3ff2-4b9a-a9e6-5fad9d86d1a5 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:23.363058 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-94132499-3ff2-4b9a-a9e6-5fad9d86d1a5 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 85cf0fec-3e12-4af3-9525-925901fc41d9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:23.371923 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-94132499-3ff2-4b9a-a9e6-5fad9d86d1a5 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:23.375064 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-94132499-3ff2-4b9a-a9e6-5fad9d86d1a5 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:23.376496 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-94132499-3ff2-4b9a-a9e6-5fad9d86d1a5 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:23.377267 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-94132499-3ff2-4b9a-a9e6-5fad9d86d1a5 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:23.678682 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0a328a7f-278c-4c00-9597-7eae80745b4b tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9472908374c94355ada94f4947c99f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab10eb9b4cc4b13a640f5479056ab79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:23.695846 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0a328a7f-278c-4c00-9597-7eae80745b4b tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] 10.222.0.57 "GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee" status: 200 len: 1517 microversion: 2.1 time: 0.541263 Jul 18 02:15:23.697272 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 803/1629] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:23 2022] GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee => generated 1517 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:23.705880 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-25ef40d6-ed11-45ec-a941-094fc6edb995 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:23.706955 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-25ef40d6-ed11-45ec-a941-094fc6edb995 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] [instance: 697075ff-db42-4729-8faf-2c2935d72630] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:23.715816 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-25ef40d6-ed11-45ec-a941-094fc6edb995 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:23.717773 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-25ef40d6-ed11-45ec-a941-094fc6edb995 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:23.719785 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-25ef40d6-ed11-45ec-a941-094fc6edb995 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:23.721327 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-25ef40d6-ed11-45ec-a941-094fc6edb995 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:23.766379 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-94132499-3ff2-4b9a-a9e6-5fad9d86d1a5 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:23.783508 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-94132499-3ff2-4b9a-a9e6-5fad9d86d1a5 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/85cf0fec-3e12-4af3-9525-925901fc41d9" status: 200 len: 1317 microversion: 2.1 time: 0.426003 Jul 18 02:15:23.785092 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 827/1630] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:23 2022] GET /compute/v2.1/servers/85cf0fec-3e12-4af3-9525-925901fc41d9 => generated 1317 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:23.811479 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-54c6a274-22f0-4168-b2bf-6599d7979f79 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a85504c0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:23.945228 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-54c6a274-22f0-4168-b2bf-6599d7979f79 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372" status: 200 len: 1423 microversion: 2.1 time: 0.144870 Jul 18 02:15:23.945993 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 828/1631] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:15:23 2022] GET /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372 => generated 1423 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:23.963471 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7f5ece79-6539-4941-adad-17d163ef42b9 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:23.965861 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7f5ece79-6539-4941-adad-17d163ef42b9 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:24.005935 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7f5ece79-6539-4941-adad-17d163ef42b9 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:24.010919 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7f5ece79-6539-4941-adad-17d163ef42b9 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:24.014508 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7f5ece79-6539-4941-adad-17d163ef42b9 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:24.016525 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7f5ece79-6539-4941-adad-17d163ef42b9 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:24.092656 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-7f5ece79-6539-4941-adad-17d163ef42b9 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lazy-loading 'flavor' on Instance uuid 7ddcf97f-5c13-4ed6-ac5b-17368a126dee {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:15:24.107441 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-25ef40d6-ed11-45ec-a941-094fc6edb995 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a9dd4e239c4d73bdde1ced9cb90b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5d1b19c84a4a9fa4595a5c84f4555c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:24.128341 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-25ef40d6-ed11-45ec-a941-094fc6edb995 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/servers/697075ff-db42-4729-8faf-2c2935d72630" status: 200 len: 1474 microversion: 2.1 time: 0.428018 Jul 18 02:15:24.129813 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 804/1632] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:23 2022] GET /compute/v2.1/servers/697075ff-db42-4729-8faf-2c2935d72630 => generated 1474 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:24.140534 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-ff616bfb-98a8-42a4-8639-a6bc8f4c68ae req-2af96667-606c-4c64-9c06-5b37202894b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b4a452c-dd09-4dd6-ab90-bd7d584343e5", "name": "network-vif-unplugged", "status": "completed", "tag": "a4f23488-d99c-41fb-8662-75c98bd2a84e"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:24.168635 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-ff616bfb-98a8-42a4-8639-a6bc8f4c68ae req-2af96667-606c-4c64-9c06-5b37202894b1 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:24.171286 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-ff616bfb-98a8-42a4-8639-a6bc8f4c68ae req-2af96667-606c-4c64-9c06-5b37202894b1 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:24.196349 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-ff616bfb-98a8-42a4-8639-a6bc8f4c68ae req-2af96667-606c-4c64-9c06-5b37202894b1 service nova] Creating event network-vif-unplugged:a4f23488-d99c-41fb-8662-75c98bd2a84e for instance 2b4a452c-dd09-4dd6-ab90-bd7d584343e5 on n-h1-465891-3 Jul 18 02:15:24.213152 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-ff616bfb-98a8-42a4-8639-a6bc8f4c68ae req-2af96667-606c-4c64-9c06-5b37202894b1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080775 Jul 18 02:15:24.214376 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 805/1633] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:24.235218 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e1af5729-1549-4152-9d3c-9850c53cbaed tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:24.236821 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e1af5729-1549-4152-9d3c-9850c53cbaed tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2b4a452c-dd09-4dd6-ab90-bd7d584343e5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:24.251824 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e1af5729-1549-4152-9d3c-9850c53cbaed tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:24.252629 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e1af5729-1549-4152-9d3c-9850c53cbaed tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:24.254325 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e1af5729-1549-4152-9d3c-9850c53cbaed tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:24.255082 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e1af5729-1549-4152-9d3c-9850c53cbaed tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:24.324997 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7f5ece79-6539-4941-adad-17d163ef42b9 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] 10.222.0.57 "POST /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee/action" status: 200 len: 32 microversion: 2.1 time: 0.372907 Jul 18 02:15:24.326617 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 829/1634] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:15:23 2022] POST /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee/action => generated 32 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:15:24.339800 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-901bc487-ad22-48a4-8eff-b81cb62f6209 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:24.340518 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-901bc487-ad22-48a4-8eff-b81cb62f6209 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:24.363449 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-901bc487-ad22-48a4-8eff-b81cb62f6209 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:24.363916 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-901bc487-ad22-48a4-8eff-b81cb62f6209 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:24.364762 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-901bc487-ad22-48a4-8eff-b81cb62f6209 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:24.365207 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-901bc487-ad22-48a4-8eff-b81cb62f6209 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:24.596449 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e1af5729-1549-4152-9d3c-9850c53cbaed tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:24.613303 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e1af5729-1549-4152-9d3c-9850c53cbaed tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:24.617456 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e1af5729-1549-4152-9d3c-9850c53cbaed tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:24.620479 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e1af5729-1549-4152-9d3c-9850c53cbaed tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5" status: 200 len: 1568 microversion: 2.25 time: 0.403751 Jul 18 02:15:24.632529 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 806/1635] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:15:24 2022] GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5 => generated 1568 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:15:24.650841 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-40e5546e-ff10-440c-b272-f52b807e24b5 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:24.651872 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-40e5546e-ff10-440c-b272-f52b807e24b5 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: b74ae52f-6794-49d2-867e-be0996b090aa] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:24.658545 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-901bc487-ad22-48a4-8eff-b81cb62f6209 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9472908374c94355ada94f4947c99f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab10eb9b4cc4b13a640f5479056ab79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:24.661527 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-40e5546e-ff10-440c-b272-f52b807e24b5 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:24.663205 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-40e5546e-ff10-440c-b272-f52b807e24b5 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:24.665255 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-40e5546e-ff10-440c-b272-f52b807e24b5 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:24.666439 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-40e5546e-ff10-440c-b272-f52b807e24b5 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:24.668509 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-901bc487-ad22-48a4-8eff-b81cb62f6209 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] 10.222.0.57 "GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee" status: 200 len: 1523 microversion: 2.1 time: 0.336506 Jul 18 02:15:24.670545 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 830/1636] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:24 2022] GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee => generated 1523 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:24.719946 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-40e5546e-ff10-440c-b272-f52b807e24b5 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "GET /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082777 Jul 18 02:15:24.720578 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 807/1637] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:15:24 2022] GET /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:24.772458 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-87f2f1e2-4fd4-4dd1-b5ce-b1fe1b764b15 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-848148827", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "78dfad14-feb6-4310-88aa-f627d76987ec"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:24.813978 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d44e9775-7b2e-4bc5-b038-4ba25f915eab tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:24.814694 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d44e9775-7b2e-4bc5-b038-4ba25f915eab tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 85cf0fec-3e12-4af3-9525-925901fc41d9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:24.822226 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d44e9775-7b2e-4bc5-b038-4ba25f915eab tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:24.822941 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d44e9775-7b2e-4bc5-b038-4ba25f915eab tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:24.823741 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d44e9775-7b2e-4bc5-b038-4ba25f915eab tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:24.824184 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d44e9775-7b2e-4bc5-b038-4ba25f915eab tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:24.842883 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-87f2f1e2-4fd4-4dd1-b5ce-b1fe1b764b15 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] validate_networks() for [('78dfad14-feb6-4310-88aa-f627d76987ec', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:15:25.066741 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d44e9775-7b2e-4bc5-b038-4ba25f915eab tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:25.086174 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d44e9775-7b2e-4bc5-b038-4ba25f915eab tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/85cf0fec-3e12-4af3-9525-925901fc41d9" status: 200 len: 1317 microversion: 2.1 time: 0.275620 Jul 18 02:15:25.088056 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 808/1638] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:24 2022] GET /compute/v2.1/servers/85cf0fec-3e12-4af3-9525-925901fc41d9 => generated 1317 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:25.093298 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f3a217f4-7fb5-41c0-b711-88736654fcb4 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a8871d30>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:25.157955 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f3a217f4-7fb5-41c0-b711-88736654fcb4 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372" status: 200 len: 1423 microversion: 2.1 time: 0.068850 Jul 18 02:15:25.158807 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 809/1639] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:15:25 2022] GET /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372 => generated 1423 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:25.164926 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1120c252-9a4e-4ba7-aa89-4b0e86753b7f tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:25.166531 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1120c252-9a4e-4ba7-aa89-4b0e86753b7f tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] [instance: 697075ff-db42-4729-8faf-2c2935d72630] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:25.174181 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1120c252-9a4e-4ba7-aa89-4b0e86753b7f tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:25.174932 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1120c252-9a4e-4ba7-aa89-4b0e86753b7f tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:25.175740 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1120c252-9a4e-4ba7-aa89-4b0e86753b7f tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:25.176195 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1120c252-9a4e-4ba7-aa89-4b0e86753b7f tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:25.651903 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1120c252-9a4e-4ba7-aa89-4b0e86753b7f tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a9dd4e239c4d73bdde1ced9cb90b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5d1b19c84a4a9fa4595a5c84f4555c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:25.680114 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1120c252-9a4e-4ba7-aa89-4b0e86753b7f tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/servers/697075ff-db42-4729-8faf-2c2935d72630" status: 200 len: 1474 microversion: 2.1 time: 0.519315 Jul 18 02:15:25.682349 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 810/1640] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:25 2022] GET /compute/v2.1/servers/697075ff-db42-4729-8faf-2c2935d72630 => generated 1474 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:25.698974 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-9eb461dc-77a9-403d-99d2-621fb634f108 req-f8aa97b0-6da5-4e7c-a17c-c7e9b6a72b66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32361df9-4e50-409c-9cc7-6f70ba6ce26e", "name": "network-vif-plugged", "status": "completed", "tag": "7c604958-4d5c-4ace-8013-9827944aa0c6"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:25.711961 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-9eb461dc-77a9-403d-99d2-621fb634f108 req-f8aa97b0-6da5-4e7c-a17c-c7e9b6a72b66 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:25.715367 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-9eb461dc-77a9-403d-99d2-621fb634f108 req-f8aa97b0-6da5-4e7c-a17c-c7e9b6a72b66 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:25.716974 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-87f2f1e2-4fd4-4dd1-b5ce-b1fe1b764b15 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:15:25.718066 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-87f2f1e2-4fd4-4dd1-b5ce-b1fe1b764b15 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:15:25.719199 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-87f2f1e2-4fd4-4dd1-b5ce-b1fe1b764b15 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:15:25.720069 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-87f2f1e2-4fd4-4dd1-b5ce-b1fe1b764b15 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:15:25.720929 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-87f2f1e2-4fd4-4dd1-b5ce-b1fe1b764b15 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:15:25.738335 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-87f2f1e2-4fd4-4dd1-b5ce-b1fe1b764b15 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:25.738965 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-87f2f1e2-4fd4-4dd1-b5ce-b1fe1b764b15 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:25.740198 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-87f2f1e2-4fd4-4dd1-b5ce-b1fe1b764b15 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:25.742618 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-87f2f1e2-4fd4-4dd1-b5ce-b1fe1b764b15 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:25.745027 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-9eb461dc-77a9-403d-99d2-621fb634f108 req-f8aa97b0-6da5-4e7c-a17c-c7e9b6a72b66 service nova] Creating event network-vif-plugged:7c604958-4d5c-4ace-8013-9827944aa0c6 for instance 32361df9-4e50-409c-9cc7-6f70ba6ce26e on n-h1-465891-3 Jul 18 02:15:25.760192 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-9eb461dc-77a9-403d-99d2-621fb634f108 req-f8aa97b0-6da5-4e7c-a17c-c7e9b6a72b66 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075348 Jul 18 02:15:25.761185 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 811/1641] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:25.767490 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-477c212f-1922-4b68-810b-fc6dc6877db5 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:25.768925 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-477c212f-1922-4b68-810b-fc6dc6877db5 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2b4a452c-dd09-4dd6-ab90-bd7d584343e5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:25.772555 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:25.795604 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-477c212f-1922-4b68-810b-fc6dc6877db5 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:25.796359 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-477c212f-1922-4b68-810b-fc6dc6877db5 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:25.803857 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-477c212f-1922-4b68-810b-fc6dc6877db5 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:25.804814 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-477c212f-1922-4b68-810b-fc6dc6877db5 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:25.816189 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-87f2f1e2-4fd4-4dd1-b5ce-b1fe1b764b15 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Getting quotas for project 58dcb69855544ff3b51109aa5d41f637. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:15:25.848887 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-87f2f1e2-4fd4-4dd1-b5ce-b1fe1b764b15 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Getting quotas for user 560f87bfc55d4de2b0106db2ce0ce2af and project 58dcb69855544ff3b51109aa5d41f637. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:15:25.875986 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-87f2f1e2-4fd4-4dd1-b5ce-b1fe1b764b15 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:15:25.878850 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-87f2f1e2-4fd4-4dd1-b5ce-b1fe1b764b15 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 4a494dac-3446-4569-b154-b14f9eb22b3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:15:25.936350 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-87f2f1e2-4fd4-4dd1-b5ce-b1fe1b764b15 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.263811 Jul 18 02:15:25.937737 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 831/1642] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:15:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:15:25.969016 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3753bc50-e960-4272-9e6b-474b5b25c163 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:25.970347 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3753bc50-e960-4272-9e6b-474b5b25c163 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:25.995344 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3753bc50-e960-4272-9e6b-474b5b25c163 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:25.995858 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3753bc50-e960-4272-9e6b-474b5b25c163 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:25.996839 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3753bc50-e960-4272-9e6b-474b5b25c163 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:25.997356 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3753bc50-e960-4272-9e6b-474b5b25c163 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:26.399522 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-477c212f-1922-4b68-810b-fc6dc6877db5 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:26.415953 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-477c212f-1922-4b68-810b-fc6dc6877db5 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:26.418928 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-477c212f-1922-4b68-810b-fc6dc6877db5 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:26.422243 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-477c212f-1922-4b68-810b-fc6dc6877db5 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5" status: 200 len: 1568 microversion: 2.25 time: 0.658329 Jul 18 02:15:26.423267 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 812/1643] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:15:25 2022] GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5 => generated 1568 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:15:26.440958 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f1b007e2-3bb7-4658-97ea-76f65ba375eb tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:26.442385 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f1b007e2-3bb7-4658-97ea-76f65ba375eb tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: b74ae52f-6794-49d2-867e-be0996b090aa] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:26.452581 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f1b007e2-3bb7-4658-97ea-76f65ba375eb tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:26.453033 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f1b007e2-3bb7-4658-97ea-76f65ba375eb tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:26.454394 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f1b007e2-3bb7-4658-97ea-76f65ba375eb tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:26.455713 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f1b007e2-3bb7-4658-97ea-76f65ba375eb tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:26.503287 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:26.510479 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f1b007e2-3bb7-4658-97ea-76f65ba375eb tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "GET /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078537 Jul 18 02:15:26.511082 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 813/1644] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:15:26 2022] GET /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:26.535507 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7cc14440-e041-4b79-a3f5-92dbfee4e09d tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-886836671", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "78dfad14-feb6-4310-88aa-f627d76987ec"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:26.606760 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3753bc50-e960-4272-9e6b-474b5b25c163 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9472908374c94355ada94f4947c99f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab10eb9b4cc4b13a640f5479056ab79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:26.650223 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3753bc50-e960-4272-9e6b-474b5b25c163 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] 10.222.0.57 "GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee" status: 200 len: 1523 microversion: 2.1 time: 0.704687 Jul 18 02:15:26.651686 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 832/1645] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:25 2022] GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee => generated 1523 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:26.665604 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-73d80198-af04-40d7-a54a-159f79bd5c13 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:26.667925 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-73d80198-af04-40d7-a54a-159f79bd5c13 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 85cf0fec-3e12-4af3-9525-925901fc41d9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:26.684526 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-7cc14440-e041-4b79-a3f5-92dbfee4e09d tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] validate_networks() for [('78dfad14-feb6-4310-88aa-f627d76987ec', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:15:26.732741 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-73d80198-af04-40d7-a54a-159f79bd5c13 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:26.734678 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-73d80198-af04-40d7-a54a-159f79bd5c13 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:26.736459 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-73d80198-af04-40d7-a54a-159f79bd5c13 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:26.737545 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-73d80198-af04-40d7-a54a-159f79bd5c13 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:27.862207 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-73d80198-af04-40d7-a54a-159f79bd5c13 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:27.894192 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-73d80198-af04-40d7-a54a-159f79bd5c13 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/85cf0fec-3e12-4af3-9525-925901fc41d9" status: 200 len: 1466 microversion: 2.1 time: 1.237301 Jul 18 02:15:27.899160 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 833/1646] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:26 2022] GET /compute/v2.1/servers/85cf0fec-3e12-4af3-9525-925901fc41d9 => generated 1466 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:27.936357 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-05173a31-8d85-4f10-9c90-973e7bab7413 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a85ea790>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:28.039338 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-05173a31-8d85-4f10-9c90-973e7bab7413 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372" status: 200 len: 1423 microversion: 2.1 time: 0.135617 Jul 18 02:15:28.039971 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 834/1647] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:15:27 2022] GET /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372 => generated 1423 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:28.070794 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-3c275a58-4e8f-424e-b05c-529e23108785 req-de991aa0-cc07-4311-a77f-aec9b75d55a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b4a452c-dd09-4dd6-ab90-bd7d584343e5", "tag": "a4f23488-d99c-41fb-8662-75c98bd2a84e"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:28.113451 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-3c275a58-4e8f-424e-b05c-529e23108785 req-de991aa0-cc07-4311-a77f-aec9b75d55a7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:28.114560 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-3c275a58-4e8f-424e-b05c-529e23108785 req-de991aa0-cc07-4311-a77f-aec9b75d55a7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:28.205759 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-3c275a58-4e8f-424e-b05c-529e23108785 req-de991aa0-cc07-4311-a77f-aec9b75d55a7 service nova] Creating event network-changed:a4f23488-d99c-41fb-8662-75c98bd2a84e for instance 2b4a452c-dd09-4dd6-ab90-bd7d584343e5 on n-h1-465891-3 Jul 18 02:15:28.230298 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-3c275a58-4e8f-424e-b05c-529e23108785 req-de991aa0-cc07-4311-a77f-aec9b75d55a7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177599 Jul 18 02:15:28.246161 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 835/1648] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:28.305237 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d6653bca-2f38-446a-b19c-d03ad19dc2b2 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:28.311002 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d6653bca-2f38-446a-b19c-d03ad19dc2b2 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] [instance: 697075ff-db42-4729-8faf-2c2935d72630] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:28.367320 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d6653bca-2f38-446a-b19c-d03ad19dc2b2 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:28.380181 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d6653bca-2f38-446a-b19c-d03ad19dc2b2 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:28.385032 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d6653bca-2f38-446a-b19c-d03ad19dc2b2 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:28.390139 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d6653bca-2f38-446a-b19c-d03ad19dc2b2 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:28.577721 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d6653bca-2f38-446a-b19c-d03ad19dc2b2 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:28.586288 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d6653bca-2f38-446a-b19c-d03ad19dc2b2 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:28.595916 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-7cc14440-e041-4b79-a3f5-92dbfee4e09d tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:15:28.596639 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-7cc14440-e041-4b79-a3f5-92dbfee4e09d tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:15:28.597051 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-7cc14440-e041-4b79-a3f5-92dbfee4e09d tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:15:28.597615 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-7cc14440-e041-4b79-a3f5-92dbfee4e09d tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:15:28.598146 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-7cc14440-e041-4b79-a3f5-92dbfee4e09d tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:15:28.606034 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-d6653bca-2f38-446a-b19c-d03ad19dc2b2 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lazy-loading 'fault' on Instance uuid 697075ff-db42-4729-8faf-2c2935d72630 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:15:28.631877 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7cc14440-e041-4b79-a3f5-92dbfee4e09d tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:28.634253 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7cc14440-e041-4b79-a3f5-92dbfee4e09d tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:28.645490 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7cc14440-e041-4b79-a3f5-92dbfee4e09d tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:28.648050 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7cc14440-e041-4b79-a3f5-92dbfee4e09d tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:28.730082 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-7cc14440-e041-4b79-a3f5-92dbfee4e09d tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Getting quotas for project 58dcb69855544ff3b51109aa5d41f637. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:15:28.769776 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-7cc14440-e041-4b79-a3f5-92dbfee4e09d tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Getting quotas for user 560f87bfc55d4de2b0106db2ce0ce2af and project 58dcb69855544ff3b51109aa5d41f637. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:15:28.816862 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7cc14440-e041-4b79-a3f5-92dbfee4e09d tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:15:28.830610 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7cc14440-e041-4b79-a3f5-92dbfee4e09d tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 11caf39a-9515-4e04-b244-3be043262875] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:15:28.962167 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7cc14440-e041-4b79-a3f5-92dbfee4e09d tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.446002 Jul 18 02:15:28.962980 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 814/1649] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:15:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2451 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:15:28.968873 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e47e3906-b468-4587-a2e9-5109f8765d78 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:29.000211 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e47e3906-b468-4587-a2e9-5109f8765d78 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:29.013270 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e47e3906-b468-4587-a2e9-5109f8765d78 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:29.014791 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e47e3906-b468-4587-a2e9-5109f8765d78 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:29.016232 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e47e3906-b468-4587-a2e9-5109f8765d78 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:29.017002 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e47e3906-b468-4587-a2e9-5109f8765d78 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:29.053245 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d6653bca-2f38-446a-b19c-d03ad19dc2b2 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a9dd4e239c4d73bdde1ced9cb90b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5d1b19c84a4a9fa4595a5c84f4555c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:29.067458 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d6653bca-2f38-446a-b19c-d03ad19dc2b2 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/servers/697075ff-db42-4729-8faf-2c2935d72630" status: 200 len: 1308 microversion: 2.1 time: 0.812610 Jul 18 02:15:29.068418 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 836/1650] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:28 2022] GET /compute/v2.1/servers/697075ff-db42-4729-8faf-2c2935d72630 => generated 1308 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:29.082602 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-814114fa-0970-4262-b570-2ce6d5a989b4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:29.083861 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-814114fa-0970-4262-b570-2ce6d5a989b4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2b4a452c-dd09-4dd6-ab90-bd7d584343e5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:29.101731 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-814114fa-0970-4262-b570-2ce6d5a989b4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:29.105766 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-814114fa-0970-4262-b570-2ce6d5a989b4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:29.106786 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-814114fa-0970-4262-b570-2ce6d5a989b4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:29.108987 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-814114fa-0970-4262-b570-2ce6d5a989b4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:29.712752 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e47e3906-b468-4587-a2e9-5109f8765d78 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 200 len: 1857 microversion: 2.1 time: 0.748285 Jul 18 02:15:29.731655 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 815/1651] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:28 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 1857 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:29.741438 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-848e231f-d531-4f3b-8ba5-dd5709f7ec18 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:29.745324 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-848e231f-d531-4f3b-8ba5-dd5709f7ec18 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: b74ae52f-6794-49d2-867e-be0996b090aa] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:29.788901 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-848e231f-d531-4f3b-8ba5-dd5709f7ec18 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:29.790764 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-848e231f-d531-4f3b-8ba5-dd5709f7ec18 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:29.796822 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-848e231f-d531-4f3b-8ba5-dd5709f7ec18 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:29.799045 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-848e231f-d531-4f3b-8ba5-dd5709f7ec18 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:29.832585 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-814114fa-0970-4262-b570-2ce6d5a989b4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:29.868825 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-814114fa-0970-4262-b570-2ce6d5a989b4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:29.878781 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-814114fa-0970-4262-b570-2ce6d5a989b4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:29.892336 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-814114fa-0970-4262-b570-2ce6d5a989b4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5" status: 200 len: 1568 microversion: 2.25 time: 0.821990 Jul 18 02:15:29.900303 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 837/1652] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:15:29 2022] GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5 => generated 1568 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:15:29.933954 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6a9d958c-35eb-4abe-809c-2a2dddd17daa tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:29.935592 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6a9d958c-35eb-4abe-809c-2a2dddd17daa tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:29.961495 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6a9d958c-35eb-4abe-809c-2a2dddd17daa tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:29.970234 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6a9d958c-35eb-4abe-809c-2a2dddd17daa tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:29.972398 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6a9d958c-35eb-4abe-809c-2a2dddd17daa tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:29.976792 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6a9d958c-35eb-4abe-809c-2a2dddd17daa tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:30.037620 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-848e231f-d531-4f3b-8ba5-dd5709f7ec18 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "GET /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.303244 Jul 18 02:15:30.049353 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 816/1653] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:15:29 2022] GET /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa/os-volume_attachments => generated 197 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:30.064936 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-a2e30253-b6e2-45f0-b4ee-8819b522031c req-879c109a-3909-45eb-ac06-d7ba5fbba41a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "697075ff-db42-4729-8faf-2c2935d72630", "name": "network-vif-deleted", "tag": "26b96c32-3f20-4f09-8e97-8a938a803c4c"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:30.096745 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-a2e30253-b6e2-45f0-b4ee-8819b522031c req-879c109a-3909-45eb-ac06-d7ba5fbba41a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:30.097493 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-a2e30253-b6e2-45f0-b4ee-8819b522031c req-879c109a-3909-45eb-ac06-d7ba5fbba41a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:30.127139 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-a2e30253-b6e2-45f0-b4ee-8819b522031c req-879c109a-3909-45eb-ac06-d7ba5fbba41a service nova] Creating event network-vif-deleted:26b96c32-3f20-4f09-8e97-8a938a803c4c for instance 697075ff-db42-4729-8faf-2c2935d72630 on n-h2-465891-3 Jul 18 02:15:30.142753 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-a2e30253-b6e2-45f0-b4ee-8819b522031c req-879c109a-3909-45eb-ac06-d7ba5fbba41a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094553 Jul 18 02:15:30.143564 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 817/1654] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:30.161611 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c2d57aec-b7bd-4980-a7b9-a60c301b3139 tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:30.165321 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c2d57aec-b7bd-4980-a7b9-a60c301b3139 tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] [instance: 85cf0fec-3e12-4af3-9525-925901fc41d9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:30.195874 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c2d57aec-b7bd-4980-a7b9-a60c301b3139 tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:30.197957 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c2d57aec-b7bd-4980-a7b9-a60c301b3139 tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:30.200147 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c2d57aec-b7bd-4980-a7b9-a60c301b3139 tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:30.203432 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c2d57aec-b7bd-4980-a7b9-a60c301b3139 tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:30.956177 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6a9d958c-35eb-4abe-809c-2a2dddd17daa tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9472908374c94355ada94f4947c99f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab10eb9b4cc4b13a640f5479056ab79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:30.978808 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6a9d958c-35eb-4abe-809c-2a2dddd17daa tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] 10.222.0.57 "GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee" status: 200 len: 1523 microversion: 2.1 time: 1.076404 Jul 18 02:15:30.979558 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 838/1655] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:29 2022] GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee => generated 1523 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:31.005853 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9abae2cc-8d79-4dbc-9db4-d56e00024273 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a86055e0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:31.109423 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9abae2cc-8d79-4dbc-9db4-d56e00024273 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372" status: 200 len: 1423 microversion: 2.1 time: 0.128855 Jul 18 02:15:31.110087 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 839/1656] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:15:30 2022] GET /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372 => generated 1423 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:31.121252 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-11846041-b212-40e1-9ac9-69c40263ae56 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2030566720", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "451", "networks": [{"uuid": "78dfad14-feb6-4310-88aa-f627d76987ec"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:31.275098 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c2d57aec-b7bd-4980-a7b9-a60c301b3139 tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/85cf0fec-3e12-4af3-9525-925901fc41d9" status: 200 len: 1617 microversion: 2.1 time: 1.086589 Jul 18 02:15:31.279640 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 818/1657] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:30 2022] GET /compute/v2.1/servers/85cf0fec-3e12-4af3-9525-925901fc41d9 => generated 1617 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:31.320769 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d9891103-4072-4f7d-893f-f1959db2f99b tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-465891-3", "block_migration": true, "disk_over_commit": false}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:31.352534 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d9891103-4072-4f7d-893f-f1959db2f99b tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:31.395218 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d9891103-4072-4f7d-893f-f1959db2f99b tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:31.396998 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d9891103-4072-4f7d-893f-f1959db2f99b tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:31.400430 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d9891103-4072-4f7d-893f-f1959db2f99b tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:31.401188 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-11846041-b212-40e1-9ac9-69c40263ae56 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] validate_networks() for [('78dfad14-feb6-4310-88aa-f627d76987ec', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:15:31.401848 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d9891103-4072-4f7d-893f-f1959db2f99b tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:31.488423 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-d9891103-4072-4f7d-893f-f1959db2f99b tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lazy-loading 'flavor' on Instance uuid 19592434-cafa-4e79-a790-0674ab77672f {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:15:31.531241 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d9891103-4072-4f7d-893f-f1959db2f99b tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Going to try to live migrate instance to n-h2-465891-3 {{(pid=119543) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 18 02:15:33.034610 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-11846041-b212-40e1-9ac9-69c40263ae56 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:15:33.035711 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-11846041-b212-40e1-9ac9-69c40263ae56 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:15:33.036382 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-11846041-b212-40e1-9ac9-69c40263ae56 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:15:33.038177 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-11846041-b212-40e1-9ac9-69c40263ae56 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:15:33.038885 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-11846041-b212-40e1-9ac9-69c40263ae56 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:15:33.064871 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-11846041-b212-40e1-9ac9-69c40263ae56 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:33.067110 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-11846041-b212-40e1-9ac9-69c40263ae56 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:33.083269 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-11846041-b212-40e1-9ac9-69c40263ae56 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:33.086575 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-11846041-b212-40e1-9ac9-69c40263ae56 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:33.186033 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-11846041-b212-40e1-9ac9-69c40263ae56 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Getting quotas for project 58dcb69855544ff3b51109aa5d41f637. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:15:33.212872 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-11846041-b212-40e1-9ac9-69c40263ae56 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Getting quotas for user 560f87bfc55d4de2b0106db2ce0ce2af and project 58dcb69855544ff3b51109aa5d41f637. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:15:33.270772 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-11846041-b212-40e1-9ac9-69c40263ae56 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:15:33.292067 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-11846041-b212-40e1-9ac9-69c40263ae56 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 25d7575c-c9a7-4dba-8f13-6c57e988af59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:15:33.521328 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-11846041-b212-40e1-9ac9-69c40263ae56 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.403947 Jul 18 02:15:33.522358 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 840/1658] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:15:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2412 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:15:33.541028 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ea124e7e-a188-4f76-a001-28fb57467f76 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:33.551378 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ea124e7e-a188-4f76-a001-28fb57467f76 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] [instance: 697075ff-db42-4729-8faf-2c2935d72630] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:33.578005 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea124e7e-a188-4f76-a001-28fb57467f76 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:33.585776 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea124e7e-a188-4f76-a001-28fb57467f76 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:33.587101 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea124e7e-a188-4f76-a001-28fb57467f76 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:33.589687 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea124e7e-a188-4f76-a001-28fb57467f76 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:33.644229 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-ea124e7e-a188-4f76-a001-28fb57467f76 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] HTTP exception thrown: Instance 697075ff-db42-4729-8faf-2c2935d72630 could not be found. Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ea124e7e-a188-4f76-a001-28fb57467f76 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Request method failure captured: Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/697075ff-db42-4729-8faf-2c2935d72630 HTTP/1.1 Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MFwV5bRdZluXbBPx6A4z7PSYNFOFZ9QdVwb3y3KaIFsfdKHzw-86PrzyizLYKF833OnddStfccsruqpjt3Vs6y1R--Bgco10Cwj-o-EYReyJBqJTXbas5TNu8JtlTNy1ySnaqgRU_4rLZmzll8XztOgdsWQF5ZnMML7D5wRmnqNcu4 Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: db5d1b19c84a4a9fa4595a5c84f4555c Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ListImageFiltersTestJSON-2100098285 Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_db5d1b19c84a4a9fa4595a5c84f4555c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/db5d1b19c84a4a9fa4595a5c84f4555c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/db5d1b19c84a4a9fa4595a5c84f4555c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/db5d1b19c84a4a9fa4595a5c84f4555c"}]}] Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ListImageFiltersTestJSON-2100098285 Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: db5d1b19c84a4a9fa4595a5c84f4555c Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-2100098285 Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ListImageFiltersTestJSON-2100098285-project Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 91a9dd4e239c4d73bdde1ced9cb90b46 Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ListImageFiltersTestJSON-2100098285-project Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 697075ff-db42-4729-8faf-2c2935d72630 could not be found. Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '697075ff-db42-4729-8faf-2c2935d72630'} Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 697075ff-db42-4729-8faf-2c2935d72630 could not be found. Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 697075ff-db42-4729-8faf-2c2935d72630 could not be found. Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:33.656884 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:33.669179 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:33.669179 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:15:33.669179 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:15:33.669179 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:15:33.669179 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:15:33.669179 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 697075ff-db42-4729-8faf-2c2935d72630 could not be found. Jul 18 02:15:33.669179 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:15:33.669179 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ea124e7e-a188-4f76-a001-28fb57467f76 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Returning 404 to user: Instance 697075ff-db42-4729-8faf-2c2935d72630 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:15:33.669179 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ea124e7e-a188-4f76-a001-28fb57467f76 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "GET /compute/v2.1/servers/697075ff-db42-4729-8faf-2c2935d72630" status: 404 len: 111 microversion: 2.1 time: 0.134758 Jul 18 02:15:33.669179 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 841/1659] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:33 2022] GET /compute/v2.1/servers/697075ff-db42-4729-8faf-2c2935d72630 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:15:33.697848 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e3787b6e-7a3c-4055-98ca-c112831af583 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:33.698704 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e3787b6e-7a3c-4055-98ca-c112831af583 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2b4a452c-dd09-4dd6-ab90-bd7d584343e5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:33.730911 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e3787b6e-7a3c-4055-98ca-c112831af583 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:33.743462 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e3787b6e-7a3c-4055-98ca-c112831af583 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:33.744856 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e3787b6e-7a3c-4055-98ca-c112831af583 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:33.746604 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e3787b6e-7a3c-4055-98ca-c112831af583 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:34.319926 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e3787b6e-7a3c-4055-98ca-c112831af583 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:34.338772 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e3787b6e-7a3c-4055-98ca-c112831af583 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:34.340409 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e3787b6e-7a3c-4055-98ca-c112831af583 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:34.357681 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e3787b6e-7a3c-4055-98ca-c112831af583 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5" status: 200 len: 1568 microversion: 2.25 time: 0.667118 Jul 18 02:15:34.358576 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 842/1660] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:15:33 2022] GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5 => generated 1568 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:15:34.373526 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1f8fe7bf-6239-4e07-89a7-08e40f256efe tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:34.386047 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1f8fe7bf-6239-4e07-89a7-08e40f256efe tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: b74ae52f-6794-49d2-867e-be0996b090aa] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:34.414184 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1f8fe7bf-6239-4e07-89a7-08e40f256efe tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:34.414646 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1f8fe7bf-6239-4e07-89a7-08e40f256efe tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:34.417097 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1f8fe7bf-6239-4e07-89a7-08e40f256efe tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:34.417599 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1f8fe7bf-6239-4e07-89a7-08e40f256efe tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:34.589764 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1f8fe7bf-6239-4e07-89a7-08e40f256efe tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "GET /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.207509 Jul 18 02:15:34.597650 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 843/1661] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:15:34 2022] GET /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa/os-volume_attachments => generated 197 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:34.623055 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ed8bf99d-248c-4b5d-82b3-101ae29c78b6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1622953480", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "c207a0eb-5ef9-4932-9f3a-22f2a11129e5"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:34.852789 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-ed8bf99d-248c-4b5d-82b3-101ae29c78b6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] validate_networks() for None {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:15:35.746151 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-ed8bf99d-248c-4b5d-82b3-101ae29c78b6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:15:35.747242 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-ed8bf99d-248c-4b5d-82b3-101ae29c78b6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:15:35.747242 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-ed8bf99d-248c-4b5d-82b3-101ae29c78b6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:15:35.747571 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-ed8bf99d-248c-4b5d-82b3-101ae29c78b6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:15:35.747846 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-ed8bf99d-248c-4b5d-82b3-101ae29c78b6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:15:35.781179 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ed8bf99d-248c-4b5d-82b3-101ae29c78b6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:35.783671 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ed8bf99d-248c-4b5d-82b3-101ae29c78b6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:35.795503 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ed8bf99d-248c-4b5d-82b3-101ae29c78b6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:35.801509 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ed8bf99d-248c-4b5d-82b3-101ae29c78b6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:35.889502 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-ed8bf99d-248c-4b5d-82b3-101ae29c78b6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Getting quotas for project 8f8bb1ebead3481f946ae7878c3cfc41. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:15:35.909605 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:35.912343 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-ed8bf99d-248c-4b5d-82b3-101ae29c78b6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Getting quotas for user 100f65c0d9d3456fa177599821aed7ff and project 8f8bb1ebead3481f946ae7878c3cfc41. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:15:35.994452 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ed8bf99d-248c-4b5d-82b3-101ae29c78b6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:15:35.999639 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ed8bf99d-248c-4b5d-82b3-101ae29c78b6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c4cc6162-ade9-4f10-9468-fdd1ed52b877] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:15:36.130130 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ed8bf99d-248c-4b5d-82b3-101ae29c78b6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.512864 Jul 18 02:15:36.132688 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 844/1662] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:15:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:15:36.143029 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-41686751-9635-4597-aeed-467418d93f5c tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:36.144862 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-41686751-9635-4597-aeed-467418d93f5c tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:36.162171 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-41686751-9635-4597-aeed-467418d93f5c tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:36.163342 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-41686751-9635-4597-aeed-467418d93f5c tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:36.165078 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-41686751-9635-4597-aeed-467418d93f5c tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:36.166207 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-41686751-9635-4597-aeed-467418d93f5c tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:36.481605 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d9891103-4072-4f7d-893f-f1959db2f99b tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f/action" status: 202 len: 0 microversion: 2.1 time: 5.194294 Jul 18 02:15:36.483745 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 819/1663] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:15:31 2022] POST /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f/action => generated 0 bytes in 5203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:15:36.493598 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bfd5a3d5-e919-489f-a667-4d645fc3c2a7 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a8a34790>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:36.605387 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bfd5a3d5-e919-489f-a667-4d645fc3c2a7 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372" status: 200 len: 1423 microversion: 2.1 time: 0.119188 Jul 18 02:15:36.620504 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 820/1664] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:15:36 2022] GET /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372 => generated 1423 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:36.647204 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-fbc00c76-e793-47a5-83c5-ee6e69f75c65 req-42e5ad1b-9ee8-4436-aff2-b23d7b466ca3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a494dac-3446-4569-b154-b14f9eb22b3e", "tag": "599eb580-601e-480c-8a2a-f0553823ab76"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:36.654514 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:36.680935 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-fbc00c76-e793-47a5-83c5-ee6e69f75c65 req-42e5ad1b-9ee8-4436-aff2-b23d7b466ca3 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:36.681487 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-41686751-9635-4597-aeed-467418d93f5c tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9472908374c94355ada94f4947c99f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab10eb9b4cc4b13a640f5479056ab79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:36.699356 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-41686751-9635-4597-aeed-467418d93f5c tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] 10.222.0.57 "GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee" status: 200 len: 1523 microversion: 2.1 time: 0.563200 Jul 18 02:15:36.700058 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-fbc00c76-e793-47a5-83c5-ee6e69f75c65 req-42e5ad1b-9ee8-4436-aff2-b23d7b466ca3 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:36.702563 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 845/1665] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:36 2022] GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee => generated 1523 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:36.716225 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-fbc00c76-e793-47a5-83c5-ee6e69f75c65 req-42e5ad1b-9ee8-4436-aff2-b23d7b466ca3 service nova] Creating event network-changed:599eb580-601e-480c-8a2a-f0553823ab76 for instance 4a494dac-3446-4569-b154-b14f9eb22b3e on n-h1-465891-3 Jul 18 02:15:36.723748 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-fbc00c76-e793-47a5-83c5-ee6e69f75c65 req-42e5ad1b-9ee8-4436-aff2-b23d7b466ca3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091704 Jul 18 02:15:36.731042 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 821/1666] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:36.733120 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-daa5d3e6-70c7-4246-aa9e-c77c5dcd44ce req-92cdf5eb-c45d-4f6c-ab2e-1cefd76a0807 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b4a452c-dd09-4dd6-ab90-bd7d584343e5", "name": "network-vif-unplugged", "status": "completed", "tag": "a4f23488-d99c-41fb-8662-75c98bd2a84e"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:36.759173 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e49794d9-b2c3-44d2-9736-938769d39329 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:36.766976 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e49794d9-b2c3-44d2-9736-938769d39329 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 25d7575c-c9a7-4dba-8f13-6c57e988af59] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:36.783902 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-daa5d3e6-70c7-4246-aa9e-c77c5dcd44ce req-92cdf5eb-c45d-4f6c-ab2e-1cefd76a0807 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:36.786929 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e49794d9-b2c3-44d2-9736-938769d39329 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:36.787920 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-daa5d3e6-70c7-4246-aa9e-c77c5dcd44ce req-92cdf5eb-c45d-4f6c-ab2e-1cefd76a0807 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:36.794514 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e49794d9-b2c3-44d2-9736-938769d39329 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:36.795846 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e49794d9-b2c3-44d2-9736-938769d39329 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:36.803139 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e49794d9-b2c3-44d2-9736-938769d39329 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:36.834785 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-daa5d3e6-70c7-4246-aa9e-c77c5dcd44ce req-92cdf5eb-c45d-4f6c-ab2e-1cefd76a0807 service nova] Creating event network-vif-unplugged:a4f23488-d99c-41fb-8662-75c98bd2a84e for instance 2b4a452c-dd09-4dd6-ab90-bd7d584343e5 on n-h1-465891-3 Jul 18 02:15:36.854123 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-daa5d3e6-70c7-4246-aa9e-c77c5dcd44ce req-92cdf5eb-c45d-4f6c-ab2e-1cefd76a0807 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.149359 Jul 18 02:15:36.856546 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 846/1667] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:36.871110 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a1ad3c6d-64ec-4553-b92f-a12ce3ede977 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a85881f0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:37.182122 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e49794d9-b2c3-44d2-9736-938769d39329 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:37.269816 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e49794d9-b2c3-44d2-9736-938769d39329 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers/25d7575c-c9a7-4dba-8f13-6c57e988af59" status: 200 len: 1217 microversion: 2.1 time: 0.511994 Jul 18 02:15:37.281289 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 822/1668] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:36 2022] GET /compute/v2.1/servers/25d7575c-c9a7-4dba-8f13-6c57e988af59 => generated 1217 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:37.317426 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-246df806-f948-4e25-9251-171206ad4e5c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:37.320009 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-246df806-f948-4e25-9251-171206ad4e5c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2b4a452c-dd09-4dd6-ab90-bd7d584343e5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:37.338683 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-246df806-f948-4e25-9251-171206ad4e5c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:37.339403 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-246df806-f948-4e25-9251-171206ad4e5c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:37.340386 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-246df806-f948-4e25-9251-171206ad4e5c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:37.341101 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-246df806-f948-4e25-9251-171206ad4e5c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:37.961273 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a1ad3c6d-64ec-4553-b92f-a12ce3ede977 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "DELETE /compute/v2.1/images/a4ab5dcd-67de-4bfa-8ea9-3b238dbac0ff" status: 204 len: 0 microversion: 2.1 time: 1.101964 Jul 18 02:15:37.962665 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 847/1669] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:36 2022] DELETE /compute/v2.1/images/a4ab5dcd-67de-4bfa-8ea9-3b238dbac0ff => generated 0 bytes in 1105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:15:37.969859 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-97f5574b-9c01-4e33-b1a7-15314598f289 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:37.971460 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-97f5574b-9c01-4e33-b1a7-15314598f289 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: b74ae52f-6794-49d2-867e-be0996b090aa] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:38.022477 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-97f5574b-9c01-4e33-b1a7-15314598f289 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:38.023455 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-97f5574b-9c01-4e33-b1a7-15314598f289 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:38.024539 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-97f5574b-9c01-4e33-b1a7-15314598f289 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:38.027044 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-97f5574b-9c01-4e33-b1a7-15314598f289 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:38.140936 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-97f5574b-9c01-4e33-b1a7-15314598f289 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "GET /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.176774 Jul 18 02:15:38.151027 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 848/1670] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:15:37 2022] GET /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:38.163111 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-901c7f9f-cb6d-4a0a-9859-3b95863e41fb tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:38.165469 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-901c7f9f-cb6d-4a0a-9859-3b95863e41fb tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c4cc6162-ade9-4f10-9468-fdd1ed52b877] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:38.179141 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-246df806-f948-4e25-9251-171206ad4e5c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:38.189604 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-901c7f9f-cb6d-4a0a-9859-3b95863e41fb tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:38.189890 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-901c7f9f-cb6d-4a0a-9859-3b95863e41fb tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:38.199017 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-901c7f9f-cb6d-4a0a-9859-3b95863e41fb tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:38.199856 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-901c7f9f-cb6d-4a0a-9859-3b95863e41fb tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:38.231116 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-246df806-f948-4e25-9251-171206ad4e5c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:38.240188 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-246df806-f948-4e25-9251-171206ad4e5c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:38.246752 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-246df806-f948-4e25-9251-171206ad4e5c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5" status: 200 len: 1568 microversion: 2.25 time: 0.960800 Jul 18 02:15:38.250826 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 823/1671] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:15:37 2022] GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5 => generated 1568 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:15:38.268038 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-10d33716-a1de-4643-9c1c-c6caae380535 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:38.269451 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-10d33716-a1de-4643-9c1c-c6caae380535 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:38.282198 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-10d33716-a1de-4643-9c1c-c6caae380535 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:38.283419 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-10d33716-a1de-4643-9c1c-c6caae380535 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:38.284670 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-10d33716-a1de-4643-9c1c-c6caae380535 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:38.285224 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-10d33716-a1de-4643-9c1c-c6caae380535 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:38.433454 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-901c7f9f-cb6d-4a0a-9859-3b95863e41fb tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:38.462004 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-901c7f9f-cb6d-4a0a-9859-3b95863e41fb tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877" status: 200 len: 1221 microversion: 2.1 time: 0.307996 Jul 18 02:15:38.463941 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 849/1672] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:38 2022] GET /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877 => generated 1221 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:38.478463 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-849162ef-78ef-4758-bb97-1bd94cd2d91c tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a85cc3a0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:38.639516 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-849162ef-78ef-4758-bb97-1bd94cd2d91c tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372" status: 200 len: 1423 microversion: 2.1 time: 0.171386 Jul 18 02:15:38.641764 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 850/1673] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:15:38 2022] GET /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372 => generated 1423 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:38.655965 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d0e9573c-7e1c-4862-9e45-2fd697a0bf04 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:38.659372 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d0e9573c-7e1c-4862-9e45-2fd697a0bf04 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:38.674930 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d0e9573c-7e1c-4862-9e45-2fd697a0bf04 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:38.675763 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d0e9573c-7e1c-4862-9e45-2fd697a0bf04 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:38.677069 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d0e9573c-7e1c-4862-9e45-2fd697a0bf04 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:38.678052 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d0e9573c-7e1c-4862-9e45-2fd697a0bf04 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:38.703574 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:38.795950 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:39.175344 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d0e9573c-7e1c-4862-9e45-2fd697a0bf04 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9472908374c94355ada94f4947c99f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab10eb9b4cc4b13a640f5479056ab79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:39.199145 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-10d33716-a1de-4643-9c1c-c6caae380535 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:39.221963 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d0e9573c-7e1c-4862-9e45-2fd697a0bf04 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] 10.222.0.57 "GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee" status: 200 len: 1523 microversion: 2.1 time: 0.576988 Jul 18 02:15:39.226292 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 851/1674] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:38 2022] GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee => generated 1523 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:39.244920 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-10d33716-a1de-4643-9c1c-c6caae380535 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 200 len: 1716 microversion: 2.1 time: 0.987259 Jul 18 02:15:39.250183 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 824/1675] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:38 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 1716 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:39.256482 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b1fce96c-8243-4d98-a8b5-ba72f0f766b8 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a85caaf0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:39.272677 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-79192ac3-e0f5-461f-8709-b623d473849f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:39.274994 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-79192ac3-e0f5-461f-8709-b623d473849f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 25d7575c-c9a7-4dba-8f13-6c57e988af59] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:39.293728 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-79192ac3-e0f5-461f-8709-b623d473849f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:39.294398 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-79192ac3-e0f5-461f-8709-b623d473849f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:39.295690 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-79192ac3-e0f5-461f-8709-b623d473849f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:39.296345 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-79192ac3-e0f5-461f-8709-b623d473849f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:39.608597 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-79192ac3-e0f5-461f-8709-b623d473849f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:39.637567 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-79192ac3-e0f5-461f-8709-b623d473849f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers/25d7575c-c9a7-4dba-8f13-6c57e988af59" status: 200 len: 1279 microversion: 2.1 time: 0.385281 Jul 18 02:15:39.652543 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 825/1676] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:39 2022] GET /compute/v2.1/servers/25d7575c-c9a7-4dba-8f13-6c57e988af59 => generated 1279 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:39.663541 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-7138e7f9-da81-4e21-ab4c-25e38f7abd0c req-58729719-ddbc-4470-8b5d-669e734c0451 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11caf39a-9515-4e04-b244-3be043262875", "tag": "2dec9e13-e24b-4e03-ae42-a92defd8aaec"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:39.682420 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-7138e7f9-da81-4e21-ab4c-25e38f7abd0c req-58729719-ddbc-4470-8b5d-669e734c0451 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:39.683639 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-7138e7f9-da81-4e21-ab4c-25e38f7abd0c req-58729719-ddbc-4470-8b5d-669e734c0451 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:39.734692 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-7138e7f9-da81-4e21-ab4c-25e38f7abd0c req-58729719-ddbc-4470-8b5d-669e734c0451 service nova] Creating event network-changed:2dec9e13-e24b-4e03-ae42-a92defd8aaec for instance 11caf39a-9515-4e04-b244-3be043262875 on n-h1-465891-3 Jul 18 02:15:39.763246 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-7138e7f9-da81-4e21-ab4c-25e38f7abd0c req-58729719-ddbc-4470-8b5d-669e734c0451 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106332 Jul 18 02:15:39.764986 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 826/1677] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:39.815043 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-eb9a00ab-a8fa-4df7-8c46-9f43dc13dfd7 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:39.817688 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-eb9a00ab-a8fa-4df7-8c46-9f43dc13dfd7 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: b74ae52f-6794-49d2-867e-be0996b090aa] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:39.857655 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eb9a00ab-a8fa-4df7-8c46-9f43dc13dfd7 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:39.858710 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eb9a00ab-a8fa-4df7-8c46-9f43dc13dfd7 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:39.860232 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eb9a00ab-a8fa-4df7-8c46-9f43dc13dfd7 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:39.861045 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eb9a00ab-a8fa-4df7-8c46-9f43dc13dfd7 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:40.043094 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-eb9a00ab-a8fa-4df7-8c46-9f43dc13dfd7 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "GET /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.272439 Jul 18 02:15:40.050186 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 827/1678] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:15:39 2022] GET /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa/os-volume_attachments => generated 197 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:40.066854 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9947a208-fa18-495f-a175-2255f005777a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:40.074989 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9947a208-fa18-495f-a175-2255f005777a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2b4a452c-dd09-4dd6-ab90-bd7d584343e5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:40.101413 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9947a208-fa18-495f-a175-2255f005777a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:40.103184 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9947a208-fa18-495f-a175-2255f005777a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:40.108506 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9947a208-fa18-495f-a175-2255f005777a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:40.110423 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9947a208-fa18-495f-a175-2255f005777a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:40.301411 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b1fce96c-8243-4d98-a8b5-ba72f0f766b8 tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "DELETE /compute/v2.1/images/9dbaf0e4-95a4-4278-9954-659c13fc47dd" status: 204 len: 0 microversion: 2.1 time: 1.071557 Jul 18 02:15:40.302779 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 852/1679] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:39 2022] DELETE /compute/v2.1/images/9dbaf0e4-95a4-4278-9954-659c13fc47dd => generated 0 bytes in 1076 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:15:40.320234 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-406db703-5abe-4799-bd01-f81564c3ea50 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:40.321996 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-406db703-5abe-4799-bd01-f81564c3ea50 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c4cc6162-ade9-4f10-9468-fdd1ed52b877] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:40.355084 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-406db703-5abe-4799-bd01-f81564c3ea50 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:40.359700 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-406db703-5abe-4799-bd01-f81564c3ea50 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:40.361654 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-406db703-5abe-4799-bd01-f81564c3ea50 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:40.365447 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-406db703-5abe-4799-bd01-f81564c3ea50 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:40.540757 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9947a208-fa18-495f-a175-2255f005777a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:40.573634 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9947a208-fa18-495f-a175-2255f005777a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:40.576032 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9947a208-fa18-495f-a175-2255f005777a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:40.582277 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9947a208-fa18-495f-a175-2255f005777a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5" status: 200 len: 1543 microversion: 2.25 time: 0.529647 Jul 18 02:15:40.583576 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 828/1680] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:15:40 2022] GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5 => generated 1543 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:15:40.610074 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-df6b0ea5-8ec6-4fc9-b8e8-b2225088e2d6 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a8a438b0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:40.663429 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-406db703-5abe-4799-bd01-f81564c3ea50 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:40.682876 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-406db703-5abe-4799-bd01-f81564c3ea50 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877" status: 200 len: 1269 microversion: 2.1 time: 0.378031 Jul 18 02:15:40.690894 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 853/1681] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:40 2022] GET /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877 => generated 1269 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:40.726749 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7a55dac3-bed5-4c09-8bf2-b5b24830fb4d tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:40.732383 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7a55dac3-bed5-4c09-8bf2-b5b24830fb4d tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:40.777233 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7a55dac3-bed5-4c09-8bf2-b5b24830fb4d tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:40.780104 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7a55dac3-bed5-4c09-8bf2-b5b24830fb4d tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:40.790645 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7a55dac3-bed5-4c09-8bf2-b5b24830fb4d tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:40.808297 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7a55dac3-bed5-4c09-8bf2-b5b24830fb4d tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:40.813350 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-df6b0ea5-8ec6-4fc9-b8e8-b2225088e2d6 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372" status: 200 len: 1423 microversion: 2.1 time: 0.221757 Jul 18 02:15:40.817019 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 829/1682] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:15:40 2022] GET /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372 => generated 1423 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:40.844138 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-22182499-ae38-4e94-8862-0ada2310c5fb tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:40.847288 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-22182499-ae38-4e94-8862-0ada2310c5fb tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:40.888792 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-22182499-ae38-4e94-8862-0ada2310c5fb tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:40.893275 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-22182499-ae38-4e94-8862-0ada2310c5fb tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:40.895035 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-22182499-ae38-4e94-8862-0ada2310c5fb tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:40.896758 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-22182499-ae38-4e94-8862-0ada2310c5fb tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:41.463019 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7a55dac3-bed5-4c09-8bf2-b5b24830fb4d tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9472908374c94355ada94f4947c99f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab10eb9b4cc4b13a640f5479056ab79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:41.498227 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7a55dac3-bed5-4c09-8bf2-b5b24830fb4d tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] 10.222.0.57 "GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee" status: 200 len: 1523 microversion: 2.1 time: 0.802593 Jul 18 02:15:41.510889 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 854/1683] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:40 2022] GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee => generated 1523 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:41.518779 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-481f943d-dab1-4b59-b96f-3fcf0314364c tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] Calling method '.version_select at 0x7ff4a85cae50>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:41.572288 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-22182499-ae38-4e94-8862-0ada2310c5fb tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:41.593101 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-22182499-ae38-4e94-8862-0ada2310c5fb tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 200 len: 1716 microversion: 2.1 time: 0.772667 Jul 18 02:15:41.594392 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 830/1684] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:40 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 1716 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:41.609407 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2f0e3fcb-666b-4926-9306-5d2be80b7203 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Calling method '.version_select at 0x7ff4a8a34f70>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:41.612829 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2f0e3fcb-666b-4926-9306-5d2be80b7203 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:41.614840 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2f0e3fcb-666b-4926-9306-5d2be80b7203 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:41.662844 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2f0e3fcb-666b-4926-9306-5d2be80b7203 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] 10.222.0.57 "GET /compute/v2.1/os-migrations" status: 200 len: 2603 microversion: 2.25 time: 0.066849 Jul 18 02:15:41.675877 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 831/1685] 10.222.0.57 () {60 vars in 1183 bytes} [Mon Jul 18 02:15:41 2022] GET /compute/v2.1/os-migrations => generated 2603 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:15:41.685368 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-240e90a3-7c17-4848-a58d-6b2a5d243536 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:41.694586 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-240e90a3-7c17-4848-a58d-6b2a5d243536 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 25d7575c-c9a7-4dba-8f13-6c57e988af59] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:41.717092 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-240e90a3-7c17-4848-a58d-6b2a5d243536 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:41.726168 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-240e90a3-7c17-4848-a58d-6b2a5d243536 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:41.727360 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-240e90a3-7c17-4848-a58d-6b2a5d243536 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:41.727923 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-240e90a3-7c17-4848-a58d-6b2a5d243536 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:41.882581 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-240e90a3-7c17-4848-a58d-6b2a5d243536 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:41.925398 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-240e90a3-7c17-4848-a58d-6b2a5d243536 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers/25d7575c-c9a7-4dba-8f13-6c57e988af59" status: 200 len: 1279 microversion: 2.1 time: 0.257651 Jul 18 02:15:41.926427 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 832/1686] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:41 2022] GET /compute/v2.1/servers/25d7575c-c9a7-4dba-8f13-6c57e988af59 => generated 1279 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:41.945076 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cacbd3d0-8410-4b43-82e5-082302582b8d tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:41.948573 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cacbd3d0-8410-4b43-82e5-082302582b8d tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: b74ae52f-6794-49d2-867e-be0996b090aa] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:41.961596 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cacbd3d0-8410-4b43-82e5-082302582b8d tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:41.982529 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cacbd3d0-8410-4b43-82e5-082302582b8d tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:41.983767 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cacbd3d0-8410-4b43-82e5-082302582b8d tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:41.990496 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cacbd3d0-8410-4b43-82e5-082302582b8d tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:42.076005 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:42.084350 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cacbd3d0-8410-4b43-82e5-082302582b8d tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "GET /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.153408 Jul 18 02:15:42.089475 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 833/1687] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:15:41 2022] GET /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa/os-volume_attachments => generated 25 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:15:42.102887 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4ca652e4-8277-4bff-a9a1-349ce9520243 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:42.106787 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4ca652e4-8277-4bff-a9a1-349ce9520243 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] [instance: 2b4a452c-dd09-4dd6-ab90-bd7d584343e5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:42.120349 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4ca652e4-8277-4bff-a9a1-349ce9520243 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:42.121141 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4ca652e4-8277-4bff-a9a1-349ce9520243 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:42.122292 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4ca652e4-8277-4bff-a9a1-349ce9520243 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:42.122937 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4ca652e4-8277-4bff-a9a1-349ce9520243 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:42.404792 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-481f943d-dab1-4b59-b96f-3fcf0314364c tempest-ListImageFiltersTestJSON-2100098285 tempest-ListImageFiltersTestJSON-2100098285-project] 10.222.0.57 "DELETE /compute/v2.1/images/2e3b2a4a-cc21-4e53-b850-4c9fca382b4b" status: 204 len: 0 microversion: 2.1 time: 0.891885 Jul 18 02:15:42.414636 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 855/1688] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:41 2022] DELETE /compute/v2.1/images/2e3b2a4a-cc21-4e53-b850-4c9fca382b4b => generated 0 bytes in 895 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:15:42.434723 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0d87e417-bf85-4062-94ad-d283d9d0066c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:42.436624 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0d87e417-bf85-4062-94ad-d283d9d0066c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c4cc6162-ade9-4f10-9468-fdd1ed52b877] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:42.470192 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0d87e417-bf85-4062-94ad-d283d9d0066c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:42.475853 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0d87e417-bf85-4062-94ad-d283d9d0066c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:42.479874 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0d87e417-bf85-4062-94ad-d283d9d0066c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:42.488485 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0d87e417-bf85-4062-94ad-d283d9d0066c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:42.743836 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-4ca652e4-8277-4bff-a9a1-349ce9520243 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lazy-loading 'services' on Instance uuid 2b4a452c-dd09-4dd6-ab90-bd7d584343e5 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:15:42.781999 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4ca652e4-8277-4bff-a9a1-349ce9520243 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5" status: 200 len: 2036 microversion: 2.25 time: 0.690736 Jul 18 02:15:42.787117 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 834/1689] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:15:42 2022] GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5 => generated 2036 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:15:42.804244 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ed55d1de-d3ca-47a4-9951-4f9aa1453654 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a87c2c10>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:42.845152 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0d87e417-bf85-4062-94ad-d283d9d0066c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:42.855874 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0d87e417-bf85-4062-94ad-d283d9d0066c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877" status: 200 len: 1275 microversion: 2.1 time: 0.438933 Jul 18 02:15:42.870565 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 856/1690] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:42 2022] GET /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877 => generated 1275 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:42.881364 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-28bbb628-1936-4d3d-9762-71d47d9b74f9 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:42.883254 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-28bbb628-1936-4d3d-9762-71d47d9b74f9 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:42.896418 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-28bbb628-1936-4d3d-9762-71d47d9b74f9 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:42.899309 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-28bbb628-1936-4d3d-9762-71d47d9b74f9 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:42.901098 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-28bbb628-1936-4d3d-9762-71d47d9b74f9 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:42.902868 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-28bbb628-1936-4d3d-9762-71d47d9b74f9 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:42.964307 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=100 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:43.006704 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ed55d1de-d3ca-47a4-9951-4f9aa1453654 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372" status: 200 len: 1423 microversion: 2.1 time: 0.217485 Jul 18 02:15:43.007636 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 835/1691] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:15:42 2022] GET /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372 => generated 1423 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:43.012954 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e3e6262d-5d3e-4287-b1fd-607369e2f41f tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1914450140", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "7a5e7db6-e3f6-41d5-a093-718ef43d6b10"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:43.076487 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-e3e6262d-5d3e-4287-b1fd-607369e2f41f tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] validate_networks() for [('7a5e7db6-e3f6-41d5-a093-718ef43d6b10', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:15:43.663569 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-28bbb628-1936-4d3d-9762-71d47d9b74f9 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9472908374c94355ada94f4947c99f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab10eb9b4cc4b13a640f5479056ab79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:43.699923 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-28bbb628-1936-4d3d-9762-71d47d9b74f9 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] 10.222.0.57 "GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee" status: 200 len: 1523 microversion: 2.1 time: 0.821379 Jul 18 02:15:43.701662 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 857/1692] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:42 2022] GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee => generated 1523 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:43.719200 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6fbcc998-549b-4bc3-a2b6-b2d8a40067a3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:43.723032 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6fbcc998-549b-4bc3-a2b6-b2d8a40067a3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:43.754208 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6fbcc998-549b-4bc3-a2b6-b2d8a40067a3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:43.755682 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6fbcc998-549b-4bc3-a2b6-b2d8a40067a3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:43.762900 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6fbcc998-549b-4bc3-a2b6-b2d8a40067a3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:43.764151 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6fbcc998-549b-4bc3-a2b6-b2d8a40067a3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:44.625592 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6fbcc998-549b-4bc3-a2b6-b2d8a40067a3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:44.664808 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6fbcc998-549b-4bc3-a2b6-b2d8a40067a3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 200 len: 1716 microversion: 2.1 time: 0.960950 Jul 18 02:15:44.686567 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 858/1693] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:43 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 1716 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:44.702242 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e06d43fc-1002-48b2-b4ad-ed3790df8455 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Action: 'create', calling method: .version_select at 0x7ff4a85f7c10>, body: {"keypair": {"name": "tempest-keypair-1707145596", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMsc2HlqBV7wlA7ykEhtr2grB3rcY45rWKdEIRjBOlcgzE6yQ4EsWAeglbxPnnw6Tu3LqwmJsAB8TFXYL5hcJNBgTBcdSnT1yN5bysff/d/M5zPweTy1/tMx+87ReSxnnQ=="}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:44.813511 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-e06d43fc-1002-48b2-b4ad-ed3790df8455 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Getting quotas for project 9d0f5bbde58545fb9ccd1c2eb842ed49. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:15:44.845673 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-e06d43fc-1002-48b2-b4ad-ed3790df8455 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Getting quotas for user 575dd6743cff44678749d452329355d1 and project 9d0f5bbde58545fb9ccd1c2eb842ed49. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:15:44.956394 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e06d43fc-1002-48b2-b4ad-ed3790df8455 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.267386 Jul 18 02:15:44.957282 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 859/1694] 10.222.0.57 () {62 vars in 1199 bytes} [Mon Jul 18 02:15:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 270 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 18 02:15:44.966536 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bd35438b-feb6-4788-868c-e24eca11d8a8 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:44.970462 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bd35438b-feb6-4788-868c-e24eca11d8a8 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 25d7575c-c9a7-4dba-8f13-6c57e988af59] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:44.992352 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bd35438b-feb6-4788-868c-e24eca11d8a8 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:44.993123 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bd35438b-feb6-4788-868c-e24eca11d8a8 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:45.013291 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bd35438b-feb6-4788-868c-e24eca11d8a8 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:45.014119 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bd35438b-feb6-4788-868c-e24eca11d8a8 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:45.849882 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:46.580651 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-e3e6262d-5d3e-4287-b1fd-607369e2f41f tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:15:46.581410 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-e3e6262d-5d3e-4287-b1fd-607369e2f41f tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:15:46.583077 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-e3e6262d-5d3e-4287-b1fd-607369e2f41f tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:15:46.584109 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-e3e6262d-5d3e-4287-b1fd-607369e2f41f tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:15:46.585141 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-e3e6262d-5d3e-4287-b1fd-607369e2f41f tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:15:46.635075 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e3e6262d-5d3e-4287-b1fd-607369e2f41f tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:46.636090 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e3e6262d-5d3e-4287-b1fd-607369e2f41f tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:46.637538 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e3e6262d-5d3e-4287-b1fd-607369e2f41f tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:46.638297 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e3e6262d-5d3e-4287-b1fd-607369e2f41f tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:46.645045 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bd35438b-feb6-4788-868c-e24eca11d8a8 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:46.667785 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-e3e6262d-5d3e-4287-b1fd-607369e2f41f tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Getting quotas for project fb6b8514bba84ba8a09c64abbb2d1a2e. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:15:46.670462 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bd35438b-feb6-4788-868c-e24eca11d8a8 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers/25d7575c-c9a7-4dba-8f13-6c57e988af59" status: 200 len: 1321 microversion: 2.1 time: 1.710575 Jul 18 02:15:46.671375 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 860/1695] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:44 2022] GET /compute/v2.1/servers/25d7575c-c9a7-4dba-8f13-6c57e988af59 => generated 1321 bytes in 1713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:46.675981 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-e3e6262d-5d3e-4287-b1fd-607369e2f41f tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Getting quotas for user fe79fa13328b4e40922d0e3e4551a8e8 and project fb6b8514bba84ba8a09c64abbb2d1a2e. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:15:46.695521 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e3e6262d-5d3e-4287-b1fd-607369e2f41f tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:15:46.695800 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c9c57abb-c405-465e-a235-4b398c287e19 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:46.696696 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c9c57abb-c405-465e-a235-4b398c287e19 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c4cc6162-ade9-4f10-9468-fdd1ed52b877] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:46.698973 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e3e6262d-5d3e-4287-b1fd-607369e2f41f tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: e86cd628-160d-4516-ad58-899768acecd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:15:46.726580 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c9c57abb-c405-465e-a235-4b398c287e19 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:46.727295 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c9c57abb-c405-465e-a235-4b398c287e19 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:46.733904 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c9c57abb-c405-465e-a235-4b398c287e19 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:46.734905 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c9c57abb-c405-465e-a235-4b398c287e19 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:46.774422 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e3e6262d-5d3e-4287-b1fd-607369e2f41f tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.765139 Jul 18 02:15:46.775481 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 836/1696] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:15:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 3767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:15:46.786540 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6e3f57fd-ca39-4180-80ef-7708bace9679 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4adced430>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:46.864726 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6e3f57fd-ca39-4180-80ef-7708bace9679 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372" status: 200 len: 1423 microversion: 2.1 time: 0.082751 Jul 18 02:15:46.869335 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 837/1697] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:15:46 2022] GET /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372 => generated 1423 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:46.881015 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-8b5dc344-6051-4199-801a-26defdf76806 req-3f3959a4-9a79-4e82-a3d6-d93cfeb27771 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a494dac-3446-4569-b154-b14f9eb22b3e", "name": "network-vif-plugged", "status": "completed", "tag": "599eb580-601e-480c-8a2a-f0553823ab76"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:46.924270 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-8b5dc344-6051-4199-801a-26defdf76806 req-3f3959a4-9a79-4e82-a3d6-d93cfeb27771 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:46.925808 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-8b5dc344-6051-4199-801a-26defdf76806 req-3f3959a4-9a79-4e82-a3d6-d93cfeb27771 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:46.970047 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-8b5dc344-6051-4199-801a-26defdf76806 req-3f3959a4-9a79-4e82-a3d6-d93cfeb27771 service nova] Creating event network-vif-plugged:599eb580-601e-480c-8a2a-f0553823ab76 for instance 4a494dac-3446-4569-b154-b14f9eb22b3e on n-h1-465891-3 Jul 18 02:15:46.981178 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-8b5dc344-6051-4199-801a-26defdf76806 req-3f3959a4-9a79-4e82-a3d6-d93cfeb27771 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110166 Jul 18 02:15:46.985217 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 838/1698] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:46.993536 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ac8cf381-8b99-4667-9d52-7b2f662ab31d tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:47.000966 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ac8cf381-8b99-4667-9d52-7b2f662ab31d tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:47.018602 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ac8cf381-8b99-4667-9d52-7b2f662ab31d tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:47.022744 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ac8cf381-8b99-4667-9d52-7b2f662ab31d tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:47.024244 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ac8cf381-8b99-4667-9d52-7b2f662ab31d tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:47.024805 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ac8cf381-8b99-4667-9d52-7b2f662ab31d tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:48.792132 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c9c57abb-c405-465e-a235-4b398c287e19 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:48.803832 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c9c57abb-c405-465e-a235-4b398c287e19 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877" status: 200 len: 1317 microversion: 2.1 time: 2.116982 Jul 18 02:15:48.804722 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 861/1699] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:46 2022] GET /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877 => generated 1317 bytes in 2129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:48.816209 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-94bfb710-d5a5-4a8b-b177-dab93bf8fe3d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:48.817552 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-94bfb710-d5a5-4a8b-b177-dab93bf8fe3d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:48.841161 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-94bfb710-d5a5-4a8b-b177-dab93bf8fe3d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:48.841734 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-94bfb710-d5a5-4a8b-b177-dab93bf8fe3d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:48.842666 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-94bfb710-d5a5-4a8b-b177-dab93bf8fe3d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:48.843194 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-94bfb710-d5a5-4a8b-b177-dab93bf8fe3d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:49.003839 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ac8cf381-8b99-4667-9d52-7b2f662ab31d tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9472908374c94355ada94f4947c99f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab10eb9b4cc4b13a640f5479056ab79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:49.022276 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ac8cf381-8b99-4667-9d52-7b2f662ab31d tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] 10.222.0.57 "GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee" status: 200 len: 1523 microversion: 2.1 time: 2.035141 Jul 18 02:15:49.022893 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 839/1700] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:46 2022] GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee => generated 1523 bytes in 2037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:49.032661 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-b38b0ea0-a9d7-48a3-aeb4-818c69e78449 req-307c2cb1-d14f-4b62-b71f-a7ad5355d3c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25d7575c-c9a7-4dba-8f13-6c57e988af59", "tag": "53440909-ff47-419d-9dd2-14b37718950a"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:49.060183 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-b38b0ea0-a9d7-48a3-aeb4-818c69e78449 req-307c2cb1-d14f-4b62-b71f-a7ad5355d3c1 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:49.060625 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-b38b0ea0-a9d7-48a3-aeb4-818c69e78449 req-307c2cb1-d14f-4b62-b71f-a7ad5355d3c1 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:49.083229 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-b38b0ea0-a9d7-48a3-aeb4-818c69e78449 req-307c2cb1-d14f-4b62-b71f-a7ad5355d3c1 service nova] Creating event network-changed:53440909-ff47-419d-9dd2-14b37718950a for instance 25d7575c-c9a7-4dba-8f13-6c57e988af59 on n-h2-465891-3 Jul 18 02:15:49.101115 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-b38b0ea0-a9d7-48a3-aeb4-818c69e78449 req-307c2cb1-d14f-4b62-b71f-a7ad5355d3c1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076949 Jul 18 02:15:49.102066 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 840/1701] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:49.390505 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8b2b1868-06a4-4a44-80d2-8c1ce436897b tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Action: 'create', calling method: .version_select at 0x7ff4a8a55c10>, body: {"keypair": {"name": "tempest-keypair-977365364", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNj14lpl51Q+ahotA2tjpqpa0Kk9aG+l6aCh7Z6bqrxl6h/McRl0lmCKEQwlu6Np2T6CG63nbRU4KblplkJgaMggCp6u4VPzWPT8kzliLDcS9QFtGNUvnCYrs+ATMgqqGw=="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:49.450182 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-8b2b1868-06a4-4a44-80d2-8c1ce436897b tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Getting quotas for project 82f86eb4ab6d4a448b2ec12ce759ee29. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:15:49.464163 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-8b2b1868-06a4-4a44-80d2-8c1ce436897b tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Getting quotas for user bc3164ee635f41e3b71fa6f8826cc826 and project 82f86eb4ab6d4a448b2ec12ce759ee29. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:15:49.564840 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8b2b1868-06a4-4a44-80d2-8c1ce436897b tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.460587 Jul 18 02:15:49.566053 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 841/1702] 10.222.0.57 () {62 vars in 1198 bytes} [Mon Jul 18 02:15:49 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 463 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 18 02:15:49.571395 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a14296c0-2100-4b4d-b263-bd41902a48b6 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:49.574206 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a14296c0-2100-4b4d-b263-bd41902a48b6 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: e86cd628-160d-4516-ad58-899768acecd9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:49.592930 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a14296c0-2100-4b4d-b263-bd41902a48b6 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:49.593791 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a14296c0-2100-4b4d-b263-bd41902a48b6 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:49.604249 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a14296c0-2100-4b4d-b263-bd41902a48b6 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:49.605092 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a14296c0-2100-4b4d-b263-bd41902a48b6 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:49.694573 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-94bfb710-d5a5-4a8b-b177-dab93bf8fe3d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:49.768788 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-94bfb710-d5a5-4a8b-b177-dab93bf8fe3d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 200 len: 1716 microversion: 2.1 time: 0.925827 Jul 18 02:15:49.774523 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a14296c0-2100-4b4d-b263-bd41902a48b6 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe79fa13328b4e40922d0e3e4551a8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6b8514bba84ba8a09c64abbb2d1a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:49.790258 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 862/1703] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:48 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 1716 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:49.792813 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a14296c0-2100-4b4d-b263-bd41902a48b6 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "GET /compute/v2.1/servers/e86cd628-160d-4516-ad58-899768acecd9" status: 200 len: 1222 microversion: 2.1 time: 0.220782 Jul 18 02:15:49.809170 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-65274ea8-4e32-4646-9ee1-631187a5a998 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:49.811271 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 842/1704] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:49 2022] GET /compute/v2.1/servers/e86cd628-160d-4516-ad58-899768acecd9 => generated 1222 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:49.822345 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f92b7967-07f8-4254-ae1c-1ded24afdfd2 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a89dcc10>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:49.825243 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-65274ea8-4e32-4646-9ee1-631187a5a998 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 25d7575c-c9a7-4dba-8f13-6c57e988af59] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:49.856857 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65274ea8-4e32-4646-9ee1-631187a5a998 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:49.858576 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65274ea8-4e32-4646-9ee1-631187a5a998 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:49.876076 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65274ea8-4e32-4646-9ee1-631187a5a998 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:49.881870 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65274ea8-4e32-4646-9ee1-631187a5a998 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:49.959185 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f92b7967-07f8-4254-ae1c-1ded24afdfd2 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372" status: 200 len: 1423 microversion: 2.1 time: 0.143450 Jul 18 02:15:49.960804 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 843/1705] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:15:49 2022] GET /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372 => generated 1423 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:49.966952 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6f3eff07-c5b8-4477-b958-fae33687cbc0 tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Calling method '.version_select at 0x7ff4a8aec1f0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:49.995320 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6f3eff07-c5b8-4477-b958-fae33687cbc0 tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] 10.222.0.57 "GET /compute/v2.1/os-keypairs/tempest-keypair-977365364" status: 200 len: 511 microversion: 2.2 time: 0.032752 Jul 18 02:15:49.996353 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 844/1706] 10.222.0.57 () {60 vars in 1254 bytes} [Mon Jul 18 02:15:49 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-977365364 => generated 511 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:50.001915 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1479fa68-fea9-4ba9-8728-7f785bbf861c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:50.002938 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1479fa68-fea9-4ba9-8728-7f785bbf861c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c4cc6162-ade9-4f10-9468-fdd1ed52b877] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:50.014749 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1479fa68-fea9-4ba9-8728-7f785bbf861c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:50.015885 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1479fa68-fea9-4ba9-8728-7f785bbf861c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:50.016927 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1479fa68-fea9-4ba9-8728-7f785bbf861c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:50.017597 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1479fa68-fea9-4ba9-8728-7f785bbf861c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:50.923057 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1479fa68-fea9-4ba9-8728-7f785bbf861c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:50.938877 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1479fa68-fea9-4ba9-8728-7f785bbf861c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877" status: 200 len: 1317 microversion: 2.1 time: 0.934880 Jul 18 02:15:50.946889 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 845/1707] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:49 2022] GET /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877 => generated 1317 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:50.982376 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ee4a85fa-1c89-4c2c-87f1-35e77977f7ac tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Calling method '.version_select at 0x7ff4a8aec0d0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:51.044719 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ee4a85fa-1c89-4c2c-87f1-35e77977f7ac tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-977365364" status: 204 len: 0 microversion: 2.2 time: 0.094241 Jul 18 02:15:51.054395 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 846/1708] 10.222.0.57 () {60 vars in 1257 bytes} [Mon Jul 18 02:15:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-977365364 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:15:51.069086 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4d398220-504b-415e-a23f-639ce1e31878 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:51.069756 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4d398220-504b-415e-a23f-639ce1e31878 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:51.087710 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4d398220-504b-415e-a23f-639ce1e31878 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:51.088171 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4d398220-504b-415e-a23f-639ce1e31878 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:51.092325 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4d398220-504b-415e-a23f-639ce1e31878 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:51.094964 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4d398220-504b-415e-a23f-639ce1e31878 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:51.096249 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-65274ea8-4e32-4646-9ee1-631187a5a998 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:51.119365 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-65274ea8-4e32-4646-9ee1-631187a5a998 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers/25d7575c-c9a7-4dba-8f13-6c57e988af59" status: 200 len: 1321 microversion: 2.1 time: 1.314485 Jul 18 02:15:51.128854 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 863/1709] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:49 2022] GET /compute/v2.1/servers/25d7575c-c9a7-4dba-8f13-6c57e988af59 => generated 1321 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:51.128854 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a75d677f-673e-4c7f-a857-b92bc15e342b tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:51.128854 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a75d677f-673e-4c7f-a857-b92bc15e342b tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: e86cd628-160d-4516-ad58-899768acecd9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:51.148174 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a75d677f-673e-4c7f-a857-b92bc15e342b tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:51.153219 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a75d677f-673e-4c7f-a857-b92bc15e342b tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:51.154278 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a75d677f-673e-4c7f-a857-b92bc15e342b tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:51.154740 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a75d677f-673e-4c7f-a857-b92bc15e342b tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:51.510609 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a75d677f-673e-4c7f-a857-b92bc15e342b tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe79fa13328b4e40922d0e3e4551a8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6b8514bba84ba8a09c64abbb2d1a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:51.532194 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a75d677f-673e-4c7f-a857-b92bc15e342b tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "GET /compute/v2.1/servers/e86cd628-160d-4516-ad58-899768acecd9" status: 200 len: 1276 microversion: 2.1 time: 0.407982 Jul 18 02:15:51.535540 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 864/1710] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:51 2022] GET /compute/v2.1/servers/e86cd628-160d-4516-ad58-899768acecd9 => generated 1276 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:51.564996 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-90d2ad0c-6bf9-4cd6-80dd-a27fb06e4f98 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:51.567543 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-90d2ad0c-6bf9-4cd6-80dd-a27fb06e4f98 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:51.588069 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-90d2ad0c-6bf9-4cd6-80dd-a27fb06e4f98 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:51.588729 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-90d2ad0c-6bf9-4cd6-80dd-a27fb06e4f98 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:51.590660 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-90d2ad0c-6bf9-4cd6-80dd-a27fb06e4f98 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:51.593772 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-90d2ad0c-6bf9-4cd6-80dd-a27fb06e4f98 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:51.841307 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4d398220-504b-415e-a23f-639ce1e31878 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9472908374c94355ada94f4947c99f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab10eb9b4cc4b13a640f5479056ab79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:51.861794 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4d398220-504b-415e-a23f-639ce1e31878 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] 10.222.0.57 "GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee" status: 200 len: 1523 microversion: 2.1 time: 0.805302 Jul 18 02:15:51.862719 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 847/1711] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:51 2022] GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee => generated 1523 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:51.869236 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-1812070b-dff8-4216-b343-4ccde691ff34 req-d61f9ac5-337b-4770-a824-d905a5c8a67a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4cc6162-ade9-4f10-9468-fdd1ed52b877", "tag": "6439e9de-0c99-49d5-b628-c36d89f73fc6"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:51.900652 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-1812070b-dff8-4216-b343-4ccde691ff34 req-d61f9ac5-337b-4770-a824-d905a5c8a67a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:51.901418 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-1812070b-dff8-4216-b343-4ccde691ff34 req-d61f9ac5-337b-4770-a824-d905a5c8a67a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:51.928636 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-1812070b-dff8-4216-b343-4ccde691ff34 req-d61f9ac5-337b-4770-a824-d905a5c8a67a service nova] Creating event network-changed:6439e9de-0c99-49d5-b628-c36d89f73fc6 for instance c4cc6162-ade9-4f10-9468-fdd1ed52b877 on n-h1-465891-3 Jul 18 02:15:51.945948 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-1812070b-dff8-4216-b343-4ccde691ff34 req-d61f9ac5-337b-4770-a824-d905a5c8a67a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081128 Jul 18 02:15:51.954438 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 848/1712] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:51.969352 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-596919e1-5feb-4aef-86d9-77a7dca65868 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a8aecf70>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:52.064080 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-596919e1-5feb-4aef-86d9-77a7dca65868 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372" status: 200 len: 1423 microversion: 2.1 time: 0.107836 Jul 18 02:15:52.065502 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 849/1713] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:15:51 2022] GET /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372 => generated 1423 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:52.077559 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-88c19b1e-81ef-48cb-947e-cf72f398afef tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Action: 'create', calling method: .version_select at 0x7ff4a8aa28b0>, body: {"keypair": {"name": "tempest-keypair-1532200092", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCewRnZqeGoUhRAUrlr3wod/5N3FpbIJ0+XjrQbX+SfmCzqYsYhxT6BtoaGL4WYVzTTYqOBIYtd0gKTmr32VopI0Ggi+w+BQGTti3lXqSl4KHlFD3NJcbnRM7oF/77Eg6Q=="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:52.113064 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-88c19b1e-81ef-48cb-947e-cf72f398afef tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Getting quotas for project 82f86eb4ab6d4a448b2ec12ce759ee29. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:15:52.132640 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-88c19b1e-81ef-48cb-947e-cf72f398afef tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Getting quotas for user bc3164ee635f41e3b71fa6f8826cc826 and project 82f86eb4ab6d4a448b2ec12ce759ee29. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:15:52.192933 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-88c19b1e-81ef-48cb-947e-cf72f398afef tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.121434 Jul 18 02:15:52.196382 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 850/1714] 10.222.0.57 () {62 vars in 1198 bytes} [Mon Jul 18 02:15:52 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 130 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 18 02:15:52.212283 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-17c798b3-e695-43b7-b9e2-43bf7021dbb9 req-5838be5d-c193-4b30-8cce-1ca4d67e3dff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11caf39a-9515-4e04-b244-3be043262875", "name": "network-vif-plugged", "status": "completed", "tag": "2dec9e13-e24b-4e03-ae42-a92defd8aaec"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:52.246775 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-17c798b3-e695-43b7-b9e2-43bf7021dbb9 req-5838be5d-c193-4b30-8cce-1ca4d67e3dff service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:52.247455 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-17c798b3-e695-43b7-b9e2-43bf7021dbb9 req-5838be5d-c193-4b30-8cce-1ca4d67e3dff service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:52.271517 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-17c798b3-e695-43b7-b9e2-43bf7021dbb9 req-5838be5d-c193-4b30-8cce-1ca4d67e3dff service nova] Creating event network-vif-plugged:2dec9e13-e24b-4e03-ae42-a92defd8aaec for instance 11caf39a-9515-4e04-b244-3be043262875 on n-h1-465891-3 Jul 18 02:15:52.289327 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-17c798b3-e695-43b7-b9e2-43bf7021dbb9 req-5838be5d-c193-4b30-8cce-1ca4d67e3dff service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091295 Jul 18 02:15:52.291295 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 851/1715] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:52.306250 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d7095489-5ae8-43e7-bd09-05ac350f1ad2 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:52.309280 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d7095489-5ae8-43e7-bd09-05ac350f1ad2 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c4cc6162-ade9-4f10-9468-fdd1ed52b877] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:52.331418 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d7095489-5ae8-43e7-bd09-05ac350f1ad2 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:52.335422 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d7095489-5ae8-43e7-bd09-05ac350f1ad2 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:52.336728 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d7095489-5ae8-43e7-bd09-05ac350f1ad2 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:52.337362 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d7095489-5ae8-43e7-bd09-05ac350f1ad2 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:52.404065 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-90d2ad0c-6bf9-4cd6-80dd-a27fb06e4f98 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:52.429279 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-90d2ad0c-6bf9-4cd6-80dd-a27fb06e4f98 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 200 len: 1716 microversion: 2.1 time: 0.892122 Jul 18 02:15:52.438385 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 865/1716] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:51 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 1716 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:52.455358 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8ba47cb4-9248-4c94-b8f8-0a54b6288f2d tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:52.456605 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8ba47cb4-9248-4c94-b8f8-0a54b6288f2d tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 25d7575c-c9a7-4dba-8f13-6c57e988af59] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:52.490542 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8ba47cb4-9248-4c94-b8f8-0a54b6288f2d tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:52.491651 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8ba47cb4-9248-4c94-b8f8-0a54b6288f2d tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:52.492955 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8ba47cb4-9248-4c94-b8f8-0a54b6288f2d tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:52.493863 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8ba47cb4-9248-4c94-b8f8-0a54b6288f2d tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:53.307731 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8ba47cb4-9248-4c94-b8f8-0a54b6288f2d tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:53.334330 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8ba47cb4-9248-4c94-b8f8-0a54b6288f2d tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers/25d7575c-c9a7-4dba-8f13-6c57e988af59" status: 200 len: 1321 microversion: 2.1 time: 0.891237 Jul 18 02:15:53.347320 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 866/1717] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:52 2022] GET /compute/v2.1/servers/25d7575c-c9a7-4dba-8f13-6c57e988af59 => generated 1321 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:53.376516 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-496a0e93-b602-4aa3-9fa5-017ccb91a04b tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Calling method '.version_select at 0x7ff4a85dd9d0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:53.439327 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-496a0e93-b602-4aa3-9fa5-017ccb91a04b tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1532200092" status: 204 len: 0 microversion: 2.2 time: 0.085945 Jul 18 02:15:53.440059 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 867/1718] 10.222.0.57 () {60 vars in 1260 bytes} [Mon Jul 18 02:15:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1532200092 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:15:53.465008 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-65fd6021-4fbb-4a90-b11f-f6bb8b5d3e3a tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:53.466610 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-65fd6021-4fbb-4a90-b11f-f6bb8b5d3e3a tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: e86cd628-160d-4516-ad58-899768acecd9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:53.484759 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65fd6021-4fbb-4a90-b11f-f6bb8b5d3e3a tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:53.485363 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65fd6021-4fbb-4a90-b11f-f6bb8b5d3e3a tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:53.486576 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65fd6021-4fbb-4a90-b11f-f6bb8b5d3e3a tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:53.487203 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65fd6021-4fbb-4a90-b11f-f6bb8b5d3e3a tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:53.639184 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d7095489-5ae8-43e7-bd09-05ac350f1ad2 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:53.654467 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d7095489-5ae8-43e7-bd09-05ac350f1ad2 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877" status: 200 len: 1317 microversion: 2.1 time: 1.360242 Jul 18 02:15:53.655083 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 852/1719] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:52 2022] GET /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877 => generated 1317 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:53.671264 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0f68f183-7779-4bd7-9cd6-c6b34d908f24 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:53.671900 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0f68f183-7779-4bd7-9cd6-c6b34d908f24 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:53.691981 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0f68f183-7779-4bd7-9cd6-c6b34d908f24 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:53.693059 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0f68f183-7779-4bd7-9cd6-c6b34d908f24 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:53.693997 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0f68f183-7779-4bd7-9cd6-c6b34d908f24 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:53.694460 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0f68f183-7779-4bd7-9cd6-c6b34d908f24 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:53.744542 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-65fd6021-4fbb-4a90-b11f-f6bb8b5d3e3a tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe79fa13328b4e40922d0e3e4551a8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6b8514bba84ba8a09c64abbb2d1a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:53.756824 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-65fd6021-4fbb-4a90-b11f-f6bb8b5d3e3a tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "GET /compute/v2.1/servers/e86cd628-160d-4516-ad58-899768acecd9" status: 200 len: 1276 microversion: 2.1 time: 0.315859 Jul 18 02:15:53.757467 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 868/1720] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:53 2022] GET /compute/v2.1/servers/e86cd628-160d-4516-ad58-899768acecd9 => generated 1276 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:53.767274 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5520959c-e6c1-49e9-b444-d370076e8d54 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a851f280>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:53.852280 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5520959c-e6c1-49e9-b444-d370076e8d54 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372" status: 200 len: 1423 microversion: 2.1 time: 0.093661 Jul 18 02:15:53.853220 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 869/1721] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:15:53 2022] GET /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372 => generated 1423 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:53.861594 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e7fc6a13-31dc-4fff-8740-636c997b4ab5 tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Action: 'create', calling method: .version_select at 0x7ff4a8609c10>, body: {"keypair": {"name": "tempest-keypair-1120496496", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:53.924405 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=23 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:53.928046 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-e7fc6a13-31dc-4fff-8740-636c997b4ab5 tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Getting quotas for project 82f86eb4ab6d4a448b2ec12ce759ee29. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:15:53.936087 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-e7fc6a13-31dc-4fff-8740-636c997b4ab5 tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Getting quotas for user bc3164ee635f41e3b71fa6f8826cc826 and project 82f86eb4ab6d4a448b2ec12ce759ee29. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:15:54.033518 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e7fc6a13-31dc-4fff-8740-636c997b4ab5 tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.175853 Jul 18 02:15:54.037861 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 870/1722] 10.222.0.57 () {62 vars in 1198 bytes} [Mon Jul 18 02:15:53 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 181 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 18 02:15:54.047582 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-afc1ee31-526a-4f06-b692-a69088befe18 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:54.049840 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-afc1ee31-526a-4f06-b692-a69088befe18 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:54.075510 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-afc1ee31-526a-4f06-b692-a69088befe18 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:54.076546 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-afc1ee31-526a-4f06-b692-a69088befe18 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:54.078218 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-afc1ee31-526a-4f06-b692-a69088befe18 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:54.078926 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-afc1ee31-526a-4f06-b692-a69088befe18 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:54.444618 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0f68f183-7779-4bd7-9cd6-c6b34d908f24 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9472908374c94355ada94f4947c99f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab10eb9b4cc4b13a640f5479056ab79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:54.459007 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0f68f183-7779-4bd7-9cd6-c6b34d908f24 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] 10.222.0.57 "GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee" status: 200 len: 1523 microversion: 2.1 time: 0.791735 Jul 18 02:15:54.459980 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 853/1723] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:53 2022] GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee => generated 1523 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:54.469316 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ebfa1e37-3b62-4c45-b8b8-78a91e2c8bf9 tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Calling method '.version_select at 0x7ff4a8a34310>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:54.478899 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-afc1ee31-526a-4f06-b692-a69088befe18 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:54.509828 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-afc1ee31-526a-4f06-b692-a69088befe18 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 200 len: 1716 microversion: 2.1 time: 0.469717 Jul 18 02:15:54.515095 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 871/1724] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:54 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 1716 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:54.519132 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ebfa1e37-3b62-4c45-b8b8-78a91e2c8bf9 tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1120496496" status: 204 len: 0 microversion: 2.2 time: 0.057797 Jul 18 02:15:54.529911 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 854/1725] 10.222.0.57 () {60 vars in 1260 bytes} [Mon Jul 18 02:15:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1120496496 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:15:54.545092 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-92de3235-767f-433f-933b-267b4e236319 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:54.545092 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-92de3235-767f-433f-933b-267b4e236319 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 25d7575c-c9a7-4dba-8f13-6c57e988af59] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:54.551634 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5098e1a0-c066-46e4-a9f0-33719374eabb tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Action: 'create', calling method: .version_select at 0x7ff4a8971550>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-572665081", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPFp2K52/dBn9OsO95vr/7G0RnoCvM05NKj9PtRWQor8Iom65rqQ1G+vUQCm43C1krHCFWP379J529NLynOoffBo27OiNwitgT0da74pAsCicqaMx2n1/cyLbrgDlSujBA=="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:54.581740 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-92de3235-767f-433f-933b-267b4e236319 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:54.589309 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-92de3235-767f-433f-933b-267b4e236319 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:54.591386 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-92de3235-767f-433f-933b-267b4e236319 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:54.592553 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-92de3235-767f-433f-933b-267b4e236319 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:54.603889 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-5098e1a0-c066-46e4-a9f0-33719374eabb tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Getting quotas for project 82f86eb4ab6d4a448b2ec12ce759ee29. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:15:54.623727 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-5098e1a0-c066-46e4-a9f0-33719374eabb tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Getting quotas for user bc3164ee635f41e3b71fa6f8826cc826 and project 82f86eb4ab6d4a448b2ec12ce759ee29. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:15:54.635101 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:54.677089 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5098e1a0-c066-46e4-a9f0-33719374eabb tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.142525 Jul 18 02:15:54.690144 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 855/1726] 10.222.0.57 () {62 vars in 1198 bytes} [Mon Jul 18 02:15:54 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 156 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Jul 18 02:15:54.708826 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-097cb4c2-5a87-4c42-b81c-55416998384c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:54.723917 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-097cb4c2-5a87-4c42-b81c-55416998384c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c4cc6162-ade9-4f10-9468-fdd1ed52b877] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:54.741018 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-097cb4c2-5a87-4c42-b81c-55416998384c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:54.746511 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-097cb4c2-5a87-4c42-b81c-55416998384c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:54.747543 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-097cb4c2-5a87-4c42-b81c-55416998384c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:54.748001 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-097cb4c2-5a87-4c42-b81c-55416998384c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:55.267289 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-92de3235-767f-433f-933b-267b4e236319 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:55.280090 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-92de3235-767f-433f-933b-267b4e236319 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers/25d7575c-c9a7-4dba-8f13-6c57e988af59" status: 200 len: 1321 microversion: 2.1 time: 0.759786 Jul 18 02:15:55.280934 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 872/1727] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:54 2022] GET /compute/v2.1/servers/25d7575c-c9a7-4dba-8f13-6c57e988af59 => generated 1321 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:55.287482 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-aff772b8-1a41-4dc3-9fd4-be794404106b req-284e2248-04cb-4227-b940-43f1a4d1e7ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25d7575c-c9a7-4dba-8f13-6c57e988af59", "name": "network-vif-plugged", "status": "completed", "tag": "53440909-ff47-419d-9dd2-14b37718950a"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:55.299157 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-097cb4c2-5a87-4c42-b81c-55416998384c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:55.303666 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-aff772b8-1a41-4dc3-9fd4-be794404106b req-284e2248-04cb-4227-b940-43f1a4d1e7ed service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:55.304119 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-aff772b8-1a41-4dc3-9fd4-be794404106b req-284e2248-04cb-4227-b940-43f1a4d1e7ed service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:55.310430 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-097cb4c2-5a87-4c42-b81c-55416998384c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877" status: 200 len: 1317 microversion: 2.1 time: 0.618467 Jul 18 02:15:55.311833 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 856/1728] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:54 2022] GET /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877 => generated 1317 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:55.325289 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c9d2e07f-1a38-4935-a67a-02be365daecc tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Action: 'create', calling method: .version_select at 0x7ff4adced280>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-197942118", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPL5zlDOrX+uT4bQIb137rqP8orrc1YnGJbbJGp+ZFpG7vukELzyYB+zqfekrVLUdIV9eSlLY4QC1LJ1UaTqIyVDMSO+9xx32IypMiCKkCdu/vhoVcE89CzmiWfU2gAw1w=="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:55.327019 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-aff772b8-1a41-4dc3-9fd4-be794404106b req-284e2248-04cb-4227-b940-43f1a4d1e7ed service nova] Creating event network-vif-plugged:53440909-ff47-419d-9dd2-14b37718950a for instance 25d7575c-c9a7-4dba-8f13-6c57e988af59 on n-h2-465891-3 Jul 18 02:15:55.336624 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-aff772b8-1a41-4dc3-9fd4-be794404106b req-284e2248-04cb-4227-b940-43f1a4d1e7ed service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054156 Jul 18 02:15:55.338524 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 873/1729] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:55.347346 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-84cb0bf2-f95d-4181-a5b9-153a999ba19d tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:55.348743 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-84cb0bf2-f95d-4181-a5b9-153a999ba19d tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: e86cd628-160d-4516-ad58-899768acecd9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:55.355987 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-c9d2e07f-1a38-4935-a67a-02be365daecc tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Getting quotas for project 82f86eb4ab6d4a448b2ec12ce759ee29. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:15:55.358022 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-84cb0bf2-f95d-4181-a5b9-153a999ba19d tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:55.358784 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-84cb0bf2-f95d-4181-a5b9-153a999ba19d tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:55.359823 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-84cb0bf2-f95d-4181-a5b9-153a999ba19d tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:55.360434 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-84cb0bf2-f95d-4181-a5b9-153a999ba19d tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:55.373545 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-c9d2e07f-1a38-4935-a67a-02be365daecc tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Getting quotas for user bc3164ee635f41e3b71fa6f8826cc826 and project 82f86eb4ab6d4a448b2ec12ce759ee29. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:15:55.453796 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c9d2e07f-1a38-4935-a67a-02be365daecc tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.139727 Jul 18 02:15:55.454771 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 857/1730] 10.222.0.57 () {62 vars in 1198 bytes} [Mon Jul 18 02:15:55 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 141 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 18 02:15:55.464269 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f39a6790-f463-4f07-b7be-9cb8919737a3 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a8c03ee0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:55.555375 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f39a6790-f463-4f07-b7be-9cb8919737a3 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372" status: 200 len: 1423 microversion: 2.1 time: 0.099364 Jul 18 02:15:55.563542 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 858/1731] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:15:55 2022] GET /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372 => generated 1423 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:55.572934 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-035c7268-2fab-4eda-a568-5072ab1984af tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-568180584", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "e5432050-4fd3-426b-81bb-244a073d1cbe"}], "security_groups": [{"name": "tempest-securitygroup--1830027022"}], "key_name": "tempest-keypair-1707145596", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:55.723613 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-84cb0bf2-f95d-4181-a5b9-153a999ba19d tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe79fa13328b4e40922d0e3e4551a8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6b8514bba84ba8a09c64abbb2d1a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:55.743045 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-84cb0bf2-f95d-4181-a5b9-153a999ba19d tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "GET /compute/v2.1/servers/e86cd628-160d-4516-ad58-899768acecd9" status: 200 len: 1318 microversion: 2.1 time: 0.399284 Jul 18 02:15:55.743045 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 874/1732] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:55 2022] GET /compute/v2.1/servers/e86cd628-160d-4516-ad58-899768acecd9 => generated 1318 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:55.757897 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-afdc1e73-61a6-4ac2-a4bc-2c11a095f144 tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Action: 'create', calling method: .version_select at 0x7ff4a8605940>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1689180229", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPm+GX5bmVCBipmcLyOIQtvVBiemMjWN63mYSgLpS2sOa1h1vV4JW+yATtbQxZRdoCnjWsVbi3PbomNtUGb+KJqtSqFrdgTTcQGr7D04T1e5MLS6OwYiRKVBQYtslxeiWA=="}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:55.776733 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-035c7268-2fab-4eda-a568-5072ab1984af tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] validate_networks() for [('e5432050-4fd3-426b-81bb-244a073d1cbe', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:15:55.856810 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-afdc1e73-61a6-4ac2-a4bc-2c11a095f144 tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Getting quotas for project 82f86eb4ab6d4a448b2ec12ce759ee29. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:15:55.879464 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-afdc1e73-61a6-4ac2-a4bc-2c11a095f144 tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Getting quotas for user bc3164ee635f41e3b71fa6f8826cc826 and project 82f86eb4ab6d4a448b2ec12ce759ee29. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:15:55.970557 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-afdc1e73-61a6-4ac2-a4bc-2c11a095f144 tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.225136 Jul 18 02:15:55.971535 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 875/1733] 10.222.0.57 () {62 vars in 1198 bytes} [Mon Jul 18 02:15:55 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 228 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 18 02:15:56.002223 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0d17101a-043e-45fa-b65b-ff5747ca36bd tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:56.002223 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0d17101a-043e-45fa-b65b-ff5747ca36bd tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:56.002223 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0d17101a-043e-45fa-b65b-ff5747ca36bd tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:56.002223 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0d17101a-043e-45fa-b65b-ff5747ca36bd tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:56.002223 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0d17101a-043e-45fa-b65b-ff5747ca36bd tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:56.002223 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0d17101a-043e-45fa-b65b-ff5747ca36bd tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:56.535600 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0d17101a-043e-45fa-b65b-ff5747ca36bd tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9472908374c94355ada94f4947c99f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab10eb9b4cc4b13a640f5479056ab79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:56.570715 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0d17101a-043e-45fa-b65b-ff5747ca36bd tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] 10.222.0.57 "GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee" status: 200 len: 1523 microversion: 2.1 time: 0.590526 Jul 18 02:15:56.579960 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 876/1734] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:55 2022] GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee => generated 1523 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:56.606739 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4e01baee-bb20-4c30-bdec-7cf719768a59 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:56.608187 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4e01baee-bb20-4c30-bdec-7cf719768a59 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:56.633901 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e01baee-bb20-4c30-bdec-7cf719768a59 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:56.634447 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e01baee-bb20-4c30-bdec-7cf719768a59 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:56.637343 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e01baee-bb20-4c30-bdec-7cf719768a59 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:56.644942 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e01baee-bb20-4c30-bdec-7cf719768a59 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:56.652796 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:57.923317 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4e01baee-bb20-4c30-bdec-7cf719768a59 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:57.936963 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4e01baee-bb20-4c30-bdec-7cf719768a59 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 200 len: 1716 microversion: 2.1 time: 1.355294 Jul 18 02:15:57.947705 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 877/1735] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:56 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 1716 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:57.953690 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e36218cb-1219-468b-803d-b7adaa62da7a tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Calling method '.version_select at 0x7ff4a8609280>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:57.957256 n-d-465891-3 devstack@n-api.service[119544]: WARNING oslo_db.sqlalchemy.utils [None req-e36218cb-1219-468b-803d-b7adaa62da7a tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 18 02:15:57.965664 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e36218cb-1219-468b-803d-b7adaa62da7a tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] 10.222.0.57 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.016160 Jul 18 02:15:57.966891 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 878/1736] 10.222.0.57 () {60 vars in 1176 bytes} [Mon Jul 18 02:15:57 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:57.972145 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-44b0a467-4b50-4f7b-990c-4e0a036be324 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:57.974361 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-44b0a467-4b50-4f7b-990c-4e0a036be324 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 25d7575c-c9a7-4dba-8f13-6c57e988af59] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:57.977447 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:57.984323 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-44b0a467-4b50-4f7b-990c-4e0a036be324 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:57.985317 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-44b0a467-4b50-4f7b-990c-4e0a036be324 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:57.987216 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-44b0a467-4b50-4f7b-990c-4e0a036be324 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:57.988735 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-44b0a467-4b50-4f7b-990c-4e0a036be324 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:58.245194 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-035c7268-2fab-4eda-a568-5072ab1984af tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:15:58.245805 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-035c7268-2fab-4eda-a568-5072ab1984af tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:15:58.246121 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-035c7268-2fab-4eda-a568-5072ab1984af tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:15:58.246540 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-035c7268-2fab-4eda-a568-5072ab1984af tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:15:58.247580 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-035c7268-2fab-4eda-a568-5072ab1984af tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:15:58.254187 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-44b0a467-4b50-4f7b-990c-4e0a036be324 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:58.260137 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-035c7268-2fab-4eda-a568-5072ab1984af tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:58.261020 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-035c7268-2fab-4eda-a568-5072ab1984af tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:58.261830 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-035c7268-2fab-4eda-a568-5072ab1984af tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:58.262274 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-035c7268-2fab-4eda-a568-5072ab1984af tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:58.262778 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-44b0a467-4b50-4f7b-990c-4e0a036be324 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers/25d7575c-c9a7-4dba-8f13-6c57e988af59" status: 200 len: 1512 microversion: 2.1 time: 0.294496 Jul 18 02:15:58.263370 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 879/1737] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:57 2022] GET /compute/v2.1/servers/25d7575c-c9a7-4dba-8f13-6c57e988af59 => generated 1512 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:58.274024 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f9061a45-2d17-4a79-8513-ad9af00431d7 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:58.275053 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f9061a45-2d17-4a79-8513-ad9af00431d7 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c4cc6162-ade9-4f10-9468-fdd1ed52b877] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:58.282554 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f9061a45-2d17-4a79-8513-ad9af00431d7 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:58.283454 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f9061a45-2d17-4a79-8513-ad9af00431d7 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:58.284526 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f9061a45-2d17-4a79-8513-ad9af00431d7 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:58.285358 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f9061a45-2d17-4a79-8513-ad9af00431d7 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:58.295819 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-035c7268-2fab-4eda-a568-5072ab1984af tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Getting quotas for project 9d0f5bbde58545fb9ccd1c2eb842ed49. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:15:58.305394 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-035c7268-2fab-4eda-a568-5072ab1984af tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Getting quotas for user 575dd6743cff44678749d452329355d1 and project 9d0f5bbde58545fb9ccd1c2eb842ed49. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:15:58.326464 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-035c7268-2fab-4eda-a568-5072ab1984af tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:15:58.329692 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-035c7268-2fab-4eda-a568-5072ab1984af tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:15:58.432559 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-035c7268-2fab-4eda-a568-5072ab1984af tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 2.867459 Jul 18 02:15:58.441508 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 859/1738] 10.222.0.57 () {62 vars in 1187 bytes} [Mon Jul 18 02:15:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 2870 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 02:15:58.442570 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e706d201-1214-4f29-b7e5-cfd900896edd tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a8c03790>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:58.545340 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e706d201-1214-4f29-b7e5-cfd900896edd tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372" status: 200 len: 1432 microversion: 2.1 time: 0.108325 Jul 18 02:15:58.546648 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 860/1739] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:15:58 2022] GET /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372 => generated 1432 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:58.554277 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-14b1b0a5-a4ee-439c-bf72-9543402164c0 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:58.556848 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-14b1b0a5-a4ee-439c-bf72-9543402164c0 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: e86cd628-160d-4516-ad58-899768acecd9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:58.570305 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14b1b0a5-a4ee-439c-bf72-9543402164c0 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:58.570903 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14b1b0a5-a4ee-439c-bf72-9543402164c0 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:58.573507 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14b1b0a5-a4ee-439c-bf72-9543402164c0 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:58.573918 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14b1b0a5-a4ee-439c-bf72-9543402164c0 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:58.600009 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f9061a45-2d17-4a79-8513-ad9af00431d7 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:58.602686 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=100 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:58.610809 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f9061a45-2d17-4a79-8513-ad9af00431d7 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877" status: 200 len: 1317 microversion: 2.1 time: 0.346050 Jul 18 02:15:58.612067 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 880/1740] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:58 2022] GET /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877 => generated 1317 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:58.617785 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-f40a5a6a-c4c3-4427-a1e1-b5fbbad97bb1 req-2f39babe-6101-48f1-a5b6-72d6da9ae36d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e86cd628-160d-4516-ad58-899768acecd9", "tag": "68490722-4f41-4a28-aca9-a8f598e9d8dd"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:58.632871 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-f40a5a6a-c4c3-4427-a1e1-b5fbbad97bb1 req-2f39babe-6101-48f1-a5b6-72d6da9ae36d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:58.633517 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-f40a5a6a-c4c3-4427-a1e1-b5fbbad97bb1 req-2f39babe-6101-48f1-a5b6-72d6da9ae36d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:58.652878 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-f40a5a6a-c4c3-4427-a1e1-b5fbbad97bb1 req-2f39babe-6101-48f1-a5b6-72d6da9ae36d service nova] Creating event network-changed:68490722-4f41-4a28-aca9-a8f598e9d8dd for instance e86cd628-160d-4516-ad58-899768acecd9 on n-h1-465891-3 Jul 18 02:15:58.663893 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-f40a5a6a-c4c3-4427-a1e1-b5fbbad97bb1 req-2f39babe-6101-48f1-a5b6-72d6da9ae36d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050387 Jul 18 02:15:58.666068 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 881/1741] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:58.672320 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-10ec0190-4b88-4fa9-9844-1b1345a2aecc tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:58.673046 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-10ec0190-4b88-4fa9-9844-1b1345a2aecc tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:58.681990 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-10ec0190-4b88-4fa9-9844-1b1345a2aecc tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:58.682310 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-10ec0190-4b88-4fa9-9844-1b1345a2aecc tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:58.684251 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-10ec0190-4b88-4fa9-9844-1b1345a2aecc tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:58.684745 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-10ec0190-4b88-4fa9-9844-1b1345a2aecc tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:58.995888 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-14b1b0a5-a4ee-439c-bf72-9543402164c0 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe79fa13328b4e40922d0e3e4551a8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6b8514bba84ba8a09c64abbb2d1a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:59.018710 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-14b1b0a5-a4ee-439c-bf72-9543402164c0 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "GET /compute/v2.1/servers/e86cd628-160d-4516-ad58-899768acecd9" status: 200 len: 1318 microversion: 2.1 time: 0.468087 Jul 18 02:15:59.040923 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 861/1742] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:58 2022] GET /compute/v2.1/servers/e86cd628-160d-4516-ad58-899768acecd9 => generated 1318 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:59.056673 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ff185da6-575b-4cf2-a832-df3dba23e864 tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Calling method '.version_select at 0x7ff4a8c03040>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:59.099503 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ff185da6-575b-4cf2-a832-df3dba23e864 tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1689180229" status: 204 len: 0 microversion: 2.2 time: 0.054696 Jul 18 02:15:59.107896 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 862/1743] 10.222.0.57 () {60 vars in 1320 bytes} [Mon Jul 18 02:15:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1689180229 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:15:59.119629 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4d40d642-2b4e-4a0c-b92d-a73dddeb5636 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:59.122045 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4d40d642-2b4e-4a0c-b92d-a73dddeb5636 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 4a494dac-3446-4569-b154-b14f9eb22b3e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:59.137547 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4d40d642-2b4e-4a0c-b92d-a73dddeb5636 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:59.138748 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4d40d642-2b4e-4a0c-b92d-a73dddeb5636 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:59.140588 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4d40d642-2b4e-4a0c-b92d-a73dddeb5636 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:59.141876 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4d40d642-2b4e-4a0c-b92d-a73dddeb5636 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:59.209349 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-10ec0190-4b88-4fa9-9844-1b1345a2aecc tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9472908374c94355ada94f4947c99f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab10eb9b4cc4b13a640f5479056ab79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:59.256951 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-10ec0190-4b88-4fa9-9844-1b1345a2aecc tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] 10.222.0.57 "GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee" status: 200 len: 1523 microversion: 2.1 time: 0.585346 Jul 18 02:15:59.258145 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 882/1744] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:58 2022] GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee => generated 1523 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:59.266246 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7477b4a1-8cd4-4fb9-8046-0e4cbea06c50 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:59.267192 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7477b4a1-8cd4-4fb9-8046-0e4cbea06c50 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:59.478322 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7477b4a1-8cd4-4fb9-8046-0e4cbea06c50 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:59.518180 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7477b4a1-8cd4-4fb9-8046-0e4cbea06c50 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:59.521744 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7477b4a1-8cd4-4fb9-8046-0e4cbea06c50 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:59.524383 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7477b4a1-8cd4-4fb9-8046-0e4cbea06c50 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 200 len: 1285 microversion: 2.25 time: 0.264604 Jul 18 02:15:59.528722 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 883/1745] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:15:59 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 1285 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:15:59.552013 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bec28c14-c536-478f-969d-b8e2c87acf11 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a88001f0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:59.568595 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4d40d642-2b4e-4a0c-b92d-a73dddeb5636 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:59.583036 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4d40d642-2b4e-4a0c-b92d-a73dddeb5636 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers/4a494dac-3446-4569-b154-b14f9eb22b3e" status: 200 len: 1511 microversion: 2.1 time: 0.473350 Jul 18 02:15:59.583774 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 863/1746] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:59 2022] GET /compute/v2.1/servers/4a494dac-3446-4569-b154-b14f9eb22b3e => generated 1511 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:59.595150 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2f60dcae-d47c-4256-a85b-de4f74ee6a03 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:59.598517 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2f60dcae-d47c-4256-a85b-de4f74ee6a03 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:59.614171 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2f60dcae-d47c-4256-a85b-de4f74ee6a03 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:59.615933 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2f60dcae-d47c-4256-a85b-de4f74ee6a03 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:59.616446 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2f60dcae-d47c-4256-a85b-de4f74ee6a03 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:59.617232 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2f60dcae-d47c-4256-a85b-de4f74ee6a03 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:59.646026 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bec28c14-c536-478f-969d-b8e2c87acf11 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372" status: 200 len: 1432 microversion: 2.1 time: 0.112789 Jul 18 02:15:59.646744 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 884/1747] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:15:59 2022] GET /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372 => generated 1432 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:59.651704 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-64b2195a-1b21-4ed0-8d9b-b78eaf62329d tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Calling method '.version_select at 0x7ff4a85cc1f0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:59.672497 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-64b2195a-1b21-4ed0-8d9b-b78eaf62329d tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-197942118" status: 204 len: 0 microversion: 2.2 time: 0.024575 Jul 18 02:15:59.673218 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 885/1748] 10.222.0.57 () {60 vars in 1317 bytes} [Mon Jul 18 02:15:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-197942118 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:15:59.678972 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d8717ab6-6259-48dd-b4a9-c9ad0921448f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:59.679701 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d8717ab6-6259-48dd-b4a9-c9ad0921448f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 11caf39a-9515-4e04-b244-3be043262875] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:59.687396 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d8717ab6-6259-48dd-b4a9-c9ad0921448f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:59.688136 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d8717ab6-6259-48dd-b4a9-c9ad0921448f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:59.689111 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d8717ab6-6259-48dd-b4a9-c9ad0921448f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:59.689598 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d8717ab6-6259-48dd-b4a9-c9ad0921448f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:59.952072 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2f60dcae-d47c-4256-a85b-de4f74ee6a03 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:59.961957 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d8717ab6-6259-48dd-b4a9-c9ad0921448f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:59.971871 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d8717ab6-6259-48dd-b4a9-c9ad0921448f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers/11caf39a-9515-4e04-b244-3be043262875" status: 200 len: 1511 microversion: 2.1 time: 0.297531 Jul 18 02:15:59.972871 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 886/1749] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:59 2022] GET /compute/v2.1/servers/11caf39a-9515-4e04-b244-3be043262875 => generated 1511 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:59.975330 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2f60dcae-d47c-4256-a85b-de4f74ee6a03 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 200 len: 1716 microversion: 2.1 time: 0.383584 Jul 18 02:15:59.978613 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3297ff74-92e1-4d98-a37b-4ea98df9c331 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:59.979764 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3297ff74-92e1-4d98-a37b-4ea98df9c331 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c4cc6162-ade9-4f10-9468-fdd1ed52b877] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:59.986731 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 864/1750] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:59 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 1716 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:59.987611 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3297ff74-92e1-4d98-a37b-4ea98df9c331 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:59.989017 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3297ff74-92e1-4d98-a37b-4ea98df9c331 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:59.990357 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3297ff74-92e1-4d98-a37b-4ea98df9c331 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:59.991187 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3297ff74-92e1-4d98-a37b-4ea98df9c331 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:00.010307 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-efad1c32-560e-4d21-b61a-adc087601134 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:00.012236 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-efad1c32-560e-4d21-b61a-adc087601134 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] [instance: 32361df9-4e50-409c-9cc7-6f70ba6ce26e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:00.020907 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-efad1c32-560e-4d21-b61a-adc087601134 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:00.022382 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-efad1c32-560e-4d21-b61a-adc087601134 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:00.024599 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-efad1c32-560e-4d21-b61a-adc087601134 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:00.025340 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-efad1c32-560e-4d21-b61a-adc087601134 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:00.342922 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3297ff74-92e1-4d98-a37b-4ea98df9c331 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:00.357890 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3297ff74-92e1-4d98-a37b-4ea98df9c331 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877" status: 200 len: 1317 microversion: 2.1 time: 0.383043 Jul 18 02:16:00.358983 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 887/1751] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:59 2022] GET /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877 => generated 1317 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:00.367213 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-efad1c32-560e-4d21-b61a-adc087601134 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28fb70d1545b087bce52f2975a1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c8e07f8a9b4a398614fcf02c561416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:00.367992 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bc7b4523-fbeb-40b0-ac39-9e582f611cc2 tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Calling method '.version_select at 0x7ff4a85cae50>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:00.376369 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-efad1c32-560e-4d21-b61a-adc087601134 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e" status: 200 len: 1465 microversion: 2.1 time: 0.381340 Jul 18 02:16:00.377217 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 865/1752] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:59 2022] GET /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e => generated 1465 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:00.385209 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4d099f20-db9c-47a5-ab69-5ea73c3eeb54 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:00.390613 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4d099f20-db9c-47a5-ab69-5ea73c3eeb54 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:00.392015 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4d099f20-db9c-47a5-ab69-5ea73c3eeb54 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '58dcb69855544ff3b51109aa5d41f637'} {{(pid=119543) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:16:00.398417 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bc7b4523-fbeb-40b0-ac39-9e582f611cc2 tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-572665081" status: 204 len: 0 microversion: 2.2 time: 0.037388 Jul 18 02:16:00.399191 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 888/1753] 10.222.0.57 () {60 vars in 1317 bytes} [Mon Jul 18 02:16:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-572665081 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:00.413931 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4d099f20-db9c-47a5-ab69-5ea73c3eeb54 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:00.414306 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f98ba2de-cedf-465a-bda8-dcecae56fd30 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:00.414495 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4d099f20-db9c-47a5-ab69-5ea73c3eeb54 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:00.414870 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f98ba2de-cedf-465a-bda8-dcecae56fd30 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: e86cd628-160d-4516-ad58-899768acecd9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:00.415181 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4d099f20-db9c-47a5-ab69-5ea73c3eeb54 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:00.415754 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4d099f20-db9c-47a5-ab69-5ea73c3eeb54 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:00.421695 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f98ba2de-cedf-465a-bda8-dcecae56fd30 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:00.422170 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f98ba2de-cedf-465a-bda8-dcecae56fd30 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:00.423075 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f98ba2de-cedf-465a-bda8-dcecae56fd30 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:00.423446 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f98ba2de-cedf-465a-bda8-dcecae56fd30 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:00.599983 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.multi_cell_list [None req-4d099f20-db9c-47a5-ab69-5ea73c3eeb54 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119543) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:16:00.602031 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f98ba2de-cedf-465a-bda8-dcecae56fd30 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe79fa13328b4e40922d0e3e4551a8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6b8514bba84ba8a09c64abbb2d1a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:00.620521 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f98ba2de-cedf-465a-bda8-dcecae56fd30 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "GET /compute/v2.1/servers/e86cd628-160d-4516-ad58-899768acecd9" status: 200 len: 1318 microversion: 2.1 time: 0.220026 Jul 18 02:16:00.621735 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 889/1754] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:00 2022] GET /compute/v2.1/servers/e86cd628-160d-4516-ad58-899768acecd9 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:00.637001 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-78a21145-eef7-430a-ab94-45ac131c0ff0 req-9e85fe0e-9c6b-4a8e-84c9-3dbffaa1cacd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4cc6162-ade9-4f10-9468-fdd1ed52b877", "name": "network-vif-plugged", "status": "completed", "tag": "6439e9de-0c99-49d5-b628-c36d89f73fc6"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:00.671646 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-78a21145-eef7-430a-ab94-45ac131c0ff0 req-9e85fe0e-9c6b-4a8e-84c9-3dbffaa1cacd service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:00.674266 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-78a21145-eef7-430a-ab94-45ac131c0ff0 req-9e85fe0e-9c6b-4a8e-84c9-3dbffaa1cacd service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:00.704871 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-78a21145-eef7-430a-ab94-45ac131c0ff0 req-9e85fe0e-9c6b-4a8e-84c9-3dbffaa1cacd service nova] Creating event network-vif-plugged:6439e9de-0c99-49d5-b628-c36d89f73fc6 for instance c4cc6162-ade9-4f10-9468-fdd1ed52b877 on n-h1-465891-3 Jul 18 02:16:00.714994 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-78a21145-eef7-430a-ab94-45ac131c0ff0 req-9e85fe0e-9c6b-4a8e-84c9-3dbffaa1cacd service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090981 Jul 18 02:16:00.716054 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 890/1755] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:00.728211 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-543c41c8-be6f-4089-ab51-8fa6ddb8d4ee tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:00.729961 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-543c41c8-be6f-4089-ab51-8fa6ddb8d4ee tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:00.734954 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4d099f20-db9c-47a5-ab69-5ea73c3eeb54 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:00.746034 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4d099f20-db9c-47a5-ab69-5ea73c3eeb54 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:00.747178 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4d099f20-db9c-47a5-ab69-5ea73c3eeb54 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:00.760877 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-543c41c8-be6f-4089-ab51-8fa6ddb8d4ee tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:00.761634 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-543c41c8-be6f-4089-ab51-8fa6ddb8d4ee tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:00.763187 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-543c41c8-be6f-4089-ab51-8fa6ddb8d4ee tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:00.773046 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-543c41c8-be6f-4089-ab51-8fa6ddb8d4ee tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:00.948030 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4d099f20-db9c-47a5-ab69-5ea73c3eeb54 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 0.569574 Jul 18 02:16:00.948957 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 866/1756] 10.222.0.57 () {58 vars in 1166 bytes} [Mon Jul 18 02:16:00 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:00.954537 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-800760c8-f500-4c9e-9f1f-45be619a2526 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4adced670>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:01.014566 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-800760c8-f500-4c9e-9f1f-45be619a2526 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/3bb0a19f-5b69-48ee-a771-8fd416f92f36" status: 200 len: 784 microversion: 2.1 time: 0.064269 Jul 18 02:16:01.016417 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 867/1757] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:16:00 2022] GET /compute/v2.1/images/3bb0a19f-5b69-48ee-a771-8fd416f92f36 => generated 784 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:01.022984 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c617ddd3-f2de-42d0-8f8d-dee4bc972d58 tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Action: 'create', calling method: .version_select at 0x7ff4a8a344c0>, body: {"keypair": {"name": "tempest-keypair-2075640800", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsN67vQe6zecwG0eagc+7EUXLnl9HeEHSdVzRYvbAZnlx0tmGKhsJGxK9P3ipP2R9ys8GLvJwOptJj41HbQBn12c7yKPwBY6gcpS1bJpQdKtPoIsMWzEzVWqFSedyb7sA=="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:01.044885 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-c617ddd3-f2de-42d0-8f8d-dee4bc972d58 tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Getting quotas for project 82f86eb4ab6d4a448b2ec12ce759ee29. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:16:01.052932 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-c617ddd3-f2de-42d0-8f8d-dee4bc972d58 tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Getting quotas for user bc3164ee635f41e3b71fa6f8826cc826 and project 82f86eb4ab6d4a448b2ec12ce759ee29. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:16:01.067514 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-543c41c8-be6f-4089-ab51-8fa6ddb8d4ee tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9472908374c94355ada94f4947c99f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab10eb9b4cc4b13a640f5479056ab79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:01.076262 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-543c41c8-be6f-4089-ab51-8fa6ddb8d4ee tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] 10.222.0.57 "GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee" status: 200 len: 1503 microversion: 2.1 time: 0.357922 Jul 18 02:16:01.077751 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 891/1758] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:00 2022] GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee => generated 1503 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:01.084562 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e1259d83-666d-441b-9d10-c17e5a0fead1 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:01.085596 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e1259d83-666d-441b-9d10-c17e5a0fead1 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:01.093689 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e1259d83-666d-441b-9d10-c17e5a0fead1 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:01.094283 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e1259d83-666d-441b-9d10-c17e5a0fead1 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:01.095074 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e1259d83-666d-441b-9d10-c17e5a0fead1 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:01.095873 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e1259d83-666d-441b-9d10-c17e5a0fead1 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:01.103804 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c617ddd3-f2de-42d0-8f8d-dee4bc972d58 tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.085555 Jul 18 02:16:01.104902 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 868/1759] 10.222.0.57 () {62 vars in 1198 bytes} [Mon Jul 18 02:16:01 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 88 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 18 02:16:01.115121 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-82267c93-021b-4827-92c8-a0faf6e359a5 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:01.126410 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-82267c93-021b-4827-92c8-a0faf6e359a5 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:01.128912 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-82267c93-021b-4827-92c8-a0faf6e359a5 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-848148827', 'deleted': False, 'project_id': '58dcb69855544ff3b51109aa5d41f637'} {{(pid=119543) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:16:01.143311 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-82267c93-021b-4827-92c8-a0faf6e359a5 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:01.145532 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-82267c93-021b-4827-92c8-a0faf6e359a5 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:01.147531 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-82267c93-021b-4827-92c8-a0faf6e359a5 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:01.148609 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-82267c93-021b-4827-92c8-a0faf6e359a5 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:01.189868 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e1259d83-666d-441b-9d10-c17e5a0fead1 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:01.200438 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e1259d83-666d-441b-9d10-c17e5a0fead1 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:01.202661 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e1259d83-666d-441b-9d10-c17e5a0fead1 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:01.204055 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e1259d83-666d-441b-9d10-c17e5a0fead1 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 200 len: 1343 microversion: 2.25 time: 0.124740 Jul 18 02:16:01.205219 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 892/1760] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:16:01 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 1343 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:16:01.215452 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-63dba711-e28f-4ef5-94c1-893033d64c83 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:01.216625 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-63dba711-e28f-4ef5-94c1-893033d64c83 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:01.227537 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-63dba711-e28f-4ef5-94c1-893033d64c83 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:01.228179 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-63dba711-e28f-4ef5-94c1-893033d64c83 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:01.229481 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-63dba711-e28f-4ef5-94c1-893033d64c83 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:01.230133 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-63dba711-e28f-4ef5-94c1-893033d64c83 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:01.346481 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.multi_cell_list [None req-82267c93-021b-4827-92c8-a0faf6e359a5 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119543) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:16:01.355373 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:01.416471 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-63dba711-e28f-4ef5-94c1-893033d64c83 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:01.427246 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-63dba711-e28f-4ef5-94c1-893033d64c83 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 200 len: 1716 microversion: 2.1 time: 0.220740 Jul 18 02:16:01.428292 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 893/1761] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:01 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 1716 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:01.433183 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-17e52fd2-4ffa-472d-88da-a0a5f8f2b5e2 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:01.448857 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-17e52fd2-4ffa-472d-88da-a0a5f8f2b5e2 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019527 Jul 18 02:16:01.450122 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 894/1762] 10.222.0.57 () {58 vars in 1136 bytes} [Mon Jul 18 02:16:01 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:01.455971 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f4550795-f1f0-4097-816e-ee8ae94cd08b tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Action: 'create', calling method: .version_select at 0x7ff4a856a040>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1402531802", "description": "tempest-description-1276199438"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:01.481940 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-82267c93-021b-4827-92c8-a0faf6e359a5 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:01.489818 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-82267c93-021b-4827-92c8-a0faf6e359a5 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:01.490272 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-82267c93-021b-4827-92c8-a0faf6e359a5 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:01.668136 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-82267c93-021b-4827-92c8-a0faf6e359a5 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-848148827" status: 200 len: 1514 microversion: 2.1 time: 0.561571 Jul 18 02:16:01.683699 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 869/1763] 10.222.0.57 () {58 vars in 1260 bytes} [Mon Jul 18 02:16:01 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-848148827 => generated 1514 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:01.683699 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0e6baef9-eb11-44cb-8803-e806aa9a1b2a tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Calling method '.version_select at 0x7ff4a8971e50>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:01.686915 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0e6baef9-eb11-44cb-8803-e806aa9a1b2a tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] 10.222.0.57 "GET /compute/v2.1/os-keypairs/tempest-keypair-2075640800" status: 200 len: 513 microversion: 2.2 time: 0.015257 Jul 18 02:16:01.688127 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 870/1764] 10.222.0.57 () {60 vars in 1257 bytes} [Mon Jul 18 02:16:01 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2075640800 => generated 513 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:01.694831 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2614b0b0-7f79-41b1-b759-c07b7d368104 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:01.695260 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2614b0b0-7f79-41b1-b759-c07b7d368104 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c4cc6162-ade9-4f10-9468-fdd1ed52b877] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:01.701815 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2614b0b0-7f79-41b1-b759-c07b7d368104 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:01.702256 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2614b0b0-7f79-41b1-b759-c07b7d368104 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:01.703074 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2614b0b0-7f79-41b1-b759-c07b7d368104 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:01.703520 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2614b0b0-7f79-41b1-b759-c07b7d368104 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:01.739648 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f4550795-f1f0-4097-816e-ee8ae94cd08b tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.288177 Jul 18 02:16:01.740518 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 895/1765] 10.222.0.57 () {60 vars in 1179 bytes} [Mon Jul 18 02:16:01 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:01.746002 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ec1e0f8c-76c6-4d38-ae86-d46c02f4576e tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a86091f0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:01.906938 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2614b0b0-7f79-41b1-b759-c07b7d368104 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:01.922442 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2614b0b0-7f79-41b1-b759-c07b7d368104 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877" status: 200 len: 1317 microversion: 2.1 time: 0.233140 Jul 18 02:16:01.923501 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 871/1766] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:01 2022] GET /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877 => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:01.929263 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-290397c7-4ed3-4a7d-95d8-292e0af969a8 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:01.929924 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-290397c7-4ed3-4a7d-95d8-292e0af969a8 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: e86cd628-160d-4516-ad58-899768acecd9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:01.936554 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-290397c7-4ed3-4a7d-95d8-292e0af969a8 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:01.937005 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-290397c7-4ed3-4a7d-95d8-292e0af969a8 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:01.937836 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-290397c7-4ed3-4a7d-95d8-292e0af969a8 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:01.938274 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-290397c7-4ed3-4a7d-95d8-292e0af969a8 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:02.119568 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-290397c7-4ed3-4a7d-95d8-292e0af969a8 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe79fa13328b4e40922d0e3e4551a8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6b8514bba84ba8a09c64abbb2d1a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:02.142302 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-290397c7-4ed3-4a7d-95d8-292e0af969a8 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "GET /compute/v2.1/servers/e86cd628-160d-4516-ad58-899768acecd9" status: 200 len: 1318 microversion: 2.1 time: 0.214689 Jul 18 02:16:02.145296 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 872/1767] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:01 2022] GET /compute/v2.1/servers/e86cd628-160d-4516-ad58-899768acecd9 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:02.160497 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b371c672-7d52-44b8-b774-570a319701d2 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:02.168497 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b371c672-7d52-44b8-b774-570a319701d2 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:02.171492 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b371c672-7d52-44b8-b774-570a319701d2 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '58dcb69855544ff3b51109aa5d41f637'} {{(pid=119543) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:16:02.188999 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b371c672-7d52-44b8-b774-570a319701d2 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:02.189893 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b371c672-7d52-44b8-b774-570a319701d2 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:02.192198 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b371c672-7d52-44b8-b774-570a319701d2 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:02.193220 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b371c672-7d52-44b8-b774-570a319701d2 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:02.339544 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.multi_cell_list [None req-b371c672-7d52-44b8-b774-570a319701d2 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119543) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:16:02.461086 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b371c672-7d52-44b8-b774-570a319701d2 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:02.470593 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b371c672-7d52-44b8-b774-570a319701d2 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:02.471057 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b371c672-7d52-44b8-b774-570a319701d2 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:02.619286 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ec1e0f8c-76c6-4d38-ae86-d46c02f4576e tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "DELETE /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372" status: 204 len: 0 microversion: 2.1 time: 0.877093 Jul 18 02:16:02.620197 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 896/1768] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:01 2022] DELETE /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372 => generated 0 bytes in 879 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:02.625220 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d3e3f39d-ec4f-4a53-b1fa-a0c5c4dd11a5 tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Calling method '.version_select at 0x7ff4a8550670>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:02.631524 n-d-465891-3 devstack@n-api.service[119544]: WARNING oslo_db.sqlalchemy.utils [None req-d3e3f39d-ec4f-4a53-b1fa-a0c5c4dd11a5 tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 18 02:16:02.648735 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d3e3f39d-ec4f-4a53-b1fa-a0c5c4dd11a5 tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] 10.222.0.57 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.027362 Jul 18 02:16:02.650349 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 897/1769] 10.222.0.57 () {60 vars in 1176 bytes} [Mon Jul 18 02:16:02 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:02.660271 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e85fe452-6d5b-4da0-a3e4-160dadb843e5 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1402531802"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:02.661783 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e85fe452-6d5b-4da0-a3e4-160dadb843e5 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:02.670600 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e85fe452-6d5b-4da0-a3e4-160dadb843e5 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:02.671231 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e85fe452-6d5b-4da0-a3e4-160dadb843e5 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:02.672361 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e85fe452-6d5b-4da0-a3e4-160dadb843e5 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:02.673104 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e85fe452-6d5b-4da0-a3e4-160dadb843e5 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:02.755467 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b371c672-7d52-44b8-b774-570a319701d2 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4517 microversion: 2.1 time: 0.606965 Jul 18 02:16:02.764865 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 873/1770] 10.222.0.57 () {58 vars in 1172 bytes} [Mon Jul 18 02:16:02 2022] GET /compute/v2.1/servers/detail?status=active => generated 4517 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:02.777733 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-47d54f0e-0fcf-4206-95f5-f8f5c596a422 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:02.778444 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-47d54f0e-0fcf-4206-95f5-f8f5c596a422 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:02.791587 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-47d54f0e-0fcf-4206-95f5-f8f5c596a422 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:02.792245 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-47d54f0e-0fcf-4206-95f5-f8f5c596a422 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:02.792818 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-47d54f0e-0fcf-4206-95f5-f8f5c596a422 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:02.793273 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-47d54f0e-0fcf-4206-95f5-f8f5c596a422 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:03.007989 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.network.security_group_api [None req-e85fe452-6d5b-4da0-a3e4-160dadb843e5 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Adding security group 5acaaa95-2c29-4e14-b127-5dd6e2bc6ac7 to port 4d6c976a-bead-4367-8b9a-e4a14283ef03 Jul 18 02:16:03.221099 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-47d54f0e-0fcf-4206-95f5-f8f5c596a422 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:03.243799 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-47d54f0e-0fcf-4206-95f5-f8f5c596a422 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:03.248135 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-47d54f0e-0fcf-4206-95f5-f8f5c596a422 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:03.255593 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-47d54f0e-0fcf-4206-95f5-f8f5c596a422 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 200 len: 1411 microversion: 2.25 time: 0.487645 Jul 18 02:16:03.256228 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 874/1771] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:16:02 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 1411 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:16:03.282381 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-14a54ef9-bb25-4385-b706-cd1de3057940 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:03.284022 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-14a54ef9-bb25-4385-b706-cd1de3057940 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:03.295992 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14a54ef9-bb25-4385-b706-cd1de3057940 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:03.296596 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14a54ef9-bb25-4385-b706-cd1de3057940 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:03.297737 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14a54ef9-bb25-4385-b706-cd1de3057940 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:03.298380 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14a54ef9-bb25-4385-b706-cd1de3057940 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:03.638241 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-14a54ef9-bb25-4385-b706-cd1de3057940 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:03.652341 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-14a54ef9-bb25-4385-b706-cd1de3057940 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 200 len: 1716 microversion: 2.1 time: 0.393826 Jul 18 02:16:03.652973 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 875/1772] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:03 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 1716 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:03.658206 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9e781d1c-a066-44f4-8430-93ad2f36c7c2 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a8eedd30>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:03.684219 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-9e781d1c-a066-44f4-8430-93ad2f36c7c2 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] HTTP exception thrown: Image not found. Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9e781d1c-a066-44f4-8430-93ad2f36c7c2 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Request method failure captured: Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372 HTTP/1.1 Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MITEAlZp93OeZ-U1RRSSge7lqtV_XWE_Klx2sq7ovrJ1CzwP725dD8UvFFnPxzfUNIsef0cib4XEV5e9bmgqy_KlD1pSM86WAkf4LTENkSbTVK8KXqIjFPuEKt5SNb2q-ZLJkwKk9oPxZ7T0P2uTBaPEXox4MI7anaVqOt26zV38w4 Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: f0c8e07f8a9b4a398614fcf02c561416 Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ImagesOneServerTestJSON-1709241645 Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f0c8e07f8a9b4a398614fcf02c561416"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f0c8e07f8a9b4a398614fcf02c561416"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f0c8e07f8a9b4a398614fcf02c561416"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f0c8e07f8a9b4a398614fcf02c561416"}]}] Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ImagesOneServerTestJSON-1709241645 Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: f0c8e07f8a9b4a398614fcf02c561416 Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1709241645 Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ImagesOneServerTestJSON-1709241645-project Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 9ca28fb70d1545b087bce52f2975a1ea Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ImagesOneServerTestJSON-1709241645-project Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: exception: Image not found. Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '3eb238d2-163e-4ee5-b17f-91bf0a57d372'} Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3eb238d2-163e-4ee5-b17f-91bf0a57d372 Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 18 02:16:03.686457 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3eb238d2-163e-4ee5-b17f-91bf0a57d372 could not be found. Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9e781d1c-a066-44f4-8430-93ad2f36c7c2 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Returning 404 to user: Image not found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9e781d1c-a066-44f4-8430-93ad2f36c7c2 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372" status: 404 len: 62 microversion: 2.1 time: 0.033784 Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 876/1773] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:16:03 2022] GET /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372 => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:16:03.697055 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-671fd735-95da-4bfb-9112-db56bf758ef5 tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Calling method '.version_select at 0x7ff4a95a2040>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:03.745390 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-671fd735-95da-4bfb-9112-db56bf758ef5 tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2075640800" status: 204 len: 0 microversion: 2.2 time: 0.054943 Jul 18 02:16:03.746885 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 877/1774] 10.222.0.57 () {60 vars in 1260 bytes} [Mon Jul 18 02:16:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2075640800 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:03.759239 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b77a2904-d5c6-4783-aa31-e93712a1f18f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:03.774398 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b77a2904-d5c6-4783-aa31-e93712a1f18f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:03.774719 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.compute.servers [None req-b77a2904-d5c6-4783-aa31-e93712a1f18f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Removing options 'limit' from query {{(pid=119543) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 18 02:16:03.776101 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b77a2904-d5c6-4783-aa31-e93712a1f18f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Searching by: {'deleted': False, 'project_id': '58dcb69855544ff3b51109aa5d41f637'} {{(pid=119543) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:16:03.787347 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b77a2904-d5c6-4783-aa31-e93712a1f18f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:03.788628 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b77a2904-d5c6-4783-aa31-e93712a1f18f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:03.789813 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b77a2904-d5c6-4783-aa31-e93712a1f18f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:03.790918 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b77a2904-d5c6-4783-aa31-e93712a1f18f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:03.887434 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b77a2904-d5c6-4783-aa31-e93712a1f18f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:03.895997 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e85fe452-6d5b-4da0-a3e4-160dadb843e5 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] 10.222.0.57 "POST /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee/action" status: 202 len: 0 microversion: 2.1 time: 1.243013 Jul 18 02:16:03.897942 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 898/1775] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:16:02 2022] POST /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee/action => generated 0 bytes in 1247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:16:03.912766 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a2bd04fe-dbc0-4697-a18f-f640d0dcef7b tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:03.914074 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a2bd04fe-dbc0-4697-a18f-f640d0dcef7b tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c4cc6162-ade9-4f10-9468-fdd1ed52b877] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:03.915142 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b77a2904-d5c6-4783-aa31-e93712a1f18f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:03.916080 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b77a2904-d5c6-4783-aa31-e93712a1f18f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:03.946493 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a2bd04fe-dbc0-4697-a18f-f640d0dcef7b tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:03.948890 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a2bd04fe-dbc0-4697-a18f-f640d0dcef7b tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:03.950073 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a2bd04fe-dbc0-4697-a18f-f640d0dcef7b tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:03.955427 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a2bd04fe-dbc0-4697-a18f-f640d0dcef7b tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:04.176723 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b77a2904-d5c6-4783-aa31-e93712a1f18f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.427687 Jul 18 02:16:04.177897 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 878/1776] 10.222.0.57 () {58 vars in 1160 bytes} [Mon Jul 18 02:16:03 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:04.183157 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4571b4b1-1126-4bf4-9d60-4b862055813f tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:04.186807 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4571b4b1-1126-4bf4-9d60-4b862055813f tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: e86cd628-160d-4516-ad58-899768acecd9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:04.202465 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4571b4b1-1126-4bf4-9d60-4b862055813f tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:04.203295 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4571b4b1-1126-4bf4-9d60-4b862055813f tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:04.204753 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4571b4b1-1126-4bf4-9d60-4b862055813f tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:04.206031 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4571b4b1-1126-4bf4-9d60-4b862055813f tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:04.265973 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a2bd04fe-dbc0-4697-a18f-f640d0dcef7b tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:04.282125 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a2bd04fe-dbc0-4697-a18f-f640d0dcef7b tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877" status: 200 len: 1317 microversion: 2.1 time: 0.381838 Jul 18 02:16:04.283930 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 899/1777] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:03 2022] GET /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877 => generated 1317 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:04.307202 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-0c6f325e-8340-485c-a3b3-034445f56b15 req-e49884b2-3d9d-42f9-a70c-3fb437b23dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "174a0067-ee9a-493e-a1d9-099fdf4bbaec", "tag": "6947632d-5fe6-4f71-b7ce-376a2c05af5b"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:04.317226 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-0c6f325e-8340-485c-a3b3-034445f56b15 req-e49884b2-3d9d-42f9-a70c-3fb437b23dd7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:04.317669 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-0c6f325e-8340-485c-a3b3-034445f56b15 req-e49884b2-3d9d-42f9-a70c-3fb437b23dd7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:04.330276 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-0c6f325e-8340-485c-a3b3-034445f56b15 req-e49884b2-3d9d-42f9-a70c-3fb437b23dd7 service nova] Creating event network-changed:6947632d-5fe6-4f71-b7ce-376a2c05af5b for instance 174a0067-ee9a-493e-a1d9-099fdf4bbaec on n-h2-465891-3 Jul 18 02:16:04.336665 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-0c6f325e-8340-485c-a3b3-034445f56b15 req-e49884b2-3d9d-42f9-a70c-3fb437b23dd7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050308 Jul 18 02:16:04.337285 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 900/1778] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:04.343279 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-dea14d17-e14c-4ffa-9f2f-03c7e506ef83 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-83545225"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:04.345017 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-dea14d17-e14c-4ffa-9f2f-03c7e506ef83 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] [instance: 32361df9-4e50-409c-9cc7-6f70ba6ce26e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:04.354827 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dea14d17-e14c-4ffa-9f2f-03c7e506ef83 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:04.355162 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dea14d17-e14c-4ffa-9f2f-03c7e506ef83 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:04.356229 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dea14d17-e14c-4ffa-9f2f-03c7e506ef83 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:04.356887 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dea14d17-e14c-4ffa-9f2f-03c7e506ef83 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:04.475503 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4571b4b1-1126-4bf4-9d60-4b862055813f tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe79fa13328b4e40922d0e3e4551a8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6b8514bba84ba8a09c64abbb2d1a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:04.488440 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4571b4b1-1126-4bf4-9d60-4b862055813f tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "GET /compute/v2.1/servers/e86cd628-160d-4516-ad58-899768acecd9" status: 200 len: 1318 microversion: 2.1 time: 0.308382 Jul 18 02:16:04.489635 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 879/1779] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:04 2022] GET /compute/v2.1/servers/e86cd628-160d-4516-ad58-899768acecd9 => generated 1318 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:04.504382 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9ea827d8-58d3-4243-9903-8cafe55fb6f1 tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Action: 'create', calling method: .version_select at 0x7ff4a95a2040>, body: {"keypair": {"name": "tempest-keypair-762121616", "type": "x509"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:04.524460 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-9ea827d8-58d3-4243-9903-8cafe55fb6f1 tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Getting quotas for project 82f86eb4ab6d4a448b2ec12ce759ee29. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:16:04.527013 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:04.531200 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-9ea827d8-58d3-4243-9903-8cafe55fb6f1 tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Getting quotas for user bc3164ee635f41e3b71fa6f8826cc826 and project 82f86eb4ab6d4a448b2ec12ce759ee29. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:16:04.576110 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.processutils [None req-9ea827d8-58d3-4243-9903-8cafe55fb6f1 tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpvukirrs7/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpvukirrs7/temp.key -subj /CN=bc3164ee635f41e3b71fa6f8826cc826 -extensions v3_req_client {{(pid=119543) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 18 02:16:04.746853 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-dea14d17-e14c-4ffa-9f2f-03c7e506ef83 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "POST /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e/action" status: 202 len: 0 microversion: 2.1 time: 0.407746 Jul 18 02:16:04.750037 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 901/1780] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:16:04 2022] POST /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e/action => generated 0 bytes in 410 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 18 02:16:04.757685 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-88b155f9-c9ae-4b40-b416-1df6bde94277 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1402531802"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:04.758450 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-88b155f9-c9ae-4b40-b416-1df6bde94277 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:04.766132 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-88b155f9-c9ae-4b40-b416-1df6bde94277 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:04.766629 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-88b155f9-c9ae-4b40-b416-1df6bde94277 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:04.767427 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-88b155f9-c9ae-4b40-b416-1df6bde94277 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:04.767861 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-88b155f9-c9ae-4b40-b416-1df6bde94277 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:05.028102 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.processutils [None req-9ea827d8-58d3-4243-9903-8cafe55fb6f1 tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpvukirrs7/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpvukirrs7/temp.key -subj /CN=bc3164ee635f41e3b71fa6f8826cc826 -extensions v3_req_client" returned: 0 in 0.451s {{(pid=119543) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 18 02:16:05.030514 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.processutils [None req-9ea827d8-58d3-4243-9903-8cafe55fb6f1 tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpvukirrs7/temp.key -password pass: {{(pid=119543) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 18 02:16:05.061901 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.processutils [None req-9ea827d8-58d3-4243-9903-8cafe55fb6f1 tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpvukirrs7/temp.key -password pass:" returned: 0 in 0.031s {{(pid=119543) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 18 02:16:05.079535 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.network.security_group_api [None req-88b155f9-c9ae-4b40-b416-1df6bde94277 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Removing security group 5acaaa95-2c29-4e14-b127-5dd6e2bc6ac7 from port 4d6c976a-bead-4367-8b9a-e4a14283ef03 Jul 18 02:16:05.112246 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-9ea827d8-58d3-4243-9903-8cafe55fb6f1 tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Getting quotas for project 82f86eb4ab6d4a448b2ec12ce759ee29. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:16:05.120809 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-9ea827d8-58d3-4243-9903-8cafe55fb6f1 tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Getting quotas for user bc3164ee635f41e3b71fa6f8826cc826 and project 82f86eb4ab6d4a448b2ec12ce759ee29. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:16:05.138554 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9ea827d8-58d3-4243-9903-8cafe55fb6f1 tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.647511 Jul 18 02:16:05.139746 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 880/1781] 10.222.0.57 () {62 vars in 1197 bytes} [Mon Jul 18 02:16:04 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 649 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:05.146667 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-f837391d-b1bf-4f09-8553-19a96dccb05b req-98e105cb-91b4-43bc-b139-9a2bba5a19c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ddcf97f-5c13-4ed6-ac5b-17368a126dee", "tag": "4d6c976a-bead-4367-8b9a-e4a14283ef03"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:05.156646 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-f837391d-b1bf-4f09-8553-19a96dccb05b req-98e105cb-91b4-43bc-b139-9a2bba5a19c1 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:05.157104 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-f837391d-b1bf-4f09-8553-19a96dccb05b req-98e105cb-91b4-43bc-b139-9a2bba5a19c1 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:05.180484 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-f837391d-b1bf-4f09-8553-19a96dccb05b req-98e105cb-91b4-43bc-b139-9a2bba5a19c1 service nova] Creating event network-changed:4d6c976a-bead-4367-8b9a-e4a14283ef03 for instance 7ddcf97f-5c13-4ed6-ac5b-17368a126dee on n-h2-465891-3 Jul 18 02:16:05.187160 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-f837391d-b1bf-4f09-8553-19a96dccb05b req-98e105cb-91b4-43bc-b139-9a2bba5a19c1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045805 Jul 18 02:16:05.188406 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 881/1782] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:05.196615 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e276707e-08a6-40dd-a0ad-b9c07ac9a9bb tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:05.200570 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e276707e-08a6-40dd-a0ad-b9c07ac9a9bb tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:05.202292 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e276707e-08a6-40dd-a0ad-b9c07ac9a9bb tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '58dcb69855544ff3b51109aa5d41f637'} {{(pid=119543) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:16:05.213907 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e276707e-08a6-40dd-a0ad-b9c07ac9a9bb tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:05.215040 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e276707e-08a6-40dd-a0ad-b9c07ac9a9bb tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:05.216335 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e276707e-08a6-40dd-a0ad-b9c07ac9a9bb tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:05.216986 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e276707e-08a6-40dd-a0ad-b9c07ac9a9bb tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:05.325942 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.multi_cell_list [None req-e276707e-08a6-40dd-a0ad-b9c07ac9a9bb tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119543) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:16:05.399520 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e276707e-08a6-40dd-a0ad-b9c07ac9a9bb tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.209297 Jul 18 02:16:05.400251 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 882/1783] 10.222.0.57 () {58 vars in 1151 bytes} [Mon Jul 18 02:16:05 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:05.405133 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-41831d57-fddd-4d58-a19c-d863c18c0f1c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:05.406075 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-41831d57-fddd-4d58-a19c-d863c18c0f1c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:05.413588 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41831d57-fddd-4d58-a19c-d863c18c0f1c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:05.414215 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41831d57-fddd-4d58-a19c-d863c18c0f1c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:05.415154 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41831d57-fddd-4d58-a19c-d863c18c0f1c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:05.415687 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41831d57-fddd-4d58-a19c-d863c18c0f1c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:05.649381 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-88b155f9-c9ae-4b40-b416-1df6bde94277 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] 10.222.0.57 "POST /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee/action" status: 202 len: 0 microversion: 2.1 time: 0.900015 Jul 18 02:16:05.650371 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 902/1784] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:16:04 2022] POST /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee/action => generated 0 bytes in 902 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:16:05.659675 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-4e6e2a28-5e4b-48b1-8d19-559974ab1254 req-68960b16-473b-404d-b0d5-4bd81c551739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32361df9-4e50-409c-9cc7-6f70ba6ce26e", "name": "network-vif-unplugged", "status": "completed", "tag": "7c604958-4d5c-4ace-8013-9827944aa0c6"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:05.680987 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-4e6e2a28-5e4b-48b1-8d19-559974ab1254 req-68960b16-473b-404d-b0d5-4bd81c551739 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:05.681821 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-4e6e2a28-5e4b-48b1-8d19-559974ab1254 req-68960b16-473b-404d-b0d5-4bd81c551739 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:05.702688 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-41831d57-fddd-4d58-a19c-d863c18c0f1c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:05.705051 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-4e6e2a28-5e4b-48b1-8d19-559974ab1254 req-68960b16-473b-404d-b0d5-4bd81c551739 service nova] Creating event network-vif-unplugged:7c604958-4d5c-4ace-8013-9827944aa0c6 for instance 32361df9-4e50-409c-9cc7-6f70ba6ce26e on n-h1-465891-3 Jul 18 02:16:05.714810 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-4e6e2a28-5e4b-48b1-8d19-559974ab1254 req-68960b16-473b-404d-b0d5-4bd81c551739 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062381 Jul 18 02:16:05.716030 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-41831d57-fddd-4d58-a19c-d863c18c0f1c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:05.716958 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 903/1785] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:05.718548 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-41831d57-fddd-4d58-a19c-d863c18c0f1c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:05.720181 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-41831d57-fddd-4d58-a19c-d863c18c0f1c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 200 len: 1411 microversion: 2.25 time: 0.318574 Jul 18 02:16:05.731429 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 883/1786] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:16:05 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 1411 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:16:05.742430 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c7c0b9f7-1ab7-473f-b92e-a6f8a5b00da3 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a8c5d3a0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:05.743625 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-15bf5083-c26f-4355-83d8-31771975a659 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:05.744612 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-15bf5083-c26f-4355-83d8-31771975a659 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:05.776643 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-15bf5083-c26f-4355-83d8-31771975a659 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:05.777462 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-15bf5083-c26f-4355-83d8-31771975a659 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:05.778920 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-15bf5083-c26f-4355-83d8-31771975a659 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:05.779733 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-15bf5083-c26f-4355-83d8-31771975a659 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:05.816852 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c7c0b9f7-1ab7-473f-b92e-a6f8a5b00da3 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf" status: 200 len: 1427 microversion: 2.1 time: 0.081611 Jul 18 02:16:05.823655 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 884/1787] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:16:05 2022] GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf => generated 1427 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:05.830855 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-53d9d0aa-fb62-4336-a309-b21c161e14c8 tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Calling method '.version_select at 0x7ff4a8c5d280>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:05.841660 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-53d9d0aa-fb62-4336-a309-b21c161e14c8 tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] 10.222.0.57 "GET /compute/v2.1/os-keypairs/tempest-keypair-762121616" status: 200 len: 1533 microversion: 2.2 time: 0.016300 Jul 18 02:16:05.842933 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 885/1788] 10.222.0.57 () {60 vars in 1254 bytes} [Mon Jul 18 02:16:05 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-762121616 => generated 1533 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:05.848504 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e5631d4c-9ded-4ad9-b650-88d317df96c4 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:05.849553 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e5631d4c-9ded-4ad9-b650-88d317df96c4 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c4cc6162-ade9-4f10-9468-fdd1ed52b877] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:05.858018 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e5631d4c-9ded-4ad9-b650-88d317df96c4 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:05.858884 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e5631d4c-9ded-4ad9-b650-88d317df96c4 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:05.859958 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e5631d4c-9ded-4ad9-b650-88d317df96c4 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:05.860641 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e5631d4c-9ded-4ad9-b650-88d317df96c4 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:06.089507 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-15bf5083-c26f-4355-83d8-31771975a659 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:06.101364 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e5631d4c-9ded-4ad9-b650-88d317df96c4 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:06.103761 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-15bf5083-c26f-4355-83d8-31771975a659 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 200 len: 1716 microversion: 2.1 time: 0.367707 Jul 18 02:16:06.104835 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 904/1789] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:05 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 1716 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:06.112243 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-360b0871-3452-4d2e-8c08-13ad4b68cd03 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:06.115136 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e5631d4c-9ded-4ad9-b650-88d317df96c4 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877" status: 200 len: 1467 microversion: 2.1 time: 0.270434 Jul 18 02:16:06.116293 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 886/1790] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:05 2022] GET /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877 => generated 1467 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:06.118485 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-360b0871-3452-4d2e-8c08-13ad4b68cd03 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:06.118983 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.compute.servers [None req-360b0871-3452-4d2e-8c08-13ad4b68cd03 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Removing options 'limit' from query {{(pid=119544) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 18 02:16:06.120025 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-360b0871-3452-4d2e-8c08-13ad4b68cd03 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Searching by: {'deleted': False, 'project_id': '58dcb69855544ff3b51109aa5d41f637'} {{(pid=119544) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:16:06.126968 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2f1691d2-c7a8-40a5-b539-a96171089eff tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:06.128765 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2f1691d2-c7a8-40a5-b539-a96171089eff tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: e86cd628-160d-4516-ad58-899768acecd9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:06.131715 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-360b0871-3452-4d2e-8c08-13ad4b68cd03 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:06.132523 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-360b0871-3452-4d2e-8c08-13ad4b68cd03 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:06.134026 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-360b0871-3452-4d2e-8c08-13ad4b68cd03 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:06.134821 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-360b0871-3452-4d2e-8c08-13ad4b68cd03 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:06.135811 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2f1691d2-c7a8-40a5-b539-a96171089eff tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:06.136267 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2f1691d2-c7a8-40a5-b539-a96171089eff tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:06.137064 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2f1691d2-c7a8-40a5-b539-a96171089eff tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:06.138071 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2f1691d2-c7a8-40a5-b539-a96171089eff tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:06.278452 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.multi_cell_list [None req-360b0871-3452-4d2e-8c08-13ad4b68cd03 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119544) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:16:06.324271 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2f1691d2-c7a8-40a5-b539-a96171089eff tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe79fa13328b4e40922d0e3e4551a8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6b8514bba84ba8a09c64abbb2d1a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:06.341328 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2f1691d2-c7a8-40a5-b539-a96171089eff tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "GET /compute/v2.1/servers/e86cd628-160d-4516-ad58-899768acecd9" status: 200 len: 1318 microversion: 2.1 time: 0.222280 Jul 18 02:16:06.343610 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-360b0871-3452-4d2e-8c08-13ad4b68cd03 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.237011 Jul 18 02:16:06.344222 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 905/1791] 10.222.0.57 () {58 vars in 1149 bytes} [Mon Jul 18 02:16:06 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:06.358260 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3f71fb42-323a-438e-a2cc-aca06b215700 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Action: 'create', calling method: .version_select at 0x7ff4a88c83a0>, body: {"pool": null} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:06.365984 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 887/1792] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:06 2022] GET /compute/v2.1/servers/e86cd628-160d-4516-ad58-899768acecd9 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:06.374648 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5730fef1-e656-463d-8f76-8dd8be1413d3 tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Calling method '.version_select at 0x7ff4a8c5d9d0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:06.380953 n-d-465891-3 devstack@n-api.service[119543]: WARNING oslo_db.sqlalchemy.utils [None req-5730fef1-e656-463d-8f76-8dd8be1413d3 tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 18 02:16:06.390157 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5730fef1-e656-463d-8f76-8dd8be1413d3 tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] 10.222.0.57 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.021983 Jul 18 02:16:06.391125 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 888/1793] 10.222.0.57 () {60 vars in 1176 bytes} [Mon Jul 18 02:16:06 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:06.398418 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-13ab7a0c-e60c-4c9a-b885-a5aa8bed2ee1 tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:06.399156 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-13ab7a0c-e60c-4c9a-b885-a5aa8bed2ee1 tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] [instance: c4cc6162-ade9-4f10-9468-fdd1ed52b877] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:06.407037 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-13ab7a0c-e60c-4c9a-b885-a5aa8bed2ee1 tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:06.407603 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-13ab7a0c-e60c-4c9a-b885-a5aa8bed2ee1 tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:06.408497 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-13ab7a0c-e60c-4c9a-b885-a5aa8bed2ee1 tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:06.409014 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-13ab7a0c-e60c-4c9a-b885-a5aa8bed2ee1 tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:06.747592 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-13ab7a0c-e60c-4c9a-b885-a5aa8bed2ee1 tempest-ServersOnMultiNodesTest-1110041303 tempest-ServersOnMultiNodesTest-1110041303-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877" status: 200 len: 1618 microversion: 2.1 time: 0.355264 Jul 18 02:16:06.748210 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 889/1794] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:06 2022] GET /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877 => generated 1618 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:06.763349 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-56c2f3bb-4462-49fc-853b-e91123431ce5 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:06.767202 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-56c2f3bb-4462-49fc-853b-e91123431ce5 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:06.767885 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-56c2f3bb-4462-49fc-853b-e91123431ce5 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Searching by: {'deleted': False, 'project_id': '58dcb69855544ff3b51109aa5d41f637'} {{(pid=119543) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:16:06.774037 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56c2f3bb-4462-49fc-853b-e91123431ce5 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:06.774511 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56c2f3bb-4462-49fc-853b-e91123431ce5 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:06.775329 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56c2f3bb-4462-49fc-853b-e91123431ce5 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:06.775768 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56c2f3bb-4462-49fc-853b-e91123431ce5 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:06.808308 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.multi_cell_list [None req-56c2f3bb-4462-49fc-853b-e91123431ce5 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119543) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:16:06.840682 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-56c2f3bb-4462-49fc-853b-e91123431ce5 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.091312 Jul 18 02:16:06.841280 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 890/1795] 10.222.0.57 () {58 vars in 1124 bytes} [Mon Jul 18 02:16:06 2022] GET /compute/v2.1/servers => generated 1010 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:06.846022 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fc5b226d-30d9-4202-bb87-01e00b17d761 tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] Calling method '.version_select at 0x7ff4a8a55f70>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:06.866983 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fc5b226d-30d9-4202-bb87-01e00b17d761 tempest-KeyPairsV22TestJSON-1363163724 tempest-KeyPairsV22TestJSON-1363163724-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-762121616" status: 204 len: 0 microversion: 2.2 time: 0.024560 Jul 18 02:16:06.868162 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 891/1796] 10.222.0.57 () {60 vars in 1257 bytes} [Mon Jul 18 02:16:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-762121616 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:06.877448 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0ab621ac-7c94-40c3-a9ac-fdc8869b13eb tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:06.880759 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0ab621ac-7c94-40c3-a9ac-fdc8869b13eb tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:06.888889 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0ab621ac-7c94-40c3-a9ac-fdc8869b13eb tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:06.889500 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0ab621ac-7c94-40c3-a9ac-fdc8869b13eb tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:06.890757 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0ab621ac-7c94-40c3-a9ac-fdc8869b13eb tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:06.891548 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0ab621ac-7c94-40c3-a9ac-fdc8869b13eb tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:07.334138 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0ab621ac-7c94-40c3-a9ac-fdc8869b13eb tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:07.355018 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0ab621ac-7c94-40c3-a9ac-fdc8869b13eb tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:07.357397 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0ab621ac-7c94-40c3-a9ac-fdc8869b13eb tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:07.358971 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0ab621ac-7c94-40c3-a9ac-fdc8869b13eb tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 200 len: 1411 microversion: 2.25 time: 0.488880 Jul 18 02:16:07.359869 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 892/1797] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:16:06 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 1411 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:16:07.376359 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-942f5cd4-57c0-4cfe-baa9-34d3f6ab6514 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:07.387376 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-942f5cd4-57c0-4cfe-baa9-34d3f6ab6514 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c4cc6162-ade9-4f10-9468-fdd1ed52b877] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:07.395343 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-942f5cd4-57c0-4cfe-baa9-34d3f6ab6514 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:07.395784 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-942f5cd4-57c0-4cfe-baa9-34d3f6ab6514 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:07.396567 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-942f5cd4-57c0-4cfe-baa9-34d3f6ab6514 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:07.396997 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-942f5cd4-57c0-4cfe-baa9-34d3f6ab6514 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:07.400114 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:07.428588 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-942f5cd4-57c0-4cfe-baa9-34d3f6ab6514 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c4cc6162-ade9-4f10-9468-fdd1ed52b877] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:16:07.660256 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-942f5cd4-57c0-4cfe-baa9-34d3f6ab6514 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877" status: 204 len: 0 microversion: 2.1 time: 0.286947 Jul 18 02:16:07.664708 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 893/1798] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:16:07 2022] DELETE /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:07.672230 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2d4ab84e-bd9b-49cd-abdb-dec06c222c75 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a93793a0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:07.733443 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2d4ab84e-bd9b-49cd-abdb-dec06c222c75 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf" status: 200 len: 1427 microversion: 2.1 time: 0.066802 Jul 18 02:16:07.735180 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 894/1799] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:16:07 2022] GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf => generated 1427 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:07.740744 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a6dc00f6-08d7-47d4-ab22-be2d2abc28a8 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:07.745012 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a6dc00f6-08d7-47d4-ab22-be2d2abc28a8 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:07.746343 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a6dc00f6-08d7-47d4-ab22-be2d2abc28a8 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '58dcb69855544ff3b51109aa5d41f637'} {{(pid=119543) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:16:07.765384 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a6dc00f6-08d7-47d4-ab22-be2d2abc28a8 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:07.765872 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a6dc00f6-08d7-47d4-ab22-be2d2abc28a8 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:07.766853 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a6dc00f6-08d7-47d4-ab22-be2d2abc28a8 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:07.767642 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a6dc00f6-08d7-47d4-ab22-be2d2abc28a8 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:07.911748 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.multi_cell_list [None req-a6dc00f6-08d7-47d4-ab22-be2d2abc28a8 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119543) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:16:07.996199 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a6dc00f6-08d7-47d4-ab22-be2d2abc28a8 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.259043 Jul 18 02:16:07.996912 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 895/1800] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:16:07 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:08.010640 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b1dda20a-c1d8-4040-8879-6649c6eed58e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:08.011652 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b1dda20a-c1d8-4040-8879-6649c6eed58e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:08.028940 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b1dda20a-c1d8-4040-8879-6649c6eed58e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:08.029953 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b1dda20a-c1d8-4040-8879-6649c6eed58e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:08.031017 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b1dda20a-c1d8-4040-8879-6649c6eed58e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:08.031675 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b1dda20a-c1d8-4040-8879-6649c6eed58e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:08.334746 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b1dda20a-c1d8-4040-8879-6649c6eed58e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:08.367889 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b1dda20a-c1d8-4040-8879-6649c6eed58e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 200 len: 1716 microversion: 2.1 time: 0.369168 Jul 18 02:16:08.385961 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 896/1801] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:07 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 1716 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:08.397096 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-69cdf82a-e926-4cbc-9321-8bf15987e5ab req-fa47e898-6c78-4b9f-9936-93f04f28eba7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ddcf97f-5c13-4ed6-ac5b-17368a126dee", "tag": "4d6c976a-bead-4367-8b9a-e4a14283ef03"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:08.407544 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-69cdf82a-e926-4cbc-9321-8bf15987e5ab req-fa47e898-6c78-4b9f-9936-93f04f28eba7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:08.408107 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-69cdf82a-e926-4cbc-9321-8bf15987e5ab req-fa47e898-6c78-4b9f-9936-93f04f28eba7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:08.422442 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-69cdf82a-e926-4cbc-9321-8bf15987e5ab req-fa47e898-6c78-4b9f-9936-93f04f28eba7 service nova] Creating event network-changed:4d6c976a-bead-4367-8b9a-e4a14283ef03 for instance 7ddcf97f-5c13-4ed6-ac5b-17368a126dee on n-h2-465891-3 Jul 18 02:16:08.429413 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-69cdf82a-e926-4cbc-9321-8bf15987e5ab req-fa47e898-6c78-4b9f-9936-93f04f28eba7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041405 Jul 18 02:16:08.430576 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 897/1802] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:08.439088 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-66511738-d5bb-4d70-aab3-27ab5dd98aa3 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:08.452684 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-66511738-d5bb-4d70-aab3-27ab5dd98aa3 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: e86cd628-160d-4516-ad58-899768acecd9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:08.462717 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-66511738-d5bb-4d70-aab3-27ab5dd98aa3 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:08.463288 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-66511738-d5bb-4d70-aab3-27ab5dd98aa3 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:08.465424 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-66511738-d5bb-4d70-aab3-27ab5dd98aa3 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:08.466596 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-66511738-d5bb-4d70-aab3-27ab5dd98aa3 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:08.838661 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-66511738-d5bb-4d70-aab3-27ab5dd98aa3 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe79fa13328b4e40922d0e3e4551a8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6b8514bba84ba8a09c64abbb2d1a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:08.851105 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-66511738-d5bb-4d70-aab3-27ab5dd98aa3 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "GET /compute/v2.1/servers/e86cd628-160d-4516-ad58-899768acecd9" status: 200 len: 1318 microversion: 2.1 time: 0.418264 Jul 18 02:16:08.860807 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 898/1803] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:08 2022] GET /compute/v2.1/servers/e86cd628-160d-4516-ad58-899768acecd9 => generated 1318 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:08.867649 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c68a81ac-bc2e-4afe-8a67-6a9e86f71082 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:08.868094 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c68a81ac-bc2e-4afe-8a67-6a9e86f71082 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c4cc6162-ade9-4f10-9468-fdd1ed52b877] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:08.875182 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c68a81ac-bc2e-4afe-8a67-6a9e86f71082 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:08.875764 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c68a81ac-bc2e-4afe-8a67-6a9e86f71082 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:08.876582 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c68a81ac-bc2e-4afe-8a67-6a9e86f71082 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:08.877028 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c68a81ac-bc2e-4afe-8a67-6a9e86f71082 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:09.490639 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=9 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:09.852799 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c68a81ac-bc2e-4afe-8a67-6a9e86f71082 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:09.866316 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c68a81ac-bc2e-4afe-8a67-6a9e86f71082 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877" status: 200 len: 1473 microversion: 2.1 time: 1.004267 Jul 18 02:16:09.867297 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 899/1804] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:08 2022] GET /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877 => generated 1473 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:09.884242 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-7134ffb8-5e51-4bdb-ac54-163c42885ea3 req-e970acfd-67c6-4071-b762-b8141822b07b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e86cd628-160d-4516-ad58-899768acecd9", "name": "network-vif-plugged", "status": "completed", "tag": "68490722-4f41-4a28-aca9-a8f598e9d8dd"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:09.902189 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-7134ffb8-5e51-4bdb-ac54-163c42885ea3 req-e970acfd-67c6-4071-b762-b8141822b07b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:09.906171 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-7134ffb8-5e51-4bdb-ac54-163c42885ea3 req-e970acfd-67c6-4071-b762-b8141822b07b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:09.921585 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3f71fb42-323a-438e-a2cc-aca06b215700 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] 10.222.0.57 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.570018 Jul 18 02:16:09.922524 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 906/1805] 10.222.0.57 () {60 vars in 1169 bytes} [Mon Jul 18 02:16:06 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:09.934589 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-905f289f-253f-414b-bef0-c1c3f4bed86d tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:09.939766 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-905f289f-253f-414b-bef0-c1c3f4bed86d tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:09.941034 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.compute.servers [None req-905f289f-253f-414b-bef0-c1c3f4bed86d tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Removing options 'limit' from query {{(pid=119544) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 18 02:16:09.942817 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-905f289f-253f-414b-bef0-c1c3f4bed86d tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Searching by: {'deleted': False, 'project_id': '58dcb69855544ff3b51109aa5d41f637'} {{(pid=119544) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:16:09.949986 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-905f289f-253f-414b-bef0-c1c3f4bed86d tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:09.952142 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-905f289f-253f-414b-bef0-c1c3f4bed86d tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:09.953249 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-7134ffb8-5e51-4bdb-ac54-163c42885ea3 req-e970acfd-67c6-4071-b762-b8141822b07b service nova] Creating event network-vif-plugged:68490722-4f41-4a28-aca9-a8f598e9d8dd for instance e86cd628-160d-4516-ad58-899768acecd9 on n-h1-465891-3 Jul 18 02:16:09.954175 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-905f289f-253f-414b-bef0-c1c3f4bed86d tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:09.955700 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-905f289f-253f-414b-bef0-c1c3f4bed86d tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:09.981440 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-7134ffb8-5e51-4bdb-ac54-163c42885ea3 req-e970acfd-67c6-4071-b762-b8141822b07b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112338 Jul 18 02:16:09.991264 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 900/1806] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:10.001088 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-3e888804-8333-4941-9166-d786575475ec req-0c93dd4d-beea-4712-920b-cad53cae7867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19592434-cafa-4e79-a790-0674ab77672f", "name": "network-vif-unplugged", "status": "completed", "tag": "4c9f9136-52be-4062-9d09-7fd94b7a5870"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:10.007983 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-905f289f-253f-414b-bef0-c1c3f4bed86d tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.083701 Jul 18 02:16:10.013895 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 907/1807] 10.222.0.57 () {58 vars in 1139 bytes} [Mon Jul 18 02:16:09 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:10.023374 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-36552260-863b-4ec4-8a54-51493256d650 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:10.028235 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-3e888804-8333-4941-9166-d786575475ec req-0c93dd4d-beea-4712-920b-cad53cae7867 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:10.029432 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-3e888804-8333-4941-9166-d786575475ec req-0c93dd4d-beea-4712-920b-cad53cae7867 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:10.037415 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-36552260-863b-4ec4-8a54-51493256d650 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:10.064481 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-36552260-863b-4ec4-8a54-51493256d650 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:10.065842 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-36552260-863b-4ec4-8a54-51493256d650 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:10.067317 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-36552260-863b-4ec4-8a54-51493256d650 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:10.068097 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-36552260-863b-4ec4-8a54-51493256d650 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:10.076915 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-3e888804-8333-4941-9166-d786575475ec req-0c93dd4d-beea-4712-920b-cad53cae7867 service nova] Creating event network-vif-unplugged:4c9f9136-52be-4062-9d09-7fd94b7a5870 for instance 19592434-cafa-4e79-a790-0674ab77672f on n-h1-465891-3 Jul 18 02:16:10.104667 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-3e888804-8333-4941-9166-d786575475ec req-0c93dd4d-beea-4712-920b-cad53cae7867 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110603 Jul 18 02:16:10.105747 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 901/1808] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:10.124138 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ea1c6797-c5e2-45a2-a17a-a4b4f9db7df0 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a8964550>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:10.148807 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:10.246787 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ea1c6797-c5e2-45a2-a17a-a4b4f9db7df0 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf" status: 200 len: 1427 microversion: 2.1 time: 0.138777 Jul 18 02:16:10.247868 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 902/1809] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:16:10 2022] GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf => generated 1427 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:10.272479 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fbf15e4d-4ff3-4154-9cb2-b9d71414187e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:10.275515 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fbf15e4d-4ff3-4154-9cb2-b9d71414187e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:10.296248 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fbf15e4d-4ff3-4154-9cb2-b9d71414187e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:10.297031 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fbf15e4d-4ff3-4154-9cb2-b9d71414187e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:10.307739 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fbf15e4d-4ff3-4154-9cb2-b9d71414187e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:10.308505 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fbf15e4d-4ff3-4154-9cb2-b9d71414187e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:10.437743 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-36552260-863b-4ec4-8a54-51493256d650 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:10.490928 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-36552260-863b-4ec4-8a54-51493256d650 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:10.497845 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-36552260-863b-4ec4-8a54-51493256d650 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:10.507174 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-36552260-863b-4ec4-8a54-51493256d650 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 200 len: 1411 microversion: 2.25 time: 0.488603 Jul 18 02:16:10.535172 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 908/1810] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:16:10 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 1411 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:16:10.557858 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-15cbac04-05bc-4059-822e-222bd3534b22 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:10.568361 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-15cbac04-05bc-4059-822e-222bd3534b22 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: e86cd628-160d-4516-ad58-899768acecd9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:10.600179 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-15cbac04-05bc-4059-822e-222bd3534b22 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:10.604709 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-15cbac04-05bc-4059-822e-222bd3534b22 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:10.608705 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-15cbac04-05bc-4059-822e-222bd3534b22 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:10.611533 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-15cbac04-05bc-4059-822e-222bd3534b22 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:10.668273 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fbf15e4d-4ff3-4154-9cb2-b9d71414187e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:10.690897 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fbf15e4d-4ff3-4154-9cb2-b9d71414187e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 200 len: 1716 microversion: 2.1 time: 0.440612 Jul 18 02:16:10.698025 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 903/1811] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:10 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 1716 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:10.710485 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7259c530-2c85-4951-a511-8f9941e82b44 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.145"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:10.712592 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7259c530-2c85-4951-a511-8f9941e82b44 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:10.734261 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7259c530-2c85-4951-a511-8f9941e82b44 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:10.739024 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7259c530-2c85-4951-a511-8f9941e82b44 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:10.745201 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7259c530-2c85-4951-a511-8f9941e82b44 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:10.746441 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7259c530-2c85-4951-a511-8f9941e82b44 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:10.832122 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7259c530-2c85-4951-a511-8f9941e82b44 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Acquired lock "refresh_cache-7ddcf97f-5c13-4ed6-ac5b-17368a126dee" {{(pid=119543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 02:16:11.067960 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-15cbac04-05bc-4059-822e-222bd3534b22 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe79fa13328b4e40922d0e3e4551a8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6b8514bba84ba8a09c64abbb2d1a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:11.080435 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-15cbac04-05bc-4059-822e-222bd3534b22 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "GET /compute/v2.1/servers/e86cd628-160d-4516-ad58-899768acecd9" status: 200 len: 1318 microversion: 2.1 time: 0.543066 Jul 18 02:16:11.081729 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 909/1812] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:10 2022] GET /compute/v2.1/servers/e86cd628-160d-4516-ad58-899768acecd9 => generated 1318 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:11.102084 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4a8fef62-c8ad-4633-8f68-213dd9791afd tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:11.106193 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4a8fef62-c8ad-4633-8f68-213dd9791afd tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:11.106876 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4a8fef62-c8ad-4633-8f68-213dd9791afd tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-848148827', 'deleted': False, 'project_id': '58dcb69855544ff3b51109aa5d41f637'} {{(pid=119544) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:16:11.129811 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4a8fef62-c8ad-4633-8f68-213dd9791afd tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:11.130570 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4a8fef62-c8ad-4633-8f68-213dd9791afd tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:11.131622 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4a8fef62-c8ad-4633-8f68-213dd9791afd tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:11.132276 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4a8fef62-c8ad-4633-8f68-213dd9791afd tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:11.262920 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.multi_cell_list [None req-4a8fef62-c8ad-4633-8f68-213dd9791afd tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119544) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:16:11.435250 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4a8fef62-c8ad-4633-8f68-213dd9791afd tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-848148827" status: 200 len: 345 microversion: 2.1 time: 0.340638 Jul 18 02:16:11.446491 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 910/1813] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Jul 18 02:16:11 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-848148827 => generated 345 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:11.446491 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-11bae557-225e-4d10-a08a-37852797a4e0 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:11.446491 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-11bae557-225e-4d10-a08a-37852797a4e0 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c4cc6162-ade9-4f10-9468-fdd1ed52b877] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:11.455265 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-11bae557-225e-4d10-a08a-37852797a4e0 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:11.457044 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-11bae557-225e-4d10-a08a-37852797a4e0 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:11.458982 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-11bae557-225e-4d10-a08a-37852797a4e0 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:11.460049 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-11bae557-225e-4d10-a08a-37852797a4e0 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:11.575808 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-11bae557-225e-4d10-a08a-37852797a4e0 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:11.588153 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-11bae557-225e-4d10-a08a-37852797a4e0 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877" status: 200 len: 1302 microversion: 2.1 time: 0.150509 Jul 18 02:16:11.605741 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 911/1814] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:11 2022] GET /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877 => generated 1302 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:11.605741 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f320814a-271e-42fc-a065-2942f3601c1a tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a8591820>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:11.663009 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f320814a-271e-42fc-a065-2942f3601c1a tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf" status: 200 len: 1427 microversion: 2.1 time: 0.071283 Jul 18 02:16:11.672674 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 912/1815] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:16:11 2022] GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf => generated 1427 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:11.672674 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8724f933-84e7-447a-8a82-3733d0a55928 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:11.678132 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8724f933-84e7-447a-8a82-3733d0a55928 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:11.678470 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8724f933-84e7-447a-8a82-3733d0a55928 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:11.709160 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8724f933-84e7-447a-8a82-3733d0a55928 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 4a494dac-3446-4569-b154-b14f9eb22b3e] Going to try to stop instance {{(pid=119544) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 02:16:11.775991 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8724f933-84e7-447a-8a82-3733d0a55928 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "POST /compute/v2.1/servers/4a494dac-3446-4569-b154-b14f9eb22b3e/action" status: 202 len: 0 microversion: 2.1 time: 0.110247 Jul 18 02:16:11.782393 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 913/1816] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:16:11 2022] POST /compute/v2.1/servers/4a494dac-3446-4569-b154-b14f9eb22b3e/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:16:11.794075 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b4ef856f-be18-4d77-acda-ea78129e7a59 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:11.795569 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b4ef856f-be18-4d77-acda-ea78129e7a59 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:11.809608 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b4ef856f-be18-4d77-acda-ea78129e7a59 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:11.811865 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b4ef856f-be18-4d77-acda-ea78129e7a59 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:11.814016 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b4ef856f-be18-4d77-acda-ea78129e7a59 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:11.815613 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b4ef856f-be18-4d77-acda-ea78129e7a59 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:12.307087 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b4ef856f-be18-4d77-acda-ea78129e7a59 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:12.316958 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b4ef856f-be18-4d77-acda-ea78129e7a59 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:12.318731 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b4ef856f-be18-4d77-acda-ea78129e7a59 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:12.319982 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b4ef856f-be18-4d77-acda-ea78129e7a59 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 200 len: 1411 microversion: 2.25 time: 0.535788 Jul 18 02:16:12.324357 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 914/1817] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:16:11 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 1411 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:16:12.340821 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-691809a6-9786-4d35-8bf9-fb90afd2b12c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:12.344633 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-691809a6-9786-4d35-8bf9-fb90afd2b12c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:12.357912 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-691809a6-9786-4d35-8bf9-fb90afd2b12c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:12.362313 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-691809a6-9786-4d35-8bf9-fb90afd2b12c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:12.365415 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-691809a6-9786-4d35-8bf9-fb90afd2b12c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:12.366242 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-691809a6-9786-4d35-8bf9-fb90afd2b12c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:12.631753 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-691809a6-9786-4d35-8bf9-fb90afd2b12c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:12.649008 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-691809a6-9786-4d35-8bf9-fb90afd2b12c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 200 len: 1716 microversion: 2.1 time: 0.321391 Jul 18 02:16:12.661333 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 915/1818] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:12 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 1716 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:12.667011 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5a5ecb61-8e93-444f-be00-904274410f97 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:12.668034 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5a5ecb61-8e93-444f-be00-904274410f97 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 4a494dac-3446-4569-b154-b14f9eb22b3e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:12.677154 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5a5ecb61-8e93-444f-be00-904274410f97 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:12.678593 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5a5ecb61-8e93-444f-be00-904274410f97 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:12.679631 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5a5ecb61-8e93-444f-be00-904274410f97 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:12.680326 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5a5ecb61-8e93-444f-be00-904274410f97 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:12.969377 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5a5ecb61-8e93-444f-be00-904274410f97 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:12.997436 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5a5ecb61-8e93-444f-be00-904274410f97 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers/4a494dac-3446-4569-b154-b14f9eb22b3e" status: 200 len: 1521 microversion: 2.1 time: 0.327646 Jul 18 02:16:12.999144 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 916/1819] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:12 2022] GET /compute/v2.1/servers/4a494dac-3446-4569-b154-b14f9eb22b3e => generated 1521 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:13.017238 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-7528e421-aa2c-41de-bc49-9b8de9e3ba1f req-fe21f670-dcf0-40b7-8de6-0c174b6d1d44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "174a0067-ee9a-493e-a1d9-099fdf4bbaec", "name": "network-vif-plugged", "status": "completed", "tag": "6947632d-5fe6-4f71-b7ce-376a2c05af5b"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:13.042257 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-7528e421-aa2c-41de-bc49-9b8de9e3ba1f req-fe21f670-dcf0-40b7-8de6-0c174b6d1d44 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:13.047853 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-7528e421-aa2c-41de-bc49-9b8de9e3ba1f req-fe21f670-dcf0-40b7-8de6-0c174b6d1d44 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:13.087489 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-7528e421-aa2c-41de-bc49-9b8de9e3ba1f req-fe21f670-dcf0-40b7-8de6-0c174b6d1d44 service nova] Creating event network-vif-plugged:6947632d-5fe6-4f71-b7ce-376a2c05af5b for instance 174a0067-ee9a-493e-a1d9-099fdf4bbaec on n-h2-465891-3 Jul 18 02:16:13.101326 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-7528e421-aa2c-41de-bc49-9b8de9e3ba1f req-fe21f670-dcf0-40b7-8de6-0c174b6d1d44 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091321 Jul 18 02:16:13.102931 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 917/1820] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:13.117304 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-58525022-8f3a-44f7-bd5c-d0cbf5c91bcf tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:13.119850 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-7259c530-2c85-4951-a511-8f9941e82b44 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] Building network info cache for instance {{(pid=119543) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 18 02:16:13.123046 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-58525022-8f3a-44f7-bd5c-d0cbf5c91bcf tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: e86cd628-160d-4516-ad58-899768acecd9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:13.142294 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-58525022-8f3a-44f7-bd5c-d0cbf5c91bcf tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:13.144341 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-58525022-8f3a-44f7-bd5c-d0cbf5c91bcf tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:13.146765 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-58525022-8f3a-44f7-bd5c-d0cbf5c91bcf tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:13.149400 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-58525022-8f3a-44f7-bd5c-d0cbf5c91bcf tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:13.539332 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-58525022-8f3a-44f7-bd5c-d0cbf5c91bcf tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe79fa13328b4e40922d0e3e4551a8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6b8514bba84ba8a09c64abbb2d1a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:13.551813 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-58525022-8f3a-44f7-bd5c-d0cbf5c91bcf tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "GET /compute/v2.1/servers/e86cd628-160d-4516-ad58-899768acecd9" status: 200 len: 1318 microversion: 2.1 time: 0.445730 Jul 18 02:16:13.555513 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 918/1821] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:13 2022] GET /compute/v2.1/servers/e86cd628-160d-4516-ad58-899768acecd9 => generated 1318 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:13.568560 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-8224bc72-99e7-4902-98aa-cf3799c4aee0 req-8d6eefd8-10b2-42ba-a41a-70f8b9150cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19592434-cafa-4e79-a790-0674ab77672f", "tag": "4c9f9136-52be-4062-9d09-7fd94b7a5870"}, {"server_uuid": "c4cc6162-ade9-4f10-9468-fdd1ed52b877", "name": "network-vif-deleted", "tag": "6439e9de-0c99-49d5-b628-c36d89f73fc6"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:13.587154 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-8224bc72-99e7-4902-98aa-cf3799c4aee0 req-8d6eefd8-10b2-42ba-a41a-70f8b9150cb7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:13.595167 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-8224bc72-99e7-4902-98aa-cf3799c4aee0 req-8d6eefd8-10b2-42ba-a41a-70f8b9150cb7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:13.612802 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-8224bc72-99e7-4902-98aa-cf3799c4aee0 req-8d6eefd8-10b2-42ba-a41a-70f8b9150cb7 service nova] Creating event network-changed:4c9f9136-52be-4062-9d09-7fd94b7a5870 for instance 19592434-cafa-4e79-a790-0674ab77672f on n-h1-465891-3 Jul 18 02:16:13.613605 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-8224bc72-99e7-4902-98aa-cf3799c4aee0 req-8d6eefd8-10b2-42ba-a41a-70f8b9150cb7 service nova] Creating event network-vif-deleted:6439e9de-0c99-49d5-b628-c36d89f73fc6 for instance c4cc6162-ade9-4f10-9468-fdd1ed52b877 on n-h1-465891-3 Jul 18 02:16:13.621123 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-8224bc72-99e7-4902-98aa-cf3799c4aee0 req-8d6eefd8-10b2-42ba-a41a-70f8b9150cb7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.062577 Jul 18 02:16:13.622407 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 919/1822] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:13.628470 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-371a71db-6d15-4e13-b287-8917685aa6b1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:13.629862 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-371a71db-6d15-4e13-b287-8917685aa6b1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c4cc6162-ade9-4f10-9468-fdd1ed52b877] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:13.638028 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-371a71db-6d15-4e13-b287-8917685aa6b1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:13.639677 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-371a71db-6d15-4e13-b287-8917685aa6b1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:13.641015 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-371a71db-6d15-4e13-b287-8917685aa6b1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:13.641645 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-371a71db-6d15-4e13-b287-8917685aa6b1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:13.680828 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-371a71db-6d15-4e13-b287-8917685aa6b1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:13.681881 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-371a71db-6d15-4e13-b287-8917685aa6b1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:13.682551 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-371a71db-6d15-4e13-b287-8917685aa6b1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lazy-loading 'fault' on Instance uuid c4cc6162-ade9-4f10-9468-fdd1ed52b877 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:16:13.751470 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-371a71db-6d15-4e13-b287-8917685aa6b1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:13.766843 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-371a71db-6d15-4e13-b287-8917685aa6b1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877" status: 200 len: 1307 microversion: 2.1 time: 0.142985 Jul 18 02:16:13.777215 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 920/1823] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:13 2022] GET /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877 => generated 1307 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:13.782736 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9cd5f199-9f15-4b41-953b-035cc1dcb5c8 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a83c5f70>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:13.883554 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9cd5f199-9f15-4b41-953b-035cc1dcb5c8 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf" status: 200 len: 1427 microversion: 2.1 time: 0.104743 Jul 18 02:16:13.892910 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 921/1824] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:16:13 2022] GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf => generated 1427 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:13.892910 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-6490d5c1-cfa1-457f-a1e9-56bfd64c548a req-f3b0c0d6-ab5b-435e-96f4-2e8a12dd84c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ddcf97f-5c13-4ed6-ac5b-17368a126dee", "tag": "4d6c976a-bead-4367-8b9a-e4a14283ef03"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:13.898608 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-6490d5c1-cfa1-457f-a1e9-56bfd64c548a req-f3b0c0d6-ab5b-435e-96f4-2e8a12dd84c2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:13.899068 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-6490d5c1-cfa1-457f-a1e9-56bfd64c548a req-f3b0c0d6-ab5b-435e-96f4-2e8a12dd84c2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:13.915098 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-6490d5c1-cfa1-457f-a1e9-56bfd64c548a req-f3b0c0d6-ab5b-435e-96f4-2e8a12dd84c2 service nova] Creating event network-changed:4d6c976a-bead-4367-8b9a-e4a14283ef03 for instance 7ddcf97f-5c13-4ed6-ac5b-17368a126dee on n-h2-465891-3 Jul 18 02:16:13.930952 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-6490d5c1-cfa1-457f-a1e9-56bfd64c548a req-f3b0c0d6-ab5b-435e-96f4-2e8a12dd84c2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044904 Jul 18 02:16:13.931329 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 922/1825] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:13.950458 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0dc5af6b-4472-4da1-b31d-0bfeccbd9384 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:13.951171 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0dc5af6b-4472-4da1-b31d-0bfeccbd9384 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:13.964940 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0dc5af6b-4472-4da1-b31d-0bfeccbd9384 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:13.965499 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0dc5af6b-4472-4da1-b31d-0bfeccbd9384 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:13.966210 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0dc5af6b-4472-4da1-b31d-0bfeccbd9384 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:13.966659 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0dc5af6b-4472-4da1-b31d-0bfeccbd9384 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:14.394266 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0dc5af6b-4472-4da1-b31d-0bfeccbd9384 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:14.409862 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0dc5af6b-4472-4da1-b31d-0bfeccbd9384 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:14.414742 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0dc5af6b-4472-4da1-b31d-0bfeccbd9384 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:14.416437 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0dc5af6b-4472-4da1-b31d-0bfeccbd9384 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 200 len: 1411 microversion: 2.25 time: 0.484043 Jul 18 02:16:14.417564 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 923/1826] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:16:13 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 1411 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:16:14.424420 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a16ac652-da25-4057-a0d3-a71fd5c6ec47 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:14.425567 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a16ac652-da25-4057-a0d3-a71fd5c6ec47 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:14.446976 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a16ac652-da25-4057-a0d3-a71fd5c6ec47 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:14.447908 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a16ac652-da25-4057-a0d3-a71fd5c6ec47 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:14.449302 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a16ac652-da25-4057-a0d3-a71fd5c6ec47 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:14.452432 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a16ac652-da25-4057-a0d3-a71fd5c6ec47 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:14.819658 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-7259c530-2c85-4951-a511-8f9941e82b44 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] Updating instance_info_cache with network_info: [{"id": "4d6c976a-bead-4367-8b9a-e4a14283ef03", "address": "fa:16:3e:ea:a9:1e", "network": {"id": "52a44372-961a-4af7-89e6-8796aa5e1c76", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-2062877766-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5ab10eb9b4cc4b13a640f5479056ab79", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap4d6c976a-be", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119543) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 18 02:16:14.859431 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a16ac652-da25-4057-a0d3-a71fd5c6ec47 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:14.874222 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a16ac652-da25-4057-a0d3-a71fd5c6ec47 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 200 len: 1716 microversion: 2.1 time: 0.455118 Jul 18 02:16:14.884833 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 924/1827] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:14 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 1716 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:14.885127 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7259c530-2c85-4951-a511-8f9941e82b44 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Releasing lock "refresh_cache-7ddcf97f-5c13-4ed6-ac5b-17368a126dee" {{(pid=119543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 02:16:14.885127 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7259c530-2c85-4951-a511-8f9941e82b44 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] 10.222.0.57 "POST /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee/action" status: 202 len: 0 microversion: 2.1 time: 4.184717 Jul 18 02:16:14.887786 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 904/1828] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:16:10 2022] POST /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee/action => generated 0 bytes in 4189 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 18 02:16:14.898165 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cf5f14c2-3906-4df5-8cbb-705cf67c9b6a tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:14.899151 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cf5f14c2-3906-4df5-8cbb-705cf67c9b6a tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: e86cd628-160d-4516-ad58-899768acecd9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:14.901427 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6ee29d79-11c2-41b8-955e-9208506ddfde tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:14.902325 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6ee29d79-11c2-41b8-955e-9208506ddfde tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 4a494dac-3446-4569-b154-b14f9eb22b3e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:14.908393 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cf5f14c2-3906-4df5-8cbb-705cf67c9b6a tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:14.909209 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cf5f14c2-3906-4df5-8cbb-705cf67c9b6a tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:14.910576 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cf5f14c2-3906-4df5-8cbb-705cf67c9b6a tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:14.911138 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cf5f14c2-3906-4df5-8cbb-705cf67c9b6a tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:14.912274 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6ee29d79-11c2-41b8-955e-9208506ddfde tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:14.912917 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6ee29d79-11c2-41b8-955e-9208506ddfde tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:14.914214 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6ee29d79-11c2-41b8-955e-9208506ddfde tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:14.914832 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6ee29d79-11c2-41b8-955e-9208506ddfde tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:15.137688 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=48 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:15.271799 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6ee29d79-11c2-41b8-955e-9208506ddfde tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:15.284161 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6ee29d79-11c2-41b8-955e-9208506ddfde tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers/4a494dac-3446-4569-b154-b14f9eb22b3e" status: 200 len: 1521 microversion: 2.1 time: 0.400944 Jul 18 02:16:15.284730 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 925/1829] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:14 2022] GET /compute/v2.1/servers/4a494dac-3446-4569-b154-b14f9eb22b3e => generated 1521 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:15.290029 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1ee1f929-26c8-4ecf-b6e3-a0fd4ea565c1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:15.290980 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1ee1f929-26c8-4ecf-b6e3-a0fd4ea565c1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c4cc6162-ade9-4f10-9468-fdd1ed52b877] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:15.299056 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ee1f929-26c8-4ecf-b6e3-a0fd4ea565c1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:15.299946 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ee1f929-26c8-4ecf-b6e3-a0fd4ea565c1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:15.301101 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ee1f929-26c8-4ecf-b6e3-a0fd4ea565c1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:15.301737 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ee1f929-26c8-4ecf-b6e3-a0fd4ea565c1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:15.349100 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ee1f929-26c8-4ecf-b6e3-a0fd4ea565c1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:15.349896 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ee1f929-26c8-4ecf-b6e3-a0fd4ea565c1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:15.350533 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-1ee1f929-26c8-4ecf-b6e3-a0fd4ea565c1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lazy-loading 'fault' on Instance uuid c4cc6162-ade9-4f10-9468-fdd1ed52b877 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:16:15.361202 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cf5f14c2-3906-4df5-8cbb-705cf67c9b6a tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe79fa13328b4e40922d0e3e4551a8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6b8514bba84ba8a09c64abbb2d1a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:15.380489 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cf5f14c2-3906-4df5-8cbb-705cf67c9b6a tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "GET /compute/v2.1/servers/e86cd628-160d-4516-ad58-899768acecd9" status: 200 len: 1318 microversion: 2.1 time: 0.490962 Jul 18 02:16:15.381033 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 905/1830] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:14 2022] GET /compute/v2.1/servers/e86cd628-160d-4516-ad58-899768acecd9 => generated 1318 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:15.389895 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-35a4c3f5-30b9-4fdd-b0f9-47ee4a058e8c tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Action: 'action', calling method: .version_select at 0x7ff4ab6c70d0>, body: {"removeFloatingIp": {"address": "172.25.3.145"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:15.441292 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1ee1f929-26c8-4ecf-b6e3-a0fd4ea565c1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:15.485726 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1ee1f929-26c8-4ecf-b6e3-a0fd4ea565c1 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877" status: 200 len: 1307 microversion: 2.1 time: 0.199379 Jul 18 02:16:15.502865 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 926/1831] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:15 2022] GET /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877 => generated 1307 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:15.510153 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6def60b2-3915-4a00-831e-a4cd26a92780 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a83c5940>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:15.586196 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6def60b2-3915-4a00-831e-a4cd26a92780 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf" status: 200 len: 1427 microversion: 2.1 time: 0.081417 Jul 18 02:16:15.596708 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 927/1832] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:16:15 2022] GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf => generated 1427 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:15.604558 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-54bbc588-b8ca-4611-9cc0-f1db01b41771 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:15.606626 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-54bbc588-b8ca-4611-9cc0-f1db01b41771 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:15.616137 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54bbc588-b8ca-4611-9cc0-f1db01b41771 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:15.616910 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54bbc588-b8ca-4611-9cc0-f1db01b41771 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:15.618469 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54bbc588-b8ca-4611-9cc0-f1db01b41771 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:15.619388 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54bbc588-b8ca-4611-9cc0-f1db01b41771 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:15.629437 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:15.765736 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-35a4c3f5-30b9-4fdd-b0f9-47ee4a058e8c tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:15.773201 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-35a4c3f5-30b9-4fdd-b0f9-47ee4a058e8c tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:15.774011 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-35a4c3f5-30b9-4fdd-b0f9-47ee4a058e8c tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:15.775019 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-35a4c3f5-30b9-4fdd-b0f9-47ee4a058e8c tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:15.775667 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-35a4c3f5-30b9-4fdd-b0f9-47ee4a058e8c tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:16.005433 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-54bbc588-b8ca-4611-9cc0-f1db01b41771 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:16.019194 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-54bbc588-b8ca-4611-9cc0-f1db01b41771 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:16.033112 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-54bbc588-b8ca-4611-9cc0-f1db01b41771 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:16.035382 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-54bbc588-b8ca-4611-9cc0-f1db01b41771 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 200 len: 1608 microversion: 2.25 time: 0.437151 Jul 18 02:16:16.036204 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 928/1833] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:16:15 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 1608 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:16:16.041662 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-99c343ac-f9b9-4c4f-93e7-339e05132c92 req-75c222b6-23a0-4789-b8d0-a3e98d42cbb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32361df9-4e50-409c-9cc7-6f70ba6ce26e", "name": "network-vif-plugged", "status": "completed", "tag": "7c604958-4d5c-4ace-8013-9827944aa0c6"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:16.069199 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-99c343ac-f9b9-4c4f-93e7-339e05132c92 req-75c222b6-23a0-4789-b8d0-a3e98d42cbb2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:16.074886 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-99c343ac-f9b9-4c4f-93e7-339e05132c92 req-75c222b6-23a0-4789-b8d0-a3e98d42cbb2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:16.099258 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-99c343ac-f9b9-4c4f-93e7-339e05132c92 req-75c222b6-23a0-4789-b8d0-a3e98d42cbb2 service nova] Creating event network-vif-plugged:7c604958-4d5c-4ace-8013-9827944aa0c6 for instance 32361df9-4e50-409c-9cc7-6f70ba6ce26e on n-h1-465891-3 Jul 18 02:16:16.114944 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-99c343ac-f9b9-4c4f-93e7-339e05132c92 req-75c222b6-23a0-4789-b8d0-a3e98d42cbb2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076172 Jul 18 02:16:16.120726 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 929/1834] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:16.127047 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-97fd9e9b-781c-4b0c-a8e4-494e665d6bd3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:16.128100 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-97fd9e9b-781c-4b0c-a8e4-494e665d6bd3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:16.136059 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-97fd9e9b-781c-4b0c-a8e4-494e665d6bd3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:16.136883 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-97fd9e9b-781c-4b0c-a8e4-494e665d6bd3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:16.138325 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-97fd9e9b-781c-4b0c-a8e4-494e665d6bd3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:16.138992 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-97fd9e9b-781c-4b0c-a8e4-494e665d6bd3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:16.239361 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-35a4c3f5-30b9-4fdd-b0f9-47ee4a058e8c tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Acquired lock "refresh_cache-7ddcf97f-5c13-4ed6-ac5b-17368a126dee" {{(pid=119543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 02:16:16.544130 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-97fd9e9b-781c-4b0c-a8e4-494e665d6bd3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:16.560181 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-97fd9e9b-781c-4b0c-a8e4-494e665d6bd3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 200 len: 1716 microversion: 2.1 time: 0.436718 Jul 18 02:16:16.561308 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 930/1835] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:16 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 1716 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:16.575206 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-eb3d2232-baf8-4d2f-b607-807eed2bae1c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:16.576949 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-eb3d2232-baf8-4d2f-b607-807eed2bae1c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:16.581822 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:16.590125 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eb3d2232-baf8-4d2f-b607-807eed2bae1c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:16.591093 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eb3d2232-baf8-4d2f-b607-807eed2bae1c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:16.593115 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eb3d2232-baf8-4d2f-b607-807eed2bae1c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:16.595383 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eb3d2232-baf8-4d2f-b607-807eed2bae1c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:16.729632 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-eb3d2232-baf8-4d2f-b607-807eed2bae1c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.166346 Jul 18 02:16:16.730294 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 931/1836] 10.222.0.57 () {60 vars in 1315 bytes} [Mon Jul 18 02:16:16 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec/os-interface => generated 285 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:16:16.742446 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-72e4a0b7-1c84-4419-8f12-0c679de7cc85 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:16.743375 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-72e4a0b7-1c84-4419-8f12-0c679de7cc85 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 4a494dac-3446-4569-b154-b14f9eb22b3e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:16.750418 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-72e4a0b7-1c84-4419-8f12-0c679de7cc85 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:16.751139 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-72e4a0b7-1c84-4419-8f12-0c679de7cc85 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:16.752142 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-72e4a0b7-1c84-4419-8f12-0c679de7cc85 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:16.753918 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-72e4a0b7-1c84-4419-8f12-0c679de7cc85 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:17.661396 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-72e4a0b7-1c84-4419-8f12-0c679de7cc85 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:17.676806 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-72e4a0b7-1c84-4419-8f12-0c679de7cc85 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers/4a494dac-3446-4569-b154-b14f9eb22b3e" status: 200 len: 1521 microversion: 2.1 time: 0.938306 Jul 18 02:16:17.679159 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 932/1837] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:16 2022] GET /compute/v2.1/servers/4a494dac-3446-4569-b154-b14f9eb22b3e => generated 1521 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:17.684919 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ed3db0b1-0e89-47eb-9e5b-c317745c498e tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:17.685963 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ed3db0b1-0e89-47eb-9e5b-c317745c498e tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: e86cd628-160d-4516-ad58-899768acecd9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:17.694701 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ed3db0b1-0e89-47eb-9e5b-c317745c498e tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:17.695452 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ed3db0b1-0e89-47eb-9e5b-c317745c498e tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:17.696269 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ed3db0b1-0e89-47eb-9e5b-c317745c498e tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:17.696710 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ed3db0b1-0e89-47eb-9e5b-c317745c498e tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:17.814294 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=16 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:18.214377 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ed3db0b1-0e89-47eb-9e5b-c317745c498e tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe79fa13328b4e40922d0e3e4551a8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6b8514bba84ba8a09c64abbb2d1a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:18.243855 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ed3db0b1-0e89-47eb-9e5b-c317745c498e tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "GET /compute/v2.1/servers/e86cd628-160d-4516-ad58-899768acecd9" status: 200 len: 1318 microversion: 2.1 time: 0.562971 Jul 18 02:16:18.255578 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 933/1838] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:17 2022] GET /compute/v2.1/servers/e86cd628-160d-4516-ad58-899768acecd9 => generated 1318 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:18.281896 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-391e96ed-ed42-4d31-8e27-73f8fdd6e39d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:18.282885 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-391e96ed-ed42-4d31-8e27-73f8fdd6e39d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c4cc6162-ade9-4f10-9468-fdd1ed52b877] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:18.300022 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-35a4c3f5-30b9-4fdd-b0f9-47ee4a058e8c tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] Building network info cache for instance {{(pid=119543) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 18 02:16:18.300356 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-391e96ed-ed42-4d31-8e27-73f8fdd6e39d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:18.300693 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-391e96ed-ed42-4d31-8e27-73f8fdd6e39d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:18.301529 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-391e96ed-ed42-4d31-8e27-73f8fdd6e39d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:18.301999 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-391e96ed-ed42-4d31-8e27-73f8fdd6e39d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:18.379122 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-391e96ed-ed42-4d31-8e27-73f8fdd6e39d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:18.385193 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-391e96ed-ed42-4d31-8e27-73f8fdd6e39d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:18.385903 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-391e96ed-ed42-4d31-8e27-73f8fdd6e39d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lazy-loading 'fault' on Instance uuid c4cc6162-ade9-4f10-9468-fdd1ed52b877 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:16:18.517492 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-391e96ed-ed42-4d31-8e27-73f8fdd6e39d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:18.552828 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-391e96ed-ed42-4d31-8e27-73f8fdd6e39d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877" status: 200 len: 1307 microversion: 2.1 time: 0.291387 Jul 18 02:16:18.555088 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 934/1839] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:18 2022] GET /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877 => generated 1307 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:18.577026 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3778bd71-89a5-443f-9347-b6546d493b7d tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a8591550>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:18.745040 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3778bd71-89a5-443f-9347-b6546d493b7d tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf" status: 200 len: 1427 microversion: 2.1 time: 0.187776 Jul 18 02:16:18.754111 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 935/1840] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:16:18 2022] GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf => generated 1427 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:18.767545 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8d316c35-8244-4f60-a644-fc4015bf04e3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:18.775088 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8d316c35-8244-4f60-a644-fc4015bf04e3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:18.811587 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8d316c35-8244-4f60-a644-fc4015bf04e3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:18.818413 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8d316c35-8244-4f60-a644-fc4015bf04e3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:18.820349 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8d316c35-8244-4f60-a644-fc4015bf04e3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:18.824437 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8d316c35-8244-4f60-a644-fc4015bf04e3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:19.619751 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8d316c35-8244-4f60-a644-fc4015bf04e3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:19.631448 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8d316c35-8244-4f60-a644-fc4015bf04e3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 200 len: 1716 microversion: 2.1 time: 0.873862 Jul 18 02:16:19.634237 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 936/1841] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:18 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 1716 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:19.700207 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-34631bc0-fc98-40d0-ab07-263d9b627633 req-7eaaae93-ff4b-4246-80a2-e73967f34fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ddcf97f-5c13-4ed6-ac5b-17368a126dee", "tag": "4d6c976a-bead-4367-8b9a-e4a14283ef03"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:19.737163 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-34631bc0-fc98-40d0-ab07-263d9b627633 req-7eaaae93-ff4b-4246-80a2-e73967f34fb3 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:19.741067 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-34631bc0-fc98-40d0-ab07-263d9b627633 req-7eaaae93-ff4b-4246-80a2-e73967f34fb3 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:19.791890 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-34631bc0-fc98-40d0-ab07-263d9b627633 req-7eaaae93-ff4b-4246-80a2-e73967f34fb3 service nova] Creating event network-changed:4d6c976a-bead-4367-8b9a-e4a14283ef03 for instance 7ddcf97f-5c13-4ed6-ac5b-17368a126dee on n-h2-465891-3 Jul 18 02:16:19.800228 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-34631bc0-fc98-40d0-ab07-263d9b627633 req-7eaaae93-ff4b-4246-80a2-e73967f34fb3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163379 Jul 18 02:16:19.801601 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 937/1842] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:19.808651 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0a6e1737-c396-4c60-92fb-7c91b7d6b082 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:19.810347 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0a6e1737-c396-4c60-92fb-7c91b7d6b082 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 4a494dac-3446-4569-b154-b14f9eb22b3e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:19.831565 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a6e1737-c396-4c60-92fb-7c91b7d6b082 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:19.832611 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a6e1737-c396-4c60-92fb-7c91b7d6b082 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:19.833746 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a6e1737-c396-4c60-92fb-7c91b7d6b082 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:19.834471 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a6e1737-c396-4c60-92fb-7c91b7d6b082 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:20.378451 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0a6e1737-c396-4c60-92fb-7c91b7d6b082 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:20.389035 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0a6e1737-c396-4c60-92fb-7c91b7d6b082 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers/4a494dac-3446-4569-b154-b14f9eb22b3e" status: 200 len: 1521 microversion: 2.1 time: 0.584118 Jul 18 02:16:20.389035 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 938/1843] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:19 2022] GET /compute/v2.1/servers/4a494dac-3446-4569-b154-b14f9eb22b3e => generated 1521 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:20.444482 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b906dad5-5fc5-47a2-98e3-0f0b4a6cc08e tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:20.445652 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b906dad5-5fc5-47a2-98e3-0f0b4a6cc08e tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: e86cd628-160d-4516-ad58-899768acecd9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:20.500077 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b906dad5-5fc5-47a2-98e3-0f0b4a6cc08e tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:20.500966 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b906dad5-5fc5-47a2-98e3-0f0b4a6cc08e tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:20.503008 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b906dad5-5fc5-47a2-98e3-0f0b4a6cc08e tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:20.509197 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b906dad5-5fc5-47a2-98e3-0f0b4a6cc08e tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:21.064332 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-35a4c3f5-30b9-4fdd-b0f9-47ee4a058e8c tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] Updating instance_info_cache with network_info: [{"id": "4d6c976a-bead-4367-8b9a-e4a14283ef03", "address": "fa:16:3e:ea:a9:1e", "network": {"id": "52a44372-961a-4af7-89e6-8796aa5e1c76", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-2062877766-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5ab10eb9b4cc4b13a640f5479056ab79", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap4d6c976a-be", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119543) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 18 02:16:21.102813 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-35a4c3f5-30b9-4fdd-b0f9-47ee4a058e8c tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Releasing lock "refresh_cache-7ddcf97f-5c13-4ed6-ac5b-17368a126dee" {{(pid=119543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 02:16:21.108106 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-35a4c3f5-30b9-4fdd-b0f9-47ee4a058e8c tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] 10.222.0.57 "POST /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee/action" status: 202 len: 0 microversion: 2.1 time: 5.723874 Jul 18 02:16:21.110387 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 906/1844] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:16:15 2022] POST /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee/action => generated 0 bytes in 5728 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 18 02:16:21.130257 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3c6b3380-75a1-46ea-a7fd-8cf4af532311 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:21.132280 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3c6b3380-75a1-46ea-a7fd-8cf4af532311 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c4cc6162-ade9-4f10-9468-fdd1ed52b877] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:21.182452 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3c6b3380-75a1-46ea-a7fd-8cf4af532311 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:21.183481 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3c6b3380-75a1-46ea-a7fd-8cf4af532311 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:21.184970 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3c6b3380-75a1-46ea-a7fd-8cf4af532311 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:21.185827 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3c6b3380-75a1-46ea-a7fd-8cf4af532311 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:21.205939 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:21.268134 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b906dad5-5fc5-47a2-98e3-0f0b4a6cc08e tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe79fa13328b4e40922d0e3e4551a8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6b8514bba84ba8a09c64abbb2d1a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:21.299448 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b906dad5-5fc5-47a2-98e3-0f0b4a6cc08e tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "GET /compute/v2.1/servers/e86cd628-160d-4516-ad58-899768acecd9" status: 200 len: 1509 microversion: 2.1 time: 0.909097 Jul 18 02:16:21.312384 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 939/1845] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:20 2022] GET /compute/v2.1/servers/e86cd628-160d-4516-ad58-899768acecd9 => generated 1509 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:21.344558 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a734352d-a6ae-4245-92c0-a3f19b19ab08 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a837d820>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:21.349178 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3c6b3380-75a1-46ea-a7fd-8cf4af532311 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:21.368464 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3c6b3380-75a1-46ea-a7fd-8cf4af532311 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:21.369057 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-3c6b3380-75a1-46ea-a7fd-8cf4af532311 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lazy-loading 'fault' on Instance uuid c4cc6162-ade9-4f10-9468-fdd1ed52b877 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:16:21.499257 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3c6b3380-75a1-46ea-a7fd-8cf4af532311 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:21.511671 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3c6b3380-75a1-46ea-a7fd-8cf4af532311 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877" status: 200 len: 1307 microversion: 2.1 time: 0.398204 Jul 18 02:16:21.522962 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 907/1846] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:21 2022] GET /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877 => generated 1307 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:21.537168 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a734352d-a6ae-4245-92c0-a3f19b19ab08 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf" status: 200 len: 1427 microversion: 2.1 time: 0.203384 Jul 18 02:16:21.537168 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 940/1847] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:16:21 2022] GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf => generated 1427 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:21.571898 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-55483f06-5c70-4653-9ae0-f7167f18f909 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Calling method '.version_select at 0x7ff4ab2dd430>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:21.582273 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2d2841af-55f5-45b2-950b-a18982be6951 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:21.583493 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2d2841af-55f5-45b2-950b-a18982be6951 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:21.630054 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2d2841af-55f5-45b2-950b-a18982be6951 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:21.630542 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2d2841af-55f5-45b2-950b-a18982be6951 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:21.640384 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2d2841af-55f5-45b2-950b-a18982be6951 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:21.641266 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2d2841af-55f5-45b2-950b-a18982be6951 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:23.098451 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2d2841af-55f5-45b2-950b-a18982be6951 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:23.114809 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2d2841af-55f5-45b2-950b-a18982be6951 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 200 len: 1716 microversion: 2.1 time: 1.581515 Jul 18 02:16:23.126932 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 941/1848] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:21 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 1716 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:23.143564 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-03e1082c-2679-400a-8f6d-862a5cb9a8b9 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:23.159893 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-03e1082c-2679-400a-8f6d-862a5cb9a8b9 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 4a494dac-3446-4569-b154-b14f9eb22b3e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:23.184527 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-03e1082c-2679-400a-8f6d-862a5cb9a8b9 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:23.190923 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-03e1082c-2679-400a-8f6d-862a5cb9a8b9 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:23.194016 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-03e1082c-2679-400a-8f6d-862a5cb9a8b9 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:23.200137 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-03e1082c-2679-400a-8f6d-862a5cb9a8b9 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:23.719625 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-03e1082c-2679-400a-8f6d-862a5cb9a8b9 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:23.760587 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-03e1082c-2679-400a-8f6d-862a5cb9a8b9 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers/4a494dac-3446-4569-b154-b14f9eb22b3e" status: 200 len: 1498 microversion: 2.1 time: 0.620994 Jul 18 02:16:23.775548 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 942/1849] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:23 2022] GET /compute/v2.1/servers/4a494dac-3446-4569-b154-b14f9eb22b3e => generated 1498 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:23.792222 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-f09d3ac2-4fa4-4183-9ef7-0992c1e80961 req-d7fcbbca-c8cd-4d72-bd11-6531a594da84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "174a0067-ee9a-493e-a1d9-099fdf4bbaec", "tag": "6947632d-5fe6-4f71-b7ce-376a2c05af5b"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:23.804553 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-f09d3ac2-4fa4-4183-9ef7-0992c1e80961 req-d7fcbbca-c8cd-4d72-bd11-6531a594da84 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:23.805313 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-f09d3ac2-4fa4-4183-9ef7-0992c1e80961 req-d7fcbbca-c8cd-4d72-bd11-6531a594da84 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:23.873268 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-f09d3ac2-4fa4-4183-9ef7-0992c1e80961 req-d7fcbbca-c8cd-4d72-bd11-6531a594da84 service nova] Creating event network-changed:6947632d-5fe6-4f71-b7ce-376a2c05af5b for instance 174a0067-ee9a-493e-a1d9-099fdf4bbaec on n-h2-465891-3 Jul 18 02:16:23.907231 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-f09d3ac2-4fa4-4183-9ef7-0992c1e80961 req-d7fcbbca-c8cd-4d72-bd11-6531a594da84 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116266 Jul 18 02:16:23.927460 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 943/1850] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:23.963715 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-43a7a0fa-f1ed-4bf8-ade3-52e84a154b3b tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a8376700>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:24.163432 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-43a7a0fa-f1ed-4bf8-ade3-52e84a154b3b tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf" status: 200 len: 1427 microversion: 2.1 time: 0.232790 Jul 18 02:16:24.186735 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 944/1851] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:16:23 2022] GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf => generated 1427 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:24.197081 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-56fa172b-4b3e-453b-8f92-44abc729dc4c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:24.197081 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-56fa172b-4b3e-453b-8f92-44abc729dc4c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c4cc6162-ade9-4f10-9468-fdd1ed52b877] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:24.241155 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-56fa172b-4b3e-453b-8f92-44abc729dc4c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:24.241601 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-56fa172b-4b3e-453b-8f92-44abc729dc4c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:24.242673 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-56fa172b-4b3e-453b-8f92-44abc729dc4c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:24.243329 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-56fa172b-4b3e-453b-8f92-44abc729dc4c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:24.280214 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-56fa172b-4b3e-453b-8f92-44abc729dc4c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] HTTP exception thrown: Instance c4cc6162-ade9-4f10-9468-fdd1ed52b877 could not be found. Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-56fa172b-4b3e-453b-8f92-44abc729dc4c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Request method failure captured: Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877 HTTP/1.1 Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MGCWrWHCddcrN4RqNfnBFPBSabjGvo5gM77Tw6VfoUAuTFYZJ3-CEdjKYax5T5uhOfCuNLEmOh531jNb7qti0OvzfRwr8H4xYd6v1BUcfs9beu0dZ5AWDeHwp-6BMUAWJqOL9IUkCg8_lfh7_6ef8hef4LR8j_2qAWtZaYjzyZxBJ0 Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 8f8bb1ebead3481f946ae7878c3cfc41 Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersOnMultiNodesTest-1310468150 Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8f8bb1ebead3481f946ae7878c3cfc41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8f8bb1ebead3481f946ae7878c3cfc41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8f8bb1ebead3481f946ae7878c3cfc41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8f8bb1ebead3481f946ae7878c3cfc41"}]}] Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersOnMultiNodesTest-1310468150 Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 8f8bb1ebead3481f946ae7878c3cfc41 Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1310468150 Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersOnMultiNodesTest-1310468150-project Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 100f65c0d9d3456fa177599821aed7ff Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersOnMultiNodesTest-1310468150-project Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance c4cc6162-ade9-4f10-9468-fdd1ed52b877 could not be found. Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'c4cc6162-ade9-4f10-9468-fdd1ed52b877'} Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4cc6162-ade9-4f10-9468-fdd1ed52b877 could not be found. Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4cc6162-ade9-4f10-9468-fdd1ed52b877 could not be found. Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:16:24.290125 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:16:24.296422 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:24.296422 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:16:24.296422 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:16:24.296422 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:16:24.296422 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:16:24.296422 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4cc6162-ade9-4f10-9468-fdd1ed52b877 could not be found. Jul 18 02:16:24.296422 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:16:24.301883 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-56fa172b-4b3e-453b-8f92-44abc729dc4c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Returning 404 to user: Instance c4cc6162-ade9-4f10-9468-fdd1ed52b877 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:16:24.303260 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-56fa172b-4b3e-453b-8f92-44abc729dc4c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877" status: 404 len: 111 microversion: 2.1 time: 0.112987 Jul 18 02:16:24.313731 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 945/1852] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:24 2022] GET /compute/v2.1/servers/c4cc6162-ade9-4f10-9468-fdd1ed52b877 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:16:24.326858 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f588b376-cb44-4d6d-b278-3eb7f8ab6310 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:24.339320 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f588b376-cb44-4d6d-b278-3eb7f8ab6310 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:24.343489 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f588b376-cb44-4d6d-b278-3eb7f8ab6310 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '58dcb69855544ff3b51109aa5d41f637'} {{(pid=119544) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:16:24.361041 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f588b376-cb44-4d6d-b278-3eb7f8ab6310 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:24.366149 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f588b376-cb44-4d6d-b278-3eb7f8ab6310 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:24.367531 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f588b376-cb44-4d6d-b278-3eb7f8ab6310 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:24.370032 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f588b376-cb44-4d6d-b278-3eb7f8ab6310 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:24.477108 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.multi_cell_list [None req-f588b376-cb44-4d6d-b278-3eb7f8ab6310 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119544) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:16:24.593163 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f588b376-cb44-4d6d-b278-3eb7f8ab6310 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.276649 Jul 18 02:16:24.603949 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 946/1853] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 18 02:16:24 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:24.622753 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5081b29e-eca5-4ba4-b4cf-6a3d2d9402ac tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:24.639441 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5081b29e-eca5-4ba4-b4cf-6a3d2d9402ac tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:24.675775 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5081b29e-eca5-4ba4-b4cf-6a3d2d9402ac tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:24.681075 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5081b29e-eca5-4ba4-b4cf-6a3d2d9402ac tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:24.692892 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5081b29e-eca5-4ba4-b4cf-6a3d2d9402ac tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:24.699317 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5081b29e-eca5-4ba4-b4cf-6a3d2d9402ac tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:25.513549 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-55483f06-5c70-4653-9ae0-f7167f18f909 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] 10.222.0.57 "DELETE /compute/v2.1/os-floating-ips/36707672-9022-4a5b-8737-2f896e696b7f" status: 202 len: 0 microversion: 2.1 time: 3.969631 Jul 18 02:16:25.519704 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 908/1854] 10.222.0.57 () {58 vars in 1262 bytes} [Mon Jul 18 02:16:21 2022] DELETE /compute/v2.1/os-floating-ips/36707672-9022-4a5b-8737-2f896e696b7f => generated 0 bytes in 3976 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:16:25.525599 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6e42bc51-948b-4afd-8294-022651a8daae tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:25.526430 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6e42bc51-948b-4afd-8294-022651a8daae tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 85cf0fec-3e12-4af3-9525-925901fc41d9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:25.543507 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e42bc51-948b-4afd-8294-022651a8daae tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:25.544281 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e42bc51-948b-4afd-8294-022651a8daae tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:25.545299 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e42bc51-948b-4afd-8294-022651a8daae tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:25.545944 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e42bc51-948b-4afd-8294-022651a8daae tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:25.627246 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6e42bc51-948b-4afd-8294-022651a8daae tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 85cf0fec-3e12-4af3-9525-925901fc41d9] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:16:25.724453 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5081b29e-eca5-4ba4-b4cf-6a3d2d9402ac tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:25.743833 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5081b29e-eca5-4ba4-b4cf-6a3d2d9402ac tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 200 len: 1716 microversion: 2.1 time: 1.136568 Jul 18 02:16:25.744357 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 947/1855] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:24 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 1716 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:25.762339 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4692087f-cfb8-4786-8136-78479533d38e tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:25.787045 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=4,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:25.789719 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4692087f-cfb8-4786-8136-78479533d38e tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:25.798099 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4692087f-cfb8-4786-8136-78479533d38e tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:25.917011 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4692087f-cfb8-4786-8136-78479533d38e tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 4a494dac-3446-4569-b154-b14f9eb22b3e] Going to try to start instance {{(pid=119544) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 02:16:25.988587 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6e42bc51-948b-4afd-8294-022651a8daae tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "DELETE /compute/v2.1/servers/85cf0fec-3e12-4af3-9525-925901fc41d9" status: 204 len: 0 microversion: 2.1 time: 0.467140 Jul 18 02:16:25.989243 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 909/1856] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:16:25 2022] DELETE /compute/v2.1/servers/85cf0fec-3e12-4af3-9525-925901fc41d9 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:26.018474 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a5d2e17b-ea6a-45d0-a7ca-ed524edf590c tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a80223a0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:26.086227 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4692087f-cfb8-4786-8136-78479533d38e tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "POST /compute/v2.1/servers/4a494dac-3446-4569-b154-b14f9eb22b3e/action" status: 202 len: 0 microversion: 2.1 time: 0.329187 Jul 18 02:16:26.114763 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 948/1857] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:16:25 2022] POST /compute/v2.1/servers/4a494dac-3446-4569-b154-b14f9eb22b3e/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:16:26.158623 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ca1f4f36-69de-4b1c-babe-905d7e5cbaf9 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Calling method '.version_select at 0x7ff4a94e6700>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:26.180716 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a5d2e17b-ea6a-45d0-a7ca-ed524edf590c tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf" status: 200 len: 1427 microversion: 2.1 time: 0.183885 Jul 18 02:16:26.197633 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 910/1858] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:16:25 2022] GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf => generated 1427 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:26.209576 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b0a00bc7-c12a-4d34-a08c-20627d2d7839 tempest-VolumesAdminNegativeTest-1236398612 tempest-VolumesAdminNegativeTest-1236398612-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "f4bf8dbf-2f2f-42bf-a0a8-51221b4462d6"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:26.224579 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b0a00bc7-c12a-4d34-a08c-20627d2d7839 tempest-VolumesAdminNegativeTest-1236398612 tempest-VolumesAdminNegativeTest-1236398612-project-admin] [instance: e86cd628-160d-4516-ad58-899768acecd9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:26.253103 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b0a00bc7-c12a-4d34-a08c-20627d2d7839 tempest-VolumesAdminNegativeTest-1236398612 tempest-VolumesAdminNegativeTest-1236398612-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:26.262449 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b0a00bc7-c12a-4d34-a08c-20627d2d7839 tempest-VolumesAdminNegativeTest-1236398612 tempest-VolumesAdminNegativeTest-1236398612-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:26.279836 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b0a00bc7-c12a-4d34-a08c-20627d2d7839 tempest-VolumesAdminNegativeTest-1236398612 tempest-VolumesAdminNegativeTest-1236398612-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:26.281358 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b0a00bc7-c12a-4d34-a08c-20627d2d7839 tempest-VolumesAdminNegativeTest-1236398612 tempest-VolumesAdminNegativeTest-1236398612-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:26.537997 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-b0a00bc7-c12a-4d34-a08c-20627d2d7839 tempest-VolumesAdminNegativeTest-1236398612 tempest-VolumesAdminNegativeTest-1236398612-project-admin] HTTP exception thrown: Volume 0d5bdb2e-d8db-463d-9e9e-9ef5a23c4b73 could not be found. Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b0a00bc7-c12a-4d34-a08c-20627d2d7839 tempest-VolumesAdminNegativeTest-1236398612 tempest-VolumesAdminNegativeTest-1236398612-project-admin] Request method failure captured: Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: request: PUT /compute/v2.1/servers/e86cd628-160d-4516-ad58-899768acecd9/os-volume_attachments/0d5bdb2e-d8db-463d-9e9e-9ef5a23c4b73 HTTP/1.1 Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 74 Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MG0mBhXEn4ldFlGgEaGffCrImpCXLFviLmGEX5WwFzPdbA2D2vzb8_skSNDflnGLUH2Y0yDSTFPLalLQQ0BXYMH1UeK2AJPF7-gcD7I0m0gecHZi6aCcwgj8Uc2_O_JqqK91L6ZZv7dHFH7p6OAF7IUHiwVaaXNG44l5l4RKrb0_As Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: b3c8847b00274283bc0a80503bc0bb80 Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-VolumesAdminNegativeTest-1236398612 Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,admin,reader Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,admin,reader Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b3c8847b00274283bc0a80503bc0bb80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b3c8847b00274283bc0a80503bc0bb80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b3c8847b00274283bc0a80503bc0bb80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b3c8847b00274283bc0a80503bc0bb80"}]}] Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-VolumesAdminNegativeTest-1236398612 Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: b3c8847b00274283bc0a80503bc0bb80 Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1236398612 Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-VolumesAdminNegativeTest-1236398612-project-admin Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: a6cd390b445b4dd28d1d9bc1aa3a9455 Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-VolumesAdminNegativeTest-1236398612-project-admin Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: {"volumeAttachment": {"volumeId": "f4bf8dbf-2f2f-42bf-a0a8-51221b4462d6"}} Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: exception: Volume 0d5bdb2e-d8db-463d-9e9e-9ef5a23c4b73 could not be found. Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'server_id': 'e86cd628-160d-4516-ad58-899768acecd9', 'id': '0d5bdb2e-d8db-463d-9e9e-9ef5a23c4b73', 'body': {'volumeAttachment': {'volumeId': 'f4bf8dbf-2f2f-42bf-a0a8-51221b4462d6'}}} Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0d5bdb2e-d8db-463d-9e9e-9ef5a23c4b73 could not be found. (HTTP 404) (Request-ID: req-4bca0c5c-d92b-4903-9730-3a4993dae07e) Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 02:16:26.571820 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0d5bdb2e-d8db-463d-9e9e-9ef5a23c4b73 could not be found. Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0d5bdb2e-d8db-463d-9e9e-9ef5a23c4b73 could not be found. Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0d5bdb2e-d8db-463d-9e9e-9ef5a23c4b73 could not be found. Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b0a00bc7-c12a-4d34-a08c-20627d2d7839 tempest-VolumesAdminNegativeTest-1236398612 tempest-VolumesAdminNegativeTest-1236398612-project-admin] Returning 404 to user: Volume 0d5bdb2e-d8db-463d-9e9e-9ef5a23c4b73 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b0a00bc7-c12a-4d34-a08c-20627d2d7839 tempest-VolumesAdminNegativeTest-1236398612 tempest-VolumesAdminNegativeTest-1236398612-project-admin] 10.222.0.57 "PUT /compute/v2.1/servers/e86cd628-160d-4516-ad58-899768acecd9/os-volume_attachments/0d5bdb2e-d8db-463d-9e9e-9ef5a23c4b73" status: 404 len: 109 microversion: 2.1 time: 0.373849 Jul 18 02:16:26.594169 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 911/1859] 10.222.0.57 () {60 vars in 1432 bytes} [Mon Jul 18 02:16:26 2022] PUT /compute/v2.1/servers/e86cd628-160d-4516-ad58-899768acecd9/os-volume_attachments/0d5bdb2e-d8db-463d-9e9e-9ef5a23c4b73 => generated 109 bytes in 376 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:16:26.611167 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9aa352f0-a16b-4b17-aa75-a212d652bd56 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:26.611167 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9aa352f0-a16b-4b17-aa75-a212d652bd56 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 85cf0fec-3e12-4af3-9525-925901fc41d9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:26.634527 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9aa352f0-a16b-4b17-aa75-a212d652bd56 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:26.637500 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9aa352f0-a16b-4b17-aa75-a212d652bd56 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:26.641487 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9aa352f0-a16b-4b17-aa75-a212d652bd56 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:26.641835 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9aa352f0-a16b-4b17-aa75-a212d652bd56 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:26.760621 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ca1f4f36-69de-4b1c-babe-905d7e5cbaf9 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/5acaaa95-2c29-4e14-b127-5dd6e2bc6ac7" status: 202 len: 0 microversion: 2.1 time: 0.641133 Jul 18 02:16:26.761227 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 949/1860] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 02:16:26 2022] DELETE /compute/v2.1/os-security-groups/5acaaa95-2c29-4e14-b127-5dd6e2bc6ac7 => generated 0 bytes in 645 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:16:26.772563 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-29555f9d-aedc-4fa1-8be1-a531094178f5 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:26.773360 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-29555f9d-aedc-4fa1-8be1-a531094178f5 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 4a494dac-3446-4569-b154-b14f9eb22b3e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:26.812370 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-29555f9d-aedc-4fa1-8be1-a531094178f5 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:26.812933 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-29555f9d-aedc-4fa1-8be1-a531094178f5 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:26.813862 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-29555f9d-aedc-4fa1-8be1-a531094178f5 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:26.814481 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-29555f9d-aedc-4fa1-8be1-a531094178f5 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:26.871680 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:27.579533 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9aa352f0-a16b-4b17-aa75-a212d652bd56 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:27.613587 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9aa352f0-a16b-4b17-aa75-a212d652bd56 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/85cf0fec-3e12-4af3-9525-925901fc41d9" status: 200 len: 1472 microversion: 2.1 time: 1.036747 Jul 18 02:16:27.614696 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 912/1861] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:26 2022] GET /compute/v2.1/servers/85cf0fec-3e12-4af3-9525-925901fc41d9 => generated 1472 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:27.645112 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-81504121-bbbc-4cb6-84f8-1f25b7b26f4f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:27.664576 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-29555f9d-aedc-4fa1-8be1-a531094178f5 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:27.674506 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-81504121-bbbc-4cb6-84f8-1f25b7b26f4f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:27.718333 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-29555f9d-aedc-4fa1-8be1-a531094178f5 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers/4a494dac-3446-4569-b154-b14f9eb22b3e" status: 200 len: 1507 microversion: 2.1 time: 0.948251 Jul 18 02:16:27.730921 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 950/1862] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:26 2022] GET /compute/v2.1/servers/4a494dac-3446-4569-b154-b14f9eb22b3e => generated 1507 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:27.731256 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-81504121-bbbc-4cb6-84f8-1f25b7b26f4f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:27.731256 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-81504121-bbbc-4cb6-84f8-1f25b7b26f4f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:27.733149 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-81504121-bbbc-4cb6-84f8-1f25b7b26f4f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:27.734038 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-81504121-bbbc-4cb6-84f8-1f25b7b26f4f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:27.750515 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6c256cbc-d899-4fec-a267-1a81d765d975 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:27.751316 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6c256cbc-d899-4fec-a267-1a81d765d975 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:27.785870 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6c256cbc-d899-4fec-a267-1a81d765d975 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:27.787555 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6c256cbc-d899-4fec-a267-1a81d765d975 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:27.802713 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6c256cbc-d899-4fec-a267-1a81d765d975 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:27.803824 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6c256cbc-d899-4fec-a267-1a81d765d975 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:27.922237 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6c256cbc-d899-4fec-a267-1a81d765d975 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:16:28.151873 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-81504121-bbbc-4cb6-84f8-1f25b7b26f4f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:28.174716 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-81504121-bbbc-4cb6-84f8-1f25b7b26f4f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 200 len: 1716 microversion: 2.1 time: 0.542424 Jul 18 02:16:28.192730 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 913/1863] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:27 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 1716 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:28.198620 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-07af8de0-7cc3-43e4-9a23-3348a0a9e575 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a880bb80>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:28.226864 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6c256cbc-d899-4fec-a267-1a81d765d975 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee" status: 204 len: 0 microversion: 2.1 time: 0.502516 Jul 18 02:16:28.227762 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 951/1864] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:16:27 2022] DELETE /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee => generated 0 bytes in 505 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:28.247956 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3b3ef3a4-4247-41a6-9e89-20978ae58817 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:28.257162 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3b3ef3a4-4247-41a6-9e89-20978ae58817 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:28.264061 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b3ef3a4-4247-41a6-9e89-20978ae58817 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:28.264527 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b3ef3a4-4247-41a6-9e89-20978ae58817 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:28.270041 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b3ef3a4-4247-41a6-9e89-20978ae58817 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:28.270509 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b3ef3a4-4247-41a6-9e89-20978ae58817 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:28.369759 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-07af8de0-7cc3-43e4-9a23-3348a0a9e575 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf" status: 200 len: 1427 microversion: 2.1 time: 0.175118 Jul 18 02:16:28.374117 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 914/1865] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:16:28 2022] GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf => generated 1427 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:28.637467 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-afa12ab9-7a28-4382-84db-11423b602184 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:28.654502 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-afa12ab9-7a28-4382-84db-11423b602184 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 85cf0fec-3e12-4af3-9525-925901fc41d9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:28.672870 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3b3ef3a4-4247-41a6-9e89-20978ae58817 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9472908374c94355ada94f4947c99f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab10eb9b4cc4b13a640f5479056ab79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:28.684272 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3b3ef3a4-4247-41a6-9e89-20978ae58817 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] 10.222.0.57 "GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee" status: 200 len: 1509 microversion: 2.1 time: 0.450804 Jul 18 02:16:28.685434 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 952/1866] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:28 2022] GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee => generated 1509 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:16:28.718206 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-afa12ab9-7a28-4382-84db-11423b602184 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:28.719508 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-afa12ab9-7a28-4382-84db-11423b602184 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:28.722105 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-afa12ab9-7a28-4382-84db-11423b602184 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:28.723232 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-afa12ab9-7a28-4382-84db-11423b602184 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:28.749574 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-36892c32-de6e-4560-9a2c-d023fe149ac7 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:28.751851 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-36892c32-de6e-4560-9a2c-d023fe149ac7 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 4a494dac-3446-4569-b154-b14f9eb22b3e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:28.766612 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-36892c32-de6e-4560-9a2c-d023fe149ac7 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:28.770523 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-36892c32-de6e-4560-9a2c-d023fe149ac7 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:28.771546 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-36892c32-de6e-4560-9a2c-d023fe149ac7 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:28.772768 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-36892c32-de6e-4560-9a2c-d023fe149ac7 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:29.189446 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-afa12ab9-7a28-4382-84db-11423b602184 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:29.234410 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-afa12ab9-7a28-4382-84db-11423b602184 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/85cf0fec-3e12-4af3-9525-925901fc41d9" status: 200 len: 1472 microversion: 2.1 time: 0.603836 Jul 18 02:16:29.250242 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 915/1867] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:28 2022] GET /compute/v2.1/servers/85cf0fec-3e12-4af3-9525-925901fc41d9 => generated 1472 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:29.265289 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cc0998f9-0d91-4eca-a2ac-c5371540049f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:29.283070 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cc0998f9-0d91-4eca-a2ac-c5371540049f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:29.295932 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cc0998f9-0d91-4eca-a2ac-c5371540049f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:29.297281 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cc0998f9-0d91-4eca-a2ac-c5371540049f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:29.299238 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cc0998f9-0d91-4eca-a2ac-c5371540049f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:29.300551 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cc0998f9-0d91-4eca-a2ac-c5371540049f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:29.699578 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-36892c32-de6e-4560-9a2c-d023fe149ac7 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:29.738952 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-36892c32-de6e-4560-9a2c-d023fe149ac7 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers/4a494dac-3446-4569-b154-b14f9eb22b3e" status: 200 len: 1507 microversion: 2.1 time: 0.997965 Jul 18 02:16:29.740971 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 953/1868] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:28 2022] GET /compute/v2.1/servers/4a494dac-3446-4569-b154-b14f9eb22b3e => generated 1507 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:29.762155 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-03b05d57-8571-4962-b5f3-e20c6ef79ab5 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a8324550>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:29.882152 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-03b05d57-8571-4962-b5f3-e20c6ef79ab5 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf" status: 200 len: 1427 microversion: 2.1 time: 0.134407 Jul 18 02:16:29.894891 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 954/1869] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:16:29 2022] GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf => generated 1427 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:29.917511 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cc0998f9-0d91-4eca-a2ac-c5371540049f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:29.924906 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cd6cd8d2-93c4-4d18-b217-2704700b21b0 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:29.926148 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cd6cd8d2-93c4-4d18-b217-2704700b21b0 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:29.958473 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cd6cd8d2-93c4-4d18-b217-2704700b21b0 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:29.959271 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cd6cd8d2-93c4-4d18-b217-2704700b21b0 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:29.965939 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cc0998f9-0d91-4eca-a2ac-c5371540049f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 200 len: 1716 microversion: 2.1 time: 0.712892 Jul 18 02:16:29.967072 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 916/1870] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:29 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 1716 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:30.013390 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cd6cd8d2-93c4-4d18-b217-2704700b21b0 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:30.014520 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cd6cd8d2-93c4-4d18-b217-2704700b21b0 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:30.268266 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-11c1c93d-914b-4693-a598-a8562dc2d490 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:30.279171 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-11c1c93d-914b-4693-a598-a8562dc2d490 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 85cf0fec-3e12-4af3-9525-925901fc41d9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:30.286718 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-11c1c93d-914b-4693-a598-a8562dc2d490 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:30.287186 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-11c1c93d-914b-4693-a598-a8562dc2d490 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:30.291570 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-11c1c93d-914b-4693-a598-a8562dc2d490 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:30.292039 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-11c1c93d-914b-4693-a598-a8562dc2d490 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:31.886538 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-cd6cd8d2-93c4-4d18-b217-2704700b21b0 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9472908374c94355ada94f4947c99f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab10eb9b4cc4b13a640f5479056ab79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:31.892409 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-11c1c93d-914b-4693-a598-a8562dc2d490 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:31.940950 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cd6cd8d2-93c4-4d18-b217-2704700b21b0 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] 10.222.0.57 "GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee" status: 200 len: 1509 microversion: 2.1 time: 2.039215 Jul 18 02:16:31.945480 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 955/1871] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:29 2022] GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee => generated 1509 bytes in 2049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:31.964302 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-11c1c93d-914b-4693-a598-a8562dc2d490 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/85cf0fec-3e12-4af3-9525-925901fc41d9" status: 200 len: 1472 microversion: 2.1 time: 1.703108 Jul 18 02:16:31.969421 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 917/1872] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:30 2022] GET /compute/v2.1/servers/85cf0fec-3e12-4af3-9525-925901fc41d9 => generated 1472 bytes in 1710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:31.977982 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-123166f2-deeb-4f03-bffc-828076fc8078 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:31.985200 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-123166f2-deeb-4f03-bffc-828076fc8078 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 4a494dac-3446-4569-b154-b14f9eb22b3e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:32.014720 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c5763b02-55bf-45dd-ba78-d7dbabc8e342 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a801e940>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:32.027983 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-123166f2-deeb-4f03-bffc-828076fc8078 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:32.034959 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-123166f2-deeb-4f03-bffc-828076fc8078 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:32.036646 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-123166f2-deeb-4f03-bffc-828076fc8078 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:32.041853 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-123166f2-deeb-4f03-bffc-828076fc8078 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:32.183521 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c5763b02-55bf-45dd-ba78-d7dbabc8e342 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf" status: 200 len: 1427 microversion: 2.1 time: 0.206185 Jul 18 02:16:32.187404 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 918/1873] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:16:31 2022] GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf => generated 1427 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:32.228752 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-36ae17c4-bb54-473d-b218-9f6514dc6a95 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:32.233408 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-36ae17c4-bb54-473d-b218-9f6514dc6a95 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:32.265745 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-36ae17c4-bb54-473d-b218-9f6514dc6a95 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:32.280619 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-36ae17c4-bb54-473d-b218-9f6514dc6a95 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:32.282112 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-36ae17c4-bb54-473d-b218-9f6514dc6a95 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:32.283533 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-36ae17c4-bb54-473d-b218-9f6514dc6a95 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:34.006708 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-123166f2-deeb-4f03-bffc-828076fc8078 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:34.035619 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-123166f2-deeb-4f03-bffc-828076fc8078 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers/4a494dac-3446-4569-b154-b14f9eb22b3e" status: 200 len: 1511 microversion: 2.1 time: 2.088229 Jul 18 02:16:34.050575 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 956/1874] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:31 2022] GET /compute/v2.1/servers/4a494dac-3446-4569-b154-b14f9eb22b3e => generated 1511 bytes in 2104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:34.060486 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-26ebc20e-c5d5-4d96-9688-4f77479024fa req-a23f7c49-e62b-4f73-9f0f-b1fbe698eeac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85cf0fec-3e12-4af3-9525-925901fc41d9", "name": "network-vif-deleted", "tag": "6d4cd1b3-4941-4b7c-ae0f-5cb58271177c"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:34.129425 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-26ebc20e-c5d5-4d96-9688-4f77479024fa req-a23f7c49-e62b-4f73-9f0f-b1fbe698eeac service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:34.133380 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-26ebc20e-c5d5-4d96-9688-4f77479024fa req-a23f7c49-e62b-4f73-9f0f-b1fbe698eeac service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:34.182413 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-26ebc20e-c5d5-4d96-9688-4f77479024fa req-a23f7c49-e62b-4f73-9f0f-b1fbe698eeac service nova] Creating event network-vif-deleted:6d4cd1b3-4941-4b7c-ae0f-5cb58271177c for instance 85cf0fec-3e12-4af3-9525-925901fc41d9 on n-h2-465891-3 Jul 18 02:16:34.198075 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-26ebc20e-c5d5-4d96-9688-4f77479024fa req-a23f7c49-e62b-4f73-9f0f-b1fbe698eeac service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145808 Jul 18 02:16:34.199136 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 957/1875] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:34.212949 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-6f318a70-8a55-42e8-aff9-af2458013d69 req-36419e49-3c58-4abd-abe7-70b0691c8c47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ddcf97f-5c13-4ed6-ac5b-17368a126dee", "name": "network-vif-deleted", "tag": "4d6c976a-bead-4367-8b9a-e4a14283ef03"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:34.230352 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-6f318a70-8a55-42e8-aff9-af2458013d69 req-36419e49-3c58-4abd-abe7-70b0691c8c47 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:34.230811 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-6f318a70-8a55-42e8-aff9-af2458013d69 req-36419e49-3c58-4abd-abe7-70b0691c8c47 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:34.258303 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-6f318a70-8a55-42e8-aff9-af2458013d69 req-36419e49-3c58-4abd-abe7-70b0691c8c47 service nova] Creating event network-vif-deleted:4d6c976a-bead-4367-8b9a-e4a14283ef03 for instance 7ddcf97f-5c13-4ed6-ac5b-17368a126dee on n-h2-465891-3 Jul 18 02:16:34.275420 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-6f318a70-8a55-42e8-aff9-af2458013d69 req-36419e49-3c58-4abd-abe7-70b0691c8c47 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074595 Jul 18 02:16:34.276408 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 958/1876] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:34.286511 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d081b61a-d541-4b5a-b9dd-86fc34cc30b9 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:34.287245 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d081b61a-d541-4b5a-b9dd-86fc34cc30b9 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] [instance: 7ddcf97f-5c13-4ed6-ac5b-17368a126dee] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:34.304401 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d081b61a-d541-4b5a-b9dd-86fc34cc30b9 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:34.305164 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d081b61a-d541-4b5a-b9dd-86fc34cc30b9 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:34.306096 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d081b61a-d541-4b5a-b9dd-86fc34cc30b9 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:34.306579 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d081b61a-d541-4b5a-b9dd-86fc34cc30b9 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:34.331129 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-36ae17c4-bb54-473d-b218-9f6514dc6a95 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:34.345026 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-36ae17c4-bb54-473d-b218-9f6514dc6a95 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 200 len: 1706 microversion: 2.1 time: 2.154125 Jul 18 02:16:34.350523 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 919/1877] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:32 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 1706 bytes in 2162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:34.361478 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-d081b61a-d541-4b5a-b9dd-86fc34cc30b9 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] HTTP exception thrown: Instance 7ddcf97f-5c13-4ed6-ac5b-17368a126dee could not be found. Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d081b61a-d541-4b5a-b9dd-86fc34cc30b9 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Request method failure captured: Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee HTTP/1.1 Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MIXqU9CLzTR6iWWJByY77mnTg3xDSFB_iUvapjuDfW78RQ7eFPiG_p0UNkPzgKv57jbgEU6CFRJ3ijl_n08SsCdYWlEuEhBeZHqqWP6A4zamSD3_JEFISiF2bZO5RrGYXIEWAORlNbWMeBEzco7u-gOm7fPjuedguVTYeTb7jD8eBI Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 5ab10eb9b4cc4b13a640f5479056ab79 Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1484112956 Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5ab10eb9b4cc4b13a640f5479056ab79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5ab10eb9b4cc4b13a640f5479056ab79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5ab10eb9b4cc4b13a640f5479056ab79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5ab10eb9b4cc4b13a640f5479056ab79"}]}] Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1484112956 Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 5ab10eb9b4cc4b13a640f5479056ab79 Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1484112956 Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServerRescueTestJSONUnderV235-1484112956-project Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 9472908374c94355ada94f4947c99f6a Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1484112956-project Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 7ddcf97f-5c13-4ed6-ac5b-17368a126dee could not be found. Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '7ddcf97f-5c13-4ed6-ac5b-17368a126dee'} Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ddcf97f-5c13-4ed6-ac5b-17368a126dee could not be found. Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ddcf97f-5c13-4ed6-ac5b-17368a126dee could not be found. Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:16:34.363418 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:16:34.368540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:16:34.368540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:34.368540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:16:34.368540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:16:34.368540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:16:34.368540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:16:34.368540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ddcf97f-5c13-4ed6-ac5b-17368a126dee could not be found. Jul 18 02:16:34.368540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:16:34.368540 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d081b61a-d541-4b5a-b9dd-86fc34cc30b9 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] Returning 404 to user: Instance 7ddcf97f-5c13-4ed6-ac5b-17368a126dee could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:16:34.368540 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d081b61a-d541-4b5a-b9dd-86fc34cc30b9 tempest-ServerRescueTestJSONUnderV235-1484112956 tempest-ServerRescueTestJSONUnderV235-1484112956-project] 10.222.0.57 "GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee" status: 404 len: 111 microversion: 2.1 time: 0.087367 Jul 18 02:16:34.373549 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 959/1878] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:34 2022] GET /compute/v2.1/servers/7ddcf97f-5c13-4ed6-ac5b-17368a126dee => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:16:34.378646 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0202c7de-eceb-48c1-bf02-697ffed6ff36 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:34.379835 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0202c7de-eceb-48c1-bf02-697ffed6ff36 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 85cf0fec-3e12-4af3-9525-925901fc41d9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:34.387734 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-49ec72f3-0b24-4129-823f-499f72d18d31 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a838d670>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:34.405825 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:34.409358 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0202c7de-eceb-48c1-bf02-697ffed6ff36 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:34.410938 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:34.414193 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0202c7de-eceb-48c1-bf02-697ffed6ff36 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:34.415174 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0202c7de-eceb-48c1-bf02-697ffed6ff36 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:34.415623 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0202c7de-eceb-48c1-bf02-697ffed6ff36 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:34.477043 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-49ec72f3-0b24-4129-823f-499f72d18d31 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf" status: 200 len: 1427 microversion: 2.1 time: 0.101858 Jul 18 02:16:34.482917 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 960/1879] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:16:34 2022] GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf => generated 1427 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:34.486578 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-0202c7de-eceb-48c1-bf02-697ffed6ff36 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] HTTP exception thrown: Instance 85cf0fec-3e12-4af3-9525-925901fc41d9 could not be found. Jul 18 02:16:34.488622 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-009956e5-60c9-437b-9287-9932e8ef5581 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:34.492816 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-009956e5-60c9-437b-9287-9932e8ef5581 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:34.493350 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.compute.servers [None req-009956e5-60c9-437b-9287-9932e8ef5581 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Removing options 'limit' from query {{(pid=119544) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0202c7de-eceb-48c1-bf02-697ffed6ff36 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Request method failure captured: Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/85cf0fec-3e12-4af3-9525-925901fc41d9 HTTP/1.1 Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MGCWrWHCddcrN4RqNfnBFPBSabjGvo5gM77Tw6VfoUAuTFYZJ3-CEdjKYax5T5uhOfCuNLEmOh531jNb7qti0OvzfRwr8H4xYd6v1BUcfs9beu0dZ5AWDeHwp-6BMUAWJqOL9IUkCg8_lfh7_6ef8hef4LR8j_2qAWtZaYjzyZxBJ0 Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 8f8bb1ebead3481f946ae7878c3cfc41 Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersOnMultiNodesTest-1310468150 Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8f8bb1ebead3481f946ae7878c3cfc41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8f8bb1ebead3481f946ae7878c3cfc41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8f8bb1ebead3481f946ae7878c3cfc41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8f8bb1ebead3481f946ae7878c3cfc41"}]}] Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersOnMultiNodesTest-1310468150 Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 8f8bb1ebead3481f946ae7878c3cfc41 Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1310468150 Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersOnMultiNodesTest-1310468150-project Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 100f65c0d9d3456fa177599821aed7ff Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersOnMultiNodesTest-1310468150-project Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 85cf0fec-3e12-4af3-9525-925901fc41d9 could not be found. Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '85cf0fec-3e12-4af3-9525-925901fc41d9'} Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85cf0fec-3e12-4af3-9525-925901fc41d9 could not be found. Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85cf0fec-3e12-4af3-9525-925901fc41d9 could not be found. Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:16:34.500419 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:16:34.508591 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:34.508591 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:16:34.508591 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:16:34.508591 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:16:34.508591 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:16:34.508591 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85cf0fec-3e12-4af3-9525-925901fc41d9 could not be found. Jul 18 02:16:34.508591 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:16:34.508591 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0202c7de-eceb-48c1-bf02-697ffed6ff36 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Returning 404 to user: Instance 85cf0fec-3e12-4af3-9525-925901fc41d9 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:16:34.509873 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0202c7de-eceb-48c1-bf02-697ffed6ff36 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/85cf0fec-3e12-4af3-9525-925901fc41d9" status: 404 len: 111 microversion: 2.1 time: 0.156629 Jul 18 02:16:34.513771 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 920/1880] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:34 2022] GET /compute/v2.1/servers/85cf0fec-3e12-4af3-9525-925901fc41d9 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:16:34.514137 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-009956e5-60c9-437b-9287-9932e8ef5581 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Searching by: {'deleted': False, 'project_id': '58dcb69855544ff3b51109aa5d41f637'} {{(pid=119544) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:16:34.514323 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-009956e5-60c9-437b-9287-9932e8ef5581 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:34.521106 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-009956e5-60c9-437b-9287-9932e8ef5581 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:34.522342 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-009956e5-60c9-437b-9287-9932e8ef5581 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:34.522995 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-009956e5-60c9-437b-9287-9932e8ef5581 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:34.527581 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-009956e5-60c9-437b-9287-9932e8ef5581 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.044100 Jul 18 02:16:34.529810 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d7267626-25de-482d-8645-1faddf007280 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:34.530788 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d7267626-25de-482d-8645-1faddf007280 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: e86cd628-160d-4516-ad58-899768acecd9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:34.531455 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 961/1881] 10.222.0.57 () {58 vars in 1139 bytes} [Mon Jul 18 02:16:34 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:16:34.549054 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6487f2b2-1ed6-47bb-97b6-12e86749e154 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Calling method '.version_select at 0x7ff4a834e5e0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:34.574520 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6487f2b2-1ed6-47bb-97b6-12e86749e154 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:34.575051 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d7267626-25de-482d-8645-1faddf007280 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:34.575785 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6487f2b2-1ed6-47bb-97b6-12e86749e154 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:34.576471 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d7267626-25de-482d-8645-1faddf007280 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:34.577481 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d7267626-25de-482d-8645-1faddf007280 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:34.589276 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d7267626-25de-482d-8645-1faddf007280 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:34.611054 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6487f2b2-1ed6-47bb-97b6-12e86749e154 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] 10.222.0.57 "GET /compute/v2.1/os-migrations" status: 200 len: 1933 microversion: 2.1 time: 0.078367 Jul 18 02:16:34.619032 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 962/1882] 10.222.0.57 () {58 vars in 1142 bytes} [Mon Jul 18 02:16:34 2022] GET /compute/v2.1/os-migrations => generated 1933 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:34.619032 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a4341df6-c654-49ed-a5d4-d7b148c33e9c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:34.619032 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a4341df6-c654-49ed-a5d4-d7b148c33e9c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 89bd86f8-830e-44ed-82a9-7b77e67606f8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:34.661376 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a4341df6-c654-49ed-a5d4-d7b148c33e9c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:34.662218 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a4341df6-c654-49ed-a5d4-d7b148c33e9c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:34.663341 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a4341df6-c654-49ed-a5d4-d7b148c33e9c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:34.664884 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a4341df6-c654-49ed-a5d4-d7b148c33e9c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:34.681759 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d7267626-25de-482d-8645-1faddf007280 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: e86cd628-160d-4516-ad58-899768acecd9] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:16:34.730488 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a4341df6-c654-49ed-a5d4-d7b148c33e9c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 89bd86f8-830e-44ed-82a9-7b77e67606f8] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:16:34.990496 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d7267626-25de-482d-8645-1faddf007280 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "DELETE /compute/v2.1/servers/e86cd628-160d-4516-ad58-899768acecd9" status: 204 len: 0 microversion: 2.1 time: 0.478166 Jul 18 02:16:34.992677 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 921/1883] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:16:34 2022] DELETE /compute/v2.1/servers/e86cd628-160d-4516-ad58-899768acecd9 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:34.995072 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a4341df6-c654-49ed-a5d4-d7b148c33e9c tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "DELETE /compute/v2.1/servers/89bd86f8-830e-44ed-82a9-7b77e67606f8" status: 204 len: 0 microversion: 2.1 time: 0.381876 Jul 18 02:16:34.996205 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 963/1884] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:16:34 2022] DELETE /compute/v2.1/servers/89bd86f8-830e-44ed-82a9-7b77e67606f8 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:35.006012 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-26785754-5c25-4526-96e3-f3e8721ba5d6 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:35.010114 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-26785754-5c25-4526-96e3-f3e8721ba5d6 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 4a494dac-3446-4569-b154-b14f9eb22b3e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:35.011979 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-16455795-bec7-498e-b8e7-0b6ad4089e54 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:35.014449 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-16455795-bec7-498e-b8e7-0b6ad4089e54 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:35.034841 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-26785754-5c25-4526-96e3-f3e8721ba5d6 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:35.037838 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-16455795-bec7-498e-b8e7-0b6ad4089e54 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:35.044772 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-16455795-bec7-498e-b8e7-0b6ad4089e54 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:35.046457 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-16455795-bec7-498e-b8e7-0b6ad4089e54 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:35.047045 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-16455795-bec7-498e-b8e7-0b6ad4089e54 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:35.047854 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-26785754-5c25-4526-96e3-f3e8721ba5d6 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:35.053095 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-26785754-5c25-4526-96e3-f3e8721ba5d6 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:35.054189 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-26785754-5c25-4526-96e3-f3e8721ba5d6 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:36.098297 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-16455795-bec7-498e-b8e7-0b6ad4089e54 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 200 len: 1857 microversion: 2.1 time: 1.099727 Jul 18 02:16:36.100078 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 964/1885] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:34 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 1857 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:36.105738 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b4aa51d4-5417-4ec5-81ab-3d32a3b28d3a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:36.106932 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b4aa51d4-5417-4ec5-81ab-3d32a3b28d3a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 89bd86f8-830e-44ed-82a9-7b77e67606f8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:36.115419 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b4aa51d4-5417-4ec5-81ab-3d32a3b28d3a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:36.116689 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b4aa51d4-5417-4ec5-81ab-3d32a3b28d3a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:36.117794 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b4aa51d4-5417-4ec5-81ab-3d32a3b28d3a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:36.118421 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b4aa51d4-5417-4ec5-81ab-3d32a3b28d3a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:36.760977 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-26785754-5c25-4526-96e3-f3e8721ba5d6 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:36.778709 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-26785754-5c25-4526-96e3-f3e8721ba5d6 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers/4a494dac-3446-4569-b154-b14f9eb22b3e" status: 200 len: 1511 microversion: 2.1 time: 1.783876 Jul 18 02:16:36.781234 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 922/1886] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:34 2022] GET /compute/v2.1/servers/4a494dac-3446-4569-b154-b14f9eb22b3e => generated 1511 bytes in 1788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:36.791690 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-20bc71e3-537b-4a9b-a280-d56e752a7ae7 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:36.792491 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-20bc71e3-537b-4a9b-a280-d56e752a7ae7 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: e86cd628-160d-4516-ad58-899768acecd9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:36.807961 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20bc71e3-537b-4a9b-a280-d56e752a7ae7 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:36.811108 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20bc71e3-537b-4a9b-a280-d56e752a7ae7 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:36.813014 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20bc71e3-537b-4a9b-a280-d56e752a7ae7 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:36.817769 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20bc71e3-537b-4a9b-a280-d56e752a7ae7 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:38.005050 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b4aa51d4-5417-4ec5-81ab-3d32a3b28d3a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:38.016255 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b4aa51d4-5417-4ec5-81ab-3d32a3b28d3a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/89bd86f8-830e-44ed-82a9-7b77e67606f8" status: 200 len: 1471 microversion: 2.1 time: 1.914802 Jul 18 02:16:38.018824 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 965/1887] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:36 2022] GET /compute/v2.1/servers/89bd86f8-830e-44ed-82a9-7b77e67606f8 => generated 1471 bytes in 1918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:38.026843 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b452f950-166c-4e42-8760-b7b0dd6220f4 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a838daf0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:38.108986 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-20bc71e3-537b-4a9b-a280-d56e752a7ae7 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe79fa13328b4e40922d0e3e4551a8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6b8514bba84ba8a09c64abbb2d1a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:38.125382 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b452f950-166c-4e42-8760-b7b0dd6220f4 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf" status: 200 len: 1427 microversion: 2.1 time: 0.100877 Jul 18 02:16:38.128970 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-20bc71e3-537b-4a9b-a280-d56e752a7ae7 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "GET /compute/v2.1/servers/e86cd628-160d-4516-ad58-899768acecd9" status: 200 len: 1515 microversion: 2.1 time: 1.341173 Jul 18 02:16:38.130744 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 966/1888] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:16:38 2022] GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf => generated 1427 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:38.135259 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 923/1889] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:36 2022] GET /compute/v2.1/servers/e86cd628-160d-4516-ad58-899768acecd9 => generated 1515 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:38.139642 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b6171c91-1d2c-4718-b012-42aa08418833 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:38.142381 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b6171c91-1d2c-4718-b012-42aa08418833 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:38.144286 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-5aadefd2-1a0b-47fd-a77f-32284e5b8225 req-285fef2d-a69f-433f-ad50-4956e471ce10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19592434-cafa-4e79-a790-0674ab77672f", "name": "network-vif-unplugged", "status": "completed", "tag": "4c9f9136-52be-4062-9d09-7fd94b7a5870"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:38.157342 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6171c91-1d2c-4718-b012-42aa08418833 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:38.161382 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6171c91-1d2c-4718-b012-42aa08418833 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:38.164161 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-5aadefd2-1a0b-47fd-a77f-32284e5b8225 req-285fef2d-a69f-433f-ad50-4956e471ce10 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:38.165444 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6171c91-1d2c-4718-b012-42aa08418833 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:38.166110 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6171c91-1d2c-4718-b012-42aa08418833 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:38.170447 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-5aadefd2-1a0b-47fd-a77f-32284e5b8225 req-285fef2d-a69f-433f-ad50-4956e471ce10 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:38.198122 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-5aadefd2-1a0b-47fd-a77f-32284e5b8225 req-285fef2d-a69f-433f-ad50-4956e471ce10 service nova] Creating event network-vif-unplugged:4c9f9136-52be-4062-9d09-7fd94b7a5870 for instance 19592434-cafa-4e79-a790-0674ab77672f on n-h1-465891-3 Jul 18 02:16:38.211255 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-5aadefd2-1a0b-47fd-a77f-32284e5b8225 req-285fef2d-a69f-433f-ad50-4956e471ce10 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074467 Jul 18 02:16:38.212930 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 924/1890] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:38.218690 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7bebf7a8-3c3c-4f92-9a18-fc8d85ff0d49 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:38.223099 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7bebf7a8-3c3c-4f92-9a18-fc8d85ff0d49 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 11caf39a-9515-4e04-b244-3be043262875] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:38.246226 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7bebf7a8-3c3c-4f92-9a18-fc8d85ff0d49 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:38.247129 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7bebf7a8-3c3c-4f92-9a18-fc8d85ff0d49 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:38.248203 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7bebf7a8-3c3c-4f92-9a18-fc8d85ff0d49 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:38.248881 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7bebf7a8-3c3c-4f92-9a18-fc8d85ff0d49 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:38.638399 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-b6171c91-1d2c-4718-b012-42aa08418833 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lazy-loading 'services' on Instance uuid 19592434-cafa-4e79-a790-0674ab77672f {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:16:39.069974 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b6171c91-1d2c-4718-b012-42aa08418833 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "DELETE /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f/os-volume_attachments/3e0d785f-a071-4a01-b6aa-b3319594b5f1" status: 202 len: 0 microversion: 2.1 time: 0.935098 Jul 18 02:16:39.077450 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 967/1891] 10.222.0.57 () {58 vars in 1415 bytes} [Mon Jul 18 02:16:38 2022] DELETE /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f/os-volume_attachments/3e0d785f-a071-4a01-b6aa-b3319594b5f1 => generated 0 bytes in 946 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:16:39.092550 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-d4ce8941-479f-44bf-9f1b-d3a8addf7b6e req-3b23fe64-b7c1-4fe1-aba3-ddac6d941c7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e86cd628-160d-4516-ad58-899768acecd9", "name": "network-vif-deleted", "tag": "68490722-4f41-4a28-aca9-a8f598e9d8dd"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:39.183856 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-d4ce8941-479f-44bf-9f1b-d3a8addf7b6e req-3b23fe64-b7c1-4fe1-aba3-ddac6d941c7b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:39.186353 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-d4ce8941-479f-44bf-9f1b-d3a8addf7b6e req-3b23fe64-b7c1-4fe1-aba3-ddac6d941c7b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:39.225948 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-d4ce8941-479f-44bf-9f1b-d3a8addf7b6e req-3b23fe64-b7c1-4fe1-aba3-ddac6d941c7b service nova] Creating event network-vif-deleted:68490722-4f41-4a28-aca9-a8f598e9d8dd for instance e86cd628-160d-4516-ad58-899768acecd9 on n-h1-465891-3 Jul 18 02:16:39.246267 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-d4ce8941-479f-44bf-9f1b-d3a8addf7b6e req-3b23fe64-b7c1-4fe1-aba3-ddac6d941c7b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164825 Jul 18 02:16:39.247022 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 968/1892] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:39.274087 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0e0fc001-715c-48df-84c3-11fcde282021 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:39.275425 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0e0fc001-715c-48df-84c3-11fcde282021 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 89bd86f8-830e-44ed-82a9-7b77e67606f8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:39.286483 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0e0fc001-715c-48df-84c3-11fcde282021 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:39.296939 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0e0fc001-715c-48df-84c3-11fcde282021 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:39.298112 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0e0fc001-715c-48df-84c3-11fcde282021 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:39.298710 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0e0fc001-715c-48df-84c3-11fcde282021 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:39.508868 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7bebf7a8-3c3c-4f92-9a18-fc8d85ff0d49 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:39.556742 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7bebf7a8-3c3c-4f92-9a18-fc8d85ff0d49 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers/11caf39a-9515-4e04-b244-3be043262875" status: 200 len: 1511 microversion: 2.1 time: 1.333041 Jul 18 02:16:39.560555 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 925/1893] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:38 2022] GET /compute/v2.1/servers/11caf39a-9515-4e04-b244-3be043262875 => generated 1511 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:39.588002 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-46be951a-5857-4186-8bee-150b27c0931d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:39.589379 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-46be951a-5857-4186-8bee-150b27c0931d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:39.612060 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-46be951a-5857-4186-8bee-150b27c0931d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:39.613602 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-46be951a-5857-4186-8bee-150b27c0931d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:39.614827 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-46be951a-5857-4186-8bee-150b27c0931d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:39.615477 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-46be951a-5857-4186-8bee-150b27c0931d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:39.714239 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-46be951a-5857-4186-8bee-150b27c0931d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.151374 Jul 18 02:16:39.723207 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 926/1894] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:16:39 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:39.738665 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7ad39dfe-1c73-4373-ba8b-5c2040db3b8d tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4adcb6e50>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:39.842051 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7ad39dfe-1c73-4373-ba8b-5c2040db3b8d tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf" status: 200 len: 1427 microversion: 2.1 time: 0.116936 Jul 18 02:16:39.842655 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 927/1895] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:16:39 2022] GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf => generated 1427 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:39.877734 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2298d25b-6e8f-4e09-91b0-e87a870f826f tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:39.895067 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2298d25b-6e8f-4e09-91b0-e87a870f826f tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: e86cd628-160d-4516-ad58-899768acecd9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:39.922810 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2298d25b-6e8f-4e09-91b0-e87a870f826f tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:39.923692 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2298d25b-6e8f-4e09-91b0-e87a870f826f tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:39.925627 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2298d25b-6e8f-4e09-91b0-e87a870f826f tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:39.926342 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2298d25b-6e8f-4e09-91b0-e87a870f826f tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:39.967344 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-2298d25b-6e8f-4e09-91b0-e87a870f826f tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] HTTP exception thrown: Instance e86cd628-160d-4516-ad58-899768acecd9 could not be found. Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2298d25b-6e8f-4e09-91b0-e87a870f826f tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Request method failure captured: Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/e86cd628-160d-4516-ad58-899768acecd9 HTTP/1.1 Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MGQv7RbdlIe47Q-n5a7bHCAXP4uAfsxHZNZyO7aXRp9yCPq4dGOm3hoc3mS4zwQJB8fV0ozvdPNbpJXhpp8m_8QMYVMXorZ4biT6OhIRRlQVDib6X6zyRLGcGhlwYKUzB3X5IBJUHNF6K_ry3ENWbMAStM1H1DkAnVVnOmoxHZS_eg Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: fb6b8514bba84ba8a09c64abbb2d1a2e Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-VolumesAdminNegativeTest-546332838 Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fb6b8514bba84ba8a09c64abbb2d1a2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fb6b8514bba84ba8a09c64abbb2d1a2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fb6b8514bba84ba8a09c64abbb2d1a2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fb6b8514bba84ba8a09c64abbb2d1a2e"}]}] Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-VolumesAdminNegativeTest-546332838 Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: fb6b8514bba84ba8a09c64abbb2d1a2e Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-546332838 Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-VolumesAdminNegativeTest-546332838-project Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: fe79fa13328b4e40922d0e3e4551a8e8 Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-VolumesAdminNegativeTest-546332838-project Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance e86cd628-160d-4516-ad58-899768acecd9 could not be found. Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'e86cd628-160d-4516-ad58-899768acecd9'} Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e86cd628-160d-4516-ad58-899768acecd9 could not be found. Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e86cd628-160d-4516-ad58-899768acecd9 could not be found. Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:16:39.971851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:16:39.983023 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:39.983023 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:16:39.983023 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:16:39.983023 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:16:39.983023 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:16:39.983023 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e86cd628-160d-4516-ad58-899768acecd9 could not be found. Jul 18 02:16:39.983023 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:16:39.989755 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2298d25b-6e8f-4e09-91b0-e87a870f826f tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Returning 404 to user: Instance e86cd628-160d-4516-ad58-899768acecd9 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:16:39.991613 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2298d25b-6e8f-4e09-91b0-e87a870f826f tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "GET /compute/v2.1/servers/e86cd628-160d-4516-ad58-899768acecd9" status: 404 len: 111 microversion: 2.1 time: 0.123721 Jul 18 02:16:39.993302 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 928/1896] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:39 2022] GET /compute/v2.1/servers/e86cd628-160d-4516-ad58-899768acecd9 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:16:40.004387 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-89fb367b-ae16-4c6d-9b2e-70053554a1e5 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:40.006137 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-89fb367b-ae16-4c6d-9b2e-70053554a1e5 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 25d7575c-c9a7-4dba-8f13-6c57e988af59] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:40.027568 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-89fb367b-ae16-4c6d-9b2e-70053554a1e5 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:40.029838 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-89fb367b-ae16-4c6d-9b2e-70053554a1e5 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:40.032471 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-89fb367b-ae16-4c6d-9b2e-70053554a1e5 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:40.034057 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-89fb367b-ae16-4c6d-9b2e-70053554a1e5 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:41.112029 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0e0fc001-715c-48df-84c3-11fcde282021 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:41.129610 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0e0fc001-715c-48df-84c3-11fcde282021 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/89bd86f8-830e-44ed-82a9-7b77e67606f8" status: 200 len: 1471 microversion: 2.1 time: 1.881195 Jul 18 02:16:41.143474 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 969/1897] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:39 2022] GET /compute/v2.1/servers/89bd86f8-830e-44ed-82a9-7b77e67606f8 => generated 1471 bytes in 1896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:41.149092 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e12b65f1-1bc1-4d45-b8de-411177631f78 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:41.150513 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e12b65f1-1bc1-4d45-b8de-411177631f78 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:41.158687 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e12b65f1-1bc1-4d45-b8de-411177631f78 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:41.159861 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e12b65f1-1bc1-4d45-b8de-411177631f78 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:41.161015 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e12b65f1-1bc1-4d45-b8de-411177631f78 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:41.161830 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e12b65f1-1bc1-4d45-b8de-411177631f78 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:41.186807 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:41.200263 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e12b65f1-1bc1-4d45-b8de-411177631f78 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055069 Jul 18 02:16:41.201622 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 970/1898] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:16:41 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:41.207350 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-ec30b906-9ab9-492f-a0c3-30f865b8cc5d req-5b0d1511-78df-4f1a-a08f-07b3ebecffce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19592434-cafa-4e79-a790-0674ab77672f", "tag": "4c9f9136-52be-4062-9d09-7fd94b7a5870"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:41.218790 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-ec30b906-9ab9-492f-a0c3-30f865b8cc5d req-5b0d1511-78df-4f1a-a08f-07b3ebecffce service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:41.220211 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-ec30b906-9ab9-492f-a0c3-30f865b8cc5d req-5b0d1511-78df-4f1a-a08f-07b3ebecffce service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:41.234610 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-ec30b906-9ab9-492f-a0c3-30f865b8cc5d req-5b0d1511-78df-4f1a-a08f-07b3ebecffce service nova] Creating event network-changed:4c9f9136-52be-4062-9d09-7fd94b7a5870 for instance 19592434-cafa-4e79-a790-0674ab77672f on n-h1-465891-3 Jul 18 02:16:41.241322 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-ec30b906-9ab9-492f-a0c3-30f865b8cc5d req-5b0d1511-78df-4f1a-a08f-07b3ebecffce service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038094 Jul 18 02:16:41.242480 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 971/1899] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:41.248178 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ff3cf636-7598-460d-ac76-ae8812c04b05 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a83244c0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:41.305621 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ff3cf636-7598-460d-ac76-ae8812c04b05 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf" status: 200 len: 1427 microversion: 2.1 time: 0.061533 Jul 18 02:16:41.307029 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 972/1900] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:16:41 2022] GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf => generated 1427 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:41.314364 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-879a3ca9-0073-4a13-b3b6-593ef4dc25b7 req-d9549cbb-d70b-4b48-82a5-c03328289a1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19592434-cafa-4e79-a790-0674ab77672f", "name": "network-vif-plugged", "status": "completed", "tag": "4c9f9136-52be-4062-9d09-7fd94b7a5870"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:41.325237 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-879a3ca9-0073-4a13-b3b6-593ef4dc25b7 req-d9549cbb-d70b-4b48-82a5-c03328289a1b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:41.326262 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-879a3ca9-0073-4a13-b3b6-593ef4dc25b7 req-d9549cbb-d70b-4b48-82a5-c03328289a1b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:41.340454 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-879a3ca9-0073-4a13-b3b6-593ef4dc25b7 req-d9549cbb-d70b-4b48-82a5-c03328289a1b service nova] Creating event network-vif-plugged:4c9f9136-52be-4062-9d09-7fd94b7a5870 for instance 19592434-cafa-4e79-a790-0674ab77672f on n-h1-465891-3 Jul 18 02:16:41.347010 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-879a3ca9-0073-4a13-b3b6-593ef4dc25b7 req-d9549cbb-d70b-4b48-82a5-c03328289a1b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038422 Jul 18 02:16:41.348372 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 973/1901] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:42.152626 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-534bd2c5-3517-4589-ae01-f9d4f55e1240 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:42.154316 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-534bd2c5-3517-4589-ae01-f9d4f55e1240 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 89bd86f8-830e-44ed-82a9-7b77e67606f8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:42.178071 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-534bd2c5-3517-4589-ae01-f9d4f55e1240 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:42.181382 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-534bd2c5-3517-4589-ae01-f9d4f55e1240 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:42.186936 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-534bd2c5-3517-4589-ae01-f9d4f55e1240 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:42.187694 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-534bd2c5-3517-4589-ae01-f9d4f55e1240 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:42.374977 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-89fb367b-ae16-4c6d-9b2e-70053554a1e5 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:42.395995 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-89fb367b-ae16-4c6d-9b2e-70053554a1e5 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers/25d7575c-c9a7-4dba-8f13-6c57e988af59" status: 200 len: 1512 microversion: 2.1 time: 2.395854 Jul 18 02:16:42.410868 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 929/1902] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:39 2022] GET /compute/v2.1/servers/25d7575c-c9a7-4dba-8f13-6c57e988af59 => generated 1512 bytes in 2416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:42.414622 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-534bd2c5-3517-4589-ae01-f9d4f55e1240 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:42.434309 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-10cc8f70-aed0-408f-bbcf-4d1663ad6c91 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:42.435363 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-10cc8f70-aed0-408f-bbcf-4d1663ad6c91 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:42.439674 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-534bd2c5-3517-4589-ae01-f9d4f55e1240 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/89bd86f8-830e-44ed-82a9-7b77e67606f8" status: 200 len: 1429 microversion: 2.1 time: 0.291886 Jul 18 02:16:42.452687 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 974/1903] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:42 2022] GET /compute/v2.1/servers/89bd86f8-830e-44ed-82a9-7b77e67606f8 => generated 1429 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:42.466142 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-10cc8f70-aed0-408f-bbcf-4d1663ad6c91 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:42.466603 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-10cc8f70-aed0-408f-bbcf-4d1663ad6c91 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:42.471394 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-10cc8f70-aed0-408f-bbcf-4d1663ad6c91 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:42.472192 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-10cc8f70-aed0-408f-bbcf-4d1663ad6c91 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:42.482879 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e793f389-ba2b-4d90-b673-e251da3b8d18 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a85141f0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:42.498529 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:42.544275 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-10cc8f70-aed0-408f-bbcf-4d1663ad6c91 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125638 Jul 18 02:16:42.550974 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 930/1904] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:16:42 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:42.557625 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2b477806-ce0a-4e30-90a6-06fe7a4b5d86 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:42.562756 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2b477806-ce0a-4e30-90a6-06fe7a4b5d86 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:42.564021 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2b477806-ce0a-4e30-90a6-06fe7a4b5d86 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Searching by: {'ip': '172.20.0.8', 'deleted': False, 'project_id': '58dcb69855544ff3b51109aa5d41f637'} {{(pid=119543) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:16:42.611717 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e793f389-ba2b-4d90-b673-e251da3b8d18 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf" status: 200 len: 1427 microversion: 2.1 time: 0.156322 Jul 18 02:16:42.624219 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 975/1905] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:16:42 2022] GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf => generated 1427 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:42.857609 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b477806-ce0a-4e30-90a6-06fe7a4b5d86 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:42.858537 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b477806-ce0a-4e30-90a6-06fe7a4b5d86 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:42.861662 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b477806-ce0a-4e30-90a6-06fe7a4b5d86 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:42.863634 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b477806-ce0a-4e30-90a6-06fe7a4b5d86 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:43.215082 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.multi_cell_list [None req-2b477806-ce0a-4e30-90a6-06fe7a4b5d86 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119543) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:16:43.362187 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2b477806-ce0a-4e30-90a6-06fe7a4b5d86 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers?ip=172.20.0.8" status: 200 len: 345 microversion: 2.1 time: 0.808901 Jul 18 02:16:43.365683 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 931/1906] 10.222.0.57 () {58 vars in 1151 bytes} [Mon Jul 18 02:16:42 2022] GET /compute/v2.1/servers?ip=172.20.0.8 => generated 345 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:43.389984 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7bce9839-7895-47e1-ae93-72249be6c6c9 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:43.398024 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7bce9839-7895-47e1-ae93-72249be6c6c9 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 4a494dac-3446-4569-b154-b14f9eb22b3e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:43.434527 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7bce9839-7895-47e1-ae93-72249be6c6c9 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:43.439282 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7bce9839-7895-47e1-ae93-72249be6c6c9 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:43.443594 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7bce9839-7895-47e1-ae93-72249be6c6c9 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:43.446726 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7bce9839-7895-47e1-ae93-72249be6c6c9 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:43.465197 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-47473f32-2e5b-40ca-af0d-f085e9badd11 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:43.467342 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-47473f32-2e5b-40ca-af0d-f085e9badd11 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 89bd86f8-830e-44ed-82a9-7b77e67606f8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:43.488408 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-47473f32-2e5b-40ca-af0d-f085e9badd11 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:43.494721 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-47473f32-2e5b-40ca-af0d-f085e9badd11 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:43.500727 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-47473f32-2e5b-40ca-af0d-f085e9badd11 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:43.501307 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-47473f32-2e5b-40ca-af0d-f085e9badd11 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:43.567889 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-47473f32-2e5b-40ca-af0d-f085e9badd11 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] HTTP exception thrown: Instance 89bd86f8-830e-44ed-82a9-7b77e67606f8 could not be found. Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-47473f32-2e5b-40ca-af0d-f085e9badd11 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Request method failure captured: Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/89bd86f8-830e-44ed-82a9-7b77e67606f8 HTTP/1.1 Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MGCWrWHCddcrN4RqNfnBFPBSabjGvo5gM77Tw6VfoUAuTFYZJ3-CEdjKYax5T5uhOfCuNLEmOh531jNb7qti0OvzfRwr8H4xYd6v1BUcfs9beu0dZ5AWDeHwp-6BMUAWJqOL9IUkCg8_lfh7_6ef8hef4LR8j_2qAWtZaYjzyZxBJ0 Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 8f8bb1ebead3481f946ae7878c3cfc41 Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersOnMultiNodesTest-1310468150 Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8f8bb1ebead3481f946ae7878c3cfc41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8f8bb1ebead3481f946ae7878c3cfc41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8f8bb1ebead3481f946ae7878c3cfc41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8f8bb1ebead3481f946ae7878c3cfc41"}]}] Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersOnMultiNodesTest-1310468150 Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 8f8bb1ebead3481f946ae7878c3cfc41 Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1310468150 Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersOnMultiNodesTest-1310468150-project Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 100f65c0d9d3456fa177599821aed7ff Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersOnMultiNodesTest-1310468150-project Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 89bd86f8-830e-44ed-82a9-7b77e67606f8 could not be found. Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '89bd86f8-830e-44ed-82a9-7b77e67606f8'} Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89bd86f8-830e-44ed-82a9-7b77e67606f8 could not be found. Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89bd86f8-830e-44ed-82a9-7b77e67606f8 could not be found. Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:16:43.571748 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:16:43.579876 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:43.579876 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:16:43.579876 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:16:43.579876 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:16:43.579876 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:16:43.579876 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89bd86f8-830e-44ed-82a9-7b77e67606f8 could not be found. Jul 18 02:16:43.579876 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:16:43.589834 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-47473f32-2e5b-40ca-af0d-f085e9badd11 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Returning 404 to user: Instance 89bd86f8-830e-44ed-82a9-7b77e67606f8 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:16:43.592406 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-47473f32-2e5b-40ca-af0d-f085e9badd11 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/89bd86f8-830e-44ed-82a9-7b77e67606f8" status: 404 len: 111 microversion: 2.1 time: 0.132880 Jul 18 02:16:43.596825 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 932/1907] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:43 2022] GET /compute/v2.1/servers/89bd86f8-830e-44ed-82a9-7b77e67606f8 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:16:43.624150 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9f0cfccf-5493-46d1-9bff-c819f20f5729 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:43.641189 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9f0cfccf-5493-46d1-9bff-c819f20f5729 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:43.692159 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9f0cfccf-5493-46d1-9bff-c819f20f5729 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:43.692764 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9f0cfccf-5493-46d1-9bff-c819f20f5729 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:43.693634 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9f0cfccf-5493-46d1-9bff-c819f20f5729 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:43.694114 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9f0cfccf-5493-46d1-9bff-c819f20f5729 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:43.840698 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9f0cfccf-5493-46d1-9bff-c819f20f5729 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.241760 Jul 18 02:16:43.841334 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 933/1908] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:16:43 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f/os-volume_attachments => generated 197 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:43.869905 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-1a0cd72d-4392-4c92-bf5a-03e5364420db req-9ab18cf4-2ee0-4dd1-9378-ff301cf64bda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89bd86f8-830e-44ed-82a9-7b77e67606f8", "name": "network-vif-deleted", "tag": "98d74ed7-ac53-4ee9-ba76-5139d7273944"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:43.897549 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-1a0cd72d-4392-4c92-bf5a-03e5364420db req-9ab18cf4-2ee0-4dd1-9378-ff301cf64bda service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:43.903658 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-1a0cd72d-4392-4c92-bf5a-03e5364420db req-9ab18cf4-2ee0-4dd1-9378-ff301cf64bda service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:43.966345 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-1a0cd72d-4392-4c92-bf5a-03e5364420db req-9ab18cf4-2ee0-4dd1-9378-ff301cf64bda service nova] Creating event network-vif-deleted:98d74ed7-ac53-4ee9-ba76-5139d7273944 for instance 89bd86f8-830e-44ed-82a9-7b77e67606f8 on n-h2-465891-3 Jul 18 02:16:44.017509 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-1a0cd72d-4392-4c92-bf5a-03e5364420db req-9ab18cf4-2ee0-4dd1-9378-ff301cf64bda service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154144 Jul 18 02:16:44.017509 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 934/1909] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:44.031799 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-715216ee-c032-4c54-a0a7-6a8683d49935 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:44.032833 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-715216ee-c032-4c54-a0a7-6a8683d49935 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 465df230-ba3a-430a-935d-dc0a7fb83462] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:44.072415 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-715216ee-c032-4c54-a0a7-6a8683d49935 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:44.073801 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-715216ee-c032-4c54-a0a7-6a8683d49935 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:44.082430 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-715216ee-c032-4c54-a0a7-6a8683d49935 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:44.083720 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-715216ee-c032-4c54-a0a7-6a8683d49935 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:44.088776 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7bce9839-7895-47e1-ae93-72249be6c6c9 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:44.116956 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7bce9839-7895-47e1-ae93-72249be6c6c9 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers/4a494dac-3446-4569-b154-b14f9eb22b3e" status: 200 len: 1511 microversion: 2.1 time: 0.739940 Jul 18 02:16:44.153965 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 976/1910] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:43 2022] GET /compute/v2.1/servers/4a494dac-3446-4569-b154-b14f9eb22b3e => generated 1511 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:44.188461 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-efc5b262-5d86-466e-8024-36613111b693 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a9211550>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:44.209781 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-715216ee-c032-4c54-a0a7-6a8683d49935 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 465df230-ba3a-430a-935d-dc0a7fb83462] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:16:44.385146 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-efc5b262-5d86-466e-8024-36613111b693 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf" status: 200 len: 1427 microversion: 2.1 time: 0.225881 Jul 18 02:16:44.389191 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 977/1911] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:16:44 2022] GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf => generated 1427 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:44.411485 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4c1ed6b7-0b9c-4fb1-97f2-82c38c0981c3 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:44.418395 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4c1ed6b7-0b9c-4fb1-97f2-82c38c0981c3 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 11caf39a-9515-4e04-b244-3be043262875] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:44.471253 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4c1ed6b7-0b9c-4fb1-97f2-82c38c0981c3 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:44.471730 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4c1ed6b7-0b9c-4fb1-97f2-82c38c0981c3 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:44.473347 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4c1ed6b7-0b9c-4fb1-97f2-82c38c0981c3 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:44.475829 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4c1ed6b7-0b9c-4fb1-97f2-82c38c0981c3 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:44.725509 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-715216ee-c032-4c54-a0a7-6a8683d49935 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "DELETE /compute/v2.1/servers/465df230-ba3a-430a-935d-dc0a7fb83462" status: 204 len: 0 microversion: 2.1 time: 0.708949 Jul 18 02:16:44.732952 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 935/1912] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:16:44 2022] DELETE /compute/v2.1/servers/465df230-ba3a-430a-935d-dc0a7fb83462 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:44.762544 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-772b329a-727e-444d-82e1-aab6b523d1b3 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:44.764842 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-772b329a-727e-444d-82e1-aab6b523d1b3 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c8ba5e49-8aa4-4b43-9273-16be87705a48] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:44.790162 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-772b329a-727e-444d-82e1-aab6b523d1b3 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:44.793372 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-772b329a-727e-444d-82e1-aab6b523d1b3 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:44.795115 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-772b329a-727e-444d-82e1-aab6b523d1b3 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:44.798148 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-772b329a-727e-444d-82e1-aab6b523d1b3 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:44.912814 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-772b329a-727e-444d-82e1-aab6b523d1b3 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c8ba5e49-8aa4-4b43-9273-16be87705a48] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:16:45.261257 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-772b329a-727e-444d-82e1-aab6b523d1b3 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c8ba5e49-8aa4-4b43-9273-16be87705a48" status: 204 len: 0 microversion: 2.1 time: 0.518523 Jul 18 02:16:45.263058 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 936/1913] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:16:44 2022] DELETE /compute/v2.1/servers/c8ba5e49-8aa4-4b43-9273-16be87705a48 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:45.272823 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-969c4226-0f46-4ad1-b53f-17c3366fe945 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:45.274656 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-969c4226-0f46-4ad1-b53f-17c3366fe945 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:45.283672 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-969c4226-0f46-4ad1-b53f-17c3366fe945 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:45.284754 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-969c4226-0f46-4ad1-b53f-17c3366fe945 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:45.285983 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-969c4226-0f46-4ad1-b53f-17c3366fe945 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:45.286758 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-969c4226-0f46-4ad1-b53f-17c3366fe945 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:45.325814 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-969c4226-0f46-4ad1-b53f-17c3366fe945 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060858 Jul 18 02:16:45.327229 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 937/1914] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:16:45 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:45.334012 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9ab38ed8-1a14-4aff-ac0d-7fb19a9a1715 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:45.335132 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9ab38ed8-1a14-4aff-ac0d-7fb19a9a1715 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 465df230-ba3a-430a-935d-dc0a7fb83462] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:45.345487 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9ab38ed8-1a14-4aff-ac0d-7fb19a9a1715 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:45.346456 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9ab38ed8-1a14-4aff-ac0d-7fb19a9a1715 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:45.347625 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9ab38ed8-1a14-4aff-ac0d-7fb19a9a1715 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:45.348376 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9ab38ed8-1a14-4aff-ac0d-7fb19a9a1715 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:46.323582 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4c1ed6b7-0b9c-4fb1-97f2-82c38c0981c3 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:46.368236 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4c1ed6b7-0b9c-4fb1-97f2-82c38c0981c3 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers/11caf39a-9515-4e04-b244-3be043262875" status: 200 len: 1511 microversion: 2.1 time: 1.969149 Jul 18 02:16:46.374381 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 978/1915] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:44 2022] GET /compute/v2.1/servers/11caf39a-9515-4e04-b244-3be043262875 => generated 1511 bytes in 1982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:46.413962 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2c1b0ed9-9e03-45d1-9a01-bd05d403c40f tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a8399b80>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:46.558790 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2c1b0ed9-9e03-45d1-9a01-bd05d403c40f tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf" status: 200 len: 1427 microversion: 2.1 time: 0.179649 Jul 18 02:16:46.565671 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 979/1916] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:16:46 2022] GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf => generated 1427 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:46.586535 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c98c4992-5577-4b84-889b-80d59ae029d9 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:46.588443 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c98c4992-5577-4b84-889b-80d59ae029d9 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:46.601297 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:46.634893 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c98c4992-5577-4b84-889b-80d59ae029d9 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:46.640047 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c98c4992-5577-4b84-889b-80d59ae029d9 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:46.641802 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c98c4992-5577-4b84-889b-80d59ae029d9 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:46.642588 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c98c4992-5577-4b84-889b-80d59ae029d9 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:46.786725 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c98c4992-5577-4b84-889b-80d59ae029d9 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.215399 Jul 18 02:16:46.788204 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 980/1917] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:16:46 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f/os-volume_attachments => generated 197 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:46.802370 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9ab38ed8-1a14-4aff-ac0d-7fb19a9a1715 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:46.833260 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5f91a551-57df-4aa6-8fa2-5479f4517f3b tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:46.844897 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9ab38ed8-1a14-4aff-ac0d-7fb19a9a1715 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/465df230-ba3a-430a-935d-dc0a7fb83462" status: 200 len: 1474 microversion: 2.1 time: 1.514121 Jul 18 02:16:46.846897 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5f91a551-57df-4aa6-8fa2-5479f4517f3b tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 25d7575c-c9a7-4dba-8f13-6c57e988af59] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:46.883518 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 938/1918] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:45 2022] GET /compute/v2.1/servers/465df230-ba3a-430a-935d-dc0a7fb83462 => generated 1474 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:46.904968 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5f91a551-57df-4aa6-8fa2-5479f4517f3b tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:46.909351 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5f91a551-57df-4aa6-8fa2-5479f4517f3b tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:46.914444 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5f91a551-57df-4aa6-8fa2-5479f4517f3b tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:46.915914 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5f91a551-57df-4aa6-8fa2-5479f4517f3b tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:47.585379 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-28532220-4a5b-4ea9-ab65-dc57b2dd2cc9 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4adcb6af0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:47.794960 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-28532220-4a5b-4ea9-ab65-dc57b2dd2cc9 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf" status: 200 len: 1427 microversion: 2.1 time: 0.224042 Jul 18 02:16:47.807694 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 939/1919] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:16:47 2022] GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf => generated 1427 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:47.807694 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1cef5d2c-e422-4ed8-9b58-b815d8de74c5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:47.807694 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1cef5d2c-e422-4ed8-9b58-b815d8de74c5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:47.815515 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1cef5d2c-e422-4ed8-9b58-b815d8de74c5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:47.815993 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1cef5d2c-e422-4ed8-9b58-b815d8de74c5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:47.817054 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1cef5d2c-e422-4ed8-9b58-b815d8de74c5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:47.817671 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1cef5d2c-e422-4ed8-9b58-b815d8de74c5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:47.903254 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1cef5d2c-e422-4ed8-9b58-b815d8de74c5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103915 Jul 18 02:16:47.905279 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 940/1920] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:16:47 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:47.922900 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5f91a551-57df-4aa6-8fa2-5479f4517f3b tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:47.929339 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3b069dc3-9210-4c98-935c-ce0001b0411d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:47.930929 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3b069dc3-9210-4c98-935c-ce0001b0411d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 465df230-ba3a-430a-935d-dc0a7fb83462] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:47.958755 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5f91a551-57df-4aa6-8fa2-5479f4517f3b tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers/25d7575c-c9a7-4dba-8f13-6c57e988af59" status: 200 len: 1512 microversion: 2.1 time: 1.164302 Jul 18 02:16:47.961224 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 981/1921] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:46 2022] GET /compute/v2.1/servers/25d7575c-c9a7-4dba-8f13-6c57e988af59 => generated 1512 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:47.961410 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3b069dc3-9210-4c98-935c-ce0001b0411d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:47.963040 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3b069dc3-9210-4c98-935c-ce0001b0411d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:47.964540 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3b069dc3-9210-4c98-935c-ce0001b0411d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:47.965421 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3b069dc3-9210-4c98-935c-ce0001b0411d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:47.982012 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d62b6696-1035-48f4-ad98-bca1bbae9af6 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:48.004505 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d62b6696-1035-48f4-ad98-bca1bbae9af6 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:48.013797 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d62b6696-1035-48f4-ad98-bca1bbae9af6 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Searching by: {'deleted': False, 'project_id': '58dcb69855544ff3b51109aa5d41f637'} {{(pid=119544) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:16:48.042286 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d62b6696-1035-48f4-ad98-bca1bbae9af6 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:48.046376 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d62b6696-1035-48f4-ad98-bca1bbae9af6 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:48.049780 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d62b6696-1035-48f4-ad98-bca1bbae9af6 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:48.055013 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d62b6696-1035-48f4-ad98-bca1bbae9af6 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:48.147029 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.multi_cell_list [None req-d62b6696-1035-48f4-ad98-bca1bbae9af6 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119544) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:16:48.395365 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d62b6696-1035-48f4-ad98-bca1bbae9af6 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:48.443894 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d62b6696-1035-48f4-ad98-bca1bbae9af6 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:48.445832 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d62b6696-1035-48f4-ad98-bca1bbae9af6 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:50.027056 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3b069dc3-9210-4c98-935c-ce0001b0411d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:50.051818 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3b069dc3-9210-4c98-935c-ce0001b0411d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/465df230-ba3a-430a-935d-dc0a7fb83462" status: 200 len: 1474 microversion: 2.1 time: 2.144153 Jul 18 02:16:50.066215 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 941/1922] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:47 2022] GET /compute/v2.1/servers/465df230-ba3a-430a-935d-dc0a7fb83462 => generated 1474 bytes in 2160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:50.081445 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-8c317c09-acfd-459b-80a8-d396e03c5893 req-ad40a631-b333-4c20-ad3c-4ac09632c9df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ba5e49-8aa4-4b43-9273-16be87705a48", "name": "network-vif-deleted", "tag": "e6e21fca-05de-4332-a05b-960df4333930"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:50.118126 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-8c317c09-acfd-459b-80a8-d396e03c5893 req-ad40a631-b333-4c20-ad3c-4ac09632c9df service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:50.119044 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-8c317c09-acfd-459b-80a8-d396e03c5893 req-ad40a631-b333-4c20-ad3c-4ac09632c9df service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:50.141946 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-8c317c09-acfd-459b-80a8-d396e03c5893 req-ad40a631-b333-4c20-ad3c-4ac09632c9df service nova] Creating event network-vif-deleted:e6e21fca-05de-4332-a05b-960df4333930 for instance c8ba5e49-8aa4-4b43-9273-16be87705a48 on n-h2-465891-3 Jul 18 02:16:50.152698 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-8c317c09-acfd-459b-80a8-d396e03c5893 req-ad40a631-b333-4c20-ad3c-4ac09632c9df service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084786 Jul 18 02:16:50.154024 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 942/1923] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:50.164211 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a94bab40-bb30-49b5-95c4-dc3234f590d9 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4add7cf70>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:50.288178 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a94bab40-bb30-49b5-95c4-dc3234f590d9 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf" status: 200 len: 1427 microversion: 2.1 time: 0.132552 Jul 18 02:16:50.289322 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 943/1924] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:16:50 2022] GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf => generated 1427 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:50.294784 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a97f8699-7616-4a47-b269-404a66510ae5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:50.304169 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a97f8699-7616-4a47-b269-404a66510ae5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:50.324600 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a97f8699-7616-4a47-b269-404a66510ae5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:50.326862 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a97f8699-7616-4a47-b269-404a66510ae5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:50.328707 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a97f8699-7616-4a47-b269-404a66510ae5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:50.329525 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a97f8699-7616-4a47-b269-404a66510ae5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:50.386448 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d62b6696-1035-48f4-ad98-bca1bbae9af6 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers/detail" status: 200 len: 4517 microversion: 2.1 time: 2.411962 Jul 18 02:16:50.400643 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 982/1925] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:16:47 2022] GET /compute/v2.1/servers/detail => generated 4517 bytes in 2414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:16:50.407596 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c6a8bd6b-5a40-46c0-a290-b312f654b7bc tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:50.421564 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a97f8699-7616-4a47-b269-404a66510ae5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130788 Jul 18 02:16:50.424874 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c6a8bd6b-5a40-46c0-a290-b312f654b7bc tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:50.428355 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 944/1926] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:16:50 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:50.429909 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c6a8bd6b-5a40-46c0-a290-b312f654b7bc tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '58dcb69855544ff3b51109aa5d41f637'} {{(pid=119544) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:16:50.964971 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c6a8bd6b-5a40-46c0-a290-b312f654b7bc tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:50.966168 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c6a8bd6b-5a40-46c0-a290-b312f654b7bc tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:50.967405 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c6a8bd6b-5a40-46c0-a290-b312f654b7bc tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:50.968318 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c6a8bd6b-5a40-46c0-a290-b312f654b7bc tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:50.978362 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-a26037dc-4218-4141-819d-8279a41ba6c7 req-a855d971-db79-4fc9-bdeb-977f448f438d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "465df230-ba3a-430a-935d-dc0a7fb83462", "name": "network-vif-deleted", "tag": "874a12e1-9707-47fe-86d6-8d8a405eab15"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:51.008322 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-a26037dc-4218-4141-819d-8279a41ba6c7 req-a855d971-db79-4fc9-bdeb-977f448f438d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:51.009891 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-a26037dc-4218-4141-819d-8279a41ba6c7 req-a855d971-db79-4fc9-bdeb-977f448f438d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:51.091243 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-a26037dc-4218-4141-819d-8279a41ba6c7 req-a855d971-db79-4fc9-bdeb-977f448f438d service nova] Creating event network-vif-deleted:874a12e1-9707-47fe-86d6-8d8a405eab15 for instance 465df230-ba3a-430a-935d-dc0a7fb83462 on n-h1-465891-3 Jul 18 02:16:51.115484 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-a26037dc-4218-4141-819d-8279a41ba6c7 req-a855d971-db79-4fc9-bdeb-977f448f438d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143984 Jul 18 02:16:51.120075 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 945/1927] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:51.153329 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-aa3d500b-94a2-4315-af11-d7453a1b9ace tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:51.155905 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-aa3d500b-94a2-4315-af11-d7453a1b9ace tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 465df230-ba3a-430a-935d-dc0a7fb83462] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:51.164090 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aa3d500b-94a2-4315-af11-d7453a1b9ace tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:51.164867 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aa3d500b-94a2-4315-af11-d7453a1b9ace tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:51.167942 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aa3d500b-94a2-4315-af11-d7453a1b9ace tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:51.168635 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aa3d500b-94a2-4315-af11-d7453a1b9ace tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:51.309744 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.multi_cell_list [None req-c6a8bd6b-5a40-46c0-a290-b312f654b7bc tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119544) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:16:51.372833 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-aa3d500b-94a2-4315-af11-d7453a1b9ace tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:51.387707 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-aa3d500b-94a2-4315-af11-d7453a1b9ace tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/465df230-ba3a-430a-935d-dc0a7fb83462" status: 200 len: 1304 microversion: 2.1 time: 0.264759 Jul 18 02:16:51.391408 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 946/1928] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:51 2022] GET /compute/v2.1/servers/465df230-ba3a-430a-935d-dc0a7fb83462 => generated 1304 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:51.405602 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8a40fd6c-938e-4988-a0b9-187a9752a316 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff49bedb9d0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:51.449192 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c6a8bd6b-5a40-46c0-a290-b312f654b7bc tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 1.046551 Jul 18 02:16:51.451086 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 983/1929] 10.222.0.57 () {58 vars in 1149 bytes} [Mon Jul 18 02:16:50 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:51.463034 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c14ab024-7331-4743-b92e-560c03b2430a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:51.469613 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c14ab024-7331-4743-b92e-560c03b2430a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:51.489749 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c14ab024-7331-4743-b92e-560c03b2430a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:51.496125 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c14ab024-7331-4743-b92e-560c03b2430a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:51.499206 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c14ab024-7331-4743-b92e-560c03b2430a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:51.500523 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c14ab024-7331-4743-b92e-560c03b2430a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:51.531596 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8a40fd6c-938e-4988-a0b9-187a9752a316 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf" status: 200 len: 1427 microversion: 2.1 time: 0.138595 Jul 18 02:16:51.541324 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 947/1930] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:16:51 2022] GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf => generated 1427 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:51.568056 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-86eb8093-f457-4f88-9119-9df84b8a7f91 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:51.571769 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c14ab024-7331-4743-b92e-560c03b2430a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119229 Jul 18 02:16:51.572381 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 984/1931] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:16:51 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:51.585311 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-86eb8093-f457-4f88-9119-9df84b8a7f91 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:51.586139 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-86eb8093-f457-4f88-9119-9df84b8a7f91 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '58dcb69855544ff3b51109aa5d41f637'} {{(pid=119543) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:16:51.616601 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-86eb8093-f457-4f88-9119-9df84b8a7f91 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:51.616953 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-86eb8093-f457-4f88-9119-9df84b8a7f91 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:51.618045 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-86eb8093-f457-4f88-9119-9df84b8a7f91 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:51.621532 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-86eb8093-f457-4f88-9119-9df84b8a7f91 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:51.877490 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.multi_cell_list [None req-86eb8093-f457-4f88-9119-9df84b8a7f91 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119543) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:16:51.917310 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:51.975021 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-86eb8093-f457-4f88-9119-9df84b8a7f91 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.437543 Jul 18 02:16:51.976405 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 948/1932] 10.222.0.57 () {58 vars in 1211 bytes} [Mon Jul 18 02:16:51 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:51.988004 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-668d8a23-0c2f-48a3-898b-d5b2a60fea4f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:51.992203 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-668d8a23-0c2f-48a3-898b-d5b2a60fea4f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:51.996614 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-668d8a23-0c2f-48a3-898b-d5b2a60fea4f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '58dcb69855544ff3b51109aa5d41f637'} {{(pid=119544) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:16:52.013590 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-668d8a23-0c2f-48a3-898b-d5b2a60fea4f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:52.014401 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-668d8a23-0c2f-48a3-898b-d5b2a60fea4f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:52.036715 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-668d8a23-0c2f-48a3-898b-d5b2a60fea4f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:52.037610 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-668d8a23-0c2f-48a3-898b-d5b2a60fea4f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:52.229220 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.multi_cell_list [None req-668d8a23-0c2f-48a3-898b-d5b2a60fea4f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119544) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:16:52.411553 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1fafa7ad-526d-421b-8a72-c0850bcdb9f8 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:52.412258 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1fafa7ad-526d-421b-8a72-c0850bcdb9f8 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: 465df230-ba3a-430a-935d-dc0a7fb83462] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:52.460376 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1fafa7ad-526d-421b-8a72-c0850bcdb9f8 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:52.460946 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1fafa7ad-526d-421b-8a72-c0850bcdb9f8 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:52.474606 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1fafa7ad-526d-421b-8a72-c0850bcdb9f8 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:52.475395 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1fafa7ad-526d-421b-8a72-c0850bcdb9f8 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:52.493596 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-668d8a23-0c2f-48a3-898b-d5b2a60fea4f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.501877 Jul 18 02:16:52.516475 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 985/1933] 10.222.0.57 () {58 vars in 1195 bytes} [Mon Jul 18 02:16:51 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:16:52.520731 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-1fafa7ad-526d-421b-8a72-c0850bcdb9f8 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] HTTP exception thrown: Instance 465df230-ba3a-430a-935d-dc0a7fb83462 could not be found. Jul 18 02:16:52.531803 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-caf99187-b218-454a-9ce7-96294e43a726 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1fafa7ad-526d-421b-8a72-c0850bcdb9f8 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Request method failure captured: Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/465df230-ba3a-430a-935d-dc0a7fb83462 HTTP/1.1 Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MGCWrWHCddcrN4RqNfnBFPBSabjGvo5gM77Tw6VfoUAuTFYZJ3-CEdjKYax5T5uhOfCuNLEmOh531jNb7qti0OvzfRwr8H4xYd6v1BUcfs9beu0dZ5AWDeHwp-6BMUAWJqOL9IUkCg8_lfh7_6ef8hef4LR8j_2qAWtZaYjzyZxBJ0 Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 8f8bb1ebead3481f946ae7878c3cfc41 Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersOnMultiNodesTest-1310468150 Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8f8bb1ebead3481f946ae7878c3cfc41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8f8bb1ebead3481f946ae7878c3cfc41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8f8bb1ebead3481f946ae7878c3cfc41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8f8bb1ebead3481f946ae7878c3cfc41"}]}] Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersOnMultiNodesTest-1310468150 Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 8f8bb1ebead3481f946ae7878c3cfc41 Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1310468150 Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersOnMultiNodesTest-1310468150-project Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 100f65c0d9d3456fa177599821aed7ff Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersOnMultiNodesTest-1310468150-project Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 465df230-ba3a-430a-935d-dc0a7fb83462 could not be found. Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '465df230-ba3a-430a-935d-dc0a7fb83462'} Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 465df230-ba3a-430a-935d-dc0a7fb83462 could not be found. Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 465df230-ba3a-430a-935d-dc0a7fb83462 could not be found. Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:16:52.534528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:16:52.539491 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:52.539491 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:16:52.539491 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:16:52.539491 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:16:52.539491 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:16:52.539491 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 465df230-ba3a-430a-935d-dc0a7fb83462 could not be found. Jul 18 02:16:52.539491 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:16:52.540027 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-caf99187-b218-454a-9ce7-96294e43a726 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:52.552202 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-caf99187-b218-454a-9ce7-96294e43a726 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Searching by: {'name': '-848148827', 'deleted': False, 'project_id': '58dcb69855544ff3b51109aa5d41f637'} {{(pid=119544) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:16:52.564092 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1fafa7ad-526d-421b-8a72-c0850bcdb9f8 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Returning 404 to user: Instance 465df230-ba3a-430a-935d-dc0a7fb83462 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:16:52.565440 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1fafa7ad-526d-421b-8a72-c0850bcdb9f8 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/465df230-ba3a-430a-935d-dc0a7fb83462" status: 404 len: 111 microversion: 2.1 time: 0.160689 Jul 18 02:16:52.572181 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-caf99187-b218-454a-9ce7-96294e43a726 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:52.572447 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-caf99187-b218-454a-9ce7-96294e43a726 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:52.573231 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 949/1934] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:52 2022] GET /compute/v2.1/servers/465df230-ba3a-430a-935d-dc0a7fb83462 => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:16:52.587038 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-caf99187-b218-454a-9ce7-96294e43a726 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:52.587492 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-caf99187-b218-454a-9ce7-96294e43a726 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:52.603141 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-97e08bdb-1dfe-422e-b1b1-ab757c8d7d7f tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a8022c10>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:52.780285 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-97e08bdb-1dfe-422e-b1b1-ab757c8d7d7f tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf" status: 200 len: 1427 microversion: 2.1 time: 0.205036 Jul 18 02:16:52.787113 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 950/1935] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:16:52 2022] GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf => generated 1427 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:52.829603 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9b625466-f850-4765-88fb-0eaffa51d98d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:52.850013 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9b625466-f850-4765-88fb-0eaffa51d98d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c8ba5e49-8aa4-4b43-9273-16be87705a48] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:52.877122 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9b625466-f850-4765-88fb-0eaffa51d98d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:52.881686 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9b625466-f850-4765-88fb-0eaffa51d98d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:52.886449 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9b625466-f850-4765-88fb-0eaffa51d98d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:52.887601 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9b625466-f850-4765-88fb-0eaffa51d98d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:52.973743 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-9b625466-f850-4765-88fb-0eaffa51d98d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] HTTP exception thrown: Instance c8ba5e49-8aa4-4b43-9273-16be87705a48 could not be found. Jul 18 02:16:52.976102 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.multi_cell_list [None req-caf99187-b218-454a-9ce7-96294e43a726 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119544) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9b625466-f850-4765-88fb-0eaffa51d98d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Request method failure captured: Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/c8ba5e49-8aa4-4b43-9273-16be87705a48 HTTP/1.1 Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MGCWrWHCddcrN4RqNfnBFPBSabjGvo5gM77Tw6VfoUAuTFYZJ3-CEdjKYax5T5uhOfCuNLEmOh531jNb7qti0OvzfRwr8H4xYd6v1BUcfs9beu0dZ5AWDeHwp-6BMUAWJqOL9IUkCg8_lfh7_6ef8hef4LR8j_2qAWtZaYjzyZxBJ0 Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 8f8bb1ebead3481f946ae7878c3cfc41 Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersOnMultiNodesTest-1310468150 Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8f8bb1ebead3481f946ae7878c3cfc41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8f8bb1ebead3481f946ae7878c3cfc41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8f8bb1ebead3481f946ae7878c3cfc41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8f8bb1ebead3481f946ae7878c3cfc41"}]}] Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersOnMultiNodesTest-1310468150 Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 8f8bb1ebead3481f946ae7878c3cfc41 Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1310468150 Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersOnMultiNodesTest-1310468150-project Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 100f65c0d9d3456fa177599821aed7ff Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersOnMultiNodesTest-1310468150-project Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance c8ba5e49-8aa4-4b43-9273-16be87705a48 could not be found. Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'c8ba5e49-8aa4-4b43-9273-16be87705a48'} Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8ba5e49-8aa4-4b43-9273-16be87705a48 could not be found. Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8ba5e49-8aa4-4b43-9273-16be87705a48 could not be found. Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:16:52.986806 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:16:52.996079 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:52.996079 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:16:52.996079 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:16:52.996079 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:16:52.996079 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:16:52.996079 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8ba5e49-8aa4-4b43-9273-16be87705a48 could not be found. Jul 18 02:16:52.996079 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:16:53.008912 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9b625466-f850-4765-88fb-0eaffa51d98d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Returning 404 to user: Instance c8ba5e49-8aa4-4b43-9273-16be87705a48 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:16:53.011851 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9b625466-f850-4765-88fb-0eaffa51d98d tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c8ba5e49-8aa4-4b43-9273-16be87705a48" status: 404 len: 111 microversion: 2.1 time: 0.213411 Jul 18 02:16:53.028317 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 951/1936] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:52 2022] GET /compute/v2.1/servers/c8ba5e49-8aa4-4b43-9273-16be87705a48 => generated 111 bytes in 232 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:16:53.041521 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-89dbd00d-5e47-4d0b-9018-8fab36e8f223 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:53.043765 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-89dbd00d-5e47-4d0b-9018-8fab36e8f223 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:53.079766 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-89dbd00d-5e47-4d0b-9018-8fab36e8f223 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:53.081134 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-89dbd00d-5e47-4d0b-9018-8fab36e8f223 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:53.083956 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-89dbd00d-5e47-4d0b-9018-8fab36e8f223 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:53.085834 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-89dbd00d-5e47-4d0b-9018-8fab36e8f223 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:53.173999 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-89dbd00d-5e47-4d0b-9018-8fab36e8f223 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.139431 Jul 18 02:16:53.184087 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 952/1937] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:16:53 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f/os-volume_attachments => generated 25 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:16:53.191426 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5b7194c8-43dd-4131-939d-0c1523c72694 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:53.243439 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5b7194c8-43dd-4131-939d-0c1523c72694 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "DELETE /compute/v2.1/os-server-groups/3f2188bf-ec0e-426f-8182-c941769ada5e" status: 204 len: 0 microversion: 2.1 time: 0.057663 Jul 18 02:16:53.247765 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 953/1938] 10.222.0.57 () {58 vars in 1265 bytes} [Mon Jul 18 02:16:53 2022] DELETE /compute/v2.1/os-server-groups/3f2188bf-ec0e-426f-8182-c941769ada5e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:53.271389 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c5e3485d-3ddf-4149-90c4-75b8447b9491 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:53.275701 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c5e3485d-3ddf-4149-90c4-75b8447b9491 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: a6859225-d99c-41c5-a08b-dd4836bd82c4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:53.305692 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c5e3485d-3ddf-4149-90c4-75b8447b9491 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:53.312346 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c5e3485d-3ddf-4149-90c4-75b8447b9491 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:53.315202 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c5e3485d-3ddf-4149-90c4-75b8447b9491 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:53.316248 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c5e3485d-3ddf-4149-90c4-75b8447b9491 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:53.476645 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c5e3485d-3ddf-4149-90c4-75b8447b9491 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: a6859225-d99c-41c5-a08b-dd4836bd82c4] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:16:53.854242 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c5e3485d-3ddf-4149-90c4-75b8447b9491 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a6859225-d99c-41c5-a08b-dd4836bd82c4" status: 204 len: 0 microversion: 2.1 time: 0.598914 Jul 18 02:16:53.861209 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 954/1939] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:16:53 2022] DELETE /compute/v2.1/servers/a6859225-d99c-41c5-a08b-dd4836bd82c4 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:53.880058 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c7959456-a88f-4b49-98d1-5a781fde38b7 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a880b9d0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:54.116476 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-caf99187-b218-454a-9ce7-96294e43a726 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers?name=-848148827" status: 200 len: 345 microversion: 2.1 time: 1.598789 Jul 18 02:16:54.121673 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 986/1940] 10.222.0.57 () {58 vars in 1155 bytes} [Mon Jul 18 02:16:52 2022] GET /compute/v2.1/servers?name=-848148827 => generated 345 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:54.138868 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-918dcad1-255f-4995-9a3f-6c4d80a3db83 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:54.139673 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-918dcad1-255f-4995-9a3f-6c4d80a3db83 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: a598ccda-c16b-45d8-aca0-d3d242ec0c23] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:54.160649 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-918dcad1-255f-4995-9a3f-6c4d80a3db83 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:54.161631 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-918dcad1-255f-4995-9a3f-6c4d80a3db83 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:54.162762 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-918dcad1-255f-4995-9a3f-6c4d80a3db83 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:54.163796 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-918dcad1-255f-4995-9a3f-6c4d80a3db83 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:54.177353 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c7959456-a88f-4b49-98d1-5a781fde38b7 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf" status: 200 len: 1427 microversion: 2.1 time: 0.313570 Jul 18 02:16:54.183556 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 955/1941] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:16:53 2022] GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf => generated 1427 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:54.198975 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5fd1b66f-3b11-4831-9eca-21d0bcb66f60 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:54.215591 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5fd1b66f-3b11-4831-9eca-21d0bcb66f60 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:54.217885 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5fd1b66f-3b11-4831-9eca-21d0bcb66f60 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '58dcb69855544ff3b51109aa5d41f637'} {{(pid=119543) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:16:54.245781 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5fd1b66f-3b11-4831-9eca-21d0bcb66f60 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:54.249475 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5fd1b66f-3b11-4831-9eca-21d0bcb66f60 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:54.258835 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5fd1b66f-3b11-4831-9eca-21d0bcb66f60 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:54.260689 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5fd1b66f-3b11-4831-9eca-21d0bcb66f60 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:54.283339 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-918dcad1-255f-4995-9a3f-6c4d80a3db83 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: a598ccda-c16b-45d8-aca0-d3d242ec0c23] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:16:54.762354 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-918dcad1-255f-4995-9a3f-6c4d80a3db83 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a598ccda-c16b-45d8-aca0-d3d242ec0c23" status: 204 len: 0 microversion: 2.1 time: 0.631201 Jul 18 02:16:54.764610 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 987/1942] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:16:54 2022] DELETE /compute/v2.1/servers/a598ccda-c16b-45d8-aca0-d3d242ec0c23 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:54.785950 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-da1e3148-0ce3-4c84-a05a-68f2e21542a6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:54.787990 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-da1e3148-0ce3-4c84-a05a-68f2e21542a6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: a6859225-d99c-41c5-a08b-dd4836bd82c4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:54.800938 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-da1e3148-0ce3-4c84-a05a-68f2e21542a6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:54.802544 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-da1e3148-0ce3-4c84-a05a-68f2e21542a6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:54.804518 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-da1e3148-0ce3-4c84-a05a-68f2e21542a6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:54.805634 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-da1e3148-0ce3-4c84-a05a-68f2e21542a6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:54.847102 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.multi_cell_list [None req-5fd1b66f-3b11-4831-9eca-21d0bcb66f60 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119543) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:16:55.084295 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5fd1b66f-3b11-4831-9eca-21d0bcb66f60 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.903619 Jul 18 02:16:55.097670 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 956/1943] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 18 02:16:54 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:55.103074 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-291ac342-4913-4a19-ac42-0062d7fd5f39 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:55.115855 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-291ac342-4913-4a19-ac42-0062d7fd5f39 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:55.116579 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-291ac342-4913-4a19-ac42-0062d7fd5f39 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-84814882', 'deleted': False, 'project_id': '58dcb69855544ff3b51109aa5d41f637'} {{(pid=119543) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:16:55.132614 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-291ac342-4913-4a19-ac42-0062d7fd5f39 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:55.136899 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-291ac342-4913-4a19-ac42-0062d7fd5f39 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:55.142030 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-291ac342-4913-4a19-ac42-0062d7fd5f39 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:55.146165 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-291ac342-4913-4a19-ac42-0062d7fd5f39 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:55.239476 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-da1e3148-0ce3-4c84-a05a-68f2e21542a6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:55.249187 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:55.310270 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-da1e3148-0ce3-4c84-a05a-68f2e21542a6 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/a6859225-d99c-41c5-a08b-dd4836bd82c4" status: 200 len: 1474 microversion: 2.1 time: 0.529735 Jul 18 02:16:55.332399 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 988/1944] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:54 2022] GET /compute/v2.1/servers/a6859225-d99c-41c5-a08b-dd4836bd82c4 => generated 1474 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:55.354204 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2c784630-1343-45a5-b164-cfa29e7a3142 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a831d430>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:55.558593 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2c784630-1343-45a5-b164-cfa29e7a3142 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf" status: 200 len: 1427 microversion: 2.1 time: 0.223765 Jul 18 02:16:55.579538 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 989/1945] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:16:55 2022] GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf => generated 1427 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:55.641956 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.multi_cell_list [None req-291ac342-4913-4a19-ac42-0062d7fd5f39 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119543) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:16:55.806307 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-291ac342-4913-4a19-ac42-0062d7fd5f39 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-84814882" status: 200 len: 345 microversion: 2.1 time: 0.706100 Jul 18 02:16:55.807533 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 957/1946] 10.222.0.57 () {58 vars in 1225 bytes} [Mon Jul 18 02:16:55 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-84814882 => generated 345 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:55.830407 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-474584b1-0db0-4f53-9b3a-97bf4323be3f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:55.831566 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-474584b1-0db0-4f53-9b3a-97bf4323be3f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 25d7575c-c9a7-4dba-8f13-6c57e988af59] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:55.848441 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-474584b1-0db0-4f53-9b3a-97bf4323be3f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:55.849454 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-474584b1-0db0-4f53-9b3a-97bf4323be3f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:55.851092 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-474584b1-0db0-4f53-9b3a-97bf4323be3f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:55.851997 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-474584b1-0db0-4f53-9b3a-97bf4323be3f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:55.924178 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-474584b1-0db0-4f53-9b3a-97bf4323be3f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 25d7575c-c9a7-4dba-8f13-6c57e988af59] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:16:56.150163 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-474584b1-0db0-4f53-9b3a-97bf4323be3f tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "DELETE /compute/v2.1/servers/25d7575c-c9a7-4dba-8f13-6c57e988af59" status: 204 len: 0 microversion: 2.1 time: 0.328841 Jul 18 02:16:56.152007 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 990/1947] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:16:55 2022] DELETE /compute/v2.1/servers/25d7575c-c9a7-4dba-8f13-6c57e988af59 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:56.161497 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-03fbb97e-c922-4b21-9b16-ba2cc949737e tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:56.162416 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-03fbb97e-c922-4b21-9b16-ba2cc949737e tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 25d7575c-c9a7-4dba-8f13-6c57e988af59] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:56.185470 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-03fbb97e-c922-4b21-9b16-ba2cc949737e tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:56.186200 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-03fbb97e-c922-4b21-9b16-ba2cc949737e tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:56.189926 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-03fbb97e-c922-4b21-9b16-ba2cc949737e tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:56.195939 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-03fbb97e-c922-4b21-9b16-ba2cc949737e tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:56.347932 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ba9bff43-3a2a-4387-a791-4a03a2997f0b tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:56.360237 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ba9bff43-3a2a-4387-a791-4a03a2997f0b tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: a6859225-d99c-41c5-a08b-dd4836bd82c4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:56.401644 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba9bff43-3a2a-4387-a791-4a03a2997f0b tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:56.404598 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba9bff43-3a2a-4387-a791-4a03a2997f0b tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:56.407722 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba9bff43-3a2a-4387-a791-4a03a2997f0b tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:56.411561 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba9bff43-3a2a-4387-a791-4a03a2997f0b tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:57.179792 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-03fbb97e-c922-4b21-9b16-ba2cc949737e tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:57.196012 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-03fbb97e-c922-4b21-9b16-ba2cc949737e tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers/25d7575c-c9a7-4dba-8f13-6c57e988af59" status: 200 len: 1518 microversion: 2.1 time: 1.036007 Jul 18 02:16:57.198021 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 958/1948] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:56 2022] GET /compute/v2.1/servers/25d7575c-c9a7-4dba-8f13-6c57e988af59 => generated 1518 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:57.216467 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1e27ddd4-9874-42bd-a73d-875186cc8a4b tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff49bd43940>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:57.350601 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ba9bff43-3a2a-4387-a791-4a03a2997f0b tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:57.373229 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ba9bff43-3a2a-4387-a791-4a03a2997f0b tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/a6859225-d99c-41c5-a08b-dd4836bd82c4" status: 200 len: 1474 microversion: 2.1 time: 1.038127 Jul 18 02:16:57.379694 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 991/1949] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:56 2022] GET /compute/v2.1/servers/a6859225-d99c-41c5-a08b-dd4836bd82c4 => generated 1474 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:57.385046 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-992bcedb-f108-4094-a235-e37e58f061a7 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:57.393991 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-992bcedb-f108-4094-a235-e37e58f061a7 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:57.418062 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-992bcedb-f108-4094-a235-e37e58f061a7 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:57.418904 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-992bcedb-f108-4094-a235-e37e58f061a7 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:57.424242 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-992bcedb-f108-4094-a235-e37e58f061a7 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:57.426523 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-992bcedb-f108-4094-a235-e37e58f061a7 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:58.266888 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1e27ddd4-9874-42bd-a73d-875186cc8a4b tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf" status: 200 len: 1436 microversion: 2.1 time: 1.067518 Jul 18 02:16:58.269237 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 959/1950] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:16:57 2022] GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf => generated 1436 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:58.279296 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-58bc5bb3-1721-4856-93ba-69e9935ef57c tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:58.289893 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-58bc5bb3-1721-4856-93ba-69e9935ef57c tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 25d7575c-c9a7-4dba-8f13-6c57e988af59] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:58.315116 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-58bc5bb3-1721-4856-93ba-69e9935ef57c tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:58.318944 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-58bc5bb3-1721-4856-93ba-69e9935ef57c tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:58.319855 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-58bc5bb3-1721-4856-93ba-69e9935ef57c tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:58.326759 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-58bc5bb3-1721-4856-93ba-69e9935ef57c tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:58.379605 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:58.521383 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-992bcedb-f108-4094-a235-e37e58f061a7 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lazy-loading 'services' on Instance uuid 174a0067-ee9a-493e-a1d9-099fdf4bbaec {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:16:58.564978 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-992bcedb-f108-4094-a235-e37e58f061a7 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 200 len: 2344 microversion: 2.25 time: 1.183616 Jul 18 02:16:58.569890 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 992/1951] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:16:57 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 2344 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:16:58.585169 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f33ed0a5-93fe-4815-9531-9d0926ff42bf tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a83804c0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:59.383850 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-58bc5bb3-1721-4856-93ba-69e9935ef57c tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:59.424550 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-58bc5bb3-1721-4856-93ba-69e9935ef57c tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers/25d7575c-c9a7-4dba-8f13-6c57e988af59" status: 200 len: 1518 microversion: 2.1 time: 1.153093 Jul 18 02:16:59.426398 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 960/1952] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:58 2022] GET /compute/v2.1/servers/25d7575c-c9a7-4dba-8f13-6c57e988af59 => generated 1518 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:59.451308 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-393c0bd3-2367-45eb-9f88-d21670bed7f3 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:59.452975 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-393c0bd3-2367-45eb-9f88-d21670bed7f3 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: a6859225-d99c-41c5-a08b-dd4836bd82c4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:59.472927 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-393c0bd3-2367-45eb-9f88-d21670bed7f3 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:59.474106 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-393c0bd3-2367-45eb-9f88-d21670bed7f3 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:59.476961 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-393c0bd3-2367-45eb-9f88-d21670bed7f3 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:59.478138 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-393c0bd3-2367-45eb-9f88-d21670bed7f3 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:59.577044 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-393c0bd3-2367-45eb-9f88-d21670bed7f3 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:59.581853 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-393c0bd3-2367-45eb-9f88-d21670bed7f3 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:59.586256 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-393c0bd3-2367-45eb-9f88-d21670bed7f3 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lazy-loading 'fault' on Instance uuid a6859225-d99c-41c5-a08b-dd4836bd82c4 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:17:00.215573 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-393c0bd3-2367-45eb-9f88-d21670bed7f3 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:00.236531 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-393c0bd3-2367-45eb-9f88-d21670bed7f3 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/a6859225-d99c-41c5-a08b-dd4836bd82c4" status: 200 len: 1308 microversion: 2.1 time: 0.807286 Jul 18 02:17:00.253108 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 961/1953] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:59 2022] GET /compute/v2.1/servers/a6859225-d99c-41c5-a08b-dd4836bd82c4 => generated 1308 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:00.287384 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-817f7bf7-6097-4b62-b6b2-3ad7660b1f77 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:00.314059 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:17:00.314059 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:17:00.317378 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-817f7bf7-6097-4b62-b6b2-3ad7660b1f77 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:00.323210 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-817f7bf7-6097-4b62-b6b2-3ad7660b1f77 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:00.329038 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-817f7bf7-6097-4b62-b6b2-3ad7660b1f77 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:00.335694 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-817f7bf7-6097-4b62-b6b2-3ad7660b1f77 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:00.404206 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:DELETE=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:00.449900 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-817f7bf7-6097-4b62-b6b2-3ad7660b1f77 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.179307 Jul 18 02:17:00.459547 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 962/1954] 10.222.0.57 () {60 vars in 1216 bytes} [Mon Jul 18 02:17:00 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:17:00.482317 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-5211db32-051e-485b-92f0-213e48967c26 req-4d95e52f-5323-476f-8f64-fc6ede7e9c77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6859225-d99c-41c5-a08b-dd4836bd82c4", "name": "network-vif-deleted", "tag": "f5f50624-aa07-4d03-9784-f2cb3a5d94df"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:00.543385 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-5211db32-051e-485b-92f0-213e48967c26 req-4d95e52f-5323-476f-8f64-fc6ede7e9c77 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:00.559792 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-5211db32-051e-485b-92f0-213e48967c26 req-4d95e52f-5323-476f-8f64-fc6ede7e9c77 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:00.607152 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-5211db32-051e-485b-92f0-213e48967c26 req-4d95e52f-5323-476f-8f64-fc6ede7e9c77 service nova] Creating event network-vif-deleted:f5f50624-aa07-4d03-9784-f2cb3a5d94df for instance a6859225-d99c-41c5-a08b-dd4836bd82c4 on n-h2-465891-3 Jul 18 02:17:00.649062 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-5211db32-051e-485b-92f0-213e48967c26 req-4d95e52f-5323-476f-8f64-fc6ede7e9c77 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186908 Jul 18 02:17:00.653307 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 963/1955] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:17:00.679915 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4b661cc6-5f19-41b2-a109-511ff77c7695 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:00.683597 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4b661cc6-5f19-41b2-a109-511ff77c7695 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 25d7575c-c9a7-4dba-8f13-6c57e988af59] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:00.710571 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4b661cc6-5f19-41b2-a109-511ff77c7695 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:00.719528 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4b661cc6-5f19-41b2-a109-511ff77c7695 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:00.721363 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4b661cc6-5f19-41b2-a109-511ff77c7695 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:00.726476 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4b661cc6-5f19-41b2-a109-511ff77c7695 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:01.265565 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4b661cc6-5f19-41b2-a109-511ff77c7695 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:01.307271 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4b661cc6-5f19-41b2-a109-511ff77c7695 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers/25d7575c-c9a7-4dba-8f13-6c57e988af59" status: 200 len: 1476 microversion: 2.1 time: 0.644669 Jul 18 02:17:01.312230 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 964/1956] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:00 2022] GET /compute/v2.1/servers/25d7575c-c9a7-4dba-8f13-6c57e988af59 => generated 1476 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:01.356312 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-8d8599f2-7d24-4fba-b6c5-3e93c085e8f1 req-22c2fc85-fbfa-4b59-ba30-0a40a0f8f785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a598ccda-c16b-45d8-aca0-d3d242ec0c23", "name": "network-vif-deleted", "tag": "cfb584b6-1349-4e2d-8d15-21ea1c84c96b"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:01.382261 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-8d8599f2-7d24-4fba-b6c5-3e93c085e8f1 req-22c2fc85-fbfa-4b59-ba30-0a40a0f8f785 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:01.387967 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-8d8599f2-7d24-4fba-b6c5-3e93c085e8f1 req-22c2fc85-fbfa-4b59-ba30-0a40a0f8f785 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:01.440018 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-8d8599f2-7d24-4fba-b6c5-3e93c085e8f1 req-22c2fc85-fbfa-4b59-ba30-0a40a0f8f785 service nova] Creating event network-vif-deleted:cfb584b6-1349-4e2d-8d15-21ea1c84c96b for instance a598ccda-c16b-45d8-aca0-d3d242ec0c23 on n-h2-465891-3 Jul 18 02:17:01.461832 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-8d8599f2-7d24-4fba-b6c5-3e93c085e8f1 req-22c2fc85-fbfa-4b59-ba30-0a40a0f8f785 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142551 Jul 18 02:17:01.469571 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 965/1957] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:17:01.487493 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-55889627-f249-4467-a2b9-485c1bd705ad tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:01.511507 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-55889627-f249-4467-a2b9-485c1bd705ad tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: a6859225-d99c-41c5-a08b-dd4836bd82c4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:01.529912 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-55889627-f249-4467-a2b9-485c1bd705ad tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:01.535900 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-55889627-f249-4467-a2b9-485c1bd705ad tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:01.537351 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-55889627-f249-4467-a2b9-485c1bd705ad tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:01.538737 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-55889627-f249-4467-a2b9-485c1bd705ad tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:01.584250 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-55889627-f249-4467-a2b9-485c1bd705ad tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] HTTP exception thrown: Instance a6859225-d99c-41c5-a08b-dd4836bd82c4 could not be found. Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-55889627-f249-4467-a2b9-485c1bd705ad tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Request method failure captured: Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/a6859225-d99c-41c5-a08b-dd4836bd82c4 HTTP/1.1 Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MGCWrWHCddcrN4RqNfnBFPBSabjGvo5gM77Tw6VfoUAuTFYZJ3-CEdjKYax5T5uhOfCuNLEmOh531jNb7qti0OvzfRwr8H4xYd6v1BUcfs9beu0dZ5AWDeHwp-6BMUAWJqOL9IUkCg8_lfh7_6ef8hef4LR8j_2qAWtZaYjzyZxBJ0 Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 8f8bb1ebead3481f946ae7878c3cfc41 Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersOnMultiNodesTest-1310468150 Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8f8bb1ebead3481f946ae7878c3cfc41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8f8bb1ebead3481f946ae7878c3cfc41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8f8bb1ebead3481f946ae7878c3cfc41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8f8bb1ebead3481f946ae7878c3cfc41"}]}] Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersOnMultiNodesTest-1310468150 Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 8f8bb1ebead3481f946ae7878c3cfc41 Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1310468150 Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersOnMultiNodesTest-1310468150-project Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 100f65c0d9d3456fa177599821aed7ff Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersOnMultiNodesTest-1310468150-project Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance a6859225-d99c-41c5-a08b-dd4836bd82c4 could not be found. Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'a6859225-d99c-41c5-a08b-dd4836bd82c4'} Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6859225-d99c-41c5-a08b-dd4836bd82c4 could not be found. Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6859225-d99c-41c5-a08b-dd4836bd82c4 could not be found. Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:17:01.590878 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:17:01.601546 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:01.601546 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:17:01.601546 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:17:01.601546 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:17:01.601546 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:17:01.601546 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6859225-d99c-41c5-a08b-dd4836bd82c4 could not be found. Jul 18 02:17:01.601546 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:17:01.609534 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-55889627-f249-4467-a2b9-485c1bd705ad tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Returning 404 to user: Instance a6859225-d99c-41c5-a08b-dd4836bd82c4 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:17:01.610841 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-55889627-f249-4467-a2b9-485c1bd705ad tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/a6859225-d99c-41c5-a08b-dd4836bd82c4" status: 404 len: 111 microversion: 2.1 time: 0.139149 Jul 18 02:17:01.624945 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 966/1958] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:01 2022] GET /compute/v2.1/servers/a6859225-d99c-41c5-a08b-dd4836bd82c4 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:17:01.638225 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-17b7565f-5c12-4dd9-b44c-436fc338584f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:01.640879 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-17b7565f-5c12-4dd9-b44c-436fc338584f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: a598ccda-c16b-45d8-aca0-d3d242ec0c23] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:01.660006 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-17b7565f-5c12-4dd9-b44c-436fc338584f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:01.662262 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-17b7565f-5c12-4dd9-b44c-436fc338584f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:01.667719 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-17b7565f-5c12-4dd9-b44c-436fc338584f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:01.670073 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-17b7565f-5c12-4dd9-b44c-436fc338584f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:01.757294 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-17b7565f-5c12-4dd9-b44c-436fc338584f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:01.757760 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-17b7565f-5c12-4dd9-b44c-436fc338584f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:01.758388 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-17b7565f-5c12-4dd9-b44c-436fc338584f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lazy-loading 'fault' on Instance uuid a598ccda-c16b-45d8-aca0-d3d242ec0c23 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:17:01.843195 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-17b7565f-5c12-4dd9-b44c-436fc338584f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:01.857268 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-17b7565f-5c12-4dd9-b44c-436fc338584f tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/a598ccda-c16b-45d8-aca0-d3d242ec0c23" status: 200 len: 1308 microversion: 2.1 time: 0.226873 Jul 18 02:17:01.859298 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 967/1959] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:01 2022] GET /compute/v2.1/servers/a598ccda-c16b-45d8-aca0-d3d242ec0c23 => generated 1308 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:02.339390 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6935a173-03e3-4cf2-83c9-6d342ae26f79 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:02.345133 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6935a173-03e3-4cf2-83c9-6d342ae26f79 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 25d7575c-c9a7-4dba-8f13-6c57e988af59] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:02.383155 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6935a173-03e3-4cf2-83c9-6d342ae26f79 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:02.388261 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6935a173-03e3-4cf2-83c9-6d342ae26f79 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:02.393207 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6935a173-03e3-4cf2-83c9-6d342ae26f79 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:02.395645 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6935a173-03e3-4cf2-83c9-6d342ae26f79 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:02.457864 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-6935a173-03e3-4cf2-83c9-6d342ae26f79 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] HTTP exception thrown: Instance 25d7575c-c9a7-4dba-8f13-6c57e988af59 could not be found. Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6935a173-03e3-4cf2-83c9-6d342ae26f79 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Request method failure captured: Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/25d7575c-c9a7-4dba-8f13-6c57e988af59 HTTP/1.1 Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MI8MPusgATUKFrHTQmd1gCQOSSETlPagSSlfyEs42mc7gHLv4CTOuYJNLE73RiuicpsVMD9RAliaYUdGNMZnvhbVB2gbC_dFSLjLbSwBaZQ1bN8KdHt_Asbc5RGU2_R5gspJ06JaAnBcmxuCZBnnEo2GtyFwE56zjhd9aJMxO2W8rs Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 58dcb69855544ff3b51109aa5d41f637 Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ListServerFiltersTestJSON-21025684 Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_58dcb69855544ff3b51109aa5d41f637"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/58dcb69855544ff3b51109aa5d41f637"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/58dcb69855544ff3b51109aa5d41f637"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/58dcb69855544ff3b51109aa5d41f637"}]}] Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ListServerFiltersTestJSON-21025684 Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 58dcb69855544ff3b51109aa5d41f637 Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-21025684 Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ListServerFiltersTestJSON-21025684-project Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 560f87bfc55d4de2b0106db2ce0ce2af Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ListServerFiltersTestJSON-21025684-project Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 25d7575c-c9a7-4dba-8f13-6c57e988af59 could not be found. Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '25d7575c-c9a7-4dba-8f13-6c57e988af59'} Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25d7575c-c9a7-4dba-8f13-6c57e988af59 could not be found. Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25d7575c-c9a7-4dba-8f13-6c57e988af59 could not be found. Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:17:02.467475 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:17:02.483880 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:02.483880 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:17:02.483880 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:17:02.483880 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:17:02.483880 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:17:02.483880 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25d7575c-c9a7-4dba-8f13-6c57e988af59 could not be found. Jul 18 02:17:02.483880 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:17:02.493021 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6935a173-03e3-4cf2-83c9-6d342ae26f79 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Returning 404 to user: Instance 25d7575c-c9a7-4dba-8f13-6c57e988af59 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:17:02.494921 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6935a173-03e3-4cf2-83c9-6d342ae26f79 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers/25d7575c-c9a7-4dba-8f13-6c57e988af59" status: 404 len: 111 microversion: 2.1 time: 0.168088 Jul 18 02:17:02.498118 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 968/1960] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:02 2022] GET /compute/v2.1/servers/25d7575c-c9a7-4dba-8f13-6c57e988af59 => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:17:02.516889 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-13e685e6-80cf-4a03-aa71-e2e3bc9a6db5 req-3e6e7b87-7fd6-4892-a4a5-95b360543c71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32361df9-4e50-409c-9cc7-6f70ba6ce26e", "name": "network-vif-unplugged", "status": "completed", "tag": "7c604958-4d5c-4ace-8013-9827944aa0c6"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:02.558887 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-13e685e6-80cf-4a03-aa71-e2e3bc9a6db5 req-3e6e7b87-7fd6-4892-a4a5-95b360543c71 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:02.560169 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-13e685e6-80cf-4a03-aa71-e2e3bc9a6db5 req-3e6e7b87-7fd6-4892-a4a5-95b360543c71 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:02.618046 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-13e685e6-80cf-4a03-aa71-e2e3bc9a6db5 req-3e6e7b87-7fd6-4892-a4a5-95b360543c71 service nova] Creating event network-vif-unplugged:7c604958-4d5c-4ace-8013-9827944aa0c6 for instance 32361df9-4e50-409c-9cc7-6f70ba6ce26e on n-h1-465891-3 Jul 18 02:17:02.637130 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-13e685e6-80cf-4a03-aa71-e2e3bc9a6db5 req-3e6e7b87-7fd6-4892-a4a5-95b360543c71 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.132160 Jul 18 02:17:02.642091 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 969/1961] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:17:02.668688 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-aefd8fbb-97fe-4fa9-8225-3024075623c9 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:02.672102 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-aefd8fbb-97fe-4fa9-8225-3024075623c9 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 11caf39a-9515-4e04-b244-3be043262875] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:02.695807 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aefd8fbb-97fe-4fa9-8225-3024075623c9 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:02.696508 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aefd8fbb-97fe-4fa9-8225-3024075623c9 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:02.697348 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aefd8fbb-97fe-4fa9-8225-3024075623c9 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:02.697819 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aefd8fbb-97fe-4fa9-8225-3024075623c9 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:02.707329 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=8 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:02.750313 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-aefd8fbb-97fe-4fa9-8225-3024075623c9 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 11caf39a-9515-4e04-b244-3be043262875] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:17:02.794756 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:02.948145 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-aefd8fbb-97fe-4fa9-8225-3024075623c9 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "DELETE /compute/v2.1/servers/11caf39a-9515-4e04-b244-3be043262875" status: 204 len: 0 microversion: 2.1 time: 0.300519 Jul 18 02:17:02.949455 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 970/1962] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:17:02 2022] DELETE /compute/v2.1/servers/11caf39a-9515-4e04-b244-3be043262875 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:17:02.961310 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-06f8e4fa-49f1-4c65-98ea-f53053717e01 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:02.962080 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-06f8e4fa-49f1-4c65-98ea-f53053717e01 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: b74ae52f-6794-49d2-867e-be0996b090aa] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:02.976736 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-06f8e4fa-49f1-4c65-98ea-f53053717e01 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:02.977206 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-06f8e4fa-49f1-4c65-98ea-f53053717e01 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:02.978395 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-06f8e4fa-49f1-4c65-98ea-f53053717e01 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:02.979093 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-06f8e4fa-49f1-4c65-98ea-f53053717e01 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:03.044474 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-06f8e4fa-49f1-4c65-98ea-f53053717e01 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: b74ae52f-6794-49d2-867e-be0996b090aa] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:17:03.258748 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-06f8e4fa-49f1-4c65-98ea-f53053717e01 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa" status: 204 len: 0 microversion: 2.1 time: 0.302235 Jul 18 02:17:03.259615 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 971/1963] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:17:02 2022] DELETE /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:17:03.273083 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f64d3996-dd1d-40ef-98a7-312cee7e5193 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:03.275008 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f64d3996-dd1d-40ef-98a7-312cee7e5193 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: a598ccda-c16b-45d8-aca0-d3d242ec0c23] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:03.288334 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f64d3996-dd1d-40ef-98a7-312cee7e5193 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:03.288798 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f64d3996-dd1d-40ef-98a7-312cee7e5193 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:03.293911 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f64d3996-dd1d-40ef-98a7-312cee7e5193 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:03.294380 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f64d3996-dd1d-40ef-98a7-312cee7e5193 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:03.350128 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-f64d3996-dd1d-40ef-98a7-312cee7e5193 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] HTTP exception thrown: Instance a598ccda-c16b-45d8-aca0-d3d242ec0c23 could not be found. Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f64d3996-dd1d-40ef-98a7-312cee7e5193 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Request method failure captured: Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/a598ccda-c16b-45d8-aca0-d3d242ec0c23 HTTP/1.1 Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MGCWrWHCddcrN4RqNfnBFPBSabjGvo5gM77Tw6VfoUAuTFYZJ3-CEdjKYax5T5uhOfCuNLEmOh531jNb7qti0OvzfRwr8H4xYd6v1BUcfs9beu0dZ5AWDeHwp-6BMUAWJqOL9IUkCg8_lfh7_6ef8hef4LR8j_2qAWtZaYjzyZxBJ0 Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 8f8bb1ebead3481f946ae7878c3cfc41 Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersOnMultiNodesTest-1310468150 Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8f8bb1ebead3481f946ae7878c3cfc41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8f8bb1ebead3481f946ae7878c3cfc41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8f8bb1ebead3481f946ae7878c3cfc41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8f8bb1ebead3481f946ae7878c3cfc41"}]}] Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersOnMultiNodesTest-1310468150 Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 8f8bb1ebead3481f946ae7878c3cfc41 Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1310468150 Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersOnMultiNodesTest-1310468150-project Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 100f65c0d9d3456fa177599821aed7ff Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersOnMultiNodesTest-1310468150-project Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance a598ccda-c16b-45d8-aca0-d3d242ec0c23 could not be found. Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'a598ccda-c16b-45d8-aca0-d3d242ec0c23'} Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a598ccda-c16b-45d8-aca0-d3d242ec0c23 could not be found. Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a598ccda-c16b-45d8-aca0-d3d242ec0c23 could not be found. Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:17:03.358021 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:17:03.364138 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:03.364138 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:17:03.364138 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:17:03.364138 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:17:03.364138 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:17:03.364138 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a598ccda-c16b-45d8-aca0-d3d242ec0c23 could not be found. Jul 18 02:17:03.364138 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:17:03.366305 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f64d3996-dd1d-40ef-98a7-312cee7e5193 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Returning 404 to user: Instance a598ccda-c16b-45d8-aca0-d3d242ec0c23 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:17:03.367399 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f64d3996-dd1d-40ef-98a7-312cee7e5193 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/a598ccda-c16b-45d8-aca0-d3d242ec0c23" status: 404 len: 111 microversion: 2.1 time: 0.105604 Jul 18 02:17:03.371548 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 972/1964] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:03 2022] GET /compute/v2.1/servers/a598ccda-c16b-45d8-aca0-d3d242ec0c23 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:17:03.393661 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a3d49bf5-a2b8-4705-b6a8-963fbb5a7a6c tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:03.394780 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a3d49bf5-a2b8-4705-b6a8-963fbb5a7a6c tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 11caf39a-9515-4e04-b244-3be043262875] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:03.408052 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a3d49bf5-a2b8-4705-b6a8-963fbb5a7a6c tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:03.414281 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a3d49bf5-a2b8-4705-b6a8-963fbb5a7a6c tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:03.415859 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a3d49bf5-a2b8-4705-b6a8-963fbb5a7a6c tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:03.416922 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a3d49bf5-a2b8-4705-b6a8-963fbb5a7a6c tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:03.682964 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a3d49bf5-a2b8-4705-b6a8-963fbb5a7a6c tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:03.698424 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a3d49bf5-a2b8-4705-b6a8-963fbb5a7a6c tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers/11caf39a-9515-4e04-b244-3be043262875" status: 200 len: 1517 microversion: 2.1 time: 0.325339 Jul 18 02:17:03.699444 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 973/1965] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:03 2022] GET /compute/v2.1/servers/11caf39a-9515-4e04-b244-3be043262875 => generated 1517 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:03.713855 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2b4cc721-26e0-4f2d-8883-1cbda3dea184 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:03.713855 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2b4cc721-26e0-4f2d-8883-1cbda3dea184 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: b74ae52f-6794-49d2-867e-be0996b090aa] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:03.714334 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b4cc721-26e0-4f2d-8883-1cbda3dea184 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:03.718399 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b4cc721-26e0-4f2d-8883-1cbda3dea184 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:03.718399 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b4cc721-26e0-4f2d-8883-1cbda3dea184 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:03.718399 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b4cc721-26e0-4f2d-8883-1cbda3dea184 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:04.088999 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2b4cc721-26e0-4f2d-8883-1cbda3dea184 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe79fa13328b4e40922d0e3e4551a8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6b8514bba84ba8a09c64abbb2d1a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:04.108194 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2b4cc721-26e0-4f2d-8883-1cbda3dea184 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "GET /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa" status: 200 len: 1683 microversion: 2.1 time: 0.406479 Jul 18 02:17:04.122345 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 974/1966] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:03 2022] GET /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa => generated 1683 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:04.137141 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-984725f5-67de-4a7e-acd6-072e63adceee tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:04.189214 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-984725f5-67de-4a7e-acd6-072e63adceee tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "DELETE /compute/v2.1/os-server-groups/79c8cde4-43d9-44ee-a52f-1013fc485b00" status: 204 len: 0 microversion: 2.1 time: 0.057935 Jul 18 02:17:04.192834 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 975/1967] 10.222.0.57 () {58 vars in 1265 bytes} [Mon Jul 18 02:17:04 2022] DELETE /compute/v2.1/os-server-groups/79c8cde4-43d9-44ee-a52f-1013fc485b00 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:17:04.206196 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-c700bc5d-55db-4098-a675-5a0ba925e1fe req-2eae2292-80bc-4118-825c-ac6e55e8bf19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25d7575c-c9a7-4dba-8f13-6c57e988af59", "name": "network-vif-deleted", "tag": "53440909-ff47-419d-9dd2-14b37718950a"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:04.233956 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-c700bc5d-55db-4098-a675-5a0ba925e1fe req-2eae2292-80bc-4118-825c-ac6e55e8bf19 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:04.235247 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-c700bc5d-55db-4098-a675-5a0ba925e1fe req-2eae2292-80bc-4118-825c-ac6e55e8bf19 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:04.266862 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-c700bc5d-55db-4098-a675-5a0ba925e1fe req-2eae2292-80bc-4118-825c-ac6e55e8bf19 service nova] Creating event network-vif-deleted:53440909-ff47-419d-9dd2-14b37718950a for instance 25d7575c-c9a7-4dba-8f13-6c57e988af59 on n-h2-465891-3 Jul 18 02:17:04.276636 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-c700bc5d-55db-4098-a675-5a0ba925e1fe req-2eae2292-80bc-4118-825c-ac6e55e8bf19 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081042 Jul 18 02:17:04.277811 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 976/1968] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:17:04.291872 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a04c4d8e-0305-469c-bf1b-c05378fca052 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb18b47d-0852-4f0e-8efd-899476724da4", "device": "/dev/xvdb"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:04.295375 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a04c4d8e-0305-469c-bf1b-c05378fca052 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:04.320304 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a04c4d8e-0305-469c-bf1b-c05378fca052 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:04.321651 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a04c4d8e-0305-469c-bf1b-c05378fca052 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:04.323281 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a04c4d8e-0305-469c-bf1b-c05378fca052 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:04.324614 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a04c4d8e-0305-469c-bf1b-c05378fca052 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:05.056524 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a04c4d8e-0305-469c-bf1b-c05378fca052 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "POST /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.773713 Jul 18 02:17:05.057483 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 977/1969] 10.222.0.57 () {62 vars in 1363 bytes} [Mon Jul 18 02:17:04 2022] POST /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec/os-volume_attachments => generated 194 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:17:05.082359 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-97e054f1-b010-496c-bc0d-f98418ee08f2 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:05.083299 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-97e054f1-b010-496c-bc0d-f98418ee08f2 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c207a0eb-5ef9-4932-9f3a-22f2a11129e5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:05.137888 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-97e054f1-b010-496c-bc0d-f98418ee08f2 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:05.141222 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-97e054f1-b010-496c-bc0d-f98418ee08f2 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:05.142803 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-97e054f1-b010-496c-bc0d-f98418ee08f2 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:05.143776 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-97e054f1-b010-496c-bc0d-f98418ee08f2 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:05.242365 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-97e054f1-b010-496c-bc0d-f98418ee08f2 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c207a0eb-5ef9-4932-9f3a-22f2a11129e5] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:17:05.492726 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-97e054f1-b010-496c-bc0d-f98418ee08f2 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5" status: 204 len: 0 microversion: 2.1 time: 0.432846 Jul 18 02:17:05.497427 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 978/1970] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:17:05 2022] DELETE /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:17:05.522476 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-74547237-2e9f-45de-861d-d9dfd6d22cba tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:05.524126 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-74547237-2e9f-45de-861d-d9dfd6d22cba tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 11caf39a-9515-4e04-b244-3be043262875] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:05.543203 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-74547237-2e9f-45de-861d-d9dfd6d22cba tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:05.543656 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-74547237-2e9f-45de-861d-d9dfd6d22cba tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:05.545398 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-74547237-2e9f-45de-861d-d9dfd6d22cba tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:05.546001 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-74547237-2e9f-45de-861d-d9dfd6d22cba tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:06.173649 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-74547237-2e9f-45de-861d-d9dfd6d22cba tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:06.189850 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-74547237-2e9f-45de-861d-d9dfd6d22cba tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers/11caf39a-9515-4e04-b244-3be043262875" status: 200 len: 1517 microversion: 2.1 time: 0.693860 Jul 18 02:17:06.190824 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 979/1971] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:05 2022] GET /compute/v2.1/servers/11caf39a-9515-4e04-b244-3be043262875 => generated 1517 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:06.210499 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fa2d8f83-b914-4bd1-baa2-47b7aac1a754 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:06.211680 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fa2d8f83-b914-4bd1-baa2-47b7aac1a754 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: b74ae52f-6794-49d2-867e-be0996b090aa] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:06.224236 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fa2d8f83-b914-4bd1-baa2-47b7aac1a754 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:06.229758 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fa2d8f83-b914-4bd1-baa2-47b7aac1a754 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:06.231394 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fa2d8f83-b914-4bd1-baa2-47b7aac1a754 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:06.232084 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fa2d8f83-b914-4bd1-baa2-47b7aac1a754 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:07.039255 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fa2d8f83-b914-4bd1-baa2-47b7aac1a754 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe79fa13328b4e40922d0e3e4551a8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6b8514bba84ba8a09c64abbb2d1a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:07.051270 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fa2d8f83-b914-4bd1-baa2-47b7aac1a754 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "GET /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa" status: 200 len: 1683 microversion: 2.1 time: 0.852583 Jul 18 02:17:07.051874 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 980/1972] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:06 2022] GET /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa => generated 1683 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:07.066671 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6ce8f785-ed69-4e37-b409-64c83c2dddf9 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:07.067301 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6ce8f785-ed69-4e37-b409-64c83c2dddf9 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c207a0eb-5ef9-4932-9f3a-22f2a11129e5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:07.085053 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6ce8f785-ed69-4e37-b409-64c83c2dddf9 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:07.085510 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6ce8f785-ed69-4e37-b409-64c83c2dddf9 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:07.094869 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6ce8f785-ed69-4e37-b409-64c83c2dddf9 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:07.095202 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6ce8f785-ed69-4e37-b409-64c83c2dddf9 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:07.402457 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:07.655572 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6ce8f785-ed69-4e37-b409-64c83c2dddf9 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:07.679597 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6ce8f785-ed69-4e37-b409-64c83c2dddf9 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5" status: 200 len: 1473 microversion: 2.1 time: 0.624520 Jul 18 02:17:07.680937 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 981/1973] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:07 2022] GET /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5 => generated 1473 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:07.708665 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-dd94dd02-02b6-49f9-85e7-c141a4419ebb req-42297f6d-b789-49e7-9649-74bc77b4becb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11caf39a-9515-4e04-b244-3be043262875", "name": "network-vif-deleted", "tag": "2dec9e13-e24b-4e03-ae42-a92defd8aaec"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:07.743391 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-dd94dd02-02b6-49f9-85e7-c141a4419ebb req-42297f6d-b789-49e7-9649-74bc77b4becb service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:07.744268 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-dd94dd02-02b6-49f9-85e7-c141a4419ebb req-42297f6d-b789-49e7-9649-74bc77b4becb service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:08.309797 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-dd94dd02-02b6-49f9-85e7-c141a4419ebb req-42297f6d-b789-49e7-9649-74bc77b4becb service nova] Creating event network-vif-deleted:2dec9e13-e24b-4e03-ae42-a92defd8aaec for instance 11caf39a-9515-4e04-b244-3be043262875 on n-h1-465891-3 Jul 18 02:17:08.329657 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-dd94dd02-02b6-49f9-85e7-c141a4419ebb req-42297f6d-b789-49e7-9649-74bc77b4becb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.642588 Jul 18 02:17:08.329657 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 982/1974] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:17:08.361881 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d771cf99-0f04-4706-83e8-2b8391862d8a tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:08.372200 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d771cf99-0f04-4706-83e8-2b8391862d8a tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 11caf39a-9515-4e04-b244-3be043262875] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:08.406984 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d771cf99-0f04-4706-83e8-2b8391862d8a tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:08.407647 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d771cf99-0f04-4706-83e8-2b8391862d8a tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:08.409168 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d771cf99-0f04-4706-83e8-2b8391862d8a tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:08.415318 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d771cf99-0f04-4706-83e8-2b8391862d8a tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:08.459110 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-d771cf99-0f04-4706-83e8-2b8391862d8a tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] HTTP exception thrown: Instance 11caf39a-9515-4e04-b244-3be043262875 could not be found. Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d771cf99-0f04-4706-83e8-2b8391862d8a tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Request method failure captured: Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/11caf39a-9515-4e04-b244-3be043262875 HTTP/1.1 Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MI8MPusgATUKFrHTQmd1gCQOSSETlPagSSlfyEs42mc7gHLv4CTOuYJNLE73RiuicpsVMD9RAliaYUdGNMZnvhbVB2gbC_dFSLjLbSwBaZQ1bN8KdHt_Asbc5RGU2_R5gspJ06JaAnBcmxuCZBnnEo2GtyFwE56zjhd9aJMxO2W8rs Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 58dcb69855544ff3b51109aa5d41f637 Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ListServerFiltersTestJSON-21025684 Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_58dcb69855544ff3b51109aa5d41f637"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/58dcb69855544ff3b51109aa5d41f637"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/58dcb69855544ff3b51109aa5d41f637"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/58dcb69855544ff3b51109aa5d41f637"}]}] Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ListServerFiltersTestJSON-21025684 Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 58dcb69855544ff3b51109aa5d41f637 Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-21025684 Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ListServerFiltersTestJSON-21025684-project Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 560f87bfc55d4de2b0106db2ce0ce2af Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ListServerFiltersTestJSON-21025684-project Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 11caf39a-9515-4e04-b244-3be043262875 could not be found. Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '11caf39a-9515-4e04-b244-3be043262875'} Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11caf39a-9515-4e04-b244-3be043262875 could not be found. Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11caf39a-9515-4e04-b244-3be043262875 could not be found. Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:17:08.461813 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:17:08.468613 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:08.468613 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:17:08.468613 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:17:08.468613 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:17:08.468613 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:17:08.468613 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11caf39a-9515-4e04-b244-3be043262875 could not be found. Jul 18 02:17:08.468613 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:17:08.471928 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d771cf99-0f04-4706-83e8-2b8391862d8a tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Returning 404 to user: Instance 11caf39a-9515-4e04-b244-3be043262875 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:17:08.472656 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d771cf99-0f04-4706-83e8-2b8391862d8a tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers/11caf39a-9515-4e04-b244-3be043262875" status: 404 len: 111 microversion: 2.1 time: 0.128410 Jul 18 02:17:08.473424 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 983/1975] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:08 2022] GET /compute/v2.1/servers/11caf39a-9515-4e04-b244-3be043262875 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:17:08.480967 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6b88760a-6609-47a7-be90-acf875069f77 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:08.481909 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6b88760a-6609-47a7-be90-acf875069f77 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: b74ae52f-6794-49d2-867e-be0996b090aa] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:08.491348 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6b88760a-6609-47a7-be90-acf875069f77 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:08.492255 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6b88760a-6609-47a7-be90-acf875069f77 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:08.504300 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6b88760a-6609-47a7-be90-acf875069f77 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:08.504889 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6b88760a-6609-47a7-be90-acf875069f77 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:08.557313 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:08.730636 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6b88760a-6609-47a7-be90-acf875069f77 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe79fa13328b4e40922d0e3e4551a8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6b8514bba84ba8a09c64abbb2d1a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:08.744057 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6b88760a-6609-47a7-be90-acf875069f77 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "GET /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa" status: 200 len: 1327 microversion: 2.1 time: 0.268973 Jul 18 02:17:08.745608 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 984/1976] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:08 2022] GET /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa => generated 1327 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:08.753294 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1ffba25e-2fe2-409a-ad23-427ad549f46a tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:08.754973 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1ffba25e-2fe2-409a-ad23-427ad549f46a tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 4a494dac-3446-4569-b154-b14f9eb22b3e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:08.764724 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1ffba25e-2fe2-409a-ad23-427ad549f46a tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:08.765964 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1ffba25e-2fe2-409a-ad23-427ad549f46a tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:08.767365 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1ffba25e-2fe2-409a-ad23-427ad549f46a tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:08.768140 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1ffba25e-2fe2-409a-ad23-427ad549f46a tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:08.854189 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1ffba25e-2fe2-409a-ad23-427ad549f46a tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 4a494dac-3446-4569-b154-b14f9eb22b3e] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:17:08.870479 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:09.107863 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1ffba25e-2fe2-409a-ad23-427ad549f46a tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4a494dac-3446-4569-b154-b14f9eb22b3e" status: 204 len: 0 microversion: 2.1 time: 0.360153 Jul 18 02:17:09.110273 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 985/1977] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:17:08 2022] DELETE /compute/v2.1/servers/4a494dac-3446-4569-b154-b14f9eb22b3e => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:17:09.128410 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-90e90e99-7cfe-42c9-86ec-f408d9bf787a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:09.137354 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-90e90e99-7cfe-42c9-86ec-f408d9bf787a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c207a0eb-5ef9-4932-9f3a-22f2a11129e5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:09.196696 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-90e90e99-7cfe-42c9-86ec-f408d9bf787a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:09.205948 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-90e90e99-7cfe-42c9-86ec-f408d9bf787a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:09.211841 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-90e90e99-7cfe-42c9-86ec-f408d9bf787a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:09.219772 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-90e90e99-7cfe-42c9-86ec-f408d9bf787a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:09.460010 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-90e90e99-7cfe-42c9-86ec-f408d9bf787a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:09.495591 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-90e90e99-7cfe-42c9-86ec-f408d9bf787a tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5" status: 200 len: 1431 microversion: 2.1 time: 0.380516 Jul 18 02:17:09.499725 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 986/1978] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:09 2022] GET /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5 => generated 1431 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:09.517662 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-46e6b2fd-d6a9-4ff4-abc9-0dfcfe0a0a3a tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:09.518337 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-46e6b2fd-d6a9-4ff4-abc9-0dfcfe0a0a3a tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 4a494dac-3446-4569-b154-b14f9eb22b3e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:09.537725 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-46e6b2fd-d6a9-4ff4-abc9-0dfcfe0a0a3a tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:09.538192 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-46e6b2fd-d6a9-4ff4-abc9-0dfcfe0a0a3a tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:09.539001 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-46e6b2fd-d6a9-4ff4-abc9-0dfcfe0a0a3a tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:09.541789 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-46e6b2fd-d6a9-4ff4-abc9-0dfcfe0a0a3a tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:09.905624 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-46e6b2fd-d6a9-4ff4-abc9-0dfcfe0a0a3a tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:09.938833 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-46e6b2fd-d6a9-4ff4-abc9-0dfcfe0a0a3a tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers/4a494dac-3446-4569-b154-b14f9eb22b3e" status: 200 len: 1517 microversion: 2.1 time: 0.416613 Jul 18 02:17:09.938833 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 987/1979] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:09 2022] GET /compute/v2.1/servers/4a494dac-3446-4569-b154-b14f9eb22b3e => generated 1517 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:09.938833 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-85b25647-01e5-48d1-a0fc-24af934cbc2c tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:09.938833 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-85b25647-01e5-48d1-a0fc-24af934cbc2c tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] [instance: b74ae52f-6794-49d2-867e-be0996b090aa] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:09.947624 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85b25647-01e5-48d1-a0fc-24af934cbc2c tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:09.956027 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85b25647-01e5-48d1-a0fc-24af934cbc2c tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:09.961494 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85b25647-01e5-48d1-a0fc-24af934cbc2c tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:09.962820 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85b25647-01e5-48d1-a0fc-24af934cbc2c tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:09.992481 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-85b25647-01e5-48d1-a0fc-24af934cbc2c tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] HTTP exception thrown: Instance b74ae52f-6794-49d2-867e-be0996b090aa could not be found. Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-85b25647-01e5-48d1-a0fc-24af934cbc2c tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Request method failure captured: Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa HTTP/1.1 Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MGQv7RbdlIe47Q-n5a7bHCAXP4uAfsxHZNZyO7aXRp9yCPq4dGOm3hoc3mS4zwQJB8fV0ozvdPNbpJXhpp8m_8QMYVMXorZ4biT6OhIRRlQVDib6X6zyRLGcGhlwYKUzB3X5IBJUHNF6K_ry3ENWbMAStM1H1DkAnVVnOmoxHZS_eg Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: fb6b8514bba84ba8a09c64abbb2d1a2e Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-VolumesAdminNegativeTest-546332838 Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fb6b8514bba84ba8a09c64abbb2d1a2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fb6b8514bba84ba8a09c64abbb2d1a2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fb6b8514bba84ba8a09c64abbb2d1a2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fb6b8514bba84ba8a09c64abbb2d1a2e"}]}] Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-VolumesAdminNegativeTest-546332838 Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: fb6b8514bba84ba8a09c64abbb2d1a2e Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-546332838 Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-VolumesAdminNegativeTest-546332838-project Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: fe79fa13328b4e40922d0e3e4551a8e8 Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-VolumesAdminNegativeTest-546332838-project Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance b74ae52f-6794-49d2-867e-be0996b090aa could not be found. Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'b74ae52f-6794-49d2-867e-be0996b090aa'} Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b74ae52f-6794-49d2-867e-be0996b090aa could not be found. Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b74ae52f-6794-49d2-867e-be0996b090aa could not be found. Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:17:10.006631 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:17:10.011343 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:10.011343 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:17:10.011343 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:17:10.011343 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:17:10.011343 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:17:10.011343 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b74ae52f-6794-49d2-867e-be0996b090aa could not be found. Jul 18 02:17:10.011343 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:17:10.011892 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-85b25647-01e5-48d1-a0fc-24af934cbc2c tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Returning 404 to user: Instance b74ae52f-6794-49d2-867e-be0996b090aa could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:17:10.015506 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-85b25647-01e5-48d1-a0fc-24af934cbc2c tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "GET /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa" status: 404 len: 111 microversion: 2.1 time: 0.091981 Jul 18 02:17:10.016111 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 988/1980] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:09 2022] GET /compute/v2.1/servers/b74ae52f-6794-49d2-867e-be0996b090aa => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:17:10.033938 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d68f351c-71e3-4a8b-bf60-a8fab92a8c23 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] Calling method '.version_select at 0x7ff49bedbee0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:10.079423 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d68f351c-71e3-4a8b-bf60-a8fab92a8c23 tempest-VolumesAdminNegativeTest-546332838 tempest-VolumesAdminNegativeTest-546332838-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1423110932" status: 202 len: 0 microversion: 2.1 time: 0.052858 Jul 18 02:17:10.086197 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 989/1981] 10.222.0.57 () {58 vars in 1220 bytes} [Mon Jul 18 02:17:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1423110932 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:17:10.423900 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-52b2077e-031c-40f2-805c-2af285db2865 req-80711fba-b94c-438a-b640-1e2aa72af774 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b74ae52f-6794-49d2-867e-be0996b090aa", "name": "network-vif-deleted", "tag": "22d8b9d4-cdb4-4747-87c6-94168bb42281"}, {"server_uuid": "c207a0eb-5ef9-4932-9f3a-22f2a11129e5", "name": "network-vif-deleted", "tag": "e0557aa1-29d2-4268-a9d8-e4d7f46423d1"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:10.444479 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=10 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:10.496097 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-52b2077e-031c-40f2-805c-2af285db2865 req-80711fba-b94c-438a-b640-1e2aa72af774 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:10.505362 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-52b2077e-031c-40f2-805c-2af285db2865 req-80711fba-b94c-438a-b640-1e2aa72af774 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:10.588938 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-52b2077e-031c-40f2-805c-2af285db2865 req-80711fba-b94c-438a-b640-1e2aa72af774 service nova] Creating event network-vif-deleted:22d8b9d4-cdb4-4747-87c6-94168bb42281 for instance b74ae52f-6794-49d2-867e-be0996b090aa on n-h2-465891-3 Jul 18 02:17:10.594234 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-52b2077e-031c-40f2-805c-2af285db2865 req-80711fba-b94c-438a-b640-1e2aa72af774 service nova] Creating event network-vif-deleted:e0557aa1-29d2-4268-a9d8-e4d7f46423d1 for instance c207a0eb-5ef9-4932-9f3a-22f2a11129e5 on n-h1-465891-3 Jul 18 02:17:10.641225 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-52b2077e-031c-40f2-805c-2af285db2865 req-80711fba-b94c-438a-b640-1e2aa72af774 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.224774 Jul 18 02:17:10.646849 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 990/1982] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:17:10.661200 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c02987e7-5701-46b2-a536-cc9509b076ee tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:10.662848 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c02987e7-5701-46b2-a536-cc9509b076ee tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c207a0eb-5ef9-4932-9f3a-22f2a11129e5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:10.739144 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c02987e7-5701-46b2-a536-cc9509b076ee tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:10.740395 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c02987e7-5701-46b2-a536-cc9509b076ee tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:10.741915 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c02987e7-5701-46b2-a536-cc9509b076ee tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:10.749192 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c02987e7-5701-46b2-a536-cc9509b076ee tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:10.907152 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c02987e7-5701-46b2-a536-cc9509b076ee tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:10.910139 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c02987e7-5701-46b2-a536-cc9509b076ee tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:10.911266 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-c02987e7-5701-46b2-a536-cc9509b076ee tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lazy-loading 'fault' on Instance uuid c207a0eb-5ef9-4932-9f3a-22f2a11129e5 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:17:10.991561 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c02987e7-5701-46b2-a536-cc9509b076ee tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f65c0d9d3456fa177599821aed7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8bb1ebead3481f946ae7878c3cfc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:11.003991 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c02987e7-5701-46b2-a536-cc9509b076ee tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5" status: 200 len: 1307 microversion: 2.1 time: 0.354182 Jul 18 02:17:11.005375 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 991/1983] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:10 2022] GET /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5 => generated 1307 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:11.028454 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dea96ad9-b290-4365-9320-ba03a89d8103 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:11.031775 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-dea96ad9-b290-4365-9320-ba03a89d8103 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 4a494dac-3446-4569-b154-b14f9eb22b3e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:11.070086 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dea96ad9-b290-4365-9320-ba03a89d8103 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:11.070728 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dea96ad9-b290-4365-9320-ba03a89d8103 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:11.072747 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dea96ad9-b290-4365-9320-ba03a89d8103 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:11.073470 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dea96ad9-b290-4365-9320-ba03a89d8103 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:11.759914 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-dea96ad9-b290-4365-9320-ba03a89d8103 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:11.768874 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-dea96ad9-b290-4365-9320-ba03a89d8103 tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers/4a494dac-3446-4569-b154-b14f9eb22b3e" status: 200 len: 1517 microversion: 2.1 time: 0.756518 Jul 18 02:17:11.791400 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 992/1984] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:11 2022] GET /compute/v2.1/servers/4a494dac-3446-4569-b154-b14f9eb22b3e => generated 1517 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:12.032927 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5f98aa9f-8ab8-467c-a096-be3029740664 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:12.033643 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5f98aa9f-8ab8-467c-a096-be3029740664 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] [instance: c207a0eb-5ef9-4932-9f3a-22f2a11129e5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:12.036449 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=4,nova_api:DELETE=4 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:12.047743 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5f98aa9f-8ab8-467c-a096-be3029740664 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:12.048669 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5f98aa9f-8ab8-467c-a096-be3029740664 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:12.053042 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5f98aa9f-8ab8-467c-a096-be3029740664 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:12.055077 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5f98aa9f-8ab8-467c-a096-be3029740664 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:12.096868 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-5f98aa9f-8ab8-467c-a096-be3029740664 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] HTTP exception thrown: Instance c207a0eb-5ef9-4932-9f3a-22f2a11129e5 could not be found. Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5f98aa9f-8ab8-467c-a096-be3029740664 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Request method failure captured: Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5 HTTP/1.1 Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MGCWrWHCddcrN4RqNfnBFPBSabjGvo5gM77Tw6VfoUAuTFYZJ3-CEdjKYax5T5uhOfCuNLEmOh531jNb7qti0OvzfRwr8H4xYd6v1BUcfs9beu0dZ5AWDeHwp-6BMUAWJqOL9IUkCg8_lfh7_6ef8hef4LR8j_2qAWtZaYjzyZxBJ0 Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 8f8bb1ebead3481f946ae7878c3cfc41 Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersOnMultiNodesTest-1310468150 Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8f8bb1ebead3481f946ae7878c3cfc41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8f8bb1ebead3481f946ae7878c3cfc41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8f8bb1ebead3481f946ae7878c3cfc41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8f8bb1ebead3481f946ae7878c3cfc41"}]}] Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersOnMultiNodesTest-1310468150 Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 8f8bb1ebead3481f946ae7878c3cfc41 Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1310468150 Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersOnMultiNodesTest-1310468150-project Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 100f65c0d9d3456fa177599821aed7ff Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersOnMultiNodesTest-1310468150-project Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance c207a0eb-5ef9-4932-9f3a-22f2a11129e5 could not be found. Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'c207a0eb-5ef9-4932-9f3a-22f2a11129e5'} Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c207a0eb-5ef9-4932-9f3a-22f2a11129e5 could not be found. Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c207a0eb-5ef9-4932-9f3a-22f2a11129e5 could not be found. Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:17:12.102567 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:17:12.108554 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:12.108554 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:17:12.108554 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:17:12.108554 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:17:12.108554 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:17:12.108554 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c207a0eb-5ef9-4932-9f3a-22f2a11129e5 could not be found. Jul 18 02:17:12.108554 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:17:12.112030 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5f98aa9f-8ab8-467c-a096-be3029740664 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] Returning 404 to user: Instance c207a0eb-5ef9-4932-9f3a-22f2a11129e5 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:17:12.114472 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5f98aa9f-8ab8-467c-a096-be3029740664 tempest-ServersOnMultiNodesTest-1310468150 tempest-ServersOnMultiNodesTest-1310468150-project] 10.222.0.57 "GET /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5" status: 404 len: 111 microversion: 2.1 time: 0.086235 Jul 18 02:17:12.116605 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 993/1985] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:12 2022] GET /compute/v2.1/servers/c207a0eb-5ef9-4932-9f3a-22f2a11129e5 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:17:12.807064 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5b84926e-e1fb-45ab-b181-ef152761d96b tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:12.808760 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5b84926e-e1fb-45ab-b181-ef152761d96b tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 4a494dac-3446-4569-b154-b14f9eb22b3e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:12.854921 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5b84926e-e1fb-45ab-b181-ef152761d96b tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:12.855391 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5b84926e-e1fb-45ab-b181-ef152761d96b tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:12.863695 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5b84926e-e1fb-45ab-b181-ef152761d96b tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:12.864194 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5b84926e-e1fb-45ab-b181-ef152761d96b tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:13.150750 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5b84926e-e1fb-45ab-b181-ef152761d96b tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560f87bfc55d4de2b0106db2ce0ce2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dcb69855544ff3b51109aa5d41f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:13.168161 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5b84926e-e1fb-45ab-b181-ef152761d96b tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers/4a494dac-3446-4569-b154-b14f9eb22b3e" status: 200 len: 1475 microversion: 2.1 time: 0.371610 Jul 18 02:17:13.169987 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 994/1986] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:12 2022] GET /compute/v2.1/servers/4a494dac-3446-4569-b154-b14f9eb22b3e => generated 1475 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:13.238210 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-fc17989e-5074-496d-99fd-3f8d5d9c4dec req-79212561-027c-4a8b-9d6f-6b5c3a154ee1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a494dac-3446-4569-b154-b14f9eb22b3e", "name": "network-vif-deleted", "tag": "599eb580-601e-480c-8a2a-f0553823ab76"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:13.257647 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-fc17989e-5074-496d-99fd-3f8d5d9c4dec req-79212561-027c-4a8b-9d6f-6b5c3a154ee1 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:13.258956 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-fc17989e-5074-496d-99fd-3f8d5d9c4dec req-79212561-027c-4a8b-9d6f-6b5c3a154ee1 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:13.277945 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-fc17989e-5074-496d-99fd-3f8d5d9c4dec req-79212561-027c-4a8b-9d6f-6b5c3a154ee1 service nova] Creating event network-vif-deleted:599eb580-601e-480c-8a2a-f0553823ab76 for instance 4a494dac-3446-4569-b154-b14f9eb22b3e on n-h1-465891-3 Jul 18 02:17:13.290463 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-fc17989e-5074-496d-99fd-3f8d5d9c4dec req-79212561-027c-4a8b-9d6f-6b5c3a154ee1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070293 Jul 18 02:17:13.291929 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 995/1987] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:17:14.227368 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d41b9eb1-a6cf-4235-bf5f-3845bc818f0a tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:14.231081 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d41b9eb1-a6cf-4235-bf5f-3845bc818f0a tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] [instance: 4a494dac-3446-4569-b154-b14f9eb22b3e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:14.263557 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d41b9eb1-a6cf-4235-bf5f-3845bc818f0a tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:14.281337 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d41b9eb1-a6cf-4235-bf5f-3845bc818f0a tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:14.288356 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d41b9eb1-a6cf-4235-bf5f-3845bc818f0a tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:14.293757 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d41b9eb1-a6cf-4235-bf5f-3845bc818f0a tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:14.363248 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-d41b9eb1-a6cf-4235-bf5f-3845bc818f0a tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] HTTP exception thrown: Instance 4a494dac-3446-4569-b154-b14f9eb22b3e could not be found. Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d41b9eb1-a6cf-4235-bf5f-3845bc818f0a tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Request method failure captured: Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/4a494dac-3446-4569-b154-b14f9eb22b3e HTTP/1.1 Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MI8MPusgATUKFrHTQmd1gCQOSSETlPagSSlfyEs42mc7gHLv4CTOuYJNLE73RiuicpsVMD9RAliaYUdGNMZnvhbVB2gbC_dFSLjLbSwBaZQ1bN8KdHt_Asbc5RGU2_R5gspJ06JaAnBcmxuCZBnnEo2GtyFwE56zjhd9aJMxO2W8rs Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 58dcb69855544ff3b51109aa5d41f637 Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ListServerFiltersTestJSON-21025684 Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_58dcb69855544ff3b51109aa5d41f637"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/58dcb69855544ff3b51109aa5d41f637"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/58dcb69855544ff3b51109aa5d41f637"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/58dcb69855544ff3b51109aa5d41f637"}]}] Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ListServerFiltersTestJSON-21025684 Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 58dcb69855544ff3b51109aa5d41f637 Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-21025684 Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ListServerFiltersTestJSON-21025684-project Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 560f87bfc55d4de2b0106db2ce0ce2af Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ListServerFiltersTestJSON-21025684-project Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 4a494dac-3446-4569-b154-b14f9eb22b3e could not be found. Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '4a494dac-3446-4569-b154-b14f9eb22b3e'} Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a494dac-3446-4569-b154-b14f9eb22b3e could not be found. Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a494dac-3446-4569-b154-b14f9eb22b3e could not be found. Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:17:14.367997 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:17:14.382894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:14.382894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:17:14.382894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:17:14.382894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:17:14.382894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:17:14.382894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a494dac-3446-4569-b154-b14f9eb22b3e could not be found. Jul 18 02:17:14.382894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:17:14.382894 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d41b9eb1-a6cf-4235-bf5f-3845bc818f0a tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] Returning 404 to user: Instance 4a494dac-3446-4569-b154-b14f9eb22b3e could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:17:14.382894 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d41b9eb1-a6cf-4235-bf5f-3845bc818f0a tempest-ListServerFiltersTestJSON-21025684 tempest-ListServerFiltersTestJSON-21025684-project] 10.222.0.57 "GET /compute/v2.1/servers/4a494dac-3446-4569-b154-b14f9eb22b3e" status: 404 len: 111 microversion: 2.1 time: 0.179004 Jul 18 02:17:14.382894 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 996/1988] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:14 2022] GET /compute/v2.1/servers/4a494dac-3446-4569-b154-b14f9eb22b3e => generated 111 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:17:22.239424 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3d4e7e43-df69-42d4-bdfc-79b833fe07a2 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-608195674", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": "none"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:24.320024 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:32.284268 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=9 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:37.731133 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f33ed0a5-93fe-4815-9531-9d0926ff42bf tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf" status: 200 len: 1436 microversion: 2.1 time: 39.155151 Jul 18 02:17:37.736674 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 993/1989] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:16:58 2022] GET /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf => generated 1436 bytes in 39165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:37.764612 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-3d4e7e43-df69-42d4-bdfc-79b833fe07a2 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:17:37.766190 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-3d4e7e43-df69-42d4-bdfc-79b833fe07a2 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:17:37.767401 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-3d4e7e43-df69-42d4-bdfc-79b833fe07a2 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:17:37.770064 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-3d4e7e43-df69-42d4-bdfc-79b833fe07a2 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:17:37.774295 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-3d4e7e43-df69-42d4-bdfc-79b833fe07a2 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:17:37.779121 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a55e6b4d-5837-44b7-9a47-d69ba571593b tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:37.781437 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a55e6b4d-5837-44b7-9a47-d69ba571593b tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:37.886468 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a55e6b4d-5837-44b7-9a47-d69ba571593b tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:37.887938 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a55e6b4d-5837-44b7-9a47-d69ba571593b tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:37.892626 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a55e6b4d-5837-44b7-9a47-d69ba571593b tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:37.913363 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3d4e7e43-df69-42d4-bdfc-79b833fe07a2 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:37.913809 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3d4e7e43-df69-42d4-bdfc-79b833fe07a2 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:37.915319 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a55e6b4d-5837-44b7-9a47-d69ba571593b tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:37.918650 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3d4e7e43-df69-42d4-bdfc-79b833fe07a2 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:37.919501 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3d4e7e43-df69-42d4-bdfc-79b833fe07a2 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:37.991195 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-3d4e7e43-df69-42d4-bdfc-79b833fe07a2 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Getting quotas for project e7908acaf63a40ea973bd9834ac8f443. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:17:38.004992 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-3d4e7e43-df69-42d4-bdfc-79b833fe07a2 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Getting quotas for user 85586fc53a2145438642fa8eb0e94a65 and project e7908acaf63a40ea973bd9834ac8f443. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:17:38.062092 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3d4e7e43-df69-42d4-bdfc-79b833fe07a2 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:17:38.068259 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3d4e7e43-df69-42d4-bdfc-79b833fe07a2 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] [instance: 3b508c42-7dd6-4483-83b3-b210ef7ca47e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:17:38.249833 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-a55e6b4d-5837-44b7-9a47-d69ba571593b tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lazy-loading 'services' on Instance uuid 174a0067-ee9a-493e-a1d9-099fdf4bbaec {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:17:38.285626 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a55e6b4d-5837-44b7-9a47-d69ba571593b tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 200 len: 2422 microversion: 2.25 time: 0.546973 Jul 18 02:17:38.301734 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 994/1990] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:17:37 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 2422 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:17:38.303489 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0a4b401a-575c-440c-ab80-4dbc8beee517 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:38.311118 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0a4b401a-575c-440c-ab80-4dbc8beee517 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] [instance: 32361df9-4e50-409c-9cc7-6f70ba6ce26e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:38.321017 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a4b401a-575c-440c-ab80-4dbc8beee517 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:38.327928 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3d4e7e43-df69-42d4-bdfc-79b833fe07a2 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 16.757863 Jul 18 02:17:38.329135 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 997/1991] 10.222.0.57 () {62 vars in 1187 bytes} [Mon Jul 18 02:17:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 16761 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 02:17:38.343075 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a4b401a-575c-440c-ab80-4dbc8beee517 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:38.343938 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a4b401a-575c-440c-ab80-4dbc8beee517 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:38.344386 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a4b401a-575c-440c-ab80-4dbc8beee517 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:38.355059 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-07dfef9f-fc6f-4c28-920f-e1175dced9e1 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-465891-3", "block_migration": "auto"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:38.363372 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-07dfef9f-fc6f-4c28-920f-e1175dced9e1 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:38.384757 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-07dfef9f-fc6f-4c28-920f-e1175dced9e1 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:38.386574 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-07dfef9f-fc6f-4c28-920f-e1175dced9e1 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:38.389518 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-07dfef9f-fc6f-4c28-920f-e1175dced9e1 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:38.390392 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-07dfef9f-fc6f-4c28-920f-e1175dced9e1 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:38.614495 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-07dfef9f-fc6f-4c28-920f-e1175dced9e1 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lazy-loading 'flavor' on Instance uuid 174a0067-ee9a-493e-a1d9-099fdf4bbaec {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:17:38.710336 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-07dfef9f-fc6f-4c28-920f-e1175dced9e1 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Going to try to live migrate instance to n-h1-465891-3 {{(pid=119543) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 18 02:17:39.422534 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0a4b401a-575c-440c-ab80-4dbc8beee517 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28fb70d1545b087bce52f2975a1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c8e07f8a9b4a398614fcf02c561416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:39.440830 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0a4b401a-575c-440c-ab80-4dbc8beee517 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e" status: 200 len: 1465 microversion: 2.1 time: 1.144725 Jul 18 02:17:39.444522 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 995/1992] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:38 2022] GET /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e => generated 1465 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:39.478172 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e1a4bb32-f328-4222-85c1-b3bd2c4d8fea tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:39.487363 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e1a4bb32-f328-4222-85c1-b3bd2c4d8fea tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] [instance: 3b508c42-7dd6-4483-83b3-b210ef7ca47e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:39.806559 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e1a4bb32-f328-4222-85c1-b3bd2c4d8fea tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85586fc53a2145438642fa8eb0e94a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7908acaf63a40ea973bd9834ac8f443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:39.850955 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e1a4bb32-f328-4222-85c1-b3bd2c4d8fea tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85586fc53a2145438642fa8eb0e94a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7908acaf63a40ea973bd9834ac8f443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:39.861400 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e1a4bb32-f328-4222-85c1-b3bd2c4d8fea tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85586fc53a2145438642fa8eb0e94a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7908acaf63a40ea973bd9834ac8f443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:39.871346 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e1a4bb32-f328-4222-85c1-b3bd2c4d8fea tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] 10.222.0.57 "GET /compute/v2.1/servers/3b508c42-7dd6-4483-83b3-b210ef7ca47e" status: 200 len: 1280 microversion: 2.47 time: 0.423414 Jul 18 02:17:39.878589 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 996/1993] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:17:39 2022] GET /compute/v2.1/servers/3b508c42-7dd6-4483-83b3-b210ef7ca47e => generated 1280 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:17:39.893409 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e33d927d-a475-427d-9681-80d2d7ce1fad tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a8550e50>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:43.216439 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e33d927d-a475-427d-9681-80d2d7ce1fad tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "DELETE /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf" status: 204 len: 0 microversion: 2.1 time: 3.325861 Jul 18 02:17:43.218739 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 997/1994] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:39 2022] DELETE /compute/v2.1/images/d5f37061-2912-4a27-809b-6219f7308abf => generated 0 bytes in 3332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:17:43.240165 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-db3b257e-8bfc-4a98-b177-bf527200d111 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:43.244349 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-db3b257e-8bfc-4a98-b177-bf527200d111 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] [instance: 3b508c42-7dd6-4483-83b3-b210ef7ca47e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:43.275206 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-db3b257e-8bfc-4a98-b177-bf527200d111 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:43.276410 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-db3b257e-8bfc-4a98-b177-bf527200d111 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:43.284604 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-db3b257e-8bfc-4a98-b177-bf527200d111 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:43.298920 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-db3b257e-8bfc-4a98-b177-bf527200d111 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:44.836623 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-db3b257e-8bfc-4a98-b177-bf527200d111 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85586fc53a2145438642fa8eb0e94a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7908acaf63a40ea973bd9834ac8f443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:44.920181 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-db3b257e-8bfc-4a98-b177-bf527200d111 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85586fc53a2145438642fa8eb0e94a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7908acaf63a40ea973bd9834ac8f443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:44.925724 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-db3b257e-8bfc-4a98-b177-bf527200d111 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85586fc53a2145438642fa8eb0e94a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7908acaf63a40ea973bd9834ac8f443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:44.928582 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-db3b257e-8bfc-4a98-b177-bf527200d111 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] 10.222.0.57 "GET /compute/v2.1/servers/3b508c42-7dd6-4483-83b3-b210ef7ca47e" status: 200 len: 1338 microversion: 2.47 time: 1.707815 Jul 18 02:17:44.941853 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 998/1995] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:17:43 2022] GET /compute/v2.1/servers/3b508c42-7dd6-4483-83b3-b210ef7ca47e => generated 1338 bytes in 1712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:17:44.957436 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b1d78d0c-62fe-494b-8a89-f5e3f7d2b1cc tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '.version_select at 0x7ff4a85ca820>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:45.046192 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-b1d78d0c-62fe-494b-8a89-f5e3f7d2b1cc tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] HTTP exception thrown: Image not found. Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b1d78d0c-62fe-494b-8a89-f5e3f7d2b1cc tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Request method failure captured: Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372 HTTP/1.1 Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MITEAlZp93OeZ-U1RRSSge7lqtV_XWE_Klx2sq7ovrJ1CzwP725dD8UvFFnPxzfUNIsef0cib4XEV5e9bmgqy_KlD1pSM86WAkf4LTENkSbTVK8KXqIjFPuEKt5SNb2q-ZLJkwKk9oPxZ7T0P2uTBaPEXox4MI7anaVqOt26zV38w4 Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: f0c8e07f8a9b4a398614fcf02c561416 Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ImagesOneServerTestJSON-1709241645 Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f0c8e07f8a9b4a398614fcf02c561416"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f0c8e07f8a9b4a398614fcf02c561416"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f0c8e07f8a9b4a398614fcf02c561416"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f0c8e07f8a9b4a398614fcf02c561416"}]}] Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ImagesOneServerTestJSON-1709241645 Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: f0c8e07f8a9b4a398614fcf02c561416 Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1709241645 Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ImagesOneServerTestJSON-1709241645-project Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 9ca28fb70d1545b087bce52f2975a1ea Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ImagesOneServerTestJSON-1709241645-project Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: exception: Image not found. Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '3eb238d2-163e-4ee5-b17f-91bf0a57d372'} Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3eb238d2-163e-4ee5-b17f-91bf0a57d372 to delete Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3eb238d2-163e-4ee5-b17f-91bf0a57d372 could not be found. Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:17:45.048537 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:45.054359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:17:45.054359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:17:45.054359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:17:45.054359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:17:45.054359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:17:45.054359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:17:45.054359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:17:45.054359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:17:45.054359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 18 02:17:45.054359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 02:17:45.054359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:17:45.054359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:17:45.054359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:17:45.054359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:17:45.054359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:45.054359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:17:45.054359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:17:45.054359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:17:45.054359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:17:45.054359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:17:45.054359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:17:45.059986 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b1d78d0c-62fe-494b-8a89-f5e3f7d2b1cc tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Returning 404 to user: Image not found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:17:45.061285 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b1d78d0c-62fe-494b-8a89-f5e3f7d2b1cc tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "DELETE /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372" status: 404 len: 62 microversion: 2.1 time: 0.126166 Jul 18 02:17:45.062778 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 999/1996] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:44 2022] DELETE /compute/v2.1/images/3eb238d2-163e-4ee5-b17f-91bf0a57d372 => generated 62 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:17:45.073077 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6bed3444-f462-4e5b-9627-bcb4986e963a tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:45.077193 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6bed3444-f462-4e5b-9627-bcb4986e963a tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] [instance: 32361df9-4e50-409c-9cc7-6f70ba6ce26e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:45.097143 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6bed3444-f462-4e5b-9627-bcb4986e963a tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:45.097988 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6bed3444-f462-4e5b-9627-bcb4986e963a tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:45.099026 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6bed3444-f462-4e5b-9627-bcb4986e963a tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:45.099662 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6bed3444-f462-4e5b-9627-bcb4986e963a tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:45.152994 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6bed3444-f462-4e5b-9627-bcb4986e963a tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] [instance: 32361df9-4e50-409c-9cc7-6f70ba6ce26e] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:17:45.292251 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6bed3444-f462-4e5b-9627-bcb4986e963a tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "DELETE /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e" status: 204 len: 0 microversion: 2.1 time: 0.223261 Jul 18 02:17:45.295284 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1000/1997] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:17:45 2022] DELETE /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:17:45.308211 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7b0d12be-e7d3-4f95-862b-c767b86d809a tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:45.311572 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7b0d12be-e7d3-4f95-862b-c767b86d809a tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] [instance: 32361df9-4e50-409c-9cc7-6f70ba6ce26e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:45.322730 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7b0d12be-e7d3-4f95-862b-c767b86d809a tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:45.323564 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7b0d12be-e7d3-4f95-862b-c767b86d809a tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:45.326745 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7b0d12be-e7d3-4f95-862b-c767b86d809a tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:45.328381 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7b0d12be-e7d3-4f95-862b-c767b86d809a tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:47.696207 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7b0d12be-e7d3-4f95-862b-c767b86d809a tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28fb70d1545b087bce52f2975a1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c8e07f8a9b4a398614fcf02c561416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:47.765124 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7b0d12be-e7d3-4f95-862b-c767b86d809a tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e" status: 200 len: 1471 microversion: 2.1 time: 2.463081 Jul 18 02:17:47.787200 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1001/1998] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:45 2022] GET /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e => generated 1471 bytes in 2487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:17:47.821773 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-81fb423f-f10d-4911-b93b-ea95eeaf503f tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:47.828360 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-81fb423f-f10d-4911-b93b-ea95eeaf503f tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] [instance: 3b508c42-7dd6-4483-83b3-b210ef7ca47e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:47.865942 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-81fb423f-f10d-4911-b93b-ea95eeaf503f tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:47.876307 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-81fb423f-f10d-4911-b93b-ea95eeaf503f tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:47.883581 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-81fb423f-f10d-4911-b93b-ea95eeaf503f tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:47.887729 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-81fb423f-f10d-4911-b93b-ea95eeaf503f tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:47.955241 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:48.044336 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:48.254898 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-81fb423f-f10d-4911-b93b-ea95eeaf503f tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85586fc53a2145438642fa8eb0e94a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7908acaf63a40ea973bd9834ac8f443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:48.293969 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-81fb423f-f10d-4911-b93b-ea95eeaf503f tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85586fc53a2145438642fa8eb0e94a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7908acaf63a40ea973bd9834ac8f443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:48.300148 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-81fb423f-f10d-4911-b93b-ea95eeaf503f tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85586fc53a2145438642fa8eb0e94a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7908acaf63a40ea973bd9834ac8f443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:48.311498 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-81fb423f-f10d-4911-b93b-ea95eeaf503f tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] 10.222.0.57 "GET /compute/v2.1/servers/3b508c42-7dd6-4483-83b3-b210ef7ca47e" status: 200 len: 1338 microversion: 2.47 time: 0.513529 Jul 18 02:17:48.312971 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1002/1999] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:17:47 2022] GET /compute/v2.1/servers/3b508c42-7dd6-4483-83b3-b210ef7ca47e => generated 1338 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:17:48.586848 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-07dfef9f-fc6f-4c28-920f-e1175dced9e1 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec/action" status: 202 len: 0 microversion: 2.25 time: 10.252415 Jul 18 02:17:48.588981 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 998/2000] 10.222.0.57 () {62 vars in 1318 bytes} [Mon Jul 18 02:17:38 2022] POST /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec/action => generated 0 bytes in 10256 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:17:48.599795 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2e03a154-b8ee-40a4-b12c-7898963e1f88 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:48.601109 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2e03a154-b8ee-40a4-b12c-7898963e1f88 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:48.631404 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2e03a154-b8ee-40a4-b12c-7898963e1f88 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:48.632285 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2e03a154-b8ee-40a4-b12c-7898963e1f88 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:48.638173 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2e03a154-b8ee-40a4-b12c-7898963e1f88 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:48.639205 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2e03a154-b8ee-40a4-b12c-7898963e1f88 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:48.804164 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bbcf17db-0704-495d-9265-f8c8a0f4373f tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:48.805137 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bbcf17db-0704-495d-9265-f8c8a0f4373f tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] [instance: 32361df9-4e50-409c-9cc7-6f70ba6ce26e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:48.827673 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:48.829971 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bbcf17db-0704-495d-9265-f8c8a0f4373f tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:48.830752 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bbcf17db-0704-495d-9265-f8c8a0f4373f tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:48.832082 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bbcf17db-0704-495d-9265-f8c8a0f4373f tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:48.834185 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bbcf17db-0704-495d-9265-f8c8a0f4373f tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:49.821368 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:50.160548 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bbcf17db-0704-495d-9265-f8c8a0f4373f tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28fb70d1545b087bce52f2975a1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c8e07f8a9b4a398614fcf02c561416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:50.217624 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bbcf17db-0704-495d-9265-f8c8a0f4373f tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e" status: 200 len: 1471 microversion: 2.1 time: 1.417510 Jul 18 02:17:50.235396 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 999/2001] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:48 2022] GET /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e => generated 1471 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:17:50.291513 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7df8f9fe-f1ed-4119-b253-d5b678d4ee95 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:50.300555 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7df8f9fe-f1ed-4119-b253-d5b678d4ee95 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] [instance: 3b508c42-7dd6-4483-83b3-b210ef7ca47e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:50.359250 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7df8f9fe-f1ed-4119-b253-d5b678d4ee95 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:50.361343 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7df8f9fe-f1ed-4119-b253-d5b678d4ee95 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:50.376755 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7df8f9fe-f1ed-4119-b253-d5b678d4ee95 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:50.388082 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7df8f9fe-f1ed-4119-b253-d5b678d4ee95 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:50.680854 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2e03a154-b8ee-40a4-b12c-7898963e1f88 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:50.744439 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2e03a154-b8ee-40a4-b12c-7898963e1f88 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:50.750981 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2e03a154-b8ee-40a4-b12c-7898963e1f88 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:50.759374 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2e03a154-b8ee-40a4-b12c-7898963e1f88 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 200 len: 1814 microversion: 2.25 time: 2.163769 Jul 18 02:17:50.778973 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1003/2002] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:17:48 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 1814 bytes in 2183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:17:51.304307 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7df8f9fe-f1ed-4119-b253-d5b678d4ee95 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85586fc53a2145438642fa8eb0e94a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7908acaf63a40ea973bd9834ac8f443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:51.318861 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7df8f9fe-f1ed-4119-b253-d5b678d4ee95 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85586fc53a2145438642fa8eb0e94a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7908acaf63a40ea973bd9834ac8f443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:51.324453 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5b80e224-d8fd-4ae7-bb51-29121b8755fe tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:51.329065 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5b80e224-d8fd-4ae7-bb51-29121b8755fe tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] [instance: 32361df9-4e50-409c-9cc7-6f70ba6ce26e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:51.340730 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7df8f9fe-f1ed-4119-b253-d5b678d4ee95 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85586fc53a2145438642fa8eb0e94a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7908acaf63a40ea973bd9834ac8f443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:51.342028 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7df8f9fe-f1ed-4119-b253-d5b678d4ee95 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] 10.222.0.57 "GET /compute/v2.1/servers/3b508c42-7dd6-4483-83b3-b210ef7ca47e" status: 200 len: 1359 microversion: 2.47 time: 1.104629 Jul 18 02:17:51.342629 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1000/2003] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:17:50 2022] GET /compute/v2.1/servers/3b508c42-7dd6-4483-83b3-b210ef7ca47e => generated 1359 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:17:51.423515 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5b80e224-d8fd-4ae7-bb51-29121b8755fe tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:51.429284 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5b80e224-d8fd-4ae7-bb51-29121b8755fe tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:51.431625 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5b80e224-d8fd-4ae7-bb51-29121b8755fe tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:51.432778 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-80705eae-46a9-4e14-983b-f3940cd286c4 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-2113366691"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:51.434569 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5b80e224-d8fd-4ae7-bb51-29121b8755fe tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:51.441215 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-80705eae-46a9-4e14-983b-f3940cd286c4 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] [instance: 3b508c42-7dd6-4483-83b3-b210ef7ca47e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:51.470816 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-80705eae-46a9-4e14-983b-f3940cd286c4 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:51.472183 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-80705eae-46a9-4e14-983b-f3940cd286c4 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:51.474190 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-80705eae-46a9-4e14-983b-f3940cd286c4 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:51.475203 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-80705eae-46a9-4e14-983b-f3940cd286c4 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:52.146882 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 02:17:52.147136 n-d-465891-3 devstack@n-api.service[119544]: Mon Jul 18 02:17:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e (ip 10.222.0.57) !!! Jul 18 02:17:53.691461 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5b80e224-d8fd-4ae7-bb51-29121b8755fe tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28fb70d1545b087bce52f2975a1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c8e07f8a9b4a398614fcf02c561416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:53.782739 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5b80e224-d8fd-4ae7-bb51-29121b8755fe tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e" status: 200 len: 1471 microversion: 2.1 time: 2.481305 Jul 18 02:17:53.811619 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1004/2004] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:51 2022] GET /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e => generated 1471 bytes in 2529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:53.854523 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e9189c6d-8d74-414c-ab5a-9e75eacc7dc0 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:53.857598 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e9189c6d-8d74-414c-ab5a-9e75eacc7dc0 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:53.924168 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e9189c6d-8d74-414c-ab5a-9e75eacc7dc0 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:53.926813 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e9189c6d-8d74-414c-ab5a-9e75eacc7dc0 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:53.931580 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e9189c6d-8d74-414c-ab5a-9e75eacc7dc0 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:53.942541 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e9189c6d-8d74-414c-ab5a-9e75eacc7dc0 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:54.598510 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-80705eae-46a9-4e14-983b-f3940cd286c4 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] 10.222.0.57 "POST /compute/v2.1/servers/3b508c42-7dd6-4483-83b3-b210ef7ca47e/action" status: 202 len: 52 microversion: 2.47 time: 3.210485 Jul 18 02:17:54.605560 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1001/2005] 10.222.0.57 () {62 vars in 1318 bytes} [Mon Jul 18 02:17:51 2022] POST /compute/v2.1/servers/3b508c42-7dd6-4483-83b3-b210ef7ca47e/action => generated 52 bytes in 3220 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Jul 18 02:17:54.628249 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e455a5ab-d1c4-4508-bcd6-86a9d10dd56e tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:54.629822 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e455a5ab-d1c4-4508-bcd6-86a9d10dd56e tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] [instance: 3b508c42-7dd6-4483-83b3-b210ef7ca47e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:54.671288 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e455a5ab-d1c4-4508-bcd6-86a9d10dd56e tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:54.672435 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e455a5ab-d1c4-4508-bcd6-86a9d10dd56e tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:54.674971 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e455a5ab-d1c4-4508-bcd6-86a9d10dd56e tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:54.678247 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e455a5ab-d1c4-4508-bcd6-86a9d10dd56e tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:54.800818 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e455a5ab-d1c4-4508-bcd6-86a9d10dd56e tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] [instance: 3b508c42-7dd6-4483-83b3-b210ef7ca47e] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:17:55.633330 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e455a5ab-d1c4-4508-bcd6-86a9d10dd56e tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3b508c42-7dd6-4483-83b3-b210ef7ca47e" status: 204 len: 0 microversion: 2.47 time: 0.981284 Jul 18 02:17:55.642571 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1002/2006] 10.222.0.57 () {60 vars in 1279 bytes} [Mon Jul 18 02:17:54 2022] DELETE /compute/v2.1/servers/3b508c42-7dd6-4483-83b3-b210ef7ca47e => generated 0 bytes in 1027 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 18 02:17:55.671248 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fc719627-b746-4f51-b547-5948d7908f39 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:55.671900 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fc719627-b746-4f51-b547-5948d7908f39 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] [instance: 32361df9-4e50-409c-9cc7-6f70ba6ce26e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:55.717830 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fc719627-b746-4f51-b547-5948d7908f39 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:55.726213 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fc719627-b746-4f51-b547-5948d7908f39 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:55.734344 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fc719627-b746-4f51-b547-5948d7908f39 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:55.753035 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fc719627-b746-4f51-b547-5948d7908f39 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:55.968952 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e9189c6d-8d74-414c-ab5a-9e75eacc7dc0 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:55.984228 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e9189c6d-8d74-414c-ab5a-9e75eacc7dc0 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:55.994707 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e9189c6d-8d74-414c-ab5a-9e75eacc7dc0 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:56.031437 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e9189c6d-8d74-414c-ab5a-9e75eacc7dc0 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 200 len: 1814 microversion: 2.25 time: 2.212501 Jul 18 02:17:56.035564 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1005/2007] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:17:53 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 1814 bytes in 2223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:17:56.114724 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fa88a57d-3e10-474b-bd2c-bc6b758c3a9e tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:56.116194 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fa88a57d-3e10-474b-bd2c-bc6b758c3a9e tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] [instance: 3b508c42-7dd6-4483-83b3-b210ef7ca47e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:56.167792 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fa88a57d-3e10-474b-bd2c-bc6b758c3a9e tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:56.168934 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fa88a57d-3e10-474b-bd2c-bc6b758c3a9e tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:56.171387 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fa88a57d-3e10-474b-bd2c-bc6b758c3a9e tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:56.179079 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fa88a57d-3e10-474b-bd2c-bc6b758c3a9e tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:56.379832 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fc719627-b746-4f51-b547-5948d7908f39 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28fb70d1545b087bce52f2975a1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c8e07f8a9b4a398614fcf02c561416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:56.392153 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fc719627-b746-4f51-b547-5948d7908f39 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e" status: 200 len: 1429 microversion: 2.1 time: 0.747979 Jul 18 02:17:56.394455 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1003/2008] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:55 2022] GET /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e => generated 1429 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:56.679316 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-339a7710-a0f5-4735-bc9c-8d6a9cd7cff9 req-b8ee6ee8-7651-4578-b58a-d41a7b6e53c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32361df9-4e50-409c-9cc7-6f70ba6ce26e", "name": "network-vif-deleted", "tag": "7c604958-4d5c-4ace-8013-9827944aa0c6"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:56.720711 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-339a7710-a0f5-4735-bc9c-8d6a9cd7cff9 req-b8ee6ee8-7651-4578-b58a-d41a7b6e53c2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:56.738117 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-339a7710-a0f5-4735-bc9c-8d6a9cd7cff9 req-b8ee6ee8-7651-4578-b58a-d41a7b6e53c2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:56.757685 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fa88a57d-3e10-474b-bd2c-bc6b758c3a9e tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85586fc53a2145438642fa8eb0e94a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7908acaf63a40ea973bd9834ac8f443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:56.795722 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-339a7710-a0f5-4735-bc9c-8d6a9cd7cff9 req-b8ee6ee8-7651-4578-b58a-d41a7b6e53c2 service nova] Creating event network-vif-deleted:7c604958-4d5c-4ace-8013-9827944aa0c6 for instance 32361df9-4e50-409c-9cc7-6f70ba6ce26e on n-h1-465891-3 Jul 18 02:17:56.821414 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-339a7710-a0f5-4735-bc9c-8d6a9cd7cff9 req-b8ee6ee8-7651-4578-b58a-d41a7b6e53c2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145926 Jul 18 02:17:56.835535 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1004/2009] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:17:56.860741 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fa88a57d-3e10-474b-bd2c-bc6b758c3a9e tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85586fc53a2145438642fa8eb0e94a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7908acaf63a40ea973bd9834ac8f443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:56.869318 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fa88a57d-3e10-474b-bd2c-bc6b758c3a9e tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85586fc53a2145438642fa8eb0e94a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7908acaf63a40ea973bd9834ac8f443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:56.916624 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fa88a57d-3e10-474b-bd2c-bc6b758c3a9e tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] 10.222.0.57 "GET /compute/v2.1/servers/3b508c42-7dd6-4483-83b3-b210ef7ca47e" status: 200 len: 1365 microversion: 2.47 time: 0.876606 Jul 18 02:17:56.919065 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1006/2010] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:17:56 2022] GET /compute/v2.1/servers/3b508c42-7dd6-4483-83b3-b210ef7ca47e => generated 1365 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:17:57.059154 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-91095b28-58f5-4c47-b51e-bcf32923d856 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:57.060122 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-91095b28-58f5-4c47-b51e-bcf32923d856 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:57.082601 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-91095b28-58f5-4c47-b51e-bcf32923d856 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:57.094027 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-91095b28-58f5-4c47-b51e-bcf32923d856 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:57.098357 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-91095b28-58f5-4c47-b51e-bcf32923d856 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:57.099140 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-91095b28-58f5-4c47-b51e-bcf32923d856 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:57.433905 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4e56d788-34e8-4366-87dd-127cb5fbd426 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:57.442006 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4e56d788-34e8-4366-87dd-127cb5fbd426 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] [instance: 32361df9-4e50-409c-9cc7-6f70ba6ce26e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:57.496102 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e56d788-34e8-4366-87dd-127cb5fbd426 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:57.503443 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e56d788-34e8-4366-87dd-127cb5fbd426 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:57.507852 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e56d788-34e8-4366-87dd-127cb5fbd426 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:57.508902 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e56d788-34e8-4366-87dd-127cb5fbd426 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:57.788571 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e56d788-34e8-4366-87dd-127cb5fbd426 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:57.791916 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e56d788-34e8-4366-87dd-127cb5fbd426 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:57.794722 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-4e56d788-34e8-4366-87dd-127cb5fbd426 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lazy-loading 'fault' on Instance uuid 32361df9-4e50-409c-9cc7-6f70ba6ce26e {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:17:58.290350 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4e56d788-34e8-4366-87dd-127cb5fbd426 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28fb70d1545b087bce52f2975a1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c8e07f8a9b4a398614fcf02c561416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:58.300365 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4e56d788-34e8-4366-87dd-127cb5fbd426 tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e" status: 200 len: 1307 microversion: 2.1 time: 0.887548 Jul 18 02:17:58.317806 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1007/2011] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:57 2022] GET /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e => generated 1307 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:17:58.347326 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0a54c138-388b-4901-b86d-89005f8880f4 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:58.354264 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0a54c138-388b-4901-b86d-89005f8880f4 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] [instance: 3b508c42-7dd6-4483-83b3-b210ef7ca47e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:58.394608 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a54c138-388b-4901-b86d-89005f8880f4 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:58.399913 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a54c138-388b-4901-b86d-89005f8880f4 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:58.402560 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a54c138-388b-4901-b86d-89005f8880f4 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:58.410025 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a54c138-388b-4901-b86d-89005f8880f4 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:58.522649 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-91095b28-58f5-4c47-b51e-bcf32923d856 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:58.558928 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-91095b28-58f5-4c47-b51e-bcf32923d856 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:58.574227 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-91095b28-58f5-4c47-b51e-bcf32923d856 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:58.601324 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-91095b28-58f5-4c47-b51e-bcf32923d856 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 200 len: 1814 microversion: 2.25 time: 1.540775 Jul 18 02:17:58.624669 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1005/2012] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:17:57 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 1814 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:17:58.864824 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0a54c138-388b-4901-b86d-89005f8880f4 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85586fc53a2145438642fa8eb0e94a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7908acaf63a40ea973bd9834ac8f443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:58.872671 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:58.890382 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0a54c138-388b-4901-b86d-89005f8880f4 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85586fc53a2145438642fa8eb0e94a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7908acaf63a40ea973bd9834ac8f443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:58.908109 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0a54c138-388b-4901-b86d-89005f8880f4 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85586fc53a2145438642fa8eb0e94a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7908acaf63a40ea973bd9834ac8f443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:58.911613 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0a54c138-388b-4901-b86d-89005f8880f4 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] 10.222.0.57 "GET /compute/v2.1/servers/3b508c42-7dd6-4483-83b3-b210ef7ca47e" status: 200 len: 1365 microversion: 2.47 time: 0.595531 Jul 18 02:17:58.913115 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1008/2013] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:17:58 2022] GET /compute/v2.1/servers/3b508c42-7dd6-4483-83b3-b210ef7ca47e => generated 1365 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:17:59.334093 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-faedc1e9-3c2a-4c55-9903-1877065bf99b tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:59.335618 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-faedc1e9-3c2a-4c55-9903-1877065bf99b tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] [instance: 32361df9-4e50-409c-9cc7-6f70ba6ce26e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:59.384033 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-faedc1e9-3c2a-4c55-9903-1877065bf99b tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:59.391381 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-faedc1e9-3c2a-4c55-9903-1877065bf99b tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:59.409473 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-faedc1e9-3c2a-4c55-9903-1877065bf99b tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:59.420581 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-faedc1e9-3c2a-4c55-9903-1877065bf99b tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:59.634299 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f157d9cf-43b2-4f40-b0e9-f1ec0896d83d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:59.635458 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f157d9cf-43b2-4f40-b0e9-f1ec0896d83d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:59.663682 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-faedc1e9-3c2a-4c55-9903-1877065bf99b tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] HTTP exception thrown: Instance 32361df9-4e50-409c-9cc7-6f70ba6ce26e could not be found. Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-faedc1e9-3c2a-4c55-9903-1877065bf99b tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Request method failure captured: Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e HTTP/1.1 Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MITEAlZp93OeZ-U1RRSSge7lqtV_XWE_Klx2sq7ovrJ1CzwP725dD8UvFFnPxzfUNIsef0cib4XEV5e9bmgqy_KlD1pSM86WAkf4LTENkSbTVK8KXqIjFPuEKt5SNb2q-ZLJkwKk9oPxZ7T0P2uTBaPEXox4MI7anaVqOt26zV38w4 Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: f0c8e07f8a9b4a398614fcf02c561416 Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ImagesOneServerTestJSON-1709241645 Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f0c8e07f8a9b4a398614fcf02c561416"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f0c8e07f8a9b4a398614fcf02c561416"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f0c8e07f8a9b4a398614fcf02c561416"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f0c8e07f8a9b4a398614fcf02c561416"}]}] Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ImagesOneServerTestJSON-1709241645 Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: f0c8e07f8a9b4a398614fcf02c561416 Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1709241645 Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ImagesOneServerTestJSON-1709241645-project Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 9ca28fb70d1545b087bce52f2975a1ea Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ImagesOneServerTestJSON-1709241645-project Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 32361df9-4e50-409c-9cc7-6f70ba6ce26e could not be found. Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '32361df9-4e50-409c-9cc7-6f70ba6ce26e'} Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32361df9-4e50-409c-9cc7-6f70ba6ce26e could not be found. Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32361df9-4e50-409c-9cc7-6f70ba6ce26e could not be found. Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:17:59.689528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:17:59.693188 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:59.693188 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:17:59.693188 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:17:59.693188 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:17:59.693188 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:17:59.693188 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32361df9-4e50-409c-9cc7-6f70ba6ce26e could not be found. Jul 18 02:17:59.693188 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:17:59.704179 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f157d9cf-43b2-4f40-b0e9-f1ec0896d83d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:59.705153 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f157d9cf-43b2-4f40-b0e9-f1ec0896d83d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:59.709027 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f157d9cf-43b2-4f40-b0e9-f1ec0896d83d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:59.710040 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f157d9cf-43b2-4f40-b0e9-f1ec0896d83d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:59.722824 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-faedc1e9-3c2a-4c55-9903-1877065bf99b tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] Returning 404 to user: Instance 32361df9-4e50-409c-9cc7-6f70ba6ce26e could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:17:59.725044 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-faedc1e9-3c2a-4c55-9903-1877065bf99b tempest-ImagesOneServerTestJSON-1709241645 tempest-ImagesOneServerTestJSON-1709241645-project] 10.222.0.57 "GET /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e" status: 404 len: 111 microversion: 2.1 time: 0.396234 Jul 18 02:17:59.752219 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1006/2014] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:59 2022] GET /compute/v2.1/servers/32361df9-4e50-409c-9cc7-6f70ba6ce26e => generated 111 bytes in 424 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:17:59.969590 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-88fc691b-0d9b-4a23-aa73-e4307717a743 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:59.970526 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-88fc691b-0d9b-4a23-aa73-e4307717a743 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] [instance: 3b508c42-7dd6-4483-83b3-b210ef7ca47e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:59.985616 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-88fc691b-0d9b-4a23-aa73-e4307717a743 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:59.994975 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-88fc691b-0d9b-4a23-aa73-e4307717a743 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:00.001568 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-88fc691b-0d9b-4a23-aa73-e4307717a743 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:00.002841 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-88fc691b-0d9b-4a23-aa73-e4307717a743 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:00.465607 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-88fc691b-0d9b-4a23-aa73-e4307717a743 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85586fc53a2145438642fa8eb0e94a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7908acaf63a40ea973bd9834ac8f443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:00.475323 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-88fc691b-0d9b-4a23-aa73-e4307717a743 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85586fc53a2145438642fa8eb0e94a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7908acaf63a40ea973bd9834ac8f443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:00.504136 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-88fc691b-0d9b-4a23-aa73-e4307717a743 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85586fc53a2145438642fa8eb0e94a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7908acaf63a40ea973bd9834ac8f443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:00.516884 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-88fc691b-0d9b-4a23-aa73-e4307717a743 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] 10.222.0.57 "GET /compute/v2.1/servers/3b508c42-7dd6-4483-83b3-b210ef7ca47e" status: 200 len: 1365 microversion: 2.47 time: 0.551992 Jul 18 02:18:00.525807 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1007/2015] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:17:59 2022] GET /compute/v2.1/servers/3b508c42-7dd6-4483-83b3-b210ef7ca47e => generated 1365 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:00.579070 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f157d9cf-43b2-4f40-b0e9-f1ec0896d83d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:00.749876 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f157d9cf-43b2-4f40-b0e9-f1ec0896d83d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:00.760244 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f157d9cf-43b2-4f40-b0e9-f1ec0896d83d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:00.766710 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f157d9cf-43b2-4f40-b0e9-f1ec0896d83d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 200 len: 1814 microversion: 2.25 time: 1.140947 Jul 18 02:18:00.768643 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1009/2016] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:17:59 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 1814 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:01.577386 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f113b125-e00b-4c63-9a4c-18b17c916db2 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:01.578200 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f113b125-e00b-4c63-9a4c-18b17c916db2 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] [instance: 3b508c42-7dd6-4483-83b3-b210ef7ca47e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:01.603734 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f113b125-e00b-4c63-9a4c-18b17c916db2 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:01.604781 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f113b125-e00b-4c63-9a4c-18b17c916db2 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:01.605752 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f113b125-e00b-4c63-9a4c-18b17c916db2 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:01.606220 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f113b125-e00b-4c63-9a4c-18b17c916db2 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:01.791012 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6cc9c68b-8b17-4d46-931d-1871eeb126ad tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:01.793079 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6cc9c68b-8b17-4d46-931d-1871eeb126ad tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:01.845783 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6cc9c68b-8b17-4d46-931d-1871eeb126ad tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:01.846596 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6cc9c68b-8b17-4d46-931d-1871eeb126ad tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:01.855772 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6cc9c68b-8b17-4d46-931d-1871eeb126ad tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:01.856792 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6cc9c68b-8b17-4d46-931d-1871eeb126ad tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:02.104735 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f113b125-e00b-4c63-9a4c-18b17c916db2 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85586fc53a2145438642fa8eb0e94a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7908acaf63a40ea973bd9834ac8f443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:02.145680 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f113b125-e00b-4c63-9a4c-18b17c916db2 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85586fc53a2145438642fa8eb0e94a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7908acaf63a40ea973bd9834ac8f443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:02.147625 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f113b125-e00b-4c63-9a4c-18b17c916db2 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85586fc53a2145438642fa8eb0e94a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7908acaf63a40ea973bd9834ac8f443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:02.169000 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f113b125-e00b-4c63-9a4c-18b17c916db2 tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] 10.222.0.57 "GET /compute/v2.1/servers/3b508c42-7dd6-4483-83b3-b210ef7ca47e" status: 200 len: 1365 microversion: 2.47 time: 0.592851 Jul 18 02:18:02.174783 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1008/2017] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:01 2022] GET /compute/v2.1/servers/3b508c42-7dd6-4483-83b3-b210ef7ca47e => generated 1365 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:03.211517 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d318dfc5-ca68-4579-aed8-59423caed67f tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:03.213046 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d318dfc5-ca68-4579-aed8-59423caed67f tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] [instance: 3b508c42-7dd6-4483-83b3-b210ef7ca47e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:03.223694 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d318dfc5-ca68-4579-aed8-59423caed67f tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:03.225499 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d318dfc5-ca68-4579-aed8-59423caed67f tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:03.226689 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d318dfc5-ca68-4579-aed8-59423caed67f tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:03.227396 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d318dfc5-ca68-4579-aed8-59423caed67f tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:03.364860 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d318dfc5-ca68-4579-aed8-59423caed67f tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:03.367076 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d318dfc5-ca68-4579-aed8-59423caed67f tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:03.367932 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-d318dfc5-ca68-4579-aed8-59423caed67f tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lazy-loading 'fault' on Instance uuid 3b508c42-7dd6-4483-83b3-b210ef7ca47e {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:18:03.568576 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d318dfc5-ca68-4579-aed8-59423caed67f tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85586fc53a2145438642fa8eb0e94a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7908acaf63a40ea973bd9834ac8f443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:03.596777 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d318dfc5-ca68-4579-aed8-59423caed67f tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85586fc53a2145438642fa8eb0e94a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7908acaf63a40ea973bd9834ac8f443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:03.613527 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d318dfc5-ca68-4579-aed8-59423caed67f tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85586fc53a2145438642fa8eb0e94a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7908acaf63a40ea973bd9834ac8f443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:03.617222 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d318dfc5-ca68-4579-aed8-59423caed67f tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] 10.222.0.57 "GET /compute/v2.1/servers/3b508c42-7dd6-4483-83b3-b210ef7ca47e" status: 200 len: 1370 microversion: 2.47 time: 0.415634 Jul 18 02:18:03.626482 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1009/2018] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:03 2022] GET /compute/v2.1/servers/3b508c42-7dd6-4483-83b3-b210ef7ca47e => generated 1370 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:04.289771 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6cc9c68b-8b17-4d46-931d-1871eeb126ad tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:04.343424 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6cc9c68b-8b17-4d46-931d-1871eeb126ad tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:04.351639 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6cc9c68b-8b17-4d46-931d-1871eeb126ad tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:04.358626 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6cc9c68b-8b17-4d46-931d-1871eeb126ad tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 200 len: 1814 microversion: 2.25 time: 2.569179 Jul 18 02:18:04.376925 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1010/2019] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:01 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 1814 bytes in 2592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:18:04.664764 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f3c9bcc0-ff8f-4de7-be02-d84b11d99de5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1774217630", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "caec55b9-88ff-45af-a9ee-477b3847fbba"}], "block_device_mapping_v2": [{"uuid": "a083bae6-d691-4413-aaf6-3ce848f145dd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:04.666240 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5eb8f162-0a36-4373-8a4f-764bb27a6dbc tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:04.669782 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5eb8f162-0a36-4373-8a4f-764bb27a6dbc tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] [instance: 3b508c42-7dd6-4483-83b3-b210ef7ca47e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:04.707919 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5eb8f162-0a36-4373-8a4f-764bb27a6dbc tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:04.715401 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5eb8f162-0a36-4373-8a4f-764bb27a6dbc tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:04.721211 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5eb8f162-0a36-4373-8a4f-764bb27a6dbc tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:04.730645 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5eb8f162-0a36-4373-8a4f-764bb27a6dbc tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:04.921653 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:04.957241 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-5eb8f162-0a36-4373-8a4f-764bb27a6dbc tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] HTTP exception thrown: Instance 3b508c42-7dd6-4483-83b3-b210ef7ca47e could not be found. Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5eb8f162-0a36-4373-8a4f-764bb27a6dbc tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Request method failure captured: Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/3b508c42-7dd6-4483-83b3-b210ef7ca47e HTTP/1.1 Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MKxRR2aSrUuePtfxqXdsZzwinCmLr85wb3t2JOQgZ5Vx5WyCrdMyW5m3orXk53jooZKsf_UsLKgHZ2yUjvTUIxJUkgjXCmuKZIZaB51mW2PJNZzfreR-5SjO5r4q2uoZ4ub-N06iAvXjXbDYyGQDnhTZKaiq7zlAIT2e0CopLcXq78 Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: X-Openstack-Nova-Api-Version: 2.47 Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: e7908acaf63a40ea973bd9834ac8f443 Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersAaction247Test-306631996 Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e7908acaf63a40ea973bd9834ac8f443"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e7908acaf63a40ea973bd9834ac8f443"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "tempest-type-1403670135", "name": "tempest-service-424335878", "endpoints": []}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e7908acaf63a40ea973bd9834ac8f443"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e7908acaf63a40ea973bd9834ac8f443"}]}, {"type": "tempest-type-1126140503", "name": "tempest-service-54502583", "endpoints": []}] Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersAaction247Test-306631996 Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: e7908acaf63a40ea973bd9834ac8f443 Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersAaction247Test-306631996 Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersAaction247Test-306631996-project Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 85586fc53a2145438642fa8eb0e94a65 Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersAaction247Test-306631996-project Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 3b508c42-7dd6-4483-83b3-b210ef7ca47e could not be found. Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '3b508c42-7dd6-4483-83b3-b210ef7ca47e'} Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b508c42-7dd6-4483-83b3-b210ef7ca47e could not be found. Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:18:04.976802 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b508c42-7dd6-4483-83b3-b210ef7ca47e could not be found. Jul 18 02:18:04.994189 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:18:04.994189 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:18:04.994189 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:18:04.994189 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:18:04.994189 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:18:04.994189 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:18:04.994189 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:18:04.994189 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:18:04.994189 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b508c42-7dd6-4483-83b3-b210ef7ca47e could not be found. Jul 18 02:18:04.994189 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:18:04.998141 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5eb8f162-0a36-4373-8a4f-764bb27a6dbc tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] Returning 404 to user: Instance 3b508c42-7dd6-4483-83b3-b210ef7ca47e could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:18:05.007949 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5eb8f162-0a36-4373-8a4f-764bb27a6dbc tempest-ServersAaction247Test-306631996 tempest-ServersAaction247Test-306631996-project] 10.222.0.57 "GET /compute/v2.1/servers/3b508c42-7dd6-4483-83b3-b210ef7ca47e" status: 404 len: 111 microversion: 2.47 time: 0.352426 Jul 18 02:18:05.009931 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1010/2020] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:04 2022] GET /compute/v2.1/servers/3b508c42-7dd6-4483-83b3-b210ef7ca47e => generated 111 bytes in 356 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:18:05.068985 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-f3c9bcc0-ff8f-4de7-be02-d84b11d99de5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] validate_networks() for [('caec55b9-88ff-45af-a9ee-477b3847fbba', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:18:05.413315 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-50cffc9e-f9c2-4ffd-b89f-feccb48235a6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:05.434431 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-50cffc9e-f9c2-4ffd-b89f-feccb48235a6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:05.480902 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-50cffc9e-f9c2-4ffd-b89f-feccb48235a6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:05.514485 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-50cffc9e-f9c2-4ffd-b89f-feccb48235a6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:05.520292 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-50cffc9e-f9c2-4ffd-b89f-feccb48235a6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:05.531132 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-50cffc9e-f9c2-4ffd-b89f-feccb48235a6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:08.990810 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-f3c9bcc0-ff8f-4de7-be02-d84b11d99de5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:18:08.991499 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-f3c9bcc0-ff8f-4de7-be02-d84b11d99de5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:18:08.994997 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-50cffc9e-f9c2-4ffd-b89f-feccb48235a6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:08.997854 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-f3c9bcc0-ff8f-4de7-be02-d84b11d99de5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:18:08.998454 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-f3c9bcc0-ff8f-4de7-be02-d84b11d99de5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:18:08.998875 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-f3c9bcc0-ff8f-4de7-be02-d84b11d99de5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:18:09.002264 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:09.027333 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-50cffc9e-f9c2-4ffd-b89f-feccb48235a6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:09.033907 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-50cffc9e-f9c2-4ffd-b89f-feccb48235a6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:09.035259 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f3c9bcc0-ff8f-4de7-be02-d84b11d99de5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:09.036757 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-50cffc9e-f9c2-4ffd-b89f-feccb48235a6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 200 len: 1814 microversion: 2.25 time: 3.637495 Jul 18 02:18:09.040401 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f3c9bcc0-ff8f-4de7-be02-d84b11d99de5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:09.054035 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1011/2021] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:05 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 1814 bytes in 3643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:09.055339 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f3c9bcc0-ff8f-4de7-be02-d84b11d99de5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:09.059820 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f3c9bcc0-ff8f-4de7-be02-d84b11d99de5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:09.122381 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-f3c9bcc0-ff8f-4de7-be02-d84b11d99de5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Getting quotas for project e382977cb6bf4f358fb3245cb3768140. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:18:09.137639 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-f3c9bcc0-ff8f-4de7-be02-d84b11d99de5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Getting quotas for user 77381e85d31a4747acb08a8d4572eb1b and project e382977cb6bf4f358fb3245cb3768140. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:18:09.532450 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-90d56b38-79f7-4940-9a1d-5dd3d7a29945 tempest-KeyPairsV2TestJSON-2040798046 tempest-KeyPairsV2TestJSON-2040798046-project] Action: 'create', calling method: .version_select at 0x7ff4adcfc700>, body: {"keypair": {"name": "tempest-keypair-897412846", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYfO8kMfS2N0ta5HfDXIiZ3Bx8cs/xvj/vyRhtr8B02BPRlNjyrSUOdKTdS6muTVzSmkJJvyFB9bFyNY58Qkdq1STiUyFzWGoaAkmjNEF9Nmm+/GGCsuxYyCwHo1G3fqg=="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:09.721322 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-90d56b38-79f7-4940-9a1d-5dd3d7a29945 tempest-KeyPairsV2TestJSON-2040798046 tempest-KeyPairsV2TestJSON-2040798046-project] Getting quotas for project 22b4543ad44f4611a8f5739f4e86b342. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:18:09.789227 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-90d56b38-79f7-4940-9a1d-5dd3d7a29945 tempest-KeyPairsV2TestJSON-2040798046 tempest-KeyPairsV2TestJSON-2040798046-project] Getting quotas for user d7bf66ad838d43c892cbef6386a3ad13 and project 22b4543ad44f4611a8f5739f4e86b342. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:18:09.871289 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-90d56b38-79f7-4940-9a1d-5dd3d7a29945 tempest-KeyPairsV2TestJSON-2040798046 tempest-KeyPairsV2TestJSON-2040798046-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.809449 Jul 18 02:18:09.873796 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1012/2022] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 02:18:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:18:10.116229 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f3c9bcc0-ff8f-4de7-be02-d84b11d99de5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:18:10.122534 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f3c9bcc0-ff8f-4de7-be02-d84b11d99de5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a083bae6-d691-4413-aaf6-3ce848f145dd',volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:18:10.282920 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ff5798ed-10d6-487c-b6d7-9dbb41a289a0 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1466118728", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "158397fb-03e8-488a-929e-26b83d7a32dd"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:10.693828 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-ff5798ed-10d6-487c-b6d7-9dbb41a289a0 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] validate_networks() for [('158397fb-03e8-488a-929e-26b83d7a32dd', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:18:10.924840 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f3c9bcc0-ff8f-4de7-be02-d84b11d99de5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.266598 Jul 18 02:18:10.930929 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1011/2023] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:18:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 6273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:18:10.941032 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c0b376a5-0abd-4f53-b8f5-b697767a6a34 tempest-KeyPairsV2TestJSON-2040798046 tempest-KeyPairsV2TestJSON-2040798046-project] Calling method '.version_select at 0x7ff4a8256820>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:11.025461 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c0b376a5-0abd-4f53-b8f5-b697767a6a34 tempest-KeyPairsV2TestJSON-2040798046 tempest-KeyPairsV2TestJSON-2040798046-project] 10.222.0.57 "GET /compute/v2.1/os-keypairs/tempest-keypair-897412846" status: 200 len: 497 microversion: 2.1 time: 0.086248 Jul 18 02:18:11.026815 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1012/2024] 10.222.0.57 () {58 vars in 1214 bytes} [Mon Jul 18 02:18:10 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-897412846 => generated 497 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:18:11.047904 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3369e4cc-0a90-4685-88da-955cb1e22b23 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:11.058370 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3369e4cc-0a90-4685-88da-955cb1e22b23 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:11.121566 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3369e4cc-0a90-4685-88da-955cb1e22b23 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:11.129901 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3369e4cc-0a90-4685-88da-955cb1e22b23 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:11.133038 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3369e4cc-0a90-4685-88da-955cb1e22b23 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:11.140058 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3369e4cc-0a90-4685-88da-955cb1e22b23 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:12.517674 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3369e4cc-0a90-4685-88da-955cb1e22b23 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:12.529926 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3369e4cc-0a90-4685-88da-955cb1e22b23 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:12.539904 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3369e4cc-0a90-4685-88da-955cb1e22b23 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:12.542913 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3369e4cc-0a90-4685-88da-955cb1e22b23 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 200 len: 1814 microversion: 2.25 time: 1.514352 Jul 18 02:18:12.546026 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1013/2025] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:11 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 1814 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:12.566468 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4b1ac36a-24f2-4478-8a16-ff10b9331dce tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:12.567536 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4b1ac36a-24f2-4478-8a16-ff10b9331dce tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:12.989449 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4b1ac36a-24f2-4478-8a16-ff10b9331dce tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:13.052022 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4b1ac36a-24f2-4478-8a16-ff10b9331dce tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 200 len: 1053 microversion: 2.1 time: 0.503714 Jul 18 02:18:13.055630 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1014/2026] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:12 2022] GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 1053 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:13.089939 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1dd98c86-db58-4707-8590-a60ea50a3337 tempest-KeyPairsV2TestJSON-2040798046 tempest-KeyPairsV2TestJSON-2040798046-project] Calling method '.version_select at 0x7ff4a84e4b80>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:13.140745 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-ff5798ed-10d6-487c-b6d7-9dbb41a289a0 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:18:13.141454 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-ff5798ed-10d6-487c-b6d7-9dbb41a289a0 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:18:13.143903 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-ff5798ed-10d6-487c-b6d7-9dbb41a289a0 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:18:13.144704 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-ff5798ed-10d6-487c-b6d7-9dbb41a289a0 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:18:13.145344 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-ff5798ed-10d6-487c-b6d7-9dbb41a289a0 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:18:13.177742 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1dd98c86-db58-4707-8590-a60ea50a3337 tempest-KeyPairsV2TestJSON-2040798046 tempest-KeyPairsV2TestJSON-2040798046-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-897412846" status: 202 len: 0 microversion: 2.1 time: 0.115529 Jul 18 02:18:13.180484 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1015/2027] 10.222.0.57 () {58 vars in 1217 bytes} [Mon Jul 18 02:18:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-897412846 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:18:13.183586 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ff5798ed-10d6-487c-b6d7-9dbb41a289a0 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:13.187625 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ff5798ed-10d6-487c-b6d7-9dbb41a289a0 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:13.190469 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ff5798ed-10d6-487c-b6d7-9dbb41a289a0 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:13.194923 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ff5798ed-10d6-487c-b6d7-9dbb41a289a0 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:13.207432 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-348c25d3-17c0-4e31-9f9c-d1dbc13cd68a tempest-KeyPairsV2TestJSON-2040798046 tempest-KeyPairsV2TestJSON-2040798046-project] Action: 'create', calling method: .version_select at 0x7ff4a851fca0>, body: {"keypair": {"name": "tempest-keypair-1060977964", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZG1GW5fAoX0HyyUUTn5Pw6uHjwGQxWOp5secI86E2Fi3eE+mv4MjgSiEDaukg0bSkZ5khV5kBUmbLuJJgscsBzzBWBl+lLEj/0OzyVbRAZcUXIukbepyE7J3PE5evXBQ=="}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:13.274558 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-348c25d3-17c0-4e31-9f9c-d1dbc13cd68a tempest-KeyPairsV2TestJSON-2040798046 tempest-KeyPairsV2TestJSON-2040798046-project] Getting quotas for project 22b4543ad44f4611a8f5739f4e86b342. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:18:13.305005 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-348c25d3-17c0-4e31-9f9c-d1dbc13cd68a tempest-KeyPairsV2TestJSON-2040798046 tempest-KeyPairsV2TestJSON-2040798046-project] Getting quotas for user d7bf66ad838d43c892cbef6386a3ad13 and project 22b4543ad44f4611a8f5739f4e86b342. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:18:13.321346 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-ff5798ed-10d6-487c-b6d7-9dbb41a289a0 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Getting quotas for project 839043bafeef4b8785747ca6c2e96817. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:18:13.356358 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-ff5798ed-10d6-487c-b6d7-9dbb41a289a0 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Getting quotas for user e81eea16bcfa4dc5bd66926c6a2658ba and project 839043bafeef4b8785747ca6c2e96817. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:18:13.429811 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ff5798ed-10d6-487c-b6d7-9dbb41a289a0 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:18:13.443685 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ff5798ed-10d6-487c-b6d7-9dbb41a289a0 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 9fa0633a-54a6-4b73-b9b0-4728a4807856] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:18:13.462139 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-348c25d3-17c0-4e31-9f9c-d1dbc13cd68a tempest-KeyPairsV2TestJSON-2040798046 tempest-KeyPairsV2TestJSON-2040798046-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.266873 Jul 18 02:18:13.469491 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1016/2028] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 02:18:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:18:13.487177 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4184790e-3f63-4fab-832d-976bbb10ce84 tempest-KeyPairsV2TestJSON-2040798046 tempest-KeyPairsV2TestJSON-2040798046-project] Calling method '.version_select at 0x7ff4a85caee0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:13.543383 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4184790e-3f63-4fab-832d-976bbb10ce84 tempest-KeyPairsV2TestJSON-2040798046 tempest-KeyPairsV2TestJSON-2040798046-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1060977964" status: 202 len: 0 microversion: 2.1 time: 0.059735 Jul 18 02:18:13.557803 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1017/2029] 10.222.0.57 () {58 vars in 1220 bytes} [Mon Jul 18 02:18:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1060977964 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:18:13.585324 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-791dffe0-678a-42f4-adbb-eff3db6a3597 tempest-KeyPairsV2TestJSON-2040798046 tempest-KeyPairsV2TestJSON-2040798046-project] Action: 'create', calling method: .version_select at 0x7ff4a85cc1f0>, body: {"keypair": {"name": "tempest-keypair-1212506317", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:13.678088 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-791dffe0-678a-42f4-adbb-eff3db6a3597 tempest-KeyPairsV2TestJSON-2040798046 tempest-KeyPairsV2TestJSON-2040798046-project] Getting quotas for project 22b4543ad44f4611a8f5739f4e86b342. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:18:13.730854 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-791dffe0-678a-42f4-adbb-eff3db6a3597 tempest-KeyPairsV2TestJSON-2040798046 tempest-KeyPairsV2TestJSON-2040798046-project] Getting quotas for user d7bf66ad838d43c892cbef6386a3ad13 and project 22b4543ad44f4611a8f5739f4e86b342. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:18:13.767719 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ff5798ed-10d6-487c-b6d7-9dbb41a289a0 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.886401 Jul 18 02:18:13.770153 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1013/2030] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:18:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 3893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:18:13.793616 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2dea56c7-c5e7-49fd-affd-97ea0af3c853 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:13.795213 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2dea56c7-c5e7-49fd-affd-97ea0af3c853 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:13.824186 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2dea56c7-c5e7-49fd-affd-97ea0af3c853 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:13.827144 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2dea56c7-c5e7-49fd-affd-97ea0af3c853 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:13.829651 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2dea56c7-c5e7-49fd-affd-97ea0af3c853 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:13.830841 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2dea56c7-c5e7-49fd-affd-97ea0af3c853 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:13.890075 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-791dffe0-678a-42f4-adbb-eff3db6a3597 tempest-KeyPairsV2TestJSON-2040798046 tempest-KeyPairsV2TestJSON-2040798046-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.328769 Jul 18 02:18:13.905780 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1018/2031] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 02:18:13 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:18:13.913023 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2ea6b324-4c0d-45e5-ba52-86962c5ae323 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:13.914221 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2ea6b324-4c0d-45e5-ba52-86962c5ae323 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 9fa0633a-54a6-4b73-b9b0-4728a4807856] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:14.273667 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2ea6b324-4c0d-45e5-ba52-86962c5ae323 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81eea16bcfa4dc5bd66926c6a2658ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839043bafeef4b8785747ca6c2e96817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:14.285793 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2ea6b324-4c0d-45e5-ba52-86962c5ae323 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] 10.222.0.57 "GET /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856" status: 200 len: 1224 microversion: 2.1 time: 0.380591 Jul 18 02:18:14.294318 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1019/2032] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:13 2022] GET /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856 => generated 1224 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:14.327510 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4213dc41-ea22-4bfe-b8d5-7f1fb19a561e tempest-KeyPairsV2TestJSON-2040798046 tempest-KeyPairsV2TestJSON-2040798046-project] Calling method '.version_select at 0x7ff4a8605e50>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:14.402977 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4213dc41-ea22-4bfe-b8d5-7f1fb19a561e tempest-KeyPairsV2TestJSON-2040798046 tempest-KeyPairsV2TestJSON-2040798046-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1212506317" status: 202 len: 0 microversion: 2.1 time: 0.104106 Jul 18 02:18:14.403763 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1020/2033] 10.222.0.57 () {58 vars in 1220 bytes} [Mon Jul 18 02:18:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1212506317 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:18:14.450723 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2dea56c7-c5e7-49fd-affd-97ea0af3c853 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:14.498405 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2dea56c7-c5e7-49fd-affd-97ea0af3c853 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:14.506068 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2dea56c7-c5e7-49fd-affd-97ea0af3c853 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:14.511959 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2dea56c7-c5e7-49fd-affd-97ea0af3c853 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 200 len: 1814 microversion: 2.25 time: 0.737495 Jul 18 02:18:14.514443 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1014/2034] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:13 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 1814 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:14.533542 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-df03d051-1e67-45fc-b27a-64d7e72a779e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:14.563745 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-df03d051-1e67-45fc-b27a-64d7e72a779e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:14.608432 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-df03d051-1e67-45fc-b27a-64d7e72a779e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:14.610547 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-df03d051-1e67-45fc-b27a-64d7e72a779e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:14.616091 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-df03d051-1e67-45fc-b27a-64d7e72a779e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:14.617062 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-df03d051-1e67-45fc-b27a-64d7e72a779e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:14.785633 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-df03d051-1e67-45fc-b27a-64d7e72a779e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:14.820195 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-df03d051-1e67-45fc-b27a-64d7e72a779e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 200 len: 1159 microversion: 2.1 time: 0.299333 Jul 18 02:18:14.828657 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1015/2035] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:14 2022] GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 1159 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:14.843545 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f44b2810-1aa6-43cf-b842-ab22e00289f7 tempest-KeyPairsV2TestJSON-2040798046 tempest-KeyPairsV2TestJSON-2040798046-project] Action: 'create', calling method: .version_select at 0x7ff4a8b4eaf0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-611389508", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6tffUZUIIZonQjGEUDLHsXxunbmS+rUiJsvHhPia/gDEUwUMOMH3Rv9H8quUwKf7hXklye2XPUAU6LbaLcOHT8f5D7eZ0a/ul9gLGgyrroPhsm9wnIWsciGG/5sA5aRA=="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:14.890259 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-f44b2810-1aa6-43cf-b842-ab22e00289f7 tempest-KeyPairsV2TestJSON-2040798046 tempest-KeyPairsV2TestJSON-2040798046-project] Getting quotas for project 22b4543ad44f4611a8f5739f4e86b342. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:18:14.909140 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-f44b2810-1aa6-43cf-b842-ab22e00289f7 tempest-KeyPairsV2TestJSON-2040798046 tempest-KeyPairsV2TestJSON-2040798046-project] Getting quotas for user d7bf66ad838d43c892cbef6386a3ad13 and project 22b4543ad44f4611a8f5739f4e86b342. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:18:15.002909 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f44b2810-1aa6-43cf-b842-ab22e00289f7 tempest-KeyPairsV2TestJSON-2040798046 tempest-KeyPairsV2TestJSON-2040798046-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.169055 Jul 18 02:18:15.005303 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1016/2036] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 02:18:14 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:18:15.037679 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e7b588fb-96fe-481b-9aa2-92b0bfd05e0f tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-998912550", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": "none"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:15.043940 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fb63ecc1-a898-469e-a0c9-46486d9bb5ab tempest-KeyPairsV2TestJSON-2040798046 tempest-KeyPairsV2TestJSON-2040798046-project] Action: 'create', calling method: .version_select at 0x7ff4a801ee50>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-73880789", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoZ5HLn7drbMFMBRZuL1X0mhqgAmEb5K427TqrLzPiiadYgoxEO1h2p0wqRvmHzXGlws8U/0Y003BUpGEyz+SJdrSiBT3VJzsbfcT0eliV6YomnmBt1tjgxr89R1m5z1Q=="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:15.155870 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-fb63ecc1-a898-469e-a0c9-46486d9bb5ab tempest-KeyPairsV2TestJSON-2040798046 tempest-KeyPairsV2TestJSON-2040798046-project] Getting quotas for project 22b4543ad44f4611a8f5739f4e86b342. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:18:15.206267 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-fb63ecc1-a898-469e-a0c9-46486d9bb5ab tempest-KeyPairsV2TestJSON-2040798046 tempest-KeyPairsV2TestJSON-2040798046-project] Getting quotas for user d7bf66ad838d43c892cbef6386a3ad13 and project 22b4543ad44f4611a8f5739f4e86b342. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:18:15.263590 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-e7b588fb-96fe-481b-9aa2-92b0bfd05e0f tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:18:15.264030 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-e7b588fb-96fe-481b-9aa2-92b0bfd05e0f tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:18:15.264527 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-e7b588fb-96fe-481b-9aa2-92b0bfd05e0f tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:18:15.264988 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-e7b588fb-96fe-481b-9aa2-92b0bfd05e0f tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:18:15.265407 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-e7b588fb-96fe-481b-9aa2-92b0bfd05e0f tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:18:15.290103 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e7b588fb-96fe-481b-9aa2-92b0bfd05e0f tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:15.290638 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e7b588fb-96fe-481b-9aa2-92b0bfd05e0f tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:15.291470 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e7b588fb-96fe-481b-9aa2-92b0bfd05e0f tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:15.291923 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e7b588fb-96fe-481b-9aa2-92b0bfd05e0f tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:15.390320 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-e7b588fb-96fe-481b-9aa2-92b0bfd05e0f tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Getting quotas for project e0dcd66163c6460a93f34495720f1185. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:18:15.418912 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-e7b588fb-96fe-481b-9aa2-92b0bfd05e0f tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Getting quotas for user 33b9832562054fba865593b7b9d81158 and project e0dcd66163c6460a93f34495720f1185. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:18:15.427484 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fb63ecc1-a898-469e-a0c9-46486d9bb5ab tempest-KeyPairsV2TestJSON-2040798046 tempest-KeyPairsV2TestJSON-2040798046-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.397488 Jul 18 02:18:15.446106 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1017/2037] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 02:18:15 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:18:15.481471 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bd93afd0-b411-4a0f-b989-2950c541ea38 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:15.483312 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e7b588fb-96fe-481b-9aa2-92b0bfd05e0f tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:18:15.484277 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bd93afd0-b411-4a0f-b989-2950c541ea38 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 9fa0633a-54a6-4b73-b9b0-4728a4807856] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:15.485607 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e7b588fb-96fe-481b-9aa2-92b0bfd05e0f tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] [instance: 963c78a4-9b68-4450-9b77-31214f51d29a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:18:15.624953 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bd93afd0-b411-4a0f-b989-2950c541ea38 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81eea16bcfa4dc5bd66926c6a2658ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839043bafeef4b8785747ca6c2e96817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:15.665005 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bd93afd0-b411-4a0f-b989-2950c541ea38 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] 10.222.0.57 "GET /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856" status: 200 len: 1224 microversion: 2.1 time: 0.213568 Jul 18 02:18:15.680654 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e7b588fb-96fe-481b-9aa2-92b0bfd05e0f tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 1.275689 Jul 18 02:18:15.682147 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1021/2039] 10.222.0.57 () {62 vars in 1187 bytes} [Mon Jul 18 02:18:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1278 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 02:18:15.685365 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1018/2039] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:15 2022] GET /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856 => generated 1224 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:15.704497 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8d0afa77-2ecd-4a0a-99c9-c1ab70d3176d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:15.705781 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8d0afa77-2ecd-4a0a-99c9-c1ab70d3176d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:15.711152 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e7734f19-ffd2-467b-8868-579308bce1e9 tempest-KeyPairsV2TestJSON-2040798046 tempest-KeyPairsV2TestJSON-2040798046-project] Action: 'create', calling method: .version_select at 0x7ff4a85ccd30>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-938240301", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8YOzOMgnXLA5H8LanhMi5xSlNHks3fw/A2JMwGuNYoKDIbyhHuAzCNcDzsLJqovbcmNShRRsMciTYdpSLNkhiCYVthWXmPdZS8RBHLXX5YaaQ7nWJKHnHKStGdsPaNiw=="}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:15.730145 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8d0afa77-2ecd-4a0a-99c9-c1ab70d3176d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:15.735115 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8d0afa77-2ecd-4a0a-99c9-c1ab70d3176d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:15.736100 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8d0afa77-2ecd-4a0a-99c9-c1ab70d3176d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:15.736571 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8d0afa77-2ecd-4a0a-99c9-c1ab70d3176d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:15.777687 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-e7734f19-ffd2-467b-8868-579308bce1e9 tempest-KeyPairsV2TestJSON-2040798046 tempest-KeyPairsV2TestJSON-2040798046-project] Getting quotas for project 22b4543ad44f4611a8f5739f4e86b342. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:18:15.789747 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-e7734f19-ffd2-467b-8868-579308bce1e9 tempest-KeyPairsV2TestJSON-2040798046 tempest-KeyPairsV2TestJSON-2040798046-project] Getting quotas for user d7bf66ad838d43c892cbef6386a3ad13 and project 22b4543ad44f4611a8f5739f4e86b342. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:18:15.899627 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e7734f19-ffd2-467b-8868-579308bce1e9 tempest-KeyPairsV2TestJSON-2040798046 tempest-KeyPairsV2TestJSON-2040798046-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.216527 Jul 18 02:18:15.901054 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1022/2040] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 02:18:15 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:18:15.939114 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-141700d8-0e88-4fd1-8e1c-8190ba43a2ab tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:15.943338 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-141700d8-0e88-4fd1-8e1c-8190ba43a2ab tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] [instance: 963c78a4-9b68-4450-9b77-31214f51d29a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:16.317062 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8d0afa77-2ecd-4a0a-99c9-c1ab70d3176d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:16.356369 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8d0afa77-2ecd-4a0a-99c9-c1ab70d3176d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:16.363224 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-141700d8-0e88-4fd1-8e1c-8190ba43a2ab tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:16.366405 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8d0afa77-2ecd-4a0a-99c9-c1ab70d3176d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:16.367822 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8d0afa77-2ecd-4a0a-99c9-c1ab70d3176d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 200 len: 1814 microversion: 2.25 time: 0.681221 Jul 18 02:18:16.368436 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1019/2041] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:15 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 1814 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:16.418697 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-141700d8-0e88-4fd1-8e1c-8190ba43a2ab tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:16.424466 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a137b5b3-a4c5-4e54-8fa5-fc3d9502ddd5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:16.425451 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a137b5b3-a4c5-4e54-8fa5-fc3d9502ddd5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:16.429747 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-141700d8-0e88-4fd1-8e1c-8190ba43a2ab tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:16.440449 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-141700d8-0e88-4fd1-8e1c-8190ba43a2ab tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] 10.222.0.57 "GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a" status: 200 len: 1277 microversion: 2.54 time: 0.535791 Jul 18 02:18:16.452138 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1023/2042] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:15 2022] GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a => generated 1277 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:16.475180 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a137b5b3-a4c5-4e54-8fa5-fc3d9502ddd5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:16.475954 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a137b5b3-a4c5-4e54-8fa5-fc3d9502ddd5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:16.476894 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a137b5b3-a4c5-4e54-8fa5-fc3d9502ddd5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:16.477396 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a137b5b3-a4c5-4e54-8fa5-fc3d9502ddd5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:16.499724 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b09d5424-6d28-4458-abb0-a80a7b7c6c10 tempest-KeyPairsV2TestJSON-2040798046 tempest-KeyPairsV2TestJSON-2040798046-project] Calling method '.version_select at 0x7ff4a8531b80>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:16.524550 n-d-465891-3 devstack@n-api.service[119544]: WARNING oslo_db.sqlalchemy.utils [None req-b09d5424-6d28-4458-abb0-a80a7b7c6c10 tempest-KeyPairsV2TestJSON-2040798046 tempest-KeyPairsV2TestJSON-2040798046-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 18 02:18:16.596989 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b09d5424-6d28-4458-abb0-a80a7b7c6c10 tempest-KeyPairsV2TestJSON-2040798046 tempest-KeyPairsV2TestJSON-2040798046-project] 10.222.0.57 "GET /compute/v2.1/os-keypairs" status: 200 len: 1090 microversion: 2.1 time: 0.141565 Jul 18 02:18:16.606414 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1024/2043] 10.222.0.57 () {58 vars in 1136 bytes} [Mon Jul 18 02:18:16 2022] GET /compute/v2.1/os-keypairs => generated 1090 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:16.649437 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e633b179-08e2-4d5a-9a4c-2ed039fb6fb0 tempest-KeyPairsV2TestJSON-2040798046 tempest-KeyPairsV2TestJSON-2040798046-project] Calling method '.version_select at 0x7ff4a840b940>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:16.769114 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e633b179-08e2-4d5a-9a4c-2ed039fb6fb0 tempest-KeyPairsV2TestJSON-2040798046 tempest-KeyPairsV2TestJSON-2040798046-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-938240301" status: 202 len: 0 microversion: 2.1 time: 0.148306 Jul 18 02:18:16.773071 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1025/2044] 10.222.0.57 () {58 vars in 1274 bytes} [Mon Jul 18 02:18:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-938240301 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:18:16.776636 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a137b5b3-a4c5-4e54-8fa5-fc3d9502ddd5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:16.791172 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-16bf45fe-578d-4b6b-893b-fc923aa27ba6 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:16.793105 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-16bf45fe-578d-4b6b-893b-fc923aa27ba6 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 9fa0633a-54a6-4b73-b9b0-4728a4807856] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:16.799276 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=9,nova_api:DELETE=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:16.801407 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a137b5b3-a4c5-4e54-8fa5-fc3d9502ddd5 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 200 len: 1169 microversion: 2.1 time: 0.431100 Jul 18 02:18:16.802089 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1020/2045] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:16 2022] GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 1169 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:16.813732 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-16bf45fe-578d-4b6b-893b-fc923aa27ba6 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:16.815669 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-16bf45fe-578d-4b6b-893b-fc923aa27ba6 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:16.818919 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-16bf45fe-578d-4b6b-893b-fc923aa27ba6 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:16.827628 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-16bf45fe-578d-4b6b-893b-fc923aa27ba6 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:16.848900 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f2c1c4fa-b946-4704-920b-66af0be287d4 tempest-KeyPairsV2TestJSON-2040798046 tempest-KeyPairsV2TestJSON-2040798046-project] Calling method '.version_select at 0x7ff49bf96820>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:16.908098 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:16.969448 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f2c1c4fa-b946-4704-920b-66af0be287d4 tempest-KeyPairsV2TestJSON-2040798046 tempest-KeyPairsV2TestJSON-2040798046-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-73880789" status: 202 len: 0 microversion: 2.1 time: 0.141850 Jul 18 02:18:16.971537 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1021/2046] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 02:18:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-73880789 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:18:17.012045 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-53f890df-ef34-4d44-a958-06b6f6e99f5d tempest-KeyPairsV2TestJSON-2040798046 tempest-KeyPairsV2TestJSON-2040798046-project] Calling method '.version_select at 0x7ff4a801ed30>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:17.093859 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-53f890df-ef34-4d44-a958-06b6f6e99f5d tempest-KeyPairsV2TestJSON-2040798046 tempest-KeyPairsV2TestJSON-2040798046-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-611389508" status: 202 len: 0 microversion: 2.1 time: 0.114504 Jul 18 02:18:17.095250 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1022/2047] 10.222.0.57 () {58 vars in 1274 bytes} [Mon Jul 18 02:18:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-611389508 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:18:17.203554 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-16bf45fe-578d-4b6b-893b-fc923aa27ba6 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81eea16bcfa4dc5bd66926c6a2658ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839043bafeef4b8785747ca6c2e96817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:17.226478 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-16bf45fe-578d-4b6b-893b-fc923aa27ba6 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] 10.222.0.57 "GET /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856" status: 200 len: 1220 microversion: 2.1 time: 0.450793 Jul 18 02:18:17.227790 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1026/2048] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:16 2022] GET /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856 => generated 1220 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:17.390020 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-823bff75-2ce7-4db6-9038-0f58e1b11f7a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:17.390348 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-823bff75-2ce7-4db6-9038-0f58e1b11f7a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:17.408530 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-823bff75-2ce7-4db6-9038-0f58e1b11f7a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:17.413615 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-823bff75-2ce7-4db6-9038-0f58e1b11f7a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:17.414939 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-823bff75-2ce7-4db6-9038-0f58e1b11f7a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:17.417741 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-823bff75-2ce7-4db6-9038-0f58e1b11f7a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:17.476619 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2f77ff7a-ca13-4b00-83da-1bb0077e4fd5 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:17.488721 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2f77ff7a-ca13-4b00-83da-1bb0077e4fd5 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] [instance: 963c78a4-9b68-4450-9b77-31214f51d29a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:19.186864 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2f77ff7a-ca13-4b00-83da-1bb0077e4fd5 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:19.198291 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2f77ff7a-ca13-4b00-83da-1bb0077e4fd5 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:19.207657 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2f77ff7a-ca13-4b00-83da-1bb0077e4fd5 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:19.210501 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2f77ff7a-ca13-4b00-83da-1bb0077e4fd5 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] 10.222.0.57 "GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a" status: 200 len: 1277 microversion: 2.54 time: 1.747149 Jul 18 02:18:19.211325 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1027/2049] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:17 2022] GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a => generated 1277 bytes in 1750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:19.239941 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-186b5281-d575-4274-a498-88fe47501572 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:19.240912 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-186b5281-d575-4274-a498-88fe47501572 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:19.271706 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-186b5281-d575-4274-a498-88fe47501572 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:19.272179 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-186b5281-d575-4274-a498-88fe47501572 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:19.275901 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-186b5281-d575-4274-a498-88fe47501572 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:19.277976 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-186b5281-d575-4274-a498-88fe47501572 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:19.399385 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-823bff75-2ce7-4db6-9038-0f58e1b11f7a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:19.414137 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-823bff75-2ce7-4db6-9038-0f58e1b11f7a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:19.422787 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-823bff75-2ce7-4db6-9038-0f58e1b11f7a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:19.426428 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-823bff75-2ce7-4db6-9038-0f58e1b11f7a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 200 len: 1814 microversion: 2.25 time: 2.041452 Jul 18 02:18:19.441940 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1023/2050] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:17 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 1814 bytes in 2059 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:19.455770 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f01d302f-f6ac-4e47-b7fb-fd75f51089c1 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:19.456832 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f01d302f-f6ac-4e47-b7fb-fd75f51089c1 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 9fa0633a-54a6-4b73-b9b0-4728a4807856] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:19.471541 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f01d302f-f6ac-4e47-b7fb-fd75f51089c1 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:19.475613 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f01d302f-f6ac-4e47-b7fb-fd75f51089c1 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:19.476773 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f01d302f-f6ac-4e47-b7fb-fd75f51089c1 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:19.483467 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f01d302f-f6ac-4e47-b7fb-fd75f51089c1 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:19.967635 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f01d302f-f6ac-4e47-b7fb-fd75f51089c1 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81eea16bcfa4dc5bd66926c6a2658ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839043bafeef4b8785747ca6c2e96817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:20.000414 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f01d302f-f6ac-4e47-b7fb-fd75f51089c1 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] 10.222.0.57 "GET /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856" status: 200 len: 1282 microversion: 2.1 time: 0.556300 Jul 18 02:18:20.029209 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1024/2051] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:19 2022] GET /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856 => generated 1282 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:20.842589 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-75ba5a69-8502-442d-8740-08959353b2c3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1814451930 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1814451930-project-admin] Calling method '.version_select at 0x7ff4a915b940>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:20.869871 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:18:20.869871 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:18:20.872276 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-75ba5a69-8502-442d-8740-08959353b2c3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1814451930 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1814451930-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:20.872979 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-75ba5a69-8502-442d-8740-08959353b2c3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1814451930 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1814451930-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:20.893174 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-186b5281-d575-4274-a498-88fe47501572 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:20.927663 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-186b5281-d575-4274-a498-88fe47501572 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 200 len: 1211 microversion: 2.1 time: 1.712568 Jul 18 02:18:20.933426 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1028/2052] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:19 2022] GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 1211 bytes in 1721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:20.954707 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9bab80b6-f73b-499a-a5f8-c0bb36ac4346 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:20.956157 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9bab80b6-f73b-499a-a5f8-c0bb36ac4346 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] [instance: 963c78a4-9b68-4450-9b77-31214f51d29a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:20.979528 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9bab80b6-f73b-499a-a5f8-c0bb36ac4346 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:20.989620 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9bab80b6-f73b-499a-a5f8-c0bb36ac4346 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:20.991989 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9bab80b6-f73b-499a-a5f8-c0bb36ac4346 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:20.992887 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9bab80b6-f73b-499a-a5f8-c0bb36ac4346 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:20.998305 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-75ba5a69-8502-442d-8740-08959353b2c3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1814451930 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1814451930-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:21.005771 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-75ba5a69-8502-442d-8740-08959353b2c3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1814451930 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1814451930-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:21.055481 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-75ba5a69-8502-442d-8740-08959353b2c3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1814451930 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1814451930-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:21.060013 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-75ba5a69-8502-442d-8740-08959353b2c3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1814451930 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1814451930-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:21.086151 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-75ba5a69-8502-442d-8740-08959353b2c3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1814451930 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1814451930-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.864749 Jul 18 02:18:21.092022 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1025/2053] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:18:20 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:18:21.108225 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bfe5878e-59ed-4507-8587-26308ca43573 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:21.114767 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bfe5878e-59ed-4507-8587-26308ca43573 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:21.165106 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bfe5878e-59ed-4507-8587-26308ca43573 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:21.173591 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bfe5878e-59ed-4507-8587-26308ca43573 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:21.175651 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bfe5878e-59ed-4507-8587-26308ca43573 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:21.183877 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bfe5878e-59ed-4507-8587-26308ca43573 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:21.571899 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9bab80b6-f73b-499a-a5f8-c0bb36ac4346 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:21.584232 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9bab80b6-f73b-499a-a5f8-c0bb36ac4346 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:21.594349 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9bab80b6-f73b-499a-a5f8-c0bb36ac4346 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:21.597887 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9bab80b6-f73b-499a-a5f8-c0bb36ac4346 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] 10.222.0.57 "GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a" status: 200 len: 1335 microversion: 2.54 time: 0.662364 Jul 18 02:18:21.601558 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1029/2054] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:20 2022] GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a => generated 1335 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:21.611505 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d3924390-7d7b-4933-920b-60b808addf60 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:21.612551 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d3924390-7d7b-4933-920b-60b808addf60 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 9fa0633a-54a6-4b73-b9b0-4728a4807856] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:21.639334 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d3924390-7d7b-4933-920b-60b808addf60 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:21.641584 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d3924390-7d7b-4933-920b-60b808addf60 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:21.644634 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d3924390-7d7b-4933-920b-60b808addf60 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:21.647119 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d3924390-7d7b-4933-920b-60b808addf60 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:21.968821 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d3924390-7d7b-4933-920b-60b808addf60 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81eea16bcfa4dc5bd66926c6a2658ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839043bafeef4b8785747ca6c2e96817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:22.023427 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bfe5878e-59ed-4507-8587-26308ca43573 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:22.030447 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d3924390-7d7b-4933-920b-60b808addf60 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] 10.222.0.57 "GET /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856" status: 200 len: 1282 microversion: 2.1 time: 0.410339 Jul 18 02:18:22.045748 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bfe5878e-59ed-4507-8587-26308ca43573 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:22.050053 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1030/2055] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:21 2022] GET /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856 => generated 1282 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:22.050311 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bfe5878e-59ed-4507-8587-26308ca43573 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:22.051412 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bfe5878e-59ed-4507-8587-26308ca43573 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 200 len: 1814 microversion: 2.25 time: 0.956581 Jul 18 02:18:22.064774 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1026/2056] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:21 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 1814 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:22.072301 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1fb3d37f-c484-4852-9ca7-43d1f18ac6ab tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:22.078192 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1fb3d37f-c484-4852-9ca7-43d1f18ac6ab tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:22.097257 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-42f1198d-28d8-4380-8b7f-357d2deefd84 req-06ab5ce6-ad66-4742-b615-2d6c36aa21cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36319b4f-008b-4321-ac5d-e201e50673d3", "tag": "22552354-154e-44d7-a1ec-f329d159341f"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:22.100657 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1fb3d37f-c484-4852-9ca7-43d1f18ac6ab tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:22.101240 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1fb3d37f-c484-4852-9ca7-43d1f18ac6ab tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:22.102140 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1fb3d37f-c484-4852-9ca7-43d1f18ac6ab tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:22.102708 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1fb3d37f-c484-4852-9ca7-43d1f18ac6ab tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:22.131417 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-42f1198d-28d8-4380-8b7f-357d2deefd84 req-06ab5ce6-ad66-4742-b615-2d6c36aa21cf service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:22.132692 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-42f1198d-28d8-4380-8b7f-357d2deefd84 req-06ab5ce6-ad66-4742-b615-2d6c36aa21cf service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:22.200304 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-42f1198d-28d8-4380-8b7f-357d2deefd84 req-06ab5ce6-ad66-4742-b615-2d6c36aa21cf service nova] Creating event network-changed:22552354-154e-44d7-a1ec-f329d159341f for instance 36319b4f-008b-4321-ac5d-e201e50673d3 on n-h1-465891-3 Jul 18 02:18:22.226288 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-42f1198d-28d8-4380-8b7f-357d2deefd84 req-06ab5ce6-ad66-4742-b615-2d6c36aa21cf service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171417 Jul 18 02:18:22.229105 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1031/2057] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:18:22.630390 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-eab64ce1-f436-4c58-9820-4d6664a328d0 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:22.636027 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-eab64ce1-f436-4c58-9820-4d6664a328d0 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] [instance: 963c78a4-9b68-4450-9b77-31214f51d29a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:22.669599 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eab64ce1-f436-4c58-9820-4d6664a328d0 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:22.681386 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eab64ce1-f436-4c58-9820-4d6664a328d0 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:22.684413 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eab64ce1-f436-4c58-9820-4d6664a328d0 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:22.687617 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eab64ce1-f436-4c58-9820-4d6664a328d0 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:22.904716 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1fb3d37f-c484-4852-9ca7-43d1f18ac6ab tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:22.943577 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1fb3d37f-c484-4852-9ca7-43d1f18ac6ab tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 200 len: 1211 microversion: 2.1 time: 0.875872 Jul 18 02:18:22.945847 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1027/2058] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:22 2022] GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 1211 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:23.060798 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-eab64ce1-f436-4c58-9820-4d6664a328d0 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:23.068662 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-89373d84-95e7-47ce-8046-b1b2794efa31 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:23.078661 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-89373d84-95e7-47ce-8046-b1b2794efa31 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 9fa0633a-54a6-4b73-b9b0-4728a4807856] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:23.125343 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-eab64ce1-f436-4c58-9820-4d6664a328d0 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:23.142288 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-89373d84-95e7-47ce-8046-b1b2794efa31 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:23.146148 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-eab64ce1-f436-4c58-9820-4d6664a328d0 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:23.148456 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-89373d84-95e7-47ce-8046-b1b2794efa31 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:23.151718 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-89373d84-95e7-47ce-8046-b1b2794efa31 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:23.155382 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-89373d84-95e7-47ce-8046-b1b2794efa31 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:23.159907 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-eab64ce1-f436-4c58-9820-4d6664a328d0 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] 10.222.0.57 "GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a" status: 200 len: 1335 microversion: 2.54 time: 0.542036 Jul 18 02:18:23.175726 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1032/2059] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:22 2022] GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a => generated 1335 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:18:23.219202 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fd504f3e-da47-42fb-8b3d-af18ce8b7e8c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:23.220756 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fd504f3e-da47-42fb-8b3d-af18ce8b7e8c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:23.261261 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd504f3e-da47-42fb-8b3d-af18ce8b7e8c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:23.284887 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd504f3e-da47-42fb-8b3d-af18ce8b7e8c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:23.288515 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd504f3e-da47-42fb-8b3d-af18ce8b7e8c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:23.292957 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:23.297117 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd504f3e-da47-42fb-8b3d-af18ce8b7e8c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:24.334373 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-89373d84-95e7-47ce-8046-b1b2794efa31 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81eea16bcfa4dc5bd66926c6a2658ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839043bafeef4b8785747ca6c2e96817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:24.383430 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-89373d84-95e7-47ce-8046-b1b2794efa31 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] 10.222.0.57 "GET /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856" status: 200 len: 1282 microversion: 2.1 time: 1.327438 Jul 18 02:18:24.402131 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1028/2060] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:23 2022] GET /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856 => generated 1282 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:24.542255 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fd504f3e-da47-42fb-8b3d-af18ce8b7e8c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:24.594299 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fd504f3e-da47-42fb-8b3d-af18ce8b7e8c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:24.605355 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fd504f3e-da47-42fb-8b3d-af18ce8b7e8c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:24.617863 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fd504f3e-da47-42fb-8b3d-af18ce8b7e8c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 200 len: 1814 microversion: 2.25 time: 1.433084 Jul 18 02:18:24.634405 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1033/2061] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:23 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 1814 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:24.668467 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bdcb99cb-4257-43c6-9488-9b077779352e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:24.669681 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bdcb99cb-4257-43c6-9488-9b077779352e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:24.683969 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bdcb99cb-4257-43c6-9488-9b077779352e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:24.684762 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bdcb99cb-4257-43c6-9488-9b077779352e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:24.686281 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bdcb99cb-4257-43c6-9488-9b077779352e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:24.687059 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bdcb99cb-4257-43c6-9488-9b077779352e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:24.872356 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-162683d0-26fd-41de-bd59-f37653b1e414 tempest-AZV2TestJSON-1563519964 tempest-AZV2TestJSON-1563519964-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:24.874663 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-162683d0-26fd-41de-bd59-f37653b1e414 tempest-AZV2TestJSON-1563519964 tempest-AZV2TestJSON-1563519964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:24.875911 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-162683d0-26fd-41de-bd59-f37653b1e414 tempest-AZV2TestJSON-1563519964 tempest-AZV2TestJSON-1563519964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:24.876928 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-162683d0-26fd-41de-bd59-f37653b1e414 tempest-AZV2TestJSON-1563519964 tempest-AZV2TestJSON-1563519964-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:24.877794 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-162683d0-26fd-41de-bd59-f37653b1e414 tempest-AZV2TestJSON-1563519964 tempest-AZV2TestJSON-1563519964-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:24.948458 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-162683d0-26fd-41de-bd59-f37653b1e414 tempest-AZV2TestJSON-1563519964 tempest-AZV2TestJSON-1563519964-project] 10.222.0.57 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.540349 Jul 18 02:18:24.950930 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1029/2062] 10.222.0.57 () {58 vars in 1163 bytes} [Mon Jul 18 02:18:24 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:18:24.964717 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e56ed433-f7d9-4d2b-9f25-568d9247223f tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:24.967236 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e56ed433-f7d9-4d2b-9f25-568d9247223f tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] [instance: 963c78a4-9b68-4450-9b77-31214f51d29a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:24.976498 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e56ed433-f7d9-4d2b-9f25-568d9247223f tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:24.977495 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e56ed433-f7d9-4d2b-9f25-568d9247223f tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:24.979331 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e56ed433-f7d9-4d2b-9f25-568d9247223f tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:24.980181 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e56ed433-f7d9-4d2b-9f25-568d9247223f tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:25.330092 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e56ed433-f7d9-4d2b-9f25-568d9247223f tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:25.344670 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e56ed433-f7d9-4d2b-9f25-568d9247223f tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:25.351830 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e56ed433-f7d9-4d2b-9f25-568d9247223f tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:25.355007 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:25.357206 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e56ed433-f7d9-4d2b-9f25-568d9247223f tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] 10.222.0.57 "GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a" status: 200 len: 1356 microversion: 2.54 time: 0.402526 Jul 18 02:18:25.358173 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1030/2063] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:24 2022] GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a => generated 1356 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:25.367215 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bdcb99cb-4257-43c6-9488-9b077779352e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:25.379643 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0c79e23f-1c56-46fa-845e-83e3c885ee7d tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Action: 'create', calling method: .version_select at 0x7ff49bf3a3a0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1238105074", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbJi7ezaW66uQ12CA1copeKxKjMrgjA423TPGfIJ2s2BMUOicklRQKLJwJhij+NcgZHhLeuBPM1z3oS15uj3UPTIEakqVmjT3zGBt8Ne8xEHMRvN8w4rylNWfa8Hf6s6A=="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:25.388446 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bdcb99cb-4257-43c6-9488-9b077779352e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 200 len: 1211 microversion: 2.1 time: 0.742280 Jul 18 02:18:25.389119 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1034/2064] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:24 2022] GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 1211 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:25.405474 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-0c79e23f-1c56-46fa-845e-83e3c885ee7d tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Getting quotas for project e0dcd66163c6460a93f34495720f1185. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:18:25.439150 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-afed1592-634f-4233-b09c-eef685da47a8 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:25.440983 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-afed1592-634f-4233-b09c-eef685da47a8 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 9fa0633a-54a6-4b73-b9b0-4728a4807856] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:25.447168 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-0c79e23f-1c56-46fa-845e-83e3c885ee7d tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Getting quotas for user 33b9832562054fba865593b7b9d81158 and project e0dcd66163c6460a93f34495720f1185. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:18:25.458455 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-afed1592-634f-4233-b09c-eef685da47a8 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:25.465421 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-afed1592-634f-4233-b09c-eef685da47a8 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:25.466431 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-afed1592-634f-4233-b09c-eef685da47a8 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:25.467084 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-afed1592-634f-4233-b09c-eef685da47a8 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:25.519235 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0c79e23f-1c56-46fa-845e-83e3c885ee7d tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.143299 Jul 18 02:18:25.529432 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1031/2065] 10.222.0.57 () {62 vars in 1199 bytes} [Mon Jul 18 02:18:25 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 154 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 18 02:18:25.535563 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-571821e9-4a41-4e06-bf76-84b1f83650c4 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1238105074", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:25.537928 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-571821e9-4a41-4e06-bf76-84b1f83650c4 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] [instance: 963c78a4-9b68-4450-9b77-31214f51d29a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:25.546667 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-571821e9-4a41-4e06-bf76-84b1f83650c4 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:25.547495 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-571821e9-4a41-4e06-bf76-84b1f83650c4 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:25.548548 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-571821e9-4a41-4e06-bf76-84b1f83650c4 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:25.549222 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-571821e9-4a41-4e06-bf76-84b1f83650c4 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:25.806341 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-571821e9-4a41-4e06-bf76-84b1f83650c4 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:18:25.813723 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-571821e9-4a41-4e06-bf76-84b1f83650c4 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:18:25.814650 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-571821e9-4a41-4e06-bf76-84b1f83650c4 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:18:25.816051 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-571821e9-4a41-4e06-bf76-84b1f83650c4 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:18:25.817083 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-571821e9-4a41-4e06-bf76-84b1f83650c4 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:18:26.079036 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-571821e9-4a41-4e06-bf76-84b1f83650c4 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] [instance: 963c78a4-9b68-4450-9b77-31214f51d29a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:26.094825 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-571821e9-4a41-4e06-bf76-84b1f83650c4 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:26.095291 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-571821e9-4a41-4e06-bf76-84b1f83650c4 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:26.096122 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-571821e9-4a41-4e06-bf76-84b1f83650c4 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:26.096571 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-571821e9-4a41-4e06-bf76-84b1f83650c4 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:26.151456 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-571821e9-4a41-4e06-bf76-84b1f83650c4 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] 10.222.0.57 "POST /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a/action" status: 202 len: 1139 microversion: 2.54 time: 0.620324 Jul 18 02:18:26.162068 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1032/2066] 10.222.0.57 () {62 vars in 1319 bytes} [Mon Jul 18 02:18:25 2022] POST /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a/action => generated 1139 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 18 02:18:26.162671 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-afed1592-634f-4233-b09c-eef685da47a8 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81eea16bcfa4dc5bd66926c6a2658ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839043bafeef4b8785747ca6c2e96817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:26.180181 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b3a622fd-f4c2-4dd5-b249-fa5d30492ce5 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:26.181048 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b3a622fd-f4c2-4dd5-b249-fa5d30492ce5 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:26.209207 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b3a622fd-f4c2-4dd5-b249-fa5d30492ce5 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:26.209999 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b3a622fd-f4c2-4dd5-b249-fa5d30492ce5 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:26.211088 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b3a622fd-f4c2-4dd5-b249-fa5d30492ce5 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:26.214106 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b3a622fd-f4c2-4dd5-b249-fa5d30492ce5 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:26.227119 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-afed1592-634f-4233-b09c-eef685da47a8 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] 10.222.0.57 "GET /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856" status: 200 len: 1324 microversion: 2.1 time: 0.799664 Jul 18 02:18:26.235878 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1035/2067] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:25 2022] GET /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856 => generated 1324 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:26.269136 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5ff3c0d9-6795-40c5-8f33-13ab886cbd8a tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:26.270546 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5ff3c0d9-6795-40c5-8f33-13ab886cbd8a tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] [instance: 963c78a4-9b68-4450-9b77-31214f51d29a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:26.273598 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:26.282209 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ff3c0d9-6795-40c5-8f33-13ab886cbd8a tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:26.285063 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ff3c0d9-6795-40c5-8f33-13ab886cbd8a tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:26.287119 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ff3c0d9-6795-40c5-8f33-13ab886cbd8a tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:26.287989 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ff3c0d9-6795-40c5-8f33-13ab886cbd8a tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:27.100504 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5ff3c0d9-6795-40c5-8f33-13ab886cbd8a tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:27.110879 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5ff3c0d9-6795-40c5-8f33-13ab886cbd8a tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:27.116777 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5ff3c0d9-6795-40c5-8f33-13ab886cbd8a tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:27.121162 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5ff3c0d9-6795-40c5-8f33-13ab886cbd8a tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] 10.222.0.57 "GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a" status: 200 len: 1408 microversion: 2.54 time: 0.879003 Jul 18 02:18:27.122268 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1036/2068] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:26 2022] GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a => generated 1408 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:27.134854 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ee64540d-f69c-4166-9b23-44514735a246 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:27.137282 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ee64540d-f69c-4166-9b23-44514735a246 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:27.157399 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ee64540d-f69c-4166-9b23-44514735a246 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:27.159245 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ee64540d-f69c-4166-9b23-44514735a246 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:27.160496 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ee64540d-f69c-4166-9b23-44514735a246 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:27.162337 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ee64540d-f69c-4166-9b23-44514735a246 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:27.197764 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b3a622fd-f4c2-4dd5-b249-fa5d30492ce5 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:27.217435 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b3a622fd-f4c2-4dd5-b249-fa5d30492ce5 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:27.221193 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b3a622fd-f4c2-4dd5-b249-fa5d30492ce5 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:27.228113 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b3a622fd-f4c2-4dd5-b249-fa5d30492ce5 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 200 len: 1814 microversion: 2.25 time: 1.065233 Jul 18 02:18:27.232416 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1033/2069] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:26 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 1814 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:27.263920 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1709860c-6a4b-41f8-a025-d92684d16ecc tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:27.265128 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1709860c-6a4b-41f8-a025-d92684d16ecc tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 9fa0633a-54a6-4b73-b9b0-4728a4807856] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:27.282515 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1709860c-6a4b-41f8-a025-d92684d16ecc tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:27.282976 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1709860c-6a4b-41f8-a025-d92684d16ecc tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:27.288163 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1709860c-6a4b-41f8-a025-d92684d16ecc tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:27.293290 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1709860c-6a4b-41f8-a025-d92684d16ecc tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:27.847875 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1709860c-6a4b-41f8-a025-d92684d16ecc tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81eea16bcfa4dc5bd66926c6a2658ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839043bafeef4b8785747ca6c2e96817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:27.867451 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1709860c-6a4b-41f8-a025-d92684d16ecc tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] 10.222.0.57 "GET /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856" status: 200 len: 1324 microversion: 2.1 time: 0.612322 Jul 18 02:18:27.876307 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1034/2070] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:27 2022] GET /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856 => generated 1324 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:18:27.962128 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ee64540d-f69c-4166-9b23-44514735a246 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:27.978711 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ee64540d-f69c-4166-9b23-44514735a246 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 200 len: 1211 microversion: 2.1 time: 0.852316 Jul 18 02:18:27.981771 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1037/2071] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:27 2022] GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 1211 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:28.147783 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-372940b3-a224-471b-9908-16132fb7f387 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:28.173643 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-372940b3-a224-471b-9908-16132fb7f387 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] [instance: 963c78a4-9b68-4450-9b77-31214f51d29a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:28.189159 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-372940b3-a224-471b-9908-16132fb7f387 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:28.190423 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-372940b3-a224-471b-9908-16132fb7f387 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:28.191728 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-372940b3-a224-471b-9908-16132fb7f387 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:28.192739 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-372940b3-a224-471b-9908-16132fb7f387 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:28.261517 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bd1499bc-3300-4cfa-abd1-df534907e69a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:28.262832 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bd1499bc-3300-4cfa-abd1-df534907e69a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:28.280507 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bd1499bc-3300-4cfa-abd1-df534907e69a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:28.283281 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bd1499bc-3300-4cfa-abd1-df534907e69a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:28.287240 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bd1499bc-3300-4cfa-abd1-df534907e69a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:28.288242 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bd1499bc-3300-4cfa-abd1-df534907e69a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:28.492464 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-372940b3-a224-471b-9908-16132fb7f387 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:28.521460 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-372940b3-a224-471b-9908-16132fb7f387 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:28.538091 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-372940b3-a224-471b-9908-16132fb7f387 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:28.540579 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-372940b3-a224-471b-9908-16132fb7f387 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] 10.222.0.57 "GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a" status: 200 len: 1408 microversion: 2.54 time: 0.398898 Jul 18 02:18:28.541687 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1035/2072] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:28 2022] GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a => generated 1408 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:28.910277 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f67b318d-d85c-4f54-bba1-6a81ab5548e4 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:28.911663 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f67b318d-d85c-4f54-bba1-6a81ab5548e4 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 9fa0633a-54a6-4b73-b9b0-4728a4807856] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:28.955308 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f67b318d-d85c-4f54-bba1-6a81ab5548e4 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:28.956145 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f67b318d-d85c-4f54-bba1-6a81ab5548e4 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:28.957651 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f67b318d-d85c-4f54-bba1-6a81ab5548e4 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:28.975322 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f67b318d-d85c-4f54-bba1-6a81ab5548e4 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:29.019110 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bd1499bc-3300-4cfa-abd1-df534907e69a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:29.073600 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bd1499bc-3300-4cfa-abd1-df534907e69a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:29.092873 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bd1499bc-3300-4cfa-abd1-df534907e69a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:29.095386 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bd1499bc-3300-4cfa-abd1-df534907e69a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 200 len: 1814 microversion: 2.25 time: 0.845436 Jul 18 02:18:29.126951 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1038/2073] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:28 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 1814 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:29.161620 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-13f6f686-8349-49e4-a825-ae9df20b1b9e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:29.170042 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-13f6f686-8349-49e4-a825-ae9df20b1b9e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:29.196581 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-13f6f686-8349-49e4-a825-ae9df20b1b9e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:29.201670 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-13f6f686-8349-49e4-a825-ae9df20b1b9e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:29.206506 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-13f6f686-8349-49e4-a825-ae9df20b1b9e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:29.210669 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-13f6f686-8349-49e4-a825-ae9df20b1b9e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:29.211034 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=32 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:30.084326 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-13f6f686-8349-49e4-a825-ae9df20b1b9e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:30.099350 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=96 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:30.103784 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f67b318d-d85c-4f54-bba1-6a81ab5548e4 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81eea16bcfa4dc5bd66926c6a2658ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839043bafeef4b8785747ca6c2e96817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:30.115423 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f67b318d-d85c-4f54-bba1-6a81ab5548e4 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] 10.222.0.57 "GET /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856" status: 200 len: 1324 microversion: 2.1 time: 1.217678 Jul 18 02:18:30.116043 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1036/2074] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:28 2022] GET /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856 => generated 1324 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:30.124014 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-13f6f686-8349-49e4-a825-ae9df20b1b9e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 200 len: 1211 microversion: 2.1 time: 0.983887 Jul 18 02:18:30.135824 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1039/2075] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:29 2022] GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 1211 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:30.175449 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d210c81f-1ce9-4bb5-9cbf-8ac3c0d757fa tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:30.178003 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d210c81f-1ce9-4bb5-9cbf-8ac3c0d757fa tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] [instance: 963c78a4-9b68-4450-9b77-31214f51d29a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:30.210342 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d210c81f-1ce9-4bb5-9cbf-8ac3c0d757fa tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:30.218052 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d210c81f-1ce9-4bb5-9cbf-8ac3c0d757fa tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:30.227854 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d210c81f-1ce9-4bb5-9cbf-8ac3c0d757fa tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:30.231937 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d210c81f-1ce9-4bb5-9cbf-8ac3c0d757fa tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:30.733402 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-99f4f8ce-f541-4392-8697-27085e908be3 req-92ebc995-df1d-497e-b3e5-19a13f19a3df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fa0633a-54a6-4b73-b9b0-4728a4807856", "tag": "ee9f4c78-62bc-4a6d-9904-38efa10900ec"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:30.767883 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-99f4f8ce-f541-4392-8697-27085e908be3 req-92ebc995-df1d-497e-b3e5-19a13f19a3df service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:30.768386 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-99f4f8ce-f541-4392-8697-27085e908be3 req-92ebc995-df1d-497e-b3e5-19a13f19a3df service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:30.795189 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-99f4f8ce-f541-4392-8697-27085e908be3 req-92ebc995-df1d-497e-b3e5-19a13f19a3df service nova] Creating event network-changed:ee9f4c78-62bc-4a6d-9904-38efa10900ec for instance 9fa0633a-54a6-4b73-b9b0-4728a4807856 on n-h2-465891-3 Jul 18 02:18:30.801520 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-99f4f8ce-f541-4392-8697-27085e908be3 req-92ebc995-df1d-497e-b3e5-19a13f19a3df service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.672439 Jul 18 02:18:30.803373 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1037/2076] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:18:30.974568 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d210c81f-1ce9-4bb5-9cbf-8ac3c0d757fa tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:31.004964 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d210c81f-1ce9-4bb5-9cbf-8ac3c0d757fa tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:31.020498 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d210c81f-1ce9-4bb5-9cbf-8ac3c0d757fa tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:31.023135 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d210c81f-1ce9-4bb5-9cbf-8ac3c0d757fa tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] 10.222.0.57 "GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a" status: 200 len: 1408 microversion: 2.54 time: 0.881573 Jul 18 02:18:31.038329 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1040/2077] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:30 2022] GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a => generated 1408 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:31.188274 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-db275d2f-a419-4489-87d7-3854dc411b3c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:31.191865 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-db275d2f-a419-4489-87d7-3854dc411b3c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:31.213154 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2b31ccd0-4460-4521-a66a-7438b3d78924 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:31.214254 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2b31ccd0-4460-4521-a66a-7438b3d78924 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:31.220008 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-db275d2f-a419-4489-87d7-3854dc411b3c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:31.220744 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-db275d2f-a419-4489-87d7-3854dc411b3c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:31.223343 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-db275d2f-a419-4489-87d7-3854dc411b3c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:31.228121 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-db275d2f-a419-4489-87d7-3854dc411b3c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:31.258738 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b31ccd0-4460-4521-a66a-7438b3d78924 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:31.261004 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b31ccd0-4460-4521-a66a-7438b3d78924 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:31.265117 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b31ccd0-4460-4521-a66a-7438b3d78924 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:31.269936 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b31ccd0-4460-4521-a66a-7438b3d78924 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:31.875962 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-db275d2f-a419-4489-87d7-3854dc411b3c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:31.925600 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-db275d2f-a419-4489-87d7-3854dc411b3c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 200 len: 1211 microversion: 2.1 time: 0.745303 Jul 18 02:18:31.949789 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1041/2078] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:31 2022] GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 1211 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:31.957937 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4dfa6ad9-d54a-4a7b-9f77-56a9669563ed tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:31.971189 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4dfa6ad9-d54a-4a7b-9f77-56a9669563ed tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 9fa0633a-54a6-4b73-b9b0-4728a4807856] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:32.007986 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4dfa6ad9-d54a-4a7b-9f77-56a9669563ed tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:32.009498 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4dfa6ad9-d54a-4a7b-9f77-56a9669563ed tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:32.011215 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4dfa6ad9-d54a-4a7b-9f77-56a9669563ed tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:32.016108 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4dfa6ad9-d54a-4a7b-9f77-56a9669563ed tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:32.046378 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2b31ccd0-4460-4521-a66a-7438b3d78924 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:32.080436 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2b31ccd0-4460-4521-a66a-7438b3d78924 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:32.090180 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2b31ccd0-4460-4521-a66a-7438b3d78924 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:32.092867 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2b31ccd0-4460-4521-a66a-7438b3d78924 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 200 len: 1814 microversion: 2.25 time: 1.286009 Jul 18 02:18:32.098740 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1038/2079] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:30 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 1814 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:32.126316 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-54529982-1c35-4990-b774-776187b6e90f tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:32.127983 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-54529982-1c35-4990-b774-776187b6e90f tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] [instance: 963c78a4-9b68-4450-9b77-31214f51d29a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:32.145056 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-54529982-1c35-4990-b774-776187b6e90f tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:32.151568 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-54529982-1c35-4990-b774-776187b6e90f tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:32.153207 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-54529982-1c35-4990-b774-776187b6e90f tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:32.154170 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-54529982-1c35-4990-b774-776187b6e90f tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:32.465885 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-54529982-1c35-4990-b774-776187b6e90f tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:32.494332 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-54529982-1c35-4990-b774-776187b6e90f tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:32.504327 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-54529982-1c35-4990-b774-776187b6e90f tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:32.511776 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-54529982-1c35-4990-b774-776187b6e90f tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] 10.222.0.57 "GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a" status: 200 len: 1408 microversion: 2.54 time: 0.410786 Jul 18 02:18:32.535842 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1039/2080] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:32 2022] GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a => generated 1408 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:32.535842 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-1ecd97fb-847e-4e98-a69f-8c19260c5bde req-a13def43-de54-471e-b9a5-e903598a8b2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "174a0067-ee9a-493e-a1d9-099fdf4bbaec", "name": "network-vif-unplugged", "status": "completed", "tag": "6947632d-5fe6-4f71-b7ce-376a2c05af5b"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:32.599925 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-1ecd97fb-847e-4e98-a69f-8c19260c5bde req-a13def43-de54-471e-b9a5-e903598a8b2a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:32.614829 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-1ecd97fb-847e-4e98-a69f-8c19260c5bde req-a13def43-de54-471e-b9a5-e903598a8b2a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:32.663098 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-1ecd97fb-847e-4e98-a69f-8c19260c5bde req-a13def43-de54-471e-b9a5-e903598a8b2a service nova] Creating event network-vif-unplugged:6947632d-5fe6-4f71-b7ce-376a2c05af5b for instance 174a0067-ee9a-493e-a1d9-099fdf4bbaec on n-h2-465891-3 Jul 18 02:18:32.691356 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-1ecd97fb-847e-4e98-a69f-8c19260c5bde req-a13def43-de54-471e-b9a5-e903598a8b2a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.165171 Jul 18 02:18:32.694960 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1040/2081] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:18:32.932111 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4dfa6ad9-d54a-4a7b-9f77-56a9669563ed tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81eea16bcfa4dc5bd66926c6a2658ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839043bafeef4b8785747ca6c2e96817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:32.970981 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-60c34fd7-b4fd-4a7b-9c74-f3073aad2e1c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:32.971895 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4dfa6ad9-d54a-4a7b-9f77-56a9669563ed tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] 10.222.0.57 "GET /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856" status: 200 len: 1324 microversion: 2.1 time: 1.028961 Jul 18 02:18:32.973125 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1042/2082] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:31 2022] GET /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856 => generated 1324 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:32.983385 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-60c34fd7-b4fd-4a7b-9c74-f3073aad2e1c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:33.050526 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60c34fd7-b4fd-4a7b-9c74-f3073aad2e1c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:33.051708 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60c34fd7-b4fd-4a7b-9c74-f3073aad2e1c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:33.060067 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60c34fd7-b4fd-4a7b-9c74-f3073aad2e1c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:33.068621 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60c34fd7-b4fd-4a7b-9c74-f3073aad2e1c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:33.137507 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ed27d993-5ccd-476a-907e-279e50e2c0ee tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:33.143426 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ed27d993-5ccd-476a-907e-279e50e2c0ee tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:33.190183 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ed27d993-5ccd-476a-907e-279e50e2c0ee tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:33.196269 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ed27d993-5ccd-476a-907e-279e50e2c0ee tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:33.198139 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ed27d993-5ccd-476a-907e-279e50e2c0ee tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:33.199199 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ed27d993-5ccd-476a-907e-279e50e2c0ee tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:34.818140 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ed27d993-5ccd-476a-907e-279e50e2c0ee tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:34.845479 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ed27d993-5ccd-476a-907e-279e50e2c0ee tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:34.859803 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ed27d993-5ccd-476a-907e-279e50e2c0ee tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:34.864248 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ed27d993-5ccd-476a-907e-279e50e2c0ee tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 200 len: 1814 microversion: 2.25 time: 1.737590 Jul 18 02:18:34.886673 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1043/2083] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:33 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 1814 bytes in 1761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:18:34.887850 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:34.900167 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-58693ac5-cd58-4a55-8f7e-8257c8091245 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:34.911066 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-58693ac5-cd58-4a55-8f7e-8257c8091245 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] [instance: 963c78a4-9b68-4450-9b77-31214f51d29a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:34.938048 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-58693ac5-cd58-4a55-8f7e-8257c8091245 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:34.938512 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-58693ac5-cd58-4a55-8f7e-8257c8091245 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:34.939366 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-58693ac5-cd58-4a55-8f7e-8257c8091245 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:34.939808 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-58693ac5-cd58-4a55-8f7e-8257c8091245 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:35.103280 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-58693ac5-cd58-4a55-8f7e-8257c8091245 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:35.116884 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-60c34fd7-b4fd-4a7b-9c74-f3073aad2e1c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:35.125607 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-60c34fd7-b4fd-4a7b-9c74-f3073aad2e1c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 200 len: 1211 microversion: 2.1 time: 2.164589 Jul 18 02:18:35.133413 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-58693ac5-cd58-4a55-8f7e-8257c8091245 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:35.134176 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1041/2084] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:32 2022] GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 1211 bytes in 2175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:18:35.139566 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d184c3ef-159b-49bf-8aa1-5a255b450695 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:35.141833 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-58693ac5-cd58-4a55-8f7e-8257c8091245 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:35.145558 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-58693ac5-cd58-4a55-8f7e-8257c8091245 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] 10.222.0.57 "GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a" status: 200 len: 1408 microversion: 2.54 time: 0.257401 Jul 18 02:18:35.154735 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1044/2085] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:34 2022] GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a => generated 1408 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:35.155946 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d184c3ef-159b-49bf-8aa1-5a255b450695 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 9fa0633a-54a6-4b73-b9b0-4728a4807856] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:35.170756 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d184c3ef-159b-49bf-8aa1-5a255b450695 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:35.171478 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d184c3ef-159b-49bf-8aa1-5a255b450695 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:35.172532 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d184c3ef-159b-49bf-8aa1-5a255b450695 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:35.176826 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d184c3ef-159b-49bf-8aa1-5a255b450695 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:35.440669 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-1521367c-1322-41f3-82f2-64b3ab378a22 req-65c9f8e5-905e-450e-a285-0af098488e41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "174a0067-ee9a-493e-a1d9-099fdf4bbaec", "tag": "6947632d-5fe6-4f71-b7ce-376a2c05af5b"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:35.465894 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=24 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:35.472732 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-1521367c-1322-41f3-82f2-64b3ab378a22 req-65c9f8e5-905e-450e-a285-0af098488e41 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:35.473208 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-1521367c-1322-41f3-82f2-64b3ab378a22 req-65c9f8e5-905e-450e-a285-0af098488e41 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:35.513785 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-1521367c-1322-41f3-82f2-64b3ab378a22 req-65c9f8e5-905e-450e-a285-0af098488e41 service nova] Creating event network-changed:6947632d-5fe6-4f71-b7ce-376a2c05af5b for instance 174a0067-ee9a-493e-a1d9-099fdf4bbaec on n-h2-465891-3 Jul 18 02:18:35.530519 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-1521367c-1322-41f3-82f2-64b3ab378a22 req-65c9f8e5-905e-450e-a285-0af098488e41 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089843 Jul 18 02:18:35.531246 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1045/2086] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:18:35.894291 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-35f2c686-260b-4f84-aa56-797c329cda9a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:35.895766 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-35f2c686-260b-4f84-aa56-797c329cda9a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:35.908492 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-35f2c686-260b-4f84-aa56-797c329cda9a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:35.909246 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-35f2c686-260b-4f84-aa56-797c329cda9a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:35.910298 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-35f2c686-260b-4f84-aa56-797c329cda9a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:35.914764 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-35f2c686-260b-4f84-aa56-797c329cda9a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:36.255407 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d184c3ef-159b-49bf-8aa1-5a255b450695 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81eea16bcfa4dc5bd66926c6a2658ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839043bafeef4b8785747ca6c2e96817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:36.343655 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d184c3ef-159b-49bf-8aa1-5a255b450695 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] 10.222.0.57 "GET /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856" status: 200 len: 1324 microversion: 2.1 time: 1.204309 Jul 18 02:18:36.352203 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1042/2087] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:35 2022] GET /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856 => generated 1324 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:36.402218 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d7bc2638-09b4-4afd-8143-d2c5f082225b tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:36.403329 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d7bc2638-09b4-4afd-8143-d2c5f082225b tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:36.423139 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d7bc2638-09b4-4afd-8143-d2c5f082225b tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:36.424168 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d7bc2638-09b4-4afd-8143-d2c5f082225b tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:36.425504 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d7bc2638-09b4-4afd-8143-d2c5f082225b tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:36.426396 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d7bc2638-09b4-4afd-8143-d2c5f082225b tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:37.069123 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-35f2c686-260b-4f84-aa56-797c329cda9a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:37.096577 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-35f2c686-260b-4f84-aa56-797c329cda9a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:37.098289 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-35f2c686-260b-4f84-aa56-797c329cda9a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:37.099579 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-35f2c686-260b-4f84-aa56-797c329cda9a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 200 len: 1814 microversion: 2.25 time: 1.209924 Jul 18 02:18:37.100536 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1046/2088] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:35 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 1814 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:37.118381 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-604db479-7a83-4f77-a196-5f0d6d6b0ebc tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:37.119324 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-604db479-7a83-4f77-a196-5f0d6d6b0ebc tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] [instance: 963c78a4-9b68-4450-9b77-31214f51d29a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:37.129314 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-604db479-7a83-4f77-a196-5f0d6d6b0ebc tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:37.129314 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-604db479-7a83-4f77-a196-5f0d6d6b0ebc tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:37.129314 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-604db479-7a83-4f77-a196-5f0d6d6b0ebc tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:37.129314 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-604db479-7a83-4f77-a196-5f0d6d6b0ebc tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:37.623677 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-604db479-7a83-4f77-a196-5f0d6d6b0ebc tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:37.640939 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-604db479-7a83-4f77-a196-5f0d6d6b0ebc tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:37.642588 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-604db479-7a83-4f77-a196-5f0d6d6b0ebc tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:37.643871 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-604db479-7a83-4f77-a196-5f0d6d6b0ebc tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] 10.222.0.57 "GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a" status: 200 len: 1408 microversion: 2.54 time: 0.542325 Jul 18 02:18:37.662480 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1047/2089] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:37 2022] GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a => generated 1408 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:37.674534 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8eaaff3d-bf61-4070-aa5b-97c8a2a31c7e tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:37.675086 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8eaaff3d-bf61-4070-aa5b-97c8a2a31c7e tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 9fa0633a-54a6-4b73-b9b0-4728a4807856] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:37.698173 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8eaaff3d-bf61-4070-aa5b-97c8a2a31c7e tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:37.713509 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8eaaff3d-bf61-4070-aa5b-97c8a2a31c7e tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:37.714730 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8eaaff3d-bf61-4070-aa5b-97c8a2a31c7e tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:37.715562 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8eaaff3d-bf61-4070-aa5b-97c8a2a31c7e tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:37.880677 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d7bc2638-09b4-4afd-8143-d2c5f082225b tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:37.894018 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d7bc2638-09b4-4afd-8143-d2c5f082225b tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 200 len: 1199 microversion: 2.1 time: 1.513795 Jul 18 02:18:37.894664 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1043/2090] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:36 2022] GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 1199 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:38.127926 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-72577a50-9ab0-4d25-8b2b-ef4d18c09f2d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:38.131034 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-72577a50-9ab0-4d25-8b2b-ef4d18c09f2d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:38.167351 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-72577a50-9ab0-4d25-8b2b-ef4d18c09f2d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:38.172295 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-72577a50-9ab0-4d25-8b2b-ef4d18c09f2d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:38.175215 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-72577a50-9ab0-4d25-8b2b-ef4d18c09f2d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:38.180437 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-72577a50-9ab0-4d25-8b2b-ef4d18c09f2d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:39.138403 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-72577a50-9ab0-4d25-8b2b-ef4d18c09f2d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:39.161396 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-72577a50-9ab0-4d25-8b2b-ef4d18c09f2d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:39.168469 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-72577a50-9ab0-4d25-8b2b-ef4d18c09f2d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:39.174767 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-72577a50-9ab0-4d25-8b2b-ef4d18c09f2d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 200 len: 1814 microversion: 2.25 time: 1.057039 Jul 18 02:18:39.178490 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1044/2091] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:38 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 1814 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:39.214623 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9f8a44d4-b1c0-4ce0-bb6a-5901861cb589 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:39.217959 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9f8a44d4-b1c0-4ce0-bb6a-5901861cb589 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] [instance: 963c78a4-9b68-4450-9b77-31214f51d29a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:39.241477 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9f8a44d4-b1c0-4ce0-bb6a-5901861cb589 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:39.245435 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9f8a44d4-b1c0-4ce0-bb6a-5901861cb589 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:39.248133 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9f8a44d4-b1c0-4ce0-bb6a-5901861cb589 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:39.250864 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9f8a44d4-b1c0-4ce0-bb6a-5901861cb589 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:39.819205 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9f8a44d4-b1c0-4ce0-bb6a-5901861cb589 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:39.843744 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9f8a44d4-b1c0-4ce0-bb6a-5901861cb589 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:39.852449 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9f8a44d4-b1c0-4ce0-bb6a-5901861cb589 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:39.855310 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9f8a44d4-b1c0-4ce0-bb6a-5901861cb589 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] 10.222.0.57 "GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a" status: 200 len: 1408 microversion: 2.54 time: 0.675071 Jul 18 02:18:39.873549 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1045/2092] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:39 2022] GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a => generated 1408 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:39.883816 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8eaaff3d-bf61-4070-aa5b-97c8a2a31c7e tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81eea16bcfa4dc5bd66926c6a2658ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839043bafeef4b8785747ca6c2e96817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:39.901024 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d5a5630c-e4bf-4bdb-b37b-731cb1b52c83 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:39.939941 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d5a5630c-e4bf-4bdb-b37b-731cb1b52c83 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:39.941563 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8eaaff3d-bf61-4070-aa5b-97c8a2a31c7e tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] 10.222.0.57 "GET /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856" status: 200 len: 1324 microversion: 2.1 time: 2.277780 Jul 18 02:18:39.945462 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1048/2093] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:37 2022] GET /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856 => generated 1324 bytes in 2282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:39.982038 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5a5630c-e4bf-4bdb-b37b-731cb1b52c83 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:39.985512 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5a5630c-e4bf-4bdb-b37b-731cb1b52c83 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:39.990944 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5a5630c-e4bf-4bdb-b37b-731cb1b52c83 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:40.001386 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5a5630c-e4bf-4bdb-b37b-731cb1b52c83 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:40.198398 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c90fc4d0-74b7-4757-8aac-f46c4ecf3e29 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:40.198961 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c90fc4d0-74b7-4757-8aac-f46c4ecf3e29 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:40.230069 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c90fc4d0-74b7-4757-8aac-f46c4ecf3e29 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:40.230578 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c90fc4d0-74b7-4757-8aac-f46c4ecf3e29 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:40.231530 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c90fc4d0-74b7-4757-8aac-f46c4ecf3e29 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:40.231987 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c90fc4d0-74b7-4757-8aac-f46c4ecf3e29 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:41.427740 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c90fc4d0-74b7-4757-8aac-f46c4ecf3e29 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:41.444039 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d5a5630c-e4bf-4bdb-b37b-731cb1b52c83 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:41.459036 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c90fc4d0-74b7-4757-8aac-f46c4ecf3e29 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:41.462820 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d5a5630c-e4bf-4bdb-b37b-731cb1b52c83 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 200 len: 1199 microversion: 2.1 time: 1.587413 Jul 18 02:18:41.465966 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c90fc4d0-74b7-4757-8aac-f46c4ecf3e29 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:41.471397 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c90fc4d0-74b7-4757-8aac-f46c4ecf3e29 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 200 len: 1814 microversion: 2.25 time: 1.278417 Jul 18 02:18:41.473826 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1049/2094] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:40 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 1814 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:18:41.474973 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1046/2095] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:39 2022] GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 1199 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:41.484814 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-586d98ab-25f1-4304-ac88-0b7a9ea9887c tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:41.533916 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-586d98ab-25f1-4304-ac88-0b7a9ea9887c tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] [instance: 963c78a4-9b68-4450-9b77-31214f51d29a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:41.577005 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-586d98ab-25f1-4304-ac88-0b7a9ea9887c tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:41.598965 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-586d98ab-25f1-4304-ac88-0b7a9ea9887c tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:41.605077 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-586d98ab-25f1-4304-ac88-0b7a9ea9887c tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:41.605876 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-586d98ab-25f1-4304-ac88-0b7a9ea9887c tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:41.893023 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-9710d226-21e4-4f60-afe2-db53e0e2ac1e req-9928bfaa-c16c-44bb-ac87-90d54d1c021e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fa0633a-54a6-4b73-b9b0-4728a4807856", "name": "network-vif-plugged", "status": "completed", "tag": "ee9f4c78-62bc-4a6d-9904-38efa10900ec"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:41.925627 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-9710d226-21e4-4f60-afe2-db53e0e2ac1e req-9928bfaa-c16c-44bb-ac87-90d54d1c021e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:41.936674 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-9710d226-21e4-4f60-afe2-db53e0e2ac1e req-9928bfaa-c16c-44bb-ac87-90d54d1c021e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:41.995225 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-9710d226-21e4-4f60-afe2-db53e0e2ac1e req-9928bfaa-c16c-44bb-ac87-90d54d1c021e service nova] Creating event network-vif-plugged:ee9f4c78-62bc-4a6d-9904-38efa10900ec for instance 9fa0633a-54a6-4b73-b9b0-4728a4807856 on n-h2-465891-3 Jul 18 02:18:42.016957 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-9710d226-21e4-4f60-afe2-db53e0e2ac1e req-9928bfaa-c16c-44bb-ac87-90d54d1c021e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.537938 Jul 18 02:18:42.018736 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1050/2096] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:18:42.037437 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a97274c8-253d-4b76-bd37-0b26974abc8f tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:42.045836 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a97274c8-253d-4b76-bd37-0b26974abc8f tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 9fa0633a-54a6-4b73-b9b0-4728a4807856] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:42.079600 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a97274c8-253d-4b76-bd37-0b26974abc8f tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:42.089138 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a97274c8-253d-4b76-bd37-0b26974abc8f tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:42.093669 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a97274c8-253d-4b76-bd37-0b26974abc8f tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:42.097436 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a97274c8-253d-4b76-bd37-0b26974abc8f tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:43.082024 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-586d98ab-25f1-4304-ac88-0b7a9ea9887c tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:43.140250 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-586d98ab-25f1-4304-ac88-0b7a9ea9887c tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:43.144083 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-586d98ab-25f1-4304-ac88-0b7a9ea9887c tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:43.147589 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-586d98ab-25f1-4304-ac88-0b7a9ea9887c tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] 10.222.0.57 "GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a" status: 200 len: 1408 microversion: 2.54 time: 1.670851 Jul 18 02:18:43.156353 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1047/2097] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:41 2022] GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a => generated 1408 bytes in 1680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:43.181816 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4ef9c54b-977e-4cdc-96f7-c9de14a92080 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:43.184877 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4ef9c54b-977e-4cdc-96f7-c9de14a92080 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:43.218915 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4ef9c54b-977e-4cdc-96f7-c9de14a92080 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:43.220348 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4ef9c54b-977e-4cdc-96f7-c9de14a92080 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:43.227459 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4ef9c54b-977e-4cdc-96f7-c9de14a92080 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:43.228898 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4ef9c54b-977e-4cdc-96f7-c9de14a92080 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:43.588257 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a97274c8-253d-4b76-bd37-0b26974abc8f tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81eea16bcfa4dc5bd66926c6a2658ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839043bafeef4b8785747ca6c2e96817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:43.680460 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a97274c8-253d-4b76-bd37-0b26974abc8f tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] 10.222.0.57 "GET /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856" status: 200 len: 1324 microversion: 2.1 time: 1.649056 Jul 18 02:18:43.685075 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1051/2098] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:42 2022] GET /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856 => generated 1324 bytes in 1664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:43.713940 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4ef9c54b-977e-4cdc-96f7-c9de14a92080 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:43.720126 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9aa46a70-6c66-4f4d-9e82-300ff473a671 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:43.723106 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9aa46a70-6c66-4f4d-9e82-300ff473a671 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:43.767270 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9aa46a70-6c66-4f4d-9e82-300ff473a671 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:43.770225 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4ef9c54b-977e-4cdc-96f7-c9de14a92080 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 200 len: 1199 microversion: 2.1 time: 0.608954 Jul 18 02:18:43.771962 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1048/2099] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:43 2022] GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 1199 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:43.774175 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9aa46a70-6c66-4f4d-9e82-300ff473a671 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:43.777813 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9aa46a70-6c66-4f4d-9e82-300ff473a671 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:43.780861 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9aa46a70-6c66-4f4d-9e82-300ff473a671 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:44.181350 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0c40795d-6dbc-4c4d-b960-44a05b52c4a2 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:44.183108 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0c40795d-6dbc-4c4d-b960-44a05b52c4a2 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] [instance: 963c78a4-9b68-4450-9b77-31214f51d29a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:44.255259 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c40795d-6dbc-4c4d-b960-44a05b52c4a2 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:44.256041 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c40795d-6dbc-4c4d-b960-44a05b52c4a2 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:44.266437 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c40795d-6dbc-4c4d-b960-44a05b52c4a2 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:44.267642 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c40795d-6dbc-4c4d-b960-44a05b52c4a2 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:44.652114 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0c40795d-6dbc-4c4d-b960-44a05b52c4a2 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:44.667394 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0c40795d-6dbc-4c4d-b960-44a05b52c4a2 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:44.676287 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0c40795d-6dbc-4c4d-b960-44a05b52c4a2 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:44.689915 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0c40795d-6dbc-4c4d-b960-44a05b52c4a2 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] 10.222.0.57 "GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a" status: 200 len: 1408 microversion: 2.54 time: 0.512840 Jul 18 02:18:44.699000 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1049/2100] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:44 2022] GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a => generated 1408 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:44.705992 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4508441f-eb9a-457f-8bbb-4a24495d0ec8 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Action: 'create', calling method: .version_select at 0x7ff4a89dcc10>, body: {"keypair": {"name": "tempest-keypair-1604770316", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFyPksKNb6MIhyzclnxOufV3Dy/wmTMOt6Wk1t7Ko4T82ZEeEeQYbtMTZtXECO8/N51HsaGi6xJn3yNaC1UN9TrOOPOtJ6dUqxUioIV4WMON/CPdOpMiEtTXLAuEui1IFA=="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:44.770037 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-4508441f-eb9a-457f-8bbb-4a24495d0ec8 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Getting quotas for project b23f7f1ddc754ed98b5a77138365a743. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:18:44.786177 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-4508441f-eb9a-457f-8bbb-4a24495d0ec8 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Getting quotas for user 78557a76b1d14ecfaf40e4990cf89be2 and project b23f7f1ddc754ed98b5a77138365a743. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:18:44.911508 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4508441f-eb9a-457f-8bbb-4a24495d0ec8 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.210780 Jul 18 02:18:44.912935 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1050/2101] 10.222.0.57 () {62 vars in 1199 bytes} [Mon Jul 18 02:18:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 213 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 18 02:18:44.950557 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2de13173-3011-48e3-b2c0-1d580d85b7a9 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:44.965192 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2de13173-3011-48e3-b2c0-1d580d85b7a9 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 9fa0633a-54a6-4b73-b9b0-4728a4807856] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:45.003820 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2de13173-3011-48e3-b2c0-1d580d85b7a9 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:45.005023 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2de13173-3011-48e3-b2c0-1d580d85b7a9 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:45.010962 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2de13173-3011-48e3-b2c0-1d580d85b7a9 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:45.014665 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2de13173-3011-48e3-b2c0-1d580d85b7a9 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:45.111765 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9aa46a70-6c66-4f4d-9e82-300ff473a671 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:45.168405 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9aa46a70-6c66-4f4d-9e82-300ff473a671 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:45.191157 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9aa46a70-6c66-4f4d-9e82-300ff473a671 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:45.200336 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9aa46a70-6c66-4f4d-9e82-300ff473a671 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 200 len: 1814 microversion: 2.25 time: 1.508112 Jul 18 02:18:45.202762 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1052/2102] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:43 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 1814 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:45.247264 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1c3f1c19-edc7-477c-9cf1-5d87b1f72d27 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:45.252348 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1c3f1c19-edc7-477c-9cf1-5d87b1f72d27 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:45.298760 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1c3f1c19-edc7-477c-9cf1-5d87b1f72d27 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:45.300148 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1c3f1c19-edc7-477c-9cf1-5d87b1f72d27 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:45.317343 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1c3f1c19-edc7-477c-9cf1-5d87b1f72d27 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:45.318885 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1c3f1c19-edc7-477c-9cf1-5d87b1f72d27 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:46.162816 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2de13173-3011-48e3-b2c0-1d580d85b7a9 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81eea16bcfa4dc5bd66926c6a2658ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839043bafeef4b8785747ca6c2e96817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:46.174661 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2de13173-3011-48e3-b2c0-1d580d85b7a9 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] 10.222.0.57 "GET /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856" status: 200 len: 1520 microversion: 2.1 time: 1.257969 Jul 18 02:18:46.179827 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1051/2103] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:44 2022] GET /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856 => generated 1520 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:46.216844 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-13212aac-b326-42b2-81b2-743d4dcdba70 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:46.217504 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-13212aac-b326-42b2-81b2-743d4dcdba70 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] [instance: 963c78a4-9b68-4450-9b77-31214f51d29a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:46.247439 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-13212aac-b326-42b2-81b2-743d4dcdba70 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:46.248161 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-13212aac-b326-42b2-81b2-743d4dcdba70 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:46.250315 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-13212aac-b326-42b2-81b2-743d4dcdba70 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:46.250777 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-13212aac-b326-42b2-81b2-743d4dcdba70 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:46.375444 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:46.528498 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-13212aac-b326-42b2-81b2-743d4dcdba70 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:46.542204 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-13212aac-b326-42b2-81b2-743d4dcdba70 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:46.548402 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-13212aac-b326-42b2-81b2-743d4dcdba70 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:46.550815 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-13212aac-b326-42b2-81b2-743d4dcdba70 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] 10.222.0.57 "GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a" status: 200 len: 1408 microversion: 2.54 time: 0.356365 Jul 18 02:18:46.555181 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1052/2104] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:46 2022] GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a => generated 1408 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:46.570731 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f709f7fd-06a2-4f57-bc05-77757c20e916 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Action: 'create', calling method: .version_select at 0x7ff4a8c90d30>, body: {"pool": null} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:46.767093 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1c3f1c19-edc7-477c-9cf1-5d87b1f72d27 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:46.834866 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1c3f1c19-edc7-477c-9cf1-5d87b1f72d27 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 200 len: 1199 microversion: 2.1 time: 1.614099 Jul 18 02:18:46.844830 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1053/2105] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:45 2022] GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 1199 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:46.869065 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d3bc3193-e682-4d65-843c-48b55c38c7d2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:46.872013 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d3bc3193-e682-4d65-843c-48b55c38c7d2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:46.896470 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d3bc3193-e682-4d65-843c-48b55c38c7d2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:46.904873 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d3bc3193-e682-4d65-843c-48b55c38c7d2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:46.906893 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d3bc3193-e682-4d65-843c-48b55c38c7d2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:46.908637 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d3bc3193-e682-4d65-843c-48b55c38c7d2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:47.661694 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d3bc3193-e682-4d65-843c-48b55c38c7d2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:47.691944 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d3bc3193-e682-4d65-843c-48b55c38c7d2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:47.704200 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d3bc3193-e682-4d65-843c-48b55c38c7d2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:47.712546 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d3bc3193-e682-4d65-843c-48b55c38c7d2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 200 len: 1814 microversion: 2.25 time: 0.865087 Jul 18 02:18:47.717078 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1054/2106] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:46 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 1814 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:48.321055 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9a6e0cdd-6715-479f-b4d6-7c0023a27e6e tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Action: 'create', calling method: .version_select at 0x7ff4a85dd8b0>, body: {"keypair": {"name": "tempest-keypair-2006192699", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG68P2wOB9qseB8Urqe9ytUqQmezKWcbqHBgL7/MTyc6x4P47Zpp1gu7U65ew3roGx66gPlqokmjBYJMyNX0yaEfOMaItYfNoUX+FDPU6UqdHrB+4hIB+StbDAL7vOxXXg=="}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:48.333545 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=60 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:48.354985 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-9a6e0cdd-6715-479f-b4d6-7c0023a27e6e tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Getting quotas for project 0cef90571c1a4b31bb089a9242569cc2. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:18:48.372856 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-9a6e0cdd-6715-479f-b4d6-7c0023a27e6e tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Getting quotas for user aa996f5ca59e4423ac26d459aab6c7c9 and project 0cef90571c1a4b31bb089a9242569cc2. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:18:48.425819 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9a6e0cdd-6715-479f-b4d6-7c0023a27e6e tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.705877 Jul 18 02:18:48.427971 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1055/2107] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 02:18:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:18:48.438543 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2163f8fe-e2d8-4773-8e25-2370bc9600f0 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:48.439187 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2163f8fe-e2d8-4773-8e25-2370bc9600f0 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] [instance: 963c78a4-9b68-4450-9b77-31214f51d29a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:48.458942 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2163f8fe-e2d8-4773-8e25-2370bc9600f0 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:48.468528 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2163f8fe-e2d8-4773-8e25-2370bc9600f0 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:48.470461 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2163f8fe-e2d8-4773-8e25-2370bc9600f0 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:48.471914 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2163f8fe-e2d8-4773-8e25-2370bc9600f0 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:48.651891 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2163f8fe-e2d8-4773-8e25-2370bc9600f0 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:48.666584 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2163f8fe-e2d8-4773-8e25-2370bc9600f0 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:48.669860 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2163f8fe-e2d8-4773-8e25-2370bc9600f0 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:48.676791 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2163f8fe-e2d8-4773-8e25-2370bc9600f0 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] 10.222.0.57 "GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a" status: 200 len: 1408 microversion: 2.54 time: 0.247617 Jul 18 02:18:48.685196 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1056/2108] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:48 2022] GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a => generated 1408 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:48.705877 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-eedebdf2-68ac-41c6-b174-698976d242c4 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:48.707658 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-eedebdf2-68ac-41c6-b174-698976d242c4 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:48.740530 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eedebdf2-68ac-41c6-b174-698976d242c4 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:48.743264 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eedebdf2-68ac-41c6-b174-698976d242c4 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:48.750837 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eedebdf2-68ac-41c6-b174-698976d242c4 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:48.753339 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eedebdf2-68ac-41c6-b174-698976d242c4 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:49.591096 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-eedebdf2-68ac-41c6-b174-698976d242c4 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:49.602054 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-eedebdf2-68ac-41c6-b174-698976d242c4 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 200 len: 1199 microversion: 2.1 time: 0.913930 Jul 18 02:18:49.603412 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1057/2109] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:48 2022] GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 1199 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:49.609080 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-64ed2f5e-93e7-4c45-9be5-de9be1cf2095 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:49.609998 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-64ed2f5e-93e7-4c45-9be5-de9be1cf2095 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:49.618811 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-64ed2f5e-93e7-4c45-9be5-de9be1cf2095 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:49.619569 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-64ed2f5e-93e7-4c45-9be5-de9be1cf2095 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:49.620565 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-64ed2f5e-93e7-4c45-9be5-de9be1cf2095 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:49.621171 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-64ed2f5e-93e7-4c45-9be5-de9be1cf2095 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:50.289084 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-64ed2f5e-93e7-4c45-9be5-de9be1cf2095 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:50.309606 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=100 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:50.323773 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-64ed2f5e-93e7-4c45-9be5-de9be1cf2095 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:50.323773 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-64ed2f5e-93e7-4c45-9be5-de9be1cf2095 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:50.323773 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-64ed2f5e-93e7-4c45-9be5-de9be1cf2095 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 200 len: 1814 microversion: 2.25 time: 0.718149 Jul 18 02:18:50.328024 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1058/2110] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:49 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 1814 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:50.335525 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8e3e2234-b469-4143-a694-4bab5af6904f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-185714180", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "1a3e0e2b-3694-468d-b069-5c59fd737a8c"}, {"port": "11cacb3f-8e0c-4904-8fb7-ad9beec7e463", "tag": "port-1"}, {"port": "ec520d27-3206-4d7f-96c7-14f7ddd7dba6", "tag": "port-2"}, {"uuid": "d76e28fe-6a13-4a53-9199-9bf7b35bb68c", "tag": "net-1"}, {"uuid": "d76e28fe-6a13-4a53-9199-9bf7b35bb68c"}, {"uuid": "e13b1230-bf1e-4e27-8b99-824195e424ab", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "e13b1230-bf1e-4e27-8b99-824195e424ab", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "75c8e256-6c47-446b-ba92-362f462f6f70", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "912ce07a-8197-4af4-80e2-b0a3ab5a56e4", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "0a874b59-803a-48b6-918c-3135a61e147a", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--18619727"}], "key_name": "tempest-keypair-1604770316", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:50.769235 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-8e3e2234-b469-4143-a694-4bab5af6904f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] validate_networks() for [('1a3e0e2b-3694-468d-b069-5c59fd737a8c', None, None, None, None, None), (None, None, '11cacb3f-8e0c-4904-8fb7-ad9beec7e463', None, None, None), (None, None, 'ec520d27-3206-4d7f-96c7-14f7ddd7dba6', None, None, None), ('d76e28fe-6a13-4a53-9199-9bf7b35bb68c', None, None, None, None, None), ('d76e28fe-6a13-4a53-9199-9bf7b35bb68c', None, None, None, None, None), ('e13b1230-bf1e-4e27-8b99-824195e424ab', '10.2.2.100', None, None, None, None), ('e13b1230-bf1e-4e27-8b99-824195e424ab', '10.2.2.200', None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:18:52.298924 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f709f7fd-06a2-4f57-bc05-77757c20e916 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] 10.222.0.57 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.741673 Jul 18 02:18:52.300952 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1053/2111] 10.222.0.57 () {60 vars in 1169 bytes} [Mon Jul 18 02:18:46 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5745 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:18:52.313386 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ac009e5b-ad07-4062-bbda-f41195b0c61e tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:52.315953 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ac009e5b-ad07-4062-bbda-f41195b0c61e tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] [instance: 963c78a4-9b68-4450-9b77-31214f51d29a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:52.328473 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:INSERT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:52.364483 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ac009e5b-ad07-4062-bbda-f41195b0c61e tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:52.379397 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ac009e5b-ad07-4062-bbda-f41195b0c61e tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:52.385314 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ac009e5b-ad07-4062-bbda-f41195b0c61e tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:52.386425 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ac009e5b-ad07-4062-bbda-f41195b0c61e tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:53.286171 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ac009e5b-ad07-4062-bbda-f41195b0c61e tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:53.297148 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ac009e5b-ad07-4062-bbda-f41195b0c61e tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:53.299216 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ac009e5b-ad07-4062-bbda-f41195b0c61e tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:53.302286 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ac009e5b-ad07-4062-bbda-f41195b0c61e tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] 10.222.0.57 "GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a" status: 200 len: 1408 microversion: 2.54 time: 0.998549 Jul 18 02:18:53.304110 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1054/2112] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:52 2022] GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a => generated 1408 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:53.313181 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-84b236f0-826a-4675-a0ee-0115ad01d1ee req-d9dcfba3-5001-4a92-8001-9dda879f84f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "174a0067-ee9a-493e-a1d9-099fdf4bbaec", "name": "network-vif-unplugged", "status": "completed", "tag": "6947632d-5fe6-4f71-b7ce-376a2c05af5b"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:53.324072 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-84b236f0-826a-4675-a0ee-0115ad01d1ee req-d9dcfba3-5001-4a92-8001-9dda879f84f4 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:53.324781 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-84b236f0-826a-4675-a0ee-0115ad01d1ee req-d9dcfba3-5001-4a92-8001-9dda879f84f4 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:53.340229 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-84b236f0-826a-4675-a0ee-0115ad01d1ee req-d9dcfba3-5001-4a92-8001-9dda879f84f4 service nova] Creating event network-vif-unplugged:6947632d-5fe6-4f71-b7ce-376a2c05af5b for instance 174a0067-ee9a-493e-a1d9-099fdf4bbaec on n-h2-465891-3 Jul 18 02:18:53.346799 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-84b236f0-826a-4675-a0ee-0115ad01d1ee req-d9dcfba3-5001-4a92-8001-9dda879f84f4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041025 Jul 18 02:18:53.353523 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1055/2113] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:18:53.360684 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-511ddb53-84cd-4546-9471-02ffaa52745a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:53.361650 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-511ddb53-84cd-4546-9471-02ffaa52745a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:53.377048 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-511ddb53-84cd-4546-9471-02ffaa52745a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:53.377626 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-511ddb53-84cd-4546-9471-02ffaa52745a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:53.378392 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-511ddb53-84cd-4546-9471-02ffaa52745a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:53.378942 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-511ddb53-84cd-4546-9471-02ffaa52745a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:54.087077 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-511ddb53-84cd-4546-9471-02ffaa52745a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:54.108067 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-511ddb53-84cd-4546-9471-02ffaa52745a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 200 len: 1199 microversion: 2.1 time: 0.752280 Jul 18 02:18:54.114795 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1056/2114] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:53 2022] GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 1199 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:54.141551 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2cdac7d8-0b6c-4efe-826f-ac8c185787ea tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:54.143858 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2cdac7d8-0b6c-4efe-826f-ac8c185787ea tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:54.161757 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2cdac7d8-0b6c-4efe-826f-ac8c185787ea tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:54.163129 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2cdac7d8-0b6c-4efe-826f-ac8c185787ea tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:54.164939 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2cdac7d8-0b6c-4efe-826f-ac8c185787ea tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:54.165679 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2cdac7d8-0b6c-4efe-826f-ac8c185787ea tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:54.717487 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2cdac7d8-0b6c-4efe-826f-ac8c185787ea tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:54.736993 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2cdac7d8-0b6c-4efe-826f-ac8c185787ea tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:54.741614 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2cdac7d8-0b6c-4efe-826f-ac8c185787ea tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:54.744437 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2cdac7d8-0b6c-4efe-826f-ac8c185787ea tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 200 len: 1814 microversion: 2.25 time: 0.625217 Jul 18 02:18:54.745810 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1057/2115] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:54 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 1814 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:54.755061 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-746f3df3-da6f-4685-9288-09a57809a9a8 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1377384491", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "158397fb-03e8-488a-929e-26b83d7a32dd"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:54.817952 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=4 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:54.847122 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-746f3df3-da6f-4685-9288-09a57809a9a8 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] validate_networks() for [('158397fb-03e8-488a-929e-26b83d7a32dd', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:18:56.007469 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-746f3df3-da6f-4685-9288-09a57809a9a8 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:18:56.009862 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-746f3df3-da6f-4685-9288-09a57809a9a8 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:18:56.010779 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-746f3df3-da6f-4685-9288-09a57809a9a8 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:18:56.011441 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-746f3df3-da6f-4685-9288-09a57809a9a8 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:18:56.012101 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-746f3df3-da6f-4685-9288-09a57809a9a8 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:18:56.027507 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-746f3df3-da6f-4685-9288-09a57809a9a8 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:56.029310 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-746f3df3-da6f-4685-9288-09a57809a9a8 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:56.031244 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-746f3df3-da6f-4685-9288-09a57809a9a8 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:56.032144 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-746f3df3-da6f-4685-9288-09a57809a9a8 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:56.058880 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-746f3df3-da6f-4685-9288-09a57809a9a8 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Getting quotas for project 839043bafeef4b8785747ca6c2e96817. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:18:56.067460 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-746f3df3-da6f-4685-9288-09a57809a9a8 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Getting quotas for user e81eea16bcfa4dc5bd66926c6a2658ba and project 839043bafeef4b8785747ca6c2e96817. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:18:56.091417 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-746f3df3-da6f-4685-9288-09a57809a9a8 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:18:56.096290 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-746f3df3-da6f-4685-9288-09a57809a9a8 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 05c84048-d3a6-4711-8c32-23ef6424fa9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:18:56.185662 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-746f3df3-da6f-4685-9288-09a57809a9a8 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.437606 Jul 18 02:18:56.187085 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1058/2116] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:18:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1440 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:18:56.203969 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-09447db1-bd8e-47cf-9443-743f48e5069a tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1856339476", "imageRef": "6349e88a-8083-47f0-ac23-6ebc110fb371", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "7837db1b-2d37-4122-addd-241492155e2f"}], "security_groups": [{"name": "tempest-securitygroup--989312480"}], "key_name": "tempest-keypair-2006192699", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:56.913124 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-09447db1-bd8e-47cf-9443-743f48e5069a tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] validate_networks() for [('7837db1b-2d37-4122-addd-241492155e2f', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:18:58.386153 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:58.908197 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-09447db1-bd8e-47cf-9443-743f48e5069a tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:18:58.908990 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-09447db1-bd8e-47cf-9443-743f48e5069a tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:18:58.913681 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-09447db1-bd8e-47cf-9443-743f48e5069a tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:18:58.916966 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-09447db1-bd8e-47cf-9443-743f48e5069a tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:18:58.919649 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-09447db1-bd8e-47cf-9443-743f48e5069a tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:18:58.986431 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-09447db1-bd8e-47cf-9443-743f48e5069a tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:58.987305 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-09447db1-bd8e-47cf-9443-743f48e5069a tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:58.989539 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-09447db1-bd8e-47cf-9443-743f48e5069a tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:58.992640 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-09447db1-bd8e-47cf-9443-743f48e5069a tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:59.063997 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-09447db1-bd8e-47cf-9443-743f48e5069a tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Getting quotas for project 0cef90571c1a4b31bb089a9242569cc2. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:18:59.077052 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-09447db1-bd8e-47cf-9443-743f48e5069a tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Getting quotas for user aa996f5ca59e4423ac26d459aab6c7c9 and project 0cef90571c1a4b31bb089a9242569cc2. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:18:59.106683 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-09447db1-bd8e-47cf-9443-743f48e5069a tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:18:59.111333 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-09447db1-bd8e-47cf-9443-743f48e5069a tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] [instance: 0f30e76e-91e9-441f-b482-28de008a5e40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6349e88a-8083-47f0-ac23-6ebc110fb371',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:18:59.182326 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-09447db1-bd8e-47cf-9443-743f48e5069a tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.993834 Jul 18 02:18:59.189655 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1059/2117] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:18:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 3002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:18:59.196709 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a5debdf6-75f5-4109-aaf8-febd60990ba9 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:59.197741 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a5debdf6-75f5-4109-aaf8-febd60990ba9 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] [instance: 963c78a4-9b68-4450-9b77-31214f51d29a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:59.207218 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a5debdf6-75f5-4109-aaf8-febd60990ba9 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:59.208578 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a5debdf6-75f5-4109-aaf8-febd60990ba9 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:59.211163 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a5debdf6-75f5-4109-aaf8-febd60990ba9 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:59.211995 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a5debdf6-75f5-4109-aaf8-febd60990ba9 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:59.574356 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a5debdf6-75f5-4109-aaf8-febd60990ba9 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:59.614563 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a5debdf6-75f5-4109-aaf8-febd60990ba9 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:59.618920 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a5debdf6-75f5-4109-aaf8-febd60990ba9 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:59.621289 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a5debdf6-75f5-4109-aaf8-febd60990ba9 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] 10.222.0.57 "GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a" status: 200 len: 1399 microversion: 2.54 time: 0.429678 Jul 18 02:18:59.622552 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1060/2118] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:59 2022] GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a => generated 1399 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:59.651230 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ec77a36f-4d2d-4a4a-a16e-090f3087bc33 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:59.654851 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ec77a36f-4d2d-4a4a-a16e-090f3087bc33 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:59.681760 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ec77a36f-4d2d-4a4a-a16e-090f3087bc33 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:59.682248 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ec77a36f-4d2d-4a4a-a16e-090f3087bc33 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:59.683171 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ec77a36f-4d2d-4a4a-a16e-090f3087bc33 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:59.683635 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ec77a36f-4d2d-4a4a-a16e-090f3087bc33 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:00.094337 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-8e3e2234-b469-4143-a694-4bab5af6904f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:19:00.121199 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-8e3e2234-b469-4143-a694-4bab5af6904f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:19:00.128374 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-8e3e2234-b469-4143-a694-4bab5af6904f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:19:00.129555 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-8e3e2234-b469-4143-a694-4bab5af6904f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:19:00.133133 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ec77a36f-4d2d-4a4a-a16e-090f3087bc33 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:00.133899 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-8e3e2234-b469-4143-a694-4bab5af6904f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:19:00.143560 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ec77a36f-4d2d-4a4a-a16e-090f3087bc33 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 200 len: 1199 microversion: 2.1 time: 0.518737 Jul 18 02:19:00.153908 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1061/2119] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:59 2022] GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 1199 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:00.158198 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-709f2eeb-4598-42b4-8e56-fb1228292f47 req-3d67c8d9-9da4-4d47-b6bc-2b31141b51d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36319b4f-008b-4321-ac5d-e201e50673d3", "name": "network-vif-plugged", "status": "completed", "tag": "22552354-154e-44d7-a1ec-f329d159341f"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:00.175543 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-709f2eeb-4598-42b4-8e56-fb1228292f47 req-3d67c8d9-9da4-4d47-b6bc-2b31141b51d2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:00.176561 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-709f2eeb-4598-42b4-8e56-fb1228292f47 req-3d67c8d9-9da4-4d47-b6bc-2b31141b51d2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:00.197608 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-709f2eeb-4598-42b4-8e56-fb1228292f47 req-3d67c8d9-9da4-4d47-b6bc-2b31141b51d2 service nova] Creating event network-vif-plugged:22552354-154e-44d7-a1ec-f329d159341f for instance 36319b4f-008b-4321-ac5d-e201e50673d3 on n-h1-465891-3 Jul 18 02:19:00.204944 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-709f2eeb-4598-42b4-8e56-fb1228292f47 req-3d67c8d9-9da4-4d47-b6bc-2b31141b51d2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058217 Jul 18 02:19:00.206332 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1062/2120] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:19:00.212837 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8e3e2234-b469-4143-a694-4bab5af6904f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:00.214475 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-80c168b1-0f78-47d0-9261-de3218630ced tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:00.215296 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-80c168b1-0f78-47d0-9261-de3218630ced tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:00.220913 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8e3e2234-b469-4143-a694-4bab5af6904f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:00.223601 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-80c168b1-0f78-47d0-9261-de3218630ced tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:00.223826 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8e3e2234-b469-4143-a694-4bab5af6904f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:00.224184 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-80c168b1-0f78-47d0-9261-de3218630ced tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:00.225630 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-80c168b1-0f78-47d0-9261-de3218630ced tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:00.226442 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-80c168b1-0f78-47d0-9261-de3218630ced tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:00.233779 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8e3e2234-b469-4143-a694-4bab5af6904f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:00.315958 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-8e3e2234-b469-4143-a694-4bab5af6904f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Getting quotas for project b23f7f1ddc754ed98b5a77138365a743. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:19:00.329388 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-8e3e2234-b469-4143-a694-4bab5af6904f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Getting quotas for user 78557a76b1d14ecfaf40e4990cf89be2 and project b23f7f1ddc754ed98b5a77138365a743. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:19:00.962653 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8e3e2234-b469-4143-a694-4bab5af6904f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:19:00.967611 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8e3e2234-b469-4143-a694-4bab5af6904f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='75c8e256-6c47-446b-ba92-362f462f6f70',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='912ce07a-8197-4af4-80e2-b0a3ab5a56e4',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0a874b59-803a-48b6-918c-3135a61e147a',volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:19:01.026824 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-80c168b1-0f78-47d0-9261-de3218630ced tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:01.040103 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-80c168b1-0f78-47d0-9261-de3218630ced tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:01.045270 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-80c168b1-0f78-47d0-9261-de3218630ced tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:01.066444 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-80c168b1-0f78-47d0-9261-de3218630ced tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 200 len: 1804 microversion: 2.25 time: 0.852233 Jul 18 02:19:01.104821 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1063/2121] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:19:00 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 1804 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:19:01.121923 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8dc20b15-0cb7-4aab-80ef-74479b76d3eb tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:01.126216 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8dc20b15-0cb7-4aab-80ef-74479b76d3eb tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 05c84048-d3a6-4711-8c32-23ef6424fa9b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:01.141855 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8dc20b15-0cb7-4aab-80ef-74479b76d3eb tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:01.143182 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8dc20b15-0cb7-4aab-80ef-74479b76d3eb tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:01.144337 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8dc20b15-0cb7-4aab-80ef-74479b76d3eb tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:01.144968 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8dc20b15-0cb7-4aab-80ef-74479b76d3eb tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:01.741692 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8dc20b15-0cb7-4aab-80ef-74479b76d3eb tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81eea16bcfa4dc5bd66926c6a2658ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839043bafeef4b8785747ca6c2e96817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:01.760979 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8dc20b15-0cb7-4aab-80ef-74479b76d3eb tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] 10.222.0.57 "GET /compute/v2.1/servers/05c84048-d3a6-4711-8c32-23ef6424fa9b" status: 200 len: 1324 microversion: 2.1 time: 0.653782 Jul 18 02:19:01.766383 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1064/2122] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:01 2022] GET /compute/v2.1/servers/05c84048-d3a6-4711-8c32-23ef6424fa9b => generated 1324 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:01.947525 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8e3e2234-b469-4143-a694-4bab5af6904f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.42 time: 11.617115 Jul 18 02:19:01.949984 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1059/2123] 10.222.0.57 () {62 vars in 1188 bytes} [Mon Jul 18 02:18:50 2022] POST /compute/v2.1/servers => generated 404 bytes in 11621 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 02:19:01.961414 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-caa75c2f-fa5a-4860-a573-ccea6570117e tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:01.962875 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-caa75c2f-fa5a-4860-a573-ccea6570117e tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] [instance: 0f30e76e-91e9-441f-b482-28de008a5e40] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:01.984697 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-caa75c2f-fa5a-4860-a573-ccea6570117e tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:01.986184 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-caa75c2f-fa5a-4860-a573-ccea6570117e tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:01.987902 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-caa75c2f-fa5a-4860-a573-ccea6570117e tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:01.989665 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-caa75c2f-fa5a-4860-a573-ccea6570117e tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:02.416534 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-caa75c2f-fa5a-4860-a573-ccea6570117e tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa996f5ca59e4423ac26d459aab6c7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cef90571c1a4b31bb089a9242569cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:02.438084 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-caa75c2f-fa5a-4860-a573-ccea6570117e tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] 10.222.0.57 "GET /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40" status: 200 len: 1304 microversion: 2.1 time: 0.485730 Jul 18 02:19:02.441142 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1060/2124] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:01 2022] GET /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40 => generated 1304 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:02.487029 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e8f7c80b-6b95-43f6-9bf3-734c409f0b12 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Calling method '.version_select at 0x7ff4a8531f70>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:02.605534 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e8f7c80b-6b95-43f6-9bf3-734c409f0b12 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1238105074" status: 204 len: 0 microversion: 2.54 time: 0.158457 Jul 18 02:19:02.619570 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1061/2125] 10.222.0.57 () {60 vars in 1318 bytes} [Mon Jul 18 02:19:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1238105074 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:19:02.653569 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-41f163b4-d903-428b-a563-eeb20c4b2259 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Action: 'create', calling method: .version_select at 0x7ff4add60ee0>, body: {"keypair": {"name": "tempest-keypair-1680034301", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgHxrl9Jeh66e7PEHhV5azbS7AtPCRwt85Mpm5x1zm0ZbR88IF0ScF5OlFlQp0tgarqcLPzWMreqL6hINo3hDleiOJjbrZztW36sKlRSb5P915LItP8el+VTjuIFif7bw=="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:02.698244 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-41f163b4-d903-428b-a563-eeb20c4b2259 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Getting quotas for project d0ed68b2710e40f487813716ca4965e9. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:19:02.726857 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-41f163b4-d903-428b-a563-eeb20c4b2259 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Getting quotas for user 1de42754291d4c43b983b425a02ea9d3 and project d0ed68b2710e40f487813716ca4965e9. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:19:02.796075 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-41f163b4-d903-428b-a563-eeb20c4b2259 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.022544 Jul 18 02:19:02.798120 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1065/2126] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 02:19:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:19:02.824842 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0c55e097-15c3-45ed-b668-4cc48d3b5468 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:02.830348 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0c55e097-15c3-45ed-b668-4cc48d3b5468 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:02.872868 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c55e097-15c3-45ed-b668-4cc48d3b5468 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:02.878667 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c55e097-15c3-45ed-b668-4cc48d3b5468 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:02.884608 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c55e097-15c3-45ed-b668-4cc48d3b5468 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:02.894934 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c55e097-15c3-45ed-b668-4cc48d3b5468 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:03.644919 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0c55e097-15c3-45ed-b668-4cc48d3b5468 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:03.661871 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0c55e097-15c3-45ed-b668-4cc48d3b5468 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 200 len: 1382 microversion: 2.1 time: 0.860687 Jul 18 02:19:03.663818 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1066/2127] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:02 2022] GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 1382 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:03.669017 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6f0005a5-737a-4b8d-a596-33c59bd99dfd tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:03.672347 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6f0005a5-737a-4b8d-a596-33c59bd99dfd tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:03.981550 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6f0005a5-737a-4b8d-a596-33c59bd99dfd tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:03.997947 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6f0005a5-737a-4b8d-a596-33c59bd99dfd tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:03.999833 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6f0005a5-737a-4b8d-a596-33c59bd99dfd tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:04.001163 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6f0005a5-737a-4b8d-a596-33c59bd99dfd tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1285 microversion: 2.42 time: 0.336160 Jul 18 02:19:04.016341 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1067/2128] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:19:03 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1285 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:19:04.040490 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-41902b58-ec6c-428d-aca0-63f0007cf752 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:04.041015 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-41902b58-ec6c-428d-aca0-63f0007cf752 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] [instance: 963c78a4-9b68-4450-9b77-31214f51d29a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:04.075980 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41902b58-ec6c-428d-aca0-63f0007cf752 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:04.076362 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41902b58-ec6c-428d-aca0-63f0007cf752 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:04.080337 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41902b58-ec6c-428d-aca0-63f0007cf752 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:04.081040 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41902b58-ec6c-428d-aca0-63f0007cf752 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:04.214321 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-41902b58-ec6c-428d-aca0-63f0007cf752 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] [instance: 963c78a4-9b68-4450-9b77-31214f51d29a] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:19:04.249470 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-17bbf115-b375-4160-9258-43df84747949 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Calling method '.version_select at 0x7ff4a82564c0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:04.262106 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-17bbf115-b375-4160-9258-43df84747949 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:04.276294 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-17bbf115-b375-4160-9258-43df84747949 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:04.366112 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-17bbf115-b375-4160-9258-43df84747949 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] 10.222.0.57 "GET /compute/v2.1/os-migrations" status: 200 len: 2533 microversion: 2.25 time: 1.732069 Jul 18 02:19:04.368092 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1062/2129] 10.222.0.57 () {60 vars in 1183 bytes} [Mon Jul 18 02:19:02 2022] GET /compute/v2.1/os-migrations => generated 2533 bytes in 1748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:19:04.392220 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-32f0d5f0-01a8-46c5-bb6a-38171a9feca8 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:04.431325 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-32f0d5f0-01a8-46c5-bb6a-38171a9feca8 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 05c84048-d3a6-4711-8c32-23ef6424fa9b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:04.464817 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-32f0d5f0-01a8-46c5-bb6a-38171a9feca8 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:04.465537 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-32f0d5f0-01a8-46c5-bb6a-38171a9feca8 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:04.466893 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-32f0d5f0-01a8-46c5-bb6a-38171a9feca8 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:04.467578 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-32f0d5f0-01a8-46c5-bb6a-38171a9feca8 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:04.520811 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-41902b58-ec6c-428d-aca0-63f0007cf752 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] 10.222.0.57 "DELETE /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a" status: 204 len: 0 microversion: 2.54 time: 0.497499 Jul 18 02:19:04.522555 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1068/2130] 10.222.0.57 () {60 vars in 1279 bytes} [Mon Jul 18 02:19:04 2022] DELETE /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:19:04.534998 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bd94d40f-1fef-46b7-bc70-7c326020016d tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:04.536020 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bd94d40f-1fef-46b7-bc70-7c326020016d tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] [instance: 0f30e76e-91e9-441f-b482-28de008a5e40] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:04.574328 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bd94d40f-1fef-46b7-bc70-7c326020016d tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:04.574848 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bd94d40f-1fef-46b7-bc70-7c326020016d tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:04.575709 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bd94d40f-1fef-46b7-bc70-7c326020016d tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:04.576160 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bd94d40f-1fef-46b7-bc70-7c326020016d tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:05.984067 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-32f0d5f0-01a8-46c5-bb6a-38171a9feca8 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81eea16bcfa4dc5bd66926c6a2658ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839043bafeef4b8785747ca6c2e96817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:06.047646 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-32f0d5f0-01a8-46c5-bb6a-38171a9feca8 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] 10.222.0.57 "GET /compute/v2.1/servers/05c84048-d3a6-4711-8c32-23ef6424fa9b" status: 200 len: 1324 microversion: 2.1 time: 1.662027 Jul 18 02:19:06.062359 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1063/2131] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:04 2022] GET /compute/v2.1/servers/05c84048-d3a6-4711-8c32-23ef6424fa9b => generated 1324 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:06.076455 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8ccd4a76-f6ee-4f58-a923-1bea9038f3dc tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:06.102750 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8ccd4a76-f6ee-4f58-a923-1bea9038f3dc tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:06.119726 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8ccd4a76-f6ee-4f58-a923-1bea9038f3dc tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:06.138916 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8ccd4a76-f6ee-4f58-a923-1bea9038f3dc tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:06.141334 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8ccd4a76-f6ee-4f58-a923-1bea9038f3dc tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:06.142633 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8ccd4a76-f6ee-4f58-a923-1bea9038f3dc tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:06.190735 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bd94d40f-1fef-46b7-bc70-7c326020016d tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa996f5ca59e4423ac26d459aab6c7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cef90571c1a4b31bb089a9242569cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:06.244500 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bd94d40f-1fef-46b7-bc70-7c326020016d tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] 10.222.0.57 "GET /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40" status: 200 len: 1371 microversion: 2.1 time: 1.715831 Jul 18 02:19:06.249810 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1069/2132] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:04 2022] GET /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40 => generated 1371 bytes in 1727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:06.689573 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-e6dbb62c-b1ad-4769-bae8-e2e14de09165 req-5ba58222-0d4a-4eaf-bbed-3249be2d925f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05c84048-d3a6-4711-8c32-23ef6424fa9b", "tag": "8ddcd961-a463-442c-9c8d-a4a26d309062"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:06.705230 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-e6dbb62c-b1ad-4769-bae8-e2e14de09165 req-5ba58222-0d4a-4eaf-bbed-3249be2d925f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:06.706358 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-e6dbb62c-b1ad-4769-bae8-e2e14de09165 req-5ba58222-0d4a-4eaf-bbed-3249be2d925f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:06.734595 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-e6dbb62c-b1ad-4769-bae8-e2e14de09165 req-5ba58222-0d4a-4eaf-bbed-3249be2d925f service nova] Creating event network-changed:8ddcd961-a463-442c-9c8d-a4a26d309062 for instance 05c84048-d3a6-4711-8c32-23ef6424fa9b on n-h1-465891-3 Jul 18 02:19:06.757925 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-e6dbb62c-b1ad-4769-bae8-e2e14de09165 req-5ba58222-0d4a-4eaf-bbed-3249be2d925f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.499722 Jul 18 02:19:06.759280 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1070/2133] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:19:06.768942 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-66ea19d2-91ef-4921-a69c-efa03f896593 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:06.770736 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-66ea19d2-91ef-4921-a69c-efa03f896593 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:06.785141 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-66ea19d2-91ef-4921-a69c-efa03f896593 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:06.786343 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-66ea19d2-91ef-4921-a69c-efa03f896593 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:06.788168 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-66ea19d2-91ef-4921-a69c-efa03f896593 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:06.788936 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-66ea19d2-91ef-4921-a69c-efa03f896593 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:06.950452 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8ccd4a76-f6ee-4f58-a923-1bea9038f3dc tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 200 len: 1533 microversion: 2.1 time: 0.875476 Jul 18 02:19:06.952334 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1064/2134] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:06 2022] GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 1533 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:06.965441 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-be0e20b0-1ff1-4911-921c-7537a96fcd92 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:06.971530 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-be0e20b0-1ff1-4911-921c-7537a96fcd92 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] [instance: 963c78a4-9b68-4450-9b77-31214f51d29a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:06.995085 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-be0e20b0-1ff1-4911-921c-7537a96fcd92 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:06.997631 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-be0e20b0-1ff1-4911-921c-7537a96fcd92 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:06.999550 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-be0e20b0-1ff1-4911-921c-7537a96fcd92 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:07.000578 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-be0e20b0-1ff1-4911-921c-7537a96fcd92 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:07.125046 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-66ea19d2-91ef-4921-a69c-efa03f896593 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lazy-loading 'services' on Instance uuid 174a0067-ee9a-493e-a1d9-099fdf4bbaec {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:19:07.184236 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-66ea19d2-91ef-4921-a69c-efa03f896593 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 200 len: 2422 microversion: 2.25 time: 0.422467 Jul 18 02:19:07.198172 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1071/2135] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:19:06 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 2422 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:19:07.204325 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-be0e20b0-1ff1-4911-921c-7537a96fcd92 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:07.214953 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4642326e-5e8e-45e0-b391-0c888dce9d52 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:07.215634 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4642326e-5e8e-45e0-b391-0c888dce9d52 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:07.223807 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-be0e20b0-1ff1-4911-921c-7537a96fcd92 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:07.227552 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-be0e20b0-1ff1-4911-921c-7537a96fcd92 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:07.230318 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-be0e20b0-1ff1-4911-921c-7537a96fcd92 tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] 10.222.0.57 "GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a" status: 200 len: 1405 microversion: 2.54 time: 0.274991 Jul 18 02:19:07.231892 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1065/2136] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:19:06 2022] GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a => generated 1405 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:19:07.244633 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4642326e-5e8e-45e0-b391-0c888dce9d52 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:07.244951 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7ae13af1-e67d-420e-8dc7-a4067b0278e6 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:07.245300 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4642326e-5e8e-45e0-b391-0c888dce9d52 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:07.245858 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7ae13af1-e67d-420e-8dc7-a4067b0278e6 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:07.246655 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4642326e-5e8e-45e0-b391-0c888dce9d52 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:07.247278 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4642326e-5e8e-45e0-b391-0c888dce9d52 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:07.254534 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7ae13af1-e67d-420e-8dc7-a4067b0278e6 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:07.255269 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7ae13af1-e67d-420e-8dc7-a4067b0278e6 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:07.259185 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7ae13af1-e67d-420e-8dc7-a4067b0278e6 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:07.260153 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7ae13af1-e67d-420e-8dc7-a4067b0278e6 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:07.772591 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4642326e-5e8e-45e0-b391-0c888dce9d52 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:07.835289 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4642326e-5e8e-45e0-b391-0c888dce9d52 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:07.839420 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4642326e-5e8e-45e0-b391-0c888dce9d52 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:07.843142 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4642326e-5e8e-45e0-b391-0c888dce9d52 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1519 microversion: 2.42 time: 0.642073 Jul 18 02:19:07.845068 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1072/2137] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:19:07 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1519 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:19:07.870950 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9411a0cb-a896-4ed8-a766-73bdf9722abe tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:07.923669 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9411a0cb-a896-4ed8-a766-73bdf9722abe tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 05c84048-d3a6-4711-8c32-23ef6424fa9b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:07.946674 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9411a0cb-a896-4ed8-a766-73bdf9722abe tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:07.951635 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9411a0cb-a896-4ed8-a766-73bdf9722abe tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:07.952706 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9411a0cb-a896-4ed8-a766-73bdf9722abe tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:07.953213 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9411a0cb-a896-4ed8-a766-73bdf9722abe tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:08.020077 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:19:08.393293 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7ae13af1-e67d-420e-8dc7-a4067b0278e6 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 200 len: 1533 microversion: 2.1 time: 1.159173 Jul 18 02:19:08.395552 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1066/2138] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:07 2022] GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 1533 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:08.426663 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-85f36c2a-80f0-40b0-af35-d1c284505f45 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:08.429684 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-85f36c2a-80f0-40b0-af35-d1c284505f45 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:08.445617 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-85f36c2a-80f0-40b0-af35-d1c284505f45 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:08.446854 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-85f36c2a-80f0-40b0-af35-d1c284505f45 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:08.448343 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-85f36c2a-80f0-40b0-af35-d1c284505f45 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:08.449260 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-85f36c2a-80f0-40b0-af35-d1c284505f45 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:08.614166 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9411a0cb-a896-4ed8-a766-73bdf9722abe tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81eea16bcfa4dc5bd66926c6a2658ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839043bafeef4b8785747ca6c2e96817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:08.642269 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9411a0cb-a896-4ed8-a766-73bdf9722abe tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] 10.222.0.57 "GET /compute/v2.1/servers/05c84048-d3a6-4711-8c32-23ef6424fa9b" status: 200 len: 1324 microversion: 2.1 time: 0.794663 Jul 18 02:19:08.643695 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1073/2139] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:07 2022] GET /compute/v2.1/servers/05c84048-d3a6-4711-8c32-23ef6424fa9b => generated 1324 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:08.661135 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-618e780d-d3d1-4071-a5c4-8012c6f29422 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:08.662525 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-618e780d-d3d1-4071-a5c4-8012c6f29422 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] [instance: 0f30e76e-91e9-441f-b482-28de008a5e40] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:08.696414 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-618e780d-d3d1-4071-a5c4-8012c6f29422 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:08.697352 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-618e780d-d3d1-4071-a5c4-8012c6f29422 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:08.698822 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-618e780d-d3d1-4071-a5c4-8012c6f29422 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:08.699636 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-618e780d-d3d1-4071-a5c4-8012c6f29422 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:09.025351 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=4 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:19:09.103003 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-618e780d-d3d1-4071-a5c4-8012c6f29422 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa996f5ca59e4423ac26d459aab6c7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cef90571c1a4b31bb089a9242569cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:09.114610 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-618e780d-d3d1-4071-a5c4-8012c6f29422 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] 10.222.0.57 "GET /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40" status: 200 len: 1371 microversion: 2.1 time: 0.468705 Jul 18 02:19:09.117068 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1074/2140] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:08 2022] GET /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40 => generated 1371 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:09.127405 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e04209a3-abed-48e9-ad18-cd23f81e5a8d tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:09.128734 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e04209a3-abed-48e9-ad18-cd23f81e5a8d tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] [instance: 963c78a4-9b68-4450-9b77-31214f51d29a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:09.138814 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e04209a3-abed-48e9-ad18-cd23f81e5a8d tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:09.139793 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e04209a3-abed-48e9-ad18-cd23f81e5a8d tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:09.140987 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e04209a3-abed-48e9-ad18-cd23f81e5a8d tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:09.141787 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e04209a3-abed-48e9-ad18-cd23f81e5a8d tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:09.196310 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-85f36c2a-80f0-40b0-af35-d1c284505f45 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lazy-loading 'services' on Instance uuid 174a0067-ee9a-493e-a1d9-099fdf4bbaec {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:19:09.215649 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e04209a3-abed-48e9-ad18-cd23f81e5a8d tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:09.216645 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e04209a3-abed-48e9-ad18-cd23f81e5a8d tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:09.217318 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-e04209a3-abed-48e9-ad18-cd23f81e5a8d tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lazy-loading 'fault' on Instance uuid 963c78a4-9b68-4450-9b77-31214f51d29a {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:19:09.221958 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-85f36c2a-80f0-40b0-af35-d1c284505f45 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 200 len: 2422 microversion: 2.25 time: 0.822520 Jul 18 02:19:09.223339 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1067/2141] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:19:08 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 2422 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:19:09.248790 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3a1553c1-6335-4008-9147-2bf5496020d8 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:09.255493 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:19:09.255493 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:19:09.283334 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3a1553c1-6335-4008-9147-2bf5496020d8 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:09.290007 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3a1553c1-6335-4008-9147-2bf5496020d8 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:09.291946 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3a1553c1-6335-4008-9147-2bf5496020d8 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:09.308793 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3a1553c1-6335-4008-9147-2bf5496020d8 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:09.468724 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3a1553c1-6335-4008-9147-2bf5496020d8 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.243828 Jul 18 02:19:09.480096 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1068/2142] 10.222.0.57 () {58 vars in 1175 bytes} [Mon Jul 18 02:19:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:19:09.504382 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6b8057c2-2e27-481d-af9b-6c7a9126434f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:09.505096 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6b8057c2-2e27-481d-af9b-6c7a9126434f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:09.543119 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b8057c2-2e27-481d-af9b-6c7a9126434f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:09.543858 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b8057c2-2e27-481d-af9b-6c7a9126434f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:09.547905 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b8057c2-2e27-481d-af9b-6c7a9126434f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:09.551886 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b8057c2-2e27-481d-af9b-6c7a9126434f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:09.648863 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e04209a3-abed-48e9-ad18-cd23f81e5a8d tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:09.718552 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e04209a3-abed-48e9-ad18-cd23f81e5a8d tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:09.737947 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e04209a3-abed-48e9-ad18-cd23f81e5a8d tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b9832562054fba865593b7b9d81158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dcd66163c6460a93f34495720f1185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:09.741483 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e04209a3-abed-48e9-ad18-cd23f81e5a8d tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] 10.222.0.57 "GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a" status: 200 len: 1410 microversion: 2.54 time: 0.620770 Jul 18 02:19:09.743665 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1075/2143] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:19:09 2022] GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a => generated 1410 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:19:09.779306 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-333163f8-ca6e-4a52-bc41-0b3697bd1faf req-ab7e51c9-cda6-483c-91cd-112cfa754951 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f30e76e-91e9-441f-b482-28de008a5e40", "tag": "c40bedcf-1c93-48e3-a6b6-5d5d4726ef87"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:09.833269 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-333163f8-ca6e-4a52-bc41-0b3697bd1faf req-ab7e51c9-cda6-483c-91cd-112cfa754951 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:09.843961 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-333163f8-ca6e-4a52-bc41-0b3697bd1faf req-ab7e51c9-cda6-483c-91cd-112cfa754951 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:09.905483 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-333163f8-ca6e-4a52-bc41-0b3697bd1faf req-ab7e51c9-cda6-483c-91cd-112cfa754951 service nova] Creating event network-changed:c40bedcf-1c93-48e3-a6b6-5d5d4726ef87 for instance 0f30e76e-91e9-441f-b482-28de008a5e40 on n-h2-465891-3 Jul 18 02:19:09.954124 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-333163f8-ca6e-4a52-bc41-0b3697bd1faf req-ab7e51c9-cda6-483c-91cd-112cfa754951 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.208309 Jul 18 02:19:09.965394 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1076/2144] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:19:09.980549 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d90c85a1-9177-42ac-8ad3-8640d347a8ff tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-465891-3", "block_migration": false, "disk_over_commit": false}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:09.994458 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d90c85a1-9177-42ac-8ad3-8640d347a8ff tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:10.017351 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d90c85a1-9177-42ac-8ad3-8640d347a8ff tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:10.024389 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d90c85a1-9177-42ac-8ad3-8640d347a8ff tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:10.028786 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d90c85a1-9177-42ac-8ad3-8640d347a8ff tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:10.036832 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6b8057c2-2e27-481d-af9b-6c7a9126434f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:10.048028 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d90c85a1-9177-42ac-8ad3-8640d347a8ff tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:10.068237 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6b8057c2-2e27-481d-af9b-6c7a9126434f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:10.090090 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6b8057c2-2e27-481d-af9b-6c7a9126434f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:10.100060 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6b8057c2-2e27-481d-af9b-6c7a9126434f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1575 microversion: 2.42 time: 0.617798 Jul 18 02:19:10.109299 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1069/2145] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:19:09 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1575 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:19:10.152873 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-abe37463-0f30-448d-ba64-048fa6d35f1c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:10.153444 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-abe37463-0f30-448d-ba64-048fa6d35f1c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:10.204683 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-d90c85a1-9177-42ac-8ad3-8640d347a8ff tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lazy-loading 'flavor' on Instance uuid 36319b4f-008b-4321-ac5d-e201e50673d3 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:19:10.216403 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-abe37463-0f30-448d-ba64-048fa6d35f1c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:10.216862 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-abe37463-0f30-448d-ba64-048fa6d35f1c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:10.239963 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-abe37463-0f30-448d-ba64-048fa6d35f1c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:10.247110 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-abe37463-0f30-448d-ba64-048fa6d35f1c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:10.320059 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d90c85a1-9177-42ac-8ad3-8640d347a8ff tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Going to try to live migrate instance to n-h2-465891-3 {{(pid=119543) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 18 02:19:10.418957 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:19:10.728933 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-abe37463-0f30-448d-ba64-048fa6d35f1c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lazy-loading 'services' on Instance uuid 174a0067-ee9a-493e-a1d9-099fdf4bbaec {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:19:11.071570 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-abe37463-0f30-448d-ba64-048fa6d35f1c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "DELETE /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec/os-volume_attachments/cb18b47d-0852-4f0e-8efd-899476724da4" status: 202 len: 0 microversion: 2.25 time: 0.960604 Jul 18 02:19:11.072189 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1070/2146] 10.222.0.57 () {60 vars in 1456 bytes} [Mon Jul 18 02:19:10 2022] DELETE /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec/os-volume_attachments/cb18b47d-0852-4f0e-8efd-899476724da4 => generated 0 bytes in 962 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:19:11.088688 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-91bd9acf-51a6-4476-9eaf-4dd7c36c7f10 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:11.089414 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-91bd9acf-51a6-4476-9eaf-4dd7c36c7f10 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 05c84048-d3a6-4711-8c32-23ef6424fa9b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:11.143307 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91bd9acf-51a6-4476-9eaf-4dd7c36c7f10 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:11.145506 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91bd9acf-51a6-4476-9eaf-4dd7c36c7f10 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:11.152514 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91bd9acf-51a6-4476-9eaf-4dd7c36c7f10 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:11.154080 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91bd9acf-51a6-4476-9eaf-4dd7c36c7f10 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:12.290882 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-91bd9acf-51a6-4476-9eaf-4dd7c36c7f10 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81eea16bcfa4dc5bd66926c6a2658ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839043bafeef4b8785747ca6c2e96817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:12.317732 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-91bd9acf-51a6-4476-9eaf-4dd7c36c7f10 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] 10.222.0.57 "GET /compute/v2.1/servers/05c84048-d3a6-4711-8c32-23ef6424fa9b" status: 200 len: 1324 microversion: 2.1 time: 1.236362 Jul 18 02:19:12.319157 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1071/2147] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:11 2022] GET /compute/v2.1/servers/05c84048-d3a6-4711-8c32-23ef6424fa9b => generated 1324 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:12.334067 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7a00ab30-6ef2-4dba-a1e0-4a77d196c510 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:12.335604 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7a00ab30-6ef2-4dba-a1e0-4a77d196c510 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] [instance: 0f30e76e-91e9-441f-b482-28de008a5e40] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:12.370974 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7a00ab30-6ef2-4dba-a1e0-4a77d196c510 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:12.371774 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7a00ab30-6ef2-4dba-a1e0-4a77d196c510 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:12.372974 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7a00ab30-6ef2-4dba-a1e0-4a77d196c510 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:12.380006 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7a00ab30-6ef2-4dba-a1e0-4a77d196c510 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:13.347655 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7a00ab30-6ef2-4dba-a1e0-4a77d196c510 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa996f5ca59e4423ac26d459aab6c7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cef90571c1a4b31bb089a9242569cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:13.370021 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7a00ab30-6ef2-4dba-a1e0-4a77d196c510 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] 10.222.0.57 "GET /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40" status: 200 len: 1371 microversion: 2.1 time: 1.047033 Jul 18 02:19:13.371688 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1072/2148] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:12 2022] GET /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40 => generated 1371 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:13.396366 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5ab32d58-0b96-48ef-994f-6933a2e537ec tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:13.400246 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5ab32d58-0b96-48ef-994f-6933a2e537ec tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] [instance: 963c78a4-9b68-4450-9b77-31214f51d29a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:13.435031 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ab32d58-0b96-48ef-994f-6933a2e537ec tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:13.438399 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ab32d58-0b96-48ef-994f-6933a2e537ec tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:13.441300 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ab32d58-0b96-48ef-994f-6933a2e537ec tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:13.444666 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ab32d58-0b96-48ef-994f-6933a2e537ec tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:13.513630 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-5ab32d58-0b96-48ef-994f-6933a2e537ec tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] HTTP exception thrown: Instance 963c78a4-9b68-4450-9b77-31214f51d29a could not be found. Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5ab32d58-0b96-48ef-994f-6933a2e537ec tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Request method failure captured: Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a HTTP/1.1 Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MLljHDRGRmz0vvUZfvGW4FIjgYoihAKrqJZl8a8WbhO2KqBOvWyJivO5icor3DizagxchcU5fYAYix6tOZ-vhit7XTGttF-hbS24eJt-_V9E6iz071605aaspxLG52TEuV4zhzFkeDWJvogqKDAKlzERKnkGkAVH0P5vEXryjaVb7M Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: X-Openstack-Nova-Api-Version: 2.54 Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: e0dcd66163c6460a93f34495720f1185 Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServerShowV254Test-1823659600 Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e0dcd66163c6460a93f34495720f1185"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e0dcd66163c6460a93f34495720f1185"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e0dcd66163c6460a93f34495720f1185"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e0dcd66163c6460a93f34495720f1185"}]}] Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServerShowV254Test-1823659600 Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: e0dcd66163c6460a93f34495720f1185 Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServerShowV254Test-1823659600 Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServerShowV254Test-1823659600-project Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 33b9832562054fba865593b7b9d81158 Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServerShowV254Test-1823659600-project Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 963c78a4-9b68-4450-9b77-31214f51d29a could not be found. Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '963c78a4-9b68-4450-9b77-31214f51d29a'} Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 963c78a4-9b68-4450-9b77-31214f51d29a could not be found. Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 963c78a4-9b68-4450-9b77-31214f51d29a could not be found. Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:19:13.517044 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:19:13.524571 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:19:13.524571 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:19:13.524571 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:19:13.524571 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:19:13.524571 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:19:13.524571 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 963c78a4-9b68-4450-9b77-31214f51d29a could not be found. Jul 18 02:19:13.524571 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:19:13.527474 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5ab32d58-0b96-48ef-994f-6933a2e537ec tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] Returning 404 to user: Instance 963c78a4-9b68-4450-9b77-31214f51d29a could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:19:13.528942 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5ab32d58-0b96-48ef-994f-6933a2e537ec tempest-ServerShowV254Test-1823659600 tempest-ServerShowV254Test-1823659600-project] 10.222.0.57 "GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a" status: 404 len: 111 microversion: 2.54 time: 0.154886 Jul 18 02:19:13.548382 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1073/2149] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:19:13 2022] GET /compute/v2.1/servers/963c78a4-9b68-4450-9b77-31214f51d29a => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:19:13.579767 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-38a32aa4-21c4-4dce-98e3-9fc1c4a96cf5 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:13.582477 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-38a32aa4-21c4-4dce-98e3-9fc1c4a96cf5 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:13.601439 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-38a32aa4-21c4-4dce-98e3-9fc1c4a96cf5 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:13.602966 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-38a32aa4-21c4-4dce-98e3-9fc1c4a96cf5 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:13.604806 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-38a32aa4-21c4-4dce-98e3-9fc1c4a96cf5 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:13.607776 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-38a32aa4-21c4-4dce-98e3-9fc1c4a96cf5 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:13.723439 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-38a32aa4-21c4-4dce-98e3-9fc1c4a96cf5 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.171416 Jul 18 02:19:13.726243 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1074/2150] 10.222.0.57 () {60 vars in 1342 bytes} [Mon Jul 18 02:19:13 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec/os-volume_attachments => generated 197 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:19:13.737191 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-28a2cc8d-aa03-441c-a970-8b4e79eb9c93 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:13.739017 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-28a2cc8d-aa03-441c-a970-8b4e79eb9c93 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:13.754347 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-28a2cc8d-aa03-441c-a970-8b4e79eb9c93 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:13.756262 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-28a2cc8d-aa03-441c-a970-8b4e79eb9c93 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:13.758241 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-28a2cc8d-aa03-441c-a970-8b4e79eb9c93 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:13.760044 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-28a2cc8d-aa03-441c-a970-8b4e79eb9c93 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:13.987325 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=18 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:19:15.683532 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-28a2cc8d-aa03-441c-a970-8b4e79eb9c93 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:15.721963 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-28a2cc8d-aa03-441c-a970-8b4e79eb9c93 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:15.725489 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-28a2cc8d-aa03-441c-a970-8b4e79eb9c93 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:15.738952 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-28a2cc8d-aa03-441c-a970-8b4e79eb9c93 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1659 microversion: 2.42 time: 2.009872 Jul 18 02:19:15.754753 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1075/2151] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:19:13 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1659 bytes in 2027 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:19:15.762102 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8c37e359-7697-48e6-83fe-eded38b51da5 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:15.771291 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8c37e359-7697-48e6-83fe-eded38b51da5 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 05c84048-d3a6-4711-8c32-23ef6424fa9b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:15.792916 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8c37e359-7697-48e6-83fe-eded38b51da5 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:15.794125 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8c37e359-7697-48e6-83fe-eded38b51da5 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:15.797118 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8c37e359-7697-48e6-83fe-eded38b51da5 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:15.797965 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8c37e359-7697-48e6-83fe-eded38b51da5 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:17.281557 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d90c85a1-9177-42ac-8ad3-8640d347a8ff tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3/action" status: 202 len: 0 microversion: 2.1 time: 7.308794 Jul 18 02:19:17.282656 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1077/2152] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:19:09 2022] POST /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3/action => generated 0 bytes in 7316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:19:17.300441 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-b0e1f826-1793-4473-9031-a4522400124c req-aaf33914-1b8f-48d2-a049-52eea9fe3a08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05c84048-d3a6-4711-8c32-23ef6424fa9b", "name": "network-vif-plugged", "status": "completed", "tag": "8ddcd961-a463-442c-9c8d-a4a26d309062"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:17.319983 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:19:17.384858 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-b0e1f826-1793-4473-9031-a4522400124c req-aaf33914-1b8f-48d2-a049-52eea9fe3a08 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:17.385530 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-b0e1f826-1793-4473-9031-a4522400124c req-aaf33914-1b8f-48d2-a049-52eea9fe3a08 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:17.420867 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-b0e1f826-1793-4473-9031-a4522400124c req-aaf33914-1b8f-48d2-a049-52eea9fe3a08 service nova] Creating event network-vif-plugged:8ddcd961-a463-442c-9c8d-a4a26d309062 for instance 05c84048-d3a6-4711-8c32-23ef6424fa9b on n-h1-465891-3 Jul 18 02:19:17.432687 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-b0e1f826-1793-4473-9031-a4522400124c req-aaf33914-1b8f-48d2-a049-52eea9fe3a08 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144482 Jul 18 02:19:17.446830 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1078/2153] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:19:17.455414 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-12291043-f6c8-4f83-ba8a-89e59fd19577 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:17.456895 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-12291043-f6c8-4f83-ba8a-89e59fd19577 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] [instance: 0f30e76e-91e9-441f-b482-28de008a5e40] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:17.469479 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-12291043-f6c8-4f83-ba8a-89e59fd19577 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:17.471086 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-12291043-f6c8-4f83-ba8a-89e59fd19577 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:17.472661 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-12291043-f6c8-4f83-ba8a-89e59fd19577 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:17.474830 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-12291043-f6c8-4f83-ba8a-89e59fd19577 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:17.835489 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8c37e359-7697-48e6-83fe-eded38b51da5 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81eea16bcfa4dc5bd66926c6a2658ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839043bafeef4b8785747ca6c2e96817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:17.865097 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8c37e359-7697-48e6-83fe-eded38b51da5 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] 10.222.0.57 "GET /compute/v2.1/servers/05c84048-d3a6-4711-8c32-23ef6424fa9b" status: 200 len: 1324 microversion: 2.1 time: 2.106688 Jul 18 02:19:17.874729 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1076/2154] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:15 2022] GET /compute/v2.1/servers/05c84048-d3a6-4711-8c32-23ef6424fa9b => generated 1324 bytes in 2118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:17.887555 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7fbefa03-9669-414a-b6b2-0d995098b39c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:17.894298 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7fbefa03-9669-414a-b6b2-0d995098b39c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:17.938791 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7fbefa03-9669-414a-b6b2-0d995098b39c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:17.941820 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7fbefa03-9669-414a-b6b2-0d995098b39c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:17.944808 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7fbefa03-9669-414a-b6b2-0d995098b39c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:17.950812 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7fbefa03-9669-414a-b6b2-0d995098b39c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:18.075269 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7fbefa03-9669-414a-b6b2-0d995098b39c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.198217 Jul 18 02:19:18.078948 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1077/2155] 10.222.0.57 () {60 vars in 1342 bytes} [Mon Jul 18 02:19:17 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec/os-volume_attachments => generated 197 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:19:18.088467 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-dc53c81c-3237-427f-aa6c-11f3a8110948 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:18.091365 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-dc53c81c-3237-427f-aa6c-11f3a8110948 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:18.111126 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dc53c81c-3237-427f-aa6c-11f3a8110948 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:18.111892 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dc53c81c-3237-427f-aa6c-11f3a8110948 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:18.115325 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dc53c81c-3237-427f-aa6c-11f3a8110948 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:18.116387 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dc53c81c-3237-427f-aa6c-11f3a8110948 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:18.163365 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:19:18.434802 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-12291043-f6c8-4f83-ba8a-89e59fd19577 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa996f5ca59e4423ac26d459aab6c7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cef90571c1a4b31bb089a9242569cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:18.445833 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-12291043-f6c8-4f83-ba8a-89e59fd19577 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] 10.222.0.57 "GET /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40" status: 200 len: 1371 microversion: 2.1 time: 0.996590 Jul 18 02:19:18.453484 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1079/2156] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:17 2022] GET /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40 => generated 1371 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:18.473079 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6e234e6e-416f-4c1b-9b66-a270dabd92f6 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:18.477135 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6e234e6e-416f-4c1b-9b66-a270dabd92f6 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:18.499412 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e234e6e-416f-4c1b-9b66-a270dabd92f6 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:18.503276 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e234e6e-416f-4c1b-9b66-a270dabd92f6 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:18.507507 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e234e6e-416f-4c1b-9b66-a270dabd92f6 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:18.512534 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e234e6e-416f-4c1b-9b66-a270dabd92f6 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:19.332333 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:19:20.572514 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6e234e6e-416f-4c1b-9b66-a270dabd92f6 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:20.588016 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6e234e6e-416f-4c1b-9b66-a270dabd92f6 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 200 len: 1392 microversion: 2.1 time: 2.132854 Jul 18 02:19:20.594886 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1080/2157] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:18 2022] GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 1392 bytes in 2140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:20.609251 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6fa1eb6d-e157-46c0-a2e0-5b6392784b11 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:20.612617 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6fa1eb6d-e157-46c0-a2e0-5b6392784b11 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 05c84048-d3a6-4711-8c32-23ef6424fa9b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:20.680265 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6fa1eb6d-e157-46c0-a2e0-5b6392784b11 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:20.695008 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6fa1eb6d-e157-46c0-a2e0-5b6392784b11 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:20.699750 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6fa1eb6d-e157-46c0-a2e0-5b6392784b11 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:20.710776 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6fa1eb6d-e157-46c0-a2e0-5b6392784b11 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:21.043738 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-dc53c81c-3237-427f-aa6c-11f3a8110948 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:21.110142 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-dc53c81c-3237-427f-aa6c-11f3a8110948 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:21.116703 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-dc53c81c-3237-427f-aa6c-11f3a8110948 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:21.134581 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-dc53c81c-3237-427f-aa6c-11f3a8110948 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1659 microversion: 2.42 time: 3.038636 Jul 18 02:19:21.150255 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1078/2158] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:19:18 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1659 bytes in 3070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:19:21.176322 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0047d5d4-3b80-4708-98d7-1acd6fd75037 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:21.180443 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0047d5d4-3b80-4708-98d7-1acd6fd75037 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:21.190963 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:19:21.224370 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0047d5d4-3b80-4708-98d7-1acd6fd75037 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:21.235258 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0047d5d4-3b80-4708-98d7-1acd6fd75037 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:21.243119 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0047d5d4-3b80-4708-98d7-1acd6fd75037 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:21.244479 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0047d5d4-3b80-4708-98d7-1acd6fd75037 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:21.400342 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0047d5d4-3b80-4708-98d7-1acd6fd75037 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.247474 Jul 18 02:19:21.405874 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1079/2159] 10.222.0.57 () {60 vars in 1342 bytes} [Mon Jul 18 02:19:21 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec/os-volume_attachments => generated 197 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:19:21.419989 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cf2729a7-e9a8-4f07-8269-3b1fc2881f01 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:21.422144 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cf2729a7-e9a8-4f07-8269-3b1fc2881f01 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] [instance: 0f30e76e-91e9-441f-b482-28de008a5e40] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:21.438410 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cf2729a7-e9a8-4f07-8269-3b1fc2881f01 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:21.438878 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cf2729a7-e9a8-4f07-8269-3b1fc2881f01 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:21.446798 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cf2729a7-e9a8-4f07-8269-3b1fc2881f01 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:21.448309 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cf2729a7-e9a8-4f07-8269-3b1fc2881f01 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:21.596100 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6fa1eb6d-e157-46c0-a2e0-5b6392784b11 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81eea16bcfa4dc5bd66926c6a2658ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839043bafeef4b8785747ca6c2e96817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:21.660666 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6fa1eb6d-e157-46c0-a2e0-5b6392784b11 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] 10.222.0.57 "GET /compute/v2.1/servers/05c84048-d3a6-4711-8c32-23ef6424fa9b" status: 200 len: 1521 microversion: 2.1 time: 1.063885 Jul 18 02:19:21.664127 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1081/2160] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:20 2022] GET /compute/v2.1/servers/05c84048-d3a6-4711-8c32-23ef6424fa9b => generated 1521 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:21.690153 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7b8e35e0-22c9-4cb4-9484-88b0291bbe50 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:21.696786 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7b8e35e0-22c9-4cb4-9484-88b0291bbe50 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:21.737184 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7b8e35e0-22c9-4cb4-9484-88b0291bbe50 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:21.747226 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7b8e35e0-22c9-4cb4-9484-88b0291bbe50 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:21.749158 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7b8e35e0-22c9-4cb4-9484-88b0291bbe50 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:21.750326 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7b8e35e0-22c9-4cb4-9484-88b0291bbe50 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:22.252784 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7b8e35e0-22c9-4cb4-9484-88b0291bbe50 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:22.258999 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-cf2729a7-e9a8-4f07-8269-3b1fc2881f01 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa996f5ca59e4423ac26d459aab6c7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cef90571c1a4b31bb089a9242569cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:22.275972 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cf2729a7-e9a8-4f07-8269-3b1fc2881f01 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] 10.222.0.57 "GET /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40" status: 200 len: 1371 microversion: 2.1 time: 0.868451 Jul 18 02:19:22.290812 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7b8e35e0-22c9-4cb4-9484-88b0291bbe50 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 200 len: 1392 microversion: 2.1 time: 0.619571 Jul 18 02:19:22.293483 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1080/2161] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:21 2022] GET /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40 => generated 1371 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:22.309212 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-77362088-51e2-4d7d-9a37-b3e31aef6efb tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.58"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:22.312215 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-77362088-51e2-4d7d-9a37-b3e31aef6efb tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 9fa0633a-54a6-4b73-b9b0-4728a4807856] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:22.318576 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1082/2162] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:21 2022] GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 1392 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:22.326690 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-77362088-51e2-4d7d-9a37-b3e31aef6efb tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:22.327810 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-77362088-51e2-4d7d-9a37-b3e31aef6efb tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:22.329619 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-77362088-51e2-4d7d-9a37-b3e31aef6efb tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:22.330204 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d8425a15-62bf-4c92-a8bb-78fae81e82d0 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:22.331084 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-77362088-51e2-4d7d-9a37-b3e31aef6efb tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:22.333327 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d8425a15-62bf-4c92-a8bb-78fae81e82d0 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:22.350337 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d8425a15-62bf-4c92-a8bb-78fae81e82d0 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:22.351370 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d8425a15-62bf-4c92-a8bb-78fae81e82d0 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:22.353073 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d8425a15-62bf-4c92-a8bb-78fae81e82d0 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:22.354396 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d8425a15-62bf-4c92-a8bb-78fae81e82d0 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:22.422055 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-77362088-51e2-4d7d-9a37-b3e31aef6efb tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Acquired lock "refresh_cache-9fa0633a-54a6-4b73-b9b0-4728a4807856" {{(pid=119544) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 02:19:22.785063 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d8425a15-62bf-4c92-a8bb-78fae81e82d0 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:22.800000 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d8425a15-62bf-4c92-a8bb-78fae81e82d0 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:22.802735 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d8425a15-62bf-4c92-a8bb-78fae81e82d0 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:22.804290 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d8425a15-62bf-4c92-a8bb-78fae81e82d0 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1704 microversion: 2.42 time: 0.484072 Jul 18 02:19:22.805440 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1083/2163] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:19:22 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1704 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:19:22.811619 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ff01593e-f466-4a17-b642-60ca895ef19a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:22.813124 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ff01593e-f466-4a17-b642-60ca895ef19a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:22.820793 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ff01593e-f466-4a17-b642-60ca895ef19a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:22.821521 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ff01593e-f466-4a17-b642-60ca895ef19a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:22.822550 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ff01593e-f466-4a17-b642-60ca895ef19a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:22.823166 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ff01593e-f466-4a17-b642-60ca895ef19a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:22.878002 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ff01593e-f466-4a17-b642-60ca895ef19a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.071163 Jul 18 02:19:22.878921 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1084/2164] 10.222.0.57 () {60 vars in 1342 bytes} [Mon Jul 18 02:19:22 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:19:23.311238 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-685ec3fe-2b78-4f2e-bdfa-ed30aea54d46 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:23.312433 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-685ec3fe-2b78-4f2e-bdfa-ed30aea54d46 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] [instance: 0f30e76e-91e9-441f-b482-28de008a5e40] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:23.350943 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-685ec3fe-2b78-4f2e-bdfa-ed30aea54d46 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:23.353368 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-685ec3fe-2b78-4f2e-bdfa-ed30aea54d46 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:23.359314 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-685ec3fe-2b78-4f2e-bdfa-ed30aea54d46 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:23.361099 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-685ec3fe-2b78-4f2e-bdfa-ed30aea54d46 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:24.537221 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-685ec3fe-2b78-4f2e-bdfa-ed30aea54d46 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa996f5ca59e4423ac26d459aab6c7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cef90571c1a4b31bb089a9242569cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:24.549370 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-685ec3fe-2b78-4f2e-bdfa-ed30aea54d46 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] 10.222.0.57 "GET /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40" status: 200 len: 1371 microversion: 2.1 time: 1.246062 Jul 18 02:19:24.551163 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1085/2165] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:23 2022] GET /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40 => generated 1371 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:24.557689 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ef98e3db-a4a6-4c66-b139-b86af4ae7a30 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:24.561391 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ef98e3db-a4a6-4c66-b139-b86af4ae7a30 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:24.576909 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ef98e3db-a4a6-4c66-b139-b86af4ae7a30 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:24.577965 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ef98e3db-a4a6-4c66-b139-b86af4ae7a30 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:24.580801 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ef98e3db-a4a6-4c66-b139-b86af4ae7a30 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:24.582429 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ef98e3db-a4a6-4c66-b139-b86af4ae7a30 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:25.353558 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ef98e3db-a4a6-4c66-b139-b86af4ae7a30 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:25.369890 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ef98e3db-a4a6-4c66-b139-b86af4ae7a30 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 200 len: 1392 microversion: 2.1 time: 0.815490 Jul 18 02:19:25.384481 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1086/2166] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:24 2022] GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 1392 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:25.396284 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2a76be75-aa95-4a48-b463-8964ba1869cf tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:25.396617 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2a76be75-aa95-4a48-b463-8964ba1869cf tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:25.409102 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2a76be75-aa95-4a48-b463-8964ba1869cf tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:25.411565 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2a76be75-aa95-4a48-b463-8964ba1869cf tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:25.415939 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2a76be75-aa95-4a48-b463-8964ba1869cf tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:25.418590 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2a76be75-aa95-4a48-b463-8964ba1869cf tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:25.965324 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2a76be75-aa95-4a48-b463-8964ba1869cf tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:25.987564 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2a76be75-aa95-4a48-b463-8964ba1869cf tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:25.989333 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2a76be75-aa95-4a48-b463-8964ba1869cf tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:26.002471 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2a76be75-aa95-4a48-b463-8964ba1869cf tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1704 microversion: 2.42 time: 0.616508 Jul 18 02:19:26.012834 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1087/2167] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:19:25 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1704 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:19:26.026563 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-352e03cf-96fe-47aa-8cbd-9f0056fb2aaf tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:26.033789 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-352e03cf-96fe-47aa-8cbd-9f0056fb2aaf tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:26.055721 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-352e03cf-96fe-47aa-8cbd-9f0056fb2aaf tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:26.065396 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-352e03cf-96fe-47aa-8cbd-9f0056fb2aaf tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:26.070651 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-352e03cf-96fe-47aa-8cbd-9f0056fb2aaf tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:26.071256 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-352e03cf-96fe-47aa-8cbd-9f0056fb2aaf tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:26.168228 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-352e03cf-96fe-47aa-8cbd-9f0056fb2aaf tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.163888 Jul 18 02:19:26.170340 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1088/2168] 10.222.0.57 () {60 vars in 1342 bytes} [Mon Jul 18 02:19:26 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec/os-volume_attachments => generated 25 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:26.202948 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e05f0786-da73-4f3a-b9c3-28596c5eb184 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:26.203902 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e05f0786-da73-4f3a-b9c3-28596c5eb184 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] [instance: 0f30e76e-91e9-441f-b482-28de008a5e40] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:26.213787 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e05f0786-da73-4f3a-b9c3-28596c5eb184 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:26.214729 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e05f0786-da73-4f3a-b9c3-28596c5eb184 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:26.215940 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e05f0786-da73-4f3a-b9c3-28596c5eb184 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:26.216648 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e05f0786-da73-4f3a-b9c3-28596c5eb184 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:26.262383 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:19:27.992322 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e05f0786-da73-4f3a-b9c3-28596c5eb184 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa996f5ca59e4423ac26d459aab6c7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cef90571c1a4b31bb089a9242569cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:28.011521 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e05f0786-da73-4f3a-b9c3-28596c5eb184 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] 10.222.0.57 "GET /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40" status: 200 len: 1371 microversion: 2.1 time: 1.820940 Jul 18 02:19:28.012135 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1089/2169] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:26 2022] GET /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40 => generated 1371 bytes in 1841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:28.017253 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f02a3f94-0aeb-4de4-8dbc-807008e1b79a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:28.026161 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f02a3f94-0aeb-4de4-8dbc-807008e1b79a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:28.042833 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f02a3f94-0aeb-4de4-8dbc-807008e1b79a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:28.043441 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f02a3f94-0aeb-4de4-8dbc-807008e1b79a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:28.044310 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f02a3f94-0aeb-4de4-8dbc-807008e1b79a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:28.044763 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f02a3f94-0aeb-4de4-8dbc-807008e1b79a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:28.546251 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f02a3f94-0aeb-4de4-8dbc-807008e1b79a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:28.567368 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-77362088-51e2-4d7d-9a37-b3e31aef6efb tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 9fa0633a-54a6-4b73-b9b0-4728a4807856] Building network info cache for instance {{(pid=119544) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 18 02:19:28.570711 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f02a3f94-0aeb-4de4-8dbc-807008e1b79a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 200 len: 1392 microversion: 2.1 time: 0.554355 Jul 18 02:19:28.574840 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1090/2170] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:28 2022] GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 1392 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:28.586915 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d5836a56-4ab6-45f7-beb5-c21ce0135dd8 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:28.591509 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d5836a56-4ab6-45f7-beb5-c21ce0135dd8 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:28.608813 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5836a56-4ab6-45f7-beb5-c21ce0135dd8 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:28.611130 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5836a56-4ab6-45f7-beb5-c21ce0135dd8 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:28.612011 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5836a56-4ab6-45f7-beb5-c21ce0135dd8 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:28.616949 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5836a56-4ab6-45f7-beb5-c21ce0135dd8 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:29.051327 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d5836a56-4ab6-45f7-beb5-c21ce0135dd8 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:29.073374 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d5836a56-4ab6-45f7-beb5-c21ce0135dd8 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:29.075430 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d5836a56-4ab6-45f7-beb5-c21ce0135dd8 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:29.080734 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d5836a56-4ab6-45f7-beb5-c21ce0135dd8 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1749 microversion: 2.42 time: 0.502121 Jul 18 02:19:29.086138 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1091/2171] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:19:28 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1749 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:19:29.102710 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-00ec60f5-d5ea-40c9-8d63-a65c4874b7cb req-481105f5-d440-474c-98c5-87d6bee21a75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f30e76e-91e9-441f-b482-28de008a5e40", "name": "network-vif-plugged", "status": "completed", "tag": "c40bedcf-1c93-48e3-a6b6-5d5d4726ef87"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:29.124198 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-00ec60f5-d5ea-40c9-8d63-a65c4874b7cb req-481105f5-d440-474c-98c5-87d6bee21a75 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:29.125110 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-00ec60f5-d5ea-40c9-8d63-a65c4874b7cb req-481105f5-d440-474c-98c5-87d6bee21a75 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:29.165366 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-00ec60f5-d5ea-40c9-8d63-a65c4874b7cb req-481105f5-d440-474c-98c5-87d6bee21a75 service nova] Creating event network-vif-plugged:c40bedcf-1c93-48e3-a6b6-5d5d4726ef87 for instance 0f30e76e-91e9-441f-b482-28de008a5e40 on n-h2-465891-3 Jul 18 02:19:29.177945 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-00ec60f5-d5ea-40c9-8d63-a65c4874b7cb req-481105f5-d440-474c-98c5-87d6bee21a75 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089312 Jul 18 02:19:29.182623 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1092/2172] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:19:29.229019 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-4a16d963-441f-43aa-8a24-0854b68cf0bd req-666e48f6-3492-4951-bed8-66c528c5865f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fa0633a-54a6-4b73-b9b0-4728a4807856", "tag": "ee9f4c78-62bc-4a6d-9904-38efa10900ec"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:29.275125 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-4a16d963-441f-43aa-8a24-0854b68cf0bd req-666e48f6-3492-4951-bed8-66c528c5865f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:29.276593 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-4a16d963-441f-43aa-8a24-0854b68cf0bd req-666e48f6-3492-4951-bed8-66c528c5865f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:29.295572 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-4a16d963-441f-43aa-8a24-0854b68cf0bd req-666e48f6-3492-4951-bed8-66c528c5865f service nova] Creating event network-changed:ee9f4c78-62bc-4a6d-9904-38efa10900ec for instance 9fa0633a-54a6-4b73-b9b0-4728a4807856 on n-h2-465891-3 Jul 18 02:19:29.306190 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-4a16d963-441f-43aa-8a24-0854b68cf0bd req-666e48f6-3492-4951-bed8-66c528c5865f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121235 Jul 18 02:19:29.307827 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1093/2173] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:19:29.328047 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-84c33ad5-0f05-4b4c-a25a-ce16c896357a tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:29.334384 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-84c33ad5-0f05-4b4c-a25a-ce16c896357a tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] [instance: 0f30e76e-91e9-441f-b482-28de008a5e40] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:29.345244 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-84c33ad5-0f05-4b4c-a25a-ce16c896357a tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:29.346030 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-84c33ad5-0f05-4b4c-a25a-ce16c896357a tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:29.347372 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-84c33ad5-0f05-4b4c-a25a-ce16c896357a tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:29.348283 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-84c33ad5-0f05-4b4c-a25a-ce16c896357a tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:30.071338 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-84c33ad5-0f05-4b4c-a25a-ce16c896357a tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa996f5ca59e4423ac26d459aab6c7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cef90571c1a4b31bb089a9242569cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:30.092383 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-84c33ad5-0f05-4b4c-a25a-ce16c896357a tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] 10.222.0.57 "GET /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40" status: 200 len: 1371 microversion: 2.1 time: 0.780322 Jul 18 02:19:30.104722 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1094/2174] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:29 2022] GET /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40 => generated 1371 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:30.104722 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-28c70a2b-6a50-41c4-a610-bef7e781854d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:30.104722 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-28c70a2b-6a50-41c4-a610-bef7e781854d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:30.128915 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-28c70a2b-6a50-41c4-a610-bef7e781854d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:30.132571 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-28c70a2b-6a50-41c4-a610-bef7e781854d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:30.137945 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-28c70a2b-6a50-41c4-a610-bef7e781854d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:30.138650 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-28c70a2b-6a50-41c4-a610-bef7e781854d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:31.256007 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-28c70a2b-6a50-41c4-a610-bef7e781854d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:31.284366 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-28c70a2b-6a50-41c4-a610-bef7e781854d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 200 len: 1392 microversion: 2.1 time: 1.186107 Jul 18 02:19:31.287529 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1095/2175] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:30 2022] GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 1392 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:31.317230 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6d35f061-2c62-4ced-b8f9-38b44a6f247b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:31.320588 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6d35f061-2c62-4ced-b8f9-38b44a6f247b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:31.355713 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6d35f061-2c62-4ced-b8f9-38b44a6f247b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:31.361994 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6d35f061-2c62-4ced-b8f9-38b44a6f247b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:31.366845 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6d35f061-2c62-4ced-b8f9-38b44a6f247b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:31.370808 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6d35f061-2c62-4ced-b8f9-38b44a6f247b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:31.590205 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-77362088-51e2-4d7d-9a37-b3e31aef6efb tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 9fa0633a-54a6-4b73-b9b0-4728a4807856] Updating instance_info_cache with network_info: [{"id": "ee9f4c78-62bc-4a6d-9904-38efa10900ec", "address": "fa:16:3e:20:6a:f2", "network": {"id": "158397fb-03e8-488a-929e-26b83d7a32dd", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1710267504-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "839043bafeef4b8785747ca6c2e96817", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapee9f4c78-62", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119544) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 18 02:19:31.617786 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-77362088-51e2-4d7d-9a37-b3e31aef6efb tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Releasing lock "refresh_cache-9fa0633a-54a6-4b73-b9b0-4728a4807856" {{(pid=119544) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 02:19:31.619557 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-77362088-51e2-4d7d-9a37-b3e31aef6efb tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] 10.222.0.57 "POST /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856/action" status: 202 len: 0 microversion: 2.1 time: 9.324061 Jul 18 02:19:31.620380 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1081/2176] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:19:22 2022] POST /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856/action => generated 0 bytes in 9326 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 18 02:19:31.626631 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f2dccd7c-58aa-4986-b636-0e68ac55d30b tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:31.643342 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f2dccd7c-58aa-4986-b636-0e68ac55d30b tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] [instance: 0f30e76e-91e9-441f-b482-28de008a5e40] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:31.661349 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f2dccd7c-58aa-4986-b636-0e68ac55d30b tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:31.663275 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f2dccd7c-58aa-4986-b636-0e68ac55d30b tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:31.673367 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f2dccd7c-58aa-4986-b636-0e68ac55d30b tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:31.675023 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f2dccd7c-58aa-4986-b636-0e68ac55d30b tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:32.342116 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f2dccd7c-58aa-4986-b636-0e68ac55d30b tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa996f5ca59e4423ac26d459aab6c7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cef90571c1a4b31bb089a9242569cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:32.361836 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6d35f061-2c62-4ced-b8f9-38b44a6f247b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:32.362696 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f2dccd7c-58aa-4986-b636-0e68ac55d30b tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] 10.222.0.57 "GET /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40" status: 200 len: 1557 microversion: 2.1 time: 0.739481 Jul 18 02:19:32.375947 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1082/2177] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:31 2022] GET /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40 => generated 1557 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:32.389628 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6d35f061-2c62-4ced-b8f9-38b44a6f247b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:32.390375 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e2d60676-68e9-4aaa-bd91-675d06578bbf tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.58"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:32.391795 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6d35f061-2c62-4ced-b8f9-38b44a6f247b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:32.393308 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6d35f061-2c62-4ced-b8f9-38b44a6f247b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1794 microversion: 2.42 time: 1.101922 Jul 18 02:19:32.400969 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e2d60676-68e9-4aaa-bd91-675d06578bbf tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 05c84048-d3a6-4711-8c32-23ef6424fa9b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:32.406166 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1096/2178] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:19:31 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1794 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:19:32.413275 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-98f1db47-be6e-415d-920b-fb8fcadac591 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:32.414296 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-98f1db47-be6e-415d-920b-fb8fcadac591 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:32.423460 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e2d60676-68e9-4aaa-bd91-675d06578bbf tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:32.424440 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e2d60676-68e9-4aaa-bd91-675d06578bbf tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:32.426906 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e2d60676-68e9-4aaa-bd91-675d06578bbf tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:32.427641 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e2d60676-68e9-4aaa-bd91-675d06578bbf tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:32.439505 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-98f1db47-be6e-415d-920b-fb8fcadac591 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:32.440283 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-98f1db47-be6e-415d-920b-fb8fcadac591 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:32.450183 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-98f1db47-be6e-415d-920b-fb8fcadac591 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:32.452542 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-98f1db47-be6e-415d-920b-fb8fcadac591 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:32.461660 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e2d60676-68e9-4aaa-bd91-675d06578bbf tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Acquired lock "refresh_cache-05c84048-d3a6-4711-8c32-23ef6424fa9b" {{(pid=119544) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 02:19:34.058896 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-98f1db47-be6e-415d-920b-fb8fcadac591 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:34.075620 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-98f1db47-be6e-415d-920b-fb8fcadac591 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 200 len: 1392 microversion: 2.1 time: 1.667991 Jul 18 02:19:34.076305 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1097/2179] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:32 2022] GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 1392 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:34.082279 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-358e05de-5f20-486e-810c-4cd2999ce8ae tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:34.087307 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-358e05de-5f20-486e-810c-4cd2999ce8ae tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] [instance: 0f30e76e-91e9-441f-b482-28de008a5e40] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:34.107129 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-358e05de-5f20-486e-810c-4cd2999ce8ae tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:34.107958 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-358e05de-5f20-486e-810c-4cd2999ce8ae tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:34.109125 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-358e05de-5f20-486e-810c-4cd2999ce8ae tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:34.109884 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-358e05de-5f20-486e-810c-4cd2999ce8ae tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:34.314029 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-358e05de-5f20-486e-810c-4cd2999ce8ae tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] 10.222.0.57 "GET /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.236357 Jul 18 02:19:34.315095 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1098/2180] 10.222.0.57 () {58 vars in 1274 bytes} [Mon Jul 18 02:19:34 2022] GET /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40/os-interface => generated 284 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:19:34.321720 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b7f28163-fb68-414a-a7ec-8988ab9765cb tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:34.322728 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b7f28163-fb68-414a-a7ec-8988ab9765cb tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:34.335689 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b7f28163-fb68-414a-a7ec-8988ab9765cb tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:34.345094 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b7f28163-fb68-414a-a7ec-8988ab9765cb tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:34.346312 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b7f28163-fb68-414a-a7ec-8988ab9765cb tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:34.347018 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b7f28163-fb68-414a-a7ec-8988ab9765cb tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:35.530145 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b7f28163-fb68-414a-a7ec-8988ab9765cb tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:35.606385 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b7f28163-fb68-414a-a7ec-8988ab9765cb tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:35.614610 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b7f28163-fb68-414a-a7ec-8988ab9765cb tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:35.618319 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b7f28163-fb68-414a-a7ec-8988ab9765cb tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1794 microversion: 2.42 time: 1.300178 Jul 18 02:19:35.626123 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1099/2181] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:19:34 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1794 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:19:35.671581 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-abdf80d8-cfe4-4881-a921-8e18c1cfaecc tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:35.672975 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-abdf80d8-cfe4-4881-a921-8e18c1cfaecc tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:35.695816 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-abdf80d8-cfe4-4881-a921-8e18c1cfaecc tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:35.697919 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-abdf80d8-cfe4-4881-a921-8e18c1cfaecc tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:35.700274 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-abdf80d8-cfe4-4881-a921-8e18c1cfaecc tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:35.703829 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-abdf80d8-cfe4-4881-a921-8e18c1cfaecc tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:36.282696 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-abdf80d8-cfe4-4881-a921-8e18c1cfaecc tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:36.302512 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-abdf80d8-cfe4-4881-a921-8e18c1cfaecc tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 200 len: 1392 microversion: 2.1 time: 0.655628 Jul 18 02:19:36.304277 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1100/2182] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:35 2022] GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 1392 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:36.665931 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0415bcab-c001-4bdd-9d27-bd3ca8966f5f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:36.667357 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0415bcab-c001-4bdd-9d27-bd3ca8966f5f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:36.675303 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0415bcab-c001-4bdd-9d27-bd3ca8966f5f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:36.676490 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0415bcab-c001-4bdd-9d27-bd3ca8966f5f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:36.677691 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0415bcab-c001-4bdd-9d27-bd3ca8966f5f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:36.678465 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0415bcab-c001-4bdd-9d27-bd3ca8966f5f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:37.870559 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0415bcab-c001-4bdd-9d27-bd3ca8966f5f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:37.881380 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0415bcab-c001-4bdd-9d27-bd3ca8966f5f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:37.896540 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0415bcab-c001-4bdd-9d27-bd3ca8966f5f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:37.898197 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0415bcab-c001-4bdd-9d27-bd3ca8966f5f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1839 microversion: 2.42 time: 1.236789 Jul 18 02:19:37.899363 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1101/2183] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:19:36 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1839 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:19:37.908475 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ccf9f4c6-0661-471e-9d6b-7374584ea99d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:37.909441 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ccf9f4c6-0661-471e-9d6b-7374584ea99d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:37.927111 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ccf9f4c6-0661-471e-9d6b-7374584ea99d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:37.927590 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ccf9f4c6-0661-471e-9d6b-7374584ea99d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:37.928432 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ccf9f4c6-0661-471e-9d6b-7374584ea99d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:37.929107 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ccf9f4c6-0661-471e-9d6b-7374584ea99d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:38.527205 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ccf9f4c6-0661-471e-9d6b-7374584ea99d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:38.547362 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ccf9f4c6-0661-471e-9d6b-7374584ea99d tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 200 len: 1392 microversion: 2.1 time: 0.641402 Jul 18 02:19:38.552198 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1102/2184] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:37 2022] GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 1392 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:38.962682 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-eff8d988-52cd-4007-8bb8-dc62559a9e26 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:38.964124 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-eff8d988-52cd-4007-8bb8-dc62559a9e26 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:39.038042 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eff8d988-52cd-4007-8bb8-dc62559a9e26 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:39.042540 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eff8d988-52cd-4007-8bb8-dc62559a9e26 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:39.047678 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eff8d988-52cd-4007-8bb8-dc62559a9e26 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:39.050102 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eff8d988-52cd-4007-8bb8-dc62559a9e26 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:39.764917 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.network.neutron [None req-e2d60676-68e9-4aaa-bd91-675d06578bbf tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 05c84048-d3a6-4711-8c32-23ef6424fa9b] re-assign floating IP 172.25.3.58 from instance 9fa0633a-54a6-4b73-b9b0-4728a4807856 Jul 18 02:19:39.957282 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-e2d60676-68e9-4aaa-bd91-675d06578bbf tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 9fa0633a-54a6-4b73-b9b0-4728a4807856] Building network info cache for instance {{(pid=119544) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 18 02:19:40.431250 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-eff8d988-52cd-4007-8bb8-dc62559a9e26 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:40.503698 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-eff8d988-52cd-4007-8bb8-dc62559a9e26 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:40.518071 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-eff8d988-52cd-4007-8bb8-dc62559a9e26 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:40.541649 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-eff8d988-52cd-4007-8bb8-dc62559a9e26 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1839 microversion: 2.42 time: 1.620410 Jul 18 02:19:40.551878 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1103/2185] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:19:38 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1839 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:19:40.586838 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-2bbf4704-095c-48c5-bde1-fdfb355aed30 req-69c110b6-136d-4e6c-a497-dbcbfabd11ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fa0633a-54a6-4b73-b9b0-4728a4807856", "tag": "ee9f4c78-62bc-4a6d-9904-38efa10900ec"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:40.644942 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-2bbf4704-095c-48c5-bde1-fdfb355aed30 req-69c110b6-136d-4e6c-a497-dbcbfabd11ae service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:40.649057 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-2bbf4704-095c-48c5-bde1-fdfb355aed30 req-69c110b6-136d-4e6c-a497-dbcbfabd11ae service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:40.713880 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-2bbf4704-095c-48c5-bde1-fdfb355aed30 req-69c110b6-136d-4e6c-a497-dbcbfabd11ae service nova] Creating event network-changed:ee9f4c78-62bc-4a6d-9904-38efa10900ec for instance 9fa0633a-54a6-4b73-b9b0-4728a4807856 on n-h2-465891-3 Jul 18 02:19:40.750008 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-2bbf4704-095c-48c5-bde1-fdfb355aed30 req-69c110b6-136d-4e6c-a497-dbcbfabd11ae service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192484 Jul 18 02:19:40.759592 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1104/2186] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:19:40.831023 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-47647b45-920e-4d1a-a7ba-39fb2bb958da tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:40.838084 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-47647b45-920e-4d1a-a7ba-39fb2bb958da tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:40.887589 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-47647b45-920e-4d1a-a7ba-39fb2bb958da tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:40.888511 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-47647b45-920e-4d1a-a7ba-39fb2bb958da tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:40.895488 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-47647b45-920e-4d1a-a7ba-39fb2bb958da tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:40.896477 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-47647b45-920e-4d1a-a7ba-39fb2bb958da tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:42.410812 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=9 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:19:43.046918 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-47647b45-920e-4d1a-a7ba-39fb2bb958da tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:43.067962 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-47647b45-920e-4d1a-a7ba-39fb2bb958da tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 200 len: 1392 microversion: 2.1 time: 2.303360 Jul 18 02:19:43.072462 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1105/2187] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:40 2022] GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 1392 bytes in 2312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:43.081993 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-630adb44-073d-4d11-a356-3dd7a4b2d20a tempest-VolumesTestJSON-1408624197 tempest-VolumesTestJSON-1408624197-project] Calling method '.version_select at 0x7ff4a8871c10>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:45.033361 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-e2d60676-68e9-4aaa-bd91-675d06578bbf tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 9fa0633a-54a6-4b73-b9b0-4728a4807856] Updating instance_info_cache with network_info: [{"id": "ee9f4c78-62bc-4a6d-9904-38efa10900ec", "address": "fa:16:3e:20:6a:f2", "network": {"id": "158397fb-03e8-488a-929e-26b83d7a32dd", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1710267504-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "839043bafeef4b8785747ca6c2e96817", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapee9f4c78-62", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119544) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 18 02:19:45.069132 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-e2d60676-68e9-4aaa-bd91-675d06578bbf tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 05c84048-d3a6-4711-8c32-23ef6424fa9b] Building network info cache for instance {{(pid=119544) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 18 02:19:45.333585 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-630adb44-073d-4d11-a356-3dd7a4b2d20a tempest-VolumesTestJSON-1408624197 tempest-VolumesTestJSON-1408624197-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/ebd4ce12-9c56-45f1-9b55-0c1121a7bdab" status: 200 len: 350 microversion: 2.1 time: 2.256190 Jul 18 02:19:45.335296 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1106/2188] 10.222.0.57 () {58 vars in 1244 bytes} [Mon Jul 18 02:19:43 2022] GET /compute/v2.1/os-volumes/ebd4ce12-9c56-45f1-9b55-0c1121a7bdab => generated 350 bytes in 2262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:19:45.342091 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d5e1fcc8-2c32-4a81-804d-450c980bc346 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:45.344515 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d5e1fcc8-2c32-4a81-804d-450c980bc346 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:45.366568 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5e1fcc8-2c32-4a81-804d-450c980bc346 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:45.367285 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5e1fcc8-2c32-4a81-804d-450c980bc346 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:45.371259 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5e1fcc8-2c32-4a81-804d-450c980bc346 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:45.372150 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5e1fcc8-2c32-4a81-804d-450c980bc346 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:46.307284 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d5e1fcc8-2c32-4a81-804d-450c980bc346 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:46.343911 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d5e1fcc8-2c32-4a81-804d-450c980bc346 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:46.352969 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d5e1fcc8-2c32-4a81-804d-450c980bc346 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:46.358192 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d5e1fcc8-2c32-4a81-804d-450c980bc346 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1860 microversion: 2.42 time: 1.017329 Jul 18 02:19:46.358902 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1107/2189] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:19:45 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1860 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:19:46.364183 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-1dc91f1e-9b5c-4728-a65b-380bcf1cc489 req-81e82905-42e4-463a-9c7a-337a38f483c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05c84048-d3a6-4711-8c32-23ef6424fa9b", "tag": "8ddcd961-a463-442c-9c8d-a4a26d309062"}, {"name": "network-changed", "server_uuid": "b909490f-2890-43c0-b956-9de562d52d67", "tag": "e55a6513-6292-448a-b056-14ca8f284b1b"}, {"name": "network-changed", "server_uuid": "0f30e76e-91e9-441f-b482-28de008a5e40", "tag": "c40bedcf-1c93-48e3-a6b6-5d5d4726ef87"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:46.398703 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-1dc91f1e-9b5c-4728-a65b-380bcf1cc489 req-81e82905-42e4-463a-9c7a-337a38f483c9 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:46.399218 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-1dc91f1e-9b5c-4728-a65b-380bcf1cc489 req-81e82905-42e4-463a-9c7a-337a38f483c9 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:46.428748 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-1dc91f1e-9b5c-4728-a65b-380bcf1cc489 req-81e82905-42e4-463a-9c7a-337a38f483c9 service nova] Creating event network-changed:8ddcd961-a463-442c-9c8d-a4a26d309062 for instance 05c84048-d3a6-4711-8c32-23ef6424fa9b on n-h1-465891-3 Jul 18 02:19:46.429083 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-1dc91f1e-9b5c-4728-a65b-380bcf1cc489 req-81e82905-42e4-463a-9c7a-337a38f483c9 service nova] Creating event network-changed:e55a6513-6292-448a-b056-14ca8f284b1b for instance b909490f-2890-43c0-b956-9de562d52d67 on n-h2-465891-3 Jul 18 02:19:46.434911 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-1dc91f1e-9b5c-4728-a65b-380bcf1cc489 req-81e82905-42e4-463a-9c7a-337a38f483c9 service nova] Creating event network-changed:c40bedcf-1c93-48e3-a6b6-5d5d4726ef87 for instance 0f30e76e-91e9-441f-b482-28de008a5e40 on n-h2-465891-3 Jul 18 02:19:46.462555 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-1dc91f1e-9b5c-4728-a65b-380bcf1cc489 req-81e82905-42e4-463a-9c7a-337a38f483c9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.102334 Jul 18 02:19:46.463926 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1108/2190] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:19:46.469567 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e49cb0f6-c998-49b0-a7d6-8b68cc0c444f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:46.470339 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e49cb0f6-c998-49b0-a7d6-8b68cc0c444f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:46.499504 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e49cb0f6-c998-49b0-a7d6-8b68cc0c444f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:46.502596 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e49cb0f6-c998-49b0-a7d6-8b68cc0c444f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:46.506468 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e49cb0f6-c998-49b0-a7d6-8b68cc0c444f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:46.516086 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e49cb0f6-c998-49b0-a7d6-8b68cc0c444f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:47.374441 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e49cb0f6-c998-49b0-a7d6-8b68cc0c444f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:47.382651 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:19:47.397941 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e49cb0f6-c998-49b0-a7d6-8b68cc0c444f tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 200 len: 1392 microversion: 2.1 time: 0.932688 Jul 18 02:19:47.398934 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1109/2191] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:46 2022] GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 1392 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:47.416637 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6935f008-b693-4a66-9bc8-236f42485fd9 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:47.417580 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6935f008-b693-4a66-9bc8-236f42485fd9 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:47.446666 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=62 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:19:47.448486 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6935f008-b693-4a66-9bc8-236f42485fd9 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:47.449032 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6935f008-b693-4a66-9bc8-236f42485fd9 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:47.449965 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6935f008-b693-4a66-9bc8-236f42485fd9 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:47.450449 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6935f008-b693-4a66-9bc8-236f42485fd9 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:48.391782 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6935f008-b693-4a66-9bc8-236f42485fd9 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:48.408715 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6935f008-b693-4a66-9bc8-236f42485fd9 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:48.411084 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6935f008-b693-4a66-9bc8-236f42485fd9 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:48.412573 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6935f008-b693-4a66-9bc8-236f42485fd9 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1860 microversion: 2.42 time: 1.005525 Jul 18 02:19:48.425930 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1110/2192] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:19:47 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1860 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:19:48.457301 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9d928648-2287-4b4c-96fe-2bc3e37c28fc tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:48.464063 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9d928648-2287-4b4c-96fe-2bc3e37c28fc tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:48.483217 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9d928648-2287-4b4c-96fe-2bc3e37c28fc tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:48.483982 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9d928648-2287-4b4c-96fe-2bc3e37c28fc tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:48.485094 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9d928648-2287-4b4c-96fe-2bc3e37c28fc tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:48.486121 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9d928648-2287-4b4c-96fe-2bc3e37c28fc tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:48.506423 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-e2d60676-68e9-4aaa-bd91-675d06578bbf tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 05c84048-d3a6-4711-8c32-23ef6424fa9b] Updating instance_info_cache with network_info: [{"id": "8ddcd961-a463-442c-9c8d-a4a26d309062", "address": "fa:16:3e:a6:5b:e5", "network": {"id": "158397fb-03e8-488a-929e-26b83d7a32dd", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1710267504-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "839043bafeef4b8785747ca6c2e96817", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8ddcd961-a4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119544) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 18 02:19:48.510778 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=44,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=1,nova_cell1:RELEASE=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:19:48.555987 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e2d60676-68e9-4aaa-bd91-675d06578bbf tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Releasing lock "refresh_cache-05c84048-d3a6-4711-8c32-23ef6424fa9b" {{(pid=119544) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 02:19:48.566674 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e2d60676-68e9-4aaa-bd91-675d06578bbf tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] 10.222.0.57 "POST /compute/v2.1/servers/05c84048-d3a6-4711-8c32-23ef6424fa9b/action" status: 202 len: 0 microversion: 2.1 time: 16.185729 Jul 18 02:19:48.579165 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1083/2193] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:19:32 2022] POST /compute/v2.1/servers/05c84048-d3a6-4711-8c32-23ef6424fa9b/action => generated 0 bytes in 16198 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 18 02:19:48.604268 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-05c26a33-6909-4fd2-98ec-3a06b240fc09 req-370c8aca-d2ad-405b-976e-94620f038612 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b909490f-2890-43c0-b956-9de562d52d67", "tag": "11cacb3f-8e0c-4904-8fb7-ad9beec7e463"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:48.639621 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-05c26a33-6909-4fd2-98ec-3a06b240fc09 req-370c8aca-d2ad-405b-976e-94620f038612 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:48.639933 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-05c26a33-6909-4fd2-98ec-3a06b240fc09 req-370c8aca-d2ad-405b-976e-94620f038612 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:48.683848 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-05c26a33-6909-4fd2-98ec-3a06b240fc09 req-370c8aca-d2ad-405b-976e-94620f038612 service nova] Creating event network-changed:11cacb3f-8e0c-4904-8fb7-ad9beec7e463 for instance b909490f-2890-43c0-b956-9de562d52d67 on n-h2-465891-3 Jul 18 02:19:48.704255 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-05c26a33-6909-4fd2-98ec-3a06b240fc09 req-370c8aca-d2ad-405b-976e-94620f038612 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123265 Jul 18 02:19:48.713803 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1084/2194] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:19:48.727505 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4e2aca02-7d45-4498-b4f1-c7c441a16350 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.58"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:49.909443 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9d928648-2287-4b4c-96fe-2bc3e37c28fc tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:49.932272 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9d928648-2287-4b4c-96fe-2bc3e37c28fc tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 200 len: 1392 microversion: 2.1 time: 1.504083 Jul 18 02:19:49.945861 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1111/2195] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:48 2022] GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 1392 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:49.960923 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a52b3d6b-5da7-4f93-bcde-4eeefee4c24b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:49.963489 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a52b3d6b-5da7-4f93-bcde-4eeefee4c24b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:49.980959 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a52b3d6b-5da7-4f93-bcde-4eeefee4c24b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:49.984225 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a52b3d6b-5da7-4f93-bcde-4eeefee4c24b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:49.985460 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a52b3d6b-5da7-4f93-bcde-4eeefee4c24b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:49.992553 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a52b3d6b-5da7-4f93-bcde-4eeefee4c24b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:50.318672 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4e2aca02-7d45-4498-b4f1-c7c441a16350 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 05c84048-d3a6-4711-8c32-23ef6424fa9b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:50.349214 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e2aca02-7d45-4498-b4f1-c7c441a16350 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:50.350263 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e2aca02-7d45-4498-b4f1-c7c441a16350 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:50.351975 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e2aca02-7d45-4498-b4f1-c7c441a16350 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:50.352913 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e2aca02-7d45-4498-b4f1-c7c441a16350 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:52.133108 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a52b3d6b-5da7-4f93-bcde-4eeefee4c24b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:52.157070 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a52b3d6b-5da7-4f93-bcde-4eeefee4c24b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:52.161755 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a52b3d6b-5da7-4f93-bcde-4eeefee4c24b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:52.166681 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a52b3d6b-5da7-4f93-bcde-4eeefee4c24b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1881 microversion: 2.42 time: 2.219527 Jul 18 02:19:52.169616 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1112/2196] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:19:49 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1881 bytes in 2223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:19:52.195711 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-931cc0ac-c461-4db6-a001-ac6f969143be tempest-VolumesTestJSON-1408624197 tempest-VolumesTestJSON-1408624197-project] Calling method '.version_select at 0x7ff4a880be50>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:52.407521 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-931cc0ac-c461-4db6-a001-ac6f969143be tempest-VolumesTestJSON-1408624197 tempest-VolumesTestJSON-1408624197-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/76e26eac-ed96-46df-8f69-7126efc43d6d" status: 200 len: 351 microversion: 2.1 time: 0.235365 Jul 18 02:19:52.410871 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1113/2197] 10.222.0.57 () {58 vars in 1244 bytes} [Mon Jul 18 02:19:52 2022] GET /compute/v2.1/os-volumes/76e26eac-ed96-46df-8f69-7126efc43d6d => generated 351 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:19:52.430456 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-13a017cd-55d9-4074-8949-8f16d1d7f90c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:52.434901 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-13a017cd-55d9-4074-8949-8f16d1d7f90c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:52.464644 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-13a017cd-55d9-4074-8949-8f16d1d7f90c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:52.465886 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-13a017cd-55d9-4074-8949-8f16d1d7f90c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:52.473885 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-13a017cd-55d9-4074-8949-8f16d1d7f90c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:52.474760 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-13a017cd-55d9-4074-8949-8f16d1d7f90c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:53.621490 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-4e2aca02-7d45-4498-b4f1-c7c441a16350 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] HTTP exception thrown: Floating IP 172.25.3.58 is not associated with instance 9fa0633a-54a6-4b73-b9b0-4728a4807856. Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4e2aca02-7d45-4498-b4f1-c7c441a16350 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Request method failure captured: Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856/action HTTP/1.1 Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 48 Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MLhn-Bo4ylHafHh51dFW-fkwl9ly4FkrYSXw1OE_OZ1ioOrZ3J3Il44TDJYO-gMynDjof26mC1LLXdQwCetWjgMAzgDSZB0yTvMmaWhWU9RJ-Dz2oaeHaLB1XWWYdIBXzOIlEv1XXfpQosuhqfWhANVnIpdNYgthh66mIxGR18yxHQ Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 839043bafeef4b8785747ca6c2e96817 Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-280661734 Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_839043bafeef4b8785747ca6c2e96817"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/839043bafeef4b8785747ca6c2e96817"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/839043bafeef4b8785747ca6c2e96817"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/839043bafeef4b8785747ca6c2e96817"}]}] Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-280661734 Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 839043bafeef4b8785747ca6c2e96817 Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-280661734 Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-FloatingIPsAssociationTestJSON-280661734-project Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: e81eea16bcfa4dc5bd66926c6a2658ba Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-280661734-project Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: {"removeFloatingIp": {"address": "172.25.3.58"}} Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: exception: Floating IP 172.25.3.58 is not associated with instance 9fa0633a-54a6-4b73-b9b0-4728a4807856. Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '9fa0633a-54a6-4b73-b9b0-4728a4807856', 'body': {'removeFloatingIp': {'address': '172.25.3.58'}}} Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.3.58 is not associated with instance 9fa0633a-54a6-4b73-b9b0-4728a4807856. Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.3.58 is not associated with instance 9fa0633a-54a6-4b73-b9b0-4728a4807856. Jul 18 02:19:53.624794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:19:53.631381 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4e2aca02-7d45-4498-b4f1-c7c441a16350 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Returning 409 to user: Floating IP 172.25.3.58 is not associated with instance 9fa0633a-54a6-4b73-b9b0-4728a4807856. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:19:53.631381 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4e2aca02-7d45-4498-b4f1-c7c441a16350 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] 10.222.0.57 "POST /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856/action" status: 409 len: 145 microversion: 2.1 time: 4.910656 Jul 18 02:19:53.631381 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1085/2198] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:19:48 2022] POST /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856/action => generated 145 bytes in 4916 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:19:53.654585 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-0b16bed0-2101-4b71-ac12-5bbc639ee098 req-319c6040-a05f-465a-9eb0-3716c42181e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b909490f-2890-43c0-b956-9de562d52d67", "tag": "ec520d27-3206-4d7f-96c7-14f7ddd7dba6"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:53.696926 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-0b16bed0-2101-4b71-ac12-5bbc639ee098 req-319c6040-a05f-465a-9eb0-3716c42181e4 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:53.720538 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-0b16bed0-2101-4b71-ac12-5bbc639ee098 req-319c6040-a05f-465a-9eb0-3716c42181e4 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:53.761080 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-0b16bed0-2101-4b71-ac12-5bbc639ee098 req-319c6040-a05f-465a-9eb0-3716c42181e4 service nova] Creating event network-changed:ec520d27-3206-4d7f-96c7-14f7ddd7dba6 for instance b909490f-2890-43c0-b956-9de562d52d67 on n-h2-465891-3 Jul 18 02:19:53.806364 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-0b16bed0-2101-4b71-ac12-5bbc639ee098 req-319c6040-a05f-465a-9eb0-3716c42181e4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164045 Jul 18 02:19:53.808132 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1086/2199] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:19:53.819815 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4030b0a6-c258-4ac6-803d-2b78a7c76748 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:53.821810 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4030b0a6-c258-4ac6-803d-2b78a7c76748 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:53.836243 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4030b0a6-c258-4ac6-803d-2b78a7c76748 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:53.837363 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4030b0a6-c258-4ac6-803d-2b78a7c76748 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:53.839156 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4030b0a6-c258-4ac6-803d-2b78a7c76748 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:53.840231 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4030b0a6-c258-4ac6-803d-2b78a7c76748 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:54.249407 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-13a017cd-55d9-4074-8949-8f16d1d7f90c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:54.308542 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-13a017cd-55d9-4074-8949-8f16d1d7f90c tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 200 len: 1392 microversion: 2.1 time: 1.895293 Jul 18 02:19:54.312378 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1114/2200] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:52 2022] GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 1392 bytes in 1899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:54.343519 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cb3b4bdd-e215-4d9d-b3d5-33a4500cf914 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.58"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:54.922826 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4030b0a6-c258-4ac6-803d-2b78a7c76748 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:54.965383 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4030b0a6-c258-4ac6-803d-2b78a7c76748 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:54.974811 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4030b0a6-c258-4ac6-803d-2b78a7c76748 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:54.982950 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4030b0a6-c258-4ac6-803d-2b78a7c76748 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1881 microversion: 2.42 time: 1.169169 Jul 18 02:19:55.003468 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1087/2201] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:19:53 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1881 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:19:55.003468 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-2c105c0a-7446-48fc-bf2c-34669e8f3aed req-6a796d25-088b-4287-aa17-f59a49368baf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36319b4f-008b-4321-ac5d-e201e50673d3", "name": "network-vif-unplugged", "status": "completed", "tag": "22552354-154e-44d7-a1ec-f329d159341f"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:55.069473 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-2c105c0a-7446-48fc-bf2c-34669e8f3aed req-6a796d25-088b-4287-aa17-f59a49368baf service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:55.071859 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-2c105c0a-7446-48fc-bf2c-34669e8f3aed req-6a796d25-088b-4287-aa17-f59a49368baf service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:55.113507 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-2c105c0a-7446-48fc-bf2c-34669e8f3aed req-6a796d25-088b-4287-aa17-f59a49368baf service nova] Creating event network-vif-unplugged:22552354-154e-44d7-a1ec-f329d159341f for instance 36319b4f-008b-4321-ac5d-e201e50673d3 on n-h1-465891-3 Jul 18 02:19:55.131907 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-2c105c0a-7446-48fc-bf2c-34669e8f3aed req-6a796d25-088b-4287-aa17-f59a49368baf service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.139517 Jul 18 02:19:55.133866 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1088/2202] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:19:55.146735 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4209bd9f-3077-47ed-8545-ff81bcc8f76e tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1780077148", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "74f6bc9a-9d3a-45ba-8d13-344ef0b39097"}], "security_groups": [{"name": "tempest-securitygroup--2023690903"}], "key_name": "tempest-keypair-1680034301", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "d82058f2-eb9b-4243-ad56-9edc3db60fbd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:55.630566 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cb3b4bdd-e215-4d9d-b3d5-33a4500cf914 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 05c84048-d3a6-4711-8c32-23ef6424fa9b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:55.638755 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cb3b4bdd-e215-4d9d-b3d5-33a4500cf914 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:55.639238 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cb3b4bdd-e215-4d9d-b3d5-33a4500cf914 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:55.640076 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cb3b4bdd-e215-4d9d-b3d5-33a4500cf914 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:55.640545 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cb3b4bdd-e215-4d9d-b3d5-33a4500cf914 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:56.410206 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-4209bd9f-3077-47ed-8545-ff81bcc8f76e tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] validate_networks() for [('74f6bc9a-9d3a-45ba-8d13-344ef0b39097', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:19:57.342959 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cb3b4bdd-e215-4d9d-b3d5-33a4500cf914 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Acquired lock "refresh_cache-05c84048-d3a6-4711-8c32-23ef6424fa9b" {{(pid=119543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 02:19:58.450252 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-4209bd9f-3077-47ed-8545-ff81bcc8f76e tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Getting quotas for project d0ed68b2710e40f487813716ca4965e9. Resources: dict_keys(['metadata_items']) {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:19:58.468680 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-4209bd9f-3077-47ed-8545-ff81bcc8f76e tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Getting quotas for user 1de42754291d4c43b983b425a02ea9d3 and project d0ed68b2710e40f487813716ca4965e9. Resources: dict_keys(['metadata_items']) {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:19:58.555749 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-4209bd9f-3077-47ed-8545-ff81bcc8f76e tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:19:58.556136 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-4209bd9f-3077-47ed-8545-ff81bcc8f76e tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:19:58.558409 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-4209bd9f-3077-47ed-8545-ff81bcc8f76e tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:19:58.559125 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-4209bd9f-3077-47ed-8545-ff81bcc8f76e tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:19:58.565219 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-4209bd9f-3077-47ed-8545-ff81bcc8f76e tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:19:58.599417 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4209bd9f-3077-47ed-8545-ff81bcc8f76e tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:58.599952 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4209bd9f-3077-47ed-8545-ff81bcc8f76e tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:58.600862 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4209bd9f-3077-47ed-8545-ff81bcc8f76e tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:58.607959 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4209bd9f-3077-47ed-8545-ff81bcc8f76e tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:58.675943 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-4209bd9f-3077-47ed-8545-ff81bcc8f76e tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Getting quotas for project d0ed68b2710e40f487813716ca4965e9. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:19:58.695378 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-4209bd9f-3077-47ed-8545-ff81bcc8f76e tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Getting quotas for user 1de42754291d4c43b983b425a02ea9d3 and project d0ed68b2710e40f487813716ca4965e9. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:19:58.956722 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4209bd9f-3077-47ed-8545-ff81bcc8f76e tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:19:58.960103 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4209bd9f-3077-47ed-8545-ff81bcc8f76e tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] [instance: 896cc676-e125-4e42-992c-be94d8965977] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d82058f2-eb9b-4243-ad56-9edc3db60fbd',volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:19:59.391206 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4209bd9f-3077-47ed-8545-ff81bcc8f76e tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 4.254555 Jul 18 02:19:59.393633 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1089/2203] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:19:55 2022] POST /compute/v2.1/servers => generated 407 bytes in 4259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:19:59.405047 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3b9caec2-dd7a-4783-938b-e4838e9690c1 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:59.409530 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3b9caec2-dd7a-4783-938b-e4838e9690c1 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:59.436815 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b9caec2-dd7a-4783-938b-e4838e9690c1 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:59.443801 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b9caec2-dd7a-4783-938b-e4838e9690c1 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:59.444996 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b9caec2-dd7a-4783-938b-e4838e9690c1 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:59.452175 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b9caec2-dd7a-4783-938b-e4838e9690c1 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:59.778960 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-cb3b4bdd-e215-4d9d-b3d5-33a4500cf914 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 05c84048-d3a6-4711-8c32-23ef6424fa9b] Building network info cache for instance {{(pid=119543) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 18 02:20:00.459250 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3b9caec2-dd7a-4783-938b-e4838e9690c1 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:00.514785 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3b9caec2-dd7a-4783-938b-e4838e9690c1 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 200 len: 1392 microversion: 2.1 time: 1.117887 Jul 18 02:20:00.523211 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1090/2204] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:59 2022] GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 1392 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:00.585777 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-adf31c87-caa4-4144-b239-62318c4c1c59 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:00.594848 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-adf31c87-caa4-4144-b239-62318c4c1c59 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:00.626215 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-adf31c87-caa4-4144-b239-62318c4c1c59 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:00.627087 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-adf31c87-caa4-4144-b239-62318c4c1c59 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:00.640130 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-adf31c87-caa4-4144-b239-62318c4c1c59 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:00.640915 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-adf31c87-caa4-4144-b239-62318c4c1c59 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:02.119791 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-adf31c87-caa4-4144-b239-62318c4c1c59 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:02.169949 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-adf31c87-caa4-4144-b239-62318c4c1c59 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:02.174729 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-adf31c87-caa4-4144-b239-62318c4c1c59 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:02.177154 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-adf31c87-caa4-4144-b239-62318c4c1c59 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1881 microversion: 2.42 time: 1.646732 Jul 18 02:20:02.179047 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1091/2205] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:00 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1881 bytes in 1655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:02.199729 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-96daaa11-a337-47aa-a29c-89ae480420ef tempest-VolumesTestJSON-1408624197 tempest-VolumesTestJSON-1408624197-project] Calling method '.version_select at 0x7ff4a85f7dc0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:03.149124 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-cb3b4bdd-e215-4d9d-b3d5-33a4500cf914 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 05c84048-d3a6-4711-8c32-23ef6424fa9b] Updating instance_info_cache with network_info: [{"id": "8ddcd961-a463-442c-9c8d-a4a26d309062", "address": "fa:16:3e:a6:5b:e5", "network": {"id": "158397fb-03e8-488a-929e-26b83d7a32dd", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1710267504-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "839043bafeef4b8785747ca6c2e96817", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8ddcd961-a4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119543) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 18 02:20:03.189359 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cb3b4bdd-e215-4d9d-b3d5-33a4500cf914 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Releasing lock "refresh_cache-05c84048-d3a6-4711-8c32-23ef6424fa9b" {{(pid=119543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 02:20:03.193754 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cb3b4bdd-e215-4d9d-b3d5-33a4500cf914 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] 10.222.0.57 "POST /compute/v2.1/servers/05c84048-d3a6-4711-8c32-23ef6424fa9b/action" status: 202 len: 0 microversion: 2.1 time: 8.878913 Jul 18 02:20:03.195695 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1115/2206] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:19:54 2022] POST /compute/v2.1/servers/05c84048-d3a6-4711-8c32-23ef6424fa9b/action => generated 0 bytes in 8882 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 18 02:20:03.206646 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-7bd84e50-2215-4ffb-a312-cd3956b1ee13 req-49fd5a56-06c1-4dbb-be16-c683582edf55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b909490f-2890-43c0-b956-9de562d52d67", "tag": "22242ae4-54de-42d2-be8a-9ecb3f7a6197"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:03.225371 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-7bd84e50-2215-4ffb-a312-cd3956b1ee13 req-49fd5a56-06c1-4dbb-be16-c683582edf55 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:03.226579 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-7bd84e50-2215-4ffb-a312-cd3956b1ee13 req-49fd5a56-06c1-4dbb-be16-c683582edf55 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:03.258479 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-7bd84e50-2215-4ffb-a312-cd3956b1ee13 req-49fd5a56-06c1-4dbb-be16-c683582edf55 service nova] Creating event network-changed:22242ae4-54de-42d2-be8a-9ecb3f7a6197 for instance b909490f-2890-43c0-b956-9de562d52d67 on n-h2-465891-3 Jul 18 02:20:03.270385 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-7bd84e50-2215-4ffb-a312-cd3956b1ee13 req-49fd5a56-06c1-4dbb-be16-c683582edf55 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071609 Jul 18 02:20:03.272160 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1116/2207] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:03.286967 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-295e6bbc-580d-4456-961a-2fa3ad4a8116 req-bc0e00d2-e7bb-4808-b8e9-6543e196763a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36319b4f-008b-4321-ac5d-e201e50673d3", "tag": "22552354-154e-44d7-a1ec-f329d159341f"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:03.311144 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-295e6bbc-580d-4456-961a-2fa3ad4a8116 req-bc0e00d2-e7bb-4808-b8e9-6543e196763a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:03.312316 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-295e6bbc-580d-4456-961a-2fa3ad4a8116 req-bc0e00d2-e7bb-4808-b8e9-6543e196763a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:03.342441 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-295e6bbc-580d-4456-961a-2fa3ad4a8116 req-bc0e00d2-e7bb-4808-b8e9-6543e196763a service nova] Creating event network-changed:22552354-154e-44d7-a1ec-f329d159341f for instance 36319b4f-008b-4321-ac5d-e201e50673d3 on n-h1-465891-3 Jul 18 02:20:03.354328 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-295e6bbc-580d-4456-961a-2fa3ad4a8116 req-bc0e00d2-e7bb-4808-b8e9-6543e196763a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079627 Jul 18 02:20:03.360469 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1117/2208] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:03.367353 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8cdfd28e-e1f0-4cb7-8331-901b0fbb4671 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:03.368319 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8cdfd28e-e1f0-4cb7-8331-901b0fbb4671 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] [instance: 896cc676-e125-4e42-992c-be94d8965977] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:03.378035 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8cdfd28e-e1f0-4cb7-8331-901b0fbb4671 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:03.378797 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8cdfd28e-e1f0-4cb7-8331-901b0fbb4671 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:03.379625 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8cdfd28e-e1f0-4cb7-8331-901b0fbb4671 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:03.380076 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8cdfd28e-e1f0-4cb7-8331-901b0fbb4671 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:03.585987 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8cdfd28e-e1f0-4cb7-8331-901b0fbb4671 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de42754291d4c43b983b425a02ea9d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ed68b2710e40f487813716ca4965e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:03.603222 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8cdfd28e-e1f0-4cb7-8331-901b0fbb4671 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] 10.222.0.57 "GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977" status: 200 len: 1238 microversion: 2.1 time: 0.240278 Jul 18 02:20:03.609677 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1118/2209] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:03 2022] GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977 => generated 1238 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:03.618096 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5faad96f-a5c1-49d3-88b1-0cf618fce6eb tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:03.620656 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5faad96f-a5c1-49d3-88b1-0cf618fce6eb tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:03.646107 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5faad96f-a5c1-49d3-88b1-0cf618fce6eb tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:03.646712 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5faad96f-a5c1-49d3-88b1-0cf618fce6eb tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:03.647593 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5faad96f-a5c1-49d3-88b1-0cf618fce6eb tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:03.648710 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5faad96f-a5c1-49d3-88b1-0cf618fce6eb tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:03.824271 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-96daaa11-a337-47aa-a29c-89ae480420ef tempest-VolumesTestJSON-1408624197 tempest-VolumesTestJSON-1408624197-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/0ead5052-f8ce-4ca4-8399-c9f152a2e0da" status: 200 len: 350 microversion: 2.1 time: 1.633709 Jul 18 02:20:03.827909 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1092/2210] 10.222.0.57 () {58 vars in 1244 bytes} [Mon Jul 18 02:20:02 2022] GET /compute/v2.1/os-volumes/0ead5052-f8ce-4ca4-8399-c9f152a2e0da => generated 350 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:03.847137 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7724647b-0710-4173-a6b0-2fb8ed7ae92e tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:03.848124 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7724647b-0710-4173-a6b0-2fb8ed7ae92e tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 05c84048-d3a6-4711-8c32-23ef6424fa9b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:03.882138 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7724647b-0710-4173-a6b0-2fb8ed7ae92e tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:03.883084 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7724647b-0710-4173-a6b0-2fb8ed7ae92e tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:03.889779 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7724647b-0710-4173-a6b0-2fb8ed7ae92e tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:03.890760 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7724647b-0710-4173-a6b0-2fb8ed7ae92e tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:04.035516 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7724647b-0710-4173-a6b0-2fb8ed7ae92e tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 05c84048-d3a6-4711-8c32-23ef6424fa9b] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:20:04.421351 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7724647b-0710-4173-a6b0-2fb8ed7ae92e tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] 10.222.0.57 "DELETE /compute/v2.1/servers/05c84048-d3a6-4711-8c32-23ef6424fa9b" status: 204 len: 0 microversion: 2.1 time: 0.590126 Jul 18 02:20:04.422908 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1093/2211] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:20:03 2022] DELETE /compute/v2.1/servers/05c84048-d3a6-4711-8c32-23ef6424fa9b => generated 0 bytes in 594 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:20:04.448208 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d025842d-f681-4008-8613-9180063a8d00 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:04.451412 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d025842d-f681-4008-8613-9180063a8d00 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:04.472525 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d025842d-f681-4008-8613-9180063a8d00 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:04.473742 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d025842d-f681-4008-8613-9180063a8d00 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:04.476496 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d025842d-f681-4008-8613-9180063a8d00 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:04.477248 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d025842d-f681-4008-8613-9180063a8d00 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:04.699082 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5faad96f-a5c1-49d3-88b1-0cf618fce6eb tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:04.740041 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5faad96f-a5c1-49d3-88b1-0cf618fce6eb tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 200 len: 1392 microversion: 2.1 time: 1.129058 Jul 18 02:20:04.746741 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1119/2212] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:03 2022] GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 1392 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:04.757203 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-3751c4cd-f03e-4083-83b7-e27ec23db09f req-4056e226-99b0-4373-aa07-881ef77460bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36319b4f-008b-4321-ac5d-e201e50673d3", "name": "network-vif-unplugged", "status": "completed", "tag": "22552354-154e-44d7-a1ec-f329d159341f"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:04.776407 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-3751c4cd-f03e-4083-83b7-e27ec23db09f req-4056e226-99b0-4373-aa07-881ef77460bb service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:04.776996 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-3751c4cd-f03e-4083-83b7-e27ec23db09f req-4056e226-99b0-4373-aa07-881ef77460bb service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:04.807151 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-3751c4cd-f03e-4083-83b7-e27ec23db09f req-4056e226-99b0-4373-aa07-881ef77460bb service nova] Creating event network-vif-unplugged:22552354-154e-44d7-a1ec-f329d159341f for instance 36319b4f-008b-4321-ac5d-e201e50673d3 on n-h1-465891-3 Jul 18 02:20:04.818871 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-3751c4cd-f03e-4083-83b7-e27ec23db09f req-4056e226-99b0-4373-aa07-881ef77460bb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070576 Jul 18 02:20:04.826366 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1120/2213] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:04.838255 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4edf1813-6fb9-470f-aea0-8db3daa2ab45 tempest-VolumesTestJSON-1408624197 tempest-VolumesTestJSON-1408624197-project] Calling method '.version_select at 0x7ff49bcb6820>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:05.409022 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d025842d-f681-4008-8613-9180063a8d00 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:05.425027 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d025842d-f681-4008-8613-9180063a8d00 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:05.437685 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d025842d-f681-4008-8613-9180063a8d00 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:05.440289 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d025842d-f681-4008-8613-9180063a8d00 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1881 microversion: 2.42 time: 1.005421 Jul 18 02:20:05.441174 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1094/2214] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:04 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1881 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:05.458119 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a72fa45d-7aed-4747-8235-201006fd4eed tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.58"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:05.459725 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a72fa45d-7aed-4747-8235-201006fd4eed tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 9fa0633a-54a6-4b73-b9b0-4728a4807856] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:05.473983 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a72fa45d-7aed-4747-8235-201006fd4eed tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:05.474718 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a72fa45d-7aed-4747-8235-201006fd4eed tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:05.475715 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a72fa45d-7aed-4747-8235-201006fd4eed tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:05.476327 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a72fa45d-7aed-4747-8235-201006fd4eed tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:05.520735 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a72fa45d-7aed-4747-8235-201006fd4eed tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Acquired lock "refresh_cache-9fa0633a-54a6-4b73-b9b0-4728a4807856" {{(pid=119544) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 02:20:08.632339 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:08.716262 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=10 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:13.466782 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-a72fa45d-7aed-4747-8235-201006fd4eed tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 9fa0633a-54a6-4b73-b9b0-4728a4807856] Building network info cache for instance {{(pid=119544) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 18 02:20:14.766013 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=19 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:14.805184 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=51,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:15.464779 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:15.582866 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4edf1813-6fb9-470f-aea0-8db3daa2ab45 tempest-VolumesTestJSON-1408624197 tempest-VolumesTestJSON-1408624197-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 10.754399 Jul 18 02:20:15.585062 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1121/2215] 10.222.0.57 () {58 vars in 1133 bytes} [Mon Jul 18 02:20:04 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 10758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:15.602841 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5a0ac1e6-f963-4453-af8b-b3086916fe1f tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:15.612429 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5a0ac1e6-f963-4453-af8b-b3086916fe1f tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] [instance: 896cc676-e125-4e42-992c-be94d8965977] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:15.634633 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5a0ac1e6-f963-4453-af8b-b3086916fe1f tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:15.643306 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5a0ac1e6-f963-4453-af8b-b3086916fe1f tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:15.645803 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5a0ac1e6-f963-4453-af8b-b3086916fe1f tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:15.647355 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5a0ac1e6-f963-4453-af8b-b3086916fe1f tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:18.020921 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-a72fa45d-7aed-4747-8235-201006fd4eed tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 9fa0633a-54a6-4b73-b9b0-4728a4807856] Updating instance_info_cache with network_info: [{"id": "ee9f4c78-62bc-4a6d-9904-38efa10900ec", "address": "fa:16:3e:20:6a:f2", "network": {"id": "158397fb-03e8-488a-929e-26b83d7a32dd", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1710267504-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "839043bafeef4b8785747ca6c2e96817", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapee9f4c78-62", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119544) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 18 02:20:18.046863 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5a0ac1e6-f963-4453-af8b-b3086916fe1f tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de42754291d4c43b983b425a02ea9d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ed68b2710e40f487813716ca4965e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:18.100083 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5a0ac1e6-f963-4453-af8b-b3086916fe1f tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] 10.222.0.57 "GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977" status: 200 len: 1306 microversion: 2.1 time: 2.512125 Jul 18 02:20:18.100956 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1122/2216] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:15 2022] GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977 => generated 1306 bytes in 2515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:18.111075 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a72fa45d-7aed-4747-8235-201006fd4eed tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Releasing lock "refresh_cache-9fa0633a-54a6-4b73-b9b0-4728a4807856" {{(pid=119544) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 02:20:18.113100 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-4782b9c1-4c2d-44b7-9977-a4df8f64c24a req-143669ea-46a2-47f2-bdb7-a85c40d8111d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05c84048-d3a6-4711-8c32-23ef6424fa9b", "tag": "8ddcd961-a463-442c-9c8d-a4a26d309062"}, {"name": "network-changed", "server_uuid": "b909490f-2890-43c0-b956-9de562d52d67", "tag": "7d2eaf01-7168-45f2-9cf4-bf37b3151ae2"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:18.117463 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a72fa45d-7aed-4747-8235-201006fd4eed tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] 10.222.0.57 "POST /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856/action" status: 202 len: 0 microversion: 2.1 time: 12.663510 Jul 18 02:20:18.125139 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1095/2217] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:20:05 2022] POST /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856/action => generated 0 bytes in 12667 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 18 02:20:18.129724 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-4782b9c1-4c2d-44b7-9977-a4df8f64c24a req-143669ea-46a2-47f2-bdb7-a85c40d8111d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:18.130572 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-4782b9c1-4c2d-44b7-9977-a4df8f64c24a req-143669ea-46a2-47f2-bdb7-a85c40d8111d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:18.175847 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-4782b9c1-4c2d-44b7-9977-a4df8f64c24a req-143669ea-46a2-47f2-bdb7-a85c40d8111d service nova] Creating event network-changed:8ddcd961-a463-442c-9c8d-a4a26d309062 for instance 05c84048-d3a6-4711-8c32-23ef6424fa9b on n-h1-465891-3 Jul 18 02:20:18.176908 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-4782b9c1-4c2d-44b7-9977-a4df8f64c24a req-143669ea-46a2-47f2-bdb7-a85c40d8111d service nova] Creating event network-changed:7d2eaf01-7168-45f2-9cf4-bf37b3151ae2 for instance b909490f-2890-43c0-b956-9de562d52d67 on n-h2-465891-3 Jul 18 02:20:18.216122 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-4782b9c1-4c2d-44b7-9977-a4df8f64c24a req-143669ea-46a2-47f2-bdb7-a85c40d8111d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.112584 Jul 18 02:20:18.222878 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1123/2218] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:18.247051 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2bac46d3-79f7-4d1d-84f8-2291b5cb3d00 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:18.280929 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2bac46d3-79f7-4d1d-84f8-2291b5cb3d00 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:18.316595 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2bac46d3-79f7-4d1d-84f8-2291b5cb3d00 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:18.317776 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2bac46d3-79f7-4d1d-84f8-2291b5cb3d00 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:18.326508 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2bac46d3-79f7-4d1d-84f8-2291b5cb3d00 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:18.327655 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2bac46d3-79f7-4d1d-84f8-2291b5cb3d00 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:19.209125 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4823033d-bed4-46c8-9c0e-b2ccb8deb9e3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:19.210508 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4823033d-bed4-46c8-9c0e-b2ccb8deb9e3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:19.245937 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4823033d-bed4-46c8-9c0e-b2ccb8deb9e3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:19.246726 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4823033d-bed4-46c8-9c0e-b2ccb8deb9e3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:19.248430 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4823033d-bed4-46c8-9c0e-b2ccb8deb9e3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:19.250006 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4823033d-bed4-46c8-9c0e-b2ccb8deb9e3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:19.318344 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=60,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:20.287945 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2bac46d3-79f7-4d1d-84f8-2291b5cb3d00 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:20.301957 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4823033d-bed4-46c8-9c0e-b2ccb8deb9e3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:20.339818 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4823033d-bed4-46c8-9c0e-b2ccb8deb9e3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 200 len: 1382 microversion: 2.1 time: 2.203395 Jul 18 02:20:20.341024 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1096/2219] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:18 2022] GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 1382 bytes in 2220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:20.343804 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2bac46d3-79f7-4d1d-84f8-2291b5cb3d00 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:20.348750 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2bac46d3-79f7-4d1d-84f8-2291b5cb3d00 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:20.357037 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-826b3abf-adda-4d8e-b5c5-e981c4bb736a req-f250d787-ed58-4443-8d36-f411965f019e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05c84048-d3a6-4711-8c32-23ef6424fa9b", "name": "network-vif-deleted", "tag": "8ddcd961-a463-442c-9c8d-a4a26d309062"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:20.359963 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2bac46d3-79f7-4d1d-84f8-2291b5cb3d00 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1869 microversion: 2.42 time: 2.127645 Jul 18 02:20:20.363069 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1124/2220] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:18 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1869 bytes in 2136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:20.388232 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-61d664a2-ce9d-465c-b19d-da3f1b9d1a25 tempest-VolumesTestJSON-1408624197 tempest-VolumesTestJSON-1408624197-project] Calling method '.version_select at 0x7ff49bca9550>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:20.401097 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-826b3abf-adda-4d8e-b5c5-e981c4bb736a req-f250d787-ed58-4443-8d36-f411965f019e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:20.403755 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-826b3abf-adda-4d8e-b5c5-e981c4bb736a req-f250d787-ed58-4443-8d36-f411965f019e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:20.437848 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-826b3abf-adda-4d8e-b5c5-e981c4bb736a req-f250d787-ed58-4443-8d36-f411965f019e service nova] Creating event network-vif-deleted:8ddcd961-a463-442c-9c8d-a4a26d309062 for instance 05c84048-d3a6-4711-8c32-23ef6424fa9b on n-h1-465891-3 Jul 18 02:20:20.448142 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-826b3abf-adda-4d8e-b5c5-e981c4bb736a req-f250d787-ed58-4443-8d36-f411965f019e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104511 Jul 18 02:20:20.449231 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1097/2221] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:20.462030 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9a8fe34f-ed9f-45db-8e89-1cc29d051135 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Calling method '.version_select at 0x7ff4a8609550>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:20.637277 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-61d664a2-ce9d-465c-b19d-da3f1b9d1a25 tempest-VolumesTestJSON-1408624197 tempest-VolumesTestJSON-1408624197-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.272025 Jul 18 02:20:20.639129 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1125/2222] 10.222.0.57 () {58 vars in 1148 bytes} [Mon Jul 18 02:20:20 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:20.650248 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fc0ef2fe-986d-465e-a64b-69039685fa68 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:20.651564 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fc0ef2fe-986d-465e-a64b-69039685fa68 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] [instance: 896cc676-e125-4e42-992c-be94d8965977] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:20.663873 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fc0ef2fe-986d-465e-a64b-69039685fa68 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:20.664824 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fc0ef2fe-986d-465e-a64b-69039685fa68 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:20.666441 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fc0ef2fe-986d-465e-a64b-69039685fa68 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:20.667331 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fc0ef2fe-986d-465e-a64b-69039685fa68 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:21.087456 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9a8fe34f-ed9f-45db-8e89-1cc29d051135 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] 10.222.0.57 "GET /compute/v2.1/os-floating-ips/78b520f1-fc5f-45e0-8e61-f9251abdce0f" status: 200 len: 183 microversion: 2.1 time: 0.631729 Jul 18 02:20:21.089143 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1098/2223] 10.222.0.57 () {58 vars in 1259 bytes} [Mon Jul 18 02:20:20 2022] GET /compute/v2.1/os-floating-ips/78b520f1-fc5f-45e0-8e61-f9251abdce0f => generated 183 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:21.105758 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c31929f2-09b5-43fb-aa23-eff7838499f1 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5fda4952-6782-453c-8872-e9a9aaaaa6b8"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:21.108407 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c31929f2-09b5-43fb-aa23-eff7838499f1 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] [instance: 0f30e76e-91e9-441f-b482-28de008a5e40] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:21.131750 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c31929f2-09b5-43fb-aa23-eff7838499f1 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:21.132210 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c31929f2-09b5-43fb-aa23-eff7838499f1 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:21.136594 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c31929f2-09b5-43fb-aa23-eff7838499f1 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:21.140422 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c31929f2-09b5-43fb-aa23-eff7838499f1 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:21.144319 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fc0ef2fe-986d-465e-a64b-69039685fa68 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de42754291d4c43b983b425a02ea9d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ed68b2710e40f487813716ca4965e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:21.162932 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fc0ef2fe-986d-465e-a64b-69039685fa68 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] 10.222.0.57 "GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977" status: 200 len: 1294 microversion: 2.1 time: 0.521749 Jul 18 02:20:21.179715 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1126/2224] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:20 2022] GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977 => generated 1294 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:21.193274 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-dc6d3bb0-e323-415a-b8d5-00eedebbdde2 req-80c02bad-0bf2-4d19-bf57-fbdaf103bf05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b909490f-2890-43c0-b956-9de562d52d67", "tag": "8ed539e3-cacf-4544-b22a-ef277f6be4d8"}, {"name": "network-changed", "server_uuid": "b909490f-2890-43c0-b956-9de562d52d67", "tag": "6ca621a9-9ed9-4c3d-acdf-29cc441d2c6e"}, {"name": "network-changed", "server_uuid": "9fa0633a-54a6-4b73-b9b0-4728a4807856", "tag": "ee9f4c78-62bc-4a6d-9904-38efa10900ec"}, {"name": "network-changed", "server_uuid": "896cc676-e125-4e42-992c-be94d8965977", "tag": "74150074-2639-48b5-9935-1a1c8780d926"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:21.213826 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-dc6d3bb0-e323-415a-b8d5-00eedebbdde2 req-80c02bad-0bf2-4d19-bf57-fbdaf103bf05 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:21.219235 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-dc6d3bb0-e323-415a-b8d5-00eedebbdde2 req-80c02bad-0bf2-4d19-bf57-fbdaf103bf05 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:21.263582 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-dc6d3bb0-e323-415a-b8d5-00eedebbdde2 req-80c02bad-0bf2-4d19-bf57-fbdaf103bf05 service nova] Creating event network-changed:8ed539e3-cacf-4544-b22a-ef277f6be4d8 for instance b909490f-2890-43c0-b956-9de562d52d67 on n-h2-465891-3 Jul 18 02:20:21.264107 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-dc6d3bb0-e323-415a-b8d5-00eedebbdde2 req-80c02bad-0bf2-4d19-bf57-fbdaf103bf05 service nova] Creating event network-changed:6ca621a9-9ed9-4c3d-acdf-29cc441d2c6e for instance b909490f-2890-43c0-b956-9de562d52d67 on n-h2-465891-3 Jul 18 02:20:21.264617 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-dc6d3bb0-e323-415a-b8d5-00eedebbdde2 req-80c02bad-0bf2-4d19-bf57-fbdaf103bf05 service nova] Creating event network-changed:ee9f4c78-62bc-4a6d-9904-38efa10900ec for instance 9fa0633a-54a6-4b73-b9b0-4728a4807856 on n-h2-465891-3 Jul 18 02:20:21.265122 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-dc6d3bb0-e323-415a-b8d5-00eedebbdde2 req-80c02bad-0bf2-4d19-bf57-fbdaf103bf05 service nova] Creating event network-changed:74150074-2639-48b5-9935-1a1c8780d926 for instance 896cc676-e125-4e42-992c-be94d8965977 on n-h1-465891-3 Jul 18 02:20:21.289739 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-dc6d3bb0-e323-415a-b8d5-00eedebbdde2 req-80c02bad-0bf2-4d19-bf57-fbdaf103bf05 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 680 microversion: 2.1 time: 0.107170 Jul 18 02:20:21.294158 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1127/2225] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 680 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:21.306708 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-36a5f59f-8048-4645-860a-7e0ed9e1fb02 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Calling method '.version_select at 0x7ff4add60790>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:21.309417 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-36a5f59f-8048-4645-860a-7e0ed9e1fb02 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:21.312856 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-36a5f59f-8048-4645-860a-7e0ed9e1fb02 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:21.337156 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-36a5f59f-8048-4645-860a-7e0ed9e1fb02 tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] 10.222.0.57 "GET /compute/v2.1/os-migrations" status: 200 len: 2701 microversion: 2.1 time: 0.041635 Jul 18 02:20:21.339171 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1128/2226] 10.222.0.57 () {58 vars in 1142 bytes} [Mon Jul 18 02:20:21 2022] GET /compute/v2.1/os-migrations => generated 2701 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:21.345209 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-df64d19e-bf79-47f8-bbe1-0a45961a6b3d tempest-VolumesTestJSON-1408624197 tempest-VolumesTestJSON-1408624197-project] Calling method '.version_select at 0x7ff4a880b040>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:21.651324 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-df64d19e-bf79-47f8-bbe1-0a45961a6b3d tempest-VolumesTestJSON-1408624197 tempest-VolumesTestJSON-1408624197-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.310629 Jul 18 02:20:21.654066 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1129/2227] 10.222.0.57 () {58 vars in 1133 bytes} [Mon Jul 18 02:20:21 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:21.667038 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-495653e6-12c5-433e-bd05-26162b08b152 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.58"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:21.743523 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c31929f2-09b5-43fb-aa23-eff7838499f1 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] 10.222.0.57 "POST /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.651148 Jul 18 02:20:21.744402 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1099/2228] 10.222.0.57 () {60 vars in 1322 bytes} [Mon Jul 18 02:20:21 2022] POST /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40/os-volume_attachments => generated 194 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:21.749598 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-002d0298-0fef-4cd3-94dc-7e3d67909b3a tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:21.750992 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-002d0298-0fef-4cd3-94dc-7e3d67909b3a tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:21.776986 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-002d0298-0fef-4cd3-94dc-7e3d67909b3a tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:21.777813 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-002d0298-0fef-4cd3-94dc-7e3d67909b3a tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:21.779137 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-002d0298-0fef-4cd3-94dc-7e3d67909b3a tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:21.782691 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-002d0298-0fef-4cd3-94dc-7e3d67909b3a tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:22.353359 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-495653e6-12c5-433e-bd05-26162b08b152 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 9fa0633a-54a6-4b73-b9b0-4728a4807856] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:22.361644 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-495653e6-12c5-433e-bd05-26162b08b152 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:22.363122 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-495653e6-12c5-433e-bd05-26162b08b152 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:22.363993 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-495653e6-12c5-433e-bd05-26162b08b152 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:22.366604 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-495653e6-12c5-433e-bd05-26162b08b152 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:22.577768 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-002d0298-0fef-4cd3-94dc-7e3d67909b3a tempest-LiveMigrationTest-1781886708 tempest-LiveMigrationTest-1781886708-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 200 len: 1533 microversion: 2.1 time: 0.827539 Jul 18 02:20:22.582916 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1100/2229] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:21 2022] GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 1533 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:22.645142 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8be544d6-f6a5-4d0b-8199-e429d0e51035 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:22.646761 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8be544d6-f6a5-4d0b-8199-e429d0e51035 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:22.662354 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8be544d6-f6a5-4d0b-8199-e429d0e51035 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:22.667705 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8be544d6-f6a5-4d0b-8199-e429d0e51035 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:22.669228 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8be544d6-f6a5-4d0b-8199-e429d0e51035 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:22.670900 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8be544d6-f6a5-4d0b-8199-e429d0e51035 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:23.649868 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-495653e6-12c5-433e-bd05-26162b08b152 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Acquired lock "refresh_cache-9fa0633a-54a6-4b73-b9b0-4728a4807856" {{(pid=119543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 02:20:23.896014 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8be544d6-f6a5-4d0b-8199-e429d0e51035 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:23.919067 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8be544d6-f6a5-4d0b-8199-e429d0e51035 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:23.924150 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8be544d6-f6a5-4d0b-8199-e429d0e51035 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:23.928550 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8be544d6-f6a5-4d0b-8199-e429d0e51035 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1869 microversion: 2.42 time: 1.342088 Jul 18 02:20:23.930514 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1101/2230] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:22 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1869 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:23.945462 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0d0bc174-c927-4c62-bfa5-ae2f65aaf747 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-532544039", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "e5432050-4fd3-426b-81bb-244a073d1cbe"}], "block_device_mapping_v2": [{"uuid": "4883f06e-23d9-498a-95cc-f28157536bec", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:24.218662 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-0d0bc174-c927-4c62-bfa5-ae2f65aaf747 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] validate_networks() for [('e5432050-4fd3-426b-81bb-244a073d1cbe', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:20:25.445672 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-0d0bc174-c927-4c62-bfa5-ae2f65aaf747 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:20:25.446762 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-0d0bc174-c927-4c62-bfa5-ae2f65aaf747 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:20:25.446762 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-0d0bc174-c927-4c62-bfa5-ae2f65aaf747 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:20:25.447442 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-0d0bc174-c927-4c62-bfa5-ae2f65aaf747 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:20:25.449068 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-0d0bc174-c927-4c62-bfa5-ae2f65aaf747 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:20:25.466900 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0d0bc174-c927-4c62-bfa5-ae2f65aaf747 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:25.467736 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0d0bc174-c927-4c62-bfa5-ae2f65aaf747 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:25.473471 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0d0bc174-c927-4c62-bfa5-ae2f65aaf747 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:25.474133 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0d0bc174-c927-4c62-bfa5-ae2f65aaf747 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:25.525554 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-0d0bc174-c927-4c62-bfa5-ae2f65aaf747 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Getting quotas for project 9d0f5bbde58545fb9ccd1c2eb842ed49. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:20:25.532749 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-0d0bc174-c927-4c62-bfa5-ae2f65aaf747 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Getting quotas for user 575dd6743cff44678749d452329355d1 and project 9d0f5bbde58545fb9ccd1c2eb842ed49. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:20:25.664084 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0d0bc174-c927-4c62-bfa5-ae2f65aaf747 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:20:25.667369 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0d0bc174-c927-4c62-bfa5-ae2f65aaf747 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4883f06e-23d9-498a-95cc-f28157536bec',volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:20:25.990183 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0d0bc174-c927-4c62-bfa5-ae2f65aaf747 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.048908 Jul 18 02:20:25.991499 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1102/2231] 10.222.0.57 () {62 vars in 1187 bytes} [Mon Jul 18 02:20:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2060 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 02:20:26.019022 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-899286be-4859-452f-93e8-32c1734a2550 tempest-VolumesTestJSON-1408624197 tempest-VolumesTestJSON-1408624197-project] Calling method '.version_select at 0x7ff4a86bbaf0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:26.263886 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-899286be-4859-452f-93e8-32c1734a2550 tempest-VolumesTestJSON-1408624197 tempest-VolumesTestJSON-1408624197-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.269371 Jul 18 02:20:26.274248 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1103/2232] 10.222.0.57 () {58 vars in 1166 bytes} [Mon Jul 18 02:20:25 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:26.313993 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-495653e6-12c5-433e-bd05-26162b08b152 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 9fa0633a-54a6-4b73-b9b0-4728a4807856] Building network info cache for instance {{(pid=119543) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 18 02:20:26.322237 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-79e3ed03-065b-4f5f-afb3-70451a050cfd tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:26.332319 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-79e3ed03-065b-4f5f-afb3-70451a050cfd tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] [instance: 896cc676-e125-4e42-992c-be94d8965977] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:26.395876 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-79e3ed03-065b-4f5f-afb3-70451a050cfd tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:26.399529 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-79e3ed03-065b-4f5f-afb3-70451a050cfd tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:26.400886 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-79e3ed03-065b-4f5f-afb3-70451a050cfd tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:26.405231 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-79e3ed03-065b-4f5f-afb3-70451a050cfd tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:26.924565 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-79e3ed03-065b-4f5f-afb3-70451a050cfd tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de42754291d4c43b983b425a02ea9d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ed68b2710e40f487813716ca4965e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:26.935878 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-79e3ed03-065b-4f5f-afb3-70451a050cfd tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] 10.222.0.57 "GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977" status: 200 len: 1294 microversion: 2.1 time: 0.659478 Jul 18 02:20:26.936541 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1104/2233] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:26 2022] GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977 => generated 1294 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:26.948311 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6f908028-99e4-4640-8877-d4ce7624fcdd tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:26.958632 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6f908028-99e4-4640-8877-d4ce7624fcdd tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:26.979517 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6f908028-99e4-4640-8877-d4ce7624fcdd tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:26.983256 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6f908028-99e4-4640-8877-d4ce7624fcdd tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:26.989328 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6f908028-99e4-4640-8877-d4ce7624fcdd tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:26.991528 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6f908028-99e4-4640-8877-d4ce7624fcdd tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:27.069638 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6f908028-99e4-4640-8877-d4ce7624fcdd tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:20:27.278165 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6f908028-99e4-4640-8877-d4ce7624fcdd tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "DELETE /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 204 len: 0 microversion: 2.1 time: 0.333647 Jul 18 02:20:27.279088 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1105/2234] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:20:26 2022] DELETE /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:20:27.285584 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0c3c6443-3e3c-40aa-8f83-5bec930ec570 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:27.288574 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0c3c6443-3e3c-40aa-8f83-5bec930ec570 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:27.303058 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c3c6443-3e3c-40aa-8f83-5bec930ec570 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:27.306321 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c3c6443-3e3c-40aa-8f83-5bec930ec570 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:27.310250 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c3c6443-3e3c-40aa-8f83-5bec930ec570 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:27.310883 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c3c6443-3e3c-40aa-8f83-5bec930ec570 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:27.793285 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0c3c6443-3e3c-40aa-8f83-5bec930ec570 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:27.814647 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0c3c6443-3e3c-40aa-8f83-5bec930ec570 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:27.818429 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0c3c6443-3e3c-40aa-8f83-5bec930ec570 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:27.820358 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0c3c6443-3e3c-40aa-8f83-5bec930ec570 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1869 microversion: 2.42 time: 0.539746 Jul 18 02:20:27.821766 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1106/2235] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:27 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1869 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:27.833573 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2e46f0c9-5964-4c7e-ba7c-cecfbf3e2cca tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:27.847090 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2e46f0c9-5964-4c7e-ba7c-cecfbf3e2cca tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:27.862693 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2e46f0c9-5964-4c7e-ba7c-cecfbf3e2cca tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:27.865630 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2e46f0c9-5964-4c7e-ba7c-cecfbf3e2cca tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:27.868323 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2e46f0c9-5964-4c7e-ba7c-cecfbf3e2cca tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:27.873717 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2e46f0c9-5964-4c7e-ba7c-cecfbf3e2cca tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:28.112484 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-495653e6-12c5-433e-bd05-26162b08b152 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 9fa0633a-54a6-4b73-b9b0-4728a4807856] Updating instance_info_cache with network_info: [{"id": "ee9f4c78-62bc-4a6d-9904-38efa10900ec", "address": "fa:16:3e:20:6a:f2", "network": {"id": "158397fb-03e8-488a-929e-26b83d7a32dd", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1710267504-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "839043bafeef4b8785747ca6c2e96817", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapee9f4c78-62", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119543) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 18 02:20:28.160330 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-495653e6-12c5-433e-bd05-26162b08b152 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Releasing lock "refresh_cache-9fa0633a-54a6-4b73-b9b0-4728a4807856" {{(pid=119543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 02:20:28.168759 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-495653e6-12c5-433e-bd05-26162b08b152 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] 10.222.0.57 "POST /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856/action" status: 202 len: 0 microversion: 2.1 time: 6.508848 Jul 18 02:20:28.173736 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1130/2236] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:20:21 2022] POST /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856/action => generated 0 bytes in 6519 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 18 02:20:28.178250 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2e46f0c9-5964-4c7e-ba7c-cecfbf3e2cca tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:28.188084 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2e46f0c9-5964-4c7e-ba7c-cecfbf3e2cca tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:28.198595 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b295ed9b-045a-4cea-9b18-156a1ffbe81a tempest-VolumesTestJSON-1408624197 tempest-VolumesTestJSON-1408624197-project] Calling method '.version_select at 0x7ff49bef4790>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:28.200785 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2e46f0c9-5964-4c7e-ba7c-cecfbf3e2cca tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:28.202591 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2e46f0c9-5964-4c7e-ba7c-cecfbf3e2cca tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1232 microversion: 2.25 time: 0.379237 Jul 18 02:20:28.204954 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1107/2237] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:27 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1232 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:28.214418 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-9d352a25-e77c-4bb7-8b3d-63fcfeef8dae req-98f44976-a16f-4c29-9680-e9d9cec26faf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fa0633a-54a6-4b73-b9b0-4728a4807856", "tag": "ee9f4c78-62bc-4a6d-9904-38efa10900ec"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:28.238266 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-9d352a25-e77c-4bb7-8b3d-63fcfeef8dae req-98f44976-a16f-4c29-9680-e9d9cec26faf service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:28.238891 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-9d352a25-e77c-4bb7-8b3d-63fcfeef8dae req-98f44976-a16f-4c29-9680-e9d9cec26faf service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:28.265298 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-9d352a25-e77c-4bb7-8b3d-63fcfeef8dae req-98f44976-a16f-4c29-9680-e9d9cec26faf service nova] Creating event network-changed:ee9f4c78-62bc-4a6d-9904-38efa10900ec for instance 9fa0633a-54a6-4b73-b9b0-4728a4807856 on n-h2-465891-3 Jul 18 02:20:28.281933 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-9d352a25-e77c-4bb7-8b3d-63fcfeef8dae req-98f44976-a16f-4c29-9680-e9d9cec26faf service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074664 Jul 18 02:20:28.283875 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1108/2238] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:28.300005 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-79625e76-bf60-498d-abc6-1f75d8848600 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:28.300976 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-79625e76-bf60-498d-abc6-1f75d8848600 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:28.320182 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-79625e76-bf60-498d-abc6-1f75d8848600 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:28.320855 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-79625e76-bf60-498d-abc6-1f75d8848600 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:28.321941 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-79625e76-bf60-498d-abc6-1f75d8848600 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:28.323623 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-79625e76-bf60-498d-abc6-1f75d8848600 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:28.522630 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b295ed9b-045a-4cea-9b18-156a1ffbe81a tempest-VolumesTestJSON-1408624197 tempest-VolumesTestJSON-1408624197-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.344764 Jul 18 02:20:28.523788 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1131/2239] 10.222.0.57 () {58 vars in 1169 bytes} [Mon Jul 18 02:20:28 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:28.543174 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-667a4963-500a-467d-9062-9887254cf196 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:28.544565 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-667a4963-500a-467d-9062-9887254cf196 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] [instance: 896cc676-e125-4e42-992c-be94d8965977] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:28.587245 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-667a4963-500a-467d-9062-9887254cf196 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:28.588445 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-667a4963-500a-467d-9062-9887254cf196 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:28.590470 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-667a4963-500a-467d-9062-9887254cf196 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:28.591519 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-667a4963-500a-467d-9062-9887254cf196 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:29.293812 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-79625e76-bf60-498d-abc6-1f75d8848600 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:29.318731 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-79625e76-bf60-498d-abc6-1f75d8848600 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 200 len: 1388 microversion: 2.1 time: 1.031387 Jul 18 02:20:29.319758 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1109/2240] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:28 2022] GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 1388 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:29.360062 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d5ecc1e9-df9c-4bf9-87e5-da52e3e76b53 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:29.360952 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d5ecc1e9-df9c-4bf9-87e5-da52e3e76b53 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 05c84048-d3a6-4711-8c32-23ef6424fa9b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:29.387868 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d5ecc1e9-df9c-4bf9-87e5-da52e3e76b53 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:29.388688 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d5ecc1e9-df9c-4bf9-87e5-da52e3e76b53 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:29.395693 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d5ecc1e9-df9c-4bf9-87e5-da52e3e76b53 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:29.400005 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d5ecc1e9-df9c-4bf9-87e5-da52e3e76b53 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:29.464058 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-d5ecc1e9-df9c-4bf9-87e5-da52e3e76b53 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] HTTP exception thrown: Instance 05c84048-d3a6-4711-8c32-23ef6424fa9b could not be found. Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d5ecc1e9-df9c-4bf9-87e5-da52e3e76b53 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Request method failure captured: Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/servers/05c84048-d3a6-4711-8c32-23ef6424fa9b HTTP/1.1 Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MLhn-Bo4ylHafHh51dFW-fkwl9ly4FkrYSXw1OE_OZ1ioOrZ3J3Il44TDJYO-gMynDjof26mC1LLXdQwCetWjgMAzgDSZB0yTvMmaWhWU9RJ-Dz2oaeHaLB1XWWYdIBXzOIlEv1XXfpQosuhqfWhANVnIpdNYgthh66mIxGR18yxHQ Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 839043bafeef4b8785747ca6c2e96817 Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-280661734 Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_839043bafeef4b8785747ca6c2e96817"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/839043bafeef4b8785747ca6c2e96817"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/839043bafeef4b8785747ca6c2e96817"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/839043bafeef4b8785747ca6c2e96817"}]}] Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-280661734 Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 839043bafeef4b8785747ca6c2e96817 Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-280661734 Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-FloatingIPsAssociationTestJSON-280661734-project Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: e81eea16bcfa4dc5bd66926c6a2658ba Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-280661734-project Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 05c84048-d3a6-4711-8c32-23ef6424fa9b could not be found. Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '05c84048-d3a6-4711-8c32-23ef6424fa9b'} Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05c84048-d3a6-4711-8c32-23ef6424fa9b could not be found. Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:20:29.467497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:20:29.472020 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05c84048-d3a6-4711-8c32-23ef6424fa9b could not be found. Jul 18 02:20:29.472020 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:20:29.472020 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:29.472020 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:20:29.472020 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:29.472020 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:29.472020 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:29.472020 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:20:29.472020 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:20:29.472020 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05c84048-d3a6-4711-8c32-23ef6424fa9b could not be found. Jul 18 02:20:29.472020 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:20:29.475895 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d5ecc1e9-df9c-4bf9-87e5-da52e3e76b53 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Returning 404 to user: Instance 05c84048-d3a6-4711-8c32-23ef6424fa9b could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:20:29.481107 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d5ecc1e9-df9c-4bf9-87e5-da52e3e76b53 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] 10.222.0.57 "DELETE /compute/v2.1/servers/05c84048-d3a6-4711-8c32-23ef6424fa9b" status: 404 len: 111 microversion: 2.1 time: 0.133225 Jul 18 02:20:29.486480 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1110/2241] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:20:29 2022] DELETE /compute/v2.1/servers/05c84048-d3a6-4711-8c32-23ef6424fa9b => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:20:29.506853 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-85b0be16-0165-4603-bc47-6212c446b33d tempest-VolumesTestJSON-1408624197 tempest-VolumesTestJSON-1408624197-project] Calling method '.version_select at 0x7ff4a86145e0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:29.599622 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-667a4963-500a-467d-9062-9887254cf196 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de42754291d4c43b983b425a02ea9d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ed68b2710e40f487813716ca4965e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:29.617942 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-667a4963-500a-467d-9062-9887254cf196 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] 10.222.0.57 "GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977" status: 200 len: 1294 microversion: 2.1 time: 1.091630 Jul 18 02:20:29.619493 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1132/2242] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:28 2022] GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977 => generated 1294 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:29.634892 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b506b7ea-510c-46a6-b540-18afac081c2b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:29.638456 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b506b7ea-510c-46a6-b540-18afac081c2b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:29.660324 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b506b7ea-510c-46a6-b540-18afac081c2b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:29.664007 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b506b7ea-510c-46a6-b540-18afac081c2b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:29.667703 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b506b7ea-510c-46a6-b540-18afac081c2b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:29.669935 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b506b7ea-510c-46a6-b540-18afac081c2b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:30.380977 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b506b7ea-510c-46a6-b540-18afac081c2b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:30.393252 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b506b7ea-510c-46a6-b540-18afac081c2b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:30.395720 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b506b7ea-510c-46a6-b540-18afac081c2b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:30.397377 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b506b7ea-510c-46a6-b540-18afac081c2b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1869 microversion: 2.42 time: 0.773957 Jul 18 02:20:30.398307 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1133/2243] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:29 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1869 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:30.405218 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e659f5fd-6457-4197-bcaf-227834af0401 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:30.406344 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e659f5fd-6457-4197-bcaf-227834af0401 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:30.414210 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e659f5fd-6457-4197-bcaf-227834af0401 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:30.415061 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e659f5fd-6457-4197-bcaf-227834af0401 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:30.417899 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e659f5fd-6457-4197-bcaf-227834af0401 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:30.418790 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e659f5fd-6457-4197-bcaf-227834af0401 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:30.719573 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e659f5fd-6457-4197-bcaf-227834af0401 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:30.733976 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e659f5fd-6457-4197-bcaf-227834af0401 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:30.740020 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e659f5fd-6457-4197-bcaf-227834af0401 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:30.741618 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e659f5fd-6457-4197-bcaf-227834af0401 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1250 microversion: 2.25 time: 0.342049 Jul 18 02:20:30.744722 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1134/2244] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:30 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1250 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:30.759519 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-718fb842-1f41-4c9b-8f3b-292359a1cf80 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:30.760503 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-718fb842-1f41-4c9b-8f3b-292359a1cf80 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 05c84048-d3a6-4711-8c32-23ef6424fa9b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:30.775389 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-718fb842-1f41-4c9b-8f3b-292359a1cf80 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:30.776362 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-718fb842-1f41-4c9b-8f3b-292359a1cf80 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:30.777457 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-718fb842-1f41-4c9b-8f3b-292359a1cf80 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:30.778154 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-718fb842-1f41-4c9b-8f3b-292359a1cf80 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:30.786881 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-85b0be16-0165-4603-bc47-6212c446b33d tempest-VolumesTestJSON-1408624197 tempest-VolumesTestJSON-1408624197-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 1.292175 Jul 18 02:20:30.793850 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1111/2245] 10.222.0.57 () {58 vars in 1154 bytes} [Mon Jul 18 02:20:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:30.800693 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-6735eef7-806b-4670-93a0-11d832053c9d req-a7afd344-6ee9-441f-b018-d90246aee561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36319b4f-008b-4321-ac5d-e201e50673d3", "name": "network-vif-deleted", "tag": "22552354-154e-44d7-a1ec-f329d159341f"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:30.827418 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-718fb842-1f41-4c9b-8f3b-292359a1cf80 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] HTTP exception thrown: Instance 05c84048-d3a6-4711-8c32-23ef6424fa9b could not be found. Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-718fb842-1f41-4c9b-8f3b-292359a1cf80 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Request method failure captured: Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/05c84048-d3a6-4711-8c32-23ef6424fa9b HTTP/1.1 Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MLhn-Bo4ylHafHh51dFW-fkwl9ly4FkrYSXw1OE_OZ1ioOrZ3J3Il44TDJYO-gMynDjof26mC1LLXdQwCetWjgMAzgDSZB0yTvMmaWhWU9RJ-Dz2oaeHaLB1XWWYdIBXzOIlEv1XXfpQosuhqfWhANVnIpdNYgthh66mIxGR18yxHQ Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 839043bafeef4b8785747ca6c2e96817 Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-280661734 Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_839043bafeef4b8785747ca6c2e96817"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/839043bafeef4b8785747ca6c2e96817"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/839043bafeef4b8785747ca6c2e96817"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/839043bafeef4b8785747ca6c2e96817"}]}] Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-280661734 Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 839043bafeef4b8785747ca6c2e96817 Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-280661734 Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-FloatingIPsAssociationTestJSON-280661734-project Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: e81eea16bcfa4dc5bd66926c6a2658ba Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-280661734-project Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 05c84048-d3a6-4711-8c32-23ef6424fa9b could not be found. Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '05c84048-d3a6-4711-8c32-23ef6424fa9b'} Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05c84048-d3a6-4711-8c32-23ef6424fa9b could not be found. Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05c84048-d3a6-4711-8c32-23ef6424fa9b could not be found. Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:20:30.835179 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:30.838701 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:20:30.838701 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:30.838701 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:30.838701 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:30.838701 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:20:30.838701 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:20:30.838701 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05c84048-d3a6-4711-8c32-23ef6424fa9b could not be found. Jul 18 02:20:30.838701 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:20:30.840921 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-718fb842-1f41-4c9b-8f3b-292359a1cf80 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Returning 404 to user: Instance 05c84048-d3a6-4711-8c32-23ef6424fa9b could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:20:30.846612 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-718fb842-1f41-4c9b-8f3b-292359a1cf80 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] 10.222.0.57 "GET /compute/v2.1/servers/05c84048-d3a6-4711-8c32-23ef6424fa9b" status: 404 len: 111 microversion: 2.1 time: 0.100466 Jul 18 02:20:30.847954 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1135/2246] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:30 2022] GET /compute/v2.1/servers/05c84048-d3a6-4711-8c32-23ef6424fa9b => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:20:30.854653 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-6735eef7-806b-4670-93a0-11d832053c9d req-a7afd344-6ee9-441f-b018-d90246aee561 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:30.858447 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c6ef8ae6-5b38-4f9c-8fdd-167c35ae5aa6 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:30.860787 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c6ef8ae6-5b38-4f9c-8fdd-167c35ae5aa6 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:30.864010 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-6735eef7-806b-4670-93a0-11d832053c9d req-a7afd344-6ee9-441f-b018-d90246aee561 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:30.884651 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c6ef8ae6-5b38-4f9c-8fdd-167c35ae5aa6 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:30.885219 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c6ef8ae6-5b38-4f9c-8fdd-167c35ae5aa6 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:30.886479 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c6ef8ae6-5b38-4f9c-8fdd-167c35ae5aa6 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:30.891257 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c6ef8ae6-5b38-4f9c-8fdd-167c35ae5aa6 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:30.913306 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-6735eef7-806b-4670-93a0-11d832053c9d req-a7afd344-6ee9-441f-b018-d90246aee561 service nova] Creating event network-vif-deleted:22552354-154e-44d7-a1ec-f329d159341f for instance 36319b4f-008b-4321-ac5d-e201e50673d3 on n-h2-465891-3 Jul 18 02:20:30.931786 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-6735eef7-806b-4670-93a0-11d832053c9d req-a7afd344-6ee9-441f-b018-d90246aee561 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142078 Jul 18 02:20:30.935330 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1112/2247] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:30.950962 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d3c402d7-456b-4d1b-9023-91809d8c1d70 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:30.956119 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d3c402d7-456b-4d1b-9023-91809d8c1d70 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] [instance: 896cc676-e125-4e42-992c-be94d8965977] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:30.983005 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d3c402d7-456b-4d1b-9023-91809d8c1d70 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:30.984534 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d3c402d7-456b-4d1b-9023-91809d8c1d70 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:30.986373 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d3c402d7-456b-4d1b-9023-91809d8c1d70 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:30.987320 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d3c402d7-456b-4d1b-9023-91809d8c1d70 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:31.703207 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c6ef8ae6-5b38-4f9c-8fdd-167c35ae5aa6 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:31.717177 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c6ef8ae6-5b38-4f9c-8fdd-167c35ae5aa6 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 200 len: 1184 microversion: 2.1 time: 0.867614 Jul 18 02:20:31.725149 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1136/2248] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:30 2022] GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 1184 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:31.732347 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b363ada5-2ff3-43d5-85aa-2f262494335f tempest-VolumesTestJSON-1408624197 tempest-VolumesTestJSON-1408624197-project] Calling method '.version_select at 0x7ff4a8022ca0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:32.046443 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d3c402d7-456b-4d1b-9023-91809d8c1d70 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de42754291d4c43b983b425a02ea9d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ed68b2710e40f487813716ca4965e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:32.063046 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d3c402d7-456b-4d1b-9023-91809d8c1d70 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] 10.222.0.57 "GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977" status: 200 len: 1294 microversion: 2.1 time: 1.124406 Jul 18 02:20:32.067693 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1113/2249] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:30 2022] GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977 => generated 1294 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:32.079827 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-12222541-f291-4fb8-8edd-8e4441545de2 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Calling method '.version_select at 0x7ff4a825bd30>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:34.754953 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-12222541-f291-4fb8-8edd-8e4441545de2 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] 10.222.0.57 "DELETE /compute/v2.1/os-floating-ips/78b520f1-fc5f-45e0-8e61-f9251abdce0f" status: 202 len: 0 microversion: 2.1 time: 2.685754 Jul 18 02:20:34.756818 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1114/2250] 10.222.0.57 () {58 vars in 1262 bytes} [Mon Jul 18 02:20:32 2022] DELETE /compute/v2.1/os-floating-ips/78b520f1-fc5f-45e0-8e61-f9251abdce0f => generated 0 bytes in 2688 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:20:34.764311 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cbee8ac9-cce6-4eb5-b669-b10dacdfcbc3 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:34.765803 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cbee8ac9-cce6-4eb5-b669-b10dacdfcbc3 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:34.788291 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cbee8ac9-cce6-4eb5-b669-b10dacdfcbc3 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:34.791307 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cbee8ac9-cce6-4eb5-b669-b10dacdfcbc3 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:34.796589 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cbee8ac9-cce6-4eb5-b669-b10dacdfcbc3 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:34.797580 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cbee8ac9-cce6-4eb5-b669-b10dacdfcbc3 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:35.323493 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-cbee8ac9-cce6-4eb5-b669-b10dacdfcbc3 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:35.345779 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-cbee8ac9-cce6-4eb5-b669-b10dacdfcbc3 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:35.349205 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-cbee8ac9-cce6-4eb5-b669-b10dacdfcbc3 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:35.352600 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cbee8ac9-cce6-4eb5-b669-b10dacdfcbc3 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1869 microversion: 2.42 time: 0.594157 Jul 18 02:20:35.353621 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1115/2251] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:34 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1869 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:35.361500 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-34ce2940-2370-4250-b6c9-b512f468ba1f tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:35.362601 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-34ce2940-2370-4250-b6c9-b512f468ba1f tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:35.374871 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-34ce2940-2370-4250-b6c9-b512f468ba1f tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:35.376179 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-34ce2940-2370-4250-b6c9-b512f468ba1f tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:35.378452 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-34ce2940-2370-4250-b6c9-b512f468ba1f tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:35.379844 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-34ce2940-2370-4250-b6c9-b512f468ba1f tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:35.498081 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:35.547408 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:36.290350 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-34ce2940-2370-4250-b6c9-b512f468ba1f tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:36.318370 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-34ce2940-2370-4250-b6c9-b512f468ba1f tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:36.320070 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-34ce2940-2370-4250-b6c9-b512f468ba1f tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:36.321252 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-34ce2940-2370-4250-b6c9-b512f468ba1f tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1292 microversion: 2.25 time: 0.966061 Jul 18 02:20:36.321866 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1116/2252] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:35 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1292 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:36.345600 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-37ba9f98-6041-4977-ab3c-75687598aed1 req-db52dbb3-23c6-4fa8-a2a7-c80a0d864863 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "896cc676-e125-4e42-992c-be94d8965977", "name": "network-vif-plugged", "status": "completed", "tag": "74150074-2639-48b5-9935-1a1c8780d926"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:36.385917 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-37ba9f98-6041-4977-ab3c-75687598aed1 req-db52dbb3-23c6-4fa8-a2a7-c80a0d864863 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:36.386381 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-37ba9f98-6041-4977-ab3c-75687598aed1 req-db52dbb3-23c6-4fa8-a2a7-c80a0d864863 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:36.391577 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:36.407700 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-37ba9f98-6041-4977-ab3c-75687598aed1 req-db52dbb3-23c6-4fa8-a2a7-c80a0d864863 service nova] Creating event network-vif-plugged:74150074-2639-48b5-9935-1a1c8780d926 for instance 896cc676-e125-4e42-992c-be94d8965977 on n-h1-465891-3 Jul 18 02:20:36.416449 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-37ba9f98-6041-4977-ab3c-75687598aed1 req-db52dbb3-23c6-4fa8-a2a7-c80a0d864863 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087243 Jul 18 02:20:36.416449 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1117/2253] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:36.420932 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fad69633-afd2-4f02-8f70-df88aaff8302 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:36.421827 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fad69633-afd2-4f02-8f70-df88aaff8302 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:36.429887 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fad69633-afd2-4f02-8f70-df88aaff8302 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:36.430638 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fad69633-afd2-4f02-8f70-df88aaff8302 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:36.431684 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fad69633-afd2-4f02-8f70-df88aaff8302 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:36.432315 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fad69633-afd2-4f02-8f70-df88aaff8302 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:36.545090 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fad69633-afd2-4f02-8f70-df88aaff8302 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:36.558891 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fad69633-afd2-4f02-8f70-df88aaff8302 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 200 len: 1184 microversion: 2.1 time: 0.142601 Jul 18 02:20:36.572501 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1118/2254] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:36 2022] GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 1184 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:36.578842 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1ecfca0d-cbdb-499d-8915-8575ece6f4a6 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:36.579850 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1ecfca0d-cbdb-499d-8915-8575ece6f4a6 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] [instance: 896cc676-e125-4e42-992c-be94d8965977] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:36.588129 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ecfca0d-cbdb-499d-8915-8575ece6f4a6 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:36.588967 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ecfca0d-cbdb-499d-8915-8575ece6f4a6 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:36.590284 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ecfca0d-cbdb-499d-8915-8575ece6f4a6 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:36.591153 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ecfca0d-cbdb-499d-8915-8575ece6f4a6 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:37.143202 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1ecfca0d-cbdb-499d-8915-8575ece6f4a6 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de42754291d4c43b983b425a02ea9d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ed68b2710e40f487813716ca4965e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:37.162555 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1ecfca0d-cbdb-499d-8915-8575ece6f4a6 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] 10.222.0.57 "GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977" status: 200 len: 1294 microversion: 2.1 time: 0.585834 Jul 18 02:20:37.164415 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1119/2255] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:36 2022] GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977 => generated 1294 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:37.176261 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4d33b060-9d6d-4818-b19f-9cad50f449fb tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:37.176976 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4d33b060-9d6d-4818-b19f-9cad50f449fb tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 9fa0633a-54a6-4b73-b9b0-4728a4807856] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:37.192126 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4d33b060-9d6d-4818-b19f-9cad50f449fb tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:37.193028 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4d33b060-9d6d-4818-b19f-9cad50f449fb tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:37.196091 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4d33b060-9d6d-4818-b19f-9cad50f449fb tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:37.196862 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4d33b060-9d6d-4818-b19f-9cad50f449fb tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:37.232271 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4d33b060-9d6d-4818-b19f-9cad50f449fb tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 9fa0633a-54a6-4b73-b9b0-4728a4807856] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:20:37.368831 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4d33b060-9d6d-4818-b19f-9cad50f449fb tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856" status: 204 len: 0 microversion: 2.1 time: 0.202344 Jul 18 02:20:37.370888 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1120/2256] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:20:37 2022] DELETE /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:20:37.383864 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1ac5de92-8bd5-4994-aee2-40d445438b6c tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:37.385608 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1ac5de92-8bd5-4994-aee2-40d445438b6c tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:37.398109 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ac5de92-8bd5-4994-aee2-40d445438b6c tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:37.399015 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ac5de92-8bd5-4994-aee2-40d445438b6c tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:37.400615 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ac5de92-8bd5-4994-aee2-40d445438b6c tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:37.401526 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ac5de92-8bd5-4994-aee2-40d445438b6c tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:37.721994 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1ac5de92-8bd5-4994-aee2-40d445438b6c tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:37.741653 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1ac5de92-8bd5-4994-aee2-40d445438b6c tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:37.744740 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1ac5de92-8bd5-4994-aee2-40d445438b6c tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:37.747130 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1ac5de92-8bd5-4994-aee2-40d445438b6c tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1869 microversion: 2.42 time: 0.373978 Jul 18 02:20:37.748462 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1121/2257] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:37 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1869 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:37.757423 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-105660d6-c9f0-46e6-aa53-f52984e50e0d req-a917524c-ee68-45c9-9172-617e1a9c8074 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2563fe1c-ce0c-4a16-8d70-eb578016eae9", "tag": "85a63441-1332-45c5-b28b-36162eda7e6e"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:37.773529 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-105660d6-c9f0-46e6-aa53-f52984e50e0d req-a917524c-ee68-45c9-9172-617e1a9c8074 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:37.774398 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-105660d6-c9f0-46e6-aa53-f52984e50e0d req-a917524c-ee68-45c9-9172-617e1a9c8074 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:37.799576 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-105660d6-c9f0-46e6-aa53-f52984e50e0d req-a917524c-ee68-45c9-9172-617e1a9c8074 service nova] Creating event network-changed:85a63441-1332-45c5-b28b-36162eda7e6e for instance 2563fe1c-ce0c-4a16-8d70-eb578016eae9 on n-h1-465891-3 Jul 18 02:20:37.808698 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-105660d6-c9f0-46e6-aa53-f52984e50e0d req-a917524c-ee68-45c9-9172-617e1a9c8074 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056756 Jul 18 02:20:37.810031 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1122/2258] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:37.819030 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fe68eccf-5805-49a8-929f-9cb19f0e047f tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:37.819760 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fe68eccf-5805-49a8-929f-9cb19f0e047f tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:37.827946 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fe68eccf-5805-49a8-929f-9cb19f0e047f tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:37.828687 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fe68eccf-5805-49a8-929f-9cb19f0e047f tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:37.829479 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fe68eccf-5805-49a8-929f-9cb19f0e047f tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:37.830589 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fe68eccf-5805-49a8-929f-9cb19f0e047f tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:38.114765 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fe68eccf-5805-49a8-929f-9cb19f0e047f tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:38.129888 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fe68eccf-5805-49a8-929f-9cb19f0e047f tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:38.133308 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fe68eccf-5805-49a8-929f-9cb19f0e047f tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:38.135524 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fe68eccf-5805-49a8-929f-9cb19f0e047f tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1292 microversion: 2.25 time: 0.322987 Jul 18 02:20:38.146471 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1123/2259] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:37 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1292 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:38.146471 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3cb8c6de-315c-408a-b803-27742163ceff tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:38.146471 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3cb8c6de-315c-408a-b803-27742163ceff tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 9fa0633a-54a6-4b73-b9b0-4728a4807856] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:38.155458 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3cb8c6de-315c-408a-b803-27742163ceff tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:38.156600 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3cb8c6de-315c-408a-b803-27742163ceff tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:38.158237 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3cb8c6de-315c-408a-b803-27742163ceff tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:38.158887 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3cb8c6de-315c-408a-b803-27742163ceff tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:38.392389 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3cb8c6de-315c-408a-b803-27742163ceff tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81eea16bcfa4dc5bd66926c6a2658ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839043bafeef4b8785747ca6c2e96817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:38.410655 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3cb8c6de-315c-408a-b803-27742163ceff tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] 10.222.0.57 "GET /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856" status: 200 len: 1526 microversion: 2.1 time: 0.272824 Jul 18 02:20:38.425764 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1124/2260] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:38 2022] GET /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856 => generated 1526 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:38.425764 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0a22f4b6-268c-46f8-b37a-f5afcdb77ff2 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:38.425764 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0a22f4b6-268c-46f8-b37a-f5afcdb77ff2 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:38.427478 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a22f4b6-268c-46f8-b37a-f5afcdb77ff2 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:38.427943 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a22f4b6-268c-46f8-b37a-f5afcdb77ff2 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:38.428791 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a22f4b6-268c-46f8-b37a-f5afcdb77ff2 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:38.429351 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a22f4b6-268c-46f8-b37a-f5afcdb77ff2 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:38.776418 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0a22f4b6-268c-46f8-b37a-f5afcdb77ff2 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:38.806571 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0a22f4b6-268c-46f8-b37a-f5afcdb77ff2 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 200 len: 1184 microversion: 2.1 time: 0.391895 Jul 18 02:20:38.816862 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1125/2261] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:38 2022] GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 1184 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:38.817648 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a5a794db-7572-406b-9585-90a9dc6f329c tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:38.818649 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a5a794db-7572-406b-9585-90a9dc6f329c tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] [instance: 896cc676-e125-4e42-992c-be94d8965977] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:38.845271 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a5a794db-7572-406b-9585-90a9dc6f329c tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:38.846377 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a5a794db-7572-406b-9585-90a9dc6f329c tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:38.848548 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a5a794db-7572-406b-9585-90a9dc6f329c tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:38.849185 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a5a794db-7572-406b-9585-90a9dc6f329c tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:39.480163 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a5a794db-7572-406b-9585-90a9dc6f329c tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de42754291d4c43b983b425a02ea9d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ed68b2710e40f487813716ca4965e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:39.511044 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a5a794db-7572-406b-9585-90a9dc6f329c tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] 10.222.0.57 "GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977" status: 200 len: 1485 microversion: 2.1 time: 0.700628 Jul 18 02:20:39.514671 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1126/2262] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:38 2022] GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977 => generated 1485 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:39.525113 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8690e486-6c89-4628-bd3b-7cb67bc882d3 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:39.525906 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8690e486-6c89-4628-bd3b-7cb67bc882d3 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:39.535567 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8690e486-6c89-4628-bd3b-7cb67bc882d3 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:39.536116 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8690e486-6c89-4628-bd3b-7cb67bc882d3 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:39.537109 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8690e486-6c89-4628-bd3b-7cb67bc882d3 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:39.537657 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8690e486-6c89-4628-bd3b-7cb67bc882d3 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:40.291195 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8690e486-6c89-4628-bd3b-7cb67bc882d3 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:40.316311 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8690e486-6c89-4628-bd3b-7cb67bc882d3 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:40.323236 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8690e486-6c89-4628-bd3b-7cb67bc882d3 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:40.324630 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8690e486-6c89-4628-bd3b-7cb67bc882d3 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1869 microversion: 2.42 time: 0.808346 Jul 18 02:20:40.325238 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1127/2263] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:39 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1869 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:40.334777 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d82be1b0-2355-458c-ac27-6e59c912e588 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:40.352269 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d82be1b0-2355-458c-ac27-6e59c912e588 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:40.360386 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d82be1b0-2355-458c-ac27-6e59c912e588 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:40.360842 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d82be1b0-2355-458c-ac27-6e59c912e588 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:40.361666 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d82be1b0-2355-458c-ac27-6e59c912e588 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:40.362140 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d82be1b0-2355-458c-ac27-6e59c912e588 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:40.683278 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d82be1b0-2355-458c-ac27-6e59c912e588 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:40.698203 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d82be1b0-2355-458c-ac27-6e59c912e588 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:40.700091 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d82be1b0-2355-458c-ac27-6e59c912e588 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:40.704827 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d82be1b0-2355-458c-ac27-6e59c912e588 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1292 microversion: 2.25 time: 0.376299 Jul 18 02:20:40.718300 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1128/2264] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:40 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1292 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:40.729364 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-737d5c0e-4f31-4ce6-90b6-2bc969bb8b4c tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:40.732415 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-737d5c0e-4f31-4ce6-90b6-2bc969bb8b4c tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 9fa0633a-54a6-4b73-b9b0-4728a4807856] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:40.749153 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-737d5c0e-4f31-4ce6-90b6-2bc969bb8b4c tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:40.749632 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-737d5c0e-4f31-4ce6-90b6-2bc969bb8b4c tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:40.750510 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-737d5c0e-4f31-4ce6-90b6-2bc969bb8b4c tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:40.753392 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-737d5c0e-4f31-4ce6-90b6-2bc969bb8b4c tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:40.885180 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=22 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:41.050603 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b363ada5-2ff3-43d5-85aa-2f262494335f tempest-VolumesTestJSON-1408624197 tempest-VolumesTestJSON-1408624197-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 9.322949 Jul 18 02:20:41.057204 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1137/2265] 10.222.0.57 () {58 vars in 1187 bytes} [Mon Jul 18 02:20:31 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 9330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:41.085571 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-71146f4d-d254-4f88-973e-7d262a7c33f9 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:41.086670 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-71146f4d-d254-4f88-973e-7d262a7c33f9 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] [instance: 896cc676-e125-4e42-992c-be94d8965977] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:41.120239 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-71146f4d-d254-4f88-973e-7d262a7c33f9 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:41.132990 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-71146f4d-d254-4f88-973e-7d262a7c33f9 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:41.136161 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-71146f4d-d254-4f88-973e-7d262a7c33f9 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:41.138826 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-71146f4d-d254-4f88-973e-7d262a7c33f9 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:41.406426 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-71146f4d-d254-4f88-973e-7d262a7c33f9 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] 10.222.0.57 "GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.343247 Jul 18 02:20:41.418491 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1138/2266] 10.222.0.57 () {58 vars in 1274 bytes} [Mon Jul 18 02:20:41 2022] GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977/os-interface => generated 284 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:41.449219 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-20afd609-9688-445f-9c1e-f79b7ea27698 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:41.450308 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-20afd609-9688-445f-9c1e-f79b7ea27698 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:41.516244 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20afd609-9688-445f-9c1e-f79b7ea27698 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:41.517292 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20afd609-9688-445f-9c1e-f79b7ea27698 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:41.518794 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20afd609-9688-445f-9c1e-f79b7ea27698 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:41.519587 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20afd609-9688-445f-9c1e-f79b7ea27698 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:42.435355 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-20afd609-9688-445f-9c1e-f79b7ea27698 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:42.459006 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-20afd609-9688-445f-9c1e-f79b7ea27698 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 200 len: 1184 microversion: 2.1 time: 1.039162 Jul 18 02:20:42.471022 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1139/2267] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:41 2022] GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 1184 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:42.477646 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6ff430a0-08b8-43d7-a804-30f102da92bf tempest-VolumesTestJSON-1408624197 tempest-VolumesTestJSON-1408624197-project] Calling method '.version_select at 0x7ff4a8022310>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:42.725088 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-737d5c0e-4f31-4ce6-90b6-2bc969bb8b4c tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81eea16bcfa4dc5bd66926c6a2658ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839043bafeef4b8785747ca6c2e96817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:42.757007 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-737d5c0e-4f31-4ce6-90b6-2bc969bb8b4c tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] 10.222.0.57 "GET /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856" status: 200 len: 1526 microversion: 2.1 time: 2.029143 Jul 18 02:20:42.772409 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1129/2268] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:40 2022] GET /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856 => generated 1526 bytes in 2053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:42.799090 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b35bcc5e-41d0-4d09-abf1-67d8872485ed tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:42.802905 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b35bcc5e-41d0-4d09-abf1-67d8872485ed tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:42.845425 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b35bcc5e-41d0-4d09-abf1-67d8872485ed tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:42.848525 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b35bcc5e-41d0-4d09-abf1-67d8872485ed tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:42.854577 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b35bcc5e-41d0-4d09-abf1-67d8872485ed tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:42.855354 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6ff430a0-08b8-43d7-a804-30f102da92bf tempest-VolumesTestJSON-1408624197 tempest-VolumesTestJSON-1408624197-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.382553 Jul 18 02:20:42.856543 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1140/2269] 10.222.0.57 () {58 vars in 1154 bytes} [Mon Jul 18 02:20:42 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:42.860927 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b35bcc5e-41d0-4d09-abf1-67d8872485ed tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:42.889123 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-eb298e45-022f-480a-bfc9-6348980bd633 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:42.892026 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-eb298e45-022f-480a-bfc9-6348980bd633 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:42.937597 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eb298e45-022f-480a-bfc9-6348980bd633 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:42.939160 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eb298e45-022f-480a-bfc9-6348980bd633 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:42.941006 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eb298e45-022f-480a-bfc9-6348980bd633 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:42.943834 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eb298e45-022f-480a-bfc9-6348980bd633 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:43.903594 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-eb298e45-022f-480a-bfc9-6348980bd633 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:43.936698 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-eb298e45-022f-480a-bfc9-6348980bd633 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:43.941035 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-eb298e45-022f-480a-bfc9-6348980bd633 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:43.943527 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-eb298e45-022f-480a-bfc9-6348980bd633 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1292 microversion: 2.25 time: 1.084861 Jul 18 02:20:43.946943 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1141/2270] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:42 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1292 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:43.986553 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-ecc58731-4523-4b9f-83a6-21bcd92bdad5 req-749bb6d1-8a52-4214-a23d-15b6fee8bacf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fa0633a-54a6-4b73-b9b0-4728a4807856", "name": "network-vif-deleted", "tag": "ee9f4c78-62bc-4a6d-9904-38efa10900ec"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:44.054956 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b35bcc5e-41d0-4d09-abf1-67d8872485ed tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:44.060557 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-ecc58731-4523-4b9f-83a6-21bcd92bdad5 req-749bb6d1-8a52-4214-a23d-15b6fee8bacf service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:44.062617 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-ecc58731-4523-4b9f-83a6-21bcd92bdad5 req-749bb6d1-8a52-4214-a23d-15b6fee8bacf service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:44.077462 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b35bcc5e-41d0-4d09-abf1-67d8872485ed tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:44.079708 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b35bcc5e-41d0-4d09-abf1-67d8872485ed tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:44.087643 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b35bcc5e-41d0-4d09-abf1-67d8872485ed tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1869 microversion: 2.42 time: 1.300711 Jul 18 02:20:44.100778 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1130/2271] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:42 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1869 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:44.108793 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-ecc58731-4523-4b9f-83a6-21bcd92bdad5 req-749bb6d1-8a52-4214-a23d-15b6fee8bacf service nova] Creating event network-vif-deleted:ee9f4c78-62bc-4a6d-9904-38efa10900ec for instance 9fa0633a-54a6-4b73-b9b0-4728a4807856 on n-h2-465891-3 Jul 18 02:20:44.113046 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8b037675-3d4f-45f1-bb66-93374496e9c5 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:44.117006 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8b037675-3d4f-45f1-bb66-93374496e9c5 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] [instance: 0f30e76e-91e9-441f-b482-28de008a5e40] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:44.131990 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-ecc58731-4523-4b9f-83a6-21bcd92bdad5 req-749bb6d1-8a52-4214-a23d-15b6fee8bacf service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178498 Jul 18 02:20:44.135594 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8b037675-3d4f-45f1-bb66-93374496e9c5 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:44.136999 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8b037675-3d4f-45f1-bb66-93374496e9c5 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:44.139824 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1142/2272] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:44.140979 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8b037675-3d4f-45f1-bb66-93374496e9c5 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:44.142002 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8b037675-3d4f-45f1-bb66-93374496e9c5 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:44.168121 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c3aa32fb-2a1f-4929-8b85-8711cca90195 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:44.178946 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c3aa32fb-2a1f-4929-8b85-8711cca90195 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 36319b4f-008b-4321-ac5d-e201e50673d3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:44.212966 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c3aa32fb-2a1f-4929-8b85-8711cca90195 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:44.215218 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c3aa32fb-2a1f-4929-8b85-8711cca90195 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:44.216730 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c3aa32fb-2a1f-4929-8b85-8711cca90195 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:44.219880 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c3aa32fb-2a1f-4929-8b85-8711cca90195 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:44.258335 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-c3aa32fb-2a1f-4929-8b85-8711cca90195 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] HTTP exception thrown: Instance 36319b4f-008b-4321-ac5d-e201e50673d3 could not be found. Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c3aa32fb-2a1f-4929-8b85-8711cca90195 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Request method failure captured: Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 HTTP/1.1 Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MDxoIhYq-PuyDMFlQXpvNK2aUuzIqTYrptsOrKN4PRdQI3jif23F4uYig_PuKVXcsu8K3Abm9mAq_5FRRgTYbl1azkwUdzQa6ZC79fQpoio58iE72vUHSVbA38_URTvTgS_u5xLWglb1rnFLdm8_0kGQCYgVr34-6JeM0w6r8oCu94 Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: e382977cb6bf4f358fb3245cb3768140 Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-LiveMigrationTest-1548530922 Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e382977cb6bf4f358fb3245cb3768140"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e382977cb6bf4f358fb3245cb3768140"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e382977cb6bf4f358fb3245cb3768140"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e382977cb6bf4f358fb3245cb3768140"}]}] Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-LiveMigrationTest-1548530922 Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: e382977cb6bf4f358fb3245cb3768140 Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-LiveMigrationTest-1548530922 Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-LiveMigrationTest-1548530922-project Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 77381e85d31a4747acb08a8d4572eb1b Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-LiveMigrationTest-1548530922-project Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 36319b4f-008b-4321-ac5d-e201e50673d3 could not be found. Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '36319b4f-008b-4321-ac5d-e201e50673d3'} Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36319b4f-008b-4321-ac5d-e201e50673d3 could not be found. Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36319b4f-008b-4321-ac5d-e201e50673d3 could not be found. Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:44.260165 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:20:44.266394 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:44.266394 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:44.266394 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:44.266394 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:20:44.266394 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:20:44.266394 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36319b4f-008b-4321-ac5d-e201e50673d3 could not be found. Jul 18 02:20:44.266394 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:20:44.266394 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c3aa32fb-2a1f-4929-8b85-8711cca90195 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Returning 404 to user: Instance 36319b4f-008b-4321-ac5d-e201e50673d3 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:20:44.266394 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c3aa32fb-2a1f-4929-8b85-8711cca90195 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3" status: 404 len: 111 microversion: 2.1 time: 0.116338 Jul 18 02:20:44.268325 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1143/2273] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:44 2022] GET /compute/v2.1/servers/36319b4f-008b-4321-ac5d-e201e50673d3 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:20:44.293252 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8b037675-3d4f-45f1-bb66-93374496e9c5 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] 10.222.0.57 "GET /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.185202 Jul 18 02:20:44.302817 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1131/2274] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:20:44 2022] GET /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:44.321823 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e60892a6-0fd9-4034-835c-35976ae7fd72 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:44.322672 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e60892a6-0fd9-4034-835c-35976ae7fd72 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] [instance: 9fa0633a-54a6-4b73-b9b0-4728a4807856] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:44.361037 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e60892a6-0fd9-4034-835c-35976ae7fd72 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:44.361616 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e60892a6-0fd9-4034-835c-35976ae7fd72 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:44.367060 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-192cf44e-13ad-4863-a7c2-29e14d297479 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:44.370451 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e60892a6-0fd9-4034-835c-35976ae7fd72 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:44.370715 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-192cf44e-13ad-4863-a7c2-29e14d297479 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] [instance: 0f30e76e-91e9-441f-b482-28de008a5e40] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:44.380582 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e60892a6-0fd9-4034-835c-35976ae7fd72 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:44.422246 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-192cf44e-13ad-4863-a7c2-29e14d297479 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:44.425560 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-192cf44e-13ad-4863-a7c2-29e14d297479 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:44.431462 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-e60892a6-0fd9-4034-835c-35976ae7fd72 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] HTTP exception thrown: Instance 9fa0633a-54a6-4b73-b9b0-4728a4807856 could not be found. Jul 18 02:20:44.432969 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-192cf44e-13ad-4863-a7c2-29e14d297479 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:44.440873 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-192cf44e-13ad-4863-a7c2-29e14d297479 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e60892a6-0fd9-4034-835c-35976ae7fd72 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Request method failure captured: Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856 HTTP/1.1 Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MLhn-Bo4ylHafHh51dFW-fkwl9ly4FkrYSXw1OE_OZ1ioOrZ3J3Il44TDJYO-gMynDjof26mC1LLXdQwCetWjgMAzgDSZB0yTvMmaWhWU9RJ-Dz2oaeHaLB1XWWYdIBXzOIlEv1XXfpQosuhqfWhANVnIpdNYgthh66mIxGR18yxHQ Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 839043bafeef4b8785747ca6c2e96817 Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-280661734 Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_839043bafeef4b8785747ca6c2e96817"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/839043bafeef4b8785747ca6c2e96817"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/839043bafeef4b8785747ca6c2e96817"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/839043bafeef4b8785747ca6c2e96817"}]}] Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-280661734 Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 839043bafeef4b8785747ca6c2e96817 Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-280661734 Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-FloatingIPsAssociationTestJSON-280661734-project Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: e81eea16bcfa4dc5bd66926c6a2658ba Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-280661734-project Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 9fa0633a-54a6-4b73-b9b0-4728a4807856 could not be found. Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '9fa0633a-54a6-4b73-b9b0-4728a4807856'} Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fa0633a-54a6-4b73-b9b0-4728a4807856 could not be found. Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fa0633a-54a6-4b73-b9b0-4728a4807856 could not be found. Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:20:44.444821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:44.448963 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:20:44.448963 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:44.448963 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:44.448963 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:44.448963 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:20:44.448963 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:20:44.448963 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fa0633a-54a6-4b73-b9b0-4728a4807856 could not be found. Jul 18 02:20:44.448963 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:20:44.452617 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e60892a6-0fd9-4034-835c-35976ae7fd72 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] Returning 404 to user: Instance 9fa0633a-54a6-4b73-b9b0-4728a4807856 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:20:44.455193 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e60892a6-0fd9-4034-835c-35976ae7fd72 tempest-FloatingIPsAssociationTestJSON-280661734 tempest-FloatingIPsAssociationTestJSON-280661734-project] 10.222.0.57 "GET /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856" status: 404 len: 111 microversion: 2.1 time: 0.185525 Jul 18 02:20:44.461763 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1144/2275] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:44 2022] GET /compute/v2.1/servers/9fa0633a-54a6-4b73-b9b0-4728a4807856 => generated 111 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:20:44.972613 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3ff1cd79-4dcd-4ada-8f04-8fa42da0e4fd tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:44.986025 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3ff1cd79-4dcd-4ada-8f04-8fa42da0e4fd tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:45.040095 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3ff1cd79-4dcd-4ada-8f04-8fa42da0e4fd tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:45.041994 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3ff1cd79-4dcd-4ada-8f04-8fa42da0e4fd tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:45.050155 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3ff1cd79-4dcd-4ada-8f04-8fa42da0e4fd tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:45.054692 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3ff1cd79-4dcd-4ada-8f04-8fa42da0e4fd tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:45.058751 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=81,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:45.181739 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-192cf44e-13ad-4863-a7c2-29e14d297479 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lazy-loading 'services' on Instance uuid 0f30e76e-91e9-441f-b482-28de008a5e40 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:20:45.448877 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:45.477729 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-192cf44e-13ad-4863-a7c2-29e14d297479 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] 10.222.0.57 "DELETE /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40/os-volume_attachments/5fda4952-6782-453c-8872-e9a9aaaaa6b8" status: 202 len: 0 microversion: 2.1 time: 1.166452 Jul 18 02:20:45.479347 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1132/2276] 10.222.0.57 () {58 vars in 1415 bytes} [Mon Jul 18 02:20:44 2022] DELETE /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40/os-volume_attachments/5fda4952-6782-453c-8872-e9a9aaaaa6b8 => generated 0 bytes in 1169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:20:45.496347 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-69bb3541-f6a2-4855-ba6b-cd13580d9f94 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:45.497282 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-69bb3541-f6a2-4855-ba6b-cd13580d9f94 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:45.511723 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:45.518330 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69bb3541-f6a2-4855-ba6b-cd13580d9f94 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:45.520563 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69bb3541-f6a2-4855-ba6b-cd13580d9f94 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:45.523130 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69bb3541-f6a2-4855-ba6b-cd13580d9f94 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:45.525332 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69bb3541-f6a2-4855-ba6b-cd13580d9f94 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:46.602393 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3ff1cd79-4dcd-4ada-8f04-8fa42da0e4fd tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:46.643938 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3ff1cd79-4dcd-4ada-8f04-8fa42da0e4fd tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:46.647649 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3ff1cd79-4dcd-4ada-8f04-8fa42da0e4fd tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:46.650388 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3ff1cd79-4dcd-4ada-8f04-8fa42da0e4fd tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1292 microversion: 2.25 time: 1.687659 Jul 18 02:20:46.654401 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1145/2277] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:44 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1292 bytes in 1693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:20:46.792785 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-69bb3541-f6a2-4855-ba6b-cd13580d9f94 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:46.831544 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-69bb3541-f6a2-4855-ba6b-cd13580d9f94 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:46.843768 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-69bb3541-f6a2-4855-ba6b-cd13580d9f94 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:46.849605 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-69bb3541-f6a2-4855-ba6b-cd13580d9f94 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1869 microversion: 2.42 time: 1.366838 Jul 18 02:20:46.854432 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1133/2278] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:45 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1869 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:47.177293 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dc7e37d4-7ae2-4aa2-9cec-cc788bcc5798 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:47.179079 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-dc7e37d4-7ae2-4aa2-9cec-cc788bcc5798 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] [instance: 896cc676-e125-4e42-992c-be94d8965977] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:47.197152 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-e80414ca-c178-4762-835d-030c1dfec0b0 req-904a7c2d-26d1-4f53-a014-163f186dabd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "896cc676-e125-4e42-992c-be94d8965977", "tag": "74150074-2639-48b5-9935-1a1c8780d926"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:47.199035 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dc7e37d4-7ae2-4aa2-9cec-cc788bcc5798 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:47.200151 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dc7e37d4-7ae2-4aa2-9cec-cc788bcc5798 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:47.202567 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dc7e37d4-7ae2-4aa2-9cec-cc788bcc5798 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:47.203949 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dc7e37d4-7ae2-4aa2-9cec-cc788bcc5798 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:47.236718 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-e80414ca-c178-4762-835d-030c1dfec0b0 req-904a7c2d-26d1-4f53-a014-163f186dabd6 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:47.237478 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-e80414ca-c178-4762-835d-030c1dfec0b0 req-904a7c2d-26d1-4f53-a014-163f186dabd6 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:47.301933 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-e80414ca-c178-4762-835d-030c1dfec0b0 req-904a7c2d-26d1-4f53-a014-163f186dabd6 service nova] Creating event network-changed:74150074-2639-48b5-9935-1a1c8780d926 for instance 896cc676-e125-4e42-992c-be94d8965977 on n-h1-465891-3 Jul 18 02:20:47.324759 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-e80414ca-c178-4762-835d-030c1dfec0b0 req-904a7c2d-26d1-4f53-a014-163f186dabd6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136511 Jul 18 02:20:47.332012 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1134/2279] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:20:47.675611 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7d0a0128-516a-4196-b090-7896f5376c56 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:47.679738 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7d0a0128-516a-4196-b090-7896f5376c56 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:47.706160 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7d0a0128-516a-4196-b090-7896f5376c56 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:47.708432 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7d0a0128-516a-4196-b090-7896f5376c56 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:47.710172 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7d0a0128-516a-4196-b090-7896f5376c56 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:47.712652 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7d0a0128-516a-4196-b090-7896f5376c56 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:48.474113 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-dc7e37d4-7ae2-4aa2-9cec-cc788bcc5798 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de42754291d4c43b983b425a02ea9d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ed68b2710e40f487813716ca4965e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:48.496111 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-dc7e37d4-7ae2-4aa2-9cec-cc788bcc5798 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] 10.222.0.57 "GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977" status: 200 len: 1485 microversion: 2.1 time: 1.330091 Jul 18 02:20:48.500166 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1146/2280] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:47 2022] GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977 => generated 1485 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:48.509942 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2fcd06b1-a71a-4c63-b623-e38f31074b90 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:48.515341 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2fcd06b1-a71a-4c63-b623-e38f31074b90 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:48.535024 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2fcd06b1-a71a-4c63-b623-e38f31074b90 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:48.535762 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2fcd06b1-a71a-4c63-b623-e38f31074b90 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:48.536795 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2fcd06b1-a71a-4c63-b623-e38f31074b90 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:48.537433 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2fcd06b1-a71a-4c63-b623-e38f31074b90 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:48.750514 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7d0a0128-516a-4196-b090-7896f5376c56 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:48.761616 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7d0a0128-516a-4196-b090-7896f5376c56 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:48.775805 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7d0a0128-516a-4196-b090-7896f5376c56 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:48.777437 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7d0a0128-516a-4196-b090-7896f5376c56 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1280 microversion: 2.25 time: 1.110287 Jul 18 02:20:48.778248 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1135/2281] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:47 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1280 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:20:49.300785 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2fcd06b1-a71a-4c63-b623-e38f31074b90 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:49.315632 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2fcd06b1-a71a-4c63-b623-e38f31074b90 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:49.321062 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2fcd06b1-a71a-4c63-b623-e38f31074b90 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:49.335302 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2fcd06b1-a71a-4c63-b623-e38f31074b90 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1869 microversion: 2.42 time: 0.833287 Jul 18 02:20:49.336331 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1147/2282] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:48 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1869 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:49.810327 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-43801c41-9b9a-4324-93b6-584237209ae1 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:49.812500 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-43801c41-9b9a-4324-93b6-584237209ae1 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:49.855644 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-43801c41-9b9a-4324-93b6-584237209ae1 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:49.856546 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-43801c41-9b9a-4324-93b6-584237209ae1 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:49.858252 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-43801c41-9b9a-4324-93b6-584237209ae1 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:49.859022 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-43801c41-9b9a-4324-93b6-584237209ae1 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:50.372342 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e98e4b71-50ab-445e-a4a5-fa1becda148e tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:50.374177 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e98e4b71-50ab-445e-a4a5-fa1becda148e tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:50.384808 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e98e4b71-50ab-445e-a4a5-fa1becda148e tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:50.385290 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e98e4b71-50ab-445e-a4a5-fa1becda148e tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:50.403263 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e98e4b71-50ab-445e-a4a5-fa1becda148e tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:50.403786 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e98e4b71-50ab-445e-a4a5-fa1becda148e tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:51.265004 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e98e4b71-50ab-445e-a4a5-fa1becda148e tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:51.289453 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e98e4b71-50ab-445e-a4a5-fa1becda148e tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:51.291610 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e98e4b71-50ab-445e-a4a5-fa1becda148e tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:51.300849 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-43801c41-9b9a-4324-93b6-584237209ae1 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:51.311319 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-43801c41-9b9a-4324-93b6-584237209ae1 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:51.317218 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e98e4b71-50ab-445e-a4a5-fa1becda148e tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1869 microversion: 2.42 time: 0.948747 Jul 18 02:20:51.319497 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-43801c41-9b9a-4324-93b6-584237209ae1 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:51.320504 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1148/2283] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:50 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1869 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:20:51.330481 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-43801c41-9b9a-4324-93b6-584237209ae1 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1280 microversion: 2.25 time: 1.524855 Jul 18 02:20:51.335256 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1136/2284] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:49 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1280 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:20:52.341261 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0e579d12-1148-4569-bfaf-1f5ed3803070 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:52.343069 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0e579d12-1148-4569-bfaf-1f5ed3803070 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:52.371892 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bcb3f198-1e94-42db-a107-64bee1ee6192 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:52.372773 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bcb3f198-1e94-42db-a107-64bee1ee6192 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:52.387945 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0e579d12-1148-4569-bfaf-1f5ed3803070 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:52.392310 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bcb3f198-1e94-42db-a107-64bee1ee6192 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:52.403181 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0e579d12-1148-4569-bfaf-1f5ed3803070 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:52.403971 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bcb3f198-1e94-42db-a107-64bee1ee6192 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:52.405677 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0e579d12-1148-4569-bfaf-1f5ed3803070 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:52.406793 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bcb3f198-1e94-42db-a107-64bee1ee6192 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:52.409668 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bcb3f198-1e94-42db-a107-64bee1ee6192 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:52.411319 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0e579d12-1148-4569-bfaf-1f5ed3803070 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:54.662460 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0e579d12-1148-4569-bfaf-1f5ed3803070 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:54.673364 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0e579d12-1148-4569-bfaf-1f5ed3803070 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:54.689687 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0e579d12-1148-4569-bfaf-1f5ed3803070 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:54.695751 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0e579d12-1148-4569-bfaf-1f5ed3803070 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1869 microversion: 2.42 time: 2.359032 Jul 18 02:20:54.696970 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1149/2285] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:52 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1869 bytes in 2361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:54.808060 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bcb3f198-1e94-42db-a107-64bee1ee6192 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:54.825365 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bcb3f198-1e94-42db-a107-64bee1ee6192 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:54.828689 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bcb3f198-1e94-42db-a107-64bee1ee6192 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:54.835748 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bcb3f198-1e94-42db-a107-64bee1ee6192 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1280 microversion: 2.25 time: 2.468113 Jul 18 02:20:54.837029 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1137/2286] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:52 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1280 bytes in 2470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:20:55.731657 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4dfb65b2-cb5c-4a2d-b402-e8cd3a0eba47 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:55.733563 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4dfb65b2-cb5c-4a2d-b402-e8cd3a0eba47 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:55.744775 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4dfb65b2-cb5c-4a2d-b402-e8cd3a0eba47 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:55.751501 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4dfb65b2-cb5c-4a2d-b402-e8cd3a0eba47 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:55.752773 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4dfb65b2-cb5c-4a2d-b402-e8cd3a0eba47 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:55.753450 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4dfb65b2-cb5c-4a2d-b402-e8cd3a0eba47 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:55.876467 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ae8ccef4-7be9-47c1-9f7c-3919bccd3149 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:55.877910 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ae8ccef4-7be9-47c1-9f7c-3919bccd3149 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:55.898972 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ae8ccef4-7be9-47c1-9f7c-3919bccd3149 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:55.899989 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ae8ccef4-7be9-47c1-9f7c-3919bccd3149 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:55.901117 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ae8ccef4-7be9-47c1-9f7c-3919bccd3149 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:55.905390 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ae8ccef4-7be9-47c1-9f7c-3919bccd3149 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:56.888819 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4dfb65b2-cb5c-4a2d-b402-e8cd3a0eba47 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:56.916860 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4dfb65b2-cb5c-4a2d-b402-e8cd3a0eba47 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:56.929407 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4dfb65b2-cb5c-4a2d-b402-e8cd3a0eba47 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:56.934133 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4dfb65b2-cb5c-4a2d-b402-e8cd3a0eba47 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1869 microversion: 2.42 time: 1.206660 Jul 18 02:20:56.937120 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1150/2287] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:55 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1869 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:20:57.005495 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ae8ccef4-7be9-47c1-9f7c-3919bccd3149 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:57.042506 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ae8ccef4-7be9-47c1-9f7c-3919bccd3149 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:57.048926 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ae8ccef4-7be9-47c1-9f7c-3919bccd3149 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:57.060906 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ae8ccef4-7be9-47c1-9f7c-3919bccd3149 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1280 microversion: 2.25 time: 1.190359 Jul 18 02:20:57.077738 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1138/2288] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:55 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1280 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:57.976180 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1cbcf36e-3790-442e-9dd7-6b54b96d5b4e tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:57.977080 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1cbcf36e-3790-442e-9dd7-6b54b96d5b4e tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:58.009806 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1cbcf36e-3790-442e-9dd7-6b54b96d5b4e tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:58.016474 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1cbcf36e-3790-442e-9dd7-6b54b96d5b4e tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:58.025870 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1cbcf36e-3790-442e-9dd7-6b54b96d5b4e tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:58.026600 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1cbcf36e-3790-442e-9dd7-6b54b96d5b4e tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:58.114459 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-10402139-0841-4277-adae-47399953cc29 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:58.116758 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-10402139-0841-4277-adae-47399953cc29 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:58.164576 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-10402139-0841-4277-adae-47399953cc29 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:58.174287 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-10402139-0841-4277-adae-47399953cc29 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:58.181166 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-10402139-0841-4277-adae-47399953cc29 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:58.182557 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-10402139-0841-4277-adae-47399953cc29 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:59.216315 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1cbcf36e-3790-442e-9dd7-6b54b96d5b4e tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:59.256838 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1cbcf36e-3790-442e-9dd7-6b54b96d5b4e tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:59.273128 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-10402139-0841-4277-adae-47399953cc29 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:59.275589 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1cbcf36e-3790-442e-9dd7-6b54b96d5b4e tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:59.282036 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1cbcf36e-3790-442e-9dd7-6b54b96d5b4e tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1869 microversion: 2.42 time: 1.316905 Jul 18 02:20:59.287381 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1151/2289] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:57 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1869 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:59.297783 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-10402139-0841-4277-adae-47399953cc29 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:59.300794 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-10402139-0841-4277-adae-47399953cc29 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:59.307885 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c7c73a0f-89be-4e98-93d2-2324005eb908 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:59.313823 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-10402139-0841-4277-adae-47399953cc29 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1280 microversion: 2.25 time: 1.214887 Jul 18 02:20:59.314943 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c7c73a0f-89be-4e98-93d2-2324005eb908 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:59.339786 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1139/2290] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:58 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1280 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:59.349117 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c7c73a0f-89be-4e98-93d2-2324005eb908 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:59.352676 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c7c73a0f-89be-4e98-93d2-2324005eb908 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:59.355533 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c7c73a0f-89be-4e98-93d2-2324005eb908 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:59.359539 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c7c73a0f-89be-4e98-93d2-2324005eb908 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:59.539128 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c7c73a0f-89be-4e98-93d2-2324005eb908 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:20:59.929416 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c7c73a0f-89be-4e98-93d2-2324005eb908 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "DELETE /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 204 len: 0 microversion: 2.1 time: 0.639977 Jul 18 02:20:59.930445 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1152/2291] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:20:59 2022] DELETE /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 0 bytes in 642 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:20:59.948726 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a57b3d10-0ec2-4f5a-aa00-d3839471eb43 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:59.955655 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a57b3d10-0ec2-4f5a-aa00-d3839471eb43 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:00.034994 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a57b3d10-0ec2-4f5a-aa00-d3839471eb43 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:00.035639 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a57b3d10-0ec2-4f5a-aa00-d3839471eb43 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:00.046205 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a57b3d10-0ec2-4f5a-aa00-d3839471eb43 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:00.047054 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a57b3d10-0ec2-4f5a-aa00-d3839471eb43 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:00.317686 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7044adf3-4bfa-4753-a331-a489ac82f93a tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:00.318573 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7044adf3-4bfa-4753-a331-a489ac82f93a tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:00.346899 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7044adf3-4bfa-4753-a331-a489ac82f93a tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:00.351435 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7044adf3-4bfa-4753-a331-a489ac82f93a tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:00.361257 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7044adf3-4bfa-4753-a331-a489ac82f93a tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:00.363526 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7044adf3-4bfa-4753-a331-a489ac82f93a tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:02.071330 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a57b3d10-0ec2-4f5a-aa00-d3839471eb43 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:02.118554 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a57b3d10-0ec2-4f5a-aa00-d3839471eb43 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 200 len: 1666 microversion: 2.1 time: 2.180562 Jul 18 02:21:02.125326 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1140/2292] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:59 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 1666 bytes in 2190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:21:02.152621 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d195d080-0c06-4008-9f05-360db601a95d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:02.159252 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d195d080-0c06-4008-9f05-360db601a95d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:02.191938 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d195d080-0c06-4008-9f05-360db601a95d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:02.195984 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d195d080-0c06-4008-9f05-360db601a95d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:02.203211 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d195d080-0c06-4008-9f05-360db601a95d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:02.208268 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d195d080-0c06-4008-9f05-360db601a95d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:02.314625 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7044adf3-4bfa-4753-a331-a489ac82f93a tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:02.332900 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7044adf3-4bfa-4753-a331-a489ac82f93a tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:02.339228 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7044adf3-4bfa-4753-a331-a489ac82f93a tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:02.343294 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7044adf3-4bfa-4753-a331-a489ac82f93a tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1869 microversion: 2.42 time: 2.032062 Jul 18 02:21:02.349005 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1153/2293] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:00 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1869 bytes in 2041 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:21:02.365138 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-26b94185-1855-49f9-b2ff-57ac168e21da req-1f682c3b-9171-43f5-869f-559dc8e87346 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b909490f-2890-43c0-b956-9de562d52d67", "name": "network-vif-plugged", "status": "completed", "tag": "e55a6513-6292-448a-b056-14ca8f284b1b"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:02.390111 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-26b94185-1855-49f9-b2ff-57ac168e21da req-1f682c3b-9171-43f5-869f-559dc8e87346 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:02.394287 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-26b94185-1855-49f9-b2ff-57ac168e21da req-1f682c3b-9171-43f5-869f-559dc8e87346 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:02.462915 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-26b94185-1855-49f9-b2ff-57ac168e21da req-1f682c3b-9171-43f5-869f-559dc8e87346 service nova] Creating event network-vif-plugged:e55a6513-6292-448a-b056-14ca8f284b1b for instance b909490f-2890-43c0-b956-9de562d52d67 on n-h2-465891-3 Jul 18 02:21:02.489185 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-26b94185-1855-49f9-b2ff-57ac168e21da req-1f682c3b-9171-43f5-869f-559dc8e87346 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137735 Jul 18 02:21:02.494360 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1154/2294] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:03.145833 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a9ddcb41-ded4-4982-9ff1-ca58d82d5249 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:03.147491 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a9ddcb41-ded4-4982-9ff1-ca58d82d5249 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:03.159390 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9ddcb41-ded4-4982-9ff1-ca58d82d5249 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:03.160244 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9ddcb41-ded4-4982-9ff1-ca58d82d5249 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:03.163710 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9ddcb41-ded4-4982-9ff1-ca58d82d5249 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:03.164453 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9ddcb41-ded4-4982-9ff1-ca58d82d5249 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:03.213358 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d195d080-0c06-4008-9f05-360db601a95d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:03.248418 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d195d080-0c06-4008-9f05-360db601a95d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:03.251843 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d195d080-0c06-4008-9f05-360db601a95d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:03.260917 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d195d080-0c06-4008-9f05-360db601a95d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1280 microversion: 2.25 time: 1.124521 Jul 18 02:21:03.262542 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1141/2295] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:02 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1280 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:03.385659 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0a8ce705-374d-41ed-a158-7cdfd98d6d94 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:03.394441 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0a8ce705-374d-41ed-a158-7cdfd98d6d94 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:03.424326 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a8ce705-374d-41ed-a158-7cdfd98d6d94 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:03.425153 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a8ce705-374d-41ed-a158-7cdfd98d6d94 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:03.426679 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a8ce705-374d-41ed-a158-7cdfd98d6d94 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:03.427442 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a8ce705-374d-41ed-a158-7cdfd98d6d94 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:04.768975 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a9ddcb41-ded4-4982-9ff1-ca58d82d5249 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:04.789644 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a9ddcb41-ded4-4982-9ff1-ca58d82d5249 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 200 len: 1666 microversion: 2.1 time: 1.652397 Jul 18 02:21:04.793160 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1155/2296] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:03 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 1666 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:21:04.824273 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1f9dcc1a-6a05-4e29-83dc-4c556f049dc2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:04.828208 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1f9dcc1a-6a05-4e29-83dc-4c556f049dc2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:04.846754 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1f9dcc1a-6a05-4e29-83dc-4c556f049dc2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:04.848632 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1f9dcc1a-6a05-4e29-83dc-4c556f049dc2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:04.850565 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1f9dcc1a-6a05-4e29-83dc-4c556f049dc2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:04.853421 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1f9dcc1a-6a05-4e29-83dc-4c556f049dc2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:05.118317 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0a8ce705-374d-41ed-a158-7cdfd98d6d94 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:05.165841 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0a8ce705-374d-41ed-a158-7cdfd98d6d94 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:05.168181 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0a8ce705-374d-41ed-a158-7cdfd98d6d94 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:05.171207 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0a8ce705-374d-41ed-a158-7cdfd98d6d94 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1869 microversion: 2.42 time: 1.792502 Jul 18 02:21:05.172394 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1142/2297] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:03 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1869 bytes in 1795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:21:05.178374 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-dbafebc7-1fe5-4aec-9066-f8d9d8fe0ac4 req-5afda268-4c20-47d3-86c6-9cf1c7ba6979 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2563fe1c-ce0c-4a16-8d70-eb578016eae9", "name": "network-vif-plugged", "status": "completed", "tag": "85a63441-1332-45c5-b28b-36162eda7e6e"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:05.191893 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-dbafebc7-1fe5-4aec-9066-f8d9d8fe0ac4 req-5afda268-4c20-47d3-86c6-9cf1c7ba6979 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:05.192483 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-dbafebc7-1fe5-4aec-9066-f8d9d8fe0ac4 req-5afda268-4c20-47d3-86c6-9cf1c7ba6979 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:05.218137 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-dbafebc7-1fe5-4aec-9066-f8d9d8fe0ac4 req-5afda268-4c20-47d3-86c6-9cf1c7ba6979 service nova] Creating event network-vif-plugged:85a63441-1332-45c5-b28b-36162eda7e6e for instance 2563fe1c-ce0c-4a16-8d70-eb578016eae9 on n-h1-465891-3 Jul 18 02:21:05.227411 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-dbafebc7-1fe5-4aec-9066-f8d9d8fe0ac4 req-5afda268-4c20-47d3-86c6-9cf1c7ba6979 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053316 Jul 18 02:21:05.229441 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1143/2298] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:05.238094 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8ae068db-c071-4801-be23-e17b48da71a2 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:05.239676 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8ae068db-c071-4801-be23-e17b48da71a2 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] [instance: 0f30e76e-91e9-441f-b482-28de008a5e40] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:05.263582 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8ae068db-c071-4801-be23-e17b48da71a2 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:05.264974 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8ae068db-c071-4801-be23-e17b48da71a2 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:05.266882 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8ae068db-c071-4801-be23-e17b48da71a2 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:05.282017 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8ae068db-c071-4801-be23-e17b48da71a2 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:05.377262 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8ae068db-c071-4801-be23-e17b48da71a2 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] 10.222.0.57 "GET /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.145678 Jul 18 02:21:05.378710 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1144/2299] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:21:05 2022] GET /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40/os-volume_attachments => generated 25 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:21:05.478544 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ff9a77d2-e203-4a78-8af8-43b421e8cf1d tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:05.482734 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ff9a77d2-e203-4a78-8af8-43b421e8cf1d tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] [instance: 0f30e76e-91e9-441f-b482-28de008a5e40] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:05.503023 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ff9a77d2-e203-4a78-8af8-43b421e8cf1d tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:05.504146 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ff9a77d2-e203-4a78-8af8-43b421e8cf1d tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:05.506430 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ff9a77d2-e203-4a78-8af8-43b421e8cf1d tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:05.507511 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ff9a77d2-e203-4a78-8af8-43b421e8cf1d tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:05.548515 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ff9a77d2-e203-4a78-8af8-43b421e8cf1d tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] 10.222.0.57 "GET /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.079859 Jul 18 02:21:05.548984 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1145/2300] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:21:05 2022] GET /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:21:05.679325 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-21fc1869-0bb9-42dd-ac02-34073ffb88fd tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:05.680222 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-21fc1869-0bb9-42dd-ac02-34073ffb88fd tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] [instance: 0f30e76e-91e9-441f-b482-28de008a5e40] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:05.690685 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-21fc1869-0bb9-42dd-ac02-34073ffb88fd tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:05.692105 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-21fc1869-0bb9-42dd-ac02-34073ffb88fd tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:05.693633 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-21fc1869-0bb9-42dd-ac02-34073ffb88fd tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:05.694416 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-21fc1869-0bb9-42dd-ac02-34073ffb88fd tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:05.782968 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-21fc1869-0bb9-42dd-ac02-34073ffb88fd tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] [instance: 0f30e76e-91e9-441f-b482-28de008a5e40] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:21:06.050951 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1f9dcc1a-6a05-4e29-83dc-4c556f049dc2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:06.091155 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1f9dcc1a-6a05-4e29-83dc-4c556f049dc2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:06.111091 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1f9dcc1a-6a05-4e29-83dc-4c556f049dc2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:06.139239 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1f9dcc1a-6a05-4e29-83dc-4c556f049dc2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1280 microversion: 2.25 time: 1.320003 Jul 18 02:21:06.142289 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1156/2301] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:04 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1280 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:06.192182 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-91063825-6c07-489a-8d12-397e8f696700 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:06.195348 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-91063825-6c07-489a-8d12-397e8f696700 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:06.277690 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-91063825-6c07-489a-8d12-397e8f696700 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:06.279222 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-91063825-6c07-489a-8d12-397e8f696700 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:06.280983 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-91063825-6c07-489a-8d12-397e8f696700 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:06.282845 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-91063825-6c07-489a-8d12-397e8f696700 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:06.293999 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-21fc1869-0bb9-42dd-ac02-34073ffb88fd tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] 10.222.0.57 "DELETE /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40" status: 204 len: 0 microversion: 2.1 time: 0.618358 Jul 18 02:21:06.306296 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1146/2302] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:21:05 2022] DELETE /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:21:06.351942 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ee3ea76e-8101-4d1a-977f-22867962d622 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:06.359032 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ee3ea76e-8101-4d1a-977f-22867962d622 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:06.414898 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ee3ea76e-8101-4d1a-977f-22867962d622 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:06.416086 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ee3ea76e-8101-4d1a-977f-22867962d622 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:06.418004 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ee3ea76e-8101-4d1a-977f-22867962d622 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:06.419839 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ee3ea76e-8101-4d1a-977f-22867962d622 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:07.219001 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-91063825-6c07-489a-8d12-397e8f696700 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:07.233989 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-91063825-6c07-489a-8d12-397e8f696700 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 200 len: 1599 microversion: 2.1 time: 1.087717 Jul 18 02:21:07.234710 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1157/2303] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:06 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 1599 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:21:07.257064 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c370f4b9-540e-4c77-bffb-08ff9c9a8f61 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:07.266463 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c370f4b9-540e-4c77-bffb-08ff9c9a8f61 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] [instance: 0f30e76e-91e9-441f-b482-28de008a5e40] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:07.283728 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c370f4b9-540e-4c77-bffb-08ff9c9a8f61 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:07.286464 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c370f4b9-540e-4c77-bffb-08ff9c9a8f61 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:07.287542 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c370f4b9-540e-4c77-bffb-08ff9c9a8f61 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:07.289340 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c370f4b9-540e-4c77-bffb-08ff9c9a8f61 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:08.027243 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ee3ea76e-8101-4d1a-977f-22867962d622 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:08.084761 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ee3ea76e-8101-4d1a-977f-22867962d622 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:08.100068 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ee3ea76e-8101-4d1a-977f-22867962d622 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:08.103363 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ee3ea76e-8101-4d1a-977f-22867962d622 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1869 microversion: 2.42 time: 1.789563 Jul 18 02:21:08.105333 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1147/2304] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:06 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1869 bytes in 1798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:08.115810 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c370f4b9-540e-4c77-bffb-08ff9c9a8f61 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa996f5ca59e4423ac26d459aab6c7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cef90571c1a4b31bb089a9242569cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:08.132167 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c370f4b9-540e-4c77-bffb-08ff9c9a8f61 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] 10.222.0.57 "GET /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40" status: 200 len: 1681 microversion: 2.1 time: 0.887566 Jul 18 02:21:08.136764 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1158/2305] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:07 2022] GET /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40 => generated 1681 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:21:08.138121 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a4ec0e6a-e122-4a48-bbbf-9ba761332c58 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:08.144773 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a4ec0e6a-e122-4a48-bbbf-9ba761332c58 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:08.151384 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-ab0bf460-363a-43b4-8abb-25002ac7e769 req-95a1d56b-8c20-4507-8f5c-5c4f17125105 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19592434-cafa-4e79-a790-0674ab77672f", "name": "network-vif-deleted", "tag": "4c9f9136-52be-4062-9d09-7fd94b7a5870"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:08.174265 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a4ec0e6a-e122-4a48-bbbf-9ba761332c58 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:08.175226 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a4ec0e6a-e122-4a48-bbbf-9ba761332c58 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:08.176728 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a4ec0e6a-e122-4a48-bbbf-9ba761332c58 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:08.177531 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a4ec0e6a-e122-4a48-bbbf-9ba761332c58 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:08.182864 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-ab0bf460-363a-43b4-8abb-25002ac7e769 req-95a1d56b-8c20-4507-8f5c-5c4f17125105 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:08.186462 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-ab0bf460-363a-43b4-8abb-25002ac7e769 req-95a1d56b-8c20-4507-8f5c-5c4f17125105 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:08.227419 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-ab0bf460-363a-43b4-8abb-25002ac7e769 req-95a1d56b-8c20-4507-8f5c-5c4f17125105 service nova] Creating event network-vif-deleted:4c9f9136-52be-4062-9d09-7fd94b7a5870 for instance 19592434-cafa-4e79-a790-0674ab77672f on n-h1-465891-3 Jul 18 02:21:08.246607 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-ab0bf460-363a-43b4-8abb-25002ac7e769 req-95a1d56b-8c20-4507-8f5c-5c4f17125105 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105533 Jul 18 02:21:08.252191 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1159/2306] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:08.301840 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-38624ac9-11f2-4f88-b223-38463bc39a0a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:08.308069 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-38624ac9-11f2-4f88-b223-38463bc39a0a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 19592434-cafa-4e79-a790-0674ab77672f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:08.357334 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-38624ac9-11f2-4f88-b223-38463bc39a0a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:08.361649 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-38624ac9-11f2-4f88-b223-38463bc39a0a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:08.364091 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-38624ac9-11f2-4f88-b223-38463bc39a0a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:08.367965 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-38624ac9-11f2-4f88-b223-38463bc39a0a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:08.420293 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-38624ac9-11f2-4f88-b223-38463bc39a0a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] HTTP exception thrown: Instance 19592434-cafa-4e79-a790-0674ab77672f could not be found. Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-38624ac9-11f2-4f88-b223-38463bc39a0a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Request method failure captured: Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f HTTP/1.1 Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MDxoIhYq-PuyDMFlQXpvNK2aUuzIqTYrptsOrKN4PRdQI3jif23F4uYig_PuKVXcsu8K3Abm9mAq_5FRRgTYbl1azkwUdzQa6ZC79fQpoio58iE72vUHSVbA38_URTvTgS_u5xLWglb1rnFLdm8_0kGQCYgVr34-6JeM0w6r8oCu94 Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: e382977cb6bf4f358fb3245cb3768140 Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-LiveMigrationTest-1548530922 Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e382977cb6bf4f358fb3245cb3768140"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e382977cb6bf4f358fb3245cb3768140"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e382977cb6bf4f358fb3245cb3768140"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e382977cb6bf4f358fb3245cb3768140"}]}] Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-LiveMigrationTest-1548530922 Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: e382977cb6bf4f358fb3245cb3768140 Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-LiveMigrationTest-1548530922 Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-LiveMigrationTest-1548530922-project Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 77381e85d31a4747acb08a8d4572eb1b Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-LiveMigrationTest-1548530922-project Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 19592434-cafa-4e79-a790-0674ab77672f could not be found. Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '19592434-cafa-4e79-a790-0674ab77672f'} Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19592434-cafa-4e79-a790-0674ab77672f could not be found. Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19592434-cafa-4e79-a790-0674ab77672f could not be found. Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:21:08.426052 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:21:08.437501 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:21:08.437501 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:21:08.437501 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:21:08.437501 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:21:08.437501 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:21:08.437501 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19592434-cafa-4e79-a790-0674ab77672f could not be found. Jul 18 02:21:08.437501 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:21:08.441760 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-38624ac9-11f2-4f88-b223-38463bc39a0a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Returning 404 to user: Instance 19592434-cafa-4e79-a790-0674ab77672f could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:21:08.444211 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-38624ac9-11f2-4f88-b223-38463bc39a0a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f" status: 404 len: 111 microversion: 2.1 time: 0.180879 Jul 18 02:21:08.447080 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1160/2307] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:08 2022] GET /compute/v2.1/servers/19592434-cafa-4e79-a790-0674ab77672f => generated 111 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:21:08.462463 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-02007ff6-b23c-40ac-ba67-ee69d633ff68 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '.version_select at 0x7ff49bb825e0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:08.505804 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-02007ff6-b23c-40ac-ba67-ee69d633ff68 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1215991492" status: 202 len: 0 microversion: 2.1 time: 0.053067 Jul 18 02:21:08.508248 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1161/2308] 10.222.0.57 () {58 vars in 1220 bytes} [Mon Jul 18 02:21:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1215991492 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:21:08.635209 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-ec7b94e2-a347-4839-9b1d-80829a78dfee req-3a79b61d-d001-47e6-bdf2-732888693f93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b909490f-2890-43c0-b956-9de562d52d67", "name": "network-vif-plugged", "status": "completed", "tag": "11cacb3f-8e0c-4904-8fb7-ad9beec7e463"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:08.658290 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-ec7b94e2-a347-4839-9b1d-80829a78dfee req-3a79b61d-d001-47e6-bdf2-732888693f93 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:08.659658 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-ec7b94e2-a347-4839-9b1d-80829a78dfee req-3a79b61d-d001-47e6-bdf2-732888693f93 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:08.679983 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-ec7b94e2-a347-4839-9b1d-80829a78dfee req-3a79b61d-d001-47e6-bdf2-732888693f93 service nova] Creating event network-vif-plugged:11cacb3f-8e0c-4904-8fb7-ad9beec7e463 for instance b909490f-2890-43c0-b956-9de562d52d67 on n-h2-465891-3 Jul 18 02:21:08.688704 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-ec7b94e2-a347-4839-9b1d-80829a78dfee req-3a79b61d-d001-47e6-bdf2-732888693f93 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061207 Jul 18 02:21:08.690021 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1162/2309] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:21:08.873147 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a4ec0e6a-e122-4a48-bbbf-9ba761332c58 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:08.891470 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a4ec0e6a-e122-4a48-bbbf-9ba761332c58 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:08.894012 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a4ec0e6a-e122-4a48-bbbf-9ba761332c58 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:08.896756 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a4ec0e6a-e122-4a48-bbbf-9ba761332c58 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1476 microversion: 2.25 time: 0.788698 Jul 18 02:21:08.898147 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1148/2310] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:08 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1476 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:08.930751 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-20bf029a-a02f-4e58-aca5-9e4ceba1efa4 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:08.932069 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-20bf029a-a02f-4e58-aca5-9e4ceba1efa4 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:08.948441 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20bf029a-a02f-4e58-aca5-9e4ceba1efa4 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:08.951264 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20bf029a-a02f-4e58-aca5-9e4ceba1efa4 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:08.954152 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20bf029a-a02f-4e58-aca5-9e4ceba1efa4 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:08.954792 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20bf029a-a02f-4e58-aca5-9e4ceba1efa4 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:09.134452 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ee3ce468-f781-44e1-a0a9-0ff97bdaa373 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:09.137289 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ee3ce468-f781-44e1-a0a9-0ff97bdaa373 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:09.151062 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ee3ce468-f781-44e1-a0a9-0ff97bdaa373 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:09.152449 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ee3ce468-f781-44e1-a0a9-0ff97bdaa373 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:09.155094 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ee3ce468-f781-44e1-a0a9-0ff97bdaa373 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:09.159332 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ee3ce468-f781-44e1-a0a9-0ff97bdaa373 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:09.171422 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:21:09.591456 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:21:09.600363 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-20bf029a-a02f-4e58-aca5-9e4ceba1efa4 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lazy-loading 'services' on Instance uuid 2563fe1c-ce0c-4a16-8d70-eb578016eae9 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:21:09.636807 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-20bf029a-a02f-4e58-aca5-9e4ceba1efa4 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1968 microversion: 2.25 time: 0.711048 Jul 18 02:21:09.641259 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1163/2311] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:08 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1968 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:09.668423 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-17efa4c6-bcf5-49bc-9027-11e4def623d8 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:09.670427 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-17efa4c6-bcf5-49bc-9027-11e4def623d8 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] [instance: 0f30e76e-91e9-441f-b482-28de008a5e40] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:09.702983 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-17efa4c6-bcf5-49bc-9027-11e4def623d8 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:09.704581 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-17efa4c6-bcf5-49bc-9027-11e4def623d8 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:09.706520 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-17efa4c6-bcf5-49bc-9027-11e4def623d8 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:09.708160 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-17efa4c6-bcf5-49bc-9027-11e4def623d8 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:09.761058 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ee3ce468-f781-44e1-a0a9-0ff97bdaa373 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:09.825869 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ee3ce468-f781-44e1-a0a9-0ff97bdaa373 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:09.832749 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ee3ce468-f781-44e1-a0a9-0ff97bdaa373 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:09.836998 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ee3ce468-f781-44e1-a0a9-0ff97bdaa373 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1869 microversion: 2.42 time: 0.715532 Jul 18 02:21:09.839133 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1149/2312] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:09 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1869 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:21:09.860664 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7bc70ce1-2a31-4d5e-a2dd-a5801384f8f4 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:09.862414 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7bc70ce1-2a31-4d5e-a2dd-a5801384f8f4 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:09.880085 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7bc70ce1-2a31-4d5e-a2dd-a5801384f8f4 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:09.881351 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7bc70ce1-2a31-4d5e-a2dd-a5801384f8f4 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:09.884192 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7bc70ce1-2a31-4d5e-a2dd-a5801384f8f4 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:09.885320 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7bc70ce1-2a31-4d5e-a2dd-a5801384f8f4 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:10.440945 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-17efa4c6-bcf5-49bc-9027-11e4def623d8 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa996f5ca59e4423ac26d459aab6c7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cef90571c1a4b31bb089a9242569cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:10.464898 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-17efa4c6-bcf5-49bc-9027-11e4def623d8 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] 10.222.0.57 "GET /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40" status: 200 len: 1681 microversion: 2.1 time: 0.821515 Jul 18 02:21:10.468818 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1164/2313] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:09 2022] GET /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40 => generated 1681 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:21:10.617802 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-7bc70ce1-2a31-4d5e-a2dd-a5801384f8f4 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lazy-loading 'services' on Instance uuid 2563fe1c-ce0c-4a16-8d70-eb578016eae9 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:21:10.648702 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7bc70ce1-2a31-4d5e-a2dd-a5801384f8f4 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1968 microversion: 2.25 time: 0.808076 Jul 18 02:21:10.649519 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1150/2314] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:09 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1968 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:10.674199 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4ce430dd-d89b-4898-9931-0cc6b35e2093 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:10.676408 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:21:10.676408 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:21:10.679486 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4ce430dd-d89b-4898-9931-0cc6b35e2093 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:10.680295 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4ce430dd-d89b-4898-9931-0cc6b35e2093 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:10.684420 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4ce430dd-d89b-4898-9931-0cc6b35e2093 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:10.686800 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4ce430dd-d89b-4898-9931-0cc6b35e2093 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:10.747570 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4ce430dd-d89b-4898-9931-0cc6b35e2093 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.077398 Jul 18 02:21:10.773384 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1165/2315] 10.222.0.57 () {60 vars in 1216 bytes} [Mon Jul 18 02:21:10 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 02:21:10.775434 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cce3499a-bf3c-4632-a5e2-05c326780ec5 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-465891-3", "block_migration": "auto"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:10.777765 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cce3499a-bf3c-4632-a5e2-05c326780ec5 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:10.794428 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cce3499a-bf3c-4632-a5e2-05c326780ec5 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:10.795921 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cce3499a-bf3c-4632-a5e2-05c326780ec5 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:10.798538 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cce3499a-bf3c-4632-a5e2-05c326780ec5 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:10.800254 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cce3499a-bf3c-4632-a5e2-05c326780ec5 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:10.870321 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-49596f2a-5a4e-4459-9939-a008172e3fe5 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:10.877939 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-49596f2a-5a4e-4459-9939-a008172e3fe5 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:10.949286 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:21:10.953065 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-49596f2a-5a4e-4459-9939-a008172e3fe5 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:10.966472 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-49596f2a-5a4e-4459-9939-a008172e3fe5 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:10.967564 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-49596f2a-5a4e-4459-9939-a008172e3fe5 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:10.967987 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-49596f2a-5a4e-4459-9939-a008172e3fe5 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:10.979281 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-cce3499a-bf3c-4632-a5e2-05c326780ec5 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lazy-loading 'flavor' on Instance uuid 2563fe1c-ce0c-4a16-8d70-eb578016eae9 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:21:11.017338 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cce3499a-bf3c-4632-a5e2-05c326780ec5 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Going to try to live migrate instance to n-h2-465891-3 {{(pid=119544) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 18 02:21:11.921401 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-49596f2a-5a4e-4459-9939-a008172e3fe5 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:11.982251 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-49596f2a-5a4e-4459-9939-a008172e3fe5 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:12.018464 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-49596f2a-5a4e-4459-9939-a008172e3fe5 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:12.031110 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-49596f2a-5a4e-4459-9939-a008172e3fe5 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1869 microversion: 2.42 time: 1.165310 Jul 18 02:21:12.035789 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1166/2316] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:10 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1869 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:12.046357 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-18f62a8c-907a-4ada-8427-1f1f1fe235dd req-9d8a526f-aa54-4654-aec9-64f8a06e54f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b909490f-2890-43c0-b956-9de562d52d67", "name": "network-vif-plugged", "status": "completed", "tag": "6ca621a9-9ed9-4c3d-acdf-29cc441d2c6e"}, {"server_uuid": "b909490f-2890-43c0-b956-9de562d52d67", "name": "network-vif-plugged", "status": "completed", "tag": "22242ae4-54de-42d2-be8a-9ecb3f7a6197"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:12.071713 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-18f62a8c-907a-4ada-8427-1f1f1fe235dd req-9d8a526f-aa54-4654-aec9-64f8a06e54f1 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:12.073173 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-18f62a8c-907a-4ada-8427-1f1f1fe235dd req-9d8a526f-aa54-4654-aec9-64f8a06e54f1 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:12.120111 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-18f62a8c-907a-4ada-8427-1f1f1fe235dd req-9d8a526f-aa54-4654-aec9-64f8a06e54f1 service nova] Creating event network-vif-plugged:6ca621a9-9ed9-4c3d-acdf-29cc441d2c6e for instance b909490f-2890-43c0-b956-9de562d52d67 on n-h2-465891-3 Jul 18 02:21:12.127604 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-18f62a8c-907a-4ada-8427-1f1f1fe235dd req-9d8a526f-aa54-4654-aec9-64f8a06e54f1 service nova] Creating event network-vif-plugged:22242ae4-54de-42d2-be8a-9ecb3f7a6197 for instance b909490f-2890-43c0-b956-9de562d52d67 on n-h2-465891-3 Jul 18 02:21:12.164509 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-18f62a8c-907a-4ada-8427-1f1f1fe235dd req-9d8a526f-aa54-4654-aec9-64f8a06e54f1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.121649 Jul 18 02:21:12.168308 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1167/2317] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:12.200840 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5f1b64a0-e943-45c9-bee7-4a28ce83ef96 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:12.207117 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5f1b64a0-e943-45c9-bee7-4a28ce83ef96 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] [instance: 0f30e76e-91e9-441f-b482-28de008a5e40] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:12.250349 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5f1b64a0-e943-45c9-bee7-4a28ce83ef96 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:12.254624 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5f1b64a0-e943-45c9-bee7-4a28ce83ef96 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:12.259235 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5f1b64a0-e943-45c9-bee7-4a28ce83ef96 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:12.281607 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5f1b64a0-e943-45c9-bee7-4a28ce83ef96 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:12.663460 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5f1b64a0-e943-45c9-bee7-4a28ce83ef96 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa996f5ca59e4423ac26d459aab6c7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cef90571c1a4b31bb089a9242569cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:12.702165 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5f1b64a0-e943-45c9-bee7-4a28ce83ef96 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] 10.222.0.57 "GET /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40" status: 200 len: 1614 microversion: 2.1 time: 0.521721 Jul 18 02:21:12.703983 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1168/2318] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:12 2022] GET /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40 => generated 1614 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:21:12.712154 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1590499b-f4e1-4ce0-ad82-77e5c39962d0 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:12.712677 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1590499b-f4e1-4ce0-ad82-77e5c39962d0 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: ae4f2139-250b-4a65-8436-702487cc1ded] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:12.734497 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1590499b-f4e1-4ce0-ad82-77e5c39962d0 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:12.735230 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1590499b-f4e1-4ce0-ad82-77e5c39962d0 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:12.739095 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1590499b-f4e1-4ce0-ad82-77e5c39962d0 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:12.739782 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1590499b-f4e1-4ce0-ad82-77e5c39962d0 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:12.823404 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1590499b-f4e1-4ce0-ad82-77e5c39962d0 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: ae4f2139-250b-4a65-8436-702487cc1ded] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:21:13.046871 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1590499b-f4e1-4ce0-ad82-77e5c39962d0 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded" status: 204 len: 0 microversion: 2.1 time: 0.332050 Jul 18 02:21:13.049587 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1169/2319] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:21:12 2022] DELETE /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:21:13.059690 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-12873ebe-5733-42a1-adca-ed74a51a5137 req-9d410658-f1a1-4f2c-97c0-0177d128329e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f30e76e-91e9-441f-b482-28de008a5e40", "name": "network-vif-deleted", "tag": "c40bedcf-1c93-48e3-a6b6-5d5d4726ef87"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:13.087080 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-12873ebe-5733-42a1-adca-ed74a51a5137 req-9d410658-f1a1-4f2c-97c0-0177d128329e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:13.092557 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-12873ebe-5733-42a1-adca-ed74a51a5137 req-9d410658-f1a1-4f2c-97c0-0177d128329e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:13.131521 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-12873ebe-5733-42a1-adca-ed74a51a5137 req-9d410658-f1a1-4f2c-97c0-0177d128329e service nova] Creating event network-vif-deleted:c40bedcf-1c93-48e3-a6b6-5d5d4726ef87 for instance 0f30e76e-91e9-441f-b482-28de008a5e40 on n-h2-465891-3 Jul 18 02:21:13.148521 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-12873ebe-5733-42a1-adca-ed74a51a5137 req-9d410658-f1a1-4f2c-97c0-0177d128329e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096023 Jul 18 02:21:13.152298 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1170/2320] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:13.168674 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3cc73f7f-748c-45e5-82f4-b2debbecc447 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:13.171421 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3cc73f7f-748c-45e5-82f4-b2debbecc447 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:13.188213 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3cc73f7f-748c-45e5-82f4-b2debbecc447 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:13.189106 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3cc73f7f-748c-45e5-82f4-b2debbecc447 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:13.191296 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3cc73f7f-748c-45e5-82f4-b2debbecc447 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:13.192128 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3cc73f7f-748c-45e5-82f4-b2debbecc447 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:14.209588 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3cc73f7f-748c-45e5-82f4-b2debbecc447 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:14.232804 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3cc73f7f-748c-45e5-82f4-b2debbecc447 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:14.237553 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3cc73f7f-748c-45e5-82f4-b2debbecc447 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:14.243501 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3cc73f7f-748c-45e5-82f4-b2debbecc447 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1869 microversion: 2.42 time: 1.086903 Jul 18 02:21:14.271509 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1171/2321] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:13 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1869 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:14.286631 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8786238e-a415-4874-b706-99f7be702b73 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:14.290345 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8786238e-a415-4874-b706-99f7be702b73 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: ae4f2139-250b-4a65-8436-702487cc1ded] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:14.331951 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8786238e-a415-4874-b706-99f7be702b73 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:14.332890 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8786238e-a415-4874-b706-99f7be702b73 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:14.337757 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8786238e-a415-4874-b706-99f7be702b73 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:14.338571 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8786238e-a415-4874-b706-99f7be702b73 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:15.259773 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8786238e-a415-4874-b706-99f7be702b73 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:15.270325 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8786238e-a415-4874-b706-99f7be702b73 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded" status: 200 len: 1484 microversion: 2.1 time: 0.996180 Jul 18 02:21:15.281386 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1172/2322] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:14 2022] GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded => generated 1484 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:21:15.295908 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3e73cbf3-097e-47bd-8ddf-ccf997c8c599 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:15.296552 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3e73cbf3-097e-47bd-8ddf-ccf997c8c599 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] [instance: 0f30e76e-91e9-441f-b482-28de008a5e40] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:15.312160 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3e73cbf3-097e-47bd-8ddf-ccf997c8c599 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:15.314157 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3e73cbf3-097e-47bd-8ddf-ccf997c8c599 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:15.316845 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3e73cbf3-097e-47bd-8ddf-ccf997c8c599 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:15.319443 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3e73cbf3-097e-47bd-8ddf-ccf997c8c599 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:15.355765 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-3e73cbf3-097e-47bd-8ddf-ccf997c8c599 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] HTTP exception thrown: Instance 0f30e76e-91e9-441f-b482-28de008a5e40 could not be found. Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3e73cbf3-097e-47bd-8ddf-ccf997c8c599 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Request method failure captured: Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40 HTTP/1.1 Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MK7Pac-IW3Op3UnmraS72cE4sAhI3O5e-FqqdFNnZcQ5qG_D4S3wn9jbPcZryPZAoRG7e79xpO9t7Rlftw9aZaL_DDejA1BFduxOzeQwfCdnhHthjtF9DV6hb65QXUAL1Na8TIn4PisQ5NOS0-QSSyuL-z6dSlYB2TRLkZsTv0-o3Y Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 0cef90571c1a4b31bb089a9242569cc2 Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1629905749 Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0cef90571c1a4b31bb089a9242569cc2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0cef90571c1a4b31bb089a9242569cc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0cef90571c1a4b31bb089a9242569cc2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0cef90571c1a4b31bb089a9242569cc2"}]}] Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1629905749 Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 0cef90571c1a4b31bb089a9242569cc2 Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1629905749 Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-AttachSCSIVolumeTestJSON-1629905749-project Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: aa996f5ca59e4423ac26d459aab6c7c9 Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1629905749-project Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 0f30e76e-91e9-441f-b482-28de008a5e40 could not be found. Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '0f30e76e-91e9-441f-b482-28de008a5e40'} Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f30e76e-91e9-441f-b482-28de008a5e40 could not be found. Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f30e76e-91e9-441f-b482-28de008a5e40 could not be found. Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:21:15.366897 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:21:15.373423 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:21:15.373423 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:21:15.373423 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:21:15.373423 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:21:15.373423 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:21:15.373423 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f30e76e-91e9-441f-b482-28de008a5e40 could not be found. Jul 18 02:21:15.373423 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:21:15.373423 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3e73cbf3-097e-47bd-8ddf-ccf997c8c599 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Returning 404 to user: Instance 0f30e76e-91e9-441f-b482-28de008a5e40 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:21:15.373423 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3e73cbf3-097e-47bd-8ddf-ccf997c8c599 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] 10.222.0.57 "GET /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40" status: 404 len: 111 microversion: 2.1 time: 0.087036 Jul 18 02:21:15.374819 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1173/2323] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:15 2022] GET /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:21:15.393262 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-a13dbc27-31b5-4f9e-9833-8a8dc5ba64c4 req-11939c0e-330b-4127-8fb4-77e1ac322125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b909490f-2890-43c0-b956-9de562d52d67", "name": "network-vif-plugged", "status": "completed", "tag": "7d2eaf01-7168-45f2-9cf4-bf37b3151ae2"}, {"server_uuid": "b909490f-2890-43c0-b956-9de562d52d67", "name": "network-vif-plugged", "status": "completed", "tag": "ec520d27-3206-4d7f-96c7-14f7ddd7dba6"}, {"server_uuid": "b909490f-2890-43c0-b956-9de562d52d67", "name": "network-vif-plugged", "status": "completed", "tag": "8ed539e3-cacf-4544-b22a-ef277f6be4d8"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:15.413180 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-a13dbc27-31b5-4f9e-9833-8a8dc5ba64c4 req-11939c0e-330b-4127-8fb4-77e1ac322125 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:15.414072 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-a13dbc27-31b5-4f9e-9833-8a8dc5ba64c4 req-11939c0e-330b-4127-8fb4-77e1ac322125 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:15.489295 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-a13dbc27-31b5-4f9e-9833-8a8dc5ba64c4 req-11939c0e-330b-4127-8fb4-77e1ac322125 service nova] Creating event network-vif-plugged:7d2eaf01-7168-45f2-9cf4-bf37b3151ae2 for instance b909490f-2890-43c0-b956-9de562d52d67 on n-h2-465891-3 Jul 18 02:21:15.492522 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-a13dbc27-31b5-4f9e-9833-8a8dc5ba64c4 req-11939c0e-330b-4127-8fb4-77e1ac322125 service nova] Creating event network-vif-plugged:ec520d27-3206-4d7f-96c7-14f7ddd7dba6 for instance b909490f-2890-43c0-b956-9de562d52d67 on n-h2-465891-3 Jul 18 02:21:15.493646 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-a13dbc27-31b5-4f9e-9833-8a8dc5ba64c4 req-11939c0e-330b-4127-8fb4-77e1ac322125 service nova] Creating event network-vif-plugged:8ed539e3-cacf-4544-b22a-ef277f6be4d8 for instance b909490f-2890-43c0-b956-9de562d52d67 on n-h2-465891-3 Jul 18 02:21:15.504288 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-a13dbc27-31b5-4f9e-9833-8a8dc5ba64c4 req-11939c0e-330b-4127-8fb4-77e1ac322125 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.126906 Jul 18 02:21:15.506081 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1174/2324] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:15.518132 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0274a5e0-e55d-45b5-93cf-aa67e92c1ced tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:15.519767 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0274a5e0-e55d-45b5-93cf-aa67e92c1ced tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:15.529608 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0274a5e0-e55d-45b5-93cf-aa67e92c1ced tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:15.530630 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0274a5e0-e55d-45b5-93cf-aa67e92c1ced tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:15.532022 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0274a5e0-e55d-45b5-93cf-aa67e92c1ced tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:15.532854 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0274a5e0-e55d-45b5-93cf-aa67e92c1ced tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:16.310624 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0274a5e0-e55d-45b5-93cf-aa67e92c1ced tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:16.333140 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0274a5e0-e55d-45b5-93cf-aa67e92c1ced tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:16.334937 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0274a5e0-e55d-45b5-93cf-aa67e92c1ced tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:16.336786 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0274a5e0-e55d-45b5-93cf-aa67e92c1ced tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1869 microversion: 2.42 time: 0.828845 Jul 18 02:21:16.338908 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1175/2325] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:15 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1869 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:16.360559 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8afa52c1-0113-41d3-936b-55e92d0e8e9e tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Calling method '.version_select at 0x7ff4a80223a0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:16.407768 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8afa52c1-0113-41d3-936b-55e92d0e8e9e tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2006192699" status: 202 len: 0 microversion: 2.1 time: 0.052848 Jul 18 02:21:16.408803 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1176/2326] 10.222.0.57 () {58 vars in 1220 bytes} [Mon Jul 18 02:21:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2006192699 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:21:16.423447 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-68ca72b3-d878-466f-a286-d62275363e34 req-3789a923-a2d3-40ae-9eb1-5d116c18dbc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae4f2139-250b-4a65-8436-702487cc1ded", "name": "network-vif-deleted", "tag": "babbb140-0981-4a5e-b5a3-7f0cc8649998"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:16.448219 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-68ca72b3-d878-466f-a286-d62275363e34 req-3789a923-a2d3-40ae-9eb1-5d116c18dbc9 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:16.449215 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-68ca72b3-d878-466f-a286-d62275363e34 req-3789a923-a2d3-40ae-9eb1-5d116c18dbc9 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:16.491322 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-68ca72b3-d878-466f-a286-d62275363e34 req-3789a923-a2d3-40ae-9eb1-5d116c18dbc9 service nova] Creating event network-vif-deleted:babbb140-0981-4a5e-b5a3-7f0cc8649998 for instance ae4f2139-250b-4a65-8436-702487cc1ded on n-h2-465891-3 Jul 18 02:21:16.500839 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-68ca72b3-d878-466f-a286-d62275363e34 req-3789a923-a2d3-40ae-9eb1-5d116c18dbc9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087827 Jul 18 02:21:16.515509 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1177/2327] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:16.524174 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ed823b60-e5bd-4147-b1fd-cb8d254acaf3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:16.525791 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ed823b60-e5bd-4147-b1fd-cb8d254acaf3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: ae4f2139-250b-4a65-8436-702487cc1ded] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:16.548479 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ed823b60-e5bd-4147-b1fd-cb8d254acaf3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:16.549370 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ed823b60-e5bd-4147-b1fd-cb8d254acaf3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:16.550579 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ed823b60-e5bd-4147-b1fd-cb8d254acaf3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:16.551271 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ed823b60-e5bd-4147-b1fd-cb8d254acaf3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:16.622420 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ed823b60-e5bd-4147-b1fd-cb8d254acaf3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:16.623463 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ed823b60-e5bd-4147-b1fd-cb8d254acaf3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:16.623951 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-ed823b60-e5bd-4147-b1fd-cb8d254acaf3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lazy-loading 'fault' on Instance uuid ae4f2139-250b-4a65-8436-702487cc1ded {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:21:16.790900 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ed823b60-e5bd-4147-b1fd-cb8d254acaf3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:16.835268 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ed823b60-e5bd-4147-b1fd-cb8d254acaf3 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded" status: 200 len: 1300 microversion: 2.1 time: 0.317424 Jul 18 02:21:16.836556 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1178/2328] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:16 2022] GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded => generated 1300 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:21:16.880098 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cce3499a-bf3c-4632-a5e2-05c326780ec5 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9/action" status: 202 len: 0 microversion: 2.25 time: 6.114872 Jul 18 02:21:16.881483 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1151/2329] 10.222.0.57 () {62 vars in 1318 bytes} [Mon Jul 18 02:21:10 2022] POST /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9/action => generated 0 bytes in 6118 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:21:16.893133 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-18b89412-273a-407a-aa11-a64af37265aa tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:16.893777 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-18b89412-273a-407a-aa11-a64af37265aa tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:16.905916 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-18b89412-273a-407a-aa11-a64af37265aa tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:16.906873 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-18b89412-273a-407a-aa11-a64af37265aa tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:16.911988 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-18b89412-273a-407a-aa11-a64af37265aa tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:16.914459 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-18b89412-273a-407a-aa11-a64af37265aa tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:17.368799 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-54c6dd60-9e1b-48e4-be61-31bd6e6e3f40 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:17.381989 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-54c6dd60-9e1b-48e4-be61-31bd6e6e3f40 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:17.388688 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:21:17.471346 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54c6dd60-9e1b-48e4-be61-31bd6e6e3f40 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:17.472244 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54c6dd60-9e1b-48e4-be61-31bd6e6e3f40 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:17.473755 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54c6dd60-9e1b-48e4-be61-31bd6e6e3f40 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:17.474534 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54c6dd60-9e1b-48e4-be61-31bd6e6e3f40 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:19.141427 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-18b89412-273a-407a-aa11-a64af37265aa tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:19.164723 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-18b89412-273a-407a-aa11-a64af37265aa tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:19.171113 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-18b89412-273a-407a-aa11-a64af37265aa tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:19.173105 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-18b89412-273a-407a-aa11-a64af37265aa tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1486 microversion: 2.25 time: 2.284457 Jul 18 02:21:19.177409 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1179/2330] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:16 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1486 bytes in 2290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:19.192605 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f0f7b9f1-1df9-4cd9-a3ea-1f994bf8a7f4 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:19.193589 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f0f7b9f1-1df9-4cd9-a3ea-1f994bf8a7f4 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: ae4f2139-250b-4a65-8436-702487cc1ded] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:19.221894 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f0f7b9f1-1df9-4cd9-a3ea-1f994bf8a7f4 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:19.222514 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f0f7b9f1-1df9-4cd9-a3ea-1f994bf8a7f4 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:19.227059 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f0f7b9f1-1df9-4cd9-a3ea-1f994bf8a7f4 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:19.227808 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f0f7b9f1-1df9-4cd9-a3ea-1f994bf8a7f4 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:19.278521 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-f0f7b9f1-1df9-4cd9-a3ea-1f994bf8a7f4 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] HTTP exception thrown: Instance ae4f2139-250b-4a65-8436-702487cc1ded could not be found. Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f0f7b9f1-1df9-4cd9-a3ea-1f994bf8a7f4 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Request method failure captured: Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded HTTP/1.1 Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MDxoIhYq-PuyDMFlQXpvNK2aUuzIqTYrptsOrKN4PRdQI3jif23F4uYig_PuKVXcsu8K3Abm9mAq_5FRRgTYbl1azkwUdzQa6ZC79fQpoio58iE72vUHSVbA38_URTvTgS_u5xLWglb1rnFLdm8_0kGQCYgVr34-6JeM0w6r8oCu94 Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: e382977cb6bf4f358fb3245cb3768140 Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-LiveMigrationTest-1548530922 Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e382977cb6bf4f358fb3245cb3768140"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e382977cb6bf4f358fb3245cb3768140"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e382977cb6bf4f358fb3245cb3768140"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e382977cb6bf4f358fb3245cb3768140"}]}] Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-LiveMigrationTest-1548530922 Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: e382977cb6bf4f358fb3245cb3768140 Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-LiveMigrationTest-1548530922 Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-LiveMigrationTest-1548530922-project Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 77381e85d31a4747acb08a8d4572eb1b Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-LiveMigrationTest-1548530922-project Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance ae4f2139-250b-4a65-8436-702487cc1ded could not be found. Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'ae4f2139-250b-4a65-8436-702487cc1ded'} Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae4f2139-250b-4a65-8436-702487cc1ded could not be found. Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae4f2139-250b-4a65-8436-702487cc1ded could not be found. Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:21:19.285116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:21:19.291253 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:21:19.291253 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:21:19.291253 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:21:19.291253 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:21:19.291253 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:21:19.291253 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae4f2139-250b-4a65-8436-702487cc1ded could not be found. Jul 18 02:21:19.291253 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:21:19.291253 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f0f7b9f1-1df9-4cd9-a3ea-1f994bf8a7f4 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Returning 404 to user: Instance ae4f2139-250b-4a65-8436-702487cc1ded could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:21:19.309939 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f0f7b9f1-1df9-4cd9-a3ea-1f994bf8a7f4 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded" status: 404 len: 111 microversion: 2.1 time: 0.130309 Jul 18 02:21:19.320331 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1180/2331] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:19 2022] GET /compute/v2.1/servers/ae4f2139-250b-4a65-8436-702487cc1ded => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:21:19.356798 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e83d49b7-fc9d-44e0-bb86-254d72511f87 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:19.357846 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e83d49b7-fc9d-44e0-bb86-254d72511f87 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:19.395568 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e83d49b7-fc9d-44e0-bb86-254d72511f87 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:19.396619 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e83d49b7-fc9d-44e0-bb86-254d72511f87 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:19.399261 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e83d49b7-fc9d-44e0-bb86-254d72511f87 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:19.404774 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e83d49b7-fc9d-44e0-bb86-254d72511f87 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:19.534656 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e83d49b7-fc9d-44e0-bb86-254d72511f87 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:21:19.764636 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e83d49b7-fc9d-44e0-bb86-254d72511f87 tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "DELETE /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 204 len: 0 microversion: 2.1 time: 0.437363 Jul 18 02:21:19.771479 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1181/2332] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:21:19 2022] DELETE /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:21:19.782986 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-75b4d6b5-c010-48da-8479-cd041348ff1a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:19.783823 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-75b4d6b5-c010-48da-8479-cd041348ff1a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:19.810228 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-75b4d6b5-c010-48da-8479-cd041348ff1a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:19.810740 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-75b4d6b5-c010-48da-8479-cd041348ff1a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:19.811823 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-75b4d6b5-c010-48da-8479-cd041348ff1a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:19.812320 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-75b4d6b5-c010-48da-8479-cd041348ff1a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:19.822823 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:21:20.154967 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-54c6dd60-9e1b-48e4-be61-31bd6e6e3f40 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:20.176509 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-54c6dd60-9e1b-48e4-be61-31bd6e6e3f40 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:20.180472 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-54c6dd60-9e1b-48e4-be61-31bd6e6e3f40 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:20.183647 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-54c6dd60-9e1b-48e4-be61-31bd6e6e3f40 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1869 microversion: 2.42 time: 2.828119 Jul 18 02:21:20.185785 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1152/2333] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:17 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1869 bytes in 2832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:20.228817 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3ca41d39-d35a-45ef-99ae-4d8fcf490197 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:20.229933 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3ca41d39-d35a-45ef-99ae-4d8fcf490197 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:20.251506 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3ca41d39-d35a-45ef-99ae-4d8fcf490197 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:20.252440 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3ca41d39-d35a-45ef-99ae-4d8fcf490197 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:20.254442 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3ca41d39-d35a-45ef-99ae-4d8fcf490197 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:20.255579 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3ca41d39-d35a-45ef-99ae-4d8fcf490197 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:20.706692 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:21:20.977050 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-75b4d6b5-c010-48da-8479-cd041348ff1a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:21.010489 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-75b4d6b5-c010-48da-8479-cd041348ff1a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 200 len: 1500 microversion: 2.1 time: 1.236711 Jul 18 02:21:21.012377 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1182/2334] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:19 2022] GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 1500 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:21:21.211182 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9e9e14e1-59ec-4c8c-86ab-065ea5cfc28b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:21.212717 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9e9e14e1-59ec-4c8c-86ab-065ea5cfc28b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:21.226135 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e9e14e1-59ec-4c8c-86ab-065ea5cfc28b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:21.227481 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e9e14e1-59ec-4c8c-86ab-065ea5cfc28b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:21.229356 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e9e14e1-59ec-4c8c-86ab-065ea5cfc28b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:21.231314 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e9e14e1-59ec-4c8c-86ab-065ea5cfc28b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:21.234496 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3ca41d39-d35a-45ef-99ae-4d8fcf490197 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:21.250349 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3ca41d39-d35a-45ef-99ae-4d8fcf490197 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:21.252256 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3ca41d39-d35a-45ef-99ae-4d8fcf490197 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:21.253984 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3ca41d39-d35a-45ef-99ae-4d8fcf490197 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1486 microversion: 2.25 time: 1.046642 Jul 18 02:21:21.260602 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1153/2335] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:20 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1486 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:22.036749 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1bbf55e1-03b1-4944-98a0-b990fcbcba4e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:22.038039 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1bbf55e1-03b1-4944-98a0-b990fcbcba4e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:22.052255 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1bbf55e1-03b1-4944-98a0-b990fcbcba4e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:22.053343 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1bbf55e1-03b1-4944-98a0-b990fcbcba4e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:22.055043 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1bbf55e1-03b1-4944-98a0-b990fcbcba4e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:22.055652 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1bbf55e1-03b1-4944-98a0-b990fcbcba4e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:22.874994 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9e9e14e1-59ec-4c8c-86ab-065ea5cfc28b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:22.912546 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9e9e14e1-59ec-4c8c-86ab-065ea5cfc28b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:22.922657 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9e9e14e1-59ec-4c8c-86ab-065ea5cfc28b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:22.927937 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9e9e14e1-59ec-4c8c-86ab-065ea5cfc28b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 2827 microversion: 2.42 time: 1.722995 Jul 18 02:21:22.929753 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1183/2336] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:21 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 2827 bytes in 1728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:21:22.942854 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-53017984-69ab-4ed0-a0e0-c30cfe22c021 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:22.946261 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-53017984-69ab-4ed0-a0e0-c30cfe22c021 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:22.958826 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-53017984-69ab-4ed0-a0e0-c30cfe22c021 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:22.959545 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-53017984-69ab-4ed0-a0e0-c30cfe22c021 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:22.960643 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-53017984-69ab-4ed0-a0e0-c30cfe22c021 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:22.962398 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-53017984-69ab-4ed0-a0e0-c30cfe22c021 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:22.973883 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1bbf55e1-03b1-4944-98a0-b990fcbcba4e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:23.048251 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1bbf55e1-03b1-4944-98a0-b990fcbcba4e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 200 len: 1500 microversion: 2.1 time: 1.018599 Jul 18 02:21:23.062032 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1154/2337] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:22 2022] GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 1500 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:21:23.068901 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cb8e1d91-14f3-40f6-83d4-bc36bc89f003 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:23.071923 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cb8e1d91-14f3-40f6-83d4-bc36bc89f003 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:23.083726 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cb8e1d91-14f3-40f6-83d4-bc36bc89f003 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:23.084925 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cb8e1d91-14f3-40f6-83d4-bc36bc89f003 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:23.086115 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cb8e1d91-14f3-40f6-83d4-bc36bc89f003 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:23.086861 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cb8e1d91-14f3-40f6-83d4-bc36bc89f003 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:23.590996 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cb8e1d91-14f3-40f6-83d4-bc36bc89f003 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.527107 Jul 18 02:21:23.591749 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1155/2338] 10.222.0.57 () {60 vars in 1315 bytes} [Mon Jul 18 02:21:23 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67/os-interface => generated 1831 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:23.600229 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-74fc0f3f-6774-43bd-b323-db1197d878d7 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:23.610668 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-74fc0f3f-6774-43bd-b323-db1197d878d7 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1de42754291d4c43b983b425a02ea9d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ed68b2710e40f487813716ca4965e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:23.612735 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-74fc0f3f-6774-43bd-b323-db1197d878d7 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Searching by: {'deleted': False, 'project_id': 'd0ed68b2710e40f487813716ca4965e9'} {{(pid=119544) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:21:23.629227 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74fc0f3f-6774-43bd-b323-db1197d878d7 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:23.631698 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74fc0f3f-6774-43bd-b323-db1197d878d7 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:23.634803 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74fc0f3f-6774-43bd-b323-db1197d878d7 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:23.637172 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74fc0f3f-6774-43bd-b323-db1197d878d7 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:23.710356 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.multi_cell_list [None req-74fc0f3f-6774-43bd-b323-db1197d878d7 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119544) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:21:23.793612 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-74fc0f3f-6774-43bd-b323-db1197d878d7 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] 10.222.0.57 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.199227 Jul 18 02:21:23.796482 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1156/2339] 10.222.0.57 () {58 vars in 1124 bytes} [Mon Jul 18 02:21:23 2022] GET /compute/v2.1/servers => generated 344 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:23.815591 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2fde86dc-0ff2-4156-b51d-9eb414e78756 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:23.819981 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2fde86dc-0ff2-4156-b51d-9eb414e78756 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1de42754291d4c43b983b425a02ea9d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ed68b2710e40f487813716ca4965e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:23.825288 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2fde86dc-0ff2-4156-b51d-9eb414e78756 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Searching by: {'deleted': False, 'project_id': 'd0ed68b2710e40f487813716ca4965e9'} {{(pid=119544) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:21:23.833077 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2fde86dc-0ff2-4156-b51d-9eb414e78756 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:23.833962 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2fde86dc-0ff2-4156-b51d-9eb414e78756 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:23.834993 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2fde86dc-0ff2-4156-b51d-9eb414e78756 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:23.835725 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2fde86dc-0ff2-4156-b51d-9eb414e78756 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:23.874248 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.multi_cell_list [None req-2fde86dc-0ff2-4156-b51d-9eb414e78756 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119544) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:21:23.932452 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2fde86dc-0ff2-4156-b51d-9eb414e78756 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de42754291d4c43b983b425a02ea9d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ed68b2710e40f487813716ca4965e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:23.953571 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2fde86dc-0ff2-4156-b51d-9eb414e78756 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:23.954546 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2fde86dc-0ff2-4156-b51d-9eb414e78756 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:24.079233 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-53017984-69ab-4ed0-a0e0-c30cfe22c021 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:24.105338 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-53017984-69ab-4ed0-a0e0-c30cfe22c021 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:24.109894 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-53017984-69ab-4ed0-a0e0-c30cfe22c021 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:24.114000 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-53017984-69ab-4ed0-a0e0-c30cfe22c021 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1486 microversion: 2.25 time: 1.181643 Jul 18 02:21:24.116820 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1184/2340] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:22 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1486 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:24.123599 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9b28c3fd-a21b-4c15-8383-cbb953241f6e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:24.124653 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9b28c3fd-a21b-4c15-8383-cbb953241f6e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:24.135354 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9b28c3fd-a21b-4c15-8383-cbb953241f6e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:24.154665 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9b28c3fd-a21b-4c15-8383-cbb953241f6e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:24.156358 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9b28c3fd-a21b-4c15-8383-cbb953241f6e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:24.157240 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9b28c3fd-a21b-4c15-8383-cbb953241f6e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:24.647859 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9b28c3fd-a21b-4c15-8383-cbb953241f6e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77381e85d31a4747acb08a8d4572eb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e382977cb6bf4f358fb3245cb3768140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:24.682423 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9b28c3fd-a21b-4c15-8383-cbb953241f6e tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 200 len: 1296 microversion: 2.1 time: 0.563474 Jul 18 02:21:24.694637 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1185/2341] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:24 2022] GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 1296 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:21:24.707446 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-bac011f6-0907-44de-aca4-2d97d4c122e4 req-6be86428-b3de-4610-a7d7-a7213d88b236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22002049-4347-47d8-a5a2-6d3f31ec8927", "name": "network-vif-deleted", "tag": "83756a9c-0161-44d8-b50b-8a364a6fcada"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:24.760381 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-bac011f6-0907-44de-aca4-2d97d4c122e4 req-6be86428-b3de-4610-a7d7-a7213d88b236 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:24.768068 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-bac011f6-0907-44de-aca4-2d97d4c122e4 req-6be86428-b3de-4610-a7d7-a7213d88b236 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:24.971351 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2fde86dc-0ff2-4156-b51d-9eb414e78756 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] 10.222.0.57 "GET /compute/v2.1/servers/detail" status: 200 len: 1606 microversion: 2.1 time: 1.160570 Jul 18 02:21:24.974173 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1157/2342] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:21:23 2022] GET /compute/v2.1/servers/detail => generated 1606 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:21:24.985025 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-bac011f6-0907-44de-aca4-2d97d4c122e4 req-6be86428-b3de-4610-a7d7-a7213d88b236 service nova] Creating event network-vif-deleted:83756a9c-0161-44d8-b50b-8a364a6fcada for instance 22002049-4347-47d8-a5a2-6d3f31ec8927 on n-h2-465891-3 Jul 18 02:21:25.021555 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-bac011f6-0907-44de-aca4-2d97d4c122e4 req-6be86428-b3de-4610-a7d7-a7213d88b236 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.332799 Jul 18 02:21:25.023138 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ba2a7b2c-5908-4ed9-b792-3dd767e774b7 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:25.023555 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1186/2343] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:25.064974 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ba2a7b2c-5908-4ed9-b792-3dd767e774b7 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] 10.222.0.57 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.050278 Jul 18 02:21:25.072386 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1158/2344] 10.222.0.57 () {58 vars in 1136 bytes} [Mon Jul 18 02:21:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:25.141402 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b42f21d7-d646-4dde-b2b6-6b9df2198236 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:25.142826 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b42f21d7-d646-4dde-b2b6-6b9df2198236 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:25.170379 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b42f21d7-d646-4dde-b2b6-6b9df2198236 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:25.171408 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b42f21d7-d646-4dde-b2b6-6b9df2198236 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:25.172895 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b42f21d7-d646-4dde-b2b6-6b9df2198236 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:25.189422 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b42f21d7-d646-4dde-b2b6-6b9df2198236 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:25.439558 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5348d0f7-c793-49f4-ba7d-df8fee0e1829 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:25.440277 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5348d0f7-c793-49f4-ba7d-df8fee0e1829 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] [instance: 896cc676-e125-4e42-992c-be94d8965977] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:25.463445 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5348d0f7-c793-49f4-ba7d-df8fee0e1829 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:25.465009 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5348d0f7-c793-49f4-ba7d-df8fee0e1829 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:25.470929 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5348d0f7-c793-49f4-ba7d-df8fee0e1829 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:25.471920 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5348d0f7-c793-49f4-ba7d-df8fee0e1829 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:25.611529 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5348d0f7-c793-49f4-ba7d-df8fee0e1829 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] [instance: 896cc676-e125-4e42-992c-be94d8965977] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:21:25.644168 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b42f21d7-d646-4dde-b2b6-6b9df2198236 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:25.697949 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b42f21d7-d646-4dde-b2b6-6b9df2198236 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:25.706526 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b42f21d7-d646-4dde-b2b6-6b9df2198236 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:25.709544 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b42f21d7-d646-4dde-b2b6-6b9df2198236 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1486 microversion: 2.25 time: 0.576181 Jul 18 02:21:25.742501 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1187/2345] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:25 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1486 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:21:25.762399 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-76e90235-7d70-4b53-b727-c6bd3f8f398a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:25.771993 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-76e90235-7d70-4b53-b727-c6bd3f8f398a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] [instance: 22002049-4347-47d8-a5a2-6d3f31ec8927] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:25.799770 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-76e90235-7d70-4b53-b727-c6bd3f8f398a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:25.801148 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-76e90235-7d70-4b53-b727-c6bd3f8f398a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:25.806174 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-76e90235-7d70-4b53-b727-c6bd3f8f398a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:25.810474 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-76e90235-7d70-4b53-b727-c6bd3f8f398a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:25.852998 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-76e90235-7d70-4b53-b727-c6bd3f8f398a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] HTTP exception thrown: Instance 22002049-4347-47d8-a5a2-6d3f31ec8927 could not be found. Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-76e90235-7d70-4b53-b727-c6bd3f8f398a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Request method failure captured: Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 HTTP/1.1 Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MDxoIhYq-PuyDMFlQXpvNK2aUuzIqTYrptsOrKN4PRdQI3jif23F4uYig_PuKVXcsu8K3Abm9mAq_5FRRgTYbl1azkwUdzQa6ZC79fQpoio58iE72vUHSVbA38_URTvTgS_u5xLWglb1rnFLdm8_0kGQCYgVr34-6JeM0w6r8oCu94 Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: e382977cb6bf4f358fb3245cb3768140 Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-LiveMigrationTest-1548530922 Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e382977cb6bf4f358fb3245cb3768140"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e382977cb6bf4f358fb3245cb3768140"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e382977cb6bf4f358fb3245cb3768140"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e382977cb6bf4f358fb3245cb3768140"}]}] Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-LiveMigrationTest-1548530922 Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: e382977cb6bf4f358fb3245cb3768140 Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-LiveMigrationTest-1548530922 Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-LiveMigrationTest-1548530922-project Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 77381e85d31a4747acb08a8d4572eb1b Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-LiveMigrationTest-1548530922-project Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 22002049-4347-47d8-a5a2-6d3f31ec8927 could not be found. Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '22002049-4347-47d8-a5a2-6d3f31ec8927'} Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22002049-4347-47d8-a5a2-6d3f31ec8927 could not be found. Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22002049-4347-47d8-a5a2-6d3f31ec8927 could not be found. Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:21:25.858496 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:21:25.862338 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:21:25.862338 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:21:25.862338 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:21:25.862338 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:21:25.862338 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:21:25.862338 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22002049-4347-47d8-a5a2-6d3f31ec8927 could not be found. Jul 18 02:21:25.862338 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:21:25.868128 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-76e90235-7d70-4b53-b727-c6bd3f8f398a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] Returning 404 to user: Instance 22002049-4347-47d8-a5a2-6d3f31ec8927 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:21:25.872708 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-76e90235-7d70-4b53-b727-c6bd3f8f398a tempest-LiveMigrationTest-1548530922 tempest-LiveMigrationTest-1548530922-project] 10.222.0.57 "GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927" status: 404 len: 111 microversion: 2.1 time: 0.125743 Jul 18 02:21:25.875234 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5348d0f7-c793-49f4-ba7d-df8fee0e1829 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] 10.222.0.57 "DELETE /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977" status: 204 len: 0 microversion: 2.1 time: 0.442596 Jul 18 02:21:25.876283 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1159/2346] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:21:25 2022] DELETE /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:21:25.877046 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1188/2347] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:25 2022] GET /compute/v2.1/servers/22002049-4347-47d8-a5a2-6d3f31ec8927 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:21:25.888697 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9c7f3907-0502-4829-ab55-bcd3ebf4af69 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:25.889950 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9c7f3907-0502-4829-ab55-bcd3ebf4af69 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] [instance: 896cc676-e125-4e42-992c-be94d8965977] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:25.909441 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9c7f3907-0502-4829-ab55-bcd3ebf4af69 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:25.910183 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9c7f3907-0502-4829-ab55-bcd3ebf4af69 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:25.911198 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9c7f3907-0502-4829-ab55-bcd3ebf4af69 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:25.911844 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9c7f3907-0502-4829-ab55-bcd3ebf4af69 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:26.514979 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9c7f3907-0502-4829-ab55-bcd3ebf4af69 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de42754291d4c43b983b425a02ea9d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ed68b2710e40f487813716ca4965e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:26.534735 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9c7f3907-0502-4829-ab55-bcd3ebf4af69 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] 10.222.0.57 "GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977" status: 200 len: 1609 microversion: 2.1 time: 0.651400 Jul 18 02:21:26.535406 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1160/2348] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:25 2022] GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977 => generated 1609 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:21:26.748291 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1b07ab7c-79ba-4dd3-9913-f558461f3f04 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:26.749318 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1b07ab7c-79ba-4dd3-9913-f558461f3f04 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:26.771493 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1b07ab7c-79ba-4dd3-9913-f558461f3f04 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:26.772358 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1b07ab7c-79ba-4dd3-9913-f558461f3f04 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:26.773301 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1b07ab7c-79ba-4dd3-9913-f558461f3f04 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:26.773917 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1b07ab7c-79ba-4dd3-9913-f558461f3f04 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:27.570295 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a76c993d-0c0e-4ba0-a5c3-0730e0b15aa1 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:27.571332 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a76c993d-0c0e-4ba0-a5c3-0730e0b15aa1 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] [instance: 896cc676-e125-4e42-992c-be94d8965977] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:27.595529 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a76c993d-0c0e-4ba0-a5c3-0730e0b15aa1 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:27.599527 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a76c993d-0c0e-4ba0-a5c3-0730e0b15aa1 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:27.603086 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a76c993d-0c0e-4ba0-a5c3-0730e0b15aa1 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:27.603288 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a76c993d-0c0e-4ba0-a5c3-0730e0b15aa1 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:27.724694 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1b07ab7c-79ba-4dd3-9913-f558461f3f04 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:27.741029 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1b07ab7c-79ba-4dd3-9913-f558461f3f04 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:27.743878 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1b07ab7c-79ba-4dd3-9913-f558461f3f04 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:27.746295 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1b07ab7c-79ba-4dd3-9913-f558461f3f04 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1486 microversion: 2.25 time: 1.003295 Jul 18 02:21:27.760406 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1189/2349] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:26 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1486 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:28.009884 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-f4f8aca0-4fa6-4d99-be7b-aad2722994ae req-3d8c8b7b-446a-4ca5-a5af-254b2aadd17e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b909490f-2890-43c0-b956-9de562d52d67", "tag": "e55a6513-6292-448a-b056-14ca8f284b1b"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:28.043689 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-f4f8aca0-4fa6-4d99-be7b-aad2722994ae req-3d8c8b7b-446a-4ca5-a5af-254b2aadd17e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:28.044787 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-f4f8aca0-4fa6-4d99-be7b-aad2722994ae req-3d8c8b7b-446a-4ca5-a5af-254b2aadd17e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:28.095454 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-f4f8aca0-4fa6-4d99-be7b-aad2722994ae req-3d8c8b7b-446a-4ca5-a5af-254b2aadd17e service nova] Creating event network-changed:e55a6513-6292-448a-b056-14ca8f284b1b for instance b909490f-2890-43c0-b956-9de562d52d67 on n-h2-465891-3 Jul 18 02:21:28.128918 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-f4f8aca0-4fa6-4d99-be7b-aad2722994ae req-3d8c8b7b-446a-4ca5-a5af-254b2aadd17e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121972 Jul 18 02:21:28.129636 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1190/2350] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:28.770098 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-51f1c582-5b88-46c7-aa35-dfef23c9c5c6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:28.771090 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-51f1c582-5b88-46c7-aa35-dfef23c9c5c6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:28.786514 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-51f1c582-5b88-46c7-aa35-dfef23c9c5c6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:28.788136 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-51f1c582-5b88-46c7-aa35-dfef23c9c5c6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:28.789413 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-51f1c582-5b88-46c7-aa35-dfef23c9c5c6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:28.791398 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-51f1c582-5b88-46c7-aa35-dfef23c9c5c6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:29.213765 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-51f1c582-5b88-46c7-aa35-dfef23c9c5c6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:29.232474 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-51f1c582-5b88-46c7-aa35-dfef23c9c5c6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:29.239529 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-51f1c582-5b88-46c7-aa35-dfef23c9c5c6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:29.243144 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-51f1c582-5b88-46c7-aa35-dfef23c9c5c6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1486 microversion: 2.25 time: 0.478592 Jul 18 02:21:29.251270 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1191/2351] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:28 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1486 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:21:29.588154 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a76c993d-0c0e-4ba0-a5c3-0730e0b15aa1 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de42754291d4c43b983b425a02ea9d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ed68b2710e40f487813716ca4965e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:29.643611 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a76c993d-0c0e-4ba0-a5c3-0730e0b15aa1 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] 10.222.0.57 "GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977" status: 200 len: 1609 microversion: 2.1 time: 2.076764 Jul 18 02:21:29.660237 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1161/2352] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:27 2022] GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977 => generated 1609 bytes in 2095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:21:30.272752 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4a2ad97c-1877-4038-a18f-5feaaaf4bb4b tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:30.274639 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4a2ad97c-1877-4038-a18f-5feaaaf4bb4b tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:30.313200 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4a2ad97c-1877-4038-a18f-5feaaaf4bb4b tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:30.316060 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4a2ad97c-1877-4038-a18f-5feaaaf4bb4b tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:30.316944 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4a2ad97c-1877-4038-a18f-5feaaaf4bb4b tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:30.319502 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4a2ad97c-1877-4038-a18f-5feaaaf4bb4b tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:30.687561 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-21bd3301-f90a-4aa5-9eaf-648252ca1deb tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:30.692842 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-21bd3301-f90a-4aa5-9eaf-648252ca1deb tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] [instance: 896cc676-e125-4e42-992c-be94d8965977] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:30.719394 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-21bd3301-f90a-4aa5-9eaf-648252ca1deb tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:30.721020 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-21bd3301-f90a-4aa5-9eaf-648252ca1deb tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:30.724096 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-21bd3301-f90a-4aa5-9eaf-648252ca1deb tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:30.725316 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-21bd3301-f90a-4aa5-9eaf-648252ca1deb tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:30.798956 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:21:32.069880 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4a2ad97c-1877-4038-a18f-5feaaaf4bb4b tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:32.084163 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4a2ad97c-1877-4038-a18f-5feaaaf4bb4b tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:32.099129 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4a2ad97c-1877-4038-a18f-5feaaaf4bb4b tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:32.100417 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4a2ad97c-1877-4038-a18f-5feaaaf4bb4b tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1486 microversion: 2.25 time: 1.832753 Jul 18 02:21:32.101019 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1192/2353] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:30 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1486 bytes in 1834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:32.207316 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-21bd3301-f90a-4aa5-9eaf-648252ca1deb tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de42754291d4c43b983b425a02ea9d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ed68b2710e40f487813716ca4965e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:32.220482 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-21bd3301-f90a-4aa5-9eaf-648252ca1deb tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] 10.222.0.57 "GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977" status: 200 len: 1609 microversion: 2.1 time: 1.542846 Jul 18 02:21:32.222936 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1162/2354] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:30 2022] GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977 => generated 1609 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:21:33.145316 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2fee2d90-281f-4b43-b481-b89298444032 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:33.170331 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2fee2d90-281f-4b43-b481-b89298444032 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:33.225496 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2fee2d90-281f-4b43-b481-b89298444032 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:33.226829 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2fee2d90-281f-4b43-b481-b89298444032 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:33.228742 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2fee2d90-281f-4b43-b481-b89298444032 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:33.231041 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2fee2d90-281f-4b43-b481-b89298444032 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:33.254049 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e358a6fa-1d01-4fa2-b6d8-e9c7c06affdc tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:33.255484 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e358a6fa-1d01-4fa2-b6d8-e9c7c06affdc tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] [instance: 896cc676-e125-4e42-992c-be94d8965977] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:33.311352 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e358a6fa-1d01-4fa2-b6d8-e9c7c06affdc tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:33.311713 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e358a6fa-1d01-4fa2-b6d8-e9c7c06affdc tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:33.313733 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e358a6fa-1d01-4fa2-b6d8-e9c7c06affdc tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:33.314249 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e358a6fa-1d01-4fa2-b6d8-e9c7c06affdc tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:33.851904 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:21:33.924456 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:21:34.145430 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e358a6fa-1d01-4fa2-b6d8-e9c7c06affdc tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de42754291d4c43b983b425a02ea9d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ed68b2710e40f487813716ca4965e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:34.167847 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e358a6fa-1d01-4fa2-b6d8-e9c7c06affdc tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] 10.222.0.57 "GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977" status: 200 len: 1541 microversion: 2.1 time: 0.918767 Jul 18 02:21:34.180558 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1163/2355] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:33 2022] GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977 => generated 1541 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:21:35.000231 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2fee2d90-281f-4b43-b481-b89298444032 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:35.018218 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2fee2d90-281f-4b43-b481-b89298444032 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:35.030166 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2fee2d90-281f-4b43-b481-b89298444032 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:35.033679 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2fee2d90-281f-4b43-b481-b89298444032 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1486 microversion: 2.25 time: 1.915352 Jul 18 02:21:35.035195 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1193/2356] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:33 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1486 bytes in 1920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:21:35.210389 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7c7be982-4576-473b-bc62-0797e3bd0eb7 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:35.211985 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7c7be982-4576-473b-bc62-0797e3bd0eb7 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] [instance: 896cc676-e125-4e42-992c-be94d8965977] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:35.231356 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7c7be982-4576-473b-bc62-0797e3bd0eb7 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:35.232204 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7c7be982-4576-473b-bc62-0797e3bd0eb7 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:35.235802 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7c7be982-4576-473b-bc62-0797e3bd0eb7 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:35.236643 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7c7be982-4576-473b-bc62-0797e3bd0eb7 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:35.600235 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7c7be982-4576-473b-bc62-0797e3bd0eb7 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de42754291d4c43b983b425a02ea9d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ed68b2710e40f487813716ca4965e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:35.642869 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7c7be982-4576-473b-bc62-0797e3bd0eb7 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] 10.222.0.57 "GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977" status: 200 len: 1541 microversion: 2.1 time: 0.437828 Jul 18 02:21:35.643633 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1164/2357] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:35 2022] GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977 => generated 1541 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:21:36.061341 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ae3060e8-6133-4d9a-b02d-0e46d775893e tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:36.067593 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ae3060e8-6133-4d9a-b02d-0e46d775893e tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:36.102832 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ae3060e8-6133-4d9a-b02d-0e46d775893e tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:36.108036 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-4388d68f-61a7-4f8a-98d7-e4c8bf761b28 req-3e1e68d5-34b0-47ed-a6cb-600f2cf885e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "896cc676-e125-4e42-992c-be94d8965977", "name": "network-vif-deleted", "tag": "74150074-2639-48b5-9935-1a1c8780d926"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:36.109116 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ae3060e8-6133-4d9a-b02d-0e46d775893e tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:36.113504 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ae3060e8-6133-4d9a-b02d-0e46d775893e tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:36.118245 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ae3060e8-6133-4d9a-b02d-0e46d775893e tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:36.162852 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-4388d68f-61a7-4f8a-98d7-e4c8bf761b28 req-3e1e68d5-34b0-47ed-a6cb-600f2cf885e2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:36.174199 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-4388d68f-61a7-4f8a-98d7-e4c8bf761b28 req-3e1e68d5-34b0-47ed-a6cb-600f2cf885e2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:36.266641 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-4388d68f-61a7-4f8a-98d7-e4c8bf761b28 req-3e1e68d5-34b0-47ed-a6cb-600f2cf885e2 service nova] Creating event network-vif-deleted:74150074-2639-48b5-9935-1a1c8780d926 for instance 896cc676-e125-4e42-992c-be94d8965977 on n-h1-465891-3 Jul 18 02:21:36.306134 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-4388d68f-61a7-4f8a-98d7-e4c8bf761b28 req-3e1e68d5-34b0-47ed-a6cb-600f2cf885e2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195509 Jul 18 02:21:36.314606 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1165/2358] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:36.683863 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c0000b27-e3aa-4096-b1ed-e0988f694ebc tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:36.688550 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c0000b27-e3aa-4096-b1ed-e0988f694ebc tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] [instance: 896cc676-e125-4e42-992c-be94d8965977] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:36.718670 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c0000b27-e3aa-4096-b1ed-e0988f694ebc tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:36.721223 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c0000b27-e3aa-4096-b1ed-e0988f694ebc tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:36.724544 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c0000b27-e3aa-4096-b1ed-e0988f694ebc tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:36.727610 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c0000b27-e3aa-4096-b1ed-e0988f694ebc tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:37.023178 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c0000b27-e3aa-4096-b1ed-e0988f694ebc tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de42754291d4c43b983b425a02ea9d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ed68b2710e40f487813716ca4965e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:37.066267 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c0000b27-e3aa-4096-b1ed-e0988f694ebc tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] 10.222.0.57 "GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977" status: 200 len: 1253 microversion: 2.1 time: 0.391731 Jul 18 02:21:37.074206 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1166/2359] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:36 2022] GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977 => generated 1253 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:21:37.150277 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ae3060e8-6133-4d9a-b02d-0e46d775893e tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:37.173281 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ae3060e8-6133-4d9a-b02d-0e46d775893e tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:37.180734 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ae3060e8-6133-4d9a-b02d-0e46d775893e tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:37.184877 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ae3060e8-6133-4d9a-b02d-0e46d775893e tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1486 microversion: 2.25 time: 1.133528 Jul 18 02:21:37.190097 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1194/2360] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:36 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1486 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:21:38.110646 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6aa44323-9ba5-4904-a8cc-46030af53bb9 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:38.114063 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6aa44323-9ba5-4904-a8cc-46030af53bb9 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] [instance: 896cc676-e125-4e42-992c-be94d8965977] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:38.159306 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6aa44323-9ba5-4904-a8cc-46030af53bb9 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:38.171769 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6aa44323-9ba5-4904-a8cc-46030af53bb9 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:38.173557 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6aa44323-9ba5-4904-a8cc-46030af53bb9 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:38.174855 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6aa44323-9ba5-4904-a8cc-46030af53bb9 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:38.233894 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-447ef952-96e1-4592-a387-a707b8e3b426 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:38.237884 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-447ef952-96e1-4592-a387-a707b8e3b426 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:38.286621 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-447ef952-96e1-4592-a387-a707b8e3b426 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:38.290159 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-447ef952-96e1-4592-a387-a707b8e3b426 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:38.293809 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-447ef952-96e1-4592-a387-a707b8e3b426 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:38.296277 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-447ef952-96e1-4592-a387-a707b8e3b426 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:38.817915 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6aa44323-9ba5-4904-a8cc-46030af53bb9 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de42754291d4c43b983b425a02ea9d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ed68b2710e40f487813716ca4965e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:38.830586 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6aa44323-9ba5-4904-a8cc-46030af53bb9 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] 10.222.0.57 "GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977" status: 200 len: 1253 microversion: 2.1 time: 0.738267 Jul 18 02:21:38.834044 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1167/2361] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:38 2022] GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977 => generated 1253 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:21:39.259107 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c46f9c9b-a53c-4647-a30a-a79a417b39a8 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:39.260979 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c46f9c9b-a53c-4647-a30a-a79a417b39a8 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] [instance: 0f30e76e-91e9-441f-b482-28de008a5e40] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:39.295020 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c46f9c9b-a53c-4647-a30a-a79a417b39a8 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:39.295410 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c46f9c9b-a53c-4647-a30a-a79a417b39a8 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:39.296254 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c46f9c9b-a53c-4647-a30a-a79a417b39a8 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:39.296703 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c46f9c9b-a53c-4647-a30a-a79a417b39a8 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:39.371954 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-c46f9c9b-a53c-4647-a30a-a79a417b39a8 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] HTTP exception thrown: Instance 0f30e76e-91e9-441f-b482-28de008a5e40 could not be found. Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c46f9c9b-a53c-4647-a30a-a79a417b39a8 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Request method failure captured: Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40 HTTP/1.1 Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MK7Pac-IW3Op3UnmraS72cE4sAhI3O5e-FqqdFNnZcQ5qG_D4S3wn9jbPcZryPZAoRG7e79xpO9t7Rlftw9aZaL_DDejA1BFduxOzeQwfCdnhHthjtF9DV6hb65QXUAL1Na8TIn4PisQ5NOS0-QSSyuL-z6dSlYB2TRLkZsTv0-o3Y Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 0cef90571c1a4b31bb089a9242569cc2 Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1629905749 Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0cef90571c1a4b31bb089a9242569cc2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0cef90571c1a4b31bb089a9242569cc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0cef90571c1a4b31bb089a9242569cc2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0cef90571c1a4b31bb089a9242569cc2"}]}] Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1629905749 Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 0cef90571c1a4b31bb089a9242569cc2 Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1629905749 Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-AttachSCSIVolumeTestJSON-1629905749-project Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: aa996f5ca59e4423ac26d459aab6c7c9 Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1629905749-project Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 0f30e76e-91e9-441f-b482-28de008a5e40 could not be found. Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '0f30e76e-91e9-441f-b482-28de008a5e40'} Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f30e76e-91e9-441f-b482-28de008a5e40 could not be found. Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:21:39.375386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:21:39.379135 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f30e76e-91e9-441f-b482-28de008a5e40 could not be found. Jul 18 02:21:39.379135 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:21:39.379135 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:21:39.379135 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:21:39.379135 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:21:39.379135 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:21:39.379135 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:21:39.379135 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:21:39.379135 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:21:39.379135 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f30e76e-91e9-441f-b482-28de008a5e40 could not be found. Jul 18 02:21:39.379135 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:21:39.382382 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c46f9c9b-a53c-4647-a30a-a79a417b39a8 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Returning 404 to user: Instance 0f30e76e-91e9-441f-b482-28de008a5e40 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:21:39.383851 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c46f9c9b-a53c-4647-a30a-a79a417b39a8 tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] 10.222.0.57 "DELETE /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40" status: 404 len: 111 microversion: 2.1 time: 0.129077 Jul 18 02:21:39.388063 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1168/2362] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:21:39 2022] DELETE /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:21:39.397918 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6bc76082-26a9-4a52-a6a3-ff048c7ec7cc tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:39.398655 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6bc76082-26a9-4a52-a6a3-ff048c7ec7cc tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] [instance: 0f30e76e-91e9-441f-b482-28de008a5e40] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:39.435845 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6bc76082-26a9-4a52-a6a3-ff048c7ec7cc tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:39.436722 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6bc76082-26a9-4a52-a6a3-ff048c7ec7cc tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:39.437102 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6bc76082-26a9-4a52-a6a3-ff048c7ec7cc tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:39.437550 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6bc76082-26a9-4a52-a6a3-ff048c7ec7cc tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:39.494230 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-6bc76082-26a9-4a52-a6a3-ff048c7ec7cc tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] HTTP exception thrown: Instance 0f30e76e-91e9-441f-b482-28de008a5e40 could not be found. Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6bc76082-26a9-4a52-a6a3-ff048c7ec7cc tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Request method failure captured: Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40 HTTP/1.1 Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MK7Pac-IW3Op3UnmraS72cE4sAhI3O5e-FqqdFNnZcQ5qG_D4S3wn9jbPcZryPZAoRG7e79xpO9t7Rlftw9aZaL_DDejA1BFduxOzeQwfCdnhHthjtF9DV6hb65QXUAL1Na8TIn4PisQ5NOS0-QSSyuL-z6dSlYB2TRLkZsTv0-o3Y Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 0cef90571c1a4b31bb089a9242569cc2 Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1629905749 Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0cef90571c1a4b31bb089a9242569cc2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0cef90571c1a4b31bb089a9242569cc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0cef90571c1a4b31bb089a9242569cc2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0cef90571c1a4b31bb089a9242569cc2"}]}] Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1629905749 Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 0cef90571c1a4b31bb089a9242569cc2 Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1629905749 Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-AttachSCSIVolumeTestJSON-1629905749-project Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: aa996f5ca59e4423ac26d459aab6c7c9 Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1629905749-project Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 0f30e76e-91e9-441f-b482-28de008a5e40 could not be found. Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '0f30e76e-91e9-441f-b482-28de008a5e40'} Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f30e76e-91e9-441f-b482-28de008a5e40 could not be found. Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f30e76e-91e9-441f-b482-28de008a5e40 could not be found. Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:21:39.496607 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:21:39.514709 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:21:39.514709 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:21:39.514709 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:21:39.514709 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:21:39.514709 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:21:39.514709 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f30e76e-91e9-441f-b482-28de008a5e40 could not be found. Jul 18 02:21:39.514709 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:21:39.514709 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6bc76082-26a9-4a52-a6a3-ff048c7ec7cc tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] Returning 404 to user: Instance 0f30e76e-91e9-441f-b482-28de008a5e40 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:21:39.514709 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6bc76082-26a9-4a52-a6a3-ff048c7ec7cc tempest-AttachSCSIVolumeTestJSON-1629905749 tempest-AttachSCSIVolumeTestJSON-1629905749-project] 10.222.0.57 "GET /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40" status: 404 len: 111 microversion: 2.1 time: 0.105275 Jul 18 02:21:39.514709 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1169/2363] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:39 2022] GET /compute/v2.1/servers/0f30e76e-91e9-441f-b482-28de008a5e40 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:21:39.857747 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-28eb9d8c-68b7-48d3-8074-b3659b4eb1e4 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:39.861028 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-28eb9d8c-68b7-48d3-8074-b3659b4eb1e4 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] [instance: 896cc676-e125-4e42-992c-be94d8965977] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:39.887894 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-28eb9d8c-68b7-48d3-8074-b3659b4eb1e4 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:39.890901 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-28eb9d8c-68b7-48d3-8074-b3659b4eb1e4 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:39.894462 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-28eb9d8c-68b7-48d3-8074-b3659b4eb1e4 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:39.900017 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-28eb9d8c-68b7-48d3-8074-b3659b4eb1e4 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:39.967400 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-447ef952-96e1-4592-a387-a707b8e3b426 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:39.986250 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-447ef952-96e1-4592-a387-a707b8e3b426 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:39.991926 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-447ef952-96e1-4592-a387-a707b8e3b426 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:40.001576 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-447ef952-96e1-4592-a387-a707b8e3b426 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1486 microversion: 2.25 time: 1.779023 Jul 18 02:21:40.003408 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1195/2364] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:38 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1486 bytes in 1789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:21:40.394748 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-28eb9d8c-68b7-48d3-8074-b3659b4eb1e4 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de42754291d4c43b983b425a02ea9d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ed68b2710e40f487813716ca4965e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:40.415713 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-28eb9d8c-68b7-48d3-8074-b3659b4eb1e4 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] 10.222.0.57 "GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977" status: 200 len: 1253 microversion: 2.1 time: 0.567834 Jul 18 02:21:40.420232 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1170/2365] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:39 2022] GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977 => generated 1253 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:21:41.035839 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-71453e1d-d5b8-4143-ad1e-4b91e4dc197d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:41.042361 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-71453e1d-d5b8-4143-ad1e-4b91e4dc197d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:41.077198 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-71453e1d-d5b8-4143-ad1e-4b91e4dc197d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:41.082775 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-71453e1d-d5b8-4143-ad1e-4b91e4dc197d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:41.094991 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-71453e1d-d5b8-4143-ad1e-4b91e4dc197d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:41.098818 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-71453e1d-d5b8-4143-ad1e-4b91e4dc197d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:41.456182 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e5999aef-9685-4866-a495-456fd7251c6c tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:41.467296 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e5999aef-9685-4866-a495-456fd7251c6c tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] [instance: 896cc676-e125-4e42-992c-be94d8965977] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:41.546098 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e5999aef-9685-4866-a495-456fd7251c6c tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:41.550960 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e5999aef-9685-4866-a495-456fd7251c6c tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:41.555383 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e5999aef-9685-4866-a495-456fd7251c6c tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:41.562397 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e5999aef-9685-4866-a495-456fd7251c6c tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:42.334252 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e5999aef-9685-4866-a495-456fd7251c6c tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de42754291d4c43b983b425a02ea9d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ed68b2710e40f487813716ca4965e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:42.381364 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e5999aef-9685-4866-a495-456fd7251c6c tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] 10.222.0.57 "GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977" status: 200 len: 1253 microversion: 2.1 time: 0.935375 Jul 18 02:21:42.387257 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1171/2366] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:41 2022] GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977 => generated 1253 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:21:42.434217 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-71453e1d-d5b8-4143-ad1e-4b91e4dc197d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:42.492684 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-71453e1d-d5b8-4143-ad1e-4b91e4dc197d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:42.503326 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-71453e1d-d5b8-4143-ad1e-4b91e4dc197d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:42.513962 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-71453e1d-d5b8-4143-ad1e-4b91e4dc197d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1486 microversion: 2.25 time: 1.490033 Jul 18 02:21:42.519593 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1196/2367] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:41 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1486 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:43.432966 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-82cec402-9f92-41e0-8b8e-e6699a859880 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:43.438111 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-82cec402-9f92-41e0-8b8e-e6699a859880 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] [instance: 896cc676-e125-4e42-992c-be94d8965977] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:43.462770 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:21:43.522887 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-82cec402-9f92-41e0-8b8e-e6699a859880 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:43.528373 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-82cec402-9f92-41e0-8b8e-e6699a859880 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:43.530065 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-82cec402-9f92-41e0-8b8e-e6699a859880 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:43.535446 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-82cec402-9f92-41e0-8b8e-e6699a859880 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:43.570182 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f6f6483f-43c1-4abd-8e51-11c8b1886f38 tempest-FloatingIPDetailsTestJSON-1825447231 tempest-FloatingIPDetailsTestJSON-1825447231-project] Action: 'create', calling method: .version_select at 0x7ff49bfafc10>, body: {"pool": null} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:44.145432 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-82cec402-9f92-41e0-8b8e-e6699a859880 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de42754291d4c43b983b425a02ea9d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ed68b2710e40f487813716ca4965e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:44.188313 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-82cec402-9f92-41e0-8b8e-e6699a859880 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] 10.222.0.57 "GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977" status: 200 len: 1253 microversion: 2.1 time: 0.758762 Jul 18 02:21:44.189935 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1197/2368] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:43 2022] GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977 => generated 1253 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:21:44.211511 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-06a642e9-3dce-4e61-aa23-4effb2525d22 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:44.216422 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-06a642e9-3dce-4e61-aa23-4effb2525d22 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:44.243490 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-06a642e9-3dce-4e61-aa23-4effb2525d22 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:44.247182 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-06a642e9-3dce-4e61-aa23-4effb2525d22 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:44.250983 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-06a642e9-3dce-4e61-aa23-4effb2525d22 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:44.256592 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-06a642e9-3dce-4e61-aa23-4effb2525d22 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:47.106691 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-06a642e9-3dce-4e61-aa23-4effb2525d22 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:47.133110 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-06a642e9-3dce-4e61-aa23-4effb2525d22 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:47.142551 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-06a642e9-3dce-4e61-aa23-4effb2525d22 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:47.155207 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-06a642e9-3dce-4e61-aa23-4effb2525d22 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1486 microversion: 2.25 time: 2.962353 Jul 18 02:21:47.168436 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1198/2369] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:44 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1486 bytes in 2976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:47.201467 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a51e2c23-2838-4d84-8a24-6fd355589363 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:47.203483 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a51e2c23-2838-4d84-8a24-6fd355589363 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] [instance: 896cc676-e125-4e42-992c-be94d8965977] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:47.235288 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a51e2c23-2838-4d84-8a24-6fd355589363 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:47.239222 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a51e2c23-2838-4d84-8a24-6fd355589363 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:47.240660 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a51e2c23-2838-4d84-8a24-6fd355589363 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:47.241445 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a51e2c23-2838-4d84-8a24-6fd355589363 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:47.512739 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a51e2c23-2838-4d84-8a24-6fd355589363 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de42754291d4c43b983b425a02ea9d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ed68b2710e40f487813716ca4965e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:47.549581 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a51e2c23-2838-4d84-8a24-6fd355589363 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] 10.222.0.57 "GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977" status: 200 len: 1253 microversion: 2.1 time: 0.375053 Jul 18 02:21:47.551538 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1199/2370] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:47 2022] GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977 => generated 1253 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:21:48.199453 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fdbea797-a88f-41d9-9676-082c55ae9be4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:48.204881 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fdbea797-a88f-41d9-9676-082c55ae9be4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:48.238400 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fdbea797-a88f-41d9-9676-082c55ae9be4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:48.243476 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fdbea797-a88f-41d9-9676-082c55ae9be4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:48.250823 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fdbea797-a88f-41d9-9676-082c55ae9be4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:48.252066 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fdbea797-a88f-41d9-9676-082c55ae9be4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:49.737323 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fdbea797-a88f-41d9-9676-082c55ae9be4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:49.740779 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:21:49.761586 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fdbea797-a88f-41d9-9676-082c55ae9be4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:49.765847 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fdbea797-a88f-41d9-9676-082c55ae9be4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:49.770652 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fdbea797-a88f-41d9-9676-082c55ae9be4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1486 microversion: 2.25 time: 1.589875 Jul 18 02:21:49.772849 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1200/2371] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:48 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1486 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:49.786386 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-319760e2-fd7e-4f6e-b475-acf57a6c440e tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:49.788226 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-319760e2-fd7e-4f6e-b475-acf57a6c440e tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] [instance: 896cc676-e125-4e42-992c-be94d8965977] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:49.806349 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-319760e2-fd7e-4f6e-b475-acf57a6c440e tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:49.808957 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-319760e2-fd7e-4f6e-b475-acf57a6c440e tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:49.812237 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-319760e2-fd7e-4f6e-b475-acf57a6c440e tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:49.813068 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-319760e2-fd7e-4f6e-b475-acf57a6c440e tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:50.539428 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-319760e2-fd7e-4f6e-b475-acf57a6c440e tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de42754291d4c43b983b425a02ea9d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ed68b2710e40f487813716ca4965e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:50.563108 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-319760e2-fd7e-4f6e-b475-acf57a6c440e tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] 10.222.0.57 "GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977" status: 200 len: 1253 microversion: 2.1 time: 0.778940 Jul 18 02:21:50.566376 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1201/2372] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:49 2022] GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977 => generated 1253 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:21:50.814102 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c8f59f4f-812d-4c2c-adef-aed9f785b40b tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:50.816766 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c8f59f4f-812d-4c2c-adef-aed9f785b40b tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:50.848881 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c8f59f4f-812d-4c2c-adef-aed9f785b40b tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:50.851430 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c8f59f4f-812d-4c2c-adef-aed9f785b40b tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:50.857806 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c8f59f4f-812d-4c2c-adef-aed9f785b40b tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:50.861663 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c8f59f4f-812d-4c2c-adef-aed9f785b40b tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:51.509027 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:21:52.356439 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c8f59f4f-812d-4c2c-adef-aed9f785b40b tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:52.373538 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=47 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:21:52.389026 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c8f59f4f-812d-4c2c-adef-aed9f785b40b tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:52.390899 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c8f59f4f-812d-4c2c-adef-aed9f785b40b tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:52.392171 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c8f59f4f-812d-4c2c-adef-aed9f785b40b tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1486 microversion: 2.25 time: 1.601660 Jul 18 02:21:52.392899 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1202/2373] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:50 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1486 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:52.427568 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1e3d4178-bf0d-44bd-b956-270368ca152a tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:52.438357 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1e3d4178-bf0d-44bd-b956-270368ca152a tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] [instance: 896cc676-e125-4e42-992c-be94d8965977] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:52.493297 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1e3d4178-bf0d-44bd-b956-270368ca152a tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:52.502908 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1e3d4178-bf0d-44bd-b956-270368ca152a tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:52.509187 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1e3d4178-bf0d-44bd-b956-270368ca152a tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:52.516837 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1e3d4178-bf0d-44bd-b956-270368ca152a tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:52.563030 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f6f6483f-43c1-4abd-8e51-11c8b1886f38 tempest-FloatingIPDetailsTestJSON-1825447231 tempest-FloatingIPDetailsTestJSON-1825447231-project] 10.222.0.57 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 10.172249 Jul 18 02:21:52.571954 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1172/2374] 10.222.0.57 () {60 vars in 1169 bytes} [Mon Jul 18 02:21:42 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 10184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:52.577121 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-68a1a0cb-c099-4c5b-ae74-dfdde0820a9b req-69f003e0-918c-4338-9a2d-17ca2036cd8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2563fe1c-ce0c-4a16-8d70-eb578016eae9", "name": "network-vif-unplugged", "status": "completed", "tag": "85a63441-1332-45c5-b28b-36162eda7e6e"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:52.628135 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-68a1a0cb-c099-4c5b-ae74-dfdde0820a9b req-69f003e0-918c-4338-9a2d-17ca2036cd8b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:52.631270 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-68a1a0cb-c099-4c5b-ae74-dfdde0820a9b req-69f003e0-918c-4338-9a2d-17ca2036cd8b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:52.645821 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1e3d4178-bf0d-44bd-b956-270368ca152a tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:52.648406 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1e3d4178-bf0d-44bd-b956-270368ca152a tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:52.652103 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-1e3d4178-bf0d-44bd-b956-270368ca152a tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lazy-loading 'fault' on Instance uuid 896cc676-e125-4e42-992c-be94d8965977 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:21:52.693976 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-68a1a0cb-c099-4c5b-ae74-dfdde0820a9b req-69f003e0-918c-4338-9a2d-17ca2036cd8b service nova] Creating event network-vif-unplugged:85a63441-1332-45c5-b28b-36162eda7e6e for instance 2563fe1c-ce0c-4a16-8d70-eb578016eae9 on n-h1-465891-3 Jul 18 02:21:52.708486 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-68a1a0cb-c099-4c5b-ae74-dfdde0820a9b req-69f003e0-918c-4338-9a2d-17ca2036cd8b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.135139 Jul 18 02:21:52.714416 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1173/2375] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:52.758256 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-13f91f00-3d3f-4f5a-9979-5ad9f5fefe86 tempest-FloatingIPDetailsTestJSON-1825447231 tempest-FloatingIPDetailsTestJSON-1825447231-project] Action: 'create', calling method: .version_select at 0x7ff4a834e790>, body: {"pool": null} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:53.147037 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1e3d4178-bf0d-44bd-b956-270368ca152a tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de42754291d4c43b983b425a02ea9d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ed68b2710e40f487813716ca4965e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:53.160131 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1e3d4178-bf0d-44bd-b956-270368ca152a tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] 10.222.0.57 "GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977" status: 200 len: 1258 microversion: 2.1 time: 0.766102 Jul 18 02:21:53.160742 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1203/2376] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:52 2022] GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977 => generated 1258 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:21:53.412626 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-aef5f12a-0bf3-49bc-aaf5-5721ec403311 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:53.413562 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-aef5f12a-0bf3-49bc-aaf5-5721ec403311 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:53.428311 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aef5f12a-0bf3-49bc-aaf5-5721ec403311 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:53.430501 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aef5f12a-0bf3-49bc-aaf5-5721ec403311 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:53.431706 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aef5f12a-0bf3-49bc-aaf5-5721ec403311 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:53.432609 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aef5f12a-0bf3-49bc-aaf5-5721ec403311 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:55.916056 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-aef5f12a-0bf3-49bc-aaf5-5721ec403311 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:55.982117 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-aef5f12a-0bf3-49bc-aaf5-5721ec403311 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:55.991006 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-aef5f12a-0bf3-49bc-aaf5-5721ec403311 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:56.002453 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-aef5f12a-0bf3-49bc-aaf5-5721ec403311 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1486 microversion: 2.25 time: 2.594934 Jul 18 02:21:56.011578 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1204/2377] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:53 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1486 bytes in 2605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:56.033965 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c4476aa8-d4f2-426c-8c41-83e6696bc447 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:56.033965 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c4476aa8-d4f2-426c-8c41-83e6696bc447 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] [instance: 896cc676-e125-4e42-992c-be94d8965977] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:56.067378 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c4476aa8-d4f2-426c-8c41-83e6696bc447 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:56.071727 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c4476aa8-d4f2-426c-8c41-83e6696bc447 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:56.075929 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c4476aa8-d4f2-426c-8c41-83e6696bc447 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:56.080459 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c4476aa8-d4f2-426c-8c41-83e6696bc447 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:56.153122 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-c4476aa8-d4f2-426c-8c41-83e6696bc447 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] HTTP exception thrown: Instance 896cc676-e125-4e42-992c-be94d8965977 could not be found. Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c4476aa8-d4f2-426c-8c41-83e6696bc447 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Request method failure captured: Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977 HTTP/1.1 Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MMQhet-rA9O_G3x1_M6b_SEvP41CkIjf8gWJCA4EQhKNtqU3LXNlmX8d9wGCUNs7FJc29uHMta19zPJ5Qixq2-gjPP259m4QEYOhlWDU9bCqiN5NvZRRSXHmCYPqKS2plF3NJt93wjcNRjdrco9bac0H_qT12HsqUnYPd4zOHoT_Mo Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: d0ed68b2710e40f487813716ca4965e9 Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersTestBootFromVolume-1599769302 Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d0ed68b2710e40f487813716ca4965e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d0ed68b2710e40f487813716ca4965e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d0ed68b2710e40f487813716ca4965e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d0ed68b2710e40f487813716ca4965e9"}]}] Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersTestBootFromVolume-1599769302 Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: d0ed68b2710e40f487813716ca4965e9 Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1599769302 Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersTestBootFromVolume-1599769302-project Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 1de42754291d4c43b983b425a02ea9d3 Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersTestBootFromVolume-1599769302-project Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 896cc676-e125-4e42-992c-be94d8965977 could not be found. Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '896cc676-e125-4e42-992c-be94d8965977'} Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 896cc676-e125-4e42-992c-be94d8965977 could not be found. Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 896cc676-e125-4e42-992c-be94d8965977 could not be found. Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:21:56.161421 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:21:56.165411 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:21:56.165411 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:21:56.165411 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:21:56.165411 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:21:56.165411 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:21:56.165411 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 896cc676-e125-4e42-992c-be94d8965977 could not be found. Jul 18 02:21:56.165411 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:21:56.166185 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c4476aa8-d4f2-426c-8c41-83e6696bc447 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Returning 404 to user: Instance 896cc676-e125-4e42-992c-be94d8965977 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:21:56.171391 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c4476aa8-d4f2-426c-8c41-83e6696bc447 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] 10.222.0.57 "GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977" status: 404 len: 111 microversion: 2.1 time: 0.154217 Jul 18 02:21:56.173940 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1205/2378] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:56 2022] GET /compute/v2.1/servers/896cc676-e125-4e42-992c-be94d8965977 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:21:56.228298 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4ba7c16c-9507-46d9-8703-5378c2f06e38 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] Calling method '.version_select at 0x7ff49bef4c10>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:56.363292 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4ba7c16c-9507-46d9-8703-5378c2f06e38 tempest-ServersTestBootFromVolume-1599769302 tempest-ServersTestBootFromVolume-1599769302-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1680034301" status: 202 len: 0 microversion: 2.1 time: 0.182261 Jul 18 02:21:56.367446 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1206/2379] 10.222.0.57 () {58 vars in 1220 bytes} [Mon Jul 18 02:21:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1680034301 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:21:56.404637 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-f7271fc7-abaa-45c6-8965-22282ff0c78e req-98df5db6-bdf8-4501-beae-c9badeda6de5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2563fe1c-ce0c-4a16-8d70-eb578016eae9", "tag": "85a63441-1332-45c5-b28b-36162eda7e6e"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:56.461498 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-f7271fc7-abaa-45c6-8965-22282ff0c78e req-98df5db6-bdf8-4501-beae-c9badeda6de5 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:56.466217 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-f7271fc7-abaa-45c6-8965-22282ff0c78e req-98df5db6-bdf8-4501-beae-c9badeda6de5 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:56.515651 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-f7271fc7-abaa-45c6-8965-22282ff0c78e req-98df5db6-bdf8-4501-beae-c9badeda6de5 service nova] Creating event network-changed:85a63441-1332-45c5-b28b-36162eda7e6e for instance 2563fe1c-ce0c-4a16-8d70-eb578016eae9 on n-h1-465891-3 Jul 18 02:21:56.556479 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-f7271fc7-abaa-45c6-8965-22282ff0c78e req-98df5db6-bdf8-4501-beae-c9badeda6de5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173902 Jul 18 02:21:56.596204 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1207/2380] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:57.064989 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8b62a4b2-c3ab-44f2-acb9-4fdb37bedf03 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:57.068928 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8b62a4b2-c3ab-44f2-acb9-4fdb37bedf03 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:57.079954 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8b62a4b2-c3ab-44f2-acb9-4fdb37bedf03 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:57.080774 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8b62a4b2-c3ab-44f2-acb9-4fdb37bedf03 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:57.081909 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8b62a4b2-c3ab-44f2-acb9-4fdb37bedf03 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:57.082568 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8b62a4b2-c3ab-44f2-acb9-4fdb37bedf03 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:57.763825 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8b62a4b2-c3ab-44f2-acb9-4fdb37bedf03 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:57.773850 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8b62a4b2-c3ab-44f2-acb9-4fdb37bedf03 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:57.785581 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8b62a4b2-c3ab-44f2-acb9-4fdb37bedf03 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:57.787461 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8b62a4b2-c3ab-44f2-acb9-4fdb37bedf03 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1486 microversion: 2.25 time: 0.743112 Jul 18 02:21:57.788633 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1208/2381] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:57 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1486 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:58.824744 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2405f9d0-1b2a-4678-aaa8-cd1da61164d3 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:58.833531 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2405f9d0-1b2a-4678-aaa8-cd1da61164d3 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:58.863677 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2405f9d0-1b2a-4678-aaa8-cd1da61164d3 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:58.864525 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2405f9d0-1b2a-4678-aaa8-cd1da61164d3 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:58.871904 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2405f9d0-1b2a-4678-aaa8-cd1da61164d3 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:58.872826 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2405f9d0-1b2a-4678-aaa8-cd1da61164d3 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:59.749821 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2405f9d0-1b2a-4678-aaa8-cd1da61164d3 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:59.816448 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2405f9d0-1b2a-4678-aaa8-cd1da61164d3 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:59.818083 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2405f9d0-1b2a-4678-aaa8-cd1da61164d3 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:59.820680 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2405f9d0-1b2a-4678-aaa8-cd1da61164d3 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1486 microversion: 2.25 time: 1.005061 Jul 18 02:21:59.824192 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1209/2382] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:58 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1486 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:22:00.638007 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-13f91f00-3d3f-4f5a-9979-5ad9f5fefe86 tempest-FloatingIPDetailsTestJSON-1825447231 tempest-FloatingIPDetailsTestJSON-1825447231-project] 10.222.0.57 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 7.921085 Jul 18 02:22:00.652060 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1174/2383] 10.222.0.57 () {60 vars in 1169 bytes} [Mon Jul 18 02:21:52 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 7937 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:22:00.657817 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6adc2187-d128-4e20-84f2-8de2c74ffdf1 tempest-FloatingIPDetailsTestJSON-1825447231 tempest-FloatingIPDetailsTestJSON-1825447231-project] Action: 'create', calling method: .version_select at 0x7ff49bb44430>, body: {"pool": null} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:22:00.856269 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a348bc08-8a43-4f86-8016-5f55acaeff7d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:00.862159 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a348bc08-8a43-4f86-8016-5f55acaeff7d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:00.940416 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a348bc08-8a43-4f86-8016-5f55acaeff7d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:00.947873 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a348bc08-8a43-4f86-8016-5f55acaeff7d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:00.979739 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a348bc08-8a43-4f86-8016-5f55acaeff7d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:00.988697 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a348bc08-8a43-4f86-8016-5f55acaeff7d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:02.269243 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a348bc08-8a43-4f86-8016-5f55acaeff7d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:02.286609 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a348bc08-8a43-4f86-8016-5f55acaeff7d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:02.288781 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a348bc08-8a43-4f86-8016-5f55acaeff7d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:02.291563 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a348bc08-8a43-4f86-8016-5f55acaeff7d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1486 microversion: 2.25 time: 1.449921 Jul 18 02:22:02.302128 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1175/2384] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:00 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1486 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:03.337356 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bfbe48d0-97ff-4abf-b8ee-923fd3bc2e28 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:03.339647 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bfbe48d0-97ff-4abf-b8ee-923fd3bc2e28 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:03.382730 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bfbe48d0-97ff-4abf-b8ee-923fd3bc2e28 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:03.386953 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bfbe48d0-97ff-4abf-b8ee-923fd3bc2e28 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:03.391856 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bfbe48d0-97ff-4abf-b8ee-923fd3bc2e28 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:03.393834 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bfbe48d0-97ff-4abf-b8ee-923fd3bc2e28 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:04.044521 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bfbe48d0-97ff-4abf-b8ee-923fd3bc2e28 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:04.064401 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bfbe48d0-97ff-4abf-b8ee-923fd3bc2e28 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:04.070257 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bfbe48d0-97ff-4abf-b8ee-923fd3bc2e28 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:04.077628 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bfbe48d0-97ff-4abf-b8ee-923fd3bc2e28 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1486 microversion: 2.25 time: 0.753394 Jul 18 02:22:04.082252 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1176/2385] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:03 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1486 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:04.328990 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-677a6bff-97a3-4eef-8976-ec26abc00435 req-e81eff11-8156-4df0-96f5-829a5d48378d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2563fe1c-ce0c-4a16-8d70-eb578016eae9", "name": "network-vif-unplugged", "status": "completed", "tag": "85a63441-1332-45c5-b28b-36162eda7e6e"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:22:04.347016 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-677a6bff-97a3-4eef-8976-ec26abc00435 req-e81eff11-8156-4df0-96f5-829a5d48378d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:04.348085 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-677a6bff-97a3-4eef-8976-ec26abc00435 req-e81eff11-8156-4df0-96f5-829a5d48378d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:04.380510 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-677a6bff-97a3-4eef-8976-ec26abc00435 req-e81eff11-8156-4df0-96f5-829a5d48378d service nova] Creating event network-vif-unplugged:85a63441-1332-45c5-b28b-36162eda7e6e for instance 2563fe1c-ce0c-4a16-8d70-eb578016eae9 on n-h1-465891-3 Jul 18 02:22:04.392365 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-677a6bff-97a3-4eef-8976-ec26abc00435 req-e81eff11-8156-4df0-96f5-829a5d48378d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071496 Jul 18 02:22:04.395589 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1177/2386] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:22:05.103118 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-55ad1198-0bad-4114-9bcf-1730d8913dd3 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:05.103994 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-55ad1198-0bad-4114-9bcf-1730d8913dd3 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:05.122238 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-55ad1198-0bad-4114-9bcf-1730d8913dd3 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:05.123448 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-55ad1198-0bad-4114-9bcf-1730d8913dd3 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:05.125464 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-55ad1198-0bad-4114-9bcf-1730d8913dd3 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:05.126899 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-55ad1198-0bad-4114-9bcf-1730d8913dd3 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:06.314853 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-55ad1198-0bad-4114-9bcf-1730d8913dd3 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:06.354234 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-55ad1198-0bad-4114-9bcf-1730d8913dd3 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:06.375859 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-55ad1198-0bad-4114-9bcf-1730d8913dd3 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:06.384025 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-55ad1198-0bad-4114-9bcf-1730d8913dd3 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1486 microversion: 2.25 time: 1.283195 Jul 18 02:22:06.389167 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1178/2387] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:05 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1486 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:22:07.428708 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b6a3fcdc-a517-4059-a90c-82f1ab1cc88a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:07.432446 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b6a3fcdc-a517-4059-a90c-82f1ab1cc88a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:07.458492 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6a3fcdc-a517-4059-a90c-82f1ab1cc88a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:07.459773 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6a3fcdc-a517-4059-a90c-82f1ab1cc88a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:07.466914 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6a3fcdc-a517-4059-a90c-82f1ab1cc88a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:07.467690 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6a3fcdc-a517-4059-a90c-82f1ab1cc88a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:08.489896 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b6a3fcdc-a517-4059-a90c-82f1ab1cc88a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:08.526726 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b6a3fcdc-a517-4059-a90c-82f1ab1cc88a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:08.531056 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b6a3fcdc-a517-4059-a90c-82f1ab1cc88a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:08.535890 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b6a3fcdc-a517-4059-a90c-82f1ab1cc88a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1486 microversion: 2.25 time: 1.114590 Jul 18 02:22:08.538623 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1179/2388] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:07 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1486 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:08.853756 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:22:09.576360 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-268d4d7c-cd58-4061-a50f-7559b49acdde tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:09.577615 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-268d4d7c-cd58-4061-a50f-7559b49acdde tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:09.592534 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-268d4d7c-cd58-4061-a50f-7559b49acdde tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:09.593688 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-268d4d7c-cd58-4061-a50f-7559b49acdde tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:09.596318 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-268d4d7c-cd58-4061-a50f-7559b49acdde tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:09.597178 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-268d4d7c-cd58-4061-a50f-7559b49acdde tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:09.803657 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=43 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:22:10.173493 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6adc2187-d128-4e20-84f2-8de2c74ffdf1 tempest-FloatingIPDetailsTestJSON-1825447231 tempest-FloatingIPDetailsTestJSON-1825447231-project] 10.222.0.57 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 9.520327 Jul 18 02:22:10.176168 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1210/2389] 10.222.0.57 () {60 vars in 1169 bytes} [Mon Jul 18 02:22:00 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 9525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:22:10.201268 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e4bc03a2-df82-4640-9479-611bf2380724 tempest-FloatingIPDetailsTestJSON-1825447231 tempest-FloatingIPDetailsTestJSON-1825447231-project] Action: 'create', calling method: .version_select at 0x7ff4a8788c10>, body: {"pool": null} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:22:10.547355 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-268d4d7c-cd58-4061-a50f-7559b49acdde tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:10.623087 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-268d4d7c-cd58-4061-a50f-7559b49acdde tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:10.627705 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-268d4d7c-cd58-4061-a50f-7559b49acdde tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:10.632275 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-268d4d7c-cd58-4061-a50f-7559b49acdde tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1486 microversion: 2.25 time: 1.069738 Jul 18 02:22:10.634883 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1180/2390] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:09 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1486 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:11.673376 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-57ec30b8-0074-472c-82f2-3cf532b0dcbc tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:11.678105 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-57ec30b8-0074-472c-82f2-3cf532b0dcbc tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:11.725308 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-57ec30b8-0074-472c-82f2-3cf532b0dcbc tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:11.730689 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-57ec30b8-0074-472c-82f2-3cf532b0dcbc tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:11.736160 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-57ec30b8-0074-472c-82f2-3cf532b0dcbc tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:11.737177 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-57ec30b8-0074-472c-82f2-3cf532b0dcbc tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:12.878014 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-57ec30b8-0074-472c-82f2-3cf532b0dcbc tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:12.896359 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-57ec30b8-0074-472c-82f2-3cf532b0dcbc tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:12.900716 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-57ec30b8-0074-472c-82f2-3cf532b0dcbc tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:12.903545 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-57ec30b8-0074-472c-82f2-3cf532b0dcbc tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1486 microversion: 2.25 time: 1.242874 Jul 18 02:22:12.921904 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1181/2391] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:11 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1486 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:13.942595 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3fd458ad-d375-4810-8356-c15493d96a0b tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:13.944984 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3fd458ad-d375-4810-8356-c15493d96a0b tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:13.986347 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3fd458ad-d375-4810-8356-c15493d96a0b tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:13.988052 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3fd458ad-d375-4810-8356-c15493d96a0b tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:13.989558 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3fd458ad-d375-4810-8356-c15493d96a0b tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:13.990498 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3fd458ad-d375-4810-8356-c15493d96a0b tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:14.442896 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3fd458ad-d375-4810-8356-c15493d96a0b tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:14.464302 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3fd458ad-d375-4810-8356-c15493d96a0b tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:14.470041 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3fd458ad-d375-4810-8356-c15493d96a0b tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:14.477580 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3fd458ad-d375-4810-8356-c15493d96a0b tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1476 microversion: 2.25 time: 0.544081 Jul 18 02:22:14.485110 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1182/2392] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:13 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1476 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:14.522210 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8a7f2ed1-66c3-4c04-be3d-34629be912c9 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Calling method '.version_select at 0x7ff49bf160d0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:14.526036 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a7f2ed1-66c3-4c04-be3d-34629be912c9 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:14.526879 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a7f2ed1-66c3-4c04-be3d-34629be912c9 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:14.584061 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8a7f2ed1-66c3-4c04-be3d-34629be912c9 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] 10.222.0.57 "GET /compute/v2.1/os-migrations" status: 200 len: 1940 microversion: 2.25 time: 0.062663 Jul 18 02:22:14.592815 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1183/2393] 10.222.0.57 () {60 vars in 1183 bytes} [Mon Jul 18 02:22:14 2022] GET /compute/v2.1/os-migrations => generated 1940 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:14.613470 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-aa6a696d-92d9-438f-a0b4-fb0f45b2d597 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:14.616974 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-aa6a696d-92d9-438f-a0b4-fb0f45b2d597 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:14.655698 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aa6a696d-92d9-438f-a0b4-fb0f45b2d597 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:14.658825 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aa6a696d-92d9-438f-a0b4-fb0f45b2d597 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:14.666873 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aa6a696d-92d9-438f-a0b4-fb0f45b2d597 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:14.670407 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aa6a696d-92d9-438f-a0b4-fb0f45b2d597 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:15.822363 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-aa6a696d-92d9-438f-a0b4-fb0f45b2d597 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] Lazy-loading 'services' on Instance uuid 2563fe1c-ce0c-4a16-8d70-eb578016eae9 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:22:15.884756 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-aa6a696d-92d9-438f-a0b4-fb0f45b2d597 tempest-LiveAutoBlockMigrationV225Test-948249151 tempest-LiveAutoBlockMigrationV225Test-948249151-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1968 microversion: 2.25 time: 1.279655 Jul 18 02:22:15.886767 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1184/2394] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:14 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1968 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:15.952912 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6916d30b-a9d7-4faa-9aab-be9700e3ee6a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:15.954085 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6916d30b-a9d7-4faa-9aab-be9700e3ee6a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:15.976984 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6916d30b-a9d7-4faa-9aab-be9700e3ee6a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:15.985447 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6916d30b-a9d7-4faa-9aab-be9700e3ee6a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:15.990246 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6916d30b-a9d7-4faa-9aab-be9700e3ee6a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:15.993477 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6916d30b-a9d7-4faa-9aab-be9700e3ee6a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:16.115783 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6916d30b-a9d7-4faa-9aab-be9700e3ee6a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:22:16.142071 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e4bc03a2-df82-4640-9479-611bf2380724 tempest-FloatingIPDetailsTestJSON-1825447231 tempest-FloatingIPDetailsTestJSON-1825447231-project] 10.222.0.57 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.950594 Jul 18 02:22:16.146584 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1211/2395] 10.222.0.57 () {60 vars in 1169 bytes} [Mon Jul 18 02:22:10 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5957 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:22:16.163603 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-75d1d015-1457-4da7-95a2-ee88259cec44 tempest-FloatingIPDetailsTestJSON-1825447231 tempest-FloatingIPDetailsTestJSON-1825447231-project] Calling method '.version_select at 0x7ff49bb82ee0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:16.439457 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6916d30b-a9d7-4faa-9aab-be9700e3ee6a tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 204 len: 0 microversion: 2.25 time: 0.500424 Jul 18 02:22:16.441081 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1185/2396] 10.222.0.57 () {60 vars in 1279 bytes} [Mon Jul 18 02:22:15 2022] DELETE /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:22:16.463492 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-98b4db43-c3c9-431d-835f-9e306c4515c6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:16.467016 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-98b4db43-c3c9-431d-835f-9e306c4515c6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:16.491026 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-98b4db43-c3c9-431d-835f-9e306c4515c6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:16.492834 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-98b4db43-c3c9-431d-835f-9e306c4515c6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:16.495037 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-98b4db43-c3c9-431d-835f-9e306c4515c6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:16.496148 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-98b4db43-c3c9-431d-835f-9e306c4515c6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:17.089629 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-75d1d015-1457-4da7-95a2-ee88259cec44 tempest-FloatingIPDetailsTestJSON-1825447231 tempest-FloatingIPDetailsTestJSON-1825447231-project] 10.222.0.57 "GET /compute/v2.1/os-floating-ips/2322b4f1-8d61-4d89-9101-5c8c9ef5ffa1" status: 200 len: 141 microversion: 2.1 time: 0.937645 Jul 18 02:22:17.100949 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-98b4db43-c3c9-431d-835f-9e306c4515c6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:17.104285 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1212/2397] 10.222.0.57 () {58 vars in 1259 bytes} [Mon Jul 18 02:22:16 2022] GET /compute/v2.1/os-floating-ips/2322b4f1-8d61-4d89-9101-5c8c9ef5ffa1 => generated 141 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:22:17.115873 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-98b4db43-c3c9-431d-835f-9e306c4515c6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:17.120486 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-35ecdca6-d39d-45cb-9c80-1d6385efdffa tempest-FloatingIPDetailsTestJSON-1825447231 tempest-FloatingIPDetailsTestJSON-1825447231-project] Calling method '.version_select at 0x7ff49bb441f0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:17.122324 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-98b4db43-c3c9-431d-835f-9e306c4515c6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:17.123820 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-98b4db43-c3c9-431d-835f-9e306c4515c6 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1482 microversion: 2.25 time: 0.675637 Jul 18 02:22:17.128282 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1186/2398] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:16 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1482 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:22:18.164260 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fcc318bb-846b-49f5-a49d-83ff604c1746 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:18.166521 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fcc318bb-846b-49f5-a49d-83ff604c1746 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:18.205131 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fcc318bb-846b-49f5-a49d-83ff604c1746 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:18.205131 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fcc318bb-846b-49f5-a49d-83ff604c1746 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:18.218607 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fcc318bb-846b-49f5-a49d-83ff604c1746 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:18.220565 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fcc318bb-846b-49f5-a49d-83ff604c1746 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:19.440439 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fcc318bb-846b-49f5-a49d-83ff604c1746 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:19.472921 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fcc318bb-846b-49f5-a49d-83ff604c1746 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:19.477887 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fcc318bb-846b-49f5-a49d-83ff604c1746 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:19.480611 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fcc318bb-846b-49f5-a49d-83ff604c1746 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1482 microversion: 2.25 time: 1.323091 Jul 18 02:22:19.502678 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1187/2399] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:18 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1482 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:20.020714 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-011ed253-94da-4fec-8085-a6da186bd31b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1741925094", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:22:20.217493 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-011ed253-94da-4fec-8085-a6da186bd31b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] validate_networks() for None {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:22:21.423838 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-011ed253-94da-4fec-8085-a6da186bd31b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:22:21.426932 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-011ed253-94da-4fec-8085-a6da186bd31b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:22:21.428950 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-011ed253-94da-4fec-8085-a6da186bd31b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:22:21.430467 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-011ed253-94da-4fec-8085-a6da186bd31b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:22:21.439712 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-011ed253-94da-4fec-8085-a6da186bd31b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:22:21.490349 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-011ed253-94da-4fec-8085-a6da186bd31b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:21.498908 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-011ed253-94da-4fec-8085-a6da186bd31b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:21.502697 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-011ed253-94da-4fec-8085-a6da186bd31b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:21.505185 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-011ed253-94da-4fec-8085-a6da186bd31b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:21.584503 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:22:21.617639 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-011ed253-94da-4fec-8085-a6da186bd31b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Getting quotas for project d7ff962145954166b4c5efb0a0f1edff. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:22:21.673464 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-011ed253-94da-4fec-8085-a6da186bd31b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Getting quotas for user dbeea54ebc4749aba59afb60feaa6159 and project d7ff962145954166b4c5efb0a0f1edff. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:22:21.740667 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-011ed253-94da-4fec-8085-a6da186bd31b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:22:21.745657 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-011ed253-94da-4fec-8085-a6da186bd31b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:22:21.938445 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-011ed253-94da-4fec-8085-a6da186bd31b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.429280 Jul 18 02:22:21.940330 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1188/2400] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:22:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:22:22.142421 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-35ecdca6-d39d-45cb-9c80-1d6385efdffa tempest-FloatingIPDetailsTestJSON-1825447231 tempest-FloatingIPDetailsTestJSON-1825447231-project] 10.222.0.57 "DELETE /compute/v2.1/os-floating-ips/2322b4f1-8d61-4d89-9101-5c8c9ef5ffa1" status: 202 len: 0 microversion: 2.1 time: 5.035596 Jul 18 02:22:22.143892 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1213/2401] 10.222.0.57 () {58 vars in 1262 bytes} [Mon Jul 18 02:22:17 2022] DELETE /compute/v2.1/os-floating-ips/2322b4f1-8d61-4d89-9101-5c8c9ef5ffa1 => generated 0 bytes in 5038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:22:22.164042 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-64eb6137-2a64-420f-812c-f813ee524ffa tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:22.175030 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-64eb6137-2a64-420f-812c-f813ee524ffa tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:22.213020 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-64eb6137-2a64-420f-812c-f813ee524ffa tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:22.213861 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-64eb6137-2a64-420f-812c-f813ee524ffa tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:22.215292 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-64eb6137-2a64-420f-812c-f813ee524ffa tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:22.216004 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-64eb6137-2a64-420f-812c-f813ee524ffa tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:22.768862 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a1650b0e-4c77-4795-9751-623ab1bd90a4 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:22.771136 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a1650b0e-4c77-4795-9751-623ab1bd90a4 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:22.798757 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a1650b0e-4c77-4795-9751-623ab1bd90a4 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:22.800189 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a1650b0e-4c77-4795-9751-623ab1bd90a4 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:22.801740 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a1650b0e-4c77-4795-9751-623ab1bd90a4 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:22.803009 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a1650b0e-4c77-4795-9751-623ab1bd90a4 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:22.858149 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:22:22.883586 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-64eb6137-2a64-420f-812c-f813ee524ffa tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:22.907298 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-64eb6137-2a64-420f-812c-f813ee524ffa tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:22.917181 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-64eb6137-2a64-420f-812c-f813ee524ffa tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:22.921399 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-64eb6137-2a64-420f-812c-f813ee524ffa tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1265 microversion: 2.25 time: 0.775777 Jul 18 02:22:22.923691 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1214/2402] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:22 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1265 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:22.934133 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-51652a37-838c-40bf-b81f-66da49dd27c3 req-da16b328-d19a-44e3-acbf-511c9931fcdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2563fe1c-ce0c-4a16-8d70-eb578016eae9", "name": "network-vif-deleted", "tag": "85a63441-1332-45c5-b28b-36162eda7e6e"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:22:22.955535 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-51652a37-838c-40bf-b81f-66da49dd27c3 req-da16b328-d19a-44e3-acbf-511c9931fcdc service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:22.961210 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-51652a37-838c-40bf-b81f-66da49dd27c3 req-da16b328-d19a-44e3-acbf-511c9931fcdc service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:23.005651 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-51652a37-838c-40bf-b81f-66da49dd27c3 req-da16b328-d19a-44e3-acbf-511c9931fcdc service nova] Creating event network-vif-deleted:85a63441-1332-45c5-b28b-36162eda7e6e for instance 2563fe1c-ce0c-4a16-8d70-eb578016eae9 on n-h2-465891-3 Jul 18 02:22:23.044037 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-51652a37-838c-40bf-b81f-66da49dd27c3 req-da16b328-d19a-44e3-acbf-511c9931fcdc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116829 Jul 18 02:22:23.046510 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1215/2403] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:22:23.061825 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5d53e629-35a6-4ac8-b088-e6141b6567bb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:23.068080 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5d53e629-35a6-4ac8-b088-e6141b6567bb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:23.394985 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5d53e629-35a6-4ac8-b088-e6141b6567bb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:23.409397 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5d53e629-35a6-4ac8-b088-e6141b6567bb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1213 microversion: 2.1 time: 0.356383 Jul 18 02:22:23.411015 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1216/2404] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:23 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1213 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:23.422315 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-20ec24c9-0fbb-4ddb-af1e-ed9632b7eb5b tempest-FloatingIPDetailsTestJSON-1825447231 tempest-FloatingIPDetailsTestJSON-1825447231-project] Calling method '.version_select at 0x7ff49bc67550>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:23.846285 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a1650b0e-4c77-4795-9751-623ab1bd90a4 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:23.872074 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a1650b0e-4c77-4795-9751-623ab1bd90a4 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:23.874934 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a1650b0e-4c77-4795-9751-623ab1bd90a4 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:23.876820 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a1650b0e-4c77-4795-9751-623ab1bd90a4 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 2946 microversion: 2.42 time: 1.929992 Jul 18 02:22:23.886184 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1189/2405] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:21 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 2946 bytes in 1941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:24.079523 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-20ec24c9-0fbb-4ddb-af1e-ed9632b7eb5b tempest-FloatingIPDetailsTestJSON-1825447231 tempest-FloatingIPDetailsTestJSON-1825447231-project] 10.222.0.57 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.666003 Jul 18 02:22:24.080595 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1217/2406] 10.222.0.57 () {58 vars in 1163 bytes} [Mon Jul 18 02:22:23 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:22:24.091249 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-392b7d50-ceb7-4870-a15d-b26199e2882f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:24.092157 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-392b7d50-ceb7-4870-a15d-b26199e2882f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:24.108515 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-392b7d50-ceb7-4870-a15d-b26199e2882f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:24.109484 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-392b7d50-ceb7-4870-a15d-b26199e2882f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:24.110753 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-392b7d50-ceb7-4870-a15d-b26199e2882f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:24.111817 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-392b7d50-ceb7-4870-a15d-b26199e2882f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:24.288821 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-058671bf-2a0c-4747-8992-fa155fd21ba8 tempest-FlavorsV2TestJSON-1376079458 tempest-FlavorsV2TestJSON-1376079458-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:24.306301 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-058671bf-2a0c-4747-8992-fa155fd21ba8 tempest-FlavorsV2TestJSON-1376079458 tempest-FlavorsV2TestJSON-1376079458-project] 10.222.0.57 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.418194 Jul 18 02:22:24.308117 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1190/2407] 10.222.0.57 () {58 vars in 1136 bytes} [Mon Jul 18 02:22:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:22:24.333888 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-25d37205-518a-42c5-b07d-9dcadc42d40e tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:24.342095 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-25d37205-518a-42c5-b07d-9dcadc42d40e tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:24.353727 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25d37205-518a-42c5-b07d-9dcadc42d40e tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:24.354556 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25d37205-518a-42c5-b07d-9dcadc42d40e tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:24.355795 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25d37205-518a-42c5-b07d-9dcadc42d40e tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:24.356668 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25d37205-518a-42c5-b07d-9dcadc42d40e tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:24.554426 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-392b7d50-ceb7-4870-a15d-b26199e2882f tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.472009 Jul 18 02:22:24.555860 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1218/2408] 10.222.0.57 () {60 vars in 1315 bytes} [Mon Jul 18 02:22:24 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67/os-interface => generated 1831 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:24.561735 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2fdc2c88-4c8a-4be1-88cf-01117958b36f tempest-FloatingIPDetailsTestJSON-1825447231 tempest-FloatingIPDetailsTestJSON-1825447231-project] Calling method '.version_select at 0x7ff49bb09d30>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:24.564445 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-25d37205-518a-42c5-b07d-9dcadc42d40e tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:24.575648 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-25d37205-518a-42c5-b07d-9dcadc42d40e tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:24.577262 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-25d37205-518a-42c5-b07d-9dcadc42d40e tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:24.578486 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-25d37205-518a-42c5-b07d-9dcadc42d40e tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1265 microversion: 2.25 time: 0.268706 Jul 18 02:22:24.579065 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1191/2409] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:24 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1265 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:24.595327 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-215c7e76-f344-4522-a8b7-f022e368ac81 tempest-FlavorsV2TestJSON-1376079458 tempest-FlavorsV2TestJSON-1376079458-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:24.634513 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-215c7e76-f344-4522-a8b7-f022e368ac81 tempest-FlavorsV2TestJSON-1376079458 tempest-FlavorsV2TestJSON-1376079458-project] 10.222.0.57 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.054309 Jul 18 02:22:24.638101 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1192/2410] 10.222.0.57 () {58 vars in 1124 bytes} [Mon Jul 18 02:22:24 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:24.649308 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-aa8d83b5-4daf-46c2-a4d2-c7d272ae0c04 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:24.649971 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-aa8d83b5-4daf-46c2-a4d2-c7d272ae0c04 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:25.142616 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-aa8d83b5-4daf-46c2-a4d2-c7d272ae0c04 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:25.165834 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-aa8d83b5-4daf-46c2-a4d2-c7d272ae0c04 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1213 microversion: 2.1 time: 0.526167 Jul 18 02:22:25.175608 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1193/2411] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:24 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1213 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:25.182023 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-35d6c779-8052-4066-a1f2-678545f8beca tempest-FlavorsV2TestJSON-1376079458 tempest-FlavorsV2TestJSON-1376079458-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:25.204889 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-35d6c779-8052-4066-a1f2-678545f8beca tempest-FlavorsV2TestJSON-1376079458 tempest-FlavorsV2TestJSON-1376079458-project] 10.222.0.57 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026891 Jul 18 02:22:25.209959 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1194/2412] 10.222.0.57 () {58 vars in 1136 bytes} [Mon Jul 18 02:22:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:22:25.244532 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fb273714-96a9-4231-89b1-2af93016be73 tempest-FlavorsV2TestJSON-1376079458 tempest-FlavorsV2TestJSON-1376079458-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:25.288083 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fb273714-96a9-4231-89b1-2af93016be73 tempest-FlavorsV2TestJSON-1376079458 tempest-FlavorsV2TestJSON-1376079458-project] 10.222.0.57 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.056086 Jul 18 02:22:25.295275 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1195/2413] 10.222.0.57 () {58 vars in 1136 bytes} [Mon Jul 18 02:22:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:22:25.313987 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-658f512c-5a98-4c8d-b3f8-6b1e61cacfd2 tempest-FlavorsV2TestJSON-1376079458 tempest-FlavorsV2TestJSON-1376079458-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:25.374723 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-658f512c-5a98-4c8d-b3f8-6b1e61cacfd2 tempest-FlavorsV2TestJSON-1376079458 tempest-FlavorsV2TestJSON-1376079458-project] 10.222.0.57 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.068386 Jul 18 02:22:25.378242 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1196/2414] 10.222.0.57 () {58 vars in 1164 bytes} [Mon Jul 18 02:22:25 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:22:25.408852 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5659bb2c-8846-407c-97e6-409e60350822 tempest-FlavorsV2TestJSON-1376079458 tempest-FlavorsV2TestJSON-1376079458-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:25.430286 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5659bb2c-8846-407c-97e6-409e60350822 tempest-FlavorsV2TestJSON-1376079458 tempest-FlavorsV2TestJSON-1376079458-project] 10.222.0.57 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024276 Jul 18 02:22:25.431941 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1197/2415] 10.222.0.57 () {58 vars in 1136 bytes} [Mon Jul 18 02:22:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:22:25.456656 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-deec2ead-f6c8-4364-b42f-067603ae7f44 tempest-FlavorsV2TestJSON-1376079458 tempest-FlavorsV2TestJSON-1376079458-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:25.524909 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-deec2ead-f6c8-4364-b42f-067603ae7f44 tempest-FlavorsV2TestJSON-1376079458 tempest-FlavorsV2TestJSON-1376079458-project] 10.222.0.57 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.080808 Jul 18 02:22:25.525959 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1198/2416] 10.222.0.57 () {58 vars in 1168 bytes} [Mon Jul 18 02:22:25 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:25.564996 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-46353ec7-8a8f-4e25-9b11-2bf00fb993c7 tempest-FlavorsV2TestJSON-1376079458 tempest-FlavorsV2TestJSON-1376079458-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:25.604744 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2fdc2c88-4c8a-4be1-88cf-01117958b36f tempest-FloatingIPDetailsTestJSON-1825447231 tempest-FloatingIPDetailsTestJSON-1825447231-project] 10.222.0.57 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 1.046635 Jul 18 02:22:25.607056 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1219/2417] 10.222.0.57 () {58 vars in 1148 bytes} [Mon Jul 18 02:22:24 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:22:25.616049 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0a9799d4-f8de-4e89-9a7e-9b6058ed1e09 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:25.625257 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0a9799d4-f8de-4e89-9a7e-9b6058ed1e09 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:25.628032 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-46353ec7-8a8f-4e25-9b11-2bf00fb993c7 tempest-FlavorsV2TestJSON-1376079458 tempest-FlavorsV2TestJSON-1376079458-project] 10.222.0.57 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.075676 Jul 18 02:22:25.630864 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1199/2418] 10.222.0.57 () {58 vars in 1160 bytes} [Mon Jul 18 02:22:25 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:22:25.647304 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-22512876-8a39-4741-8612-9db9f7b26d86 tempest-FloatingIPDetailsTestJSON-1825447231 tempest-FloatingIPDetailsTestJSON-1825447231-project] Calling method '.version_select at 0x7ff4a88b3820>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:25.655817 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0a9799d4-f8de-4e89-9a7e-9b6058ed1e09 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:25.657184 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0a9799d4-f8de-4e89-9a7e-9b6058ed1e09 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:25.662856 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0a9799d4-f8de-4e89-9a7e-9b6058ed1e09 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:25.664659 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0a9799d4-f8de-4e89-9a7e-9b6058ed1e09 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:25.963307 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0a9799d4-f8de-4e89-9a7e-9b6058ed1e09 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:25.996398 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0a9799d4-f8de-4e89-9a7e-9b6058ed1e09 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:26.013355 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0a9799d4-f8de-4e89-9a7e-9b6058ed1e09 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:26.016060 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0a9799d4-f8de-4e89-9a7e-9b6058ed1e09 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1265 microversion: 2.25 time: 0.406969 Jul 18 02:22:26.018054 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1220/2419] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:25 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1265 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:26.027824 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1705d9e3-e1a9-4356-a5b9-1fadcd08c905 tempest-FlavorsV2TestJSON-1376079458 tempest-FlavorsV2TestJSON-1376079458-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:26.063125 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1705d9e3-e1a9-4356-a5b9-1fadcd08c905 tempest-FlavorsV2TestJSON-1376079458 tempest-FlavorsV2TestJSON-1376079458-project] 10.222.0.57 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.042823 Jul 18 02:22:26.065131 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1221/2420] 10.222.0.57 () {58 vars in 1136 bytes} [Mon Jul 18 02:22:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:22:26.093125 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-97a27bb0-fbe8-49aa-adc5-af33a5de1f77 tempest-FlavorsV2TestJSON-1376079458 tempest-FlavorsV2TestJSON-1376079458-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:26.186632 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-97a27bb0-fbe8-49aa-adc5-af33a5de1f77 tempest-FlavorsV2TestJSON-1376079458 tempest-FlavorsV2TestJSON-1376079458-project] 10.222.0.57 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.111754 Jul 18 02:22:26.188723 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1222/2421] 10.222.0.57 () {58 vars in 1166 bytes} [Mon Jul 18 02:22:26 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:26.202186 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0b5e6f8e-1c38-4dbe-bc22-8a19c0f04ac4 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:26.204306 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0b5e6f8e-1c38-4dbe-bc22-8a19c0f04ac4 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:26.219642 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0b5e6f8e-1c38-4dbe-bc22-8a19c0f04ac4 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:26.220859 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0b5e6f8e-1c38-4dbe-bc22-8a19c0f04ac4 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:26.223593 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0b5e6f8e-1c38-4dbe-bc22-8a19c0f04ac4 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:26.224835 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0b5e6f8e-1c38-4dbe-bc22-8a19c0f04ac4 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:26.796139 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0b5e6f8e-1c38-4dbe-bc22-8a19c0f04ac4 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:26.810383 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0b5e6f8e-1c38-4dbe-bc22-8a19c0f04ac4 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1283 microversion: 2.1 time: 0.619166 Jul 18 02:22:26.811626 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1223/2422] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:26 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1283 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:26.822406 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-43d1500f-2cdd-47d4-9d5f-a5545b510c78 tempest-FlavorsV2TestJSON-1376079458 tempest-FlavorsV2TestJSON-1376079458-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:26.855686 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-43d1500f-2cdd-47d4-9d5f-a5545b510c78 tempest-FlavorsV2TestJSON-1376079458 tempest-FlavorsV2TestJSON-1376079458-project] 10.222.0.57 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.042665 Jul 18 02:22:26.862779 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1224/2423] 10.222.0.57 () {58 vars in 1136 bytes} [Mon Jul 18 02:22:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:22:26.884212 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e3203b96-c8de-4b8d-9e42-70ce4674fdbb tempest-FlavorsV2TestJSON-1376079458 tempest-FlavorsV2TestJSON-1376079458-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:26.958637 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e3203b96-c8de-4b8d-9e42-70ce4674fdbb tempest-FlavorsV2TestJSON-1376079458 tempest-FlavorsV2TestJSON-1376079458-project] 10.222.0.57 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.078935 Jul 18 02:22:26.978425 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1225/2424] 10.222.0.57 () {58 vars in 1143 bytes} [Mon Jul 18 02:22:26 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:22:26.983325 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5ee2e5c6-4367-4dcc-be7b-f43198758570 tempest-FlavorsV2TestJSON-1376079458 tempest-FlavorsV2TestJSON-1376079458-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:27.017552 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5ee2e5c6-4367-4dcc-be7b-f43198758570 tempest-FlavorsV2TestJSON-1376079458 tempest-FlavorsV2TestJSON-1376079458-project] 10.222.0.57 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.038142 Jul 18 02:22:27.018261 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1226/2425] 10.222.0.57 () {58 vars in 1136 bytes} [Mon Jul 18 02:22:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:22:27.036242 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-19489e8b-7546-4be0-9aff-bf4a887d6d1d tempest-FlavorsV2TestJSON-1376079458 tempest-FlavorsV2TestJSON-1376079458-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:27.150383 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-19489e8b-7546-4be0-9aff-bf4a887d6d1d tempest-FlavorsV2TestJSON-1376079458 tempest-FlavorsV2TestJSON-1376079458-project] 10.222.0.57 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.094398 Jul 18 02:22:27.151827 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1227/2426] 10.222.0.57 () {58 vars in 1147 bytes} [Mon Jul 18 02:22:27 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:27.184227 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e1f46378-8d6d-4494-a7f0-208fcc496f84 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:27.186121 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e1f46378-8d6d-4494-a7f0-208fcc496f84 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:27.230619 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e1f46378-8d6d-4494-a7f0-208fcc496f84 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:27.231543 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e1f46378-8d6d-4494-a7f0-208fcc496f84 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:27.232612 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e1f46378-8d6d-4494-a7f0-208fcc496f84 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:27.233242 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e1f46378-8d6d-4494-a7f0-208fcc496f84 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:27.654143 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e1f46378-8d6d-4494-a7f0-208fcc496f84 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:27.681408 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e1f46378-8d6d-4494-a7f0-208fcc496f84 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:27.693785 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e1f46378-8d6d-4494-a7f0-208fcc496f84 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:27.701067 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e1f46378-8d6d-4494-a7f0-208fcc496f84 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1265 microversion: 2.25 time: 0.546963 Jul 18 02:22:27.705884 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1228/2427] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:27 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1265 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:27.731937 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-58eee7ba-f489-43dc-9fef-d71117ac3f59 tempest-FlavorsV2TestJSON-1376079458 tempest-FlavorsV2TestJSON-1376079458-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:27.780883 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-58eee7ba-f489-43dc-9fef-d71117ac3f59 tempest-FlavorsV2TestJSON-1376079458 tempest-FlavorsV2TestJSON-1376079458-project] 10.222.0.57 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.071719 Jul 18 02:22:27.801584 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1229/2428] 10.222.0.57 () {58 vars in 1139 bytes} [Mon Jul 18 02:22:27 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:22:27.824741 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-efac131f-2331-433d-a280-b22f6ddfd3b3 tempest-FlavorsV2TestJSON-1376079458 tempest-FlavorsV2TestJSON-1376079458-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:27.896419 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-efac131f-2331-433d-a280-b22f6ddfd3b3 tempest-FlavorsV2TestJSON-1376079458 tempest-FlavorsV2TestJSON-1376079458-project] 10.222.0.57 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.091603 Jul 18 02:22:27.901983 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1230/2429] 10.222.0.57 () {58 vars in 1136 bytes} [Mon Jul 18 02:22:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:22:27.965959 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-67561f1b-dc81-4ce0-9284-f3d7ffe7f024 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:27.971857 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-67561f1b-dc81-4ce0-9284-f3d7ffe7f024 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:28.000836 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-67561f1b-dc81-4ce0-9284-f3d7ffe7f024 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:28.004954 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-67561f1b-dc81-4ce0-9284-f3d7ffe7f024 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:28.010155 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-67561f1b-dc81-4ce0-9284-f3d7ffe7f024 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:28.011044 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-67561f1b-dc81-4ce0-9284-f3d7ffe7f024 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:28.333948 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-67561f1b-dc81-4ce0-9284-f3d7ffe7f024 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:28.365812 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-67561f1b-dc81-4ce0-9284-f3d7ffe7f024 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1271 microversion: 2.1 time: 0.457771 Jul 18 02:22:28.366963 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1231/2430] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:27 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1271 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:28.391938 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c8609573-8158-43d2-9926-24b1e3180492 tempest-FlavorsV2TestJSON-1376079458 tempest-FlavorsV2TestJSON-1376079458-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:28.465310 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c8609573-8158-43d2-9926-24b1e3180492 tempest-FlavorsV2TestJSON-1376079458 tempest-FlavorsV2TestJSON-1376079458-project] 10.222.0.57 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.095715 Jul 18 02:22:28.474354 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1232/2431] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:22:28 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:28.489152 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-eefcb3b7-b0fa-426e-9b22-4f15fd749d48 tempest-FlavorsV2TestJSON-1376079458 tempest-FlavorsV2TestJSON-1376079458-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:28.571814 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-eefcb3b7-b0fa-426e-9b22-4f15fd749d48 tempest-FlavorsV2TestJSON-1376079458 tempest-FlavorsV2TestJSON-1376079458-project] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.089452 Jul 18 02:22:28.586406 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1233/2432] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:22:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:28.610384 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-23c29d2a-50ca-4407-90b7-397d5a32056e tempest-FlavorsV2TestJSON-1376079458 tempest-FlavorsV2TestJSON-1376079458-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:28.648868 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-23c29d2a-50ca-4407-90b7-397d5a32056e tempest-FlavorsV2TestJSON-1376079458 tempest-FlavorsV2TestJSON-1376079458-project] 10.222.0.57 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.045132 Jul 18 02:22:28.667081 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1234/2433] 10.222.0.57 () {58 vars in 1136 bytes} [Mon Jul 18 02:22:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:22:28.740796 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8ff8c358-e6a4-419f-b01c-efee66a66818 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:28.745577 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8ff8c358-e6a4-419f-b01c-efee66a66818 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:28.777481 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8ff8c358-e6a4-419f-b01c-efee66a66818 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:28.780241 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8ff8c358-e6a4-419f-b01c-efee66a66818 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:28.786037 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8ff8c358-e6a4-419f-b01c-efee66a66818 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:28.790510 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8ff8c358-e6a4-419f-b01c-efee66a66818 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:29.218620 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8ff8c358-e6a4-419f-b01c-efee66a66818 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:29.231580 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8ff8c358-e6a4-419f-b01c-efee66a66818 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:29.244313 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8ff8c358-e6a4-419f-b01c-efee66a66818 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:29.248563 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8ff8c358-e6a4-419f-b01c-efee66a66818 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1265 microversion: 2.25 time: 0.515047 Jul 18 02:22:29.252934 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1235/2434] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:28 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1265 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:22:29.395325 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5d1a99fc-faad-44c6-baed-919d58d794fb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:29.396359 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5d1a99fc-faad-44c6-baed-919d58d794fb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:29.414934 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5d1a99fc-faad-44c6-baed-919d58d794fb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:29.415493 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5d1a99fc-faad-44c6-baed-919d58d794fb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:29.416283 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5d1a99fc-faad-44c6-baed-919d58d794fb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:29.416738 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5d1a99fc-faad-44c6-baed-919d58d794fb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:29.664973 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5d1a99fc-faad-44c6-baed-919d58d794fb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:29.685279 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5d1a99fc-faad-44c6-baed-919d58d794fb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1271 microversion: 2.1 time: 0.291399 Jul 18 02:22:29.697294 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1236/2435] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:29 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1271 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:30.287609 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8eac766a-ca39-44cb-95b5-0680f3e94e09 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:30.290046 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8eac766a-ca39-44cb-95b5-0680f3e94e09 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:30.301547 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8eac766a-ca39-44cb-95b5-0680f3e94e09 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:30.304531 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8eac766a-ca39-44cb-95b5-0680f3e94e09 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:30.307614 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8eac766a-ca39-44cb-95b5-0680f3e94e09 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:30.309953 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8eac766a-ca39-44cb-95b5-0680f3e94e09 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:30.567429 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8eac766a-ca39-44cb-95b5-0680f3e94e09 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:30.585566 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8eac766a-ca39-44cb-95b5-0680f3e94e09 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:30.588090 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8eac766a-ca39-44cb-95b5-0680f3e94e09 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:30.590559 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8eac766a-ca39-44cb-95b5-0680f3e94e09 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1265 microversion: 2.25 time: 0.307623 Jul 18 02:22:30.593420 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1237/2436] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:30 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1265 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:30.711505 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9fcc2816-5ead-4695-87a7-60075db2d129 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:30.712581 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9fcc2816-5ead-4695-87a7-60075db2d129 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:30.744338 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9fcc2816-5ead-4695-87a7-60075db2d129 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:30.745054 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9fcc2816-5ead-4695-87a7-60075db2d129 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:30.752834 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9fcc2816-5ead-4695-87a7-60075db2d129 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:30.756443 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9fcc2816-5ead-4695-87a7-60075db2d129 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:31.204155 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-22512876-8a39-4741-8612-9db9f7b26d86 tempest-FloatingIPDetailsTestJSON-1825447231 tempest-FloatingIPDetailsTestJSON-1825447231-project] 10.222.0.57 "DELETE /compute/v2.1/os-floating-ips/3db2fc2a-dd97-4266-84a8-f26519c9de31" status: 202 len: 0 microversion: 2.1 time: 5.570739 Jul 18 02:22:31.205904 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1200/2437] 10.222.0.57 () {58 vars in 1262 bytes} [Mon Jul 18 02:22:25 2022] DELETE /compute/v2.1/os-floating-ips/3db2fc2a-dd97-4266-84a8-f26519c9de31 => generated 0 bytes in 5574 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:22:31.220025 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4e341d60-4fe8-41f7-94bd-1bf09c719513 tempest-FloatingIPDetailsTestJSON-1825447231 tempest-FloatingIPDetailsTestJSON-1825447231-project] Calling method '.version_select at 0x7ff4a88c8af0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:31.246623 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9fcc2816-5ead-4695-87a7-60075db2d129 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:31.275892 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9fcc2816-5ead-4695-87a7-60075db2d129 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1271 microversion: 2.1 time: 0.574811 Jul 18 02:22:31.279939 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1238/2438] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:30 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1271 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:22:31.557858 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:22:31.617676 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fe8acc06-8972-4f04-9bb7-213819615f2e tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:31.619237 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fe8acc06-8972-4f04-9bb7-213819615f2e tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:31.636394 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fe8acc06-8972-4f04-9bb7-213819615f2e tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:31.653293 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fe8acc06-8972-4f04-9bb7-213819615f2e tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:31.660595 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fe8acc06-8972-4f04-9bb7-213819615f2e tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:31.661659 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fe8acc06-8972-4f04-9bb7-213819615f2e tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:32.116632 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fe8acc06-8972-4f04-9bb7-213819615f2e tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:32.153123 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fe8acc06-8972-4f04-9bb7-213819615f2e tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:32.160973 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fe8acc06-8972-4f04-9bb7-213819615f2e tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:32.169539 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fe8acc06-8972-4f04-9bb7-213819615f2e tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 200 len: 1265 microversion: 2.25 time: 0.557275 Jul 18 02:22:32.174522 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1239/2439] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:31 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 1265 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:32.300244 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2acc07ad-fabe-43c9-840d-ea094d294928 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:32.308520 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2acc07ad-fabe-43c9-840d-ea094d294928 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:32.337385 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2acc07ad-fabe-43c9-840d-ea094d294928 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:32.338269 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2acc07ad-fabe-43c9-840d-ea094d294928 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:32.341638 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2acc07ad-fabe-43c9-840d-ea094d294928 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:32.344239 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2acc07ad-fabe-43c9-840d-ea094d294928 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:33.334562 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2acc07ad-fabe-43c9-840d-ea094d294928 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:33.358203 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2acc07ad-fabe-43c9-840d-ea094d294928 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1271 microversion: 2.1 time: 1.067014 Jul 18 02:22:33.364888 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1240/2440] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:32 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1271 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:33.387230 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-20eb3b95-8a0a-489a-b888-b3d618837055 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:33.388586 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-20eb3b95-8a0a-489a-b888-b3d618837055 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2563fe1c-ce0c-4a16-8d70-eb578016eae9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:33.410290 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:22:33.434023 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20eb3b95-8a0a-489a-b888-b3d618837055 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:33.435379 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20eb3b95-8a0a-489a-b888-b3d618837055 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:33.437109 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20eb3b95-8a0a-489a-b888-b3d618837055 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:33.438469 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20eb3b95-8a0a-489a-b888-b3d618837055 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:33.520053 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-20eb3b95-8a0a-489a-b888-b3d618837055 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] HTTP exception thrown: Instance 2563fe1c-ce0c-4a16-8d70-eb578016eae9 could not be found. Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-20eb3b95-8a0a-489a-b888-b3d618837055 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Request method failure captured: Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 HTTP/1.1 Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MGsLDoyOzgLRg2BX3cvVr1GpblgGW8O2WZA94rA_-vM2oer1r5NZgrD18DqsaiVcPResWG2UVj4mChLB4EtXep3gtu_ICdVBF9LtGrAHf1gzev_w_kLLd8d2TQ4t5azuzu6V-mwogR1J5wvkWYNqwUx2r74hRfwqTpAIJFQIsZIP1g Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: X-Openstack-Nova-Api-Version: 2.25 Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 9d0f5bbde58545fb9ccd1c2eb842ed49 Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-905351447 Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9d0f5bbde58545fb9ccd1c2eb842ed49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9d0f5bbde58545fb9ccd1c2eb842ed49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9d0f5bbde58545fb9ccd1c2eb842ed49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9d0f5bbde58545fb9ccd1c2eb842ed49"}]}] Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-905351447 Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 9d0f5bbde58545fb9ccd1c2eb842ed49 Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-905351447 Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-LiveAutoBlockMigrationV225Test-905351447-project Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 575dd6743cff44678749d452329355d1 Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-905351447-project Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 2563fe1c-ce0c-4a16-8d70-eb578016eae9 could not be found. Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '2563fe1c-ce0c-4a16-8d70-eb578016eae9'} Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2563fe1c-ce0c-4a16-8d70-eb578016eae9 could not be found. Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2563fe1c-ce0c-4a16-8d70-eb578016eae9 could not be found. Jul 18 02:22:33.524703 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:33.533941 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:22:33.533941 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:33.533941 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:33.533941 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:22:33.533941 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:22:33.533941 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:22:33.533941 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:22:33.533941 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2563fe1c-ce0c-4a16-8d70-eb578016eae9 could not be found. Jul 18 02:22:33.533941 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:33.539974 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-20eb3b95-8a0a-489a-b888-b3d618837055 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Returning 404 to user: Instance 2563fe1c-ce0c-4a16-8d70-eb578016eae9 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:22:33.539974 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-20eb3b95-8a0a-489a-b888-b3d618837055 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9" status: 404 len: 111 microversion: 2.25 time: 0.170589 Jul 18 02:22:33.541146 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1241/2441] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:33 2022] GET /compute/v2.1/servers/2563fe1c-ce0c-4a16-8d70-eb578016eae9 => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:22:34.376820 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c7a06f52-09fa-4728-9fbe-ac929c1aef19 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:34.377629 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c7a06f52-09fa-4728-9fbe-ac929c1aef19 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:34.396085 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c7a06f52-09fa-4728-9fbe-ac929c1aef19 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:34.399307 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c7a06f52-09fa-4728-9fbe-ac929c1aef19 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:34.404542 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c7a06f52-09fa-4728-9fbe-ac929c1aef19 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:34.407127 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c7a06f52-09fa-4728-9fbe-ac929c1aef19 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:34.570556 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=11 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:22:34.974627 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c7a06f52-09fa-4728-9fbe-ac929c1aef19 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:35.020014 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c7a06f52-09fa-4728-9fbe-ac929c1aef19 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1271 microversion: 2.1 time: 0.638500 Jul 18 02:22:35.024679 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1242/2442] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:34 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1271 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:22:35.148939 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=8 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:22:35.574186 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7f11c5e6-5163-4436-ac54-afda203e8fb0 tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] Action: 'create', calling method: .version_select at 0x7ff49bb6ddc0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZ2Y2iYrLlGQH//de290naL835vC6FD+CII+CQ2/Ruia2mMHoFClzOQcFkHXOgHkDW+FgHmQplvdFV0qj4rtYOxMN0Td56nt/9DtoDcgIzgt/ebHlv9DXjX1w7HHktWjQ=="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:22:35.582159 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:22:35.604501 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-7f11c5e6-5163-4436-ac54-afda203e8fb0 tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7f11c5e6-5163-4436-ac54-afda203e8fb0 tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] Request method failure captured: Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 257 Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MPqD3JsQ87PrEqBEDIM2kNe2BKg8PAqLvaaj43PabMfvxGuCdtSY5tijhj7B2ydfKIkbwwDRZHZ4n6FNfv_PGSg3zL072IaRsKzFUD4OUT_Kfa-8EQVbsAqXNTmuSg5liT6fji59AW6fs57vOGDjn4-5gq6w-bN8P07riQWPYFtCEk Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 0bd2ddfb72fc408a9d891709af160d20 Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1100707094 Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0bd2ddfb72fc408a9d891709af160d20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0bd2ddfb72fc408a9d891709af160d20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0bd2ddfb72fc408a9d891709af160d20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0bd2ddfb72fc408a9d891709af160d20"}]}] Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1100707094 Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 0bd2ddfb72fc408a9d891709af160d20 Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1100707094 Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-KeyPairsNegativeTestJSON-1100707094-project Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 6b48eb18abce48aebd0f458551477699 Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1100707094-project Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZ2Y2iYrLlGQH//de290naL835vC6FD+CII+CQ2/Ruia2mMHoFClzOQcFkHXOgHkDW+FgHmQplvdFV0qj4rtYOxMN0Td56nt/9DtoDcgIzgt/ebHlv9DXjX1w7HHktWjQ=="}} Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: exception: Keypair data is invalid: Keypair name contains unsafe characters Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZ2Y2iYrLlGQH//de290naL835vC6FD+CII+CQ2/Ruia2mMHoFClzOQcFkHXOgHkDW+FgHmQplvdFV0qj4rtYOxMN0Td56nt/9DtoDcgIzgt/ebHlv9DXjX1w7HHktWjQ=='}}} Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in import_key_pair Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in _validate_new_key_pair Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:22:35.622252 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:22:35.626549 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:22:35.626549 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:22:35.626549 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:22:35.626549 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:22:35.626549 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:22:35.626549 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:22:35.626549 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 18 02:22:35.626549 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 18 02:22:35.626549 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 18 02:22:35.626549 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 18 02:22:35.626549 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters Jul 18 02:22:35.626549 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:35.626549 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:22:35.626549 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:35.626549 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:35.626549 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:22:35.626549 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:22:35.626549 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:22:35.626549 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:22:35.626549 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters Jul 18 02:22:35.626549 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:35.630739 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7f11c5e6-5163-4436-ac54-afda203e8fb0 tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:22:35.632858 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7f11c5e6-5163-4436-ac54-afda203e8fb0 tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.419092 Jul 18 02:22:35.636732 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1243/2443] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 02:22:35 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 424 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:22:35.654108 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5147ddbe-97b7-4b02-af8b-a6be69b99fcb tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] Action: 'create', calling method: .version_select at 0x7ff4a8abbca0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1259786192", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:22:35.703392 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-5147ddbe-97b7-4b02-af8b-a6be69b99fcb tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] Getting quotas for project 0bd2ddfb72fc408a9d891709af160d20. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:22:35.715468 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-5147ddbe-97b7-4b02-af8b-a6be69b99fcb tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] Getting quotas for user 6b48eb18abce48aebd0f458551477699 and project 0bd2ddfb72fc408a9d891709af160d20. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:22:35.792056 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-5147ddbe-97b7-4b02-af8b-a6be69b99fcb tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 18 02:22:35.806913 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5147ddbe-97b7-4b02-af8b-a6be69b99fcb tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] Request method failure captured: Jul 18 02:22:35.806913 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 18 02:22:35.806913 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:22:35.806913 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:22:35.806913 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:22:35.806913 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 2167 Jul 18 02:22:35.806913 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:22:35.806913 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:22:35.806913 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:22:35.806913 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:22:35.806913 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MPqD3JsQ87PrEqBEDIM2kNe2BKg8PAqLvaaj43PabMfvxGuCdtSY5tijhj7B2ydfKIkbwwDRZHZ4n6FNfv_PGSg3zL072IaRsKzFUD4OUT_Kfa-8EQVbsAqXNTmuSg5liT6fji59AW6fs57vOGDjn4-5gq6w-bN8P07riQWPYFtCEk Jul 18 02:22:35.806913 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:22:35.806913 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:22:35.806913 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:22:35.806913 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:22:35.806913 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:22:35.806913 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:22:35.806913 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 0bd2ddfb72fc408a9d891709af160d20 Jul 18 02:22:35.806913 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1100707094 Jul 18 02:22:35.806913 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:22:35.806913 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:22:35.806913 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0bd2ddfb72fc408a9d891709af160d20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0bd2ddfb72fc408a9d891709af160d20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0bd2ddfb72fc408a9d891709af160d20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0bd2ddfb72fc408a9d891709af160d20"}]}] Jul 18 02:22:35.806913 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1100707094 Jul 18 02:22:35.806913 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 0bd2ddfb72fc408a9d891709af160d20 Jul 18 02:22:35.806913 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1100707094 Jul 18 02:22:35.806913 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-KeyPairsNegativeTestJSON-1100707094-project Jul 18 02:22:35.806913 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:22:35.806913 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:22:35.806913 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 6b48eb18abce48aebd0f458551477699 Jul 18 02:22:35.806913 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1100707094-project Jul 18 02:22:35.806913 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 02:22:35.806913 n-d-465891-3 devstack@n-api.service[119543]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1259786192", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Jul 18 02:22:35.806913 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:22:35.806913 n-d-465891-3 devstack@n-api.service[119543]: exception: Keypair data is invalid: failed to generate fingerprint Jul 18 02:22:35.811451 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1259786192', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Jul 18 02:22:35.811451 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:22:35.811451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:35.811451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 18 02:22:35.811451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 18 02:22:35.811451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Jul 18 02:22:35.811451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Jul 18 02:22:35.811451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Jul 18 02:22:35.811451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:35.811451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:22:35.811451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:35.811451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:35.811451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 18 02:22:35.811451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 18 02:22:35.811451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 02:22:35.811451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 02:22:35.811451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:22:35.811451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:22:35.811451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:22:35.811451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:22:35.811451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 02:22:35.811451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 02:22:35.811451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 18 02:22:35.811451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 18 02:22:35.811451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 18 02:22:35.811451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 18 02:22:35.811451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 18 02:22:35.811451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 18 02:22:35.811451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 18 02:22:35.811451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:35.811451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:22:35.811451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:35.811451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:35.811451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:22:35.811451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:22:35.811451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:22:35.811451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:22:35.811451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:22:35.811451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:22:35.811451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:22:35.811451 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:22:35.816291 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:22:35.816291 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:22:35.816291 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:22:35.816291 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:22:35.816291 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 18 02:22:35.816291 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 18 02:22:35.816291 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 18 02:22:35.816291 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 18 02:22:35.816291 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 18 02:22:35.816291 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:35.816291 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:22:35.816291 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:35.816291 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:35.816291 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:22:35.816291 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:22:35.816291 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:22:35.816291 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:22:35.816291 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 18 02:22:35.816291 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:35.826265 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5147ddbe-97b7-4b02-af8b-a6be69b99fcb tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:22:35.835937 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5147ddbe-97b7-4b02-af8b-a6be69b99fcb tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.180827 Jul 18 02:22:35.837995 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1244/2444] 10.222.0.57 () {60 vars in 1159 bytes} [Mon Jul 18 02:22:35 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 197 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 18 02:22:35.856835 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-56faae12-ce8e-4817-9f94-2de1881f08aa tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] Action: 'create', calling method: .version_select at 0x7ff49bb6d1f0>, body: {"keypair": {"name": "tempest-keypair-726482926", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIqNqsSqKCqzZ7o249v2tnObO1AoPUkp/TgkuPORG8Uk0TRYYuoE6nqDvbZAsJT603gZteABMa6fjvM4Xnr0JgeIGPCn6mCj+m9bCozBjdqpXtiCvOSPTJd2OKQgfHRzQ=="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:22:35.941589 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4e341d60-4fe8-41f7-94bd-1bf09c719513 tempest-FloatingIPDetailsTestJSON-1825447231 tempest-FloatingIPDetailsTestJSON-1825447231-project] 10.222.0.57 "DELETE /compute/v2.1/os-floating-ips/8513e81d-28b6-471c-a0f6-3a3679065394" status: 202 len: 0 microversion: 2.1 time: 4.729600 Jul 18 02:22:35.943589 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1201/2445] 10.222.0.57 () {58 vars in 1262 bytes} [Mon Jul 18 02:22:31 2022] DELETE /compute/v2.1/os-floating-ips/8513e81d-28b6-471c-a0f6-3a3679065394 => generated 0 bytes in 4732 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:22:35.952025 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-56faae12-ce8e-4817-9f94-2de1881f08aa tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] Getting quotas for project 0bd2ddfb72fc408a9d891709af160d20. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:22:35.954350 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-81082b18-520c-4916-8148-b453354d3918 tempest-FloatingIPDetailsTestJSON-1825447231 tempest-FloatingIPDetailsTestJSON-1825447231-project] Calling method '.version_select at 0x7ff49bed9790>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:36.004911 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-56faae12-ce8e-4817-9f94-2de1881f08aa tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] Getting quotas for user 6b48eb18abce48aebd0f458551477699 and project 0bd2ddfb72fc408a9d891709af160d20. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:22:36.163623 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-56faae12-ce8e-4817-9f94-2de1881f08aa tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.314355 Jul 18 02:22:36.169014 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1245/2446] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 02:22:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:22:36.182147 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0a1dce68-e460-453d-b744-c34626bae6c3 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:36.183764 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0a1dce68-e460-453d-b744-c34626bae6c3 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:36.200202 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0a1dce68-e460-453d-b744-c34626bae6c3 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:36.201725 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0a1dce68-e460-453d-b744-c34626bae6c3 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:36.203701 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0a1dce68-e460-453d-b744-c34626bae6c3 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:36.205136 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0a1dce68-e460-453d-b744-c34626bae6c3 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:37.730218 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0a1dce68-e460-453d-b744-c34626bae6c3 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:37.773010 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0a1dce68-e460-453d-b744-c34626bae6c3 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1313 microversion: 2.1 time: 1.597795 Jul 18 02:22:37.775273 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1246/2447] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:36 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1313 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:37.824550 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-76039ced-b1b8-4821-8d3a-decd9cd26b10 tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] Action: 'create', calling method: .version_select at 0x7ff4a87c24c0>, body: {"keypair": {"name": "tempest-keypair-726482926", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqP571GJCKsPL8qR624UlOkXba8lqgTOTPzw+F5RnoaX8BuXlS8FU2DyK7DPO2y2EVFBkBaIW9Uuo5qJRxOMPltfn6vRjMIfKkS1bFKJavDwxQpjGzvVr6H9ajUpDUGcA=="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:22:37.901605 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-76039ced-b1b8-4821-8d3a-decd9cd26b10 tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] Getting quotas for project 0bd2ddfb72fc408a9d891709af160d20. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:22:37.922015 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-76039ced-b1b8-4821-8d3a-decd9cd26b10 tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] Getting quotas for user 6b48eb18abce48aebd0f458551477699 and project 0bd2ddfb72fc408a9d891709af160d20. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:22:37.976802 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-76039ced-b1b8-4821-8d3a-decd9cd26b10 tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] HTTP exception thrown: Key pair 'tempest-keypair-726482926' already exists. Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-76039ced-b1b8-4821-8d3a-decd9cd26b10 tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] Request method failure captured: Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 272 Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MPqD3JsQ87PrEqBEDIM2kNe2BKg8PAqLvaaj43PabMfvxGuCdtSY5tijhj7B2ydfKIkbwwDRZHZ4n6FNfv_PGSg3zL072IaRsKzFUD4OUT_Kfa-8EQVbsAqXNTmuSg5liT6fji59AW6fs57vOGDjn4-5gq6w-bN8P07riQWPYFtCEk Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 0bd2ddfb72fc408a9d891709af160d20 Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1100707094 Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0bd2ddfb72fc408a9d891709af160d20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0bd2ddfb72fc408a9d891709af160d20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0bd2ddfb72fc408a9d891709af160d20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0bd2ddfb72fc408a9d891709af160d20"}]}] Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1100707094 Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 0bd2ddfb72fc408a9d891709af160d20 Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1100707094 Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-KeyPairsNegativeTestJSON-1100707094-project Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 6b48eb18abce48aebd0f458551477699 Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1100707094-project Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: {"keypair": {"name": "tempest-keypair-726482926", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqP571GJCKsPL8qR624UlOkXba8lqgTOTPzw+F5RnoaX8BuXlS8FU2DyK7DPO2y2EVFBkBaIW9Uuo5qJRxOMPltfn6vRjMIfKkS1bFKJavDwxQpjGzvVr6H9ajUpDUGcA=="}} Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: exception: Key pair 'tempest-keypair-726482926' already exists. Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-726482926', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqP571GJCKsPL8qR624UlOkXba8lqgTOTPzw+F5RnoaX8BuXlS8FU2DyK7DPO2y2EVFBkBaIW9Uuo5qJRxOMPltfn6vRjMIfKkS1bFKJavDwxQpjGzvVr6H9ajUpDUGcA=='}}} Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result.read() Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '6b48eb18abce48aebd0f458551477699-tempest-keypair-726482926' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 18 02:22:37.996482 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi kp.save(context.session) Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi session.flush() Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result.read() Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 18 02:22:38.008992 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '6b48eb18abce48aebd0f458551477699-tempest-keypair-726482926' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 18, 2, 22, 37, 962806), 'updated_at': None, 'name': 'tempest-keypair-726482926', 'user_id': '6b48eb18abce48aebd0f458551477699', 'fingerprint': '19:e3:4b:9d:5d:63:b3:19:83:12:d3:4f:6b:51:ec:2f', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqP571GJCKsPL8qR624UlOkXba8lqgTOTPzw+F5RnoaX8BuXlS8FU2DyK7DPO2y2EVFBkBaIW9Uuo5qJRxOMPltfn6vRjMIfKkS1bFKJavDwxQpjGzvVr6H9ajUpDUGcA==', 'type': 'ssh'}] Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6661, in import_key_pair Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi keypair.create() Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._create() Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-726482926' already exists. Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Jul 18 02:22:38.019317 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-726482926' already exists. Jul 18 02:22:38.031099 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:38.031099 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:22:38.031099 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:38.031099 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:38.031099 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:22:38.031099 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:22:38.031099 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:22:38.031099 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:22:38.031099 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-726482926' already exists. Jul 18 02:22:38.031099 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:38.031099 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-76039ced-b1b8-4821-8d3a-decd9cd26b10 tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] Returning 409 to user: Key pair 'tempest-keypair-726482926' already exists. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:22:38.035025 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-76039ced-b1b8-4821-8d3a-decd9cd26b10 tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.256994 Jul 18 02:22:38.039651 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1247/2448] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 02:22:37 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 263 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:22:38.064450 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a5b7ba96-8b6b-46e3-a84c-2102199511d2 tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] Calling method '.version_select at 0x7ff49baec4c0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:38.135399 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a5b7ba96-8b6b-46e3-a84c-2102199511d2 tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-726482926" status: 202 len: 0 microversion: 2.1 time: 0.088506 Jul 18 02:22:38.136157 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1248/2449] 10.222.0.57 () {58 vars in 1217 bytes} [Mon Jul 18 02:22:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-726482926 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:22:38.167251 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6e3ca39b-8128-4be7-9307-45090307141f tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] Action: 'create', calling method: .version_select at 0x7ff49bb828b0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKv6dziIau6r7QYpqtxjFYwqIdSLLztz3whbVrEUEQr1URbOwy/GZ4LSSncaAVC/L3/cf4RB7qq50FWplPmBqHvqOEDNQMhWxIXj96/dWGLXt7OhQHGf0LatujBDWAvcOQ=="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6e3ca39b-8128-4be7-9307-45090307141f tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] Request method failure captured: Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 247 Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MPqD3JsQ87PrEqBEDIM2kNe2BKg8PAqLvaaj43PabMfvxGuCdtSY5tijhj7B2ydfKIkbwwDRZHZ4n6FNfv_PGSg3zL072IaRsKzFUD4OUT_Kfa-8EQVbsAqXNTmuSg5liT6fji59AW6fs57vOGDjn4-5gq6w-bN8P07riQWPYFtCEk Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 0bd2ddfb72fc408a9d891709af160d20 Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1100707094 Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0bd2ddfb72fc408a9d891709af160d20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0bd2ddfb72fc408a9d891709af160d20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0bd2ddfb72fc408a9d891709af160d20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0bd2ddfb72fc408a9d891709af160d20"}]}] Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1100707094 Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 0bd2ddfb72fc408a9d891709af160d20 Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1100707094 Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-KeyPairsNegativeTestJSON-1100707094-project Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 6b48eb18abce48aebd0f458551477699 Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1100707094-project Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKv6dziIau6r7QYpqtxjFYwqIdSLLztz3whbVrEUEQr1URbOwy/GZ4LSSncaAVC/L3/cf4RB7qq50FWplPmBqHvqOEDNQMhWxIXj96/dWGLXt7OhQHGf0LatujBDWAvcOQ=="}} Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKv6dziIau6r7QYpqtxjFYwqIdSLLztz3whbVrEUEQr1URbOwy/GZ4LSSncaAVC/L3/cf4RB7qq50FWplPmBqHvqOEDNQMhWxIXj96/dWGLXt7OhQHGf0LatujBDWAvcOQ=='}}} Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi '' Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:22:38.172226 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:22:38.181359 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:22:38.181359 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:22:38.181359 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:22:38.181359 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:22:38.181359 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 18 02:22:38.181359 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:38.181359 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:22:38.181359 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:38.181359 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:38.181359 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:22:38.181359 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:22:38.181359 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:22:38.181359 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:22:38.181359 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 18 02:22:38.181359 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:38.181359 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6e3ca39b-8128-4be7-9307-45090307141f tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:22:38.181359 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6e3ca39b-8128-4be7-9307-45090307141f tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.028273 Jul 18 02:22:38.186334 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1249/2450] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 02:22:38 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 18 02:22:38.197410 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9bc5e7ab-fb4a-4443-bfd8-6962268d39e6 tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] Action: 'create', calling method: .version_select at 0x7ff4a8eed9d0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1124738617", "public_key": " "}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:22:38.210647 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:22:38.265644 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-9bc5e7ab-fb4a-4443-bfd8-6962268d39e6 tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] Getting quotas for project 0bd2ddfb72fc408a9d891709af160d20. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:22:38.288123 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-9bc5e7ab-fb4a-4443-bfd8-6962268d39e6 tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] Getting quotas for user 6b48eb18abce48aebd0f458551477699 and project 0bd2ddfb72fc408a9d891709af160d20. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:22:38.331313 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-9bc5e7ab-fb4a-4443-bfd8-6962268d39e6 tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9bc5e7ab-fb4a-4443-bfd8-6962268d39e6 tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] Request method failure captured: Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 95 Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MPqD3JsQ87PrEqBEDIM2kNe2BKg8PAqLvaaj43PabMfvxGuCdtSY5tijhj7B2ydfKIkbwwDRZHZ4n6FNfv_PGSg3zL072IaRsKzFUD4OUT_Kfa-8EQVbsAqXNTmuSg5liT6fji59AW6fs57vOGDjn4-5gq6w-bN8P07riQWPYFtCEk Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 0bd2ddfb72fc408a9d891709af160d20 Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1100707094 Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0bd2ddfb72fc408a9d891709af160d20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0bd2ddfb72fc408a9d891709af160d20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0bd2ddfb72fc408a9d891709af160d20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0bd2ddfb72fc408a9d891709af160d20"}]}] Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1100707094 Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 0bd2ddfb72fc408a9d891709af160d20 Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1100707094 Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-KeyPairsNegativeTestJSON-1100707094-project Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 6b48eb18abce48aebd0f458551477699 Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1100707094-project Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1124738617", "public_key": " "}} Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: exception: Keypair data is invalid: failed to generate fingerprint Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1124738617', 'public_key': ' '}}} Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:22:38.333729 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:38.343237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:38.343237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:22:38.343237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:22:38.343237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:22:38.343237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:22:38.343237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:22:38.343237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:22:38.343237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:22:38.343237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:22:38.343237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:22:38.343237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:22:38.343237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:22:38.343237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:22:38.343237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 18 02:22:38.343237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 18 02:22:38.343237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 18 02:22:38.343237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 18 02:22:38.343237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 18 02:22:38.343237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:38.343237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:22:38.343237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:38.343237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:38.343237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:22:38.343237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:22:38.343237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:22:38.343237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:22:38.343237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 18 02:22:38.343237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:38.343237 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9bc5e7ab-fb4a-4443-bfd8-6962268d39e6 tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:22:38.343237 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9bc5e7ab-fb4a-4443-bfd8-6962268d39e6 tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.149822 Jul 18 02:22:38.343237 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1250/2451] 10.222.0.57 () {60 vars in 1157 bytes} [Mon Jul 18 02:22:38 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 157 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 18 02:22:38.361661 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-32331b35-0c84-4d96-a0ba-5e4d30520df6 tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] Action: 'create', calling method: .version_select at 0x7ff49baec3a0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBD8J3DxjbNXzalewgBeOLazSD5xz9IOQ3ZGeFqMVBxHEMs5u7yFqaY5PzM2HSba0yYucH0krtcuFcDYPYazzczoz4xVG5vMyxxHQ6OXnyvIZcQ50Q/AltRgaO6lZQxIBg=="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-32331b35-0c84-4d96-a0ba-5e4d30520df6 tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] Request method failure captured: Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 507 Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MPqD3JsQ87PrEqBEDIM2kNe2BKg8PAqLvaaj43PabMfvxGuCdtSY5tijhj7B2ydfKIkbwwDRZHZ4n6FNfv_PGSg3zL072IaRsKzFUD4OUT_Kfa-8EQVbsAqXNTmuSg5liT6fji59AW6fs57vOGDjn4-5gq6w-bN8P07riQWPYFtCEk Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 0bd2ddfb72fc408a9d891709af160d20 Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1100707094 Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0bd2ddfb72fc408a9d891709af160d20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0bd2ddfb72fc408a9d891709af160d20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0bd2ddfb72fc408a9d891709af160d20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0bd2ddfb72fc408a9d891709af160d20"}]}] Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1100707094 Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 0bd2ddfb72fc408a9d891709af160d20 Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1100707094 Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-KeyPairsNegativeTestJSON-1100707094-project Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 6b48eb18abce48aebd0f458551477699 Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1100707094-project Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBD8J3DxjbNXzalewgBeOLazSD5xz9IOQ3ZGeFqMVBxHEMs5u7yFqaY5PzM2HSba0yYucH0krtcuFcDYPYazzczoz4xVG5vMyxxHQ6OXnyvIZcQ50Q/AltRgaO6lZQxIBg=="}} Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBD8J3DxjbNXzalewgBeOLazSD5xz9IOQ3ZGeFqMVBxHEMs5u7yFqaY5PzM2HSba0yYucH0krtcuFcDYPYazzczoz4xVG5vMyxxHQ6OXnyvIZcQ50Q/AltRgaO6lZQxIBg=='}}} Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Jul 18 02:22:38.365130 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:38.382679 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:22:38.382679 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:38.382679 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:38.382679 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:22:38.382679 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:22:38.382679 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:22:38.382679 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:22:38.382679 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:22:38.382679 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:22:38.382679 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:22:38.382679 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:22:38.382679 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:22:38.382679 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:22:38.382679 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:22:38.382679 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:22:38.382679 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:22:38.382679 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:22:38.382679 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:22:38.382679 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:22:38.382679 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 18 02:22:38.382679 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:38.382679 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:22:38.382679 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:38.382679 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:38.382679 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:22:38.382679 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:22:38.382679 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:22:38.382679 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:22:38.382679 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 18 02:22:38.382679 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:38.382679 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-32331b35-0c84-4d96-a0ba-5e4d30520df6 tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:22:38.382679 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-32331b35-0c84-4d96-a0ba-5e4d30520df6 tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.014291 Jul 18 02:22:38.382679 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1251/2452] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 02:22:38 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:22:38.398133 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-87631741-b046-457e-b380-015ba8baa9d3 tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] Action: 'create', calling method: .version_select at 0x7ff49bb64e50>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1930365523", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:22:38.453281 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-87631741-b046-457e-b380-015ba8baa9d3 tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] Getting quotas for project 0bd2ddfb72fc408a9d891709af160d20. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:22:38.476518 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-87631741-b046-457e-b380-015ba8baa9d3 tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] Getting quotas for user 6b48eb18abce48aebd0f458551477699 and project 0bd2ddfb72fc408a9d891709af160d20. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:22:38.567267 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-87631741-b046-457e-b380-015ba8baa9d3 tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-87631741-b046-457e-b380-015ba8baa9d3 tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] Request method failure captured: Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 118 Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MPqD3JsQ87PrEqBEDIM2kNe2BKg8PAqLvaaj43PabMfvxGuCdtSY5tijhj7B2ydfKIkbwwDRZHZ4n6FNfv_PGSg3zL072IaRsKzFUD4OUT_Kfa-8EQVbsAqXNTmuSg5liT6fji59AW6fs57vOGDjn4-5gq6w-bN8P07riQWPYFtCEk Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 0bd2ddfb72fc408a9d891709af160d20 Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1100707094 Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0bd2ddfb72fc408a9d891709af160d20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0bd2ddfb72fc408a9d891709af160d20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0bd2ddfb72fc408a9d891709af160d20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0bd2ddfb72fc408a9d891709af160d20"}]}] Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1100707094 Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 0bd2ddfb72fc408a9d891709af160d20 Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1100707094 Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-KeyPairsNegativeTestJSON-1100707094-project Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 6b48eb18abce48aebd0f458551477699 Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1100707094-project Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1930365523", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: exception: Keypair data is invalid: failed to generate fingerprint Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1930365523', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 18 02:22:38.571378 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 18 02:22:38.580894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 18 02:22:38.580894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 18 02:22:38.580894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 18 02:22:38.580894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:38.580894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:22:38.580894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:38.580894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:38.580894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:22:38.580894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:22:38.580894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:22:38.580894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:22:38.580894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:22:38.580894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:22:38.580894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:22:38.580894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:22:38.580894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:22:38.580894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:22:38.580894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:22:38.580894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:22:38.580894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 18 02:22:38.580894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 18 02:22:38.580894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 18 02:22:38.580894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 18 02:22:38.580894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 18 02:22:38.580894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:38.580894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:22:38.580894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:38.580894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:38.580894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:22:38.580894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:22:38.580894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:22:38.580894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:22:38.580894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 18 02:22:38.580894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:38.580894 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-87631741-b046-457e-b380-015ba8baa9d3 tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:22:38.580894 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-87631741-b046-457e-b380-015ba8baa9d3 tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.192820 Jul 18 02:22:38.580894 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1252/2453] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 02:22:38 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 198 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jul 18 02:22:38.591666 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-42cb50d4-6a0b-46eb-9108-8a9a85fd1243 tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] Calling method '.version_select at 0x7ff49baecdc0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:38.608671 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-42cb50d4-6a0b-46eb-9108-8a9a85fd1243 tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-322633818 not found for user 6b48eb18abce48aebd0f458551477699 Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-42cb50d4-6a0b-46eb-9108-8a9a85fd1243 tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] Request method failure captured: Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-322633818 HTTP/1.1 Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MPqD3JsQ87PrEqBEDIM2kNe2BKg8PAqLvaaj43PabMfvxGuCdtSY5tijhj7B2ydfKIkbwwDRZHZ4n6FNfv_PGSg3zL072IaRsKzFUD4OUT_Kfa-8EQVbsAqXNTmuSg5liT6fji59AW6fs57vOGDjn4-5gq6w-bN8P07riQWPYFtCEk Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 0bd2ddfb72fc408a9d891709af160d20 Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1100707094 Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0bd2ddfb72fc408a9d891709af160d20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0bd2ddfb72fc408a9d891709af160d20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0bd2ddfb72fc408a9d891709af160d20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0bd2ddfb72fc408a9d891709af160d20"}]}] Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1100707094 Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 0bd2ddfb72fc408a9d891709af160d20 Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1100707094 Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-KeyPairsNegativeTestJSON-1100707094-project Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 6b48eb18abce48aebd0f458551477699 Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1100707094-project Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: exception: Keypair tempest-keypair-non-existent-322633818 not found for user 6b48eb18abce48aebd0f458551477699 Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'tempest-keypair-non-existent-322633818'} Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-322633818 not found for user 6b48eb18abce48aebd0f458551477699 Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:38.611133 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:22:38.624452 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:38.624452 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:38.624452 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:22:38.624452 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:22:38.624452 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:22:38.624452 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:22:38.624452 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:22:38.624452 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:22:38.624452 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:22:38.624452 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:22:38.624452 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:22:38.624452 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:22:38.624452 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jul 18 02:22:38.624452 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jul 18 02:22:38.624452 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jul 18 02:22:38.624452 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jul 18 02:22:38.624452 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-322633818 not found for user 6b48eb18abce48aebd0f458551477699 Jul 18 02:22:38.624452 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:38.624452 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:22:38.624452 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:38.624452 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:38.624452 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:22:38.624452 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:22:38.624452 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:22:38.624452 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:22:38.624452 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-322633818 not found for user 6b48eb18abce48aebd0f458551477699 Jul 18 02:22:38.624452 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:38.624452 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-42cb50d4-6a0b-46eb-9108-8a9a85fd1243 tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] Returning 404 to user: Keypair tempest-keypair-non-existent-322633818 not found for user 6b48eb18abce48aebd0f458551477699 {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:22:38.624452 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-42cb50d4-6a0b-46eb-9108-8a9a85fd1243 tempest-KeyPairsNegativeTestJSON-1100707094 tempest-KeyPairsNegativeTestJSON-1100707094-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-322633818" status: 404 len: 144 microversion: 2.1 time: 0.029787 Jul 18 02:22:38.624452 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1253/2454] 10.222.0.57 () {58 vars in 1256 bytes} [Mon Jul 18 02:22:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-322633818 => generated 144 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:22:38.793429 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bc12d011-1358-4215-ab95-77a0315c0fd9 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:38.794649 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bc12d011-1358-4215-ab95-77a0315c0fd9 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:38.819644 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bc12d011-1358-4215-ab95-77a0315c0fd9 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:38.823917 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bc12d011-1358-4215-ab95-77a0315c0fd9 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:38.831414 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bc12d011-1358-4215-ab95-77a0315c0fd9 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:38.837316 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bc12d011-1358-4215-ab95-77a0315c0fd9 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:40.370120 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bc12d011-1358-4215-ab95-77a0315c0fd9 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:40.387999 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bc12d011-1358-4215-ab95-77a0315c0fd9 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1313 microversion: 2.1 time: 1.598755 Jul 18 02:22:40.388977 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1254/2455] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:38 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1313 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:40.934268 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-39f11eab-6173-49a9-89ea-e32cee31f39f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1383183027", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "6dbd9947-7c83-4ca1-a653-57a9c042a444"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:22:41.140680 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-39f11eab-6173-49a9-89ea-e32cee31f39f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] validate_networks() for [('6dbd9947-7c83-4ca1-a653-57a9c042a444', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:22:41.782829 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-81082b18-520c-4916-8148-b453354d3918 tempest-FloatingIPDetailsTestJSON-1825447231 tempest-FloatingIPDetailsTestJSON-1825447231-project] 10.222.0.57 "DELETE /compute/v2.1/os-floating-ips/d636819f-ec74-4b9f-b619-117e273ca182" status: 202 len: 0 microversion: 2.1 time: 5.833192 Jul 18 02:22:41.784714 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1202/2456] 10.222.0.57 () {58 vars in 1262 bytes} [Mon Jul 18 02:22:35 2022] DELETE /compute/v2.1/os-floating-ips/d636819f-ec74-4b9f-b619-117e273ca182 => generated 0 bytes in 5837 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:22:41.809946 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6f75ecd3-0b7e-4be3-9c03-8f820bed089e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:41.813200 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6f75ecd3-0b7e-4be3-9c03-8f820bed089e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:41.847720 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6f75ecd3-0b7e-4be3-9c03-8f820bed089e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:41.853566 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6f75ecd3-0b7e-4be3-9c03-8f820bed089e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:41.866834 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6f75ecd3-0b7e-4be3-9c03-8f820bed089e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:41.867506 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6f75ecd3-0b7e-4be3-9c03-8f820bed089e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:43.680525 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6f75ecd3-0b7e-4be3-9c03-8f820bed089e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:43.689297 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6f75ecd3-0b7e-4be3-9c03-8f820bed089e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1313 microversion: 2.1 time: 1.898430 Jul 18 02:22:43.690091 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1203/2457] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:41 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1313 bytes in 1903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:43.699149 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f50a2f4d-06f4-4bf7-bb2a-374ba773ace8 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:43.700005 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f50a2f4d-06f4-4bf7-bb2a-374ba773ace8 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:43.724002 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f50a2f4d-06f4-4bf7-bb2a-374ba773ace8 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:43.725132 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f50a2f4d-06f4-4bf7-bb2a-374ba773ace8 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:43.726024 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f50a2f4d-06f4-4bf7-bb2a-374ba773ace8 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:43.732451 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f50a2f4d-06f4-4bf7-bb2a-374ba773ace8 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:43.806728 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f50a2f4d-06f4-4bf7-bb2a-374ba773ace8 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:22:44.013206 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f50a2f4d-06f4-4bf7-bb2a-374ba773ace8 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "DELETE /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 204 len: 0 microversion: 2.25 time: 0.319532 Jul 18 02:22:44.014601 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1204/2458] 10.222.0.57 () {60 vars in 1279 bytes} [Mon Jul 18 02:22:43 2022] DELETE /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:22:44.026745 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-33998dc5-fd64-49dd-baa5-d96e08cbe747 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:44.027571 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-33998dc5-fd64-49dd-baa5-d96e08cbe747 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:44.040207 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-33998dc5-fd64-49dd-baa5-d96e08cbe747 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:44.047548 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-33998dc5-fd64-49dd-baa5-d96e08cbe747 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:44.049619 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-33998dc5-fd64-49dd-baa5-d96e08cbe747 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:44.050127 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-33998dc5-fd64-49dd-baa5-d96e08cbe747 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:44.403854 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-39f11eab-6173-49a9-89ea-e32cee31f39f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:22:44.403854 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-39f11eab-6173-49a9-89ea-e32cee31f39f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:22:44.404761 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-39f11eab-6173-49a9-89ea-e32cee31f39f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:22:44.406665 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-39f11eab-6173-49a9-89ea-e32cee31f39f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:22:44.408721 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-39f11eab-6173-49a9-89ea-e32cee31f39f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:22:44.426964 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-39f11eab-6173-49a9-89ea-e32cee31f39f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:44.427888 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-39f11eab-6173-49a9-89ea-e32cee31f39f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:44.430047 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-39f11eab-6173-49a9-89ea-e32cee31f39f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:44.430878 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-39f11eab-6173-49a9-89ea-e32cee31f39f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:44.488638 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-39f11eab-6173-49a9-89ea-e32cee31f39f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Getting quotas for project ba9d4e8f2f18460ebccacbe32db57388. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:22:44.526127 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-39f11eab-6173-49a9-89ea-e32cee31f39f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Getting quotas for user 89c4d32923874a50972ab0b75a4165c0 and project ba9d4e8f2f18460ebccacbe32db57388. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:22:44.572061 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-39f11eab-6173-49a9-89ea-e32cee31f39f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:22:44.579413 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-39f11eab-6173-49a9-89ea-e32cee31f39f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:22:44.804422 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-39f11eab-6173-49a9-89ea-e32cee31f39f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.280673 Jul 18 02:22:44.814477 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1255/2459] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:22:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 4292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 02:22:44.858360 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-35a15884-19bd-4b93-98e7-135352336600 req-e96a2b01-5185-4c2a-945c-ea0b13c7ede7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67029c55-03b9-4f19-bf3d-b54f1998ebae", "tag": "35c7791f-4eef-441a-884d-d3eed4376b4f"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:22:44.914373 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-35a15884-19bd-4b93-98e7-135352336600 req-e96a2b01-5185-4c2a-945c-ea0b13c7ede7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:44.928440 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-35a15884-19bd-4b93-98e7-135352336600 req-e96a2b01-5185-4c2a-945c-ea0b13c7ede7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:44.969107 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-35a15884-19bd-4b93-98e7-135352336600 req-e96a2b01-5185-4c2a-945c-ea0b13c7ede7 service nova] Creating event network-changed:35c7791f-4eef-441a-884d-d3eed4376b4f for instance 67029c55-03b9-4f19-bf3d-b54f1998ebae on n-h1-465891-3 Jul 18 02:22:44.988888 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-35a15884-19bd-4b93-98e7-135352336600 req-e96a2b01-5185-4c2a-945c-ea0b13c7ede7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172067 Jul 18 02:22:44.994577 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1256/2460] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:22:45.009291 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4cb4364f-0ac7-40e7-9341-7db288c0068a tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:45.010051 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4cb4364f-0ac7-40e7-9341-7db288c0068a tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:45.028839 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4cb4364f-0ac7-40e7-9341-7db288c0068a tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:45.029297 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4cb4364f-0ac7-40e7-9341-7db288c0068a tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:45.030137 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4cb4364f-0ac7-40e7-9341-7db288c0068a tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:45.030603 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4cb4364f-0ac7-40e7-9341-7db288c0068a tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:45.079062 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:22:45.625975 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-33998dc5-fd64-49dd-baa5-d96e08cbe747 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:45.665247 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-33998dc5-fd64-49dd-baa5-d96e08cbe747 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:45.668743 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-33998dc5-fd64-49dd-baa5-d96e08cbe747 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:45.677569 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-33998dc5-fd64-49dd-baa5-d96e08cbe747 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 200 len: 1732 microversion: 2.25 time: 1.656299 Jul 18 02:22:45.680501 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1205/2461] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:44 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 1732 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:22:45.701294 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7a6062ba-d63e-430f-87ce-551fb72d12cc tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:45.702829 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7a6062ba-d63e-430f-87ce-551fb72d12cc tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:46.949745 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7a6062ba-d63e-430f-87ce-551fb72d12cc tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:46.979941 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7a6062ba-d63e-430f-87ce-551fb72d12cc tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc" status: 200 len: 1215 microversion: 2.1 time: 1.297043 Jul 18 02:22:46.993564 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1206/2462] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:45 2022] GET /compute/v2.1/servers/6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc => generated 1215 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:47.699936 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7b159c73-c689-41b3-ad51-86b5ad4b5d08 tempest-AbsoluteLimitsNegativeTestJSON-672851949 tempest-AbsoluteLimitsNegativeTestJSON-672851949-project] Calling method '.version_select at 0x7ff49bf1caf0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:47.729259 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7b159c73-c689-41b3-ad51-86b5ad4b5d08 tempest-AbsoluteLimitsNegativeTestJSON-672851949 tempest-AbsoluteLimitsNegativeTestJSON-672851949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:47.730148 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7b159c73-c689-41b3-ad51-86b5ad4b5d08 tempest-AbsoluteLimitsNegativeTestJSON-672851949 tempest-AbsoluteLimitsNegativeTestJSON-672851949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:47.731534 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7b159c73-c689-41b3-ad51-86b5ad4b5d08 tempest-AbsoluteLimitsNegativeTestJSON-672851949 tempest-AbsoluteLimitsNegativeTestJSON-672851949-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:47.732403 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7b159c73-c689-41b3-ad51-86b5ad4b5d08 tempest-AbsoluteLimitsNegativeTestJSON-672851949 tempest-AbsoluteLimitsNegativeTestJSON-672851949-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:47.780530 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7b159c73-c689-41b3-ad51-86b5ad4b5d08 tempest-AbsoluteLimitsNegativeTestJSON-672851949 tempest-AbsoluteLimitsNegativeTestJSON-672851949-project] 10.222.0.57 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.781412 Jul 18 02:22:47.782455 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1207/2463] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Jul 18 02:22:46 2022] GET /compute/v2.1/limits => generated 511 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:22:47.792940 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-dcbcb8c7-961c-4879-9714-628b2c4f7c8c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:47.794459 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-dcbcb8c7-961c-4879-9714-628b2c4f7c8c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:47.808972 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dcbcb8c7-961c-4879-9714-628b2c4f7c8c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:47.810563 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dcbcb8c7-961c-4879-9714-628b2c4f7c8c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:47.812342 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dcbcb8c7-961c-4879-9714-628b2c4f7c8c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:47.813337 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dcbcb8c7-961c-4879-9714-628b2c4f7c8c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:47.932247 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4cb4364f-0ac7-40e7-9341-7db288c0068a tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:47.945125 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4cb4364f-0ac7-40e7-9341-7db288c0068a tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1313 microversion: 2.1 time: 2.949063 Jul 18 02:22:47.947004 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1257/2464] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:44 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1313 bytes in 2952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:47.975029 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-eae09e3a-5bdc-4a02-a68d-3abbc0b4a6fe tempest-AbsoluteLimitsNegativeTestJSON-672851949 tempest-AbsoluteLimitsNegativeTestJSON-672851949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1447708210", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:22:48.085596 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-eae09e3a-5bdc-4a02-a68d-3abbc0b4a6fe tempest-AbsoluteLimitsNegativeTestJSON-672851949 tempest-AbsoluteLimitsNegativeTestJSON-672851949-project] validate_networks() for None {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:22:48.766847 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-dcbcb8c7-961c-4879-9714-628b2c4f7c8c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:48.787256 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-dcbcb8c7-961c-4879-9714-628b2c4f7c8c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:48.790201 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-dcbcb8c7-961c-4879-9714-628b2c4f7c8c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:48.791853 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-dcbcb8c7-961c-4879-9714-628b2c4f7c8c tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 200 len: 1732 microversion: 2.25 time: 1.007590 Jul 18 02:22:48.793318 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1208/2465] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:47 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 1732 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:48.799041 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-267fb0be-4ab2-4542-807a-500c5fbcaf7e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:48.800129 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-267fb0be-4ab2-4542-807a-500c5fbcaf7e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:48.808919 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-267fb0be-4ab2-4542-807a-500c5fbcaf7e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:48.810036 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-267fb0be-4ab2-4542-807a-500c5fbcaf7e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:48.810438 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-267fb0be-4ab2-4542-807a-500c5fbcaf7e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:48.811129 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-267fb0be-4ab2-4542-807a-500c5fbcaf7e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:49.493941 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-267fb0be-4ab2-4542-807a-500c5fbcaf7e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:49.514676 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-267fb0be-4ab2-4542-807a-500c5fbcaf7e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc" status: 200 len: 1273 microversion: 2.1 time: 0.719931 Jul 18 02:22:49.516066 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1209/2466] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:48 2022] GET /compute/v2.1/servers/6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc => generated 1273 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:49.521843 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a4b80aeb-8c36-41dc-85e2-e0d69ef5201c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:49.522921 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a4b80aeb-8c36-41dc-85e2-e0d69ef5201c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:49.533178 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a4b80aeb-8c36-41dc-85e2-e0d69ef5201c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:49.534105 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a4b80aeb-8c36-41dc-85e2-e0d69ef5201c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:49.535238 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a4b80aeb-8c36-41dc-85e2-e0d69ef5201c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:49.535965 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a4b80aeb-8c36-41dc-85e2-e0d69ef5201c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:49.897646 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-eae09e3a-5bdc-4a02-a68d-3abbc0b4a6fe tempest-AbsoluteLimitsNegativeTestJSON-672851949 tempest-AbsoluteLimitsNegativeTestJSON-672851949-project] Getting quotas for project 57be856a5d8948cab789cd1749ecbaaf. Resources: dict_keys(['metadata_items']) {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:22:49.909172 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-eae09e3a-5bdc-4a02-a68d-3abbc0b4a6fe tempest-AbsoluteLimitsNegativeTestJSON-672851949 tempest-AbsoluteLimitsNegativeTestJSON-672851949-project] Getting quotas for user ae93fc4ebd44499da2f7298202a4e66a and project 57be856a5d8948cab789cd1749ecbaaf. Resources: dict_keys(['metadata_items']) {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:22:49.938858 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-eae09e3a-5bdc-4a02-a68d-3abbc0b4a6fe tempest-AbsoluteLimitsNegativeTestJSON-672851949 tempest-AbsoluteLimitsNegativeTestJSON-672851949-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Jul 18 02:22:49.950472 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-eae09e3a-5bdc-4a02-a68d-3abbc0b4a6fe tempest-AbsoluteLimitsNegativeTestJSON-672851949 tempest-AbsoluteLimitsNegativeTestJSON-672851949-project] Request method failure captured: Jul 18 02:22:49.950472 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:22:49.950472 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:22:49.950472 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:22:49.950472 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:22:49.950472 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 1752 Jul 18 02:22:49.950472 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:22:49.950472 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:22:49.950472 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:22:49.950472 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:22:49.950472 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MP0pTUqmcS9v4OhI9NJjMKXFaly358DljvE2TfMlu9VcKagQuEZohZFrWLDoGDdw2CLufdcjGnABY6LebleGDJCBqLj1WMhYnDT8iXAbJapy7Ll-l2N7JGsjaFbPKdK-rq4inSI5MAKPYuyeycNWVD3bZAP924eC6TAAFivac_3egU Jul 18 02:22:49.950472 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:22:49.950472 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:22:49.950472 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:22:49.950472 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:22:49.950472 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:22:49.950472 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:22:49.950472 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 57be856a5d8948cab789cd1749ecbaaf Jul 18 02:22:49.950472 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-672851949 Jul 18 02:22:49.950472 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:22:49.950472 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:22:49.950472 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_57be856a5d8948cab789cd1749ecbaaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/57be856a5d8948cab789cd1749ecbaaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/57be856a5d8948cab789cd1749ecbaaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/57be856a5d8948cab789cd1749ecbaaf"}]}] Jul 18 02:22:49.950472 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-672851949 Jul 18 02:22:49.950472 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 57be856a5d8948cab789cd1749ecbaaf Jul 18 02:22:49.950472 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-672851949 Jul 18 02:22:49.950472 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-672851949-project Jul 18 02:22:49.950472 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:22:49.950472 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:22:49.950472 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: ae93fc4ebd44499da2f7298202a4e66a Jul 18 02:22:49.950472 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-672851949-project Jul 18 02:22:49.950472 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 02:22:49.950472 n-d-465891-3 devstack@n-api.service[119543]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1447708210", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Jul 18 02:22:49.950472 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:22:49.950472 n-d-465891-3 devstack@n-api.service[119543]: exception: Maximum number of metadata items exceeds 128 Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1447708210', 'imageRef': '3bb0a19f-5b69-48ee-a771-8fd416f92f36', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 462, in _check_metadata_properties_quota Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1002, in _checks_for_create_and_rebuild Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 469, in _check_metadata_properties_quota Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:22:49.955301 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:22:49.961671 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:22:49.961671 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 18 02:22:49.961671 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 18 02:22:49.961671 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 18 02:22:49.961671 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Jul 18 02:22:49.961671 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:49.961671 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:22:49.961671 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:49.961671 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:49.961671 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:22:49.961671 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:22:49.961671 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:22:49.961671 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:22:49.961671 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Jul 18 02:22:49.961671 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:22:49.968039 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-eae09e3a-5bdc-4a02-a68d-3abbc0b4a6fe tempest-AbsoluteLimitsNegativeTestJSON-672851949 tempest-AbsoluteLimitsNegativeTestJSON-672851949-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:22:49.968875 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-eae09e3a-5bdc-4a02-a68d-3abbc0b4a6fe tempest-AbsoluteLimitsNegativeTestJSON-672851949 tempest-AbsoluteLimitsNegativeTestJSON-672851949-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.997474 Jul 18 02:22:49.970975 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1258/2467] 10.222.0.57 () {60 vars in 1147 bytes} [Mon Jul 18 02:22:47 2022] POST /compute/v2.1/servers => generated 87 bytes in 2001 msecs (HTTP/1.1 403) 9 headers in 378 bytes (2 switches on core 0) Jul 18 02:22:49.981802 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-77be5cf7-d427-464a-9d59-87f4e7e55332 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:49.984833 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-77be5cf7-d427-464a-9d59-87f4e7e55332 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:50.003863 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77be5cf7-d427-464a-9d59-87f4e7e55332 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:50.004637 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77be5cf7-d427-464a-9d59-87f4e7e55332 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:50.006858 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77be5cf7-d427-464a-9d59-87f4e7e55332 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:50.009949 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77be5cf7-d427-464a-9d59-87f4e7e55332 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:50.492482 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a4b80aeb-8c36-41dc-85e2-e0d69ef5201c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:50.514239 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a4b80aeb-8c36-41dc-85e2-e0d69ef5201c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1313 microversion: 2.1 time: 0.996158 Jul 18 02:22:50.515492 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1210/2468] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:49 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1313 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:50.556181 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-40b61933-6be2-485f-b2ab-6947122add73 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:50.558037 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-40b61933-6be2-485f-b2ab-6947122add73 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:50.578896 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-40b61933-6be2-485f-b2ab-6947122add73 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:50.579513 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-40b61933-6be2-485f-b2ab-6947122add73 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:50.585649 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-40b61933-6be2-485f-b2ab-6947122add73 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:50.586339 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-40b61933-6be2-485f-b2ab-6947122add73 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:51.004726 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-40b61933-6be2-485f-b2ab-6947122add73 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:51.059633 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-40b61933-6be2-485f-b2ab-6947122add73 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc" status: 200 len: 1273 microversion: 2.1 time: 0.515286 Jul 18 02:22:51.062247 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1211/2469] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:50 2022] GET /compute/v2.1/servers/6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc => generated 1273 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:51.332588 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-77be5cf7-d427-464a-9d59-87f4e7e55332 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:51.369454 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-77be5cf7-d427-464a-9d59-87f4e7e55332 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:51.378549 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-77be5cf7-d427-464a-9d59-87f4e7e55332 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:51.381369 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-77be5cf7-d427-464a-9d59-87f4e7e55332 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 200 len: 1732 microversion: 2.25 time: 1.407678 Jul 18 02:22:51.404423 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1259/2470] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:49 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 1732 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:51.558585 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-54002229-5beb-4700-a6bb-b2540c2f7ed7 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:51.559783 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-54002229-5beb-4700-a6bb-b2540c2f7ed7 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:51.593649 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54002229-5beb-4700-a6bb-b2540c2f7ed7 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:51.594174 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54002229-5beb-4700-a6bb-b2540c2f7ed7 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:51.595495 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54002229-5beb-4700-a6bb-b2540c2f7ed7 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:51.596219 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54002229-5beb-4700-a6bb-b2540c2f7ed7 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:52.092088 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-15c2007b-2813-4dfd-a153-5b43774af97c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:52.093996 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-15c2007b-2813-4dfd-a153-5b43774af97c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:52.163903 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-15c2007b-2813-4dfd-a153-5b43774af97c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:52.166776 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-15c2007b-2813-4dfd-a153-5b43774af97c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:52.174305 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-15c2007b-2813-4dfd-a153-5b43774af97c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:52.186289 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-15c2007b-2813-4dfd-a153-5b43774af97c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:53.138034 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-54002229-5beb-4700-a6bb-b2540c2f7ed7 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:53.153779 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-54002229-5beb-4700-a6bb-b2540c2f7ed7 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1313 microversion: 2.1 time: 1.611443 Jul 18 02:22:53.154887 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1212/2471] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:51 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1313 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:53.169008 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b47e363e-5660-46c5-ba54-334417321657 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:53.170058 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b47e363e-5660-46c5-ba54-334417321657 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:53.210489 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b47e363e-5660-46c5-ba54-334417321657 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:53.219512 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b47e363e-5660-46c5-ba54-334417321657 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:53.222789 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b47e363e-5660-46c5-ba54-334417321657 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:53.223470 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b47e363e-5660-46c5-ba54-334417321657 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:53.383089 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-15c2007b-2813-4dfd-a153-5b43774af97c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:53.400540 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-15c2007b-2813-4dfd-a153-5b43774af97c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc" status: 200 len: 1315 microversion: 2.1 time: 1.317365 Jul 18 02:22:53.403780 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1260/2472] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:52 2022] GET /compute/v2.1/servers/6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc => generated 1315 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:53.477401 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b47e363e-5660-46c5-ba54-334417321657 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:53.499083 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b47e363e-5660-46c5-ba54-334417321657 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:53.513595 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b47e363e-5660-46c5-ba54-334417321657 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:53.515915 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b47e363e-5660-46c5-ba54-334417321657 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 200 len: 1664 microversion: 2.25 time: 0.357550 Jul 18 02:22:53.528371 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1213/2473] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:53 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 1664 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:53.932998 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-32c274a2-0bb6-4ded-b456-9406e58cce4c req-593f1f2f-2ac1-4644-bfb5-0fbaca1533a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "174a0067-ee9a-493e-a1d9-099fdf4bbaec", "name": "network-vif-deleted", "tag": "6947632d-5fe6-4f71-b7ce-376a2c05af5b"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:22:53.957592 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-32c274a2-0bb6-4ded-b456-9406e58cce4c req-593f1f2f-2ac1-4644-bfb5-0fbaca1533a5 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:53.959181 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-32c274a2-0bb6-4ded-b456-9406e58cce4c req-593f1f2f-2ac1-4644-bfb5-0fbaca1533a5 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:53.981549 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-32c274a2-0bb6-4ded-b456-9406e58cce4c req-593f1f2f-2ac1-4644-bfb5-0fbaca1533a5 service nova] Creating event network-vif-deleted:6947632d-5fe6-4f71-b7ce-376a2c05af5b for instance 174a0067-ee9a-493e-a1d9-099fdf4bbaec on n-h1-465891-3 Jul 18 02:22:53.989006 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-32c274a2-0bb6-4ded-b456-9406e58cce4c req-593f1f2f-2ac1-4644-bfb5-0fbaca1533a5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060190 Jul 18 02:22:53.991532 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1261/2474] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:22:54.186651 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6d7f20f8-b9fe-4dbc-b236-f66f37ac1663 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:54.187919 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6d7f20f8-b9fe-4dbc-b236-f66f37ac1663 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:54.212380 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6d7f20f8-b9fe-4dbc-b236-f66f37ac1663 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:54.213145 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6d7f20f8-b9fe-4dbc-b236-f66f37ac1663 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:54.214164 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6d7f20f8-b9fe-4dbc-b236-f66f37ac1663 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:54.214789 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6d7f20f8-b9fe-4dbc-b236-f66f37ac1663 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:54.419903 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-59879983-6fce-46b0-9f92-09708ff3570b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:54.420745 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-59879983-6fce-46b0-9f92-09708ff3570b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:54.456184 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-59879983-6fce-46b0-9f92-09708ff3570b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:54.462059 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-59879983-6fce-46b0-9f92-09708ff3570b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:54.466306 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-59879983-6fce-46b0-9f92-09708ff3570b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:54.484210 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-59879983-6fce-46b0-9f92-09708ff3570b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:54.490866 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:22:55.738221 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-59879983-6fce-46b0-9f92-09708ff3570b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:55.763344 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6d7f20f8-b9fe-4dbc-b236-f66f37ac1663 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:55.774827 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6d7f20f8-b9fe-4dbc-b236-f66f37ac1663 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1313 microversion: 2.1 time: 1.591996 Jul 18 02:22:55.779332 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1214/2475] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:54 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1313 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:55.784736 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-59879983-6fce-46b0-9f92-09708ff3570b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc" status: 200 len: 1315 microversion: 2.1 time: 1.368513 Jul 18 02:22:55.788859 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1262/2476] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:54 2022] GET /compute/v2.1/servers/6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc => generated 1315 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:55.795562 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-44fda554-679e-47a4-a40f-f26e2123a6d4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:55.797264 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-44fda554-679e-47a4-a40f-f26e2123a6d4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 174a0067-ee9a-493e-a1d9-099fdf4bbaec] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:55.830254 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-44fda554-679e-47a4-a40f-f26e2123a6d4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:55.831031 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-44fda554-679e-47a4-a40f-f26e2123a6d4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:55.832521 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-44fda554-679e-47a4-a40f-f26e2123a6d4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:55.833347 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-44fda554-679e-47a4-a40f-f26e2123a6d4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:55.867920 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-44fda554-679e-47a4-a40f-f26e2123a6d4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] HTTP exception thrown: Instance 174a0067-ee9a-493e-a1d9-099fdf4bbaec could not be found. Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-44fda554-679e-47a4-a40f-f26e2123a6d4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Request method failure captured: Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec HTTP/1.1 Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MGsLDoyOzgLRg2BX3cvVr1GpblgGW8O2WZA94rA_-vM2oer1r5NZgrD18DqsaiVcPResWG2UVj4mChLB4EtXep3gtu_ICdVBF9LtGrAHf1gzev_w_kLLd8d2TQ4t5azuzu6V-mwogR1J5wvkWYNqwUx2r74hRfwqTpAIJFQIsZIP1g Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: X-Openstack-Nova-Api-Version: 2.25 Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 9d0f5bbde58545fb9ccd1c2eb842ed49 Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-905351447 Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9d0f5bbde58545fb9ccd1c2eb842ed49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9d0f5bbde58545fb9ccd1c2eb842ed49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9d0f5bbde58545fb9ccd1c2eb842ed49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9d0f5bbde58545fb9ccd1c2eb842ed49"}]}] Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-905351447 Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 9d0f5bbde58545fb9ccd1c2eb842ed49 Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-905351447 Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-LiveAutoBlockMigrationV225Test-905351447-project Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 575dd6743cff44678749d452329355d1 Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-905351447-project Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 174a0067-ee9a-493e-a1d9-099fdf4bbaec could not be found. Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '174a0067-ee9a-493e-a1d9-099fdf4bbaec'} Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 174a0067-ee9a-493e-a1d9-099fdf4bbaec could not be found. Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 174a0067-ee9a-493e-a1d9-099fdf4bbaec could not be found. Jul 18 02:22:55.872273 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:22:55.882884 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:22:55.882884 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:22:55.882884 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:55.882884 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:22:55.882884 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:22:55.882884 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:22:55.882884 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:22:55.882884 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 174a0067-ee9a-493e-a1d9-099fdf4bbaec could not be found. Jul 18 02:22:55.882884 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:22:55.882884 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-44fda554-679e-47a4-a40f-f26e2123a6d4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Returning 404 to user: Instance 174a0067-ee9a-493e-a1d9-099fdf4bbaec could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:22:55.882884 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-44fda554-679e-47a4-a40f-f26e2123a6d4 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec" status: 404 len: 111 microversion: 2.25 time: 0.093791 Jul 18 02:22:55.882884 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1215/2477] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:55 2022] GET /compute/v2.1/servers/174a0067-ee9a-493e-a1d9-099fdf4bbaec => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:22:55.894684 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-54ae29b8-e2dd-44a9-9197-455806219222 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '.version_select at 0x7ff4a8b1d5e0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:55.958819 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-54ae29b8-e2dd-44a9-9197-455806219222 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1707145596" status: 204 len: 0 microversion: 2.25 time: 0.070945 Jul 18 02:22:55.960005 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1263/2478] 10.222.0.57 () {60 vars in 1261 bytes} [Mon Jul 18 02:22:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1707145596 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:22:56.833733 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-68e1b8a0-6cbd-4ab9-9c7a-314c66616958 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:56.834449 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-68e1b8a0-6cbd-4ab9-9c7a-314c66616958 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:56.851600 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c1e27aa7-6144-4995-92c3-0aef9002f2ea tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:56.857195 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c1e27aa7-6144-4995-92c3-0aef9002f2ea tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:56.887037 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-68e1b8a0-6cbd-4ab9-9c7a-314c66616958 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:56.887846 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-68e1b8a0-6cbd-4ab9-9c7a-314c66616958 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:56.898366 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-68e1b8a0-6cbd-4ab9-9c7a-314c66616958 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:56.902240 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-68e1b8a0-6cbd-4ab9-9c7a-314c66616958 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:56.923000 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c1e27aa7-6144-4995-92c3-0aef9002f2ea tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:56.931435 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c1e27aa7-6144-4995-92c3-0aef9002f2ea tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:56.933399 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c1e27aa7-6144-4995-92c3-0aef9002f2ea tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:56.935795 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c1e27aa7-6144-4995-92c3-0aef9002f2ea tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:57.729669 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:22:57.749956 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:22:57.755670 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-68e1b8a0-6cbd-4ab9-9c7a-314c66616958 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:57.765102 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-68e1b8a0-6cbd-4ab9-9c7a-314c66616958 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc" status: 200 len: 1315 microversion: 2.1 time: 0.963705 Jul 18 02:22:57.766099 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1264/2479] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:56 2022] GET /compute/v2.1/servers/6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc => generated 1315 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:57.975274 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c1e27aa7-6144-4995-92c3-0aef9002f2ea tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:57.992963 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c1e27aa7-6144-4995-92c3-0aef9002f2ea tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1313 microversion: 2.1 time: 1.187313 Jul 18 02:22:57.994310 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1216/2480] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:56 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1313 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:58.083185 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-1b7c1f30-d050-45b9-9b6e-6559145805f6 req-59f0573a-b841-4a2d-ab69-c7e0c37c2de0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc", "tag": "4d36d36e-f101-43f3-b0c2-de0016f5a306"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:22:58.107742 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-1b7c1f30-d050-45b9-9b6e-6559145805f6 req-59f0573a-b841-4a2d-ab69-c7e0c37c2de0 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:58.108224 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-1b7c1f30-d050-45b9-9b6e-6559145805f6 req-59f0573a-b841-4a2d-ab69-c7e0c37c2de0 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:58.154118 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-1b7c1f30-d050-45b9-9b6e-6559145805f6 req-59f0573a-b841-4a2d-ab69-c7e0c37c2de0 service nova] Creating event network-changed:4d36d36e-f101-43f3-b0c2-de0016f5a306 for instance 6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc on n-h2-465891-3 Jul 18 02:22:58.163084 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-1b7c1f30-d050-45b9-9b6e-6559145805f6 req-59f0573a-b841-4a2d-ab69-c7e0c37c2de0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084519 Jul 18 02:22:58.163949 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1265/2481] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:22:58.785154 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3d46680b-ee92-4ef6-a333-69ccbaacb089 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:58.786541 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3d46680b-ee92-4ef6-a333-69ccbaacb089 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:58.813598 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3d46680b-ee92-4ef6-a333-69ccbaacb089 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:58.814228 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3d46680b-ee92-4ef6-a333-69ccbaacb089 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:58.815247 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3d46680b-ee92-4ef6-a333-69ccbaacb089 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:58.815699 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3d46680b-ee92-4ef6-a333-69ccbaacb089 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:59.023104 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-028cdc95-b225-4e78-8052-714ab0bb750e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:59.023827 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-028cdc95-b225-4e78-8052-714ab0bb750e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:59.035050 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-028cdc95-b225-4e78-8052-714ab0bb750e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:59.035822 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-028cdc95-b225-4e78-8052-714ab0bb750e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:59.036975 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-028cdc95-b225-4e78-8052-714ab0bb750e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:59.043681 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-028cdc95-b225-4e78-8052-714ab0bb750e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:59.897052 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3d46680b-ee92-4ef6-a333-69ccbaacb089 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:59.916808 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3d46680b-ee92-4ef6-a333-69ccbaacb089 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc" status: 200 len: 1315 microversion: 2.1 time: 1.137044 Jul 18 02:22:59.917815 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1217/2482] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:58 2022] GET /compute/v2.1/servers/6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc => generated 1315 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:59.924136 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e492de81-8905-4341-8fe0-5df69721fb8d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:59.925236 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e492de81-8905-4341-8fe0-5df69721fb8d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2b4a452c-dd09-4dd6-ab90-bd7d584343e5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:59.927918 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=30 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:22:59.937910 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e492de81-8905-4341-8fe0-5df69721fb8d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:59.938996 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e492de81-8905-4341-8fe0-5df69721fb8d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:59.941217 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e492de81-8905-4341-8fe0-5df69721fb8d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:59.943105 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e492de81-8905-4341-8fe0-5df69721fb8d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:59.987223 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e492de81-8905-4341-8fe0-5df69721fb8d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2b4a452c-dd09-4dd6-ab90-bd7d584343e5] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:23:00.097428 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:23:00.180881 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e492de81-8905-4341-8fe0-5df69721fb8d tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5" status: 204 len: 0 microversion: 2.25 time: 0.261509 Jul 18 02:23:00.184112 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1218/2483] 10.222.0.57 () {60 vars in 1279 bytes} [Mon Jul 18 02:22:59 2022] DELETE /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:23:00.197855 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-f01294d5-746f-4b4b-ad3c-d3f06b19dd2e req-50854d54-ce98-4694-88c9-60984e2c202e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67029c55-03b9-4f19-bf3d-b54f1998ebae", "name": "network-vif-plugged", "status": "completed", "tag": "35c7791f-4eef-441a-884d-d3eed4376b4f"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:00.212518 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-f01294d5-746f-4b4b-ad3c-d3f06b19dd2e req-50854d54-ce98-4694-88c9-60984e2c202e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:00.213325 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-f01294d5-746f-4b4b-ad3c-d3f06b19dd2e req-50854d54-ce98-4694-88c9-60984e2c202e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:00.234442 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-f01294d5-746f-4b4b-ad3c-d3f06b19dd2e req-50854d54-ce98-4694-88c9-60984e2c202e service nova] Creating event network-vif-plugged:35c7791f-4eef-441a-884d-d3eed4376b4f for instance 67029c55-03b9-4f19-bf3d-b54f1998ebae on n-h1-465891-3 Jul 18 02:23:00.241334 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-f01294d5-746f-4b4b-ad3c-d3f06b19dd2e req-50854d54-ce98-4694-88c9-60984e2c202e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054173 Jul 18 02:23:00.242693 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1219/2484] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:23:00.249546 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9d603557-e189-4bcd-a7f5-6302cabba2e3 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:00.250727 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9d603557-e189-4bcd-a7f5-6302cabba2e3 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2b4a452c-dd09-4dd6-ab90-bd7d584343e5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:00.259099 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9d603557-e189-4bcd-a7f5-6302cabba2e3 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:00.259939 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9d603557-e189-4bcd-a7f5-6302cabba2e3 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:00.261548 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9d603557-e189-4bcd-a7f5-6302cabba2e3 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:00.262299 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9d603557-e189-4bcd-a7f5-6302cabba2e3 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:00.635857 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-028cdc95-b225-4e78-8052-714ab0bb750e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:00.683292 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-028cdc95-b225-4e78-8052-714ab0bb750e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1313 microversion: 2.1 time: 1.664631 Jul 18 02:23:00.688683 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1266/2485] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:59 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1313 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:00.775407 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9d603557-e189-4bcd-a7f5-6302cabba2e3 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:00.792829 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9d603557-e189-4bcd-a7f5-6302cabba2e3 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:00.797157 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9d603557-e189-4bcd-a7f5-6302cabba2e3 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:00.804403 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9d603557-e189-4bcd-a7f5-6302cabba2e3 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5" status: 200 len: 1549 microversion: 2.25 time: 0.558156 Jul 18 02:23:00.812642 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1220/2486] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:23:00 2022] GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5 => generated 1549 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:23:00.936067 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7088201d-59d9-4949-bb9e-9463021ea3c6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:00.938286 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7088201d-59d9-4949-bb9e-9463021ea3c6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:00.947002 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7088201d-59d9-4949-bb9e-9463021ea3c6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:00.948432 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7088201d-59d9-4949-bb9e-9463021ea3c6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:00.949507 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7088201d-59d9-4949-bb9e-9463021ea3c6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:00.950916 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7088201d-59d9-4949-bb9e-9463021ea3c6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:01.725740 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0615874e-13b7-416d-8784-e6e678f2c7b8 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:01.728810 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0615874e-13b7-416d-8784-e6e678f2c7b8 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:01.770842 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0615874e-13b7-416d-8784-e6e678f2c7b8 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:01.772541 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0615874e-13b7-416d-8784-e6e678f2c7b8 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:01.775256 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0615874e-13b7-416d-8784-e6e678f2c7b8 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:01.776224 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0615874e-13b7-416d-8784-e6e678f2c7b8 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:01.948788 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7088201d-59d9-4949-bb9e-9463021ea3c6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:02.007285 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7088201d-59d9-4949-bb9e-9463021ea3c6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc" status: 200 len: 1315 microversion: 2.1 time: 1.074434 Jul 18 02:23:02.026188 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1267/2487] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:00 2022] GET /compute/v2.1/servers/6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc => generated 1315 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:02.044993 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3fb40c61-1c2a-4bee-9b10-65908d1297b2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:02.053982 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3fb40c61-1c2a-4bee-9b10-65908d1297b2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2b4a452c-dd09-4dd6-ab90-bd7d584343e5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:02.103722 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3fb40c61-1c2a-4bee-9b10-65908d1297b2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:02.104517 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3fb40c61-1c2a-4bee-9b10-65908d1297b2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:02.107730 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3fb40c61-1c2a-4bee-9b10-65908d1297b2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:02.108898 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3fb40c61-1c2a-4bee-9b10-65908d1297b2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:02.869941 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0615874e-13b7-416d-8784-e6e678f2c7b8 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:02.902910 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0615874e-13b7-416d-8784-e6e678f2c7b8 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1313 microversion: 2.1 time: 1.198910 Jul 18 02:23:02.909334 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1221/2488] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:01 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1313 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:03.056567 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-35861c3a-7e6b-4485-9fcc-1dafbc5ef9b0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:03.057507 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-35861c3a-7e6b-4485-9fcc-1dafbc5ef9b0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:03.078527 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-35861c3a-7e6b-4485-9fcc-1dafbc5ef9b0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:03.084527 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-35861c3a-7e6b-4485-9fcc-1dafbc5ef9b0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:03.086151 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-35861c3a-7e6b-4485-9fcc-1dafbc5ef9b0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:03.089655 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-35861c3a-7e6b-4485-9fcc-1dafbc5ef9b0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:03.792095 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3fb40c61-1c2a-4bee-9b10-65908d1297b2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:03.858203 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3fb40c61-1c2a-4bee-9b10-65908d1297b2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:03.875298 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3fb40c61-1c2a-4bee-9b10-65908d1297b2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:03.879789 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3fb40c61-1c2a-4bee-9b10-65908d1297b2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5" status: 200 len: 1549 microversion: 2.25 time: 1.851189 Jul 18 02:23:03.886414 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1268/2489] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:23:02 2022] GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5 => generated 1549 bytes in 1859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:23:03.933339 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f62c64ae-df83-467c-9994-3d6a00c96051 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:03.934185 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f62c64ae-df83-467c-9994-3d6a00c96051 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:03.946774 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f62c64ae-df83-467c-9994-3d6a00c96051 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:03.947652 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f62c64ae-df83-467c-9994-3d6a00c96051 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:03.948594 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f62c64ae-df83-467c-9994-3d6a00c96051 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:03.949152 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f62c64ae-df83-467c-9994-3d6a00c96051 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:04.652920 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-35861c3a-7e6b-4485-9fcc-1dafbc5ef9b0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:04.664872 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-35861c3a-7e6b-4485-9fcc-1dafbc5ef9b0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc" status: 200 len: 1315 microversion: 2.1 time: 1.615141 Jul 18 02:23:04.675763 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1222/2490] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:03 2022] GET /compute/v2.1/servers/6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc => generated 1315 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:04.916162 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5ba4e469-b0fe-43a5-ae0c-619171b63ad2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:04.917356 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5ba4e469-b0fe-43a5-ae0c-619171b63ad2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2b4a452c-dd09-4dd6-ab90-bd7d584343e5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:04.947608 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ba4e469-b0fe-43a5-ae0c-619171b63ad2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:04.948375 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ba4e469-b0fe-43a5-ae0c-619171b63ad2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:04.951155 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ba4e469-b0fe-43a5-ae0c-619171b63ad2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:04.952346 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ba4e469-b0fe-43a5-ae0c-619171b63ad2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:05.384192 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f62c64ae-df83-467c-9994-3d6a00c96051 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:05.404607 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f62c64ae-df83-467c-9994-3d6a00c96051 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1462 microversion: 2.1 time: 1.468206 Jul 18 02:23:05.417177 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1269/2491] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:03 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1462 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:23:06.089896 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5ba4e469-b0fe-43a5-ae0c-619171b63ad2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:06.106537 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5ba4e469-b0fe-43a5-ae0c-619171b63ad2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:06.113181 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5ba4e469-b0fe-43a5-ae0c-619171b63ad2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:06.117809 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5ba4e469-b0fe-43a5-ae0c-619171b63ad2 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5" status: 200 len: 1549 microversion: 2.25 time: 1.207174 Jul 18 02:23:06.119319 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1223/2492] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:23:04 2022] GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5 => generated 1549 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:23:06.130271 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bb208988-9c27-41aa-a435-bb2438ea6d90 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:06.134834 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bb208988-9c27-41aa-a435-bb2438ea6d90 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:06.147287 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8fc58785-c2db-43ec-b225-710526ddce54 tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:06.148618 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8fc58785-c2db-43ec-b225-710526ddce54 tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:06.153672 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:23:06.187243 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8fc58785-c2db-43ec-b225-710526ddce54 tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:06.188219 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8fc58785-c2db-43ec-b225-710526ddce54 tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:06.193743 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8fc58785-c2db-43ec-b225-710526ddce54 tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:06.195071 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8fc58785-c2db-43ec-b225-710526ddce54 tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:06.200446 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb208988-9c27-41aa-a435-bb2438ea6d90 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:06.201321 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb208988-9c27-41aa-a435-bb2438ea6d90 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:06.202475 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb208988-9c27-41aa-a435-bb2438ea6d90 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:06.203350 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb208988-9c27-41aa-a435-bb2438ea6d90 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:07.300233 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bb208988-9c27-41aa-a435-bb2438ea6d90 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:07.310890 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bb208988-9c27-41aa-a435-bb2438ea6d90 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc" status: 200 len: 1315 microversion: 2.1 time: 1.187502 Jul 18 02:23:07.312430 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1224/2493] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:06 2022] GET /compute/v2.1/servers/6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc => generated 1315 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:07.330609 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-82810d8c-0547-4029-a35c-4b6e1b96b7e7 req-66facafb-8e7d-4f5c-afd7-8e70169a7983 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b4a452c-dd09-4dd6-ab90-bd7d584343e5", "name": "network-vif-deleted", "tag": "a4f23488-d99c-41fb-8662-75c98bd2a84e"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:07.344312 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-82810d8c-0547-4029-a35c-4b6e1b96b7e7 req-66facafb-8e7d-4f5c-afd7-8e70169a7983 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:07.345107 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-82810d8c-0547-4029-a35c-4b6e1b96b7e7 req-66facafb-8e7d-4f5c-afd7-8e70169a7983 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:07.363922 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-82810d8c-0547-4029-a35c-4b6e1b96b7e7 req-66facafb-8e7d-4f5c-afd7-8e70169a7983 service nova] Creating event network-vif-deleted:a4f23488-d99c-41fb-8662-75c98bd2a84e for instance 2b4a452c-dd09-4dd6-ab90-bd7d584343e5 on n-h2-465891-3 Jul 18 02:23:07.372489 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-82810d8c-0547-4029-a35c-4b6e1b96b7e7 req-66facafb-8e7d-4f5c-afd7-8e70169a7983 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047382 Jul 18 02:23:07.374166 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1225/2494] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:23:07.382303 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-16b7664b-0d53-4e4a-835e-01a288f2f9c9 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:07.383511 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-16b7664b-0d53-4e4a-835e-01a288f2f9c9 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 2b4a452c-dd09-4dd6-ab90-bd7d584343e5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:07.393716 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-16b7664b-0d53-4e4a-835e-01a288f2f9c9 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:07.395341 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-16b7664b-0d53-4e4a-835e-01a288f2f9c9 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:07.396560 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-16b7664b-0d53-4e4a-835e-01a288f2f9c9 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:07.397312 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-16b7664b-0d53-4e4a-835e-01a288f2f9c9 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:07.417468 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-16b7664b-0d53-4e4a-835e-01a288f2f9c9 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] HTTP exception thrown: Instance 2b4a452c-dd09-4dd6-ab90-bd7d584343e5 could not be found. Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-16b7664b-0d53-4e4a-835e-01a288f2f9c9 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Request method failure captured: Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5 HTTP/1.1 Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MGsLDoyOzgLRg2BX3cvVr1GpblgGW8O2WZA94rA_-vM2oer1r5NZgrD18DqsaiVcPResWG2UVj4mChLB4EtXep3gtu_ICdVBF9LtGrAHf1gzev_w_kLLd8d2TQ4t5azuzu6V-mwogR1J5wvkWYNqwUx2r74hRfwqTpAIJFQIsZIP1g Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: X-Openstack-Nova-Api-Version: 2.25 Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 9d0f5bbde58545fb9ccd1c2eb842ed49 Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-905351447 Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9d0f5bbde58545fb9ccd1c2eb842ed49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9d0f5bbde58545fb9ccd1c2eb842ed49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9d0f5bbde58545fb9ccd1c2eb842ed49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9d0f5bbde58545fb9ccd1c2eb842ed49"}]}] Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-905351447 Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 9d0f5bbde58545fb9ccd1c2eb842ed49 Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-905351447 Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-LiveAutoBlockMigrationV225Test-905351447-project Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 575dd6743cff44678749d452329355d1 Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-905351447-project Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 2b4a452c-dd09-4dd6-ab90-bd7d584343e5 could not be found. Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '2b4a452c-dd09-4dd6-ab90-bd7d584343e5'} Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b4a452c-dd09-4dd6-ab90-bd7d584343e5 could not be found. Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b4a452c-dd09-4dd6-ab90-bd7d584343e5 could not be found. Jul 18 02:23:07.419751 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:23:07.424947 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:23:07.424947 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:23:07.424947 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:23:07.424947 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:23:07.424947 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:23:07.424947 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:23:07.424947 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:23:07.424947 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b4a452c-dd09-4dd6-ab90-bd7d584343e5 could not be found. Jul 18 02:23:07.424947 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:23:07.427906 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-16b7664b-0d53-4e4a-835e-01a288f2f9c9 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Returning 404 to user: Instance 2b4a452c-dd09-4dd6-ab90-bd7d584343e5 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:23:07.428999 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-16b7664b-0d53-4e4a-835e-01a288f2f9c9 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5" status: 404 len: 111 microversion: 2.25 time: 0.052961 Jul 18 02:23:07.430133 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1226/2495] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:23:07 2022] GET /compute/v2.1/servers/2b4a452c-dd09-4dd6-ab90-bd7d584343e5 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:23:07.439101 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0b5a5862-8943-437f-8ba6-f8285c17f223 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:07.439886 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0b5a5862-8943-437f-8ba6-f8285c17f223 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 49764b86-41da-4c6d-b069-aaccf92ef89f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:07.450645 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0b5a5862-8943-437f-8ba6-f8285c17f223 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:07.451605 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0b5a5862-8943-437f-8ba6-f8285c17f223 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:07.452869 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0b5a5862-8943-437f-8ba6-f8285c17f223 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:07.453554 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0b5a5862-8943-437f-8ba6-f8285c17f223 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:07.550216 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0b5a5862-8943-437f-8ba6-f8285c17f223 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 49764b86-41da-4c6d-b069-aaccf92ef89f] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:23:07.854337 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0b5a5862-8943-437f-8ba6-f8285c17f223 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "DELETE /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f" status: 204 len: 0 microversion: 2.25 time: 0.419085 Jul 18 02:23:07.855427 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1227/2496] 10.222.0.57 () {60 vars in 1279 bytes} [Mon Jul 18 02:23:07 2022] DELETE /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:23:07.874833 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-83232be4-882a-4fda-a9f8-7deec84d49ad req-f2f6b63d-2c0a-4aef-b930-39c6675a2efa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc", "name": "network-vif-plugged", "status": "completed", "tag": "4d36d36e-f101-43f3-b0c2-de0016f5a306"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:07.892503 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-83232be4-882a-4fda-a9f8-7deec84d49ad req-f2f6b63d-2c0a-4aef-b930-39c6675a2efa service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:07.893785 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-83232be4-882a-4fda-a9f8-7deec84d49ad req-f2f6b63d-2c0a-4aef-b930-39c6675a2efa service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:07.930636 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-83232be4-882a-4fda-a9f8-7deec84d49ad req-f2f6b63d-2c0a-4aef-b930-39c6675a2efa service nova] Creating event network-vif-plugged:4d36d36e-f101-43f3-b0c2-de0016f5a306 for instance 6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc on n-h2-465891-3 Jul 18 02:23:07.943008 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-83232be4-882a-4fda-a9f8-7deec84d49ad req-f2f6b63d-2c0a-4aef-b930-39c6675a2efa service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076030 Jul 18 02:23:07.945412 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1228/2497] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:23:07.973587 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4aaebeff-7601-47fb-b1ca-839542c7ef1b tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:07.975852 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4aaebeff-7601-47fb-b1ca-839542c7ef1b tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 49764b86-41da-4c6d-b069-aaccf92ef89f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:08.004505 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4aaebeff-7601-47fb-b1ca-839542c7ef1b tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:08.006207 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4aaebeff-7601-47fb-b1ca-839542c7ef1b tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:08.008174 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4aaebeff-7601-47fb-b1ca-839542c7ef1b tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:08.009583 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4aaebeff-7601-47fb-b1ca-839542c7ef1b tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:08.408791 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8fc58785-c2db-43ec-b225-710526ddce54 tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1613 microversion: 2.1 time: 2.983922 Jul 18 02:23:08.412702 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1270/2498] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:05 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1613 bytes in 2989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:08.420257 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-16f7ba21-f4bb-4bbf-a889-8aec1cb5987a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:08.421593 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-16f7ba21-f4bb-4bbf-a889-8aec1cb5987a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:08.430753 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:23:08.433562 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-16f7ba21-f4bb-4bbf-a889-8aec1cb5987a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:08.434459 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-16f7ba21-f4bb-4bbf-a889-8aec1cb5987a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:08.435982 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-16f7ba21-f4bb-4bbf-a889-8aec1cb5987a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:08.437597 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-16f7ba21-f4bb-4bbf-a889-8aec1cb5987a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:08.762889 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4aaebeff-7601-47fb-b1ca-839542c7ef1b tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:08.782651 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4aaebeff-7601-47fb-b1ca-839542c7ef1b tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:08.787156 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4aaebeff-7601-47fb-b1ca-839542c7ef1b tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:08.794256 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4aaebeff-7601-47fb-b1ca-839542c7ef1b tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f" status: 200 len: 1563 microversion: 2.25 time: 0.846077 Jul 18 02:23:08.794926 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1229/2499] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:23:07 2022] GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f => generated 1563 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:23:08.817930 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5b5d3365-da82-4d54-b8c8-e0a5511982bf tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:08.817930 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5b5d3365-da82-4d54-b8c8-e0a5511982bf tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:08.820642 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5b5d3365-da82-4d54-b8c8-e0a5511982bf tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:08.829593 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5b5d3365-da82-4d54-b8c8-e0a5511982bf tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:08.830792 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5b5d3365-da82-4d54-b8c8-e0a5511982bf tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:08.831656 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5b5d3365-da82-4d54-b8c8-e0a5511982bf tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:08.903616 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5b5d3365-da82-4d54-b8c8-e0a5511982bf tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '5692e834e08345d7bddfadf56cb41bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c892a656afce454db6453aa4a64176d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:08.904651 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5b5d3365-da82-4d54-b8c8-e0a5511982bf tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] flavor_id is None. Assuming migration. {{(pid=119544) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 18 02:23:08.905274 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5b5d3365-da82-4d54-b8c8-e0a5511982bf tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119544) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 02:23:09.904487 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-16f7ba21-f4bb-4bbf-a889-8aec1cb5987a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:09.920404 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-16f7ba21-f4bb-4bbf-a889-8aec1cb5987a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc" status: 200 len: 1315 microversion: 2.1 time: 1.505742 Jul 18 02:23:09.946277 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1271/2500] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:08 2022] GET /compute/v2.1/servers/6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc => generated 1315 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:09.964085 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-de46a0e4-def7-475a-8959-4d0d287484ae tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:09.966102 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-de46a0e4-def7-475a-8959-4d0d287484ae tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 49764b86-41da-4c6d-b069-aaccf92ef89f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:10.004744 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-de46a0e4-def7-475a-8959-4d0d287484ae tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:10.007176 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-de46a0e4-def7-475a-8959-4d0d287484ae tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:10.008327 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-de46a0e4-def7-475a-8959-4d0d287484ae tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:10.011904 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-de46a0e4-def7-475a-8959-4d0d287484ae tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:10.624252 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5b5d3365-da82-4d54-b8c8-e0a5511982bf tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae/action" status: 202 len: 0 microversion: 2.1 time: 1.827838 Jul 18 02:23:10.637137 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1230/2501] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:23:08 2022] POST /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae/action => generated 0 bytes in 1841 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:23:10.661108 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6ad92d74-4239-4370-84cf-1a5f122b44ad tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:10.661871 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6ad92d74-4239-4370-84cf-1a5f122b44ad tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:10.687283 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6ad92d74-4239-4370-84cf-1a5f122b44ad tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:10.687737 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6ad92d74-4239-4370-84cf-1a5f122b44ad tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:10.697678 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6ad92d74-4239-4370-84cf-1a5f122b44ad tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:10.699436 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6ad92d74-4239-4370-84cf-1a5f122b44ad tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:10.944110 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-de46a0e4-def7-475a-8959-4d0d287484ae tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:10.961656 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-de46a0e4-def7-475a-8959-4d0d287484ae tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:10.963290 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-de46a0e4-def7-475a-8959-4d0d287484ae tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '575dd6743cff44678749d452329355d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f5bbde58545fb9ccd1c2eb842ed49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:10.974219 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-de46a0e4-def7-475a-8959-4d0d287484ae tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f" status: 200 len: 1563 microversion: 2.25 time: 1.016565 Jul 18 02:23:10.975420 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1272/2502] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:23:09 2022] GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f => generated 1563 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:23:11.010427 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-36211244-83b0-4904-8586-82703c065515 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:11.011553 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-36211244-83b0-4904-8586-82703c065515 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:11.027434 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-36211244-83b0-4904-8586-82703c065515 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:11.028260 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-36211244-83b0-4904-8586-82703c065515 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:11.029278 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-36211244-83b0-4904-8586-82703c065515 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:11.029947 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-36211244-83b0-4904-8586-82703c065515 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:11.678606 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6ad92d74-4239-4370-84cf-1a5f122b44ad tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:11.714615 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6ad92d74-4239-4370-84cf-1a5f122b44ad tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1471 microversion: 2.1 time: 1.070269 Jul 18 02:23:11.722007 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1231/2503] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:10 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1471 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:11.750192 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-72560877-4b5f-4dcb-ad76-ea98877e14f8 req-732b6fb6-9724-4934-bacc-0dc2f23f04b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49764b86-41da-4c6d-b069-aaccf92ef89f", "name": "network-vif-deleted", "tag": "91c20a21-2cb0-48df-99d9-8ab9275d0bc8"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:11.763473 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-72560877-4b5f-4dcb-ad76-ea98877e14f8 req-732b6fb6-9724-4934-bacc-0dc2f23f04b6 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:11.764905 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-72560877-4b5f-4dcb-ad76-ea98877e14f8 req-732b6fb6-9724-4934-bacc-0dc2f23f04b6 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:11.786685 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-72560877-4b5f-4dcb-ad76-ea98877e14f8 req-732b6fb6-9724-4934-bacc-0dc2f23f04b6 service nova] Creating event network-vif-deleted:91c20a21-2cb0-48df-99d9-8ab9275d0bc8 for instance 49764b86-41da-4c6d-b069-aaccf92ef89f on n-h1-465891-3 Jul 18 02:23:11.795379 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-72560877-4b5f-4dcb-ad76-ea98877e14f8 req-732b6fb6-9724-4934-bacc-0dc2f23f04b6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067294 Jul 18 02:23:11.797574 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1232/2504] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:23:11.828876 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-36211244-83b0-4904-8586-82703c065515 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:11.846242 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-36211244-83b0-4904-8586-82703c065515 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc" status: 200 len: 1502 microversion: 2.1 time: 0.866104 Jul 18 02:23:11.849435 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1273/2505] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:10 2022] GET /compute/v2.1/servers/6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc => generated 1502 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:11.867415 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9768a966-9d0a-46e7-bb2d-8bcebbb8f864 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:11.868184 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9768a966-9d0a-46e7-bb2d-8bcebbb8f864 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:11.885136 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9768a966-9d0a-46e7-bb2d-8bcebbb8f864 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:11.886663 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9768a966-9d0a-46e7-bb2d-8bcebbb8f864 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:11.890356 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9768a966-9d0a-46e7-bb2d-8bcebbb8f864 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:11.891781 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9768a966-9d0a-46e7-bb2d-8bcebbb8f864 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:11.968876 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9768a966-9d0a-46e7-bb2d-8bcebbb8f864 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:23:12.009321 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-550f3bbf-ca5d-4c2e-8893-51a86a2a6306 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:12.010157 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-550f3bbf-ca5d-4c2e-8893-51a86a2a6306 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] [instance: 49764b86-41da-4c6d-b069-aaccf92ef89f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:12.056733 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-550f3bbf-ca5d-4c2e-8893-51a86a2a6306 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:12.060186 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-550f3bbf-ca5d-4c2e-8893-51a86a2a6306 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:12.062194 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-550f3bbf-ca5d-4c2e-8893-51a86a2a6306 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:12.064779 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-550f3bbf-ca5d-4c2e-8893-51a86a2a6306 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:12.129607 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-550f3bbf-ca5d-4c2e-8893-51a86a2a6306 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] HTTP exception thrown: Instance 49764b86-41da-4c6d-b069-aaccf92ef89f could not be found. Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-550f3bbf-ca5d-4c2e-8893-51a86a2a6306 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Request method failure captured: Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f HTTP/1.1 Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MGsLDoyOzgLRg2BX3cvVr1GpblgGW8O2WZA94rA_-vM2oer1r5NZgrD18DqsaiVcPResWG2UVj4mChLB4EtXep3gtu_ICdVBF9LtGrAHf1gzev_w_kLLd8d2TQ4t5azuzu6V-mwogR1J5wvkWYNqwUx2r74hRfwqTpAIJFQIsZIP1g Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: X-Openstack-Nova-Api-Version: 2.25 Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 9d0f5bbde58545fb9ccd1c2eb842ed49 Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-905351447 Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9d0f5bbde58545fb9ccd1c2eb842ed49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9d0f5bbde58545fb9ccd1c2eb842ed49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9d0f5bbde58545fb9ccd1c2eb842ed49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9d0f5bbde58545fb9ccd1c2eb842ed49"}]}] Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-905351447 Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 9d0f5bbde58545fb9ccd1c2eb842ed49 Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-905351447 Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-LiveAutoBlockMigrationV225Test-905351447-project Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 575dd6743cff44678749d452329355d1 Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-905351447-project Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 49764b86-41da-4c6d-b069-aaccf92ef89f could not be found. Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '49764b86-41da-4c6d-b069-aaccf92ef89f'} Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49764b86-41da-4c6d-b069-aaccf92ef89f could not be found. Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49764b86-41da-4c6d-b069-aaccf92ef89f could not be found. Jul 18 02:23:12.137143 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:23:12.152579 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:23:12.152579 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:23:12.152579 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:23:12.152579 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:23:12.152579 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:23:12.152579 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:23:12.152579 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:23:12.152579 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49764b86-41da-4c6d-b069-aaccf92ef89f could not be found. Jul 18 02:23:12.152579 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:23:12.171779 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:23:12.198523 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-550f3bbf-ca5d-4c2e-8893-51a86a2a6306 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] Returning 404 to user: Instance 49764b86-41da-4c6d-b069-aaccf92ef89f could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:23:12.200745 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-550f3bbf-ca5d-4c2e-8893-51a86a2a6306 tempest-LiveAutoBlockMigrationV225Test-905351447 tempest-LiveAutoBlockMigrationV225Test-905351447-project] 10.222.0.57 "GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f" status: 404 len: 111 microversion: 2.25 time: 0.198308 Jul 18 02:23:12.205602 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1274/2506] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:23:12 2022] GET /compute/v2.1/servers/49764b86-41da-4c6d-b069-aaccf92ef89f => generated 111 bytes in 204 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 18 02:23:12.258814 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9768a966-9d0a-46e7-bb2d-8bcebbb8f864 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "DELETE /compute/v2.1/servers/6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc" status: 204 len: 0 microversion: 2.1 time: 0.396803 Jul 18 02:23:12.266061 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1233/2507] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:23:11 2022] DELETE /compute/v2.1/servers/6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:23:12.280987 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b285f155-02b7-4a66-8429-ad78eccabdf6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:12.282497 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b285f155-02b7-4a66-8429-ad78eccabdf6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:12.343443 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b285f155-02b7-4a66-8429-ad78eccabdf6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:12.344245 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b285f155-02b7-4a66-8429-ad78eccabdf6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:12.345623 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b285f155-02b7-4a66-8429-ad78eccabdf6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:12.349787 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b285f155-02b7-4a66-8429-ad78eccabdf6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:12.744503 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d88eed83-296e-411c-9424-911957e21d0d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:12.749553 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d88eed83-296e-411c-9424-911957e21d0d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:12.787617 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d88eed83-296e-411c-9424-911957e21d0d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:12.788783 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d88eed83-296e-411c-9424-911957e21d0d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:12.790502 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d88eed83-296e-411c-9424-911957e21d0d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:12.791484 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d88eed83-296e-411c-9424-911957e21d0d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:13.527004 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b285f155-02b7-4a66-8429-ad78eccabdf6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:13.582644 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b285f155-02b7-4a66-8429-ad78eccabdf6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc" status: 200 len: 1508 microversion: 2.1 time: 1.308181 Jul 18 02:23:13.586725 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1275/2508] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:12 2022] GET /compute/v2.1/servers/6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc => generated 1508 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:13.758308 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1cb23bb5-7d0b-46ed-a253-8e7da00c2a11 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Action: 'create', calling method: .version_select at 0x7ff49bab3790>, body: {"keypair": {"name": "tempest-keypair-654047918", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbnFE1QlSEsxa0/DTYZ6Hm43SgaGbha20mdWBTFdh/3unIKT5r/oczx9NbZXgaZx1GL+wEGFHV7ojCgAWNV897YadSLp+WTjvM5LujfD9DDt2bWAqDBiKBBwDUTWOKb4g=="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:13.779567 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-1cb23bb5-7d0b-46ed-a253-8e7da00c2a11 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Getting quotas for project 2d788b28fd2c4cf1826d908059f04c4a. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:23:13.789174 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-1cb23bb5-7d0b-46ed-a253-8e7da00c2a11 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Getting quotas for user b9b89b2c768847589c4d41aba88208a4 and project 2d788b28fd2c4cf1826d908059f04c4a. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:23:13.815143 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d88eed83-296e-411c-9424-911957e21d0d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:13.826109 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d88eed83-296e-411c-9424-911957e21d0d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1471 microversion: 2.1 time: 1.089303 Jul 18 02:23:13.826882 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1234/2509] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:12 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1471 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:13.830009 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1cb23bb5-7d0b-46ed-a253-8e7da00c2a11 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.159576 Jul 18 02:23:13.831042 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1276/2510] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 02:23:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:23:14.602630 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fbf1a3be-5e51-4855-828f-f670f97f6b6a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:14.604687 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fbf1a3be-5e51-4855-828f-f670f97f6b6a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:14.623808 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fbf1a3be-5e51-4855-828f-f670f97f6b6a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:14.624271 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fbf1a3be-5e51-4855-828f-f670f97f6b6a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:14.625638 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fbf1a3be-5e51-4855-828f-f670f97f6b6a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:14.626456 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fbf1a3be-5e51-4855-828f-f670f97f6b6a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:14.854862 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c04a44f3-c6a6-4ede-8440-f0fbac03a044 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:14.855712 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c04a44f3-c6a6-4ede-8440-f0fbac03a044 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:14.877186 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c04a44f3-c6a6-4ede-8440-f0fbac03a044 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:14.883028 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c04a44f3-c6a6-4ede-8440-f0fbac03a044 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:14.887130 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c04a44f3-c6a6-4ede-8440-f0fbac03a044 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:14.889876 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c04a44f3-c6a6-4ede-8440-f0fbac03a044 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:16.252143 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fbf1a3be-5e51-4855-828f-f670f97f6b6a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:16.308783 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fbf1a3be-5e51-4855-828f-f670f97f6b6a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc" status: 200 len: 1508 microversion: 2.1 time: 1.711006 Jul 18 02:23:16.311612 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1235/2511] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:14 2022] GET /compute/v2.1/servers/6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc => generated 1508 bytes in 1715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:16.418883 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c04a44f3-c6a6-4ede-8440-f0fbac03a044 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:16.424899 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=91 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:23:16.444250 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-4dab7f00-64c7-4ce6-86c0-e8dac64ae2d9 req-66d3c0e9-b0e1-44da-8951-cb1565e0d3a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc", "name": "network-vif-deleted", "tag": "4d36d36e-f101-43f3-b0c2-de0016f5a306"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:16.460153 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c04a44f3-c6a6-4ede-8440-f0fbac03a044 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1471 microversion: 2.1 time: 1.605888 Jul 18 02:23:16.464606 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-4dab7f00-64c7-4ce6-86c0-e8dac64ae2d9 req-66d3c0e9-b0e1-44da-8951-cb1565e0d3a5 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:16.466782 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-4dab7f00-64c7-4ce6-86c0-e8dac64ae2d9 req-66d3c0e9-b0e1-44da-8951-cb1565e0d3a5 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:16.474312 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1277/2512] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:14 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1471 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:23:16.509186 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-4dab7f00-64c7-4ce6-86c0-e8dac64ae2d9 req-66d3c0e9-b0e1-44da-8951-cb1565e0d3a5 service nova] Creating event network-vif-deleted:4d36d36e-f101-43f3-b0c2-de0016f5a306 for instance 6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc on n-h2-465891-3 Jul 18 02:23:16.532358 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-4dab7f00-64c7-4ce6-86c0-e8dac64ae2d9 req-66d3c0e9-b0e1-44da-8951-cb1565e0d3a5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083984 Jul 18 02:23:16.537885 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1236/2513] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:23:17.345301 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1a23a9ee-a2d6-4e5a-ac8f-66088aa7de37 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:17.346489 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1a23a9ee-a2d6-4e5a-ac8f-66088aa7de37 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:17.382310 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1a23a9ee-a2d6-4e5a-ac8f-66088aa7de37 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:17.384871 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1a23a9ee-a2d6-4e5a-ac8f-66088aa7de37 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:17.390537 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1a23a9ee-a2d6-4e5a-ac8f-66088aa7de37 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:17.392280 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1a23a9ee-a2d6-4e5a-ac8f-66088aa7de37 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:17.457556 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-1a23a9ee-a2d6-4e5a-ac8f-66088aa7de37 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] HTTP exception thrown: Instance 6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc could not be found. Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1a23a9ee-a2d6-4e5a-ac8f-66088aa7de37 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Request method failure captured: Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc HTTP/1.1 Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MPwaxUozPvSKq2aGl05vX5p9RkRh12PhrAa5ZuFGYH8QlWHXUoV4AOq2uE9nQ_2FUYuIDSWVSpjhgygJ-c4EGtTg2Y-_wVXi_cp3NARUTVck4-IU3Tev_AIZ-4eU7-_uXuXl7L-x01qv35sxA627UbKELg2PVDH9gxQj5dhwRrNVzw Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ba9d4e8f2f18460ebccacbe32db57388"}]}] Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-DeleteServersTestJSON-988442543 Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 89c4d32923874a50972ab0b75a4165c0 Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc could not be found. Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc'} Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc could not be found. Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc could not be found. Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:23:17.466386 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:23:17.474207 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:23:17.474207 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:23:17.474207 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:23:17.474207 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:23:17.474207 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:23:17.474207 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc could not be found. Jul 18 02:23:17.474207 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:23:17.477891 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1a23a9ee-a2d6-4e5a-ac8f-66088aa7de37 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Returning 404 to user: Instance 6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:23:17.479302 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1a23a9ee-a2d6-4e5a-ac8f-66088aa7de37 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc" status: 404 len: 111 microversion: 2.1 time: 0.139739 Jul 18 02:23:17.481788 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1278/2514] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:17 2022] GET /compute/v2.1/servers/6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:23:17.486731 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ee32e09a-83cc-4f73-bacc-4858b828c0f5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:17.491556 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ee32e09a-83cc-4f73-bacc-4858b828c0f5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:17.540291 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ee32e09a-83cc-4f73-bacc-4858b828c0f5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:17.548709 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ee32e09a-83cc-4f73-bacc-4858b828c0f5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:17.555349 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ee32e09a-83cc-4f73-bacc-4858b828c0f5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:17.556410 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ee32e09a-83cc-4f73-bacc-4858b828c0f5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:17.776733 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0baf61f4-1c44-4b28-ba84-59cbac188394 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1088957792", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "6dbd9947-7c83-4ca1-a653-57a9c042a444"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:18.034176 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-0baf61f4-1c44-4b28-ba84-59cbac188394 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] validate_networks() for [('6dbd9947-7c83-4ca1-a653-57a9c042a444', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:23:18.310028 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ee32e09a-83cc-4f73-bacc-4858b828c0f5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:18.319422 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ee32e09a-83cc-4f73-bacc-4858b828c0f5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1471 microversion: 2.1 time: 0.843621 Jul 18 02:23:18.330991 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1237/2515] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:17 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1471 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:19.324993 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-0baf61f4-1c44-4b28-ba84-59cbac188394 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:23:19.327712 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-0baf61f4-1c44-4b28-ba84-59cbac188394 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:23:19.328386 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-0baf61f4-1c44-4b28-ba84-59cbac188394 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:23:19.329673 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-0baf61f4-1c44-4b28-ba84-59cbac188394 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:23:19.331824 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-0baf61f4-1c44-4b28-ba84-59cbac188394 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:23:19.348209 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e16e5e66-7394-4ba9-962f-5b8571254098 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:19.349800 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e16e5e66-7394-4ba9-962f-5b8571254098 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:19.367584 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e16e5e66-7394-4ba9-962f-5b8571254098 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:19.368451 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e16e5e66-7394-4ba9-962f-5b8571254098 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:19.369678 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e16e5e66-7394-4ba9-962f-5b8571254098 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:19.370410 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e16e5e66-7394-4ba9-962f-5b8571254098 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:19.386035 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0baf61f4-1c44-4b28-ba84-59cbac188394 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:19.386813 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0baf61f4-1c44-4b28-ba84-59cbac188394 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:19.387757 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0baf61f4-1c44-4b28-ba84-59cbac188394 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:19.391682 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0baf61f4-1c44-4b28-ba84-59cbac188394 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:19.426076 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-0baf61f4-1c44-4b28-ba84-59cbac188394 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Getting quotas for project ba9d4e8f2f18460ebccacbe32db57388. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:23:19.435101 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-0baf61f4-1c44-4b28-ba84-59cbac188394 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Getting quotas for user 89c4d32923874a50972ab0b75a4165c0 and project ba9d4e8f2f18460ebccacbe32db57388. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:23:19.466669 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0baf61f4-1c44-4b28-ba84-59cbac188394 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:23:19.469336 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0baf61f4-1c44-4b28-ba84-59cbac188394 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:23:19.535961 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0baf61f4-1c44-4b28-ba84-59cbac188394 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.764639 Jul 18 02:23:19.538130 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1279/2516] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:23:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 02:23:19.549326 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6ad46d5d-b914-4891-b174-22ee7c521aa6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:19.550354 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6ad46d5d-b914-4891-b174-22ee7c521aa6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:19.871369 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6ad46d5d-b914-4891-b174-22ee7c521aa6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:19.873215 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e16e5e66-7394-4ba9-962f-5b8571254098 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:19.914860 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6ad46d5d-b914-4891-b174-22ee7c521aa6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a" status: 200 len: 1215 microversion: 2.1 time: 0.370555 Jul 18 02:23:19.931144 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1280/2517] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:19 2022] GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a => generated 1215 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:23:19.935683 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e16e5e66-7394-4ba9-962f-5b8571254098 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1476 microversion: 2.1 time: 0.591306 Jul 18 02:23:19.937917 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1238/2518] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:19 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1476 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:20.960813 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4b7b25f4-dbd5-4b79-8022-a3af5693db9d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:20.964272 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b19e83ce-46b4-446a-ae59-11b2977eab10 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:20.965444 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b19e83ce-46b4-446a-ae59-11b2977eab10 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:20.975255 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4b7b25f4-dbd5-4b79-8022-a3af5693db9d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:20.999789 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b19e83ce-46b4-446a-ae59-11b2977eab10 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:21.003469 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4b7b25f4-dbd5-4b79-8022-a3af5693db9d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:21.003935 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4b7b25f4-dbd5-4b79-8022-a3af5693db9d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:21.004953 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4b7b25f4-dbd5-4b79-8022-a3af5693db9d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:21.005465 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4b7b25f4-dbd5-4b79-8022-a3af5693db9d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:21.017828 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b19e83ce-46b4-446a-ae59-11b2977eab10 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:21.019106 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b19e83ce-46b4-446a-ae59-11b2977eab10 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:21.019937 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b19e83ce-46b4-446a-ae59-11b2977eab10 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:21.441390 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b19e83ce-46b4-446a-ae59-11b2977eab10 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:21.470985 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b19e83ce-46b4-446a-ae59-11b2977eab10 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a" status: 200 len: 1211 microversion: 2.1 time: 0.525305 Jul 18 02:23:21.470985 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1281/2519] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:20 2022] GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a => generated 1211 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:21.686856 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4b7b25f4-dbd5-4b79-8022-a3af5693db9d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:21.721078 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4b7b25f4-dbd5-4b79-8022-a3af5693db9d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1476 microversion: 2.1 time: 0.768579 Jul 18 02:23:21.735499 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1239/2520] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:20 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1476 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:22.490972 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6eceaa3e-edbc-45d9-8efb-985e8c02ccd2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:22.490972 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6eceaa3e-edbc-45d9-8efb-985e8c02ccd2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:22.511971 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6eceaa3e-edbc-45d9-8efb-985e8c02ccd2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:22.512453 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6eceaa3e-edbc-45d9-8efb-985e8c02ccd2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:22.515282 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6eceaa3e-edbc-45d9-8efb-985e8c02ccd2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:22.516960 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6eceaa3e-edbc-45d9-8efb-985e8c02ccd2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:22.739625 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-beb567db-f0e5-4595-81ec-a192b4dde410 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:22.740549 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-beb567db-f0e5-4595-81ec-a192b4dde410 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:22.759873 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-beb567db-f0e5-4595-81ec-a192b4dde410 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:22.761063 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-beb567db-f0e5-4595-81ec-a192b4dde410 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:22.764418 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-beb567db-f0e5-4595-81ec-a192b4dde410 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:22.765330 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-beb567db-f0e5-4595-81ec-a192b4dde410 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:22.791549 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6eceaa3e-edbc-45d9-8efb-985e8c02ccd2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:22.812957 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6eceaa3e-edbc-45d9-8efb-985e8c02ccd2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a" status: 200 len: 1273 microversion: 2.1 time: 0.326913 Jul 18 02:23:22.817455 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1282/2521] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:22 2022] GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a => generated 1273 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:23.469912 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-beb567db-f0e5-4595-81ec-a192b4dde410 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:23.483051 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-beb567db-f0e5-4595-81ec-a192b4dde410 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1476 microversion: 2.1 time: 0.747684 Jul 18 02:23:23.498034 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1240/2522] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:22 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1476 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:23:23.840920 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1699c6cf-25cf-42bf-9ad3-45b0c34cd878 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:23.841926 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1699c6cf-25cf-42bf-9ad3-45b0c34cd878 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:23.858328 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1699c6cf-25cf-42bf-9ad3-45b0c34cd878 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:23.859601 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1699c6cf-25cf-42bf-9ad3-45b0c34cd878 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:23.861351 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1699c6cf-25cf-42bf-9ad3-45b0c34cd878 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:23.862683 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1699c6cf-25cf-42bf-9ad3-45b0c34cd878 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:23.873006 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-42b3f8a8-b306-4dc6-bb5d-98e3548de9e6 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-2050122653", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "b54d8828-8c51-48e1-b48f-8fa28054f5b5"}], "security_groups": [{"name": "tempest-securitygroup--453771870"}], "key_name": "tempest-keypair-654047918", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:24.394402 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-42b3f8a8-b306-4dc6-bb5d-98e3548de9e6 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] validate_networks() for [('b54d8828-8c51-48e1-b48f-8fa28054f5b5', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:23:24.750446 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1699c6cf-25cf-42bf-9ad3-45b0c34cd878 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:24.758937 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1699c6cf-25cf-42bf-9ad3-45b0c34cd878 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a" status: 200 len: 1315 microversion: 2.1 time: 0.927243 Jul 18 02:23:24.766912 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1283/2523] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:23 2022] GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a => generated 1315 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:24.772613 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-29414885-a4f6-41ae-beb4-50b96b351165 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:24.779134 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-29414885-a4f6-41ae-beb4-50b96b351165 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:24.795935 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-29414885-a4f6-41ae-beb4-50b96b351165 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:24.796632 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-29414885-a4f6-41ae-beb4-50b96b351165 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:24.797733 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-29414885-a4f6-41ae-beb4-50b96b351165 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:24.798375 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-29414885-a4f6-41ae-beb4-50b96b351165 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:26.249570 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-29414885-a4f6-41ae-beb4-50b96b351165 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:26.364011 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-29414885-a4f6-41ae-beb4-50b96b351165 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1476 microversion: 2.1 time: 1.595415 Jul 18 02:23:26.380917 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1284/2524] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:24 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1476 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:26.380917 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-18a9bc9c-d902-45d2-97a2-4b6a08d4c47e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:26.380917 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-18a9bc9c-d902-45d2-97a2-4b6a08d4c47e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:26.391274 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-18a9bc9c-d902-45d2-97a2-4b6a08d4c47e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:26.392847 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-18a9bc9c-d902-45d2-97a2-4b6a08d4c47e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:26.393986 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-18a9bc9c-d902-45d2-97a2-4b6a08d4c47e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:26.394781 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-18a9bc9c-d902-45d2-97a2-4b6a08d4c47e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:27.398014 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-18a9bc9c-d902-45d2-97a2-4b6a08d4c47e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:27.429822 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-18a9bc9c-d902-45d2-97a2-4b6a08d4c47e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a" status: 200 len: 1315 microversion: 2.1 time: 1.062049 Jul 18 02:23:27.431342 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1285/2525] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:26 2022] GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a => generated 1315 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:27.445937 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c79fd051-4fcf-44be-a49c-8bd663d12d44 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:27.447120 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c79fd051-4fcf-44be-a49c-8bd663d12d44 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:27.478552 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c79fd051-4fcf-44be-a49c-8bd663d12d44 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:27.490022 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c79fd051-4fcf-44be-a49c-8bd663d12d44 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:27.491093 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c79fd051-4fcf-44be-a49c-8bd663d12d44 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:27.491570 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c79fd051-4fcf-44be-a49c-8bd663d12d44 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:28.019759 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-42b3f8a8-b306-4dc6-bb5d-98e3548de9e6 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Getting quotas for project 2d788b28fd2c4cf1826d908059f04c4a. Resources: dict_keys(['metadata_items']) {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:23:28.030248 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-42b3f8a8-b306-4dc6-bb5d-98e3548de9e6 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Getting quotas for user b9b89b2c768847589c4d41aba88208a4 and project 2d788b28fd2c4cf1826d908059f04c4a. Resources: dict_keys(['metadata_items']) {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:23:28.050536 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-42b3f8a8-b306-4dc6-bb5d-98e3548de9e6 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:23:28.051233 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-42b3f8a8-b306-4dc6-bb5d-98e3548de9e6 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:23:28.051869 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-42b3f8a8-b306-4dc6-bb5d-98e3548de9e6 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:23:28.052449 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-42b3f8a8-b306-4dc6-bb5d-98e3548de9e6 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:23:28.053009 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-42b3f8a8-b306-4dc6-bb5d-98e3548de9e6 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:23:28.064553 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-42b3f8a8-b306-4dc6-bb5d-98e3548de9e6 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:28.065047 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-42b3f8a8-b306-4dc6-bb5d-98e3548de9e6 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:28.066260 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-42b3f8a8-b306-4dc6-bb5d-98e3548de9e6 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:28.066743 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-42b3f8a8-b306-4dc6-bb5d-98e3548de9e6 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:28.093044 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-42b3f8a8-b306-4dc6-bb5d-98e3548de9e6 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Getting quotas for project 2d788b28fd2c4cf1826d908059f04c4a. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:23:28.101258 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-42b3f8a8-b306-4dc6-bb5d-98e3548de9e6 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Getting quotas for user b9b89b2c768847589c4d41aba88208a4 and project 2d788b28fd2c4cf1826d908059f04c4a. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:23:28.116488 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c79fd051-4fcf-44be-a49c-8bd663d12d44 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:28.133302 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c79fd051-4fcf-44be-a49c-8bd663d12d44 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1475 microversion: 2.1 time: 0.700216 Jul 18 02:23:28.134459 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1286/2526] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:27 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1475 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:28.135646 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-42b3f8a8-b306-4dc6-bb5d-98e3548de9e6 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:23:28.141154 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-42b3f8a8-b306-4dc6-bb5d-98e3548de9e6 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] [instance: 49facc8e-4cfc-4522-90d3-38c9f152e390] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:23:28.270278 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-42b3f8a8-b306-4dc6-bb5d-98e3548de9e6 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 4.429351 Jul 18 02:23:28.273124 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1241/2527] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:23:23 2022] POST /compute/v2.1/servers => generated 408 bytes in 4434 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:23:28.287792 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-38ad44b3-e49b-4fd0-bb56-54c759c670ef tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:28.296046 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-38ad44b3-e49b-4fd0-bb56-54c759c670ef tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] [instance: 49facc8e-4cfc-4522-90d3-38c9f152e390] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:28.448613 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b2f0ebba-a6be-435b-9e6f-76fed8de3933 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:28.449244 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b2f0ebba-a6be-435b-9e6f-76fed8de3933 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:28.476508 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b2f0ebba-a6be-435b-9e6f-76fed8de3933 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:28.477256 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b2f0ebba-a6be-435b-9e6f-76fed8de3933 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:28.479209 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b2f0ebba-a6be-435b-9e6f-76fed8de3933 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:28.484971 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b2f0ebba-a6be-435b-9e6f-76fed8de3933 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:28.600551 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-38ad44b3-e49b-4fd0-bb56-54c759c670ef tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b89b2c768847589c4d41aba88208a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d788b28fd2c4cf1826d908059f04c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:28.614166 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-38ad44b3-e49b-4fd0-bb56-54c759c670ef tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] 10.222.0.57 "GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390" status: 200 len: 1277 microversion: 2.1 time: 0.332922 Jul 18 02:23:28.615388 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1287/2528] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:28 2022] GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390 => generated 1277 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:23:28.932212 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b2f0ebba-a6be-435b-9e6f-76fed8de3933 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:28.950482 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b2f0ebba-a6be-435b-9e6f-76fed8de3933 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a" status: 200 len: 1315 microversion: 2.1 time: 0.498360 Jul 18 02:23:28.951167 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1242/2529] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:28 2022] GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a => generated 1315 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:29.163974 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2f355fac-8645-46f1-83ff-14efae668190 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:29.164650 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2f355fac-8645-46f1-83ff-14efae668190 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:29.178373 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-45677b30-4624-4fa9-9a8d-dd526a90ccce req-c946b27c-6e77-4496-a7e6-55192eafe6fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67029c55-03b9-4f19-bf3d-b54f1998ebae", "name": "network-vif-unplugged", "status": "completed", "tag": "35c7791f-4eef-441a-884d-d3eed4376b4f"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:29.190133 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-45677b30-4624-4fa9-9a8d-dd526a90ccce req-c946b27c-6e77-4496-a7e6-55192eafe6fa service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:29.190589 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-45677b30-4624-4fa9-9a8d-dd526a90ccce req-c946b27c-6e77-4496-a7e6-55192eafe6fa service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:29.208315 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2f355fac-8645-46f1-83ff-14efae668190 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:29.209127 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2f355fac-8645-46f1-83ff-14efae668190 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:29.209997 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2f355fac-8645-46f1-83ff-14efae668190 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:29.210441 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2f355fac-8645-46f1-83ff-14efae668190 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:29.269257 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-45677b30-4624-4fa9-9a8d-dd526a90ccce req-c946b27c-6e77-4496-a7e6-55192eafe6fa service nova] Creating event network-vif-unplugged:35c7791f-4eef-441a-884d-d3eed4376b4f for instance 67029c55-03b9-4f19-bf3d-b54f1998ebae on n-h2-465891-3 Jul 18 02:23:29.318660 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [req-45677b30-4624-4fa9-9a8d-dd526a90ccce req-c946b27c-6e77-4496-a7e6-55192eafe6fa service nova] Instance 67029c55-03b9-4f19-bf3d-b54f1998ebae is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3', 'n-h2-465891-3'} {{(pid=119544) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 02:23:29.372950 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-45677b30-4624-4fa9-9a8d-dd526a90ccce req-c946b27c-6e77-4496-a7e6-55192eafe6fa service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.192093 Jul 18 02:23:29.374210 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1243/2530] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:23:29.411624 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:23:29.633746 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-37d2b383-4435-4b6b-a32a-56b742cfb9df tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:29.634542 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-37d2b383-4435-4b6b-a32a-56b742cfb9df tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] [instance: 49facc8e-4cfc-4522-90d3-38c9f152e390] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:29.649557 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-37d2b383-4435-4b6b-a32a-56b742cfb9df tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:29.650391 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-37d2b383-4435-4b6b-a32a-56b742cfb9df tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:29.651409 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-37d2b383-4435-4b6b-a32a-56b742cfb9df tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:29.651856 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-37d2b383-4435-4b6b-a32a-56b742cfb9df tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:29.882370 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-37d2b383-4435-4b6b-a32a-56b742cfb9df tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b89b2c768847589c4d41aba88208a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d788b28fd2c4cf1826d908059f04c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:29.898943 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-37d2b383-4435-4b6b-a32a-56b742cfb9df tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] 10.222.0.57 "GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390" status: 200 len: 1273 microversion: 2.1 time: 0.269562 Jul 18 02:23:29.899908 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1244/2531] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:29 2022] GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390 => generated 1273 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:29.978459 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3760ceac-4622-4105-8504-9ea91290e803 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:29.980567 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3760ceac-4622-4105-8504-9ea91290e803 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:29.994586 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3760ceac-4622-4105-8504-9ea91290e803 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:29.995374 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3760ceac-4622-4105-8504-9ea91290e803 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:29.996617 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3760ceac-4622-4105-8504-9ea91290e803 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:29.997454 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3760ceac-4622-4105-8504-9ea91290e803 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:30.151631 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2f355fac-8645-46f1-83ff-14efae668190 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:30.168015 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2f355fac-8645-46f1-83ff-14efae668190 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1475 microversion: 2.1 time: 1.007941 Jul 18 02:23:30.180607 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1288/2532] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:29 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1475 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:30.938349 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3efc5018-1ea0-42ed-87c8-70164b7a8ec4 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:30.942581 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3efc5018-1ea0-42ed-87c8-70164b7a8ec4 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] [instance: 49facc8e-4cfc-4522-90d3-38c9f152e390] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:31.026218 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3efc5018-1ea0-42ed-87c8-70164b7a8ec4 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:31.029536 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3efc5018-1ea0-42ed-87c8-70164b7a8ec4 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:31.035110 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3efc5018-1ea0-42ed-87c8-70164b7a8ec4 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:31.038579 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3efc5018-1ea0-42ed-87c8-70164b7a8ec4 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:31.426381 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3efc5018-1ea0-42ed-87c8-70164b7a8ec4 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b89b2c768847589c4d41aba88208a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d788b28fd2c4cf1826d908059f04c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:31.448559 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3efc5018-1ea0-42ed-87c8-70164b7a8ec4 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] 10.222.0.57 "GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390" status: 200 len: 1335 microversion: 2.1 time: 0.524941 Jul 18 02:23:31.451267 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1289/2533] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:30 2022] GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390 => generated 1335 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:31.458598 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-28c334dc-562c-4681-8d99-a8bb9740ea8f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:31.460051 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-28c334dc-562c-4681-8d99-a8bb9740ea8f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:31.469970 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-28c334dc-562c-4681-8d99-a8bb9740ea8f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:31.471553 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-28c334dc-562c-4681-8d99-a8bb9740ea8f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:31.472482 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-28c334dc-562c-4681-8d99-a8bb9740ea8f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:31.473011 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-28c334dc-562c-4681-8d99-a8bb9740ea8f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:31.567714 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3760ceac-4622-4105-8504-9ea91290e803 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:31.591020 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3760ceac-4622-4105-8504-9ea91290e803 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a" status: 200 len: 1315 microversion: 2.1 time: 1.621690 Jul 18 02:23:31.592824 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1245/2534] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:29 2022] GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a => generated 1315 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:31.750947 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-5193342b-f07e-47a7-8621-e3ea2527437b req-91ea74cd-2dab-4d88-8d93-ea521be5ec81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a", "tag": "a8f166e0-39af-4a4f-bae5-dbdbaf61cc83"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:31.770336 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-5193342b-f07e-47a7-8621-e3ea2527437b req-91ea74cd-2dab-4d88-8d93-ea521be5ec81 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:31.774942 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-5193342b-f07e-47a7-8621-e3ea2527437b req-91ea74cd-2dab-4d88-8d93-ea521be5ec81 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:31.808424 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-5193342b-f07e-47a7-8621-e3ea2527437b req-91ea74cd-2dab-4d88-8d93-ea521be5ec81 service nova] Creating event network-changed:a8f166e0-39af-4a4f-bae5-dbdbaf61cc83 for instance 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a on n-h2-465891-3 Jul 18 02:23:31.823549 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-5193342b-f07e-47a7-8621-e3ea2527437b req-91ea74cd-2dab-4d88-8d93-ea521be5ec81 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.225542 Jul 18 02:23:31.828215 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1246/2535] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:23:32.151996 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-28c334dc-562c-4681-8d99-a8bb9740ea8f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:32.167059 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-28c334dc-562c-4681-8d99-a8bb9740ea8f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1475 microversion: 2.1 time: 0.714094 Jul 18 02:23:32.168356 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1290/2536] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:31 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1475 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:32.471270 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c3141d4d-6d8d-49d4-a8a5-22fd490532c7 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:32.472452 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c3141d4d-6d8d-49d4-a8a5-22fd490532c7 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] [instance: 49facc8e-4cfc-4522-90d3-38c9f152e390] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:32.490513 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c3141d4d-6d8d-49d4-a8a5-22fd490532c7 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:32.494030 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c3141d4d-6d8d-49d4-a8a5-22fd490532c7 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:32.494968 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c3141d4d-6d8d-49d4-a8a5-22fd490532c7 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:32.495429 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c3141d4d-6d8d-49d4-a8a5-22fd490532c7 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:32.615083 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e8670249-b7c8-4751-9757-c2e2a9f1a0c6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:32.616621 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e8670249-b7c8-4751-9757-c2e2a9f1a0c6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:32.625558 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e8670249-b7c8-4751-9757-c2e2a9f1a0c6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:32.626462 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e8670249-b7c8-4751-9757-c2e2a9f1a0c6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:32.627686 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e8670249-b7c8-4751-9757-c2e2a9f1a0c6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:32.628887 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e8670249-b7c8-4751-9757-c2e2a9f1a0c6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:32.747194 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c3141d4d-6d8d-49d4-a8a5-22fd490532c7 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b89b2c768847589c4d41aba88208a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d788b28fd2c4cf1826d908059f04c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:32.820076 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c3141d4d-6d8d-49d4-a8a5-22fd490532c7 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] 10.222.0.57 "GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390" status: 200 len: 1335 microversion: 2.1 time: 0.354910 Jul 18 02:23:32.821858 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1247/2537] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:32 2022] GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390 => generated 1335 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:33.205370 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5e1dd6ae-e341-4652-ad1e-9239939b9821 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:33.211060 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5e1dd6ae-e341-4652-ad1e-9239939b9821 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:33.244822 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5e1dd6ae-e341-4652-ad1e-9239939b9821 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:33.245825 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5e1dd6ae-e341-4652-ad1e-9239939b9821 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:33.247270 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5e1dd6ae-e341-4652-ad1e-9239939b9821 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:33.248071 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5e1dd6ae-e341-4652-ad1e-9239939b9821 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:34.221334 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e8670249-b7c8-4751-9757-c2e2a9f1a0c6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:34.230230 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e8670249-b7c8-4751-9757-c2e2a9f1a0c6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a" status: 200 len: 1315 microversion: 2.1 time: 1.621915 Jul 18 02:23:34.243045 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1291/2538] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:32 2022] GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a => generated 1315 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:34.350323 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d901d0e5-b89d-453c-b4b8-dfdc53b211fd tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1404339089", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "8dbf13cf-b327-461b-b589-7989b265d2de"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:34.532180 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-d901d0e5-b89d-453c-b4b8-dfdc53b211fd tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] validate_networks() for [('8dbf13cf-b327-461b-b589-7989b265d2de', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:23:34.661559 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5e1dd6ae-e341-4652-ad1e-9239939b9821 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:34.689039 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5e1dd6ae-e341-4652-ad1e-9239939b9821 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1475 microversion: 2.1 time: 1.497106 Jul 18 02:23:34.691350 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1248/2539] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:33 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1475 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:34.704057 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ccd9ac55-008e-409a-bd6c-36cccbba0184 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:34.705823 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ccd9ac55-008e-409a-bd6c-36cccbba0184 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] [instance: 49facc8e-4cfc-4522-90d3-38c9f152e390] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:34.732389 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ccd9ac55-008e-409a-bd6c-36cccbba0184 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:34.739765 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ccd9ac55-008e-409a-bd6c-36cccbba0184 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:34.743268 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ccd9ac55-008e-409a-bd6c-36cccbba0184 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:34.747387 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ccd9ac55-008e-409a-bd6c-36cccbba0184 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:35.621283 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ccd9ac55-008e-409a-bd6c-36cccbba0184 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b89b2c768847589c4d41aba88208a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d788b28fd2c4cf1826d908059f04c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:35.647643 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ccd9ac55-008e-409a-bd6c-36cccbba0184 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] 10.222.0.57 "GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390" status: 200 len: 1335 microversion: 2.1 time: 0.953096 Jul 18 02:23:35.660130 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1249/2540] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:34 2022] GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390 => generated 1335 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:35.670339 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-f010d279-fe01-462f-a820-b316bf3a4c9e req-2049566a-9463-41ec-980b-3612cdbb84ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67029c55-03b9-4f19-bf3d-b54f1998ebae", "tag": "35c7791f-4eef-441a-884d-d3eed4376b4f"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:35.687767 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-f010d279-fe01-462f-a820-b316bf3a4c9e req-2049566a-9463-41ec-980b-3612cdbb84ac service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:35.688964 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-f010d279-fe01-462f-a820-b316bf3a4c9e req-2049566a-9463-41ec-980b-3612cdbb84ac service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:35.734174 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-f010d279-fe01-462f-a820-b316bf3a4c9e req-2049566a-9463-41ec-980b-3612cdbb84ac service nova] Creating event network-changed:35c7791f-4eef-441a-884d-d3eed4376b4f for instance 67029c55-03b9-4f19-bf3d-b54f1998ebae on n-h2-465891-3 Jul 18 02:23:35.771566 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [req-f010d279-fe01-462f-a820-b316bf3a4c9e req-2049566a-9463-41ec-980b-3612cdbb84ac service nova] Instance 67029c55-03b9-4f19-bf3d-b54f1998ebae is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3', 'n-h2-465891-3'} {{(pid=119544) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 02:23:35.809591 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-f010d279-fe01-462f-a820-b316bf3a4c9e req-2049566a-9463-41ec-980b-3612cdbb84ac service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146002 Jul 18 02:23:35.811695 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1250/2541] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:23:35.826265 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4e859764-8ee5-411d-9e7b-a16859168e0b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:35.828296 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4e859764-8ee5-411d-9e7b-a16859168e0b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:35.874919 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e859764-8ee5-411d-9e7b-a16859168e0b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:35.878693 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e859764-8ee5-411d-9e7b-a16859168e0b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:35.880564 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e859764-8ee5-411d-9e7b-a16859168e0b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:35.884176 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e859764-8ee5-411d-9e7b-a16859168e0b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:37.655431 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4e859764-8ee5-411d-9e7b-a16859168e0b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:37.684020 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4e859764-8ee5-411d-9e7b-a16859168e0b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a" status: 200 len: 1315 microversion: 2.1 time: 1.870041 Jul 18 02:23:37.686478 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1251/2542] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:35 2022] GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a => generated 1315 bytes in 1874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:37.702078 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7bb0e07b-172d-4ed6-9742-f2814a048293 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:37.703192 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7bb0e07b-172d-4ed6-9742-f2814a048293 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:37.729221 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:23:37.745488 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7bb0e07b-172d-4ed6-9742-f2814a048293 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:37.746401 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7bb0e07b-172d-4ed6-9742-f2814a048293 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:37.747594 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7bb0e07b-172d-4ed6-9742-f2814a048293 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:37.748331 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7bb0e07b-172d-4ed6-9742-f2814a048293 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:38.077875 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:23:38.116381 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=10 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:23:38.606332 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=14 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:23:39.745005 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7bb0e07b-172d-4ed6-9742-f2814a048293 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:39.776825 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:23:39.809880 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7bb0e07b-172d-4ed6-9742-f2814a048293 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1475 microversion: 2.1 time: 2.121330 Jul 18 02:23:39.811697 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1252/2543] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:37 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1475 bytes in 2124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:39.820687 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-41adf9c9-c15c-4d44-ac51-ac8b32b258a4 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:39.822315 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-41adf9c9-c15c-4d44-ac51-ac8b32b258a4 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] [instance: 49facc8e-4cfc-4522-90d3-38c9f152e390] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:39.843283 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-41adf9c9-c15c-4d44-ac51-ac8b32b258a4 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:39.857234 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-41adf9c9-c15c-4d44-ac51-ac8b32b258a4 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:39.860366 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-41adf9c9-c15c-4d44-ac51-ac8b32b258a4 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:39.861178 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-41adf9c9-c15c-4d44-ac51-ac8b32b258a4 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:40.480930 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-d901d0e5-b89d-453c-b4b8-dfdc53b211fd tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:23:40.481734 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-d901d0e5-b89d-453c-b4b8-dfdc53b211fd tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:23:40.482125 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-d901d0e5-b89d-453c-b4b8-dfdc53b211fd tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:23:40.482644 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-d901d0e5-b89d-453c-b4b8-dfdc53b211fd tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:23:40.483145 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-d901d0e5-b89d-453c-b4b8-dfdc53b211fd tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:23:40.485858 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:23:40.510833 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d901d0e5-b89d-453c-b4b8-dfdc53b211fd tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:40.515482 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d901d0e5-b89d-453c-b4b8-dfdc53b211fd tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:40.516605 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d901d0e5-b89d-453c-b4b8-dfdc53b211fd tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:40.517175 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d901d0e5-b89d-453c-b4b8-dfdc53b211fd tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:40.567444 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-d901d0e5-b89d-453c-b4b8-dfdc53b211fd tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Getting quotas for project 82362419c7974c36b6931ccbc274a646. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:23:40.579667 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-d901d0e5-b89d-453c-b4b8-dfdc53b211fd tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Getting quotas for user f74142c97f164df080e0056b5953cf5f and project 82362419c7974c36b6931ccbc274a646. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:23:40.604126 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d901d0e5-b89d-453c-b4b8-dfdc53b211fd tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:23:40.607706 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d901d0e5-b89d-453c-b4b8-dfdc53b211fd tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] [instance: 8d246564-436e-480a-989e-b67ec47fa8e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:23:40.705681 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d901d0e5-b89d-453c-b4b8-dfdc53b211fd tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.460753 Jul 18 02:23:40.706828 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1292/2544] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:23:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 6463 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:23:40.735325 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bfa6fe01-3eb2-4e9c-b4d3-69c1d8c78e1d tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:40.736474 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bfa6fe01-3eb2-4e9c-b4d3-69c1d8c78e1d tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:40.753830 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bfa6fe01-3eb2-4e9c-b4d3-69c1d8c78e1d tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:40.754973 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bfa6fe01-3eb2-4e9c-b4d3-69c1d8c78e1d tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:40.756318 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bfa6fe01-3eb2-4e9c-b4d3-69c1d8c78e1d tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:40.756968 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bfa6fe01-3eb2-4e9c-b4d3-69c1d8c78e1d tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:41.219113 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-41adf9c9-c15c-4d44-ac51-ac8b32b258a4 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b89b2c768847589c4d41aba88208a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d788b28fd2c4cf1826d908059f04c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:41.230428 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-41adf9c9-c15c-4d44-ac51-ac8b32b258a4 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] 10.222.0.57 "GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390" status: 200 len: 1402 microversion: 2.1 time: 1.416629 Jul 18 02:23:41.231863 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1253/2545] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:39 2022] GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390 => generated 1402 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:41.240065 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-83f5e7fc-c064-4b5f-9ca9-ce0fd56bb9b8 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:41.241441 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-83f5e7fc-c064-4b5f-9ca9-ce0fd56bb9b8 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] [instance: 8d246564-436e-480a-989e-b67ec47fa8e9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:41.709099 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-83f5e7fc-c064-4b5f-9ca9-ce0fd56bb9b8 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74142c97f164df080e0056b5953cf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82362419c7974c36b6931ccbc274a646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:41.757690 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-83f5e7fc-c064-4b5f-9ca9-ce0fd56bb9b8 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] 10.222.0.57 "GET /compute/v2.1/servers/8d246564-436e-480a-989e-b67ec47fa8e9" status: 200 len: 1216 microversion: 2.1 time: 0.523449 Jul 18 02:23:41.771780 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1254/2546] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:41 2022] GET /compute/v2.1/servers/8d246564-436e-480a-989e-b67ec47fa8e9 => generated 1216 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:41.784482 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-945639f6-dcfd-47c6-ba29-36c29194a151 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:41.785659 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-945639f6-dcfd-47c6-ba29-36c29194a151 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:41.822732 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-945639f6-dcfd-47c6-ba29-36c29194a151 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:41.825019 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-945639f6-dcfd-47c6-ba29-36c29194a151 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:41.830881 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-945639f6-dcfd-47c6-ba29-36c29194a151 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:41.832001 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-945639f6-dcfd-47c6-ba29-36c29194a151 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:42.322492 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bfa6fe01-3eb2-4e9c-b4d3-69c1d8c78e1d tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:42.372847 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bfa6fe01-3eb2-4e9c-b4d3-69c1d8c78e1d tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a" status: 200 len: 1315 microversion: 2.1 time: 1.663841 Jul 18 02:23:42.382890 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1293/2547] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:40 2022] GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a => generated 1315 bytes in 1675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:42.408624 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2f127d66-b32c-4e5f-b494-617659d9ad9b tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:42.410537 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2f127d66-b32c-4e5f-b494-617659d9ad9b tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] [instance: 49facc8e-4cfc-4522-90d3-38c9f152e390] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:42.423110 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2f127d66-b32c-4e5f-b494-617659d9ad9b tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:42.423974 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2f127d66-b32c-4e5f-b494-617659d9ad9b tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:42.425410 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2f127d66-b32c-4e5f-b494-617659d9ad9b tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:42.426302 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2f127d66-b32c-4e5f-b494-617659d9ad9b tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:43.424051 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-945639f6-dcfd-47c6-ba29-36c29194a151 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:43.440398 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-945639f6-dcfd-47c6-ba29-36c29194a151 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1470 microversion: 2.1 time: 1.665015 Jul 18 02:23:43.442083 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1255/2548] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:41 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1470 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:43.592476 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-8ec6929d-1ce7-4218-94a7-d0c258b11a90 req-c78bad2c-701d-4da8-9c00-c466898fe743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a", "name": "network-vif-plugged", "status": "completed", "tag": "a8f166e0-39af-4a4f-bae5-dbdbaf61cc83"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:43.641627 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-8ec6929d-1ce7-4218-94a7-d0c258b11a90 req-c78bad2c-701d-4da8-9c00-c466898fe743 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:43.646176 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-8ec6929d-1ce7-4218-94a7-d0c258b11a90 req-c78bad2c-701d-4da8-9c00-c466898fe743 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:43.676713 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-8ec6929d-1ce7-4218-94a7-d0c258b11a90 req-c78bad2c-701d-4da8-9c00-c466898fe743 service nova] Creating event network-vif-plugged:a8f166e0-39af-4a4f-bae5-dbdbaf61cc83 for instance 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a on n-h2-465891-3 Jul 18 02:23:43.692846 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-8ec6929d-1ce7-4218-94a7-d0c258b11a90 req-c78bad2c-701d-4da8-9c00-c466898fe743 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.246152 Jul 18 02:23:43.694655 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1256/2549] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:23:43.720319 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-39a5b018-99ae-4fc1-bd59-bc158194a068 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:43.727449 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-39a5b018-99ae-4fc1-bd59-bc158194a068 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] [instance: 8d246564-436e-480a-989e-b67ec47fa8e9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:43.752756 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-39a5b018-99ae-4fc1-bd59-bc158194a068 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:43.754420 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-39a5b018-99ae-4fc1-bd59-bc158194a068 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:43.760097 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-39a5b018-99ae-4fc1-bd59-bc158194a068 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:43.761514 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-39a5b018-99ae-4fc1-bd59-bc158194a068 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:43.999202 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-39a5b018-99ae-4fc1-bd59-bc158194a068 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74142c97f164df080e0056b5953cf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82362419c7974c36b6931ccbc274a646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:44.042879 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-39a5b018-99ae-4fc1-bd59-bc158194a068 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] 10.222.0.57 "GET /compute/v2.1/servers/8d246564-436e-480a-989e-b67ec47fa8e9" status: 200 len: 1274 microversion: 2.1 time: 0.345151 Jul 18 02:23:44.044766 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1257/2550] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:43 2022] GET /compute/v2.1/servers/8d246564-436e-480a-989e-b67ec47fa8e9 => generated 1274 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:44.051285 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7d790225-5b07-41e8-8976-f310e734ef12 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:44.052309 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7d790225-5b07-41e8-8976-f310e734ef12 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:44.062119 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7d790225-5b07-41e8-8976-f310e734ef12 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:44.062966 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7d790225-5b07-41e8-8976-f310e734ef12 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:44.064394 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7d790225-5b07-41e8-8976-f310e734ef12 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:44.065068 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7d790225-5b07-41e8-8976-f310e734ef12 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:44.175632 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2f127d66-b32c-4e5f-b494-617659d9ad9b tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b89b2c768847589c4d41aba88208a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d788b28fd2c4cf1826d908059f04c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:44.204679 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2f127d66-b32c-4e5f-b494-617659d9ad9b tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] 10.222.0.57 "GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390" status: 200 len: 1402 microversion: 2.1 time: 1.819589 Jul 18 02:23:44.205555 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1294/2551] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:42 2022] GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390 => generated 1402 bytes in 1822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:44.217041 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7962b1a5-8206-4d0d-8e83-6c31a372f382 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:44.221494 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7962b1a5-8206-4d0d-8e83-6c31a372f382 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:44.239313 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7962b1a5-8206-4d0d-8e83-6c31a372f382 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:44.240249 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7962b1a5-8206-4d0d-8e83-6c31a372f382 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:44.246191 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7962b1a5-8206-4d0d-8e83-6c31a372f382 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:44.251213 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7962b1a5-8206-4d0d-8e83-6c31a372f382 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:44.436712 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7962b1a5-8206-4d0d-8e83-6c31a372f382 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "POST /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae/action" status: 204 len: 0 microversion: 2.1 time: 0.225020 Jul 18 02:23:44.440296 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1295/2552] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:23:44 2022] POST /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae/action => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:23:44.458506 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-25187a09-b38e-4bff-80f7-f6ebf284ee69 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:44.460895 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-25187a09-b38e-4bff-80f7-f6ebf284ee69 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:44.485526 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-25187a09-b38e-4bff-80f7-f6ebf284ee69 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:44.487148 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-25187a09-b38e-4bff-80f7-f6ebf284ee69 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:44.490666 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-25187a09-b38e-4bff-80f7-f6ebf284ee69 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:44.491469 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-25187a09-b38e-4bff-80f7-f6ebf284ee69 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:45.194587 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7d790225-5b07-41e8-8976-f310e734ef12 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:45.253008 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7d790225-5b07-41e8-8976-f310e734ef12 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a" status: 200 len: 1315 microversion: 2.1 time: 1.205672 Jul 18 02:23:45.256662 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1258/2553] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:44 2022] GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a => generated 1315 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:45.301306 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-25187a09-b38e-4bff-80f7-f6ebf284ee69 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:45.307171 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7b779781-3a37-43d5-b53a-bf192c2439de tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:45.314139 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-25187a09-b38e-4bff-80f7-f6ebf284ee69 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1470 microversion: 2.1 time: 0.869013 Jul 18 02:23:45.314776 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1296/2554] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:44 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1470 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:45.324223 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d3027b8b-5c1f-4f6c-b40a-7487968d48dc tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:45.327328 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7b779781-3a37-43d5-b53a-bf192c2439de tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] [instance: 8d246564-436e-480a-989e-b67ec47fa8e9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:45.333233 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d3027b8b-5c1f-4f6c-b40a-7487968d48dc tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] [instance: 49facc8e-4cfc-4522-90d3-38c9f152e390] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:45.343517 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d3027b8b-5c1f-4f6c-b40a-7487968d48dc tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:45.344279 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d3027b8b-5c1f-4f6c-b40a-7487968d48dc tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:45.345331 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d3027b8b-5c1f-4f6c-b40a-7487968d48dc tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:45.346001 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d3027b8b-5c1f-4f6c-b40a-7487968d48dc tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:45.352843 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7b779781-3a37-43d5-b53a-bf192c2439de tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:45.355935 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7b779781-3a37-43d5-b53a-bf192c2439de tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:45.359342 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7b779781-3a37-43d5-b53a-bf192c2439de tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:45.361510 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7b779781-3a37-43d5-b53a-bf192c2439de tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:45.406372 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:23:45.660920 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7b779781-3a37-43d5-b53a-bf192c2439de tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74142c97f164df080e0056b5953cf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82362419c7974c36b6931ccbc274a646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:45.684433 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7b779781-3a37-43d5-b53a-bf192c2439de tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] 10.222.0.57 "GET /compute/v2.1/servers/8d246564-436e-480a-989e-b67ec47fa8e9" status: 200 len: 1274 microversion: 2.1 time: 0.422039 Jul 18 02:23:45.704231 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1259/2555] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:45 2022] GET /compute/v2.1/servers/8d246564-436e-480a-989e-b67ec47fa8e9 => generated 1274 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:45.814439 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d3027b8b-5c1f-4f6c-b40a-7487968d48dc tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b89b2c768847589c4d41aba88208a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d788b28fd2c4cf1826d908059f04c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:45.824720 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d3027b8b-5c1f-4f6c-b40a-7487968d48dc tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] 10.222.0.57 "GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390" status: 200 len: 1402 microversion: 2.1 time: 0.508435 Jul 18 02:23:45.835607 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1297/2556] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:45 2022] GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390 => generated 1402 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:46.137184 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-d19c2fd7-69b8-4828-87e8-5a64f1d8f9c8 req-3715953c-e373-45c3-a93b-4927ee25b1c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67029c55-03b9-4f19-bf3d-b54f1998ebae", "name": "network-vif-plugged", "status": "completed", "tag": "35c7791f-4eef-441a-884d-d3eed4376b4f"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:46.166237 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-d19c2fd7-69b8-4828-87e8-5a64f1d8f9c8 req-3715953c-e373-45c3-a93b-4927ee25b1c4 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:46.166935 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-d19c2fd7-69b8-4828-87e8-5a64f1d8f9c8 req-3715953c-e373-45c3-a93b-4927ee25b1c4 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:46.214265 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-d19c2fd7-69b8-4828-87e8-5a64f1d8f9c8 req-3715953c-e373-45c3-a93b-4927ee25b1c4 service nova] Creating event network-vif-plugged:35c7791f-4eef-441a-884d-d3eed4376b4f for instance 67029c55-03b9-4f19-bf3d-b54f1998ebae on n-h2-465891-3 Jul 18 02:23:46.232628 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [req-d19c2fd7-69b8-4828-87e8-5a64f1d8f9c8 req-3715953c-e373-45c3-a93b-4927ee25b1c4 service nova] Instance 67029c55-03b9-4f19-bf3d-b54f1998ebae is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3', 'n-h2-465891-3'} {{(pid=119544) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 02:23:46.238033 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-c4256068-9e37-4799-b5de-d2bc1aff74a3 req-7284651d-4185-40c7-b090-15c8e61e566e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49facc8e-4cfc-4522-90d3-38c9f152e390", "tag": "44254fc9-6729-4435-8c9a-c405df2363b5"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:46.268674 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-c4256068-9e37-4799-b5de-d2bc1aff74a3 req-7284651d-4185-40c7-b090-15c8e61e566e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:46.269488 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-c4256068-9e37-4799-b5de-d2bc1aff74a3 req-7284651d-4185-40c7-b090-15c8e61e566e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:46.291364 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-d19c2fd7-69b8-4828-87e8-5a64f1d8f9c8 req-3715953c-e373-45c3-a93b-4927ee25b1c4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174592 Jul 18 02:23:46.292028 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1260/2557] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:23:46.302727 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-c4256068-9e37-4799-b5de-d2bc1aff74a3 req-7284651d-4185-40c7-b090-15c8e61e566e service nova] Creating event network-changed:44254fc9-6729-4435-8c9a-c405df2363b5 for instance 49facc8e-4cfc-4522-90d3-38c9f152e390 on n-h1-465891-3 Jul 18 02:23:46.317444 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9540cc4b-b066-44a8-94f3-04fc12c074aa tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:46.317665 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-c4256068-9e37-4799-b5de-d2bc1aff74a3 req-7284651d-4185-40c7-b090-15c8e61e566e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085055 Jul 18 02:23:46.320748 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1298/2558] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:23:46.326452 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9540cc4b-b066-44a8-94f3-04fc12c074aa tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:46.333279 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d6efeb1c-eaa4-4945-9a3b-88238562a45d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:46.337275 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d6efeb1c-eaa4-4945-9a3b-88238562a45d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:46.344403 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9540cc4b-b066-44a8-94f3-04fc12c074aa tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:46.344881 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9540cc4b-b066-44a8-94f3-04fc12c074aa tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:46.345718 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9540cc4b-b066-44a8-94f3-04fc12c074aa tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:46.346184 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9540cc4b-b066-44a8-94f3-04fc12c074aa tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:46.356205 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d6efeb1c-eaa4-4945-9a3b-88238562a45d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:46.356685 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d6efeb1c-eaa4-4945-9a3b-88238562a45d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:46.361126 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d6efeb1c-eaa4-4945-9a3b-88238562a45d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:46.364918 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d6efeb1c-eaa4-4945-9a3b-88238562a45d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:47.842007 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9540cc4b-b066-44a8-94f3-04fc12c074aa tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:47.854588 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9540cc4b-b066-44a8-94f3-04fc12c074aa tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a" status: 200 len: 1502 microversion: 2.1 time: 1.544588 Jul 18 02:23:47.855926 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1261/2559] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:46 2022] GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a => generated 1502 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:47.863346 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-29b73ffc-65d5-40af-a4a4-3eced35d6045 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:47.864211 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-29b73ffc-65d5-40af-a4a4-3eced35d6045 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] [instance: 8d246564-436e-480a-989e-b67ec47fa8e9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:47.873465 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-29b73ffc-65d5-40af-a4a4-3eced35d6045 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:47.874364 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-29b73ffc-65d5-40af-a4a4-3eced35d6045 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:47.877395 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-29b73ffc-65d5-40af-a4a4-3eced35d6045 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:47.878352 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-29b73ffc-65d5-40af-a4a4-3eced35d6045 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:47.903317 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d6efeb1c-eaa4-4945-9a3b-88238562a45d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:47.926531 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d6efeb1c-eaa4-4945-9a3b-88238562a45d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1470 microversion: 2.1 time: 1.597190 Jul 18 02:23:47.928331 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1299/2560] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:46 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1470 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:47.938264 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e0ba57c7-35a2-457e-8f2d-22785505474b tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:47.939607 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e0ba57c7-35a2-457e-8f2d-22785505474b tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] [instance: 49facc8e-4cfc-4522-90d3-38c9f152e390] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:47.956827 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e0ba57c7-35a2-457e-8f2d-22785505474b tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:47.958071 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e0ba57c7-35a2-457e-8f2d-22785505474b tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:47.959893 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e0ba57c7-35a2-457e-8f2d-22785505474b tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:47.960984 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e0ba57c7-35a2-457e-8f2d-22785505474b tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:49.694772 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e0ba57c7-35a2-457e-8f2d-22785505474b tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b89b2c768847589c4d41aba88208a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d788b28fd2c4cf1826d908059f04c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:49.704168 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e0ba57c7-35a2-457e-8f2d-22785505474b tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] 10.222.0.57 "GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390" status: 200 len: 1402 microversion: 2.1 time: 1.773880 Jul 18 02:23:49.706031 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1300/2561] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:47 2022] GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390 => generated 1402 bytes in 1777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:49.712109 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-667979b7-4cd4-4d52-8eed-f05dea5ba67d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:49.718961 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-667979b7-4cd4-4d52-8eed-f05dea5ba67d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:49.729060 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-667979b7-4cd4-4d52-8eed-f05dea5ba67d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:49.747494 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-667979b7-4cd4-4d52-8eed-f05dea5ba67d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:49.749808 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-667979b7-4cd4-4d52-8eed-f05dea5ba67d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:49.750970 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-667979b7-4cd4-4d52-8eed-f05dea5ba67d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:49.862576 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-29b73ffc-65d5-40af-a4a4-3eced35d6045 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74142c97f164df080e0056b5953cf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82362419c7974c36b6931ccbc274a646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:49.897057 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-29b73ffc-65d5-40af-a4a4-3eced35d6045 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] 10.222.0.57 "GET /compute/v2.1/servers/8d246564-436e-480a-989e-b67ec47fa8e9" status: 200 len: 1316 microversion: 2.1 time: 2.039198 Jul 18 02:23:49.902433 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1262/2562] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:47 2022] GET /compute/v2.1/servers/8d246564-436e-480a-989e-b67ec47fa8e9 => generated 1316 bytes in 2046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:49.908173 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-ca85c186-cd7f-48ef-9536-7f3fab001529 req-4cff12e1-9959-4601-a290-4e5156706973 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d246564-436e-480a-989e-b67ec47fa8e9", "tag": "a51a1193-20b8-4c79-916d-a97e87bdbc22"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:49.928199 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-ca85c186-cd7f-48ef-9536-7f3fab001529 req-4cff12e1-9959-4601-a290-4e5156706973 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:49.928884 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-ca85c186-cd7f-48ef-9536-7f3fab001529 req-4cff12e1-9959-4601-a290-4e5156706973 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:49.945134 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-ca85c186-cd7f-48ef-9536-7f3fab001529 req-4cff12e1-9959-4601-a290-4e5156706973 service nova] Creating event network-changed:a51a1193-20b8-4c79-916d-a97e87bdbc22 for instance 8d246564-436e-480a-989e-b67ec47fa8e9 on n-h2-465891-3 Jul 18 02:23:49.953102 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-ca85c186-cd7f-48ef-9536-7f3fab001529 req-4cff12e1-9959-4601-a290-4e5156706973 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048223 Jul 18 02:23:49.954967 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1263/2563] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:23:50.536745 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:23:50.598018 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:23:50.741493 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-21946388-c7d6-450c-a7a1-eba426125dd7 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:50.743963 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-21946388-c7d6-450c-a7a1-eba426125dd7 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] [instance: 49facc8e-4cfc-4522-90d3-38c9f152e390] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:50.756626 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-21946388-c7d6-450c-a7a1-eba426125dd7 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:50.757311 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-21946388-c7d6-450c-a7a1-eba426125dd7 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:50.758351 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-21946388-c7d6-450c-a7a1-eba426125dd7 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:50.758792 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-21946388-c7d6-450c-a7a1-eba426125dd7 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:51.142146 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-667979b7-4cd4-4d52-8eed-f05dea5ba67d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:51.180236 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-667979b7-4cd4-4d52-8eed-f05dea5ba67d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1470 microversion: 2.1 time: 1.470764 Jul 18 02:23:51.191365 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1301/2564] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:49 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1470 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:51.198466 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-da9bd18d-f5f9-4d1b-a47b-07bf10e41024 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:51.200006 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-da9bd18d-f5f9-4d1b-a47b-07bf10e41024 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] [instance: 8d246564-436e-480a-989e-b67ec47fa8e9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:51.214319 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-da9bd18d-f5f9-4d1b-a47b-07bf10e41024 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:51.215273 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-da9bd18d-f5f9-4d1b-a47b-07bf10e41024 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:51.216803 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-da9bd18d-f5f9-4d1b-a47b-07bf10e41024 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:51.217897 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-da9bd18d-f5f9-4d1b-a47b-07bf10e41024 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:51.707439 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-21946388-c7d6-450c-a7a1-eba426125dd7 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b89b2c768847589c4d41aba88208a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d788b28fd2c4cf1826d908059f04c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:51.719118 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-21946388-c7d6-450c-a7a1-eba426125dd7 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] 10.222.0.57 "GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390" status: 200 len: 1402 microversion: 2.1 time: 0.988375 Jul 18 02:23:51.730712 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1264/2565] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:50 2022] GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390 => generated 1402 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:23:51.736944 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5bfa4e20-2535-42a7-8f77-a240c594eab7 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ea11e4a-e1d2-4077-af42-b02f32b1ea3d"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:51.743467 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5bfa4e20-2535-42a7-8f77-a240c594eab7 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:51.750121 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:23:51.754093 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5bfa4e20-2535-42a7-8f77-a240c594eab7 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:51.756463 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5bfa4e20-2535-42a7-8f77-a240c594eab7 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:51.757573 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5bfa4e20-2535-42a7-8f77-a240c594eab7 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:51.758778 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5bfa4e20-2535-42a7-8f77-a240c594eab7 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:51.779699 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-da9bd18d-f5f9-4d1b-a47b-07bf10e41024 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74142c97f164df080e0056b5953cf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82362419c7974c36b6931ccbc274a646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:51.799073 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-da9bd18d-f5f9-4d1b-a47b-07bf10e41024 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] 10.222.0.57 "GET /compute/v2.1/servers/8d246564-436e-480a-989e-b67ec47fa8e9" status: 200 len: 1316 microversion: 2.1 time: 0.612898 Jul 18 02:23:51.800630 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1302/2566] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:51 2022] GET /compute/v2.1/servers/8d246564-436e-480a-989e-b67ec47fa8e9 => generated 1316 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:52.128919 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5bfa4e20-2535-42a7-8f77-a240c594eab7 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "POST /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.394875 Jul 18 02:23:52.130429 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1265/2567] 10.222.0.57 () {60 vars in 1322 bytes} [Mon Jul 18 02:23:51 2022] POST /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a/os-volume_attachments => generated 194 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:23:52.213207 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8770a540-01cf-4813-9835-45cba3f65a9c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:52.223250 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8770a540-01cf-4813-9835-45cba3f65a9c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:52.251865 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8770a540-01cf-4813-9835-45cba3f65a9c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:52.258911 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8770a540-01cf-4813-9835-45cba3f65a9c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:52.260368 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8770a540-01cf-4813-9835-45cba3f65a9c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:52.261200 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8770a540-01cf-4813-9835-45cba3f65a9c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:52.747952 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-012bfe2f-158c-481c-9263-ce38d3353d09 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:52.751492 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-012bfe2f-158c-481c-9263-ce38d3353d09 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] [instance: 49facc8e-4cfc-4522-90d3-38c9f152e390] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:52.766809 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-012bfe2f-158c-481c-9263-ce38d3353d09 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:52.768644 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-012bfe2f-158c-481c-9263-ce38d3353d09 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:52.773078 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-012bfe2f-158c-481c-9263-ce38d3353d09 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:52.774110 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-012bfe2f-158c-481c-9263-ce38d3353d09 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:53.307110 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8770a540-01cf-4813-9835-45cba3f65a9c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:53.330757 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8770a540-01cf-4813-9835-45cba3f65a9c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1470 microversion: 2.1 time: 1.134244 Jul 18 02:23:53.337591 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1303/2568] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:52 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1470 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:53.344601 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9e9cd01a-9749-4aa9-a7c2-452cb424fffa tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:53.358440 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9e9cd01a-9749-4aa9-a7c2-452cb424fffa tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] [instance: 8d246564-436e-480a-989e-b67ec47fa8e9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:53.384304 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e9cd01a-9749-4aa9-a7c2-452cb424fffa tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:53.394454 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e9cd01a-9749-4aa9-a7c2-452cb424fffa tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:53.404694 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e9cd01a-9749-4aa9-a7c2-452cb424fffa tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:53.405661 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e9cd01a-9749-4aa9-a7c2-452cb424fffa tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:53.667837 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-012bfe2f-158c-481c-9263-ce38d3353d09 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b89b2c768847589c4d41aba88208a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d788b28fd2c4cf1826d908059f04c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:53.683465 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-012bfe2f-158c-481c-9263-ce38d3353d09 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] 10.222.0.57 "GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390" status: 200 len: 1402 microversion: 2.1 time: 0.949436 Jul 18 02:23:53.689336 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1266/2569] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:52 2022] GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390 => generated 1402 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:54.378682 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4749d0f2-6e76-40f4-a295-f51fe6f96787 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:54.379423 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4749d0f2-6e76-40f4-a295-f51fe6f96787 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:54.388546 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4749d0f2-6e76-40f4-a295-f51fe6f96787 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:54.389462 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4749d0f2-6e76-40f4-a295-f51fe6f96787 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:54.403546 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4749d0f2-6e76-40f4-a295-f51fe6f96787 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:54.404694 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4749d0f2-6e76-40f4-a295-f51fe6f96787 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:54.810875 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9e9cd01a-9749-4aa9-a7c2-452cb424fffa tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74142c97f164df080e0056b5953cf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82362419c7974c36b6931ccbc274a646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:54.825189 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9e9cd01a-9749-4aa9-a7c2-452cb424fffa tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] 10.222.0.57 "GET /compute/v2.1/servers/8d246564-436e-480a-989e-b67ec47fa8e9" status: 200 len: 1316 microversion: 2.1 time: 1.485561 Jul 18 02:23:54.826443 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1304/2570] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:53 2022] GET /compute/v2.1/servers/8d246564-436e-480a-989e-b67ec47fa8e9 => generated 1316 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:54.832638 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e261ce68-f9f2-4ed9-99b0-c2cb2f06eda0 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:54.834279 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e261ce68-f9f2-4ed9-99b0-c2cb2f06eda0 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] [instance: 49facc8e-4cfc-4522-90d3-38c9f152e390] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:54.841650 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e261ce68-f9f2-4ed9-99b0-c2cb2f06eda0 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:54.842398 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e261ce68-f9f2-4ed9-99b0-c2cb2f06eda0 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:54.844002 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e261ce68-f9f2-4ed9-99b0-c2cb2f06eda0 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:54.844675 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e261ce68-f9f2-4ed9-99b0-c2cb2f06eda0 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:55.957298 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e261ce68-f9f2-4ed9-99b0-c2cb2f06eda0 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b89b2c768847589c4d41aba88208a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d788b28fd2c4cf1826d908059f04c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:55.974363 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e261ce68-f9f2-4ed9-99b0-c2cb2f06eda0 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] 10.222.0.57 "GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390" status: 200 len: 1402 microversion: 2.1 time: 1.146222 Jul 18 02:23:55.977735 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1305/2571] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:54 2022] GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390 => generated 1402 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:56.010159 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-eceffedc-f952-436b-b9ff-277c9d5aa3bf tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:56.010915 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-eceffedc-f952-436b-b9ff-277c9d5aa3bf tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] [instance: 8d246564-436e-480a-989e-b67ec47fa8e9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:56.019176 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eceffedc-f952-436b-b9ff-277c9d5aa3bf tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:56.019635 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eceffedc-f952-436b-b9ff-277c9d5aa3bf tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:56.020431 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eceffedc-f952-436b-b9ff-277c9d5aa3bf tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:56.020879 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eceffedc-f952-436b-b9ff-277c9d5aa3bf tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:56.546465 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4749d0f2-6e76-40f4-a295-f51fe6f96787 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:56.591850 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4749d0f2-6e76-40f4-a295-f51fe6f96787 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1462 microversion: 2.1 time: 2.238775 Jul 18 02:23:56.595057 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1267/2572] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:54 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1462 bytes in 2244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:56.624932 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1640f93c-c331-4f38-80bb-839222040a00 tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:56.626142 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1640f93c-c331-4f38-80bb-839222040a00 tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:56.639837 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1640f93c-c331-4f38-80bb-839222040a00 tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:56.640732 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1640f93c-c331-4f38-80bb-839222040a00 tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:56.642402 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1640f93c-c331-4f38-80bb-839222040a00 tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:56.643459 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1640f93c-c331-4f38-80bb-839222040a00 tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:57.424109 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-eceffedc-f952-436b-b9ff-277c9d5aa3bf tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74142c97f164df080e0056b5953cf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82362419c7974c36b6931ccbc274a646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:57.455399 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-eceffedc-f952-436b-b9ff-277c9d5aa3bf tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] 10.222.0.57 "GET /compute/v2.1/servers/8d246564-436e-480a-989e-b67ec47fa8e9" status: 200 len: 1316 microversion: 2.1 time: 1.460806 Jul 18 02:23:57.462353 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1306/2573] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:55 2022] GET /compute/v2.1/servers/8d246564-436e-480a-989e-b67ec47fa8e9 => generated 1316 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:57.469584 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-129604c1-0eaa-4d6b-a0a5-d67cf2e2d347 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:57.470702 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-129604c1-0eaa-4d6b-a0a5-d67cf2e2d347 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] [instance: 49facc8e-4cfc-4522-90d3-38c9f152e390] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:57.478328 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-129604c1-0eaa-4d6b-a0a5-d67cf2e2d347 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:57.479020 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-129604c1-0eaa-4d6b-a0a5-d67cf2e2d347 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:57.479971 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-129604c1-0eaa-4d6b-a0a5-d67cf2e2d347 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:57.480569 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-129604c1-0eaa-4d6b-a0a5-d67cf2e2d347 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:57.641996 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1640f93c-c331-4f38-80bb-839222040a00 tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1613 microversion: 2.1 time: 1.023419 Jul 18 02:23:57.657530 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1268/2574] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:56 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1613 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:57.690459 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ba458534-bba7-45a9-9a35-4edf01edae45 tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Calling method '.version_select at 0x7ff49be339d0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:57.700713 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba458534-bba7-45a9-9a35-4edf01edae45 tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:57.702789 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba458534-bba7-45a9-9a35-4edf01edae45 tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:57.726961 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ba458534-bba7-45a9-9a35-4edf01edae45 tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] 10.222.0.57 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.049071 Jul 18 02:23:57.729365 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1269/2575] 10.222.0.57 () {58 vars in 1142 bytes} [Mon Jul 18 02:23:57 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:23:57.990733 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9a8e4285-064f-4293-bb21-f1ff7711200d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1244159583", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:58.206052 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-9a8e4285-064f-4293-bb21-f1ff7711200d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] validate_networks() for None {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:23:58.632672 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-129604c1-0eaa-4d6b-a0a5-d67cf2e2d347 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b89b2c768847589c4d41aba88208a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d788b28fd2c4cf1826d908059f04c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:58.646738 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-129604c1-0eaa-4d6b-a0a5-d67cf2e2d347 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] 10.222.0.57 "GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390" status: 200 len: 1402 microversion: 2.1 time: 1.181071 Jul 18 02:23:58.661498 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1307/2576] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:57 2022] GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390 => generated 1402 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:58.667143 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-4d11670a-2bd1-452c-8590-29cd79c743db req-bd0ab841-2514-4bd0-8458-c6305acad808 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d246564-436e-480a-989e-b67ec47fa8e9", "name": "network-vif-plugged", "status": "completed", "tag": "a51a1193-20b8-4c79-916d-a97e87bdbc22"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:58.689677 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-4d11670a-2bd1-452c-8590-29cd79c743db req-bd0ab841-2514-4bd0-8458-c6305acad808 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:58.691851 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-4d11670a-2bd1-452c-8590-29cd79c743db req-bd0ab841-2514-4bd0-8458-c6305acad808 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:58.717392 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-4d11670a-2bd1-452c-8590-29cd79c743db req-bd0ab841-2514-4bd0-8458-c6305acad808 service nova] Creating event network-vif-plugged:a51a1193-20b8-4c79-916d-a97e87bdbc22 for instance 8d246564-436e-480a-989e-b67ec47fa8e9 on n-h2-465891-3 Jul 18 02:23:58.726003 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-4d11670a-2bd1-452c-8590-29cd79c743db req-bd0ab841-2514-4bd0-8458-c6305acad808 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062762 Jul 18 02:23:58.728812 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1308/2577] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:23:58.737958 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0c473492-5c42-4c15-9e91-1a6af00d7d52 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:58.739339 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0c473492-5c42-4c15-9e91-1a6af00d7d52 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] [instance: 8d246564-436e-480a-989e-b67ec47fa8e9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:58.802007 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c473492-5c42-4c15-9e91-1a6af00d7d52 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:58.807680 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c473492-5c42-4c15-9e91-1a6af00d7d52 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:58.811782 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c473492-5c42-4c15-9e91-1a6af00d7d52 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:58.819293 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c473492-5c42-4c15-9e91-1a6af00d7d52 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:59.731694 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-9a8e4285-064f-4293-bb21-f1ff7711200d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:23:59.746010 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-9a8e4285-064f-4293-bb21-f1ff7711200d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:23:59.747595 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-9a8e4285-064f-4293-bb21-f1ff7711200d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:23:59.753416 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-9a8e4285-064f-4293-bb21-f1ff7711200d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:23:59.757491 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-9a8e4285-064f-4293-bb21-f1ff7711200d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:23:59.801136 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9a8e4285-064f-4293-bb21-f1ff7711200d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:59.808096 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9a8e4285-064f-4293-bb21-f1ff7711200d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:59.810466 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9a8e4285-064f-4293-bb21-f1ff7711200d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:59.811424 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9a8e4285-064f-4293-bb21-f1ff7711200d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:59.848330 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0c473492-5c42-4c15-9e91-1a6af00d7d52 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74142c97f164df080e0056b5953cf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82362419c7974c36b6931ccbc274a646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:59.876771 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0c473492-5c42-4c15-9e91-1a6af00d7d52 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] 10.222.0.57 "GET /compute/v2.1/servers/8d246564-436e-480a-989e-b67ec47fa8e9" status: 200 len: 1316 microversion: 2.1 time: 1.145516 Jul 18 02:23:59.901906 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1309/2578] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:58 2022] GET /compute/v2.1/servers/8d246564-436e-480a-989e-b67ec47fa8e9 => generated 1316 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:59.929604 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8dfaab86-4e6a-4134-be68-852823c115b4 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:59.934580 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8dfaab86-4e6a-4134-be68-852823c115b4 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] [instance: 49facc8e-4cfc-4522-90d3-38c9f152e390] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:59.950798 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-9a8e4285-064f-4293-bb21-f1ff7711200d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Getting quotas for project d7ff962145954166b4c5efb0a0f1edff. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:23:59.976908 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8dfaab86-4e6a-4134-be68-852823c115b4 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:59.980505 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8dfaab86-4e6a-4134-be68-852823c115b4 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:59.980505 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8dfaab86-4e6a-4134-be68-852823c115b4 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:59.991344 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8dfaab86-4e6a-4134-be68-852823c115b4 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:59.995897 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-9a8e4285-064f-4293-bb21-f1ff7711200d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Getting quotas for user dbeea54ebc4749aba59afb60feaa6159 and project d7ff962145954166b4c5efb0a0f1edff. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:24:00.044774 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9a8e4285-064f-4293-bb21-f1ff7711200d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:24:00.057071 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9a8e4285-064f-4293-bb21-f1ff7711200d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:24:00.166966 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9a8e4285-064f-4293-bb21-f1ff7711200d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.181547 Jul 18 02:24:00.176625 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1270/2579] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:23:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2196 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:24:00.181892 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-33b30f50-47be-4e6b-b193-f63fadf7e15b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:00.195625 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-33b30f50-47be-4e6b-b193-f63fadf7e15b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:00.373334 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-33b30f50-47be-4e6b-b193-f63fadf7e15b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:00.382366 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-33b30f50-47be-4e6b-b193-f63fadf7e15b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1213 microversion: 2.1 time: 0.204406 Jul 18 02:24:00.387604 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1271/2580] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:00 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1213 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:00.928436 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-98a5d08c-ec4d-425b-95d6-ab1b0bc565f1 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:00.929501 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-98a5d08c-ec4d-425b-95d6-ab1b0bc565f1 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] [instance: 8d246564-436e-480a-989e-b67ec47fa8e9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:00.952488 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-98a5d08c-ec4d-425b-95d6-ab1b0bc565f1 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:00.953308 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-98a5d08c-ec4d-425b-95d6-ab1b0bc565f1 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:00.956308 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-98a5d08c-ec4d-425b-95d6-ab1b0bc565f1 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:00.957876 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-98a5d08c-ec4d-425b-95d6-ab1b0bc565f1 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:01.305557 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8dfaab86-4e6a-4134-be68-852823c115b4 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b89b2c768847589c4d41aba88208a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d788b28fd2c4cf1826d908059f04c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:01.325211 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8dfaab86-4e6a-4134-be68-852823c115b4 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] 10.222.0.57 "GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390" status: 200 len: 1402 microversion: 2.1 time: 1.431351 Jul 18 02:24:01.335049 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1310/2581] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:59 2022] GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390 => generated 1402 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:01.404575 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-98a5d08c-ec4d-425b-95d6-ab1b0bc565f1 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74142c97f164df080e0056b5953cf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82362419c7974c36b6931ccbc274a646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:01.419020 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-98a5d08c-ec4d-425b-95d6-ab1b0bc565f1 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] 10.222.0.57 "GET /compute/v2.1/servers/8d246564-436e-480a-989e-b67ec47fa8e9" status: 200 len: 1504 microversion: 2.1 time: 0.502538 Jul 18 02:24:01.421332 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1272/2582] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:00 2022] GET /compute/v2.1/servers/8d246564-436e-480a-989e-b67ec47fa8e9 => generated 1504 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:01.450283 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-41987de1-8bbf-4a22-bcb3-00ea285cabe4 req-15f1a0b6-f53d-4ca5-b182-6afe7c3272fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49facc8e-4cfc-4522-90d3-38c9f152e390", "name": "network-vif-plugged", "status": "completed", "tag": "44254fc9-6729-4435-8c9a-c405df2363b5"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:01.493561 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-41987de1-8bbf-4a22-bcb3-00ea285cabe4 req-15f1a0b6-f53d-4ca5-b182-6afe7c3272fe service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:01.496039 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-41987de1-8bbf-4a22-bcb3-00ea285cabe4 req-15f1a0b6-f53d-4ca5-b182-6afe7c3272fe service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:01.513566 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:24:01.544496 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-41987de1-8bbf-4a22-bcb3-00ea285cabe4 req-15f1a0b6-f53d-4ca5-b182-6afe7c3272fe service nova] Creating event network-vif-plugged:44254fc9-6729-4435-8c9a-c405df2363b5 for instance 49facc8e-4cfc-4522-90d3-38c9f152e390 on n-h1-465891-3 Jul 18 02:24:01.563167 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-41987de1-8bbf-4a22-bcb3-00ea285cabe4 req-15f1a0b6-f53d-4ca5-b182-6afe7c3272fe service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138032 Jul 18 02:24:01.571399 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1273/2583] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:01.583624 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bf9464f8-01b1-4f39-9f8b-6a7c905551b2 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:01.587941 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bf9464f8-01b1-4f39-9f8b-6a7c905551b2 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:01.607635 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bf9464f8-01b1-4f39-9f8b-6a7c905551b2 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:01.608098 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bf9464f8-01b1-4f39-9f8b-6a7c905551b2 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:01.608902 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bf9464f8-01b1-4f39-9f8b-6a7c905551b2 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:01.611001 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bf9464f8-01b1-4f39-9f8b-6a7c905551b2 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:01.730915 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9e825f40-9dc9-47eb-a9f5-77e9d084a2e4 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-2062439942", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:01.853761 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-9e825f40-9dc9-47eb-a9f5-77e9d084a2e4 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] validate_networks() for None {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:24:02.127760 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bf9464f8-01b1-4f39-9f8b-6a7c905551b2 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:02.156169 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bf9464f8-01b1-4f39-9f8b-6a7c905551b2 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1209 microversion: 2.1 time: 0.582065 Jul 18 02:24:02.156688 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1274/2584] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:01 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1209 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:02.181450 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-286ca01e-3440-4690-993f-4b1ed0b3837d tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:02.183638 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-286ca01e-3440-4690-993f-4b1ed0b3837d tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] [instance: 8d246564-436e-480a-989e-b67ec47fa8e9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:02.208046 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-286ca01e-3440-4690-993f-4b1ed0b3837d tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:02.209321 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-286ca01e-3440-4690-993f-4b1ed0b3837d tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:02.213213 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-286ca01e-3440-4690-993f-4b1ed0b3837d tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:02.223178 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-286ca01e-3440-4690-993f-4b1ed0b3837d tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:02.324481 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-286ca01e-3440-4690-993f-4b1ed0b3837d tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] [instance: 8d246564-436e-480a-989e-b67ec47fa8e9] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:24:02.610469 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-286ca01e-3440-4690-993f-4b1ed0b3837d tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8d246564-436e-480a-989e-b67ec47fa8e9" status: 204 len: 0 microversion: 2.1 time: 0.451468 Jul 18 02:24:02.617106 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1275/2585] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:24:02 2022] DELETE /compute/v2.1/servers/8d246564-436e-480a-989e-b67ec47fa8e9 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:24:02.628442 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-192d92a7-91a6-4221-8dc0-ed49961f792d tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:02.649554 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-192d92a7-91a6-4221-8dc0-ed49961f792d tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] [instance: 49facc8e-4cfc-4522-90d3-38c9f152e390] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:02.686935 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-192d92a7-91a6-4221-8dc0-ed49961f792d tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:02.694340 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-192d92a7-91a6-4221-8dc0-ed49961f792d tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:02.696181 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-192d92a7-91a6-4221-8dc0-ed49961f792d tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:02.698292 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-192d92a7-91a6-4221-8dc0-ed49961f792d tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:03.107279 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-9e825f40-9dc9-47eb-a9f5-77e9d084a2e4 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:24:03.110119 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-9e825f40-9dc9-47eb-a9f5-77e9d084a2e4 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:24:03.111760 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-9e825f40-9dc9-47eb-a9f5-77e9d084a2e4 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:24:03.113013 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-9e825f40-9dc9-47eb-a9f5-77e9d084a2e4 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:24:03.116539 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-9e825f40-9dc9-47eb-a9f5-77e9d084a2e4 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:24:03.189558 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e825f40-9dc9-47eb-a9f5-77e9d084a2e4 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:03.190434 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e825f40-9dc9-47eb-a9f5-77e9d084a2e4 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:03.191998 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e825f40-9dc9-47eb-a9f5-77e9d084a2e4 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:03.192790 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e825f40-9dc9-47eb-a9f5-77e9d084a2e4 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:03.249868 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-192d92a7-91a6-4221-8dc0-ed49961f792d tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b89b2c768847589c4d41aba88208a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d788b28fd2c4cf1826d908059f04c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:03.250456 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-9e825f40-9dc9-47eb-a9f5-77e9d084a2e4 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Getting quotas for project 2db663b2f2234793bb4038ad90b2b972. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:24:03.257154 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-9e825f40-9dc9-47eb-a9f5-77e9d084a2e4 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Getting quotas for user f6646c45c9574550b601a37de6fc0321 and project 2db663b2f2234793bb4038ad90b2b972. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:24:03.279619 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-192d92a7-91a6-4221-8dc0-ed49961f792d tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] 10.222.0.57 "GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390" status: 200 len: 1402 microversion: 2.1 time: 0.659548 Jul 18 02:24:03.280987 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1276/2586] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:02 2022] GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390 => generated 1402 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:03.291767 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9e825f40-9dc9-47eb-a9f5-77e9d084a2e4 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:24:03.293424 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-48fac491-fed4-49ca-b7fc-10ee9b3e99a2 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:03.294753 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-48fac491-fed4-49ca-b7fc-10ee9b3e99a2 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] [instance: 8d246564-436e-480a-989e-b67ec47fa8e9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:03.297210 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9e825f40-9dc9-47eb-a9f5-77e9d084a2e4 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] [instance: 7b1fb401-75fb-4d72-96ee-b5a5f1146882] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:24:03.320522 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-48fac491-fed4-49ca-b7fc-10ee9b3e99a2 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:03.328716 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-48fac491-fed4-49ca-b7fc-10ee9b3e99a2 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:03.331034 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-48fac491-fed4-49ca-b7fc-10ee9b3e99a2 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:03.331826 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-48fac491-fed4-49ca-b7fc-10ee9b3e99a2 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:03.393024 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9e825f40-9dc9-47eb-a9f5-77e9d084a2e4 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.055932 Jul 18 02:24:03.399144 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1311/2587] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:24:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:24:03.405221 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-53ba7601-8280-41c0-8e37-12c8f5819dbd tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:03.406474 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-53ba7601-8280-41c0-8e37-12c8f5819dbd tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:03.420381 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-53ba7601-8280-41c0-8e37-12c8f5819dbd tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:03.421097 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-53ba7601-8280-41c0-8e37-12c8f5819dbd tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:03.422590 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-53ba7601-8280-41c0-8e37-12c8f5819dbd tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:03.423379 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-53ba7601-8280-41c0-8e37-12c8f5819dbd tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:03.598479 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-53ba7601-8280-41c0-8e37-12c8f5819dbd tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:03.611036 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-53ba7601-8280-41c0-8e37-12c8f5819dbd tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1271 microversion: 2.1 time: 0.212124 Jul 18 02:24:03.612096 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1312/2588] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:03 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1271 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:03.620594 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3b9a5555-2cf7-4462-b662-127138aa738f tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:03.622314 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3b9a5555-2cf7-4462-b662-127138aa738f tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] [instance: 7b1fb401-75fb-4d72-96ee-b5a5f1146882] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:04.225902 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-48fac491-fed4-49ca-b7fc-10ee9b3e99a2 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74142c97f164df080e0056b5953cf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82362419c7974c36b6931ccbc274a646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:04.258392 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-48fac491-fed4-49ca-b7fc-10ee9b3e99a2 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] 10.222.0.57 "GET /compute/v2.1/servers/8d246564-436e-480a-989e-b67ec47fa8e9" status: 200 len: 1510 microversion: 2.1 time: 0.962566 Jul 18 02:24:04.259881 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1277/2589] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:03 2022] GET /compute/v2.1/servers/8d246564-436e-480a-989e-b67ec47fa8e9 => generated 1510 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:04.298874 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3b9a5555-2cf7-4462-b662-127138aa738f tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6646c45c9574550b601a37de6fc0321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db663b2f2234793bb4038ad90b2b972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:04.303727 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2f24144e-2b6e-4fcc-b831-dbbeb3c1b189 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:04.310891 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3b9a5555-2cf7-4462-b662-127138aa738f tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] 10.222.0.57 "GET /compute/v2.1/servers/7b1fb401-75fb-4d72-96ee-b5a5f1146882" status: 200 len: 1214 microversion: 2.1 time: 0.695351 Jul 18 02:24:04.311493 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2f24144e-2b6e-4fcc-b831-dbbeb3c1b189 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] [instance: 49facc8e-4cfc-4522-90d3-38c9f152e390] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:04.322108 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1313/2590] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:03 2022] GET /compute/v2.1/servers/7b1fb401-75fb-4d72-96ee-b5a5f1146882 => generated 1214 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:04.333831 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2f24144e-2b6e-4fcc-b831-dbbeb3c1b189 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:04.334920 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2f24144e-2b6e-4fcc-b831-dbbeb3c1b189 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:04.336678 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2f24144e-2b6e-4fcc-b831-dbbeb3c1b189 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:04.339197 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2f24144e-2b6e-4fcc-b831-dbbeb3c1b189 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:04.635927 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1848015c-a9cf-44bb-99a1-785a0ada31e5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:04.637099 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1848015c-a9cf-44bb-99a1-785a0ada31e5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:04.665711 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1848015c-a9cf-44bb-99a1-785a0ada31e5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:04.666547 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1848015c-a9cf-44bb-99a1-785a0ada31e5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:04.676220 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1848015c-a9cf-44bb-99a1-785a0ada31e5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:04.677421 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1848015c-a9cf-44bb-99a1-785a0ada31e5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:05.048823 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1848015c-a9cf-44bb-99a1-785a0ada31e5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:05.096834 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1848015c-a9cf-44bb-99a1-785a0ada31e5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1271 microversion: 2.1 time: 0.465466 Jul 18 02:24:05.121970 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1314/2591] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:04 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1271 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:05.296356 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8e0090ac-dfd5-47df-ba9e-06a56cf058e3 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:05.303028 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8e0090ac-dfd5-47df-ba9e-06a56cf058e3 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] [instance: 8d246564-436e-480a-989e-b67ec47fa8e9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:05.307491 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2f24144e-2b6e-4fcc-b831-dbbeb3c1b189 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b89b2c768847589c4d41aba88208a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d788b28fd2c4cf1826d908059f04c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:05.317387 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2f24144e-2b6e-4fcc-b831-dbbeb3c1b189 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] 10.222.0.57 "GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390" status: 200 len: 1590 microversion: 2.1 time: 1.022804 Jul 18 02:24:05.318771 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1278/2592] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:04 2022] GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390 => generated 1590 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:24:05.329647 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f15ccd5e-ba85-4176-9703-83459201e4d3 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:05.330600 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f15ccd5e-ba85-4176-9703-83459201e4d3 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] [instance: 7b1fb401-75fb-4d72-96ee-b5a5f1146882] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:05.331103 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8e0090ac-dfd5-47df-ba9e-06a56cf058e3 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:05.333406 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8e0090ac-dfd5-47df-ba9e-06a56cf058e3 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:05.336485 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8e0090ac-dfd5-47df-ba9e-06a56cf058e3 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:05.343993 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8e0090ac-dfd5-47df-ba9e-06a56cf058e3 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:05.376547 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f15ccd5e-ba85-4176-9703-83459201e4d3 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:05.377041 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f15ccd5e-ba85-4176-9703-83459201e4d3 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:05.377971 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f15ccd5e-ba85-4176-9703-83459201e4d3 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:05.378434 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f15ccd5e-ba85-4176-9703-83459201e4d3 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:05.805231 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f15ccd5e-ba85-4176-9703-83459201e4d3 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6646c45c9574550b601a37de6fc0321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db663b2f2234793bb4038ad90b2b972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:05.815936 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f15ccd5e-ba85-4176-9703-83459201e4d3 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] 10.222.0.57 "GET /compute/v2.1/servers/7b1fb401-75fb-4d72-96ee-b5a5f1146882" status: 200 len: 1274 microversion: 2.1 time: 0.490180 Jul 18 02:24:05.817734 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1279/2593] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:05 2022] GET /compute/v2.1/servers/7b1fb401-75fb-4d72-96ee-b5a5f1146882 => generated 1274 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:05.831563 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-656d34a2-1af6-4db3-832c-69dab44eafd3 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:05.832628 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-656d34a2-1af6-4db3-832c-69dab44eafd3 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] [instance: 49facc8e-4cfc-4522-90d3-38c9f152e390] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:05.844987 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-656d34a2-1af6-4db3-832c-69dab44eafd3 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:05.845718 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-656d34a2-1af6-4db3-832c-69dab44eafd3 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:05.847009 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-656d34a2-1af6-4db3-832c-69dab44eafd3 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:05.848207 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-656d34a2-1af6-4db3-832c-69dab44eafd3 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:06.256631 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-656d34a2-1af6-4db3-832c-69dab44eafd3 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] 10.222.0.57 "GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.435732 Jul 18 02:24:06.257759 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1280/2594] 10.222.0.57 () {58 vars in 1274 bytes} [Mon Jul 18 02:24:05 2022] GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390/os-interface => generated 285 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:06.282676 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bb6d87bd-1591-492a-86a1-d1e0c8759e8b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:06.283926 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bb6d87bd-1591-492a-86a1-d1e0c8759e8b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:06.294647 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb6d87bd-1591-492a-86a1-d1e0c8759e8b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:06.295793 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb6d87bd-1591-492a-86a1-d1e0c8759e8b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:06.296729 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb6d87bd-1591-492a-86a1-d1e0c8759e8b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:06.297260 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb6d87bd-1591-492a-86a1-d1e0c8759e8b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:06.508987 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8e0090ac-dfd5-47df-ba9e-06a56cf058e3 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74142c97f164df080e0056b5953cf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82362419c7974c36b6931ccbc274a646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:06.538429 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8e0090ac-dfd5-47df-ba9e-06a56cf058e3 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] 10.222.0.57 "GET /compute/v2.1/servers/8d246564-436e-480a-989e-b67ec47fa8e9" status: 200 len: 1510 microversion: 2.1 time: 1.251728 Jul 18 02:24:06.541134 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1315/2595] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:05 2022] GET /compute/v2.1/servers/8d246564-436e-480a-989e-b67ec47fa8e9 => generated 1510 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:06.696043 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bb6d87bd-1591-492a-86a1-d1e0c8759e8b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:06.722697 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bb6d87bd-1591-492a-86a1-d1e0c8759e8b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1271 microversion: 2.1 time: 0.451667 Jul 18 02:24:06.742265 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1281/2596] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:06 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1271 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:06.850591 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-23884e6e-224f-4ec7-bd7f-cff31303815a tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:06.860862 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-23884e6e-224f-4ec7-bd7f-cff31303815a tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] [instance: 7b1fb401-75fb-4d72-96ee-b5a5f1146882] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:06.926674 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-23884e6e-224f-4ec7-bd7f-cff31303815a tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:06.927218 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-23884e6e-224f-4ec7-bd7f-cff31303815a tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:06.928088 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-23884e6e-224f-4ec7-bd7f-cff31303815a tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:06.934863 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-23884e6e-224f-4ec7-bd7f-cff31303815a tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:06.974314 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-fe6566b3-1736-4838-b2b8-e13e5b5db3d3 req-684b4efa-76bd-4b49-b708-6f41bafc915c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d246564-436e-480a-989e-b67ec47fa8e9", "name": "network-vif-deleted", "tag": "a51a1193-20b8-4c79-916d-a97e87bdbc22"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:07.020789 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-fe6566b3-1736-4838-b2b8-e13e5b5db3d3 req-684b4efa-76bd-4b49-b708-6f41bafc915c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:07.023704 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-fe6566b3-1736-4838-b2b8-e13e5b5db3d3 req-684b4efa-76bd-4b49-b708-6f41bafc915c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:07.085685 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-fe6566b3-1736-4838-b2b8-e13e5b5db3d3 req-684b4efa-76bd-4b49-b708-6f41bafc915c service nova] Creating event network-vif-deleted:a51a1193-20b8-4c79-916d-a97e87bdbc22 for instance 8d246564-436e-480a-989e-b67ec47fa8e9 on n-h2-465891-3 Jul 18 02:24:07.107298 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-fe6566b3-1736-4838-b2b8-e13e5b5db3d3 req-684b4efa-76bd-4b49-b708-6f41bafc915c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.404899 Jul 18 02:24:07.114574 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1316/2597] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:24:07.278554 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-23884e6e-224f-4ec7-bd7f-cff31303815a tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6646c45c9574550b601a37de6fc0321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db663b2f2234793bb4038ad90b2b972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:07.288424 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-23884e6e-224f-4ec7-bd7f-cff31303815a tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] 10.222.0.57 "GET /compute/v2.1/servers/7b1fb401-75fb-4d72-96ee-b5a5f1146882" status: 200 len: 1272 microversion: 2.1 time: 0.446941 Jul 18 02:24:07.299857 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1282/2598] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:06 2022] GET /compute/v2.1/servers/7b1fb401-75fb-4d72-96ee-b5a5f1146882 => generated 1272 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:07.576465 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-55c191da-b57e-4e83-b21f-3ffdc0e82741 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:07.578468 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-55c191da-b57e-4e83-b21f-3ffdc0e82741 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] [instance: 8d246564-436e-480a-989e-b67ec47fa8e9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:07.596718 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-55c191da-b57e-4e83-b21f-3ffdc0e82741 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:07.597556 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-55c191da-b57e-4e83-b21f-3ffdc0e82741 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:07.599147 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-55c191da-b57e-4e83-b21f-3ffdc0e82741 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:07.600121 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-55c191da-b57e-4e83-b21f-3ffdc0e82741 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:07.650034 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-55c191da-b57e-4e83-b21f-3ffdc0e82741 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] HTTP exception thrown: Instance 8d246564-436e-480a-989e-b67ec47fa8e9 could not be found. Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-55c191da-b57e-4e83-b21f-3ffdc0e82741 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Request method failure captured: Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/8d246564-436e-480a-989e-b67ec47fa8e9 HTTP/1.1 Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MQldYfmcEQJfvjpxTABClOtPd9lbKKbVGs24SRMX-SQblsZq3CtejrE_YA6VGg0vtCe193V4PfapmtUD22KAtF20h4QjanunhLX2U6bp1iT82lz4IWsPi8FxpdTbdOtA5ag8-AGm1ytYxxHYNizcfmkMAsTf25Hq9GenCqeXOSuEI8 Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 82362419c7974c36b6931ccbc274a646 Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ImagesNegativeTestJSON-85814598 Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_82362419c7974c36b6931ccbc274a646"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/82362419c7974c36b6931ccbc274a646"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/82362419c7974c36b6931ccbc274a646"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/82362419c7974c36b6931ccbc274a646"}]}] Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ImagesNegativeTestJSON-85814598 Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 82362419c7974c36b6931ccbc274a646 Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-85814598 Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ImagesNegativeTestJSON-85814598-project Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: f74142c97f164df080e0056b5953cf5f Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ImagesNegativeTestJSON-85814598-project Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 8d246564-436e-480a-989e-b67ec47fa8e9 could not be found. Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '8d246564-436e-480a-989e-b67ec47fa8e9'} Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d246564-436e-480a-989e-b67ec47fa8e9 could not be found. Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d246564-436e-480a-989e-b67ec47fa8e9 could not be found. Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:07.653348 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:24:07.662234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:07.662234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:07.662234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:07.662234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:24:07.662234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:24:07.662234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d246564-436e-480a-989e-b67ec47fa8e9 could not be found. Jul 18 02:24:07.662234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:24:07.666958 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-55c191da-b57e-4e83-b21f-3ffdc0e82741 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Returning 404 to user: Instance 8d246564-436e-480a-989e-b67ec47fa8e9 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:24:07.667269 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-55c191da-b57e-4e83-b21f-3ffdc0e82741 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] 10.222.0.57 "GET /compute/v2.1/servers/8d246564-436e-480a-989e-b67ec47fa8e9" status: 404 len: 111 microversion: 2.1 time: 0.101821 Jul 18 02:24:07.669443 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1317/2599] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:07 2022] GET /compute/v2.1/servers/8d246564-436e-480a-989e-b67ec47fa8e9 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:24:07.682229 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ac885dc8-6970-4660-8882-edbec5eb898b tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-864470065", "metadata": {"image_type": "test"}}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:07.685023 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ac885dc8-6970-4660-8882-edbec5eb898b tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] [instance: 8d246564-436e-480a-989e-b67ec47fa8e9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:07.697320 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ac885dc8-6970-4660-8882-edbec5eb898b tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:07.700886 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ac885dc8-6970-4660-8882-edbec5eb898b tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:07.703436 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ac885dc8-6970-4660-8882-edbec5eb898b tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:07.705155 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ac885dc8-6970-4660-8882-edbec5eb898b tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:07.744466 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-ac885dc8-6970-4660-8882-edbec5eb898b tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] HTTP exception thrown: Instance 8d246564-436e-480a-989e-b67ec47fa8e9 could not be found. Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ac885dc8-6970-4660-8882-edbec5eb898b tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Request method failure captured: Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers/8d246564-436e-480a-989e-b67ec47fa8e9/action HTTP/1.1 Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 111 Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MQldYfmcEQJfvjpxTABClOtPd9lbKKbVGs24SRMX-SQblsZq3CtejrE_YA6VGg0vtCe193V4PfapmtUD22KAtF20h4QjanunhLX2U6bp1iT82lz4IWsPi8FxpdTbdOtA5ag8-AGm1ytYxxHYNizcfmkMAsTf25Hq9GenCqeXOSuEI8 Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 82362419c7974c36b6931ccbc274a646 Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ImagesNegativeTestJSON-85814598 Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_82362419c7974c36b6931ccbc274a646"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/82362419c7974c36b6931ccbc274a646"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/82362419c7974c36b6931ccbc274a646"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/82362419c7974c36b6931ccbc274a646"}]}] Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ImagesNegativeTestJSON-85814598 Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 82362419c7974c36b6931ccbc274a646 Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-85814598 Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ImagesNegativeTestJSON-85814598-project Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: f74142c97f164df080e0056b5953cf5f Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ImagesNegativeTestJSON-85814598-project Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-864470065", "metadata": {"image_type": "test"}}} Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 8d246564-436e-480a-989e-b67ec47fa8e9 could not be found. Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '8d246564-436e-480a-989e-b67ec47fa8e9', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-864470065', 'metadata': {'image_type': 'test'}}}} Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d246564-436e-480a-989e-b67ec47fa8e9 could not be found. Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 18 02:24:07.750927 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:24:07.774651 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:24:07.774651 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:24:07.774651 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:24:07.774651 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d246564-436e-480a-989e-b67ec47fa8e9 could not be found. Jul 18 02:24:07.774651 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:07.774651 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:07.774651 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:07.774651 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:07.774651 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:07.774651 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:07.774651 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:24:07.774651 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:24:07.774651 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d246564-436e-480a-989e-b67ec47fa8e9 could not be found. Jul 18 02:24:07.774651 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:07.774651 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ac885dc8-6970-4660-8882-edbec5eb898b tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Returning 404 to user: Instance 8d246564-436e-480a-989e-b67ec47fa8e9 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:24:07.774651 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ac885dc8-6970-4660-8882-edbec5eb898b tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] 10.222.0.57 "POST /compute/v2.1/servers/8d246564-436e-480a-989e-b67ec47fa8e9/action" status: 404 len: 111 microversion: 2.1 time: 0.076117 Jul 18 02:24:07.783860 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a7a94ba2-fde3-4aa5-92b4-fe26f9ba7e05 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:07.785378 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1283/2600] 10.222.0.57 () {60 vars in 1278 bytes} [Mon Jul 18 02:24:07 2022] POST /compute/v2.1/servers/8d246564-436e-480a-989e-b67ec47fa8e9/action => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:24:07.785982 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a7a94ba2-fde3-4aa5-92b4-fe26f9ba7e05 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:07.785982 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a7a94ba2-fde3-4aa5-92b4-fe26f9ba7e05 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:07.785982 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a7a94ba2-fde3-4aa5-92b4-fe26f9ba7e05 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:07.785982 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a7a94ba2-fde3-4aa5-92b4-fe26f9ba7e05 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:07.785982 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a7a94ba2-fde3-4aa5-92b4-fe26f9ba7e05 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:07.795504 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:24:07.814886 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-22c28495-d697-436c-916c-3b1967689691 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-251709697", "metadata": {"image_type": "test"}}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:07.820146 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-22c28495-d697-436c-916c-3b1967689691 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Failed to fetch instance by id tempest-invalid-1434160534 {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 18 02:24:07.821019 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-22c28495-d697-436c-916c-3b1967689691 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] HTTP exception thrown: Instance tempest-invalid-1434160534 could not be found. Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-22c28495-d697-436c-916c-3b1967689691 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Request method failure captured: Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers/tempest-invalid-1434160534/action HTTP/1.1 Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 111 Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MQldYfmcEQJfvjpxTABClOtPd9lbKKbVGs24SRMX-SQblsZq3CtejrE_YA6VGg0vtCe193V4PfapmtUD22KAtF20h4QjanunhLX2U6bp1iT82lz4IWsPi8FxpdTbdOtA5ag8-AGm1ytYxxHYNizcfmkMAsTf25Hq9GenCqeXOSuEI8 Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 82362419c7974c36b6931ccbc274a646 Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ImagesNegativeTestJSON-85814598 Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_82362419c7974c36b6931ccbc274a646"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/82362419c7974c36b6931ccbc274a646"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/82362419c7974c36b6931ccbc274a646"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/82362419c7974c36b6931ccbc274a646"}]}] Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ImagesNegativeTestJSON-85814598 Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 82362419c7974c36b6931ccbc274a646 Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-85814598 Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ImagesNegativeTestJSON-85814598-project Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: f74142c97f164df080e0056b5953cf5f Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ImagesNegativeTestJSON-85814598-project Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-251709697", "metadata": {"image_type": "test"}}} Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance tempest-invalid-1434160534 could not be found. Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'tempest-invalid-1434160534', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-251709697', 'metadata': {'image_type': 'test'}}}} Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1434160534 could not be found. Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1434160534 could not be found. Jul 18 02:24:07.828219 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:07.837436 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:07.837436 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:07.837436 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:07.837436 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:07.837436 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:07.837436 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:24:07.837436 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:24:07.837436 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1434160534 could not be found. Jul 18 02:24:07.837436 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:07.842561 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-22c28495-d697-436c-916c-3b1967689691 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Returning 404 to user: Instance tempest-invalid-1434160534 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:24:07.844431 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-22c28495-d697-436c-916c-3b1967689691 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] 10.222.0.57 "POST /compute/v2.1/servers/tempest-invalid-1434160534/action" status: 404 len: 101 microversion: 2.1 time: 0.053817 Jul 18 02:24:07.854503 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1284/2601] 10.222.0.57 () {60 vars in 1248 bytes} [Mon Jul 18 02:24:07 2022] POST /compute/v2.1/servers/tempest-invalid-1434160534/action => generated 101 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:24:07.880508 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-83abffb5-ce3f-4442-9c18-931c7f005f5f tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-747342235"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:07.882466 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-83abffb5-ce3f-4442-9c18-931c7f005f5f tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 18 02:24:07.883369 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-83abffb5-ce3f-4442-9c18-931c7f005f5f tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-83abffb5-ce3f-4442-9c18-931c7f005f5f tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Request method failure captured: Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 56 Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MQldYfmcEQJfvjpxTABClOtPd9lbKKbVGs24SRMX-SQblsZq3CtejrE_YA6VGg0vtCe193V4PfapmtUD22KAtF20h4QjanunhLX2U6bp1iT82lz4IWsPi8FxpdTbdOtA5ag8-AGm1ytYxxHYNizcfmkMAsTf25Hq9GenCqeXOSuEI8 Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 82362419c7974c36b6931ccbc274a646 Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ImagesNegativeTestJSON-85814598 Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_82362419c7974c36b6931ccbc274a646"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/82362419c7974c36b6931ccbc274a646"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/82362419c7974c36b6931ccbc274a646"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/82362419c7974c36b6931ccbc274a646"}]}] Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ImagesNegativeTestJSON-85814598 Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 82362419c7974c36b6931ccbc274a646 Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-85814598 Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ImagesNegativeTestJSON-85814598-project Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: f74142c97f164df080e0056b5953cf5f Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ImagesNegativeTestJSON-85814598-project Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: {"createImage": {"name": "tempest-test-snap-747342235"}} Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-747342235'}}} Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 18 02:24:07.888112 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:07.908704 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:07.908704 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:07.908704 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:07.908704 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:07.908704 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:07.908704 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:24:07.908704 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:24:07.908704 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 18 02:24:07.908704 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:07.908704 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-83abffb5-ce3f-4442-9c18-931c7f005f5f tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:24:07.908704 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-83abffb5-ce3f-4442-9c18-931c7f005f5f tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] 10.222.0.57 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.028845 Jul 18 02:24:07.908704 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1285/2602] 10.222.0.57 () {60 vars in 1274 bytes} [Mon Jul 18 02:24:07 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:24:07.922159 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-17b58021-fccd-4ab3-8ffa-e7088a2f3244 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1900326256"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:07.926144 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-17b58021-fccd-4ab3-8ffa-e7088a2f3244 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 18 02:24:07.931087 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-17b58021-fccd-4ab3-8ffa-e7088a2f3244 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-17b58021-fccd-4ab3-8ffa-e7088a2f3244 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Request method failure captured: Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 57 Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MQldYfmcEQJfvjpxTABClOtPd9lbKKbVGs24SRMX-SQblsZq3CtejrE_YA6VGg0vtCe193V4PfapmtUD22KAtF20h4QjanunhLX2U6bp1iT82lz4IWsPi8FxpdTbdOtA5ag8-AGm1ytYxxHYNizcfmkMAsTf25Hq9GenCqeXOSuEI8 Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 82362419c7974c36b6931ccbc274a646 Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ImagesNegativeTestJSON-85814598 Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_82362419c7974c36b6931ccbc274a646"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/82362419c7974c36b6931ccbc274a646"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/82362419c7974c36b6931ccbc274a646"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/82362419c7974c36b6931ccbc274a646"}]}] Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ImagesNegativeTestJSON-85814598 Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 82362419c7974c36b6931ccbc274a646 Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-85814598 Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ImagesNegativeTestJSON-85814598-project Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: f74142c97f164df080e0056b5953cf5f Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ImagesNegativeTestJSON-85814598-project Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: {"createImage": {"name": "tempest-test-snap-1900326256"}} Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1900326256'}}} Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 18 02:24:07.944493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:07.956515 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:07.956515 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:07.956515 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:07.956515 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:07.956515 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:07.956515 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:24:07.956515 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:24:07.956515 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 18 02:24:07.956515 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:07.956515 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-17b58021-fccd-4ab3-8ffa-e7088a2f3244 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:24:07.956515 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-17b58021-fccd-4ab3-8ffa-e7088a2f3244 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] 10.222.0.57 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.045292 Jul 18 02:24:07.956515 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1286/2603] 10.222.0.57 () {60 vars in 1280 bytes} [Mon Jul 18 02:24:07 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:24:07.975913 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0d1c135b-f276-4aca-b08a-69f652a63727 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:07.982798 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0d1c135b-f276-4aca-b08a-69f652a63727 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] [instance: 8d246564-436e-480a-989e-b67ec47fa8e9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:07.988443 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:24:08.009239 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0d1c135b-f276-4aca-b08a-69f652a63727 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:08.010000 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0d1c135b-f276-4aca-b08a-69f652a63727 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:08.011593 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0d1c135b-f276-4aca-b08a-69f652a63727 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:08.012710 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0d1c135b-f276-4aca-b08a-69f652a63727 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:08.053957 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-0d1c135b-f276-4aca-b08a-69f652a63727 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] HTTP exception thrown: Instance 8d246564-436e-480a-989e-b67ec47fa8e9 could not be found. Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0d1c135b-f276-4aca-b08a-69f652a63727 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Request method failure captured: Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/servers/8d246564-436e-480a-989e-b67ec47fa8e9 HTTP/1.1 Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MQldYfmcEQJfvjpxTABClOtPd9lbKKbVGs24SRMX-SQblsZq3CtejrE_YA6VGg0vtCe193V4PfapmtUD22KAtF20h4QjanunhLX2U6bp1iT82lz4IWsPi8FxpdTbdOtA5ag8-AGm1ytYxxHYNizcfmkMAsTf25Hq9GenCqeXOSuEI8 Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 82362419c7974c36b6931ccbc274a646 Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ImagesNegativeTestJSON-85814598 Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_82362419c7974c36b6931ccbc274a646"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/82362419c7974c36b6931ccbc274a646"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/82362419c7974c36b6931ccbc274a646"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/82362419c7974c36b6931ccbc274a646"}]}] Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ImagesNegativeTestJSON-85814598 Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 82362419c7974c36b6931ccbc274a646 Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-85814598 Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ImagesNegativeTestJSON-85814598-project Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: f74142c97f164df080e0056b5953cf5f Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ImagesNegativeTestJSON-85814598-project Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 8d246564-436e-480a-989e-b67ec47fa8e9 could not be found. Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '8d246564-436e-480a-989e-b67ec47fa8e9'} Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d246564-436e-480a-989e-b67ec47fa8e9 could not be found. Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:24:08.057750 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:24:08.067062 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d246564-436e-480a-989e-b67ec47fa8e9 could not be found. Jul 18 02:24:08.067062 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:08.067062 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:08.067062 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:08.067062 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:08.067062 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:08.067062 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:08.067062 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:24:08.067062 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:24:08.067062 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d246564-436e-480a-989e-b67ec47fa8e9 could not be found. Jul 18 02:24:08.067062 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:08.067062 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0d1c135b-f276-4aca-b08a-69f652a63727 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Returning 404 to user: Instance 8d246564-436e-480a-989e-b67ec47fa8e9 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:24:08.067062 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0d1c135b-f276-4aca-b08a-69f652a63727 tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8d246564-436e-480a-989e-b67ec47fa8e9" status: 404 len: 111 microversion: 2.1 time: 0.103290 Jul 18 02:24:08.067062 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1287/2604] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:24:07 2022] DELETE /compute/v2.1/servers/8d246564-436e-480a-989e-b67ec47fa8e9 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:24:08.075467 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-728b9678-c15c-4047-bde7-dcfb8e3166db tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:08.076134 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-728b9678-c15c-4047-bde7-dcfb8e3166db tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] [instance: 8d246564-436e-480a-989e-b67ec47fa8e9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:08.083619 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-728b9678-c15c-4047-bde7-dcfb8e3166db tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:08.084239 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-728b9678-c15c-4047-bde7-dcfb8e3166db tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:08.085975 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-728b9678-c15c-4047-bde7-dcfb8e3166db tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:08.086785 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-728b9678-c15c-4047-bde7-dcfb8e3166db tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:08.114714 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-728b9678-c15c-4047-bde7-dcfb8e3166db tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] HTTP exception thrown: Instance 8d246564-436e-480a-989e-b67ec47fa8e9 could not be found. Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-728b9678-c15c-4047-bde7-dcfb8e3166db tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Request method failure captured: Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/8d246564-436e-480a-989e-b67ec47fa8e9 HTTP/1.1 Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MQldYfmcEQJfvjpxTABClOtPd9lbKKbVGs24SRMX-SQblsZq3CtejrE_YA6VGg0vtCe193V4PfapmtUD22KAtF20h4QjanunhLX2U6bp1iT82lz4IWsPi8FxpdTbdOtA5ag8-AGm1ytYxxHYNizcfmkMAsTf25Hq9GenCqeXOSuEI8 Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 82362419c7974c36b6931ccbc274a646 Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ImagesNegativeTestJSON-85814598 Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_82362419c7974c36b6931ccbc274a646"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/82362419c7974c36b6931ccbc274a646"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/82362419c7974c36b6931ccbc274a646"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/82362419c7974c36b6931ccbc274a646"}]}] Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ImagesNegativeTestJSON-85814598 Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 82362419c7974c36b6931ccbc274a646 Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-85814598 Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ImagesNegativeTestJSON-85814598-project Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: f74142c97f164df080e0056b5953cf5f Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ImagesNegativeTestJSON-85814598-project Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 8d246564-436e-480a-989e-b67ec47fa8e9 could not be found. Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '8d246564-436e-480a-989e-b67ec47fa8e9'} Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d246564-436e-480a-989e-b67ec47fa8e9 could not be found. Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d246564-436e-480a-989e-b67ec47fa8e9 could not be found. Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:08.117307 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:08.126511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:08.126511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:08.126511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:08.126511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:24:08.126511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:24:08.126511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d246564-436e-480a-989e-b67ec47fa8e9 could not be found. Jul 18 02:24:08.126511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:08.126511 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-728b9678-c15c-4047-bde7-dcfb8e3166db tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] Returning 404 to user: Instance 8d246564-436e-480a-989e-b67ec47fa8e9 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:24:08.126511 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-728b9678-c15c-4047-bde7-dcfb8e3166db tempest-ImagesNegativeTestJSON-85814598 tempest-ImagesNegativeTestJSON-85814598-project] 10.222.0.57 "GET /compute/v2.1/servers/8d246564-436e-480a-989e-b67ec47fa8e9" status: 404 len: 111 microversion: 2.1 time: 0.048652 Jul 18 02:24:08.126511 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1288/2605] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:08 2022] GET /compute/v2.1/servers/8d246564-436e-480a-989e-b67ec47fa8e9 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:24:08.308041 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2e72b1f6-1bbc-4941-a61e-40645e66e58e tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:08.309100 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2e72b1f6-1bbc-4941-a61e-40645e66e58e tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] [instance: 7b1fb401-75fb-4d72-96ee-b5a5f1146882] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:08.322662 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2e72b1f6-1bbc-4941-a61e-40645e66e58e tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:08.323408 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2e72b1f6-1bbc-4941-a61e-40645e66e58e tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:08.325093 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2e72b1f6-1bbc-4941-a61e-40645e66e58e tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:08.325847 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2e72b1f6-1bbc-4941-a61e-40645e66e58e tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:08.696236 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2e72b1f6-1bbc-4941-a61e-40645e66e58e tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6646c45c9574550b601a37de6fc0321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db663b2f2234793bb4038ad90b2b972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:08.710854 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2e72b1f6-1bbc-4941-a61e-40645e66e58e tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] 10.222.0.57 "GET /compute/v2.1/servers/7b1fb401-75fb-4d72-96ee-b5a5f1146882" status: 200 len: 1272 microversion: 2.1 time: 0.408012 Jul 18 02:24:08.724108 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1289/2606] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:08 2022] GET /compute/v2.1/servers/7b1fb401-75fb-4d72-96ee-b5a5f1146882 => generated 1272 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:09.373172 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a7a94ba2-fde3-4aa5-92b4-fe26f9ba7e05 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:09.420351 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a7a94ba2-fde3-4aa5-92b4-fe26f9ba7e05 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1313 microversion: 2.1 time: 1.667177 Jul 18 02:24:09.424646 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1318/2607] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:07 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1313 bytes in 1675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:24:09.743347 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2ce01e87-1a5c-49ac-8405-f3b6c57ede5c tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:09.743809 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2ce01e87-1a5c-49ac-8405-f3b6c57ede5c tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] [instance: 7b1fb401-75fb-4d72-96ee-b5a5f1146882] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:09.760001 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ce01e87-1a5c-49ac-8405-f3b6c57ede5c tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:09.761994 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ce01e87-1a5c-49ac-8405-f3b6c57ede5c tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:09.765475 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ce01e87-1a5c-49ac-8405-f3b6c57ede5c tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:09.768639 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ce01e87-1a5c-49ac-8405-f3b6c57ede5c tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:09.843741 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-33f3008d-10d1-42a7-8f1b-9aed77583763 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:09.845581 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-33f3008d-10d1-42a7-8f1b-9aed77583763 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:09.859435 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-33f3008d-10d1-42a7-8f1b-9aed77583763 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:09.861999 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-33f3008d-10d1-42a7-8f1b-9aed77583763 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:09.862569 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-33f3008d-10d1-42a7-8f1b-9aed77583763 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:09.863225 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-33f3008d-10d1-42a7-8f1b-9aed77583763 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:09.882253 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:24:09.914377 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-33f3008d-10d1-42a7-8f1b-9aed77583763 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:24:09.990649 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2ce01e87-1a5c-49ac-8405-f3b6c57ede5c tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6646c45c9574550b601a37de6fc0321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db663b2f2234793bb4038ad90b2b972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:10.016582 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2ce01e87-1a5c-49ac-8405-f3b6c57ede5c tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] 10.222.0.57 "GET /compute/v2.1/servers/7b1fb401-75fb-4d72-96ee-b5a5f1146882" status: 200 len: 1272 microversion: 2.1 time: 0.286886 Jul 18 02:24:10.026991 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1290/2608] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:09 2022] GET /compute/v2.1/servers/7b1fb401-75fb-4d72-96ee-b5a5f1146882 => generated 1272 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:10.069827 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-33f3008d-10d1-42a7-8f1b-9aed77583763 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "DELETE /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a" status: 204 len: 0 microversion: 2.1 time: 0.234582 Jul 18 02:24:10.071063 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1319/2609] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:24:09 2022] DELETE /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:24:10.083449 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0e70256c-4258-495f-b672-3778887a6193 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:10.084792 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0e70256c-4258-495f-b672-3778887a6193 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:10.096112 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0e70256c-4258-495f-b672-3778887a6193 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:10.097011 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0e70256c-4258-495f-b672-3778887a6193 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:10.098632 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0e70256c-4258-495f-b672-3778887a6193 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:10.099924 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0e70256c-4258-495f-b672-3778887a6193 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:10.382883 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=8 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:24:10.459046 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-de3dcbcd-32e2-40bf-b8d1-105437c8508b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:10.460538 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-de3dcbcd-32e2-40bf-b8d1-105437c8508b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:10.467550 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-de3dcbcd-32e2-40bf-b8d1-105437c8508b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:10.468279 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-de3dcbcd-32e2-40bf-b8d1-105437c8508b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:10.469296 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-de3dcbcd-32e2-40bf-b8d1-105437c8508b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:10.471247 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-de3dcbcd-32e2-40bf-b8d1-105437c8508b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:10.876355 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0e70256c-4258-495f-b672-3778887a6193 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:10.890062 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0e70256c-4258-495f-b672-3778887a6193 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a" status: 200 len: 1554 microversion: 2.1 time: 0.813847 Jul 18 02:24:10.901235 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1291/2610] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:10 2022] GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a => generated 1554 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:11.041382 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5fa5b62d-85bf-43c4-92f3-dc389b246a3b tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:11.042563 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5fa5b62d-85bf-43c4-92f3-dc389b246a3b tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] [instance: 7b1fb401-75fb-4d72-96ee-b5a5f1146882] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:11.055895 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5fa5b62d-85bf-43c4-92f3-dc389b246a3b tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:11.056713 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5fa5b62d-85bf-43c4-92f3-dc389b246a3b tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:11.058245 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5fa5b62d-85bf-43c4-92f3-dc389b246a3b tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:11.058986 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5fa5b62d-85bf-43c4-92f3-dc389b246a3b tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:11.109068 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-de3dcbcd-32e2-40bf-b8d1-105437c8508b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:11.146403 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-de3dcbcd-32e2-40bf-b8d1-105437c8508b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1313 microversion: 2.1 time: 0.694587 Jul 18 02:24:11.147740 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1320/2611] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:10 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1313 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:11.627247 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5fa5b62d-85bf-43c4-92f3-dc389b246a3b tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6646c45c9574550b601a37de6fc0321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db663b2f2234793bb4038ad90b2b972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:11.635577 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5fa5b62d-85bf-43c4-92f3-dc389b246a3b tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] 10.222.0.57 "GET /compute/v2.1/servers/7b1fb401-75fb-4d72-96ee-b5a5f1146882" status: 200 len: 1272 microversion: 2.1 time: 0.602602 Jul 18 02:24:11.636566 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1292/2612] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:11 2022] GET /compute/v2.1/servers/7b1fb401-75fb-4d72-96ee-b5a5f1146882 => generated 1272 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:11.914817 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ac1e5f21-f6bc-4033-a7d6-6bf1e7fc123f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:11.916260 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ac1e5f21-f6bc-4033-a7d6-6bf1e7fc123f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:11.928378 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:24:11.931514 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ac1e5f21-f6bc-4033-a7d6-6bf1e7fc123f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:11.933741 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ac1e5f21-f6bc-4033-a7d6-6bf1e7fc123f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:11.933741 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ac1e5f21-f6bc-4033-a7d6-6bf1e7fc123f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:11.934209 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ac1e5f21-f6bc-4033-a7d6-6bf1e7fc123f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:12.167600 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2e7e7a3d-d82f-4201-8bf1-8eba75b3d85e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:12.169545 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2e7e7a3d-d82f-4201-8bf1-8eba75b3d85e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:12.180264 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2e7e7a3d-d82f-4201-8bf1-8eba75b3d85e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:12.181189 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2e7e7a3d-d82f-4201-8bf1-8eba75b3d85e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:12.182263 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2e7e7a3d-d82f-4201-8bf1-8eba75b3d85e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:12.185174 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2e7e7a3d-d82f-4201-8bf1-8eba75b3d85e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:13.234597 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ac1e5f21-f6bc-4033-a7d6-6bf1e7fc123f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:13.240337 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:24:13.265036 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ac1e5f21-f6bc-4033-a7d6-6bf1e7fc123f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a" status: 200 len: 1554 microversion: 2.1 time: 1.353962 Jul 18 02:24:13.280257 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1321/2613] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:11 2022] GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a => generated 1554 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:24:13.299784 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f9bf6c6c-dcda-4226-acc0-e0c93a14d304 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:13.305008 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f9bf6c6c-dcda-4226-acc0-e0c93a14d304 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] [instance: 7b1fb401-75fb-4d72-96ee-b5a5f1146882] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:13.337466 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f9bf6c6c-dcda-4226-acc0-e0c93a14d304 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:13.338569 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f9bf6c6c-dcda-4226-acc0-e0c93a14d304 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:13.340317 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f9bf6c6c-dcda-4226-acc0-e0c93a14d304 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:13.345370 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f9bf6c6c-dcda-4226-acc0-e0c93a14d304 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:13.430728 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2e7e7a3d-d82f-4201-8bf1-8eba75b3d85e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:13.446286 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2e7e7a3d-d82f-4201-8bf1-8eba75b3d85e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1313 microversion: 2.1 time: 1.279758 Jul 18 02:24:13.447463 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1293/2614] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:12 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1313 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:24:13.460540 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-78c4b271-5f6f-44cc-a763-c684a6b77d16 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:13.461358 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-78c4b271-5f6f-44cc-a763-c684a6b77d16 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] [instance: 49facc8e-4cfc-4522-90d3-38c9f152e390] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:13.487311 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-78c4b271-5f6f-44cc-a763-c684a6b77d16 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:13.492200 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-78c4b271-5f6f-44cc-a763-c684a6b77d16 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:13.497644 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-78c4b271-5f6f-44cc-a763-c684a6b77d16 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:13.498797 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-78c4b271-5f6f-44cc-a763-c684a6b77d16 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:13.528382 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:24:14.303493 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=8 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:24:14.570583 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-78c4b271-5f6f-44cc-a763-c684a6b77d16 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b89b2c768847589c4d41aba88208a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d788b28fd2c4cf1826d908059f04c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:14.610367 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-78c4b271-5f6f-44cc-a763-c684a6b77d16 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] 10.222.0.57 "GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390" status: 200 len: 1590 microversion: 2.1 time: 1.161185 Jul 18 02:24:14.616781 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1294/2615] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:13 2022] GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390 => generated 1590 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:14.637980 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-524d7559-a50c-40cd-a5fb-40b7c4bc0b26 req-96f2916b-b42b-41f7-9aef-7bbdc3e7d6fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49facc8e-4cfc-4522-90d3-38c9f152e390", "tag": "44254fc9-6729-4435-8c9a-c405df2363b5"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:14.666675 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-524d7559-a50c-40cd-a5fb-40b7c4bc0b26 req-96f2916b-b42b-41f7-9aef-7bbdc3e7d6fd service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:14.668221 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-524d7559-a50c-40cd-a5fb-40b7c4bc0b26 req-96f2916b-b42b-41f7-9aef-7bbdc3e7d6fd service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:14.700004 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-524d7559-a50c-40cd-a5fb-40b7c4bc0b26 req-96f2916b-b42b-41f7-9aef-7bbdc3e7d6fd service nova] Creating event network-changed:44254fc9-6729-4435-8c9a-c405df2363b5 for instance 49facc8e-4cfc-4522-90d3-38c9f152e390 on n-h1-465891-3 Jul 18 02:24:14.710676 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-524d7559-a50c-40cd-a5fb-40b7c4bc0b26 req-96f2916b-b42b-41f7-9aef-7bbdc3e7d6fd service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090727 Jul 18 02:24:14.712766 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1295/2616] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:14.721434 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f9bf6c6c-dcda-4226-acc0-e0c93a14d304 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6646c45c9574550b601a37de6fc0321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db663b2f2234793bb4038ad90b2b972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:14.738437 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fd1ee338-1a4a-43ff-b08c-891d0299faad tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:14.744055 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fd1ee338-1a4a-43ff-b08c-891d0299faad tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:14.746061 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f9bf6c6c-dcda-4226-acc0-e0c93a14d304 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] 10.222.0.57 "GET /compute/v2.1/servers/7b1fb401-75fb-4d72-96ee-b5a5f1146882" status: 200 len: 1314 microversion: 2.1 time: 1.463155 Jul 18 02:24:14.748076 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1322/2617] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:13 2022] GET /compute/v2.1/servers/7b1fb401-75fb-4d72-96ee-b5a5f1146882 => generated 1314 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:14.763679 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-11a62815-e9ed-4935-91ff-ced014eb4e48 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:14.765663 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-11a62815-e9ed-4935-91ff-ced014eb4e48 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:14.769074 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd1ee338-1a4a-43ff-b08c-891d0299faad tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:14.772993 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd1ee338-1a4a-43ff-b08c-891d0299faad tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:14.776931 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd1ee338-1a4a-43ff-b08c-891d0299faad tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:14.779319 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd1ee338-1a4a-43ff-b08c-891d0299faad tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:14.822825 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-11a62815-e9ed-4935-91ff-ced014eb4e48 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:14.830563 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-11a62815-e9ed-4935-91ff-ced014eb4e48 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:14.838624 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-11a62815-e9ed-4935-91ff-ced014eb4e48 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:14.840178 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-11a62815-e9ed-4935-91ff-ced014eb4e48 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:15.268590 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fd1ee338-1a4a-43ff-b08c-891d0299faad tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:15.283622 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fd1ee338-1a4a-43ff-b08c-891d0299faad tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a" status: 200 len: 1512 microversion: 2.1 time: 0.568228 Jul 18 02:24:15.286161 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1296/2618] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:14 2022] GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a => generated 1512 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:15.291674 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-486fe085-3d2f-42e2-b1b8-52d2d72a51bd req-c2b29f7a-5991-4e08-a7ad-dcecfa444af1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a", "name": "network-vif-deleted", "tag": "a8f166e0-39af-4a4f-bae5-dbdbaf61cc83"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:15.316667 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-486fe085-3d2f-42e2-b1b8-52d2d72a51bd req-c2b29f7a-5991-4e08-a7ad-dcecfa444af1 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:15.325332 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-486fe085-3d2f-42e2-b1b8-52d2d72a51bd req-c2b29f7a-5991-4e08-a7ad-dcecfa444af1 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:15.367758 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-486fe085-3d2f-42e2-b1b8-52d2d72a51bd req-c2b29f7a-5991-4e08-a7ad-dcecfa444af1 service nova] Creating event network-vif-deleted:a8f166e0-39af-4a4f-bae5-dbdbaf61cc83 for instance 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a on n-h2-465891-3 Jul 18 02:24:15.380614 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-486fe085-3d2f-42e2-b1b8-52d2d72a51bd req-c2b29f7a-5991-4e08-a7ad-dcecfa444af1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092629 Jul 18 02:24:15.387314 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1297/2619] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:15.782124 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6e280b0a-f4f2-4774-95c3-028c72499048 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:15.790859 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6e280b0a-f4f2-4774-95c3-028c72499048 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] [instance: 7b1fb401-75fb-4d72-96ee-b5a5f1146882] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:15.812207 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6e280b0a-f4f2-4774-95c3-028c72499048 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:15.813586 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6e280b0a-f4f2-4774-95c3-028c72499048 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:15.817443 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6e280b0a-f4f2-4774-95c3-028c72499048 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:15.818804 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6e280b0a-f4f2-4774-95c3-028c72499048 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:15.977805 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-11a62815-e9ed-4935-91ff-ced014eb4e48 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:16.002007 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-11a62815-e9ed-4935-91ff-ced014eb4e48 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1313 microversion: 2.1 time: 1.250673 Jul 18 02:24:16.003112 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1323/2620] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:14 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1313 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:16.306643 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c042ec37-6efe-4fed-aa50-cd8909d366d6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:16.307286 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c042ec37-6efe-4fed-aa50-cd8909d366d6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:16.324754 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c042ec37-6efe-4fed-aa50-cd8909d366d6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:16.326334 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c042ec37-6efe-4fed-aa50-cd8909d366d6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:16.327199 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c042ec37-6efe-4fed-aa50-cd8909d366d6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:16.327653 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c042ec37-6efe-4fed-aa50-cd8909d366d6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:17.430311 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c042ec37-6efe-4fed-aa50-cd8909d366d6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:17.460877 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c042ec37-6efe-4fed-aa50-cd8909d366d6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a" status: 200 len: 1346 microversion: 2.1 time: 1.161216 Jul 18 02:24:17.461514 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1324/2621] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:16 2022] GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a => generated 1346 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:17.482457 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ef826d7d-2c24-4e8f-832f-f9d419c7ea8c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:17.483709 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ef826d7d-2c24-4e8f-832f-f9d419c7ea8c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:17.506818 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ef826d7d-2c24-4e8f-832f-f9d419c7ea8c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:17.507280 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ef826d7d-2c24-4e8f-832f-f9d419c7ea8c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:17.508097 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ef826d7d-2c24-4e8f-832f-f9d419c7ea8c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:17.508545 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ef826d7d-2c24-4e8f-832f-f9d419c7ea8c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:17.937344 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6e280b0a-f4f2-4774-95c3-028c72499048 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6646c45c9574550b601a37de6fc0321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db663b2f2234793bb4038ad90b2b972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:17.982848 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6e280b0a-f4f2-4774-95c3-028c72499048 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] 10.222.0.57 "GET /compute/v2.1/servers/7b1fb401-75fb-4d72-96ee-b5a5f1146882" status: 200 len: 1314 microversion: 2.1 time: 2.209112 Jul 18 02:24:17.983795 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1298/2622] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:15 2022] GET /compute/v2.1/servers/7b1fb401-75fb-4d72-96ee-b5a5f1146882 => generated 1314 bytes in 2211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:24:17.990243 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-361089dd-6535-4bc7-b64f-d64db4a5f4b4 req-78d6a88b-d664-4b77-9a75-d922635de55b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7", "tag": "d130b73f-1f50-4848-bcf5-1bc41a9e7331"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:18.013265 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-361089dd-6535-4bc7-b64f-d64db4a5f4b4 req-78d6a88b-d664-4b77-9a75-d922635de55b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:18.014919 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-361089dd-6535-4bc7-b64f-d64db4a5f4b4 req-78d6a88b-d664-4b77-9a75-d922635de55b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:18.046037 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-361089dd-6535-4bc7-b64f-d64db4a5f4b4 req-78d6a88b-d664-4b77-9a75-d922635de55b service nova] Creating event network-changed:d130b73f-1f50-4848-bcf5-1bc41a9e7331 for instance dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 on n-h1-465891-3 Jul 18 02:24:18.065762 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-361089dd-6535-4bc7-b64f-d64db4a5f4b4 req-78d6a88b-d664-4b77-9a75-d922635de55b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076862 Jul 18 02:24:18.082354 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1299/2623] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:18.342769 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ef826d7d-2c24-4e8f-832f-f9d419c7ea8c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:18.375343 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ef826d7d-2c24-4e8f-832f-f9d419c7ea8c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1313 microversion: 2.1 time: 0.908255 Jul 18 02:24:18.381162 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1325/2624] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:17 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1313 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:18.497268 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-55094eed-9253-4846-972e-72ab8e32334c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:18.499174 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-55094eed-9253-4846-972e-72ab8e32334c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:18.518266 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-55094eed-9253-4846-972e-72ab8e32334c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:18.519836 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-55094eed-9253-4846-972e-72ab8e32334c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:18.520742 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-55094eed-9253-4846-972e-72ab8e32334c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:18.522701 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-55094eed-9253-4846-972e-72ab8e32334c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:19.009227 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6d36be8e-fc1f-4731-82f3-a42286be775b tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:19.011372 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6d36be8e-fc1f-4731-82f3-a42286be775b tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] [instance: 7b1fb401-75fb-4d72-96ee-b5a5f1146882] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:19.033203 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6d36be8e-fc1f-4731-82f3-a42286be775b tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:19.047062 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6d36be8e-fc1f-4731-82f3-a42286be775b tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:19.063460 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6d36be8e-fc1f-4731-82f3-a42286be775b tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:19.064657 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6d36be8e-fc1f-4731-82f3-a42286be775b tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:19.102156 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-55094eed-9253-4846-972e-72ab8e32334c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:19.129634 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-55094eed-9253-4846-972e-72ab8e32334c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a" status: 200 len: 1346 microversion: 2.1 time: 0.646534 Jul 18 02:24:19.131325 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1300/2625] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:18 2022] GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a => generated 1346 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:19.397350 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d9c2ccf9-c069-405b-a299-bd440a747c3d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:19.397350 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d9c2ccf9-c069-405b-a299-bd440a747c3d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:19.415041 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d9c2ccf9-c069-405b-a299-bd440a747c3d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:19.415798 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d9c2ccf9-c069-405b-a299-bd440a747c3d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:19.417776 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d9c2ccf9-c069-405b-a299-bd440a747c3d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:19.419285 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d9c2ccf9-c069-405b-a299-bd440a747c3d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:20.171444 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d9c2ccf9-c069-405b-a299-bd440a747c3d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:20.195827 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d9c2ccf9-c069-405b-a299-bd440a747c3d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1313 microversion: 2.1 time: 0.804878 Jul 18 02:24:20.206292 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1301/2626] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:19 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1313 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:20.220691 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-33934a9d-aaeb-4d75-9934-d6e2761482f8 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:20.221831 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-33934a9d-aaeb-4d75-9934-d6e2761482f8 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:20.248996 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-33934a9d-aaeb-4d75-9934-d6e2761482f8 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:20.250109 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-33934a9d-aaeb-4d75-9934-d6e2761482f8 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:20.251603 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-33934a9d-aaeb-4d75-9934-d6e2761482f8 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:20.259076 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-33934a9d-aaeb-4d75-9934-d6e2761482f8 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:20.641594 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-33934a9d-aaeb-4d75-9934-d6e2761482f8 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:20.668215 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-33934a9d-aaeb-4d75-9934-d6e2761482f8 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a" status: 200 len: 1346 microversion: 2.1 time: 0.459835 Jul 18 02:24:20.691384 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1302/2627] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:20 2022] GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a => generated 1346 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:20.701901 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6d36be8e-fc1f-4731-82f3-a42286be775b tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6646c45c9574550b601a37de6fc0321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db663b2f2234793bb4038ad90b2b972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:20.707474 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-f07a5819-1141-4a53-8849-97e2e0b074c1 req-99a65284-64a0-4786-88b3-ec8c484079d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b1fb401-75fb-4d72-96ee-b5a5f1146882", "tag": "c40205a1-085f-4751-9efd-57c16c913fa4"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:20.725967 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-f07a5819-1141-4a53-8849-97e2e0b074c1 req-99a65284-64a0-4786-88b3-ec8c484079d9 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:20.728060 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-f07a5819-1141-4a53-8849-97e2e0b074c1 req-99a65284-64a0-4786-88b3-ec8c484079d9 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:20.761536 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-f07a5819-1141-4a53-8849-97e2e0b074c1 req-99a65284-64a0-4786-88b3-ec8c484079d9 service nova] Creating event network-changed:c40205a1-085f-4751-9efd-57c16c913fa4 for instance 7b1fb401-75fb-4d72-96ee-b5a5f1146882 on n-h2-465891-3 Jul 18 02:24:20.769585 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6d36be8e-fc1f-4731-82f3-a42286be775b tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] 10.222.0.57 "GET /compute/v2.1/servers/7b1fb401-75fb-4d72-96ee-b5a5f1146882" status: 200 len: 1314 microversion: 2.1 time: 1.767124 Jul 18 02:24:20.772763 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-f07a5819-1141-4a53-8849-97e2e0b074c1 req-99a65284-64a0-4786-88b3-ec8c484079d9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078899 Jul 18 02:24:20.774902 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1326/2628] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:19 2022] GET /compute/v2.1/servers/7b1fb401-75fb-4d72-96ee-b5a5f1146882 => generated 1314 bytes in 1774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:20.776321 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1303/2629] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:21.218604 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c15819a2-c7a7-4850-a5f6-eb74faf98e95 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:21.222641 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c15819a2-c7a7-4850-a5f6-eb74faf98e95 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:21.257380 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c15819a2-c7a7-4850-a5f6-eb74faf98e95 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:21.262083 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c15819a2-c7a7-4850-a5f6-eb74faf98e95 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:21.265542 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c15819a2-c7a7-4850-a5f6-eb74faf98e95 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:21.266076 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c15819a2-c7a7-4850-a5f6-eb74faf98e95 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:21.714624 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9c283046-0aa6-4755-aba1-66e212fd25a4 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:21.724947 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9c283046-0aa6-4755-aba1-66e212fd25a4 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:21.757222 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9c283046-0aa6-4755-aba1-66e212fd25a4 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:21.759907 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9c283046-0aa6-4755-aba1-66e212fd25a4 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:21.766614 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9c283046-0aa6-4755-aba1-66e212fd25a4 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:21.767531 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9c283046-0aa6-4755-aba1-66e212fd25a4 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:22.221195 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9c283046-0aa6-4755-aba1-66e212fd25a4 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:22.247379 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9c283046-0aa6-4755-aba1-66e212fd25a4 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a" status: 200 len: 1346 microversion: 2.1 time: 0.545064 Jul 18 02:24:22.248460 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1304/2630] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:21 2022] GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a => generated 1346 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:22.286171 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2697fc53-8761-4689-9445-8705b93a7ceb tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:22.287316 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2697fc53-8761-4689-9445-8705b93a7ceb tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] [instance: 7b1fb401-75fb-4d72-96ee-b5a5f1146882] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:22.323627 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2697fc53-8761-4689-9445-8705b93a7ceb tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:22.323750 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2697fc53-8761-4689-9445-8705b93a7ceb tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:22.325129 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2697fc53-8761-4689-9445-8705b93a7ceb tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:22.325960 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2697fc53-8761-4689-9445-8705b93a7ceb tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:23.189089 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c15819a2-c7a7-4850-a5f6-eb74faf98e95 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:23.218301 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c15819a2-c7a7-4850-a5f6-eb74faf98e95 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1313 microversion: 2.1 time: 2.005964 Jul 18 02:24:23.219926 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1327/2631] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:21 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1313 bytes in 2010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:23.279967 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d489f70f-6f32-4b2a-a986-7bbf06ad0a99 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:23.281263 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d489f70f-6f32-4b2a-a986-7bbf06ad0a99 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:23.290011 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d489f70f-6f32-4b2a-a986-7bbf06ad0a99 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:23.291897 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d489f70f-6f32-4b2a-a986-7bbf06ad0a99 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:23.293178 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d489f70f-6f32-4b2a-a986-7bbf06ad0a99 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:23.293942 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d489f70f-6f32-4b2a-a986-7bbf06ad0a99 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:23.678900 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d489f70f-6f32-4b2a-a986-7bbf06ad0a99 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:23.691966 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2697fc53-8761-4689-9445-8705b93a7ceb tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6646c45c9574550b601a37de6fc0321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db663b2f2234793bb4038ad90b2b972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:23.695186 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d489f70f-6f32-4b2a-a986-7bbf06ad0a99 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a" status: 200 len: 1346 microversion: 2.1 time: 0.417436 Jul 18 02:24:23.695955 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1328/2632] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:23 2022] GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a => generated 1346 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:24:23.708955 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2697fc53-8761-4689-9445-8705b93a7ceb tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] 10.222.0.57 "GET /compute/v2.1/servers/7b1fb401-75fb-4d72-96ee-b5a5f1146882" status: 200 len: 1314 microversion: 2.1 time: 1.435647 Jul 18 02:24:23.715902 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1305/2633] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:22 2022] GET /compute/v2.1/servers/7b1fb401-75fb-4d72-96ee-b5a5f1146882 => generated 1314 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:24.239292 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f8ee91fe-446d-411f-84f4-0b7ac6e450ae tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:24.240102 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f8ee91fe-446d-411f-84f4-0b7ac6e450ae tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:24.251718 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f8ee91fe-446d-411f-84f4-0b7ac6e450ae tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:24.252700 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f8ee91fe-446d-411f-84f4-0b7ac6e450ae tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:24.271559 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f8ee91fe-446d-411f-84f4-0b7ac6e450ae tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:24.275422 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f8ee91fe-446d-411f-84f4-0b7ac6e450ae tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:24.726058 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-32b01474-2b6c-4d85-b8ae-f3655decaad0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:24.727559 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-32b01474-2b6c-4d85-b8ae-f3655decaad0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:24.749044 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-32b01474-2b6c-4d85-b8ae-f3655decaad0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:24.749898 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-32b01474-2b6c-4d85-b8ae-f3655decaad0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:24.751357 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-32b01474-2b6c-4d85-b8ae-f3655decaad0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:24.752143 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-32b01474-2b6c-4d85-b8ae-f3655decaad0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:24.820145 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-32b01474-2b6c-4d85-b8ae-f3655decaad0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] HTTP exception thrown: Instance 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a could not be found. Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-32b01474-2b6c-4d85-b8ae-f3655decaad0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Request method failure captured: Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a HTTP/1.1 Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MPwaxUozPvSKq2aGl05vX5p9RkRh12PhrAa5ZuFGYH8QlWHXUoV4AOq2uE9nQ_2FUYuIDSWVSpjhgygJ-c4EGtTg2Y-_wVXi_cp3NARUTVck4-IU3Tev_AIZ-4eU7-_uXuXl7L-x01qv35sxA627UbKELg2PVDH9gxQj5dhwRrNVzw Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ba9d4e8f2f18460ebccacbe32db57388"}]}] Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-DeleteServersTestJSON-988442543 Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 89c4d32923874a50972ab0b75a4165c0 Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a could not be found. Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a'} Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a could not be found. Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a could not be found. Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:24.823601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:24.832225 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:24.832225 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:24.832225 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:24.832225 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:24:24.832225 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:24:24.832225 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a could not be found. Jul 18 02:24:24.832225 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:24.832225 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-32b01474-2b6c-4d85-b8ae-f3655decaad0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Returning 404 to user: Instance 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:24:24.832225 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-32b01474-2b6c-4d85-b8ae-f3655decaad0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a" status: 404 len: 111 microversion: 2.1 time: 0.107967 Jul 18 02:24:24.862773 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1306/2634] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:24 2022] GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:24:24.875102 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a80b0f5a-8172-44be-9371-3e23204862cb tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:24.883562 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a80b0f5a-8172-44be-9371-3e23204862cb tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] [instance: 7b1fb401-75fb-4d72-96ee-b5a5f1146882] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:24.909617 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a80b0f5a-8172-44be-9371-3e23204862cb tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:24.915344 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a80b0f5a-8172-44be-9371-3e23204862cb tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:24.920758 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a80b0f5a-8172-44be-9371-3e23204862cb tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:24.925219 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a80b0f5a-8172-44be-9371-3e23204862cb tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:25.519683 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f8ee91fe-446d-411f-84f4-0b7ac6e450ae tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:25.537104 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f8ee91fe-446d-411f-84f4-0b7ac6e450ae tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1313 microversion: 2.1 time: 1.300486 Jul 18 02:24:25.538451 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1329/2635] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:24 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1313 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:25.558665 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-633f98d5-f0d3-4197-88f7-f12e3295449b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:25.561807 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-633f98d5-f0d3-4197-88f7-f12e3295449b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:25.586509 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-633f98d5-f0d3-4197-88f7-f12e3295449b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:25.587477 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-633f98d5-f0d3-4197-88f7-f12e3295449b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:25.588748 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-633f98d5-f0d3-4197-88f7-f12e3295449b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:25.589469 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-633f98d5-f0d3-4197-88f7-f12e3295449b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:25.607598 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-633f98d5-f0d3-4197-88f7-f12e3295449b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] HTTP exception thrown: Instance 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a could not be found. Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-633f98d5-f0d3-4197-88f7-f12e3295449b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Request method failure captured: Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a/os-volume_attachments HTTP/1.1 Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MPwaxUozPvSKq2aGl05vX5p9RkRh12PhrAa5ZuFGYH8QlWHXUoV4AOq2uE9nQ_2FUYuIDSWVSpjhgygJ-c4EGtTg2Y-_wVXi_cp3NARUTVck4-IU3Tev_AIZ-4eU7-_uXuXl7L-x01qv35sxA627UbKELg2PVDH9gxQj5dhwRrNVzw Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ba9d4e8f2f18460ebccacbe32db57388"}]}] Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-DeleteServersTestJSON-988442543 Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 89c4d32923874a50972ab0b75a4165c0 Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a could not be found. Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'server_id': '104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a'} Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a could not be found. Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:24:25.609857 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a could not be found. Jul 18 02:24:25.614311 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:24:25.614311 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:25.614311 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:24:25.614311 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:25.614311 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:25.614311 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:25.614311 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:24:25.614311 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:24:25.614311 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a could not be found. Jul 18 02:24:25.614311 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:24:25.618078 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-633f98d5-f0d3-4197-88f7-f12e3295449b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Returning 404 to user: Instance 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:24:25.619439 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-633f98d5-f0d3-4197-88f7-f12e3295449b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.079292 Jul 18 02:24:25.621392 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1330/2636] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:24:25 2022] GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a/os-volume_attachments => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:24:25.783756 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a80b0f5a-8172-44be-9371-3e23204862cb tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6646c45c9574550b601a37de6fc0321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db663b2f2234793bb4038ad90b2b972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:25.798263 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a80b0f5a-8172-44be-9371-3e23204862cb tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] 10.222.0.57 "GET /compute/v2.1/servers/7b1fb401-75fb-4d72-96ee-b5a5f1146882" status: 200 len: 1314 microversion: 2.1 time: 0.933315 Jul 18 02:24:25.799733 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1307/2637] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:24 2022] GET /compute/v2.1/servers/7b1fb401-75fb-4d72-96ee-b5a5f1146882 => generated 1314 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:26.065440 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6118a109-f340-4145-a002-2217bbc8ff7e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-347076742", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "6dbd9947-7c83-4ca1-a653-57a9c042a444"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:26.180572 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-6118a109-f340-4145-a002-2217bbc8ff7e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] validate_networks() for [('6dbd9947-7c83-4ca1-a653-57a9c042a444', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:24:26.557196 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-65a0a711-d319-4628-baac-26d717f81057 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:26.558107 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-65a0a711-d319-4628-baac-26d717f81057 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:26.569613 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65a0a711-d319-4628-baac-26d717f81057 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:26.570714 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65a0a711-d319-4628-baac-26d717f81057 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:26.571776 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65a0a711-d319-4628-baac-26d717f81057 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:26.572371 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65a0a711-d319-4628-baac-26d717f81057 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:26.955566 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-65a0a711-d319-4628-baac-26d717f81057 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:26.975400 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-65a0a711-d319-4628-baac-26d717f81057 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1313 microversion: 2.1 time: 0.423098 Jul 18 02:24:26.977739 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1308/2638] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:26 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1313 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:24:27.006948 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d9ef5a1a-13a9-4476-83b5-a983a3058eb1 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:27.011469 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d9ef5a1a-13a9-4476-83b5-a983a3058eb1 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] [instance: 7b1fb401-75fb-4d72-96ee-b5a5f1146882] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:27.033989 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d9ef5a1a-13a9-4476-83b5-a983a3058eb1 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:27.035162 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d9ef5a1a-13a9-4476-83b5-a983a3058eb1 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:27.037573 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d9ef5a1a-13a9-4476-83b5-a983a3058eb1 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:27.038945 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d9ef5a1a-13a9-4476-83b5-a983a3058eb1 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:27.588649 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-6118a109-f340-4145-a002-2217bbc8ff7e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:24:27.589639 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-6118a109-f340-4145-a002-2217bbc8ff7e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:24:27.591749 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-6118a109-f340-4145-a002-2217bbc8ff7e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:24:27.592021 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-6118a109-f340-4145-a002-2217bbc8ff7e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:24:27.593068 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-6118a109-f340-4145-a002-2217bbc8ff7e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:24:27.603855 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6118a109-f340-4145-a002-2217bbc8ff7e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:27.604738 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6118a109-f340-4145-a002-2217bbc8ff7e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:27.605889 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6118a109-f340-4145-a002-2217bbc8ff7e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:27.606600 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6118a109-f340-4145-a002-2217bbc8ff7e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:27.633588 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-6118a109-f340-4145-a002-2217bbc8ff7e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Getting quotas for project ba9d4e8f2f18460ebccacbe32db57388. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:24:27.642419 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-6118a109-f340-4145-a002-2217bbc8ff7e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Getting quotas for user 89c4d32923874a50972ab0b75a4165c0 and project ba9d4e8f2f18460ebccacbe32db57388. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:24:27.694683 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6118a109-f340-4145-a002-2217bbc8ff7e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:24:27.696769 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6118a109-f340-4145-a002-2217bbc8ff7e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: d53aa87d-8927-449a-8792-afb60f09fd31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:24:27.703948 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d9ef5a1a-13a9-4476-83b5-a983a3058eb1 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6646c45c9574550b601a37de6fc0321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db663b2f2234793bb4038ad90b2b972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:27.720387 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d9ef5a1a-13a9-4476-83b5-a983a3058eb1 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] 10.222.0.57 "GET /compute/v2.1/servers/7b1fb401-75fb-4d72-96ee-b5a5f1146882" status: 200 len: 1314 microversion: 2.1 time: 0.740411 Jul 18 02:24:27.725586 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1309/2639] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:26 2022] GET /compute/v2.1/servers/7b1fb401-75fb-4d72-96ee-b5a5f1146882 => generated 1314 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:27.739677 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-594da031-f93e-44fe-a194-86a490f60064 req-fa325238-eae9-4e68-8d75-ab08ccea65a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7", "name": "network-vif-plugged", "status": "completed", "tag": "d130b73f-1f50-4848-bcf5-1bc41a9e7331"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:27.771140 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-594da031-f93e-44fe-a194-86a490f60064 req-fa325238-eae9-4e68-8d75-ab08ccea65a0 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:27.771962 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-594da031-f93e-44fe-a194-86a490f60064 req-fa325238-eae9-4e68-8d75-ab08ccea65a0 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:27.787300 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-594da031-f93e-44fe-a194-86a490f60064 req-fa325238-eae9-4e68-8d75-ab08ccea65a0 service nova] Creating event network-vif-plugged:d130b73f-1f50-4848-bcf5-1bc41a9e7331 for instance dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 on n-h1-465891-3 Jul 18 02:24:27.795587 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-594da031-f93e-44fe-a194-86a490f60064 req-fa325238-eae9-4e68-8d75-ab08ccea65a0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067498 Jul 18 02:24:27.797738 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1310/2640] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:27.834469 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6118a109-f340-4145-a002-2217bbc8ff7e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.772568 Jul 18 02:24:27.845004 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1331/2641] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:24:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:24:27.849990 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cf722d3c-f28e-481f-9fb4-6f44d9011bbf tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:27.850714 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cf722d3c-f28e-481f-9fb4-6f44d9011bbf tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: d53aa87d-8927-449a-8792-afb60f09fd31] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:27.995663 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-78ee2570-9696-4a8f-9c21-92539080d0d1 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:27.996304 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-78ee2570-9696-4a8f-9c21-92539080d0d1 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:28.011080 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-78ee2570-9696-4a8f-9c21-92539080d0d1 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:28.011542 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-78ee2570-9696-4a8f-9c21-92539080d0d1 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:28.013632 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-78ee2570-9696-4a8f-9c21-92539080d0d1 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:28.016036 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-78ee2570-9696-4a8f-9c21-92539080d0d1 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:28.679251 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-cf722d3c-f28e-481f-9fb4-6f44d9011bbf tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:28.689478 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cf722d3c-f28e-481f-9fb4-6f44d9011bbf tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/d53aa87d-8927-449a-8792-afb60f09fd31" status: 200 len: 1214 microversion: 2.1 time: 0.845653 Jul 18 02:24:28.690224 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1311/2642] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:27 2022] GET /compute/v2.1/servers/d53aa87d-8927-449a-8792-afb60f09fd31 => generated 1214 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:28.711442 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c8a9e6aa-0ccf-434c-b6dd-1f2346f1ee2b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:28.711937 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c8a9e6aa-0ccf-434c-b6dd-1f2346f1ee2b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: d53aa87d-8927-449a-8792-afb60f09fd31] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:28.754400 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c8a9e6aa-0ccf-434c-b6dd-1f2346f1ee2b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: d53aa87d-8927-449a-8792-afb60f09fd31] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:24:29.398113 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.scheduler.client.report [None req-c8a9e6aa-0ccf-434c-b6dd-1f2346f1ee2b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Deleted allocations for instance d53aa87d-8927-449a-8792-afb60f09fd31 Jul 18 02:24:29.408066 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-78ee2570-9696-4a8f-9c21-92539080d0d1 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:29.424591 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-78ee2570-9696-4a8f-9c21-92539080d0d1 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1313 microversion: 2.1 time: 1.433391 Jul 18 02:24:29.425538 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1332/2643] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:27 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1313 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:29.430443 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1bdbd08d-97e3-40ec-9d35-b0d3f65296fe tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:29.431060 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1bdbd08d-97e3-40ec-9d35-b0d3f65296fe tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] [instance: 7b1fb401-75fb-4d72-96ee-b5a5f1146882] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:29.450350 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c8a9e6aa-0ccf-434c-b6dd-1f2346f1ee2b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d53aa87d-8927-449a-8792-afb60f09fd31" status: 204 len: 0 microversion: 2.1 time: 0.740834 Jul 18 02:24:29.450958 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1bdbd08d-97e3-40ec-9d35-b0d3f65296fe tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:29.451500 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1bdbd08d-97e3-40ec-9d35-b0d3f65296fe tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:29.452346 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1bdbd08d-97e3-40ec-9d35-b0d3f65296fe tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:29.452796 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1bdbd08d-97e3-40ec-9d35-b0d3f65296fe tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:29.454889 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1312/2644] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:24:28 2022] DELETE /compute/v2.1/servers/d53aa87d-8927-449a-8792-afb60f09fd31 => generated 0 bytes in 748 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:24:29.470808 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-04976cf0-6a83-48f7-a499-9130a5a11f96 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:29.471564 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-04976cf0-6a83-48f7-a499-9130a5a11f96 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: d53aa87d-8927-449a-8792-afb60f09fd31] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:29.499609 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-04976cf0-6a83-48f7-a499-9130a5a11f96 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:29.502778 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-04976cf0-6a83-48f7-a499-9130a5a11f96 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:29.503779 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-04976cf0-6a83-48f7-a499-9130a5a11f96 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:29.504244 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-04976cf0-6a83-48f7-a499-9130a5a11f96 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:29.523442 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-04976cf0-6a83-48f7-a499-9130a5a11f96 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] HTTP exception thrown: Instance d53aa87d-8927-449a-8792-afb60f09fd31 could not be found. Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-04976cf0-6a83-48f7-a499-9130a5a11f96 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Request method failure captured: Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/d53aa87d-8927-449a-8792-afb60f09fd31 HTTP/1.1 Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MPwaxUozPvSKq2aGl05vX5p9RkRh12PhrAa5ZuFGYH8QlWHXUoV4AOq2uE9nQ_2FUYuIDSWVSpjhgygJ-c4EGtTg2Y-_wVXi_cp3NARUTVck4-IU3Tev_AIZ-4eU7-_uXuXl7L-x01qv35sxA627UbKELg2PVDH9gxQj5dhwRrNVzw Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ba9d4e8f2f18460ebccacbe32db57388"}]}] Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-DeleteServersTestJSON-988442543 Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 89c4d32923874a50972ab0b75a4165c0 Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance d53aa87d-8927-449a-8792-afb60f09fd31 could not be found. Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'd53aa87d-8927-449a-8792-afb60f09fd31'} Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d53aa87d-8927-449a-8792-afb60f09fd31 could not be found. Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d53aa87d-8927-449a-8792-afb60f09fd31 could not be found. Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:29.525171 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:29.530008 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:29.530008 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:29.530008 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:29.530008 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:24:29.530008 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:24:29.530008 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d53aa87d-8927-449a-8792-afb60f09fd31 could not be found. Jul 18 02:24:29.530008 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:29.530008 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-04976cf0-6a83-48f7-a499-9130a5a11f96 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Returning 404 to user: Instance d53aa87d-8927-449a-8792-afb60f09fd31 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:24:29.530008 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-04976cf0-6a83-48f7-a499-9130a5a11f96 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/d53aa87d-8927-449a-8792-afb60f09fd31" status: 404 len: 111 microversion: 2.1 time: 0.061819 Jul 18 02:24:29.530008 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1313/2645] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:29 2022] GET /compute/v2.1/servers/d53aa87d-8927-449a-8792-afb60f09fd31 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:24:29.626340 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b17b73be-eca5-497f-966a-2ef3d89b6271 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1246701091", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "6dbd9947-7c83-4ca1-a653-57a9c042a444"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:29.705603 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-b17b73be-eca5-497f-966a-2ef3d89b6271 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] validate_networks() for [('6dbd9947-7c83-4ca1-a653-57a9c042a444', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:24:29.968766 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1bdbd08d-97e3-40ec-9d35-b0d3f65296fe tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6646c45c9574550b601a37de6fc0321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db663b2f2234793bb4038ad90b2b972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:29.989992 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1bdbd08d-97e3-40ec-9d35-b0d3f65296fe tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] 10.222.0.57 "GET /compute/v2.1/servers/7b1fb401-75fb-4d72-96ee-b5a5f1146882" status: 200 len: 1314 microversion: 2.1 time: 0.562991 Jul 18 02:24:29.994914 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1333/2646] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:29 2022] GET /compute/v2.1/servers/7b1fb401-75fb-4d72-96ee-b5a5f1146882 => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:30.008261 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-3b136c08-5c74-48f6-b43b-51db16afc97a req-77f626ed-125a-444c-98bd-569a1917ec65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b1fb401-75fb-4d72-96ee-b5a5f1146882", "name": "network-vif-plugged", "status": "completed", "tag": "c40205a1-085f-4751-9efd-57c16c913fa4"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:30.037234 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-3b136c08-5c74-48f6-b43b-51db16afc97a req-77f626ed-125a-444c-98bd-569a1917ec65 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:30.038336 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-3b136c08-5c74-48f6-b43b-51db16afc97a req-77f626ed-125a-444c-98bd-569a1917ec65 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:30.067126 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-3b136c08-5c74-48f6-b43b-51db16afc97a req-77f626ed-125a-444c-98bd-569a1917ec65 service nova] Creating event network-vif-plugged:c40205a1-085f-4751-9efd-57c16c913fa4 for instance 7b1fb401-75fb-4d72-96ee-b5a5f1146882 on n-h2-465891-3 Jul 18 02:24:30.078877 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-3b136c08-5c74-48f6-b43b-51db16afc97a req-77f626ed-125a-444c-98bd-569a1917ec65 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081253 Jul 18 02:24:30.080470 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1334/2647] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:30.455402 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-df1bc0a0-5607-4f4f-b1cf-6bdd70cf48de tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:30.456599 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-df1bc0a0-5607-4f4f-b1cf-6bdd70cf48de tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:30.480008 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-df1bc0a0-5607-4f4f-b1cf-6bdd70cf48de tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:30.480008 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-df1bc0a0-5607-4f4f-b1cf-6bdd70cf48de tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:30.480802 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-df1bc0a0-5607-4f4f-b1cf-6bdd70cf48de tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:30.481262 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-df1bc0a0-5607-4f4f-b1cf-6bdd70cf48de tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:30.488040 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:24:31.333570 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-df1bc0a0-5607-4f4f-b1cf-6bdd70cf48de tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:31.352414 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-df1bc0a0-5607-4f4f-b1cf-6bdd70cf48de tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1313 microversion: 2.1 time: 0.911059 Jul 18 02:24:31.365748 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1335/2648] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:30 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1313 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:31.377403 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-752f7f62-430b-4f54-bcaa-bde49fcf2233 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:31.378149 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-752f7f62-430b-4f54-bcaa-bde49fcf2233 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] [instance: 7b1fb401-75fb-4d72-96ee-b5a5f1146882] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:31.386077 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-752f7f62-430b-4f54-bcaa-bde49fcf2233 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:31.386679 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-752f7f62-430b-4f54-bcaa-bde49fcf2233 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:31.387657 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-752f7f62-430b-4f54-bcaa-bde49fcf2233 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:31.389527 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-752f7f62-430b-4f54-bcaa-bde49fcf2233 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:31.566903 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-b17b73be-eca5-497f-966a-2ef3d89b6271 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:24:31.567806 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-b17b73be-eca5-497f-966a-2ef3d89b6271 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:24:31.568816 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-b17b73be-eca5-497f-966a-2ef3d89b6271 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:24:31.569675 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-b17b73be-eca5-497f-966a-2ef3d89b6271 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:24:31.570587 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-b17b73be-eca5-497f-966a-2ef3d89b6271 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:24:31.594896 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b17b73be-eca5-497f-966a-2ef3d89b6271 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:31.596005 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b17b73be-eca5-497f-966a-2ef3d89b6271 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:31.598601 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b17b73be-eca5-497f-966a-2ef3d89b6271 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:31.599581 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b17b73be-eca5-497f-966a-2ef3d89b6271 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:31.641236 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-b17b73be-eca5-497f-966a-2ef3d89b6271 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Getting quotas for project ba9d4e8f2f18460ebccacbe32db57388. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:24:31.654378 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-b17b73be-eca5-497f-966a-2ef3d89b6271 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Getting quotas for user 89c4d32923874a50972ab0b75a4165c0 and project ba9d4e8f2f18460ebccacbe32db57388. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:24:31.685099 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b17b73be-eca5-497f-966a-2ef3d89b6271 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:24:31.690487 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b17b73be-eca5-497f-966a-2ef3d89b6271 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b88a4eac-c5c4-42d9-a57a-02975ace4b39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:24:31.861214 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b17b73be-eca5-497f-966a-2ef3d89b6271 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.234657 Jul 18 02:24:31.863901 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1314/2649] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:24:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2243 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:24:31.894784 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2c71c675-5632-453c-8bb4-dbb602077058 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:31.895578 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2c71c675-5632-453c-8bb4-dbb602077058 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:31.925898 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2c71c675-5632-453c-8bb4-dbb602077058 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:31.926901 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2c71c675-5632-453c-8bb4-dbb602077058 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:31.929745 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2c71c675-5632-453c-8bb4-dbb602077058 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:31.933008 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2c71c675-5632-453c-8bb4-dbb602077058 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:32.043653 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 02:24:32.043653 n-d-465891-3 devstack@n-api.service[119544]: Mon Jul 18 02:24:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 (ip 10.222.0.57) !!! Jul 18 02:24:32.090914 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2c71c675-5632-453c-8bb4-dbb602077058 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:24:32.418673 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2c71c675-5632-453c-8bb4-dbb602077058 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 204 len: 0 microversion: 2.42 time: 0.550358 Jul 18 02:24:32.425145 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1315/2650] 10.222.0.57 () {60 vars in 1279 bytes} [Mon Jul 18 02:24:31 2022] DELETE /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:24:32.437521 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2e67b279-cc25-40af-859b-8678464294f1 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:32.441213 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2e67b279-cc25-40af-859b-8678464294f1 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b88a4eac-c5c4-42d9-a57a-02975ace4b39] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:32.898759 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2e67b279-cc25-40af-859b-8678464294f1 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:32.936714 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2e67b279-cc25-40af-859b-8678464294f1 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39" status: 200 len: 1215 microversion: 2.1 time: 0.510919 Jul 18 02:24:32.940864 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1316/2651] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:32 2022] GET /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39 => generated 1215 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:32.961077 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-556fc986-62e3-411a-93b0-6f752461a3a1 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:32.976027 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-556fc986-62e3-411a-93b0-6f752461a3a1 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:32.993839 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-752f7f62-430b-4f54-bcaa-bde49fcf2233 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6646c45c9574550b601a37de6fc0321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db663b2f2234793bb4038ad90b2b972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:33.005666 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-556fc986-62e3-411a-93b0-6f752461a3a1 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:33.011417 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-556fc986-62e3-411a-93b0-6f752461a3a1 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:33.012947 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-556fc986-62e3-411a-93b0-6f752461a3a1 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:33.019273 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-556fc986-62e3-411a-93b0-6f752461a3a1 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:33.044359 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-752f7f62-430b-4f54-bcaa-bde49fcf2233 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] 10.222.0.57 "GET /compute/v2.1/servers/7b1fb401-75fb-4d72-96ee-b5a5f1146882" status: 200 len: 1314 microversion: 2.1 time: 1.684472 Jul 18 02:24:33.045757 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1336/2652] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:31 2022] GET /compute/v2.1/servers/7b1fb401-75fb-4d72-96ee-b5a5f1146882 => generated 1314 bytes in 1692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:33.090309 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e6e562de-56cb-46e8-a4be-2f2a1103a8e4 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:33.096400 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e6e562de-56cb-46e8-a4be-2f2a1103a8e4 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:33.127423 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:24:33.146978 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e6e562de-56cb-46e8-a4be-2f2a1103a8e4 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:33.156897 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e6e562de-56cb-46e8-a4be-2f2a1103a8e4 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:33.160699 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e6e562de-56cb-46e8-a4be-2f2a1103a8e4 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:33.163862 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e6e562de-56cb-46e8-a4be-2f2a1103a8e4 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:33.834363 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-556fc986-62e3-411a-93b0-6f752461a3a1 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:33.846318 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-556fc986-62e3-411a-93b0-6f752461a3a1 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1463 microversion: 2.1 time: 0.899068 Jul 18 02:24:33.851839 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1317/2653] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:32 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1463 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:33.884619 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-22f44cff-8e18-499e-8d67-491facad6cfe tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:33.887154 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-22f44cff-8e18-499e-8d67-491facad6cfe tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:33.894930 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:24:33.912073 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-22f44cff-8e18-499e-8d67-491facad6cfe tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:33.914148 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-22f44cff-8e18-499e-8d67-491facad6cfe tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:33.915836 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-22f44cff-8e18-499e-8d67-491facad6cfe tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:33.916972 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-22f44cff-8e18-499e-8d67-491facad6cfe tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:34.104127 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e6e562de-56cb-46e8-a4be-2f2a1103a8e4 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:34.130425 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e6e562de-56cb-46e8-a4be-2f2a1103a8e4 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:34.136770 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e6e562de-56cb-46e8-a4be-2f2a1103a8e4 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:34.139649 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e6e562de-56cb-46e8-a4be-2f2a1103a8e4 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 2952 microversion: 2.42 time: 1.085746 Jul 18 02:24:34.142197 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1337/2654] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:24:33 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 2952 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:24:34.152715 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7c1ca837-a936-4024-9b11-4231b95264f1 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:34.154397 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7c1ca837-a936-4024-9b11-4231b95264f1 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b88a4eac-c5c4-42d9-a57a-02975ace4b39] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:34.172920 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7c1ca837-a936-4024-9b11-4231b95264f1 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:34.174205 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7c1ca837-a936-4024-9b11-4231b95264f1 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:34.177572 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7c1ca837-a936-4024-9b11-4231b95264f1 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:34.179087 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7c1ca837-a936-4024-9b11-4231b95264f1 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:34.288195 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-22f44cff-8e18-499e-8d67-491facad6cfe tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:34.304428 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-22f44cff-8e18-499e-8d67-491facad6cfe tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Old instance type m1.heat2, new instance type m1.heat {{(pid=119544) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 02:24:34.327808 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-22f44cff-8e18-499e-8d67-491facad6cfe tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:24:34.340262 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-22f44cff-8e18-499e-8d67-491facad6cfe tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:24:34.341514 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-22f44cff-8e18-499e-8d67-491facad6cfe tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:24:34.343086 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-22f44cff-8e18-499e-8d67-491facad6cfe tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:24:34.343086 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-22f44cff-8e18-499e-8d67-491facad6cfe tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:24:34.348988 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7c1ca837-a936-4024-9b11-4231b95264f1 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:34.381752 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7c1ca837-a936-4024-9b11-4231b95264f1 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39" status: 200 len: 1219 microversion: 2.1 time: 0.233496 Jul 18 02:24:34.384233 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1338/2655] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:34 2022] GET /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39 => generated 1219 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:34.395644 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c644a6ac-ae2b-4538-a421-5759777f52c9 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:34.402019 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c644a6ac-ae2b-4538-a421-5759777f52c9 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] [instance: 7b1fb401-75fb-4d72-96ee-b5a5f1146882] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:34.440530 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c644a6ac-ae2b-4538-a421-5759777f52c9 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:34.446832 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c644a6ac-ae2b-4538-a421-5759777f52c9 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:34.454652 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c644a6ac-ae2b-4538-a421-5759777f52c9 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:34.460162 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c644a6ac-ae2b-4538-a421-5759777f52c9 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:34.627942 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-22f44cff-8e18-499e-8d67-491facad6cfe tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "POST /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7/action" status: 202 len: 0 microversion: 2.1 time: 0.754520 Jul 18 02:24:34.629587 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1318/2656] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:24:33 2022] POST /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7/action => generated 0 bytes in 757 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:24:34.671493 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6cb2e8aa-d6bf-4511-9d3b-7e447ff009e9 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:34.679663 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6cb2e8aa-d6bf-4511-9d3b-7e447ff009e9 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:34.734933 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6cb2e8aa-d6bf-4511-9d3b-7e447ff009e9 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:34.736159 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6cb2e8aa-d6bf-4511-9d3b-7e447ff009e9 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:34.746728 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6cb2e8aa-d6bf-4511-9d3b-7e447ff009e9 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:34.747947 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6cb2e8aa-d6bf-4511-9d3b-7e447ff009e9 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:35.434655 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c644a6ac-ae2b-4538-a421-5759777f52c9 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6646c45c9574550b601a37de6fc0321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db663b2f2234793bb4038ad90b2b972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:35.444712 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c644a6ac-ae2b-4538-a421-5759777f52c9 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] 10.222.0.57 "GET /compute/v2.1/servers/7b1fb401-75fb-4d72-96ee-b5a5f1146882" status: 200 len: 1464 microversion: 2.1 time: 1.058467 Jul 18 02:24:35.449889 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1339/2657] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:34 2022] GET /compute/v2.1/servers/7b1fb401-75fb-4d72-96ee-b5a5f1146882 => generated 1464 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:35.461158 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-956e4458-205e-4b48-b541-df3f8f200b96 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:35.464062 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-956e4458-205e-4b48-b541-df3f8f200b96 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:35.478961 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6cb2e8aa-d6bf-4511-9d3b-7e447ff009e9 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:35.483924 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-956e4458-205e-4b48-b541-df3f8f200b96 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:35.484399 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-956e4458-205e-4b48-b541-df3f8f200b96 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:35.486680 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-956e4458-205e-4b48-b541-df3f8f200b96 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:35.492707 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-956e4458-205e-4b48-b541-df3f8f200b96 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:35.496763 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6cb2e8aa-d6bf-4511-9d3b-7e447ff009e9 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1472 microversion: 2.1 time: 0.850272 Jul 18 02:24:35.509076 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1319/2658] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:34 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1472 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:35.522393 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e46a8439-30cb-43c0-be0b-307efed0f5af tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:35.523023 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e46a8439-30cb-43c0-be0b-307efed0f5af tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b88a4eac-c5c4-42d9-a57a-02975ace4b39] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:35.561552 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e46a8439-30cb-43c0-be0b-307efed0f5af tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:35.562956 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e46a8439-30cb-43c0-be0b-307efed0f5af tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:35.562956 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e46a8439-30cb-43c0-be0b-307efed0f5af tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:35.563976 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e46a8439-30cb-43c0-be0b-307efed0f5af tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:36.072878 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e46a8439-30cb-43c0-be0b-307efed0f5af tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:36.098906 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e46a8439-30cb-43c0-be0b-307efed0f5af tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39" status: 200 len: 1267 microversion: 2.1 time: 0.584626 Jul 18 02:24:36.099682 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1320/2659] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:35 2022] GET /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39 => generated 1267 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:36.469665 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-956e4458-205e-4b48-b541-df3f8f200b96 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:36.488082 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-956e4458-205e-4b48-b541-df3f8f200b96 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:36.496949 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-956e4458-205e-4b48-b541-df3f8f200b96 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:36.498430 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-956e4458-205e-4b48-b541-df3f8f200b96 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 2952 microversion: 2.42 time: 1.045059 Jul 18 02:24:36.499122 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1340/2660] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:24:35 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 2952 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:24:36.778272 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8acee4e3-5446-4b2c-a114-1eb60010f9e8 tempest-TenantUsagesTestJSON-1760970516 tempest-TenantUsagesTestJSON-1760970516-project-admin] Calling method '.version_select at 0x7ff49bdc6160>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:36.803048 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a7809f30-6a3a-4ca1-a2ba-724b1be2ef12 tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] Action: 'create', calling method: .version_select at 0x7ff49baeb280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1530453591", "description": "tempest-description-1766484561"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:36.843695 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8acee4e3-5446-4b2c-a114-1eb60010f9e8 tempest-TenantUsagesTestJSON-1760970516 tempest-TenantUsagesTestJSON-1760970516-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:36.844727 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8acee4e3-5446-4b2c-a114-1eb60010f9e8 tempest-TenantUsagesTestJSON-1760970516 tempest-TenantUsagesTestJSON-1760970516-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:36.945328 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8acee4e3-5446-4b2c-a114-1eb60010f9e8 tempest-TenantUsagesTestJSON-1760970516 tempest-TenantUsagesTestJSON-1760970516-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:36.956099 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8acee4e3-5446-4b2c-a114-1eb60010f9e8 tempest-TenantUsagesTestJSON-1760970516 tempest-TenantUsagesTestJSON-1760970516-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:37.005655 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8acee4e3-5446-4b2c-a114-1eb60010f9e8 tempest-TenantUsagesTestJSON-1760970516 tempest-TenantUsagesTestJSON-1760970516-project-admin] 10.222.0.57 "GET /compute/v2.1/os-simple-tenant-usage/2db663b2f2234793bb4038ad90b2b972?start=2022-07-17T02%3A24%3A35.459856&end=2022-07-19T02%3A24%3A35.459856" status: 200 len: 695 microversion: 2.1 time: 0.902974 Jul 18 02:24:37.011813 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1321/2661] 10.222.0.57 () {58 vars in 1411 bytes} [Mon Jul 18 02:24:36 2022] GET /compute/v2.1/os-simple-tenant-usage/2db663b2f2234793bb4038ad90b2b972?start=2022-07-17T02%3A24%3A35.459856&end=2022-07-19T02%3A24%3A35.459856 => generated 695 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:37.024105 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7a843bc8-5116-42f8-93ea-b52609ba7e3b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:37.028853 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7a843bc8-5116-42f8-93ea-b52609ba7e3b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:37.046907 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7a843bc8-5116-42f8-93ea-b52609ba7e3b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:37.047381 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7a843bc8-5116-42f8-93ea-b52609ba7e3b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:37.050111 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7a843bc8-5116-42f8-93ea-b52609ba7e3b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:37.051535 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7a843bc8-5116-42f8-93ea-b52609ba7e3b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:37.213192 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a7809f30-6a3a-4ca1-a2ba-724b1be2ef12 tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.696730 Jul 18 02:24:37.215217 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1341/2662] 10.222.0.57 () {60 vars in 1179 bytes} [Mon Jul 18 02:24:36 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:37.250090 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-015facf8-b5b1-403c-a5b5-34934625f923 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Calling method '.version_select at 0x7ff49ba31670>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:37.272182 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-015facf8-b5b1-403c-a5b5-34934625f923 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:37.275115 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-015facf8-b5b1-403c-a5b5-34934625f923 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:37.309451 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-015facf8-b5b1-403c-a5b5-34934625f923 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:37.311872 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-015facf8-b5b1-403c-a5b5-34934625f923 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:37.334281 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-015facf8-b5b1-403c-a5b5-34934625f923 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] 10.222.0.57 "GET /compute/v2.1/os-simple-tenant-usage/2db663b2f2234793bb4038ad90b2b972?start=2022-07-17T02%3A24%3A35.459856&end=2022-07-19T02%3A24%3A35.459856" status: 200 len: 695 microversion: 2.1 time: 0.117290 Jul 18 02:24:37.334909 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1342/2663] 10.222.0.57 () {58 vars in 1411 bytes} [Mon Jul 18 02:24:37 2022] GET /compute/v2.1/os-simple-tenant-usage/2db663b2f2234793bb4038ad90b2b972?start=2022-07-17T02%3A24%3A35.459856&end=2022-07-19T02%3A24%3A35.459856 => generated 695 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:37.348958 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-09e9c7e3-537a-4b6d-aa05-7b76e383a64a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:37.349983 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-09e9c7e3-537a-4b6d-aa05-7b76e383a64a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b88a4eac-c5c4-42d9-a57a-02975ace4b39] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:37.358039 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-09e9c7e3-537a-4b6d-aa05-7b76e383a64a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:37.358823 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-09e9c7e3-537a-4b6d-aa05-7b76e383a64a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:37.360473 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-09e9c7e3-537a-4b6d-aa05-7b76e383a64a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:37.361814 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-09e9c7e3-537a-4b6d-aa05-7b76e383a64a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:37.667988 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:24:38.058962 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-09e9c7e3-537a-4b6d-aa05-7b76e383a64a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:38.064109 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7a843bc8-5116-42f8-93ea-b52609ba7e3b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:38.081624 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-09e9c7e3-537a-4b6d-aa05-7b76e383a64a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39" status: 200 len: 1273 microversion: 2.1 time: 0.734165 Jul 18 02:24:38.084619 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7a843bc8-5116-42f8-93ea-b52609ba7e3b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1472 microversion: 2.1 time: 1.067504 Jul 18 02:24:38.084811 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1343/2664] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:37 2022] GET /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39 => generated 1273 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:38.087013 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1322/2665] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:37 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1472 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:38.099766 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2929a1ac-2744-4f75-9ed5-a218d820e7a2 tempest-TenantUsagesTestJSON-1760970516 tempest-TenantUsagesTestJSON-1760970516-project-admin] Calling method '.version_select at 0x7ff4adce4160>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:38.109510 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-361d649a-0f40-42f8-b430-2ef0927ab184 tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] Action: 'create', calling method: .version_select at 0x7ff49bc678b0>, body: {"security_group_rule": {"parent_group_id": "ab9a0cb7-4212-4717-ae3b-01908f800a77", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:38.116846 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2929a1ac-2744-4f75-9ed5-a218d820e7a2 tempest-TenantUsagesTestJSON-1760970516 tempest-TenantUsagesTestJSON-1760970516-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:38.118022 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2929a1ac-2744-4f75-9ed5-a218d820e7a2 tempest-TenantUsagesTestJSON-1760970516 tempest-TenantUsagesTestJSON-1760970516-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:38.138781 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2929a1ac-2744-4f75-9ed5-a218d820e7a2 tempest-TenantUsagesTestJSON-1760970516 tempest-TenantUsagesTestJSON-1760970516-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:38.139757 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2929a1ac-2744-4f75-9ed5-a218d820e7a2 tempest-TenantUsagesTestJSON-1760970516 tempest-TenantUsagesTestJSON-1760970516-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:38.349821 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2929a1ac-2744-4f75-9ed5-a218d820e7a2 tempest-TenantUsagesTestJSON-1760970516 tempest-TenantUsagesTestJSON-1760970516-project-admin] 10.222.0.57 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-17T02%3A24%3A35.459856&end=2022-07-19T02%3A24%3A35.459856&detailed=1" status: 200 len: 33745 microversion: 2.1 time: 0.260445 Jul 18 02:24:38.363649 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1323/2666] 10.222.0.57 () {58 vars in 1334 bytes} [Mon Jul 18 02:24:38 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-17T02%3A24%3A35.459856&end=2022-07-19T02%3A24%3A35.459856&detailed=1 => generated 33745 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:24:38.387982 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-dfb7ab1b-d856-4a90-89ff-07213d731767 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:38.391355 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-dfb7ab1b-d856-4a90-89ff-07213d731767 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:38.399301 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dfb7ab1b-d856-4a90-89ff-07213d731767 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:38.400406 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dfb7ab1b-d856-4a90-89ff-07213d731767 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:38.401568 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dfb7ab1b-d856-4a90-89ff-07213d731767 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:38.402295 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dfb7ab1b-d856-4a90-89ff-07213d731767 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:39.162269 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-dfb7ab1b-d856-4a90-89ff-07213d731767 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:39.176529 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-dfb7ab1b-d856-4a90-89ff-07213d731767 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:39.193352 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-dfb7ab1b-d856-4a90-89ff-07213d731767 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:39.195340 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-dfb7ab1b-d856-4a90-89ff-07213d731767 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 2931 microversion: 2.42 time: 0.830119 Jul 18 02:24:39.196261 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1324/2667] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:24:38 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 2931 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:24:39.201432 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-1084134d-9fe9-4169-9102-7f4673cbbba5 req-136bc539-d3e8-4161-ae84-9ce62e5da4ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b909490f-2890-43c0-b956-9de562d52d67", "name": "network-vif-unplugged", "status": "completed", "tag": "11cacb3f-8e0c-4904-8fb7-ad9beec7e463"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:39.227356 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-1084134d-9fe9-4169-9102-7f4673cbbba5 req-136bc539-d3e8-4161-ae84-9ce62e5da4ef service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:39.228327 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-1084134d-9fe9-4169-9102-7f4673cbbba5 req-136bc539-d3e8-4161-ae84-9ce62e5da4ef service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:39.259409 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-1084134d-9fe9-4169-9102-7f4673cbbba5 req-136bc539-d3e8-4161-ae84-9ce62e5da4ef service nova] Creating event network-vif-unplugged:11cacb3f-8e0c-4904-8fb7-ad9beec7e463 for instance b909490f-2890-43c0-b956-9de562d52d67 on n-h2-465891-3 Jul 18 02:24:39.276039 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-1084134d-9fe9-4169-9102-7f4673cbbba5 req-136bc539-d3e8-4161-ae84-9ce62e5da4ef service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078073 Jul 18 02:24:39.277210 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1325/2668] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:39.282731 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-144992bf-b48c-4b66-acbc-9036e5ec13dd tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:39.283697 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-144992bf-b48c-4b66-acbc-9036e5ec13dd tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] [instance: 7b1fb401-75fb-4d72-96ee-b5a5f1146882] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:39.297634 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-144992bf-b48c-4b66-acbc-9036e5ec13dd tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:39.298600 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-144992bf-b48c-4b66-acbc-9036e5ec13dd tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:39.299736 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-144992bf-b48c-4b66-acbc-9036e5ec13dd tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:39.301320 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-144992bf-b48c-4b66-acbc-9036e5ec13dd tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:39.350653 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-144992bf-b48c-4b66-acbc-9036e5ec13dd tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] [instance: 7b1fb401-75fb-4d72-96ee-b5a5f1146882] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:24:39.591811 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-144992bf-b48c-4b66-acbc-9036e5ec13dd tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7b1fb401-75fb-4d72-96ee-b5a5f1146882" status: 204 len: 0 microversion: 2.1 time: 0.310175 Jul 18 02:24:39.592930 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1326/2669] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:24:39 2022] DELETE /compute/v2.1/servers/7b1fb401-75fb-4d72-96ee-b5a5f1146882 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:24:39.605606 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2d107e97-d9fb-449f-a3c1-541ca236cc68 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:39.613926 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2d107e97-d9fb-449f-a3c1-541ca236cc68 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b88a4eac-c5c4-42d9-a57a-02975ace4b39] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:39.632559 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2d107e97-d9fb-449f-a3c1-541ca236cc68 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:39.634069 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2d107e97-d9fb-449f-a3c1-541ca236cc68 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:39.635112 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2d107e97-d9fb-449f-a3c1-541ca236cc68 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:39.640357 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2d107e97-d9fb-449f-a3c1-541ca236cc68 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:39.977609 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2d107e97-d9fb-449f-a3c1-541ca236cc68 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:40.005044 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2d107e97-d9fb-449f-a3c1-541ca236cc68 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39" status: 200 len: 1273 microversion: 2.1 time: 0.409782 Jul 18 02:24:40.011788 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1327/2670] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:39 2022] GET /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39 => generated 1273 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:40.021291 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-361d649a-0f40-42f8-b430-2ef0927ab184 tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] 10.222.0.57 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.922280 Jul 18 02:24:40.022796 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1344/2671] 10.222.0.57 () {60 vars in 1194 bytes} [Mon Jul 18 02:24:38 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1937 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:40.028039 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3c2e864b-0efc-4f7b-bf24-bc07327db8ae tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:40.028901 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3c2e864b-0efc-4f7b-bf24-bc07327db8ae tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] [instance: 7b1fb401-75fb-4d72-96ee-b5a5f1146882] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:40.039368 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-86d1a71c-e4ea-4fc4-bd4a-7a40cca0733f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:40.041049 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-86d1a71c-e4ea-4fc4-bd4a-7a40cca0733f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:40.046127 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3c2e864b-0efc-4f7b-bf24-bc07327db8ae tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:40.049685 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3c2e864b-0efc-4f7b-bf24-bc07327db8ae tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:40.051619 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3c2e864b-0efc-4f7b-bf24-bc07327db8ae tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:40.053492 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-86d1a71c-e4ea-4fc4-bd4a-7a40cca0733f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:40.055738 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-86d1a71c-e4ea-4fc4-bd4a-7a40cca0733f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:40.056843 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3c2e864b-0efc-4f7b-bf24-bc07327db8ae tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:40.057988 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-86d1a71c-e4ea-4fc4-bd4a-7a40cca0733f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:40.059755 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-86d1a71c-e4ea-4fc4-bd4a-7a40cca0733f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:41.616776 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3c2e864b-0efc-4f7b-bf24-bc07327db8ae tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6646c45c9574550b601a37de6fc0321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db663b2f2234793bb4038ad90b2b972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:41.636052 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3c2e864b-0efc-4f7b-bf24-bc07327db8ae tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] 10.222.0.57 "GET /compute/v2.1/servers/7b1fb401-75fb-4d72-96ee-b5a5f1146882" status: 200 len: 1470 microversion: 2.1 time: 1.607778 Jul 18 02:24:41.636827 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1345/2672] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:40 2022] GET /compute/v2.1/servers/7b1fb401-75fb-4d72-96ee-b5a5f1146882 => generated 1470 bytes in 1613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:41.647558 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ead20f85-f125-49de-bc0a-da425d54a36c tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] Action: 'create', calling method: .version_select at 0x7ff49ba0ef70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-500880663", "description": "tempest-description-1162443908"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:41.739564 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-86d1a71c-e4ea-4fc4-bd4a-7a40cca0733f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:41.771133 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-86d1a71c-e4ea-4fc4-bd4a-7a40cca0733f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1472 microversion: 2.1 time: 1.756417 Jul 18 02:24:41.776595 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1328/2673] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:40 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1472 bytes in 1764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:41.784281 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-dcb0f06f-20c9-40fc-8418-b923dfd09487 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:41.787157 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-dcb0f06f-20c9-40fc-8418-b923dfd09487 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:41.798410 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dcb0f06f-20c9-40fc-8418-b923dfd09487 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:41.799351 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dcb0f06f-20c9-40fc-8418-b923dfd09487 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:41.800512 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dcb0f06f-20c9-40fc-8418-b923dfd09487 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:41.801856 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dcb0f06f-20c9-40fc-8418-b923dfd09487 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:42.531345 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-dcb0f06f-20c9-40fc-8418-b923dfd09487 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:42.566880 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ead20f85-f125-49de-bc0a-da425d54a36c tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.928476 Jul 18 02:24:42.567701 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1346/2674] 10.222.0.57 () {60 vars in 1179 bytes} [Mon Jul 18 02:24:41 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:42.575704 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bac11048-fb02-4106-a488-552831843e45 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:42.580896 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bac11048-fb02-4106-a488-552831843e45 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b88a4eac-c5c4-42d9-a57a-02975ace4b39] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:42.595947 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:24:42.597629 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-dcb0f06f-20c9-40fc-8418-b923dfd09487 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:42.600889 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bac11048-fb02-4106-a488-552831843e45 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:42.601796 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bac11048-fb02-4106-a488-552831843e45 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:42.603907 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bac11048-fb02-4106-a488-552831843e45 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:42.605037 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bac11048-fb02-4106-a488-552831843e45 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:42.614893 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-dcb0f06f-20c9-40fc-8418-b923dfd09487 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:42.623634 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-dcb0f06f-20c9-40fc-8418-b923dfd09487 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 2865 microversion: 2.42 time: 0.839867 Jul 18 02:24:42.654319 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1329/2675] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:24:41 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 2865 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:24:42.686439 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-6afdb259-e282-4829-9ccf-1c070c8b70c5 req-a72d987a-3922-48ef-beb0-a66a4857cad6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b909490f-2890-43c0-b956-9de562d52d67", "name": "network-vif-unplugged", "status": "completed", "tag": "6ca621a9-9ed9-4c3d-acdf-29cc441d2c6e"}, {"server_uuid": "b909490f-2890-43c0-b956-9de562d52d67", "name": "network-vif-unplugged", "status": "completed", "tag": "22242ae4-54de-42d2-be8a-9ecb3f7a6197"}, {"server_uuid": "b909490f-2890-43c0-b956-9de562d52d67", "name": "network-vif-unplugged", "status": "completed", "tag": "e55a6513-6292-448a-b056-14ca8f284b1b"}, {"server_uuid": "b909490f-2890-43c0-b956-9de562d52d67", "name": "network-vif-unplugged", "status": "completed", "tag": "7d2eaf01-7168-45f2-9cf4-bf37b3151ae2"}, {"server_uuid": "b909490f-2890-43c0-b956-9de562d52d67", "name": "network-vif-unplugged", "status": "completed", "tag": "8ed539e3-cacf-4544-b22a-ef277f6be4d8"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:42.710975 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-6afdb259-e282-4829-9ccf-1c070c8b70c5 req-a72d987a-3922-48ef-beb0-a66a4857cad6 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:42.712646 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-6afdb259-e282-4829-9ccf-1c070c8b70c5 req-a72d987a-3922-48ef-beb0-a66a4857cad6 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:42.773401 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-6afdb259-e282-4829-9ccf-1c070c8b70c5 req-a72d987a-3922-48ef-beb0-a66a4857cad6 service nova] Creating event network-vif-unplugged:6ca621a9-9ed9-4c3d-acdf-29cc441d2c6e for instance b909490f-2890-43c0-b956-9de562d52d67 on n-h2-465891-3 Jul 18 02:24:42.776453 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-6afdb259-e282-4829-9ccf-1c070c8b70c5 req-a72d987a-3922-48ef-beb0-a66a4857cad6 service nova] Creating event network-vif-unplugged:22242ae4-54de-42d2-be8a-9ecb3f7a6197 for instance b909490f-2890-43c0-b956-9de562d52d67 on n-h2-465891-3 Jul 18 02:24:42.777030 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-6afdb259-e282-4829-9ccf-1c070c8b70c5 req-a72d987a-3922-48ef-beb0-a66a4857cad6 service nova] Creating event network-vif-unplugged:e55a6513-6292-448a-b056-14ca8f284b1b for instance b909490f-2890-43c0-b956-9de562d52d67 on n-h2-465891-3 Jul 18 02:24:42.777605 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-6afdb259-e282-4829-9ccf-1c070c8b70c5 req-a72d987a-3922-48ef-beb0-a66a4857cad6 service nova] Creating event network-vif-unplugged:7d2eaf01-7168-45f2-9cf4-bf37b3151ae2 for instance b909490f-2890-43c0-b956-9de562d52d67 on n-h2-465891-3 Jul 18 02:24:42.778288 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-6afdb259-e282-4829-9ccf-1c070c8b70c5 req-a72d987a-3922-48ef-beb0-a66a4857cad6 service nova] Creating event network-vif-unplugged:8ed539e3-cacf-4544-b22a-ef277f6be4d8 for instance b909490f-2890-43c0-b956-9de562d52d67 on n-h2-465891-3 Jul 18 02:24:42.788544 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-6afdb259-e282-4829-9ccf-1c070c8b70c5 req-a72d987a-3922-48ef-beb0-a66a4857cad6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.120349 Jul 18 02:24:42.790166 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1330/2676] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:42.802781 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-aef04c55-dbf5-4a38-9cbf-a8a765911a8d req-d26fb2dc-1b11-4a78-8708-b2bb45de596a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b909490f-2890-43c0-b956-9de562d52d67", "name": "network-vif-deleted", "tag": "7d2eaf01-7168-45f2-9cf4-bf37b3151ae2"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:42.814129 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-aef04c55-dbf5-4a38-9cbf-a8a765911a8d req-d26fb2dc-1b11-4a78-8708-b2bb45de596a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:42.814581 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-aef04c55-dbf5-4a38-9cbf-a8a765911a8d req-d26fb2dc-1b11-4a78-8708-b2bb45de596a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:42.835525 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-aef04c55-dbf5-4a38-9cbf-a8a765911a8d req-d26fb2dc-1b11-4a78-8708-b2bb45de596a service nova] Creating event network-vif-deleted:7d2eaf01-7168-45f2-9cf4-bf37b3151ae2 for instance b909490f-2890-43c0-b956-9de562d52d67 on n-h2-465891-3 Jul 18 02:24:42.849199 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-aef04c55-dbf5-4a38-9cbf-a8a765911a8d req-d26fb2dc-1b11-4a78-8708-b2bb45de596a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053266 Jul 18 02:24:42.850846 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1331/2677] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:42.868693 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-073a8d34-ec33-4f3a-ad27-2ff1dbd90c84 tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] Action: 'create', calling method: .version_select at 0x7ff49bdc6e50>, body: {"security_group_rule": {"parent_group_id": "42a7835d-bdc4-47b8-b410-f17377878a13", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:42.914334 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=12 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:24:43.384550 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bac11048-fb02-4106-a488-552831843e45 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:43.404673 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bac11048-fb02-4106-a488-552831843e45 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39" status: 200 len: 1315 microversion: 2.1 time: 0.833550 Jul 18 02:24:43.406230 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1347/2678] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:42 2022] GET /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39 => generated 1315 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:43.418307 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4dc2d3f8-9dcb-4052-af43-947a38477b30 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:43.420234 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4dc2d3f8-9dcb-4052-af43-947a38477b30 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] [instance: 7b1fb401-75fb-4d72-96ee-b5a5f1146882] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:43.441591 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4dc2d3f8-9dcb-4052-af43-947a38477b30 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:43.442643 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4dc2d3f8-9dcb-4052-af43-947a38477b30 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:43.443700 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4dc2d3f8-9dcb-4052-af43-947a38477b30 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:43.444340 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4dc2d3f8-9dcb-4052-af43-947a38477b30 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:43.705527 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4dc2d3f8-9dcb-4052-af43-947a38477b30 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6646c45c9574550b601a37de6fc0321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db663b2f2234793bb4038ad90b2b972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:43.745108 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4dc2d3f8-9dcb-4052-af43-947a38477b30 tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] 10.222.0.57 "GET /compute/v2.1/servers/7b1fb401-75fb-4d72-96ee-b5a5f1146882" status: 200 len: 1428 microversion: 2.1 time: 0.336257 Jul 18 02:24:43.753670 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1348/2679] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:43 2022] GET /compute/v2.1/servers/7b1fb401-75fb-4d72-96ee-b5a5f1146882 => generated 1428 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:43.784632 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e5bacad2-c4c4-4943-879d-22af1229c075 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:43.789863 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e5bacad2-c4c4-4943-879d-22af1229c075 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:43.810536 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e5bacad2-c4c4-4943-879d-22af1229c075 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:43.811063 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e5bacad2-c4c4-4943-879d-22af1229c075 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:43.812340 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e5bacad2-c4c4-4943-879d-22af1229c075 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:43.812970 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e5bacad2-c4c4-4943-879d-22af1229c075 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:44.447537 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-073a8d34-ec33-4f3a-ad27-2ff1dbd90c84 tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] 10.222.0.57 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.595039 Jul 18 02:24:44.457231 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1332/2680] 10.222.0.57 () {60 vars in 1194 bytes} [Mon Jul 18 02:24:42 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:44.466665 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ac56d49f-3ebe-484b-8442-e26b65a30b11 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:44.471264 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ac56d49f-3ebe-484b-8442-e26b65a30b11 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:44.500384 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ac56d49f-3ebe-484b-8442-e26b65a30b11 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:44.534348 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ac56d49f-3ebe-484b-8442-e26b65a30b11 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:44.551347 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ac56d49f-3ebe-484b-8442-e26b65a30b11 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:44.559945 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ac56d49f-3ebe-484b-8442-e26b65a30b11 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:44.884979 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e5bacad2-c4c4-4943-879d-22af1229c075 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:44.902785 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e5bacad2-c4c4-4943-879d-22af1229c075 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1477 microversion: 2.1 time: 1.147180 Jul 18 02:24:44.903707 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1349/2681] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:43 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1477 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:44.919062 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-dc08b6e6-a6b4-422e-9672-29f0d6ee4940 req-2b8f538c-e569-41d3-bf6a-954845b0ce05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b1fb401-75fb-4d72-96ee-b5a5f1146882", "name": "network-vif-deleted", "tag": "c40205a1-085f-4751-9efd-57c16c913fa4"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:44.936132 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-dc08b6e6-a6b4-422e-9672-29f0d6ee4940 req-2b8f538c-e569-41d3-bf6a-954845b0ce05 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:44.936887 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-dc08b6e6-a6b4-422e-9672-29f0d6ee4940 req-2b8f538c-e569-41d3-bf6a-954845b0ce05 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:44.955216 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-dc08b6e6-a6b4-422e-9672-29f0d6ee4940 req-2b8f538c-e569-41d3-bf6a-954845b0ce05 service nova] Creating event network-vif-deleted:c40205a1-085f-4751-9efd-57c16c913fa4 for instance 7b1fb401-75fb-4d72-96ee-b5a5f1146882 on n-h2-465891-3 Jul 18 02:24:44.968006 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-dc08b6e6-a6b4-422e-9672-29f0d6ee4940 req-2b8f538c-e569-41d3-bf6a-954845b0ce05 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059623 Jul 18 02:24:44.969735 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1350/2682] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:44.981550 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e9b238c7-1e30-4aeb-9674-142801a12d42 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:44.982922 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e9b238c7-1e30-4aeb-9674-142801a12d42 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b88a4eac-c5c4-42d9-a57a-02975ace4b39] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:44.996454 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e9b238c7-1e30-4aeb-9674-142801a12d42 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:44.997462 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e9b238c7-1e30-4aeb-9674-142801a12d42 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:44.998992 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e9b238c7-1e30-4aeb-9674-142801a12d42 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:44.999800 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e9b238c7-1e30-4aeb-9674-142801a12d42 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:45.265739 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ac56d49f-3ebe-484b-8442-e26b65a30b11 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:45.293569 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ac56d49f-3ebe-484b-8442-e26b65a30b11 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:45.297241 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ac56d49f-3ebe-484b-8442-e26b65a30b11 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:45.299919 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ac56d49f-3ebe-484b-8442-e26b65a30b11 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 2706 microversion: 2.42 time: 0.840787 Jul 18 02:24:45.301428 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1333/2683] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:24:44 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 2706 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:24:45.313129 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fa7171c3-cf3f-45c8-a670-04785ba3c5ca tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] Action: 'create', calling method: .version_select at 0x7ff4adc390d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-841583032", "description": "tempest-description-1233065689"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:45.642464 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e9b238c7-1e30-4aeb-9674-142801a12d42 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:45.664262 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e9b238c7-1e30-4aeb-9674-142801a12d42 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39" status: 200 len: 1315 microversion: 2.1 time: 0.691051 Jul 18 02:24:45.666166 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1351/2684] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:44 2022] GET /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39 => generated 1315 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:45.676856 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3226b468-80d9-4fc2-8d67-96a5634a72df tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:45.679217 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3226b468-80d9-4fc2-8d67-96a5634a72df tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] [instance: 7b1fb401-75fb-4d72-96ee-b5a5f1146882] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:45.693511 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3226b468-80d9-4fc2-8d67-96a5634a72df tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:45.695438 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3226b468-80d9-4fc2-8d67-96a5634a72df tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:45.697206 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3226b468-80d9-4fc2-8d67-96a5634a72df tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:45.698302 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3226b468-80d9-4fc2-8d67-96a5634a72df tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:45.735277 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-3226b468-80d9-4fc2-8d67-96a5634a72df tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] HTTP exception thrown: Instance 7b1fb401-75fb-4d72-96ee-b5a5f1146882 could not be found. Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3226b468-80d9-4fc2-8d67-96a5634a72df tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Request method failure captured: Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/7b1fb401-75fb-4d72-96ee-b5a5f1146882 HTTP/1.1 Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MQ-_x5kKvlDK5XJsF7c02HpAhTQo4OMsrCzIxZZyFcIIXkvu57IVDe6pY2wmyDMFGEcDRPNXVqcsuIECmGcoGlYTaKW3Lz8vunJ0NH0g8Z2zSEtwq4QERs49N4flE8tk36gIHPBzPmU1jazW-iSdMUbEqz2tQtBU3dhk3KSQhzBs_g Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 2db663b2f2234793bb4038ad90b2b972 Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-TenantUsagesTestJSON-376949488 Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2db663b2f2234793bb4038ad90b2b972"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2db663b2f2234793bb4038ad90b2b972"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2db663b2f2234793bb4038ad90b2b972"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2db663b2f2234793bb4038ad90b2b972"}]}] Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-TenantUsagesTestJSON-376949488 Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 2db663b2f2234793bb4038ad90b2b972 Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-TenantUsagesTestJSON-376949488 Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-TenantUsagesTestJSON-376949488-project Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: f6646c45c9574550b601a37de6fc0321 Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-TenantUsagesTestJSON-376949488-project Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 7b1fb401-75fb-4d72-96ee-b5a5f1146882 could not be found. Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '7b1fb401-75fb-4d72-96ee-b5a5f1146882'} Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b1fb401-75fb-4d72-96ee-b5a5f1146882 could not be found. Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b1fb401-75fb-4d72-96ee-b5a5f1146882 could not be found. Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:45.739027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:24:45.748062 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:45.748062 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:45.748062 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:45.748062 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:24:45.748062 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:24:45.748062 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b1fb401-75fb-4d72-96ee-b5a5f1146882 could not be found. Jul 18 02:24:45.748062 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:24:45.751138 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3226b468-80d9-4fc2-8d67-96a5634a72df tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] Returning 404 to user: Instance 7b1fb401-75fb-4d72-96ee-b5a5f1146882 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:24:45.753445 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3226b468-80d9-4fc2-8d67-96a5634a72df tempest-TenantUsagesTestJSON-376949488 tempest-TenantUsagesTestJSON-376949488-project] 10.222.0.57 "GET /compute/v2.1/servers/7b1fb401-75fb-4d72-96ee-b5a5f1146882" status: 404 len: 111 microversion: 2.1 time: 0.085054 Jul 18 02:24:45.760446 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1352/2685] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:45 2022] GET /compute/v2.1/servers/7b1fb401-75fb-4d72-96ee-b5a5f1146882 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:24:45.774295 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-a73ac322-acd7-4c85-9059-05ee5cd7d8ba req-d4aa227b-040c-446f-869d-43bfda3df954 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b909490f-2890-43c0-b956-9de562d52d67", "name": "network-vif-deleted", "tag": "6ca621a9-9ed9-4c3d-acdf-29cc441d2c6e"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:45.808607 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-a73ac322-acd7-4c85-9059-05ee5cd7d8ba req-d4aa227b-040c-446f-869d-43bfda3df954 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:45.810309 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-a73ac322-acd7-4c85-9059-05ee5cd7d8ba req-d4aa227b-040c-446f-869d-43bfda3df954 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:45.839300 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-a73ac322-acd7-4c85-9059-05ee5cd7d8ba req-d4aa227b-040c-446f-869d-43bfda3df954 service nova] Creating event network-vif-deleted:6ca621a9-9ed9-4c3d-acdf-29cc441d2c6e for instance b909490f-2890-43c0-b956-9de562d52d67 on n-h2-465891-3 Jul 18 02:24:45.852913 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-a73ac322-acd7-4c85-9059-05ee5cd7d8ba req-d4aa227b-040c-446f-869d-43bfda3df954 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086761 Jul 18 02:24:45.854801 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1353/2686] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:45.929124 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6491779e-23bd-4802-a6d5-4f60c0be524d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:45.940735 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6491779e-23bd-4802-a6d5-4f60c0be524d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:45.980121 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6491779e-23bd-4802-a6d5-4f60c0be524d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:45.987048 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6491779e-23bd-4802-a6d5-4f60c0be524d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:45.992302 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6491779e-23bd-4802-a6d5-4f60c0be524d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:45.993321 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6491779e-23bd-4802-a6d5-4f60c0be524d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:46.747356 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6491779e-23bd-4802-a6d5-4f60c0be524d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:46.765178 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6491779e-23bd-4802-a6d5-4f60c0be524d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1477 microversion: 2.1 time: 0.845417 Jul 18 02:24:46.768115 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1354/2687] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:45 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1477 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:46.780011 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-787d6624-75ac-41f8-9073-8aa150a8cc19 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:46.782064 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-787d6624-75ac-41f8-9073-8aa150a8cc19 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:46.793618 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-787d6624-75ac-41f8-9073-8aa150a8cc19 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:46.794488 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-787d6624-75ac-41f8-9073-8aa150a8cc19 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:46.796085 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-787d6624-75ac-41f8-9073-8aa150a8cc19 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:46.796962 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-787d6624-75ac-41f8-9073-8aa150a8cc19 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:46.867785 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fa7171c3-cf3f-45c8-a670-04785ba3c5ca tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.563140 Jul 18 02:24:46.868836 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1334/2688] 10.222.0.57 () {60 vars in 1179 bytes} [Mon Jul 18 02:24:45 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:46.885628 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-13ef83ee-af12-4192-b643-a99b0775de17 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:46.886560 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-13ef83ee-af12-4192-b643-a99b0775de17 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b88a4eac-c5c4-42d9-a57a-02975ace4b39] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:47.233831 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-13ef83ee-af12-4192-b643-a99b0775de17 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:47.234269 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-13ef83ee-af12-4192-b643-a99b0775de17 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:47.235338 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-13ef83ee-af12-4192-b643-a99b0775de17 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:47.235962 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-13ef83ee-af12-4192-b643-a99b0775de17 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:47.299329 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=4 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:24:47.848045 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-787d6624-75ac-41f8-9073-8aa150a8cc19 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:47.890592 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-787d6624-75ac-41f8-9073-8aa150a8cc19 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:47.899063 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-787d6624-75ac-41f8-9073-8aa150a8cc19 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:47.904698 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-787d6624-75ac-41f8-9073-8aa150a8cc19 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 2547 microversion: 2.42 time: 1.132750 Jul 18 02:24:47.906918 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1355/2689] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:24:46 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 2547 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:24:47.928898 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b61b7ed4-a6ed-4d52-a703-103a7c622ab3 tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] Action: 'create', calling method: .version_select at 0x7ff49ba7baf0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1789265861", "description": "tempest-description-1200226497"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:48.138822 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:24:48.175610 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-13ef83ee-af12-4192-b643-a99b0775de17 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:48.188689 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-13ef83ee-af12-4192-b643-a99b0775de17 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39" status: 200 len: 1315 microversion: 2.1 time: 1.315361 Jul 18 02:24:48.196228 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1335/2690] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:46 2022] GET /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39 => generated 1315 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:48.202689 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-fbe50e7f-05d0-4e28-8ee3-163a0931dd7e req-eecb743d-305f-489b-bcba-51a5827fa7af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b88a4eac-c5c4-42d9-a57a-02975ace4b39", "tag": "900706a2-3a45-4454-ae08-e2e0b80fdbbb"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:48.232129 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-fbe50e7f-05d0-4e28-8ee3-163a0931dd7e req-eecb743d-305f-489b-bcba-51a5827fa7af service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:48.233963 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-fbe50e7f-05d0-4e28-8ee3-163a0931dd7e req-eecb743d-305f-489b-bcba-51a5827fa7af service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:48.257670 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-fbe50e7f-05d0-4e28-8ee3-163a0931dd7e req-eecb743d-305f-489b-bcba-51a5827fa7af service nova] Creating event network-changed:900706a2-3a45-4454-ae08-e2e0b80fdbbb for instance b88a4eac-c5c4-42d9-a57a-02975ace4b39 on n-h2-465891-3 Jul 18 02:24:48.282738 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-fbe50e7f-05d0-4e28-8ee3-163a0931dd7e req-eecb743d-305f-489b-bcba-51a5827fa7af service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084590 Jul 18 02:24:48.284133 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1336/2691] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:48.291832 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-777f43e7-0c93-4620-beec-179df2496fa2 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:48.292900 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-777f43e7-0c93-4620-beec-179df2496fa2 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:48.313656 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-777f43e7-0c93-4620-beec-179df2496fa2 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:48.314760 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-777f43e7-0c93-4620-beec-179df2496fa2 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:48.316030 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-777f43e7-0c93-4620-beec-179df2496fa2 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:48.316828 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-777f43e7-0c93-4620-beec-179df2496fa2 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:48.326022 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:24:48.807344 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-777f43e7-0c93-4620-beec-179df2496fa2 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:48.835606 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-777f43e7-0c93-4620-beec-179df2496fa2 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1477 microversion: 2.1 time: 0.535049 Jul 18 02:24:48.838973 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1337/2692] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:48 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1477 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:48.873802 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-be9f9f47-8130-4bda-bda8-c5d62ba06d4c req-e2a82e0c-63df-4d92-b29f-bd3d281b7030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b909490f-2890-43c0-b956-9de562d52d67", "name": "network-vif-deleted", "tag": "8ed539e3-cacf-4544-b22a-ef277f6be4d8"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:48.878229 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b61b7ed4-a6ed-4d52-a703-103a7c622ab3 tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.968506 Jul 18 02:24:48.882556 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1356/2693] 10.222.0.57 () {60 vars in 1179 bytes} [Mon Jul 18 02:24:47 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:48.920703 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-10913591-bff2-4bf9-b301-3de879fdeb51 tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] Action: 'create', calling method: .version_select at 0x7ff49ba6a550>, body: {"security_group_rule": {"parent_group_id": "6e0aa5af-781d-435c-be44-a7f32e47f9e7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "ff6dbbad-40f8-407e-894f-2ca6dbbfe81a"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:48.955249 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-be9f9f47-8130-4bda-bda8-c5d62ba06d4c req-e2a82e0c-63df-4d92-b29f-bd3d281b7030 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:48.956798 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-be9f9f47-8130-4bda-bda8-c5d62ba06d4c req-e2a82e0c-63df-4d92-b29f-bd3d281b7030 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:49.002747 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-be9f9f47-8130-4bda-bda8-c5d62ba06d4c req-e2a82e0c-63df-4d92-b29f-bd3d281b7030 service nova] Creating event network-vif-deleted:8ed539e3-cacf-4544-b22a-ef277f6be4d8 for instance b909490f-2890-43c0-b956-9de562d52d67 on n-h2-465891-3 Jul 18 02:24:49.035000 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-be9f9f47-8130-4bda-bda8-c5d62ba06d4c req-e2a82e0c-63df-4d92-b29f-bd3d281b7030 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180151 Jul 18 02:24:49.038505 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1338/2694] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:49.058891 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4173967f-3ac4-4138-ac85-e9285cb52e55 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:49.060994 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4173967f-3ac4-4138-ac85-e9285cb52e55 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:49.076573 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4173967f-3ac4-4138-ac85-e9285cb52e55 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:49.077968 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4173967f-3ac4-4138-ac85-e9285cb52e55 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:49.107113 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4173967f-3ac4-4138-ac85-e9285cb52e55 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:49.117144 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4173967f-3ac4-4138-ac85-e9285cb52e55 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:50.779148 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4173967f-3ac4-4138-ac85-e9285cb52e55 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:50.797805 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4173967f-3ac4-4138-ac85-e9285cb52e55 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:50.799882 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4173967f-3ac4-4138-ac85-e9285cb52e55 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:50.805640 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4173967f-3ac4-4138-ac85-e9285cb52e55 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 2502 microversion: 2.42 time: 1.762874 Jul 18 02:24:50.807052 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1339/2695] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:24:49 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 2502 bytes in 1768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:24:50.824988 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8e2a9826-d880-4c12-a2d8-5acb28716872 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:50.832411 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8e2a9826-d880-4c12-a2d8-5acb28716872 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b88a4eac-c5c4-42d9-a57a-02975ace4b39] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:50.851143 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8e2a9826-d880-4c12-a2d8-5acb28716872 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:50.851906 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8e2a9826-d880-4c12-a2d8-5acb28716872 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:50.854294 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8e2a9826-d880-4c12-a2d8-5acb28716872 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:50.857796 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8e2a9826-d880-4c12-a2d8-5acb28716872 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:52.616457 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-10913591-bff2-4bf9-b301-3de879fdeb51 tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] 10.222.0.57 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 3.713206 Jul 18 02:24:52.621621 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1357/2696] 10.222.0.57 () {60 vars in 1194 bytes} [Mon Jul 18 02:24:48 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 3721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:52.658018 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b54c3ae2-7097-4669-8d00-6d050aa75b94 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:52.662101 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b54c3ae2-7097-4669-8d00-6d050aa75b94 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:52.695600 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b54c3ae2-7097-4669-8d00-6d050aa75b94 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:52.700180 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b54c3ae2-7097-4669-8d00-6d050aa75b94 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:52.706475 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b54c3ae2-7097-4669-8d00-6d050aa75b94 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:52.707807 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b54c3ae2-7097-4669-8d00-6d050aa75b94 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:52.882794 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8e2a9826-d880-4c12-a2d8-5acb28716872 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:52.928080 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8e2a9826-d880-4c12-a2d8-5acb28716872 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39" status: 200 len: 1315 microversion: 2.1 time: 2.117563 Jul 18 02:24:52.938569 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1340/2697] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:50 2022] GET /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39 => generated 1315 bytes in 2129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:52.949631 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-d3220945-d278-4532-ae4f-948b7a01d12f req-a80cad7c-6cb2-426d-b02f-d7f6c701b8a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b909490f-2890-43c0-b956-9de562d52d67", "name": "network-vif-deleted", "tag": "e55a6513-6292-448a-b056-14ca8f284b1b"}, {"server_uuid": "b909490f-2890-43c0-b956-9de562d52d67", "name": "network-vif-deleted", "tag": "22242ae4-54de-42d2-be8a-9ecb3f7a6197"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:52.998193 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-d3220945-d278-4532-ae4f-948b7a01d12f req-a80cad7c-6cb2-426d-b02f-d7f6c701b8a5 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:53.003713 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-d3220945-d278-4532-ae4f-948b7a01d12f req-a80cad7c-6cb2-426d-b02f-d7f6c701b8a5 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:53.058206 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-d3220945-d278-4532-ae4f-948b7a01d12f req-a80cad7c-6cb2-426d-b02f-d7f6c701b8a5 service nova] Creating event network-vif-deleted:e55a6513-6292-448a-b056-14ca8f284b1b for instance b909490f-2890-43c0-b956-9de562d52d67 on n-h2-465891-3 Jul 18 02:24:53.059708 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-d3220945-d278-4532-ae4f-948b7a01d12f req-a80cad7c-6cb2-426d-b02f-d7f6c701b8a5 service nova] Creating event network-vif-deleted:22242ae4-54de-42d2-be8a-9ecb3f7a6197 for instance b909490f-2890-43c0-b956-9de562d52d67 on n-h2-465891-3 Jul 18 02:24:53.080907 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-d3220945-d278-4532-ae4f-948b7a01d12f req-a80cad7c-6cb2-426d-b02f-d7f6c701b8a5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.139630 Jul 18 02:24:53.082970 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1341/2698] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:53.094011 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2442b94a-0768-4add-8a9f-dfe3998aeed0 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:53.110615 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2442b94a-0768-4add-8a9f-dfe3998aeed0 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:53.140317 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2442b94a-0768-4add-8a9f-dfe3998aeed0 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:53.142687 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2442b94a-0768-4add-8a9f-dfe3998aeed0 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:53.153293 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2442b94a-0768-4add-8a9f-dfe3998aeed0 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:53.154609 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2442b94a-0768-4add-8a9f-dfe3998aeed0 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:53.404186 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2442b94a-0768-4add-8a9f-dfe3998aeed0 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:53.456412 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2442b94a-0768-4add-8a9f-dfe3998aeed0 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:53.460624 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2442b94a-0768-4add-8a9f-dfe3998aeed0 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:53.462932 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2442b94a-0768-4add-8a9f-dfe3998aeed0 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1604 microversion: 2.42 time: 0.377656 Jul 18 02:24:53.464397 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1342/2699] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:24:53 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1604 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:24:53.497528 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b0bdfb9f-c858-40a7-8aa2-1da2db6da0a8 tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] Action: 'create', calling method: .version_select at 0x7ff49bdf61f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-701073463", "description": "tempest-description-1470650842"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:53.650304 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b54c3ae2-7097-4669-8d00-6d050aa75b94 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:53.666514 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b54c3ae2-7097-4669-8d00-6d050aa75b94 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1477 microversion: 2.1 time: 1.043451 Jul 18 02:24:53.667715 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1358/2700] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:52 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1477 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:53.968270 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ba6de295-e73c-46aa-98a9-674472698390 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:53.969190 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ba6de295-e73c-46aa-98a9-674472698390 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b88a4eac-c5c4-42d9-a57a-02975ace4b39] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:53.982437 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ba6de295-e73c-46aa-98a9-674472698390 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:53.982894 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ba6de295-e73c-46aa-98a9-674472698390 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:53.983693 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ba6de295-e73c-46aa-98a9-674472698390 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:53.989840 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ba6de295-e73c-46aa-98a9-674472698390 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:54.089332 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:24:54.108661 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b0bdfb9f-c858-40a7-8aa2-1da2db6da0a8 tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.641840 Jul 18 02:24:54.110233 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1343/2701] 10.222.0.57 () {60 vars in 1179 bytes} [Mon Jul 18 02:24:53 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:54.130497 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3e96d551-bd63-465c-9d9b-7a6acb1b3611 tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] Action: 'create', calling method: .version_select at 0x7ff49bd90700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2144841186", "description": "tempest-description-1406215110"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:54.763280 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ba6de295-e73c-46aa-98a9-674472698390 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:54.779335 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ba6de295-e73c-46aa-98a9-674472698390 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39" status: 200 len: 1315 microversion: 2.1 time: 0.815421 Jul 18 02:24:54.779797 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1359/2702] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:53 2022] GET /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39 => generated 1315 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:24:54.795419 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6f1d12a1-2b38-4926-961f-6b1a025c5ad0 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:54.796287 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6f1d12a1-2b38-4926-961f-6b1a025c5ad0 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:54.806793 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6f1d12a1-2b38-4926-961f-6b1a025c5ad0 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:54.808569 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6f1d12a1-2b38-4926-961f-6b1a025c5ad0 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:54.813981 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6f1d12a1-2b38-4926-961f-6b1a025c5ad0 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:54.817332 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6f1d12a1-2b38-4926-961f-6b1a025c5ad0 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:55.161643 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6f1d12a1-2b38-4926-961f-6b1a025c5ad0 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:55.202285 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3e96d551-bd63-465c-9d9b-7a6acb1b3611 tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.077319 Jul 18 02:24:55.203280 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1344/2703] 10.222.0.57 () {60 vars in 1179 bytes} [Mon Jul 18 02:24:54 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:24:55.206856 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6f1d12a1-2b38-4926-961f-6b1a025c5ad0 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:55.209016 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6f1d12a1-2b38-4926-961f-6b1a025c5ad0 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:55.212151 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6f1d12a1-2b38-4926-961f-6b1a025c5ad0 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1604 microversion: 2.42 time: 0.430962 Jul 18 02:24:55.213918 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1360/2704] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:24:54 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1604 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:24:55.216256 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5ddbf608-49bf-4fe1-906f-0de83bb612fb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:55.217372 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5ddbf608-49bf-4fe1-906f-0de83bb612fb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:55.239605 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-7dfe8a17-5f6a-434f-9f7b-e3eb4d2e1997 req-cdda2e06-7a88-4852-a19e-66912b69d756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b88a4eac-c5c4-42d9-a57a-02975ace4b39", "name": "network-vif-plugged", "status": "completed", "tag": "900706a2-3a45-4454-ae08-e2e0b80fdbbb"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:55.247389 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ddbf608-49bf-4fe1-906f-0de83bb612fb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:55.258874 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ddbf608-49bf-4fe1-906f-0de83bb612fb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:55.260723 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ddbf608-49bf-4fe1-906f-0de83bb612fb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:55.262950 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ddbf608-49bf-4fe1-906f-0de83bb612fb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:55.279502 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-7dfe8a17-5f6a-434f-9f7b-e3eb4d2e1997 req-cdda2e06-7a88-4852-a19e-66912b69d756 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:55.280103 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-7dfe8a17-5f6a-434f-9f7b-e3eb4d2e1997 req-cdda2e06-7a88-4852-a19e-66912b69d756 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:55.328214 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-7dfe8a17-5f6a-434f-9f7b-e3eb4d2e1997 req-cdda2e06-7a88-4852-a19e-66912b69d756 service nova] Creating event network-vif-plugged:900706a2-3a45-4454-ae08-e2e0b80fdbbb for instance b88a4eac-c5c4-42d9-a57a-02975ace4b39 on n-h2-465891-3 Jul 18 02:24:55.355481 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-7dfe8a17-5f6a-434f-9f7b-e3eb4d2e1997 req-cdda2e06-7a88-4852-a19e-66912b69d756 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137602 Jul 18 02:24:55.356853 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1361/2705] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:55.375113 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-079af5da-aedd-426e-bc86-1258212f6860 tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] Action: 'create', calling method: .version_select at 0x7ff49ba9c670>, body: {"security_group_rule": {"parent_group_id": "d1deeda5-8664-4ed5-bfc8-1f4e5881e593", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "7d813c80-9c79-44be-bfd5-c7df34f91cc4"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:56.183380 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5ddbf608-49bf-4fe1-906f-0de83bb612fb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:56.218492 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5ddbf608-49bf-4fe1-906f-0de83bb612fb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1477 microversion: 2.1 time: 1.012739 Jul 18 02:24:56.219914 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1345/2706] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:55 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1477 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:56.528000 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1bf9026a-c2ad-4155-91cc-34c1ae9ef669 tempest-ListImageFiltersNegativeTestJSON-261830757 tempest-ListImageFiltersNegativeTestJSON-261830757-project] Calling method '.version_select at 0x7ff4adbedca0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:56.569161 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-1bf9026a-c2ad-4155-91cc-34c1ae9ef669 tempest-ListImageFiltersNegativeTestJSON-261830757 tempest-ListImageFiltersNegativeTestJSON-261830757-project] HTTP exception thrown: Image not found. Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1bf9026a-c2ad-4155-91cc-34c1ae9ef669 tempest-ListImageFiltersNegativeTestJSON-261830757 tempest-ListImageFiltersNegativeTestJSON-261830757-project] Request method failure captured: Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/images/d821a81a-d541-4fb1-96c6-18774796f26d HTTP/1.1 Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MR3mzxFOWVB4R2e3heR8T-e3PSzb7g-Id-YXY6qzq4oYtMQg_6W5LHkFmuxw6RFqUlvPabnuPQE5CUme07Z3_V5mOrs0R_7tFLWGVxa69AByuM8Ow_syJDpFhI10-3iGXCn9NQBUwfkFUb8cuB0zWhLM1MP6qaXLnDvHcTXzkJy0b4 Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 162f8f6927e94c00966fdbfc15f78c2f Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-261830757 Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_162f8f6927e94c00966fdbfc15f78c2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/162f8f6927e94c00966fdbfc15f78c2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/162f8f6927e94c00966fdbfc15f78c2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/162f8f6927e94c00966fdbfc15f78c2f"}]}] Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-261830757 Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 162f8f6927e94c00966fdbfc15f78c2f Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-261830757 Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ListImageFiltersNegativeTestJSON-261830757-project Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 9bb12b7122f045069edacd18b09ac822 Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-261830757-project Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: exception: Image not found. Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'd821a81a-d541-4fb1-96c6-18774796f26d'} Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d821a81a-d541-4fb1-96c6-18774796f26d Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 18 02:24:56.574051 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d821a81a-d541-4fb1-96c6-18774796f26d could not be found. Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1bf9026a-c2ad-4155-91cc-34c1ae9ef669 tempest-ListImageFiltersNegativeTestJSON-261830757 tempest-ListImageFiltersNegativeTestJSON-261830757-project] Returning 404 to user: Image not found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:24:56.590971 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1bf9026a-c2ad-4155-91cc-34c1ae9ef669 tempest-ListImageFiltersNegativeTestJSON-261830757 tempest-ListImageFiltersNegativeTestJSON-261830757-project] 10.222.0.57 "GET /compute/v2.1/images/d821a81a-d541-4fb1-96c6-18774796f26d" status: 404 len: 62 microversion: 2.1 time: 0.359710 Jul 18 02:24:56.603260 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1346/2707] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:24:56 2022] GET /compute/v2.1/images/d821a81a-d541-4fb1-96c6-18774796f26d => generated 62 bytes in 383 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:24:56.616947 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d34af45a-1d61-4225-bc7a-48837b284767 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:56.618664 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d34af45a-1d61-4225-bc7a-48837b284767 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b88a4eac-c5c4-42d9-a57a-02975ace4b39] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:56.633794 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d34af45a-1d61-4225-bc7a-48837b284767 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:56.636189 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d34af45a-1d61-4225-bc7a-48837b284767 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:56.638785 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d34af45a-1d61-4225-bc7a-48837b284767 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:56.639934 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d34af45a-1d61-4225-bc7a-48837b284767 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:57.305362 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-079af5da-aedd-426e-bc86-1258212f6860 tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] 10.222.0.57 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.945560 Jul 18 02:24:57.314077 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d34af45a-1d61-4225-bc7a-48837b284767 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:57.317953 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1362/2708] 10.222.0.57 () {60 vars in 1194 bytes} [Mon Jul 18 02:24:55 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1959 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:57.332539 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-da5a6fe0-f2f0-4a5c-af8f-27b5fd381059 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:57.338741 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-da5a6fe0-f2f0-4a5c-af8f-27b5fd381059 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:57.366093 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-da5a6fe0-f2f0-4a5c-af8f-27b5fd381059 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:57.367443 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-da5a6fe0-f2f0-4a5c-af8f-27b5fd381059 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:57.375030 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-da5a6fe0-f2f0-4a5c-af8f-27b5fd381059 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:57.376546 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-da5a6fe0-f2f0-4a5c-af8f-27b5fd381059 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:57.401665 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d34af45a-1d61-4225-bc7a-48837b284767 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39" status: 200 len: 1315 microversion: 2.1 time: 0.781496 Jul 18 02:24:57.410962 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1347/2709] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:56 2022] GET /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39 => generated 1315 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:57.446961 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-93383449-542e-447c-ae91-35f4918b2442 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:57.450244 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-93383449-542e-447c-ae91-35f4918b2442 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:57.479840 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-93383449-542e-447c-ae91-35f4918b2442 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:57.494168 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-93383449-542e-447c-ae91-35f4918b2442 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:57.495473 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-93383449-542e-447c-ae91-35f4918b2442 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:57.496190 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-93383449-542e-447c-ae91-35f4918b2442 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:57.576721 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-da5a6fe0-f2f0-4a5c-af8f-27b5fd381059 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:57.620070 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-da5a6fe0-f2f0-4a5c-af8f-27b5fd381059 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:57.624081 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-da5a6fe0-f2f0-4a5c-af8f-27b5fd381059 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:57.626754 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-da5a6fe0-f2f0-4a5c-af8f-27b5fd381059 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1604 microversion: 2.42 time: 0.306518 Jul 18 02:24:57.628672 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1363/2710] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:24:57 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1604 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:24:57.639827 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6ba4f12f-c1fd-4565-90c8-543a8a0c3452 tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] Calling method '.version_select at 0x7ff49ba5b790>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:57.910529 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-93383449-542e-447c-ae91-35f4918b2442 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:57.931006 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-93383449-542e-447c-ae91-35f4918b2442 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1477 microversion: 2.1 time: 0.509213 Jul 18 02:24:57.936953 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1348/2711] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:57 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1477 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:58.110929 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6ba4f12f-c1fd-4565-90c8-543a8a0c3452 tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/7d813c80-9c79-44be-bfd5-c7df34f91cc4" status: 202 len: 0 microversion: 2.1 time: 0.480362 Jul 18 02:24:58.111873 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1364/2712] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 02:24:57 2022] DELETE /compute/v2.1/os-security-groups/7d813c80-9c79-44be-bfd5-c7df34f91cc4 => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:24:58.122079 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0bc5cb8d-bb9f-4bfa-af94-2ccbc95b8481 tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] Calling method '.version_select at 0x7ff49bea2550>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:58.230024 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0bc5cb8d-bb9f-4bfa-af94-2ccbc95b8481 tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] 10.222.0.57 "GET /compute/v2.1/os-security-groups/d1deeda5-8664-4ed5-bfc8-1f4e5881e593" status: 200 len: 247 microversion: 2.1 time: 0.111711 Jul 18 02:24:58.231146 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1349/2713] 10.222.0.57 () {58 vars in 1268 bytes} [Mon Jul 18 02:24:58 2022] GET /compute/v2.1/os-security-groups/d1deeda5-8664-4ed5-bfc8-1f4e5881e593 => generated 247 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:58.255681 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c7313a9b-b782-4204-94a1-907ba25f3b09 tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] Action: 'create', calling method: .version_select at 0x7ff49ba9cdc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1400987971", "description": "tempest-description-1890032023"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:58.448271 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-63df58cc-77fb-4378-8539-881fcd41072e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:58.448271 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-63df58cc-77fb-4378-8539-881fcd41072e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b88a4eac-c5c4-42d9-a57a-02975ace4b39] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:58.478691 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-63df58cc-77fb-4378-8539-881fcd41072e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:58.479755 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-63df58cc-77fb-4378-8539-881fcd41072e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:58.485640 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-63df58cc-77fb-4378-8539-881fcd41072e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:58.487394 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-63df58cc-77fb-4378-8539-881fcd41072e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:58.729059 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c7313a9b-b782-4204-94a1-907ba25f3b09 tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.481829 Jul 18 02:24:58.737545 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1365/2714] 10.222.0.57 () {60 vars in 1179 bytes} [Mon Jul 18 02:24:58 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:58.743556 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a0449d60-2625-4176-8684-eac57a918e75 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:58.744689 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a0449d60-2625-4176-8684-eac57a918e75 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:58.753685 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a0449d60-2625-4176-8684-eac57a918e75 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:58.754579 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a0449d60-2625-4176-8684-eac57a918e75 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:58.755605 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a0449d60-2625-4176-8684-eac57a918e75 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:58.756227 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a0449d60-2625-4176-8684-eac57a918e75 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:58.908836 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a0449d60-2625-4176-8684-eac57a918e75 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:58.939096 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a0449d60-2625-4176-8684-eac57a918e75 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:58.944856 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a0449d60-2625-4176-8684-eac57a918e75 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:58.949655 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a0449d60-2625-4176-8684-eac57a918e75 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1604 microversion: 2.42 time: 0.209720 Jul 18 02:24:58.952179 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1366/2715] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:24:58 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1604 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:24:58.966012 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-624776f9-c403-4cc4-b7a0-47c72078a60c tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] Action: 'create', calling method: .version_select at 0x7ff49ba5b790>, body: {"security_group_rule": {"parent_group_id": "bcf0d697-1a77-43d8-b95e-62e69afca562", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:59.066759 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-63df58cc-77fb-4378-8539-881fcd41072e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:59.079565 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-63df58cc-77fb-4378-8539-881fcd41072e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39" status: 200 len: 1502 microversion: 2.1 time: 0.642025 Jul 18 02:24:59.080559 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1350/2716] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:58 2022] GET /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39 => generated 1502 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:59.089625 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cdb1a4be-de84-461b-8124-c44860b59dcb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:59.093559 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cdb1a4be-de84-461b-8124-c44860b59dcb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:59.105864 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cdb1a4be-de84-461b-8124-c44860b59dcb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:59.106319 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cdb1a4be-de84-461b-8124-c44860b59dcb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:59.107147 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cdb1a4be-de84-461b-8124-c44860b59dcb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:59.112654 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cdb1a4be-de84-461b-8124-c44860b59dcb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:59.499779 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-cdb1a4be-de84-461b-8124-c44860b59dcb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:59.533164 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cdb1a4be-de84-461b-8124-c44860b59dcb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1477 microversion: 2.1 time: 0.450757 Jul 18 02:24:59.570409 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1351/2717] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:59 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1477 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:59.588886 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0597f96e-cc4d-4e9d-871b-193f57525461 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:59.592215 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0597f96e-cc4d-4e9d-871b-193f57525461 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b88a4eac-c5c4-42d9-a57a-02975ace4b39] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:59.607073 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0597f96e-cc4d-4e9d-871b-193f57525461 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:59.608865 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0597f96e-cc4d-4e9d-871b-193f57525461 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:59.610577 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0597f96e-cc4d-4e9d-871b-193f57525461 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:59.611630 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0597f96e-cc4d-4e9d-871b-193f57525461 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:59.654042 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-624776f9-c403-4cc4-b7a0-47c72078a60c tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] 10.222.0.57 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.699358 Jul 18 02:24:59.663836 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1367/2718] 10.222.0.57 () {60 vars in 1194 bytes} [Mon Jul 18 02:24:58 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:59.672302 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-00dd0f7d-d4ee-40ee-a249-98d1e5c0bc9a tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] Action: 'create', calling method: .version_select at 0x7ff49ba7b0d0>, body: {"security_group_rule": {"parent_group_id": "bcf0d697-1a77-43d8-b95e-62e69afca562", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:59.792775 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0597f96e-cc4d-4e9d-871b-193f57525461 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "POST /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39/action" status: 202 len: 0 microversion: 2.1 time: 0.214764 Jul 18 02:24:59.797584 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1352/2719] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:24:59 2022] POST /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:24:59.824343 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b887c0ca-f74a-4bd2-91eb-b38dae69b4dc tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:59.828652 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b887c0ca-f74a-4bd2-91eb-b38dae69b4dc tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b88a4eac-c5c4-42d9-a57a-02975ace4b39] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:59.876750 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b887c0ca-f74a-4bd2-91eb-b38dae69b4dc tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:59.877824 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b887c0ca-f74a-4bd2-91eb-b38dae69b4dc tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:59.882556 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b887c0ca-f74a-4bd2-91eb-b38dae69b4dc tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:59.884946 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b887c0ca-f74a-4bd2-91eb-b38dae69b4dc tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:00.213486 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-00dd0f7d-d4ee-40ee-a249-98d1e5c0bc9a tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] 10.222.0.57 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.547442 Jul 18 02:25:00.215008 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1368/2720] 10.222.0.57 () {60 vars in 1194 bytes} [Mon Jul 18 02:24:59 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:25:00.239378 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3c888ca2-92d5-4e5f-b172-f1b8b8048598 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:00.240489 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3c888ca2-92d5-4e5f-b172-f1b8b8048598 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:00.262748 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3c888ca2-92d5-4e5f-b172-f1b8b8048598 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:00.263342 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3c888ca2-92d5-4e5f-b172-f1b8b8048598 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:00.274704 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3c888ca2-92d5-4e5f-b172-f1b8b8048598 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:00.275975 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3c888ca2-92d5-4e5f-b172-f1b8b8048598 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:00.312229 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b887c0ca-f74a-4bd2-91eb-b38dae69b4dc tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:00.323369 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b887c0ca-f74a-4bd2-91eb-b38dae69b4dc tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39" status: 200 len: 1507 microversion: 2.1 time: 0.516454 Jul 18 02:25:00.324689 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1353/2721] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:59 2022] GET /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39 => generated 1507 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:25:00.332544 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-12cc0554-d098-456f-b1cd-b68cdf692d2d tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] Calling method '.version_select at 0x7ff49bdd6dc0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:00.422500 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3c888ca2-92d5-4e5f-b172-f1b8b8048598 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:00.440165 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3c888ca2-92d5-4e5f-b172-f1b8b8048598 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:00.444396 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3c888ca2-92d5-4e5f-b172-f1b8b8048598 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:00.446865 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3c888ca2-92d5-4e5f-b172-f1b8b8048598 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1604 microversion: 2.42 time: 0.230007 Jul 18 02:25:00.458457 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1369/2722] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:25:00 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1604 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:25:00.488214 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-12cc0554-d098-456f-b1cd-b68cdf692d2d tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] 10.222.0.57 "GET /compute/v2.1/os-security-groups/bcf0d697-1a77-43d8-b95e-62e69afca562" status: 200 len: 665 microversion: 2.1 time: 0.161850 Jul 18 02:25:00.489060 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1354/2723] 10.222.0.57 () {58 vars in 1268 bytes} [Mon Jul 18 02:25:00 2022] GET /compute/v2.1/os-security-groups/bcf0d697-1a77-43d8-b95e-62e69afca562 => generated 665 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:25:00.509587 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-55cf90dd-ecdc-4da4-ba8f-7d097676302e tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] Calling method '.version_select at 0x7ff49ba5b550>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:00.562340 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7ce4b0ad-0c1b-4dbd-88b7-5eb5cce1dbae tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:00.563879 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7ce4b0ad-0c1b-4dbd-88b7-5eb5cce1dbae tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:00.578045 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7ce4b0ad-0c1b-4dbd-88b7-5eb5cce1dbae tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:00.581415 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7ce4b0ad-0c1b-4dbd-88b7-5eb5cce1dbae tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:00.590110 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7ce4b0ad-0c1b-4dbd-88b7-5eb5cce1dbae tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:00.590950 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7ce4b0ad-0c1b-4dbd-88b7-5eb5cce1dbae tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:00.865594 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7ce4b0ad-0c1b-4dbd-88b7-5eb5cce1dbae tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:00.876923 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7ce4b0ad-0c1b-4dbd-88b7-5eb5cce1dbae tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1477 microversion: 2.1 time: 0.328161 Jul 18 02:25:00.879983 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1355/2724] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:00 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1477 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:00.903519 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-55cf90dd-ecdc-4da4-ba8f-7d097676302e tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-group-rules/20b51007-d2b9-413a-9365-31deb06fa084" status: 202 len: 0 microversion: 2.1 time: 0.401045 Jul 18 02:25:00.904543 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1370/2725] 10.222.0.57 () {58 vars in 1286 bytes} [Mon Jul 18 02:25:00 2022] DELETE /compute/v2.1/os-security-group-rules/20b51007-d2b9-413a-9365-31deb06fa084 => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:25:00.917959 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-364c99c1-1e6f-4265-94e0-dbfbaba0127e tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] Calling method '.version_select at 0x7ff49b9f64c0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:01.295326 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-beb33671-cbe8-46bf-b3c3-23289d5b0b5b tempest-ListImagesTestJSON-961504870 tempest-ListImagesTestJSON-961504870-project] Calling method '.version_select at 0x7ff49bdd6b80>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:01.363751 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-364c99c1-1e6f-4265-94e0-dbfbaba0127e tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/bcf0d697-1a77-43d8-b95e-62e69afca562" status: 202 len: 0 microversion: 2.1 time: 0.451504 Jul 18 02:25:01.364538 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1371/2726] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 02:25:00 2022] DELETE /compute/v2.1/os-security-groups/bcf0d697-1a77-43d8-b95e-62e69afca562 => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:25:01.369551 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-76c151bc-45ed-4754-9e53-c2275384394e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:01.370201 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-76c151bc-45ed-4754-9e53-c2275384394e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b88a4eac-c5c4-42d9-a57a-02975ace4b39] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:01.388535 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-76c151bc-45ed-4754-9e53-c2275384394e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:01.389231 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-76c151bc-45ed-4754-9e53-c2275384394e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:01.390362 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-76c151bc-45ed-4754-9e53-c2275384394e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:01.390972 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-76c151bc-45ed-4754-9e53-c2275384394e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:01.422833 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-beb33671-cbe8-46bf-b3c3-23289d5b0b5b tempest-ListImagesTestJSON-961504870 tempest-ListImagesTestJSON-961504870-project] 10.222.0.57 "GET /compute/v2.1/images/3bb0a19f-5b69-48ee-a771-8fd416f92f36" status: 200 len: 784 microversion: 2.1 time: 0.540851 Jul 18 02:25:01.425522 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1356/2727] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Jul 18 02:25:00 2022] GET /compute/v2.1/images/3bb0a19f-5b69-48ee-a771-8fd416f92f36 => generated 784 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:25:01.435762 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9252b49d-cbb3-46a0-a626-33ddaa4f9911 tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] Calling method '.version_select at 0x7ff49be26820>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:01.507338 n-d-465891-3 devstack@n-api.service[119544]: DEBUG neutronclient.v2_0.client [None req-9252b49d-cbb3-46a0-a626-33ddaa4f9911 tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7d813c80-9c79-44be-bfd5-c7df34f91cc4 does not exist", "detail": ""}} {{(pid=119544) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:25:01.509393 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.security_group_api [None req-9252b49d-cbb3-46a0-a626-33ddaa4f9911 tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] Neutron security group 7d813c80-9c79-44be-bfd5-c7df34f91cc4 not found {{(pid=119544) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 02:25:01.511973 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-9252b49d-cbb3-46a0-a626-33ddaa4f9911 tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] HTTP exception thrown: Security group 7d813c80-9c79-44be-bfd5-c7df34f91cc4 does not exist Jul 18 02:25:01.511973 n-d-465891-3 devstack@n-api.service[119544]: Neutron server returns request_ids: ['req-51013933-f0e9-470a-b40e-e8adefb4b3aa'] Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9252b49d-cbb3-46a0-a626-33ddaa4f9911 tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] Request method failure captured: Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/os-security-groups/7d813c80-9c79-44be-bfd5-c7df34f91cc4 HTTP/1.1 Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MRjU5S3SSjF6ikn7huxiqOyH2yZ3U0RXDH9bkwHP9QIwKe_VLxsTamCTcsNgOaPxYfG37PfTGbyZWc5Sv10H4w9Qs9cb-KON9j2yJnADUMjHU7ZqPO-UK-EE4M3V2Eq_sRJHpfI14rZVfSHy-3OHjxB6obGFjuS54poGqWUEveqQYw Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 44714f11608b4ca384e9565abb847993 Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-93095457 Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_44714f11608b4ca384e9565abb847993"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/44714f11608b4ca384e9565abb847993"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/44714f11608b4ca384e9565abb847993"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/44714f11608b4ca384e9565abb847993"}]}] Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-SecurityGroupRulesTestJSON-93095457 Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 44714f11608b4ca384e9565abb847993 Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-93095457 Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-SecurityGroupRulesTestJSON-93095457-project Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: bf9a910bfc434f39b0eef4646aff71c5 Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-SecurityGroupRulesTestJSON-93095457-project Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: exception: Security group 7d813c80-9c79-44be-bfd5-c7df34f91cc4 does not exist Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: Neutron server returns request_ids: ['req-51013933-f0e9-470a-b40e-e8adefb4b3aa'] Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '7d813c80-9c79-44be-bfd5-c7df34f91cc4'} Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:25:01.517327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7d813c80-9c79-44be-bfd5-c7df34f91cc4 does not exist Jul 18 02:25:01.528552 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-51013933-f0e9-470a-b40e-e8adefb4b3aa'] Jul 18 02:25:01.528552 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:25:01.528552 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:01.528552 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:25:01.528552 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:01.528552 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 18 02:25:01.528552 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 18 02:25:01.528552 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 02:25:01.528552 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 02:25:01.528552 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7d813c80-9c79-44be-bfd5-c7df34f91cc4 does not exist Jul 18 02:25:01.528552 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-51013933-f0e9-470a-b40e-e8adefb4b3aa'] Jul 18 02:25:01.528552 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:25:01.528552 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:01.528552 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:25:01.528552 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:01.528552 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:25:01.528552 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:25:01.528552 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:25:01.528552 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:25:01.528552 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:25:01.528552 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:25:01.528552 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:25:01.528552 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:25:01.528552 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 18 02:25:01.528552 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 02:25:01.528552 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7d813c80-9c79-44be-bfd5-c7df34f91cc4 does not exist Jul 18 02:25:01.528552 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-51013933-f0e9-470a-b40e-e8adefb4b3aa'] Jul 18 02:25:01.528552 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:25:01.528552 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:01.528552 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:25:01.528552 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:01.528552 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:25:01.528552 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:25:01.528552 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:25:01.528552 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:25:01.528552 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7d813c80-9c79-44be-bfd5-c7df34f91cc4 does not exist Jul 18 02:25:01.528552 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-51013933-f0e9-470a-b40e-e8adefb4b3aa'] Jul 18 02:25:01.528552 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:25:01.540769 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9252b49d-cbb3-46a0-a626-33ddaa4f9911 tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] Returning 404 to user: Security group 7d813c80-9c79-44be-bfd5-c7df34f91cc4 does not exist Jul 18 02:25:01.540769 n-d-465891-3 devstack@n-api.service[119544]: Neutron server returns request_ids: ['req-51013933-f0e9-470a-b40e-e8adefb4b3aa'] {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:25:01.542098 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9252b49d-cbb3-46a0-a626-33ddaa4f9911 tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/7d813c80-9c79-44be-bfd5-c7df34f91cc4" status: 404 len: 194 microversion: 2.1 time: 0.114590 Jul 18 02:25:01.543537 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1357/2728] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 02:25:01 2022] DELETE /compute/v2.1/os-security-groups/7d813c80-9c79-44be-bfd5-c7df34f91cc4 => generated 194 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:25:01.553618 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-582a4bac-fb42-4e5f-91fd-856646161c8f tempest-ListImagesTestJSON-961504870 tempest-ListImagesTestJSON-961504870-project] Calling method '.version_select at 0x7ff4adc06310>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:01.641447 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-582a4bac-fb42-4e5f-91fd-856646161c8f tempest-ListImagesTestJSON-961504870 tempest-ListImagesTestJSON-961504870-project] 10.222.0.57 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.095845 Jul 18 02:25:01.644844 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1358/2729] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Jul 18 02:25:01 2022] GET /compute/v2.1/images => generated 445 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:25:01.658827 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ded21bbc-afaf-4cf5-8094-fd7fb2cf7e0b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:01.660623 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ded21bbc-afaf-4cf5-8094-fd7fb2cf7e0b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:01.673977 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ded21bbc-afaf-4cf5-8094-fd7fb2cf7e0b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:01.675107 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ded21bbc-afaf-4cf5-8094-fd7fb2cf7e0b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:01.676766 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ded21bbc-afaf-4cf5-8094-fd7fb2cf7e0b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:01.677789 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ded21bbc-afaf-4cf5-8094-fd7fb2cf7e0b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:01.826793 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ded21bbc-afaf-4cf5-8094-fd7fb2cf7e0b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:01.837145 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-76c151bc-45ed-4754-9e53-c2275384394e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:01.850595 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ded21bbc-afaf-4cf5-8094-fd7fb2cf7e0b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:01.857161 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ded21bbc-afaf-4cf5-8094-fd7fb2cf7e0b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:01.860699 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ded21bbc-afaf-4cf5-8094-fd7fb2cf7e0b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1604 microversion: 2.42 time: 0.213596 Jul 18 02:25:01.861532 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-76c151bc-45ed-4754-9e53-c2275384394e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39" status: 200 len: 1487 microversion: 2.1 time: 0.495666 Jul 18 02:25:01.862587 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1372/2730] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:01 2022] GET /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39 => generated 1487 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:01.863267 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1359/2731] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:25:01 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1604 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:25:01.885686 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5260934a-5bc5-43ea-b3d1-57aee4986779 tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] Calling method '.version_select at 0x7ff4adc7aee0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:01.895445 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a396370c-b989-4d88-96f1-654098ffd0c4 tempest-ListImagesTestJSON-961504870 tempest-ListImagesTestJSON-961504870-project] Calling method '.version_select at 0x7ff49ba9c0d0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:02.052807 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a396370c-b989-4d88-96f1-654098ffd0c4 tempest-ListImagesTestJSON-961504870 tempest-ListImagesTestJSON-961504870-project] 10.222.0.57 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.167514 Jul 18 02:25:02.054886 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1373/2732] 10.222.0.57 () {58 vars in 1142 bytes} [Mon Jul 18 02:25:01 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:25:02.097895 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-78d32dac-f397-440a-b890-5d2e2b8d0d2b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:02.099058 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-78d32dac-f397-440a-b890-5d2e2b8d0d2b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b88a4eac-c5c4-42d9-a57a-02975ace4b39] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:02.138662 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-78d32dac-f397-440a-b890-5d2e2b8d0d2b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:02.139431 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-78d32dac-f397-440a-b890-5d2e2b8d0d2b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:02.141370 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-78d32dac-f397-440a-b890-5d2e2b8d0d2b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:02.154417 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-78d32dac-f397-440a-b890-5d2e2b8d0d2b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:02.257830 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-78d32dac-f397-440a-b890-5d2e2b8d0d2b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b88a4eac-c5c4-42d9-a57a-02975ace4b39] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:25:02.458415 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-78d32dac-f397-440a-b890-5d2e2b8d0d2b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39" status: 204 len: 0 microversion: 2.1 time: 0.386663 Jul 18 02:25:02.459442 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1374/2733] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:25:02 2022] DELETE /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:25:02.464409 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bb7470ed-0d4f-4f50-b0b1-60c87cb29e66 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:02.465133 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bb7470ed-0d4f-4f50-b0b1-60c87cb29e66 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:02.479852 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5260934a-5bc5-43ea-b3d1-57aee4986779 tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/d1deeda5-8664-4ed5-bfc8-1f4e5881e593" status: 202 len: 0 microversion: 2.1 time: 0.613858 Jul 18 02:25:02.481588 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1360/2734] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 02:25:01 2022] DELETE /compute/v2.1/os-security-groups/d1deeda5-8664-4ed5-bfc8-1f4e5881e593 => generated 0 bytes in 617 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:25:02.488329 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bb7470ed-0d4f-4f50-b0b1-60c87cb29e66 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:02.488793 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bb7470ed-0d4f-4f50-b0b1-60c87cb29e66 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:02.489605 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bb7470ed-0d4f-4f50-b0b1-60c87cb29e66 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:02.490068 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bb7470ed-0d4f-4f50-b0b1-60c87cb29e66 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:02.502666 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2c107cbf-3562-4852-8411-09ee0cd6ab9d tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:02.523255 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2c107cbf-3562-4852-8411-09ee0cd6ab9d tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b88a4eac-c5c4-42d9-a57a-02975ace4b39] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:02.544524 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2c107cbf-3562-4852-8411-09ee0cd6ab9d tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:02.545657 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2c107cbf-3562-4852-8411-09ee0cd6ab9d tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:02.547967 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2c107cbf-3562-4852-8411-09ee0cd6ab9d tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:02.549119 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2c107cbf-3562-4852-8411-09ee0cd6ab9d tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:02.767480 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bb7470ed-0d4f-4f50-b0b1-60c87cb29e66 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:02.793501 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bb7470ed-0d4f-4f50-b0b1-60c87cb29e66 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1477 microversion: 2.1 time: 0.332897 Jul 18 02:25:02.794883 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1375/2735] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:02 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1477 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:02.817494 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-74be0752-2f31-40a1-95a4-216abd1abf69 tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] Calling method '.version_select at 0x7ff49ba0edc0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:02.961071 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2c107cbf-3562-4852-8411-09ee0cd6ab9d tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:02.976180 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2c107cbf-3562-4852-8411-09ee0cd6ab9d tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39" status: 200 len: 1493 microversion: 2.1 time: 0.492723 Jul 18 02:25:02.978888 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1361/2736] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:02 2022] GET /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39 => generated 1493 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:02.988223 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fc4c97ea-0ee7-4cd3-be88-122fe1d41d08 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:02.995870 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fc4c97ea-0ee7-4cd3-be88-122fe1d41d08 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:03.010473 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fc4c97ea-0ee7-4cd3-be88-122fe1d41d08 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:03.011619 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fc4c97ea-0ee7-4cd3-be88-122fe1d41d08 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:03.014053 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fc4c97ea-0ee7-4cd3-be88-122fe1d41d08 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:03.015863 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fc4c97ea-0ee7-4cd3-be88-122fe1d41d08 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:03.583999 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fc4c97ea-0ee7-4cd3-be88-122fe1d41d08 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:03.598343 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fc4c97ea-0ee7-4cd3-be88-122fe1d41d08 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:03.607840 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fc4c97ea-0ee7-4cd3-be88-122fe1d41d08 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:03.610809 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fc4c97ea-0ee7-4cd3-be88-122fe1d41d08 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1604 microversion: 2.42 time: 0.627486 Jul 18 02:25:03.612106 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1362/2737] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:25:02 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1604 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:25:03.702717 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-74be0752-2f31-40a1-95a4-216abd1abf69 tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/ff6dbbad-40f8-407e-894f-2ca6dbbfe81a" status: 202 len: 0 microversion: 2.1 time: 0.902451 Jul 18 02:25:03.707952 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1376/2738] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 02:25:02 2022] DELETE /compute/v2.1/os-security-groups/ff6dbbad-40f8-407e-894f-2ca6dbbfe81a => generated 0 bytes in 909 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:25:03.712599 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d6859c7b-b7a9-4e2f-a502-8e269616e391 tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] Calling method '.version_select at 0x7ff4adc06430>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:03.836971 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3f132105-a908-4ae4-abdf-dabf9369cfbe tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:03.841972 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3f132105-a908-4ae4-abdf-dabf9369cfbe tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:03.904062 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3f132105-a908-4ae4-abdf-dabf9369cfbe tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:03.906478 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3f132105-a908-4ae4-abdf-dabf9369cfbe tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:03.908038 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3f132105-a908-4ae4-abdf-dabf9369cfbe tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:03.908872 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3f132105-a908-4ae4-abdf-dabf9369cfbe tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:04.427311 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3f132105-a908-4ae4-abdf-dabf9369cfbe tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:04.439058 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3f132105-a908-4ae4-abdf-dabf9369cfbe tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1477 microversion: 2.1 time: 0.615407 Jul 18 02:25:04.450132 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1377/2739] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:03 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1477 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:04.456037 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9bd5937f-2ed3-4353-a636-6fea241bc79e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:04.456663 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9bd5937f-2ed3-4353-a636-6fea241bc79e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b88a4eac-c5c4-42d9-a57a-02975ace4b39] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:04.466206 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9bd5937f-2ed3-4353-a636-6fea241bc79e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:04.478538 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9bd5937f-2ed3-4353-a636-6fea241bc79e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:04.479674 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9bd5937f-2ed3-4353-a636-6fea241bc79e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:04.480296 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9bd5937f-2ed3-4353-a636-6fea241bc79e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:04.800479 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d6859c7b-b7a9-4e2f-a502-8e269616e391 tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/6e0aa5af-781d-435c-be44-a7f32e47f9e7" status: 202 len: 0 microversion: 2.1 time: 1.091704 Jul 18 02:25:04.805164 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1363/2740] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 02:25:03 2022] DELETE /compute/v2.1/os-security-groups/6e0aa5af-781d-435c-be44-a7f32e47f9e7 => generated 0 bytes in 1097 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:25:04.811888 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7913adfb-cc13-49f4-911e-9b5579e9d675 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:04.812780 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7913adfb-cc13-49f4-911e-9b5579e9d675 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:04.818687 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:25:04.857187 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7913adfb-cc13-49f4-911e-9b5579e9d675 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:04.858187 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7913adfb-cc13-49f4-911e-9b5579e9d675 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:04.860819 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7913adfb-cc13-49f4-911e-9b5579e9d675 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:04.861973 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7913adfb-cc13-49f4-911e-9b5579e9d675 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:04.868426 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:25:05.225875 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7913adfb-cc13-49f4-911e-9b5579e9d675 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:05.261883 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7913adfb-cc13-49f4-911e-9b5579e9d675 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:05.272551 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7913adfb-cc13-49f4-911e-9b5579e9d675 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:05.275096 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7913adfb-cc13-49f4-911e-9b5579e9d675 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1604 microversion: 2.42 time: 0.467590 Jul 18 02:25:05.276466 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1364/2741] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:25:04 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1604 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:25:05.306632 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ac69d96e-aa96-49ac-9778-03fa016a9787 tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] Calling method '.version_select at 0x7ff49bde88b0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:05.749673 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9bd5937f-2ed3-4353-a636-6fea241bc79e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:05.768310 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9bd5937f-2ed3-4353-a636-6fea241bc79e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39" status: 200 len: 1493 microversion: 2.1 time: 1.316579 Jul 18 02:25:05.769771 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1378/2742] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:04 2022] GET /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39 => generated 1493 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:05.790178 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1c2346b9-d9db-41d4-b36d-323b2ab86d54 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:05.800879 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1c2346b9-d9db-41d4-b36d-323b2ab86d54 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:05.820851 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c2346b9-d9db-41d4-b36d-323b2ab86d54 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:05.824554 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c2346b9-d9db-41d4-b36d-323b2ab86d54 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:05.827365 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c2346b9-d9db-41d4-b36d-323b2ab86d54 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:05.828358 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c2346b9-d9db-41d4-b36d-323b2ab86d54 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:06.680398 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1c2346b9-d9db-41d4-b36d-323b2ab86d54 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:06.712172 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1c2346b9-d9db-41d4-b36d-323b2ab86d54 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1476 microversion: 2.1 time: 0.937589 Jul 18 02:25:06.731117 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1379/2743] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:05 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1476 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:06.749506 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c3d9f163-0f0f-4ded-a83d-edfa3cb66b8b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:06.751714 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c3d9f163-0f0f-4ded-a83d-edfa3cb66b8b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:06.770293 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c3d9f163-0f0f-4ded-a83d-edfa3cb66b8b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:06.771521 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c3d9f163-0f0f-4ded-a83d-edfa3cb66b8b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:06.780540 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c3d9f163-0f0f-4ded-a83d-edfa3cb66b8b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:06.783725 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c3d9f163-0f0f-4ded-a83d-edfa3cb66b8b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:07.430326 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ac69d96e-aa96-49ac-9778-03fa016a9787 tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/42a7835d-bdc4-47b8-b410-f17377878a13" status: 202 len: 0 microversion: 2.1 time: 2.138309 Jul 18 02:25:07.434204 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1365/2744] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 02:25:05 2022] DELETE /compute/v2.1/os-security-groups/42a7835d-bdc4-47b8-b410-f17377878a13 => generated 0 bytes in 2154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:25:07.441042 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-374636c2-3691-4b5c-ade0-a56d41f13321 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:07.442242 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-374636c2-3691-4b5c-ade0-a56d41f13321 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b88a4eac-c5c4-42d9-a57a-02975ace4b39] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:07.468178 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-374636c2-3691-4b5c-ade0-a56d41f13321 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:07.469373 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-374636c2-3691-4b5c-ade0-a56d41f13321 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:07.472629 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-374636c2-3691-4b5c-ade0-a56d41f13321 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:07.473429 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-374636c2-3691-4b5c-ade0-a56d41f13321 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:07.594181 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c3d9f163-0f0f-4ded-a83d-edfa3cb66b8b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:07.633148 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c3d9f163-0f0f-4ded-a83d-edfa3cb66b8b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:07.636254 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c3d9f163-0f0f-4ded-a83d-edfa3cb66b8b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:07.638233 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c3d9f163-0f0f-4ded-a83d-edfa3cb66b8b tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1604 microversion: 2.42 time: 0.898699 Jul 18 02:25:07.643850 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1380/2745] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:25:06 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1604 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:25:07.658768 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-33426bbc-2bae-40fa-b94e-c323fa506fa6 tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] Calling method '.version_select at 0x7ff49b992e50>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:08.708810 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-374636c2-3691-4b5c-ade0-a56d41f13321 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:08.719425 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-374636c2-3691-4b5c-ade0-a56d41f13321 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39" status: 200 len: 1493 microversion: 2.1 time: 1.286222 Jul 18 02:25:08.720911 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1366/2746] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:07 2022] GET /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39 => generated 1493 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:08.729009 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-7bccda5c-f57f-4dd4-9805-13ae244a78c8 req-0df38ef2-bb4d-4e05-85cb-3c7e3b426e2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7", "name": "network-vif-unplugged", "status": "completed", "tag": "d130b73f-1f50-4848-bcf5-1bc41a9e7331"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:25:08.744939 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-7bccda5c-f57f-4dd4-9805-13ae244a78c8 req-0df38ef2-bb4d-4e05-85cb-3c7e3b426e2d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:08.745439 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-7bccda5c-f57f-4dd4-9805-13ae244a78c8 req-0df38ef2-bb4d-4e05-85cb-3c7e3b426e2d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:08.765172 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-7bccda5c-f57f-4dd4-9805-13ae244a78c8 req-0df38ef2-bb4d-4e05-85cb-3c7e3b426e2d service nova] Creating event network-vif-unplugged:d130b73f-1f50-4848-bcf5-1bc41a9e7331 for instance dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 on n-h1-465891-3 Jul 18 02:25:08.775715 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [req-7bccda5c-f57f-4dd4-9805-13ae244a78c8 req-0df38ef2-bb4d-4e05-85cb-3c7e3b426e2d service nova] Instance dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3'} {{(pid=119544) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 02:25:08.785258 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-7bccda5c-f57f-4dd4-9805-13ae244a78c8 req-0df38ef2-bb4d-4e05-85cb-3c7e3b426e2d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061561 Jul 18 02:25:08.786625 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1367/2747] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:25:08.795381 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-20847e3a-e95d-43be-95fc-5da24aaf6e80 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:08.796608 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-20847e3a-e95d-43be-95fc-5da24aaf6e80 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:08.806087 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-20847e3a-e95d-43be-95fc-5da24aaf6e80 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:08.806846 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-20847e3a-e95d-43be-95fc-5da24aaf6e80 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:08.807820 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-20847e3a-e95d-43be-95fc-5da24aaf6e80 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:08.808559 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-20847e3a-e95d-43be-95fc-5da24aaf6e80 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:09.337118 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-20847e3a-e95d-43be-95fc-5da24aaf6e80 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:09.352732 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-20847e3a-e95d-43be-95fc-5da24aaf6e80 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1476 microversion: 2.1 time: 0.559159 Jul 18 02:25:09.355123 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1368/2748] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:08 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1476 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:09.371165 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-352e8ad3-698f-410f-9071-3c655ba6ea91 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:09.372228 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-352e8ad3-698f-410f-9071-3c655ba6ea91 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:09.382476 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-352e8ad3-698f-410f-9071-3c655ba6ea91 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:09.386392 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-352e8ad3-698f-410f-9071-3c655ba6ea91 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:09.391757 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-352e8ad3-698f-410f-9071-3c655ba6ea91 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:09.392561 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-352e8ad3-698f-410f-9071-3c655ba6ea91 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:09.647339 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-352e8ad3-698f-410f-9071-3c655ba6ea91 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:09.662694 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-352e8ad3-698f-410f-9071-3c655ba6ea91 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:09.670713 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-352e8ad3-698f-410f-9071-3c655ba6ea91 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:09.672802 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-352e8ad3-698f-410f-9071-3c655ba6ea91 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1604 microversion: 2.42 time: 0.316344 Jul 18 02:25:09.679046 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1369/2749] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:25:09 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1604 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:25:09.686050 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-4508b692-9640-43f7-9650-2b2e0bab96e4 req-11cf427b-7988-489f-9dce-076c820de3b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b88a4eac-c5c4-42d9-a57a-02975ace4b39", "name": "network-vif-deleted", "tag": "900706a2-3a45-4454-ae08-e2e0b80fdbbb"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:25:09.694237 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-33426bbc-2bae-40fa-b94e-c323fa506fa6 tempest-SecurityGroupRulesTestJSON-93095457 tempest-SecurityGroupRulesTestJSON-93095457-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/ab9a0cb7-4212-4717-ae3b-01908f800a77" status: 202 len: 0 microversion: 2.1 time: 2.048050 Jul 18 02:25:09.696040 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1381/2750] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 02:25:07 2022] DELETE /compute/v2.1/os-security-groups/ab9a0cb7-4212-4717-ae3b-01908f800a77 => generated 0 bytes in 2051 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:25:09.713628 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-4508b692-9640-43f7-9650-2b2e0bab96e4 req-11cf427b-7988-489f-9dce-076c820de3b9 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:09.714732 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-4508b692-9640-43f7-9650-2b2e0bab96e4 req-11cf427b-7988-489f-9dce-076c820de3b9 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:09.743816 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-4508b692-9640-43f7-9650-2b2e0bab96e4 req-11cf427b-7988-489f-9dce-076c820de3b9 service nova] Creating event network-vif-deleted:900706a2-3a45-4454-ae08-e2e0b80fdbbb for instance b88a4eac-c5c4-42d9-a57a-02975ace4b39 on n-h2-465891-3 Jul 18 02:25:09.751557 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-4508b692-9640-43f7-9650-2b2e0bab96e4 req-11cf427b-7988-489f-9dce-076c820de3b9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070840 Jul 18 02:25:09.752480 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1370/2751] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:25:09.760247 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-db49db4e-17b2-47e3-8f8f-d21a620545af tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:09.767865 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-db49db4e-17b2-47e3-8f8f-d21a620545af tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b88a4eac-c5c4-42d9-a57a-02975ace4b39] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:09.806653 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-db49db4e-17b2-47e3-8f8f-d21a620545af tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:09.808783 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-db49db4e-17b2-47e3-8f8f-d21a620545af tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:09.810693 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-db49db4e-17b2-47e3-8f8f-d21a620545af tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:09.817795 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-db49db4e-17b2-47e3-8f8f-d21a620545af tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:09.874417 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-db49db4e-17b2-47e3-8f8f-d21a620545af tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] HTTP exception thrown: Instance b88a4eac-c5c4-42d9-a57a-02975ace4b39 could not be found. Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-db49db4e-17b2-47e3-8f8f-d21a620545af tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Request method failure captured: Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39 HTTP/1.1 Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MPwaxUozPvSKq2aGl05vX5p9RkRh12PhrAa5ZuFGYH8QlWHXUoV4AOq2uE9nQ_2FUYuIDSWVSpjhgygJ-c4EGtTg2Y-_wVXi_cp3NARUTVck4-IU3Tev_AIZ-4eU7-_uXuXl7L-x01qv35sxA627UbKELg2PVDH9gxQj5dhwRrNVzw Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ba9d4e8f2f18460ebccacbe32db57388"}]}] Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-DeleteServersTestJSON-988442543 Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 89c4d32923874a50972ab0b75a4165c0 Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance b88a4eac-c5c4-42d9-a57a-02975ace4b39 could not be found. Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'b88a4eac-c5c4-42d9-a57a-02975ace4b39'} Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b88a4eac-c5c4-42d9-a57a-02975ace4b39 could not be found. Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b88a4eac-c5c4-42d9-a57a-02975ace4b39 could not be found. Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:09.878754 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:25:09.887383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:09.887383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:25:09.887383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:25:09.887383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:25:09.887383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:25:09.887383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b88a4eac-c5c4-42d9-a57a-02975ace4b39 could not be found. Jul 18 02:25:09.887383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:25:09.896158 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-db49db4e-17b2-47e3-8f8f-d21a620545af tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Returning 404 to user: Instance b88a4eac-c5c4-42d9-a57a-02975ace4b39 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:25:09.898118 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-db49db4e-17b2-47e3-8f8f-d21a620545af tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39" status: 404 len: 111 microversion: 2.1 time: 0.151246 Jul 18 02:25:09.901743 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1382/2752] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:09 2022] GET /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39 => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:25:10.159936 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a83a9638-ee52-42f0-a891-34cff7fb27f0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-688897547", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "6dbd9947-7c83-4ca1-a653-57a9c042a444"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:25:10.302132 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-a83a9638-ee52-42f0-a891-34cff7fb27f0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] validate_networks() for [('6dbd9947-7c83-4ca1-a653-57a9c042a444', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:25:10.387243 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3f8ad0d9-263a-4992-84d3-71484d706320 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:10.391314 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3f8ad0d9-263a-4992-84d3-71484d706320 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:10.415289 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3f8ad0d9-263a-4992-84d3-71484d706320 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:10.416624 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3f8ad0d9-263a-4992-84d3-71484d706320 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:10.418468 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3f8ad0d9-263a-4992-84d3-71484d706320 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:10.419610 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3f8ad0d9-263a-4992-84d3-71484d706320 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:11.814861 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3f8ad0d9-263a-4992-84d3-71484d706320 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:11.857272 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3f8ad0d9-263a-4992-84d3-71484d706320 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1474 microversion: 2.1 time: 1.476247 Jul 18 02:25:11.861395 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1383/2753] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:10 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1474 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:11.893653 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a9036fc7-dc46-470d-9aeb-7200d9fbebbf tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:11.895868 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a9036fc7-dc46-470d-9aeb-7200d9fbebbf tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:11.921439 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9036fc7-dc46-470d-9aeb-7200d9fbebbf tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:11.922806 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9036fc7-dc46-470d-9aeb-7200d9fbebbf tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:11.924572 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9036fc7-dc46-470d-9aeb-7200d9fbebbf tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:11.935546 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9036fc7-dc46-470d-9aeb-7200d9fbebbf tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:12.578175 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a9036fc7-dc46-470d-9aeb-7200d9fbebbf tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:12.617945 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a9036fc7-dc46-470d-9aeb-7200d9fbebbf tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:12.623992 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a9036fc7-dc46-470d-9aeb-7200d9fbebbf tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:12.638318 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a9036fc7-dc46-470d-9aeb-7200d9fbebbf tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1604 microversion: 2.42 time: 0.767733 Jul 18 02:25:12.657722 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1384/2754] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:25:11 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1604 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:25:12.676371 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-a83a9638-ee52-42f0-a891-34cff7fb27f0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:25:12.678148 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-a83a9638-ee52-42f0-a891-34cff7fb27f0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:25:12.681277 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-a83a9638-ee52-42f0-a891-34cff7fb27f0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:25:12.682680 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-a83a9638-ee52-42f0-a891-34cff7fb27f0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:25:12.684964 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-a83a9638-ee52-42f0-a891-34cff7fb27f0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:25:12.723520 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a83a9638-ee52-42f0-a891-34cff7fb27f0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:12.728131 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a83a9638-ee52-42f0-a891-34cff7fb27f0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:12.732158 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a83a9638-ee52-42f0-a891-34cff7fb27f0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:12.740106 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a83a9638-ee52-42f0-a891-34cff7fb27f0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:12.847084 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-a83a9638-ee52-42f0-a891-34cff7fb27f0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Getting quotas for project ba9d4e8f2f18460ebccacbe32db57388. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:25:12.890314 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-a83a9638-ee52-42f0-a891-34cff7fb27f0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Getting quotas for user 89c4d32923874a50972ab0b75a4165c0 and project ba9d4e8f2f18460ebccacbe32db57388. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:25:12.893082 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-837ed710-14e9-42c5-8784-8ac1e2e49571 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:12.895863 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-837ed710-14e9-42c5-8784-8ac1e2e49571 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:12.940041 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:25:12.968556 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a83a9638-ee52-42f0-a891-34cff7fb27f0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:25:12.983394 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-837ed710-14e9-42c5-8784-8ac1e2e49571 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:12.984165 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-837ed710-14e9-42c5-8784-8ac1e2e49571 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:12.985592 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-837ed710-14e9-42c5-8784-8ac1e2e49571 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:12.986327 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-837ed710-14e9-42c5-8784-8ac1e2e49571 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:12.994131 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a83a9638-ee52-42f0-a891-34cff7fb27f0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:25:13.266778 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a83a9638-ee52-42f0-a891-34cff7fb27f0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.111783 Jul 18 02:25:13.268819 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1371/2755] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:25:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 3115 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 02:25:13.286946 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f447df0a-c850-459f-b8f9-e987152dd33e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:13.287831 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f447df0a-c850-459f-b8f9-e987152dd33e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:13.875121 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f447df0a-c850-459f-b8f9-e987152dd33e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:13.936972 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f447df0a-c850-459f-b8f9-e987152dd33e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1214 microversion: 2.1 time: 0.654463 Jul 18 02:25:13.939376 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1372/2756] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:13 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1214 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:25:13.955039 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0777ada1-834f-4249-a326-49b41136fbe9 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:13.971620 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0777ada1-834f-4249-a326-49b41136fbe9 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:14.028391 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0777ada1-834f-4249-a326-49b41136fbe9 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:14.039635 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0777ada1-834f-4249-a326-49b41136fbe9 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:14.041803 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0777ada1-834f-4249-a326-49b41136fbe9 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:14.047406 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0777ada1-834f-4249-a326-49b41136fbe9 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:14.453234 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0777ada1-834f-4249-a326-49b41136fbe9 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:14.498265 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0777ada1-834f-4249-a326-49b41136fbe9 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:14.509105 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0777ada1-834f-4249-a326-49b41136fbe9 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:14.511032 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0777ada1-834f-4249-a326-49b41136fbe9 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1604 microversion: 2.42 time: 0.567489 Jul 18 02:25:14.518524 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1373/2757] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:25:13 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1604 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:25:14.532962 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-837ed710-14e9-42c5-8784-8ac1e2e49571 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:14.557226 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:25:14.575632 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-837ed710-14e9-42c5-8784-8ac1e2e49571 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1471 microversion: 2.1 time: 1.689701 Jul 18 02:25:14.580100 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1385/2758] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:12 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1471 bytes in 1695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:14.598373 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c0db0571-c9d7-4803-86b8-99d76e6e83dd tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:25:14.601834 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c0db0571-c9d7-4803-86b8-99d76e6e83dd tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:14.610953 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c0db0571-c9d7-4803-86b8-99d76e6e83dd tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:14.611769 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c0db0571-c9d7-4803-86b8-99d76e6e83dd tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:14.612788 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c0db0571-c9d7-4803-86b8-99d76e6e83dd tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:14.613539 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c0db0571-c9d7-4803-86b8-99d76e6e83dd tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:14.733434 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c0db0571-c9d7-4803-86b8-99d76e6e83dd tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "POST /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7/action" status: 204 len: 0 microversion: 2.1 time: 0.139554 Jul 18 02:25:14.735694 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1374/2759] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:25:14 2022] POST /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7/action => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:25:14.745652 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-44e5e1f8-7913-4cf4-aceb-b82bb106f19f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:14.746922 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-44e5e1f8-7913-4cf4-aceb-b82bb106f19f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:14.758039 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-44e5e1f8-7913-4cf4-aceb-b82bb106f19f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:14.759196 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-44e5e1f8-7913-4cf4-aceb-b82bb106f19f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:14.760380 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-44e5e1f8-7913-4cf4-aceb-b82bb106f19f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:14.761038 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-44e5e1f8-7913-4cf4-aceb-b82bb106f19f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:14.960605 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5f27bbd2-2a31-48ec-9d15-b4c168830d37 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:14.961637 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5f27bbd2-2a31-48ec-9d15-b4c168830d37 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:14.985772 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5f27bbd2-2a31-48ec-9d15-b4c168830d37 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:14.986292 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5f27bbd2-2a31-48ec-9d15-b4c168830d37 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:14.987493 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5f27bbd2-2a31-48ec-9d15-b4c168830d37 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:14.988263 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5f27bbd2-2a31-48ec-9d15-b4c168830d37 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:15.435911 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5f27bbd2-2a31-48ec-9d15-b4c168830d37 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:15.453098 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5f27bbd2-2a31-48ec-9d15-b4c168830d37 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1210 microversion: 2.1 time: 0.498473 Jul 18 02:25:15.465800 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1375/2760] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:14 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1210 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:25:15.538358 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a288b5ed-ab65-4dc2-a276-50cf595e6378 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:15.539706 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a288b5ed-ab65-4dc2-a276-50cf595e6378 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:15.555880 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a288b5ed-ab65-4dc2-a276-50cf595e6378 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:15.556791 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a288b5ed-ab65-4dc2-a276-50cf595e6378 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:15.566679 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a288b5ed-ab65-4dc2-a276-50cf595e6378 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:15.577356 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a288b5ed-ab65-4dc2-a276-50cf595e6378 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:16.429535 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a288b5ed-ab65-4dc2-a276-50cf595e6378 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:16.444160 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a288b5ed-ab65-4dc2-a276-50cf595e6378 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:16.445855 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a288b5ed-ab65-4dc2-a276-50cf595e6378 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:16.447199 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a288b5ed-ab65-4dc2-a276-50cf595e6378 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1604 microversion: 2.42 time: 0.919785 Jul 18 02:25:16.458328 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1376/2761] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:25:15 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1604 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:25:16.480661 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-46801683-4e99-48c4-aead-6fb939ab55e9 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:16.488327 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-46801683-4e99-48c4-aead-6fb939ab55e9 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b9b89b2c768847589c4d41aba88208a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d788b28fd2c4cf1826d908059f04c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:16.491013 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-46801683-4e99-48c4-aead-6fb939ab55e9 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Searching by: {'deleted': False, 'project_id': '2d788b28fd2c4cf1826d908059f04c4a'} {{(pid=119544) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:25:16.502897 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-46801683-4e99-48c4-aead-6fb939ab55e9 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:16.505460 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-46801683-4e99-48c4-aead-6fb939ab55e9 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:16.512504 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-46801683-4e99-48c4-aead-6fb939ab55e9 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:16.513071 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-46801683-4e99-48c4-aead-6fb939ab55e9 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:16.602201 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.multi_cell_list [None req-46801683-4e99-48c4-aead-6fb939ab55e9 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119544) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:25:16.657028 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-46801683-4e99-48c4-aead-6fb939ab55e9 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] 10.222.0.57 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.197446 Jul 18 02:25:16.658152 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1377/2762] 10.222.0.57 () {58 vars in 1124 bytes} [Mon Jul 18 02:25:16 2022] GET /compute/v2.1/servers => generated 340 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:25:16.663801 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e43d44d1-eb57-48cd-9722-3a8b052f3202 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:16.664740 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e43d44d1-eb57-48cd-9722-3a8b052f3202 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:16.673676 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e43d44d1-eb57-48cd-9722-3a8b052f3202 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:16.674446 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e43d44d1-eb57-48cd-9722-3a8b052f3202 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:16.675710 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e43d44d1-eb57-48cd-9722-3a8b052f3202 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:16.676410 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e43d44d1-eb57-48cd-9722-3a8b052f3202 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:16.750053 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-44e5e1f8-7913-4cf4-aceb-b82bb106f19f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:16.764351 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-44e5e1f8-7913-4cf4-aceb-b82bb106f19f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1471 microversion: 2.1 time: 2.023504 Jul 18 02:25:16.773750 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1386/2763] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:14 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1471 bytes in 2027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:16.786727 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2e9d1014-8bb5-4d9e-97a8-7a1ff125d78d tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:16.791603 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2e9d1014-8bb5-4d9e-97a8-7a1ff125d78d tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b9b89b2c768847589c4d41aba88208a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d788b28fd2c4cf1826d908059f04c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:16.792660 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2e9d1014-8bb5-4d9e-97a8-7a1ff125d78d tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Searching by: {'deleted': False, 'project_id': '2d788b28fd2c4cf1826d908059f04c4a'} {{(pid=119543) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:25:16.811211 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2e9d1014-8bb5-4d9e-97a8-7a1ff125d78d tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:16.817882 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2e9d1014-8bb5-4d9e-97a8-7a1ff125d78d tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:16.820600 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2e9d1014-8bb5-4d9e-97a8-7a1ff125d78d tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:16.822483 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2e9d1014-8bb5-4d9e-97a8-7a1ff125d78d tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:16.889285 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.multi_cell_list [None req-2e9d1014-8bb5-4d9e-97a8-7a1ff125d78d tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119543) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:25:16.892123 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e43d44d1-eb57-48cd-9722-3a8b052f3202 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:16.908097 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e43d44d1-eb57-48cd-9722-3a8b052f3202 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1272 microversion: 2.1 time: 0.248533 Jul 18 02:25:16.917880 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1378/2764] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:16 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1272 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:17.025808 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2e9d1014-8bb5-4d9e-97a8-7a1ff125d78d tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b89b2c768847589c4d41aba88208a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d788b28fd2c4cf1826d908059f04c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:17.047858 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2e9d1014-8bb5-4d9e-97a8-7a1ff125d78d tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:17.049999 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2e9d1014-8bb5-4d9e-97a8-7a1ff125d78d tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:17.478436 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-eafe4859-80b5-41c4-8e4c-a1ede5577343 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:17.485333 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-eafe4859-80b5-41c4-8e4c-a1ede5577343 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:17.523128 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eafe4859-80b5-41c4-8e4c-a1ede5577343 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:17.524843 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eafe4859-80b5-41c4-8e4c-a1ede5577343 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:17.532516 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eafe4859-80b5-41c4-8e4c-a1ede5577343 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:17.566677 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eafe4859-80b5-41c4-8e4c-a1ede5577343 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:18.555136 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-eafe4859-80b5-41c4-8e4c-a1ede5577343 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:18.567064 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-eafe4859-80b5-41c4-8e4c-a1ede5577343 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:18.569047 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-eafe4859-80b5-41c4-8e4c-a1ede5577343 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:18.570703 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-eafe4859-80b5-41c4-8e4c-a1ede5577343 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1604 microversion: 2.42 time: 1.103049 Jul 18 02:25:18.583171 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1379/2765] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:25:17 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1604 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:25:18.588880 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-beb8b3d6-5784-4475-97a9-adff00475d8d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:18.589720 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-beb8b3d6-5784-4475-97a9-adff00475d8d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:18.597458 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-beb8b3d6-5784-4475-97a9-adff00475d8d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:18.598099 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-beb8b3d6-5784-4475-97a9-adff00475d8d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:18.602929 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-beb8b3d6-5784-4475-97a9-adff00475d8d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:18.603493 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-beb8b3d6-5784-4475-97a9-adff00475d8d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:19.056928 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2e9d1014-8bb5-4d9e-97a8-7a1ff125d78d tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] 10.222.0.57 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 2.287985 Jul 18 02:25:19.057665 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1387/2766] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:25:16 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 2289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:19.063877 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-62bb2ddf-4c56-407b-bb61-64b885fdce0d tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:19.064656 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-62bb2ddf-4c56-407b-bb61-64b885fdce0d tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:19.093968 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-62bb2ddf-4c56-407b-bb61-64b885fdce0d tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:19.095233 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-62bb2ddf-4c56-407b-bb61-64b885fdce0d tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:19.096357 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-62bb2ddf-4c56-407b-bb61-64b885fdce0d tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:19.104632 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-62bb2ddf-4c56-407b-bb61-64b885fdce0d tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:19.396073 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-62bb2ddf-4c56-407b-bb61-64b885fdce0d tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:19.409382 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-62bb2ddf-4c56-407b-bb61-64b885fdce0d tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1272 microversion: 2.1 time: 0.350467 Jul 18 02:25:19.415530 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1388/2767] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:19 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1272 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:19.420830 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-069b9ac5-f6f6-47ce-8845-7f50e81b8d78 req-619148e3-1c88-4a95-9197-cd2bdc6d310a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7", "name": "network-vif-plugged", "status": "completed", "tag": "d130b73f-1f50-4848-bcf5-1bc41a9e7331"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:25:19.447524 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-069b9ac5-f6f6-47ce-8845-7f50e81b8d78 req-619148e3-1c88-4a95-9197-cd2bdc6d310a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:19.448880 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-069b9ac5-f6f6-47ce-8845-7f50e81b8d78 req-619148e3-1c88-4a95-9197-cd2bdc6d310a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:19.470984 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-069b9ac5-f6f6-47ce-8845-7f50e81b8d78 req-619148e3-1c88-4a95-9197-cd2bdc6d310a service nova] Creating event network-vif-plugged:d130b73f-1f50-4848-bcf5-1bc41a9e7331 for instance dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 on n-h1-465891-3 Jul 18 02:25:19.473983 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-beb8b3d6-5784-4475-97a9-adff00475d8d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:19.483422 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [req-069b9ac5-f6f6-47ce-8845-7f50e81b8d78 req-619148e3-1c88-4a95-9197-cd2bdc6d310a service nova] Instance dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3'} {{(pid=119543) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 02:25:19.492562 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-beb8b3d6-5784-4475-97a9-adff00475d8d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1471 microversion: 2.1 time: 0.906808 Jul 18 02:25:19.509792 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1380/2768] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:18 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1471 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:19.511816 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-069b9ac5-f6f6-47ce-8845-7f50e81b8d78 req-619148e3-1c88-4a95-9197-cd2bdc6d310a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094232 Jul 18 02:25:19.512206 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1389/2769] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:25:19.512511 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-576925a7-1c5e-4c06-b30b-d24f1f753a43 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:19.536286 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-576925a7-1c5e-4c06-b30b-d24f1f753a43 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] 10.222.0.57 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.036349 Jul 18 02:25:19.538094 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1381/2770] 10.222.0.57 () {58 vars in 1136 bytes} [Mon Jul 18 02:25:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:25:19.594222 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-557e0b6d-d2c5-423b-bdab-e4d045b98427 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:19.595925 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-557e0b6d-d2c5-423b-bdab-e4d045b98427 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:19.604949 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-557e0b6d-d2c5-423b-bdab-e4d045b98427 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:19.605779 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-557e0b6d-d2c5-423b-bdab-e4d045b98427 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:19.606810 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-557e0b6d-d2c5-423b-bdab-e4d045b98427 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:19.607493 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-557e0b6d-d2c5-423b-bdab-e4d045b98427 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:19.706725 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-557e0b6d-d2c5-423b-bdab-e4d045b98427 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:19.708398 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-557e0b6d-d2c5-423b-bdab-e4d045b98427 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:19.714992 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-557e0b6d-d2c5-423b-bdab-e4d045b98427 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lazy-loading 'fault' on Instance uuid b909490f-2890-43c0-b956-9de562d52d67 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:25:19.864537 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-40795b90-9f8f-4019-9398-25cfc1ec7b26 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:19.865808 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-40795b90-9f8f-4019-9398-25cfc1ec7b26 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] [instance: 49facc8e-4cfc-4522-90d3-38c9f152e390] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:19.883786 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-40795b90-9f8f-4019-9398-25cfc1ec7b26 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:19.889381 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-40795b90-9f8f-4019-9398-25cfc1ec7b26 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:19.890633 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-40795b90-9f8f-4019-9398-25cfc1ec7b26 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:19.891280 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-40795b90-9f8f-4019-9398-25cfc1ec7b26 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:19.964339 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-40795b90-9f8f-4019-9398-25cfc1ec7b26 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] [instance: 49facc8e-4cfc-4522-90d3-38c9f152e390] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:25:20.138229 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:25:20.193205 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-557e0b6d-d2c5-423b-bdab-e4d045b98427 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:20.204326 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-557e0b6d-d2c5-423b-bdab-e4d045b98427 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:20.207921 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-557e0b6d-d2c5-423b-bdab-e4d045b98427 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78557a76b1d14ecfaf40e4990cf89be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23f7f1ddc754ed98b5a77138365a743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:20.211652 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-557e0b6d-d2c5-423b-bdab-e4d045b98427 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 200 len: 1371 microversion: 2.42 time: 0.623096 Jul 18 02:25:20.228626 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1390/2771] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:25:19 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 1371 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:25:20.262591 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-40795b90-9f8f-4019-9398-25cfc1ec7b26 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] 10.222.0.57 "DELETE /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390" status: 204 len: 0 microversion: 2.1 time: 0.401644 Jul 18 02:25:20.263422 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1382/2772] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:25:19 2022] DELETE /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:25:20.274430 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f21c70d0-59d0-419c-b0b0-63bb9e1d3634 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:20.275233 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f21c70d0-59d0-419c-b0b0-63bb9e1d3634 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] [instance: 49facc8e-4cfc-4522-90d3-38c9f152e390] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:20.284157 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f21c70d0-59d0-419c-b0b0-63bb9e1d3634 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:20.287798 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f21c70d0-59d0-419c-b0b0-63bb9e1d3634 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:20.296695 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f21c70d0-59d0-419c-b0b0-63bb9e1d3634 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:20.297815 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f21c70d0-59d0-419c-b0b0-63bb9e1d3634 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:20.432795 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4fb5def9-0694-4ca5-990b-83ca45a70403 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:20.434039 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4fb5def9-0694-4ca5-990b-83ca45a70403 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:20.443713 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4fb5def9-0694-4ca5-990b-83ca45a70403 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:20.444530 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4fb5def9-0694-4ca5-990b-83ca45a70403 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:20.446222 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4fb5def9-0694-4ca5-990b-83ca45a70403 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:20.447357 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4fb5def9-0694-4ca5-990b-83ca45a70403 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:21.379043 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4fb5def9-0694-4ca5-990b-83ca45a70403 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:21.400833 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4fb5def9-0694-4ca5-990b-83ca45a70403 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1272 microversion: 2.1 time: 0.963962 Jul 18 02:25:21.414995 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1383/2773] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:20 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1272 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:21.430519 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b160ba38-febc-4e00-a70b-53a31a07e55b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:21.431672 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b160ba38-febc-4e00-a70b-53a31a07e55b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:21.449796 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b160ba38-febc-4e00-a70b-53a31a07e55b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:21.452135 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b160ba38-febc-4e00-a70b-53a31a07e55b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:21.455122 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b160ba38-febc-4e00-a70b-53a31a07e55b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:21.457322 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b160ba38-febc-4e00-a70b-53a31a07e55b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:23.291595 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f21c70d0-59d0-419c-b0b0-63bb9e1d3634 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b89b2c768847589c4d41aba88208a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d788b28fd2c4cf1826d908059f04c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:23.300082 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f21c70d0-59d0-419c-b0b0-63bb9e1d3634 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] 10.222.0.57 "GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390" status: 200 len: 1715 microversion: 2.1 time: 3.030990 Jul 18 02:25:23.305452 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1391/2774] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:20 2022] GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390 => generated 1715 bytes in 3037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:23.310786 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5536c66b-51b9-4dee-a562-073896047221 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:23.311417 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5536c66b-51b9-4dee-a562-073896047221 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:23.345587 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5536c66b-51b9-4dee-a562-073896047221 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:23.346116 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5536c66b-51b9-4dee-a562-073896047221 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:23.346938 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5536c66b-51b9-4dee-a562-073896047221 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:23.347386 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5536c66b-51b9-4dee-a562-073896047221 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:23.386826 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-5536c66b-51b9-4dee-a562-073896047221 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] HTTP exception thrown: Instance b909490f-2890-43c0-b956-9de562d52d67 could not be found. Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5536c66b-51b9-4dee-a562-073896047221 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Request method failure captured: Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 HTTP/1.1 Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MJ1YwwcAyhpNjMk3wURnvDI-_3JtRn4cbLFi9i-qQ80AI8DsEPFABr6cHFDPGeHThhhQas-KtRiM2tegjv4ZL7M88NtMKKF_Mg75PP1Aa9XZsYnCuVeJTudM3IkpTnpsFDj10DUp6mPcIMGvsglPDJkWkV2sYtryG90pZNmy4RZNlQ Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: X-Openstack-Nova-Api-Version: 2.42 Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: b23f7f1ddc754ed98b5a77138365a743 Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2035703984 Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b23f7f1ddc754ed98b5a77138365a743"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b23f7f1ddc754ed98b5a77138365a743"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b23f7f1ddc754ed98b5a77138365a743"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b23f7f1ddc754ed98b5a77138365a743"}]}] Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2035703984 Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: b23f7f1ddc754ed98b5a77138365a743 Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2035703984 Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-TaggedBootDevicesTest_v242-2035703984-project Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 78557a76b1d14ecfaf40e4990cf89be2 Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2035703984-project Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance b909490f-2890-43c0-b956-9de562d52d67 could not be found. Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'b909490f-2890-43c0-b956-9de562d52d67'} Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b909490f-2890-43c0-b956-9de562d52d67 could not be found. Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b909490f-2890-43c0-b956-9de562d52d67 could not be found. Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:25:23.388733 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:23.398581 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:25:23.398581 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:23.398581 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:25:23.398581 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:25:23.398581 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:25:23.398581 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:25:23.398581 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b909490f-2890-43c0-b956-9de562d52d67 could not be found. Jul 18 02:25:23.398581 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:25:23.398581 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5536c66b-51b9-4dee-a562-073896047221 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Returning 404 to user: Instance b909490f-2890-43c0-b956-9de562d52d67 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:25:23.398581 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5536c66b-51b9-4dee-a562-073896047221 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 404 len: 111 microversion: 2.42 time: 0.083396 Jul 18 02:25:23.398581 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1392/2775] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:25:23 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:25:23.403029 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-96ea209c-4702-43ef-b91d-024a853c6b07 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:23.403029 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-96ea209c-4702-43ef-b91d-024a853c6b07 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:23.441798 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-96ea209c-4702-43ef-b91d-024a853c6b07 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:23.442272 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-96ea209c-4702-43ef-b91d-024a853c6b07 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:23.443095 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-96ea209c-4702-43ef-b91d-024a853c6b07 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:23.443544 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-96ea209c-4702-43ef-b91d-024a853c6b07 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:23.550176 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b160ba38-febc-4e00-a70b-53a31a07e55b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:23.571123 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b160ba38-febc-4e00-a70b-53a31a07e55b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1471 microversion: 2.1 time: 2.154125 Jul 18 02:25:23.578539 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1384/2776] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:21 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1471 bytes in 2162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:23.600683 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-44d702b5-41fa-4c42-a018-5f72adf1baae tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '.version_select at 0x7ff49be901f0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:23.664645 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-44d702b5-41fa-4c42-a018-5f72adf1baae tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1604770316" status: 204 len: 0 microversion: 2.42 time: 0.075918 Jul 18 02:25:23.669910 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1385/2777] 10.222.0.57 () {60 vars in 1261 bytes} [Mon Jul 18 02:25:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1604770316 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:25:24.161933 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-96ea209c-4702-43ef-b91d-024a853c6b07 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:24.193248 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-96ea209c-4702-43ef-b91d-024a853c6b07 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1272 microversion: 2.1 time: 0.797252 Jul 18 02:25:24.194418 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1393/2778] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:23 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1272 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:24.331211 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-22604b0a-8316-42e3-8db9-7933465f4be3 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:24.332184 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-22604b0a-8316-42e3-8db9-7933465f4be3 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] [instance: 49facc8e-4cfc-4522-90d3-38c9f152e390] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:24.346013 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=8 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:25:24.352242 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-22604b0a-8316-42e3-8db9-7933465f4be3 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:24.352981 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-22604b0a-8316-42e3-8db9-7933465f4be3 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:24.354399 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-22604b0a-8316-42e3-8db9-7933465f4be3 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:24.354866 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-22604b0a-8316-42e3-8db9-7933465f4be3 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:24.619288 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-42c5231c-b544-42d1-b120-1ee4e5d30de2 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:24.620510 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-42c5231c-b544-42d1-b120-1ee4e5d30de2 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:24.654025 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-42c5231c-b544-42d1-b120-1ee4e5d30de2 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:24.660663 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-42c5231c-b544-42d1-b120-1ee4e5d30de2 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:24.667661 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-42c5231c-b544-42d1-b120-1ee4e5d30de2 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:24.668185 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-42c5231c-b544-42d1-b120-1ee4e5d30de2 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:26.450685 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-42c5231c-b544-42d1-b120-1ee4e5d30de2 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:26.499321 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-42c5231c-b544-42d1-b120-1ee4e5d30de2 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1471 microversion: 2.1 time: 1.889430 Jul 18 02:25:26.521866 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1394/2779] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:24 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1471 bytes in 1898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:26.545390 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ae7e401c-08f5-44a4-853c-7720d582087e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:26.546415 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ae7e401c-08f5-44a4-853c-7720d582087e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:26.548262 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:25:26.569817 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ae7e401c-08f5-44a4-853c-7720d582087e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:26.570694 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ae7e401c-08f5-44a4-853c-7720d582087e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:26.571731 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ae7e401c-08f5-44a4-853c-7720d582087e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:26.572458 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ae7e401c-08f5-44a4-853c-7720d582087e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:26.837368 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:25:26.853482 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-22604b0a-8316-42e3-8db9-7933465f4be3 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b89b2c768847589c4d41aba88208a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d788b28fd2c4cf1826d908059f04c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:26.864381 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-22604b0a-8316-42e3-8db9-7933465f4be3 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] 10.222.0.57 "GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390" status: 200 len: 1715 microversion: 2.1 time: 2.537294 Jul 18 02:25:26.879044 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1386/2780] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:24 2022] GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390 => generated 1715 bytes in 2552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:26.887183 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-ca9650dd-f75a-4613-b3dd-48df04aeb15a req-53b4b06d-9169-40c9-ab9e-d5e593aadcae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49facc8e-4cfc-4522-90d3-38c9f152e390", "name": "network-vif-unplugged", "status": "completed", "tag": "44254fc9-6729-4435-8c9a-c405df2363b5"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:25:26.898515 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-ca9650dd-f75a-4613-b3dd-48df04aeb15a req-53b4b06d-9169-40c9-ab9e-d5e593aadcae service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:26.900172 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-ca9650dd-f75a-4613-b3dd-48df04aeb15a req-53b4b06d-9169-40c9-ab9e-d5e593aadcae service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:26.922640 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-ca9650dd-f75a-4613-b3dd-48df04aeb15a req-53b4b06d-9169-40c9-ab9e-d5e593aadcae service nova] Creating event network-vif-unplugged:44254fc9-6729-4435-8c9a-c405df2363b5 for instance 49facc8e-4cfc-4522-90d3-38c9f152e390 on n-h1-465891-3 Jul 18 02:25:26.931175 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-ca9650dd-f75a-4613-b3dd-48df04aeb15a req-53b4b06d-9169-40c9-ab9e-d5e593aadcae service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049404 Jul 18 02:25:26.933322 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1387/2781] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:25:27.014271 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:25:27.543826 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9555624a-72e4-472a-82c2-2523cd4d4005 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:27.546688 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9555624a-72e4-472a-82c2-2523cd4d4005 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:27.569751 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9555624a-72e4-472a-82c2-2523cd4d4005 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:27.573142 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9555624a-72e4-472a-82c2-2523cd4d4005 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:27.576302 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9555624a-72e4-472a-82c2-2523cd4d4005 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:27.577940 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9555624a-72e4-472a-82c2-2523cd4d4005 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:27.642694 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ae7e401c-08f5-44a4-853c-7720d582087e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:27.680816 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ae7e401c-08f5-44a4-853c-7720d582087e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1314 microversion: 2.1 time: 1.156779 Jul 18 02:25:27.687437 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1395/2782] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:26 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1314 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:27.890703 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ba3a15a5-b131-4fd8-a521-0669867318d5 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:27.897253 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ba3a15a5-b131-4fd8-a521-0669867318d5 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] [instance: 49facc8e-4cfc-4522-90d3-38c9f152e390] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:27.920657 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ba3a15a5-b131-4fd8-a521-0669867318d5 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:27.930036 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ba3a15a5-b131-4fd8-a521-0669867318d5 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:27.935254 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ba3a15a5-b131-4fd8-a521-0669867318d5 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:27.938327 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ba3a15a5-b131-4fd8-a521-0669867318d5 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:29.136941 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9555624a-72e4-472a-82c2-2523cd4d4005 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:29.180305 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9555624a-72e4-472a-82c2-2523cd4d4005 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1463 microversion: 2.1 time: 1.646134 Jul 18 02:25:29.193047 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1388/2783] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:27 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1463 bytes in 1662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:29.204846 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d71ada67-e2fa-4e2a-ad63-dd79488f4ce6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:29.208849 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d71ada67-e2fa-4e2a-ad63-dd79488f4ce6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:29.250450 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d71ada67-e2fa-4e2a-ad63-dd79488f4ce6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:29.251640 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d71ada67-e2fa-4e2a-ad63-dd79488f4ce6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:29.253383 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d71ada67-e2fa-4e2a-ad63-dd79488f4ce6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:29.259752 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d71ada67-e2fa-4e2a-ad63-dd79488f4ce6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:29.318851 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ba3a15a5-b131-4fd8-a521-0669867318d5 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b89b2c768847589c4d41aba88208a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d788b28fd2c4cf1826d908059f04c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:29.365900 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ba3a15a5-b131-4fd8-a521-0669867318d5 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] 10.222.0.57 "GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390" status: 200 len: 1715 microversion: 2.1 time: 1.482507 Jul 18 02:25:29.393206 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1396/2784] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:27 2022] GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390 => generated 1715 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:29.422162 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7df04326-f65e-4312-a1f6-94005b630789 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:29.425336 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7df04326-f65e-4312-a1f6-94005b630789 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:29.467224 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7df04326-f65e-4312-a1f6-94005b630789 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:29.468377 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7df04326-f65e-4312-a1f6-94005b630789 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:29.470383 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7df04326-f65e-4312-a1f6-94005b630789 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:29.473667 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7df04326-f65e-4312-a1f6-94005b630789 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:30.414906 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7df04326-f65e-4312-a1f6-94005b630789 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:30.457858 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7df04326-f65e-4312-a1f6-94005b630789 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1463 microversion: 2.1 time: 1.057467 Jul 18 02:25:30.476338 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1397/2785] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:29 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1463 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:30.523572 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b8d92950-d19e-4b84-aecc-089971f483c3 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:30.524030 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b8d92950-d19e-4b84-aecc-089971f483c3 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] [instance: 49facc8e-4cfc-4522-90d3-38c9f152e390] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:30.548393 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b8d92950-d19e-4b84-aecc-089971f483c3 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:30.549137 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b8d92950-d19e-4b84-aecc-089971f483c3 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:30.550583 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b8d92950-d19e-4b84-aecc-089971f483c3 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:30.551241 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b8d92950-d19e-4b84-aecc-089971f483c3 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:30.595900 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d71ada67-e2fa-4e2a-ad63-dd79488f4ce6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:30.613907 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d71ada67-e2fa-4e2a-ad63-dd79488f4ce6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1314 microversion: 2.1 time: 1.418347 Jul 18 02:25:30.615165 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1389/2786] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:29 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1314 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:30.626778 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ee295321-52c2-4798-9861-c04011dcc410 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Action: 'create', calling method: .version_select at 0x7ff49be26ee0>, body: {"keypair": {"name": "tempest-keypair-680598662", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiT8DFW3tQNgolGVnU8RbB0K9VNuu5gVYKrh2jii6Bjju/xqUYFSb4cDp0P4u4PvukBFTbTFGr0Rj5NAZOiOwXGe1TgEjQg1LAbk2rbx27TavNAj52AVsgresNgVC+Khw=="}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:25:30.654589 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-ee295321-52c2-4798-9861-c04011dcc410 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Getting quotas for project d7ff962145954166b4c5efb0a0f1edff. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:25:30.662947 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-ee295321-52c2-4798-9861-c04011dcc410 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Getting quotas for user dbeea54ebc4749aba59afb60feaa6159 and project d7ff962145954166b4c5efb0a0f1edff. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:25:30.700811 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ee295321-52c2-4798-9861-c04011dcc410 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.084210 Jul 18 02:25:30.702130 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1390/2787] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 02:25:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:25:30.903557 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b8d92950-d19e-4b84-aecc-089971f483c3 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b89b2c768847589c4d41aba88208a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d788b28fd2c4cf1826d908059f04c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:30.923843 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b8d92950-d19e-4b84-aecc-089971f483c3 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] 10.222.0.57 "GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390" status: 200 len: 1648 microversion: 2.1 time: 0.420712 Jul 18 02:25:30.931683 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1398/2788] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:30 2022] GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390 => generated 1648 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:31.208856 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-3cc76eae-486e-45f4-92f2-3b1da3e373a8 req-a7c14d0d-a72f-4ee6-9841-c6c443a2de5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49facc8e-4cfc-4522-90d3-38c9f152e390", "name": "network-vif-deleted", "tag": "44254fc9-6729-4435-8c9a-c405df2363b5"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:25:31.238556 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-3cc76eae-486e-45f4-92f2-3b1da3e373a8 req-a7c14d0d-a72f-4ee6-9841-c6c443a2de5a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:31.240636 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-3cc76eae-486e-45f4-92f2-3b1da3e373a8 req-a7c14d0d-a72f-4ee6-9841-c6c443a2de5a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:31.291145 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-3cc76eae-486e-45f4-92f2-3b1da3e373a8 req-a7c14d0d-a72f-4ee6-9841-c6c443a2de5a service nova] Creating event network-vif-deleted:44254fc9-6729-4435-8c9a-c405df2363b5 for instance 49facc8e-4cfc-4522-90d3-38c9f152e390 on n-h1-465891-3 Jul 18 02:25:31.314667 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-3cc76eae-486e-45f4-92f2-3b1da3e373a8 req-a7c14d0d-a72f-4ee6-9841-c6c443a2de5a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109490 Jul 18 02:25:31.315771 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1391/2789] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:25:31.645065 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3327ba97-e735-4356-9809-43469d5ab7d3 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:31.646455 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3327ba97-e735-4356-9809-43469d5ab7d3 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:31.661571 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3327ba97-e735-4356-9809-43469d5ab7d3 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:31.663107 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3327ba97-e735-4356-9809-43469d5ab7d3 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:31.669054 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3327ba97-e735-4356-9809-43469d5ab7d3 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:31.670082 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3327ba97-e735-4356-9809-43469d5ab7d3 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:31.959634 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fa2117f9-e889-41f7-8b8a-570a3c7172d6 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:31.960945 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fa2117f9-e889-41f7-8b8a-570a3c7172d6 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] [instance: 49facc8e-4cfc-4522-90d3-38c9f152e390] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:31.984970 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fa2117f9-e889-41f7-8b8a-570a3c7172d6 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:31.990015 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fa2117f9-e889-41f7-8b8a-570a3c7172d6 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:31.991551 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fa2117f9-e889-41f7-8b8a-570a3c7172d6 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:31.992324 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fa2117f9-e889-41f7-8b8a-570a3c7172d6 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:32.175917 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fa2117f9-e889-41f7-8b8a-570a3c7172d6 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:32.176869 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fa2117f9-e889-41f7-8b8a-570a3c7172d6 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:32.178213 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-fa2117f9-e889-41f7-8b8a-570a3c7172d6 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lazy-loading 'fault' on Instance uuid 49facc8e-4cfc-4522-90d3-38c9f152e390 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:25:32.722069 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fa2117f9-e889-41f7-8b8a-570a3c7172d6 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b89b2c768847589c4d41aba88208a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d788b28fd2c4cf1826d908059f04c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:32.736035 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fa2117f9-e889-41f7-8b8a-570a3c7172d6 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] 10.222.0.57 "GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390" status: 200 len: 1367 microversion: 2.1 time: 0.781183 Jul 18 02:25:32.738130 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1392/2790] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:31 2022] GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390 => generated 1367 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:25:33.185824 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3327ba97-e735-4356-9809-43469d5ab7d3 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:33.207825 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3327ba97-e735-4356-9809-43469d5ab7d3 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1314 microversion: 2.1 time: 1.566271 Jul 18 02:25:33.220402 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1399/2791] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:31 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1314 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:25:33.773416 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-308a545f-8e40-463e-bc2c-74e62e50a7c0 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:33.774937 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-308a545f-8e40-463e-bc2c-74e62e50a7c0 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] [instance: 49facc8e-4cfc-4522-90d3-38c9f152e390] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:33.797300 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-308a545f-8e40-463e-bc2c-74e62e50a7c0 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:33.799194 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-308a545f-8e40-463e-bc2c-74e62e50a7c0 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:33.799194 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-308a545f-8e40-463e-bc2c-74e62e50a7c0 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:33.801273 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-308a545f-8e40-463e-bc2c-74e62e50a7c0 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:33.830753 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-308a545f-8e40-463e-bc2c-74e62e50a7c0 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] HTTP exception thrown: Instance 49facc8e-4cfc-4522-90d3-38c9f152e390 could not be found. Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-308a545f-8e40-463e-bc2c-74e62e50a7c0 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Request method failure captured: Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390 HTTP/1.1 Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MQRR5C3r6wAqCp5aP_0rZj6qQ6Wo4VPU0TPT1DPmgg1wV-5zaQ22CGYUCD82MFKMIpL1lP_tRIx0j8RbcBuG2RPR_sb-Cf1MgpR_yw5LDECosWHBDjsZBKldEv2H14Ul4inOa_ezRsfEBRGnsUJ404cUnkSS3luLUy1FPx9fXTuO5k Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 2d788b28fd2c4cf1826d908059f04c4a Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersTestManualDisk-401960594 Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2d788b28fd2c4cf1826d908059f04c4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2d788b28fd2c4cf1826d908059f04c4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2d788b28fd2c4cf1826d908059f04c4a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2d788b28fd2c4cf1826d908059f04c4a"}]}] Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersTestManualDisk-401960594 Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 2d788b28fd2c4cf1826d908059f04c4a Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersTestManualDisk-401960594 Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersTestManualDisk-401960594-project Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: b9b89b2c768847589c4d41aba88208a4 Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersTestManualDisk-401960594-project Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 49facc8e-4cfc-4522-90d3-38c9f152e390 could not be found. Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '49facc8e-4cfc-4522-90d3-38c9f152e390'} Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49facc8e-4cfc-4522-90d3-38c9f152e390 could not be found. Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49facc8e-4cfc-4522-90d3-38c9f152e390 could not be found. Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:33.832764 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:25:33.836836 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:33.836836 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:25:33.836836 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:25:33.836836 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:25:33.836836 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:25:33.836836 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49facc8e-4cfc-4522-90d3-38c9f152e390 could not be found. Jul 18 02:25:33.836836 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:25:33.838641 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-308a545f-8e40-463e-bc2c-74e62e50a7c0 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Returning 404 to user: Instance 49facc8e-4cfc-4522-90d3-38c9f152e390 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:25:33.839722 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-308a545f-8e40-463e-bc2c-74e62e50a7c0 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] 10.222.0.57 "GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390" status: 404 len: 111 microversion: 2.1 time: 0.071285 Jul 18 02:25:33.841066 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1393/2792] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:33 2022] GET /compute/v2.1/servers/49facc8e-4cfc-4522-90d3-38c9f152e390 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:25:33.850867 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c350ed4d-f48e-4f63-a198-91704693a216 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] Calling method '.version_select at 0x7ff49b9920d0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:33.883988 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c350ed4d-f48e-4f63-a198-91704693a216 tempest-ServersTestManualDisk-401960594 tempest-ServersTestManualDisk-401960594-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-654047918" status: 202 len: 0 microversion: 2.1 time: 0.038012 Jul 18 02:25:33.895353 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-273aa000-9f54-4bc9-ac13-80415c44ffa7 req-8a76a072-8981-4444-a426-cf057c604f97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "637aab54-71a9-4233-85ad-7d1e785b9e9c", "tag": "747e8487-8d62-41a3-94d1-1c3cf951db53"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:25:33.910736 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1400/2793] 10.222.0.57 () {58 vars in 1217 bytes} [Mon Jul 18 02:25:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-654047918 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:25:33.922241 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-273aa000-9f54-4bc9-ac13-80415c44ffa7 req-8a76a072-8981-4444-a426-cf057c604f97 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:33.923158 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-273aa000-9f54-4bc9-ac13-80415c44ffa7 req-8a76a072-8981-4444-a426-cf057c604f97 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:33.939356 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-273aa000-9f54-4bc9-ac13-80415c44ffa7 req-8a76a072-8981-4444-a426-cf057c604f97 service nova] Creating event network-changed:747e8487-8d62-41a3-94d1-1c3cf951db53 for instance 637aab54-71a9-4233-85ad-7d1e785b9e9c on n-h2-465891-3 Jul 18 02:25:33.946487 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-273aa000-9f54-4bc9-ac13-80415c44ffa7 req-8a76a072-8981-4444-a426-cf057c604f97 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065265 Jul 18 02:25:33.947567 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1394/2794] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:25:34.232458 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-27d1262c-abf3-4aa7-88bf-e41393922008 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:34.249832 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-27d1262c-abf3-4aa7-88bf-e41393922008 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:34.290774 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-27d1262c-abf3-4aa7-88bf-e41393922008 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:34.296386 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-27d1262c-abf3-4aa7-88bf-e41393922008 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:34.298252 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-27d1262c-abf3-4aa7-88bf-e41393922008 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:34.299252 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-27d1262c-abf3-4aa7-88bf-e41393922008 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:35.071667 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-27d1262c-abf3-4aa7-88bf-e41393922008 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:35.124370 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-27d1262c-abf3-4aa7-88bf-e41393922008 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1314 microversion: 2.1 time: 0.896057 Jul 18 02:25:35.146083 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1401/2795] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:34 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1314 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:36.157353 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-dd5811b7-01bf-42e8-b56a-c0b42853ef29 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:36.158227 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-dd5811b7-01bf-42e8-b56a-c0b42853ef29 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:36.172136 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:25:36.213162 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dd5811b7-01bf-42e8-b56a-c0b42853ef29 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:36.214126 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dd5811b7-01bf-42e8-b56a-c0b42853ef29 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:36.215530 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dd5811b7-01bf-42e8-b56a-c0b42853ef29 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:36.216284 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dd5811b7-01bf-42e8-b56a-c0b42853ef29 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:36.759880 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-dd5811b7-01bf-42e8-b56a-c0b42853ef29 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:36.790276 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-dd5811b7-01bf-42e8-b56a-c0b42853ef29 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1314 microversion: 2.1 time: 0.634579 Jul 18 02:25:36.792815 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1395/2796] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:36 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1314 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:37.810574 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a0c18f51-9f8f-44da-b45f-d8e9e5d95842 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:37.811968 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a0c18f51-9f8f-44da-b45f-d8e9e5d95842 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:37.844280 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a0c18f51-9f8f-44da-b45f-d8e9e5d95842 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:37.844744 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a0c18f51-9f8f-44da-b45f-d8e9e5d95842 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:37.845575 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a0c18f51-9f8f-44da-b45f-d8e9e5d95842 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:37.846116 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a0c18f51-9f8f-44da-b45f-d8e9e5d95842 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:38.709183 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a0c18f51-9f8f-44da-b45f-d8e9e5d95842 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:38.756352 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a0c18f51-9f8f-44da-b45f-d8e9e5d95842 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1314 microversion: 2.1 time: 0.948477 Jul 18 02:25:38.758323 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1402/2797] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:37 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1314 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:39.787625 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ed1974d3-469f-4479-8e9f-c3fc11199218 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:39.788641 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ed1974d3-469f-4479-8e9f-c3fc11199218 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:39.833754 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ed1974d3-469f-4479-8e9f-c3fc11199218 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:39.838192 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ed1974d3-469f-4479-8e9f-c3fc11199218 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:39.845038 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ed1974d3-469f-4479-8e9f-c3fc11199218 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:39.850962 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ed1974d3-469f-4479-8e9f-c3fc11199218 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:40.544295 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ed1974d3-469f-4479-8e9f-c3fc11199218 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:40.578580 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ed1974d3-469f-4479-8e9f-c3fc11199218 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1314 microversion: 2.1 time: 0.789986 Jul 18 02:25:40.579742 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1396/2798] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:39 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1314 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:41.619147 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0b3055f3-1b4c-41e1-bde1-746b6af53368 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:41.622986 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0b3055f3-1b4c-41e1-bde1-746b6af53368 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:41.662398 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0b3055f3-1b4c-41e1-bde1-746b6af53368 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:41.667434 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0b3055f3-1b4c-41e1-bde1-746b6af53368 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:41.673071 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0b3055f3-1b4c-41e1-bde1-746b6af53368 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:41.676589 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0b3055f3-1b4c-41e1-bde1-746b6af53368 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:41.783015 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:25:42.117061 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-31001663-e89a-48f4-950e-ad9bd085c219 tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Calling method '.version_select at 0x7ff49bfaef70>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:42.119714 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-31001663-e89a-48f4-950e-ad9bd085c219 tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:42.120163 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-31001663-e89a-48f4-950e-ad9bd085c219 tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:42.134336 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:25:42.152784 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-31001663-e89a-48f4-950e-ad9bd085c219 tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] 10.222.0.57 "GET /compute/v2.1/os-migrations" status: 200 len: 803 microversion: 2.1 time: 0.027708 Jul 18 02:25:42.159033 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1397/2799] 10.222.0.57 () {58 vars in 1142 bytes} [Mon Jul 18 02:25:42 2022] GET /compute/v2.1/os-migrations => generated 803 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:25:42.187362 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7f378cec-51d0-4266-9cc5-345a6fa65b4f tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:42.200333 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7f378cec-51d0-4266-9cc5-345a6fa65b4f tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018572 Jul 18 02:25:42.214675 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1398/2800] 10.222.0.57 () {58 vars in 1136 bytes} [Mon Jul 18 02:25:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:25:42.220223 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-62a63dce-8ad1-4fec-ae22-54655aad25b9 tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-502945203", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:25:42.234364 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:25:42.234364 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:25:42.262295 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-62a63dce-8ad1-4fec-ae22-54655aad25b9 tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.046381 Jul 18 02:25:42.262919 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1399/2801] 10.222.0.57 () {60 vars in 1145 bytes} [Mon Jul 18 02:25:42 2022] POST /compute/v2.1/flavors => generated 498 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:25:42.277865 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8bc96e2b-826f-4812-99cc-4bc0b68d0de3 tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:42.300173 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8bc96e2b-826f-4812-99cc-4bc0b68d0de3 tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.026148 Jul 18 02:25:42.301094 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1400/2802] 10.222.0.57 () {58 vars in 1181 bytes} [Mon Jul 18 02:25:42 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:25:42.419773 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0b3055f3-1b4c-41e1-bde1-746b6af53368 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:42.433051 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0b3055f3-1b4c-41e1-bde1-746b6af53368 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1314 microversion: 2.1 time: 0.828676 Jul 18 02:25:42.433725 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1403/2803] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:41 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1314 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:42.511526 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-832b90cd-0c0c-4009-97f9-e374236e0aaf tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-812795420", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "f528b215-231b-4db9-8b70-332311acf682"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:25:42.603980 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-832b90cd-0c0c-4009-97f9-e374236e0aaf tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] validate_networks() for None {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:25:43.193790 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-832b90cd-0c0c-4009-97f9-e374236e0aaf tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:25:43.194471 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-832b90cd-0c0c-4009-97f9-e374236e0aaf tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:25:43.194652 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-832b90cd-0c0c-4009-97f9-e374236e0aaf tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:25:43.195276 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-832b90cd-0c0c-4009-97f9-e374236e0aaf tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:25:43.195900 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-832b90cd-0c0c-4009-97f9-e374236e0aaf tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:25:43.221431 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-832b90cd-0c0c-4009-97f9-e374236e0aaf tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:43.222394 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-832b90cd-0c0c-4009-97f9-e374236e0aaf tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:43.226824 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-832b90cd-0c0c-4009-97f9-e374236e0aaf tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:43.227566 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-832b90cd-0c0c-4009-97f9-e374236e0aaf tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:43.280657 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-832b90cd-0c0c-4009-97f9-e374236e0aaf tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Getting quotas for project d7ff962145954166b4c5efb0a0f1edff. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:25:43.296682 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-832b90cd-0c0c-4009-97f9-e374236e0aaf tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Getting quotas for user dbeea54ebc4749aba59afb60feaa6159 and project d7ff962145954166b4c5efb0a0f1edff. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:25:43.334540 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-832b90cd-0c0c-4009-97f9-e374236e0aaf tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:25:43.337109 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-832b90cd-0c0c-4009-97f9-e374236e0aaf tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:25:43.452594 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1db53cb5-ffe9-40ab-a633-8230f6dcd3eb tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:43.454622 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1db53cb5-ffe9-40ab-a633-8230f6dcd3eb tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:43.458313 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:25:43.471396 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-832b90cd-0c0c-4009-97f9-e374236e0aaf tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.964673 Jul 18 02:25:43.472356 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1401/2804] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:25:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:25:43.479085 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1db53cb5-ffe9-40ab-a633-8230f6dcd3eb tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:43.487565 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1db53cb5-ffe9-40ab-a633-8230f6dcd3eb tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:43.488952 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1db53cb5-ffe9-40ab-a633-8230f6dcd3eb tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:43.494995 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1db53cb5-ffe9-40ab-a633-8230f6dcd3eb tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:43.501448 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-84ef374c-ab18-4d9a-928f-7f5f638eb125 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:43.505361 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-84ef374c-ab18-4d9a-928f-7f5f638eb125 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:43.697436 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-84ef374c-ab18-4d9a-928f-7f5f638eb125 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:43.710090 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-84ef374c-ab18-4d9a-928f-7f5f638eb125 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1278 microversion: 2.1 time: 0.226959 Jul 18 02:25:43.716707 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1402/2805] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:43 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1278 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:25:43.958051 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1db53cb5-ffe9-40ab-a633-8230f6dcd3eb tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:43.991968 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1db53cb5-ffe9-40ab-a633-8230f6dcd3eb tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1314 microversion: 2.1 time: 0.542126 Jul 18 02:25:44.010959 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1404/2806] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:43 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1314 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:25:44.768380 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0cc1e9dc-3229-4244-8699-9f5d20521b1c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:44.775312 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0cc1e9dc-3229-4244-8699-9f5d20521b1c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:44.952601 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-694b2770-16b8-43ae-99f0-32238a66dc91 req-98eb4e24-045e-4f71-b137-e552d1bf9420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "637aab54-71a9-4233-85ad-7d1e785b9e9c", "name": "network-vif-plugged", "status": "completed", "tag": "747e8487-8d62-41a3-94d1-1c3cf951db53"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:25:45.020283 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-694b2770-16b8-43ae-99f0-32238a66dc91 req-98eb4e24-045e-4f71-b137-e552d1bf9420 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:45.020862 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-694b2770-16b8-43ae-99f0-32238a66dc91 req-98eb4e24-045e-4f71-b137-e552d1bf9420 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:45.070967 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-694b2770-16b8-43ae-99f0-32238a66dc91 req-98eb4e24-045e-4f71-b137-e552d1bf9420 service nova] Creating event network-vif-plugged:747e8487-8d62-41a3-94d1-1c3cf951db53 for instance 637aab54-71a9-4233-85ad-7d1e785b9e9c on n-h2-465891-3 Jul 18 02:25:45.094988 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-694b2770-16b8-43ae-99f0-32238a66dc91 req-98eb4e24-045e-4f71-b137-e552d1bf9420 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147410 Jul 18 02:25:45.097251 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1405/2807] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:25:45.120728 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e74c9a3e-f21a-4ce9-8fcc-81e7f5d5edf2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:45.125644 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e74c9a3e-f21a-4ce9-8fcc-81e7f5d5edf2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:45.152546 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e74c9a3e-f21a-4ce9-8fcc-81e7f5d5edf2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:45.156924 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e74c9a3e-f21a-4ce9-8fcc-81e7f5d5edf2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:45.162818 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e74c9a3e-f21a-4ce9-8fcc-81e7f5d5edf2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:45.166826 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e74c9a3e-f21a-4ce9-8fcc-81e7f5d5edf2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:46.204271 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0cc1e9dc-3229-4244-8699-9f5d20521b1c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:46.218169 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0cc1e9dc-3229-4244-8699-9f5d20521b1c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1278 microversion: 2.1 time: 1.475295 Jul 18 02:25:46.232297 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1403/2808] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:44 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1278 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:47.091659 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e74c9a3e-f21a-4ce9-8fcc-81e7f5d5edf2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:47.114841 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e74c9a3e-f21a-4ce9-8fcc-81e7f5d5edf2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1314 microversion: 2.1 time: 2.013480 Jul 18 02:25:47.127480 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1406/2809] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:45 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1314 bytes in 2028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:47.261197 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d865b2dc-70ea-4326-9a0c-802de8852380 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:47.269777 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d865b2dc-70ea-4326-9a0c-802de8852380 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:47.286608 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d865b2dc-70ea-4326-9a0c-802de8852380 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:47.288028 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d865b2dc-70ea-4326-9a0c-802de8852380 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:47.290384 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d865b2dc-70ea-4326-9a0c-802de8852380 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:47.291590 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d865b2dc-70ea-4326-9a0c-802de8852380 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:47.760431 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d865b2dc-70ea-4326-9a0c-802de8852380 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:47.795462 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d865b2dc-70ea-4326-9a0c-802de8852380 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1336 microversion: 2.1 time: 0.556197 Jul 18 02:25:47.810664 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1404/2810] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:47 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1336 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:48.151672 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1aa5769f-018c-4bfa-8f36-63fb894771e0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:48.152342 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1aa5769f-018c-4bfa-8f36-63fb894771e0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:48.174846 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1aa5769f-018c-4bfa-8f36-63fb894771e0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:48.175309 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1aa5769f-018c-4bfa-8f36-63fb894771e0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:48.180541 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1aa5769f-018c-4bfa-8f36-63fb894771e0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:48.181224 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1aa5769f-018c-4bfa-8f36-63fb894771e0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:48.222157 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ad38abbf-2fa4-449e-a068-ac3b6ba307b3 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:48.222662 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ad38abbf-2fa4-449e-a068-ac3b6ba307b3 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:48.240273 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ad38abbf-2fa4-449e-a068-ac3b6ba307b3 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:48.240747 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ad38abbf-2fa4-449e-a068-ac3b6ba307b3 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:48.241567 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ad38abbf-2fa4-449e-a068-ac3b6ba307b3 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:48.264613 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ad38abbf-2fa4-449e-a068-ac3b6ba307b3 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:48.308547 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-ad38abbf-2fa4-449e-a068-ac3b6ba307b3 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] HTTP exception thrown: Instance b909490f-2890-43c0-b956-9de562d52d67 could not be found. Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ad38abbf-2fa4-449e-a068-ac3b6ba307b3 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Request method failure captured: Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 HTTP/1.1 Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MJ1YwwcAyhpNjMk3wURnvDI-_3JtRn4cbLFi9i-qQ80AI8DsEPFABr6cHFDPGeHThhhQas-KtRiM2tegjv4ZL7M88NtMKKF_Mg75PP1Aa9XZsYnCuVeJTudM3IkpTnpsFDj10DUp6mPcIMGvsglPDJkWkV2sYtryG90pZNmy4RZNlQ Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: X-Openstack-Nova-Api-Version: 2.42 Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: b23f7f1ddc754ed98b5a77138365a743 Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2035703984 Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b23f7f1ddc754ed98b5a77138365a743"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b23f7f1ddc754ed98b5a77138365a743"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b23f7f1ddc754ed98b5a77138365a743"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b23f7f1ddc754ed98b5a77138365a743"}]}] Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2035703984 Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: b23f7f1ddc754ed98b5a77138365a743 Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2035703984 Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-TaggedBootDevicesTest_v242-2035703984-project Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 78557a76b1d14ecfaf40e4990cf89be2 Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2035703984-project Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance b909490f-2890-43c0-b956-9de562d52d67 could not be found. Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'b909490f-2890-43c0-b956-9de562d52d67'} Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b909490f-2890-43c0-b956-9de562d52d67 could not be found. Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:25:48.311324 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:25:48.326795 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b909490f-2890-43c0-b956-9de562d52d67 could not be found. Jul 18 02:25:48.326795 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:25:48.326795 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:48.326795 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:25:48.326795 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:48.326795 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:25:48.326795 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:25:48.326795 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:25:48.326795 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:25:48.326795 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b909490f-2890-43c0-b956-9de562d52d67 could not be found. Jul 18 02:25:48.326795 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:25:48.326795 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ad38abbf-2fa4-449e-a068-ac3b6ba307b3 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Returning 404 to user: Instance b909490f-2890-43c0-b956-9de562d52d67 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:25:48.326795 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ad38abbf-2fa4-449e-a068-ac3b6ba307b3 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 404 len: 111 microversion: 2.42 time: 0.096034 Jul 18 02:25:48.326795 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1405/2811] 10.222.0.57 () {60 vars in 1279 bytes} [Mon Jul 18 02:25:48 2022] DELETE /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:25:48.326795 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f2d41f34-926a-4eac-b9e5-00bba6645248 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:48.326795 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f2d41f34-926a-4eac-b9e5-00bba6645248 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] [instance: b909490f-2890-43c0-b956-9de562d52d67] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:48.336993 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f2d41f34-926a-4eac-b9e5-00bba6645248 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:48.342254 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f2d41f34-926a-4eac-b9e5-00bba6645248 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:48.343326 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f2d41f34-926a-4eac-b9e5-00bba6645248 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:48.347562 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f2d41f34-926a-4eac-b9e5-00bba6645248 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:48.387231 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-f2d41f34-926a-4eac-b9e5-00bba6645248 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] HTTP exception thrown: Instance b909490f-2890-43c0-b956-9de562d52d67 could not be found. Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f2d41f34-926a-4eac-b9e5-00bba6645248 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Request method failure captured: Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 HTTP/1.1 Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MJ1YwwcAyhpNjMk3wURnvDI-_3JtRn4cbLFi9i-qQ80AI8DsEPFABr6cHFDPGeHThhhQas-KtRiM2tegjv4ZL7M88NtMKKF_Mg75PP1Aa9XZsYnCuVeJTudM3IkpTnpsFDj10DUp6mPcIMGvsglPDJkWkV2sYtryG90pZNmy4RZNlQ Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: X-Openstack-Nova-Api-Version: 2.42 Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: b23f7f1ddc754ed98b5a77138365a743 Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2035703984 Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b23f7f1ddc754ed98b5a77138365a743"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b23f7f1ddc754ed98b5a77138365a743"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b23f7f1ddc754ed98b5a77138365a743"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b23f7f1ddc754ed98b5a77138365a743"}]}] Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2035703984 Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: b23f7f1ddc754ed98b5a77138365a743 Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2035703984 Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-TaggedBootDevicesTest_v242-2035703984-project Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 78557a76b1d14ecfaf40e4990cf89be2 Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2035703984-project Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance b909490f-2890-43c0-b956-9de562d52d67 could not be found. Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'b909490f-2890-43c0-b956-9de562d52d67'} Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b909490f-2890-43c0-b956-9de562d52d67 could not be found. Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b909490f-2890-43c0-b956-9de562d52d67 could not be found. Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:25:48.401720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:48.406592 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:25:48.406592 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:48.406592 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:25:48.406592 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:25:48.406592 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:25:48.406592 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:25:48.406592 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b909490f-2890-43c0-b956-9de562d52d67 could not be found. Jul 18 02:25:48.406592 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:25:48.406592 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f2d41f34-926a-4eac-b9e5-00bba6645248 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] Returning 404 to user: Instance b909490f-2890-43c0-b956-9de562d52d67 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:25:48.406592 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f2d41f34-926a-4eac-b9e5-00bba6645248 tempest-TaggedBootDevicesTest_v242-2035703984 tempest-TaggedBootDevicesTest_v242-2035703984-project] 10.222.0.57 "GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67" status: 404 len: 111 microversion: 2.42 time: 0.084764 Jul 18 02:25:48.411126 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1406/2812] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:25:48 2022] GET /compute/v2.1/servers/b909490f-2890-43c0-b956-9de562d52d67 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:25:48.834642 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-01c2d421-68f4-4c8c-be0c-bad9c83acefc tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:48.837769 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-01c2d421-68f4-4c8c-be0c-bad9c83acefc tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:48.869512 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-01c2d421-68f4-4c8c-be0c-bad9c83acefc tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:48.874428 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-01c2d421-68f4-4c8c-be0c-bad9c83acefc tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:48.879357 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-01c2d421-68f4-4c8c-be0c-bad9c83acefc tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:48.884247 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-01c2d421-68f4-4c8c-be0c-bad9c83acefc tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:49.642306 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1aa5769f-018c-4bfa-8f36-63fb894771e0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:49.673317 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1aa5769f-018c-4bfa-8f36-63fb894771e0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1314 microversion: 2.1 time: 1.526434 Jul 18 02:25:49.688313 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1407/2813] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:48 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1314 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:49.810834 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-01c2d421-68f4-4c8c-be0c-bad9c83acefc tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:49.821844 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-01c2d421-68f4-4c8c-be0c-bad9c83acefc tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1336 microversion: 2.1 time: 0.998212 Jul 18 02:25:49.825871 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1407/2814] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:48 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1336 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:50.713247 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5981ec74-2f72-4f19-b4a8-2026471cc243 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:50.714284 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5981ec74-2f72-4f19-b4a8-2026471cc243 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:50.729213 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5981ec74-2f72-4f19-b4a8-2026471cc243 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:50.729940 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5981ec74-2f72-4f19-b4a8-2026471cc243 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:50.733625 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5981ec74-2f72-4f19-b4a8-2026471cc243 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:50.734142 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5981ec74-2f72-4f19-b4a8-2026471cc243 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:50.855701 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f02a9e90-9975-451b-b4ef-0838a78876ff tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:50.856810 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f02a9e90-9975-451b-b4ef-0838a78876ff tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:50.886945 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f02a9e90-9975-451b-b4ef-0838a78876ff tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:50.896194 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f02a9e90-9975-451b-b4ef-0838a78876ff tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:50.903584 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f02a9e90-9975-451b-b4ef-0838a78876ff tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:50.904391 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f02a9e90-9975-451b-b4ef-0838a78876ff tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:51.051785 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:25:51.524709 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f02a9e90-9975-451b-b4ef-0838a78876ff tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:51.549744 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f02a9e90-9975-451b-b4ef-0838a78876ff tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1336 microversion: 2.1 time: 0.702593 Jul 18 02:25:51.562022 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1408/2815] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:50 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1336 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:25:51.698267 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5981ec74-2f72-4f19-b4a8-2026471cc243 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:51.744909 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5981ec74-2f72-4f19-b4a8-2026471cc243 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1501 microversion: 2.1 time: 1.035095 Jul 18 02:25:51.747997 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1408/2816] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:50 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1501 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:25:51.778494 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-990ff470-524f-4012-bd00-32fd2a630954 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:25:51.779667 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-990ff470-524f-4012-bd00-32fd2a630954 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:51.821976 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-990ff470-524f-4012-bd00-32fd2a630954 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:51.823612 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-990ff470-524f-4012-bd00-32fd2a630954 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:51.828185 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-990ff470-524f-4012-bd00-32fd2a630954 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:51.834548 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-990ff470-524f-4012-bd00-32fd2a630954 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:51.990436 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-990ff470-524f-4012-bd00-32fd2a630954 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lazy-loading 'flavor' on Instance uuid 637aab54-71a9-4233-85ad-7d1e785b9e9c {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:25:52.604746 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b64cda94-7edf-4a21-8c75-85da38c45bcc tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:52.608806 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b64cda94-7edf-4a21-8c75-85da38c45bcc tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:52.663760 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b64cda94-7edf-4a21-8c75-85da38c45bcc tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:52.667293 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b64cda94-7edf-4a21-8c75-85da38c45bcc tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:52.672322 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b64cda94-7edf-4a21-8c75-85da38c45bcc tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:52.679450 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b64cda94-7edf-4a21-8c75-85da38c45bcc tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:53.106235 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-990ff470-524f-4012-bd00-32fd2a630954 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "POST /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c/action" status: 202 len: 0 microversion: 2.1 time: 1.340636 Jul 18 02:25:53.112945 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1409/2817] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:25:51 2022] POST /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c/action => generated 0 bytes in 1349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:25:53.134415 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-85cf4337-2c04-44e2-a739-ddb0c1450660 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:53.138728 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-85cf4337-2c04-44e2-a739-ddb0c1450660 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:53.189859 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-85cf4337-2c04-44e2-a739-ddb0c1450660 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:53.190665 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-85cf4337-2c04-44e2-a739-ddb0c1450660 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:53.192141 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-85cf4337-2c04-44e2-a739-ddb0c1450660 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:53.192950 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-85cf4337-2c04-44e2-a739-ddb0c1450660 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:53.245657 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:25:55.681028 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b64cda94-7edf-4a21-8c75-85da38c45bcc tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:55.700990 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b64cda94-7edf-4a21-8c75-85da38c45bcc tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1378 microversion: 2.1 time: 3.111851 Jul 18 02:25:55.702696 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1409/2818] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:52 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1378 bytes in 3115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:55.957585 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-85cf4337-2c04-44e2-a739-ddb0c1450660 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:55.990569 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-85cf4337-2c04-44e2-a739-ddb0c1450660 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1507 microversion: 2.1 time: 2.873270 Jul 18 02:25:56.015723 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1410/2819] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:53 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1507 bytes in 2900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:56.751659 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9adf4c4a-1c0d-442d-849c-76e033b2e158 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:56.751659 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9adf4c4a-1c0d-442d-849c-76e033b2e158 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:56.784086 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9adf4c4a-1c0d-442d-849c-76e033b2e158 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:56.784538 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9adf4c4a-1c0d-442d-849c-76e033b2e158 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:56.793921 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9adf4c4a-1c0d-442d-849c-76e033b2e158 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:56.794597 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9adf4c4a-1c0d-442d-849c-76e033b2e158 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:57.026821 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-97dc5544-41db-42f1-b736-8072b102742d tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:57.040552 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-97dc5544-41db-42f1-b736-8072b102742d tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:57.088148 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=10 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:25:57.116599 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-97dc5544-41db-42f1-b736-8072b102742d tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:57.127178 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-97dc5544-41db-42f1-b736-8072b102742d tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:57.133208 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-97dc5544-41db-42f1-b736-8072b102742d tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:57.134257 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-97dc5544-41db-42f1-b736-8072b102742d tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:59.081330 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9adf4c4a-1c0d-442d-849c-76e033b2e158 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:59.096488 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9adf4c4a-1c0d-442d-849c-76e033b2e158 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1378 microversion: 2.1 time: 2.369936 Jul 18 02:25:59.103677 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1410/2820] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:56 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1378 bytes in 2374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:00.121465 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a55b0e94-67b3-41f9-b2a5-eb34ea075891 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:00.122632 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a55b0e94-67b3-41f9-b2a5-eb34ea075891 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:00.135756 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a55b0e94-67b3-41f9-b2a5-eb34ea075891 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:00.136479 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a55b0e94-67b3-41f9-b2a5-eb34ea075891 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:00.153106 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a55b0e94-67b3-41f9-b2a5-eb34ea075891 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:00.155087 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a55b0e94-67b3-41f9-b2a5-eb34ea075891 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:00.820738 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-97dc5544-41db-42f1-b736-8072b102742d tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:00.831873 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-97dc5544-41db-42f1-b736-8072b102742d tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1507 microversion: 2.1 time: 3.815370 Jul 18 02:26:00.841574 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1411/2821] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:57 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1507 bytes in 3826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:26:01.882815 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4694a940-7961-4d7c-bef4-19a6333a763b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:01.886083 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4694a940-7961-4d7c-bef4-19a6333a763b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:01.925057 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4694a940-7961-4d7c-bef4-19a6333a763b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:01.925520 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4694a940-7961-4d7c-bef4-19a6333a763b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:01.948528 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4694a940-7961-4d7c-bef4-19a6333a763b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:01.949400 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4694a940-7961-4d7c-bef4-19a6333a763b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:03.139315 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a55b0e94-67b3-41f9-b2a5-eb34ea075891 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:03.155497 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a55b0e94-67b3-41f9-b2a5-eb34ea075891 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1378 microversion: 2.1 time: 3.037741 Jul 18 02:26:03.156282 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1411/2822] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:00 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1378 bytes in 3039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:03.799414 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-546bc3d6-593f-456d-8220-93cb93ed3d35 tempest-SecurityGroupsNegativeTestJSON-268169294 tempest-SecurityGroupsNegativeTestJSON-268169294-project] Calling method '.version_select at 0x7ff49ba6a1f0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:04.198675 n-d-465891-3 devstack@n-api.service[119543]: DEBUG neutronclient.v2_0.client [None req-546bc3d6-593f-456d-8220-93cb93ed3d35 tempest-SecurityGroupsNegativeTestJSON-268169294 tempest-SecurityGroupsNegativeTestJSON-268169294-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 121f9da5-9f26-4266-9dd8-0fe42ca68225 does not exist", "detail": ""}} {{(pid=119543) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:26:04.199866 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.security_group_api [None req-546bc3d6-593f-456d-8220-93cb93ed3d35 tempest-SecurityGroupsNegativeTestJSON-268169294 tempest-SecurityGroupsNegativeTestJSON-268169294-project] Neutron security group 121f9da5-9f26-4266-9dd8-0fe42ca68225 not found {{(pid=119543) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 02:26:04.201444 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-546bc3d6-593f-456d-8220-93cb93ed3d35 tempest-SecurityGroupsNegativeTestJSON-268169294 tempest-SecurityGroupsNegativeTestJSON-268169294-project] HTTP exception thrown: Security group 121f9da5-9f26-4266-9dd8-0fe42ca68225 does not exist Jul 18 02:26:04.201444 n-d-465891-3 devstack@n-api.service[119543]: Neutron server returns request_ids: ['req-4332a77a-8a35-4941-b1d7-05b9c29e3561'] Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-546bc3d6-593f-456d-8220-93cb93ed3d35 tempest-SecurityGroupsNegativeTestJSON-268169294 tempest-SecurityGroupsNegativeTestJSON-268169294-project] Request method failure captured: Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/os-security-groups/121f9da5-9f26-4266-9dd8-0fe42ca68225 HTTP/1.1 Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MS6dFs6E18NcrIP79Ka5qINS8Hs01pWpGOnsSj5rUxup7fKXDroKs0GqK4agWG2iAUF_kiDXJvLQFVVDJhzGVqqVgI33A8FVZL2qw3EUd0T3qFxAoH5oPX2XLNiTxGBIsiIdSHwR7RVLUkijgFJYA3-LKSm8h5lc38CAvx2PigcWoE Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 93e443a6cf044506bb52f40d983df717 Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-268169294 Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_93e443a6cf044506bb52f40d983df717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/93e443a6cf044506bb52f40d983df717"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/93e443a6cf044506bb52f40d983df717"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/93e443a6cf044506bb52f40d983df717"}]}] Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-268169294 Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 93e443a6cf044506bb52f40d983df717 Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-268169294 Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-SecurityGroupsNegativeTestJSON-268169294-project Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: c824bdc5e475401fbcc0b43fbbc59611 Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-268169294-project Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: exception: Security group 121f9da5-9f26-4266-9dd8-0fe42ca68225 does not exist Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: Neutron server returns request_ids: ['req-4332a77a-8a35-4941-b1d7-05b9c29e3561'] Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '121f9da5-9f26-4266-9dd8-0fe42ca68225'} Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:26:04.204384 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 121f9da5-9f26-4266-9dd8-0fe42ca68225 does not exist Jul 18 02:26:04.208346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4332a77a-8a35-4941-b1d7-05b9c29e3561'] Jul 18 02:26:04.208346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:26:04.208346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:26:04.208346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:26:04.208346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:26:04.208346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 18 02:26:04.208346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 18 02:26:04.208346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 02:26:04.208346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 02:26:04.208346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 121f9da5-9f26-4266-9dd8-0fe42ca68225 does not exist Jul 18 02:26:04.208346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4332a77a-8a35-4941-b1d7-05b9c29e3561'] Jul 18 02:26:04.208346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:26:04.208346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:26:04.208346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:26:04.208346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:26:04.208346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:26:04.208346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:26:04.208346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:26:04.208346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:26:04.208346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:26:04.208346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:26:04.208346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:26:04.208346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:26:04.208346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 18 02:26:04.208346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 02:26:04.208346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 121f9da5-9f26-4266-9dd8-0fe42ca68225 does not exist Jul 18 02:26:04.208346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4332a77a-8a35-4941-b1d7-05b9c29e3561'] Jul 18 02:26:04.208346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:26:04.208346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:26:04.208346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:26:04.208346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:26:04.208346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:26:04.208346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:26:04.208346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:26:04.208346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:26:04.208346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 121f9da5-9f26-4266-9dd8-0fe42ca68225 does not exist Jul 18 02:26:04.208346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4332a77a-8a35-4941-b1d7-05b9c29e3561'] Jul 18 02:26:04.208346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:26:04.208346 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-546bc3d6-593f-456d-8220-93cb93ed3d35 tempest-SecurityGroupsNegativeTestJSON-268169294 tempest-SecurityGroupsNegativeTestJSON-268169294-project] Returning 404 to user: Security group 121f9da5-9f26-4266-9dd8-0fe42ca68225 does not exist Jul 18 02:26:04.208346 n-d-465891-3 devstack@n-api.service[119543]: Neutron server returns request_ids: ['req-4332a77a-8a35-4941-b1d7-05b9c29e3561'] {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:26:04.214190 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-546bc3d6-593f-456d-8220-93cb93ed3d35 tempest-SecurityGroupsNegativeTestJSON-268169294 tempest-SecurityGroupsNegativeTestJSON-268169294-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/121f9da5-9f26-4266-9dd8-0fe42ca68225" status: 404 len: 194 microversion: 2.1 time: 1.051410 Jul 18 02:26:04.214190 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1412/2823] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 02:26:03 2022] DELETE /compute/v2.1/os-security-groups/121f9da5-9f26-4266-9dd8-0fe42ca68225 => generated 194 bytes in 1056 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:26:04.232679 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-d670bae1-8290-46cb-b41f-733ec8a1f94e req-e78754d7-1ab8-4ef0-b689-704922434351 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d", "tag": "34d35bd1-0f8c-4049-9360-7f9c95f734d8"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:26:04.253058 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-d670bae1-8290-46cb-b41f-733ec8a1f94e req-e78754d7-1ab8-4ef0-b689-704922434351 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:04.253058 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-d670bae1-8290-46cb-b41f-733ec8a1f94e req-e78754d7-1ab8-4ef0-b689-704922434351 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:04.282303 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-d670bae1-8290-46cb-b41f-733ec8a1f94e req-e78754d7-1ab8-4ef0-b689-704922434351 service nova] Creating event network-changed:34d35bd1-0f8c-4049-9360-7f9c95f734d8 for instance a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d on n-h1-465891-3 Jul 18 02:26:04.296881 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-d670bae1-8290-46cb-b41f-733ec8a1f94e req-e78754d7-1ab8-4ef0-b689-704922434351 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073869 Jul 18 02:26:04.299697 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1413/2824] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:26:04.309778 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4694a940-7961-4d7c-bef4-19a6333a763b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:04.338106 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cf0046e8-ed60-4dd7-82c0-180de3a3ae4d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:04.339123 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cf0046e8-ed60-4dd7-82c0-180de3a3ae4d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:04.360883 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cf0046e8-ed60-4dd7-82c0-180de3a3ae4d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:04.362884 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cf0046e8-ed60-4dd7-82c0-180de3a3ae4d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:04.365093 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4694a940-7961-4d7c-bef4-19a6333a763b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1507 microversion: 2.1 time: 2.496111 Jul 18 02:26:04.366591 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cf0046e8-ed60-4dd7-82c0-180de3a3ae4d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:04.370365 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cf0046e8-ed60-4dd7-82c0-180de3a3ae4d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:04.378522 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1412/2825] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:01 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1507 bytes in 2510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:26:04.425288 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b6fe24e3-c6d2-4c69-af65-589a57c34613 tempest-SecurityGroupsNegativeTestJSON-268169294 tempest-SecurityGroupsNegativeTestJSON-268169294-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.044443 Jul 18 02:26:04.431721 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1413/2826] 10.222.0.57 () {58 vars in 1163 bytes} [Mon Jul 18 02:26:04 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 18 02:26:04.449963 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d012d2f0-8343-44c5-961d-862701f9e674 tempest-SecurityGroupsNegativeTestJSON-268169294 tempest-SecurityGroupsNegativeTestJSON-268169294-project] Calling method '.version_select at 0x7ff49be90ee0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:04.997192 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cf0046e8-ed60-4dd7-82c0-180de3a3ae4d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:05.016788 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cf0046e8-ed60-4dd7-82c0-180de3a3ae4d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1378 microversion: 2.1 time: 0.697336 Jul 18 02:26:05.030386 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1414/2827] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:04 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1378 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:05.392635 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-19d34db8-131c-4289-8858-2a9d707a7978 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:05.393542 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-19d34db8-131c-4289-8858-2a9d707a7978 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:05.411433 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-19d34db8-131c-4289-8858-2a9d707a7978 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:05.413356 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-19d34db8-131c-4289-8858-2a9d707a7978 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:05.416410 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-19d34db8-131c-4289-8858-2a9d707a7978 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:05.418645 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-19d34db8-131c-4289-8858-2a9d707a7978 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:06.493238 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d012d2f0-8343-44c5-961d-862701f9e674 tempest-SecurityGroupsNegativeTestJSON-268169294 tempest-SecurityGroupsNegativeTestJSON-268169294-project] 10.222.0.57 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 2.055205 Jul 18 02:26:06.501232 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1414/2828] 10.222.0.57 () {58 vars in 1157 bytes} [Mon Jul 18 02:26:04 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 2064 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:26:06.507921 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2f95b104-b90e-48b1-9935-7a31b6e57f85 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:06.511495 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2f95b104-b90e-48b1-9935-7a31b6e57f85 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:06.520058 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:26:06.538184 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2f95b104-b90e-48b1-9935-7a31b6e57f85 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:06.551234 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2f95b104-b90e-48b1-9935-7a31b6e57f85 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:06.563395 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2f95b104-b90e-48b1-9935-7a31b6e57f85 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:06.565925 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2f95b104-b90e-48b1-9935-7a31b6e57f85 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:07.337309 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-19d34db8-131c-4289-8858-2a9d707a7978 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:07.348895 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-19d34db8-131c-4289-8858-2a9d707a7978 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1507 microversion: 2.1 time: 1.960157 Jul 18 02:26:07.367519 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1415/2829] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:05 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1507 bytes in 1979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:26:07.392654 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-aec70993-f905-4dc7-af8f-4f289a6206b1 tempest-SecurityGroupsNegativeTestJSON-268169294 tempest-SecurityGroupsNegativeTestJSON-268169294-project] Calling method '.version_select at 0x7ff49b954700>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:07.918096 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2f95b104-b90e-48b1-9935-7a31b6e57f85 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:07.970297 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2f95b104-b90e-48b1-9935-7a31b6e57f85 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1378 microversion: 2.1 time: 1.465780 Jul 18 02:26:07.987869 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1415/2830] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:06 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1378 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:08.215985 n-d-465891-3 devstack@n-api.service[119543]: DEBUG neutronclient.v2_0.client [None req-aec70993-f905-4dc7-af8f-4f289a6206b1 tempest-SecurityGroupsNegativeTestJSON-268169294 tempest-SecurityGroupsNegativeTestJSON-268169294-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=119543) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:26:08.216851 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-aec70993-f905-4dc7-af8f-4f289a6206b1 tempest-SecurityGroupsNegativeTestJSON-268169294 tempest-SecurityGroupsNegativeTestJSON-268169294-project] HTTP exception thrown: Insufficient rights for removing default security group. Jul 18 02:26:08.216851 n-d-465891-3 devstack@n-api.service[119543]: Neutron server returns request_ids: ['req-d1e032d4-d6e4-48b2-84e8-7ef086854b37'] Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-aec70993-f905-4dc7-af8f-4f289a6206b1 tempest-SecurityGroupsNegativeTestJSON-268169294 tempest-SecurityGroupsNegativeTestJSON-268169294-project] Request method failure captured: Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/os-security-groups/1027c83f-1bc4-47bf-9cb0-adbae8602fa9 HTTP/1.1 Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MS6dFs6E18NcrIP79Ka5qINS8Hs01pWpGOnsSj5rUxup7fKXDroKs0GqK4agWG2iAUF_kiDXJvLQFVVDJhzGVqqVgI33A8FVZL2qw3EUd0T3qFxAoH5oPX2XLNiTxGBIsiIdSHwR7RVLUkijgFJYA3-LKSm8h5lc38CAvx2PigcWoE Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 93e443a6cf044506bb52f40d983df717 Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-268169294 Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_93e443a6cf044506bb52f40d983df717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/93e443a6cf044506bb52f40d983df717"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/93e443a6cf044506bb52f40d983df717"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/93e443a6cf044506bb52f40d983df717"}]}] Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-268169294 Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 93e443a6cf044506bb52f40d983df717 Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-268169294 Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-SecurityGroupsNegativeTestJSON-268169294-project Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: c824bdc5e475401fbcc0b43fbbc59611 Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-268169294-project Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: exception: Insufficient rights for removing default security group. Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: Neutron server returns request_ids: ['req-d1e032d4-d6e4-48b2-84e8-7ef086854b37'] Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '1027c83f-1bc4-47bf-9cb0-adbae8602fa9'} Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:26:08.219659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Jul 18 02:26:08.225881 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d1e032d4-d6e4-48b2-84e8-7ef086854b37'] Jul 18 02:26:08.225881 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:26:08.225881 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:26:08.225881 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:26:08.225881 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:26:08.225881 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 18 02:26:08.225881 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 18 02:26:08.225881 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 18 02:26:08.225881 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 18 02:26:08.225881 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Jul 18 02:26:08.225881 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d1e032d4-d6e4-48b2-84e8-7ef086854b37'] Jul 18 02:26:08.225881 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:26:08.225881 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:26:08.225881 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:26:08.225881 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:26:08.225881 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:26:08.225881 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:26:08.225881 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:26:08.225881 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:26:08.225881 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:26:08.225881 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:26:08.225881 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:26:08.225881 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:26:08.225881 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 18 02:26:08.225881 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 18 02:26:08.225881 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Jul 18 02:26:08.225881 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d1e032d4-d6e4-48b2-84e8-7ef086854b37'] Jul 18 02:26:08.225881 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:26:08.225881 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:26:08.225881 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:26:08.225881 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:26:08.225881 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:26:08.225881 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:26:08.225881 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:26:08.225881 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:26:08.225881 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Jul 18 02:26:08.225881 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d1e032d4-d6e4-48b2-84e8-7ef086854b37'] Jul 18 02:26:08.225881 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:26:08.225881 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-aec70993-f905-4dc7-af8f-4f289a6206b1 tempest-SecurityGroupsNegativeTestJSON-268169294 tempest-SecurityGroupsNegativeTestJSON-268169294-project] Returning 400 to user: Insufficient rights for removing default security group. Jul 18 02:26:08.225881 n-d-465891-3 devstack@n-api.service[119543]: Neutron server returns request_ids: ['req-d1e032d4-d6e4-48b2-84e8-7ef086854b37'] {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:26:08.225881 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-aec70993-f905-4dc7-af8f-4f289a6206b1 tempest-SecurityGroupsNegativeTestJSON-268169294 tempest-SecurityGroupsNegativeTestJSON-268169294-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/1027c83f-1bc4-47bf-9cb0-adbae8602fa9" status: 400 len: 182 microversion: 2.1 time: 0.854128 Jul 18 02:26:08.238200 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-aabc5f01-f25b-4747-b11d-baad7317a3cc tempest-SecurityGroupsNegativeTestJSON-268169294 tempest-SecurityGroupsNegativeTestJSON-268169294-project] Calling method '.version_select at 0x7ff49bf168b0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:08.241614 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1416/2831] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 02:26:07 2022] DELETE /compute/v2.1/os-security-groups/1027c83f-1bc4-47bf-9cb0-adbae8602fa9 => generated 182 bytes in 873 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:26:08.332114 n-d-465891-3 devstack@n-api.service[119544]: DEBUG neutronclient.v2_0.client [None req-aabc5f01-f25b-4747-b11d-baad7317a3cc tempest-SecurityGroupsNegativeTestJSON-268169294 tempest-SecurityGroupsNegativeTestJSON-268169294-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 76099752-07d8-4e9d-9049-92437bd5db96 does not exist", "detail": ""}} {{(pid=119544) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:26:08.332844 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.security_group_api [None req-aabc5f01-f25b-4747-b11d-baad7317a3cc tempest-SecurityGroupsNegativeTestJSON-268169294 tempest-SecurityGroupsNegativeTestJSON-268169294-project] Neutron security group 76099752-07d8-4e9d-9049-92437bd5db96 not found {{(pid=119544) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 02:26:08.333883 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-aabc5f01-f25b-4747-b11d-baad7317a3cc tempest-SecurityGroupsNegativeTestJSON-268169294 tempest-SecurityGroupsNegativeTestJSON-268169294-project] HTTP exception thrown: Security group 76099752-07d8-4e9d-9049-92437bd5db96 does not exist Jul 18 02:26:08.333883 n-d-465891-3 devstack@n-api.service[119544]: Neutron server returns request_ids: ['req-e194c63c-f6fe-45e5-bded-ba674248cc13'] Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-aabc5f01-f25b-4747-b11d-baad7317a3cc tempest-SecurityGroupsNegativeTestJSON-268169294 tempest-SecurityGroupsNegativeTestJSON-268169294-project] Request method failure captured: Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/os-security-groups/76099752-07d8-4e9d-9049-92437bd5db96 HTTP/1.1 Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MS6dFs6E18NcrIP79Ka5qINS8Hs01pWpGOnsSj5rUxup7fKXDroKs0GqK4agWG2iAUF_kiDXJvLQFVVDJhzGVqqVgI33A8FVZL2qw3EUd0T3qFxAoH5oPX2XLNiTxGBIsiIdSHwR7RVLUkijgFJYA3-LKSm8h5lc38CAvx2PigcWoE Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 93e443a6cf044506bb52f40d983df717 Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-268169294 Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_93e443a6cf044506bb52f40d983df717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/93e443a6cf044506bb52f40d983df717"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/93e443a6cf044506bb52f40d983df717"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/93e443a6cf044506bb52f40d983df717"}]}] Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-268169294 Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 93e443a6cf044506bb52f40d983df717 Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-268169294 Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-SecurityGroupsNegativeTestJSON-268169294-project Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: c824bdc5e475401fbcc0b43fbbc59611 Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-268169294-project Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: exception: Security group 76099752-07d8-4e9d-9049-92437bd5db96 does not exist Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: Neutron server returns request_ids: ['req-e194c63c-f6fe-45e5-bded-ba674248cc13'] Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '76099752-07d8-4e9d-9049-92437bd5db96'} Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:26:08.336603 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 76099752-07d8-4e9d-9049-92437bd5db96 does not exist Jul 18 02:26:08.343068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e194c63c-f6fe-45e5-bded-ba674248cc13'] Jul 18 02:26:08.343068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:26:08.343068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:26:08.343068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:26:08.343068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:26:08.343068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 18 02:26:08.343068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 18 02:26:08.343068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 02:26:08.343068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 02:26:08.343068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 76099752-07d8-4e9d-9049-92437bd5db96 does not exist Jul 18 02:26:08.343068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e194c63c-f6fe-45e5-bded-ba674248cc13'] Jul 18 02:26:08.343068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:26:08.343068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:26:08.343068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:26:08.343068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:26:08.343068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:26:08.343068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:26:08.343068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:26:08.343068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:26:08.343068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:26:08.343068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:26:08.343068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:26:08.343068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:26:08.343068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 18 02:26:08.343068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 02:26:08.343068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 76099752-07d8-4e9d-9049-92437bd5db96 does not exist Jul 18 02:26:08.343068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e194c63c-f6fe-45e5-bded-ba674248cc13'] Jul 18 02:26:08.343068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:26:08.343068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:26:08.343068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:26:08.343068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:26:08.343068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:26:08.343068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:26:08.343068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:26:08.343068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:26:08.343068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 76099752-07d8-4e9d-9049-92437bd5db96 does not exist Jul 18 02:26:08.343068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e194c63c-f6fe-45e5-bded-ba674248cc13'] Jul 18 02:26:08.343068 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:26:08.343068 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-aabc5f01-f25b-4747-b11d-baad7317a3cc tempest-SecurityGroupsNegativeTestJSON-268169294 tempest-SecurityGroupsNegativeTestJSON-268169294-project] Returning 404 to user: Security group 76099752-07d8-4e9d-9049-92437bd5db96 does not exist Jul 18 02:26:08.343068 n-d-465891-3 devstack@n-api.service[119544]: Neutron server returns request_ids: ['req-e194c63c-f6fe-45e5-bded-ba674248cc13'] {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:26:08.343068 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-aabc5f01-f25b-4747-b11d-baad7317a3cc tempest-SecurityGroupsNegativeTestJSON-268169294 tempest-SecurityGroupsNegativeTestJSON-268169294-project] 10.222.0.57 "GET /compute/v2.1/os-security-groups/76099752-07d8-4e9d-9049-92437bd5db96" status: 404 len: 194 microversion: 2.1 time: 0.107001 Jul 18 02:26:08.343068 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1416/2832] 10.222.0.57 () {58 vars in 1268 bytes} [Mon Jul 18 02:26:08 2022] GET /compute/v2.1/os-security-groups/76099752-07d8-4e9d-9049-92437bd5db96 => generated 194 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:26:08.354469 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7a6b05b8-7bf3-4cd6-8ce6-f93785fa1641 tempest-SecurityGroupsNegativeTestJSON-268169294 tempest-SecurityGroupsNegativeTestJSON-268169294-project] Action: 'update', calling method: .version_select at 0x7ff4a8a55f70>, body: {"security_group": {"name": "tempest-sg-1399082659", "description": "tempest-description-680714596"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:26:08.376682 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7afb80f3-e14b-410a-85bf-2465516ab5f9 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:08.377190 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7afb80f3-e14b-410a-85bf-2465516ab5f9 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:08.418350 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7afb80f3-e14b-410a-85bf-2465516ab5f9 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:08.423586 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7afb80f3-e14b-410a-85bf-2465516ab5f9 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:08.424651 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7afb80f3-e14b-410a-85bf-2465516ab5f9 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:08.425114 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7afb80f3-e14b-410a-85bf-2465516ab5f9 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:08.735366 n-d-465891-3 devstack@n-api.service[119543]: DEBUG neutronclient.v2_0.client [None req-7a6b05b8-7bf3-4cd6-8ce6-f93785fa1641 tempest-SecurityGroupsNegativeTestJSON-268169294 tempest-SecurityGroupsNegativeTestJSON-268169294-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group dc16582d-9762-4e0a-babd-1f9937c086fd does not exist", "detail": ""}} {{(pid=119543) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:26:08.736555 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.security_group_api [None req-7a6b05b8-7bf3-4cd6-8ce6-f93785fa1641 tempest-SecurityGroupsNegativeTestJSON-268169294 tempest-SecurityGroupsNegativeTestJSON-268169294-project] Neutron security group dc16582d-9762-4e0a-babd-1f9937c086fd not found {{(pid=119543) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 02:26:08.737648 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-7a6b05b8-7bf3-4cd6-8ce6-f93785fa1641 tempest-SecurityGroupsNegativeTestJSON-268169294 tempest-SecurityGroupsNegativeTestJSON-268169294-project] HTTP exception thrown: Security group dc16582d-9762-4e0a-babd-1f9937c086fd does not exist Jul 18 02:26:08.737648 n-d-465891-3 devstack@n-api.service[119543]: Neutron server returns request_ids: ['req-1ecb5fb7-bc52-4f1e-9446-c0d94bbb6ab9'] Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7a6b05b8-7bf3-4cd6-8ce6-f93785fa1641 tempest-SecurityGroupsNegativeTestJSON-268169294 tempest-SecurityGroupsNegativeTestJSON-268169294-project] Request method failure captured: Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: request: PUT /compute/v2.1/os-security-groups/dc16582d-9762-4e0a-babd-1f9937c086fd HTTP/1.1 Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 101 Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MS6dFs6E18NcrIP79Ka5qINS8Hs01pWpGOnsSj5rUxup7fKXDroKs0GqK4agWG2iAUF_kiDXJvLQFVVDJhzGVqqVgI33A8FVZL2qw3EUd0T3qFxAoH5oPX2XLNiTxGBIsiIdSHwR7RVLUkijgFJYA3-LKSm8h5lc38CAvx2PigcWoE Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 93e443a6cf044506bb52f40d983df717 Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-268169294 Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_93e443a6cf044506bb52f40d983df717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/93e443a6cf044506bb52f40d983df717"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/93e443a6cf044506bb52f40d983df717"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/93e443a6cf044506bb52f40d983df717"}]}] Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-268169294 Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 93e443a6cf044506bb52f40d983df717 Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-268169294 Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-SecurityGroupsNegativeTestJSON-268169294-project Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: c824bdc5e475401fbcc0b43fbbc59611 Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-268169294-project Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: {"security_group": {"name": "tempest-sg-1399082659", "description": "tempest-description-680714596"}} Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: exception: Security group dc16582d-9762-4e0a-babd-1f9937c086fd does not exist Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: Neutron server returns request_ids: ['req-1ecb5fb7-bc52-4f1e-9446-c0d94bbb6ab9'] Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'dc16582d-9762-4e0a-babd-1f9937c086fd', 'body': {'security_group': {'name': 'tempest-sg-1399082659', 'description': 'tempest-description-680714596'}}} Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:26:08.742904 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:26:08.747091 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:26:08.747091 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group dc16582d-9762-4e0a-babd-1f9937c086fd does not exist Jul 18 02:26:08.747091 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1ecb5fb7-bc52-4f1e-9446-c0d94bbb6ab9'] Jul 18 02:26:08.747091 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:26:08.747091 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:26:08.747091 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:26:08.747091 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:26:08.747091 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Jul 18 02:26:08.747091 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 18 02:26:08.747091 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 02:26:08.747091 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 02:26:08.747091 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group dc16582d-9762-4e0a-babd-1f9937c086fd does not exist Jul 18 02:26:08.747091 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1ecb5fb7-bc52-4f1e-9446-c0d94bbb6ab9'] Jul 18 02:26:08.747091 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:26:08.747091 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:26:08.747091 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:26:08.747091 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:26:08.747091 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:26:08.747091 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:26:08.747091 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:26:08.747091 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:26:08.747091 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:26:08.747091 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:26:08.747091 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:26:08.747091 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:26:08.747091 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Jul 18 02:26:08.747091 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 02:26:08.747091 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group dc16582d-9762-4e0a-babd-1f9937c086fd does not exist Jul 18 02:26:08.747091 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1ecb5fb7-bc52-4f1e-9446-c0d94bbb6ab9'] Jul 18 02:26:08.747091 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:26:08.747091 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:26:08.747091 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:26:08.747091 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:26:08.747091 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:26:08.747091 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:26:08.747091 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:26:08.747091 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:26:08.747091 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group dc16582d-9762-4e0a-babd-1f9937c086fd does not exist Jul 18 02:26:08.747091 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1ecb5fb7-bc52-4f1e-9446-c0d94bbb6ab9'] Jul 18 02:26:08.747091 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:26:08.747091 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7a6b05b8-7bf3-4cd6-8ce6-f93785fa1641 tempest-SecurityGroupsNegativeTestJSON-268169294 tempest-SecurityGroupsNegativeTestJSON-268169294-project] Returning 404 to user: Security group dc16582d-9762-4e0a-babd-1f9937c086fd does not exist Jul 18 02:26:08.747091 n-d-465891-3 devstack@n-api.service[119543]: Neutron server returns request_ids: ['req-1ecb5fb7-bc52-4f1e-9446-c0d94bbb6ab9'] {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:26:08.755138 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7a6b05b8-7bf3-4cd6-8ce6-f93785fa1641 tempest-SecurityGroupsNegativeTestJSON-268169294 tempest-SecurityGroupsNegativeTestJSON-268169294-project] 10.222.0.57 "PUT /compute/v2.1/os-security-groups/dc16582d-9762-4e0a-babd-1f9937c086fd" status: 404 len: 194 microversion: 2.1 time: 0.397726 Jul 18 02:26:08.760169 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1417/2833] 10.222.0.57 () {60 vars in 1289 bytes} [Mon Jul 18 02:26:08 2022] PUT /compute/v2.1/os-security-groups/dc16582d-9762-4e0a-babd-1f9937c086fd => generated 194 bytes in 413 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:26:09.004831 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d97a4d84-9035-46f7-8475-82805e58ae78 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:09.006755 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d97a4d84-9035-46f7-8475-82805e58ae78 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:09.044808 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d97a4d84-9035-46f7-8475-82805e58ae78 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:09.052411 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d97a4d84-9035-46f7-8475-82805e58ae78 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:09.054681 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d97a4d84-9035-46f7-8475-82805e58ae78 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:09.062393 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d97a4d84-9035-46f7-8475-82805e58ae78 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:09.751219 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7afb80f3-e14b-410a-85bf-2465516ab5f9 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:09.783750 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7afb80f3-e14b-410a-85bf-2465516ab5f9 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1507 microversion: 2.1 time: 1.409293 Jul 18 02:26:09.786521 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1417/2834] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:08 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1507 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:26:09.983340 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d97a4d84-9035-46f7-8475-82805e58ae78 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:10.008778 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d97a4d84-9035-46f7-8475-82805e58ae78 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1378 microversion: 2.1 time: 1.011444 Jul 18 02:26:10.010256 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1418/2835] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:08 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1378 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:10.827578 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c95f9b5f-1f35-4b15-9c58-33df0539f46b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:10.829684 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c95f9b5f-1f35-4b15-9c58-33df0539f46b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:10.841502 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c95f9b5f-1f35-4b15-9c58-33df0539f46b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:10.843807 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c95f9b5f-1f35-4b15-9c58-33df0539f46b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:10.849995 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c95f9b5f-1f35-4b15-9c58-33df0539f46b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:10.851981 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c95f9b5f-1f35-4b15-9c58-33df0539f46b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:11.038442 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e70fffde-7019-4a9f-949f-d0e2baa8e4a0 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:11.044196 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e70fffde-7019-4a9f-949f-d0e2baa8e4a0 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:11.084187 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e70fffde-7019-4a9f-949f-d0e2baa8e4a0 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:11.084653 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e70fffde-7019-4a9f-949f-d0e2baa8e4a0 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:11.091700 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e70fffde-7019-4a9f-949f-d0e2baa8e4a0 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:11.092221 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e70fffde-7019-4a9f-949f-d0e2baa8e4a0 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:12.785979 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c95f9b5f-1f35-4b15-9c58-33df0539f46b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:12.805477 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c95f9b5f-1f35-4b15-9c58-33df0539f46b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1507 microversion: 2.1 time: 2.006903 Jul 18 02:26:12.814341 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1418/2836] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:10 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1507 bytes in 2017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:12.894258 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e70fffde-7019-4a9f-949f-d0e2baa8e4a0 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:12.909757 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=71 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:26:12.945968 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e70fffde-7019-4a9f-949f-d0e2baa8e4a0 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1378 microversion: 2.1 time: 1.912278 Jul 18 02:26:12.955958 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1419/2837] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:11 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1378 bytes in 1923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:13.838422 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ecbb5b58-f8c5-4dec-84fe-a326eb218ef8 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:13.848242 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ecbb5b58-f8c5-4dec-84fe-a326eb218ef8 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:13.933578 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ecbb5b58-f8c5-4dec-84fe-a326eb218ef8 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:13.937911 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ecbb5b58-f8c5-4dec-84fe-a326eb218ef8 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:13.946738 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ecbb5b58-f8c5-4dec-84fe-a326eb218ef8 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:13.950545 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ecbb5b58-f8c5-4dec-84fe-a326eb218ef8 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:13.979170 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3ced9cda-e158-4fbb-be09-816c563cd081 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:13.985169 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3ced9cda-e158-4fbb-be09-816c563cd081 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:14.032249 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=26 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:26:14.044845 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3ced9cda-e158-4fbb-be09-816c563cd081 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:14.047981 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3ced9cda-e158-4fbb-be09-816c563cd081 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:14.049474 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3ced9cda-e158-4fbb-be09-816c563cd081 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:14.059377 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3ced9cda-e158-4fbb-be09-816c563cd081 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:14.992279 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ecbb5b58-f8c5-4dec-84fe-a326eb218ef8 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:15.006335 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ecbb5b58-f8c5-4dec-84fe-a326eb218ef8 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1507 microversion: 2.1 time: 1.177952 Jul 18 02:26:15.009848 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1419/2838] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:13 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1507 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:15.102232 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3ced9cda-e158-4fbb-be09-816c563cd081 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:15.117040 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3ced9cda-e158-4fbb-be09-816c563cd081 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1378 microversion: 2.1 time: 1.147007 Jul 18 02:26:15.129401 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1420/2839] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:13 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1378 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:26:16.040638 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-18c15aa2-a78b-4371-868e-3f2c92f68870 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:16.042080 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-18c15aa2-a78b-4371-868e-3f2c92f68870 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:16.060159 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-18c15aa2-a78b-4371-868e-3f2c92f68870 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:16.060884 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-18c15aa2-a78b-4371-868e-3f2c92f68870 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:16.061949 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-18c15aa2-a78b-4371-868e-3f2c92f68870 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:16.064250 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-18c15aa2-a78b-4371-868e-3f2c92f68870 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:16.136154 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ab622396-7e19-4042-bdfc-d8a22a2a10d0 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:16.138070 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ab622396-7e19-4042-bdfc-d8a22a2a10d0 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:16.148754 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ab622396-7e19-4042-bdfc-d8a22a2a10d0 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:16.158543 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ab622396-7e19-4042-bdfc-d8a22a2a10d0 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:16.159743 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ab622396-7e19-4042-bdfc-d8a22a2a10d0 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:16.160399 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ab622396-7e19-4042-bdfc-d8a22a2a10d0 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:17.149014 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-18c15aa2-a78b-4371-868e-3f2c92f68870 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:17.176182 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-18c15aa2-a78b-4371-868e-3f2c92f68870 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1507 microversion: 2.1 time: 1.139046 Jul 18 02:26:17.178413 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1420/2840] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:16 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1507 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:26:17.205108 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-ba7ff5b3-a1ea-4d46-bf27-354a6cdbb28d req-ce11546b-57a7-45f1-8a44-6b990629d5ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d", "name": "network-vif-plugged", "status": "completed", "tag": "34d35bd1-0f8c-4049-9360-7f9c95f734d8"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:26:17.231021 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ab622396-7e19-4042-bdfc-d8a22a2a10d0 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:17.250327 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-ba7ff5b3-a1ea-4d46-bf27-354a6cdbb28d req-ce11546b-57a7-45f1-8a44-6b990629d5ce service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:17.251917 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-ba7ff5b3-a1ea-4d46-bf27-354a6cdbb28d req-ce11546b-57a7-45f1-8a44-6b990629d5ce service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:17.296575 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ab622396-7e19-4042-bdfc-d8a22a2a10d0 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1378 microversion: 2.1 time: 1.157361 Jul 18 02:26:17.302039 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1421/2841] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:16 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1378 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:17.322761 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-ba7ff5b3-a1ea-4d46-bf27-354a6cdbb28d req-ce11546b-57a7-45f1-8a44-6b990629d5ce service nova] Creating event network-vif-plugged:34d35bd1-0f8c-4049-9360-7f9c95f734d8 for instance a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d on n-h1-465891-3 Jul 18 02:26:17.338974 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-ba7ff5b3-a1ea-4d46-bf27-354a6cdbb28d req-ce11546b-57a7-45f1-8a44-6b990629d5ce service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150631 Jul 18 02:26:17.342313 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1421/2842] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:26:18.211065 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-497c95bc-0b1d-40d3-8516-ff149836c40f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:18.215707 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-497c95bc-0b1d-40d3-8516-ff149836c40f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:18.243412 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-497c95bc-0b1d-40d3-8516-ff149836c40f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:18.244443 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-497c95bc-0b1d-40d3-8516-ff149836c40f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:18.245622 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-497c95bc-0b1d-40d3-8516-ff149836c40f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:18.258417 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-497c95bc-0b1d-40d3-8516-ff149836c40f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:18.345801 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cc0fe6a0-4cdf-48e2-8dca-9a3b15666f26 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:18.356429 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cc0fe6a0-4cdf-48e2-8dca-9a3b15666f26 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:18.428473 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cc0fe6a0-4cdf-48e2-8dca-9a3b15666f26 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:18.438406 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cc0fe6a0-4cdf-48e2-8dca-9a3b15666f26 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.048s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:18.439888 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cc0fe6a0-4cdf-48e2-8dca-9a3b15666f26 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:18.440663 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cc0fe6a0-4cdf-48e2-8dca-9a3b15666f26 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:19.155812 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-497c95bc-0b1d-40d3-8516-ff149836c40f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:19.172256 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-cc0fe6a0-4cdf-48e2-8dca-9a3b15666f26 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:19.177130 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-497c95bc-0b1d-40d3-8516-ff149836c40f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1507 microversion: 2.1 time: 0.973889 Jul 18 02:26:19.181327 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1422/2843] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:18 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1507 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:26:19.196017 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cc0fe6a0-4cdf-48e2-8dca-9a3b15666f26 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1378 microversion: 2.1 time: 0.860644 Jul 18 02:26:19.196669 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1422/2844] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:18 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1378 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:20.206575 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-57c2f704-0442-4402-84ff-29c59a97b570 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:20.207412 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-57c2f704-0442-4402-84ff-29c59a97b570 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:20.220813 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3224e727-945d-4ad9-a50b-5455491a7a85 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:20.222839 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3224e727-945d-4ad9-a50b-5455491a7a85 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:20.223078 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-57c2f704-0442-4402-84ff-29c59a97b570 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:20.226429 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-57c2f704-0442-4402-84ff-29c59a97b570 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:20.228596 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-57c2f704-0442-4402-84ff-29c59a97b570 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:20.229113 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-57c2f704-0442-4402-84ff-29c59a97b570 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:20.254712 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3224e727-945d-4ad9-a50b-5455491a7a85 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:20.258835 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3224e727-945d-4ad9-a50b-5455491a7a85 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:20.263512 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3224e727-945d-4ad9-a50b-5455491a7a85 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:20.265278 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3224e727-945d-4ad9-a50b-5455491a7a85 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:20.736683 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-57c2f704-0442-4402-84ff-29c59a97b570 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:20.745803 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-57c2f704-0442-4402-84ff-29c59a97b570 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1528 microversion: 2.1 time: 0.546567 Jul 18 02:26:20.764246 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1423/2845] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:20 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1528 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:20.986957 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3224e727-945d-4ad9-a50b-5455491a7a85 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:21.023321 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3224e727-945d-4ad9-a50b-5455491a7a85 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1527 microversion: 2.1 time: 0.809120 Jul 18 02:26:21.036000 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1423/2846] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:20 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1527 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:26:21.053317 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d9683068-c44b-4a69-a308-44385cb29cdb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:21.055704 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d9683068-c44b-4a69-a308-44385cb29cdb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:21.074000 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d9683068-c44b-4a69-a308-44385cb29cdb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:21.076383 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d9683068-c44b-4a69-a308-44385cb29cdb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:21.086368 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d9683068-c44b-4a69-a308-44385cb29cdb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:21.092555 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d9683068-c44b-4a69-a308-44385cb29cdb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:21.767458 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ac406117-fd06-4952-a061-cac28ec13ce3 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:21.770206 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ac406117-fd06-4952-a061-cac28ec13ce3 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:21.786965 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ac406117-fd06-4952-a061-cac28ec13ce3 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:21.790747 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ac406117-fd06-4952-a061-cac28ec13ce3 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:21.792138 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ac406117-fd06-4952-a061-cac28ec13ce3 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:21.794577 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ac406117-fd06-4952-a061-cac28ec13ce3 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:21.863104 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:26:22.577802 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d9683068-c44b-4a69-a308-44385cb29cdb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:22.589920 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d9683068-c44b-4a69-a308-44385cb29cdb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1527 microversion: 2.1 time: 1.547655 Jul 18 02:26:22.608679 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1424/2847] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:21 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1527 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:22.614130 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4d1991d8-4d73-4d67-a865-7c9ad76a8103 tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:22.617832 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:26:22.617832 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:26:22.658692 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4d1991d8-4d73-4d67-a865-7c9ad76a8103 tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/f528b215-231b-4db9-8b70-332311acf682" status: 202 len: 0 microversion: 2.1 time: 0.048080 Jul 18 02:26:22.659642 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1425/2848] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:26:22 2022] DELETE /compute/v2.1/flavors/f528b215-231b-4db9-8b70-332311acf682 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:26:22.668182 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-820d492f-e780-4d35-aa35-00b4e3d2f9a5 tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:22.724311 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-820d492f-e780-4d35-aa35-00b4e3d2f9a5 tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.060162 Jul 18 02:26:22.725620 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1426/2849] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:26:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:22.739988 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-45a54036-4791-47eb-92ef-95777b511262 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:26:22.742190 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-45a54036-4791-47eb-92ef-95777b511262 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:22.756038 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-45a54036-4791-47eb-92ef-95777b511262 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:22.756934 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-45a54036-4791-47eb-92ef-95777b511262 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:22.758193 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-45a54036-4791-47eb-92ef-95777b511262 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:22.758958 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-45a54036-4791-47eb-92ef-95777b511262 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:23.244121 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-45a54036-4791-47eb-92ef-95777b511262 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:23.265356 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-45a54036-4791-47eb-92ef-95777b511262 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Old instance type tempest-test_resize_flavor_-502945203, new instance type m1.heat {{(pid=119543) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 02:26:23.299760 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-45a54036-4791-47eb-92ef-95777b511262 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:26:23.300451 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-45a54036-4791-47eb-92ef-95777b511262 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:26:23.301257 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-45a54036-4791-47eb-92ef-95777b511262 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:26:23.302055 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-45a54036-4791-47eb-92ef-95777b511262 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:26:23.315985 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-45a54036-4791-47eb-92ef-95777b511262 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:26:23.348687 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ac406117-fd06-4952-a061-cac28ec13ce3 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:23.421014 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ac406117-fd06-4952-a061-cac28ec13ce3 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1523 microversion: 2.1 time: 1.659597 Jul 18 02:26:23.421637 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1424/2850] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:21 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1523 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:24.013191 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-45a54036-4791-47eb-92ef-95777b511262 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "POST /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d/action" status: 202 len: 0 microversion: 2.1 time: 1.276781 Jul 18 02:26:24.015466 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1427/2851] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:26:22 2022] POST /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d/action => generated 0 bytes in 1280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:26:24.027007 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0234d13f-d7ff-457f-adad-f027e4967343 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:24.027663 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0234d13f-d7ff-457f-adad-f027e4967343 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:24.049198 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0234d13f-d7ff-457f-adad-f027e4967343 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:24.050288 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0234d13f-d7ff-457f-adad-f027e4967343 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:24.054435 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0234d13f-d7ff-457f-adad-f027e4967343 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:24.055635 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0234d13f-d7ff-457f-adad-f027e4967343 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:24.460826 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-71b2944f-0a7c-49d4-addd-646766b9bc6b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:24.462569 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-71b2944f-0a7c-49d4-addd-646766b9bc6b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:24.509242 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-71b2944f-0a7c-49d4-addd-646766b9bc6b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:24.516389 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-71b2944f-0a7c-49d4-addd-646766b9bc6b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:24.518426 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-71b2944f-0a7c-49d4-addd-646766b9bc6b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:24.530542 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-71b2944f-0a7c-49d4-addd-646766b9bc6b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:26.432823 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0234d13f-d7ff-457f-adad-f027e4967343 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:26.446174 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0234d13f-d7ff-457f-adad-f027e4967343 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1536 microversion: 2.1 time: 2.422364 Jul 18 02:26:26.459992 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1425/2852] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:24 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1536 bytes in 2426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:26.459992 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-3f37ef38-f7fa-4462-8d5b-cf2eec33e085 req-a8e949e6-6c52-460f-9c32-aac64d95bfd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "637aab54-71a9-4233-85ad-7d1e785b9e9c", "name": "network-vif-plugged", "status": "completed", "tag": "747e8487-8d62-41a3-94d1-1c3cf951db53"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:26:26.477333 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-3f37ef38-f7fa-4462-8d5b-cf2eec33e085 req-a8e949e6-6c52-460f-9c32-aac64d95bfd4 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:26.482040 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-3f37ef38-f7fa-4462-8d5b-cf2eec33e085 req-a8e949e6-6c52-460f-9c32-aac64d95bfd4 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:26.507824 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-3f37ef38-f7fa-4462-8d5b-cf2eec33e085 req-a8e949e6-6c52-460f-9c32-aac64d95bfd4 service nova] Creating event network-vif-plugged:747e8487-8d62-41a3-94d1-1c3cf951db53 for instance 637aab54-71a9-4233-85ad-7d1e785b9e9c on n-h2-465891-3 Jul 18 02:26:26.521433 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-3f37ef38-f7fa-4462-8d5b-cf2eec33e085 req-a8e949e6-6c52-460f-9c32-aac64d95bfd4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071431 Jul 18 02:26:26.523243 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1426/2853] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:26:26.624861 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-71b2944f-0a7c-49d4-addd-646766b9bc6b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:26.646420 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-71b2944f-0a7c-49d4-addd-646766b9bc6b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1523 microversion: 2.1 time: 2.199827 Jul 18 02:26:26.648025 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1428/2854] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:24 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1523 bytes in 2203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:27.480479 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-74b6999d-f504-465a-9a02-e86db88f877a tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:27.482144 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-74b6999d-f504-465a-9a02-e86db88f877a tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:27.520658 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74b6999d-f504-465a-9a02-e86db88f877a tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:27.526134 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74b6999d-f504-465a-9a02-e86db88f877a tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:27.530994 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74b6999d-f504-465a-9a02-e86db88f877a tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:27.531299 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74b6999d-f504-465a-9a02-e86db88f877a tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:27.665886 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3b3e2166-6f26-42f0-be0e-c629077bd227 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:27.669574 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3b3e2166-6f26-42f0-be0e-c629077bd227 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:27.680756 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3b3e2166-6f26-42f0-be0e-c629077bd227 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:27.681203 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3b3e2166-6f26-42f0-be0e-c629077bd227 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:27.682043 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3b3e2166-6f26-42f0-be0e-c629077bd227 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:27.691449 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3b3e2166-6f26-42f0-be0e-c629077bd227 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:28.523572 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3b3e2166-6f26-42f0-be0e-c629077bd227 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:28.539033 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3b3e2166-6f26-42f0-be0e-c629077bd227 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1523 microversion: 2.1 time: 0.877093 Jul 18 02:26:28.545538 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1429/2855] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:27 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1523 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:28.549450 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-74b6999d-f504-465a-9a02-e86db88f877a tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:28.571281 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-74b6999d-f504-465a-9a02-e86db88f877a tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1536 microversion: 2.1 time: 1.095093 Jul 18 02:26:28.571936 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1427/2856] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:27 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1536 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:26:29.598610 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4422bd27-6487-4a99-824f-249a31c92a60 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:29.600536 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4422bd27-6487-4a99-824f-249a31c92a60 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:29.605456 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-47db9275-326a-42ab-9b66-45f3194e1f9f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:29.606731 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-47db9275-326a-42ab-9b66-45f3194e1f9f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:29.618696 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4422bd27-6487-4a99-824f-249a31c92a60 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:29.622265 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-47db9275-326a-42ab-9b66-45f3194e1f9f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:29.622839 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-47db9275-326a-42ab-9b66-45f3194e1f9f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:29.623458 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4422bd27-6487-4a99-824f-249a31c92a60 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:29.623664 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-47db9275-326a-42ab-9b66-45f3194e1f9f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:29.624115 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-47db9275-326a-42ab-9b66-45f3194e1f9f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:29.626876 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4422bd27-6487-4a99-824f-249a31c92a60 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:29.627871 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4422bd27-6487-4a99-824f-249a31c92a60 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:30.334366 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4422bd27-6487-4a99-824f-249a31c92a60 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:30.393594 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4422bd27-6487-4a99-824f-249a31c92a60 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1523 microversion: 2.1 time: 0.816663 Jul 18 02:26:30.393594 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1430/2857] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:29 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1523 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:30.399957 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-47db9275-326a-42ab-9b66-45f3194e1f9f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:30.434445 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-47db9275-326a-42ab-9b66-45f3194e1f9f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1536 microversion: 2.1 time: 0.832782 Jul 18 02:26:30.461874 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1428/2858] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:29 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1536 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:31.440319 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-09fc8ad0-caee-4772-ab41-cb5a173eaebc tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:31.444839 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-09fc8ad0-caee-4772-ab41-cb5a173eaebc tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:31.489208 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-925c0b72-f187-4019-9659-04829b3c66de tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:31.492453 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-925c0b72-f187-4019-9659-04829b3c66de tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:31.504765 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-09fc8ad0-caee-4772-ab41-cb5a173eaebc tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:31.512018 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-09fc8ad0-caee-4772-ab41-cb5a173eaebc tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:31.520471 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-09fc8ad0-caee-4772-ab41-cb5a173eaebc tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:31.522516 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-09fc8ad0-caee-4772-ab41-cb5a173eaebc tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:31.546708 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-925c0b72-f187-4019-9659-04829b3c66de tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:31.557196 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-925c0b72-f187-4019-9659-04829b3c66de tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:31.559629 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-925c0b72-f187-4019-9659-04829b3c66de tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:31.565260 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-925c0b72-f187-4019-9659-04829b3c66de tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:33.302688 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-925c0b72-f187-4019-9659-04829b3c66de tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:33.354461 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-925c0b72-f187-4019-9659-04829b3c66de tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1536 microversion: 2.1 time: 1.880262 Jul 18 02:26:33.355877 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1429/2859] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:31 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1536 bytes in 1883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:33.385170 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-09fc8ad0-caee-4772-ab41-cb5a173eaebc tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:33.403986 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-09fc8ad0-caee-4772-ab41-cb5a173eaebc tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1523 microversion: 2.1 time: 1.982610 Jul 18 02:26:33.435121 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1431/2860] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:31 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1523 bytes in 2015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:34.372611 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8bda87d9-492c-40ea-baa6-94df94de7e1c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:34.374086 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8bda87d9-492c-40ea-baa6-94df94de7e1c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:34.389663 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8bda87d9-492c-40ea-baa6-94df94de7e1c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:34.395501 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8bda87d9-492c-40ea-baa6-94df94de7e1c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:34.396977 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8bda87d9-492c-40ea-baa6-94df94de7e1c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:34.399545 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8bda87d9-492c-40ea-baa6-94df94de7e1c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:34.444246 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2b2e64fb-5495-4a78-bb7e-38a425864ee5 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:34.445029 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2b2e64fb-5495-4a78-bb7e-38a425864ee5 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:34.454757 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b2e64fb-5495-4a78-bb7e-38a425864ee5 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:34.470599 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b2e64fb-5495-4a78-bb7e-38a425864ee5 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:34.472735 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b2e64fb-5495-4a78-bb7e-38a425864ee5 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:34.473761 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b2e64fb-5495-4a78-bb7e-38a425864ee5 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:35.399155 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8bda87d9-492c-40ea-baa6-94df94de7e1c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:35.448613 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8bda87d9-492c-40ea-baa6-94df94de7e1c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1536 microversion: 2.1 time: 1.079546 Jul 18 02:26:35.450269 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1430/2861] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:34 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1536 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:35.589753 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2b2e64fb-5495-4a78-bb7e-38a425864ee5 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:35.621513 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2b2e64fb-5495-4a78-bb7e-38a425864ee5 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1523 microversion: 2.1 time: 1.182601 Jul 18 02:26:35.658372 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1432/2862] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:34 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1523 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:26:36.484305 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-18ef2291-1ec3-4e72-852f-ea7b5735ea5b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:36.491287 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-18ef2291-1ec3-4e72-852f-ea7b5735ea5b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:36.552923 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-18ef2291-1ec3-4e72-852f-ea7b5735ea5b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:36.554454 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-18ef2291-1ec3-4e72-852f-ea7b5735ea5b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:36.556431 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-18ef2291-1ec3-4e72-852f-ea7b5735ea5b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:36.569319 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-18ef2291-1ec3-4e72-852f-ea7b5735ea5b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:36.665853 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-89019729-86f0-4983-adef-edcd2b87af78 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:36.674569 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-89019729-86f0-4983-adef-edcd2b87af78 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:36.710311 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-89019729-86f0-4983-adef-edcd2b87af78 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:36.717898 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-89019729-86f0-4983-adef-edcd2b87af78 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:36.719982 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-89019729-86f0-4983-adef-edcd2b87af78 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:36.727141 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-89019729-86f0-4983-adef-edcd2b87af78 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:37.600557 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-18ef2291-1ec3-4e72-852f-ea7b5735ea5b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:37.617243 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-18ef2291-1ec3-4e72-852f-ea7b5735ea5b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1541 microversion: 2.1 time: 1.143579 Jul 18 02:26:37.618367 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1431/2863] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:36 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1541 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:37.744113 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-89019729-86f0-4983-adef-edcd2b87af78 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:37.758443 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-89019729-86f0-4983-adef-edcd2b87af78 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1523 microversion: 2.1 time: 1.106279 Jul 18 02:26:37.772399 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1433/2864] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:36 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1523 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:38.640281 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7edce19c-e9ae-42c6-a5d0-0b045c32a81e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:38.641556 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7edce19c-e9ae-42c6-a5d0-0b045c32a81e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:38.647170 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=32 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:26:38.685326 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7edce19c-e9ae-42c6-a5d0-0b045c32a81e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:38.707603 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7edce19c-e9ae-42c6-a5d0-0b045c32a81e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:38.708631 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7edce19c-e9ae-42c6-a5d0-0b045c32a81e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:38.709367 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7edce19c-e9ae-42c6-a5d0-0b045c32a81e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:38.779189 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-215e2bae-bab8-4332-9794-eaf57076f1e5 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:38.781473 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-215e2bae-bab8-4332-9794-eaf57076f1e5 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:38.814246 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-215e2bae-bab8-4332-9794-eaf57076f1e5 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:38.815504 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-215e2bae-bab8-4332-9794-eaf57076f1e5 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:38.816631 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-215e2bae-bab8-4332-9794-eaf57076f1e5 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:38.817094 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-215e2bae-bab8-4332-9794-eaf57076f1e5 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:39.351878 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7edce19c-e9ae-42c6-a5d0-0b045c32a81e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:39.364890 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7edce19c-e9ae-42c6-a5d0-0b045c32a81e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1541 microversion: 2.1 time: 0.732640 Jul 18 02:26:39.380730 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1432/2865] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:38 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1541 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:40.390411 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a19b8cb5-f6ef-4d77-8519-5ae0c3359354 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:40.400676 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a19b8cb5-f6ef-4d77-8519-5ae0c3359354 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:40.459625 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a19b8cb5-f6ef-4d77-8519-5ae0c3359354 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:40.477293 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-215e2bae-bab8-4332-9794-eaf57076f1e5 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:40.490810 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a19b8cb5-f6ef-4d77-8519-5ae0c3359354 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:40.520962 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a19b8cb5-f6ef-4d77-8519-5ae0c3359354 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:40.527310 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a19b8cb5-f6ef-4d77-8519-5ae0c3359354 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:40.583347 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-215e2bae-bab8-4332-9794-eaf57076f1e5 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1523 microversion: 2.1 time: 1.807446 Jul 18 02:26:40.593838 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1434/2866] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:38 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1523 bytes in 1819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:41.531899 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a19b8cb5-f6ef-4d77-8519-5ae0c3359354 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:41.548506 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a19b8cb5-f6ef-4d77-8519-5ae0c3359354 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1541 microversion: 2.1 time: 1.166987 Jul 18 02:26:41.559330 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1433/2867] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:40 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1541 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:41.608320 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f06c679c-8a42-4c1c-a950-d2550e1849a3 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:41.609532 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f06c679c-8a42-4c1c-a950-d2550e1849a3 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:41.628771 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f06c679c-8a42-4c1c-a950-d2550e1849a3 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:41.630900 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f06c679c-8a42-4c1c-a950-d2550e1849a3 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:41.632686 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f06c679c-8a42-4c1c-a950-d2550e1849a3 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:41.633809 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f06c679c-8a42-4c1c-a950-d2550e1849a3 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:42.589062 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6a1b7987-355b-475f-bea0-ea1e9065124e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:42.590360 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6a1b7987-355b-475f-bea0-ea1e9065124e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:42.630925 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6a1b7987-355b-475f-bea0-ea1e9065124e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:42.630925 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6a1b7987-355b-475f-bea0-ea1e9065124e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:42.630925 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6a1b7987-355b-475f-bea0-ea1e9065124e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:42.630925 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6a1b7987-355b-475f-bea0-ea1e9065124e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:43.668005 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f06c679c-8a42-4c1c-a950-d2550e1849a3 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:43.698547 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f06c679c-8a42-4c1c-a950-d2550e1849a3 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1523 microversion: 2.1 time: 2.097291 Jul 18 02:26:43.699905 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1435/2868] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:41 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1523 bytes in 2100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:43.710678 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6a1b7987-355b-475f-bea0-ea1e9065124e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:43.742841 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6a1b7987-355b-475f-bea0-ea1e9065124e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1541 microversion: 2.1 time: 1.161622 Jul 18 02:26:43.747865 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1434/2869] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:42 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1541 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:44.722778 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d55b61ec-c524-4072-8260-e947178b087f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:44.727067 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d55b61ec-c524-4072-8260-e947178b087f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:44.733883 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:26:44.751579 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d55b61ec-c524-4072-8260-e947178b087f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:44.753099 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d55b61ec-c524-4072-8260-e947178b087f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:44.755612 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d55b61ec-c524-4072-8260-e947178b087f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:44.758140 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d55b61ec-c524-4072-8260-e947178b087f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:44.783189 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4ff3565e-074f-471f-8c61-c6307eafc4cd tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:44.789487 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4ff3565e-074f-471f-8c61-c6307eafc4cd tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:44.871416 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4ff3565e-074f-471f-8c61-c6307eafc4cd tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:44.871996 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4ff3565e-074f-471f-8c61-c6307eafc4cd tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:44.883282 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4ff3565e-074f-471f-8c61-c6307eafc4cd tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:44.884069 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4ff3565e-074f-471f-8c61-c6307eafc4cd tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:44.969997 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:26:46.259999 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d55b61ec-c524-4072-8260-e947178b087f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:46.279233 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d55b61ec-c524-4072-8260-e947178b087f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1523 microversion: 2.1 time: 1.563068 Jul 18 02:26:46.287885 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1436/2870] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:44 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1523 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:46.874681 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4ff3565e-074f-471f-8c61-c6307eafc4cd tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:46.925413 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4ff3565e-074f-471f-8c61-c6307eafc4cd tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1541 microversion: 2.1 time: 2.159360 Jul 18 02:26:46.926844 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1435/2871] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:44 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1541 bytes in 2166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:47.307919 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4a1cdd0e-61ab-4d73-a324-95dca66f7504 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:47.310407 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4a1cdd0e-61ab-4d73-a324-95dca66f7504 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:47.330273 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4a1cdd0e-61ab-4d73-a324-95dca66f7504 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:47.339306 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4a1cdd0e-61ab-4d73-a324-95dca66f7504 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:47.341636 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4a1cdd0e-61ab-4d73-a324-95dca66f7504 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:47.343017 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4a1cdd0e-61ab-4d73-a324-95dca66f7504 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:47.960239 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b9c59fe6-caab-451a-8b46-58aa293f77a6 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:47.976405 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b9c59fe6-caab-451a-8b46-58aa293f77a6 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:48.034389 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b9c59fe6-caab-451a-8b46-58aa293f77a6 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:48.035263 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b9c59fe6-caab-451a-8b46-58aa293f77a6 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:48.046227 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b9c59fe6-caab-451a-8b46-58aa293f77a6 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:48.066282 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b9c59fe6-caab-451a-8b46-58aa293f77a6 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:48.149188 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4a1cdd0e-61ab-4d73-a324-95dca66f7504 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:48.158083 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4a1cdd0e-61ab-4d73-a324-95dca66f7504 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1523 microversion: 2.1 time: 0.862758 Jul 18 02:26:48.169987 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1437/2872] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:47 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1523 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:48.575201 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b9c59fe6-caab-451a-8b46-58aa293f77a6 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:48.595821 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b9c59fe6-caab-451a-8b46-58aa293f77a6 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1541 microversion: 2.1 time: 0.645291 Jul 18 02:26:48.607282 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1436/2873] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:47 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1541 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:26:49.194743 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5727e2b9-a1e0-4e41-90e9-ae4490a280de tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:49.197396 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5727e2b9-a1e0-4e41-90e9-ae4490a280de tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:49.231315 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5727e2b9-a1e0-4e41-90e9-ae4490a280de tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:49.232805 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5727e2b9-a1e0-4e41-90e9-ae4490a280de tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:49.234673 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5727e2b9-a1e0-4e41-90e9-ae4490a280de tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:49.235861 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5727e2b9-a1e0-4e41-90e9-ae4490a280de tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:49.620389 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3ff08ef0-589d-4c3e-b4e7-d0316cd146d4 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:49.622247 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3ff08ef0-589d-4c3e-b4e7-d0316cd146d4 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:49.640475 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3ff08ef0-589d-4c3e-b4e7-d0316cd146d4 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:49.641837 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3ff08ef0-589d-4c3e-b4e7-d0316cd146d4 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:49.643686 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3ff08ef0-589d-4c3e-b4e7-d0316cd146d4 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:49.644835 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3ff08ef0-589d-4c3e-b4e7-d0316cd146d4 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:50.027874 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5727e2b9-a1e0-4e41-90e9-ae4490a280de tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:50.106254 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5727e2b9-a1e0-4e41-90e9-ae4490a280de tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1523 microversion: 2.1 time: 0.921325 Jul 18 02:26:50.126081 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1438/2874] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:49 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1523 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:50.969607 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3ff08ef0-589d-4c3e-b4e7-d0316cd146d4 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:51.011629 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3ff08ef0-589d-4c3e-b4e7-d0316cd146d4 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1541 microversion: 2.1 time: 1.390433 Jul 18 02:26:51.014100 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1437/2875] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:49 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1541 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:26:51.148200 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-40d8bf0f-252d-4be7-9b20-57e740717124 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:51.149330 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-40d8bf0f-252d-4be7-9b20-57e740717124 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:51.185602 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-40d8bf0f-252d-4be7-9b20-57e740717124 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:51.186456 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-40d8bf0f-252d-4be7-9b20-57e740717124 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:51.194002 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-40d8bf0f-252d-4be7-9b20-57e740717124 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:51.197095 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-40d8bf0f-252d-4be7-9b20-57e740717124 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:52.280170 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-eb80ae53-8349-416f-9b04-6b4715f46eb5 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-677204747", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "52703084-40e7-4a52-ac89-7f5781ece06d"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:26:52.477378 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-eb80ae53-8349-416f-9b04-6b4715f46eb5 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] validate_networks() for [('52703084-40e7-4a52-ac89-7f5781ece06d', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:26:52.659394 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-40d8bf0f-252d-4be7-9b20-57e740717124 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:52.674635 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-40d8bf0f-252d-4be7-9b20-57e740717124 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1523 microversion: 2.1 time: 1.535136 Jul 18 02:26:52.683118 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1439/2876] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:51 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1523 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:52.703206 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-131fd3db-1e83-4b90-8cf3-628828500cd5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:52.711274 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-131fd3db-1e83-4b90-8cf3-628828500cd5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:52.731129 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-131fd3db-1e83-4b90-8cf3-628828500cd5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:52.731744 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-131fd3db-1e83-4b90-8cf3-628828500cd5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:52.732906 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-131fd3db-1e83-4b90-8cf3-628828500cd5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:52.735383 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-131fd3db-1e83-4b90-8cf3-628828500cd5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:53.544173 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-131fd3db-1e83-4b90-8cf3-628828500cd5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:53.650088 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-131fd3db-1e83-4b90-8cf3-628828500cd5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1541 microversion: 2.1 time: 0.963629 Jul 18 02:26:53.661081 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1440/2877] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:52 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1541 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:53.762067 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5d3d884b-c484-4e01-8f83-a2ec3bbad8ac tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:53.766884 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5d3d884b-c484-4e01-8f83-a2ec3bbad8ac tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:53.804301 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5d3d884b-c484-4e01-8f83-a2ec3bbad8ac tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:53.810605 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5d3d884b-c484-4e01-8f83-a2ec3bbad8ac tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:53.814545 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5d3d884b-c484-4e01-8f83-a2ec3bbad8ac tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:53.820577 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5d3d884b-c484-4e01-8f83-a2ec3bbad8ac tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:56.566770 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-eb80ae53-8349-416f-9b04-6b4715f46eb5 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:26:56.567574 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-eb80ae53-8349-416f-9b04-6b4715f46eb5 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:26:56.567769 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-eb80ae53-8349-416f-9b04-6b4715f46eb5 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:26:56.571641 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-eb80ae53-8349-416f-9b04-6b4715f46eb5 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:26:56.574361 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-eb80ae53-8349-416f-9b04-6b4715f46eb5 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:26:56.597024 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eb80ae53-8349-416f-9b04-6b4715f46eb5 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:56.597484 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eb80ae53-8349-416f-9b04-6b4715f46eb5 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:56.598380 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eb80ae53-8349-416f-9b04-6b4715f46eb5 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:56.598846 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eb80ae53-8349-416f-9b04-6b4715f46eb5 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:56.623624 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=80 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:26:56.648200 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-eb80ae53-8349-416f-9b04-6b4715f46eb5 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Getting quotas for project d65cd308906048719f3c79e73bdfa921. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:26:56.661096 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-eb80ae53-8349-416f-9b04-6b4715f46eb5 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Getting quotas for user 9f11a308e70d4303a66ad8aaa9338961 and project d65cd308906048719f3c79e73bdfa921. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:26:56.698995 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-eb80ae53-8349-416f-9b04-6b4715f46eb5 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Going to run 2 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:26:56.703313 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-eb80ae53-8349-416f-9b04-6b4715f46eb5 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: 7c0f69bd-6236-4b98-a759-4b3c2a39ca6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:26:56.796390 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-eb80ae53-8349-416f-9b04-6b4715f46eb5 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: 47e54256-b283-406c-80e8-cbf2622a1c9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=7c0f69bd-6236-4b98-a759-4b3c2a39ca6e,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:26:56.864083 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5d3d884b-c484-4e01-8f83-a2ec3bbad8ac tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:56.893825 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5d3d884b-c484-4e01-8f83-a2ec3bbad8ac tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1523 microversion: 2.1 time: 3.173838 Jul 18 02:26:56.906295 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1441/2878] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:53 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1523 bytes in 3188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:56.916347 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-89430c33-f701-4014-8fec-2b3c80a7f24c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:56.918253 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-89430c33-f701-4014-8fec-2b3c80a7f24c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:56.933520 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-89430c33-f701-4014-8fec-2b3c80a7f24c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:56.934855 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-89430c33-f701-4014-8fec-2b3c80a7f24c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:56.936542 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-89430c33-f701-4014-8fec-2b3c80a7f24c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:56.937655 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-89430c33-f701-4014-8fec-2b3c80a7f24c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:57.043254 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-eb80ae53-8349-416f-9b04-6b4715f46eb5 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.760107 Jul 18 02:26:57.051841 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1438/2879] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:26:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 5772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:26:57.064784 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-4150508b-ab43-4c85-9f47-f2ca8b6b1932 req-fe128f0e-4200-4c98-a0e3-e1f7d2a3f314 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d", "name": "network-vif-unplugged", "status": "completed", "tag": "34d35bd1-0f8c-4049-9360-7f9c95f734d8"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:26:57.126609 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-4150508b-ab43-4c85-9f47-f2ca8b6b1932 req-fe128f0e-4200-4c98-a0e3-e1f7d2a3f314 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:57.127319 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-4150508b-ab43-4c85-9f47-f2ca8b6b1932 req-fe128f0e-4200-4c98-a0e3-e1f7d2a3f314 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:57.173563 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-4150508b-ab43-4c85-9f47-f2ca8b6b1932 req-fe128f0e-4200-4c98-a0e3-e1f7d2a3f314 service nova] Creating event network-vif-unplugged:34d35bd1-0f8c-4049-9360-7f9c95f734d8 for instance a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d on n-h1-465891-3 Jul 18 02:26:57.201026 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [req-4150508b-ab43-4c85-9f47-f2ca8b6b1932 req-fe128f0e-4200-4c98-a0e3-e1f7d2a3f314 service nova] Instance a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3'} {{(pid=119544) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 02:26:57.229979 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-4150508b-ab43-4c85-9f47-f2ca8b6b1932 req-fe128f0e-4200-4c98-a0e3-e1f7d2a3f314 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.173802 Jul 18 02:26:57.233754 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1439/2880] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:26:57.248882 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a1f6923f-0990-49d7-a1aa-d10e06715904 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:57.263593 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a1f6923f-0990-49d7-a1aa-d10e06715904 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9f11a308e70d4303a66ad8aaa9338961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65cd308906048719f3c79e73bdfa921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:57.267325 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a1f6923f-0990-49d7-a1aa-d10e06715904 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Searching by: {'deleted': False, 'project_id': 'd65cd308906048719f3c79e73bdfa921'} {{(pid=119544) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:26:57.348055 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a1f6923f-0990-49d7-a1aa-d10e06715904 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:57.354556 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a1f6923f-0990-49d7-a1aa-d10e06715904 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:57.355923 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a1f6923f-0990-49d7-a1aa-d10e06715904 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:57.356878 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a1f6923f-0990-49d7-a1aa-d10e06715904 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:57.436018 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a1f6923f-0990-49d7-a1aa-d10e06715904 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.198168 Jul 18 02:26:57.438554 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1440/2881] 10.222.0.57 () {58 vars in 1124 bytes} [Mon Jul 18 02:26:57 2022] GET /compute/v2.1/servers => generated 675 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:26:57.464338 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3c6bf964-efac-4b48-8c0d-3592df7c6504 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:57.466359 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3c6bf964-efac-4b48-8c0d-3592df7c6504 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: 47e54256-b283-406c-80e8-cbf2622a1c9b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:58.045734 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3c6bf964-efac-4b48-8c0d-3592df7c6504 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11a308e70d4303a66ad8aaa9338961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65cd308906048719f3c79e73bdfa921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:58.074166 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3c6bf964-efac-4b48-8c0d-3592df7c6504 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "GET /compute/v2.1/servers/47e54256-b283-406c-80e8-cbf2622a1c9b" status: 200 len: 1219 microversion: 2.1 time: 0.627306 Jul 18 02:26:58.077014 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1441/2882] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:57 2022] GET /compute/v2.1/servers/47e54256-b283-406c-80e8-cbf2622a1c9b => generated 1219 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:58.092651 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-50fe344c-374a-4d4d-918c-72562698813b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:58.094338 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-50fe344c-374a-4d4d-918c-72562698813b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:58.112434 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-50fe344c-374a-4d4d-918c-72562698813b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:58.113534 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-50fe344c-374a-4d4d-918c-72562698813b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:58.115548 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-50fe344c-374a-4d4d-918c-72562698813b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:58.118982 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-50fe344c-374a-4d4d-918c-72562698813b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:58.529594 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-89430c33-f701-4014-8fec-2b3c80a7f24c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:58.579730 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-89430c33-f701-4014-8fec-2b3c80a7f24c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1540 microversion: 2.1 time: 1.669404 Jul 18 02:26:58.583813 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1442/2883] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:56 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1540 bytes in 1676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:59.102796 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ba109920-027c-426d-b1be-c13acf7f46b0 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:59.115797 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ba109920-027c-426d-b1be-c13acf7f46b0 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: 47e54256-b283-406c-80e8-cbf2622a1c9b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:00.188006 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ba109920-027c-426d-b1be-c13acf7f46b0 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11a308e70d4303a66ad8aaa9338961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65cd308906048719f3c79e73bdfa921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:00.221199 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ba109920-027c-426d-b1be-c13acf7f46b0 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "GET /compute/v2.1/servers/47e54256-b283-406c-80e8-cbf2622a1c9b" status: 200 len: 1219 microversion: 2.1 time: 1.129076 Jul 18 02:27:00.246389 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1443/2884] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:59 2022] GET /compute/v2.1/servers/47e54256-b283-406c-80e8-cbf2622a1c9b => generated 1219 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:00.255415 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-12bc03ef-498b-4629-9085-1c51006f5129 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:00.256714 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-12bc03ef-498b-4629-9085-1c51006f5129 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:00.299464 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-12bc03ef-498b-4629-9085-1c51006f5129 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:00.299997 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-12bc03ef-498b-4629-9085-1c51006f5129 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:00.300855 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-12bc03ef-498b-4629-9085-1c51006f5129 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:00.301361 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-12bc03ef-498b-4629-9085-1c51006f5129 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:00.612954 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-50fe344c-374a-4d4d-918c-72562698813b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:00.622599 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-50fe344c-374a-4d4d-918c-72562698813b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1505 microversion: 2.1 time: 2.541531 Jul 18 02:27:00.627399 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1442/2885] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:58 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1505 bytes in 2549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:00.641872 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-3a8d59cc-f9b0-4b27-b1b2-c8fff87f597d req-d8d1b1e6-9cc8-4691-9af1-441d67f3a54e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "637aab54-71a9-4233-85ad-7d1e785b9e9c", "name": "network-vif-unplugged", "status": "completed", "tag": "747e8487-8d62-41a3-94d1-1c3cf951db53"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:00.706641 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-3a8d59cc-f9b0-4b27-b1b2-c8fff87f597d req-d8d1b1e6-9cc8-4691-9af1-441d67f3a54e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:00.709312 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-3a8d59cc-f9b0-4b27-b1b2-c8fff87f597d req-d8d1b1e6-9cc8-4691-9af1-441d67f3a54e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:00.810238 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-3a8d59cc-f9b0-4b27-b1b2-c8fff87f597d req-d8d1b1e6-9cc8-4691-9af1-441d67f3a54e service nova] Creating event network-vif-unplugged:747e8487-8d62-41a3-94d1-1c3cf951db53 for instance 637aab54-71a9-4233-85ad-7d1e785b9e9c on n-h2-465891-3 Jul 18 02:27:00.849339 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-3a8d59cc-f9b0-4b27-b1b2-c8fff87f597d req-d8d1b1e6-9cc8-4691-9af1-441d67f3a54e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.213859 Jul 18 02:27:00.850553 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1443/2886] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:01.262322 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0f9320ce-3757-428c-b2ff-7875526e889e tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:01.263589 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0f9320ce-3757-428c-b2ff-7875526e889e tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: 47e54256-b283-406c-80e8-cbf2622a1c9b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:01.286338 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f9320ce-3757-428c-b2ff-7875526e889e tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:01.290908 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f9320ce-3757-428c-b2ff-7875526e889e tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:01.294100 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f9320ce-3757-428c-b2ff-7875526e889e tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:01.297599 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f9320ce-3757-428c-b2ff-7875526e889e tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:01.687941 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-12bc03ef-498b-4629-9085-1c51006f5129 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:01.699898 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-12bc03ef-498b-4629-9085-1c51006f5129 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1540 microversion: 2.1 time: 1.466492 Jul 18 02:27:01.702433 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1444/2887] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:00 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1540 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:01.708375 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-05bd4c22-9cc1-445e-b1d5-0b9d7ce21d25 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:01.709375 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-05bd4c22-9cc1-445e-b1d5-0b9d7ce21d25 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:01.718032 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-05bd4c22-9cc1-445e-b1d5-0b9d7ce21d25 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:01.718879 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-05bd4c22-9cc1-445e-b1d5-0b9d7ce21d25 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:01.720012 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-05bd4c22-9cc1-445e-b1d5-0b9d7ce21d25 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:01.720722 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-05bd4c22-9cc1-445e-b1d5-0b9d7ce21d25 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:01.825197 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0f9320ce-3757-428c-b2ff-7875526e889e tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11a308e70d4303a66ad8aaa9338961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65cd308906048719f3c79e73bdfa921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:01.842255 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0f9320ce-3757-428c-b2ff-7875526e889e tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "GET /compute/v2.1/servers/47e54256-b283-406c-80e8-cbf2622a1c9b" status: 200 len: 1289 microversion: 2.1 time: 0.585386 Jul 18 02:27:01.843494 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1444/2888] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:01 2022] GET /compute/v2.1/servers/47e54256-b283-406c-80e8-cbf2622a1c9b => generated 1289 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:02.736695 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e5bb99ce-4999-44db-8208-9cbc7b4ad8c7 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:02.738338 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e5bb99ce-4999-44db-8208-9cbc7b4ad8c7 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:02.756061 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e5bb99ce-4999-44db-8208-9cbc7b4ad8c7 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:02.757192 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e5bb99ce-4999-44db-8208-9cbc7b4ad8c7 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:02.760544 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e5bb99ce-4999-44db-8208-9cbc7b4ad8c7 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:02.761778 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e5bb99ce-4999-44db-8208-9cbc7b4ad8c7 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:03.260417 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-05bd4c22-9cc1-445e-b1d5-0b9d7ce21d25 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:03.272482 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-05bd4c22-9cc1-445e-b1d5-0b9d7ce21d25 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1505 microversion: 2.1 time: 1.568313 Jul 18 02:27:03.281979 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1445/2889] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:01 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1505 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:03.289028 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dda3ecb9-35d6-42d9-ab29-c25af09962c1 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:03.290271 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-dda3ecb9-35d6-42d9-ab29-c25af09962c1 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: 47e54256-b283-406c-80e8-cbf2622a1c9b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:03.307603 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dda3ecb9-35d6-42d9-ab29-c25af09962c1 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:03.308399 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dda3ecb9-35d6-42d9-ab29-c25af09962c1 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:03.309469 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dda3ecb9-35d6-42d9-ab29-c25af09962c1 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:03.310201 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dda3ecb9-35d6-42d9-ab29-c25af09962c1 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:03.491333 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-dda3ecb9-35d6-42d9-ab29-c25af09962c1 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11a308e70d4303a66ad8aaa9338961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65cd308906048719f3c79e73bdfa921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:03.505301 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-dda3ecb9-35d6-42d9-ab29-c25af09962c1 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "GET /compute/v2.1/servers/47e54256-b283-406c-80e8-cbf2622a1c9b" status: 200 len: 1277 microversion: 2.1 time: 0.221737 Jul 18 02:27:03.506631 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1446/2890] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:03 2022] GET /compute/v2.1/servers/47e54256-b283-406c-80e8-cbf2622a1c9b => generated 1277 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:03.542067 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e5bb99ce-4999-44db-8208-9cbc7b4ad8c7 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:03.553960 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e5bb99ce-4999-44db-8208-9cbc7b4ad8c7 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1540 microversion: 2.1 time: 0.827559 Jul 18 02:27:03.557624 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1445/2891] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:02 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1540 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:04.300037 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-26766744-966d-4100-9354-edaa304e2ba6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:04.301623 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-26766744-966d-4100-9354-edaa304e2ba6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:04.311030 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-26766744-966d-4100-9354-edaa304e2ba6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:04.311675 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-26766744-966d-4100-9354-edaa304e2ba6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:04.312660 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-26766744-966d-4100-9354-edaa304e2ba6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:04.313285 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-26766744-966d-4100-9354-edaa304e2ba6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:04.530168 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9b6b5a88-cfd9-47da-9438-1816cfcc4cec tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:04.538081 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9b6b5a88-cfd9-47da-9438-1816cfcc4cec tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: 47e54256-b283-406c-80e8-cbf2622a1c9b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:04.561980 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9b6b5a88-cfd9-47da-9438-1816cfcc4cec tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:04.563832 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9b6b5a88-cfd9-47da-9438-1816cfcc4cec tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:04.566493 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9b6b5a88-cfd9-47da-9438-1816cfcc4cec tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:04.567872 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9b6b5a88-cfd9-47da-9438-1816cfcc4cec tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:04.919833 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9b6b5a88-cfd9-47da-9438-1816cfcc4cec tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11a308e70d4303a66ad8aaa9338961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65cd308906048719f3c79e73bdfa921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:04.934325 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9b6b5a88-cfd9-47da-9438-1816cfcc4cec tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "GET /compute/v2.1/servers/47e54256-b283-406c-80e8-cbf2622a1c9b" status: 200 len: 1277 microversion: 2.1 time: 0.413754 Jul 18 02:27:04.944336 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1446/2892] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:04 2022] GET /compute/v2.1/servers/47e54256-b283-406c-80e8-cbf2622a1c9b => generated 1277 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:27:04.950531 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-40184d3b-f276-4917-939f-dbd9ce95a4ee tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:04.951349 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-40184d3b-f276-4917-939f-dbd9ce95a4ee tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:04.963603 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-40184d3b-f276-4917-939f-dbd9ce95a4ee tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:04.966221 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-40184d3b-f276-4917-939f-dbd9ce95a4ee tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:04.974857 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-40184d3b-f276-4917-939f-dbd9ce95a4ee tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:04.975715 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-40184d3b-f276-4917-939f-dbd9ce95a4ee tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:05.577779 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-26766744-966d-4100-9354-edaa304e2ba6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:05.612479 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-26766744-966d-4100-9354-edaa304e2ba6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 200 len: 1448 microversion: 2.1 time: 1.313354 Jul 18 02:27:05.628058 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1447/2893] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:04 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 1448 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:05.850839 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-40184d3b-f276-4917-939f-dbd9ce95a4ee tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:05.862088 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-40184d3b-f276-4917-939f-dbd9ce95a4ee tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1472 microversion: 2.1 time: 0.924301 Jul 18 02:27:05.862088 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1447/2894] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:04 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1472 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:05.881206 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5ce38de5-1c54-480e-884d-9d748dba0361 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:05.882366 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5ce38de5-1c54-480e-884d-9d748dba0361 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:05.900167 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ce38de5-1c54-480e-884d-9d748dba0361 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:05.902350 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ce38de5-1c54-480e-884d-9d748dba0361 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:05.909401 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ce38de5-1c54-480e-884d-9d748dba0361 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:05.909401 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ce38de5-1c54-480e-884d-9d748dba0361 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:06.002675 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0c681689-f919-4fe8-96c4-df34934f24bd tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Action: 'create', calling method: .version_select at 0x7ff49baed430>, body: {"keypair": {"name": "tempest-keypair-1141214482", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGm7bcZsUnxwvDqrhDnC/fNOKhyYfaulWhs0TXqxwHN+aTLozyeeXnL203+kuKQ6LIl4Qw2p0e9WhIxAwAalAC13u4vXo59daXLbjpmhvbvODmfQKF75qlJdfk8jZLCmvg=="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:06.132685 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-0c681689-f919-4fe8-96c4-df34934f24bd tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Getting quotas for project 00a798824fb748c8889769282273bda4. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:27:06.185969 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5ce38de5-1c54-480e-884d-9d748dba0361 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:27:06.213255 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-0c681689-f919-4fe8-96c4-df34934f24bd tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Getting quotas for user c1a08894c5e14d05b3a7b21001ff2740 and project 00a798824fb748c8889769282273bda4. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:27:06.244924 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.compute.api [None req-5ce38de5-1c54-480e-884d-9d748dba0361 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Working on deleting snapshot 981bb68c-ffa9-4996-b1a4-ea39032147ad from shelved instance... Jul 18 02:27:06.373519 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0c681689-f919-4fe8-96c4-df34934f24bd tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.743881 Jul 18 02:27:06.374352 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1448/2895] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 02:27:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:06.382752 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bf666fa6-05b9-4e76-917b-e78af585dddf tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:06.382752 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bf666fa6-05b9-4e76-917b-e78af585dddf tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: 47e54256-b283-406c-80e8-cbf2622a1c9b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:06.396972 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bf666fa6-05b9-4e76-917b-e78af585dddf tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:06.397438 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bf666fa6-05b9-4e76-917b-e78af585dddf tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:06.402801 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bf666fa6-05b9-4e76-917b-e78af585dddf tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:06.403480 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bf666fa6-05b9-4e76-917b-e78af585dddf tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:06.840777 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bf666fa6-05b9-4e76-917b-e78af585dddf tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11a308e70d4303a66ad8aaa9338961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65cd308906048719f3c79e73bdfa921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:06.872181 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bf666fa6-05b9-4e76-917b-e78af585dddf tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "GET /compute/v2.1/servers/47e54256-b283-406c-80e8-cbf2622a1c9b" status: 200 len: 1319 microversion: 2.1 time: 0.495361 Jul 18 02:27:06.873090 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1449/2896] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:06 2022] GET /compute/v2.1/servers/47e54256-b283-406c-80e8-cbf2622a1c9b => generated 1319 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:06.900042 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b42d15e7-e467-46a1-8a97-74f4f192694c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:06.903843 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b42d15e7-e467-46a1-8a97-74f4f192694c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:06.920605 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b42d15e7-e467-46a1-8a97-74f4f192694c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:06.922188 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b42d15e7-e467-46a1-8a97-74f4f192694c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:06.926185 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b42d15e7-e467-46a1-8a97-74f4f192694c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:06.929002 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b42d15e7-e467-46a1-8a97-74f4f192694c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:07.405270 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:08.059328 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=8 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:08.077175 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b42d15e7-e467-46a1-8a97-74f4f192694c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:08.101143 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b42d15e7-e467-46a1-8a97-74f4f192694c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1469 microversion: 2.1 time: 1.212203 Jul 18 02:27:08.111362 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1450/2897] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:06 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1469 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:27:08.127887 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-66c5bc58-4a59-4db5-a855-92a52d2a8421 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:08.135489 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-66c5bc58-4a59-4db5-a855-92a52d2a8421 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: 47e54256-b283-406c-80e8-cbf2622a1c9b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:08.152116 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-66c5bc58-4a59-4db5-a855-92a52d2a8421 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:08.153290 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-66c5bc58-4a59-4db5-a855-92a52d2a8421 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:08.154469 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-66c5bc58-4a59-4db5-a855-92a52d2a8421 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:08.155210 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-66c5bc58-4a59-4db5-a855-92a52d2a8421 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:08.275347 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5ce38de5-1c54-480e-884d-9d748dba0361 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Doing local delete in cell 2a4b42c4-bf71-4fae-804a-3632602c55fa(cell1) {{(pid=119544) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 18 02:27:08.278147 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ce38de5-1c54-480e-884d-9d748dba0361 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:08.279326 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ce38de5-1c54-480e-884d-9d748dba0361 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:08.284007 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.compute.api [None req-5ce38de5-1c54-480e-884d-9d748dba0361 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 18 02:27:08.294394 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-5ce38de5-1c54-480e-884d-9d748dba0361 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] deallocate_for_instance() {{(pid=119544) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 18 02:27:08.999851 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-66c5bc58-4a59-4db5-a855-92a52d2a8421 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11a308e70d4303a66ad8aaa9338961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65cd308906048719f3c79e73bdfa921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:09.015129 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-66c5bc58-4a59-4db5-a855-92a52d2a8421 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "GET /compute/v2.1/servers/47e54256-b283-406c-80e8-cbf2622a1c9b" status: 200 len: 1319 microversion: 2.1 time: 0.901177 Jul 18 02:27:09.016271 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1451/2898] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:08 2022] GET /compute/v2.1/servers/47e54256-b283-406c-80e8-cbf2622a1c9b => generated 1319 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:09.028573 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-56e3c48a-c86d-4034-abc1-ebaa974d29e1 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:09.031649 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-56e3c48a-c86d-4034-abc1-ebaa974d29e1 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:09.048233 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56e3c48a-c86d-4034-abc1-ebaa974d29e1 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:09.052024 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56e3c48a-c86d-4034-abc1-ebaa974d29e1 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:09.052891 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56e3c48a-c86d-4034-abc1-ebaa974d29e1 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:09.053772 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56e3c48a-c86d-4034-abc1-ebaa974d29e1 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:09.142149 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56e3c48a-c86d-4034-abc1-ebaa974d29e1 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:09.142773 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56e3c48a-c86d-4034-abc1-ebaa974d29e1 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:09.143820 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56e3c48a-c86d-4034-abc1-ebaa974d29e1 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:09.144363 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56e3c48a-c86d-4034-abc1-ebaa974d29e1 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:09.192933 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-56e3c48a-c86d-4034-abc1-ebaa974d29e1 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Getting quotas for project d7ff962145954166b4c5efb0a0f1edff. Resources: {'cores', 'ram'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:27:09.202443 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-56e3c48a-c86d-4034-abc1-ebaa974d29e1 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Getting quotas for user dbeea54ebc4749aba59afb60feaa6159 and project d7ff962145954166b4c5efb0a0f1edff. Resources: {'cores', 'ram'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:27:09.349336 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:09.471223 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-56e3c48a-c86d-4034-abc1-ebaa974d29e1 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "POST /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d/action" status: 202 len: 0 microversion: 2.1 time: 0.448285 Jul 18 02:27:09.475829 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1452/2899] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:27:09 2022] POST /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d/action => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:27:09.490426 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9a53a682-0a09-452a-82fd-4a72c979f4c7 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:09.494367 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9a53a682-0a09-452a-82fd-4a72c979f4c7 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:09.515297 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9a53a682-0a09-452a-82fd-4a72c979f4c7 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:09.517898 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9a53a682-0a09-452a-82fd-4a72c979f4c7 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:09.521589 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9a53a682-0a09-452a-82fd-4a72c979f4c7 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:09.524709 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9a53a682-0a09-452a-82fd-4a72c979f4c7 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:10.435733 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9a53a682-0a09-452a-82fd-4a72c979f4c7 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:10.464647 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9a53a682-0a09-452a-82fd-4a72c979f4c7 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1468 microversion: 2.1 time: 0.981642 Jul 18 02:27:10.500015 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1453/2900] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:09 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1468 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:10.515527 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c588dcd3-7d4a-4781-80f0-339ebe241cf4 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:10.517273 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c588dcd3-7d4a-4781-80f0-339ebe241cf4 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: 47e54256-b283-406c-80e8-cbf2622a1c9b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:10.554828 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c588dcd3-7d4a-4781-80f0-339ebe241cf4 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:10.558754 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c588dcd3-7d4a-4781-80f0-339ebe241cf4 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:10.567215 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c588dcd3-7d4a-4781-80f0-339ebe241cf4 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:10.568484 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c588dcd3-7d4a-4781-80f0-339ebe241cf4 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:12.566704 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c588dcd3-7d4a-4781-80f0-339ebe241cf4 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11a308e70d4303a66ad8aaa9338961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65cd308906048719f3c79e73bdfa921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:12.579797 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c588dcd3-7d4a-4781-80f0-339ebe241cf4 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "GET /compute/v2.1/servers/47e54256-b283-406c-80e8-cbf2622a1c9b" status: 200 len: 1319 microversion: 2.1 time: 2.077345 Jul 18 02:27:12.581222 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1454/2901] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:10 2022] GET /compute/v2.1/servers/47e54256-b283-406c-80e8-cbf2622a1c9b => generated 1319 bytes in 2080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:12.609330 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-f656c04a-e962-4f68-83c5-791232163544 req-72e4541f-8a4f-400a-bb75-52d348e0828f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c0f69bd-6236-4b98-a759-4b3c2a39ca6e", "tag": "4acd2913-7dcc-400c-881f-16ff9755c0b0"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:12.639426 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-f656c04a-e962-4f68-83c5-791232163544 req-72e4541f-8a4f-400a-bb75-52d348e0828f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:12.642591 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-f656c04a-e962-4f68-83c5-791232163544 req-72e4541f-8a4f-400a-bb75-52d348e0828f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:12.726620 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-f656c04a-e962-4f68-83c5-791232163544 req-72e4541f-8a4f-400a-bb75-52d348e0828f service nova] Creating event network-changed:4acd2913-7dcc-400c-881f-16ff9755c0b0 for instance 7c0f69bd-6236-4b98-a759-4b3c2a39ca6e on n-h2-465891-3 Jul 18 02:27:12.737534 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-f656c04a-e962-4f68-83c5-791232163544 req-72e4541f-8a4f-400a-bb75-52d348e0828f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154151 Jul 18 02:27:12.740278 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1455/2902] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:12.757273 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-27701ebf-2cdf-48bf-9bbd-f8e34faabf8a req-35729163-1267-4d95-83f2-69291fd739fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d", "name": "network-vif-plugged", "status": "completed", "tag": "34d35bd1-0f8c-4049-9360-7f9c95f734d8"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:12.783334 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-27701ebf-2cdf-48bf-9bbd-f8e34faabf8a req-35729163-1267-4d95-83f2-69291fd739fc service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:12.786832 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-27701ebf-2cdf-48bf-9bbd-f8e34faabf8a req-35729163-1267-4d95-83f2-69291fd739fc service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:12.832593 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-27701ebf-2cdf-48bf-9bbd-f8e34faabf8a req-35729163-1267-4d95-83f2-69291fd739fc service nova] Creating event network-vif-plugged:34d35bd1-0f8c-4049-9360-7f9c95f734d8 for instance a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d on n-h1-465891-3 Jul 18 02:27:12.848523 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [req-27701ebf-2cdf-48bf-9bbd-f8e34faabf8a req-35729163-1267-4d95-83f2-69291fd739fc service nova] Instance a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3'} {{(pid=119543) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 02:27:12.862415 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-27701ebf-2cdf-48bf-9bbd-f8e34faabf8a req-35729163-1267-4d95-83f2-69291fd739fc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117485 Jul 18 02:27:12.870424 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1456/2903] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:12.877244 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-730d7590-b065-4c82-9e64-7d1fab6000ae tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:12.878801 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-730d7590-b065-4c82-9e64-7d1fab6000ae tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:12.903232 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-730d7590-b065-4c82-9e64-7d1fab6000ae tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:12.904341 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-730d7590-b065-4c82-9e64-7d1fab6000ae tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:12.919303 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-730d7590-b065-4c82-9e64-7d1fab6000ae tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:12.920261 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-730d7590-b065-4c82-9e64-7d1fab6000ae tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:13.201847 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-5ce38de5-1c54-480e-884d-9d748dba0361 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Updating instance_info_cache with network_info: [] {{(pid=119544) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 18 02:27:13.469772 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:13.693970 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5ce38de5-1c54-480e-884d-9d748dba0361 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "DELETE /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 204 len: 0 microversion: 2.1 time: 7.830524 Jul 18 02:27:13.703073 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1448/2904] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:27:05 2022] DELETE /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 0 bytes in 7834 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:27:13.723336 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-f4d3383a-ed4c-43aa-8f55-fbf2fb68efe3 req-1c0157df-1a98-4ac1-a9d0-e53b06d883cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47e54256-b283-406c-80e8-cbf2622a1c9b", "tag": "f0088fe1-7b29-421f-99da-6f5670175091"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:13.744004 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-f4d3383a-ed4c-43aa-8f55-fbf2fb68efe3 req-1c0157df-1a98-4ac1-a9d0-e53b06d883cf service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:13.745297 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-f4d3383a-ed4c-43aa-8f55-fbf2fb68efe3 req-1c0157df-1a98-4ac1-a9d0-e53b06d883cf service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:13.760920 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-f4d3383a-ed4c-43aa-8f55-fbf2fb68efe3 req-1c0157df-1a98-4ac1-a9d0-e53b06d883cf service nova] Creating event network-changed:f0088fe1-7b29-421f-99da-6f5670175091 for instance 47e54256-b283-406c-80e8-cbf2622a1c9b on n-h1-465891-3 Jul 18 02:27:13.766894 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-f4d3383a-ed4c-43aa-8f55-fbf2fb68efe3 req-1c0157df-1a98-4ac1-a9d0-e53b06d883cf service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061711 Jul 18 02:27:13.767984 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1449/2905] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:13.775061 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2f6c5818-502c-4ab7-b9fe-7bde5b0d8061 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:13.776347 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2f6c5818-502c-4ab7-b9fe-7bde5b0d8061 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: 47e54256-b283-406c-80e8-cbf2622a1c9b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:13.786037 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2f6c5818-502c-4ab7-b9fe-7bde5b0d8061 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:13.787093 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2f6c5818-502c-4ab7-b9fe-7bde5b0d8061 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:13.788222 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2f6c5818-502c-4ab7-b9fe-7bde5b0d8061 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:13.788852 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2f6c5818-502c-4ab7-b9fe-7bde5b0d8061 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:13.976288 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-730d7590-b065-4c82-9e64-7d1fab6000ae tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:13.997596 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-730d7590-b065-4c82-9e64-7d1fab6000ae tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1468 microversion: 2.1 time: 1.124092 Jul 18 02:27:13.999080 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1457/2906] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:12 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1468 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:14.010674 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8fc4a3a0-7373-4ec4-8e77-e57a1abb7e42 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:14.012381 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8fc4a3a0-7373-4ec4-8e77-e57a1abb7e42 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:14.035560 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8fc4a3a0-7373-4ec4-8e77-e57a1abb7e42 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:14.036233 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8fc4a3a0-7373-4ec4-8e77-e57a1abb7e42 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:14.038008 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8fc4a3a0-7373-4ec4-8e77-e57a1abb7e42 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:14.038970 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8fc4a3a0-7373-4ec4-8e77-e57a1abb7e42 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:14.064555 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-8fc4a3a0-7373-4ec4-8e77-e57a1abb7e42 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] HTTP exception thrown: Instance 637aab54-71a9-4233-85ad-7d1e785b9e9c could not be found. Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8fc4a3a0-7373-4ec4-8e77-e57a1abb7e42 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Request method failure captured: Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c HTTP/1.1 Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MPwaxUozPvSKq2aGl05vX5p9RkRh12PhrAa5ZuFGYH8QlWHXUoV4AOq2uE9nQ_2FUYuIDSWVSpjhgygJ-c4EGtTg2Y-_wVXi_cp3NARUTVck4-IU3Tev_AIZ-4eU7-_uXuXl7L-x01qv35sxA627UbKELg2PVDH9gxQj5dhwRrNVzw Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ba9d4e8f2f18460ebccacbe32db57388"}]}] Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-DeleteServersTestJSON-988442543 Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 89c4d32923874a50972ab0b75a4165c0 Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 637aab54-71a9-4233-85ad-7d1e785b9e9c could not be found. Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '637aab54-71a9-4233-85ad-7d1e785b9e9c'} Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 637aab54-71a9-4233-85ad-7d1e785b9e9c could not be found. Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 637aab54-71a9-4233-85ad-7d1e785b9e9c could not be found. Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:27:14.067186 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:27:14.083618 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:14.083618 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:27:14.083618 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:27:14.083618 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:27:14.083618 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:27:14.083618 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 637aab54-71a9-4233-85ad-7d1e785b9e9c could not be found. Jul 18 02:27:14.083618 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:27:14.083618 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8fc4a3a0-7373-4ec4-8e77-e57a1abb7e42 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Returning 404 to user: Instance 637aab54-71a9-4233-85ad-7d1e785b9e9c could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:27:14.083618 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8fc4a3a0-7373-4ec4-8e77-e57a1abb7e42 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 404 len: 111 microversion: 2.1 time: 0.068828 Jul 18 02:27:14.089406 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1458/2907] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:13 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:27:14.258780 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fdea1a3f-82c5-43a1-97af-1b404c28cbf6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1721355378", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "6dbd9947-7c83-4ca1-a653-57a9c042a444"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:14.296268 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2f6c5818-502c-4ab7-b9fe-7bde5b0d8061 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11a308e70d4303a66ad8aaa9338961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65cd308906048719f3c79e73bdfa921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:14.311749 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2f6c5818-502c-4ab7-b9fe-7bde5b0d8061 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "GET /compute/v2.1/servers/47e54256-b283-406c-80e8-cbf2622a1c9b" status: 200 len: 1319 microversion: 2.1 time: 0.541131 Jul 18 02:27:14.314067 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1450/2908] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:13 2022] GET /compute/v2.1/servers/47e54256-b283-406c-80e8-cbf2622a1c9b => generated 1319 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:14.375764 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-fdea1a3f-82c5-43a1-97af-1b404c28cbf6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] validate_networks() for [('6dbd9947-7c83-4ca1-a653-57a9c042a444', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:27:14.982318 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-c92fd47b-3ef6-4dee-839b-393beb963e8f req-027feb85-7382-40b5-9e29-36fe1b29c59b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "637aab54-71a9-4233-85ad-7d1e785b9e9c", "name": "network-vif-deleted", "tag": "747e8487-8d62-41a3-94d1-1c3cf951db53"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:14.998563 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-c92fd47b-3ef6-4dee-839b-393beb963e8f req-027feb85-7382-40b5-9e29-36fe1b29c59b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:15.009544 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-c92fd47b-3ef6-4dee-839b-393beb963e8f req-027feb85-7382-40b5-9e29-36fe1b29c59b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:15.042913 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.compute.server_external_events [req-c92fd47b-3ef6-4dee-839b-393beb963e8f req-027feb85-7382-40b5-9e29-36fe1b29c59b service nova] Unable to find a host for instance 637aab54-71a9-4233-85ad-7d1e785b9e9c. Dropping event network-vif-deleted {{(pid=119544) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 18 02:27:15.048095 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-c92fd47b-3ef6-4dee-839b-393beb963e8f req-027feb85-7382-40b5-9e29-36fe1b29c59b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.067018 Jul 18 02:27:15.048943 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1451/2909] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 73 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 18 02:27:15.063060 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-abe732bc-171d-4657-9aa9-30e67103204e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:15.065652 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-abe732bc-171d-4657-9aa9-30e67103204e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:15.090337 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-abe732bc-171d-4657-9aa9-30e67103204e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:15.091217 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-abe732bc-171d-4657-9aa9-30e67103204e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:15.092663 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-abe732bc-171d-4657-9aa9-30e67103204e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:15.093457 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-abe732bc-171d-4657-9aa9-30e67103204e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:15.944733 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-abe732bc-171d-4657-9aa9-30e67103204e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:15.962709 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-abe732bc-171d-4657-9aa9-30e67103204e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1468 microversion: 2.1 time: 0.911699 Jul 18 02:27:15.967116 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1452/2910] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:15 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1468 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:15.980342 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4571cc6d-74b0-4547-a1ea-d81a94fbbf17 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:15.980981 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4571cc6d-74b0-4547-a1ea-d81a94fbbf17 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: 47e54256-b283-406c-80e8-cbf2622a1c9b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:16.009925 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4571cc6d-74b0-4547-a1ea-d81a94fbbf17 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:16.010969 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4571cc6d-74b0-4547-a1ea-d81a94fbbf17 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:16.012462 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4571cc6d-74b0-4547-a1ea-d81a94fbbf17 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:16.013548 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4571cc6d-74b0-4547-a1ea-d81a94fbbf17 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:16.034620 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:16.269103 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:16.512293 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-fdea1a3f-82c5-43a1-97af-1b404c28cbf6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:27:16.513258 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-fdea1a3f-82c5-43a1-97af-1b404c28cbf6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:27:16.514477 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-fdea1a3f-82c5-43a1-97af-1b404c28cbf6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:27:16.515204 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-fdea1a3f-82c5-43a1-97af-1b404c28cbf6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:27:16.516017 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-fdea1a3f-82c5-43a1-97af-1b404c28cbf6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:27:16.519858 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:16.590488 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fdea1a3f-82c5-43a1-97af-1b404c28cbf6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:16.595824 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fdea1a3f-82c5-43a1-97af-1b404c28cbf6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:16.597412 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fdea1a3f-82c5-43a1-97af-1b404c28cbf6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:16.598440 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fdea1a3f-82c5-43a1-97af-1b404c28cbf6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:16.626701 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-fdea1a3f-82c5-43a1-97af-1b404c28cbf6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Getting quotas for project ba9d4e8f2f18460ebccacbe32db57388. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:27:16.634243 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-fdea1a3f-82c5-43a1-97af-1b404c28cbf6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Getting quotas for user 89c4d32923874a50972ab0b75a4165c0 and project ba9d4e8f2f18460ebccacbe32db57388. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:27:16.657507 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fdea1a3f-82c5-43a1-97af-1b404c28cbf6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:27:16.660458 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fdea1a3f-82c5-43a1-97af-1b404c28cbf6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: d2dc65b8-8306-4f87-9af1-1cb5096c4ebf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:27:16.770914 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4571cc6d-74b0-4547-a1ea-d81a94fbbf17 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11a308e70d4303a66ad8aaa9338961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65cd308906048719f3c79e73bdfa921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:16.788727 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4571cc6d-74b0-4547-a1ea-d81a94fbbf17 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "GET /compute/v2.1/servers/47e54256-b283-406c-80e8-cbf2622a1c9b" status: 200 len: 1319 microversion: 2.1 time: 0.818112 Jul 18 02:27:16.809826 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1453/2911] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:15 2022] GET /compute/v2.1/servers/47e54256-b283-406c-80e8-cbf2622a1c9b => generated 1319 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:16.811892 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fdea1a3f-82c5-43a1-97af-1b404c28cbf6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.561450 Jul 18 02:27:16.813775 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1459/2912] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:27:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:27:16.829824 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c98d4787-5b72-4935-bccd-40fc59c1a461 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:16.831599 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c98d4787-5b72-4935-bccd-40fc59c1a461 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: d2dc65b8-8306-4f87-9af1-1cb5096c4ebf] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:16.987722 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b9fb65ec-7341-434d-8dfa-5c414550c10b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:16.988482 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b9fb65ec-7341-434d-8dfa-5c414550c10b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:17.012828 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b9fb65ec-7341-434d-8dfa-5c414550c10b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:17.014356 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b9fb65ec-7341-434d-8dfa-5c414550c10b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:17.030103 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b9fb65ec-7341-434d-8dfa-5c414550c10b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:17.030103 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b9fb65ec-7341-434d-8dfa-5c414550c10b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:17.756402 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c98d4787-5b72-4935-bccd-40fc59c1a461 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:17.778495 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c98d4787-5b72-4935-bccd-40fc59c1a461 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf" status: 200 len: 1215 microversion: 2.1 time: 0.955660 Jul 18 02:27:17.779842 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1454/2913] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:16 2022] GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf => generated 1215 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:27:17.794889 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2b31933d-78b1-4782-99df-b1651c272a79 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-779884026", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "c18c9226-9669-4546-95e5-957bca03da17"}], "security_groups": [{"name": "tempest-securitygroup--960221175"}], "key_name": "tempest-keypair-1141214482", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:18.562471 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-2b31933d-78b1-4782-99df-b1651c272a79 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] validate_networks() for [('c18c9226-9669-4546-95e5-957bca03da17', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:27:18.826169 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b9fb65ec-7341-434d-8dfa-5c414550c10b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:18.840464 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b9fb65ec-7341-434d-8dfa-5c414550c10b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1534 microversion: 2.1 time: 1.857939 Jul 18 02:27:18.843963 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1460/2914] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:16 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1534 bytes in 1863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:18.851171 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-00635080-3220-430f-9d05-4c8510810522 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:18.857284 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-00635080-3220-430f-9d05-4c8510810522 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: 47e54256-b283-406c-80e8-cbf2622a1c9b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:18.878643 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-00635080-3220-430f-9d05-4c8510810522 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:18.880956 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-00635080-3220-430f-9d05-4c8510810522 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:18.882041 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-00635080-3220-430f-9d05-4c8510810522 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:18.883685 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-00635080-3220-430f-9d05-4c8510810522 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:20.116745 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-00635080-3220-430f-9d05-4c8510810522 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11a308e70d4303a66ad8aaa9338961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65cd308906048719f3c79e73bdfa921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:20.131580 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-00635080-3220-430f-9d05-4c8510810522 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "GET /compute/v2.1/servers/47e54256-b283-406c-80e8-cbf2622a1c9b" status: 200 len: 1319 microversion: 2.1 time: 1.283348 Jul 18 02:27:20.133622 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1461/2915] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:18 2022] GET /compute/v2.1/servers/47e54256-b283-406c-80e8-cbf2622a1c9b => generated 1319 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:20.143002 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-07d3a40f-3f6f-4988-a85d-a9ac0a1a4aa1 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:20.143896 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-07d3a40f-3f6f-4988-a85d-a9ac0a1a4aa1 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: d2dc65b8-8306-4f87-9af1-1cb5096c4ebf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:20.174848 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-07d3a40f-3f6f-4988-a85d-a9ac0a1a4aa1 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:20.178650 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-07d3a40f-3f6f-4988-a85d-a9ac0a1a4aa1 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:20.182662 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-07d3a40f-3f6f-4988-a85d-a9ac0a1a4aa1 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:20.186152 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-07d3a40f-3f6f-4988-a85d-a9ac0a1a4aa1 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:20.353161 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-07d3a40f-3f6f-4988-a85d-a9ac0a1a4aa1 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:20.367549 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-07d3a40f-3f6f-4988-a85d-a9ac0a1a4aa1 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf" status: 200 len: 1273 microversion: 2.1 time: 0.231161 Jul 18 02:27:20.384939 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1462/2916] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:20 2022] GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf => generated 1273 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:20.393005 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-26cb809b-3572-4114-991c-00f616ed3484 req-6eb52a52-b406-4081-bef7-b9ee9957bd30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c0f69bd-6236-4b98-a759-4b3c2a39ca6e", "name": "network-vif-plugged", "status": "completed", "tag": "4acd2913-7dcc-400c-881f-16ff9755c0b0"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:20.409276 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-26cb809b-3572-4114-991c-00f616ed3484 req-6eb52a52-b406-4081-bef7-b9ee9957bd30 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:20.410080 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-26cb809b-3572-4114-991c-00f616ed3484 req-6eb52a52-b406-4081-bef7-b9ee9957bd30 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:20.426304 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-26cb809b-3572-4114-991c-00f616ed3484 req-6eb52a52-b406-4081-bef7-b9ee9957bd30 service nova] Creating event network-vif-plugged:4acd2913-7dcc-400c-881f-16ff9755c0b0 for instance 7c0f69bd-6236-4b98-a759-4b3c2a39ca6e on n-h2-465891-3 Jul 18 02:27:20.432728 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-26cb809b-3572-4114-991c-00f616ed3484 req-6eb52a52-b406-4081-bef7-b9ee9957bd30 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046130 Jul 18 02:27:20.438490 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1463/2917] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:20.836771 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-2b31933d-78b1-4782-99df-b1651c272a79 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Getting quotas for project 00a798824fb748c8889769282273bda4. Resources: dict_keys(['metadata_items']) {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:27:20.856088 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-2b31933d-78b1-4782-99df-b1651c272a79 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Getting quotas for user c1a08894c5e14d05b3a7b21001ff2740 and project 00a798824fb748c8889769282273bda4. Resources: dict_keys(['metadata_items']) {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:27:20.888529 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-2b31933d-78b1-4782-99df-b1651c272a79 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:27:20.893166 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-2b31933d-78b1-4782-99df-b1651c272a79 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:27:20.893675 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-2b31933d-78b1-4782-99df-b1651c272a79 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:27:20.894146 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-2b31933d-78b1-4782-99df-b1651c272a79 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:27:20.894555 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-2b31933d-78b1-4782-99df-b1651c272a79 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:27:20.915958 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2b31933d-78b1-4782-99df-b1651c272a79 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:20.923182 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2b31933d-78b1-4782-99df-b1651c272a79 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:20.926666 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2b31933d-78b1-4782-99df-b1651c272a79 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:20.927122 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2b31933d-78b1-4782-99df-b1651c272a79 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:20.972534 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-2b31933d-78b1-4782-99df-b1651c272a79 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Getting quotas for project 00a798824fb748c8889769282273bda4. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:27:20.991208 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-2b31933d-78b1-4782-99df-b1651c272a79 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Getting quotas for user c1a08894c5e14d05b3a7b21001ff2740 and project 00a798824fb748c8889769282273bda4. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:27:21.021828 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2b31933d-78b1-4782-99df-b1651c272a79 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:27:21.030974 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2b31933d-78b1-4782-99df-b1651c272a79 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] [instance: 8573a671-62f5-4659-a227-bb1637b51430] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:27:21.109930 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-74898169-1e88-426f-a31d-d912b53012e9 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:21.111186 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-74898169-1e88-426f-a31d-d912b53012e9 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:21.129910 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-74898169-1e88-426f-a31d-d912b53012e9 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:21.132711 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-74898169-1e88-426f-a31d-d912b53012e9 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:21.133963 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-74898169-1e88-426f-a31d-d912b53012e9 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:21.135946 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2b31933d-78b1-4782-99df-b1651c272a79 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.354754 Jul 18 02:27:21.136701 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1455/2918] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:27:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 3356 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:27:21.139138 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-74898169-1e88-426f-a31d-d912b53012e9 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:21.150898 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9f3237bd-8bef-4785-b29a-dae56aa5abb0 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:21.151538 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9f3237bd-8bef-4785-b29a-dae56aa5abb0 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] [instance: 8573a671-62f5-4659-a227-bb1637b51430] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:21.349855 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9f3237bd-8bef-4785-b29a-dae56aa5abb0 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a08894c5e14d05b3a7b21001ff2740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a798824fb748c8889769282273bda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:21.360108 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9f3237bd-8bef-4785-b29a-dae56aa5abb0 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] 10.222.0.57 "GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430" status: 200 len: 1269 microversion: 2.1 time: 0.217004 Jul 18 02:27:21.366123 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1456/2919] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:21 2022] GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430 => generated 1269 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:21.377517 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fc311af5-96fe-41c5-a84e-fa95d9b66ab7 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:21.378607 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fc311af5-96fe-41c5-a84e-fa95d9b66ab7 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: 47e54256-b283-406c-80e8-cbf2622a1c9b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:21.414329 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fc311af5-96fe-41c5-a84e-fa95d9b66ab7 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:21.414994 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fc311af5-96fe-41c5-a84e-fa95d9b66ab7 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:21.415984 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fc311af5-96fe-41c5-a84e-fa95d9b66ab7 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:21.416684 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fc311af5-96fe-41c5-a84e-fa95d9b66ab7 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:22.150037 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-74898169-1e88-426f-a31d-d912b53012e9 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:22.166040 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-74898169-1e88-426f-a31d-d912b53012e9 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1534 microversion: 2.1 time: 1.725634 Jul 18 02:27:22.188763 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1464/2920] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:20 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1534 bytes in 1749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:22.195171 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-172efcc4-3190-43a0-8ac9-a8795fb25cd8 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:22.196227 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-172efcc4-3190-43a0-8ac9-a8795fb25cd8 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: d2dc65b8-8306-4f87-9af1-1cb5096c4ebf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:22.205438 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-172efcc4-3190-43a0-8ac9-a8795fb25cd8 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:22.206428 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-172efcc4-3190-43a0-8ac9-a8795fb25cd8 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:22.207800 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-172efcc4-3190-43a0-8ac9-a8795fb25cd8 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:22.208538 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-172efcc4-3190-43a0-8ac9-a8795fb25cd8 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:22.389046 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fc311af5-96fe-41c5-a84e-fa95d9b66ab7 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11a308e70d4303a66ad8aaa9338961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65cd308906048719f3c79e73bdfa921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:22.425319 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fc311af5-96fe-41c5-a84e-fa95d9b66ab7 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "GET /compute/v2.1/servers/47e54256-b283-406c-80e8-cbf2622a1c9b" status: 200 len: 1319 microversion: 2.1 time: 1.055016 Jul 18 02:27:22.428509 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1457/2921] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:21 2022] GET /compute/v2.1/servers/47e54256-b283-406c-80e8-cbf2622a1c9b => generated 1319 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:22.460257 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4b7f23c9-be3e-41be-b7de-a1eac4f34525 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:22.486761 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4b7f23c9-be3e-41be-b7de-a1eac4f34525 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] [instance: 8573a671-62f5-4659-a227-bb1637b51430] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:22.518910 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4b7f23c9-be3e-41be-b7de-a1eac4f34525 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:22.519755 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4b7f23c9-be3e-41be-b7de-a1eac4f34525 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:22.521476 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4b7f23c9-be3e-41be-b7de-a1eac4f34525 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:22.522614 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4b7f23c9-be3e-41be-b7de-a1eac4f34525 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:22.545540 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-172efcc4-3190-43a0-8ac9-a8795fb25cd8 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:22.572543 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-172efcc4-3190-43a0-8ac9-a8795fb25cd8 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf" status: 200 len: 1273 microversion: 2.1 time: 0.379411 Jul 18 02:27:22.590044 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1465/2922] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:22 2022] GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf => generated 1273 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:22.603817 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-0c0f809e-7dbb-43a1-9256-adf106d5d963 req-f153aa54-d728-4aaf-8738-3ace517a2906 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d", "name": "network-vif-unplugged", "status": "completed", "tag": "34d35bd1-0f8c-4049-9360-7f9c95f734d8"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:22.626568 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-0c0f809e-7dbb-43a1-9256-adf106d5d963 req-f153aa54-d728-4aaf-8738-3ace517a2906 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:22.630529 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-0c0f809e-7dbb-43a1-9256-adf106d5d963 req-f153aa54-d728-4aaf-8738-3ace517a2906 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:22.654736 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-0c0f809e-7dbb-43a1-9256-adf106d5d963 req-f153aa54-d728-4aaf-8738-3ace517a2906 service nova] Creating event network-vif-unplugged:34d35bd1-0f8c-4049-9360-7f9c95f734d8 for instance a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d on n-h1-465891-3 Jul 18 02:27:22.673113 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [req-0c0f809e-7dbb-43a1-9256-adf106d5d963 req-f153aa54-d728-4aaf-8738-3ace517a2906 service nova] Instance a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3'} {{(pid=119543) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 02:27:22.690854 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-0c0f809e-7dbb-43a1-9256-adf106d5d963 req-f153aa54-d728-4aaf-8738-3ace517a2906 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094305 Jul 18 02:27:22.694459 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1466/2923] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:22.814478 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4b7f23c9-be3e-41be-b7de-a1eac4f34525 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a08894c5e14d05b3a7b21001ff2740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a798824fb748c8889769282273bda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:22.860119 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4b7f23c9-be3e-41be-b7de-a1eac4f34525 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] 10.222.0.57 "GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430" status: 200 len: 1273 microversion: 2.1 time: 0.426808 Jul 18 02:27:22.863857 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1458/2924] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:22 2022] GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430 => generated 1273 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:23.197609 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4e752abf-ac3a-4cb3-be3c-95b8fb10ec09 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:23.199446 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4e752abf-ac3a-4cb3-be3c-95b8fb10ec09 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:23.211273 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4e752abf-ac3a-4cb3-be3c-95b8fb10ec09 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:23.214861 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4e752abf-ac3a-4cb3-be3c-95b8fb10ec09 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:23.217494 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4e752abf-ac3a-4cb3-be3c-95b8fb10ec09 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:23.218303 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4e752abf-ac3a-4cb3-be3c-95b8fb10ec09 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:23.455516 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1c7c9cab-28cc-4707-a752-62608f47bdaf tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:23.458544 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1c7c9cab-28cc-4707-a752-62608f47bdaf tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: 47e54256-b283-406c-80e8-cbf2622a1c9b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:23.509073 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1c7c9cab-28cc-4707-a752-62608f47bdaf tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:23.512465 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1c7c9cab-28cc-4707-a752-62608f47bdaf tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:23.516618 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1c7c9cab-28cc-4707-a752-62608f47bdaf tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:23.522695 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1c7c9cab-28cc-4707-a752-62608f47bdaf tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:24.669571 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4e752abf-ac3a-4cb3-be3c-95b8fb10ec09 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:24.681672 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4e752abf-ac3a-4cb3-be3c-95b8fb10ec09 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1534 microversion: 2.1 time: 1.487729 Jul 18 02:27:24.684840 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1467/2925] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:23 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1534 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:24.699144 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0e19b0aa-7c40-4aa9-8e0e-63c757456a22 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:24.701036 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0e19b0aa-7c40-4aa9-8e0e-63c757456a22 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: d2dc65b8-8306-4f87-9af1-1cb5096c4ebf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:24.716226 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0e19b0aa-7c40-4aa9-8e0e-63c757456a22 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:24.721801 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0e19b0aa-7c40-4aa9-8e0e-63c757456a22 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:24.722881 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0e19b0aa-7c40-4aa9-8e0e-63c757456a22 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:24.723422 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0e19b0aa-7c40-4aa9-8e0e-63c757456a22 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:25.268628 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1c7c9cab-28cc-4707-a752-62608f47bdaf tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11a308e70d4303a66ad8aaa9338961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65cd308906048719f3c79e73bdfa921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:25.287800 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1c7c9cab-28cc-4707-a752-62608f47bdaf tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "GET /compute/v2.1/servers/47e54256-b283-406c-80e8-cbf2622a1c9b" status: 200 len: 1319 microversion: 2.1 time: 1.845478 Jul 18 02:27:25.304129 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1459/2926] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:23 2022] GET /compute/v2.1/servers/47e54256-b283-406c-80e8-cbf2622a1c9b => generated 1319 bytes in 1864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:25.332241 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2dcd51f1-0561-49e0-adf2-1df96de80e48 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:25.334088 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2dcd51f1-0561-49e0-adf2-1df96de80e48 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] [instance: 8573a671-62f5-4659-a227-bb1637b51430] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:25.354221 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2dcd51f1-0561-49e0-adf2-1df96de80e48 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:25.357856 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2dcd51f1-0561-49e0-adf2-1df96de80e48 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:25.360505 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2dcd51f1-0561-49e0-adf2-1df96de80e48 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:25.361727 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2dcd51f1-0561-49e0-adf2-1df96de80e48 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:25.427098 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0e19b0aa-7c40-4aa9-8e0e-63c757456a22 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:25.437684 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0e19b0aa-7c40-4aa9-8e0e-63c757456a22 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf" status: 200 len: 1315 microversion: 2.1 time: 0.750936 Jul 18 02:27:25.443771 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1468/2927] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:24 2022] GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf => generated 1315 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:25.456564 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-c77532ba-bc57-4339-9815-90182c5c9b5b req-45e19cbf-dcb6-4a82-bbe7-9f6c8567c475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47e54256-b283-406c-80e8-cbf2622a1c9b", "name": "network-vif-plugged", "status": "completed", "tag": "f0088fe1-7b29-421f-99da-6f5670175091"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:25.490630 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-c77532ba-bc57-4339-9815-90182c5c9b5b req-45e19cbf-dcb6-4a82-bbe7-9f6c8567c475 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:25.502302 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-c77532ba-bc57-4339-9815-90182c5c9b5b req-45e19cbf-dcb6-4a82-bbe7-9f6c8567c475 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:25.536483 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-c77532ba-bc57-4339-9815-90182c5c9b5b req-45e19cbf-dcb6-4a82-bbe7-9f6c8567c475 service nova] Creating event network-vif-plugged:f0088fe1-7b29-421f-99da-6f5670175091 for instance 47e54256-b283-406c-80e8-cbf2622a1c9b on n-h1-465891-3 Jul 18 02:27:25.589392 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-c77532ba-bc57-4339-9815-90182c5c9b5b req-45e19cbf-dcb6-4a82-bbe7-9f6c8567c475 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130827 Jul 18 02:27:25.591395 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1469/2928] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:25.748172 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2dcd51f1-0561-49e0-adf2-1df96de80e48 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a08894c5e14d05b3a7b21001ff2740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a798824fb748c8889769282273bda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:25.748471 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fceecc71-7285-49a8-8d6c-3972984c0bf2 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:25.758525 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fceecc71-7285-49a8-8d6c-3972984c0bf2 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:25.782596 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2dcd51f1-0561-49e0-adf2-1df96de80e48 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] 10.222.0.57 "GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430" status: 200 len: 1321 microversion: 2.1 time: 0.464754 Jul 18 02:27:25.801679 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1460/2929] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:25 2022] GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430 => generated 1321 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:25.801969 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fceecc71-7285-49a8-8d6c-3972984c0bf2 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:25.801969 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fceecc71-7285-49a8-8d6c-3972984c0bf2 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:25.801969 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fceecc71-7285-49a8-8d6c-3972984c0bf2 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:25.838601 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fceecc71-7285-49a8-8d6c-3972984c0bf2 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:26.327292 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-02988b87-fb58-4cf2-b80c-8162158ecaca tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:26.329982 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-02988b87-fb58-4cf2-b80c-8162158ecaca tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: 47e54256-b283-406c-80e8-cbf2622a1c9b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:26.379160 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-02988b87-fb58-4cf2-b80c-8162158ecaca tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:26.383986 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-02988b87-fb58-4cf2-b80c-8162158ecaca tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:26.385587 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-02988b87-fb58-4cf2-b80c-8162158ecaca tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:26.386445 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-02988b87-fb58-4cf2-b80c-8162158ecaca tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:26.616745 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=5 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:26.652346 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:26.997234 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fceecc71-7285-49a8-8d6c-3972984c0bf2 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:27.013551 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fceecc71-7285-49a8-8d6c-3972984c0bf2 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1527 microversion: 2.1 time: 1.300248 Jul 18 02:27:27.015354 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1470/2930] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:25 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1527 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:27.022051 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2a60a9bf-c2f6-42d9-8e7e-01918fb341b2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:27.023013 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2a60a9bf-c2f6-42d9-8e7e-01918fb341b2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: d2dc65b8-8306-4f87-9af1-1cb5096c4ebf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:27.034482 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2a60a9bf-c2f6-42d9-8e7e-01918fb341b2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:27.035416 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2a60a9bf-c2f6-42d9-8e7e-01918fb341b2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:27.036621 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2a60a9bf-c2f6-42d9-8e7e-01918fb341b2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:27.037315 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2a60a9bf-c2f6-42d9-8e7e-01918fb341b2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:27.419055 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-02988b87-fb58-4cf2-b80c-8162158ecaca tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11a308e70d4303a66ad8aaa9338961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65cd308906048719f3c79e73bdfa921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:27.483572 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-02988b87-fb58-4cf2-b80c-8162158ecaca tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "GET /compute/v2.1/servers/47e54256-b283-406c-80e8-cbf2622a1c9b" status: 200 len: 1319 microversion: 2.1 time: 1.167170 Jul 18 02:27:27.485821 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1461/2931] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:26 2022] GET /compute/v2.1/servers/47e54256-b283-406c-80e8-cbf2622a1c9b => generated 1319 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:27.505580 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a3116ccb-7e92-4bac-82b6-56e5a0c81bae tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:27.508368 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a3116ccb-7e92-4bac-82b6-56e5a0c81bae tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] [instance: 8573a671-62f5-4659-a227-bb1637b51430] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:27.545384 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a3116ccb-7e92-4bac-82b6-56e5a0c81bae tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:27.545929 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a3116ccb-7e92-4bac-82b6-56e5a0c81bae tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:27.551067 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a3116ccb-7e92-4bac-82b6-56e5a0c81bae tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:27.552314 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a3116ccb-7e92-4bac-82b6-56e5a0c81bae tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:27.676254 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2a60a9bf-c2f6-42d9-8e7e-01918fb341b2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:27.712841 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a3116ccb-7e92-4bac-82b6-56e5a0c81bae tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a08894c5e14d05b3a7b21001ff2740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a798824fb748c8889769282273bda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:27.716376 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2a60a9bf-c2f6-42d9-8e7e-01918fb341b2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf" status: 200 len: 1315 microversion: 2.1 time: 0.695120 Jul 18 02:27:27.725206 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1471/2932] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:27 2022] GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf => generated 1315 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:27.766137 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0f30502f-75f2-4122-b339-fb24539a3d5e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:27.768199 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0f30502f-75f2-4122-b339-fb24539a3d5e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:27.768915 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a3116ccb-7e92-4bac-82b6-56e5a0c81bae tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] 10.222.0.57 "GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430" status: 200 len: 1327 microversion: 2.1 time: 0.281060 Jul 18 02:27:27.776621 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1462/2933] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:27 2022] GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430 => generated 1327 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:27.802028 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0f30502f-75f2-4122-b339-fb24539a3d5e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:27.802651 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0f30502f-75f2-4122-b339-fb24539a3d5e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:27.806158 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0f30502f-75f2-4122-b339-fb24539a3d5e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:27.806693 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0f30502f-75f2-4122-b339-fb24539a3d5e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:27.842870 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:28.310189 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0f30502f-75f2-4122-b339-fb24539a3d5e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:28.320243 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0f30502f-75f2-4122-b339-fb24539a3d5e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1527 microversion: 2.1 time: 0.590793 Jul 18 02:27:28.338288 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1472/2934] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:27 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1527 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:28.355446 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b34133f0-3495-4ad5-8da1-c92b5ffd314c tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:28.365985 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:27:28.365985 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 02:27:28.409032 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-b34133f0-3495-4ad5-8da1-c92b5ffd314c tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] HTTP exception thrown: Flavor f528b215-231b-4db9-8b70-332311acf682 could not be found. Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b34133f0-3495-4ad5-8da1-c92b5ffd314c tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Request method failure captured: Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/flavors/f528b215-231b-4db9-8b70-332311acf682 HTTP/1.1 Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MPZ5CvzcWxxTigvriMY3ZeQ5CkYu0GvIjFC4PXXvwvnqSAF0JEotTJGTjmPSjb-MuRHthFLMmHT10ii6NtFhTULebww1vTvTghbaNoECcciV5aNnyQKfEDF2mkVQGEyDMNTeQcdhtqBYbunUfhcHAsUGD6zlG-XlqyKEmf_9G6sU04 Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: c892a656afce454db6453aa4a64176d3 Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-MigrationsAdminTest-1050172301 Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,admin,reader Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,admin,reader Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c892a656afce454db6453aa4a64176d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c892a656afce454db6453aa4a64176d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c892a656afce454db6453aa4a64176d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c892a656afce454db6453aa4a64176d3"}]}] Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-MigrationsAdminTest-1050172301 Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: c892a656afce454db6453aa4a64176d3 Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-MigrationsAdminTest-1050172301 Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-MigrationsAdminTest-1050172301-project-admin Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 5692e834e08345d7bddfadf56cb41bc5 Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-MigrationsAdminTest-1050172301-project-admin Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: exception: Flavor f528b215-231b-4db9-8b70-332311acf682 could not be found. Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'f528b215-231b-4db9-8b70-332311acf682'} Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi flavor.destroy() Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor f528b215-231b-4db9-8b70-332311acf682 could not be found. Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor f528b215-231b-4db9-8b70-332311acf682 could not be found. Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:27:28.431868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:27:28.446475 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:27:28.446475 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:28.446475 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:27:28.446475 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:27:28.446475 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:27:28.446475 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:27:28.446475 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor f528b215-231b-4db9-8b70-332311acf682 could not be found. Jul 18 02:27:28.446475 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:27:28.446475 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b34133f0-3495-4ad5-8da1-c92b5ffd314c tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Returning 404 to user: Flavor f528b215-231b-4db9-8b70-332311acf682 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:27:28.446475 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b34133f0-3495-4ad5-8da1-c92b5ffd314c tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/f528b215-231b-4db9-8b70-332311acf682" status: 404 len: 109 microversion: 2.1 time: 0.088346 Jul 18 02:27:28.449897 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1463/2935] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:27:28 2022] DELETE /compute/v2.1/flavors/f528b215-231b-4db9-8b70-332311acf682 => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:27:28.510218 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a01883c5-0294-46b1-8b46-e125609a8b32 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:28.518216 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a01883c5-0294-46b1-8b46-e125609a8b32 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: 47e54256-b283-406c-80e8-cbf2622a1c9b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:28.547875 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a01883c5-0294-46b1-8b46-e125609a8b32 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:28.548341 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a01883c5-0294-46b1-8b46-e125609a8b32 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:28.549174 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a01883c5-0294-46b1-8b46-e125609a8b32 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:28.551833 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a01883c5-0294-46b1-8b46-e125609a8b32 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:28.748467 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bcc3a629-52a1-4e83-a5be-4b0637d76e5d tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:28.753673 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bcc3a629-52a1-4e83-a5be-4b0637d76e5d tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: d2dc65b8-8306-4f87-9af1-1cb5096c4ebf] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:28.785717 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bcc3a629-52a1-4e83-a5be-4b0637d76e5d tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:28.786685 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bcc3a629-52a1-4e83-a5be-4b0637d76e5d tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:28.788588 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bcc3a629-52a1-4e83-a5be-4b0637d76e5d tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:28.789418 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bcc3a629-52a1-4e83-a5be-4b0637d76e5d tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:29.225225 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a01883c5-0294-46b1-8b46-e125609a8b32 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11a308e70d4303a66ad8aaa9338961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65cd308906048719f3c79e73bdfa921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:29.240831 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a01883c5-0294-46b1-8b46-e125609a8b32 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "GET /compute/v2.1/servers/47e54256-b283-406c-80e8-cbf2622a1c9b" status: 200 len: 1508 microversion: 2.1 time: 0.739292 Jul 18 02:27:29.243895 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1473/2936] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:28 2022] GET /compute/v2.1/servers/47e54256-b283-406c-80e8-cbf2622a1c9b => generated 1508 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:29.251979 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6f72ad52-c2fc-4f7a-8f95-ee16e6cad0b6 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1001771213", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:29.364866 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-6f72ad52-c2fc-4f7a-8f95-ee16e6cad0b6 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] validate_networks() for None {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:27:29.881756 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bcc3a629-52a1-4e83-a5be-4b0637d76e5d tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:29.897395 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bcc3a629-52a1-4e83-a5be-4b0637d76e5d tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf" status: 200 len: 1315 microversion: 2.1 time: 1.157700 Jul 18 02:27:29.903872 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1464/2937] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:28 2022] GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf => generated 1315 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:27:29.910645 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9777d5b9-af8d-4355-bcd0-dd1b825317f1 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:29.914140 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9777d5b9-af8d-4355-bcd0-dd1b825317f1 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] [instance: 8573a671-62f5-4659-a227-bb1637b51430] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:29.935159 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9777d5b9-af8d-4355-bcd0-dd1b825317f1 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:29.936000 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9777d5b9-af8d-4355-bcd0-dd1b825317f1 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:29.937467 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9777d5b9-af8d-4355-bcd0-dd1b825317f1 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:29.938322 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9777d5b9-af8d-4355-bcd0-dd1b825317f1 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:30.219572 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9777d5b9-af8d-4355-bcd0-dd1b825317f1 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a08894c5e14d05b3a7b21001ff2740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a798824fb748c8889769282273bda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:30.249363 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9777d5b9-af8d-4355-bcd0-dd1b825317f1 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] 10.222.0.57 "GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430" status: 200 len: 1327 microversion: 2.1 time: 0.341956 Jul 18 02:27:30.250315 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1465/2938] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:29 2022] GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430 => generated 1327 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:30.280161 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2b6b0f45-7dd4-4b93-89fb-a749f33e5aaa tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:30.281207 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2b6b0f45-7dd4-4b93-89fb-a749f33e5aaa tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: 7c0f69bd-6236-4b98-a759-4b3c2a39ca6e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:30.319803 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2b6b0f45-7dd4-4b93-89fb-a749f33e5aaa tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:30.321163 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2b6b0f45-7dd4-4b93-89fb-a749f33e5aaa tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:30.322731 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2b6b0f45-7dd4-4b93-89fb-a749f33e5aaa tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:30.327177 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2b6b0f45-7dd4-4b93-89fb-a749f33e5aaa tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:30.949896 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:31.359936 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=14 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:31.371411 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-6f72ad52-c2fc-4f7a-8f95-ee16e6cad0b6 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:27:31.372352 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-6f72ad52-c2fc-4f7a-8f95-ee16e6cad0b6 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:27:31.374311 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-6f72ad52-c2fc-4f7a-8f95-ee16e6cad0b6 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:27:31.379143 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-6f72ad52-c2fc-4f7a-8f95-ee16e6cad0b6 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:27:31.380154 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-6f72ad52-c2fc-4f7a-8f95-ee16e6cad0b6 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:27:31.436783 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6f72ad52-c2fc-4f7a-8f95-ee16e6cad0b6 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:31.437866 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6f72ad52-c2fc-4f7a-8f95-ee16e6cad0b6 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:31.439645 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6f72ad52-c2fc-4f7a-8f95-ee16e6cad0b6 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:31.440644 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6f72ad52-c2fc-4f7a-8f95-ee16e6cad0b6 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:31.478268 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-6f72ad52-c2fc-4f7a-8f95-ee16e6cad0b6 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Getting quotas for project d7ff962145954166b4c5efb0a0f1edff. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:27:31.495577 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-6f72ad52-c2fc-4f7a-8f95-ee16e6cad0b6 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Getting quotas for user dbeea54ebc4749aba59afb60feaa6159 and project d7ff962145954166b4c5efb0a0f1edff. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:27:31.529160 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6f72ad52-c2fc-4f7a-8f95-ee16e6cad0b6 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:27:31.535245 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6f72ad52-c2fc-4f7a-8f95-ee16e6cad0b6 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:27:31.554674 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2b6b0f45-7dd4-4b93-89fb-a749f33e5aaa tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11a308e70d4303a66ad8aaa9338961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65cd308906048719f3c79e73bdfa921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:31.567567 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2b6b0f45-7dd4-4b93-89fb-a749f33e5aaa tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "GET /compute/v2.1/servers/7c0f69bd-6236-4b98-a759-4b3c2a39ca6e" status: 200 len: 1507 microversion: 2.1 time: 1.297713 Jul 18 02:27:31.582473 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1466/2939] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:30 2022] GET /compute/v2.1/servers/7c0f69bd-6236-4b98-a759-4b3c2a39ca6e => generated 1507 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:31.590686 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-49fb67ae-0528-44ad-a0f5-8277a35af258 req-4c4e4944-863d-44fa-9e09-ebb716019cfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2dc65b8-8306-4f87-9af1-1cb5096c4ebf", "tag": "25824420-6674-47c8-a379-4b1b0ef9b65b"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:31.608298 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-49fb67ae-0528-44ad-a0f5-8277a35af258 req-4c4e4944-863d-44fa-9e09-ebb716019cfb service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:31.609256 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-49fb67ae-0528-44ad-a0f5-8277a35af258 req-4c4e4944-863d-44fa-9e09-ebb716019cfb service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:31.635502 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-49fb67ae-0528-44ad-a0f5-8277a35af258 req-4c4e4944-863d-44fa-9e09-ebb716019cfb service nova] Creating event network-changed:25824420-6674-47c8-a379-4b1b0ef9b65b for instance d2dc65b8-8306-4f87-9af1-1cb5096c4ebf on n-h2-465891-3 Jul 18 02:27:31.643429 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-49fb67ae-0528-44ad-a0f5-8277a35af258 req-4c4e4944-863d-44fa-9e09-ebb716019cfb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058922 Jul 18 02:27:31.644977 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1467/2940] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:31.653626 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-65a57519-8d84-4df0-8998-f17b4ff44816 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:31.655478 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-65a57519-8d84-4df0-8998-f17b4ff44816 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: d2dc65b8-8306-4f87-9af1-1cb5096c4ebf] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:31.668568 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65a57519-8d84-4df0-8998-f17b4ff44816 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:31.669486 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65a57519-8d84-4df0-8998-f17b4ff44816 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:31.673736 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65a57519-8d84-4df0-8998-f17b4ff44816 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:31.679061 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65a57519-8d84-4df0-8998-f17b4ff44816 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:31.692017 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6f72ad52-c2fc-4f7a-8f95-ee16e6cad0b6 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.446150 Jul 18 02:27:31.698509 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1474/2941] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:27:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2454 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:27:31.723569 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-4d4160ec-3ed9-4eac-b33d-ea3bb52261ba req-4532c6f2-b921-412e-b0c9-6a49d2dbf4a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d", "name": "network-vif-plugged", "status": "completed", "tag": "34d35bd1-0f8c-4049-9360-7f9c95f734d8"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:31.801262 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-4d4160ec-3ed9-4eac-b33d-ea3bb52261ba req-4532c6f2-b921-412e-b0c9-6a49d2dbf4a5 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:31.806847 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-4d4160ec-3ed9-4eac-b33d-ea3bb52261ba req-4532c6f2-b921-412e-b0c9-6a49d2dbf4a5 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:31.842987 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-4d4160ec-3ed9-4eac-b33d-ea3bb52261ba req-4532c6f2-b921-412e-b0c9-6a49d2dbf4a5 service nova] Creating event network-vif-plugged:34d35bd1-0f8c-4049-9360-7f9c95f734d8 for instance a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d on n-h1-465891-3 Jul 18 02:27:31.855758 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-4d4160ec-3ed9-4eac-b33d-ea3bb52261ba req-4532c6f2-b921-412e-b0c9-6a49d2dbf4a5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153193 Jul 18 02:27:31.858016 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1475/2942] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:31.868808 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-08148543-6954-4c55-ba06-b763903dc478 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:31.870761 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-08148543-6954-4c55-ba06-b763903dc478 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] [instance: 8573a671-62f5-4659-a227-bb1637b51430] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:31.887109 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-08148543-6954-4c55-ba06-b763903dc478 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:31.888844 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-08148543-6954-4c55-ba06-b763903dc478 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:31.890684 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-08148543-6954-4c55-ba06-b763903dc478 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:31.891792 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-08148543-6954-4c55-ba06-b763903dc478 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:32.501737 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-65a57519-8d84-4df0-8998-f17b4ff44816 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:32.522769 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-65a57519-8d84-4df0-8998-f17b4ff44816 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf" status: 200 len: 1315 microversion: 2.1 time: 0.875974 Jul 18 02:27:32.527682 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1468/2943] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:31 2022] GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf => generated 1315 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:32.543401 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0b635499-c72d-4f71-81b4-0b77213b8e9f tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:32.544192 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0b635499-c72d-4f71-81b4-0b77213b8e9f tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: 7c0f69bd-6236-4b98-a759-4b3c2a39ca6e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:32.570766 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0b635499-c72d-4f71-81b4-0b77213b8e9f tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:32.571483 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0b635499-c72d-4f71-81b4-0b77213b8e9f tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:32.572525 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0b635499-c72d-4f71-81b4-0b77213b8e9f tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:32.573141 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0b635499-c72d-4f71-81b4-0b77213b8e9f tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:32.624211 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0b635499-c72d-4f71-81b4-0b77213b8e9f tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: 7c0f69bd-6236-4b98-a759-4b3c2a39ca6e] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:27:32.822816 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-08148543-6954-4c55-ba06-b763903dc478 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a08894c5e14d05b3a7b21001ff2740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a798824fb748c8889769282273bda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:32.858223 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-08148543-6954-4c55-ba06-b763903dc478 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] 10.222.0.57 "GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430" status: 200 len: 1394 microversion: 2.1 time: 0.996817 Jul 18 02:27:32.864043 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0b635499-c72d-4f71-81b4-0b77213b8e9f tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7c0f69bd-6236-4b98-a759-4b3c2a39ca6e" status: 204 len: 0 microversion: 2.1 time: 0.334238 Jul 18 02:27:32.869636 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1476/2944] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:31 2022] GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430 => generated 1394 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:32.879249 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1469/2945] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:27:32 2022] DELETE /compute/v2.1/servers/7c0f69bd-6236-4b98-a759-4b3c2a39ca6e => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:27:32.900138 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-43b148d6-e064-40ed-8938-6acea1b72eb5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:32.909490 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1c8ada55-5efb-43cc-b19e-cf0d99a55787 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:32.910564 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1c8ada55-5efb-43cc-b19e-cf0d99a55787 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: 47e54256-b283-406c-80e8-cbf2622a1c9b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:32.915228 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-43b148d6-e064-40ed-8938-6acea1b72eb5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:32.943119 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1c8ada55-5efb-43cc-b19e-cf0d99a55787 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:32.943813 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1c8ada55-5efb-43cc-b19e-cf0d99a55787 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:32.944852 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-43b148d6-e064-40ed-8938-6acea1b72eb5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:32.945258 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1c8ada55-5efb-43cc-b19e-cf0d99a55787 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:32.946379 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-43b148d6-e064-40ed-8938-6acea1b72eb5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:32.949642 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-43b148d6-e064-40ed-8938-6acea1b72eb5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:32.950614 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-43b148d6-e064-40ed-8938-6acea1b72eb5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:32.952180 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1c8ada55-5efb-43cc-b19e-cf0d99a55787 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:33.087320 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1c8ada55-5efb-43cc-b19e-cf0d99a55787 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: 47e54256-b283-406c-80e8-cbf2622a1c9b] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:27:33.257689 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-43b148d6-e064-40ed-8938-6acea1b72eb5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:33.271681 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-43b148d6-e064-40ed-8938-6acea1b72eb5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1217 microversion: 2.1 time: 0.397700 Jul 18 02:27:33.272337 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1477/2946] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:32 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1217 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:33.323797 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:33.399637 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1c8ada55-5efb-43cc-b19e-cf0d99a55787 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "DELETE /compute/v2.1/servers/47e54256-b283-406c-80e8-cbf2622a1c9b" status: 204 len: 0 microversion: 2.1 time: 0.512791 Jul 18 02:27:33.400641 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1470/2947] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:27:32 2022] DELETE /compute/v2.1/servers/47e54256-b283-406c-80e8-cbf2622a1c9b => generated 0 bytes in 516 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:27:33.567550 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7ed9af6a-de20-4eb6-9f0f-6ddce1c18d1c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:33.569075 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7ed9af6a-de20-4eb6-9f0f-6ddce1c18d1c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: d2dc65b8-8306-4f87-9af1-1cb5096c4ebf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:33.581158 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-26b25e1f-6cd1-40ea-a541-fa6b13aa0601 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-16720631", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "52703084-40e7-4a52-ac89-7f5781ece06d"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:33.627442 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7ed9af6a-de20-4eb6-9f0f-6ddce1c18d1c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:33.628872 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7ed9af6a-de20-4eb6-9f0f-6ddce1c18d1c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:33.630539 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7ed9af6a-de20-4eb6-9f0f-6ddce1c18d1c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:33.633447 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7ed9af6a-de20-4eb6-9f0f-6ddce1c18d1c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:33.736798 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-26b25e1f-6cd1-40ea-a541-fa6b13aa0601 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] validate_networks() for [('52703084-40e7-4a52-ac89-7f5781ece06d', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:27:35.368845 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7ed9af6a-de20-4eb6-9f0f-6ddce1c18d1c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:35.387649 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7ed9af6a-de20-4eb6-9f0f-6ddce1c18d1c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf" status: 200 len: 1315 microversion: 2.1 time: 1.826403 Jul 18 02:27:35.392818 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1478/2948] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:33 2022] GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf => generated 1315 bytes in 1832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:35.412658 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-afd3fffb-9749-4a72-b571-ef0c202a6641 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:35.416638 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-afd3fffb-9749-4a72-b571-ef0c202a6641 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] [instance: 8573a671-62f5-4659-a227-bb1637b51430] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:35.511113 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-afd3fffb-9749-4a72-b571-ef0c202a6641 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:35.517537 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-afd3fffb-9749-4a72-b571-ef0c202a6641 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:35.525879 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-afd3fffb-9749-4a72-b571-ef0c202a6641 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:35.536977 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-afd3fffb-9749-4a72-b571-ef0c202a6641 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:38.026994 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-afd3fffb-9749-4a72-b571-ef0c202a6641 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a08894c5e14d05b3a7b21001ff2740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a798824fb748c8889769282273bda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:38.044698 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-afd3fffb-9749-4a72-b571-ef0c202a6641 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] 10.222.0.57 "GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430" status: 200 len: 1394 microversion: 2.1 time: 2.648463 Jul 18 02:27:38.047603 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1479/2949] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:35 2022] GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430 => generated 1394 bytes in 2653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:38.068565 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6a89227a-f7fb-4149-abaf-39abee09c965 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:38.070089 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6a89227a-f7fb-4149-abaf-39abee09c965 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:38.091332 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a89227a-f7fb-4149-abaf-39abee09c965 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:38.095128 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a89227a-f7fb-4149-abaf-39abee09c965 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:38.096961 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a89227a-f7fb-4149-abaf-39abee09c965 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:38.098392 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a89227a-f7fb-4149-abaf-39abee09c965 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:39.310524 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-26b25e1f-6cd1-40ea-a541-fa6b13aa0601 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:27:39.312913 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-26b25e1f-6cd1-40ea-a541-fa6b13aa0601 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:27:39.314670 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-26b25e1f-6cd1-40ea-a541-fa6b13aa0601 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:27:39.316050 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-26b25e1f-6cd1-40ea-a541-fa6b13aa0601 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:27:39.317157 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-26b25e1f-6cd1-40ea-a541-fa6b13aa0601 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:27:39.351697 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26b25e1f-6cd1-40ea-a541-fa6b13aa0601 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:39.352426 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26b25e1f-6cd1-40ea-a541-fa6b13aa0601 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:39.353546 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26b25e1f-6cd1-40ea-a541-fa6b13aa0601 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:39.354234 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26b25e1f-6cd1-40ea-a541-fa6b13aa0601 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:39.380135 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-26b25e1f-6cd1-40ea-a541-fa6b13aa0601 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Getting quotas for project d65cd308906048719f3c79e73bdfa921. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:27:39.388744 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-26b25e1f-6cd1-40ea-a541-fa6b13aa0601 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Getting quotas for user 9f11a308e70d4303a66ad8aaa9338961 and project d65cd308906048719f3c79e73bdfa921. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:27:39.413490 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:39.415428 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-26b25e1f-6cd1-40ea-a541-fa6b13aa0601 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Going to run 2 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:27:39.418262 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-26b25e1f-6cd1-40ea-a541-fa6b13aa0601 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: a86263d1-e36b-4902-acd0-4b00da0a6674] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:27:39.474441 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-26b25e1f-6cd1-40ea-a541-fa6b13aa0601 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: 9c92379e-52ee-4764-b3f8-bad9c89e0a8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=a86263d1-e36b-4902-acd0-4b00da0a6674,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:27:39.564022 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-26b25e1f-6cd1-40ea-a541-fa6b13aa0601 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 5.990574 Jul 18 02:27:39.568167 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1471/2950] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:27:33 2022] POST /compute/v2.1/servers => generated 32 bytes in 5998 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Jul 18 02:27:39.582987 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-edf6bca9-de95-4ac2-9ed7-dffb779900f0 req-e4755ec0-565e-4ef7-b204-e4d571e12da5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8573a671-62f5-4659-a227-bb1637b51430", "tag": "c09a4505-eb19-44b0-a058-fbd5d5a5317b"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:39.605189 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-edf6bca9-de95-4ac2-9ed7-dffb779900f0 req-e4755ec0-565e-4ef7-b204-e4d571e12da5 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:39.606239 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-edf6bca9-de95-4ac2-9ed7-dffb779900f0 req-e4755ec0-565e-4ef7-b204-e4d571e12da5 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:39.622090 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-edf6bca9-de95-4ac2-9ed7-dffb779900f0 req-e4755ec0-565e-4ef7-b204-e4d571e12da5 service nova] Creating event network-changed:c09a4505-eb19-44b0-a058-fbd5d5a5317b for instance 8573a671-62f5-4659-a227-bb1637b51430 on n-h1-465891-3 Jul 18 02:27:39.631514 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-edf6bca9-de95-4ac2-9ed7-dffb779900f0 req-e4755ec0-565e-4ef7-b204-e4d571e12da5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061359 Jul 18 02:27:39.632868 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1472/2951] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:40.130190 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6a89227a-f7fb-4149-abaf-39abee09c965 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:40.149174 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6a89227a-f7fb-4149-abaf-39abee09c965 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1313 microversion: 2.1 time: 2.097382 Jul 18 02:27:40.150937 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1480/2952] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:38 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1313 bytes in 2102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:40.164365 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b7d094e8-f5f8-4d85-a777-b5433c116acb tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:40.166456 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b7d094e8-f5f8-4d85-a777-b5433c116acb tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] [instance: 8573a671-62f5-4659-a227-bb1637b51430] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:40.180826 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b7d094e8-f5f8-4d85-a777-b5433c116acb tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:40.182247 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b7d094e8-f5f8-4d85-a777-b5433c116acb tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:40.189472 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b7d094e8-f5f8-4d85-a777-b5433c116acb tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:40.191380 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b7d094e8-f5f8-4d85-a777-b5433c116acb tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:40.276754 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b68df912-3e30-47c5-b625-0a6db2992c8c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:40.277930 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b68df912-3e30-47c5-b625-0a6db2992c8c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: d2dc65b8-8306-4f87-9af1-1cb5096c4ebf] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:40.308133 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b68df912-3e30-47c5-b625-0a6db2992c8c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:40.312903 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b68df912-3e30-47c5-b625-0a6db2992c8c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:40.317422 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b68df912-3e30-47c5-b625-0a6db2992c8c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:40.320029 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b68df912-3e30-47c5-b625-0a6db2992c8c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:41.349621 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b7d094e8-f5f8-4d85-a777-b5433c116acb tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a08894c5e14d05b3a7b21001ff2740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a798824fb748c8889769282273bda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:41.366322 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b7d094e8-f5f8-4d85-a777-b5433c116acb tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] 10.222.0.57 "GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430" status: 200 len: 1394 microversion: 2.1 time: 1.213214 Jul 18 02:27:41.367403 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1481/2953] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:40 2022] GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430 => generated 1394 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:41.376449 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-df6c8617-c700-443d-8bfd-6e1a5800c60f tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:41.393046 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-df6c8617-c700-443d-8bfd-6e1a5800c60f tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9f11a308e70d4303a66ad8aaa9338961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65cd308906048719f3c79e73bdfa921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:41.394185 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-df6c8617-c700-443d-8bfd-6e1a5800c60f tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Searching by: {'deleted': False, 'project_id': 'd65cd308906048719f3c79e73bdfa921'} {{(pid=119543) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:27:41.411911 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-df6c8617-c700-443d-8bfd-6e1a5800c60f tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:41.412815 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-df6c8617-c700-443d-8bfd-6e1a5800c60f tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:41.414114 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-df6c8617-c700-443d-8bfd-6e1a5800c60f tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:41.414797 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-df6c8617-c700-443d-8bfd-6e1a5800c60f tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:41.483594 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.multi_cell_list [None req-df6c8617-c700-443d-8bfd-6e1a5800c60f tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119543) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:27:41.558148 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:41.580129 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-df6c8617-c700-443d-8bfd-6e1a5800c60f tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "GET /compute/v2.1/servers" status: 200 len: 1000 microversion: 2.1 time: 0.211259 Jul 18 02:27:41.583460 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1482/2954] 10.222.0.57 () {58 vars in 1124 bytes} [Mon Jul 18 02:27:41 2022] GET /compute/v2.1/servers => generated 1000 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:41.602625 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-ea6ad8f2-59a0-4a96-ad6c-13f46c454737 req-7086bf30-bbd1-4308-a9bc-2f0d78b8128c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c0f69bd-6236-4b98-a759-4b3c2a39ca6e", "name": "network-vif-deleted", "tag": "4acd2913-7dcc-400c-881f-16ff9755c0b0"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:41.650065 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-ea6ad8f2-59a0-4a96-ad6c-13f46c454737 req-7086bf30-bbd1-4308-a9bc-2f0d78b8128c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:41.652703 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-ea6ad8f2-59a0-4a96-ad6c-13f46c454737 req-7086bf30-bbd1-4308-a9bc-2f0d78b8128c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:41.704556 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b68df912-3e30-47c5-b625-0a6db2992c8c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:41.718327 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-ea6ad8f2-59a0-4a96-ad6c-13f46c454737 req-7086bf30-bbd1-4308-a9bc-2f0d78b8128c service nova] Creating event network-vif-deleted:4acd2913-7dcc-400c-881f-16ff9755c0b0 for instance 7c0f69bd-6236-4b98-a759-4b3c2a39ca6e on n-h2-465891-3 Jul 18 02:27:41.733508 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b68df912-3e30-47c5-b625-0a6db2992c8c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf" status: 200 len: 1315 microversion: 2.1 time: 2.093437 Jul 18 02:27:41.734782 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1473/2955] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:39 2022] GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf => generated 1315 bytes in 2101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:41.750696 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-ea6ad8f2-59a0-4a96-ad6c-13f46c454737 req-7086bf30-bbd1-4308-a9bc-2f0d78b8128c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156010 Jul 18 02:27:41.754812 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1483/2956] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:41.758976 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-488774a6-571f-4de0-ae28-705fab666e34 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:41.766059 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-488774a6-571f-4de0-ae28-705fab666e34 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:41.782917 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a4c7f107-3bde-4199-b1e8-494bca0126f7 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:41.786099 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a4c7f107-3bde-4199-b1e8-494bca0126f7 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: 9c92379e-52ee-4764-b3f8-bad9c89e0a8f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:41.801470 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-488774a6-571f-4de0-ae28-705fab666e34 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:41.813877 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-488774a6-571f-4de0-ae28-705fab666e34 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:41.818226 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-488774a6-571f-4de0-ae28-705fab666e34 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:41.838915 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a4c7f107-3bde-4199-b1e8-494bca0126f7 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:41.839699 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-488774a6-571f-4de0-ae28-705fab666e34 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:41.847749 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a4c7f107-3bde-4199-b1e8-494bca0126f7 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:41.849518 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a4c7f107-3bde-4199-b1e8-494bca0126f7 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:41.856719 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a4c7f107-3bde-4199-b1e8-494bca0126f7 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:42.179256 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a4c7f107-3bde-4199-b1e8-494bca0126f7 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11a308e70d4303a66ad8aaa9338961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65cd308906048719f3c79e73bdfa921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:42.204487 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a4c7f107-3bde-4199-b1e8-494bca0126f7 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "GET /compute/v2.1/servers/9c92379e-52ee-4764-b3f8-bad9c89e0a8f" status: 200 len: 1212 microversion: 2.1 time: 0.436355 Jul 18 02:27:42.206008 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1484/2957] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:41 2022] GET /compute/v2.1/servers/9c92379e-52ee-4764-b3f8-bad9c89e0a8f => generated 1212 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:42.387355 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4868fef5-d997-4293-ad7d-cb3dbeec18bb tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:42.389185 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4868fef5-d997-4293-ad7d-cb3dbeec18bb tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] [instance: 8573a671-62f5-4659-a227-bb1637b51430] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:42.406778 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4868fef5-d997-4293-ad7d-cb3dbeec18bb tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:42.408044 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4868fef5-d997-4293-ad7d-cb3dbeec18bb tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:42.409336 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4868fef5-d997-4293-ad7d-cb3dbeec18bb tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:42.410195 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4868fef5-d997-4293-ad7d-cb3dbeec18bb tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:42.575863 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-488774a6-571f-4de0-ae28-705fab666e34 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:42.632051 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-488774a6-571f-4de0-ae28-705fab666e34 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1313 microversion: 2.1 time: 0.890604 Jul 18 02:27:42.637762 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1474/2958] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:41 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1313 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:42.764444 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bebd9de2-aced-4f48-96c8-f7d304a055fc tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:42.767789 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bebd9de2-aced-4f48-96c8-f7d304a055fc tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: d2dc65b8-8306-4f87-9af1-1cb5096c4ebf] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:42.792826 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bebd9de2-aced-4f48-96c8-f7d304a055fc tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:42.796714 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bebd9de2-aced-4f48-96c8-f7d304a055fc tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:42.817291 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bebd9de2-aced-4f48-96c8-f7d304a055fc tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:42.821900 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bebd9de2-aced-4f48-96c8-f7d304a055fc tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:44.214263 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4868fef5-d997-4293-ad7d-cb3dbeec18bb tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a08894c5e14d05b3a7b21001ff2740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a798824fb748c8889769282273bda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:44.229542 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4868fef5-d997-4293-ad7d-cb3dbeec18bb tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] 10.222.0.57 "GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430" status: 200 len: 1394 microversion: 2.1 time: 1.841980 Jul 18 02:27:44.232208 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1485/2959] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:42 2022] GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430 => generated 1394 bytes in 1851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:27:44.250117 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8800120b-6246-4c87-bbaf-d5e583d307a2 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:44.251328 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8800120b-6246-4c87-bbaf-d5e583d307a2 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: 9c92379e-52ee-4764-b3f8-bad9c89e0a8f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:44.271038 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8800120b-6246-4c87-bbaf-d5e583d307a2 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:44.272076 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8800120b-6246-4c87-bbaf-d5e583d307a2 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:44.273290 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8800120b-6246-4c87-bbaf-d5e583d307a2 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:44.274548 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8800120b-6246-4c87-bbaf-d5e583d307a2 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:44.548027 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8800120b-6246-4c87-bbaf-d5e583d307a2 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11a308e70d4303a66ad8aaa9338961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65cd308906048719f3c79e73bdfa921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:44.560450 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8800120b-6246-4c87-bbaf-d5e583d307a2 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "GET /compute/v2.1/servers/9c92379e-52ee-4764-b3f8-bad9c89e0a8f" status: 200 len: 1274 microversion: 2.1 time: 0.326719 Jul 18 02:27:44.561523 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1486/2960] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:44 2022] GET /compute/v2.1/servers/9c92379e-52ee-4764-b3f8-bad9c89e0a8f => generated 1274 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:44.595379 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d84a1b1a-fc38-40fe-9fd0-3a0f62eec311 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:44.596313 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d84a1b1a-fc38-40fe-9fd0-3a0f62eec311 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:44.603057 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d84a1b1a-fc38-40fe-9fd0-3a0f62eec311 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:44.603840 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d84a1b1a-fc38-40fe-9fd0-3a0f62eec311 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:44.605021 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d84a1b1a-fc38-40fe-9fd0-3a0f62eec311 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:44.605665 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d84a1b1a-fc38-40fe-9fd0-3a0f62eec311 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:44.684229 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bebd9de2-aced-4f48-96c8-f7d304a055fc tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:44.693872 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bebd9de2-aced-4f48-96c8-f7d304a055fc tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf" status: 200 len: 1315 microversion: 2.1 time: 1.939342 Jul 18 02:27:44.694876 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1475/2961] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:42 2022] GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf => generated 1315 bytes in 1942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:44.700354 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-57b0a5c5-f339-43e4-b074-8b3e3b9471aa req-9e77eec6-e4b9-4af0-aa58-1a53d9781245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47e54256-b283-406c-80e8-cbf2622a1c9b", "name": "network-vif-deleted", "tag": "f0088fe1-7b29-421f-99da-6f5670175091"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:44.719638 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-57b0a5c5-f339-43e4-b074-8b3e3b9471aa req-9e77eec6-e4b9-4af0-aa58-1a53d9781245 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:44.720610 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-57b0a5c5-f339-43e4-b074-8b3e3b9471aa req-9e77eec6-e4b9-4af0-aa58-1a53d9781245 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:44.735318 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-57b0a5c5-f339-43e4-b074-8b3e3b9471aa req-9e77eec6-e4b9-4af0-aa58-1a53d9781245 service nova] Creating event network-vif-deleted:f0088fe1-7b29-421f-99da-6f5670175091 for instance 47e54256-b283-406c-80e8-cbf2622a1c9b on n-h1-465891-3 Jul 18 02:27:44.741692 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-57b0a5c5-f339-43e4-b074-8b3e3b9471aa req-9e77eec6-e4b9-4af0-aa58-1a53d9781245 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045482 Jul 18 02:27:44.742694 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1476/2962] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:45.155722 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d84a1b1a-fc38-40fe-9fd0-3a0f62eec311 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:45.175456 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d84a1b1a-fc38-40fe-9fd0-3a0f62eec311 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1313 microversion: 2.1 time: 0.596298 Jul 18 02:27:45.185286 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1487/2963] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:44 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1313 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:45.249887 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bccf8ee9-917e-4ab1-9bcb-1ac001713a2e tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:45.252426 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bccf8ee9-917e-4ab1-9bcb-1ac001713a2e tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] [instance: 8573a671-62f5-4659-a227-bb1637b51430] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:45.276026 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bccf8ee9-917e-4ab1-9bcb-1ac001713a2e tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:45.276492 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bccf8ee9-917e-4ab1-9bcb-1ac001713a2e tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:45.277324 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bccf8ee9-917e-4ab1-9bcb-1ac001713a2e tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:45.277804 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bccf8ee9-917e-4ab1-9bcb-1ac001713a2e tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:45.581246 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7bc3076d-550a-4c5a-ae52-d3c2ba7bb89b tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:45.582145 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7bc3076d-550a-4c5a-ae52-d3c2ba7bb89b tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: 9c92379e-52ee-4764-b3f8-bad9c89e0a8f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:45.598770 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7bc3076d-550a-4c5a-ae52-d3c2ba7bb89b tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:45.600677 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7bc3076d-550a-4c5a-ae52-d3c2ba7bb89b tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:45.603696 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7bc3076d-550a-4c5a-ae52-d3c2ba7bb89b tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:45.606730 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7bc3076d-550a-4c5a-ae52-d3c2ba7bb89b tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:45.934791 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7bc3076d-550a-4c5a-ae52-d3c2ba7bb89b tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11a308e70d4303a66ad8aaa9338961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65cd308906048719f3c79e73bdfa921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:45.952928 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7bc3076d-550a-4c5a-ae52-d3c2ba7bb89b tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "GET /compute/v2.1/servers/9c92379e-52ee-4764-b3f8-bad9c89e0a8f" status: 200 len: 1274 microversion: 2.1 time: 0.376819 Jul 18 02:27:45.962118 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1488/2964] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:45 2022] GET /compute/v2.1/servers/9c92379e-52ee-4764-b3f8-bad9c89e0a8f => generated 1274 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:27:45.986954 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-c2c683f8-2db2-4d51-aa09-a49557d50531 req-b18c11d8-d8dd-4496-98dc-e8e1f29b59c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2dc65b8-8306-4f87-9af1-1cb5096c4ebf", "name": "network-vif-plugged", "status": "completed", "tag": "25824420-6674-47c8-a379-4b1b0ef9b65b"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:46.010778 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-c2c683f8-2db2-4d51-aa09-a49557d50531 req-b18c11d8-d8dd-4496-98dc-e8e1f29b59c2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:46.015351 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-c2c683f8-2db2-4d51-aa09-a49557d50531 req-b18c11d8-d8dd-4496-98dc-e8e1f29b59c2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:46.047489 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-c2c683f8-2db2-4d51-aa09-a49557d50531 req-b18c11d8-d8dd-4496-98dc-e8e1f29b59c2 service nova] Creating event network-vif-plugged:25824420-6674-47c8-a379-4b1b0ef9b65b for instance d2dc65b8-8306-4f87-9af1-1cb5096c4ebf on n-h2-465891-3 Jul 18 02:27:46.062289 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-c2c683f8-2db2-4d51-aa09-a49557d50531 req-b18c11d8-d8dd-4496-98dc-e8e1f29b59c2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097746 Jul 18 02:27:46.065932 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1489/2965] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:46.079557 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e91ffc9c-aa2c-4326-bd13-b4990aae98d8 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:46.081044 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e91ffc9c-aa2c-4326-bd13-b4990aae98d8 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: d2dc65b8-8306-4f87-9af1-1cb5096c4ebf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:46.096462 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e91ffc9c-aa2c-4326-bd13-b4990aae98d8 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:46.097186 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e91ffc9c-aa2c-4326-bd13-b4990aae98d8 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:46.100712 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e91ffc9c-aa2c-4326-bd13-b4990aae98d8 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:46.101487 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e91ffc9c-aa2c-4326-bd13-b4990aae98d8 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:46.539753 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bccf8ee9-917e-4ab1-9bcb-1ac001713a2e tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a08894c5e14d05b3a7b21001ff2740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a798824fb748c8889769282273bda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:46.554113 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bccf8ee9-917e-4ab1-9bcb-1ac001713a2e tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] 10.222.0.57 "GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430" status: 200 len: 1394 microversion: 2.1 time: 1.307891 Jul 18 02:27:46.557730 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1477/2966] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:45 2022] GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430 => generated 1394 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:46.569473 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6df4eb8d-25a3-4711-b54c-c6a134daeb5f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:46.570952 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6df4eb8d-25a3-4711-b54c-c6a134daeb5f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:46.584735 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6df4eb8d-25a3-4711-b54c-c6a134daeb5f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:46.586334 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6df4eb8d-25a3-4711-b54c-c6a134daeb5f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:46.588852 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6df4eb8d-25a3-4711-b54c-c6a134daeb5f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:46.595348 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6df4eb8d-25a3-4711-b54c-c6a134daeb5f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:47.012803 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e91ffc9c-aa2c-4326-bd13-b4990aae98d8 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:47.032893 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e91ffc9c-aa2c-4326-bd13-b4990aae98d8 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf" status: 200 len: 1315 microversion: 2.1 time: 0.961574 Jul 18 02:27:47.033179 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1490/2967] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:46 2022] GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf => generated 1315 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:47.214378 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a0ce9718-9de5-4300-b19f-25c162ffc4c4 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1031984639", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "af1ceb45-85ae-4d3a-bba1-662e79e0785f"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:47.258171 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:47.321293 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-a0ce9718-9de5-4300-b19f-25c162ffc4c4 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] validate_networks() for [('af1ceb45-85ae-4d3a-bba1-662e79e0785f', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:27:47.568842 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6df4eb8d-25a3-4711-b54c-c6a134daeb5f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:47.577881 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6df4eb8d-25a3-4711-b54c-c6a134daeb5f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1313 microversion: 2.1 time: 1.018389 Jul 18 02:27:47.578490 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1478/2968] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:46 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1313 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:47.604242 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-42eb178e-2206-474b-bfe4-1546e891affd tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:47.604959 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-42eb178e-2206-474b-bfe4-1546e891affd tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: 9c92379e-52ee-4764-b3f8-bad9c89e0a8f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:47.630907 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-42eb178e-2206-474b-bfe4-1546e891affd tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:47.634818 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-42eb178e-2206-474b-bfe4-1546e891affd tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:47.636710 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-42eb178e-2206-474b-bfe4-1546e891affd tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:47.638561 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-42eb178e-2206-474b-bfe4-1546e891affd tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:47.925790 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-42eb178e-2206-474b-bfe4-1546e891affd tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11a308e70d4303a66ad8aaa9338961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65cd308906048719f3c79e73bdfa921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:47.950523 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-42eb178e-2206-474b-bfe4-1546e891affd tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "GET /compute/v2.1/servers/9c92379e-52ee-4764-b3f8-bad9c89e0a8f" status: 200 len: 1274 microversion: 2.1 time: 0.363827 Jul 18 02:27:47.953528 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1479/2969] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:47 2022] GET /compute/v2.1/servers/9c92379e-52ee-4764-b3f8-bad9c89e0a8f => generated 1274 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:47.960351 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-be1c904d-8a8b-4d56-b885-7aab56fc0bf5 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:47.961439 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-be1c904d-8a8b-4d56-b885-7aab56fc0bf5 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] [instance: 8573a671-62f5-4659-a227-bb1637b51430] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:47.981244 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-be1c904d-8a8b-4d56-b885-7aab56fc0bf5 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:47.983877 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-be1c904d-8a8b-4d56-b885-7aab56fc0bf5 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:47.999577 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-be1c904d-8a8b-4d56-b885-7aab56fc0bf5 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:48.005512 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-be1c904d-8a8b-4d56-b885-7aab56fc0bf5 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:49.369013 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:49.409031 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:49.492620 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-be1c904d-8a8b-4d56-b885-7aab56fc0bf5 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a08894c5e14d05b3a7b21001ff2740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a798824fb748c8889769282273bda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:49.522121 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-be1c904d-8a8b-4d56-b885-7aab56fc0bf5 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] 10.222.0.57 "GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430" status: 200 len: 1394 microversion: 2.1 time: 1.566231 Jul 18 02:27:49.523040 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1480/2970] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:47 2022] GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430 => generated 1394 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:49.529314 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-bcb31d9a-7788-454e-9d04-0f5963f9cc3d req-123ec6ed-f266-4297-a54a-891329665802 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f19c9c9-419d-4b9a-abdc-432a65381922", "tag": "39add5b7-15aa-4a44-a79b-7041ecfeb6be"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:49.567432 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-bcb31d9a-7788-454e-9d04-0f5963f9cc3d req-123ec6ed-f266-4297-a54a-891329665802 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:49.568389 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-bcb31d9a-7788-454e-9d04-0f5963f9cc3d req-123ec6ed-f266-4297-a54a-891329665802 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:49.586164 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-bcb31d9a-7788-454e-9d04-0f5963f9cc3d req-123ec6ed-f266-4297-a54a-891329665802 service nova] Creating event network-changed:39add5b7-15aa-4a44-a79b-7041ecfeb6be for instance 9f19c9c9-419d-4b9a-abdc-432a65381922 on n-h2-465891-3 Jul 18 02:27:49.593472 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-bcb31d9a-7788-454e-9d04-0f5963f9cc3d req-123ec6ed-f266-4297-a54a-891329665802 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068776 Jul 18 02:27:49.596153 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1481/2971] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:49.603158 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7eb17f1b-a547-40a9-aa4f-4f33916275dc tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:49.604398 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7eb17f1b-a547-40a9-aa4f-4f33916275dc tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: d2dc65b8-8306-4f87-9af1-1cb5096c4ebf] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:49.612135 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7eb17f1b-a547-40a9-aa4f-4f33916275dc tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:49.613091 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7eb17f1b-a547-40a9-aa4f-4f33916275dc tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:49.614310 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7eb17f1b-a547-40a9-aa4f-4f33916275dc tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:49.615246 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7eb17f1b-a547-40a9-aa4f-4f33916275dc tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:49.633006 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-a0ce9718-9de5-4300-b19f-25c162ffc4c4 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:27:49.633837 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-a0ce9718-9de5-4300-b19f-25c162ffc4c4 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:27:49.634762 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-a0ce9718-9de5-4300-b19f-25c162ffc4c4 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:27:49.635465 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-a0ce9718-9de5-4300-b19f-25c162ffc4c4 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:27:49.636233 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-a0ce9718-9de5-4300-b19f-25c162ffc4c4 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:27:49.676900 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a0ce9718-9de5-4300-b19f-25c162ffc4c4 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:49.677788 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a0ce9718-9de5-4300-b19f-25c162ffc4c4 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:49.679311 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a0ce9718-9de5-4300-b19f-25c162ffc4c4 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:49.680136 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a0ce9718-9de5-4300-b19f-25c162ffc4c4 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:49.706702 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-a0ce9718-9de5-4300-b19f-25c162ffc4c4 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Getting quotas for project 31a022827cbe40e48709ae4ca21048cb. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:27:49.713388 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-a0ce9718-9de5-4300-b19f-25c162ffc4c4 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Getting quotas for user d4c4c797bfe143049d603541d8327e57 and project 31a022827cbe40e48709ae4ca21048cb. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:27:49.736227 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a0ce9718-9de5-4300-b19f-25c162ffc4c4 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Going to run 3 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:27:49.739547 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a0ce9718-9de5-4300-b19f-25c162ffc4c4 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] [instance: d6e5a9a2-964e-4c0a-8aed-d791ebac803a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:27:49.793652 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a0ce9718-9de5-4300-b19f-25c162ffc4c4 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] [instance: f78c2991-4119-43e9-a66c-519524b33977] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=d6e5a9a2-964e-4c0a-8aed-d791ebac803a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:27:49.897951 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a0ce9718-9de5-4300-b19f-25c162ffc4c4 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] [instance: 5f83aa0b-12f7-42c3-8dda-d5f45b817a93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=f78c2991-4119-43e9-a66c-519524b33977,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:27:50.142285 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a0ce9718-9de5-4300-b19f-25c162ffc4c4 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.106327 Jul 18 02:27:50.145519 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1491/2972] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:27:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 3112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:27:50.162832 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d86fcfa6-fe97-41cb-8bf3-a2bf4ed7f622 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:50.163956 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d86fcfa6-fe97-41cb-8bf3-a2bf4ed7f622 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:50.180688 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d86fcfa6-fe97-41cb-8bf3-a2bf4ed7f622 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:50.181508 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d86fcfa6-fe97-41cb-8bf3-a2bf4ed7f622 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:50.182965 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d86fcfa6-fe97-41cb-8bf3-a2bf4ed7f622 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:50.183764 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d86fcfa6-fe97-41cb-8bf3-a2bf4ed7f622 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:50.281326 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:50.409803 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7eb17f1b-a547-40a9-aa4f-4f33916275dc tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:50.426330 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7eb17f1b-a547-40a9-aa4f-4f33916275dc tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf" status: 200 len: 1502 microversion: 2.1 time: 0.828249 Jul 18 02:27:50.427038 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1482/2973] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:49 2022] GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf => generated 1502 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:50.443996 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-269fad45-97c3-493b-ae60-58fc2bbf3425 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:50.445069 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-269fad45-97c3-493b-ae60-58fc2bbf3425 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: 9c92379e-52ee-4764-b3f8-bad9c89e0a8f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:50.462910 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-269fad45-97c3-493b-ae60-58fc2bbf3425 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:50.463386 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-269fad45-97c3-493b-ae60-58fc2bbf3425 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:50.464398 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-269fad45-97c3-493b-ae60-58fc2bbf3425 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:50.472657 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-269fad45-97c3-493b-ae60-58fc2bbf3425 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:51.234547 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d86fcfa6-fe97-41cb-8bf3-a2bf4ed7f622 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:51.281326 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d86fcfa6-fe97-41cb-8bf3-a2bf4ed7f622 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1313 microversion: 2.1 time: 1.132570 Jul 18 02:27:51.285730 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1492/2974] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:50 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1313 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:51.312306 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f544e36a-544c-4600-bf51-40d94d90830e tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:51.352493 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f544e36a-544c-4600-bf51-40d94d90830e tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4c4c797bfe143049d603541d8327e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a022827cbe40e48709ae4ca21048cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:51.361485 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f544e36a-544c-4600-bf51-40d94d90830e tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Searching by: {'deleted': False, 'project_id': '31a022827cbe40e48709ae4ca21048cb'} {{(pid=119543) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:27:51.441781 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f544e36a-544c-4600-bf51-40d94d90830e tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:51.441781 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f544e36a-544c-4600-bf51-40d94d90830e tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:51.443154 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f544e36a-544c-4600-bf51-40d94d90830e tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:51.443617 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f544e36a-544c-4600-bf51-40d94d90830e tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:51.493603 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f544e36a-544c-4600-bf51-40d94d90830e tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.200559 Jul 18 02:27:51.509761 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1493/2975] 10.222.0.57 () {58 vars in 1124 bytes} [Mon Jul 18 02:27:51 2022] GET /compute/v2.1/servers => generated 1018 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:51.524903 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1023ce07-70f6-4802-9d7f-a9b2e38c57b2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:51.537315 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1023ce07-70f6-4802-9d7f-a9b2e38c57b2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:51.554000 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1023ce07-70f6-4802-9d7f-a9b2e38c57b2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:51.675582 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1023ce07-70f6-4802-9d7f-a9b2e38c57b2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: d2dc65b8-8306-4f87-9af1-1cb5096c4ebf] Going to try to stop instance {{(pid=119543) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 02:27:51.835104 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1023ce07-70f6-4802-9d7f-a9b2e38c57b2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "POST /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf/action" status: 202 len: 0 microversion: 2.1 time: 0.323318 Jul 18 02:27:51.847142 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1494/2976] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:27:51 2022] POST /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:27:51.867850 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-acad1d7c-7651-4642-97db-42312dd5d5f5 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:51.869264 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-acad1d7c-7651-4642-97db-42312dd5d5f5 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] [instance: 8573a671-62f5-4659-a227-bb1637b51430] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:51.886482 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-acad1d7c-7651-4642-97db-42312dd5d5f5 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:51.887667 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-acad1d7c-7651-4642-97db-42312dd5d5f5 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:51.889730 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-acad1d7c-7651-4642-97db-42312dd5d5f5 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:51.890857 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-acad1d7c-7651-4642-97db-42312dd5d5f5 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:52.101257 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-269fad45-97c3-493b-ae60-58fc2bbf3425 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11a308e70d4303a66ad8aaa9338961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65cd308906048719f3c79e73bdfa921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:52.124651 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-269fad45-97c3-493b-ae60-58fc2bbf3425 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "GET /compute/v2.1/servers/9c92379e-52ee-4764-b3f8-bad9c89e0a8f" status: 200 len: 1316 microversion: 2.1 time: 1.691945 Jul 18 02:27:52.126662 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1483/2977] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:50 2022] GET /compute/v2.1/servers/9c92379e-52ee-4764-b3f8-bad9c89e0a8f => generated 1316 bytes in 1699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:52.144835 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-ef7473a3-84d7-4708-8216-12355dd98673 req-b961e7d9-cbf5-4b8f-b280-86382343d5b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8573a671-62f5-4659-a227-bb1637b51430", "name": "network-vif-plugged", "status": "completed", "tag": "c09a4505-eb19-44b0-a058-fbd5d5a5317b"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:52.181957 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-ef7473a3-84d7-4708-8216-12355dd98673 req-b961e7d9-cbf5-4b8f-b280-86382343d5b5 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:52.182770 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-ef7473a3-84d7-4708-8216-12355dd98673 req-b961e7d9-cbf5-4b8f-b280-86382343d5b5 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:52.230991 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-ef7473a3-84d7-4708-8216-12355dd98673 req-b961e7d9-cbf5-4b8f-b280-86382343d5b5 service nova] Creating event network-vif-plugged:c09a4505-eb19-44b0-a058-fbd5d5a5317b for instance 8573a671-62f5-4659-a227-bb1637b51430 on n-h1-465891-3 Jul 18 02:27:52.260585 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-ef7473a3-84d7-4708-8216-12355dd98673 req-b961e7d9-cbf5-4b8f-b280-86382343d5b5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129635 Jul 18 02:27:52.261640 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1484/2978] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:52.282280 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-06d7bbd2-89dd-42ad-b700-e464da1f21ba tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:52.300798 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-06d7bbd2-89dd-42ad-b700-e464da1f21ba tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] [instance: 5f83aa0b-12f7-42c3-8dda-d5f45b817a93] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:52.738945 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-06d7bbd2-89dd-42ad-b700-e464da1f21ba tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c4c797bfe143049d603541d8327e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a022827cbe40e48709ae4ca21048cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:52.818044 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-06d7bbd2-89dd-42ad-b700-e464da1f21ba tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "GET /compute/v2.1/servers/5f83aa0b-12f7-42c3-8dda-d5f45b817a93" status: 200 len: 1223 microversion: 2.1 time: 0.553863 Jul 18 02:27:52.823674 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1485/2979] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:52 2022] GET /compute/v2.1/servers/5f83aa0b-12f7-42c3-8dda-d5f45b817a93 => generated 1223 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:52.835895 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-34516bd3-cef2-4eff-900a-4df3295899df tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:52.836963 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-34516bd3-cef2-4eff-900a-4df3295899df tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: d2dc65b8-8306-4f87-9af1-1cb5096c4ebf] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:52.848751 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-34516bd3-cef2-4eff-900a-4df3295899df tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:52.849694 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-34516bd3-cef2-4eff-900a-4df3295899df tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:52.850844 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-34516bd3-cef2-4eff-900a-4df3295899df tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:52.851685 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-34516bd3-cef2-4eff-900a-4df3295899df tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:53.366051 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-acad1d7c-7651-4642-97db-42312dd5d5f5 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a08894c5e14d05b3a7b21001ff2740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a798824fb748c8889769282273bda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:53.393746 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-acad1d7c-7651-4642-97db-42312dd5d5f5 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] 10.222.0.57 "GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430" status: 200 len: 1394 microversion: 2.1 time: 1.542814 Jul 18 02:27:53.396352 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1495/2980] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:51 2022] GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430 => generated 1394 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:53.419885 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b522b3dd-3f71-4267-8610-9dcc9af5ee34 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:53.422689 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b522b3dd-3f71-4267-8610-9dcc9af5ee34 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:53.456363 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b522b3dd-3f71-4267-8610-9dcc9af5ee34 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:53.461164 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b522b3dd-3f71-4267-8610-9dcc9af5ee34 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:53.463495 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b522b3dd-3f71-4267-8610-9dcc9af5ee34 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:53.469980 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b522b3dd-3f71-4267-8610-9dcc9af5ee34 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:53.873246 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-34516bd3-cef2-4eff-900a-4df3295899df tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:53.891964 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-34516bd3-cef2-4eff-900a-4df3295899df tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf" status: 200 len: 1512 microversion: 2.1 time: 1.064617 Jul 18 02:27:53.894289 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1486/2981] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:52 2022] GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf => generated 1512 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:53.910307 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-399aa96f-c59b-48e8-b8a9-362bc5c3a6b3 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:53.912783 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-399aa96f-c59b-48e8-b8a9-362bc5c3a6b3 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: 9c92379e-52ee-4764-b3f8-bad9c89e0a8f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:53.929856 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-399aa96f-c59b-48e8-b8a9-362bc5c3a6b3 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:53.930760 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-399aa96f-c59b-48e8-b8a9-362bc5c3a6b3 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:53.932670 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-399aa96f-c59b-48e8-b8a9-362bc5c3a6b3 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:53.934014 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-399aa96f-c59b-48e8-b8a9-362bc5c3a6b3 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:54.430923 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b522b3dd-3f71-4267-8610-9dcc9af5ee34 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:54.441675 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b522b3dd-3f71-4267-8610-9dcc9af5ee34 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1313 microversion: 2.1 time: 1.040604 Jul 18 02:27:54.443632 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1496/2982] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:53 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1313 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:54.478321 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2b5cd898-c4c4-4992-babb-040b9f3e46f4 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:54.482835 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2b5cd898-c4c4-4992-babb-040b9f3e46f4 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] [instance: 5f83aa0b-12f7-42c3-8dda-d5f45b817a93] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:54.498367 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b5cd898-c4c4-4992-babb-040b9f3e46f4 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:54.499504 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b5cd898-c4c4-4992-babb-040b9f3e46f4 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:54.500605 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b5cd898-c4c4-4992-babb-040b9f3e46f4 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:54.501843 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b5cd898-c4c4-4992-babb-040b9f3e46f4 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:54.639244 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-399aa96f-c59b-48e8-b8a9-362bc5c3a6b3 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11a308e70d4303a66ad8aaa9338961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65cd308906048719f3c79e73bdfa921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:54.667525 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-399aa96f-c59b-48e8-b8a9-362bc5c3a6b3 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "GET /compute/v2.1/servers/9c92379e-52ee-4764-b3f8-bad9c89e0a8f" status: 200 len: 1316 microversion: 2.1 time: 0.768013 Jul 18 02:27:54.677806 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1487/2983] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:53 2022] GET /compute/v2.1/servers/9c92379e-52ee-4764-b3f8-bad9c89e0a8f => generated 1316 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:54.682722 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9af20277-3f80-4ed2-9239-55ecb378b4fa tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:54.684531 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9af20277-3f80-4ed2-9239-55ecb378b4fa tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] [instance: 8573a671-62f5-4659-a227-bb1637b51430] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:54.699527 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9af20277-3f80-4ed2-9239-55ecb378b4fa tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:54.700365 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9af20277-3f80-4ed2-9239-55ecb378b4fa tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:54.702122 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9af20277-3f80-4ed2-9239-55ecb378b4fa tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:54.702937 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9af20277-3f80-4ed2-9239-55ecb378b4fa tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:55.467499 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2b5cd898-c4c4-4992-babb-040b9f3e46f4 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c4c797bfe143049d603541d8327e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a022827cbe40e48709ae4ca21048cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:55.543871 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2b5cd898-c4c4-4992-babb-040b9f3e46f4 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "GET /compute/v2.1/servers/5f83aa0b-12f7-42c3-8dda-d5f45b817a93" status: 200 len: 1275 microversion: 2.1 time: 1.098183 Jul 18 02:27:55.550357 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1497/2984] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:54 2022] GET /compute/v2.1/servers/5f83aa0b-12f7-42c3-8dda-d5f45b817a93 => generated 1275 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:55.602559 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ea8430c3-5447-429c-92d2-129fff17b5b5 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:55.614824 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ea8430c3-5447-429c-92d2-129fff17b5b5 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: d2dc65b8-8306-4f87-9af1-1cb5096c4ebf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:55.647625 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ea8430c3-5447-429c-92d2-129fff17b5b5 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:55.649268 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ea8430c3-5447-429c-92d2-129fff17b5b5 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:55.651916 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ea8430c3-5447-429c-92d2-129fff17b5b5 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:55.653331 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ea8430c3-5447-429c-92d2-129fff17b5b5 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:56.131113 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9af20277-3f80-4ed2-9239-55ecb378b4fa tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a08894c5e14d05b3a7b21001ff2740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a798824fb748c8889769282273bda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:56.179648 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9af20277-3f80-4ed2-9239-55ecb378b4fa tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] 10.222.0.57 "GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430" status: 200 len: 1394 microversion: 2.1 time: 1.508212 Jul 18 02:27:56.188368 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1488/2985] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:54 2022] GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430 => generated 1394 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:56.206027 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2d4093ff-1955-4182-80e6-0c554c3a9d9d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:56.209582 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2d4093ff-1955-4182-80e6-0c554c3a9d9d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:56.232180 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2d4093ff-1955-4182-80e6-0c554c3a9d9d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:56.233057 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2d4093ff-1955-4182-80e6-0c554c3a9d9d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:56.234719 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2d4093ff-1955-4182-80e6-0c554c3a9d9d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:56.235456 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2d4093ff-1955-4182-80e6-0c554c3a9d9d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:56.994140 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ea8430c3-5447-429c-92d2-129fff17b5b5 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:57.010076 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ea8430c3-5447-429c-92d2-129fff17b5b5 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf" status: 200 len: 1512 microversion: 2.1 time: 1.457249 Jul 18 02:27:57.020903 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1498/2986] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:55 2022] GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf => generated 1512 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:57.025349 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ece4f672-16ea-4f6c-a36e-1ef7c0832d80 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:57.027301 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ece4f672-16ea-4f6c-a36e-1ef7c0832d80 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: 9c92379e-52ee-4764-b3f8-bad9c89e0a8f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:57.052955 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ece4f672-16ea-4f6c-a36e-1ef7c0832d80 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:57.053406 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ece4f672-16ea-4f6c-a36e-1ef7c0832d80 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:57.062821 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ece4f672-16ea-4f6c-a36e-1ef7c0832d80 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:57.063504 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ece4f672-16ea-4f6c-a36e-1ef7c0832d80 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:57.413890 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2d4093ff-1955-4182-80e6-0c554c3a9d9d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:57.448802 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2d4093ff-1955-4182-80e6-0c554c3a9d9d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1313 microversion: 2.1 time: 1.254164 Jul 18 02:27:57.458389 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1489/2987] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:56 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1313 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:57.491367 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-2e40c576-3c7f-4c5b-a158-fb80d05437dd req-806729d0-7c25-4b83-a6b7-39178ba95da2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a86263d1-e36b-4902-acd0-4b00da0a6674", "tag": "5d96454a-b97a-4af0-9b1e-7dc07a7ac546"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:57.547302 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-2e40c576-3c7f-4c5b-a158-fb80d05437dd req-806729d0-7c25-4b83-a6b7-39178ba95da2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:57.550179 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-2e40c576-3c7f-4c5b-a158-fb80d05437dd req-806729d0-7c25-4b83-a6b7-39178ba95da2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:57.575064 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-2e40c576-3c7f-4c5b-a158-fb80d05437dd req-806729d0-7c25-4b83-a6b7-39178ba95da2 service nova] Creating event network-changed:5d96454a-b97a-4af0-9b1e-7dc07a7ac546 for instance a86263d1-e36b-4902-acd0-4b00da0a6674 on n-h1-465891-3 Jul 18 02:27:57.582458 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-2e40c576-3c7f-4c5b-a158-fb80d05437dd req-806729d0-7c25-4b83-a6b7-39178ba95da2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115856 Jul 18 02:27:57.587085 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1490/2988] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:57.598144 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-840d14c1-9891-450c-bece-82aea7e93959 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:57.602167 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-840d14c1-9891-450c-bece-82aea7e93959 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] [instance: 5f83aa0b-12f7-42c3-8dda-d5f45b817a93] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:57.621069 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-840d14c1-9891-450c-bece-82aea7e93959 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:57.624328 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-840d14c1-9891-450c-bece-82aea7e93959 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:57.629492 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-840d14c1-9891-450c-bece-82aea7e93959 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:57.630137 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-840d14c1-9891-450c-bece-82aea7e93959 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:57.925032 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-840d14c1-9891-450c-bece-82aea7e93959 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c4c797bfe143049d603541d8327e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a022827cbe40e48709ae4ca21048cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:57.948674 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-840d14c1-9891-450c-bece-82aea7e93959 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "GET /compute/v2.1/servers/5f83aa0b-12f7-42c3-8dda-d5f45b817a93" status: 200 len: 1281 microversion: 2.1 time: 0.351746 Jul 18 02:27:57.957787 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1491/2989] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:57 2022] GET /compute/v2.1/servers/5f83aa0b-12f7-42c3-8dda-d5f45b817a93 => generated 1281 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:57.967348 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c43a33a1-d1a7-4050-99cc-0df1e56692e2 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:57.973865 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c43a33a1-d1a7-4050-99cc-0df1e56692e2 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] [instance: 8573a671-62f5-4659-a227-bb1637b51430] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:57.987563 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c43a33a1-d1a7-4050-99cc-0df1e56692e2 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:57.990521 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c43a33a1-d1a7-4050-99cc-0df1e56692e2 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:57.991973 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c43a33a1-d1a7-4050-99cc-0df1e56692e2 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:57.994542 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c43a33a1-d1a7-4050-99cc-0df1e56692e2 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:58.032057 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:58.747017 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ece4f672-16ea-4f6c-a36e-1ef7c0832d80 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11a308e70d4303a66ad8aaa9338961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65cd308906048719f3c79e73bdfa921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:58.785009 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ece4f672-16ea-4f6c-a36e-1ef7c0832d80 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "GET /compute/v2.1/servers/9c92379e-52ee-4764-b3f8-bad9c89e0a8f" status: 200 len: 1316 microversion: 2.1 time: 1.762416 Jul 18 02:27:58.786592 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1499/2990] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:57 2022] GET /compute/v2.1/servers/9c92379e-52ee-4764-b3f8-bad9c89e0a8f => generated 1316 bytes in 1772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:58.811172 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7a458fc7-41f5-4636-8ba0-b22bdf07af41 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:58.815510 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7a458fc7-41f5-4636-8ba0-b22bdf07af41 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: d2dc65b8-8306-4f87-9af1-1cb5096c4ebf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:58.844206 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7a458fc7-41f5-4636-8ba0-b22bdf07af41 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:58.847980 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7a458fc7-41f5-4636-8ba0-b22bdf07af41 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:58.859128 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7a458fc7-41f5-4636-8ba0-b22bdf07af41 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:58.860709 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7a458fc7-41f5-4636-8ba0-b22bdf07af41 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:59.103887 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c43a33a1-d1a7-4050-99cc-0df1e56692e2 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a08894c5e14d05b3a7b21001ff2740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a798824fb748c8889769282273bda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:59.119948 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c43a33a1-d1a7-4050-99cc-0df1e56692e2 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] 10.222.0.57 "GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430" status: 200 len: 1574 microversion: 2.1 time: 1.160440 Jul 18 02:27:59.121141 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1492/2991] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:57 2022] GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430 => generated 1574 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:59.137578 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4fdb34a4-a381-4452-9fdc-6c5542a7dc06 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:59.139510 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4fdb34a4-a381-4452-9fdc-6c5542a7dc06 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:59.158111 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4fdb34a4-a381-4452-9fdc-6c5542a7dc06 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:59.160063 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4fdb34a4-a381-4452-9fdc-6c5542a7dc06 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:59.165453 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4fdb34a4-a381-4452-9fdc-6c5542a7dc06 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:59.166079 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4fdb34a4-a381-4452-9fdc-6c5542a7dc06 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:59.702549 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7a458fc7-41f5-4636-8ba0-b22bdf07af41 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:59.713726 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7a458fc7-41f5-4636-8ba0-b22bdf07af41 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf" status: 200 len: 1512 microversion: 2.1 time: 0.925245 Jul 18 02:27:59.728207 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1500/2992] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:58 2022] GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf => generated 1512 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:59.734033 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9cce44d9-e87f-479d-a972-1df30bb89348 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:59.735299 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9cce44d9-e87f-479d-a972-1df30bb89348 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] [instance: 5f83aa0b-12f7-42c3-8dda-d5f45b817a93] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:59.740417 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:59.746360 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9cce44d9-e87f-479d-a972-1df30bb89348 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:59.747335 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9cce44d9-e87f-479d-a972-1df30bb89348 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:59.750393 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9cce44d9-e87f-479d-a972-1df30bb89348 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:59.751228 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9cce44d9-e87f-479d-a972-1df30bb89348 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:00.085615 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9cce44d9-e87f-479d-a972-1df30bb89348 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c4c797bfe143049d603541d8327e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a022827cbe40e48709ae4ca21048cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:00.105131 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9cce44d9-e87f-479d-a972-1df30bb89348 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "GET /compute/v2.1/servers/5f83aa0b-12f7-42c3-8dda-d5f45b817a93" status: 200 len: 1281 microversion: 2.1 time: 0.375357 Jul 18 02:28:00.115234 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1501/2993] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:59 2022] GET /compute/v2.1/servers/5f83aa0b-12f7-42c3-8dda-d5f45b817a93 => generated 1281 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:00.119127 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-34cfdd74-474a-4d77-a29f-3d3e03c96ecb tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:00.119634 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-34cfdd74-474a-4d77-a29f-3d3e03c96ecb tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] [instance: 8573a671-62f5-4659-a227-bb1637b51430] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:00.126764 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-34cfdd74-474a-4d77-a29f-3d3e03c96ecb tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:00.127223 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-34cfdd74-474a-4d77-a29f-3d3e03c96ecb tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:00.128178 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-34cfdd74-474a-4d77-a29f-3d3e03c96ecb tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:00.128618 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-34cfdd74-474a-4d77-a29f-3d3e03c96ecb tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:00.200515 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4fdb34a4-a381-4452-9fdc-6c5542a7dc06 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:00.214356 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4fdb34a4-a381-4452-9fdc-6c5542a7dc06 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1313 microversion: 2.1 time: 1.087581 Jul 18 02:28:00.215610 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1493/2994] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:59 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1313 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:00.222273 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-252794d0-06cf-45e0-b944-28662b1f95a2 req-570e1d2a-00fe-4e6a-92e7-588667e8fb25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f19c9c9-419d-4b9a-abdc-432a65381922", "name": "network-vif-plugged", "status": "completed", "tag": "39add5b7-15aa-4a44-a79b-7041ecfeb6be"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:00.243308 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-252794d0-06cf-45e0-b944-28662b1f95a2 req-570e1d2a-00fe-4e6a-92e7-588667e8fb25 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:00.245512 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-252794d0-06cf-45e0-b944-28662b1f95a2 req-570e1d2a-00fe-4e6a-92e7-588667e8fb25 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:00.274422 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-252794d0-06cf-45e0-b944-28662b1f95a2 req-570e1d2a-00fe-4e6a-92e7-588667e8fb25 service nova] Creating event network-vif-plugged:39add5b7-15aa-4a44-a79b-7041ecfeb6be for instance 9f19c9c9-419d-4b9a-abdc-432a65381922 on n-h2-465891-3 Jul 18 02:28:00.287004 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-252794d0-06cf-45e0-b944-28662b1f95a2 req-570e1d2a-00fe-4e6a-92e7-588667e8fb25 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068509 Jul 18 02:28:00.288545 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1494/2995] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:00.302288 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-66f6890f-4433-4b45-9f57-14b255351516 req-1fa8446f-91b5-4d7b-9dfc-ad1e908ec311 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c92379e-52ee-4764-b3f8-bad9c89e0a8f", "tag": "6b657f73-a8f9-4bcb-8d13-4037471223e0"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:00.320723 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-66f6890f-4433-4b45-9f57-14b255351516 req-1fa8446f-91b5-4d7b-9dfc-ad1e908ec311 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:00.321525 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-66f6890f-4433-4b45-9f57-14b255351516 req-1fa8446f-91b5-4d7b-9dfc-ad1e908ec311 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:00.354225 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-66f6890f-4433-4b45-9f57-14b255351516 req-1fa8446f-91b5-4d7b-9dfc-ad1e908ec311 service nova] Creating event network-changed:6b657f73-a8f9-4bcb-8d13-4037471223e0 for instance 9c92379e-52ee-4764-b3f8-bad9c89e0a8f on n-h2-465891-3 Jul 18 02:28:00.362194 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-66f6890f-4433-4b45-9f57-14b255351516 req-1fa8446f-91b5-4d7b-9dfc-ad1e908ec311 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071011 Jul 18 02:28:00.363123 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1495/2996] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:00.372562 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5581c4f5-dffc-457e-90b6-151b94d5d363 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:00.373293 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5581c4f5-dffc-457e-90b6-151b94d5d363 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: 9c92379e-52ee-4764-b3f8-bad9c89e0a8f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:00.374689 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-34cfdd74-474a-4d77-a29f-3d3e03c96ecb tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] 10.222.0.57 "GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.259169 Jul 18 02:28:00.376481 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1502/2997] 10.222.0.57 () {58 vars in 1274 bytes} [Mon Jul 18 02:28:00 2022] GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430/os-interface => generated 284 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:00.391249 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5581c4f5-dffc-457e-90b6-151b94d5d363 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:00.392467 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5581c4f5-dffc-457e-90b6-151b94d5d363 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:00.393516 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5581c4f5-dffc-457e-90b6-151b94d5d363 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:00.394749 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5581c4f5-dffc-457e-90b6-151b94d5d363 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:00.737957 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c5ca3201-0293-4715-8a76-ff690e3cc9b2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:00.739040 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c5ca3201-0293-4715-8a76-ff690e3cc9b2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: d2dc65b8-8306-4f87-9af1-1cb5096c4ebf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:00.751368 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c5ca3201-0293-4715-8a76-ff690e3cc9b2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:00.752375 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c5ca3201-0293-4715-8a76-ff690e3cc9b2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:00.754364 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c5ca3201-0293-4715-8a76-ff690e3cc9b2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:00.755244 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c5ca3201-0293-4715-8a76-ff690e3cc9b2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:01.455914 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=8 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:01.711350 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c5ca3201-0293-4715-8a76-ff690e3cc9b2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:01.754756 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c5ca3201-0293-4715-8a76-ff690e3cc9b2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf" status: 200 len: 1512 microversion: 2.1 time: 1.021357 Jul 18 02:28:01.770858 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5581c4f5-dffc-457e-90b6-151b94d5d363 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11a308e70d4303a66ad8aaa9338961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65cd308906048719f3c79e73bdfa921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:01.777958 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1503/2998] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:00 2022] GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf => generated 1512 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:28:01.798778 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ff85c724-c43b-4903-bab1-7cd31fccf384 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:01.800385 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5581c4f5-dffc-457e-90b6-151b94d5d363 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "GET /compute/v2.1/servers/9c92379e-52ee-4764-b3f8-bad9c89e0a8f" status: 200 len: 1316 microversion: 2.1 time: 1.432618 Jul 18 02:28:01.814835 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ff85c724-c43b-4903-bab1-7cd31fccf384 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] [instance: 5f83aa0b-12f7-42c3-8dda-d5f45b817a93] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:01.819255 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1496/2999] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:00 2022] GET /compute/v2.1/servers/9c92379e-52ee-4764-b3f8-bad9c89e0a8f => generated 1316 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:01.829522 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e446456d-a187-485b-a782-efcf5fb3f335 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:01.831324 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e446456d-a187-485b-a782-efcf5fb3f335 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:01.849942 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ff85c724-c43b-4903-bab1-7cd31fccf384 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:01.851459 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ff85c724-c43b-4903-bab1-7cd31fccf384 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:01.857639 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ff85c724-c43b-4903-bab1-7cd31fccf384 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:01.859409 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ff85c724-c43b-4903-bab1-7cd31fccf384 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:01.860099 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e446456d-a187-485b-a782-efcf5fb3f335 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:01.861086 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e446456d-a187-485b-a782-efcf5fb3f335 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:01.863292 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e446456d-a187-485b-a782-efcf5fb3f335 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:01.864434 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e446456d-a187-485b-a782-efcf5fb3f335 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:02.811520 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:03.204381 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e446456d-a187-485b-a782-efcf5fb3f335 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:03.262406 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e446456d-a187-485b-a782-efcf5fb3f335 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1313 microversion: 2.1 time: 1.415743 Jul 18 02:28:03.263435 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1497/3000] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:01 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1313 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:03.270519 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b3b08ae7-6137-4fcf-b4cf-940c40ec5810 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:03.271895 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b3b08ae7-6137-4fcf-b4cf-940c40ec5810 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: d2dc65b8-8306-4f87-9af1-1cb5096c4ebf] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:03.280870 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b3b08ae7-6137-4fcf-b4cf-940c40ec5810 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:03.288297 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b3b08ae7-6137-4fcf-b4cf-940c40ec5810 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:03.290123 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b3b08ae7-6137-4fcf-b4cf-940c40ec5810 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:03.291148 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b3b08ae7-6137-4fcf-b4cf-940c40ec5810 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:03.615715 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ff85c724-c43b-4903-bab1-7cd31fccf384 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c4c797bfe143049d603541d8327e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a022827cbe40e48709ae4ca21048cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:03.651011 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ff85c724-c43b-4903-bab1-7cd31fccf384 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "GET /compute/v2.1/servers/5f83aa0b-12f7-42c3-8dda-d5f45b817a93" status: 200 len: 1323 microversion: 2.1 time: 1.868825 Jul 18 02:28:03.658407 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1504/3001] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:01 2022] GET /compute/v2.1/servers/5f83aa0b-12f7-42c3-8dda-d5f45b817a93 => generated 1323 bytes in 1877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:03.682388 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-340d7622-eaec-4518-8cd3-3cdf56ae3857 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:03.684399 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-340d7622-eaec-4518-8cd3-3cdf56ae3857 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: 9c92379e-52ee-4764-b3f8-bad9c89e0a8f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:03.696660 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-340d7622-eaec-4518-8cd3-3cdf56ae3857 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:03.697887 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-340d7622-eaec-4518-8cd3-3cdf56ae3857 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:03.699677 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-340d7622-eaec-4518-8cd3-3cdf56ae3857 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:03.700779 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-340d7622-eaec-4518-8cd3-3cdf56ae3857 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:05.389018 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b3b08ae7-6137-4fcf-b4cf-940c40ec5810 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:05.408884 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b3b08ae7-6137-4fcf-b4cf-940c40ec5810 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf" status: 200 len: 1512 microversion: 2.1 time: 2.142181 Jul 18 02:28:05.418926 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1498/3002] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:03 2022] GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf => generated 1512 bytes in 2154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:05.432800 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8f3e22eb-17a3-4441-89e6-9d6990bda142 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:05.433951 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8f3e22eb-17a3-4441-89e6-9d6990bda142 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:05.447667 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8f3e22eb-17a3-4441-89e6-9d6990bda142 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:05.448917 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8f3e22eb-17a3-4441-89e6-9d6990bda142 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:05.450524 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8f3e22eb-17a3-4441-89e6-9d6990bda142 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:05.451244 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8f3e22eb-17a3-4441-89e6-9d6990bda142 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:05.947045 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-340d7622-eaec-4518-8cd3-3cdf56ae3857 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11a308e70d4303a66ad8aaa9338961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65cd308906048719f3c79e73bdfa921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:05.981920 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-340d7622-eaec-4518-8cd3-3cdf56ae3857 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "GET /compute/v2.1/servers/9c92379e-52ee-4764-b3f8-bad9c89e0a8f" status: 200 len: 1316 microversion: 2.1 time: 2.320936 Jul 18 02:28:05.984323 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1505/3003] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:03 2022] GET /compute/v2.1/servers/9c92379e-52ee-4764-b3f8-bad9c89e0a8f => generated 1316 bytes in 2325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:05.995220 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-07201459-1d2e-4717-83f6-d3c8044db8bf tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:05.999287 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-07201459-1d2e-4717-83f6-d3c8044db8bf tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] [instance: 5f83aa0b-12f7-42c3-8dda-d5f45b817a93] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:06.028757 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-07201459-1d2e-4717-83f6-d3c8044db8bf tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:06.029905 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-07201459-1d2e-4717-83f6-d3c8044db8bf tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:06.031775 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-07201459-1d2e-4717-83f6-d3c8044db8bf tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:06.032954 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-07201459-1d2e-4717-83f6-d3c8044db8bf tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:07.073380 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8f3e22eb-17a3-4441-89e6-9d6990bda142 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:07.105812 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8f3e22eb-17a3-4441-89e6-9d6990bda142 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1462 microversion: 2.1 time: 1.682042 Jul 18 02:28:07.107599 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1499/3004] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:05 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1462 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:07.120155 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-a7933869-8f42-4f73-915e-753a6ee72369 req-5072e435-a239-4b90-b8b6-7fadb1c18192 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a86263d1-e36b-4902-acd0-4b00da0a6674", "name": "network-vif-plugged", "status": "completed", "tag": "5d96454a-b97a-4af0-9b1e-7dc07a7ac546"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:07.143119 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-a7933869-8f42-4f73-915e-753a6ee72369 req-5072e435-a239-4b90-b8b6-7fadb1c18192 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:07.145742 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-a7933869-8f42-4f73-915e-753a6ee72369 req-5072e435-a239-4b90-b8b6-7fadb1c18192 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:07.211567 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-a7933869-8f42-4f73-915e-753a6ee72369 req-5072e435-a239-4b90-b8b6-7fadb1c18192 service nova] Creating event network-vif-plugged:5d96454a-b97a-4af0-9b1e-7dc07a7ac546 for instance a86263d1-e36b-4902-acd0-4b00da0a6674 on n-h1-465891-3 Jul 18 02:28:07.236812 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-a7933869-8f42-4f73-915e-753a6ee72369 req-5072e435-a239-4b90-b8b6-7fadb1c18192 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125906 Jul 18 02:28:07.239203 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1500/3005] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:07.254773 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-574901f7-aa6c-4938-bf00-e67cfa92fe36 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:07.256826 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-574901f7-aa6c-4938-bf00-e67cfa92fe36 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: d2dc65b8-8306-4f87-9af1-1cb5096c4ebf] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:07.271309 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-574901f7-aa6c-4938-bf00-e67cfa92fe36 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:07.272686 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-574901f7-aa6c-4938-bf00-e67cfa92fe36 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:07.275021 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-574901f7-aa6c-4938-bf00-e67cfa92fe36 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:07.276453 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-574901f7-aa6c-4938-bf00-e67cfa92fe36 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:07.403890 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-07201459-1d2e-4717-83f6-d3c8044db8bf tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c4c797bfe143049d603541d8327e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a022827cbe40e48709ae4ca21048cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:07.447518 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-07201459-1d2e-4717-83f6-d3c8044db8bf tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "GET /compute/v2.1/servers/5f83aa0b-12f7-42c3-8dda-d5f45b817a93" status: 200 len: 1323 microversion: 2.1 time: 1.460637 Jul 18 02:28:07.453402 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1506/3006] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:05 2022] GET /compute/v2.1/servers/5f83aa0b-12f7-42c3-8dda-d5f45b817a93 => generated 1323 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:07.470036 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f3026def-e2de-481c-bc55-f68faeebda30 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:07.471956 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f3026def-e2de-481c-bc55-f68faeebda30 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: 9c92379e-52ee-4764-b3f8-bad9c89e0a8f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:07.494861 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f3026def-e2de-481c-bc55-f68faeebda30 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:07.496689 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f3026def-e2de-481c-bc55-f68faeebda30 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:07.498690 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f3026def-e2de-481c-bc55-f68faeebda30 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:07.499892 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f3026def-e2de-481c-bc55-f68faeebda30 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:08.748826 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f3026def-e2de-481c-bc55-f68faeebda30 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11a308e70d4303a66ad8aaa9338961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65cd308906048719f3c79e73bdfa921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:08.772178 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f3026def-e2de-481c-bc55-f68faeebda30 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "GET /compute/v2.1/servers/9c92379e-52ee-4764-b3f8-bad9c89e0a8f" status: 200 len: 1316 microversion: 2.1 time: 1.315710 Jul 18 02:28:08.773727 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1507/3007] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:07 2022] GET /compute/v2.1/servers/9c92379e-52ee-4764-b3f8-bad9c89e0a8f => generated 1316 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:08.885370 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-574901f7-aa6c-4938-bf00-e67cfa92fe36 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:08.936201 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-574901f7-aa6c-4938-bf00-e67cfa92fe36 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf" status: 200 len: 1512 microversion: 2.1 time: 1.694236 Jul 18 02:28:08.948178 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1501/3008] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:07 2022] GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf => generated 1512 bytes in 1708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:08.969144 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-971378ff-50a8-4f52-b4b6-fec6b5f096f2 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:08.971007 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-971378ff-50a8-4f52-b4b6-fec6b5f096f2 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] [instance: 5f83aa0b-12f7-42c3-8dda-d5f45b817a93] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:08.994600 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-971378ff-50a8-4f52-b4b6-fec6b5f096f2 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:08.995880 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-971378ff-50a8-4f52-b4b6-fec6b5f096f2 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:08.997779 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-971378ff-50a8-4f52-b4b6-fec6b5f096f2 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:09.000090 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-971378ff-50a8-4f52-b4b6-fec6b5f096f2 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:09.027882 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0a7b3d2c-f6e9-4e24-b0d9-4c598c59aacd tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:09.028665 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0a7b3d2c-f6e9-4e24-b0d9-4c598c59aacd tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:09.043078 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0a7b3d2c-f6e9-4e24-b0d9-4c598c59aacd tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:09.043568 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0a7b3d2c-f6e9-4e24-b0d9-4c598c59aacd tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:09.045933 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0a7b3d2c-f6e9-4e24-b0d9-4c598c59aacd tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:09.047167 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0a7b3d2c-f6e9-4e24-b0d9-4c598c59aacd tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:10.530375 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-971378ff-50a8-4f52-b4b6-fec6b5f096f2 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c4c797bfe143049d603541d8327e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a022827cbe40e48709ae4ca21048cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:10.569240 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-971378ff-50a8-4f52-b4b6-fec6b5f096f2 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "GET /compute/v2.1/servers/5f83aa0b-12f7-42c3-8dda-d5f45b817a93" status: 200 len: 1323 microversion: 2.1 time: 1.618654 Jul 18 02:28:10.579741 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1502/3009] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:08 2022] GET /compute/v2.1/servers/5f83aa0b-12f7-42c3-8dda-d5f45b817a93 => generated 1323 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:10.611757 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-57bcf312-6192-45b3-8d81-d1d15fe2780f req-56263ee3-161a-4e6e-9f09-14c37ea9605f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6e5a9a2-964e-4c0a-8aed-d791ebac803a", "tag": "ae0ef4d5-d29a-4de2-a08a-50a5d2377729"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:10.634147 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:10.679473 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-57bcf312-6192-45b3-8d81-d1d15fe2780f req-56263ee3-161a-4e6e-9f09-14c37ea9605f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:10.679862 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-57bcf312-6192-45b3-8d81-d1d15fe2780f req-56263ee3-161a-4e6e-9f09-14c37ea9605f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:10.711321 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-57bcf312-6192-45b3-8d81-d1d15fe2780f req-56263ee3-161a-4e6e-9f09-14c37ea9605f service nova] Creating event network-changed:ae0ef4d5-d29a-4de2-a08a-50a5d2377729 for instance d6e5a9a2-964e-4c0a-8aed-d791ebac803a on n-h1-465891-3 Jul 18 02:28:10.730425 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-57bcf312-6192-45b3-8d81-d1d15fe2780f req-56263ee3-161a-4e6e-9f09-14c37ea9605f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140515 Jul 18 02:28:10.731900 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1503/3010] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:10.739308 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-26b01f8b-f922-45f5-8080-fbb47d739fc2 req-505766fd-4a9d-4c4c-bc25-94a028f7f302 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c92379e-52ee-4764-b3f8-bad9c89e0a8f", "name": "network-vif-plugged", "status": "completed", "tag": "6b657f73-a8f9-4bcb-8d13-4037471223e0"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:10.752316 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-26b01f8b-f922-45f5-8080-fbb47d739fc2 req-505766fd-4a9d-4c4c-bc25-94a028f7f302 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:10.752796 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-26b01f8b-f922-45f5-8080-fbb47d739fc2 req-505766fd-4a9d-4c4c-bc25-94a028f7f302 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:10.790985 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-26b01f8b-f922-45f5-8080-fbb47d739fc2 req-505766fd-4a9d-4c4c-bc25-94a028f7f302 service nova] Creating event network-vif-plugged:6b657f73-a8f9-4bcb-8d13-4037471223e0 for instance 9c92379e-52ee-4764-b3f8-bad9c89e0a8f on n-h2-465891-3 Jul 18 02:28:10.796756 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-26b01f8b-f922-45f5-8080-fbb47d739fc2 req-505766fd-4a9d-4c4c-bc25-94a028f7f302 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062689 Jul 18 02:28:10.797902 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1504/3011] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:10.806725 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-21f5545d-ae99-4b76-a586-fe9ac45655b7 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:10.807810 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-21f5545d-ae99-4b76-a586-fe9ac45655b7 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: 9c92379e-52ee-4764-b3f8-bad9c89e0a8f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:10.825112 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-21f5545d-ae99-4b76-a586-fe9ac45655b7 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:10.825591 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-21f5545d-ae99-4b76-a586-fe9ac45655b7 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:10.830303 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-21f5545d-ae99-4b76-a586-fe9ac45655b7 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:10.832046 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-21f5545d-ae99-4b76-a586-fe9ac45655b7 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:10.915527 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:10.934386 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0a7b3d2c-f6e9-4e24-b0d9-4c598c59aacd tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1613 microversion: 2.1 time: 2.157893 Jul 18 02:28:10.936121 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1508/3012] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:08 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1613 bytes in 2161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:10.953183 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5435130f-0670-4515-bc77-76459ee1a13a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:10.954231 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5435130f-0670-4515-bc77-76459ee1a13a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: d2dc65b8-8306-4f87-9af1-1cb5096c4ebf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:10.962704 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5435130f-0670-4515-bc77-76459ee1a13a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:10.963477 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5435130f-0670-4515-bc77-76459ee1a13a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:10.964564 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5435130f-0670-4515-bc77-76459ee1a13a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:10.965245 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5435130f-0670-4515-bc77-76459ee1a13a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:11.616255 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5435130f-0670-4515-bc77-76459ee1a13a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:11.630516 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5435130f-0670-4515-bc77-76459ee1a13a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf" status: 200 len: 1512 microversion: 2.1 time: 0.692176 Jul 18 02:28:11.633100 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1509/3013] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:10 2022] GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf => generated 1512 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:11.639448 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b70756ef-5f7c-47fd-b21f-6db42aa57e70 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:11.641466 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b70756ef-5f7c-47fd-b21f-6db42aa57e70 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] [instance: 8573a671-62f5-4659-a227-bb1637b51430] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:11.656343 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b70756ef-5f7c-47fd-b21f-6db42aa57e70 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:11.657233 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b70756ef-5f7c-47fd-b21f-6db42aa57e70 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:11.658609 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b70756ef-5f7c-47fd-b21f-6db42aa57e70 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:11.668171 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-21f5545d-ae99-4b76-a586-fe9ac45655b7 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11a308e70d4303a66ad8aaa9338961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65cd308906048719f3c79e73bdfa921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:11.677846 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b70756ef-5f7c-47fd-b21f-6db42aa57e70 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:11.697100 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-21f5545d-ae99-4b76-a586-fe9ac45655b7 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "GET /compute/v2.1/servers/9c92379e-52ee-4764-b3f8-bad9c89e0a8f" status: 200 len: 1316 microversion: 2.1 time: 0.897122 Jul 18 02:28:11.700119 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1505/3014] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:10 2022] GET /compute/v2.1/servers/9c92379e-52ee-4764-b3f8-bad9c89e0a8f => generated 1316 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:11.716668 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-b631d4a2-cdcc-495a-892b-cb85ce63807a req-cc5cd5dd-00d2-40a1-80e3-b570fbced359 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8573a671-62f5-4659-a227-bb1637b51430", "tag": "c09a4505-eb19-44b0-a058-fbd5d5a5317b"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:11.733293 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-b631d4a2-cdcc-495a-892b-cb85ce63807a req-cc5cd5dd-00d2-40a1-80e3-b570fbced359 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:11.734539 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-b631d4a2-cdcc-495a-892b-cb85ce63807a req-cc5cd5dd-00d2-40a1-80e3-b570fbced359 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:11.768426 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-b631d4a2-cdcc-495a-892b-cb85ce63807a req-cc5cd5dd-00d2-40a1-80e3-b570fbced359 service nova] Creating event network-changed:c09a4505-eb19-44b0-a058-fbd5d5a5317b for instance 8573a671-62f5-4659-a227-bb1637b51430 on n-h1-465891-3 Jul 18 02:28:11.781597 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-b631d4a2-cdcc-495a-892b-cb85ce63807a req-cc5cd5dd-00d2-40a1-80e3-b570fbced359 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078243 Jul 18 02:28:11.783470 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1506/3015] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:11.794393 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a05cdc29-8d84-4ad2-8b1f-a802c52f36c1 tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:11.795830 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a05cdc29-8d84-4ad2-8b1f-a802c52f36c1 tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:11.813507 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a05cdc29-8d84-4ad2-8b1f-a802c52f36c1 tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:11.814988 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a05cdc29-8d84-4ad2-8b1f-a802c52f36c1 tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:11.817365 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a05cdc29-8d84-4ad2-8b1f-a802c52f36c1 tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:11.818636 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a05cdc29-8d84-4ad2-8b1f-a802c52f36c1 tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:11.888600 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a05cdc29-8d84-4ad2-8b1f-a802c52f36c1 tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '5692e834e08345d7bddfadf56cb41bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c892a656afce454db6453aa4a64176d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:11.890238 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a05cdc29-8d84-4ad2-8b1f-a802c52f36c1 tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] flavor_id is None. Assuming migration. {{(pid=119544) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 18 02:28:11.891639 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a05cdc29-8d84-4ad2-8b1f-a802c52f36c1 tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119544) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 02:28:12.239654 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b70756ef-5f7c-47fd-b21f-6db42aa57e70 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a08894c5e14d05b3a7b21001ff2740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a798824fb748c8889769282273bda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:12.253108 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b70756ef-5f7c-47fd-b21f-6db42aa57e70 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] 10.222.0.57 "GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430" status: 200 len: 1574 microversion: 2.1 time: 0.618405 Jul 18 02:28:12.257441 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1510/3016] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:11 2022] GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430 => generated 1574 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:12.276942 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c6afc5ac-548b-4920-8404-57170f802175 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:12.276942 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c6afc5ac-548b-4920-8404-57170f802175 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] [instance: 5f83aa0b-12f7-42c3-8dda-d5f45b817a93] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:12.289191 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c6afc5ac-548b-4920-8404-57170f802175 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:12.291698 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c6afc5ac-548b-4920-8404-57170f802175 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:12.294627 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c6afc5ac-548b-4920-8404-57170f802175 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:12.295185 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c6afc5ac-548b-4920-8404-57170f802175 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:12.471102 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a05cdc29-8d84-4ad2-8b1f-a802c52f36c1 tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922/action" status: 202 len: 0 microversion: 2.1 time: 0.684839 Jul 18 02:28:12.476077 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1507/3017] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:28:11 2022] POST /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922/action => generated 0 bytes in 688 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:28:12.486937 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c2565700-4c59-4cf9-a160-45c95145a125 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:12.488610 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c2565700-4c59-4cf9-a160-45c95145a125 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:12.503799 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c2565700-4c59-4cf9-a160-45c95145a125 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:12.504252 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c2565700-4c59-4cf9-a160-45c95145a125 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:12.507118 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c2565700-4c59-4cf9-a160-45c95145a125 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:12.508048 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c2565700-4c59-4cf9-a160-45c95145a125 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:12.877739 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c6afc5ac-548b-4920-8404-57170f802175 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c4c797bfe143049d603541d8327e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a022827cbe40e48709ae4ca21048cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:12.934331 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c6afc5ac-548b-4920-8404-57170f802175 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "GET /compute/v2.1/servers/5f83aa0b-12f7-42c3-8dda-d5f45b817a93" status: 200 len: 1323 microversion: 2.1 time: 0.673859 Jul 18 02:28:12.937335 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1511/3018] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:12 2022] GET /compute/v2.1/servers/5f83aa0b-12f7-42c3-8dda-d5f45b817a93 => generated 1323 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:12.955628 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-373072fe-03f7-4184-a789-3a92aa83c40c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:12.957530 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-373072fe-03f7-4184-a789-3a92aa83c40c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: d2dc65b8-8306-4f87-9af1-1cb5096c4ebf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:12.972030 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-373072fe-03f7-4184-a789-3a92aa83c40c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:12.973026 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-373072fe-03f7-4184-a789-3a92aa83c40c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:12.974981 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-373072fe-03f7-4184-a789-3a92aa83c40c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:12.975748 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-373072fe-03f7-4184-a789-3a92aa83c40c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:13.425178 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c2565700-4c59-4cf9-a160-45c95145a125 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:13.452204 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c2565700-4c59-4cf9-a160-45c95145a125 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1471 microversion: 2.1 time: 0.973863 Jul 18 02:28:13.453815 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1508/3019] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:12 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1471 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:13.483977 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-52f74b90-c799-4da3-8b75-6ee3a50796a4 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:13.485287 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-52f74b90-c799-4da3-8b75-6ee3a50796a4 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: 9c92379e-52ee-4764-b3f8-bad9c89e0a8f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:13.500155 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-373072fe-03f7-4184-a789-3a92aa83c40c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:13.511401 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-52f74b90-c799-4da3-8b75-6ee3a50796a4 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:13.512191 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-52f74b90-c799-4da3-8b75-6ee3a50796a4 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:13.513393 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-52f74b90-c799-4da3-8b75-6ee3a50796a4 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:13.515734 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-52f74b90-c799-4da3-8b75-6ee3a50796a4 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:13.522976 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-373072fe-03f7-4184-a789-3a92aa83c40c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf" status: 200 len: 1512 microversion: 2.1 time: 0.582976 Jul 18 02:28:13.543489 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1512/3020] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:12 2022] GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf => generated 1512 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:13.937732 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-aed05222-4f8f-4405-81ac-d614faab48d6 req-75e2a028-5870-4519-8e3b-3be1c69d044c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f78c2991-4119-43e9-a66c-519524b33977", "tag": "e83b2910-f842-4690-bab9-77d796e2f6c3"}, {"name": "network-changed", "server_uuid": "5f83aa0b-12f7-42c3-8dda-d5f45b817a93", "tag": "924e9457-fa79-43e4-ab5e-d525666bf909"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:13.956233 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-aed05222-4f8f-4405-81ac-d614faab48d6 req-75e2a028-5870-4519-8e3b-3be1c69d044c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:13.957679 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-aed05222-4f8f-4405-81ac-d614faab48d6 req-75e2a028-5870-4519-8e3b-3be1c69d044c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:13.992145 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-aed05222-4f8f-4405-81ac-d614faab48d6 req-75e2a028-5870-4519-8e3b-3be1c69d044c service nova] Creating event network-changed:e83b2910-f842-4690-bab9-77d796e2f6c3 for instance f78c2991-4119-43e9-a66c-519524b33977 on n-h2-465891-3 Jul 18 02:28:13.993556 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-aed05222-4f8f-4405-81ac-d614faab48d6 req-75e2a028-5870-4519-8e3b-3be1c69d044c service nova] Creating event network-changed:924e9457-fa79-43e4-ab5e-d525666bf909 for instance 5f83aa0b-12f7-42c3-8dda-d5f45b817a93 on n-h1-465891-3 Jul 18 02:28:14.019032 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-aed05222-4f8f-4405-81ac-d614faab48d6 req-75e2a028-5870-4519-8e3b-3be1c69d044c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.090838 Jul 18 02:28:14.021822 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1513/3021] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:14.032892 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b1cb37c4-2d76-49bf-aa53-6a22ff8b99a6 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:14.034789 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b1cb37c4-2d76-49bf-aa53-6a22ff8b99a6 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] [instance: 5f83aa0b-12f7-42c3-8dda-d5f45b817a93] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:14.050285 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b1cb37c4-2d76-49bf-aa53-6a22ff8b99a6 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:14.051202 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b1cb37c4-2d76-49bf-aa53-6a22ff8b99a6 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:14.055885 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b1cb37c4-2d76-49bf-aa53-6a22ff8b99a6 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:14.057951 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b1cb37c4-2d76-49bf-aa53-6a22ff8b99a6 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:14.182197 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-52f74b90-c799-4da3-8b75-6ee3a50796a4 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11a308e70d4303a66ad8aaa9338961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65cd308906048719f3c79e73bdfa921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:14.210037 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-52f74b90-c799-4da3-8b75-6ee3a50796a4 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "GET /compute/v2.1/servers/9c92379e-52ee-4764-b3f8-bad9c89e0a8f" status: 200 len: 1505 microversion: 2.1 time: 0.750977 Jul 18 02:28:14.214569 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1509/3022] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:13 2022] GET /compute/v2.1/servers/9c92379e-52ee-4764-b3f8-bad9c89e0a8f => generated 1505 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:14.250131 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-20db194b-781b-4bad-b4d0-26f1987c8e90 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:14.251651 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-20db194b-781b-4bad-b4d0-26f1987c8e90 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: a86263d1-e36b-4902-acd0-4b00da0a6674] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:14.264937 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-20db194b-781b-4bad-b4d0-26f1987c8e90 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:14.266506 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-20db194b-781b-4bad-b4d0-26f1987c8e90 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:14.268399 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-20db194b-781b-4bad-b4d0-26f1987c8e90 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:14.269841 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-20db194b-781b-4bad-b4d0-26f1987c8e90 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:15.065500 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-20db194b-781b-4bad-b4d0-26f1987c8e90 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11a308e70d4303a66ad8aaa9338961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65cd308906048719f3c79e73bdfa921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:15.079905 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b1cb37c4-2d76-49bf-aa53-6a22ff8b99a6 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c4c797bfe143049d603541d8327e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a022827cbe40e48709ae4ca21048cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:15.080753 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-20db194b-781b-4bad-b4d0-26f1987c8e90 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "GET /compute/v2.1/servers/a86263d1-e36b-4902-acd0-4b00da0a6674" status: 200 len: 1505 microversion: 2.1 time: 0.843289 Jul 18 02:28:15.096676 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1510/3023] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:14 2022] GET /compute/v2.1/servers/a86263d1-e36b-4902-acd0-4b00da0a6674 => generated 1505 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:28:15.106182 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d3cbb36c-35ac-44c1-b821-a3fb57f525cf tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:15.106817 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d3cbb36c-35ac-44c1-b821-a3fb57f525cf tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:15.110050 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b1cb37c4-2d76-49bf-aa53-6a22ff8b99a6 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "GET /compute/v2.1/servers/5f83aa0b-12f7-42c3-8dda-d5f45b817a93" status: 200 len: 1323 microversion: 2.1 time: 1.086284 Jul 18 02:28:15.116706 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1514/3024] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:14 2022] GET /compute/v2.1/servers/5f83aa0b-12f7-42c3-8dda-d5f45b817a93 => generated 1323 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:15.123763 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d3cbb36c-35ac-44c1-b821-a3fb57f525cf tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:15.124226 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d3cbb36c-35ac-44c1-b821-a3fb57f525cf tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:15.125029 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d3cbb36c-35ac-44c1-b821-a3fb57f525cf tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:15.125615 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d3cbb36c-35ac-44c1-b821-a3fb57f525cf tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:15.126433 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-916fca2a-71e5-4664-bfaa-ae131474f996 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:15.132015 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-916fca2a-71e5-4664-bfaa-ae131474f996 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: d2dc65b8-8306-4f87-9af1-1cb5096c4ebf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:15.151881 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-916fca2a-71e5-4664-bfaa-ae131474f996 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:15.152366 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-916fca2a-71e5-4664-bfaa-ae131474f996 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:15.153187 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-916fca2a-71e5-4664-bfaa-ae131474f996 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:15.153633 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-916fca2a-71e5-4664-bfaa-ae131474f996 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:15.187167 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:16.805488 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d3cbb36c-35ac-44c1-b821-a3fb57f525cf tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:16.822084 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d3cbb36c-35ac-44c1-b821-a3fb57f525cf tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1471 microversion: 2.1 time: 1.723723 Jul 18 02:28:16.823208 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1511/3025] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:15 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1471 bytes in 1726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:16.831544 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d7f6c268-05c2-4008-8f22-0685221395e4 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:16.832557 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d7f6c268-05c2-4008-8f22-0685221395e4 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: a86263d1-e36b-4902-acd0-4b00da0a6674] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:16.844695 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d7f6c268-05c2-4008-8f22-0685221395e4 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:16.845598 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d7f6c268-05c2-4008-8f22-0685221395e4 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:16.848532 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d7f6c268-05c2-4008-8f22-0685221395e4 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:16.851723 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d7f6c268-05c2-4008-8f22-0685221395e4 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:16.898747 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-916fca2a-71e5-4664-bfaa-ae131474f996 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:16.926290 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-916fca2a-71e5-4664-bfaa-ae131474f996 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf" status: 200 len: 1512 microversion: 2.1 time: 1.808067 Jul 18 02:28:16.928890 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d7f6c268-05c2-4008-8f22-0685221395e4 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: a86263d1-e36b-4902-acd0-4b00da0a6674] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:28:16.942516 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1515/3026] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:15 2022] GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf => generated 1512 bytes in 1824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:16.986823 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-41f68526-b064-4417-a7d7-866cb5f823d7 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:16.987927 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-41f68526-b064-4417-a7d7-866cb5f823d7 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] [instance: 5f83aa0b-12f7-42c3-8dda-d5f45b817a93] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:16.997689 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41f68526-b064-4417-a7d7-866cb5f823d7 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:16.998610 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41f68526-b064-4417-a7d7-866cb5f823d7 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:17.003584 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41f68526-b064-4417-a7d7-866cb5f823d7 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:17.004247 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41f68526-b064-4417-a7d7-866cb5f823d7 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:17.195830 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d7f6c268-05c2-4008-8f22-0685221395e4 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a86263d1-e36b-4902-acd0-4b00da0a6674" status: 204 len: 0 microversion: 2.1 time: 0.368824 Jul 18 02:28:17.197136 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1512/3027] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:28:16 2022] DELETE /compute/v2.1/servers/a86263d1-e36b-4902-acd0-4b00da0a6674 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:28:17.233766 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-05aad584-34c0-4024-a1f0-15b679ab4644 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:17.234768 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-05aad584-34c0-4024-a1f0-15b679ab4644 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: 9c92379e-52ee-4764-b3f8-bad9c89e0a8f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:17.255958 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-05aad584-34c0-4024-a1f0-15b679ab4644 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:17.263220 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-05aad584-34c0-4024-a1f0-15b679ab4644 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:17.265140 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-05aad584-34c0-4024-a1f0-15b679ab4644 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:17.266318 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-05aad584-34c0-4024-a1f0-15b679ab4644 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:17.372028 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-05aad584-34c0-4024-a1f0-15b679ab4644 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: 9c92379e-52ee-4764-b3f8-bad9c89e0a8f] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:28:17.638642 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-05aad584-34c0-4024-a1f0-15b679ab4644 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9c92379e-52ee-4764-b3f8-bad9c89e0a8f" status: 204 len: 0 microversion: 2.1 time: 0.433674 Jul 18 02:28:17.640120 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1513/3028] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:28:17 2022] DELETE /compute/v2.1/servers/9c92379e-52ee-4764-b3f8-bad9c89e0a8f => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:28:17.669803 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6a6fbf56-eff0-4fd8-abfc-ca91f858731f tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:17.674188 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6a6fbf56-eff0-4fd8-abfc-ca91f858731f tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: a86263d1-e36b-4902-acd0-4b00da0a6674] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:17.690841 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6a6fbf56-eff0-4fd8-abfc-ca91f858731f tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:17.692114 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6a6fbf56-eff0-4fd8-abfc-ca91f858731f tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:17.695706 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6a6fbf56-eff0-4fd8-abfc-ca91f858731f tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:17.696966 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6a6fbf56-eff0-4fd8-abfc-ca91f858731f tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:17.899126 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-41f68526-b064-4417-a7d7-866cb5f823d7 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c4c797bfe143049d603541d8327e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a022827cbe40e48709ae4ca21048cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:17.922596 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-41f68526-b064-4417-a7d7-866cb5f823d7 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "GET /compute/v2.1/servers/5f83aa0b-12f7-42c3-8dda-d5f45b817a93" status: 200 len: 1323 microversion: 2.1 time: 0.972855 Jul 18 02:28:17.928209 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1516/3029] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:16 2022] GET /compute/v2.1/servers/5f83aa0b-12f7-42c3-8dda-d5f45b817a93 => generated 1323 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:17.943501 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-80f0ef83-2fb0-4130-a78b-afbfd1a6b781 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:17.945130 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-80f0ef83-2fb0-4130-a78b-afbfd1a6b781 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:17.960384 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=9 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:17.968215 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-80f0ef83-2fb0-4130-a78b-afbfd1a6b781 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:17.969126 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-80f0ef83-2fb0-4130-a78b-afbfd1a6b781 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:17.970959 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-80f0ef83-2fb0-4130-a78b-afbfd1a6b781 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:17.971779 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-80f0ef83-2fb0-4130-a78b-afbfd1a6b781 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:18.024281 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6a6fbf56-eff0-4fd8-abfc-ca91f858731f tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11a308e70d4303a66ad8aaa9338961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65cd308906048719f3c79e73bdfa921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:18.040141 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6a6fbf56-eff0-4fd8-abfc-ca91f858731f tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "GET /compute/v2.1/servers/a86263d1-e36b-4902-acd0-4b00da0a6674" status: 200 len: 1511 microversion: 2.1 time: 0.393935 Jul 18 02:28:18.054486 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1514/3030] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:17 2022] GET /compute/v2.1/servers/a86263d1-e36b-4902-acd0-4b00da0a6674 => generated 1511 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:18.070391 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0c734364-166d-4242-90f8-2a300ff2f7bd tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:18.072021 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0c734364-166d-4242-90f8-2a300ff2f7bd tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: d2dc65b8-8306-4f87-9af1-1cb5096c4ebf] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:18.085596 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c734364-166d-4242-90f8-2a300ff2f7bd tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:18.086873 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c734364-166d-4242-90f8-2a300ff2f7bd tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:18.088595 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c734364-166d-4242-90f8-2a300ff2f7bd tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:18.089745 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c734364-166d-4242-90f8-2a300ff2f7bd tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:18.344232 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-80f0ef83-2fb0-4130-a78b-afbfd1a6b781 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:18.364504 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-80f0ef83-2fb0-4130-a78b-afbfd1a6b781 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1471 microversion: 2.1 time: 0.431252 Jul 18 02:28:18.374549 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1517/3031] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:17 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1471 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:18.495097 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0c734364-166d-4242-90f8-2a300ff2f7bd tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:18.508647 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0c734364-166d-4242-90f8-2a300ff2f7bd tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf" status: 200 len: 1512 microversion: 2.1 time: 0.451937 Jul 18 02:28:18.513800 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1515/3032] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:18 2022] GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf => generated 1512 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:18.952048 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-74b6c925-777e-4ec7-bc57-2b5ae337ae29 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:18.953746 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-74b6c925-777e-4ec7-bc57-2b5ae337ae29 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] [instance: 5f83aa0b-12f7-42c3-8dda-d5f45b817a93] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:18.976290 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-74b6c925-777e-4ec7-bc57-2b5ae337ae29 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:18.977238 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-74b6c925-777e-4ec7-bc57-2b5ae337ae29 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:18.978522 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-74b6c925-777e-4ec7-bc57-2b5ae337ae29 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:18.979420 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-74b6c925-777e-4ec7-bc57-2b5ae337ae29 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:19.088768 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-940fe420-8163-4502-b463-173299f6f1bc tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:19.090764 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-940fe420-8163-4502-b463-173299f6f1bc tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: a86263d1-e36b-4902-acd0-4b00da0a6674] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:19.115964 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-940fe420-8163-4502-b463-173299f6f1bc tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:19.119084 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-940fe420-8163-4502-b463-173299f6f1bc tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:19.120665 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-940fe420-8163-4502-b463-173299f6f1bc tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:19.125039 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-940fe420-8163-4502-b463-173299f6f1bc tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:19.756815 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-940fe420-8163-4502-b463-173299f6f1bc tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11a308e70d4303a66ad8aaa9338961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65cd308906048719f3c79e73bdfa921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:19.759930 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-74b6c925-777e-4ec7-bc57-2b5ae337ae29 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c4c797bfe143049d603541d8327e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a022827cbe40e48709ae4ca21048cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:19.772902 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-940fe420-8163-4502-b463-173299f6f1bc tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "GET /compute/v2.1/servers/a86263d1-e36b-4902-acd0-4b00da0a6674" status: 200 len: 1511 microversion: 2.1 time: 0.705180 Jul 18 02:28:19.783122 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1516/3033] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:19 2022] GET /compute/v2.1/servers/a86263d1-e36b-4902-acd0-4b00da0a6674 => generated 1511 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:19.792220 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-00ef8289-40de-46f5-81fa-5e5cbba637b9 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:19.797881 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-00ef8289-40de-46f5-81fa-5e5cbba637b9 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:19.814545 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-00ef8289-40de-46f5-81fa-5e5cbba637b9 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:19.815218 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-00ef8289-40de-46f5-81fa-5e5cbba637b9 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:19.816396 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-00ef8289-40de-46f5-81fa-5e5cbba637b9 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:19.817205 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-00ef8289-40de-46f5-81fa-5e5cbba637b9 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:19.843958 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-74b6c925-777e-4ec7-bc57-2b5ae337ae29 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "GET /compute/v2.1/servers/5f83aa0b-12f7-42c3-8dda-d5f45b817a93" status: 200 len: 1323 microversion: 2.1 time: 0.895086 Jul 18 02:28:19.845904 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1518/3034] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:18 2022] GET /compute/v2.1/servers/5f83aa0b-12f7-42c3-8dda-d5f45b817a93 => generated 1323 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:19.857078 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b562234c-f8fe-490f-bcf2-f26352f893c9 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:19.859317 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b562234c-f8fe-490f-bcf2-f26352f893c9 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: d2dc65b8-8306-4f87-9af1-1cb5096c4ebf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:19.875853 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b562234c-f8fe-490f-bcf2-f26352f893c9 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:19.882741 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b562234c-f8fe-490f-bcf2-f26352f893c9 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:19.884606 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b562234c-f8fe-490f-bcf2-f26352f893c9 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:19.886222 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b562234c-f8fe-490f-bcf2-f26352f893c9 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:20.930048 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b562234c-f8fe-490f-bcf2-f26352f893c9 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:20.961393 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b562234c-f8fe-490f-bcf2-f26352f893c9 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf" status: 200 len: 1489 microversion: 2.1 time: 1.113375 Jul 18 02:28:20.968893 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1519/3035] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:19 2022] GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf => generated 1489 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:20.978725 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c964255c-0591-4320-ac6b-5bef0a9cd242 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:20.980587 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c964255c-0591-4320-ac6b-5bef0a9cd242 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: a86263d1-e36b-4902-acd0-4b00da0a6674] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:21.002100 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c964255c-0591-4320-ac6b-5bef0a9cd242 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:21.003495 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c964255c-0591-4320-ac6b-5bef0a9cd242 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:21.005500 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c964255c-0591-4320-ac6b-5bef0a9cd242 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:21.007333 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c964255c-0591-4320-ac6b-5bef0a9cd242 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:21.117593 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-00ef8289-40de-46f5-81fa-5e5cbba637b9 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:21.153512 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-00ef8289-40de-46f5-81fa-5e5cbba637b9 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1471 microversion: 2.1 time: 1.365514 Jul 18 02:28:21.154252 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1517/3036] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:19 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1471 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:21.171155 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-920e46c1-eb1e-45e3-96ae-53af40ccbdda tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:21.174311 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-920e46c1-eb1e-45e3-96ae-53af40ccbdda tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] [instance: 5f83aa0b-12f7-42c3-8dda-d5f45b817a93] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:21.191448 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-920e46c1-eb1e-45e3-96ae-53af40ccbdda tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:21.192860 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-920e46c1-eb1e-45e3-96ae-53af40ccbdda tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:21.200301 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-920e46c1-eb1e-45e3-96ae-53af40ccbdda tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:21.200779 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-920e46c1-eb1e-45e3-96ae-53af40ccbdda tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:21.963880 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c964255c-0591-4320-ac6b-5bef0a9cd242 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11a308e70d4303a66ad8aaa9338961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65cd308906048719f3c79e73bdfa921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:22.002104 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c964255c-0591-4320-ac6b-5bef0a9cd242 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "GET /compute/v2.1/servers/a86263d1-e36b-4902-acd0-4b00da0a6674" status: 200 len: 1511 microversion: 2.1 time: 1.030412 Jul 18 02:28:22.003289 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1520/3037] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:20 2022] GET /compute/v2.1/servers/a86263d1-e36b-4902-acd0-4b00da0a6674 => generated 1511 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:22.013216 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e9dff5f8-682e-41ac-8604-d6b7e87b8e3c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:22.014624 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e9dff5f8-682e-41ac-8604-d6b7e87b8e3c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: d2dc65b8-8306-4f87-9af1-1cb5096c4ebf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:22.036559 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e9dff5f8-682e-41ac-8604-d6b7e87b8e3c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:22.038915 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e9dff5f8-682e-41ac-8604-d6b7e87b8e3c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:22.040361 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e9dff5f8-682e-41ac-8604-d6b7e87b8e3c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:22.041431 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e9dff5f8-682e-41ac-8604-d6b7e87b8e3c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:22.096761 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e9dff5f8-682e-41ac-8604-d6b7e87b8e3c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: d2dc65b8-8306-4f87-9af1-1cb5096c4ebf] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:28:22.120876 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-920e46c1-eb1e-45e3-96ae-53af40ccbdda tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c4c797bfe143049d603541d8327e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a022827cbe40e48709ae4ca21048cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:22.155456 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-920e46c1-eb1e-45e3-96ae-53af40ccbdda tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "GET /compute/v2.1/servers/5f83aa0b-12f7-42c3-8dda-d5f45b817a93" status: 200 len: 1323 microversion: 2.1 time: 0.999721 Jul 18 02:28:22.176392 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1518/3038] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:21 2022] GET /compute/v2.1/servers/5f83aa0b-12f7-42c3-8dda-d5f45b817a93 => generated 1323 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:22.213411 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-bb0014e5-c685-46f2-abb7-12641eb3498e req-4af0a1ce-c7c9-48d4-96a3-1b69e12420de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f78c2991-4119-43e9-a66c-519524b33977", "name": "network-vif-plugged", "status": "completed", "tag": "e83b2910-f842-4690-bab9-77d796e2f6c3"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:22.270518 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-bb0014e5-c685-46f2-abb7-12641eb3498e req-4af0a1ce-c7c9-48d4-96a3-1b69e12420de service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:22.282883 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-bb0014e5-c685-46f2-abb7-12641eb3498e req-4af0a1ce-c7c9-48d4-96a3-1b69e12420de service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:22.339668 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-bb0014e5-c685-46f2-abb7-12641eb3498e req-4af0a1ce-c7c9-48d4-96a3-1b69e12420de service nova] Creating event network-vif-plugged:e83b2910-f842-4690-bab9-77d796e2f6c3 for instance f78c2991-4119-43e9-a66c-519524b33977 on n-h2-465891-3 Jul 18 02:28:22.374450 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-bb0014e5-c685-46f2-abb7-12641eb3498e req-4af0a1ce-c7c9-48d4-96a3-1b69e12420de service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195233 Jul 18 02:28:22.375595 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1519/3039] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:22.376137 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e9dff5f8-682e-41ac-8604-d6b7e87b8e3c tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf" status: 204 len: 0 microversion: 2.1 time: 0.370494 Jul 18 02:28:22.379886 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1521/3040] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:28:22 2022] DELETE /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:28:22.387571 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-b46f6876-55b3-4b59-9b33-f14546bedb8e req-b4c9a85d-e766-4c24-894e-c80c307e8891 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a86263d1-e36b-4902-acd0-4b00da0a6674", "name": "network-vif-deleted", "tag": "5d96454a-b97a-4af0-9b1e-7dc07a7ac546"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:22.397440 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-dea6f39f-ebe2-40c8-b7f2-ab00cea47014 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:22.399677 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-dea6f39f-ebe2-40c8-b7f2-ab00cea47014 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:22.417771 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-b46f6876-55b3-4b59-9b33-f14546bedb8e req-b4c9a85d-e766-4c24-894e-c80c307e8891 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:22.417771 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-b46f6876-55b3-4b59-9b33-f14546bedb8e req-b4c9a85d-e766-4c24-894e-c80c307e8891 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:22.436825 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dea6f39f-ebe2-40c8-b7f2-ab00cea47014 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:22.438175 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dea6f39f-ebe2-40c8-b7f2-ab00cea47014 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:22.446764 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dea6f39f-ebe2-40c8-b7f2-ab00cea47014 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:22.447107 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-b46f6876-55b3-4b59-9b33-f14546bedb8e req-b4c9a85d-e766-4c24-894e-c80c307e8891 service nova] Creating event network-vif-deleted:5d96454a-b97a-4af0-9b1e-7dc07a7ac546 for instance a86263d1-e36b-4902-acd0-4b00da0a6674 on n-h1-465891-3 Jul 18 02:28:22.449503 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dea6f39f-ebe2-40c8-b7f2-ab00cea47014 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:22.463114 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-b46f6876-55b3-4b59-9b33-f14546bedb8e req-b4c9a85d-e766-4c24-894e-c80c307e8891 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083320 Jul 18 02:28:22.464914 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1522/3041] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:22.478258 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d5af262d-b150-4529-aa84-cfb7b70e6d28 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:22.480769 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d5af262d-b150-4529-aa84-cfb7b70e6d28 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: d2dc65b8-8306-4f87-9af1-1cb5096c4ebf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:22.502458 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5af262d-b150-4529-aa84-cfb7b70e6d28 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:22.503451 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5af262d-b150-4529-aa84-cfb7b70e6d28 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:22.505314 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5af262d-b150-4529-aa84-cfb7b70e6d28 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:22.507961 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5af262d-b150-4529-aa84-cfb7b70e6d28 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:23.667374 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d5af262d-b150-4529-aa84-cfb7b70e6d28 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:23.699707 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d5af262d-b150-4529-aa84-cfb7b70e6d28 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf" status: 200 len: 1495 microversion: 2.1 time: 1.230150 Jul 18 02:28:23.701402 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1523/3042] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:22 2022] GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf => generated 1495 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:23.721939 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fe9c1e89-1297-4d6c-9b02-6ee08f40acfe tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:23.736522 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fe9c1e89-1297-4d6c-9b02-6ee08f40acfe tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: a86263d1-e36b-4902-acd0-4b00da0a6674] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:23.769451 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fe9c1e89-1297-4d6c-9b02-6ee08f40acfe tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:23.770632 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fe9c1e89-1297-4d6c-9b02-6ee08f40acfe tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:23.773057 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fe9c1e89-1297-4d6c-9b02-6ee08f40acfe tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:23.774349 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fe9c1e89-1297-4d6c-9b02-6ee08f40acfe tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:23.791903 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-dea6f39f-ebe2-40c8-b7f2-ab00cea47014 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:23.812866 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-dea6f39f-ebe2-40c8-b7f2-ab00cea47014 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1476 microversion: 2.1 time: 1.433214 Jul 18 02:28:23.816448 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1520/3043] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:22 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1476 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:23.837763 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-89e339e5-f622-437c-9fdf-f6f46f447dfb tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:23.841023 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-89e339e5-f622-437c-9fdf-f6f46f447dfb tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] [instance: 5f83aa0b-12f7-42c3-8dda-d5f45b817a93] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:23.866467 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-89e339e5-f622-437c-9fdf-f6f46f447dfb tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:23.870624 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-89e339e5-f622-437c-9fdf-f6f46f447dfb tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:23.871519 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-89e339e5-f622-437c-9fdf-f6f46f447dfb tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:23.877216 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-89e339e5-f622-437c-9fdf-f6f46f447dfb tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:23.989902 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fe9c1e89-1297-4d6c-9b02-6ee08f40acfe tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:23.993247 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fe9c1e89-1297-4d6c-9b02-6ee08f40acfe tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:23.996298 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-fe9c1e89-1297-4d6c-9b02-6ee08f40acfe tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lazy-loading 'fault' on Instance uuid a86263d1-e36b-4902-acd0-4b00da0a6674 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:28:24.188416 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fe9c1e89-1297-4d6c-9b02-6ee08f40acfe tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f11a308e70d4303a66ad8aaa9338961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65cd308906048719f3c79e73bdfa921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:24.201141 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:24.204098 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fe9c1e89-1297-4d6c-9b02-6ee08f40acfe tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "GET /compute/v2.1/servers/a86263d1-e36b-4902-acd0-4b00da0a6674" status: 200 len: 1306 microversion: 2.1 time: 0.498088 Jul 18 02:28:24.205233 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1524/3044] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:23 2022] GET /compute/v2.1/servers/a86263d1-e36b-4902-acd0-4b00da0a6674 => generated 1306 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:24.420240 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-1c213bd2-9794-4925-b5d8-8e79089fa6f2 req-4120a2a9-6851-4533-a2ab-bd4b1a40b50f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6e5a9a2-964e-4c0a-8aed-d791ebac803a", "name": "network-vif-plugged", "status": "completed", "tag": "ae0ef4d5-d29a-4de2-a08a-50a5d2377729"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:24.438813 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-89e339e5-f622-437c-9fdf-f6f46f447dfb tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c4c797bfe143049d603541d8327e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a022827cbe40e48709ae4ca21048cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:24.441283 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-1c213bd2-9794-4925-b5d8-8e79089fa6f2 req-4120a2a9-6851-4533-a2ab-bd4b1a40b50f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:24.442144 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-1c213bd2-9794-4925-b5d8-8e79089fa6f2 req-4120a2a9-6851-4533-a2ab-bd4b1a40b50f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:24.463152 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-1c213bd2-9794-4925-b5d8-8e79089fa6f2 req-4120a2a9-6851-4533-a2ab-bd4b1a40b50f service nova] Creating event network-vif-plugged:ae0ef4d5-d29a-4de2-a08a-50a5d2377729 for instance d6e5a9a2-964e-4c0a-8aed-d791ebac803a on n-h1-465891-3 Jul 18 02:28:24.473805 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-1c213bd2-9794-4925-b5d8-8e79089fa6f2 req-4120a2a9-6851-4533-a2ab-bd4b1a40b50f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062115 Jul 18 02:28:24.481199 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1525/3045] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:24.484715 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-89e339e5-f622-437c-9fdf-f6f46f447dfb tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "GET /compute/v2.1/servers/5f83aa0b-12f7-42c3-8dda-d5f45b817a93" status: 200 len: 1323 microversion: 2.1 time: 0.666590 Jul 18 02:28:24.486084 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1521/3046] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:23 2022] GET /compute/v2.1/servers/5f83aa0b-12f7-42c3-8dda-d5f45b817a93 => generated 1323 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:24.528470 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-fcf9a43c-67ee-4c58-b76c-0cef2d3822ec req-a62a0d64-b263-45ef-a749-05bae8678d5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c92379e-52ee-4764-b3f8-bad9c89e0a8f", "name": "network-vif-deleted", "tag": "6b657f73-a8f9-4bcb-8d13-4037471223e0"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:24.591985 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-fcf9a43c-67ee-4c58-b76c-0cef2d3822ec req-a62a0d64-b263-45ef-a749-05bae8678d5b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:24.592450 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-fcf9a43c-67ee-4c58-b76c-0cef2d3822ec req-a62a0d64-b263-45ef-a749-05bae8678d5b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:24.640874 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-fcf9a43c-67ee-4c58-b76c-0cef2d3822ec req-a62a0d64-b263-45ef-a749-05bae8678d5b service nova] Creating event network-vif-deleted:6b657f73-a8f9-4bcb-8d13-4037471223e0 for instance 9c92379e-52ee-4764-b3f8-bad9c89e0a8f on n-h2-465891-3 Jul 18 02:28:24.648299 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-fcf9a43c-67ee-4c58-b76c-0cef2d3822ec req-a62a0d64-b263-45ef-a749-05bae8678d5b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126312 Jul 18 02:28:24.649686 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1526/3047] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:24.719226 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c48ccd6a-7854-4891-bc10-1cbd4f237900 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:24.720372 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c48ccd6a-7854-4891-bc10-1cbd4f237900 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: d2dc65b8-8306-4f87-9af1-1cb5096c4ebf] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:24.727173 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c48ccd6a-7854-4891-bc10-1cbd4f237900 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:24.727628 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c48ccd6a-7854-4891-bc10-1cbd4f237900 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:24.734227 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c48ccd6a-7854-4891-bc10-1cbd4f237900 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:24.738033 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c48ccd6a-7854-4891-bc10-1cbd4f237900 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:24.849217 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c3e49d9c-657c-437d-84ef-c04074a09ae7 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:24.852546 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c3e49d9c-657c-437d-84ef-c04074a09ae7 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:24.868953 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c3e49d9c-657c-437d-84ef-c04074a09ae7 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:24.868953 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c3e49d9c-657c-437d-84ef-c04074a09ae7 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:24.870388 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c3e49d9c-657c-437d-84ef-c04074a09ae7 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:24.871270 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c3e49d9c-657c-437d-84ef-c04074a09ae7 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:25.352015 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c48ccd6a-7854-4891-bc10-1cbd4f237900 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:25.390420 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c48ccd6a-7854-4891-bc10-1cbd4f237900 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf" status: 200 len: 1495 microversion: 2.1 time: 0.673881 Jul 18 02:28:25.402537 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1522/3048] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:24 2022] GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf => generated 1495 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:25.418674 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4fb79c69-4dac-440d-ab13-25ac4a1ac2e8 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:25.420243 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4fb79c69-4dac-440d-ab13-25ac4a1ac2e8 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: a86263d1-e36b-4902-acd0-4b00da0a6674] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:25.442817 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4fb79c69-4dac-440d-ab13-25ac4a1ac2e8 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:25.444170 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4fb79c69-4dac-440d-ab13-25ac4a1ac2e8 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:25.446028 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4fb79c69-4dac-440d-ab13-25ac4a1ac2e8 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:25.447097 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4fb79c69-4dac-440d-ab13-25ac4a1ac2e8 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:25.478851 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-4fb79c69-4dac-440d-ab13-25ac4a1ac2e8 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] HTTP exception thrown: Instance a86263d1-e36b-4902-acd0-4b00da0a6674 could not be found. Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4fb79c69-4dac-440d-ab13-25ac4a1ac2e8 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Request method failure captured: Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/a86263d1-e36b-4902-acd0-4b00da0a6674 HTTP/1.1 Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MTqHxb9xoxFkhIyV7WARCidPLWH3Vn3GD-NYOpzTvusId48ZSoO9353uawrK2EtlimeFCQJ6Nh3jkKh1Yx0NiEXERJJ70s81xsfuQ_tEQmKrpdbGw2fiQ-Ud__CJTjpXU1Ptrox33v9RVmBZVOlCD4YRQUhh86bXpnz6isMNUrBOuA Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: d65cd308906048719f3c79e73bdfa921 Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-MultipleCreateTestJSON-346232285 Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d65cd308906048719f3c79e73bdfa921"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d65cd308906048719f3c79e73bdfa921"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d65cd308906048719f3c79e73bdfa921"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d65cd308906048719f3c79e73bdfa921"}]}] Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-MultipleCreateTestJSON-346232285 Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: d65cd308906048719f3c79e73bdfa921 Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-MultipleCreateTestJSON-346232285 Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-MultipleCreateTestJSON-346232285-project Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 9f11a308e70d4303a66ad8aaa9338961 Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-MultipleCreateTestJSON-346232285-project Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance a86263d1-e36b-4902-acd0-4b00da0a6674 could not be found. Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'a86263d1-e36b-4902-acd0-4b00da0a6674'} Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a86263d1-e36b-4902-acd0-4b00da0a6674 could not be found. Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a86263d1-e36b-4902-acd0-4b00da0a6674 could not be found. Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:25.483612 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:25.493657 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:25.493657 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:25.493657 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:25.493657 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:28:25.493657 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:28:25.493657 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a86263d1-e36b-4902-acd0-4b00da0a6674 could not be found. Jul 18 02:28:25.493657 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:25.496380 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4fb79c69-4dac-440d-ab13-25ac4a1ac2e8 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Returning 404 to user: Instance a86263d1-e36b-4902-acd0-4b00da0a6674 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:28:25.498626 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4fb79c69-4dac-440d-ab13-25ac4a1ac2e8 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "GET /compute/v2.1/servers/a86263d1-e36b-4902-acd0-4b00da0a6674" status: 404 len: 111 microversion: 2.1 time: 0.092044 Jul 18 02:28:25.504645 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1523/3049] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:25 2022] GET /compute/v2.1/servers/a86263d1-e36b-4902-acd0-4b00da0a6674 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:28:25.514564 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bc1c4a3f-cbbf-47f8-bd68-45fb483e0707 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:25.516450 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bc1c4a3f-cbbf-47f8-bd68-45fb483e0707 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] [instance: 9c92379e-52ee-4764-b3f8-bad9c89e0a8f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:25.529330 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bc1c4a3f-cbbf-47f8-bd68-45fb483e0707 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:25.530756 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bc1c4a3f-cbbf-47f8-bd68-45fb483e0707 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:25.532643 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bc1c4a3f-cbbf-47f8-bd68-45fb483e0707 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:25.534379 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bc1c4a3f-cbbf-47f8-bd68-45fb483e0707 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:25.565605 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-bc1c4a3f-cbbf-47f8-bd68-45fb483e0707 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] HTTP exception thrown: Instance 9c92379e-52ee-4764-b3f8-bad9c89e0a8f could not be found. Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bc1c4a3f-cbbf-47f8-bd68-45fb483e0707 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Request method failure captured: Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/9c92379e-52ee-4764-b3f8-bad9c89e0a8f HTTP/1.1 Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MTqHxb9xoxFkhIyV7WARCidPLWH3Vn3GD-NYOpzTvusId48ZSoO9353uawrK2EtlimeFCQJ6Nh3jkKh1Yx0NiEXERJJ70s81xsfuQ_tEQmKrpdbGw2fiQ-Ud__CJTjpXU1Ptrox33v9RVmBZVOlCD4YRQUhh86bXpnz6isMNUrBOuA Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: d65cd308906048719f3c79e73bdfa921 Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-MultipleCreateTestJSON-346232285 Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d65cd308906048719f3c79e73bdfa921"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d65cd308906048719f3c79e73bdfa921"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d65cd308906048719f3c79e73bdfa921"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d65cd308906048719f3c79e73bdfa921"}]}] Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-MultipleCreateTestJSON-346232285 Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: d65cd308906048719f3c79e73bdfa921 Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-MultipleCreateTestJSON-346232285 Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-MultipleCreateTestJSON-346232285-project Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 9f11a308e70d4303a66ad8aaa9338961 Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-MultipleCreateTestJSON-346232285-project Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 9c92379e-52ee-4764-b3f8-bad9c89e0a8f could not be found. Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '9c92379e-52ee-4764-b3f8-bad9c89e0a8f'} Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c92379e-52ee-4764-b3f8-bad9c89e0a8f could not be found. Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c92379e-52ee-4764-b3f8-bad9c89e0a8f could not be found. Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:25.569683 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:25.580584 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:25.580584 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:25.580584 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:25.580584 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:28:25.580584 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:28:25.580584 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c92379e-52ee-4764-b3f8-bad9c89e0a8f could not be found. Jul 18 02:28:25.580584 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:25.587011 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bc1c4a3f-cbbf-47f8-bd68-45fb483e0707 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] Returning 404 to user: Instance 9c92379e-52ee-4764-b3f8-bad9c89e0a8f could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:28:25.587011 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bc1c4a3f-cbbf-47f8-bd68-45fb483e0707 tempest-MultipleCreateTestJSON-346232285 tempest-MultipleCreateTestJSON-346232285-project] 10.222.0.57 "GET /compute/v2.1/servers/9c92379e-52ee-4764-b3f8-bad9c89e0a8f" status: 404 len: 111 microversion: 2.1 time: 0.076857 Jul 18 02:28:25.593324 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1524/3050] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:25 2022] GET /compute/v2.1/servers/9c92379e-52ee-4764-b3f8-bad9c89e0a8f => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:28:25.600062 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d0c54a6a-ccdc-4476-b2c1-cfae98e78a20 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:25.601263 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d0c54a6a-ccdc-4476-b2c1-cfae98e78a20 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] [instance: 5f83aa0b-12f7-42c3-8dda-d5f45b817a93] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:25.611711 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d0c54a6a-ccdc-4476-b2c1-cfae98e78a20 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:25.613088 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d0c54a6a-ccdc-4476-b2c1-cfae98e78a20 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:25.615313 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d0c54a6a-ccdc-4476-b2c1-cfae98e78a20 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:25.618883 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d0c54a6a-ccdc-4476-b2c1-cfae98e78a20 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:25.914279 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c3e49d9c-657c-437d-84ef-c04074a09ae7 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:25.932220 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c3e49d9c-657c-437d-84ef-c04074a09ae7 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1476 microversion: 2.1 time: 1.096631 Jul 18 02:28:25.934871 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1527/3051] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:24 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1476 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:26.170566 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d0c54a6a-ccdc-4476-b2c1-cfae98e78a20 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c4c797bfe143049d603541d8327e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a022827cbe40e48709ae4ca21048cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:26.180521 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d0c54a6a-ccdc-4476-b2c1-cfae98e78a20 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "GET /compute/v2.1/servers/5f83aa0b-12f7-42c3-8dda-d5f45b817a93" status: 200 len: 1323 microversion: 2.1 time: 0.585737 Jul 18 02:28:26.198672 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1525/3052] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:25 2022] GET /compute/v2.1/servers/5f83aa0b-12f7-42c3-8dda-d5f45b817a93 => generated 1323 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:26.430108 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-805e443d-6a94-4ea1-91a6-597e3bed6f02 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:26.431391 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-805e443d-6a94-4ea1-91a6-597e3bed6f02 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: d2dc65b8-8306-4f87-9af1-1cb5096c4ebf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:26.449780 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-805e443d-6a94-4ea1-91a6-597e3bed6f02 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:26.450548 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-805e443d-6a94-4ea1-91a6-597e3bed6f02 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:26.451878 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-805e443d-6a94-4ea1-91a6-597e3bed6f02 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:26.452519 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-805e443d-6a94-4ea1-91a6-597e3bed6f02 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:26.518496 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-805e443d-6a94-4ea1-91a6-597e3bed6f02 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:26.519351 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-805e443d-6a94-4ea1-91a6-597e3bed6f02 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:26.520084 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-805e443d-6a94-4ea1-91a6-597e3bed6f02 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lazy-loading 'fault' on Instance uuid d2dc65b8-8306-4f87-9af1-1cb5096c4ebf {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:28:26.611816 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-805e443d-6a94-4ea1-91a6-597e3bed6f02 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:26.627275 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-805e443d-6a94-4ea1-91a6-597e3bed6f02 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf" status: 200 len: 1305 microversion: 2.1 time: 0.210493 Jul 18 02:28:26.631528 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1528/3053] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:26 2022] GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf => generated 1305 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:26.702173 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-77f893c3-8d40-4004-b0da-6c2e94db38a8 req-f9873a95-735f-41e4-a86c-e710e339f497 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2dc65b8-8306-4f87-9af1-1cb5096c4ebf", "name": "network-vif-deleted", "tag": "25824420-6674-47c8-a379-4b1b0ef9b65b"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:26.716344 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-77f893c3-8d40-4004-b0da-6c2e94db38a8 req-f9873a95-735f-41e4-a86c-e710e339f497 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:26.718482 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-77f893c3-8d40-4004-b0da-6c2e94db38a8 req-f9873a95-735f-41e4-a86c-e710e339f497 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:26.766972 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-77f893c3-8d40-4004-b0da-6c2e94db38a8 req-f9873a95-735f-41e4-a86c-e710e339f497 service nova] Creating event network-vif-deleted:25824420-6674-47c8-a379-4b1b0ef9b65b for instance d2dc65b8-8306-4f87-9af1-1cb5096c4ebf on n-h2-465891-3 Jul 18 02:28:26.784660 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-77f893c3-8d40-4004-b0da-6c2e94db38a8 req-f9873a95-735f-41e4-a86c-e710e339f497 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088473 Jul 18 02:28:26.788005 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1526/3054] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:26.968510 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4ec34a1b-1412-4514-ab0d-a87a79ff4a49 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:26.974323 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4ec34a1b-1412-4514-ab0d-a87a79ff4a49 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:26.988459 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4ec34a1b-1412-4514-ab0d-a87a79ff4a49 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:26.989830 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4ec34a1b-1412-4514-ab0d-a87a79ff4a49 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:26.991841 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4ec34a1b-1412-4514-ab0d-a87a79ff4a49 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:26.993232 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4ec34a1b-1412-4514-ab0d-a87a79ff4a49 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:27.214043 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9172f1a0-4808-46da-87e2-9fffbfd96e53 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:27.216070 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9172f1a0-4808-46da-87e2-9fffbfd96e53 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] [instance: 5f83aa0b-12f7-42c3-8dda-d5f45b817a93] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:27.237077 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9172f1a0-4808-46da-87e2-9fffbfd96e53 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:27.245445 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9172f1a0-4808-46da-87e2-9fffbfd96e53 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:27.248880 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9172f1a0-4808-46da-87e2-9fffbfd96e53 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:27.249952 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9172f1a0-4808-46da-87e2-9fffbfd96e53 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:27.283006 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:27.474577 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4ec34a1b-1412-4514-ab0d-a87a79ff4a49 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:27.514042 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4ec34a1b-1412-4514-ab0d-a87a79ff4a49 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1476 microversion: 2.1 time: 0.564265 Jul 18 02:28:27.515761 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9172f1a0-4808-46da-87e2-9fffbfd96e53 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c4c797bfe143049d603541d8327e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a022827cbe40e48709ae4ca21048cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:27.523384 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1529/3055] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:26 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1476 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:27.524623 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9172f1a0-4808-46da-87e2-9fffbfd96e53 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "GET /compute/v2.1/servers/5f83aa0b-12f7-42c3-8dda-d5f45b817a93" status: 200 len: 1323 microversion: 2.1 time: 0.322367 Jul 18 02:28:27.525230 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1527/3056] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:27 2022] GET /compute/v2.1/servers/5f83aa0b-12f7-42c3-8dda-d5f45b817a93 => generated 1323 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:27.650770 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-15c2ffa6-a878-44ef-b1b4-4ea27e97592e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:27.651908 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-15c2ffa6-a878-44ef-b1b4-4ea27e97592e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: d2dc65b8-8306-4f87-9af1-1cb5096c4ebf] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:27.659679 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-15c2ffa6-a878-44ef-b1b4-4ea27e97592e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:27.660541 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-15c2ffa6-a878-44ef-b1b4-4ea27e97592e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:27.661947 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-15c2ffa6-a878-44ef-b1b4-4ea27e97592e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:27.663104 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-15c2ffa6-a878-44ef-b1b4-4ea27e97592e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:27.681815 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-15c2ffa6-a878-44ef-b1b4-4ea27e97592e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] HTTP exception thrown: Instance d2dc65b8-8306-4f87-9af1-1cb5096c4ebf could not be found. Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-15c2ffa6-a878-44ef-b1b4-4ea27e97592e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Request method failure captured: Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf HTTP/1.1 Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MPwaxUozPvSKq2aGl05vX5p9RkRh12PhrAa5ZuFGYH8QlWHXUoV4AOq2uE9nQ_2FUYuIDSWVSpjhgygJ-c4EGtTg2Y-_wVXi_cp3NARUTVck4-IU3Tev_AIZ-4eU7-_uXuXl7L-x01qv35sxA627UbKELg2PVDH9gxQj5dhwRrNVzw Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ba9d4e8f2f18460ebccacbe32db57388"}]}] Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-DeleteServersTestJSON-988442543 Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 89c4d32923874a50972ab0b75a4165c0 Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance d2dc65b8-8306-4f87-9af1-1cb5096c4ebf could not be found. Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'd2dc65b8-8306-4f87-9af1-1cb5096c4ebf'} Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2dc65b8-8306-4f87-9af1-1cb5096c4ebf could not be found. Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2dc65b8-8306-4f87-9af1-1cb5096c4ebf could not be found. Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:27.684399 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:27.689784 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:27.689784 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:27.689784 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:27.689784 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:28:27.689784 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:28:27.689784 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2dc65b8-8306-4f87-9af1-1cb5096c4ebf could not be found. Jul 18 02:28:27.689784 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:27.691223 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-15c2ffa6-a878-44ef-b1b4-4ea27e97592e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Returning 404 to user: Instance d2dc65b8-8306-4f87-9af1-1cb5096c4ebf could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:28:27.692544 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-15c2ffa6-a878-44ef-b1b4-4ea27e97592e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf" status: 404 len: 111 microversion: 2.1 time: 0.048243 Jul 18 02:28:27.697860 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1528/3057] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:27 2022] GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:28:27.873555 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bc9eae05-ac49-462c-9334-b58a958c22b2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-468121707", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "6dbd9947-7c83-4ca1-a653-57a9c042a444"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:27.915908 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-ee546172-dc73-4ed3-9d6b-a39ef1f730df req-9a33f4dd-a3f7-4b04-b6aa-01da7cd4d0b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f83aa0b-12f7-42c3-8dda-d5f45b817a93", "name": "network-vif-plugged", "status": "completed", "tag": "924e9457-fa79-43e4-ab5e-d525666bf909"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:27.938565 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-ee546172-dc73-4ed3-9d6b-a39ef1f730df req-9a33f4dd-a3f7-4b04-b6aa-01da7cd4d0b2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:27.939144 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-ee546172-dc73-4ed3-9d6b-a39ef1f730df req-9a33f4dd-a3f7-4b04-b6aa-01da7cd4d0b2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:27.983084 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-ee546172-dc73-4ed3-9d6b-a39ef1f730df req-9a33f4dd-a3f7-4b04-b6aa-01da7cd4d0b2 service nova] Creating event network-vif-plugged:924e9457-fa79-43e4-ab5e-d525666bf909 for instance 5f83aa0b-12f7-42c3-8dda-d5f45b817a93 on n-h1-465891-3 Jul 18 02:28:27.990641 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-bc9eae05-ac49-462c-9334-b58a958c22b2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] validate_networks() for [('6dbd9947-7c83-4ca1-a653-57a9c042a444', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:28:28.001108 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-ee546172-dc73-4ed3-9d6b-a39ef1f730df req-9a33f4dd-a3f7-4b04-b6aa-01da7cd4d0b2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093245 Jul 18 02:28:28.008168 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1529/3058] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:28:28.559911 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d54d4873-d3da-475a-8c31-770f8bcd7da8 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:28.560690 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d54d4873-d3da-475a-8c31-770f8bcd7da8 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:28.569983 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d54d4873-d3da-475a-8c31-770f8bcd7da8 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:28.570966 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d54d4873-d3da-475a-8c31-770f8bcd7da8 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:28.571803 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d54d4873-d3da-475a-8c31-770f8bcd7da8 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:28.572452 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d54d4873-d3da-475a-8c31-770f8bcd7da8 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:28.831686 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-bc9eae05-ac49-462c-9334-b58a958c22b2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:28:28.832938 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-bc9eae05-ac49-462c-9334-b58a958c22b2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:28:28.836668 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-bc9eae05-ac49-462c-9334-b58a958c22b2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:28:28.838439 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-bc9eae05-ac49-462c-9334-b58a958c22b2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:28:28.840932 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-bc9eae05-ac49-462c-9334-b58a958c22b2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:28:28.848278 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d54d4873-d3da-475a-8c31-770f8bcd7da8 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:28.858517 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d54d4873-d3da-475a-8c31-770f8bcd7da8 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1476 microversion: 2.1 time: 0.318722 Jul 18 02:28:28.861112 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1530/3059] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:28 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1476 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:28.867262 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b2ee079b-0c2d-43e9-8c7c-077838001a64 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:28.868400 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b2ee079b-0c2d-43e9-8c7c-077838001a64 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] [instance: 5f83aa0b-12f7-42c3-8dda-d5f45b817a93] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:28.874469 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bc9eae05-ac49-462c-9334-b58a958c22b2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:28.875349 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bc9eae05-ac49-462c-9334-b58a958c22b2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:28.876506 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bc9eae05-ac49-462c-9334-b58a958c22b2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:28.877617 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bc9eae05-ac49-462c-9334-b58a958c22b2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:28.892195 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b2ee079b-0c2d-43e9-8c7c-077838001a64 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:28.893014 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b2ee079b-0c2d-43e9-8c7c-077838001a64 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:28.895508 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b2ee079b-0c2d-43e9-8c7c-077838001a64 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:28.896646 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b2ee079b-0c2d-43e9-8c7c-077838001a64 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:28.905344 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-bc9eae05-ac49-462c-9334-b58a958c22b2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Getting quotas for project ba9d4e8f2f18460ebccacbe32db57388. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:28:28.919252 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-bc9eae05-ac49-462c-9334-b58a958c22b2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Getting quotas for user 89c4d32923874a50972ab0b75a4165c0 and project ba9d4e8f2f18460ebccacbe32db57388. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:28:28.938759 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bc9eae05-ac49-462c-9334-b58a958c22b2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:28:28.941421 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bc9eae05-ac49-462c-9334-b58a958c22b2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b096f40a-9f6f-4956-bf56-7166600da59b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:28:29.027550 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bc9eae05-ac49-462c-9334-b58a958c22b2 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.162357 Jul 18 02:28:29.029558 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1530/3060] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:28:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1166 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:28:29.049982 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fcb9c721-24b8-46df-b489-1340c8306b9e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:29.050814 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fcb9c721-24b8-46df-b489-1340c8306b9e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b096f40a-9f6f-4956-bf56-7166600da59b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:29.182941 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fcb9c721-24b8-46df-b489-1340c8306b9e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:29.205040 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fcb9c721-24b8-46df-b489-1340c8306b9e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b" status: 200 len: 1214 microversion: 2.1 time: 0.168170 Jul 18 02:28:29.206404 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1531/3061] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:29 2022] GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b => generated 1214 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:29.311963 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b2ee079b-0c2d-43e9-8c7c-077838001a64 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c4c797bfe143049d603541d8327e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a022827cbe40e48709ae4ca21048cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:29.331078 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b2ee079b-0c2d-43e9-8c7c-077838001a64 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "GET /compute/v2.1/servers/5f83aa0b-12f7-42c3-8dda-d5f45b817a93" status: 200 len: 1323 microversion: 2.1 time: 0.467628 Jul 18 02:28:29.333016 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1531/3062] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:28 2022] GET /compute/v2.1/servers/5f83aa0b-12f7-42c3-8dda-d5f45b817a93 => generated 1323 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:29.921800 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4a891dd4-e180-4872-8afe-a36b57b515c5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:29.925055 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4a891dd4-e180-4872-8afe-a36b57b515c5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:29.951714 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4a891dd4-e180-4872-8afe-a36b57b515c5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:29.952481 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4a891dd4-e180-4872-8afe-a36b57b515c5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:29.954128 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4a891dd4-e180-4872-8afe-a36b57b515c5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:29.955111 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4a891dd4-e180-4872-8afe-a36b57b515c5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:30.231461 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-93cbd7cf-4d7e-4460-899c-cd5e17cb46c9 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:30.232115 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-93cbd7cf-4d7e-4460-899c-cd5e17cb46c9 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b096f40a-9f6f-4956-bf56-7166600da59b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:30.250131 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-93cbd7cf-4d7e-4460-899c-cd5e17cb46c9 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:30.250637 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-93cbd7cf-4d7e-4460-899c-cd5e17cb46c9 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:30.251468 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-93cbd7cf-4d7e-4460-899c-cd5e17cb46c9 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:30.251918 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-93cbd7cf-4d7e-4460-899c-cd5e17cb46c9 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:30.385952 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-93cbd7cf-4d7e-4460-899c-cd5e17cb46c9 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:30.398677 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-93cbd7cf-4d7e-4460-899c-cd5e17cb46c9 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b" status: 200 len: 1210 microversion: 2.1 time: 0.170949 Jul 18 02:28:30.398677 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1532/3063] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:30 2022] GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b => generated 1210 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:28:30.406735 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3587048d-9785-4763-9a1a-50b3657e4a8d tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:30.407374 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3587048d-9785-4763-9a1a-50b3657e4a8d tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] [instance: 5f83aa0b-12f7-42c3-8dda-d5f45b817a93] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:30.423983 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3587048d-9785-4763-9a1a-50b3657e4a8d tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:30.424449 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3587048d-9785-4763-9a1a-50b3657e4a8d tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:30.425259 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3587048d-9785-4763-9a1a-50b3657e4a8d tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:30.425727 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3587048d-9785-4763-9a1a-50b3657e4a8d tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:30.759129 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4a891dd4-e180-4872-8afe-a36b57b515c5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:30.776279 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4a891dd4-e180-4872-8afe-a36b57b515c5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1476 microversion: 2.1 time: 0.879164 Jul 18 02:28:30.787979 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1532/3064] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:29 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1476 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:28:31.434325 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b72ecc08-b787-4e0e-9f8e-48823aa6402f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:31.435226 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b72ecc08-b787-4e0e-9f8e-48823aa6402f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b096f40a-9f6f-4956-bf56-7166600da59b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:31.449650 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b72ecc08-b787-4e0e-9f8e-48823aa6402f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:31.453445 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b72ecc08-b787-4e0e-9f8e-48823aa6402f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:31.456441 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b72ecc08-b787-4e0e-9f8e-48823aa6402f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:31.462318 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b72ecc08-b787-4e0e-9f8e-48823aa6402f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:31.647316 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3587048d-9785-4763-9a1a-50b3657e4a8d tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c4c797bfe143049d603541d8327e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a022827cbe40e48709ae4ca21048cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:31.668939 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3587048d-9785-4763-9a1a-50b3657e4a8d tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "GET /compute/v2.1/servers/5f83aa0b-12f7-42c3-8dda-d5f45b817a93" status: 200 len: 1516 microversion: 2.1 time: 1.265989 Jul 18 02:28:31.669569 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1533/3065] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:30 2022] GET /compute/v2.1/servers/5f83aa0b-12f7-42c3-8dda-d5f45b817a93 => generated 1516 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:31.682009 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b72ecc08-b787-4e0e-9f8e-48823aa6402f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:31.699946 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-650f4f30-cb92-4815-9bd6-38061df763a7 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:31.700895 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-650f4f30-cb92-4815-9bd6-38061df763a7 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] [instance: f78c2991-4119-43e9-a66c-519524b33977] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:31.702412 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b72ecc08-b787-4e0e-9f8e-48823aa6402f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b" status: 200 len: 1272 microversion: 2.1 time: 0.277891 Jul 18 02:28:31.708317 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-650f4f30-cb92-4815-9bd6-38061df763a7 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:31.709056 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-650f4f30-cb92-4815-9bd6-38061df763a7 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:31.710076 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-650f4f30-cb92-4815-9bd6-38061df763a7 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:31.711059 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-650f4f30-cb92-4815-9bd6-38061df763a7 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:31.715360 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1533/3066] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:31 2022] GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b => generated 1272 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:28:31.816236 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-88e739d4-1ec3-490f-94ce-92fd57f8496a tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:31.817445 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-88e739d4-1ec3-490f-94ce-92fd57f8496a tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:31.845337 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-88e739d4-1ec3-490f-94ce-92fd57f8496a tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:31.848416 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-88e739d4-1ec3-490f-94ce-92fd57f8496a tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:31.850608 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-88e739d4-1ec3-490f-94ce-92fd57f8496a tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:31.852314 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-88e739d4-1ec3-490f-94ce-92fd57f8496a tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:32.564541 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-650f4f30-cb92-4815-9bd6-38061df763a7 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c4c797bfe143049d603541d8327e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a022827cbe40e48709ae4ca21048cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:32.605327 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-650f4f30-cb92-4815-9bd6-38061df763a7 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "GET /compute/v2.1/servers/f78c2991-4119-43e9-a66c-519524b33977" status: 200 len: 1516 microversion: 2.1 time: 0.910690 Jul 18 02:28:32.620199 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-88e739d4-1ec3-490f-94ce-92fd57f8496a tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:32.633748 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-88e739d4-1ec3-490f-94ce-92fd57f8496a tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1476 microversion: 2.1 time: 0.843266 Jul 18 02:28:32.635350 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1534/3067] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:31 2022] GET /compute/v2.1/servers/f78c2991-4119-43e9-a66c-519524b33977 => generated 1516 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:28:32.637930 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1534/3068] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:31 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1476 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:32.666252 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-99da5a47-0e0e-446c-888e-379e412d6457 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:32.667705 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-99da5a47-0e0e-446c-888e-379e412d6457 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] [instance: d6e5a9a2-964e-4c0a-8aed-d791ebac803a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:32.679189 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-99da5a47-0e0e-446c-888e-379e412d6457 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:32.679734 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-99da5a47-0e0e-446c-888e-379e412d6457 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:32.681465 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-99da5a47-0e0e-446c-888e-379e412d6457 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:32.691107 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-99da5a47-0e0e-446c-888e-379e412d6457 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:32.746847 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5a97ddff-5418-40fe-ba96-67d36faed077 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:32.749932 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5a97ddff-5418-40fe-ba96-67d36faed077 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b096f40a-9f6f-4956-bf56-7166600da59b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:32.759041 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5a97ddff-5418-40fe-ba96-67d36faed077 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:32.759961 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5a97ddff-5418-40fe-ba96-67d36faed077 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:32.761774 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5a97ddff-5418-40fe-ba96-67d36faed077 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:32.762579 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5a97ddff-5418-40fe-ba96-67d36faed077 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:33.027475 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5a97ddff-5418-40fe-ba96-67d36faed077 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:33.058242 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5a97ddff-5418-40fe-ba96-67d36faed077 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b" status: 200 len: 1272 microversion: 2.1 time: 0.307385 Jul 18 02:28:33.059999 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1535/3069] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:32 2022] GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b => generated 1272 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:33.663534 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7dfe62ec-bc7f-493d-ad91-e36f9b9dfa0d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:33.665018 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7dfe62ec-bc7f-493d-ad91-e36f9b9dfa0d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:33.683746 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7dfe62ec-bc7f-493d-ad91-e36f9b9dfa0d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:33.684613 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7dfe62ec-bc7f-493d-ad91-e36f9b9dfa0d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:33.689989 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7dfe62ec-bc7f-493d-ad91-e36f9b9dfa0d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:33.691186 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7dfe62ec-bc7f-493d-ad91-e36f9b9dfa0d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:33.784601 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-99da5a47-0e0e-446c-888e-379e412d6457 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c4c797bfe143049d603541d8327e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a022827cbe40e48709ae4ca21048cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:33.829006 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-99da5a47-0e0e-446c-888e-379e412d6457 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "GET /compute/v2.1/servers/d6e5a9a2-964e-4c0a-8aed-d791ebac803a" status: 200 len: 1516 microversion: 2.1 time: 1.191609 Jul 18 02:28:33.833605 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1535/3070] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:32 2022] GET /compute/v2.1/servers/d6e5a9a2-964e-4c0a-8aed-d791ebac803a => generated 1516 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:33.859660 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d3d7d2e7-8243-4fdd-a5ab-35e059e80ea8 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:33.861141 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d3d7d2e7-8243-4fdd-a5ab-35e059e80ea8 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] [instance: d6e5a9a2-964e-4c0a-8aed-d791ebac803a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:33.890821 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d3d7d2e7-8243-4fdd-a5ab-35e059e80ea8 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:33.892063 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d3d7d2e7-8243-4fdd-a5ab-35e059e80ea8 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:33.896790 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d3d7d2e7-8243-4fdd-a5ab-35e059e80ea8 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:33.898673 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d3d7d2e7-8243-4fdd-a5ab-35e059e80ea8 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:34.052673 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d3d7d2e7-8243-4fdd-a5ab-35e059e80ea8 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] [instance: d6e5a9a2-964e-4c0a-8aed-d791ebac803a] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:28:34.300302 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d3d7d2e7-8243-4fdd-a5ab-35e059e80ea8 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d6e5a9a2-964e-4c0a-8aed-d791ebac803a" status: 204 len: 0 microversion: 2.1 time: 0.451482 Jul 18 02:28:34.302145 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1536/3071] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:28:33 2022] DELETE /compute/v2.1/servers/d6e5a9a2-964e-4c0a-8aed-d791ebac803a => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:28:34.313484 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e6d8467a-1ef0-4bb5-80ba-02597670ddcf tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:34.317013 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e6d8467a-1ef0-4bb5-80ba-02597670ddcf tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b096f40a-9f6f-4956-bf56-7166600da59b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:34.341898 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e6d8467a-1ef0-4bb5-80ba-02597670ddcf tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:34.343508 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e6d8467a-1ef0-4bb5-80ba-02597670ddcf tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:34.347334 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e6d8467a-1ef0-4bb5-80ba-02597670ddcf tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:34.348778 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e6d8467a-1ef0-4bb5-80ba-02597670ddcf tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:34.790623 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e6d8467a-1ef0-4bb5-80ba-02597670ddcf tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:34.804283 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e6d8467a-1ef0-4bb5-80ba-02597670ddcf tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b" status: 200 len: 1272 microversion: 2.1 time: 0.499814 Jul 18 02:28:34.810042 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1537/3072] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:34 2022] GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b => generated 1272 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:34.826321 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c814c025-82c7-46f7-8fd1-5a00915777bb tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:34.829047 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c814c025-82c7-46f7-8fd1-5a00915777bb tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] [instance: d6e5a9a2-964e-4c0a-8aed-d791ebac803a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:34.842966 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c814c025-82c7-46f7-8fd1-5a00915777bb tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:34.845416 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c814c025-82c7-46f7-8fd1-5a00915777bb tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:34.846721 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c814c025-82c7-46f7-8fd1-5a00915777bb tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:34.848476 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c814c025-82c7-46f7-8fd1-5a00915777bb tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:34.961854 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7dfe62ec-bc7f-493d-ad91-e36f9b9dfa0d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:34.974234 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7dfe62ec-bc7f-493d-ad91-e36f9b9dfa0d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1476 microversion: 2.1 time: 1.314572 Jul 18 02:28:34.976244 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1536/3073] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:33 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1476 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:28:35.824509 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-641f32f1-d370-475f-a9ad-2b49928d0fb6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:35.826012 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-641f32f1-d370-475f-a9ad-2b49928d0fb6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b096f40a-9f6f-4956-bf56-7166600da59b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:35.879983 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-641f32f1-d370-475f-a9ad-2b49928d0fb6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:35.892855 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-641f32f1-d370-475f-a9ad-2b49928d0fb6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:35.897244 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-641f32f1-d370-475f-a9ad-2b49928d0fb6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:35.899558 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-641f32f1-d370-475f-a9ad-2b49928d0fb6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:36.147128 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c814c025-82c7-46f7-8fd1-5a00915777bb tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c4c797bfe143049d603541d8327e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a022827cbe40e48709ae4ca21048cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:36.165921 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c814c025-82c7-46f7-8fd1-5a00915777bb tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "GET /compute/v2.1/servers/d6e5a9a2-964e-4c0a-8aed-d791ebac803a" status: 200 len: 1522 microversion: 2.1 time: 1.354258 Jul 18 02:28:36.185914 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1538/3074] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:34 2022] GET /compute/v2.1/servers/d6e5a9a2-964e-4c0a-8aed-d791ebac803a => generated 1522 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:36.205130 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cdd984f5-f5b9-4048-8af6-38ca1ea4569d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:36.206976 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cdd984f5-f5b9-4048-8af6-38ca1ea4569d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:36.220596 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cdd984f5-f5b9-4048-8af6-38ca1ea4569d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:36.221902 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cdd984f5-f5b9-4048-8af6-38ca1ea4569d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:36.223691 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cdd984f5-f5b9-4048-8af6-38ca1ea4569d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:36.224841 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cdd984f5-f5b9-4048-8af6-38ca1ea4569d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:36.323032 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-641f32f1-d370-475f-a9ad-2b49928d0fb6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:36.348569 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-641f32f1-d370-475f-a9ad-2b49928d0fb6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b" status: 200 len: 1272 microversion: 2.1 time: 0.530156 Jul 18 02:28:36.350706 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1537/3075] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:35 2022] GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b => generated 1272 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:28:37.215624 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-901fe5d9-8410-4327-afd0-9a8a0a5388e1 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:37.216605 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-901fe5d9-8410-4327-afd0-9a8a0a5388e1 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] [instance: d6e5a9a2-964e-4c0a-8aed-d791ebac803a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:37.236312 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-901fe5d9-8410-4327-afd0-9a8a0a5388e1 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:37.237365 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-901fe5d9-8410-4327-afd0-9a8a0a5388e1 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:37.241365 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-901fe5d9-8410-4327-afd0-9a8a0a5388e1 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:37.242397 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-901fe5d9-8410-4327-afd0-9a8a0a5388e1 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:37.893015 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-cdd984f5-f5b9-4048-8af6-38ca1ea4569d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:37.910712 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cdd984f5-f5b9-4048-8af6-38ca1ea4569d tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1475 microversion: 2.1 time: 1.715803 Jul 18 02:28:37.915464 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1539/3076] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:36 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1475 bytes in 1728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:37.956484 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-d82fa130-2ad3-4a3d-b677-3f9d317c69dd req-e4584da9-aa03-4ffb-a2db-efe901d64253 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f19c9c9-419d-4b9a-abdc-432a65381922", "name": "network-vif-unplugged", "status": "completed", "tag": "39add5b7-15aa-4a44-a79b-7041ecfeb6be"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:38.005809 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-d82fa130-2ad3-4a3d-b677-3f9d317c69dd req-e4584da9-aa03-4ffb-a2db-efe901d64253 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:38.006569 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-d82fa130-2ad3-4a3d-b677-3f9d317c69dd req-e4584da9-aa03-4ffb-a2db-efe901d64253 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:38.035989 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-d82fa130-2ad3-4a3d-b677-3f9d317c69dd req-e4584da9-aa03-4ffb-a2db-efe901d64253 service nova] Creating event network-vif-unplugged:39add5b7-15aa-4a44-a79b-7041ecfeb6be for instance 9f19c9c9-419d-4b9a-abdc-432a65381922 on n-h1-465891-3 Jul 18 02:28:38.054733 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [req-d82fa130-2ad3-4a3d-b677-3f9d317c69dd req-e4584da9-aa03-4ffb-a2db-efe901d64253 service nova] Instance 9f19c9c9-419d-4b9a-abdc-432a65381922 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3', 'n-h2-465891-3'} {{(pid=119544) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 02:28:38.108533 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-d82fa130-2ad3-4a3d-b677-3f9d317c69dd req-e4584da9-aa03-4ffb-a2db-efe901d64253 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.189836 Jul 18 02:28:38.110284 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1540/3077] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:38.123572 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-df3d6ebf-bbc2-4df1-ae4c-19cbff11bc27 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:38.125338 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-df3d6ebf-bbc2-4df1-ae4c-19cbff11bc27 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b096f40a-9f6f-4956-bf56-7166600da59b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:38.143868 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-df3d6ebf-bbc2-4df1-ae4c-19cbff11bc27 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:38.147566 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-df3d6ebf-bbc2-4df1-ae4c-19cbff11bc27 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:38.149314 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-df3d6ebf-bbc2-4df1-ae4c-19cbff11bc27 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:38.153659 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-df3d6ebf-bbc2-4df1-ae4c-19cbff11bc27 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:38.857852 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-901fe5d9-8410-4327-afd0-9a8a0a5388e1 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c4c797bfe143049d603541d8327e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a022827cbe40e48709ae4ca21048cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:38.891919 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-901fe5d9-8410-4327-afd0-9a8a0a5388e1 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "GET /compute/v2.1/servers/d6e5a9a2-964e-4c0a-8aed-d791ebac803a" status: 200 len: 1522 microversion: 2.1 time: 1.681368 Jul 18 02:28:38.892855 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1538/3078] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:37 2022] GET /compute/v2.1/servers/d6e5a9a2-964e-4c0a-8aed-d791ebac803a => generated 1522 bytes in 1684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:28:38.918661 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-bbff8af4-b81c-4fdb-8241-e7892d7c391c req-521286b2-53ea-41d8-b25d-f0988235cdfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6e5a9a2-964e-4c0a-8aed-d791ebac803a", "name": "network-vif-deleted", "tag": "ae0ef4d5-d29a-4de2-a08a-50a5d2377729"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:38.944583 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:38.951879 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-bbff8af4-b81c-4fdb-8241-e7892d7c391c req-521286b2-53ea-41d8-b25d-f0988235cdfb service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:38.953454 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-bbff8af4-b81c-4fdb-8241-e7892d7c391c req-521286b2-53ea-41d8-b25d-f0988235cdfb service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:38.982304 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-bbff8af4-b81c-4fdb-8241-e7892d7c391c req-521286b2-53ea-41d8-b25d-f0988235cdfb service nova] Creating event network-vif-deleted:ae0ef4d5-d29a-4de2-a08a-50a5d2377729 for instance d6e5a9a2-964e-4c0a-8aed-d791ebac803a on n-h1-465891-3 Jul 18 02:28:38.993480 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-bbff8af4-b81c-4fdb-8241-e7892d7c391c req-521286b2-53ea-41d8-b25d-f0988235cdfb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095680 Jul 18 02:28:38.995089 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1539/3079] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:39.007285 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5416d623-1e18-4c8e-b09a-80ea3b31a748 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:39.009934 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5416d623-1e18-4c8e-b09a-80ea3b31a748 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:39.025500 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5416d623-1e18-4c8e-b09a-80ea3b31a748 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:39.026709 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5416d623-1e18-4c8e-b09a-80ea3b31a748 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:39.028851 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5416d623-1e18-4c8e-b09a-80ea3b31a748 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:39.030093 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5416d623-1e18-4c8e-b09a-80ea3b31a748 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:39.204776 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=8 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:39.444951 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-df3d6ebf-bbc2-4df1-ae4c-19cbff11bc27 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:39.459139 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-df3d6ebf-bbc2-4df1-ae4c-19cbff11bc27 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b" status: 200 len: 1314 microversion: 2.1 time: 1.346454 Jul 18 02:28:39.460843 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1541/3080] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:38 2022] GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b => generated 1314 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:39.856613 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5416d623-1e18-4c8e-b09a-80ea3b31a748 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:39.871571 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5416d623-1e18-4c8e-b09a-80ea3b31a748 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1475 microversion: 2.1 time: 0.873608 Jul 18 02:28:39.873154 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1540/3081] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:38 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1475 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:39.927331 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-62c9c778-7eb8-42bb-bca0-cb66e47ac6de tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:39.928976 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-62c9c778-7eb8-42bb-bca0-cb66e47ac6de tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] [instance: d6e5a9a2-964e-4c0a-8aed-d791ebac803a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:39.955712 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-62c9c778-7eb8-42bb-bca0-cb66e47ac6de tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:39.956517 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-62c9c778-7eb8-42bb-bca0-cb66e47ac6de tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:39.958304 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-62c9c778-7eb8-42bb-bca0-cb66e47ac6de tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:39.960306 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-62c9c778-7eb8-42bb-bca0-cb66e47ac6de tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:39.994490 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-62c9c778-7eb8-42bb-bca0-cb66e47ac6de tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] HTTP exception thrown: Instance d6e5a9a2-964e-4c0a-8aed-d791ebac803a could not be found. Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-62c9c778-7eb8-42bb-bca0-cb66e47ac6de tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Request method failure captured: Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/d6e5a9a2-964e-4c0a-8aed-d791ebac803a HTTP/1.1 Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MUifTwzFByK-iPOqzUxWJqVhbESwt3TtVF6URuSWWfm-eXVpvGqZPgx2jwLy-4hKXlPJuMzvFxxRoJJJWtOYeyQIS4FUpVk3yhu2Dp17QUUkyMkNR8KojAx4ugTZIuSvmoc19cyBxuGmgVF7E0S9wcY53yyIt5tU_2sIegrnAXbKFw Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 31a022827cbe40e48709ae4ca21048cb Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ListServersNegativeTestJSON-882635085 Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_31a022827cbe40e48709ae4ca21048cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/31a022827cbe40e48709ae4ca21048cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/31a022827cbe40e48709ae4ca21048cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/31a022827cbe40e48709ae4ca21048cb"}]}] Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ListServersNegativeTestJSON-882635085 Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 31a022827cbe40e48709ae4ca21048cb Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-882635085 Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ListServersNegativeTestJSON-882635085-project Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: d4c4c797bfe143049d603541d8327e57 Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ListServersNegativeTestJSON-882635085-project Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance d6e5a9a2-964e-4c0a-8aed-d791ebac803a could not be found. Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'd6e5a9a2-964e-4c0a-8aed-d791ebac803a'} Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6e5a9a2-964e-4c0a-8aed-d791ebac803a could not be found. Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6e5a9a2-964e-4c0a-8aed-d791ebac803a could not be found. Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:39.998312 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.007322 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:40.007322 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:40.007322 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:40.007322 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:28:40.007322 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:28:40.007322 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6e5a9a2-964e-4c0a-8aed-d791ebac803a could not be found. Jul 18 02:28:40.007322 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.010645 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-62c9c778-7eb8-42bb-bca0-cb66e47ac6de tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Returning 404 to user: Instance d6e5a9a2-964e-4c0a-8aed-d791ebac803a could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:28:40.012569 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-62c9c778-7eb8-42bb-bca0-cb66e47ac6de tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "GET /compute/v2.1/servers/d6e5a9a2-964e-4c0a-8aed-d791ebac803a" status: 404 len: 111 microversion: 2.1 time: 0.093215 Jul 18 02:28:40.014411 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1542/3082] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:39 2022] GET /compute/v2.1/servers/d6e5a9a2-964e-4c0a-8aed-d791ebac803a => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:28:40.030677 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-82fe0d5d-92c0-458d-85d5-ee30bf02f8ea tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:40.041936 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-82fe0d5d-92c0-458d-85d5-ee30bf02f8ea tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4c4c797bfe143049d603541d8327e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a022827cbe40e48709ae4ca21048cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:40.043990 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-82fe0d5d-92c0-458d-85d5-ee30bf02f8ea tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '31a022827cbe40e48709ae4ca21048cb'} {{(pid=119543) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:28:40.054100 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-82fe0d5d-92c0-458d-85d5-ee30bf02f8ea tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:40.054816 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-82fe0d5d-92c0-458d-85d5-ee30bf02f8ea tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:40.057827 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-82fe0d5d-92c0-458d-85d5-ee30bf02f8ea tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:40.058684 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-82fe0d5d-92c0-458d-85d5-ee30bf02f8ea tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:40.201595 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-82fe0d5d-92c0-458d-85d5-ee30bf02f8ea tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.179716 Jul 18 02:28:40.203125 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1541/3083] 10.222.0.57 () {58 vars in 1229 bytes} [Mon Jul 18 02:28:40 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:28:40.225834 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4fbcf433-d541-4e76-aa37-59ad359f3254 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4fbcf433-d541-4e76-aa37-59ad359f3254 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Request method failure captured: Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MUifTwzFByK-iPOqzUxWJqVhbESwt3TtVF6URuSWWfm-eXVpvGqZPgx2jwLy-4hKXlPJuMzvFxxRoJJJWtOYeyQIS4FUpVk3yhu2Dp17QUUkyMkNR8KojAx4ugTZIuSvmoc19cyBxuGmgVF7E0S9wcY53yyIt5tU_2sIegrnAXbKFw Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 31a022827cbe40e48709ae4ca21048cb Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ListServersNegativeTestJSON-882635085 Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_31a022827cbe40e48709ae4ca21048cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/31a022827cbe40e48709ae4ca21048cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/31a022827cbe40e48709ae4ca21048cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/31a022827cbe40e48709ae4ca21048cb"}]}] Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ListServersNegativeTestJSON-882635085 Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 31a022827cbe40e48709ae4ca21048cb Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-882635085 Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ListServersNegativeTestJSON-882635085-project Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: d4c4c797bfe143049d603541d8327e57 Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ListServersNegativeTestJSON-882635085-project Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: action_args: {} Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi '2011/01/01' Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 18 02:28:40.248251 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:28:40.268159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:28:40.268159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:28:40.268159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:28:40.268159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 18 02:28:40.268159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.268159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:40.268159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.268159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:40.268159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:40.268159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:40.268159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:28:40.268159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:28:40.268159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 18 02:28:40.268159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.268159 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4fbcf433-d541-4e76-aa37-59ad359f3254 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:28:40.268159 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4fbcf433-d541-4e76-aa37-59ad359f3254 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.039479 Jul 18 02:28:40.285431 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-10d15cb0-3e9a-4f2e-af8b-76abc79a2cc7 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:40.287020 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1543/3084] 10.222.0.57 () {58 vars in 1181 bytes} [Mon Jul 18 02:28:40 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:28:40.295605 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-10d15cb0-3e9a-4f2e-af8b-76abc79a2cc7 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4c4c797bfe143049d603541d8327e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a022827cbe40e48709ae4ca21048cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:40.298677 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-10d15cb0-3e9a-4f2e-af8b-76abc79a2cc7 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Searching by: {'deleted': False, 'project_id': '31a022827cbe40e48709ae4ca21048cb'} {{(pid=119543) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:28:40.313612 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-10d15cb0-3e9a-4f2e-af8b-76abc79a2cc7 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:40.314618 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-10d15cb0-3e9a-4f2e-af8b-76abc79a2cc7 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:40.326793 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-10d15cb0-3e9a-4f2e-af8b-76abc79a2cc7 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:40.327739 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-10d15cb0-3e9a-4f2e-af8b-76abc79a2cc7 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:40.387156 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.multi_cell_list [None req-10d15cb0-3e9a-4f2e-af8b-76abc79a2cc7 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119543) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:28:40.455120 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-10d15cb0-3e9a-4f2e-af8b-76abc79a2cc7 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.178893 Jul 18 02:28:40.456736 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1542/3085] 10.222.0.57 () {58 vars in 1124 bytes} [Mon Jul 18 02:28:40 2022] GET /compute/v2.1/servers => generated 683 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:40.477762 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4c3714c2-e3fd-4509-ae75-93bb618c5f12 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:40.498251 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4c3714c2-e3fd-4509-ae75-93bb618c5f12 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4c4c797bfe143049d603541d8327e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a022827cbe40e48709ae4ca21048cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:40.498601 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1985a4a6-c083-4677-ac81-b913ca52750b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:40.501234 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1985a4a6-c083-4677-ac81-b913ca52750b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b096f40a-9f6f-4956-bf56-7166600da59b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:40.501833 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.compute.servers [None req-4c3714c2-e3fd-4509-ae75-93bb618c5f12 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Removing options 'limit' from query {{(pid=119544) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 18 02:28:40.506286 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4c3714c2-e3fd-4509-ae75-93bb618c5f12 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Searching by: {'deleted': False, 'project_id': '31a022827cbe40e48709ae4ca21048cb'} {{(pid=119544) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:28:40.515408 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:40.516056 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1985a4a6-c083-4677-ac81-b913ca52750b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:40.516970 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1985a4a6-c083-4677-ac81-b913ca52750b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:40.519252 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1985a4a6-c083-4677-ac81-b913ca52750b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:40.520157 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4c3714c2-e3fd-4509-ae75-93bb618c5f12 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:40.520902 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1985a4a6-c083-4677-ac81-b913ca52750b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:40.521735 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4c3714c2-e3fd-4509-ae75-93bb618c5f12 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:40.522853 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4c3714c2-e3fd-4509-ae75-93bb618c5f12 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:40.523482 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4c3714c2-e3fd-4509-ae75-93bb618c5f12 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:40.580951 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.multi_cell_list [None req-4c3714c2-e3fd-4509-ae75-93bb618c5f12 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=119544) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:28:40.643801 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4c3714c2-e3fd-4509-ae75-93bb618c5f12 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.177488 Jul 18 02:28:40.646839 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1544/3086] 10.222.0.57 () {58 vars in 1143 bytes} [Mon Jul 18 02:28:40 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:28:40.668790 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-dc270242-dba7-467c-b038-9ca146c5d28b tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-dc270242-dba7-467c-b038-9ca146c5d28b tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Request method failure captured: Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MUifTwzFByK-iPOqzUxWJqVhbESwt3TtVF6URuSWWfm-eXVpvGqZPgx2jwLy-4hKXlPJuMzvFxxRoJJJWtOYeyQIS4FUpVk3yhu2Dp17QUUkyMkNR8KojAx4ugTZIuSvmoc19cyBxuGmgVF7E0S9wcY53yyIt5tU_2sIegrnAXbKFw Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 31a022827cbe40e48709ae4ca21048cb Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ListServersNegativeTestJSON-882635085 Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_31a022827cbe40e48709ae4ca21048cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/31a022827cbe40e48709ae4ca21048cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/31a022827cbe40e48709ae4ca21048cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/31a022827cbe40e48709ae4ca21048cb"}]}] Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ListServersNegativeTestJSON-882635085 Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 31a022827cbe40e48709ae4ca21048cb Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-882635085 Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ListServersNegativeTestJSON-882635085-project Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: d4c4c797bfe143049d603541d8327e57 Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ListServersNegativeTestJSON-882635085-project Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: action_args: {} Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi '-1' Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 18 02:28:40.676890 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 18 02:28:40.683559 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:28:40.683559 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:28:40.683559 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:28:40.683559 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:28:40.683559 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 18 02:28:40.683559 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.683559 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:40.683559 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.683559 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:40.683559 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:40.683559 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:40.683559 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:28:40.683559 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:28:40.683559 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 18 02:28:40.683559 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.686846 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-dc270242-dba7-467c-b038-9ca146c5d28b tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:28:40.688696 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-dc270242-dba7-467c-b038-9ca146c5d28b tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.030589 Jul 18 02:28:40.690129 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1545/3087] 10.222.0.57 () {58 vars in 1141 bytes} [Mon Jul 18 02:28:40 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:28:40.704003 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-72ad92d3-d11c-444b-8066-36ae21654611 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-72ad92d3-d11c-444b-8066-36ae21654611 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Request method failure captured: Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MUifTwzFByK-iPOqzUxWJqVhbESwt3TtVF6URuSWWfm-eXVpvGqZPgx2jwLy-4hKXlPJuMzvFxxRoJJJWtOYeyQIS4FUpVk3yhu2Dp17QUUkyMkNR8KojAx4ugTZIuSvmoc19cyBxuGmgVF7E0S9wcY53yyIt5tU_2sIegrnAXbKFw Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 31a022827cbe40e48709ae4ca21048cb Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ListServersNegativeTestJSON-882635085 Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_31a022827cbe40e48709ae4ca21048cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/31a022827cbe40e48709ae4ca21048cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/31a022827cbe40e48709ae4ca21048cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/31a022827cbe40e48709ae4ca21048cb"}]}] Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ListServersNegativeTestJSON-882635085 Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 31a022827cbe40e48709ae4ca21048cb Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-882635085 Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ListServersNegativeTestJSON-882635085-project Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: d4c4c797bfe143049d603541d8327e57 Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ListServersNegativeTestJSON-882635085-project Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: action_args: {} Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'testing' Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 18 02:28:40.709231 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 18 02:28:40.716298 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:28:40.716298 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:28:40.716298 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:28:40.716298 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:28:40.716298 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 18 02:28:40.716298 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.716298 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:40.716298 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.716298 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:40.716298 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:40.716298 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:40.716298 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:28:40.716298 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:28:40.716298 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 18 02:28:40.716298 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.720128 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-72ad92d3-d11c-444b-8066-36ae21654611 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:28:40.723959 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-72ad92d3-d11c-444b-8066-36ae21654611 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.024557 Jul 18 02:28:40.725119 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1546/3088] 10.222.0.57 () {58 vars in 1151 bytes} [Mon Jul 18 02:28:40 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:28:40.743593 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0a2c8eb8-c96b-4d17-b46b-2e205c916865 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:40.750943 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0a2c8eb8-c96b-4d17-b46b-2e205c916865 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4c4c797bfe143049d603541d8327e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a022827cbe40e48709ae4ca21048cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:40.752710 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0a2c8eb8-c96b-4d17-b46b-2e205c916865 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '31a022827cbe40e48709ae4ca21048cb'} {{(pid=119544) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:28:40.766474 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.compute.servers [None req-0a2c8eb8-c96b-4d17-b46b-2e205c916865 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Flavor 'non_existing_flavor' could not be found {{(pid=119544) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Jul 18 02:28:40.769026 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0a2c8eb8-c96b-4d17-b46b-2e205c916865 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.033777 Jul 18 02:28:40.788316 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1547/3089] 10.222.0.57 () {58 vars in 1177 bytes} [Mon Jul 18 02:28:40 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:28:40.817169 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-20027a89-a75a-42df-907d-1f5de1c11e92 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:40.846107 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-20027a89-a75a-42df-907d-1f5de1c11e92 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4c4c797bfe143049d603541d8327e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a022827cbe40e48709ae4ca21048cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:40.847997 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-20027a89-a75a-42df-907d-1f5de1c11e92 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '31a022827cbe40e48709ae4ca21048cb'} {{(pid=119544) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:28:40.859057 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-20027a89-a75a-42df-907d-1f5de1c11e92 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:40.859930 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-20027a89-a75a-42df-907d-1f5de1c11e92 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:40.861096 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-20027a89-a75a-42df-907d-1f5de1c11e92 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:40.862165 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-20027a89-a75a-42df-907d-1f5de1c11e92 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:40.996613 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-20027a89-a75a-42df-907d-1f5de1c11e92 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.191581 Jul 18 02:28:41.004535 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1548/3090] 10.222.0.57 () {58 vars in 1173 bytes} [Mon Jul 18 02:28:40 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 02:28:41.014972 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-56e4aa8d-4858-4e1f-b0a2-0f2b8640b245 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:41.015895 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-56e4aa8d-4858-4e1f-b0a2-0f2b8640b245 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:41.030528 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-56e4aa8d-4858-4e1f-b0a2-0f2b8640b245 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:41.031330 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-56e4aa8d-4858-4e1f-b0a2-0f2b8640b245 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:41.032362 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-56e4aa8d-4858-4e1f-b0a2-0f2b8640b245 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:41.032985 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-56e4aa8d-4858-4e1f-b0a2-0f2b8640b245 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:41.037490 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:41.959010 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1985a4a6-c083-4677-ac81-b913ca52750b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:41.975732 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1985a4a6-c083-4677-ac81-b913ca52750b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b" status: 200 len: 1314 microversion: 2.1 time: 1.493852 Jul 18 02:28:41.985895 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1543/3091] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:40 2022] GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b => generated 1314 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:41.997002 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-00f0c602-74e1-4a50-8b3c-8b931c3308b8 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:42.005568 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-00f0c602-74e1-4a50-8b3c-8b931c3308b8 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4c4c797bfe143049d603541d8327e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a022827cbe40e48709ae4ca21048cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:42.007453 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-00f0c602-74e1-4a50-8b3c-8b931c3308b8 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '31a022827cbe40e48709ae4ca21048cb'} {{(pid=119543) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:28:42.020519 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-00f0c602-74e1-4a50-8b3c-8b931c3308b8 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:42.022352 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-00f0c602-74e1-4a50-8b3c-8b931c3308b8 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:42.025552 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-00f0c602-74e1-4a50-8b3c-8b931c3308b8 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:42.027198 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-00f0c602-74e1-4a50-8b3c-8b931c3308b8 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:42.254772 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-00f0c602-74e1-4a50-8b3c-8b931c3308b8 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.266221 Jul 18 02:28:42.256223 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1544/3092] 10.222.0.57 () {58 vars in 1183 bytes} [Mon Jul 18 02:28:41 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:28:42.307499 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-682b7d68-7ed0-41bf-9f43-973f9af65a92 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:42.320375 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-682b7d68-7ed0-41bf-9f43-973f9af65a92 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4c4c797bfe143049d603541d8327e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a022827cbe40e48709ae4ca21048cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:42.325387 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-682b7d68-7ed0-41bf-9f43-973f9af65a92 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Searching by: {'deleted': False, 'project_id': '31a022827cbe40e48709ae4ca21048cb'} {{(pid=119543) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:28:42.360125 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-682b7d68-7ed0-41bf-9f43-973f9af65a92 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:42.362637 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-682b7d68-7ed0-41bf-9f43-973f9af65a92 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:42.374463 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-682b7d68-7ed0-41bf-9f43-973f9af65a92 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:42.375404 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-682b7d68-7ed0-41bf-9f43-973f9af65a92 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:42.457470 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.multi_cell_list [None req-682b7d68-7ed0-41bf-9f43-973f9af65a92 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119543) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:28:42.467347 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:42.517895 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-56e4aa8d-4858-4e1f-b0a2-0f2b8640b245 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:42.538548 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-56e4aa8d-4858-4e1f-b0a2-0f2b8640b245 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1475 microversion: 2.1 time: 1.530140 Jul 18 02:28:42.543601 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-682b7d68-7ed0-41bf-9f43-973f9af65a92 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c4c797bfe143049d603541d8327e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a022827cbe40e48709ae4ca21048cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:42.560736 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-682b7d68-7ed0-41bf-9f43-973f9af65a92 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:42.562688 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1549/3093] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:41 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1475 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:42.563334 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-682b7d68-7ed0-41bf-9f43-973f9af65a92 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:42.994376 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7abea62a-465b-4c4a-bee3-f4ea2a5092c0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:42.995207 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7abea62a-465b-4c4a-bee3-f4ea2a5092c0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b096f40a-9f6f-4956-bf56-7166600da59b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:43.043372 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7abea62a-465b-4c4a-bee3-f4ea2a5092c0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:43.043922 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7abea62a-465b-4c4a-bee3-f4ea2a5092c0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:43.045191 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7abea62a-465b-4c4a-bee3-f4ea2a5092c0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:43.045976 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7abea62a-465b-4c4a-bee3-f4ea2a5092c0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:43.389766 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-682b7d68-7ed0-41bf-9f43-973f9af65a92 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "GET /compute/v2.1/servers/detail" status: 200 len: 3025 microversion: 2.1 time: 1.108113 Jul 18 02:28:43.391264 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1545/3094] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:28:42 2022] GET /compute/v2.1/servers/detail => generated 3025 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:44.006109 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-72616c01-c240-4f15-b1e6-134a73f26f75 req-74ac8b8c-6d89-4f0f-94f6-7759072b03a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f19c9c9-419d-4b9a-abdc-432a65381922", "tag": "39add5b7-15aa-4a44-a79b-7041ecfeb6be"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:44.018896 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-72616c01-c240-4f15-b1e6-134a73f26f75 req-74ac8b8c-6d89-4f0f-94f6-7759072b03a9 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:44.019377 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-72616c01-c240-4f15-b1e6-134a73f26f75 req-74ac8b8c-6d89-4f0f-94f6-7759072b03a9 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:44.047451 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-72616c01-c240-4f15-b1e6-134a73f26f75 req-74ac8b8c-6d89-4f0f-94f6-7759072b03a9 service nova] Creating event network-changed:39add5b7-15aa-4a44-a79b-7041ecfeb6be for instance 9f19c9c9-419d-4b9a-abdc-432a65381922 on n-h1-465891-3 Jul 18 02:28:44.069041 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [req-72616c01-c240-4f15-b1e6-134a73f26f75 req-74ac8b8c-6d89-4f0f-94f6-7759072b03a9 service nova] Instance 9f19c9c9-419d-4b9a-abdc-432a65381922 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3', 'n-h2-465891-3'} {{(pid=119543) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 02:28:44.113985 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-72616c01-c240-4f15-b1e6-134a73f26f75 req-74ac8b8c-6d89-4f0f-94f6-7759072b03a9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.719961 Jul 18 02:28:44.116554 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1546/3095] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:44.130379 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-55907d29-ea66-4fce-87ce-2f3f0ea0b465 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:44.139320 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-55907d29-ea66-4fce-87ce-2f3f0ea0b465 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4c4c797bfe143049d603541d8327e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a022827cbe40e48709ae4ca21048cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:44.142764 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-55907d29-ea66-4fce-87ce-2f3f0ea0b465 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.022590 Jul 18 02:28:44.153126 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1547/3096] 10.222.0.57 () {58 vars in 1177 bytes} [Mon Jul 18 02:28:44 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:28:44.160532 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dd6fa3c1-5323-48a5-becc-4ccded35a7c0 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:44.162098 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-dd6fa3c1-5323-48a5-becc-4ccded35a7c0 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:44.176716 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dd6fa3c1-5323-48a5-becc-4ccded35a7c0 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:44.177514 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dd6fa3c1-5323-48a5-becc-4ccded35a7c0 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:44.179513 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dd6fa3c1-5323-48a5-becc-4ccded35a7c0 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:44.182198 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dd6fa3c1-5323-48a5-becc-4ccded35a7c0 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:44.427126 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7abea62a-465b-4c4a-bee3-f4ea2a5092c0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:44.436461 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7abea62a-465b-4c4a-bee3-f4ea2a5092c0 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b" status: 200 len: 1314 microversion: 2.1 time: 1.446881 Jul 18 02:28:44.437459 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1550/3097] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:42 2022] GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b => generated 1314 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:28:44.442971 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7b0e0813-ed67-4fde-8d28-a57b3c79cef0 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:44.447523 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7b0e0813-ed67-4fde-8d28-a57b3c79cef0 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4c4c797bfe143049d603541d8327e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a022827cbe40e48709ae4ca21048cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:44.448592 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7b0e0813-ed67-4fde-8d28-a57b3c79cef0 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Searching by: {'deleted': False, 'project_id': '31a022827cbe40e48709ae4ca21048cb'} {{(pid=119544) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:28:44.454704 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7b0e0813-ed67-4fde-8d28-a57b3c79cef0 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:44.455533 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7b0e0813-ed67-4fde-8d28-a57b3c79cef0 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:44.456795 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7b0e0813-ed67-4fde-8d28-a57b3c79cef0 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:44.457555 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7b0e0813-ed67-4fde-8d28-a57b3c79cef0 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:44.488276 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.multi_cell_list [None req-7b0e0813-ed67-4fde-8d28-a57b3c79cef0 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119544) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:28:44.571315 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7b0e0813-ed67-4fde-8d28-a57b3c79cef0 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.132369 Jul 18 02:28:44.574538 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1551/3098] 10.222.0.57 () {58 vars in 1124 bytes} [Mon Jul 18 02:28:44 2022] GET /compute/v2.1/servers => generated 683 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:44.612775 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-91d237c2-3403-4b33-94eb-f2cc72d9f79c tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:44.616469 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-91d237c2-3403-4b33-94eb-f2cc72d9f79c tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] [instance: d6e5a9a2-964e-4c0a-8aed-d791ebac803a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:44.642756 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91d237c2-3403-4b33-94eb-f2cc72d9f79c tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:44.646080 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91d237c2-3403-4b33-94eb-f2cc72d9f79c tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:44.647126 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91d237c2-3403-4b33-94eb-f2cc72d9f79c tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:44.648266 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91d237c2-3403-4b33-94eb-f2cc72d9f79c tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:44.683664 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-91d237c2-3403-4b33-94eb-f2cc72d9f79c tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] HTTP exception thrown: Instance d6e5a9a2-964e-4c0a-8aed-d791ebac803a could not be found. Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-91d237c2-3403-4b33-94eb-f2cc72d9f79c tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Request method failure captured: Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/servers/d6e5a9a2-964e-4c0a-8aed-d791ebac803a HTTP/1.1 Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MUifTwzFByK-iPOqzUxWJqVhbESwt3TtVF6URuSWWfm-eXVpvGqZPgx2jwLy-4hKXlPJuMzvFxxRoJJJWtOYeyQIS4FUpVk3yhu2Dp17QUUkyMkNR8KojAx4ugTZIuSvmoc19cyBxuGmgVF7E0S9wcY53yyIt5tU_2sIegrnAXbKFw Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 31a022827cbe40e48709ae4ca21048cb Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ListServersNegativeTestJSON-882635085 Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_31a022827cbe40e48709ae4ca21048cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/31a022827cbe40e48709ae4ca21048cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/31a022827cbe40e48709ae4ca21048cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/31a022827cbe40e48709ae4ca21048cb"}]}] Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ListServersNegativeTestJSON-882635085 Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 31a022827cbe40e48709ae4ca21048cb Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-882635085 Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ListServersNegativeTestJSON-882635085-project Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: d4c4c797bfe143049d603541d8327e57 Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ListServersNegativeTestJSON-882635085-project Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance d6e5a9a2-964e-4c0a-8aed-d791ebac803a could not be found. Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'd6e5a9a2-964e-4c0a-8aed-d791ebac803a'} Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6e5a9a2-964e-4c0a-8aed-d791ebac803a could not be found. Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:28:44.685731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:28:44.698979 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6e5a9a2-964e-4c0a-8aed-d791ebac803a could not be found. Jul 18 02:28:44.698979 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:44.698979 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:44.698979 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:44.698979 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:44.698979 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:44.698979 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:44.698979 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:28:44.698979 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:28:44.698979 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6e5a9a2-964e-4c0a-8aed-d791ebac803a could not be found. Jul 18 02:28:44.698979 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:44.698979 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-91d237c2-3403-4b33-94eb-f2cc72d9f79c tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Returning 404 to user: Instance d6e5a9a2-964e-4c0a-8aed-d791ebac803a could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:28:44.702208 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-91d237c2-3403-4b33-94eb-f2cc72d9f79c tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d6e5a9a2-964e-4c0a-8aed-d791ebac803a" status: 404 len: 111 microversion: 2.1 time: 0.115041 Jul 18 02:28:44.703114 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1552/3099] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:28:44 2022] DELETE /compute/v2.1/servers/d6e5a9a2-964e-4c0a-8aed-d791ebac803a => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:28:44.713664 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-63144cee-3b4e-46f7-87d0-f2a30dc43829 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:44.715328 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-63144cee-3b4e-46f7-87d0-f2a30dc43829 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] [instance: f78c2991-4119-43e9-a66c-519524b33977] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:44.729647 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-63144cee-3b4e-46f7-87d0-f2a30dc43829 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:44.731949 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-63144cee-3b4e-46f7-87d0-f2a30dc43829 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:44.738120 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-63144cee-3b4e-46f7-87d0-f2a30dc43829 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:44.740022 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-63144cee-3b4e-46f7-87d0-f2a30dc43829 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:44.811267 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-63144cee-3b4e-46f7-87d0-f2a30dc43829 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] [instance: f78c2991-4119-43e9-a66c-519524b33977] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:28:45.048131 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-63144cee-3b4e-46f7-87d0-f2a30dc43829 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f78c2991-4119-43e9-a66c-519524b33977" status: 204 len: 0 microversion: 2.1 time: 0.338454 Jul 18 02:28:45.053766 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1553/3100] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:28:44 2022] DELETE /compute/v2.1/servers/f78c2991-4119-43e9-a66c-519524b33977 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:28:45.066776 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5cfe90ea-126d-4820-ba90-6e9731b5cffa tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:45.068312 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5cfe90ea-126d-4820-ba90-6e9731b5cffa tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] [instance: 5f83aa0b-12f7-42c3-8dda-d5f45b817a93] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:45.077033 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5cfe90ea-126d-4820-ba90-6e9731b5cffa tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:45.077501 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5cfe90ea-126d-4820-ba90-6e9731b5cffa tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:45.078588 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5cfe90ea-126d-4820-ba90-6e9731b5cffa tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:45.080273 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5cfe90ea-126d-4820-ba90-6e9731b5cffa tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:45.120398 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5cfe90ea-126d-4820-ba90-6e9731b5cffa tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] [instance: 5f83aa0b-12f7-42c3-8dda-d5f45b817a93] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:28:45.128250 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-dd6fa3c1-5323-48a5-becc-4ccded35a7c0 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:45.144342 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-dd6fa3c1-5323-48a5-becc-4ccded35a7c0 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1475 microversion: 2.1 time: 0.992279 Jul 18 02:28:45.150566 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1548/3101] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:44 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1475 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:45.281411 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5cfe90ea-126d-4820-ba90-6e9731b5cffa tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "DELETE /compute/v2.1/servers/5f83aa0b-12f7-42c3-8dda-d5f45b817a93" status: 204 len: 0 microversion: 2.1 time: 0.223665 Jul 18 02:28:45.283563 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1554/3102] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:28:45 2022] DELETE /compute/v2.1/servers/5f83aa0b-12f7-42c3-8dda-d5f45b817a93 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:28:45.295838 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b8bf2b2c-4822-450c-a1c5-88b7060096a4 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:45.296607 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b8bf2b2c-4822-450c-a1c5-88b7060096a4 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] [instance: d6e5a9a2-964e-4c0a-8aed-d791ebac803a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:45.307392 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b8bf2b2c-4822-450c-a1c5-88b7060096a4 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:45.308516 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b8bf2b2c-4822-450c-a1c5-88b7060096a4 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:45.309997 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b8bf2b2c-4822-450c-a1c5-88b7060096a4 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:45.310527 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b8bf2b2c-4822-450c-a1c5-88b7060096a4 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:45.331941 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-b8bf2b2c-4822-450c-a1c5-88b7060096a4 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] HTTP exception thrown: Instance d6e5a9a2-964e-4c0a-8aed-d791ebac803a could not be found. Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b8bf2b2c-4822-450c-a1c5-88b7060096a4 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Request method failure captured: Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/d6e5a9a2-964e-4c0a-8aed-d791ebac803a HTTP/1.1 Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MUifTwzFByK-iPOqzUxWJqVhbESwt3TtVF6URuSWWfm-eXVpvGqZPgx2jwLy-4hKXlPJuMzvFxxRoJJJWtOYeyQIS4FUpVk3yhu2Dp17QUUkyMkNR8KojAx4ugTZIuSvmoc19cyBxuGmgVF7E0S9wcY53yyIt5tU_2sIegrnAXbKFw Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 31a022827cbe40e48709ae4ca21048cb Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ListServersNegativeTestJSON-882635085 Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_31a022827cbe40e48709ae4ca21048cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/31a022827cbe40e48709ae4ca21048cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/31a022827cbe40e48709ae4ca21048cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/31a022827cbe40e48709ae4ca21048cb"}]}] Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ListServersNegativeTestJSON-882635085 Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 31a022827cbe40e48709ae4ca21048cb Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-882635085 Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ListServersNegativeTestJSON-882635085-project Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: d4c4c797bfe143049d603541d8327e57 Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ListServersNegativeTestJSON-882635085-project Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance d6e5a9a2-964e-4c0a-8aed-d791ebac803a could not be found. Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'd6e5a9a2-964e-4c0a-8aed-d791ebac803a'} Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6e5a9a2-964e-4c0a-8aed-d791ebac803a could not be found. Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6e5a9a2-964e-4c0a-8aed-d791ebac803a could not be found. Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:45.333761 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:28:45.346418 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:45.346418 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:45.346418 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:45.346418 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:28:45.346418 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:28:45.346418 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6e5a9a2-964e-4c0a-8aed-d791ebac803a could not be found. Jul 18 02:28:45.346418 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:28:45.346418 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b8bf2b2c-4822-450c-a1c5-88b7060096a4 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Returning 404 to user: Instance d6e5a9a2-964e-4c0a-8aed-d791ebac803a could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:28:45.346418 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b8bf2b2c-4822-450c-a1c5-88b7060096a4 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "GET /compute/v2.1/servers/d6e5a9a2-964e-4c0a-8aed-d791ebac803a" status: 404 len: 111 microversion: 2.1 time: 0.046736 Jul 18 02:28:45.346418 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1549/3103] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:45 2022] GET /compute/v2.1/servers/d6e5a9a2-964e-4c0a-8aed-d791ebac803a => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:28:45.350311 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-92076f95-48b7-4351-9a66-fd2c847a300d tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:45.350311 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-92076f95-48b7-4351-9a66-fd2c847a300d tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] [instance: f78c2991-4119-43e9-a66c-519524b33977] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:45.372649 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-92076f95-48b7-4351-9a66-fd2c847a300d tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:45.374071 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-92076f95-48b7-4351-9a66-fd2c847a300d tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:45.375617 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-92076f95-48b7-4351-9a66-fd2c847a300d tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:45.381413 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-92076f95-48b7-4351-9a66-fd2c847a300d tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:45.463693 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1ac61b5d-c17a-4a87-9479-a2501f787274 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:45.469278 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1ac61b5d-c17a-4a87-9479-a2501f787274 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b096f40a-9f6f-4956-bf56-7166600da59b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:45.481790 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1ac61b5d-c17a-4a87-9479-a2501f787274 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:45.482706 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1ac61b5d-c17a-4a87-9479-a2501f787274 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:45.483810 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1ac61b5d-c17a-4a87-9479-a2501f787274 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:45.484598 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1ac61b5d-c17a-4a87-9479-a2501f787274 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:46.402511 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1ac61b5d-c17a-4a87-9479-a2501f787274 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:46.421066 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1ac61b5d-c17a-4a87-9479-a2501f787274 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b" status: 200 len: 1314 microversion: 2.1 time: 0.968748 Jul 18 02:28:46.422502 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1550/3104] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:45 2022] GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b => generated 1314 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:28:46.430299 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1056016d-9e6d-4cdf-85db-a742ab81fbbf tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:46.433231 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1056016d-9e6d-4cdf-85db-a742ab81fbbf tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:46.445068 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1056016d-9e6d-4cdf-85db-a742ab81fbbf tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:46.446194 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1056016d-9e6d-4cdf-85db-a742ab81fbbf tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:46.447914 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1056016d-9e6d-4cdf-85db-a742ab81fbbf tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:46.448747 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1056016d-9e6d-4cdf-85db-a742ab81fbbf tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:46.878596 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-92076f95-48b7-4351-9a66-fd2c847a300d tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c4c797bfe143049d603541d8327e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a022827cbe40e48709ae4ca21048cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:46.898737 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-92076f95-48b7-4351-9a66-fd2c847a300d tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "GET /compute/v2.1/servers/f78c2991-4119-43e9-a66c-519524b33977" status: 200 len: 1522 microversion: 2.1 time: 1.555237 Jul 18 02:28:46.900686 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1555/3105] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:45 2022] GET /compute/v2.1/servers/f78c2991-4119-43e9-a66c-519524b33977 => generated 1522 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:46.911495 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-ea7b5f03-78f8-4377-898c-d2063920c97a req-c526ead8-3fa0-4728-90ff-b390f108d975 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b096f40a-9f6f-4956-bf56-7166600da59b", "tag": "702b2fe2-d4a7-47ca-8224-b62a64b942ca"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:46.934097 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-ea7b5f03-78f8-4377-898c-d2063920c97a req-c526ead8-3fa0-4728-90ff-b390f108d975 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:46.935604 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-ea7b5f03-78f8-4377-898c-d2063920c97a req-c526ead8-3fa0-4728-90ff-b390f108d975 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:46.987421 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-ea7b5f03-78f8-4377-898c-d2063920c97a req-c526ead8-3fa0-4728-90ff-b390f108d975 service nova] Creating event network-changed:702b2fe2-d4a7-47ca-8224-b62a64b942ca for instance b096f40a-9f6f-4956-bf56-7166600da59b on n-h2-465891-3 Jul 18 02:28:47.001863 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-ea7b5f03-78f8-4377-898c-d2063920c97a req-c526ead8-3fa0-4728-90ff-b390f108d975 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098581 Jul 18 02:28:47.004252 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1556/3106] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:47.267342 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1056016d-9e6d-4cdf-85db-a742ab81fbbf tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:47.294875 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1056016d-9e6d-4cdf-85db-a742ab81fbbf tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1475 microversion: 2.1 time: 0.870164 Jul 18 02:28:47.299111 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1551/3107] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:46 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1475 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:47.447998 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-63497d17-e142-481e-9bd7-cf38b0f600a3 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:47.449664 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-63497d17-e142-481e-9bd7-cf38b0f600a3 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b096f40a-9f6f-4956-bf56-7166600da59b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:47.461104 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-63497d17-e142-481e-9bd7-cf38b0f600a3 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:47.462117 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-63497d17-e142-481e-9bd7-cf38b0f600a3 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:47.465820 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-63497d17-e142-481e-9bd7-cf38b0f600a3 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:47.466828 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-63497d17-e142-481e-9bd7-cf38b0f600a3 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:47.945644 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6f769694-1237-44e1-9894-156fca8765ff tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:47.945644 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6f769694-1237-44e1-9894-156fca8765ff tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] [instance: f78c2991-4119-43e9-a66c-519524b33977] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:48.024309 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6f769694-1237-44e1-9894-156fca8765ff tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:48.025628 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6f769694-1237-44e1-9894-156fca8765ff tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:48.027155 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6f769694-1237-44e1-9894-156fca8765ff tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:48.029060 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6f769694-1237-44e1-9894-156fca8765ff tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:49.317852 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-63497d17-e142-481e-9bd7-cf38b0f600a3 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:49.360004 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-63497d17-e142-481e-9bd7-cf38b0f600a3 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b" status: 200 len: 1314 microversion: 2.1 time: 1.902397 Jul 18 02:28:49.361570 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1557/3108] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:47 2022] GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b => generated 1314 bytes in 1921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:49.400209 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0508e505-752e-4f96-ab79-12b25ab366a8 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:49.402218 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0508e505-752e-4f96-ab79-12b25ab366a8 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:49.428154 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0508e505-752e-4f96-ab79-12b25ab366a8 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:49.428991 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0508e505-752e-4f96-ab79-12b25ab366a8 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:49.444628 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0508e505-752e-4f96-ab79-12b25ab366a8 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:49.446200 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0508e505-752e-4f96-ab79-12b25ab366a8 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:49.903472 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6f769694-1237-44e1-9894-156fca8765ff tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c4c797bfe143049d603541d8327e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a022827cbe40e48709ae4ca21048cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:49.912888 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6f769694-1237-44e1-9894-156fca8765ff tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "GET /compute/v2.1/servers/f78c2991-4119-43e9-a66c-519524b33977" status: 200 len: 1522 microversion: 2.1 time: 1.999223 Jul 18 02:28:49.914380 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1552/3109] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:47 2022] GET /compute/v2.1/servers/f78c2991-4119-43e9-a66c-519524b33977 => generated 1522 bytes in 2002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:49.924071 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-42c6264b-58a6-495f-8ff0-f9fab51a7275 req-015028a1-5d97-492e-8801-e96818e55ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f78c2991-4119-43e9-a66c-519524b33977", "name": "network-vif-deleted", "tag": "e83b2910-f842-4690-bab9-77d796e2f6c3"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:49.932969 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:49.935331 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-42c6264b-58a6-495f-8ff0-f9fab51a7275 req-015028a1-5d97-492e-8801-e96818e55ba7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:49.937070 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-42c6264b-58a6-495f-8ff0-f9fab51a7275 req-015028a1-5d97-492e-8801-e96818e55ba7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:49.953751 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-42c6264b-58a6-495f-8ff0-f9fab51a7275 req-015028a1-5d97-492e-8801-e96818e55ba7 service nova] Creating event network-vif-deleted:e83b2910-f842-4690-bab9-77d796e2f6c3 for instance f78c2991-4119-43e9-a66c-519524b33977 on n-h2-465891-3 Jul 18 02:28:49.959818 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-42c6264b-58a6-495f-8ff0-f9fab51a7275 req-015028a1-5d97-492e-8801-e96818e55ba7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044008 Jul 18 02:28:49.961075 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1553/3110] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:50.006163 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0508e505-752e-4f96-ab79-12b25ab366a8 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:50.026981 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0508e505-752e-4f96-ab79-12b25ab366a8 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1473 microversion: 2.1 time: 0.658729 Jul 18 02:28:50.028817 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1558/3111] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:49 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1473 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:50.385838 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-be0b38ee-ea99-4837-9b38-56a169fe5f15 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:50.390203 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-be0b38ee-ea99-4837-9b38-56a169fe5f15 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b096f40a-9f6f-4956-bf56-7166600da59b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:50.420902 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-be0b38ee-ea99-4837-9b38-56a169fe5f15 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:50.423581 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-be0b38ee-ea99-4837-9b38-56a169fe5f15 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:50.426325 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-be0b38ee-ea99-4837-9b38-56a169fe5f15 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:50.427441 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-be0b38ee-ea99-4837-9b38-56a169fe5f15 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:50.943795 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-87f26dd4-0d3f-4859-a481-4645eb2e604a tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:50.944419 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-87f26dd4-0d3f-4859-a481-4645eb2e604a tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] [instance: f78c2991-4119-43e9-a66c-519524b33977] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:50.958992 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-87f26dd4-0d3f-4859-a481-4645eb2e604a tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:50.959801 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-87f26dd4-0d3f-4859-a481-4645eb2e604a tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:50.961260 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-87f26dd4-0d3f-4859-a481-4645eb2e604a tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:50.962080 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-87f26dd4-0d3f-4859-a481-4645eb2e604a tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:51.036079 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-87f26dd4-0d3f-4859-a481-4645eb2e604a tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] HTTP exception thrown: Instance f78c2991-4119-43e9-a66c-519524b33977 could not be found. Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-87f26dd4-0d3f-4859-a481-4645eb2e604a tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Request method failure captured: Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/f78c2991-4119-43e9-a66c-519524b33977 HTTP/1.1 Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MUifTwzFByK-iPOqzUxWJqVhbESwt3TtVF6URuSWWfm-eXVpvGqZPgx2jwLy-4hKXlPJuMzvFxxRoJJJWtOYeyQIS4FUpVk3yhu2Dp17QUUkyMkNR8KojAx4ugTZIuSvmoc19cyBxuGmgVF7E0S9wcY53yyIt5tU_2sIegrnAXbKFw Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 31a022827cbe40e48709ae4ca21048cb Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ListServersNegativeTestJSON-882635085 Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_31a022827cbe40e48709ae4ca21048cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/31a022827cbe40e48709ae4ca21048cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/31a022827cbe40e48709ae4ca21048cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/31a022827cbe40e48709ae4ca21048cb"}]}] Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ListServersNegativeTestJSON-882635085 Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 31a022827cbe40e48709ae4ca21048cb Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-882635085 Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ListServersNegativeTestJSON-882635085-project Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: d4c4c797bfe143049d603541d8327e57 Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ListServersNegativeTestJSON-882635085-project Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance f78c2991-4119-43e9-a66c-519524b33977 could not be found. Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'f78c2991-4119-43e9-a66c-519524b33977'} Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f78c2991-4119-43e9-a66c-519524b33977 could not be found. Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f78c2991-4119-43e9-a66c-519524b33977 could not be found. Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:51.039403 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:51.062422 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:51.062422 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:51.062422 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:51.062422 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:28:51.062422 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:28:51.062422 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f78c2991-4119-43e9-a66c-519524b33977 could not be found. Jul 18 02:28:51.062422 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:28:51.062422 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-87f26dd4-0d3f-4859-a481-4645eb2e604a tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Returning 404 to user: Instance f78c2991-4119-43e9-a66c-519524b33977 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:28:51.062422 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-87f26dd4-0d3f-4859-a481-4645eb2e604a tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "GET /compute/v2.1/servers/f78c2991-4119-43e9-a66c-519524b33977" status: 404 len: 111 microversion: 2.1 time: 0.103184 Jul 18 02:28:51.062422 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1559/3112] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:50 2022] GET /compute/v2.1/servers/f78c2991-4119-43e9-a66c-519524b33977 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:28:51.065474 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-18c19dcc-5f7a-4c32-b335-daaec5abb157 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:51.066309 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-18c19dcc-5f7a-4c32-b335-daaec5abb157 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] [instance: 5f83aa0b-12f7-42c3-8dda-d5f45b817a93] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:51.103318 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-18c19dcc-5f7a-4c32-b335-daaec5abb157 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:51.104588 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-18c19dcc-5f7a-4c32-b335-daaec5abb157 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:51.106140 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-18c19dcc-5f7a-4c32-b335-daaec5abb157 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:51.106908 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-18c19dcc-5f7a-4c32-b335-daaec5abb157 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:51.188704 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-be0b38ee-ea99-4837-9b38-56a169fe5f15 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:51.229499 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-be0b38ee-ea99-4837-9b38-56a169fe5f15 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b" status: 200 len: 1314 microversion: 2.1 time: 0.852132 Jul 18 02:28:51.255289 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1554/3113] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:50 2022] GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b => generated 1314 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:51.272070 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b86842fb-b201-4cd8-bd79-64f80700c6fe tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:51.289480 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b86842fb-b201-4cd8-bd79-64f80700c6fe tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:51.298216 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-18c19dcc-5f7a-4c32-b335-daaec5abb157 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:51.299047 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-18c19dcc-5f7a-4c32-b335-daaec5abb157 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:51.299878 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-18c19dcc-5f7a-4c32-b335-daaec5abb157 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lazy-loading 'fault' on Instance uuid 5f83aa0b-12f7-42c3-8dda-d5f45b817a93 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:28:51.327475 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b86842fb-b201-4cd8-bd79-64f80700c6fe tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:51.328603 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b86842fb-b201-4cd8-bd79-64f80700c6fe tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:51.330823 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b86842fb-b201-4cd8-bd79-64f80700c6fe tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:51.331107 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b86842fb-b201-4cd8-bd79-64f80700c6fe tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:51.700160 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-18c19dcc-5f7a-4c32-b335-daaec5abb157 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c4c797bfe143049d603541d8327e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a022827cbe40e48709ae4ca21048cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:51.721923 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-18c19dcc-5f7a-4c32-b335-daaec5abb157 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "GET /compute/v2.1/servers/5f83aa0b-12f7-42c3-8dda-d5f45b817a93" status: 200 len: 1313 microversion: 2.1 time: 0.668329 Jul 18 02:28:51.734262 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1560/3114] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:51 2022] GET /compute/v2.1/servers/5f83aa0b-12f7-42c3-8dda-d5f45b817a93 => generated 1313 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:52.131614 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-486b8d79-4a85-4611-b50f-8023fbb82f95 req-95590e08-2744-4664-8272-152b140f60d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f83aa0b-12f7-42c3-8dda-d5f45b817a93", "name": "network-vif-deleted", "tag": "924e9457-fa79-43e4-ab5e-d525666bf909"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:52.152532 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-486b8d79-4a85-4611-b50f-8023fbb82f95 req-95590e08-2744-4664-8272-152b140f60d4 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:52.155161 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-486b8d79-4a85-4611-b50f-8023fbb82f95 req-95590e08-2744-4664-8272-152b140f60d4 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:52.191391 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-486b8d79-4a85-4611-b50f-8023fbb82f95 req-95590e08-2744-4664-8272-152b140f60d4 service nova] Creating event network-vif-deleted:924e9457-fa79-43e4-ab5e-d525666bf909 for instance 5f83aa0b-12f7-42c3-8dda-d5f45b817a93 on n-h1-465891-3 Jul 18 02:28:52.201504 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-486b8d79-4a85-4611-b50f-8023fbb82f95 req-95590e08-2744-4664-8272-152b140f60d4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089792 Jul 18 02:28:52.203260 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1561/3115] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:52.278847 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-034a20be-8d96-401c-937a-9e297e3aae7f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:52.279663 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-034a20be-8d96-401c-937a-9e297e3aae7f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b096f40a-9f6f-4956-bf56-7166600da59b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:52.292976 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-034a20be-8d96-401c-937a-9e297e3aae7f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:52.293647 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-034a20be-8d96-401c-937a-9e297e3aae7f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:52.296153 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-034a20be-8d96-401c-937a-9e297e3aae7f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:52.298104 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-034a20be-8d96-401c-937a-9e297e3aae7f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:52.419740 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=8 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:52.538737 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:52.551330 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b86842fb-b201-4cd8-bd79-64f80700c6fe tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:52.573763 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b86842fb-b201-4cd8-bd79-64f80700c6fe tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1470 microversion: 2.1 time: 1.315506 Jul 18 02:28:52.574768 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1555/3116] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:51 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1470 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:52.595477 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-13ce6a4f-4b8f-4299-b4cc-ba01ebdad10e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:52.596361 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-13ce6a4f-4b8f-4299-b4cc-ba01ebdad10e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:52.613781 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-13ce6a4f-4b8f-4299-b4cc-ba01ebdad10e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:52.614532 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-13ce6a4f-4b8f-4299-b4cc-ba01ebdad10e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:52.615627 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-13ce6a4f-4b8f-4299-b4cc-ba01ebdad10e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:52.616517 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-13ce6a4f-4b8f-4299-b4cc-ba01ebdad10e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:52.828373 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-13ce6a4f-4b8f-4299-b4cc-ba01ebdad10e tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "POST /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922/action" status: 202 len: 0 microversion: 2.1 time: 0.240376 Jul 18 02:28:52.829232 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1556/3117] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:28:52 2022] POST /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:28:52.835893 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cfe4a752-8f42-4a98-9d2c-b2ff100d9269 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:52.837926 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cfe4a752-8f42-4a98-9d2c-b2ff100d9269 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] [instance: 5f83aa0b-12f7-42c3-8dda-d5f45b817a93] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:52.846592 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cfe4a752-8f42-4a98-9d2c-b2ff100d9269 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:52.847588 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cfe4a752-8f42-4a98-9d2c-b2ff100d9269 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:52.848649 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cfe4a752-8f42-4a98-9d2c-b2ff100d9269 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:52.849287 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cfe4a752-8f42-4a98-9d2c-b2ff100d9269 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:52.866753 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-cfe4a752-8f42-4a98-9d2c-b2ff100d9269 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] HTTP exception thrown: Instance 5f83aa0b-12f7-42c3-8dda-d5f45b817a93 could not be found. Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cfe4a752-8f42-4a98-9d2c-b2ff100d9269 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Request method failure captured: Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/5f83aa0b-12f7-42c3-8dda-d5f45b817a93 HTTP/1.1 Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MUifTwzFByK-iPOqzUxWJqVhbESwt3TtVF6URuSWWfm-eXVpvGqZPgx2jwLy-4hKXlPJuMzvFxxRoJJJWtOYeyQIS4FUpVk3yhu2Dp17QUUkyMkNR8KojAx4ugTZIuSvmoc19cyBxuGmgVF7E0S9wcY53yyIt5tU_2sIegrnAXbKFw Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 31a022827cbe40e48709ae4ca21048cb Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ListServersNegativeTestJSON-882635085 Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_31a022827cbe40e48709ae4ca21048cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/31a022827cbe40e48709ae4ca21048cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/31a022827cbe40e48709ae4ca21048cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/31a022827cbe40e48709ae4ca21048cb"}]}] Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ListServersNegativeTestJSON-882635085 Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 31a022827cbe40e48709ae4ca21048cb Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-882635085 Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ListServersNegativeTestJSON-882635085-project Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: d4c4c797bfe143049d603541d8327e57 Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ListServersNegativeTestJSON-882635085-project Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 5f83aa0b-12f7-42c3-8dda-d5f45b817a93 could not be found. Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '5f83aa0b-12f7-42c3-8dda-d5f45b817a93'} Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f83aa0b-12f7-42c3-8dda-d5f45b817a93 could not be found. Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f83aa0b-12f7-42c3-8dda-d5f45b817a93 could not be found. Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:52.869051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:28:52.889268 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:52.889268 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:52.889268 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:52.889268 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:28:52.889268 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:28:52.889268 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f83aa0b-12f7-42c3-8dda-d5f45b817a93 could not be found. Jul 18 02:28:52.889268 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:28:52.889268 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cfe4a752-8f42-4a98-9d2c-b2ff100d9269 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] Returning 404 to user: Instance 5f83aa0b-12f7-42c3-8dda-d5f45b817a93 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:28:52.889268 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cfe4a752-8f42-4a98-9d2c-b2ff100d9269 tempest-ListServersNegativeTestJSON-882635085 tempest-ListServersNegativeTestJSON-882635085-project] 10.222.0.57 "GET /compute/v2.1/servers/5f83aa0b-12f7-42c3-8dda-d5f45b817a93" status: 404 len: 111 microversion: 2.1 time: 0.041257 Jul 18 02:28:52.889268 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1557/3118] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:52 2022] GET /compute/v2.1/servers/5f83aa0b-12f7-42c3-8dda-d5f45b817a93 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:28:52.889268 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e5cac312-de4c-48d7-a4ae-71cfa0c81884 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:52.889268 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e5cac312-de4c-48d7-a4ae-71cfa0c81884 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:52.889268 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e5cac312-de4c-48d7-a4ae-71cfa0c81884 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:52.889268 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e5cac312-de4c-48d7-a4ae-71cfa0c81884 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:52.889268 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e5cac312-de4c-48d7-a4ae-71cfa0c81884 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:52.894812 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e5cac312-de4c-48d7-a4ae-71cfa0c81884 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:54.181883 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e5cac312-de4c-48d7-a4ae-71cfa0c81884 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:54.200904 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-034a20be-8d96-401c-937a-9e297e3aae7f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:54.238453 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-034a20be-8d96-401c-937a-9e297e3aae7f tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b" status: 200 len: 1314 microversion: 2.1 time: 1.966776 Jul 18 02:28:54.242043 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1562/3119] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:52 2022] GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b => generated 1314 bytes in 1973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:54.243665 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e5cac312-de4c-48d7-a4ae-71cfa0c81884 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1469 microversion: 2.1 time: 1.367672 Jul 18 02:28:54.245285 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1558/3120] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:52 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1469 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:55.285502 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8de828bc-dbf3-4eaa-9472-8c9423dc610a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:55.286678 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8de828bc-dbf3-4eaa-9472-8c9423dc610a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b096f40a-9f6f-4956-bf56-7166600da59b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:55.290713 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c67e617d-d3ff-4ba7-bacf-1299aa087cba tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:55.297500 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c67e617d-d3ff-4ba7-bacf-1299aa087cba tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:55.316275 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:55.351644 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c67e617d-d3ff-4ba7-bacf-1299aa087cba tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:55.352316 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c67e617d-d3ff-4ba7-bacf-1299aa087cba tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:55.353579 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c67e617d-d3ff-4ba7-bacf-1299aa087cba tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:55.362011 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8de828bc-dbf3-4eaa-9472-8c9423dc610a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:55.365413 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c67e617d-d3ff-4ba7-bacf-1299aa087cba tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:55.370845 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8de828bc-dbf3-4eaa-9472-8c9423dc610a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:55.372651 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8de828bc-dbf3-4eaa-9472-8c9423dc610a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:55.373481 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8de828bc-dbf3-4eaa-9472-8c9423dc610a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:57.066267 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8de828bc-dbf3-4eaa-9472-8c9423dc610a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:57.074436 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8de828bc-dbf3-4eaa-9472-8c9423dc610a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b" status: 200 len: 1314 microversion: 2.1 time: 1.808629 Jul 18 02:28:57.075042 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1563/3121] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:55 2022] GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b => generated 1314 bytes in 1810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:57.133621 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c67e617d-d3ff-4ba7-bacf-1299aa087cba tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:57.161514 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c67e617d-d3ff-4ba7-bacf-1299aa087cba tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1469 microversion: 2.1 time: 1.888644 Jul 18 02:28:57.165071 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1559/3122] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:55 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1469 bytes in 1893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:28:57.781592 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-92822553-9a6e-4cf8-8e17-8d5128c3efc3 req-b96af585-3610-4017-8039-41791eb4c5d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f19c9c9-419d-4b9a-abdc-432a65381922", "name": "network-vif-plugged", "status": "completed", "tag": "39add5b7-15aa-4a44-a79b-7041ecfeb6be"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:57.837110 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-92822553-9a6e-4cf8-8e17-8d5128c3efc3 req-b96af585-3610-4017-8039-41791eb4c5d4 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:57.838458 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-92822553-9a6e-4cf8-8e17-8d5128c3efc3 req-b96af585-3610-4017-8039-41791eb4c5d4 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:57.944041 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-92822553-9a6e-4cf8-8e17-8d5128c3efc3 req-b96af585-3610-4017-8039-41791eb4c5d4 service nova] Creating event network-vif-plugged:39add5b7-15aa-4a44-a79b-7041ecfeb6be for instance 9f19c9c9-419d-4b9a-abdc-432a65381922 on n-h1-465891-3 Jul 18 02:28:58.045988 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:58.052291 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [req-92822553-9a6e-4cf8-8e17-8d5128c3efc3 req-b96af585-3610-4017-8039-41791eb4c5d4 service nova] Instance 9f19c9c9-419d-4b9a-abdc-432a65381922 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3', 'n-h2-465891-3'} {{(pid=119544) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 02:28:58.094562 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9b40ca82-a627-4784-8bfe-b7e19e173472 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:58.095913 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9b40ca82-a627-4784-8bfe-b7e19e173472 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b096f40a-9f6f-4956-bf56-7166600da59b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:58.100286 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-92822553-9a6e-4cf8-8e17-8d5128c3efc3 req-b96af585-3610-4017-8039-41791eb4c5d4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.022795 Jul 18 02:28:58.102610 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1564/3123] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:58.117631 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9b40ca82-a627-4784-8bfe-b7e19e173472 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:58.118126 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9b40ca82-a627-4784-8bfe-b7e19e173472 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:58.118957 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9b40ca82-a627-4784-8bfe-b7e19e173472 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:58.119408 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9b40ca82-a627-4784-8bfe-b7e19e173472 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:58.194615 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-22afca1e-f28a-4140-901f-933ddf7ff6ba tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:58.203735 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-22afca1e-f28a-4140-901f-933ddf7ff6ba tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:58.244903 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-22afca1e-f28a-4140-901f-933ddf7ff6ba tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:58.248990 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-22afca1e-f28a-4140-901f-933ddf7ff6ba tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:58.269198 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-22afca1e-f28a-4140-901f-933ddf7ff6ba tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:58.270484 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-22afca1e-f28a-4140-901f-933ddf7ff6ba tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:59.306121 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-22afca1e-f28a-4140-901f-933ddf7ff6ba tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:59.309672 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9b40ca82-a627-4784-8bfe-b7e19e173472 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:59.320634 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9b40ca82-a627-4784-8bfe-b7e19e173472 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b" status: 200 len: 1314 microversion: 2.1 time: 1.232408 Jul 18 02:28:59.337652 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1560/3124] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:58 2022] GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b => generated 1314 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:28:59.338464 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-22afca1e-f28a-4140-901f-933ddf7ff6ba tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1469 microversion: 2.1 time: 1.150619 Jul 18 02:28:59.347112 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1565/3125] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:58 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1469 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:00.346250 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-94882793-2c9a-489f-bded-a2052b1deaa8 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:00.347041 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-94882793-2c9a-489f-bded-a2052b1deaa8 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b096f40a-9f6f-4956-bf56-7166600da59b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:00.357988 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-07962b59-c514-444c-ab20-9f1b5f53aff0 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:00.358644 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-07962b59-c514-444c-ab20-9f1b5f53aff0 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:00.364651 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-94882793-2c9a-489f-bded-a2052b1deaa8 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:00.365644 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-94882793-2c9a-489f-bded-a2052b1deaa8 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:00.366734 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-94882793-2c9a-489f-bded-a2052b1deaa8 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:00.367425 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-94882793-2c9a-489f-bded-a2052b1deaa8 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:00.369797 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-07962b59-c514-444c-ab20-9f1b5f53aff0 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:00.377417 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-07962b59-c514-444c-ab20-9f1b5f53aff0 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:00.379098 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-07962b59-c514-444c-ab20-9f1b5f53aff0 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:00.379780 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-07962b59-c514-444c-ab20-9f1b5f53aff0 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:00.719834 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-94882793-2c9a-489f-bded-a2052b1deaa8 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:00.738292 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-94882793-2c9a-489f-bded-a2052b1deaa8 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b" status: 200 len: 1314 microversion: 2.1 time: 0.395896 Jul 18 02:29:00.750323 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1561/3126] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:00 2022] GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:00.753863 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-07962b59-c514-444c-ab20-9f1b5f53aff0 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:00.761136 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-f6a7755f-9477-4677-8e9f-4de0e89f3e82 req-d144c237-6844-460e-a60b-5f3f06098ada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b096f40a-9f6f-4956-bf56-7166600da59b", "name": "network-vif-plugged", "status": "completed", "tag": "702b2fe2-d4a7-47ca-8224-b62a64b942ca"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:00.764886 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-07962b59-c514-444c-ab20-9f1b5f53aff0 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1469 microversion: 2.1 time: 0.412043 Jul 18 02:29:00.766216 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1566/3127] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:00 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1469 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:00.781244 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-f6a7755f-9477-4677-8e9f-4de0e89f3e82 req-d144c237-6844-460e-a60b-5f3f06098ada service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:00.782551 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-f6a7755f-9477-4677-8e9f-4de0e89f3e82 req-d144c237-6844-460e-a60b-5f3f06098ada service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:00.806957 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-f6a7755f-9477-4677-8e9f-4de0e89f3e82 req-d144c237-6844-460e-a60b-5f3f06098ada service nova] Creating event network-vif-plugged:702b2fe2-d4a7-47ca-8224-b62a64b942ca for instance b096f40a-9f6f-4956-bf56-7166600da59b on n-h2-465891-3 Jul 18 02:29:00.818613 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-f6a7755f-9477-4677-8e9f-4de0e89f3e82 req-d144c237-6844-460e-a60b-5f3f06098ada service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065617 Jul 18 02:29:00.823145 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1562/3128] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:29:01.763664 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4c18ccc4-8e1b-49df-9922-c48ae96d4272 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:01.767688 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4c18ccc4-8e1b-49df-9922-c48ae96d4272 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b096f40a-9f6f-4956-bf56-7166600da59b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:01.786612 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4c18ccc4-8e1b-49df-9922-c48ae96d4272 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:01.794009 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4c18ccc4-8e1b-49df-9922-c48ae96d4272 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:01.795153 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4c18ccc4-8e1b-49df-9922-c48ae96d4272 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:01.795789 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4c18ccc4-8e1b-49df-9922-c48ae96d4272 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:01.805616 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dfb39ef6-4b95-41eb-aaec-902ee52a3717 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:01.811461 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-dfb39ef6-4b95-41eb-aaec-902ee52a3717 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:01.842209 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dfb39ef6-4b95-41eb-aaec-902ee52a3717 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:01.843440 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dfb39ef6-4b95-41eb-aaec-902ee52a3717 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:01.847483 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dfb39ef6-4b95-41eb-aaec-902ee52a3717 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:01.850067 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dfb39ef6-4b95-41eb-aaec-902ee52a3717 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:03.072788 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-dfb39ef6-4b95-41eb-aaec-902ee52a3717 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:03.089256 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:03.094769 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4c18ccc4-8e1b-49df-9922-c48ae96d4272 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:03.106497 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4c18ccc4-8e1b-49df-9922-c48ae96d4272 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b" status: 200 len: 1314 microversion: 2.1 time: 1.350528 Jul 18 02:29:03.118251 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1567/3129] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:01 2022] GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b => generated 1314 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:29:03.126251 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-dfb39ef6-4b95-41eb-aaec-902ee52a3717 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1469 microversion: 2.1 time: 1.332883 Jul 18 02:29:03.130999 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1563/3130] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:01 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1469 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:04.126079 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e93e8d34-2903-46fa-b1db-50f96dc1205b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:04.127342 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e93e8d34-2903-46fa-b1db-50f96dc1205b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b096f40a-9f6f-4956-bf56-7166600da59b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:04.148542 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-91333c7d-a040-4a25-9579-498e42dd7905 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:04.149349 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-91333c7d-a040-4a25-9579-498e42dd7905 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:04.160000 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e93e8d34-2903-46fa-b1db-50f96dc1205b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:04.160493 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e93e8d34-2903-46fa-b1db-50f96dc1205b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:04.161246 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e93e8d34-2903-46fa-b1db-50f96dc1205b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:04.161689 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e93e8d34-2903-46fa-b1db-50f96dc1205b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:04.171096 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-91333c7d-a040-4a25-9579-498e42dd7905 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:04.171550 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-91333c7d-a040-4a25-9579-498e42dd7905 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:04.172363 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-91333c7d-a040-4a25-9579-498e42dd7905 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:04.172801 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-91333c7d-a040-4a25-9579-498e42dd7905 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:05.296833 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e93e8d34-2903-46fa-b1db-50f96dc1205b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:05.312087 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e93e8d34-2903-46fa-b1db-50f96dc1205b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b" status: 200 len: 1501 microversion: 2.1 time: 1.190800 Jul 18 02:29:05.328114 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-91333c7d-a040-4a25-9579-498e42dd7905 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:05.330311 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1568/3131] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:04 2022] GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b => generated 1501 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:29:05.339258 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-279c42eb-4b02-4289-b62f-40d94fb69321 req-65f183ee-8d21-4132-b460-41ffb2e95855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f19c9c9-419d-4b9a-abdc-432a65381922", "name": "network-vif-unplugged", "status": "completed", "tag": "39add5b7-15aa-4a44-a79b-7041ecfeb6be"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:05.365281 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-279c42eb-4b02-4289-b62f-40d94fb69321 req-65f183ee-8d21-4132-b460-41ffb2e95855 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:05.365986 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-279c42eb-4b02-4289-b62f-40d94fb69321 req-65f183ee-8d21-4132-b460-41ffb2e95855 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:05.376334 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-91333c7d-a040-4a25-9579-498e42dd7905 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1469 microversion: 2.1 time: 1.231470 Jul 18 02:29:05.377990 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1564/3132] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:04 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1469 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:05.389593 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a5373ac5-1f52-48d8-ba6e-2416d9b4172a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:05.391947 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a5373ac5-1f52-48d8-ba6e-2416d9b4172a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b096f40a-9f6f-4956-bf56-7166600da59b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:05.394046 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-279c42eb-4b02-4289-b62f-40d94fb69321 req-65f183ee-8d21-4132-b460-41ffb2e95855 service nova] Creating event network-vif-unplugged:39add5b7-15aa-4a44-a79b-7041ecfeb6be for instance 9f19c9c9-419d-4b9a-abdc-432a65381922 on n-h2-465891-3 Jul 18 02:29:05.403869 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a5373ac5-1f52-48d8-ba6e-2416d9b4172a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:05.404538 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a5373ac5-1f52-48d8-ba6e-2416d9b4172a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:05.405146 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a5373ac5-1f52-48d8-ba6e-2416d9b4172a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:05.405839 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a5373ac5-1f52-48d8-ba6e-2416d9b4172a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:05.410552 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [req-279c42eb-4b02-4289-b62f-40d94fb69321 req-65f183ee-8d21-4132-b460-41ffb2e95855 service nova] Instance 9f19c9c9-419d-4b9a-abdc-432a65381922 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3', 'n-h2-465891-3'} {{(pid=119544) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 02:29:05.446748 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-279c42eb-4b02-4289-b62f-40d94fb69321 req-65f183ee-8d21-4132-b460-41ffb2e95855 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114938 Jul 18 02:29:05.457936 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1569/3133] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:29:05.476312 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-a5373ac5-1f52-48d8-ba6e-2416d9b4172a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lazy-loading 'flavor' on Instance uuid b096f40a-9f6f-4956-bf56-7166600da59b {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:29:05.892017 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a5373ac5-1f52-48d8-ba6e-2416d9b4172a tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "POST /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b/action" status: 202 len: 0 microversion: 2.1 time: 0.505041 Jul 18 02:29:05.894277 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1565/3134] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:29:05 2022] POST /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b/action => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:29:05.904290 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4c0ffdf1-c7db-48b5-88d2-e3a7b38f8615 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:05.905732 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4c0ffdf1-c7db-48b5-88d2-e3a7b38f8615 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b096f40a-9f6f-4956-bf56-7166600da59b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:05.922807 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4c0ffdf1-c7db-48b5-88d2-e3a7b38f8615 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:05.928486 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4c0ffdf1-c7db-48b5-88d2-e3a7b38f8615 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:05.933294 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4c0ffdf1-c7db-48b5-88d2-e3a7b38f8615 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:05.935888 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4c0ffdf1-c7db-48b5-88d2-e3a7b38f8615 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:06.410805 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-77beac8c-b54d-4289-b84e-4ef563c4be38 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:06.415552 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-77beac8c-b54d-4289-b84e-4ef563c4be38 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:06.485344 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77beac8c-b54d-4289-b84e-4ef563c4be38 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:06.486595 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77beac8c-b54d-4289-b84e-4ef563c4be38 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:06.492471 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77beac8c-b54d-4289-b84e-4ef563c4be38 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:06.493474 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77beac8c-b54d-4289-b84e-4ef563c4be38 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:07.833628 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4c0ffdf1-c7db-48b5-88d2-e3a7b38f8615 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:07.848737 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4c0ffdf1-c7db-48b5-88d2-e3a7b38f8615 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b" status: 200 len: 1509 microversion: 2.1 time: 1.949199 Jul 18 02:29:07.849628 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1570/3135] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:05 2022] GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b => generated 1509 bytes in 1952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:07.859921 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-19b819ff-84bf-42f5-a2bc-318d52baa121 req-25f36a9a-711c-4c49-ac16-7622104a297e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f19c9c9-419d-4b9a-abdc-432a65381922", "tag": "39add5b7-15aa-4a44-a79b-7041ecfeb6be"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:07.881854 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-19b819ff-84bf-42f5-a2bc-318d52baa121 req-25f36a9a-711c-4c49-ac16-7622104a297e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:07.883807 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-19b819ff-84bf-42f5-a2bc-318d52baa121 req-25f36a9a-711c-4c49-ac16-7622104a297e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:07.916724 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-19b819ff-84bf-42f5-a2bc-318d52baa121 req-25f36a9a-711c-4c49-ac16-7622104a297e service nova] Creating event network-changed:39add5b7-15aa-4a44-a79b-7041ecfeb6be for instance 9f19c9c9-419d-4b9a-abdc-432a65381922 on n-h2-465891-3 Jul 18 02:29:07.930310 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [req-19b819ff-84bf-42f5-a2bc-318d52baa121 req-25f36a9a-711c-4c49-ac16-7622104a297e service nova] Instance 9f19c9c9-419d-4b9a-abdc-432a65381922 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3', 'n-h2-465891-3'} {{(pid=119544) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 02:29:07.957839 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-19b819ff-84bf-42f5-a2bc-318d52baa121 req-25f36a9a-711c-4c49-ac16-7622104a297e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105589 Jul 18 02:29:07.959582 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1571/3136] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:29:08.017754 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-77beac8c-b54d-4289-b84e-4ef563c4be38 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:08.037752 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-77beac8c-b54d-4289-b84e-4ef563c4be38 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1469 microversion: 2.1 time: 1.643283 Jul 18 02:29:08.053086 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1566/3137] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:06 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1469 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:08.898908 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-81a8ac1c-af68-4735-9a76-629894c320fc tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-841293515", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "216121d0-a475-422d-a271-3064f35854e4"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:08.905173 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4f60789d-f896-4fec-8e03-d6ade9c0e024 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:08.911933 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4f60789d-f896-4fec-8e03-d6ade9c0e024 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b096f40a-9f6f-4956-bf56-7166600da59b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:08.951421 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4f60789d-f896-4fec-8e03-d6ade9c0e024 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:08.954687 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4f60789d-f896-4fec-8e03-d6ade9c0e024 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:08.965919 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4f60789d-f896-4fec-8e03-d6ade9c0e024 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:08.967704 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4f60789d-f896-4fec-8e03-d6ade9c0e024 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:09.011688 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-81a8ac1c-af68-4735-9a76-629894c320fc tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] validate_networks() for [('216121d0-a475-422d-a271-3064f35854e4', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:29:09.450961 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4f60789d-f896-4fec-8e03-d6ade9c0e024 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:09.488716 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4f60789d-f896-4fec-8e03-d6ade9c0e024 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b" status: 200 len: 1492 microversion: 2.1 time: 0.614164 Jul 18 02:29:09.490486 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1567/3138] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:08 2022] GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b => generated 1492 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:09.500835 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9aa234e2-fed0-429b-95d8-89ca243cef12 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:09.502770 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9aa234e2-fed0-429b-95d8-89ca243cef12 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:09.516290 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9aa234e2-fed0-429b-95d8-89ca243cef12 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:09.517433 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9aa234e2-fed0-429b-95d8-89ca243cef12 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:09.519378 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9aa234e2-fed0-429b-95d8-89ca243cef12 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:09.520475 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9aa234e2-fed0-429b-95d8-89ca243cef12 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:09.790631 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9aa234e2-fed0-429b-95d8-89ca243cef12 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:09.807215 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9aa234e2-fed0-429b-95d8-89ca243cef12 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1469 microversion: 2.1 time: 0.309238 Jul 18 02:29:09.808403 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1568/3139] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:09 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1469 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:09.853318 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-152a9ceb-ec6b-47b5-ae92-477f3cbdcde4 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:09.855179 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-152a9ceb-ec6b-47b5-ae92-477f3cbdcde4 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b096f40a-9f6f-4956-bf56-7166600da59b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:09.876858 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-152a9ceb-ec6b-47b5-ae92-477f3cbdcde4 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:09.877408 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-152a9ceb-ec6b-47b5-ae92-477f3cbdcde4 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:09.880147 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-152a9ceb-ec6b-47b5-ae92-477f3cbdcde4 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:09.881249 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-152a9ceb-ec6b-47b5-ae92-477f3cbdcde4 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:09.946311 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-152a9ceb-ec6b-47b5-ae92-477f3cbdcde4 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b096f40a-9f6f-4956-bf56-7166600da59b] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:29:10.332033 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-152a9ceb-ec6b-47b5-ae92-477f3cbdcde4 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b" status: 204 len: 0 microversion: 2.1 time: 0.503372 Jul 18 02:29:10.333381 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1569/3140] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:29:09 2022] DELETE /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b => generated 0 bytes in 524 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:29:10.385531 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bca23ca8-fc2e-4171-a076-b0d19a03dc48 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:10.390364 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bca23ca8-fc2e-4171-a076-b0d19a03dc48 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b096f40a-9f6f-4956-bf56-7166600da59b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:10.412575 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bca23ca8-fc2e-4171-a076-b0d19a03dc48 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:10.413058 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bca23ca8-fc2e-4171-a076-b0d19a03dc48 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:10.420337 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bca23ca8-fc2e-4171-a076-b0d19a03dc48 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:10.420920 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bca23ca8-fc2e-4171-a076-b0d19a03dc48 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:10.483018 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-81a8ac1c-af68-4735-9a76-629894c320fc tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:29:10.483786 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-81a8ac1c-af68-4735-9a76-629894c320fc tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:29:10.484688 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-81a8ac1c-af68-4735-9a76-629894c320fc tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:29:10.485943 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-81a8ac1c-af68-4735-9a76-629894c320fc tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:29:10.486440 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-81a8ac1c-af68-4735-9a76-629894c320fc tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:29:10.556766 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-81a8ac1c-af68-4735-9a76-629894c320fc tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:10.571007 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-81a8ac1c-af68-4735-9a76-629894c320fc tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:10.572734 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-81a8ac1c-af68-4735-9a76-629894c320fc tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:10.574018 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-81a8ac1c-af68-4735-9a76-629894c320fc tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:10.681308 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:10.703870 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-81a8ac1c-af68-4735-9a76-629894c320fc tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Getting quotas for project 9edf1521569645518c75d7ba91c75133. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:29:10.725962 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-81a8ac1c-af68-4735-9a76-629894c320fc tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Getting quotas for user 9fe7bb0211fa4ff2a039df1bdca9fac2 and project 9edf1521569645518c75d7ba91c75133. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:29:10.761083 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-81a8ac1c-af68-4735-9a76-629894c320fc tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:29:10.768409 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-81a8ac1c-af68-4735-9a76-629894c320fc tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] [instance: ae6f4257-696a-4178-b93d-f3b42a42e073] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:29:10.872256 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-81a8ac1c-af68-4735-9a76-629894c320fc tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.233068 Jul 18 02:29:10.884529 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1572/3141] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:29:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2247 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:29:10.890659 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-54443d74-8dc6-4d26-af3b-f85d403d2af5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:10.896907 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-54443d74-8dc6-4d26-af3b-f85d403d2af5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:10.911415 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54443d74-8dc6-4d26-af3b-f85d403d2af5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:10.914375 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54443d74-8dc6-4d26-af3b-f85d403d2af5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:10.924155 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54443d74-8dc6-4d26-af3b-f85d403d2af5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:10.925068 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54443d74-8dc6-4d26-af3b-f85d403d2af5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:11.355000 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bca23ca8-fc2e-4171-a076-b0d19a03dc48 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:11.397825 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bca23ca8-fc2e-4171-a076-b0d19a03dc48 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b" status: 200 len: 1498 microversion: 2.1 time: 1.046760 Jul 18 02:29:11.403178 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1570/3142] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:10 2022] GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b => generated 1498 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:11.429100 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-95784d99-e472-467a-b725-102d05485080 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:11.441438 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-95784d99-e472-467a-b725-102d05485080 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] [instance: ae6f4257-696a-4178-b93d-f3b42a42e073] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:11.833866 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-54443d74-8dc6-4d26-af3b-f85d403d2af5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:11.863416 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-95784d99-e472-467a-b725-102d05485080 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7bb0211fa4ff2a039df1bdca9fac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9edf1521569645518c75d7ba91c75133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:11.868798 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-54443d74-8dc6-4d26-af3b-f85d403d2af5 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1469 microversion: 2.1 time: 0.982404 Jul 18 02:29:11.870693 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1573/3143] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:10 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1469 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:11.879817 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-95784d99-e472-467a-b725-102d05485080 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] 10.222.0.57 "GET /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073" status: 200 len: 1216 microversion: 2.1 time: 0.470973 Jul 18 02:29:11.884013 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-21fa261b-12cb-49aa-8274-6ebba3059f12 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:11.886054 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1571/3144] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:11 2022] GET /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073 => generated 1216 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:11.896360 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-21fa261b-12cb-49aa-8274-6ebba3059f12 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c1a08894c5e14d05b3a7b21001ff2740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a798824fb748c8889769282273bda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:11.898364 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-21fa261b-12cb-49aa-8274-6ebba3059f12 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Searching by: {'deleted': False, 'project_id': '00a798824fb748c8889769282273bda4'} {{(pid=119544) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:29:11.913875 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-21fa261b-12cb-49aa-8274-6ebba3059f12 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:11.915079 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-21fa261b-12cb-49aa-8274-6ebba3059f12 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:11.917166 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-21fa261b-12cb-49aa-8274-6ebba3059f12 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:11.923357 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-21fa261b-12cb-49aa-8274-6ebba3059f12 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:12.009212 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.multi_cell_list [None req-21fa261b-12cb-49aa-8274-6ebba3059f12 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119544) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:29:12.171437 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-21fa261b-12cb-49aa-8274-6ebba3059f12 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] 10.222.0.57 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.295300 Jul 18 02:29:12.179199 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1574/3145] 10.222.0.57 () {58 vars in 1124 bytes} [Mon Jul 18 02:29:11 2022] GET /compute/v2.1/servers => generated 333 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:29:12.192789 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a54c71a1-fbd3-457b-a8ce-d12ea201dd08 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:12.217105 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a54c71a1-fbd3-457b-a8ce-d12ea201dd08 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c1a08894c5e14d05b3a7b21001ff2740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a798824fb748c8889769282273bda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:12.221008 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a54c71a1-fbd3-457b-a8ce-d12ea201dd08 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Searching by: {'deleted': False, 'project_id': '00a798824fb748c8889769282273bda4'} {{(pid=119543) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:29:12.262342 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a54c71a1-fbd3-457b-a8ce-d12ea201dd08 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:12.271692 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a54c71a1-fbd3-457b-a8ce-d12ea201dd08 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:12.273274 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a54c71a1-fbd3-457b-a8ce-d12ea201dd08 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:12.274167 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a54c71a1-fbd3-457b-a8ce-d12ea201dd08 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:12.443102 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-636caae7-acaa-45ef-b29a-26d32621b67e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:12.445192 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.multi_cell_list [None req-a54c71a1-fbd3-457b-a8ce-d12ea201dd08 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119543) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:29:12.447646 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-636caae7-acaa-45ef-b29a-26d32621b67e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b096f40a-9f6f-4956-bf56-7166600da59b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:12.505234 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-636caae7-acaa-45ef-b29a-26d32621b67e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:12.507102 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-636caae7-acaa-45ef-b29a-26d32621b67e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:12.510970 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-636caae7-acaa-45ef-b29a-26d32621b67e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:12.516225 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-636caae7-acaa-45ef-b29a-26d32621b67e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:12.625052 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a54c71a1-fbd3-457b-a8ce-d12ea201dd08 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a08894c5e14d05b3a7b21001ff2740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a798824fb748c8889769282273bda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:12.651241 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a54c71a1-fbd3-457b-a8ce-d12ea201dd08 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:12.653872 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a54c71a1-fbd3-457b-a8ce-d12ea201dd08 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:15.218942 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-636caae7-acaa-45ef-b29a-26d32621b67e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:15.235494 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-636caae7-acaa-45ef-b29a-26d32621b67e tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b" status: 200 len: 1498 microversion: 2.1 time: 2.807519 Jul 18 02:29:15.236527 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1575/3146] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:12 2022] GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b => generated 1498 bytes in 2810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:15.257581 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ad45c29f-7f7a-4095-9c9f-dfdbbf40da6f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:15.258686 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ad45c29f-7f7a-4095-9c9f-dfdbbf40da6f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:15.275009 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ad45c29f-7f7a-4095-9c9f-dfdbbf40da6f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:15.278182 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ad45c29f-7f7a-4095-9c9f-dfdbbf40da6f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:15.279600 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ad45c29f-7f7a-4095-9c9f-dfdbbf40da6f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:15.281791 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ad45c29f-7f7a-4095-9c9f-dfdbbf40da6f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:15.374354 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a54c71a1-fbd3-457b-a8ce-d12ea201dd08 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] 10.222.0.57 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 3.192746 Jul 18 02:29:15.388372 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1572/3147] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:29:12 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 3196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:15.399156 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-56aa115a-e0cf-4f72-b8dc-eea78bf83a6d tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:15.408254 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-56aa115a-e0cf-4f72-b8dc-eea78bf83a6d tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] [instance: ae6f4257-696a-4178-b93d-f3b42a42e073] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:15.435795 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56aa115a-e0cf-4f72-b8dc-eea78bf83a6d tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:15.436537 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56aa115a-e0cf-4f72-b8dc-eea78bf83a6d tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:15.437836 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56aa115a-e0cf-4f72-b8dc-eea78bf83a6d tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:15.438480 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56aa115a-e0cf-4f72-b8dc-eea78bf83a6d tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:15.812259 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-56aa115a-e0cf-4f72-b8dc-eea78bf83a6d tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7bb0211fa4ff2a039df1bdca9fac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9edf1521569645518c75d7ba91c75133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:15.827181 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-56aa115a-e0cf-4f72-b8dc-eea78bf83a6d tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] 10.222.0.57 "GET /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073" status: 200 len: 1274 microversion: 2.1 time: 0.449782 Jul 18 02:29:15.830300 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1573/3148] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:15 2022] GET /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073 => generated 1274 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:15.841900 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-19833f47-6e1e-4315-bbcc-b22b9ddc7276 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:15.866430 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-19833f47-6e1e-4315-bbcc-b22b9ddc7276 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] 10.222.0.57 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.033995 Jul 18 02:29:15.867091 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1574/3149] 10.222.0.57 () {58 vars in 1136 bytes} [Mon Jul 18 02:29:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:29:15.894410 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-0f90dd73-06a9-45eb-886f-129d199c7551 req-7ff6fc83-4296-43ed-9165-774b8e957093 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b096f40a-9f6f-4956-bf56-7166600da59b", "name": "network-vif-deleted", "tag": "702b2fe2-d4a7-47ca-8224-b62a64b942ca"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:15.922074 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-0f90dd73-06a9-45eb-886f-129d199c7551 req-7ff6fc83-4296-43ed-9165-774b8e957093 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:15.922534 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-0f90dd73-06a9-45eb-886f-129d199c7551 req-7ff6fc83-4296-43ed-9165-774b8e957093 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:15.954067 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-0f90dd73-06a9-45eb-886f-129d199c7551 req-7ff6fc83-4296-43ed-9165-774b8e957093 service nova] Creating event network-vif-deleted:702b2fe2-d4a7-47ca-8224-b62a64b942ca for instance b096f40a-9f6f-4956-bf56-7166600da59b on n-h2-465891-3 Jul 18 02:29:15.961225 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-0f90dd73-06a9-45eb-886f-129d199c7551 req-7ff6fc83-4296-43ed-9165-774b8e957093 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082835 Jul 18 02:29:15.962228 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1575/3150] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:29:15.985085 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ad45c29f-7f7a-4095-9c9f-dfdbbf40da6f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:15.999859 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ad45c29f-7f7a-4095-9c9f-dfdbbf40da6f tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1462 microversion: 2.1 time: 0.760914 Jul 18 02:29:16.001200 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1576/3151] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:15 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1462 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:16.046735 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0875adcb-de46-49fa-8019-587995dce8da tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:16.048242 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0875adcb-de46-49fa-8019-587995dce8da tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:16.082034 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0875adcb-de46-49fa-8019-587995dce8da tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:16.082780 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0875adcb-de46-49fa-8019-587995dce8da tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:16.089149 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0875adcb-de46-49fa-8019-587995dce8da tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:16.091942 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0875adcb-de46-49fa-8019-587995dce8da tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:16.191346 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c966d2b4-c091-4141-88ad-6efb40c99a8b tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:16.192863 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c966d2b4-c091-4141-88ad-6efb40c99a8b tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] [instance: 8573a671-62f5-4659-a227-bb1637b51430] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:16.209415 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c966d2b4-c091-4141-88ad-6efb40c99a8b tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:16.211608 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c966d2b4-c091-4141-88ad-6efb40c99a8b tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:16.213518 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c966d2b4-c091-4141-88ad-6efb40c99a8b tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:16.215007 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c966d2b4-c091-4141-88ad-6efb40c99a8b tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:16.290614 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c966d2b4-c091-4141-88ad-6efb40c99a8b tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] [instance: 8573a671-62f5-4659-a227-bb1637b51430] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:29:16.602211 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0875adcb-de46-49fa-8019-587995dce8da tempest-MigrationsAdminTest-1050172301 tempest-MigrationsAdminTest-1050172301-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1613 microversion: 2.1 time: 0.576895 Jul 18 02:29:16.606387 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1576/3152] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:16 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1613 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:16.616733 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c966d2b4-c091-4141-88ad-6efb40c99a8b tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430" status: 204 len: 0 microversion: 2.1 time: 0.434387 Jul 18 02:29:16.617964 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1577/3153] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:29:16 2022] DELETE /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:29:16.621147 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f97bcaa1-3e60-4adf-aa62-5ab8eea57458 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:16.622950 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f97bcaa1-3e60-4adf-aa62-5ab8eea57458 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b096f40a-9f6f-4956-bf56-7166600da59b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:16.629155 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c556b15a-bcf6-4b46-81ef-57653a81cab3 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:16.637515 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c556b15a-bcf6-4b46-81ef-57653a81cab3 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] [instance: 8573a671-62f5-4659-a227-bb1637b51430] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:16.639359 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f97bcaa1-3e60-4adf-aa62-5ab8eea57458 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:16.640646 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f97bcaa1-3e60-4adf-aa62-5ab8eea57458 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:16.642884 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f97bcaa1-3e60-4adf-aa62-5ab8eea57458 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:16.645284 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f97bcaa1-3e60-4adf-aa62-5ab8eea57458 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:16.653251 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c556b15a-bcf6-4b46-81ef-57653a81cab3 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:16.653916 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c556b15a-bcf6-4b46-81ef-57653a81cab3 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:16.656741 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c556b15a-bcf6-4b46-81ef-57653a81cab3 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:16.658232 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c556b15a-bcf6-4b46-81ef-57653a81cab3 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:16.806690 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f97bcaa1-3e60-4adf-aa62-5ab8eea57458 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:16.810215 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f97bcaa1-3e60-4adf-aa62-5ab8eea57458 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:16.811231 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-f97bcaa1-3e60-4adf-aa62-5ab8eea57458 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lazy-loading 'fault' on Instance uuid b096f40a-9f6f-4956-bf56-7166600da59b {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:29:17.096315 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f97bcaa1-3e60-4adf-aa62-5ab8eea57458 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c4d32923874a50972ab0b75a4165c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9d4e8f2f18460ebccacbe32db57388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:17.130118 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f97bcaa1-3e60-4adf-aa62-5ab8eea57458 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b" status: 200 len: 1304 microversion: 2.1 time: 0.518561 Jul 18 02:29:17.148267 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1577/3154] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:16 2022] GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b => generated 1304 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:17.175997 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0e2c49b6-6f45-4726-9fc7-954175333bf3 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:17.176954 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0e2c49b6-6f45-4726-9fc7-954175333bf3 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:17.182141 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c556b15a-bcf6-4b46-81ef-57653a81cab3 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a08894c5e14d05b3a7b21001ff2740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a798824fb748c8889769282273bda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:17.197083 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0e2c49b6-6f45-4726-9fc7-954175333bf3 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:17.198016 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0e2c49b6-6f45-4726-9fc7-954175333bf3 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:17.199643 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0e2c49b6-6f45-4726-9fc7-954175333bf3 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:17.200485 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0e2c49b6-6f45-4726-9fc7-954175333bf3 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:17.204829 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c556b15a-bcf6-4b46-81ef-57653a81cab3 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] 10.222.0.57 "GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430" status: 200 len: 1699 microversion: 2.1 time: 0.579667 Jul 18 02:29:17.206767 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1578/3155] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:16 2022] GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430 => generated 1699 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:17.219660 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2083b7db-a5e1-4949-86c0-cc7127d6e29d tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:17.221233 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2083b7db-a5e1-4949-86c0-cc7127d6e29d tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] [instance: ae6f4257-696a-4178-b93d-f3b42a42e073] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:17.232802 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2083b7db-a5e1-4949-86c0-cc7127d6e29d tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:17.234316 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2083b7db-a5e1-4949-86c0-cc7127d6e29d tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:17.235986 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2083b7db-a5e1-4949-86c0-cc7127d6e29d tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:17.239535 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2083b7db-a5e1-4949-86c0-cc7127d6e29d tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:17.324627 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0e2c49b6-6f45-4726-9fc7-954175333bf3 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:29:17.350343 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:17.561882 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2083b7db-a5e1-4949-86c0-cc7127d6e29d tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7bb0211fa4ff2a039df1bdca9fac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9edf1521569645518c75d7ba91c75133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:17.629467 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2083b7db-a5e1-4949-86c0-cc7127d6e29d tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] 10.222.0.57 "GET /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073" status: 200 len: 1274 microversion: 2.1 time: 0.411597 Jul 18 02:29:17.635307 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1579/3156] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:17 2022] GET /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073 => generated 1274 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:17.657240 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0e2c49b6-6f45-4726-9fc7-954175333bf3 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 204 len: 0 microversion: 2.1 time: 0.506030 Jul 18 02:29:17.659399 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1578/3157] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:29:17 2022] DELETE /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:29:17.680017 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-41b725ef-af78-4264-ac46-8f57ca7fa866 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:17.688061 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-41b725ef-af78-4264-ac46-8f57ca7fa866 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:17.743126 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-41b725ef-af78-4264-ac46-8f57ca7fa866 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:17.743576 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-41b725ef-af78-4264-ac46-8f57ca7fa866 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:17.744374 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-41b725ef-af78-4264-ac46-8f57ca7fa866 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:17.750528 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-41b725ef-af78-4264-ac46-8f57ca7fa866 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:18.174879 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-49c3ea67-3bc6-4946-8f0c-162682dfc0ce tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:18.196101 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-49c3ea67-3bc6-4946-8f0c-162682dfc0ce tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b096f40a-9f6f-4956-bf56-7166600da59b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:18.253059 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-49c3ea67-3bc6-4946-8f0c-162682dfc0ce tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:18.254192 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-49c3ea67-3bc6-4946-8f0c-162682dfc0ce tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:18.255709 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-49c3ea67-3bc6-4946-8f0c-162682dfc0ce tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:18.256505 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-49c3ea67-3bc6-4946-8f0c-162682dfc0ce tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:18.362473 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-49c3ea67-3bc6-4946-8f0c-162682dfc0ce tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] HTTP exception thrown: Instance b096f40a-9f6f-4956-bf56-7166600da59b could not be found. Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-49c3ea67-3bc6-4946-8f0c-162682dfc0ce tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Request method failure captured: Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b HTTP/1.1 Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MPwaxUozPvSKq2aGl05vX5p9RkRh12PhrAa5ZuFGYH8QlWHXUoV4AOq2uE9nQ_2FUYuIDSWVSpjhgygJ-c4EGtTg2Y-_wVXi_cp3NARUTVck4-IU3Tev_AIZ-4eU7-_uXuXl7L-x01qv35sxA627UbKELg2PVDH9gxQj5dhwRrNVzw Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ba9d4e8f2f18460ebccacbe32db57388"}]}] Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 89c4d32923874a50972ab0b75a4165c0 Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance b096f40a-9f6f-4956-bf56-7166600da59b could not be found. Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'b096f40a-9f6f-4956-bf56-7166600da59b'} Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b096f40a-9f6f-4956-bf56-7166600da59b could not be found. Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b096f40a-9f6f-4956-bf56-7166600da59b could not be found. Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:18.381073 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:18.387608 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:18.387608 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:18.387608 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:18.387608 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:29:18.387608 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:29:18.387608 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b096f40a-9f6f-4956-bf56-7166600da59b could not be found. Jul 18 02:29:18.387608 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:18.393753 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-49c3ea67-3bc6-4946-8f0c-162682dfc0ce tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Returning 404 to user: Instance b096f40a-9f6f-4956-bf56-7166600da59b could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:29:18.393753 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-49c3ea67-3bc6-4946-8f0c-162682dfc0ce tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b" status: 404 len: 111 microversion: 2.1 time: 0.232952 Jul 18 02:29:18.400257 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1579/3158] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:18 2022] GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b => generated 111 bytes in 243 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:29:18.409782 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-eed9b5fd-148c-457d-bd41-f44957ce7f96 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:18.428989 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-eed9b5fd-148c-457d-bd41-f44957ce7f96 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] [instance: 8573a671-62f5-4659-a227-bb1637b51430] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:18.463718 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eed9b5fd-148c-457d-bd41-f44957ce7f96 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:18.464479 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eed9b5fd-148c-457d-bd41-f44957ce7f96 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:18.486105 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eed9b5fd-148c-457d-bd41-f44957ce7f96 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:18.486986 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eed9b5fd-148c-457d-bd41-f44957ce7f96 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:19.764871 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-41b725ef-af78-4264-ac46-8f57ca7fa866 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:19.767600 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:19.777866 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-41b725ef-af78-4264-ac46-8f57ca7fa866 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1468 microversion: 2.1 time: 2.111966 Jul 18 02:29:19.778532 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1580/3159] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:17 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1468 bytes in 2114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:19.823496 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b86391e3-feb2-415a-a4cc-c031ba898fb4 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:19.824636 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b86391e3-feb2-415a-a4cc-c031ba898fb4 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b096f40a-9f6f-4956-bf56-7166600da59b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:19.847705 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b86391e3-feb2-415a-a4cc-c031ba898fb4 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:19.854995 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b86391e3-feb2-415a-a4cc-c031ba898fb4 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:19.855981 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b86391e3-feb2-415a-a4cc-c031ba898fb4 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:19.859616 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b86391e3-feb2-415a-a4cc-c031ba898fb4 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:19.911408 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-b86391e3-feb2-415a-a4cc-c031ba898fb4 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] HTTP exception thrown: Instance b096f40a-9f6f-4956-bf56-7166600da59b could not be found. Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b86391e3-feb2-415a-a4cc-c031ba898fb4 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Request method failure captured: Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b HTTP/1.1 Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MPwaxUozPvSKq2aGl05vX5p9RkRh12PhrAa5ZuFGYH8QlWHXUoV4AOq2uE9nQ_2FUYuIDSWVSpjhgygJ-c4EGtTg2Y-_wVXi_cp3NARUTVck4-IU3Tev_AIZ-4eU7-_uXuXl7L-x01qv35sxA627UbKELg2PVDH9gxQj5dhwRrNVzw Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ba9d4e8f2f18460ebccacbe32db57388"}]}] Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 89c4d32923874a50972ab0b75a4165c0 Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance b096f40a-9f6f-4956-bf56-7166600da59b could not be found. Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'b096f40a-9f6f-4956-bf56-7166600da59b'} Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b096f40a-9f6f-4956-bf56-7166600da59b could not be found. Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:29:19.916611 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:29:19.935095 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b096f40a-9f6f-4956-bf56-7166600da59b could not be found. Jul 18 02:29:19.935095 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:19.935095 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:19.935095 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:19.935095 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:19.935095 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:19.935095 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:19.935095 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:29:19.935095 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:29:19.935095 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b096f40a-9f6f-4956-bf56-7166600da59b could not be found. Jul 18 02:29:19.935095 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:19.935095 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b86391e3-feb2-415a-a4cc-c031ba898fb4 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Returning 404 to user: Instance b096f40a-9f6f-4956-bf56-7166600da59b could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:29:19.935095 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b86391e3-feb2-415a-a4cc-c031ba898fb4 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b" status: 404 len: 111 microversion: 2.1 time: 0.110670 Jul 18 02:29:19.935095 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1581/3160] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:29:19 2022] DELETE /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:29:19.935095 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-a027c65d-1d02-43ab-bcd8-591d3bc9ff56 req-f27ca9b4-7d2c-488e-88f9-c2b38c2fa2a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f19c9c9-419d-4b9a-abdc-432a65381922", "name": "network-vif-plugged", "status": "completed", "tag": "39add5b7-15aa-4a44-a79b-7041ecfeb6be"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:19.945158 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-a027c65d-1d02-43ab-bcd8-591d3bc9ff56 req-f27ca9b4-7d2c-488e-88f9-c2b38c2fa2a2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:19.945158 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-a027c65d-1d02-43ab-bcd8-591d3bc9ff56 req-f27ca9b4-7d2c-488e-88f9-c2b38c2fa2a2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:19.958992 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-a027c65d-1d02-43ab-bcd8-591d3bc9ff56 req-f27ca9b4-7d2c-488e-88f9-c2b38c2fa2a2 service nova] Creating event network-vif-plugged:39add5b7-15aa-4a44-a79b-7041ecfeb6be for instance 9f19c9c9-419d-4b9a-abdc-432a65381922 on n-h2-465891-3 Jul 18 02:29:19.967370 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-a027c65d-1d02-43ab-bcd8-591d3bc9ff56 req-f27ca9b4-7d2c-488e-88f9-c2b38c2fa2a2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040124 Jul 18 02:29:19.968485 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1582/3161] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:29:19.976048 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7c666b24-c9a2-41aa-b554-9564c6f28754 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:19.977111 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7c666b24-c9a2-41aa-b554-9564c6f28754 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] [instance: ae6f4257-696a-4178-b93d-f3b42a42e073] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:19.986572 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7c666b24-c9a2-41aa-b554-9564c6f28754 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:19.988566 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7c666b24-c9a2-41aa-b554-9564c6f28754 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:19.989685 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7c666b24-c9a2-41aa-b554-9564c6f28754 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:19.990324 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7c666b24-c9a2-41aa-b554-9564c6f28754 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:20.750468 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:20.870699 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7c666b24-c9a2-41aa-b554-9564c6f28754 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7bb0211fa4ff2a039df1bdca9fac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9edf1521569645518c75d7ba91c75133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:20.899102 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7c666b24-c9a2-41aa-b554-9564c6f28754 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] 10.222.0.57 "GET /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073" status: 200 len: 1316 microversion: 2.1 time: 0.928171 Jul 18 02:29:20.900155 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1583/3162] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:19 2022] GET /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073 => generated 1316 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:20.902355 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-eed9b5fd-148c-457d-bd41-f44957ce7f96 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a08894c5e14d05b3a7b21001ff2740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a798824fb748c8889769282273bda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:20.924575 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-eeabb5cc-728c-4322-8712-0695515ac298 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:20.926470 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-eeabb5cc-728c-4322-8712-0695515ac298 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b096f40a-9f6f-4956-bf56-7166600da59b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:20.937372 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-eed9b5fd-148c-457d-bd41-f44957ce7f96 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] 10.222.0.57 "GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430" status: 200 len: 1699 microversion: 2.1 time: 2.533994 Jul 18 02:29:20.953742 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eeabb5cc-728c-4322-8712-0695515ac298 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:20.953742 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eeabb5cc-728c-4322-8712-0695515ac298 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:20.953742 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eeabb5cc-728c-4322-8712-0695515ac298 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:20.953742 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eeabb5cc-728c-4322-8712-0695515ac298 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:20.955194 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1580/3163] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:18 2022] GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430 => generated 1699 bytes in 2554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:21.010949 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-eeabb5cc-728c-4322-8712-0695515ac298 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] HTTP exception thrown: Instance b096f40a-9f6f-4956-bf56-7166600da59b could not be found. Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-eeabb5cc-728c-4322-8712-0695515ac298 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Request method failure captured: Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b HTTP/1.1 Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MPwaxUozPvSKq2aGl05vX5p9RkRh12PhrAa5ZuFGYH8QlWHXUoV4AOq2uE9nQ_2FUYuIDSWVSpjhgygJ-c4EGtTg2Y-_wVXi_cp3NARUTVck4-IU3Tev_AIZ-4eU7-_uXuXl7L-x01qv35sxA627UbKELg2PVDH9gxQj5dhwRrNVzw Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ba9d4e8f2f18460ebccacbe32db57388"}]}] Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 89c4d32923874a50972ab0b75a4165c0 Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance b096f40a-9f6f-4956-bf56-7166600da59b could not be found. Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'b096f40a-9f6f-4956-bf56-7166600da59b'} Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b096f40a-9f6f-4956-bf56-7166600da59b could not be found. Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b096f40a-9f6f-4956-bf56-7166600da59b could not be found. Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:21.019555 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:21.037961 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:21.037961 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:21.037961 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:21.037961 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:29:21.037961 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:29:21.037961 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b096f40a-9f6f-4956-bf56-7166600da59b could not be found. Jul 18 02:29:21.037961 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:21.037961 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-eeabb5cc-728c-4322-8712-0695515ac298 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Returning 404 to user: Instance b096f40a-9f6f-4956-bf56-7166600da59b could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:29:21.037961 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-eeabb5cc-728c-4322-8712-0695515ac298 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b" status: 404 len: 111 microversion: 2.1 time: 0.130185 Jul 18 02:29:21.047187 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1584/3164] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:20 2022] GET /compute/v2.1/servers/b096f40a-9f6f-4956-bf56-7166600da59b => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:29:21.064976 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-25e3eaed-efc4-4e01-aad0-ac4228ccb70a tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:21.073874 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-25e3eaed-efc4-4e01-aad0-ac4228ccb70a tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:21.117578 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25e3eaed-efc4-4e01-aad0-ac4228ccb70a tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:21.119903 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25e3eaed-efc4-4e01-aad0-ac4228ccb70a tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:21.122022 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25e3eaed-efc4-4e01-aad0-ac4228ccb70a tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:21.123709 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25e3eaed-efc4-4e01-aad0-ac4228ccb70a tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:21.392705 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-f32433fd-3c03-4dcc-bbd8-6ecae95b1480 req-8c1c5cd7-f0bb-4042-9680-50615162c5d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae6f4257-696a-4178-b93d-f3b42a42e073", "tag": "e80f4a65-068f-46f3-b2aa-3ddabed941b0"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:21.430717 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:21.437479 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-f32433fd-3c03-4dcc-bbd8-6ecae95b1480 req-8c1c5cd7-f0bb-4042-9680-50615162c5d2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:21.440610 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-f32433fd-3c03-4dcc-bbd8-6ecae95b1480 req-8c1c5cd7-f0bb-4042-9680-50615162c5d2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:21.498951 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-f32433fd-3c03-4dcc-bbd8-6ecae95b1480 req-8c1c5cd7-f0bb-4042-9680-50615162c5d2 service nova] Creating event network-changed:e80f4a65-068f-46f3-b2aa-3ddabed941b0 for instance ae6f4257-696a-4178-b93d-f3b42a42e073 on n-h1-465891-3 Jul 18 02:29:21.522169 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-f32433fd-3c03-4dcc-bbd8-6ecae95b1480 req-8c1c5cd7-f0bb-4042-9680-50615162c5d2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.559476 Jul 18 02:29:21.524502 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1581/3165] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:29:21.544887 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2bac1bf9-09d8-40fa-bba1-7a0ae9616bba tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:21.551288 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2bac1bf9-09d8-40fa-bba1-7a0ae9616bba tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: d2dc65b8-8306-4f87-9af1-1cb5096c4ebf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:21.575648 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2bac1bf9-09d8-40fa-bba1-7a0ae9616bba tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:21.578473 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2bac1bf9-09d8-40fa-bba1-7a0ae9616bba tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:21.581139 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2bac1bf9-09d8-40fa-bba1-7a0ae9616bba tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:21.581959 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2bac1bf9-09d8-40fa-bba1-7a0ae9616bba tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:21.625088 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-2bac1bf9-09d8-40fa-bba1-7a0ae9616bba tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] HTTP exception thrown: Instance d2dc65b8-8306-4f87-9af1-1cb5096c4ebf could not be found. Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2bac1bf9-09d8-40fa-bba1-7a0ae9616bba tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Request method failure captured: Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf HTTP/1.1 Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MPwaxUozPvSKq2aGl05vX5p9RkRh12PhrAa5ZuFGYH8QlWHXUoV4AOq2uE9nQ_2FUYuIDSWVSpjhgygJ-c4EGtTg2Y-_wVXi_cp3NARUTVck4-IU3Tev_AIZ-4eU7-_uXuXl7L-x01qv35sxA627UbKELg2PVDH9gxQj5dhwRrNVzw Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ba9d4e8f2f18460ebccacbe32db57388"}]}] Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 89c4d32923874a50972ab0b75a4165c0 Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance d2dc65b8-8306-4f87-9af1-1cb5096c4ebf could not be found. Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'd2dc65b8-8306-4f87-9af1-1cb5096c4ebf'} Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2dc65b8-8306-4f87-9af1-1cb5096c4ebf could not be found. Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:29:21.628210 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:29:21.639874 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2dc65b8-8306-4f87-9af1-1cb5096c4ebf could not be found. Jul 18 02:29:21.639874 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:21.639874 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:21.639874 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:21.639874 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:21.639874 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:21.639874 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:21.639874 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:29:21.639874 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:29:21.639874 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2dc65b8-8306-4f87-9af1-1cb5096c4ebf could not be found. Jul 18 02:29:21.639874 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:21.639874 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2bac1bf9-09d8-40fa-bba1-7a0ae9616bba tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Returning 404 to user: Instance d2dc65b8-8306-4f87-9af1-1cb5096c4ebf could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:29:21.639874 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2bac1bf9-09d8-40fa-bba1-7a0ae9616bba tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf" status: 404 len: 111 microversion: 2.1 time: 0.102756 Jul 18 02:29:21.639874 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1582/3166] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:29:21 2022] DELETE /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:29:21.655455 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-05e18c3a-ac5e-4db4-947a-158c08bb705b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:21.656632 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-05e18c3a-ac5e-4db4-947a-158c08bb705b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: d2dc65b8-8306-4f87-9af1-1cb5096c4ebf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:21.668817 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-05e18c3a-ac5e-4db4-947a-158c08bb705b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:21.669628 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-05e18c3a-ac5e-4db4-947a-158c08bb705b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:21.672451 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-05e18c3a-ac5e-4db4-947a-158c08bb705b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:21.673665 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-05e18c3a-ac5e-4db4-947a-158c08bb705b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:21.694831 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-05e18c3a-ac5e-4db4-947a-158c08bb705b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] HTTP exception thrown: Instance d2dc65b8-8306-4f87-9af1-1cb5096c4ebf could not be found. Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-05e18c3a-ac5e-4db4-947a-158c08bb705b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Request method failure captured: Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf HTTP/1.1 Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MPwaxUozPvSKq2aGl05vX5p9RkRh12PhrAa5ZuFGYH8QlWHXUoV4AOq2uE9nQ_2FUYuIDSWVSpjhgygJ-c4EGtTg2Y-_wVXi_cp3NARUTVck4-IU3Tev_AIZ-4eU7-_uXuXl7L-x01qv35sxA627UbKELg2PVDH9gxQj5dhwRrNVzw Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ba9d4e8f2f18460ebccacbe32db57388"}]}] Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 89c4d32923874a50972ab0b75a4165c0 Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance d2dc65b8-8306-4f87-9af1-1cb5096c4ebf could not be found. Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'd2dc65b8-8306-4f87-9af1-1cb5096c4ebf'} Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2dc65b8-8306-4f87-9af1-1cb5096c4ebf could not be found. Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2dc65b8-8306-4f87-9af1-1cb5096c4ebf could not be found. Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:21.696566 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:21.707777 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:21.707777 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:21.707777 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:21.707777 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:29:21.707777 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:29:21.707777 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2dc65b8-8306-4f87-9af1-1cb5096c4ebf could not be found. Jul 18 02:29:21.707777 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:21.707777 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-05e18c3a-ac5e-4db4-947a-158c08bb705b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Returning 404 to user: Instance d2dc65b8-8306-4f87-9af1-1cb5096c4ebf could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:29:21.707777 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-05e18c3a-ac5e-4db4-947a-158c08bb705b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf" status: 404 len: 111 microversion: 2.1 time: 0.054323 Jul 18 02:29:21.707777 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1583/3167] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:21 2022] GET /compute/v2.1/servers/d2dc65b8-8306-4f87-9af1-1cb5096c4ebf => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:29:21.707777 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5a7c7a55-cd64-4ad3-bb1e-de6cd838be60 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:21.711660 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5a7c7a55-cd64-4ad3-bb1e-de6cd838be60 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:21.715026 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5a7c7a55-cd64-4ad3-bb1e-de6cd838be60 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:21.715503 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5a7c7a55-cd64-4ad3-bb1e-de6cd838be60 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:21.716366 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5a7c7a55-cd64-4ad3-bb1e-de6cd838be60 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:21.717350 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5a7c7a55-cd64-4ad3-bb1e-de6cd838be60 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:21.759043 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-5a7c7a55-cd64-4ad3-bb1e-de6cd838be60 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] HTTP exception thrown: Instance 637aab54-71a9-4233-85ad-7d1e785b9e9c could not be found. Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5a7c7a55-cd64-4ad3-bb1e-de6cd838be60 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Request method failure captured: Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c HTTP/1.1 Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MPwaxUozPvSKq2aGl05vX5p9RkRh12PhrAa5ZuFGYH8QlWHXUoV4AOq2uE9nQ_2FUYuIDSWVSpjhgygJ-c4EGtTg2Y-_wVXi_cp3NARUTVck4-IU3Tev_AIZ-4eU7-_uXuXl7L-x01qv35sxA627UbKELg2PVDH9gxQj5dhwRrNVzw Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ba9d4e8f2f18460ebccacbe32db57388"}]}] Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 89c4d32923874a50972ab0b75a4165c0 Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 637aab54-71a9-4233-85ad-7d1e785b9e9c could not be found. Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '637aab54-71a9-4233-85ad-7d1e785b9e9c'} Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 637aab54-71a9-4233-85ad-7d1e785b9e9c could not be found. Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:29:21.762999 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:29:21.773491 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 637aab54-71a9-4233-85ad-7d1e785b9e9c could not be found. Jul 18 02:29:21.773491 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:21.773491 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:21.773491 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:21.773491 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:21.773491 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:21.773491 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:21.773491 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:29:21.773491 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:29:21.773491 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 637aab54-71a9-4233-85ad-7d1e785b9e9c could not be found. Jul 18 02:29:21.773491 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:21.773491 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5a7c7a55-cd64-4ad3-bb1e-de6cd838be60 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Returning 404 to user: Instance 637aab54-71a9-4233-85ad-7d1e785b9e9c could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:29:21.773491 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5a7c7a55-cd64-4ad3-bb1e-de6cd838be60 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "DELETE /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 404 len: 111 microversion: 2.1 time: 0.064906 Jul 18 02:29:21.777046 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1584/3168] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:29:21 2022] DELETE /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:29:21.793626 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-75e7a321-279c-4c11-b4da-8ff19d6cd860 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:21.797168 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-75e7a321-279c-4c11-b4da-8ff19d6cd860 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 637aab54-71a9-4233-85ad-7d1e785b9e9c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:21.810704 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-75e7a321-279c-4c11-b4da-8ff19d6cd860 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:21.811457 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-75e7a321-279c-4c11-b4da-8ff19d6cd860 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:21.813237 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-75e7a321-279c-4c11-b4da-8ff19d6cd860 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:21.814215 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-75e7a321-279c-4c11-b4da-8ff19d6cd860 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:21.844308 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-75e7a321-279c-4c11-b4da-8ff19d6cd860 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] HTTP exception thrown: Instance 637aab54-71a9-4233-85ad-7d1e785b9e9c could not be found. Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-75e7a321-279c-4c11-b4da-8ff19d6cd860 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Request method failure captured: Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c HTTP/1.1 Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MPwaxUozPvSKq2aGl05vX5p9RkRh12PhrAa5ZuFGYH8QlWHXUoV4AOq2uE9nQ_2FUYuIDSWVSpjhgygJ-c4EGtTg2Y-_wVXi_cp3NARUTVck4-IU3Tev_AIZ-4eU7-_uXuXl7L-x01qv35sxA627UbKELg2PVDH9gxQj5dhwRrNVzw Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ba9d4e8f2f18460ebccacbe32db57388"}]}] Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 89c4d32923874a50972ab0b75a4165c0 Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 637aab54-71a9-4233-85ad-7d1e785b9e9c could not be found. Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '637aab54-71a9-4233-85ad-7d1e785b9e9c'} Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 637aab54-71a9-4233-85ad-7d1e785b9e9c could not be found. Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 637aab54-71a9-4233-85ad-7d1e785b9e9c could not be found. Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:21.847964 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:21.854145 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:21.854145 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:21.854145 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:21.854145 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:29:21.854145 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:29:21.854145 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 637aab54-71a9-4233-85ad-7d1e785b9e9c could not be found. Jul 18 02:29:21.854145 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:21.858079 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-75e7a321-279c-4c11-b4da-8ff19d6cd860 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Returning 404 to user: Instance 637aab54-71a9-4233-85ad-7d1e785b9e9c could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:29:21.859511 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-75e7a321-279c-4c11-b4da-8ff19d6cd860 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c" status: 404 len: 111 microversion: 2.1 time: 0.079937 Jul 18 02:29:21.861163 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1585/3169] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:21 2022] GET /compute/v2.1/servers/637aab54-71a9-4233-85ad-7d1e785b9e9c => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:29:21.877174 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4411095a-4be7-4aa7-b7ba-3d184b2a3dd6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:21.878625 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4411095a-4be7-4aa7-b7ba-3d184b2a3dd6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b88a4eac-c5c4-42d9-a57a-02975ace4b39] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:21.891155 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4411095a-4be7-4aa7-b7ba-3d184b2a3dd6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:21.892963 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4411095a-4be7-4aa7-b7ba-3d184b2a3dd6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:21.894076 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4411095a-4be7-4aa7-b7ba-3d184b2a3dd6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:21.894732 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4411095a-4be7-4aa7-b7ba-3d184b2a3dd6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:21.918178 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-4411095a-4be7-4aa7-b7ba-3d184b2a3dd6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] HTTP exception thrown: Instance b88a4eac-c5c4-42d9-a57a-02975ace4b39 could not be found. Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4411095a-4be7-4aa7-b7ba-3d184b2a3dd6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Request method failure captured: Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39 HTTP/1.1 Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MPwaxUozPvSKq2aGl05vX5p9RkRh12PhrAa5ZuFGYH8QlWHXUoV4AOq2uE9nQ_2FUYuIDSWVSpjhgygJ-c4EGtTg2Y-_wVXi_cp3NARUTVck4-IU3Tev_AIZ-4eU7-_uXuXl7L-x01qv35sxA627UbKELg2PVDH9gxQj5dhwRrNVzw Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ba9d4e8f2f18460ebccacbe32db57388"}]}] Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 89c4d32923874a50972ab0b75a4165c0 Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance b88a4eac-c5c4-42d9-a57a-02975ace4b39 could not be found. Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'b88a4eac-c5c4-42d9-a57a-02975ace4b39'} Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b88a4eac-c5c4-42d9-a57a-02975ace4b39 could not be found. Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:29:21.922363 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:29:21.928533 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b88a4eac-c5c4-42d9-a57a-02975ace4b39 could not be found. Jul 18 02:29:21.928533 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:21.928533 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:21.928533 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:21.928533 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:21.928533 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:21.928533 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:21.928533 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:29:21.928533 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:29:21.928533 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b88a4eac-c5c4-42d9-a57a-02975ace4b39 could not be found. Jul 18 02:29:21.928533 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:21.933368 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4411095a-4be7-4aa7-b7ba-3d184b2a3dd6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Returning 404 to user: Instance b88a4eac-c5c4-42d9-a57a-02975ace4b39 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:29:21.935316 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4411095a-4be7-4aa7-b7ba-3d184b2a3dd6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39" status: 404 len: 111 microversion: 2.1 time: 0.068179 Jul 18 02:29:21.937288 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:21.945055 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1586/3170] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:29:21 2022] DELETE /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:29:21.951484 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-376375db-01e5-4b7b-a5dd-446fc0c97f1d tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:21.952648 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-376375db-01e5-4b7b-a5dd-446fc0c97f1d tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] [instance: ae6f4257-696a-4178-b93d-f3b42a42e073] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:21.962756 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-376375db-01e5-4b7b-a5dd-446fc0c97f1d tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:21.963740 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-376375db-01e5-4b7b-a5dd-446fc0c97f1d tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:21.966607 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-376375db-01e5-4b7b-a5dd-446fc0c97f1d tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:21.967563 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-376375db-01e5-4b7b-a5dd-446fc0c97f1d tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:22.323687 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:22.442967 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-25e3eaed-efc4-4e01-aad0-ac4228ccb70a tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:22.483967 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-25e3eaed-efc4-4e01-aad0-ac4228ccb70a tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 200 len: 1468 microversion: 2.1 time: 1.432081 Jul 18 02:29:22.517264 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1585/3171] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:21 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 1468 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:22.533245 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-06a8b8a2-e968-44e5-8ddf-efd71f75b1fe tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:22.536804 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-06a8b8a2-e968-44e5-8ddf-efd71f75b1fe tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: b88a4eac-c5c4-42d9-a57a-02975ace4b39] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:22.578271 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-06a8b8a2-e968-44e5-8ddf-efd71f75b1fe tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:22.582256 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-06a8b8a2-e968-44e5-8ddf-efd71f75b1fe tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:22.587272 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-06a8b8a2-e968-44e5-8ddf-efd71f75b1fe tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:22.591118 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-06a8b8a2-e968-44e5-8ddf-efd71f75b1fe tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:22.620776 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=4 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:22.629334 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-06a8b8a2-e968-44e5-8ddf-efd71f75b1fe tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] HTTP exception thrown: Instance b88a4eac-c5c4-42d9-a57a-02975ace4b39 could not be found. Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-06a8b8a2-e968-44e5-8ddf-efd71f75b1fe tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Request method failure captured: Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39 HTTP/1.1 Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MPwaxUozPvSKq2aGl05vX5p9RkRh12PhrAa5ZuFGYH8QlWHXUoV4AOq2uE9nQ_2FUYuIDSWVSpjhgygJ-c4EGtTg2Y-_wVXi_cp3NARUTVck4-IU3Tev_AIZ-4eU7-_uXuXl7L-x01qv35sxA627UbKELg2PVDH9gxQj5dhwRrNVzw Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ba9d4e8f2f18460ebccacbe32db57388"}]}] Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 89c4d32923874a50972ab0b75a4165c0 Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance b88a4eac-c5c4-42d9-a57a-02975ace4b39 could not be found. Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'b88a4eac-c5c4-42d9-a57a-02975ace4b39'} Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b88a4eac-c5c4-42d9-a57a-02975ace4b39 could not be found. Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b88a4eac-c5c4-42d9-a57a-02975ace4b39 could not be found. Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:22.639642 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:22.649669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:22.649669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:22.649669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:22.649669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:29:22.649669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:29:22.649669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b88a4eac-c5c4-42d9-a57a-02975ace4b39 could not be found. Jul 18 02:29:22.649669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:22.654530 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-06a8b8a2-e968-44e5-8ddf-efd71f75b1fe tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Returning 404 to user: Instance b88a4eac-c5c4-42d9-a57a-02975ace4b39 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:29:22.655318 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-06a8b8a2-e968-44e5-8ddf-efd71f75b1fe tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39" status: 404 len: 111 microversion: 2.1 time: 0.133419 Jul 18 02:29:22.657079 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1586/3172] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:22 2022] GET /compute/v2.1/servers/b88a4eac-c5c4-42d9-a57a-02975ace4b39 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:29:22.667933 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-133277a2-94c5-4e12-818f-054375011382 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:22.686805 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-133277a2-94c5-4e12-818f-054375011382 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] [instance: 8573a671-62f5-4659-a227-bb1637b51430] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:22.707529 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-133277a2-94c5-4e12-818f-054375011382 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:22.709672 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-133277a2-94c5-4e12-818f-054375011382 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:22.712983 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-133277a2-94c5-4e12-818f-054375011382 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:22.716732 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-133277a2-94c5-4e12-818f-054375011382 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:23.232379 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-376375db-01e5-4b7b-a5dd-446fc0c97f1d tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7bb0211fa4ff2a039df1bdca9fac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9edf1521569645518c75d7ba91c75133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:23.258496 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-376375db-01e5-4b7b-a5dd-446fc0c97f1d tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] 10.222.0.57 "GET /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073" status: 200 len: 1316 microversion: 2.1 time: 1.310468 Jul 18 02:29:23.259700 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1587/3173] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:21 2022] GET /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073 => generated 1316 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:23.284311 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-49ad197b-b4f0-4583-b7c7-0906712d71ca req-e0d52702-5dcb-4479-ac68-50bf9729499a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8573a671-62f5-4659-a227-bb1637b51430", "name": "network-vif-unplugged", "status": "completed", "tag": "c09a4505-eb19-44b0-a058-fbd5d5a5317b"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:23.316323 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-49ad197b-b4f0-4583-b7c7-0906712d71ca req-e0d52702-5dcb-4479-ac68-50bf9729499a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:23.317126 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-49ad197b-b4f0-4583-b7c7-0906712d71ca req-e0d52702-5dcb-4479-ac68-50bf9729499a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:23.353488 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-49ad197b-b4f0-4583-b7c7-0906712d71ca req-e0d52702-5dcb-4479-ac68-50bf9729499a service nova] Creating event network-vif-unplugged:c09a4505-eb19-44b0-a058-fbd5d5a5317b for instance 8573a671-62f5-4659-a227-bb1637b51430 on n-h1-465891-3 Jul 18 02:29:23.366682 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-49ad197b-b4f0-4583-b7c7-0906712d71ca req-e0d52702-5dcb-4479-ac68-50bf9729499a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104307 Jul 18 02:29:23.369164 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1588/3174] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:29:23.394856 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f72c13a5-82f9-4885-96af-d71246aa1767 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:23.396043 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f72c13a5-82f9-4885-96af-d71246aa1767 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: d53aa87d-8927-449a-8792-afb60f09fd31] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:23.415612 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f72c13a5-82f9-4885-96af-d71246aa1767 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:23.417666 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f72c13a5-82f9-4885-96af-d71246aa1767 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:23.420937 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f72c13a5-82f9-4885-96af-d71246aa1767 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:23.422488 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f72c13a5-82f9-4885-96af-d71246aa1767 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:23.458772 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-f72c13a5-82f9-4885-96af-d71246aa1767 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] HTTP exception thrown: Instance d53aa87d-8927-449a-8792-afb60f09fd31 could not be found. Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f72c13a5-82f9-4885-96af-d71246aa1767 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Request method failure captured: Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/servers/d53aa87d-8927-449a-8792-afb60f09fd31 HTTP/1.1 Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MPwaxUozPvSKq2aGl05vX5p9RkRh12PhrAa5ZuFGYH8QlWHXUoV4AOq2uE9nQ_2FUYuIDSWVSpjhgygJ-c4EGtTg2Y-_wVXi_cp3NARUTVck4-IU3Tev_AIZ-4eU7-_uXuXl7L-x01qv35sxA627UbKELg2PVDH9gxQj5dhwRrNVzw Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ba9d4e8f2f18460ebccacbe32db57388"}]}] Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 89c4d32923874a50972ab0b75a4165c0 Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance d53aa87d-8927-449a-8792-afb60f09fd31 could not be found. Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'd53aa87d-8927-449a-8792-afb60f09fd31'} Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d53aa87d-8927-449a-8792-afb60f09fd31 could not be found. Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:29:23.462793 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:29:23.479265 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d53aa87d-8927-449a-8792-afb60f09fd31 could not be found. Jul 18 02:29:23.479265 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:23.479265 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:23.479265 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:23.479265 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:23.479265 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:23.479265 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:23.479265 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:29:23.479265 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:29:23.479265 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d53aa87d-8927-449a-8792-afb60f09fd31 could not be found. Jul 18 02:29:23.479265 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:23.479265 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f72c13a5-82f9-4885-96af-d71246aa1767 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Returning 404 to user: Instance d53aa87d-8927-449a-8792-afb60f09fd31 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:29:23.479265 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f72c13a5-82f9-4885-96af-d71246aa1767 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d53aa87d-8927-449a-8792-afb60f09fd31" status: 404 len: 111 microversion: 2.1 time: 0.089292 Jul 18 02:29:23.479265 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1589/3175] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:29:23 2022] DELETE /compute/v2.1/servers/d53aa87d-8927-449a-8792-afb60f09fd31 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:29:23.488420 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-c3e5be8b-ecec-4a28-877d-1c83f3ab3992 req-5c2b2d3f-e9bb-4c6b-8f12-680c74e903b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f19c9c9-419d-4b9a-abdc-432a65381922", "name": "network-vif-deleted", "tag": "39add5b7-15aa-4a44-a79b-7041ecfeb6be"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:23.501433 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-c3e5be8b-ecec-4a28-877d-1c83f3ab3992 req-5c2b2d3f-e9bb-4c6b-8f12-680c74e903b8 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:23.502133 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-c3e5be8b-ecec-4a28-877d-1c83f3ab3992 req-5c2b2d3f-e9bb-4c6b-8f12-680c74e903b8 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:23.526677 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-c3e5be8b-ecec-4a28-877d-1c83f3ab3992 req-5c2b2d3f-e9bb-4c6b-8f12-680c74e903b8 service nova] Creating event network-vif-deleted:39add5b7-15aa-4a44-a79b-7041ecfeb6be for instance 9f19c9c9-419d-4b9a-abdc-432a65381922 on n-h2-465891-3 Jul 18 02:29:23.535456 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-c3e5be8b-ecec-4a28-877d-1c83f3ab3992 req-5c2b2d3f-e9bb-4c6b-8f12-680c74e903b8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066531 Jul 18 02:29:23.536290 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1590/3176] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:29:23.549159 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-296b7681-2528-4b3d-b2d2-d2e13205451b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:23.550275 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-296b7681-2528-4b3d-b2d2-d2e13205451b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: d53aa87d-8927-449a-8792-afb60f09fd31] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:23.574890 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-296b7681-2528-4b3d-b2d2-d2e13205451b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:23.576110 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-296b7681-2528-4b3d-b2d2-d2e13205451b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:23.578681 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-296b7681-2528-4b3d-b2d2-d2e13205451b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:23.579485 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-296b7681-2528-4b3d-b2d2-d2e13205451b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:23.622728 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-296b7681-2528-4b3d-b2d2-d2e13205451b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] HTTP exception thrown: Instance d53aa87d-8927-449a-8792-afb60f09fd31 could not be found. Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-296b7681-2528-4b3d-b2d2-d2e13205451b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Request method failure captured: Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/d53aa87d-8927-449a-8792-afb60f09fd31 HTTP/1.1 Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MPwaxUozPvSKq2aGl05vX5p9RkRh12PhrAa5ZuFGYH8QlWHXUoV4AOq2uE9nQ_2FUYuIDSWVSpjhgygJ-c4EGtTg2Y-_wVXi_cp3NARUTVck4-IU3Tev_AIZ-4eU7-_uXuXl7L-x01qv35sxA627UbKELg2PVDH9gxQj5dhwRrNVzw Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ba9d4e8f2f18460ebccacbe32db57388"}]}] Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 89c4d32923874a50972ab0b75a4165c0 Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance d53aa87d-8927-449a-8792-afb60f09fd31 could not be found. Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'd53aa87d-8927-449a-8792-afb60f09fd31'} Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d53aa87d-8927-449a-8792-afb60f09fd31 could not be found. Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d53aa87d-8927-449a-8792-afb60f09fd31 could not be found. Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:23.627583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:23.636129 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:23.636129 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:23.636129 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:23.636129 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:29:23.636129 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:29:23.636129 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d53aa87d-8927-449a-8792-afb60f09fd31 could not be found. Jul 18 02:29:23.636129 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:23.640992 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-296b7681-2528-4b3d-b2d2-d2e13205451b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Returning 404 to user: Instance d53aa87d-8927-449a-8792-afb60f09fd31 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:29:23.642977 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-296b7681-2528-4b3d-b2d2-d2e13205451b tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/d53aa87d-8927-449a-8792-afb60f09fd31" status: 404 len: 111 microversion: 2.1 time: 0.105166 Jul 18 02:29:23.649356 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1591/3177] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:23 2022] GET /compute/v2.1/servers/d53aa87d-8927-449a-8792-afb60f09fd31 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:29:23.657651 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f917b619-fb52-4baf-9b65-b8085953fcaf tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:23.659919 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f917b619-fb52-4baf-9b65-b8085953fcaf tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 9f19c9c9-419d-4b9a-abdc-432a65381922] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:23.688435 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f917b619-fb52-4baf-9b65-b8085953fcaf tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:23.689239 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f917b619-fb52-4baf-9b65-b8085953fcaf tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:23.690820 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f917b619-fb52-4baf-9b65-b8085953fcaf tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:23.691599 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f917b619-fb52-4baf-9b65-b8085953fcaf tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:23.746421 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-f917b619-fb52-4baf-9b65-b8085953fcaf tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] HTTP exception thrown: Instance 9f19c9c9-419d-4b9a-abdc-432a65381922 could not be found. Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f917b619-fb52-4baf-9b65-b8085953fcaf tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Request method failure captured: Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 HTTP/1.1 Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MPYuQ4hiawr1dcWx5CpDeDUbpXL6uvpOiNsB7Seq7nE1tcdupt1hNIkef6Tqnk1mKTE2xd1Vb7sfkXhXjAuxYF6yilOzSIbxhaw5D-vQZxUL1lzq_2r24bQBMHzqw_w8hunD8p82wfj8CJyYgsF8XMJK0wTHVbG4cMIJacUYgDTa3A Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: d7ff962145954166b4c5efb0a0f1edff Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-MigrationsAdminTest-1961616525 Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d7ff962145954166b4c5efb0a0f1edff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d7ff962145954166b4c5efb0a0f1edff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d7ff962145954166b4c5efb0a0f1edff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d7ff962145954166b4c5efb0a0f1edff"}]}] Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-MigrationsAdminTest-1961616525 Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: d7ff962145954166b4c5efb0a0f1edff Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-MigrationsAdminTest-1961616525 Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-MigrationsAdminTest-1961616525-project Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: dbeea54ebc4749aba59afb60feaa6159 Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-MigrationsAdminTest-1961616525-project Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 9f19c9c9-419d-4b9a-abdc-432a65381922 could not be found. Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '9f19c9c9-419d-4b9a-abdc-432a65381922'} Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f19c9c9-419d-4b9a-abdc-432a65381922 could not be found. Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f19c9c9-419d-4b9a-abdc-432a65381922 could not be found. Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:23.750310 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:23.761859 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:23.761859 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:23.761859 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:23.761859 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:29:23.761859 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:29:23.761859 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f19c9c9-419d-4b9a-abdc-432a65381922 could not be found. Jul 18 02:29:23.761859 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:23.761859 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f917b619-fb52-4baf-9b65-b8085953fcaf tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Returning 404 to user: Instance 9f19c9c9-419d-4b9a-abdc-432a65381922 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:29:23.761859 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f917b619-fb52-4baf-9b65-b8085953fcaf tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922" status: 404 len: 111 microversion: 2.1 time: 0.101270 Jul 18 02:29:23.770625 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1592/3178] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:23 2022] GET /compute/v2.1/servers/9f19c9c9-419d-4b9a-abdc-432a65381922 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:29:23.792697 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9a6731cc-035a-4904-8dc8-f24134e5c7f0 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:23.794207 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9a6731cc-035a-4904-8dc8-f24134e5c7f0 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:23.808516 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9a6731cc-035a-4904-8dc8-f24134e5c7f0 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:23.809856 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9a6731cc-035a-4904-8dc8-f24134e5c7f0 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:23.812591 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9a6731cc-035a-4904-8dc8-f24134e5c7f0 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:23.813751 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9a6731cc-035a-4904-8dc8-f24134e5c7f0 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:23.920191 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9a6731cc-035a-4904-8dc8-f24134e5c7f0 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:29:24.065276 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-133277a2-94c5-4e12-818f-054375011382 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a08894c5e14d05b3a7b21001ff2740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a798824fb748c8889769282273bda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:24.074227 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-133277a2-94c5-4e12-818f-054375011382 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] 10.222.0.57 "GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430" status: 200 len: 1699 microversion: 2.1 time: 1.415241 Jul 18 02:29:24.074860 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1587/3179] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:22 2022] GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430 => generated 1699 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:24.285349 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9bdb8f45-b51d-408e-8eac-988feb608891 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:24.286186 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9bdb8f45-b51d-408e-8eac-988feb608891 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] [instance: ae6f4257-696a-4178-b93d-f3b42a42e073] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:24.303471 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9bdb8f45-b51d-408e-8eac-988feb608891 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:24.304361 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9bdb8f45-b51d-408e-8eac-988feb608891 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:24.307459 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9bdb8f45-b51d-408e-8eac-988feb608891 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:24.308557 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9bdb8f45-b51d-408e-8eac-988feb608891 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:24.338931 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9a6731cc-035a-4904-8dc8-f24134e5c7f0 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 204 len: 0 microversion: 2.1 time: 0.565164 Jul 18 02:29:24.345401 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1593/3180] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:29:23 2022] DELETE /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 0 bytes in 574 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:29:24.387371 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f17f410e-02f2-4bb0-ba8d-73b19fad786a tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:24.394510 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f17f410e-02f2-4bb0-ba8d-73b19fad786a tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:24.465990 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f17f410e-02f2-4bb0-ba8d-73b19fad786a tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:24.466816 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f17f410e-02f2-4bb0-ba8d-73b19fad786a tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:24.482513 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f17f410e-02f2-4bb0-ba8d-73b19fad786a tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:24.483912 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f17f410e-02f2-4bb0-ba8d-73b19fad786a tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:24.916374 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9bdb8f45-b51d-408e-8eac-988feb608891 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7bb0211fa4ff2a039df1bdca9fac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9edf1521569645518c75d7ba91c75133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:24.925975 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9bdb8f45-b51d-408e-8eac-988feb608891 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] 10.222.0.57 "GET /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073" status: 200 len: 1316 microversion: 2.1 time: 0.645317 Jul 18 02:29:24.929307 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1588/3181] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:24 2022] GET /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073 => generated 1316 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:29:25.041602 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f17f410e-02f2-4bb0-ba8d-73b19fad786a tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:25.071663 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f17f410e-02f2-4bb0-ba8d-73b19fad786a tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1533 microversion: 2.1 time: 0.718092 Jul 18 02:29:25.073797 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1594/3182] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:24 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1533 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:25.093233 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0f0e9de2-88bf-4892-ba34-0bd62f74e80d tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:25.094251 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0f0e9de2-88bf-4892-ba34-0bd62f74e80d tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] [instance: 8573a671-62f5-4659-a227-bb1637b51430] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:25.123120 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f0e9de2-88bf-4892-ba34-0bd62f74e80d tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:25.124136 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f0e9de2-88bf-4892-ba34-0bd62f74e80d tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:25.124957 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f0e9de2-88bf-4892-ba34-0bd62f74e80d tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:25.125488 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f0e9de2-88bf-4892-ba34-0bd62f74e80d tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:25.282052 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0f0e9de2-88bf-4892-ba34-0bd62f74e80d tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a08894c5e14d05b3a7b21001ff2740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a798824fb748c8889769282273bda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:25.292404 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0f0e9de2-88bf-4892-ba34-0bd62f74e80d tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] 10.222.0.57 "GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430" status: 200 len: 1632 microversion: 2.1 time: 0.203716 Jul 18 02:29:25.304725 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1589/3183] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:25 2022] GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430 => generated 1632 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:29:25.904070 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-791aab4c-6752-461e-ac6f-f40cba31dc42 req-609255a4-5050-4d0e-8853-7c100e229079 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8573a671-62f5-4659-a227-bb1637b51430", "name": "network-vif-deleted", "tag": "c09a4505-eb19-44b0-a058-fbd5d5a5317b"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:25.954101 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-984b48fc-033b-4cfc-8f25-57f047bd4d23 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:25.954726 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-984b48fc-033b-4cfc-8f25-57f047bd4d23 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] [instance: ae6f4257-696a-4178-b93d-f3b42a42e073] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:25.967958 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-984b48fc-033b-4cfc-8f25-57f047bd4d23 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:25.968517 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-984b48fc-033b-4cfc-8f25-57f047bd4d23 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:25.969604 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-984b48fc-033b-4cfc-8f25-57f047bd4d23 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:25.970066 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-984b48fc-033b-4cfc-8f25-57f047bd4d23 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:25.980659 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-791aab4c-6752-461e-ac6f-f40cba31dc42 req-609255a4-5050-4d0e-8853-7c100e229079 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:25.981990 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-791aab4c-6752-461e-ac6f-f40cba31dc42 req-609255a4-5050-4d0e-8853-7c100e229079 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:26.020085 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-791aab4c-6752-461e-ac6f-f40cba31dc42 req-609255a4-5050-4d0e-8853-7c100e229079 service nova] Creating event network-vif-deleted:c09a4505-eb19-44b0-a058-fbd5d5a5317b for instance 8573a671-62f5-4659-a227-bb1637b51430 on n-h1-465891-3 Jul 18 02:29:26.033566 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-791aab4c-6752-461e-ac6f-f40cba31dc42 req-609255a4-5050-4d0e-8853-7c100e229079 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137455 Jul 18 02:29:26.039494 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1595/3184] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:29:26.094600 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f1d154e0-49b4-4cf6-a5d1-6623671c6660 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:26.095820 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f1d154e0-49b4-4cf6-a5d1-6623671c6660 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:26.121465 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f1d154e0-49b4-4cf6-a5d1-6623671c6660 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:26.122307 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f1d154e0-49b4-4cf6-a5d1-6623671c6660 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:26.126209 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f1d154e0-49b4-4cf6-a5d1-6623671c6660 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:26.132044 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f1d154e0-49b4-4cf6-a5d1-6623671c6660 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:27.289190 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-984b48fc-033b-4cfc-8f25-57f047bd4d23 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7bb0211fa4ff2a039df1bdca9fac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9edf1521569645518c75d7ba91c75133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:27.329656 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-984b48fc-033b-4cfc-8f25-57f047bd4d23 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] 10.222.0.57 "GET /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073" status: 200 len: 1316 microversion: 2.1 time: 1.370679 Jul 18 02:29:27.361905 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1590/3185] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:25 2022] GET /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073 => generated 1316 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:27.373965 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-010a9cd3-f338-4f16-b77f-a9bd95558b27 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:27.386050 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-010a9cd3-f338-4f16-b77f-a9bd95558b27 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] [instance: 8573a671-62f5-4659-a227-bb1637b51430] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:27.416766 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-010a9cd3-f338-4f16-b77f-a9bd95558b27 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:27.417079 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-010a9cd3-f338-4f16-b77f-a9bd95558b27 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:27.417930 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-010a9cd3-f338-4f16-b77f-a9bd95558b27 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:27.418377 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-010a9cd3-f338-4f16-b77f-a9bd95558b27 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:27.463169 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f1d154e0-49b4-4cf6-a5d1-6623671c6660 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:27.487071 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f1d154e0-49b4-4cf6-a5d1-6623671c6660 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1533 microversion: 2.1 time: 1.398809 Jul 18 02:29:27.488506 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-010a9cd3-f338-4f16-b77f-a9bd95558b27 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] HTTP exception thrown: Instance 8573a671-62f5-4659-a227-bb1637b51430 could not be found. Jul 18 02:29:27.489261 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1596/3186] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:26 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1533 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-010a9cd3-f338-4f16-b77f-a9bd95558b27 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Request method failure captured: Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430 HTTP/1.1 Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MT4QBs42LfPVXT4wvh5K0w6JKESpBupziwS_xdzvLs4A8mTfeRSzKJtAz9cHKv4gpwJieWG2EFmg1wCHVs8zfq5ghoyivmbZk0A3Dbc3uCcBauxKSXlEC75y36fqRgWJeHaICkxbqsErvkR-tCh4HBEqHVSMQJLOBD6cxlGtkXbJnE Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 00a798824fb748c8889769282273bda4 Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersTestJSON-1298039386 Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_00a798824fb748c8889769282273bda4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/00a798824fb748c8889769282273bda4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/00a798824fb748c8889769282273bda4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/00a798824fb748c8889769282273bda4"}]}] Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersTestJSON-1298039386 Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 00a798824fb748c8889769282273bda4 Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersTestJSON-1298039386 Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersTestJSON-1298039386-project Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: c1a08894c5e14d05b3a7b21001ff2740 Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersTestJSON-1298039386-project Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 8573a671-62f5-4659-a227-bb1637b51430 could not be found. Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '8573a671-62f5-4659-a227-bb1637b51430'} Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8573a671-62f5-4659-a227-bb1637b51430 could not be found. Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8573a671-62f5-4659-a227-bb1637b51430 could not be found. Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:27.496629 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:27.501553 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:27.501553 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:27.501553 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:29:27.501553 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:29:27.501553 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8573a671-62f5-4659-a227-bb1637b51430 could not be found. Jul 18 02:29:27.501553 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:27.507958 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-010a9cd3-f338-4f16-b77f-a9bd95558b27 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Returning 404 to user: Instance 8573a671-62f5-4659-a227-bb1637b51430 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:29:27.509011 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-010a9cd3-f338-4f16-b77f-a9bd95558b27 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] 10.222.0.57 "GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430" status: 404 len: 111 microversion: 2.1 time: 0.145561 Jul 18 02:29:27.521562 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-852eaa94-5cb9-43b6-ac01-4814f33cde42 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] Calling method '.version_select at 0x7ff4a8a345e0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:27.522881 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1591/3187] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:27 2022] GET /compute/v2.1/servers/8573a671-62f5-4659-a227-bb1637b51430 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:29:27.586221 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-852eaa94-5cb9-43b6-ac01-4814f33cde42 tempest-ServersTestJSON-1298039386 tempest-ServersTestJSON-1298039386-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1141214482" status: 202 len: 0 microversion: 2.1 time: 0.068775 Jul 18 02:29:27.587610 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1597/3188] 10.222.0.57 () {58 vars in 1220 bytes} [Mon Jul 18 02:29:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1141214482 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:29:28.359605 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b58b438b-c3b9-4470-af37-0beee40d3489 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:28.360214 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b58b438b-c3b9-4470-af37-0beee40d3489 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] [instance: ae6f4257-696a-4178-b93d-f3b42a42e073] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:28.388528 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b58b438b-c3b9-4470-af37-0beee40d3489 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:28.388985 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b58b438b-c3b9-4470-af37-0beee40d3489 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:28.390005 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b58b438b-c3b9-4470-af37-0beee40d3489 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:28.390375 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b58b438b-c3b9-4470-af37-0beee40d3489 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:28.526239 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4c8e4741-ae44-4a50-aa9c-5e883230bde9 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:28.528155 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4c8e4741-ae44-4a50-aa9c-5e883230bde9 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:28.580831 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4c8e4741-ae44-4a50-aa9c-5e883230bde9 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:28.586802 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4c8e4741-ae44-4a50-aa9c-5e883230bde9 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:28.590361 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4c8e4741-ae44-4a50-aa9c-5e883230bde9 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:28.597052 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4c8e4741-ae44-4a50-aa9c-5e883230bde9 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:28.926330 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b58b438b-c3b9-4470-af37-0beee40d3489 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7bb0211fa4ff2a039df1bdca9fac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9edf1521569645518c75d7ba91c75133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:28.940291 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b58b438b-c3b9-4470-af37-0beee40d3489 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] 10.222.0.57 "GET /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073" status: 200 len: 1316 microversion: 2.1 time: 0.583506 Jul 18 02:29:28.942744 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1592/3189] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:28 2022] GET /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073 => generated 1316 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:29.534138 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4c8e4741-ae44-4a50-aa9c-5e883230bde9 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:29.602417 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-8f2c7327-cb1d-4e80-af0d-3406212dbbed req-e422d129-8e06-49da-a769-36e4e83d0d8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d", "name": "network-vif-deleted", "tag": "34d35bd1-0f8c-4049-9360-7f9c95f734d8"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:29.615728 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4c8e4741-ae44-4a50-aa9c-5e883230bde9 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1533 microversion: 2.1 time: 1.055956 Jul 18 02:29:29.640792 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1598/3190] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:28 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1533 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:29.672253 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-8f2c7327-cb1d-4e80-af0d-3406212dbbed req-e422d129-8e06-49da-a769-36e4e83d0d8e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:29.674021 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-8f2c7327-cb1d-4e80-af0d-3406212dbbed req-e422d129-8e06-49da-a769-36e4e83d0d8e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:29.771231 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-8f2c7327-cb1d-4e80-af0d-3406212dbbed req-e422d129-8e06-49da-a769-36e4e83d0d8e service nova] Creating event network-vif-deleted:34d35bd1-0f8c-4049-9360-7f9c95f734d8 for instance a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d on n-h1-465891-3 Jul 18 02:29:29.788571 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-8f2c7327-cb1d-4e80-af0d-3406212dbbed req-e422d129-8e06-49da-a769-36e4e83d0d8e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.192399 Jul 18 02:29:29.790814 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1593/3191] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:29:29.982302 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-03523676-052f-4fd8-810c-a3cd3770ab7d tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:29.995001 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-03523676-052f-4fd8-810c-a3cd3770ab7d tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] [instance: ae6f4257-696a-4178-b93d-f3b42a42e073] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:30.050280 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-03523676-052f-4fd8-810c-a3cd3770ab7d tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:30.054986 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-03523676-052f-4fd8-810c-a3cd3770ab7d tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:30.056104 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-03523676-052f-4fd8-810c-a3cd3770ab7d tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:30.057386 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-03523676-052f-4fd8-810c-a3cd3770ab7d tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:30.677362 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0dbdef85-0269-474b-a355-58e68691a365 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:30.682320 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0dbdef85-0269-474b-a355-58e68691a365 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:30.740994 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0dbdef85-0269-474b-a355-58e68691a365 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:30.741468 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0dbdef85-0269-474b-a355-58e68691a365 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:30.753633 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0dbdef85-0269-474b-a355-58e68691a365 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:30.754220 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0dbdef85-0269-474b-a355-58e68691a365 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:30.810196 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-03523676-052f-4fd8-810c-a3cd3770ab7d tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7bb0211fa4ff2a039df1bdca9fac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9edf1521569645518c75d7ba91c75133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:30.837524 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0dbdef85-0269-474b-a355-58e68691a365 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:30.837524 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0dbdef85-0269-474b-a355-58e68691a365 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:30.837524 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-0dbdef85-0269-474b-a355-58e68691a365 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lazy-loading 'fault' on Instance uuid a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:29:30.851264 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-03523676-052f-4fd8-810c-a3cd3770ab7d tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] 10.222.0.57 "GET /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073" status: 200 len: 1316 microversion: 2.1 time: 0.878172 Jul 18 02:29:30.859394 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1599/3192] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:29 2022] GET /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073 => generated 1316 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:31.144806 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0dbdef85-0269-474b-a355-58e68691a365 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:31.153031 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0dbdef85-0269-474b-a355-58e68691a365 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 200 len: 1368 microversion: 2.1 time: 0.487030 Jul 18 02:29:31.157479 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1594/3193] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:30 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 1368 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:31.212870 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9a7d116e-a22c-478a-bfe5-43f8eed952ae tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:31.213864 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9a7d116e-a22c-478a-bfe5-43f8eed952ae tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:31.247545 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9a7d116e-a22c-478a-bfe5-43f8eed952ae tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:31.249108 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9a7d116e-a22c-478a-bfe5-43f8eed952ae tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:31.250951 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9a7d116e-a22c-478a-bfe5-43f8eed952ae tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:31.251762 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9a7d116e-a22c-478a-bfe5-43f8eed952ae tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:31.316561 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-9a7d116e-a22c-478a-bfe5-43f8eed952ae tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] HTTP exception thrown: Instance 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a could not be found. Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9a7d116e-a22c-478a-bfe5-43f8eed952ae tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Request method failure captured: Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a HTTP/1.1 Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MPwaxUozPvSKq2aGl05vX5p9RkRh12PhrAa5ZuFGYH8QlWHXUoV4AOq2uE9nQ_2FUYuIDSWVSpjhgygJ-c4EGtTg2Y-_wVXi_cp3NARUTVck4-IU3Tev_AIZ-4eU7-_uXuXl7L-x01qv35sxA627UbKELg2PVDH9gxQj5dhwRrNVzw Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ba9d4e8f2f18460ebccacbe32db57388"}]}] Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 89c4d32923874a50972ab0b75a4165c0 Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a could not be found. Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a'} Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a could not be found. Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:29:31.330367 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:29:31.334880 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a could not be found. Jul 18 02:29:31.334880 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:31.334880 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:31.334880 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:31.334880 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:31.334880 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:31.334880 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:31.334880 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:29:31.334880 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:29:31.334880 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a could not be found. Jul 18 02:29:31.334880 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:31.338343 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9a7d116e-a22c-478a-bfe5-43f8eed952ae tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Returning 404 to user: Instance 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:29:31.339665 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9a7d116e-a22c-478a-bfe5-43f8eed952ae tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "DELETE /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a" status: 404 len: 111 microversion: 2.1 time: 0.136075 Jul 18 02:29:31.343862 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1600/3194] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:29:31 2022] DELETE /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:29:31.359246 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3b5ec03a-e536-4219-a0a3-697cb9619b38 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:31.362926 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3b5ec03a-e536-4219-a0a3-697cb9619b38 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:31.391858 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b5ec03a-e536-4219-a0a3-697cb9619b38 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:31.394422 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b5ec03a-e536-4219-a0a3-697cb9619b38 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:31.400447 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b5ec03a-e536-4219-a0a3-697cb9619b38 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:31.401271 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b5ec03a-e536-4219-a0a3-697cb9619b38 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:31.472928 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-3b5ec03a-e536-4219-a0a3-697cb9619b38 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] HTTP exception thrown: Instance 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a could not be found. Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3b5ec03a-e536-4219-a0a3-697cb9619b38 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Request method failure captured: Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a HTTP/1.1 Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MPwaxUozPvSKq2aGl05vX5p9RkRh12PhrAa5ZuFGYH8QlWHXUoV4AOq2uE9nQ_2FUYuIDSWVSpjhgygJ-c4EGtTg2Y-_wVXi_cp3NARUTVck4-IU3Tev_AIZ-4eU7-_uXuXl7L-x01qv35sxA627UbKELg2PVDH9gxQj5dhwRrNVzw Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ba9d4e8f2f18460ebccacbe32db57388"}]}] Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 89c4d32923874a50972ab0b75a4165c0 Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a could not be found. Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a'} Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a could not be found. Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a could not be found. Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:31.481758 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:31.498316 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:31.498316 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:31.498316 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:31.498316 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:29:31.498316 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:29:31.498316 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a could not be found. Jul 18 02:29:31.498316 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:31.502092 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3b5ec03a-e536-4219-a0a3-697cb9619b38 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Returning 404 to user: Instance 104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:29:31.504308 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3b5ec03a-e536-4219-a0a3-697cb9619b38 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a" status: 404 len: 111 microversion: 2.1 time: 0.157841 Jul 18 02:29:31.506191 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1595/3195] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:31 2022] GET /compute/v2.1/servers/104b4ad3-6af3-4f35-ac3f-a6ce6e7e489a => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:29:31.515496 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c1548a67-d071-4f1e-aa32-3a0d8e7c71d6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:31.515952 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c1548a67-d071-4f1e-aa32-3a0d8e7c71d6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:31.526492 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c1548a67-d071-4f1e-aa32-3a0d8e7c71d6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:31.526968 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c1548a67-d071-4f1e-aa32-3a0d8e7c71d6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:31.529847 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c1548a67-d071-4f1e-aa32-3a0d8e7c71d6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:31.531076 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c1548a67-d071-4f1e-aa32-3a0d8e7c71d6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:31.566091 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-c1548a67-d071-4f1e-aa32-3a0d8e7c71d6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] HTTP exception thrown: Instance 6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc could not be found. Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c1548a67-d071-4f1e-aa32-3a0d8e7c71d6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Request method failure captured: Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/servers/6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc HTTP/1.1 Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MPwaxUozPvSKq2aGl05vX5p9RkRh12PhrAa5ZuFGYH8QlWHXUoV4AOq2uE9nQ_2FUYuIDSWVSpjhgygJ-c4EGtTg2Y-_wVXi_cp3NARUTVck4-IU3Tev_AIZ-4eU7-_uXuXl7L-x01qv35sxA627UbKELg2PVDH9gxQj5dhwRrNVzw Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ba9d4e8f2f18460ebccacbe32db57388"}]}] Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 89c4d32923874a50972ab0b75a4165c0 Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc could not be found. Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc'} Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc could not be found. Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:29:31.568192 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:29:31.572928 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc could not be found. Jul 18 02:29:31.572928 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:31.572928 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:31.572928 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:31.572928 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:31.572928 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:31.572928 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:31.572928 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:29:31.572928 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:29:31.572928 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc could not be found. Jul 18 02:29:31.572928 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:31.589019 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c1548a67-d071-4f1e-aa32-3a0d8e7c71d6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Returning 404 to user: Instance 6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:29:31.596064 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c1548a67-d071-4f1e-aa32-3a0d8e7c71d6 tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "DELETE /compute/v2.1/servers/6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc" status: 404 len: 111 microversion: 2.1 time: 0.082786 Jul 18 02:29:31.599144 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1601/3196] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:29:31 2022] DELETE /compute/v2.1/servers/6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:29:31.608106 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9fa1049a-8794-4367-b079-820cb673d3ad tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:31.609857 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9fa1049a-8794-4367-b079-820cb673d3ad tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] [instance: 6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:31.620496 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9fa1049a-8794-4367-b079-820cb673d3ad tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:31.627414 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9fa1049a-8794-4367-b079-820cb673d3ad tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:31.628488 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9fa1049a-8794-4367-b079-820cb673d3ad tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:31.629050 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9fa1049a-8794-4367-b079-820cb673d3ad tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:31.662646 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-9fa1049a-8794-4367-b079-820cb673d3ad tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] HTTP exception thrown: Instance 6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc could not be found. Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9fa1049a-8794-4367-b079-820cb673d3ad tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Request method failure captured: Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc HTTP/1.1 Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MPwaxUozPvSKq2aGl05vX5p9RkRh12PhrAa5ZuFGYH8QlWHXUoV4AOq2uE9nQ_2FUYuIDSWVSpjhgygJ-c4EGtTg2Y-_wVXi_cp3NARUTVck4-IU3Tev_AIZ-4eU7-_uXuXl7L-x01qv35sxA627UbKELg2PVDH9gxQj5dhwRrNVzw Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ba9d4e8f2f18460ebccacbe32db57388"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ba9d4e8f2f18460ebccacbe32db57388"}]}] Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: ba9d4e8f2f18460ebccacbe32db57388 Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-DeleteServersTestJSON-988442543 Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 89c4d32923874a50972ab0b75a4165c0 Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-DeleteServersTestJSON-988442543-project Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc could not be found. Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc'} Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc could not be found. Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc could not be found. Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:31.664469 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:31.684408 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:31.684408 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:31.684408 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:31.684408 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:29:31.684408 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:29:31.684408 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc could not be found. Jul 18 02:29:31.684408 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:31.684408 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9fa1049a-8794-4367-b079-820cb673d3ad tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] Returning 404 to user: Instance 6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:29:31.684408 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9fa1049a-8794-4367-b079-820cb673d3ad tempest-DeleteServersTestJSON-988442543 tempest-DeleteServersTestJSON-988442543-project] 10.222.0.57 "GET /compute/v2.1/servers/6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc" status: 404 len: 111 microversion: 2.1 time: 0.067950 Jul 18 02:29:31.684408 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1596/3197] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:31 2022] GET /compute/v2.1/servers/6dbb0c0f-39e7-486c-a3e1-3df5433a4bbc => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:29:31.893551 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0ece65bb-1d75-4bf9-8697-50465e6fed91 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:31.894491 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0ece65bb-1d75-4bf9-8697-50465e6fed91 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] [instance: ae6f4257-696a-4178-b93d-f3b42a42e073] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:31.920336 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0ece65bb-1d75-4bf9-8697-50465e6fed91 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:31.921948 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0ece65bb-1d75-4bf9-8697-50465e6fed91 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:31.925454 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0ece65bb-1d75-4bf9-8697-50465e6fed91 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:31.927802 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0ece65bb-1d75-4bf9-8697-50465e6fed91 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:32.065197 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 02:29:32.065480 n-d-465891-3 devstack@n-api.service[119544]: Mon Jul 18 02:29:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 02:29:32.177281 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0d0cd255-689a-4ea0-9ffc-83ca467cc512 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:32.182975 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0d0cd255-689a-4ea0-9ffc-83ca467cc512 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:32.208683 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0d0cd255-689a-4ea0-9ffc-83ca467cc512 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:32.210207 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0d0cd255-689a-4ea0-9ffc-83ca467cc512 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:32.212164 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0d0cd255-689a-4ea0-9ffc-83ca467cc512 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:32.212837 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0d0cd255-689a-4ea0-9ffc-83ca467cc512 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:32.273676 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-0d0cd255-689a-4ea0-9ffc-83ca467cc512 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] HTTP exception thrown: Instance a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d could not be found. Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0d0cd255-689a-4ea0-9ffc-83ca467cc512 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Request method failure captured: Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d HTTP/1.1 Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MPYuQ4hiawr1dcWx5CpDeDUbpXL6uvpOiNsB7Seq7nE1tcdupt1hNIkef6Tqnk1mKTE2xd1Vb7sfkXhXjAuxYF6yilOzSIbxhaw5D-vQZxUL1lzq_2r24bQBMHzqw_w8hunD8p82wfj8CJyYgsF8XMJK0wTHVbG4cMIJacUYgDTa3A Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: d7ff962145954166b4c5efb0a0f1edff Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-MigrationsAdminTest-1961616525 Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d7ff962145954166b4c5efb0a0f1edff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d7ff962145954166b4c5efb0a0f1edff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d7ff962145954166b4c5efb0a0f1edff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d7ff962145954166b4c5efb0a0f1edff"}]}] Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-MigrationsAdminTest-1961616525 Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: d7ff962145954166b4c5efb0a0f1edff Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-MigrationsAdminTest-1961616525 Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-MigrationsAdminTest-1961616525-project Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: dbeea54ebc4749aba59afb60feaa6159 Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-MigrationsAdminTest-1961616525-project Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d could not be found. Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d'} Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d could not be found. Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d could not be found. Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:32.286010 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:32.292823 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:32.292823 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:32.292823 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:32.292823 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:29:32.292823 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:29:32.292823 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d could not be found. Jul 18 02:29:32.292823 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:32.292823 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0d0cd255-689a-4ea0-9ffc-83ca467cc512 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Returning 404 to user: Instance a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:29:32.292823 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0d0cd255-689a-4ea0-9ffc-83ca467cc512 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d" status: 404 len: 111 microversion: 2.1 time: 0.125110 Jul 18 02:29:32.308959 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1597/3198] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:32 2022] GET /compute/v2.1/servers/a3e162e9-cfc7-4bb2-9d1a-f66e95309e5d => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:29:32.334305 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c3fa1c15-fe8a-421a-81ca-38ede236c5b8 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '.version_select at 0x7ff4a826c670>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:32.431412 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c3fa1c15-fe8a-421a-81ca-38ede236c5b8 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-680598662" status: 202 len: 0 microversion: 2.1 time: 0.116912 Jul 18 02:29:32.434161 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1598/3199] 10.222.0.57 () {58 vars in 1217 bytes} [Mon Jul 18 02:29:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-680598662 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:29:33.646354 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-b06f8ba6-54cb-45a6-b3b8-021933c60f62 req-5499181f-04a1-4ece-b4a3-e8cdb79583de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae6f4257-696a-4178-b93d-f3b42a42e073", "name": "network-vif-plugged", "status": "completed", "tag": "e80f4a65-068f-46f3-b2aa-3ddabed941b0"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:33.664664 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-b06f8ba6-54cb-45a6-b3b8-021933c60f62 req-5499181f-04a1-4ece-b4a3-e8cdb79583de service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:33.665574 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-b06f8ba6-54cb-45a6-b3b8-021933c60f62 req-5499181f-04a1-4ece-b4a3-e8cdb79583de service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:33.679291 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-b06f8ba6-54cb-45a6-b3b8-021933c60f62 req-5499181f-04a1-4ece-b4a3-e8cdb79583de service nova] Creating event network-vif-plugged:e80f4a65-068f-46f3-b2aa-3ddabed941b0 for instance ae6f4257-696a-4178-b93d-f3b42a42e073 on n-h1-465891-3 Jul 18 02:29:33.687308 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-b06f8ba6-54cb-45a6-b3b8-021933c60f62 req-5499181f-04a1-4ece-b4a3-e8cdb79583de service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048924 Jul 18 02:29:33.689818 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1599/3200] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:29:34.432785 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0ece65bb-1d75-4bf9-8697-50465e6fed91 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7bb0211fa4ff2a039df1bdca9fac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9edf1521569645518c75d7ba91c75133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:34.465416 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0ece65bb-1d75-4bf9-8697-50465e6fed91 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] 10.222.0.57 "GET /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073" status: 200 len: 1316 microversion: 2.1 time: 2.580398 Jul 18 02:29:34.481037 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1602/3201] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:31 2022] GET /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073 => generated 1316 bytes in 2597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:35.522691 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-495f22f0-7959-4fa8-8415-2915914d3465 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:35.524517 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-495f22f0-7959-4fa8-8415-2915914d3465 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] [instance: ae6f4257-696a-4178-b93d-f3b42a42e073] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:35.559043 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-495f22f0-7959-4fa8-8415-2915914d3465 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:35.560440 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-495f22f0-7959-4fa8-8415-2915914d3465 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:35.567084 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-495f22f0-7959-4fa8-8415-2915914d3465 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:35.569898 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-495f22f0-7959-4fa8-8415-2915914d3465 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:36.289051 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-495f22f0-7959-4fa8-8415-2915914d3465 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7bb0211fa4ff2a039df1bdca9fac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9edf1521569645518c75d7ba91c75133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:36.307863 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-495f22f0-7959-4fa8-8415-2915914d3465 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] 10.222.0.57 "GET /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073" status: 200 len: 1316 microversion: 2.1 time: 0.805027 Jul 18 02:29:36.309179 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1600/3202] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:35 2022] GET /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073 => generated 1316 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:37.345223 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-03ead254-9eae-4f14-a9e6-8c1ea510cec4 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:37.346378 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-03ead254-9eae-4f14-a9e6-8c1ea510cec4 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] [instance: ae6f4257-696a-4178-b93d-f3b42a42e073] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:37.368949 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-03ead254-9eae-4f14-a9e6-8c1ea510cec4 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:37.376387 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-03ead254-9eae-4f14-a9e6-8c1ea510cec4 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:37.377925 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-03ead254-9eae-4f14-a9e6-8c1ea510cec4 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:37.380503 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-03ead254-9eae-4f14-a9e6-8c1ea510cec4 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:37.408660 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:38.436267 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-03ead254-9eae-4f14-a9e6-8c1ea510cec4 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7bb0211fa4ff2a039df1bdca9fac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9edf1521569645518c75d7ba91c75133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:38.464914 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-03ead254-9eae-4f14-a9e6-8c1ea510cec4 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] 10.222.0.57 "GET /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073" status: 200 len: 1505 microversion: 2.1 time: 1.128521 Jul 18 02:29:38.466410 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1603/3203] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:37 2022] GET /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073 => generated 1505 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:38.499957 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-118f4523-98a8-448e-b576-a52a6472123b tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:38.504559 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-118f4523-98a8-448e-b576-a52a6472123b tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] [instance: ae6f4257-696a-4178-b93d-f3b42a42e073] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:38.543762 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-118f4523-98a8-448e-b576-a52a6472123b tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:38.545006 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-118f4523-98a8-448e-b576-a52a6472123b tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:38.547796 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-118f4523-98a8-448e-b576-a52a6472123b tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:38.549852 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-118f4523-98a8-448e-b576-a52a6472123b tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:38.695947 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-118f4523-98a8-448e-b576-a52a6472123b tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] 10.222.0.57 "GET /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073/ips" status: 200 len: 109 microversion: 2.1 time: 0.203502 Jul 18 02:29:38.707379 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1601/3204] 10.222.0.57 () {58 vars in 1247 bytes} [Mon Jul 18 02:29:38 2022] GET /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073/ips => generated 109 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:29:38.714307 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-68bb8e05-3e70-4f1d-8a80-a579f89a9870 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:38.714964 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-68bb8e05-3e70-4f1d-8a80-a579f89a9870 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] [instance: ae6f4257-696a-4178-b93d-f3b42a42e073] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:38.728286 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-68bb8e05-3e70-4f1d-8a80-a579f89a9870 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:38.728848 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-68bb8e05-3e70-4f1d-8a80-a579f89a9870 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:38.730008 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-68bb8e05-3e70-4f1d-8a80-a579f89a9870 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:38.732235 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-68bb8e05-3e70-4f1d-8a80-a579f89a9870 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:38.792368 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-68bb8e05-3e70-4f1d-8a80-a579f89a9870 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] 10.222.0.57 "GET /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073/ips" status: 200 len: 109 microversion: 2.1 time: 0.082373 Jul 18 02:29:38.793404 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1604/3205] 10.222.0.57 () {58 vars in 1247 bytes} [Mon Jul 18 02:29:38 2022] GET /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073/ips => generated 109 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:29:38.809090 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b9be86ce-dd8c-4881-bfd9-30e37a480457 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:38.810145 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b9be86ce-dd8c-4881-bfd9-30e37a480457 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] [instance: ae6f4257-696a-4178-b93d-f3b42a42e073] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:38.820976 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b9be86ce-dd8c-4881-bfd9-30e37a480457 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:38.821809 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b9be86ce-dd8c-4881-bfd9-30e37a480457 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:38.823129 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b9be86ce-dd8c-4881-bfd9-30e37a480457 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:38.823768 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b9be86ce-dd8c-4881-bfd9-30e37a480457 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:38.861081 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b9be86ce-dd8c-4881-bfd9-30e37a480457 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] 10.222.0.57 "GET /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073/ips/tempest-ServerAddressesTestJSON-838240031-network" status: 200 len: 94 microversion: 2.1 time: 0.057532 Jul 18 02:29:38.863338 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1602/3206] 10.222.0.57 () {58 vars in 1397 bytes} [Mon Jul 18 02:29:38 2022] GET /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073/ips/tempest-ServerAddressesTestJSON-838240031-network => generated 94 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:29:38.890169 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9734740b-308a-43b6-ac0e-53a1323f244c tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:38.892727 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9734740b-308a-43b6-ac0e-53a1323f244c tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] [instance: ae6f4257-696a-4178-b93d-f3b42a42e073] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:38.906627 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9734740b-308a-43b6-ac0e-53a1323f244c tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:38.908067 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9734740b-308a-43b6-ac0e-53a1323f244c tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:38.909964 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9734740b-308a-43b6-ac0e-53a1323f244c tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:38.911177 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9734740b-308a-43b6-ac0e-53a1323f244c tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:38.980846 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9734740b-308a-43b6-ac0e-53a1323f244c tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] [instance: ae6f4257-696a-4178-b93d-f3b42a42e073] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:29:39.083676 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9999876c-af42-419f-a644-88aa679837ea tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:39.087809 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9999876c-af42-419f-a644-88aa679837ea tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:39.116576 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9999876c-af42-419f-a644-88aa679837ea tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:39.121402 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9999876c-af42-419f-a644-88aa679837ea tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:39.126540 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9999876c-af42-419f-a644-88aa679837ea tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:39.128556 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9999876c-af42-419f-a644-88aa679837ea tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:39.286327 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9999876c-af42-419f-a644-88aa679837ea tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:29:39.314713 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9734740b-308a-43b6-ac0e-53a1323f244c tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073" status: 204 len: 0 microversion: 2.1 time: 0.435560 Jul 18 02:29:39.332322 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1605/3207] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:29:38 2022] DELETE /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:29:39.366050 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-15a32d51-8f5e-465a-a243-89fe9bdabc9e tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:39.376050 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-15a32d51-8f5e-465a-a243-89fe9bdabc9e tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] [instance: ae6f4257-696a-4178-b93d-f3b42a42e073] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:39.413111 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:39.421069 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-15a32d51-8f5e-465a-a243-89fe9bdabc9e tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:39.423150 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-15a32d51-8f5e-465a-a243-89fe9bdabc9e tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:39.424959 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-15a32d51-8f5e-465a-a243-89fe9bdabc9e tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:39.426123 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-15a32d51-8f5e-465a-a243-89fe9bdabc9e tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:39.480686 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9999876c-af42-419f-a644-88aa679837ea tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "DELETE /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 204 len: 0 microversion: 2.1 time: 0.407955 Jul 18 02:29:39.485173 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1603/3208] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:29:39 2022] DELETE /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:29:39.491078 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7238cba1-0585-480f-bfff-f8d67ac5dfee tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:39.491811 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7238cba1-0585-480f-bfff-f8d67ac5dfee tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:39.516144 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7238cba1-0585-480f-bfff-f8d67ac5dfee tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:39.517434 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7238cba1-0585-480f-bfff-f8d67ac5dfee tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:39.518029 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7238cba1-0585-480f-bfff-f8d67ac5dfee tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:39.518683 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7238cba1-0585-480f-bfff-f8d67ac5dfee tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:41.574032 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-15a32d51-8f5e-465a-a243-89fe9bdabc9e tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7bb0211fa4ff2a039df1bdca9fac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9edf1521569645518c75d7ba91c75133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:41.617448 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-15a32d51-8f5e-465a-a243-89fe9bdabc9e tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] 10.222.0.57 "GET /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073" status: 200 len: 1511 microversion: 2.1 time: 2.269148 Jul 18 02:29:41.621821 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1606/3209] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:39 2022] GET /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073 => generated 1511 bytes in 2276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:41.938311 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7238cba1-0585-480f-bfff-f8d67ac5dfee tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:41.950748 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7238cba1-0585-480f-bfff-f8d67ac5dfee tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1469 microversion: 2.1 time: 2.463709 Jul 18 02:29:41.964184 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1604/3210] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:39 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1469 bytes in 2476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:29:42.647171 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4b455e36-a22a-413a-8b8e-f4a9b4e4c7a5 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:42.647924 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4b455e36-a22a-413a-8b8e-f4a9b4e4c7a5 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] [instance: ae6f4257-696a-4178-b93d-f3b42a42e073] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:42.689006 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4b455e36-a22a-413a-8b8e-f4a9b4e4c7a5 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:42.690399 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4b455e36-a22a-413a-8b8e-f4a9b4e4c7a5 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:42.691889 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4b455e36-a22a-413a-8b8e-f4a9b4e4c7a5 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:42.692701 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4b455e36-a22a-413a-8b8e-f4a9b4e4c7a5 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:42.975052 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9e793a90-8a88-40aa-ac1d-82f22cc62836 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:42.975928 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9e793a90-8a88-40aa-ac1d-82f22cc62836 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:42.991355 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:42.993176 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9e793a90-8a88-40aa-ac1d-82f22cc62836 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:43.000708 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9e793a90-8a88-40aa-ac1d-82f22cc62836 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:43.002077 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9e793a90-8a88-40aa-ac1d-82f22cc62836 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:43.002889 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9e793a90-8a88-40aa-ac1d-82f22cc62836 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:43.509247 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4b455e36-a22a-413a-8b8e-f4a9b4e4c7a5 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7bb0211fa4ff2a039df1bdca9fac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9edf1521569645518c75d7ba91c75133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:43.528760 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4b455e36-a22a-413a-8b8e-f4a9b4e4c7a5 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] 10.222.0.57 "GET /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073" status: 200 len: 1511 microversion: 2.1 time: 0.893496 Jul 18 02:29:43.530802 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1607/3211] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:42 2022] GET /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073 => generated 1511 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:43.659931 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9e793a90-8a88-40aa-ac1d-82f22cc62836 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:43.675238 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9e793a90-8a88-40aa-ac1d-82f22cc62836 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1469 microversion: 2.1 time: 0.705940 Jul 18 02:29:43.676820 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1605/3212] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:42 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1469 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:29:44.377724 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-d0192af4-fcb5-4600-a378-b782353823d6 req-a8f7a126-42ed-4815-9b57-3a67f9fa7b46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7", "name": "network-vif-deleted", "tag": "d130b73f-1f50-4848-bcf5-1bc41a9e7331"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:44.398279 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-d0192af4-fcb5-4600-a378-b782353823d6 req-a8f7a126-42ed-4815-9b57-3a67f9fa7b46 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:44.400675 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-d0192af4-fcb5-4600-a378-b782353823d6 req-a8f7a126-42ed-4815-9b57-3a67f9fa7b46 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:44.427819 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-d0192af4-fcb5-4600-a378-b782353823d6 req-a8f7a126-42ed-4815-9b57-3a67f9fa7b46 service nova] Creating event network-vif-deleted:d130b73f-1f50-4848-bcf5-1bc41a9e7331 for instance dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 on n-h1-465891-3 Jul 18 02:29:44.441652 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-d0192af4-fcb5-4600-a378-b782353823d6 req-a8f7a126-42ed-4815-9b57-3a67f9fa7b46 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068598 Jul 18 02:29:44.444536 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1606/3213] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:29:44.550141 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8f52eab4-7697-4692-90fa-4fe9982f8e8e tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:44.551088 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8f52eab4-7697-4692-90fa-4fe9982f8e8e tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] [instance: ae6f4257-696a-4178-b93d-f3b42a42e073] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:44.580152 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8f52eab4-7697-4692-90fa-4fe9982f8e8e tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:44.590521 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8f52eab4-7697-4692-90fa-4fe9982f8e8e tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:44.599033 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8f52eab4-7697-4692-90fa-4fe9982f8e8e tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:44.599901 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8f52eab4-7697-4692-90fa-4fe9982f8e8e tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:44.621911 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e04cbd62-a632-461c-8c83-8e603d0a74e8 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Action: 'create', calling method: .version_select at 0x7ff4a94c29d0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1110754975", "policies": ["affinity"]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:44.714724 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-e04cbd62-a632-461c-8c83-8e603d0a74e8 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Getting quotas for project 9d3f4bddbe0e4a0a827296b21be3e901. Resources: {'server_groups'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:29:44.772730 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-e04cbd62-a632-461c-8c83-8e603d0a74e8 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Getting quotas for user 180f08fe932e46c99c201223e7a3bef3 and project 9d3f4bddbe0e4a0a827296b21be3e901. Resources: {'server_groups'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:29:45.013519 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-e04cbd62-a632-461c-8c83-8e603d0a74e8 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Getting quotas for project 9d3f4bddbe0e4a0a827296b21be3e901. Resources: {'server_groups'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:29:45.036123 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-e04cbd62-a632-461c-8c83-8e603d0a74e8 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Getting quotas for user 180f08fe932e46c99c201223e7a3bef3 and project 9d3f4bddbe0e4a0a827296b21be3e901. Resources: {'server_groups'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:29:45.142839 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8f52eab4-7697-4692-90fa-4fe9982f8e8e tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7bb0211fa4ff2a039df1bdca9fac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9edf1521569645518c75d7ba91c75133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:45.153886 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8f52eab4-7697-4692-90fa-4fe9982f8e8e tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] 10.222.0.57 "GET /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073" status: 200 len: 1469 microversion: 2.1 time: 0.608978 Jul 18 02:29:45.164200 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1607/3214] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:44 2022] GET /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073 => generated 1469 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:29:45.175907 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8aa1ccb3-e1cd-4006-bb79-f9eaf293fb7b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:45.176801 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8aa1ccb3-e1cd-4006-bb79-f9eaf293fb7b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:45.188971 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e04cbd62-a632-461c-8c83-8e603d0a74e8 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] 10.222.0.57 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 1.206847 Jul 18 02:29:45.190140 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1608/3215] 10.222.0.57 () {60 vars in 1173 bytes} [Mon Jul 18 02:29:43 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:29:45.191545 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8aa1ccb3-e1cd-4006-bb79-f9eaf293fb7b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:45.192289 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8aa1ccb3-e1cd-4006-bb79-f9eaf293fb7b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:45.193376 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8aa1ccb3-e1cd-4006-bb79-f9eaf293fb7b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:45.194085 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8aa1ccb3-e1cd-4006-bb79-f9eaf293fb7b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:45.253667 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d0bc758b-7db2-413f-aebe-392cea2355bf tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Action: 'create', calling method: .version_select at 0x7ff4a8a34a60>, body: {"server_group": {"name": "tempest-server-group-1481337550", "policies": ["affinity"]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:45.306461 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8aa1ccb3-e1cd-4006-bb79-f9eaf293fb7b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:45.309412 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8aa1ccb3-e1cd-4006-bb79-f9eaf293fb7b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:45.310276 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-8aa1ccb3-e1cd-4006-bb79-f9eaf293fb7b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lazy-loading 'fault' on Instance uuid dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:29:45.362553 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-d0bc758b-7db2-413f-aebe-392cea2355bf tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Getting quotas for project 9d3f4bddbe0e4a0a827296b21be3e901. Resources: {'server_groups'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:29:45.378240 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:45.379872 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-d0bc758b-7db2-413f-aebe-392cea2355bf tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Getting quotas for user 180f08fe932e46c99c201223e7a3bef3 and project 9d3f4bddbe0e4a0a827296b21be3e901. Resources: {'server_groups'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:29:45.683310 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-d0bc758b-7db2-413f-aebe-392cea2355bf tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Getting quotas for project 9d3f4bddbe0e4a0a827296b21be3e901. Resources: {'server_groups'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:29:45.729587 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-d0bc758b-7db2-413f-aebe-392cea2355bf tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Getting quotas for user 180f08fe932e46c99c201223e7a3bef3 and project 9d3f4bddbe0e4a0a827296b21be3e901. Resources: {'server_groups'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:29:45.764350 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8aa1ccb3-e1cd-4006-bb79-f9eaf293fb7b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:45.772990 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8aa1ccb3-e1cd-4006-bb79-f9eaf293fb7b tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 200 len: 1303 microversion: 2.1 time: 0.606963 Jul 18 02:29:45.778124 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1608/3216] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:45 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 1303 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:45.872909 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d0bc758b-7db2-413f-aebe-392cea2355bf tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] 10.222.0.57 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.665802 Jul 18 02:29:45.884833 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1609/3217] 10.222.0.57 () {60 vars in 1172 bytes} [Mon Jul 18 02:29:45 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:29:45.897299 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f6eb977f-26ce-4d84-8074-9be43b3e3a96 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Action: 'create', calling method: .version_select at 0x7ff4a85f7310>, body: {"server_group": {"name": "tempest-server-group-1481337550", "policies": ["affinity"]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:45.961210 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-f6eb977f-26ce-4d84-8074-9be43b3e3a96 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Getting quotas for project 9d3f4bddbe0e4a0a827296b21be3e901. Resources: {'server_groups'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:29:45.981153 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-f6eb977f-26ce-4d84-8074-9be43b3e3a96 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Getting quotas for user 180f08fe932e46c99c201223e7a3bef3 and project 9d3f4bddbe0e4a0a827296b21be3e901. Resources: {'server_groups'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:29:46.027953 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-cae5eb0e-dddb-4fe1-8256-669e81c3191b req-62f4dad2-a293-4e5f-8db9-b24cb803c93b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae6f4257-696a-4178-b93d-f3b42a42e073", "name": "network-vif-deleted", "tag": "e80f4a65-068f-46f3-b2aa-3ddabed941b0"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:46.086597 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-cae5eb0e-dddb-4fe1-8256-669e81c3191b req-62f4dad2-a293-4e5f-8db9-b24cb803c93b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:46.088439 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-cae5eb0e-dddb-4fe1-8256-669e81c3191b req-62f4dad2-a293-4e5f-8db9-b24cb803c93b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:46.116142 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-cae5eb0e-dddb-4fe1-8256-669e81c3191b req-62f4dad2-a293-4e5f-8db9-b24cb803c93b service nova] Creating event network-vif-deleted:e80f4a65-068f-46f3-b2aa-3ddabed941b0 for instance ae6f4257-696a-4178-b93d-f3b42a42e073 on n-h1-465891-3 Jul 18 02:29:46.131974 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-cae5eb0e-dddb-4fe1-8256-669e81c3191b req-62f4dad2-a293-4e5f-8db9-b24cb803c93b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114531 Jul 18 02:29:46.134075 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1610/3218] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:29:46.164388 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-f6eb977f-26ce-4d84-8074-9be43b3e3a96 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Getting quotas for project 9d3f4bddbe0e4a0a827296b21be3e901. Resources: {'server_groups'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:29:46.177754 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-f6eb977f-26ce-4d84-8074-9be43b3e3a96 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Getting quotas for user 180f08fe932e46c99c201223e7a3bef3 and project 9d3f4bddbe0e4a0a827296b21be3e901. Resources: {'server_groups'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:29:46.195970 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5bdc5435-5930-4696-94d8-660363e8bd10 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:46.199516 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5bdc5435-5930-4696-94d8-660363e8bd10 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] [instance: ae6f4257-696a-4178-b93d-f3b42a42e073] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:46.212050 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f6eb977f-26ce-4d84-8074-9be43b3e3a96 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] 10.222.0.57 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.319148 Jul 18 02:29:46.214958 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1609/3219] 10.222.0.57 () {60 vars in 1172 bytes} [Mon Jul 18 02:29:45 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:29:46.242489 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5bdc5435-5930-4696-94d8-660363e8bd10 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:46.242735 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5bdc5435-5930-4696-94d8-660363e8bd10 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:46.244051 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f96889b4-0e0b-474a-99ca-00deece19609 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:46.246317 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5bdc5435-5930-4696-94d8-660363e8bd10 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:46.249811 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5bdc5435-5930-4696-94d8-660363e8bd10 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:46.323383 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f96889b4-0e0b-474a-99ca-00deece19609 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] 10.222.0.57 "DELETE /compute/v2.1/os-server-groups/e6a09738-14ed-4c6c-bcfc-c69fb233e0d4" status: 204 len: 0 microversion: 2.1 time: 0.093763 Jul 18 02:29:46.324777 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1610/3220] 10.222.0.57 () {58 vars in 1265 bytes} [Mon Jul 18 02:29:46 2022] DELETE /compute/v2.1/os-server-groups/e6a09738-14ed-4c6c-bcfc-c69fb233e0d4 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:29:46.337786 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5154b29c-ddbd-44cd-b5c6-a91a1f1d16c9 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:46.369864 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5154b29c-ddbd-44cd-b5c6-a91a1f1d16c9 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] 10.222.0.57 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.038819 Jul 18 02:29:46.377321 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1611/3221] 10.222.0.57 () {58 vars in 1151 bytes} [Mon Jul 18 02:29:46 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:29:46.405939 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b07f4e4a-e3b8-4256-9cec-0170318302a0 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:46.433895 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5bdc5435-5930-4696-94d8-660363e8bd10 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:46.435165 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5bdc5435-5930-4696-94d8-660363e8bd10 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:46.436097 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-5bdc5435-5930-4696-94d8-660363e8bd10 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lazy-loading 'fault' on Instance uuid ae6f4257-696a-4178-b93d-f3b42a42e073 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:29:46.488112 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b07f4e4a-e3b8-4256-9cec-0170318302a0 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] 10.222.0.57 "DELETE /compute/v2.1/os-server-groups/114691fe-8e5b-4e89-8886-b5b5fe13cbf9" status: 204 len: 0 microversion: 2.1 time: 0.105499 Jul 18 02:29:46.489439 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1612/3222] 10.222.0.57 () {58 vars in 1265 bytes} [Mon Jul 18 02:29:46 2022] DELETE /compute/v2.1/os-server-groups/114691fe-8e5b-4e89-8886-b5b5fe13cbf9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:29:46.500140 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0191070b-7f07-4bf5-bed0-e35229be5ddd tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:46.524703 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0191070b-7f07-4bf5-bed0-e35229be5ddd tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] 10.222.0.57 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.029286 Jul 18 02:29:46.526039 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1613/3223] 10.222.0.57 () {58 vars in 1151 bytes} [Mon Jul 18 02:29:46 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:29:46.555196 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b30b574f-d23d-4560-8492-72cd8507f74a tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Action: 'create', calling method: .version_select at 0x7ff4a8324550>, body: {"server_group": {"name": "tempest-server-group-1024533862", "policies": ["affinity"]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:46.599031 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-b30b574f-d23d-4560-8492-72cd8507f74a tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Getting quotas for project 9d3f4bddbe0e4a0a827296b21be3e901. Resources: {'server_groups'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:29:46.622382 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-b30b574f-d23d-4560-8492-72cd8507f74a tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Getting quotas for user 180f08fe932e46c99c201223e7a3bef3 and project 9d3f4bddbe0e4a0a827296b21be3e901. Resources: {'server_groups'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:29:46.726396 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-b30b574f-d23d-4560-8492-72cd8507f74a tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Getting quotas for project 9d3f4bddbe0e4a0a827296b21be3e901. Resources: {'server_groups'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:29:46.739954 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-b30b574f-d23d-4560-8492-72cd8507f74a tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Getting quotas for user 180f08fe932e46c99c201223e7a3bef3 and project 9d3f4bddbe0e4a0a827296b21be3e901. Resources: {'server_groups'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:29:46.773144 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b30b574f-d23d-4560-8492-72cd8507f74a tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] 10.222.0.57 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.224738 Jul 18 02:29:46.782707 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1614/3224] 10.222.0.57 () {60 vars in 1172 bytes} [Mon Jul 18 02:29:46 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:29:46.788876 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-85ff577c-668e-4e44-8462-6105dedadacd tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:46.877045 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-85ff577c-668e-4e44-8462-6105dedadacd tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] 10.222.0.57 "DELETE /compute/v2.1/os-server-groups/7ac9104b-ca69-405e-8fb9-b40e33823a32" status: 204 len: 0 microversion: 2.1 time: 0.092699 Jul 18 02:29:46.878725 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1615/3225] 10.222.0.57 () {58 vars in 1265 bytes} [Mon Jul 18 02:29:46 2022] DELETE /compute/v2.1/os-server-groups/7ac9104b-ca69-405e-8fb9-b40e33823a32 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:29:46.894158 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e1540a21-7fde-4e92-b7c4-605caa771bdb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:46.897733 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e1540a21-7fde-4e92-b7c4-605caa771bdb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:46.927259 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e1540a21-7fde-4e92-b7c4-605caa771bdb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:46.945695 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e1540a21-7fde-4e92-b7c4-605caa771bdb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:46.947913 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e1540a21-7fde-4e92-b7c4-605caa771bdb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:46.951362 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e1540a21-7fde-4e92-b7c4-605caa771bdb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:47.014738 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5bdc5435-5930-4696-94d8-660363e8bd10 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7bb0211fa4ff2a039df1bdca9fac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9edf1521569645518c75d7ba91c75133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:47.038830 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-e1540a21-7fde-4e92-b7c4-605caa771bdb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] HTTP exception thrown: Instance dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 could not be found. Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e1540a21-7fde-4e92-b7c4-605caa771bdb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Request method failure captured: Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 HTTP/1.1 Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MPYuQ4hiawr1dcWx5CpDeDUbpXL6uvpOiNsB7Seq7nE1tcdupt1hNIkef6Tqnk1mKTE2xd1Vb7sfkXhXjAuxYF6yilOzSIbxhaw5D-vQZxUL1lzq_2r24bQBMHzqw_w8hunD8p82wfj8CJyYgsF8XMJK0wTHVbG4cMIJacUYgDTa3A Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: d7ff962145954166b4c5efb0a0f1edff Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-MigrationsAdminTest-1961616525 Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d7ff962145954166b4c5efb0a0f1edff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d7ff962145954166b4c5efb0a0f1edff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d7ff962145954166b4c5efb0a0f1edff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d7ff962145954166b4c5efb0a0f1edff"}]}] Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-MigrationsAdminTest-1961616525 Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: d7ff962145954166b4c5efb0a0f1edff Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-MigrationsAdminTest-1961616525 Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-MigrationsAdminTest-1961616525-project Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: dbeea54ebc4749aba59afb60feaa6159 Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-MigrationsAdminTest-1961616525-project Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 could not be found. Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7'} Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 could not be found. Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 could not be found. Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:47.043800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:47.059041 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:47.059041 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:47.059041 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:47.059041 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:29:47.059041 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:29:47.059041 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 could not be found. Jul 18 02:29:47.059041 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:47.060080 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5bdc5435-5930-4696-94d8-660363e8bd10 tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] 10.222.0.57 "GET /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073" status: 200 len: 1306 microversion: 2.1 time: 0.874398 Jul 18 02:29:47.060297 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e1540a21-7fde-4e92-b7c4-605caa771bdb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Returning 404 to user: Instance dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:29:47.060297 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e1540a21-7fde-4e92-b7c4-605caa771bdb tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7" status: 404 len: 111 microversion: 2.1 time: 0.177903 Jul 18 02:29:47.064019 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1611/3226] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:46 2022] GET /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073 => generated 1306 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:29:47.071113 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1616/3227] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:46 2022] GET /compute/v2.1/servers/dd0898f3-efd7-4ba0-ab91-7c1f1a1ba9a7 => generated 111 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:29:47.092512 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-73f89267-f9b4-456c-b2fc-db6ea8d8e7b2 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:47.111877 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-612d48db-5fe3-445d-8133-d28d8026d613 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:47.112978 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-73f89267-f9b4-456c-b2fc-db6ea8d8e7b2 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:47.181128 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-73f89267-f9b4-456c-b2fc-db6ea8d8e7b2 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:47.183022 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-73f89267-f9b4-456c-b2fc-db6ea8d8e7b2 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:47.196764 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-73f89267-f9b4-456c-b2fc-db6ea8d8e7b2 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:47.198732 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-73f89267-f9b4-456c-b2fc-db6ea8d8e7b2 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:47.233196 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-612d48db-5fe3-445d-8133-d28d8026d613 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] 10.222.0.57 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.163784 Jul 18 02:29:47.253975 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1612/3228] 10.222.0.57 () {58 vars in 1151 bytes} [Mon Jul 18 02:29:47 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:29:47.272477 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-38eedbf8-822a-4328-a596-757643831cf0 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Action: 'create', calling method: .version_select at 0x7ff4a87a6310>, body: {"server_group": {"name": "tempest-server-group-1798022200", "policies": ["anti-affinity"]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:47.346263 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-73f89267-f9b4-456c-b2fc-db6ea8d8e7b2 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:29:47.377169 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-38eedbf8-822a-4328-a596-757643831cf0 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Getting quotas for project 9d3f4bddbe0e4a0a827296b21be3e901. Resources: {'server_groups'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:29:47.396001 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-38eedbf8-822a-4328-a596-757643831cf0 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Getting quotas for user 180f08fe932e46c99c201223e7a3bef3 and project 9d3f4bddbe0e4a0a827296b21be3e901. Resources: {'server_groups'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:29:47.525663 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-38eedbf8-822a-4328-a596-757643831cf0 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Getting quotas for project 9d3f4bddbe0e4a0a827296b21be3e901. Resources: {'server_groups'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:29:47.542908 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-38eedbf8-822a-4328-a596-757643831cf0 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Getting quotas for user 180f08fe932e46c99c201223e7a3bef3 and project 9d3f4bddbe0e4a0a827296b21be3e901. Resources: {'server_groups'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:29:47.560643 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4,nova_api:DELETE=9,nova_api:UPDATE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:47.583719 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-73f89267-f9b4-456c-b2fc-db6ea8d8e7b2 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "DELETE /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 204 len: 0 microversion: 2.1 time: 0.510403 Jul 18 02:29:47.584827 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1617/3229] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:29:47 2022] DELETE /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 0 bytes in 513 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:29:47.595163 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-28c73781-d980-4f25-a78a-6ffc5b2a495c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:47.606122 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-28c73781-d980-4f25-a78a-6ffc5b2a495c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:47.611318 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-38eedbf8-822a-4328-a596-757643831cf0 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] 10.222.0.57 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.347175 Jul 18 02:29:47.617876 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1613/3230] 10.222.0.57 () {60 vars in 1172 bytes} [Mon Jul 18 02:29:47 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:29:47.628083 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-28c73781-d980-4f25-a78a-6ffc5b2a495c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:47.630872 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b650db22-bb13-4624-ad92-da320a52f80e tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:47.634128 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-28c73781-d980-4f25-a78a-6ffc5b2a495c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:47.647995 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-28c73781-d980-4f25-a78a-6ffc5b2a495c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:47.649602 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-28c73781-d980-4f25-a78a-6ffc5b2a495c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:47.725162 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b650db22-bb13-4624-ad92-da320a52f80e tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] 10.222.0.57 "DELETE /compute/v2.1/os-server-groups/da852182-d1f9-4f92-b147-79244ba2a2b0" status: 204 len: 0 microversion: 2.1 time: 0.101736 Jul 18 02:29:47.725786 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1614/3231] 10.222.0.57 () {58 vars in 1265 bytes} [Mon Jul 18 02:29:47 2022] DELETE /compute/v2.1/os-server-groups/da852182-d1f9-4f92-b147-79244ba2a2b0 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:29:47.737164 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-54457bbd-6b1d-4c4d-97dc-1ecb9ec84e44 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:47.773537 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-54457bbd-6b1d-4c4d-97dc-1ecb9ec84e44 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] 10.222.0.57 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.041924 Jul 18 02:29:47.776962 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1615/3232] 10.222.0.57 () {58 vars in 1151 bytes} [Mon Jul 18 02:29:47 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:29:47.980462 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e7f6dfda-bd8c-40e0-9bef-833481ac7464 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1224835497", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "04043153-2a1f-4355-b0ed-1107f12b3972"}]}, "os:scheduler_hints": {"group": "dc6cf013-41f8-4c5c-8462-942704b0c5e7"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:48.067649 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-e7f6dfda-bd8c-40e0-9bef-833481ac7464 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] validate_networks() for [('04043153-2a1f-4355-b0ed-1107f12b3972', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:29:48.744948 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-28c73781-d980-4f25-a78a-6ffc5b2a495c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:48.757160 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-28c73781-d980-4f25-a78a-6ffc5b2a495c tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1468 microversion: 2.1 time: 1.166814 Jul 18 02:29:48.764466 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1618/3233] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:47 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1468 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:48.779164 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ab882be9-4926-408a-b943-b1b954a0cdaf tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:48.782657 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ab882be9-4926-408a-b943-b1b954a0cdaf tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] [instance: ae6f4257-696a-4178-b93d-f3b42a42e073] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:48.801281 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ab882be9-4926-408a-b943-b1b954a0cdaf tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:48.801969 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ab882be9-4926-408a-b943-b1b954a0cdaf tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:48.803118 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ab882be9-4926-408a-b943-b1b954a0cdaf tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:48.803694 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ab882be9-4926-408a-b943-b1b954a0cdaf tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:48.835591 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-ab882be9-4926-408a-b943-b1b954a0cdaf tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] HTTP exception thrown: Instance ae6f4257-696a-4178-b93d-f3b42a42e073 could not be found. Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ab882be9-4926-408a-b943-b1b954a0cdaf tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Request method failure captured: Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073 HTTP/1.1 Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MV0lzmvKKLmVpBCs-IaAy4BC3Vq9mJ92Th3pjz4bE3qmwbmBnxn4XUwt5zBCFggPldkiTeGfmGvXPSNHdFPnkzB9L5I3KegInUdVpaY8vh6a3HjqgH549gZtq-xFbbBuRzUA4DNXOZgEgn3KuBuxpfFvMpTdot1gYQ3ZD4D4OSr_yE Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 9edf1521569645518c75d7ba91c75133 Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServerAddressesTestJSON-984061451 Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9edf1521569645518c75d7ba91c75133"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9edf1521569645518c75d7ba91c75133"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9edf1521569645518c75d7ba91c75133"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9edf1521569645518c75d7ba91c75133"}]}] Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServerAddressesTestJSON-984061451 Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 9edf1521569645518c75d7ba91c75133 Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServerAddressesTestJSON-984061451 Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServerAddressesTestJSON-984061451-project Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 9fe7bb0211fa4ff2a039df1bdca9fac2 Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServerAddressesTestJSON-984061451-project Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance ae6f4257-696a-4178-b93d-f3b42a42e073 could not be found. Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'ae6f4257-696a-4178-b93d-f3b42a42e073'} Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae6f4257-696a-4178-b93d-f3b42a42e073 could not be found. Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae6f4257-696a-4178-b93d-f3b42a42e073 could not be found. Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:48.844073 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:48.854961 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:48.854961 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:48.854961 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:48.854961 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:29:48.854961 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:29:48.854961 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae6f4257-696a-4178-b93d-f3b42a42e073 could not be found. Jul 18 02:29:48.854961 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:29:48.854961 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ab882be9-4926-408a-b943-b1b954a0cdaf tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] Returning 404 to user: Instance ae6f4257-696a-4178-b93d-f3b42a42e073 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:29:48.854961 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ab882be9-4926-408a-b943-b1b954a0cdaf tempest-ServerAddressesTestJSON-984061451 tempest-ServerAddressesTestJSON-984061451-project] 10.222.0.57 "GET /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073" status: 404 len: 111 microversion: 2.1 time: 0.080405 Jul 18 02:29:48.862145 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1619/3234] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:48 2022] GET /compute/v2.1/servers/ae6f4257-696a-4178-b93d-f3b42a42e073 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:29:49.779383 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-69f0c4e1-430e-4812-974d-f96ee6b2d3dd tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:49.780699 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-69f0c4e1-430e-4812-974d-f96ee6b2d3dd tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:49.811486 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69f0c4e1-430e-4812-974d-f96ee6b2d3dd tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:49.812309 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69f0c4e1-430e-4812-974d-f96ee6b2d3dd tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:49.813384 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69f0c4e1-430e-4812-974d-f96ee6b2d3dd tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:49.814198 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69f0c4e1-430e-4812-974d-f96ee6b2d3dd tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:51.036947 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-69f0c4e1-430e-4812-974d-f96ee6b2d3dd tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:51.050583 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-69f0c4e1-430e-4812-974d-f96ee6b2d3dd tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1468 microversion: 2.1 time: 1.274681 Jul 18 02:29:51.051211 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1620/3235] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:49 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1468 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:29:51.576776 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-e7f6dfda-bd8c-40e0-9bef-833481ac7464 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:29:51.581583 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-e7f6dfda-bd8c-40e0-9bef-833481ac7464 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:29:51.583040 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-e7f6dfda-bd8c-40e0-9bef-833481ac7464 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:29:51.585023 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-e7f6dfda-bd8c-40e0-9bef-833481ac7464 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:29:51.586706 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-e7f6dfda-bd8c-40e0-9bef-833481ac7464 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:29:51.700608 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e7f6dfda-bd8c-40e0-9bef-833481ac7464 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:51.701074 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e7f6dfda-bd8c-40e0-9bef-833481ac7464 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:51.705307 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e7f6dfda-bd8c-40e0-9bef-833481ac7464 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:51.706002 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e7f6dfda-bd8c-40e0-9bef-833481ac7464 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:51.803644 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-e7f6dfda-bd8c-40e0-9bef-833481ac7464 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Getting quotas for project 9d3f4bddbe0e4a0a827296b21be3e901. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:29:51.823986 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-e7f6dfda-bd8c-40e0-9bef-833481ac7464 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Getting quotas for user 180f08fe932e46c99c201223e7a3bef3 and project 9d3f4bddbe0e4a0a827296b21be3e901. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:29:51.882029 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-4f5a6837-8eea-4f10-a981-fc6c724cd1d0 req-bfaf2bc2-d865-45b4-9fa0-4939868db7fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67029c55-03b9-4f19-bf3d-b54f1998ebae", "name": "network-vif-deleted", "tag": "35c7791f-4eef-441a-884d-d3eed4376b4f"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:51.905929 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-4f5a6837-8eea-4f10-a981-fc6c724cd1d0 req-bfaf2bc2-d865-45b4-9fa0-4939868db7fb service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:51.909590 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-4f5a6837-8eea-4f10-a981-fc6c724cd1d0 req-bfaf2bc2-d865-45b4-9fa0-4939868db7fb service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:51.925694 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e7f6dfda-bd8c-40e0-9bef-833481ac7464 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:29:51.938899 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e7f6dfda-bd8c-40e0-9bef-833481ac7464 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] [instance: 64155700-5c69-4e29-bc8f-57880281bcdc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:29:51.942620 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-4f5a6837-8eea-4f10-a981-fc6c724cd1d0 req-bfaf2bc2-d865-45b4-9fa0-4939868db7fb service nova] Creating event network-vif-deleted:35c7791f-4eef-441a-884d-d3eed4376b4f for instance 67029c55-03b9-4f19-bf3d-b54f1998ebae on n-h2-465891-3 Jul 18 02:29:51.958863 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-4f5a6837-8eea-4f10-a981-fc6c724cd1d0 req-bfaf2bc2-d865-45b4-9fa0-4939868db7fb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084406 Jul 18 02:29:51.961685 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1621/3236] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:29:52.092087 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c3142045-b002-4e41-8772-e75c29c01824 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:52.093091 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c3142045-b002-4e41-8772-e75c29c01824 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:52.121939 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c3142045-b002-4e41-8772-e75c29c01824 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:52.122437 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c3142045-b002-4e41-8772-e75c29c01824 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:52.123282 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c3142045-b002-4e41-8772-e75c29c01824 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:52.123724 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c3142045-b002-4e41-8772-e75c29c01824 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:52.383814 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-e7f6dfda-bd8c-40e0-9bef-833481ac7464 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Getting quotas for project 9d3f4bddbe0e4a0a827296b21be3e901. Resources: {'server_group_members'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:29:52.407117 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-e7f6dfda-bd8c-40e0-9bef-833481ac7464 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Getting quotas for user 180f08fe932e46c99c201223e7a3bef3 and project 9d3f4bddbe0e4a0a827296b21be3e901. Resources: {'server_group_members'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:29:52.524907 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=8,nova_api:DELETE=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:52.622203 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-e7f6dfda-bd8c-40e0-9bef-833481ac7464 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Getting quotas for project 9d3f4bddbe0e4a0a827296b21be3e901. Resources: {'server_group_members'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:29:52.634745 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-e7f6dfda-bd8c-40e0-9bef-833481ac7464 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Getting quotas for user 180f08fe932e46c99c201223e7a3bef3 and project 9d3f4bddbe0e4a0a827296b21be3e901. Resources: {'server_group_members'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:29:52.683885 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c3142045-b002-4e41-8772-e75c29c01824 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeea54ebc4749aba59afb60feaa6159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ff962145954166b4c5efb0a0f1edff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:52.716537 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c3142045-b002-4e41-8772-e75c29c01824 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 200 len: 1298 microversion: 2.1 time: 0.629102 Jul 18 02:29:52.719263 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1622/3237] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:52 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 1298 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:52.733011 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e7f6dfda-bd8c-40e0-9bef-833481ac7464 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.757003 Jul 18 02:29:52.736666 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1616/3238] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:29:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 4762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 02:29:52.753084 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-beeb607c-6972-4421-af3e-270f166bcaa8 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:52.754113 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-beeb607c-6972-4421-af3e-270f166bcaa8 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] [instance: 64155700-5c69-4e29-bc8f-57880281bcdc] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:52.975835 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-beeb607c-6972-4421-af3e-270f166bcaa8 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180f08fe932e46c99c201223e7a3bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3f4bddbe0e4a0a827296b21be3e901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:52.987475 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-beeb607c-6972-4421-af3e-270f166bcaa8 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] 10.222.0.57 "GET /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc" status: 200 len: 1213 microversion: 2.1 time: 0.240544 Jul 18 02:29:52.988222 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1623/3239] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:52 2022] GET /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc => generated 1213 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:53.740479 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fac1536e-6e1d-45f3-8b2a-cdb02ec80c54 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:53.741412 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fac1536e-6e1d-45f3-8b2a-cdb02ec80c54 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] [instance: 67029c55-03b9-4f19-bf3d-b54f1998ebae] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:53.757754 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fac1536e-6e1d-45f3-8b2a-cdb02ec80c54 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:53.759140 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fac1536e-6e1d-45f3-8b2a-cdb02ec80c54 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:53.762852 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fac1536e-6e1d-45f3-8b2a-cdb02ec80c54 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:53.763909 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fac1536e-6e1d-45f3-8b2a-cdb02ec80c54 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:53.827603 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-fac1536e-6e1d-45f3-8b2a-cdb02ec80c54 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] HTTP exception thrown: Instance 67029c55-03b9-4f19-bf3d-b54f1998ebae could not be found. Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fac1536e-6e1d-45f3-8b2a-cdb02ec80c54 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Request method failure captured: Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae HTTP/1.1 Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MPYuQ4hiawr1dcWx5CpDeDUbpXL6uvpOiNsB7Seq7nE1tcdupt1hNIkef6Tqnk1mKTE2xd1Vb7sfkXhXjAuxYF6yilOzSIbxhaw5D-vQZxUL1lzq_2r24bQBMHzqw_w8hunD8p82wfj8CJyYgsF8XMJK0wTHVbG4cMIJacUYgDTa3A Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: d7ff962145954166b4c5efb0a0f1edff Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-MigrationsAdminTest-1961616525 Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d7ff962145954166b4c5efb0a0f1edff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d7ff962145954166b4c5efb0a0f1edff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d7ff962145954166b4c5efb0a0f1edff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d7ff962145954166b4c5efb0a0f1edff"}]}] Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-MigrationsAdminTest-1961616525 Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: d7ff962145954166b4c5efb0a0f1edff Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-MigrationsAdminTest-1961616525 Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-MigrationsAdminTest-1961616525-project Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: dbeea54ebc4749aba59afb60feaa6159 Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-MigrationsAdminTest-1961616525-project Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 67029c55-03b9-4f19-bf3d-b54f1998ebae could not be found. Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '67029c55-03b9-4f19-bf3d-b54f1998ebae'} Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67029c55-03b9-4f19-bf3d-b54f1998ebae could not be found. Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67029c55-03b9-4f19-bf3d-b54f1998ebae could not be found. Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:53.831659 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:53.838120 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:53.838120 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:53.838120 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:53.838120 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:29:53.838120 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:29:53.838120 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67029c55-03b9-4f19-bf3d-b54f1998ebae could not be found. Jul 18 02:29:53.838120 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:29:53.840464 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fac1536e-6e1d-45f3-8b2a-cdb02ec80c54 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] Returning 404 to user: Instance 67029c55-03b9-4f19-bf3d-b54f1998ebae could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:29:53.841690 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fac1536e-6e1d-45f3-8b2a-cdb02ec80c54 tempest-MigrationsAdminTest-1961616525 tempest-MigrationsAdminTest-1961616525-project] 10.222.0.57 "GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae" status: 404 len: 111 microversion: 2.1 time: 0.107849 Jul 18 02:29:53.843042 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1617/3240] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:53 2022] GET /compute/v2.1/servers/67029c55-03b9-4f19-bf3d-b54f1998ebae => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:29:54.020925 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f7d4ad18-6ab8-4bfc-b5f4-4144c279046d tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:54.024574 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f7d4ad18-6ab8-4bfc-b5f4-4144c279046d tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] [instance: 64155700-5c69-4e29-bc8f-57880281bcdc] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:54.082759 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f7d4ad18-6ab8-4bfc-b5f4-4144c279046d tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:54.083490 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f7d4ad18-6ab8-4bfc-b5f4-4144c279046d tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:54.088615 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f7d4ad18-6ab8-4bfc-b5f4-4144c279046d tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:54.091260 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f7d4ad18-6ab8-4bfc-b5f4-4144c279046d tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:54.613609 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f7d4ad18-6ab8-4bfc-b5f4-4144c279046d tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180f08fe932e46c99c201223e7a3bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3f4bddbe0e4a0a827296b21be3e901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:54.624871 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f7d4ad18-6ab8-4bfc-b5f4-4144c279046d tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] 10.222.0.57 "GET /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc" status: 200 len: 1265 microversion: 2.1 time: 0.613468 Jul 18 02:29:54.642532 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1624/3241] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:54 2022] GET /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc => generated 1265 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:55.650642 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-85268ce4-115b-4af7-9229-81abe8b0c481 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:55.651805 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-85268ce4-115b-4af7-9229-81abe8b0c481 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] [instance: 64155700-5c69-4e29-bc8f-57880281bcdc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:55.680589 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85268ce4-115b-4af7-9229-81abe8b0c481 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:55.685172 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85268ce4-115b-4af7-9229-81abe8b0c481 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:55.687205 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85268ce4-115b-4af7-9229-81abe8b0c481 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:55.692719 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85268ce4-115b-4af7-9229-81abe8b0c481 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:55.964143 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-85268ce4-115b-4af7-9229-81abe8b0c481 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180f08fe932e46c99c201223e7a3bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3f4bddbe0e4a0a827296b21be3e901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:55.982552 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-85268ce4-115b-4af7-9229-81abe8b0c481 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] 10.222.0.57 "GET /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc" status: 200 len: 1271 microversion: 2.1 time: 0.339571 Jul 18 02:29:55.983164 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1618/3242] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:55 2022] GET /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc => generated 1271 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:57.018236 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a8dcac12-8c5c-4140-9154-2371704dd954 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:57.018236 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a8dcac12-8c5c-4140-9154-2371704dd954 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] [instance: 64155700-5c69-4e29-bc8f-57880281bcdc] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:57.025387 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a8dcac12-8c5c-4140-9154-2371704dd954 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:57.025882 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a8dcac12-8c5c-4140-9154-2371704dd954 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:57.026685 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a8dcac12-8c5c-4140-9154-2371704dd954 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:57.027127 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a8dcac12-8c5c-4140-9154-2371704dd954 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:57.623256 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a8dcac12-8c5c-4140-9154-2371704dd954 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180f08fe932e46c99c201223e7a3bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3f4bddbe0e4a0a827296b21be3e901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:57.641280 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a8dcac12-8c5c-4140-9154-2371704dd954 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] 10.222.0.57 "GET /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc" status: 200 len: 1271 microversion: 2.1 time: 0.633074 Jul 18 02:29:57.654327 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1625/3243] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:57 2022] GET /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc => generated 1271 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:58.667645 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2d258642-3a71-4b89-ab0c-fabd951b0be1 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:58.671550 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2d258642-3a71-4b89-ab0c-fabd951b0be1 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] [instance: 64155700-5c69-4e29-bc8f-57880281bcdc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:58.702118 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2d258642-3a71-4b89-ab0c-fabd951b0be1 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:58.703393 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2d258642-3a71-4b89-ab0c-fabd951b0be1 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:58.708501 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2d258642-3a71-4b89-ab0c-fabd951b0be1 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:58.709847 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2d258642-3a71-4b89-ab0c-fabd951b0be1 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:59.702094 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2d258642-3a71-4b89-ab0c-fabd951b0be1 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180f08fe932e46c99c201223e7a3bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3f4bddbe0e4a0a827296b21be3e901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:59.763061 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2d258642-3a71-4b89-ab0c-fabd951b0be1 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] 10.222.0.57 "GET /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc" status: 200 len: 1313 microversion: 2.1 time: 1.105515 Jul 18 02:29:59.764472 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1619/3244] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:58 2022] GET /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc => generated 1313 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:30:00.793297 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0ddcebe4-d85b-4678-97c7-53319bbd8def tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:00.795872 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0ddcebe4-d85b-4678-97c7-53319bbd8def tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] [instance: 64155700-5c69-4e29-bc8f-57880281bcdc] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:00.829763 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0ddcebe4-d85b-4678-97c7-53319bbd8def tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:00.831169 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0ddcebe4-d85b-4678-97c7-53319bbd8def tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:00.835423 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0ddcebe4-d85b-4678-97c7-53319bbd8def tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:00.837545 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0ddcebe4-d85b-4678-97c7-53319bbd8def tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:01.939024 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0ddcebe4-d85b-4678-97c7-53319bbd8def tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180f08fe932e46c99c201223e7a3bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3f4bddbe0e4a0a827296b21be3e901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:01.954997 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0ddcebe4-d85b-4678-97c7-53319bbd8def tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] 10.222.0.57 "GET /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc" status: 200 len: 1313 microversion: 2.1 time: 1.175665 Jul 18 02:30:01.957552 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1626/3245] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:00 2022] GET /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc => generated 1313 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:02.977905 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:02.980503 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=38 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:02.992552 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5bca5ad1-7071-46b5-b5c2-2441528293a7 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:02.993193 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5bca5ad1-7071-46b5-b5c2-2441528293a7 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] [instance: 64155700-5c69-4e29-bc8f-57880281bcdc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:03.022308 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5bca5ad1-7071-46b5-b5c2-2441528293a7 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:03.022785 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5bca5ad1-7071-46b5-b5c2-2441528293a7 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:03.023690 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5bca5ad1-7071-46b5-b5c2-2441528293a7 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:03.029546 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5bca5ad1-7071-46b5-b5c2-2441528293a7 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:03.391173 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=18 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:03.753652 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6a927e23-fcd6-41ae-b0f4-338dede0790b tempest-ImagesDeleteNegativeTestJSON-2083228524 tempest-ImagesDeleteNegativeTestJSON-2083228524-project] 10.222.0.57 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.368792 Jul 18 02:30:03.754873 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1627/3246] 10.222.0.57 () {58 vars in 1127 bytes} [Mon Jul 18 02:30:03 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 18 02:30:03.765150 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-23abd5be-6f7c-4412-bc3c-ec825e675f2a tempest-ImagesDeleteNegativeTestJSON-2083228524 tempest-ImagesDeleteNegativeTestJSON-2083228524-project] Calling method '.version_select at 0x7ff4a8324a60>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:03.838188 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-23abd5be-6f7c-4412-bc3c-ec825e675f2a tempest-ImagesDeleteNegativeTestJSON-2083228524 tempest-ImagesDeleteNegativeTestJSON-2083228524-project] HTTP exception thrown: Image not found. Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-23abd5be-6f7c-4412-bc3c-ec825e675f2a tempest-ImagesDeleteNegativeTestJSON-2083228524 tempest-ImagesDeleteNegativeTestJSON-2083228524-project] Request method failure captured: Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MWrD_8nK81QXGAp9mUoitGubP3fxrRbjL2ezi22ou4RMF0EhrAMpkHgCPncMXe9lpu4BbT9s9jB5A163RqtkdhNZI4adducDKtt9SQBfCqx99bqspOc6h7AArN7TxNAM4ogq16NMJDKHzn0Rxtp3D7CRAGxPt78SSK4Wkyk521RGyo Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 1c28442ac18f48ea89e8a62f565dd950 Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2083228524 Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1c28442ac18f48ea89e8a62f565dd950"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1c28442ac18f48ea89e8a62f565dd950"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1c28442ac18f48ea89e8a62f565dd950"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1c28442ac18f48ea89e8a62f565dd950"}]}] Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2083228524 Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 1c28442ac18f48ea89e8a62f565dd950 Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2083228524 Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ImagesDeleteNegativeTestJSON-2083228524-project Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 44e681db499d454ead456ff3fa85f58d Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2083228524-project Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: exception: Image not found. Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '-1'} Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:30:03.841306 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:03.848302 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:03.848302 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:03.848302 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:30:03.848302 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:30:03.848302 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:30:03.848302 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:30:03.848302 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:30:03.848302 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:30:03.848302 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 18 02:30:03.848302 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 02:30:03.848302 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:30:03.848302 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:30:03.848302 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:03.848302 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:30:03.848302 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:03.848302 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:03.848302 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:03.848302 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:30:03.848302 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:30:03.848302 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:30:03.848302 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:30:03.848302 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-23abd5be-6f7c-4412-bc3c-ec825e675f2a tempest-ImagesDeleteNegativeTestJSON-2083228524 tempest-ImagesDeleteNegativeTestJSON-2083228524-project] Returning 404 to user: Image not found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:30:03.851326 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-23abd5be-6f7c-4412-bc3c-ec825e675f2a tempest-ImagesDeleteNegativeTestJSON-2083228524 tempest-ImagesDeleteNegativeTestJSON-2083228524-project] 10.222.0.57 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.088220 Jul 18 02:30:03.852062 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1628/3247] 10.222.0.57 () {58 vars in 1133 bytes} [Mon Jul 18 02:30:03 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:30:03.890311 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9028f4d4-3e41-4849-9f05-da4c27854ff5 tempest-ImagesDeleteNegativeTestJSON-2083228524 tempest-ImagesDeleteNegativeTestJSON-2083228524-project] Calling method '.version_select at 0x7ff4a8256040>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:03.928948 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-9028f4d4-3e41-4849-9f05-da4c27854ff5 tempest-ImagesDeleteNegativeTestJSON-2083228524 tempest-ImagesDeleteNegativeTestJSON-2083228524-project] HTTP exception thrown: Image not found. Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9028f4d4-3e41-4849-9f05-da4c27854ff5 tempest-ImagesDeleteNegativeTestJSON-2083228524 tempest-ImagesDeleteNegativeTestJSON-2083228524-project] Request method failure captured: Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/images/17ead851-553c-4f2f-b8b0-de03c9eb91bj HTTP/1.1 Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MWrD_8nK81QXGAp9mUoitGubP3fxrRbjL2ezi22ou4RMF0EhrAMpkHgCPncMXe9lpu4BbT9s9jB5A163RqtkdhNZI4adducDKtt9SQBfCqx99bqspOc6h7AArN7TxNAM4ogq16NMJDKHzn0Rxtp3D7CRAGxPt78SSK4Wkyk521RGyo Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 1c28442ac18f48ea89e8a62f565dd950 Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2083228524 Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1c28442ac18f48ea89e8a62f565dd950"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1c28442ac18f48ea89e8a62f565dd950"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1c28442ac18f48ea89e8a62f565dd950"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1c28442ac18f48ea89e8a62f565dd950"}]}] Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2083228524 Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 1c28442ac18f48ea89e8a62f565dd950 Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2083228524 Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ImagesDeleteNegativeTestJSON-2083228524-project Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 44e681db499d454ead456ff3fa85f58d Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2083228524-project Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: exception: Image not found. Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '17ead851-553c-4f2f-b8b0-de03c9eb91bj'} Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 17ead851-553c-4f2f-b8b0-de03c9eb91bj to delete Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 17ead851-553c-4f2f-b8b0-de03c9eb91bj could not be found. Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:03.931055 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:30:03.938291 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:03.938291 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:03.938291 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:03.938291 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:30:03.938291 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:30:03.938291 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:30:03.938291 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:30:03.938291 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:30:03.938291 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:30:03.938291 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 18 02:30:03.938291 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 02:30:03.938291 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:30:03.938291 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:30:03.938291 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:03.938291 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:30:03.938291 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:03.938291 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:03.938291 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:03.938291 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:30:03.938291 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:30:03.938291 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:30:03.938291 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:30:03.943868 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9028f4d4-3e41-4849-9f05-da4c27854ff5 tempest-ImagesDeleteNegativeTestJSON-2083228524 tempest-ImagesDeleteNegativeTestJSON-2083228524-project] Returning 404 to user: Image not found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:30:03.945850 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9028f4d4-3e41-4849-9f05-da4c27854ff5 tempest-ImagesDeleteNegativeTestJSON-2083228524 tempest-ImagesDeleteNegativeTestJSON-2083228524-project] 10.222.0.57 "DELETE /compute/v2.1/images/17ead851-553c-4f2f-b8b0-de03c9eb91bj" status: 404 len: 62 microversion: 2.1 time: 0.087814 Jul 18 02:30:03.947010 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1629/3248] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:03 2022] DELETE /compute/v2.1/images/17ead851-553c-4f2f-b8b0-de03c9eb91bj => generated 62 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:30:03.957196 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8debc22c-1b0f-4627-9ae0-d46cbddad296 tempest-ImagesDeleteNegativeTestJSON-2083228524 tempest-ImagesDeleteNegativeTestJSON-2083228524-project] Calling method '.version_select at 0x7ff4a826c670>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:03.992337 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-8debc22c-1b0f-4627-9ae0-d46cbddad296 tempest-ImagesDeleteNegativeTestJSON-2083228524 tempest-ImagesDeleteNegativeTestJSON-2083228524-project] HTTP exception thrown: Image not found. Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8debc22c-1b0f-4627-9ae0-d46cbddad296 tempest-ImagesDeleteNegativeTestJSON-2083228524 tempest-ImagesDeleteNegativeTestJSON-2083228524-project] Request method failure captured: Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/images/d508ee25-30e5-4afb-b64e-70e45099d4821 HTTP/1.1 Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MWrD_8nK81QXGAp9mUoitGubP3fxrRbjL2ezi22ou4RMF0EhrAMpkHgCPncMXe9lpu4BbT9s9jB5A163RqtkdhNZI4adducDKtt9SQBfCqx99bqspOc6h7AArN7TxNAM4ogq16NMJDKHzn0Rxtp3D7CRAGxPt78SSK4Wkyk521RGyo Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 1c28442ac18f48ea89e8a62f565dd950 Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2083228524 Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1c28442ac18f48ea89e8a62f565dd950"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1c28442ac18f48ea89e8a62f565dd950"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1c28442ac18f48ea89e8a62f565dd950"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1c28442ac18f48ea89e8a62f565dd950"}]}] Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2083228524 Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 1c28442ac18f48ea89e8a62f565dd950 Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2083228524 Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ImagesDeleteNegativeTestJSON-2083228524-project Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 44e681db499d454ead456ff3fa85f58d Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2083228524-project Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: exception: Image not found. Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'd508ee25-30e5-4afb-b64e-70e45099d4821'} Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d508ee25-30e5-4afb-b64e-70e45099d4821 to delete Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d508ee25-30e5-4afb-b64e-70e45099d4821 could not be found. Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:03.994511 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:30:03.999256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:03.999256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:03.999256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:03.999256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:30:03.999256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:30:03.999256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:30:03.999256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:30:03.999256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:30:03.999256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:30:03.999256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 18 02:30:03.999256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 02:30:03.999256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:30:03.999256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:30:03.999256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:03.999256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:30:03.999256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:03.999256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:03.999256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:03.999256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:30:03.999256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:30:03.999256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:30:03.999256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:30:03.999256 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8debc22c-1b0f-4627-9ae0-d46cbddad296 tempest-ImagesDeleteNegativeTestJSON-2083228524 tempest-ImagesDeleteNegativeTestJSON-2083228524-project] Returning 404 to user: Image not found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:30:03.999256 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8debc22c-1b0f-4627-9ae0-d46cbddad296 tempest-ImagesDeleteNegativeTestJSON-2083228524 tempest-ImagesDeleteNegativeTestJSON-2083228524-project] 10.222.0.57 "DELETE /compute/v2.1/images/d508ee25-30e5-4afb-b64e-70e45099d4821" status: 404 len: 62 microversion: 2.1 time: 0.045747 Jul 18 02:30:04.003672 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1630/3249] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:30:03 2022] DELETE /compute/v2.1/images/d508ee25-30e5-4afb-b64e-70e45099d4821 => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 18 02:30:04.021978 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-50f35403-73e9-4f99-be21-037f6f6e4e83 tempest-ImagesDeleteNegativeTestJSON-2083228524 tempest-ImagesDeleteNegativeTestJSON-2083228524-project] Calling method '.version_select at 0x7ff4a826c430>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:04.060567 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-50f35403-73e9-4f99-be21-037f6f6e4e83 tempest-ImagesDeleteNegativeTestJSON-2083228524 tempest-ImagesDeleteNegativeTestJSON-2083228524-project] HTTP exception thrown: Image not found. Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-50f35403-73e9-4f99-be21-037f6f6e4e83 tempest-ImagesDeleteNegativeTestJSON-2083228524 tempest-ImagesDeleteNegativeTestJSON-2083228524-project] Request method failure captured: Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/images/tempest-invalid-1186512515 HTTP/1.1 Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MWrD_8nK81QXGAp9mUoitGubP3fxrRbjL2ezi22ou4RMF0EhrAMpkHgCPncMXe9lpu4BbT9s9jB5A163RqtkdhNZI4adducDKtt9SQBfCqx99bqspOc6h7AArN7TxNAM4ogq16NMJDKHzn0Rxtp3D7CRAGxPt78SSK4Wkyk521RGyo Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 1c28442ac18f48ea89e8a62f565dd950 Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2083228524 Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1c28442ac18f48ea89e8a62f565dd950"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1c28442ac18f48ea89e8a62f565dd950"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1c28442ac18f48ea89e8a62f565dd950"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1c28442ac18f48ea89e8a62f565dd950"}]}] Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2083228524 Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 1c28442ac18f48ea89e8a62f565dd950 Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2083228524 Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ImagesDeleteNegativeTestJSON-2083228524-project Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 44e681db499d454ead456ff3fa85f58d Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2083228524-project Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: exception: Image not found. Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'tempest-invalid-1186512515'} Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1186512515 to delete Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1186512515 could not be found. Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:30:04.062414 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:04.070827 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:04.070827 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:04.070827 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:30:04.070827 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:30:04.070827 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:30:04.070827 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:30:04.070827 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:30:04.070827 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:30:04.070827 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 18 02:30:04.070827 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 02:30:04.070827 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:30:04.070827 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:30:04.070827 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:04.070827 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:30:04.070827 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:04.070827 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:04.070827 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:04.070827 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:30:04.070827 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:30:04.070827 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:30:04.070827 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:30:04.070827 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-50f35403-73e9-4f99-be21-037f6f6e4e83 tempest-ImagesDeleteNegativeTestJSON-2083228524 tempest-ImagesDeleteNegativeTestJSON-2083228524-project] Returning 404 to user: Image not found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:30:04.070827 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-50f35403-73e9-4f99-be21-037f6f6e4e83 tempest-ImagesDeleteNegativeTestJSON-2083228524 tempest-ImagesDeleteNegativeTestJSON-2083228524-project] 10.222.0.57 "DELETE /compute/v2.1/images/tempest-invalid-1186512515" status: 404 len: 62 microversion: 2.1 time: 0.058873 Jul 18 02:30:04.070827 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1631/3250] 10.222.0.57 () {58 vars in 1205 bytes} [Mon Jul 18 02:30:04 2022] DELETE /compute/v2.1/images/tempest-invalid-1186512515 => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:30:04.079177 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-004a761e-2929-44ba-9d45-5efe827dc23c tempest-ImagesDeleteNegativeTestJSON-2083228524 tempest-ImagesDeleteNegativeTestJSON-2083228524-project] Calling method '.version_select at 0x7ff4a8ec1c10>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:04.149097 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-004a761e-2929-44ba-9d45-5efe827dc23c tempest-ImagesDeleteNegativeTestJSON-2083228524 tempest-ImagesDeleteNegativeTestJSON-2083228524-project] HTTP exception thrown: Image not found. Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-004a761e-2929-44ba-9d45-5efe827dc23c tempest-ImagesDeleteNegativeTestJSON-2083228524 tempest-ImagesDeleteNegativeTestJSON-2083228524-project] Request method failure captured: Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/images/e50aa3ed-4171-4987-823b-128851d22267 HTTP/1.1 Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MWrD_8nK81QXGAp9mUoitGubP3fxrRbjL2ezi22ou4RMF0EhrAMpkHgCPncMXe9lpu4BbT9s9jB5A163RqtkdhNZI4adducDKtt9SQBfCqx99bqspOc6h7AArN7TxNAM4ogq16NMJDKHzn0Rxtp3D7CRAGxPt78SSK4Wkyk521RGyo Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 1c28442ac18f48ea89e8a62f565dd950 Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2083228524 Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1c28442ac18f48ea89e8a62f565dd950"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1c28442ac18f48ea89e8a62f565dd950"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1c28442ac18f48ea89e8a62f565dd950"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1c28442ac18f48ea89e8a62f565dd950"}]}] Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2083228524 Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 1c28442ac18f48ea89e8a62f565dd950 Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2083228524 Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ImagesDeleteNegativeTestJSON-2083228524-project Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 44e681db499d454ead456ff3fa85f58d Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2083228524-project Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: exception: Image not found. Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'e50aa3ed-4171-4987-823b-128851d22267'} Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e50aa3ed-4171-4987-823b-128851d22267 to delete Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e50aa3ed-4171-4987-823b-128851d22267 could not be found. Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:04.153773 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:30:04.166288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:04.166288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:04.166288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:04.166288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:30:04.166288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:30:04.166288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:30:04.166288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:30:04.166288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:30:04.166288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:30:04.166288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 18 02:30:04.166288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 02:30:04.166288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:30:04.166288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:30:04.166288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:04.166288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:30:04.166288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:04.166288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:04.166288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:04.166288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:30:04.166288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:30:04.166288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:30:04.166288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:30:04.166288 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-004a761e-2929-44ba-9d45-5efe827dc23c tempest-ImagesDeleteNegativeTestJSON-2083228524 tempest-ImagesDeleteNegativeTestJSON-2083228524-project] Returning 404 to user: Image not found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:30:04.166288 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-004a761e-2929-44ba-9d45-5efe827dc23c tempest-ImagesDeleteNegativeTestJSON-2083228524 tempest-ImagesDeleteNegativeTestJSON-2083228524-project] 10.222.0.57 "DELETE /compute/v2.1/images/e50aa3ed-4171-4987-823b-128851d22267" status: 404 len: 62 microversion: 2.1 time: 0.084082 Jul 18 02:30:04.166288 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1632/3251] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:04 2022] DELETE /compute/v2.1/images/e50aa3ed-4171-4987-823b-128851d22267 => generated 62 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:30:04.769857 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5bca5ad1-7071-46b5-b5c2-2441528293a7 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180f08fe932e46c99c201223e7a3bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3f4bddbe0e4a0a827296b21be3e901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:04.787375 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5bca5ad1-7071-46b5-b5c2-2441528293a7 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] 10.222.0.57 "GET /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc" status: 200 len: 1313 microversion: 2.1 time: 1.817362 Jul 18 02:30:04.805930 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1620/3252] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:02 2022] GET /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc => generated 1313 bytes in 1837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:05.825797 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cbbde960-3aa7-459c-99b0-df06bbf1c88c tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:05.826412 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cbbde960-3aa7-459c-99b0-df06bbf1c88c tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] [instance: 64155700-5c69-4e29-bc8f-57880281bcdc] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:05.841408 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cbbde960-3aa7-459c-99b0-df06bbf1c88c tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:05.844416 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cbbde960-3aa7-459c-99b0-df06bbf1c88c tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:05.845365 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cbbde960-3aa7-459c-99b0-df06bbf1c88c tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:05.848486 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cbbde960-3aa7-459c-99b0-df06bbf1c88c tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:06.483791 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-cbbde960-3aa7-459c-99b0-df06bbf1c88c tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180f08fe932e46c99c201223e7a3bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3f4bddbe0e4a0a827296b21be3e901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:06.499129 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cbbde960-3aa7-459c-99b0-df06bbf1c88c tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] 10.222.0.57 "GET /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc" status: 200 len: 1313 microversion: 2.1 time: 0.679131 Jul 18 02:30:06.500078 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1633/3253] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:05 2022] GET /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc => generated 1313 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:07.058749 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-9142a3b1-e745-4760-b9dd-3cc258cc3acb req-1bf12d33-7dc9-4bd5-8281-ddffe8ffcaf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64155700-5c69-4e29-bc8f-57880281bcdc", "tag": "4af15836-f333-4ffe-817c-12d6b1a5c0d4"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:30:07.095023 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-9142a3b1-e745-4760-b9dd-3cc258cc3acb req-1bf12d33-7dc9-4bd5-8281-ddffe8ffcaf4 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:07.095723 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-9142a3b1-e745-4760-b9dd-3cc258cc3acb req-1bf12d33-7dc9-4bd5-8281-ddffe8ffcaf4 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:07.158704 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-9142a3b1-e745-4760-b9dd-3cc258cc3acb req-1bf12d33-7dc9-4bd5-8281-ddffe8ffcaf4 service nova] Creating event network-changed:4af15836-f333-4ffe-817c-12d6b1a5c0d4 for instance 64155700-5c69-4e29-bc8f-57880281bcdc on n-h2-465891-3 Jul 18 02:30:07.175859 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-9142a3b1-e745-4760-b9dd-3cc258cc3acb req-1bf12d33-7dc9-4bd5-8281-ddffe8ffcaf4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122845 Jul 18 02:30:07.177510 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1621/3254] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:30:07.531172 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0906b1d2-2a9d-4a87-ac19-ba3622a13325 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:07.531738 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0906b1d2-2a9d-4a87-ac19-ba3622a13325 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] [instance: 64155700-5c69-4e29-bc8f-57880281bcdc] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:07.560222 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0906b1d2-2a9d-4a87-ac19-ba3622a13325 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:07.568314 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0906b1d2-2a9d-4a87-ac19-ba3622a13325 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:07.572202 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0906b1d2-2a9d-4a87-ac19-ba3622a13325 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:07.598403 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0906b1d2-2a9d-4a87-ac19-ba3622a13325 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:10.094696 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0906b1d2-2a9d-4a87-ac19-ba3622a13325 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180f08fe932e46c99c201223e7a3bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3f4bddbe0e4a0a827296b21be3e901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:10.114932 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=95,nova_cell1:UPDATE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:10.117813 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0906b1d2-2a9d-4a87-ac19-ba3622a13325 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] 10.222.0.57 "GET /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc" status: 200 len: 1313 microversion: 2.1 time: 2.590415 Jul 18 02:30:10.118614 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1634/3255] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:07 2022] GET /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc => generated 1313 bytes in 2592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:10.193819 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f7322c3c-4e8d-4cc1-8624-c81319593fff tempest-AbsoluteLimitsTestJSON-17210949 tempest-AbsoluteLimitsTestJSON-17210949-project] Calling method '.version_select at 0x7ff4adced8b0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:10.211942 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f7322c3c-4e8d-4cc1-8624-c81319593fff tempest-AbsoluteLimitsTestJSON-17210949 tempest-AbsoluteLimitsTestJSON-17210949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:10.215343 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f7322c3c-4e8d-4cc1-8624-c81319593fff tempest-AbsoluteLimitsTestJSON-17210949 tempest-AbsoluteLimitsTestJSON-17210949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:10.216552 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f7322c3c-4e8d-4cc1-8624-c81319593fff tempest-AbsoluteLimitsTestJSON-17210949 tempest-AbsoluteLimitsTestJSON-17210949-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:10.218700 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f7322c3c-4e8d-4cc1-8624-c81319593fff tempest-AbsoluteLimitsTestJSON-17210949 tempest-AbsoluteLimitsTestJSON-17210949-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:10.246232 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:10.291196 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f7322c3c-4e8d-4cc1-8624-c81319593fff tempest-AbsoluteLimitsTestJSON-17210949 tempest-AbsoluteLimitsTestJSON-17210949-project] 10.222.0.57 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.261727 Jul 18 02:30:10.291925 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1622/3256] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Jul 18 02:30:10 2022] GET /compute/v2.1/limits => generated 511 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:30:11.150066 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-755d8f9c-7d55-4701-b52e-471d567f00c5 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:11.150683 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-755d8f9c-7d55-4701-b52e-471d567f00c5 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] [instance: 64155700-5c69-4e29-bc8f-57880281bcdc] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:11.168482 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-755d8f9c-7d55-4701-b52e-471d567f00c5 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:11.169079 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-755d8f9c-7d55-4701-b52e-471d567f00c5 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:11.175398 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-755d8f9c-7d55-4701-b52e-471d567f00c5 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:11.176459 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-755d8f9c-7d55-4701-b52e-471d567f00c5 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:13.381396 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-755d8f9c-7d55-4701-b52e-471d567f00c5 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180f08fe932e46c99c201223e7a3bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3f4bddbe0e4a0a827296b21be3e901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:13.430737 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-755d8f9c-7d55-4701-b52e-471d567f00c5 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] 10.222.0.57 "GET /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc" status: 200 len: 1313 microversion: 2.1 time: 2.284007 Jul 18 02:30:13.434718 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1635/3257] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:11 2022] GET /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc => generated 1313 bytes in 2289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:14.466919 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-082a31e8-ed1f-4d44-8de5-b8969350c676 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:14.468497 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-082a31e8-ed1f-4d44-8de5-b8969350c676 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] [instance: 64155700-5c69-4e29-bc8f-57880281bcdc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:14.492461 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-082a31e8-ed1f-4d44-8de5-b8969350c676 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:14.501667 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-082a31e8-ed1f-4d44-8de5-b8969350c676 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:14.506336 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-082a31e8-ed1f-4d44-8de5-b8969350c676 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:14.507257 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-082a31e8-ed1f-4d44-8de5-b8969350c676 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:15.641913 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-082a31e8-ed1f-4d44-8de5-b8969350c676 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180f08fe932e46c99c201223e7a3bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3f4bddbe0e4a0a827296b21be3e901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:15.673638 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-082a31e8-ed1f-4d44-8de5-b8969350c676 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] 10.222.0.57 "GET /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc" status: 200 len: 1313 microversion: 2.1 time: 1.212859 Jul 18 02:30:15.708292 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1623/3258] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:14 2022] GET /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc => generated 1313 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:30:16.726313 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5affeb77-6fdf-429f-95e3-d6c2c7941462 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:16.728799 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5affeb77-6fdf-429f-95e3-d6c2c7941462 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] [instance: 64155700-5c69-4e29-bc8f-57880281bcdc] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:16.743939 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5affeb77-6fdf-429f-95e3-d6c2c7941462 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:16.745349 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5affeb77-6fdf-429f-95e3-d6c2c7941462 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:16.747296 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5affeb77-6fdf-429f-95e3-d6c2c7941462 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:16.748420 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5affeb77-6fdf-429f-95e3-d6c2c7941462 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:18.420966 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5affeb77-6fdf-429f-95e3-d6c2c7941462 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180f08fe932e46c99c201223e7a3bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3f4bddbe0e4a0a827296b21be3e901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:18.452680 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5affeb77-6fdf-429f-95e3-d6c2c7941462 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] 10.222.0.57 "GET /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc" status: 200 len: 1313 microversion: 2.1 time: 1.745031 Jul 18 02:30:18.457674 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1636/3259] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:16 2022] GET /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc => generated 1313 bytes in 1754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:18.509482 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-f844f5a4-19f0-4e08-a9ae-677b6e64b733 req-d9eb21c7-4361-4b4e-b4d2-db7f2352fabf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64155700-5c69-4e29-bc8f-57880281bcdc", "name": "network-vif-plugged", "status": "completed", "tag": "4af15836-f333-4ffe-817c-12d6b1a5c0d4"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:30:18.546871 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-f844f5a4-19f0-4e08-a9ae-677b6e64b733 req-d9eb21c7-4361-4b4e-b4d2-db7f2352fabf service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:18.547738 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-f844f5a4-19f0-4e08-a9ae-677b6e64b733 req-d9eb21c7-4361-4b4e-b4d2-db7f2352fabf service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:18.614307 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-f844f5a4-19f0-4e08-a9ae-677b6e64b733 req-d9eb21c7-4361-4b4e-b4d2-db7f2352fabf service nova] Creating event network-vif-plugged:4af15836-f333-4ffe-817c-12d6b1a5c0d4 for instance 64155700-5c69-4e29-bc8f-57880281bcdc on n-h2-465891-3 Jul 18 02:30:18.686004 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-f844f5a4-19f0-4e08-a9ae-677b6e64b733 req-d9eb21c7-4361-4b4e-b4d2-db7f2352fabf service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179588 Jul 18 02:30:18.762311 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1624/3260] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:30:19.475420 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2bc459e8-6f91-441e-be62-263b192189b9 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:19.477171 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2bc459e8-6f91-441e-be62-263b192189b9 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] [instance: 64155700-5c69-4e29-bc8f-57880281bcdc] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:19.480665 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=30 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:19.518763 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2bc459e8-6f91-441e-be62-263b192189b9 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:19.520968 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2bc459e8-6f91-441e-be62-263b192189b9 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:19.522936 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2bc459e8-6f91-441e-be62-263b192189b9 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:19.526213 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2bc459e8-6f91-441e-be62-263b192189b9 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:20.796144 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2bc459e8-6f91-441e-be62-263b192189b9 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180f08fe932e46c99c201223e7a3bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3f4bddbe0e4a0a827296b21be3e901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:20.844870 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2bc459e8-6f91-441e-be62-263b192189b9 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] 10.222.0.57 "GET /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc" status: 200 len: 1313 microversion: 2.1 time: 1.370951 Jul 18 02:30:20.860903 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1637/3261] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:19 2022] GET /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc => generated 1313 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:21.864651 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-15984772-8d96-4d02-9271-8b93e4b21560 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:21.866078 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-15984772-8d96-4d02-9271-8b93e4b21560 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] [instance: 64155700-5c69-4e29-bc8f-57880281bcdc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:21.883792 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:21.891090 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:21.903201 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-15984772-8d96-4d02-9271-8b93e4b21560 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:21.903670 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-15984772-8d96-4d02-9271-8b93e4b21560 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:21.904505 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-15984772-8d96-4d02-9271-8b93e4b21560 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:21.904956 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-15984772-8d96-4d02-9271-8b93e4b21560 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:23.262118 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-15984772-8d96-4d02-9271-8b93e4b21560 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180f08fe932e46c99c201223e7a3bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3f4bddbe0e4a0a827296b21be3e901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:23.297790 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-15984772-8d96-4d02-9271-8b93e4b21560 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] 10.222.0.57 "GET /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc" status: 200 len: 1499 microversion: 2.1 time: 1.439221 Jul 18 02:30:23.298721 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1625/3262] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:21 2022] GET /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc => generated 1499 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:23.345529 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d663120d-e5a8-4240-aa88-90020cc4ea63 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:23.404330 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.compute.server_groups [None req-d663120d-e5a8-4240-aa88-90020cc4ea63 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Querying cell 2a4b42c4-bf71-4fae-804a-3632602c55fa(cell1) for 1 instances {{(pid=119544) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 18 02:30:23.407926 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d663120d-e5a8-4240-aa88-90020cc4ea63 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:23.409274 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d663120d-e5a8-4240-aa88-90020cc4ea63 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:23.463378 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d663120d-e5a8-4240-aa88-90020cc4ea63 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] 10.222.0.57 "GET /compute/v2.1/os-server-groups/dc6cf013-41f8-4c5c-8462-942704b0c5e7" status: 200 len: 222 microversion: 2.1 time: 0.137729 Jul 18 02:30:23.486791 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b7dfde5b-c212-427a-8f1f-13fd80dce67b tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:23.488198 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b7dfde5b-c212-427a-8f1f-13fd80dce67b tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] [instance: 64155700-5c69-4e29-bc8f-57880281bcdc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:23.490508 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1638/3263] 10.222.0.57 () {58 vars in 1262 bytes} [Mon Jul 18 02:30:23 2022] GET /compute/v2.1/os-server-groups/dc6cf013-41f8-4c5c-8462-942704b0c5e7 => generated 222 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:30:23.492700 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=31 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:23.508346 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b7dfde5b-c212-427a-8f1f-13fd80dce67b tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:23.514532 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b7dfde5b-c212-427a-8f1f-13fd80dce67b tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:23.516924 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b7dfde5b-c212-427a-8f1f-13fd80dce67b tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:23.518858 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b7dfde5b-c212-427a-8f1f-13fd80dce67b tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:23.681854 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b7dfde5b-c212-427a-8f1f-13fd80dce67b tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] [instance: 64155700-5c69-4e29-bc8f-57880281bcdc] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:30:24.088436 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b7dfde5b-c212-427a-8f1f-13fd80dce67b tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] 10.222.0.57 "DELETE /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc" status: 204 len: 0 microversion: 2.1 time: 0.608815 Jul 18 02:30:24.092980 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1626/3264] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:30:23 2022] DELETE /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc => generated 0 bytes in 615 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:30:24.106908 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2fe38958-aee3-463b-9d31-8e46e085cdcb tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:24.117231 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2fe38958-aee3-463b-9d31-8e46e085cdcb tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] [instance: 64155700-5c69-4e29-bc8f-57880281bcdc] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:24.139412 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2fe38958-aee3-463b-9d31-8e46e085cdcb tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:24.147634 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2fe38958-aee3-463b-9d31-8e46e085cdcb tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:24.149560 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2fe38958-aee3-463b-9d31-8e46e085cdcb tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:24.150672 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2fe38958-aee3-463b-9d31-8e46e085cdcb tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:26.118006 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2fe38958-aee3-463b-9d31-8e46e085cdcb tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180f08fe932e46c99c201223e7a3bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3f4bddbe0e4a0a827296b21be3e901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:26.135972 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2fe38958-aee3-463b-9d31-8e46e085cdcb tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] 10.222.0.57 "GET /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc" status: 200 len: 1505 microversion: 2.1 time: 2.037812 Jul 18 02:30:26.144951 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1639/3265] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:24 2022] GET /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc => generated 1505 bytes in 2048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:27.208856 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-593c279b-35ef-4547-a076-23470d4715de tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:27.210407 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-593c279b-35ef-4547-a076-23470d4715de tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] [instance: 64155700-5c69-4e29-bc8f-57880281bcdc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:27.254398 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-593c279b-35ef-4547-a076-23470d4715de tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:27.261491 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-593c279b-35ef-4547-a076-23470d4715de tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:27.263723 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-593c279b-35ef-4547-a076-23470d4715de tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:27.271692 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-593c279b-35ef-4547-a076-23470d4715de tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:27.464114 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-be0a1f22-4941-4b18-8d9c-8ac12dd8bfae tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-822420387", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "3b74ff8d-abc9-4452-b9d6-b62aa575bedc"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:30:27.664782 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-be0a1f22-4941-4b18-8d9c-8ac12dd8bfae tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] validate_networks() for [('3b74ff8d-abc9-4452-b9d6-b62aa575bedc', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:30:30.094385 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-593c279b-35ef-4547-a076-23470d4715de tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180f08fe932e46c99c201223e7a3bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3f4bddbe0e4a0a827296b21be3e901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:30.109781 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-593c279b-35ef-4547-a076-23470d4715de tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] 10.222.0.57 "GET /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc" status: 200 len: 1505 microversion: 2.1 time: 2.949519 Jul 18 02:30:30.110726 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1627/3266] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:27 2022] GET /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc => generated 1505 bytes in 2952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:30.124159 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-8a4780ef-3aa3-4423-a57f-9698fe239009 req-94d1a6a4-066e-478a-8b6c-8b24af340cfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64155700-5c69-4e29-bc8f-57880281bcdc", "name": "network-vif-deleted", "tag": "4af15836-f333-4ffe-817c-12d6b1a5c0d4"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:30:30.186533 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-8a4780ef-3aa3-4423-a57f-9698fe239009 req-94d1a6a4-066e-478a-8b6c-8b24af340cfb service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:30.187333 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-8a4780ef-3aa3-4423-a57f-9698fe239009 req-94d1a6a4-066e-478a-8b6c-8b24af340cfb service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:30.212558 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-8a4780ef-3aa3-4423-a57f-9698fe239009 req-94d1a6a4-066e-478a-8b6c-8b24af340cfb service nova] Creating event network-vif-deleted:4af15836-f333-4ffe-817c-12d6b1a5c0d4 for instance 64155700-5c69-4e29-bc8f-57880281bcdc on n-h2-465891-3 Jul 18 02:30:30.222096 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-8a4780ef-3aa3-4423-a57f-9698fe239009 req-94d1a6a4-066e-478a-8b6c-8b24af340cfb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109837 Jul 18 02:30:30.227979 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1628/3267] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:30:31.134774 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cb29544c-a66a-441e-9076-a7c6bd9fd91f tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:31.138184 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cb29544c-a66a-441e-9076-a7c6bd9fd91f tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] [instance: 64155700-5c69-4e29-bc8f-57880281bcdc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:31.157216 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cb29544c-a66a-441e-9076-a7c6bd9fd91f tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:31.164243 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cb29544c-a66a-441e-9076-a7c6bd9fd91f tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:31.168006 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cb29544c-a66a-441e-9076-a7c6bd9fd91f tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:31.169314 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cb29544c-a66a-441e-9076-a7c6bd9fd91f tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:31.216174 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-cb29544c-a66a-441e-9076-a7c6bd9fd91f tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] HTTP exception thrown: Instance 64155700-5c69-4e29-bc8f-57880281bcdc could not be found. Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cb29544c-a66a-441e-9076-a7c6bd9fd91f tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Request method failure captured: Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc HTTP/1.1 Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MWX-NkU0bT1l88HB5UORHU-hiiBrVF7mcMEF4MMcsurfzXqNaZOZMPODW_ggeXOteCDUF---3DTqZd615u8cQ9Lv8vvKrdG2X3EPDYMFnLKN-dsxLS6mU-9Gx8PD8EEveJ9gkXzr9pyPj9YfjHW0kYhF24U3Nax5xCeqCnroEtVA60 Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 9d3f4bddbe0e4a0a827296b21be3e901 Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServerGroupTestJSON-886764110 Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9d3f4bddbe0e4a0a827296b21be3e901"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9d3f4bddbe0e4a0a827296b21be3e901"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9d3f4bddbe0e4a0a827296b21be3e901"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9d3f4bddbe0e4a0a827296b21be3e901"}]}] Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServerGroupTestJSON-886764110 Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 9d3f4bddbe0e4a0a827296b21be3e901 Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServerGroupTestJSON-886764110 Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServerGroupTestJSON-886764110-project Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 180f08fe932e46c99c201223e7a3bef3 Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServerGroupTestJSON-886764110-project Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 64155700-5c69-4e29-bc8f-57880281bcdc could not be found. Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '64155700-5c69-4e29-bc8f-57880281bcdc'} Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64155700-5c69-4e29-bc8f-57880281bcdc could not be found. Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64155700-5c69-4e29-bc8f-57880281bcdc could not be found. Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:31.224641 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:30:31.230255 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:31.230255 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:31.230255 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:31.230255 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:30:31.230255 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:30:31.230255 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64155700-5c69-4e29-bc8f-57880281bcdc could not be found. Jul 18 02:30:31.230255 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:30:31.230255 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cb29544c-a66a-441e-9076-a7c6bd9fd91f tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Returning 404 to user: Instance 64155700-5c69-4e29-bc8f-57880281bcdc could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:30:31.230255 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cb29544c-a66a-441e-9076-a7c6bd9fd91f tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] 10.222.0.57 "GET /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc" status: 404 len: 111 microversion: 2.1 time: 0.101490 Jul 18 02:30:31.230255 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1629/3268] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:31 2022] GET /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:30:31.249345 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1e72f09b-0db6-4cde-b4a2-3f1eb9625dcc tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:31.278047 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.compute.server_groups [None req-1e72f09b-0db6-4cde-b4a2-3f1eb9625dcc tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Querying cell 2a4b42c4-bf71-4fae-804a-3632602c55fa(cell1) for 1 instances {{(pid=119543) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 18 02:30:31.279478 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1e72f09b-0db6-4cde-b4a2-3f1eb9625dcc tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:31.280418 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1e72f09b-0db6-4cde-b4a2-3f1eb9625dcc tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:31.303142 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1e72f09b-0db6-4cde-b4a2-3f1eb9625dcc tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] 10.222.0.57 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.058843 Jul 18 02:30:31.318425 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1630/3269] 10.222.0.57 () {58 vars in 1151 bytes} [Mon Jul 18 02:30:31 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:30:31.336910 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b20987c4-00f0-489d-9225-ac258c91b494 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:31.443655 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.compute.server_groups [None req-b20987c4-00f0-489d-9225-ac258c91b494 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Querying cell 2a4b42c4-bf71-4fae-804a-3632602c55fa(cell1) for 1 instances {{(pid=119543) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 18 02:30:31.450240 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b20987c4-00f0-489d-9225-ac258c91b494 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:31.451302 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b20987c4-00f0-489d-9225-ac258c91b494 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:31.560819 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b20987c4-00f0-489d-9225-ac258c91b494 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] 10.222.0.57 "GET /compute/v2.1/os-server-groups/dc6cf013-41f8-4c5c-8462-942704b0c5e7" status: 200 len: 184 microversion: 2.1 time: 0.217978 Jul 18 02:30:31.562188 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1631/3270] 10.222.0.57 () {58 vars in 1262 bytes} [Mon Jul 18 02:30:31 2022] GET /compute/v2.1/os-server-groups/dc6cf013-41f8-4c5c-8462-942704b0c5e7 => generated 184 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:30:31.587035 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1ad5df39-a61c-4b1f-a52a-01620c4a8466 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:31.589396 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1ad5df39-a61c-4b1f-a52a-01620c4a8466 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] [instance: 64155700-5c69-4e29-bc8f-57880281bcdc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:31.619729 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1ad5df39-a61c-4b1f-a52a-01620c4a8466 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:31.620619 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1ad5df39-a61c-4b1f-a52a-01620c4a8466 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:31.621726 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1ad5df39-a61c-4b1f-a52a-01620c4a8466 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:31.622671 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1ad5df39-a61c-4b1f-a52a-01620c4a8466 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:31.657258 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-1ad5df39-a61c-4b1f-a52a-01620c4a8466 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] HTTP exception thrown: Instance 64155700-5c69-4e29-bc8f-57880281bcdc could not be found. Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1ad5df39-a61c-4b1f-a52a-01620c4a8466 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Request method failure captured: Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc HTTP/1.1 Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MWX-NkU0bT1l88HB5UORHU-hiiBrVF7mcMEF4MMcsurfzXqNaZOZMPODW_ggeXOteCDUF---3DTqZd615u8cQ9Lv8vvKrdG2X3EPDYMFnLKN-dsxLS6mU-9Gx8PD8EEveJ9gkXzr9pyPj9YfjHW0kYhF24U3Nax5xCeqCnroEtVA60 Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 9d3f4bddbe0e4a0a827296b21be3e901 Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServerGroupTestJSON-886764110 Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9d3f4bddbe0e4a0a827296b21be3e901"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9d3f4bddbe0e4a0a827296b21be3e901"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9d3f4bddbe0e4a0a827296b21be3e901"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9d3f4bddbe0e4a0a827296b21be3e901"}]}] Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServerGroupTestJSON-886764110 Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 9d3f4bddbe0e4a0a827296b21be3e901 Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServerGroupTestJSON-886764110 Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServerGroupTestJSON-886764110-project Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 180f08fe932e46c99c201223e7a3bef3 Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServerGroupTestJSON-886764110-project Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 64155700-5c69-4e29-bc8f-57880281bcdc could not be found. Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '64155700-5c69-4e29-bc8f-57880281bcdc'} Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64155700-5c69-4e29-bc8f-57880281bcdc could not be found. Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:30:31.673045 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64155700-5c69-4e29-bc8f-57880281bcdc could not be found. Jul 18 02:30:31.678620 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:30:31.678620 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:31.678620 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:30:31.678620 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:31.678620 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:31.678620 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:31.678620 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:30:31.678620 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:30:31.678620 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64155700-5c69-4e29-bc8f-57880281bcdc could not be found. Jul 18 02:30:31.678620 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:30:31.685373 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1ad5df39-a61c-4b1f-a52a-01620c4a8466 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Returning 404 to user: Instance 64155700-5c69-4e29-bc8f-57880281bcdc could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:30:31.685373 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1ad5df39-a61c-4b1f-a52a-01620c4a8466 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] 10.222.0.57 "DELETE /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc" status: 404 len: 111 microversion: 2.1 time: 0.108007 Jul 18 02:30:31.690317 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1632/3271] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:30:31 2022] DELETE /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:30:31.695583 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d137068d-454f-48fd-a98a-4c085d9927ee tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:31.701344 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d137068d-454f-48fd-a98a-4c085d9927ee tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] [instance: 64155700-5c69-4e29-bc8f-57880281bcdc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:31.717565 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d137068d-454f-48fd-a98a-4c085d9927ee tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:31.718310 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d137068d-454f-48fd-a98a-4c085d9927ee tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:31.720680 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d137068d-454f-48fd-a98a-4c085d9927ee tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:31.721298 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d137068d-454f-48fd-a98a-4c085d9927ee tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:31.759778 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-d137068d-454f-48fd-a98a-4c085d9927ee tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] HTTP exception thrown: Instance 64155700-5c69-4e29-bc8f-57880281bcdc could not be found. Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d137068d-454f-48fd-a98a-4c085d9927ee tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Request method failure captured: Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc HTTP/1.1 Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MWX-NkU0bT1l88HB5UORHU-hiiBrVF7mcMEF4MMcsurfzXqNaZOZMPODW_ggeXOteCDUF---3DTqZd615u8cQ9Lv8vvKrdG2X3EPDYMFnLKN-dsxLS6mU-9Gx8PD8EEveJ9gkXzr9pyPj9YfjHW0kYhF24U3Nax5xCeqCnroEtVA60 Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 9d3f4bddbe0e4a0a827296b21be3e901 Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServerGroupTestJSON-886764110 Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9d3f4bddbe0e4a0a827296b21be3e901"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9d3f4bddbe0e4a0a827296b21be3e901"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9d3f4bddbe0e4a0a827296b21be3e901"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9d3f4bddbe0e4a0a827296b21be3e901"}]}] Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServerGroupTestJSON-886764110 Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 9d3f4bddbe0e4a0a827296b21be3e901 Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServerGroupTestJSON-886764110 Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServerGroupTestJSON-886764110-project Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 180f08fe932e46c99c201223e7a3bef3 Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServerGroupTestJSON-886764110-project Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 64155700-5c69-4e29-bc8f-57880281bcdc could not be found. Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '64155700-5c69-4e29-bc8f-57880281bcdc'} Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64155700-5c69-4e29-bc8f-57880281bcdc could not be found. Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64155700-5c69-4e29-bc8f-57880281bcdc could not be found. Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:31.772831 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:30:31.784244 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:31.784244 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:31.784244 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:31.784244 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:30:31.784244 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:30:31.784244 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64155700-5c69-4e29-bc8f-57880281bcdc could not be found. Jul 18 02:30:31.784244 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:30:31.784244 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d137068d-454f-48fd-a98a-4c085d9927ee tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Returning 404 to user: Instance 64155700-5c69-4e29-bc8f-57880281bcdc could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:30:31.785564 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d137068d-454f-48fd-a98a-4c085d9927ee tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] 10.222.0.57 "GET /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc" status: 404 len: 111 microversion: 2.1 time: 0.093251 Jul 18 02:30:31.791370 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1633/3272] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:31 2022] GET /compute/v2.1/servers/64155700-5c69-4e29-bc8f-57880281bcdc => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:30:31.814562 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6d143048-7fff-4339-a414-ce7464f2adc5 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:31.831310 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-6d143048-7fff-4339-a414-ce7464f2adc5 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] HTTP exception thrown: Instance group da852182-d1f9-4f92-b147-79244ba2a2b0 could not be found. Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6d143048-7fff-4339-a414-ce7464f2adc5 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Request method failure captured: Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/os-server-groups/da852182-d1f9-4f92-b147-79244ba2a2b0 HTTP/1.1 Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MWX-NkU0bT1l88HB5UORHU-hiiBrVF7mcMEF4MMcsurfzXqNaZOZMPODW_ggeXOteCDUF---3DTqZd615u8cQ9Lv8vvKrdG2X3EPDYMFnLKN-dsxLS6mU-9Gx8PD8EEveJ9gkXzr9pyPj9YfjHW0kYhF24U3Nax5xCeqCnroEtVA60 Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 9d3f4bddbe0e4a0a827296b21be3e901 Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServerGroupTestJSON-886764110 Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9d3f4bddbe0e4a0a827296b21be3e901"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9d3f4bddbe0e4a0a827296b21be3e901"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9d3f4bddbe0e4a0a827296b21be3e901"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9d3f4bddbe0e4a0a827296b21be3e901"}]}] Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServerGroupTestJSON-886764110 Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 9d3f4bddbe0e4a0a827296b21be3e901 Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServerGroupTestJSON-886764110 Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServerGroupTestJSON-886764110-project Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 180f08fe932e46c99c201223e7a3bef3 Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServerGroupTestJSON-886764110-project Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance group da852182-d1f9-4f92-b147-79244ba2a2b0 could not be found. Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'da852182-d1f9-4f92-b147-79244ba2a2b0'} Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group da852182-d1f9-4f92-b147-79244ba2a2b0 could not be found. Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group da852182-d1f9-4f92-b147-79244ba2a2b0 could not be found. Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:30:31.845492 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:31.855246 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:31.855246 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:31.855246 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:30:31.855246 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:30:31.855246 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group da852182-d1f9-4f92-b147-79244ba2a2b0 could not be found. Jul 18 02:30:31.855246 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:30:31.858296 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6d143048-7fff-4339-a414-ce7464f2adc5 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Returning 404 to user: Instance group da852182-d1f9-4f92-b147-79244ba2a2b0 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:30:31.860014 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6d143048-7fff-4339-a414-ce7464f2adc5 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] 10.222.0.57 "DELETE /compute/v2.1/os-server-groups/da852182-d1f9-4f92-b147-79244ba2a2b0" status: 404 len: 117 microversion: 2.1 time: 0.067161 Jul 18 02:30:31.861247 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1634/3273] 10.222.0.57 () {58 vars in 1265 bytes} [Mon Jul 18 02:30:31 2022] DELETE /compute/v2.1/os-server-groups/da852182-d1f9-4f92-b147-79244ba2a2b0 => generated 117 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:30:31.876026 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0e45556a-2760-46f6-80ff-17bb62a923ec tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:31.960625 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-0e45556a-2760-46f6-80ff-17bb62a923ec tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] HTTP exception thrown: Instance group 7ac9104b-ca69-405e-8fb9-b40e33823a32 could not be found. Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0e45556a-2760-46f6-80ff-17bb62a923ec tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Request method failure captured: Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/os-server-groups/7ac9104b-ca69-405e-8fb9-b40e33823a32 HTTP/1.1 Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MWX-NkU0bT1l88HB5UORHU-hiiBrVF7mcMEF4MMcsurfzXqNaZOZMPODW_ggeXOteCDUF---3DTqZd615u8cQ9Lv8vvKrdG2X3EPDYMFnLKN-dsxLS6mU-9Gx8PD8EEveJ9gkXzr9pyPj9YfjHW0kYhF24U3Nax5xCeqCnroEtVA60 Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 9d3f4bddbe0e4a0a827296b21be3e901 Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServerGroupTestJSON-886764110 Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9d3f4bddbe0e4a0a827296b21be3e901"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9d3f4bddbe0e4a0a827296b21be3e901"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9d3f4bddbe0e4a0a827296b21be3e901"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9d3f4bddbe0e4a0a827296b21be3e901"}]}] Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServerGroupTestJSON-886764110 Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 9d3f4bddbe0e4a0a827296b21be3e901 Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServerGroupTestJSON-886764110 Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServerGroupTestJSON-886764110-project Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 180f08fe932e46c99c201223e7a3bef3 Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServerGroupTestJSON-886764110-project Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance group 7ac9104b-ca69-405e-8fb9-b40e33823a32 could not be found. Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '7ac9104b-ca69-405e-8fb9-b40e33823a32'} Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 7ac9104b-ca69-405e-8fb9-b40e33823a32 could not be found. Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 7ac9104b-ca69-405e-8fb9-b40e33823a32 could not be found. Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:30:31.970140 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:31.979832 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:31.979832 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:31.979832 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:30:31.979832 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:30:31.979832 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 7ac9104b-ca69-405e-8fb9-b40e33823a32 could not be found. Jul 18 02:30:31.979832 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:30:31.993380 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0e45556a-2760-46f6-80ff-17bb62a923ec tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Returning 404 to user: Instance group 7ac9104b-ca69-405e-8fb9-b40e33823a32 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:30:31.995114 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0e45556a-2760-46f6-80ff-17bb62a923ec tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] 10.222.0.57 "DELETE /compute/v2.1/os-server-groups/7ac9104b-ca69-405e-8fb9-b40e33823a32" status: 404 len: 117 microversion: 2.1 time: 0.126018 Jul 18 02:30:31.996165 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1635/3274] 10.222.0.57 () {58 vars in 1265 bytes} [Mon Jul 18 02:30:31 2022] DELETE /compute/v2.1/os-server-groups/7ac9104b-ca69-405e-8fb9-b40e33823a32 => generated 117 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:30:32.029383 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c223a07f-16ea-4887-badc-8e9ef19195df tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:32.053862 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-c223a07f-16ea-4887-badc-8e9ef19195df tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] HTTP exception thrown: Instance group 114691fe-8e5b-4e89-8886-b5b5fe13cbf9 could not be found. Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c223a07f-16ea-4887-badc-8e9ef19195df tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Request method failure captured: Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/os-server-groups/114691fe-8e5b-4e89-8886-b5b5fe13cbf9 HTTP/1.1 Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MWX-NkU0bT1l88HB5UORHU-hiiBrVF7mcMEF4MMcsurfzXqNaZOZMPODW_ggeXOteCDUF---3DTqZd615u8cQ9Lv8vvKrdG2X3EPDYMFnLKN-dsxLS6mU-9Gx8PD8EEveJ9gkXzr9pyPj9YfjHW0kYhF24U3Nax5xCeqCnroEtVA60 Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 9d3f4bddbe0e4a0a827296b21be3e901 Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServerGroupTestJSON-886764110 Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9d3f4bddbe0e4a0a827296b21be3e901"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9d3f4bddbe0e4a0a827296b21be3e901"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9d3f4bddbe0e4a0a827296b21be3e901"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9d3f4bddbe0e4a0a827296b21be3e901"}]}] Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServerGroupTestJSON-886764110 Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 9d3f4bddbe0e4a0a827296b21be3e901 Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServerGroupTestJSON-886764110 Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServerGroupTestJSON-886764110-project Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 180f08fe932e46c99c201223e7a3bef3 Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServerGroupTestJSON-886764110-project Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance group 114691fe-8e5b-4e89-8886-b5b5fe13cbf9 could not be found. Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '114691fe-8e5b-4e89-8886-b5b5fe13cbf9'} Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 114691fe-8e5b-4e89-8886-b5b5fe13cbf9 could not be found. Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 114691fe-8e5b-4e89-8886-b5b5fe13cbf9 could not be found. Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:30:32.070334 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:32.079863 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:32.079863 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:32.079863 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:30:32.079863 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:30:32.079863 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 114691fe-8e5b-4e89-8886-b5b5fe13cbf9 could not be found. Jul 18 02:30:32.079863 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:30:32.085745 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c223a07f-16ea-4887-badc-8e9ef19195df tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Returning 404 to user: Instance group 114691fe-8e5b-4e89-8886-b5b5fe13cbf9 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:30:32.085745 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c223a07f-16ea-4887-badc-8e9ef19195df tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] 10.222.0.57 "DELETE /compute/v2.1/os-server-groups/114691fe-8e5b-4e89-8886-b5b5fe13cbf9" status: 404 len: 117 microversion: 2.1 time: 0.073234 Jul 18 02:30:32.093628 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1636/3275] 10.222.0.57 () {58 vars in 1265 bytes} [Mon Jul 18 02:30:32 2022] DELETE /compute/v2.1/os-server-groups/114691fe-8e5b-4e89-8886-b5b5fe13cbf9 => generated 117 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:30:32.125994 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9b9b2eec-c54d-476d-8c8f-f6e11b620520 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:32.156866 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-9b9b2eec-c54d-476d-8c8f-f6e11b620520 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] HTTP exception thrown: Instance group e6a09738-14ed-4c6c-bcfc-c69fb233e0d4 could not be found. Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9b9b2eec-c54d-476d-8c8f-f6e11b620520 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Request method failure captured: Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/os-server-groups/e6a09738-14ed-4c6c-bcfc-c69fb233e0d4 HTTP/1.1 Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MWX-NkU0bT1l88HB5UORHU-hiiBrVF7mcMEF4MMcsurfzXqNaZOZMPODW_ggeXOteCDUF---3DTqZd615u8cQ9Lv8vvKrdG2X3EPDYMFnLKN-dsxLS6mU-9Gx8PD8EEveJ9gkXzr9pyPj9YfjHW0kYhF24U3Nax5xCeqCnroEtVA60 Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 9d3f4bddbe0e4a0a827296b21be3e901 Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServerGroupTestJSON-886764110 Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9d3f4bddbe0e4a0a827296b21be3e901"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9d3f4bddbe0e4a0a827296b21be3e901"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9d3f4bddbe0e4a0a827296b21be3e901"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9d3f4bddbe0e4a0a827296b21be3e901"}]}] Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServerGroupTestJSON-886764110 Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 9d3f4bddbe0e4a0a827296b21be3e901 Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServerGroupTestJSON-886764110 Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServerGroupTestJSON-886764110-project Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 180f08fe932e46c99c201223e7a3bef3 Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServerGroupTestJSON-886764110-project Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance group e6a09738-14ed-4c6c-bcfc-c69fb233e0d4 could not be found. Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'e6a09738-14ed-4c6c-bcfc-c69fb233e0d4'} Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group e6a09738-14ed-4c6c-bcfc-c69fb233e0d4 could not be found. Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group e6a09738-14ed-4c6c-bcfc-c69fb233e0d4 could not be found. Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:30:32.169034 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:32.179550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:32.179550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:32.179550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:30:32.179550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:30:32.179550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group e6a09738-14ed-4c6c-bcfc-c69fb233e0d4 could not be found. Jul 18 02:30:32.179550 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:30:32.182954 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9b9b2eec-c54d-476d-8c8f-f6e11b620520 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Returning 404 to user: Instance group e6a09738-14ed-4c6c-bcfc-c69fb233e0d4 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:30:32.191365 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9b9b2eec-c54d-476d-8c8f-f6e11b620520 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] 10.222.0.57 "DELETE /compute/v2.1/os-server-groups/e6a09738-14ed-4c6c-bcfc-c69fb233e0d4" status: 404 len: 117 microversion: 2.1 time: 0.090379 Jul 18 02:30:32.195908 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1637/3276] 10.222.0.57 () {58 vars in 1265 bytes} [Mon Jul 18 02:30:32 2022] DELETE /compute/v2.1/os-server-groups/e6a09738-14ed-4c6c-bcfc-c69fb233e0d4 => generated 117 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:30:32.209773 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d6bd093a-af76-4227-b04a-df4c5a422673 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:32.331215 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d6bd093a-af76-4227-b04a-df4c5a422673 tempest-ServerGroupTestJSON-886764110 tempest-ServerGroupTestJSON-886764110-project] 10.222.0.57 "DELETE /compute/v2.1/os-server-groups/dc6cf013-41f8-4c5c-8462-942704b0c5e7" status: 204 len: 0 microversion: 2.1 time: 0.128397 Jul 18 02:30:32.333406 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1638/3277] 10.222.0.57 () {58 vars in 1265 bytes} [Mon Jul 18 02:30:32 2022] DELETE /compute/v2.1/os-server-groups/dc6cf013-41f8-4c5c-8462-942704b0c5e7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:30:32.778615 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-be0a1f22-4941-4b18-8d9c-8ac12dd8bfae tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:30:32.779469 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-be0a1f22-4941-4b18-8d9c-8ac12dd8bfae tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:30:32.788028 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-be0a1f22-4941-4b18-8d9c-8ac12dd8bfae tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:30:32.790095 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-be0a1f22-4941-4b18-8d9c-8ac12dd8bfae tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:30:32.796760 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-be0a1f22-4941-4b18-8d9c-8ac12dd8bfae tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:30:32.844056 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-be0a1f22-4941-4b18-8d9c-8ac12dd8bfae tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:32.848058 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-be0a1f22-4941-4b18-8d9c-8ac12dd8bfae tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:32.855147 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-be0a1f22-4941-4b18-8d9c-8ac12dd8bfae tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:32.859258 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-be0a1f22-4941-4b18-8d9c-8ac12dd8bfae tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:33.034765 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-be0a1f22-4941-4b18-8d9c-8ac12dd8bfae tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Getting quotas for project 1a37eb4e7dc04c2e858a1723665d77c2. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:30:33.122697 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-be0a1f22-4941-4b18-8d9c-8ac12dd8bfae tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Getting quotas for user 0f973a57c7be4a4892065eb6bbe23e39 and project 1a37eb4e7dc04c2e858a1723665d77c2. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:30:33.229858 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-be0a1f22-4941-4b18-8d9c-8ac12dd8bfae tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:30:33.255333 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-be0a1f22-4941-4b18-8d9c-8ac12dd8bfae tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] [instance: 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:30:33.623836 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-be0a1f22-4941-4b18-8d9c-8ac12dd8bfae tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 6.451854 Jul 18 02:30:33.631639 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1640/3278] 10.222.0.57 () {62 vars in 1187 bytes} [Mon Jul 18 02:30:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 6461 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 02:30:33.638294 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-df2d4ccd-e843-4ca8-9810-e1c711c93ce3 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:33.639697 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-df2d4ccd-e843-4ca8-9810-e1c711c93ce3 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] [instance: 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:34.980188 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-df2d4ccd-e843-4ca8-9810-e1c711c93ce3 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:34.995576 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-df2d4ccd-e843-4ca8-9810-e1c711c93ce3 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:34.999645 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-df2d4ccd-e843-4ca8-9810-e1c711c93ce3 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:35.001434 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-df2d4ccd-e843-4ca8-9810-e1c711c93ce3 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] 10.222.0.57 "GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5" status: 200 len: 1258 microversion: 2.21 time: 1.368146 Jul 18 02:30:35.013692 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1639/3279] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:30:33 2022] GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 => generated 1258 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:30:36.024000 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-21d6c28b-8386-44b6-9f9c-861b973381b1 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:36.025342 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-21d6c28b-8386-44b6-9f9c-861b973381b1 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] [instance: 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:36.050315 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-21d6c28b-8386-44b6-9f9c-861b973381b1 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:36.052447 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-21d6c28b-8386-44b6-9f9c-861b973381b1 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:36.060293 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-21d6c28b-8386-44b6-9f9c-861b973381b1 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:36.062606 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-21d6c28b-8386-44b6-9f9c-861b973381b1 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:36.871764 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-21d6c28b-8386-44b6-9f9c-861b973381b1 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:36.915956 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-21d6c28b-8386-44b6-9f9c-861b973381b1 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:36.923303 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-21d6c28b-8386-44b6-9f9c-861b973381b1 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:36.936941 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-21d6c28b-8386-44b6-9f9c-861b973381b1 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] 10.222.0.57 "GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5" status: 200 len: 1254 microversion: 2.21 time: 0.911438 Jul 18 02:30:36.939042 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1641/3280] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:30:36 2022] GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 => generated 1254 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:30:37.968660 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9c07080f-9db8-43a1-a250-67ea08cda918 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:37.986994 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9c07080f-9db8-43a1-a250-67ea08cda918 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] [instance: 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:38.036667 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9c07080f-9db8-43a1-a250-67ea08cda918 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:38.044243 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9c07080f-9db8-43a1-a250-67ea08cda918 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:38.047792 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9c07080f-9db8-43a1-a250-67ea08cda918 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:38.048585 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9c07080f-9db8-43a1-a250-67ea08cda918 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:38.561964 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9c07080f-9db8-43a1-a250-67ea08cda918 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:38.606193 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9c07080f-9db8-43a1-a250-67ea08cda918 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:38.622141 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9c07080f-9db8-43a1-a250-67ea08cda918 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:38.624319 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9c07080f-9db8-43a1-a250-67ea08cda918 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] 10.222.0.57 "GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5" status: 200 len: 1316 microversion: 2.21 time: 0.670282 Jul 18 02:30:38.625139 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1640/3281] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:30:37 2022] GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 => generated 1316 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:30:39.663702 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-00f7382b-29ca-4c40-a0c2-6c64df0accb1 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:39.667040 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-00f7382b-29ca-4c40-a0c2-6c64df0accb1 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] [instance: 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:39.702646 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-00f7382b-29ca-4c40-a0c2-6c64df0accb1 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:39.705972 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-00f7382b-29ca-4c40-a0c2-6c64df0accb1 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:39.710573 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-00f7382b-29ca-4c40-a0c2-6c64df0accb1 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:39.713296 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-00f7382b-29ca-4c40-a0c2-6c64df0accb1 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:41.028287 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-00f7382b-29ca-4c40-a0c2-6c64df0accb1 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:41.040017 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-00f7382b-29ca-4c40-a0c2-6c64df0accb1 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:41.041776 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-00f7382b-29ca-4c40-a0c2-6c64df0accb1 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:41.042944 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-00f7382b-29ca-4c40-a0c2-6c64df0accb1 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] 10.222.0.57 "GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5" status: 200 len: 1316 microversion: 2.21 time: 1.393609 Jul 18 02:30:41.057823 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1642/3282] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:30:39 2022] GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 => generated 1316 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:30:42.071649 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-86e66b46-d39c-4d46-b233-5c6aae88a466 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:42.073197 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-86e66b46-d39c-4d46-b233-5c6aae88a466 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] [instance: 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:42.122737 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-86e66b46-d39c-4d46-b233-5c6aae88a466 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:42.132788 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-86e66b46-d39c-4d46-b233-5c6aae88a466 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:42.134442 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-86e66b46-d39c-4d46-b233-5c6aae88a466 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:42.138631 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-86e66b46-d39c-4d46-b233-5c6aae88a466 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:42.780700 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-86e66b46-d39c-4d46-b233-5c6aae88a466 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:42.869613 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-86e66b46-d39c-4d46-b233-5c6aae88a466 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:42.900575 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-86e66b46-d39c-4d46-b233-5c6aae88a466 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:42.903601 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-86e66b46-d39c-4d46-b233-5c6aae88a466 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] 10.222.0.57 "GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5" status: 200 len: 1316 microversion: 2.21 time: 0.838439 Jul 18 02:30:42.909114 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1641/3283] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:30:42 2022] GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 => generated 1316 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:30:43.956915 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c721ecc3-b1fc-47c4-b70b-eb442de61059 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:43.964657 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c721ecc3-b1fc-47c4-b70b-eb442de61059 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] [instance: 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:44.012023 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:44.024056 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:44.041015 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c721ecc3-b1fc-47c4-b70b-eb442de61059 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:44.042452 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c721ecc3-b1fc-47c4-b70b-eb442de61059 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:44.045399 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c721ecc3-b1fc-47c4-b70b-eb442de61059 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:44.053139 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c721ecc3-b1fc-47c4-b70b-eb442de61059 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:44.169659 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=44 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:44.333902 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6b203728-4632-45ec-831e-1c51770feddb tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-185948477", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "34eb80fd-c975-41bf-bb3f-1b5f332cff3b"}, {"uuid": "fd9a6c3c-c708-40f6-be62-34c565d0a3a3"}, {"uuid": "34eb80fd-c975-41bf-bb3f-1b5f332cff3b"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:30:44.647766 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-6b203728-4632-45ec-831e-1c51770feddb tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] validate_networks() for [('34eb80fd-c975-41bf-bb3f-1b5f332cff3b', None, None, None, None, None), ('fd9a6c3c-c708-40f6-be62-34c565d0a3a3', None, None, None, None, None), ('34eb80fd-c975-41bf-bb3f-1b5f332cff3b', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:30:44.989493 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:45.171264 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c721ecc3-b1fc-47c4-b70b-eb442de61059 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:45.215697 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c721ecc3-b1fc-47c4-b70b-eb442de61059 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:45.224838 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c721ecc3-b1fc-47c4-b70b-eb442de61059 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:45.243445 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c721ecc3-b1fc-47c4-b70b-eb442de61059 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] 10.222.0.57 "GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5" status: 200 len: 1316 microversion: 2.21 time: 1.303283 Jul 18 02:30:45.261750 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1643/3284] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:30:43 2022] GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 => generated 1316 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:30:46.280722 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-eddcca8b-b3a0-46e2-bbcf-f9e2050ab5c8 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:46.281407 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-eddcca8b-b3a0-46e2-bbcf-f9e2050ab5c8 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] [instance: 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:46.296204 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eddcca8b-b3a0-46e2-bbcf-f9e2050ab5c8 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:46.306931 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eddcca8b-b3a0-46e2-bbcf-f9e2050ab5c8 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:46.307986 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eddcca8b-b3a0-46e2-bbcf-f9e2050ab5c8 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:46.308460 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eddcca8b-b3a0-46e2-bbcf-f9e2050ab5c8 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:48.304319 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-eddcca8b-b3a0-46e2-bbcf-f9e2050ab5c8 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:48.321012 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-eddcca8b-b3a0-46e2-bbcf-f9e2050ab5c8 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:48.323254 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-eddcca8b-b3a0-46e2-bbcf-f9e2050ab5c8 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:48.324760 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-eddcca8b-b3a0-46e2-bbcf-f9e2050ab5c8 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] 10.222.0.57 "GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5" status: 200 len: 1358 microversion: 2.21 time: 2.048513 Jul 18 02:30:48.326025 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1644/3285] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:30:46 2022] GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 => generated 1358 bytes in 2050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:30:49.371364 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-09628196-1881-4cea-8be0-912bea900302 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:49.372394 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-09628196-1881-4cea-8be0-912bea900302 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] [instance: 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:49.399956 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-09628196-1881-4cea-8be0-912bea900302 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:49.410277 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-09628196-1881-4cea-8be0-912bea900302 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:49.411303 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-09628196-1881-4cea-8be0-912bea900302 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:49.411772 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-09628196-1881-4cea-8be0-912bea900302 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:51.729029 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-09628196-1881-4cea-8be0-912bea900302 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:51.768584 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-09628196-1881-4cea-8be0-912bea900302 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:51.776967 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-09628196-1881-4cea-8be0-912bea900302 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:51.786264 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-09628196-1881-4cea-8be0-912bea900302 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] 10.222.0.57 "GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5" status: 200 len: 1358 microversion: 2.21 time: 2.432875 Jul 18 02:30:51.789455 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1645/3286] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:30:49 2022] GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 => generated 1358 bytes in 2441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:30:52.613226 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-6b203728-4632-45ec-831e-1c51770feddb tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:30:52.614011 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-6b203728-4632-45ec-831e-1c51770feddb tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:30:52.615364 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-6b203728-4632-45ec-831e-1c51770feddb tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:30:52.616153 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-6b203728-4632-45ec-831e-1c51770feddb tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:30:52.617056 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-6b203728-4632-45ec-831e-1c51770feddb tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:30:52.657648 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6b203728-4632-45ec-831e-1c51770feddb tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:52.658147 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6b203728-4632-45ec-831e-1c51770feddb tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:52.659025 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6b203728-4632-45ec-831e-1c51770feddb tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:52.659481 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6b203728-4632-45ec-831e-1c51770feddb tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:52.695932 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:52.725910 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-6b203728-4632-45ec-831e-1c51770feddb tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Getting quotas for project 2a2eddce815546778247c5d0c9986610. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:30:52.746044 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-6b203728-4632-45ec-831e-1c51770feddb tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Getting quotas for user c12b1d209c7c4bdfaa3f18b95095e065 and project 2a2eddce815546778247c5d0c9986610. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:30:52.790879 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6b203728-4632-45ec-831e-1c51770feddb tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:30:52.802211 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6b203728-4632-45ec-831e-1c51770feddb tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 6faedf52-1ea8-4a05-8857-d0f8be1fadf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:30:52.808091 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0b695775-5239-4d27-97be-06e0954ff800 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:52.809503 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0b695775-5239-4d27-97be-06e0954ff800 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] [instance: 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:52.819108 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:52.825166 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0b695775-5239-4d27-97be-06e0954ff800 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:52.827068 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0b695775-5239-4d27-97be-06e0954ff800 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:52.828766 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0b695775-5239-4d27-97be-06e0954ff800 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:52.834225 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0b695775-5239-4d27-97be-06e0954ff800 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:52.920995 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6b203728-4632-45ec-831e-1c51770feddb tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.594830 Jul 18 02:30:52.926270 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1642/3287] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:30:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 8601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:30:52.933119 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1b0c48b1-31cb-43ec-9254-2987a89eaa9b tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:52.940126 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1b0c48b1-31cb-43ec-9254-2987a89eaa9b tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 6faedf52-1ea8-4a05-8857-d0f8be1fadf9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:53.426395 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1b0c48b1-31cb-43ec-9254-2987a89eaa9b tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:53.442356 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1b0c48b1-31cb-43ec-9254-2987a89eaa9b tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9" status: 200 len: 1212 microversion: 2.1 time: 0.513841 Jul 18 02:30:53.453421 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1643/3288] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:52 2022] GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9 => generated 1212 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:53.951495 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0b695775-5239-4d27-97be-06e0954ff800 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:53.998125 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0b695775-5239-4d27-97be-06e0954ff800 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:54.016045 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0b695775-5239-4d27-97be-06e0954ff800 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:54.017841 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0b695775-5239-4d27-97be-06e0954ff800 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] 10.222.0.57 "GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5" status: 200 len: 1358 microversion: 2.21 time: 1.214405 Jul 18 02:30:54.027189 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1646/3289] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:30:52 2022] GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 => generated 1358 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:30:54.418517 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-153d5d65-ea51-4d26-bbee-64651f734644 req-1fd486d6-7f39-4f73-aaa5-ef42cb60cfab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5", "tag": "646d4409-4837-4982-857b-78930b5b5535"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:30:54.452563 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-153d5d65-ea51-4d26-bbee-64651f734644 req-1fd486d6-7f39-4f73-aaa5-ef42cb60cfab service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:54.453088 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-153d5d65-ea51-4d26-bbee-64651f734644 req-1fd486d6-7f39-4f73-aaa5-ef42cb60cfab service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:54.559543 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-153d5d65-ea51-4d26-bbee-64651f734644 req-1fd486d6-7f39-4f73-aaa5-ef42cb60cfab service nova] Creating event network-changed:646d4409-4837-4982-857b-78930b5b5535 for instance 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 on n-h1-465891-3 Jul 18 02:30:54.578561 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-551e7d34-08f7-468d-8965-3829d138581a tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Action: 'create', calling method: .version_select at 0x7ff4a8aec9d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-415684415", "description": "tempest-description-1159853845"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:30:54.592169 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-153d5d65-ea51-4d26-bbee-64651f734644 req-1fd486d6-7f39-4f73-aaa5-ef42cb60cfab service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174839 Jul 18 02:30:54.597614 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1647/3290] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:30:54.624955 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a0bab4dd-4ab3-45d0-a9bf-862c24d0cb00 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:54.626126 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a0bab4dd-4ab3-45d0-a9bf-862c24d0cb00 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 6faedf52-1ea8-4a05-8857-d0f8be1fadf9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:54.652653 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a0bab4dd-4ab3-45d0-a9bf-862c24d0cb00 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:54.656330 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a0bab4dd-4ab3-45d0-a9bf-862c24d0cb00 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:54.675755 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a0bab4dd-4ab3-45d0-a9bf-862c24d0cb00 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:54.677218 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a0bab4dd-4ab3-45d0-a9bf-862c24d0cb00 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:55.039022 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a0bab4dd-4ab3-45d0-a9bf-862c24d0cb00 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:55.052282 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a0bab4dd-4ab3-45d0-a9bf-862c24d0cb00 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9" status: 200 len: 1216 microversion: 2.1 time: 0.449408 Jul 18 02:30:55.060722 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1648/3291] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:54 2022] GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9 => generated 1216 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:55.082204 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7c98b5c3-2969-4272-84f8-b237c5dcc631 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:55.087570 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7c98b5c3-2969-4272-84f8-b237c5dcc631 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] [instance: 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:55.136759 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7c98b5c3-2969-4272-84f8-b237c5dcc631 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:55.137388 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7c98b5c3-2969-4272-84f8-b237c5dcc631 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:55.139381 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7c98b5c3-2969-4272-84f8-b237c5dcc631 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:55.142566 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7c98b5c3-2969-4272-84f8-b237c5dcc631 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:56.803704 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-551e7d34-08f7-468d-8965-3829d138581a tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 2.706229 Jul 18 02:30:56.806292 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1644/3292] 10.222.0.57 () {60 vars in 1179 bytes} [Mon Jul 18 02:30:54 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 2710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:30:56.818844 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-413b2a59-2321-454e-8df4-d36ff837bfba tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1819137088", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:30:56.856005 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:56.923451 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7c98b5c3-2969-4272-84f8-b237c5dcc631 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:56.974172 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-413b2a59-2321-454e-8df4-d36ff837bfba tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] validate_networks() for None {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:30:56.996959 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7c98b5c3-2969-4272-84f8-b237c5dcc631 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:57.020274 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7c98b5c3-2969-4272-84f8-b237c5dcc631 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:57.029328 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7c98b5c3-2969-4272-84f8-b237c5dcc631 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] 10.222.0.57 "GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5" status: 200 len: 1358 microversion: 2.21 time: 1.961149 Jul 18 02:30:57.030470 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1649/3293] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:30:55 2022] GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 => generated 1358 bytes in 1969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:30:57.060841 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e21b6527-7357-4d69-919a-033d122acd6d tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:57.073259 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e21b6527-7357-4d69-919a-033d122acd6d tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 6faedf52-1ea8-4a05-8857-d0f8be1fadf9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:57.088944 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e21b6527-7357-4d69-919a-033d122acd6d tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:57.090192 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e21b6527-7357-4d69-919a-033d122acd6d tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:57.092883 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e21b6527-7357-4d69-919a-033d122acd6d tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:57.095320 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e21b6527-7357-4d69-919a-033d122acd6d tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:57.676967 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e21b6527-7357-4d69-919a-033d122acd6d tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:57.699890 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e21b6527-7357-4d69-919a-033d122acd6d tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9" status: 200 len: 1270 microversion: 2.1 time: 0.667762 Jul 18 02:30:57.704013 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1650/3294] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:57 2022] GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9 => generated 1270 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:57.713094 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c557947d-f336-474c-8d3b-c3bde91e89a2 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Action: 'create', calling method: .version_select at 0x7ff4a838d4c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-603328228", "description": "tempest-description-1878175757"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:30:58.312965 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-413b2a59-2321-454e-8df4-d36ff837bfba tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:30:58.326030 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-413b2a59-2321-454e-8df4-d36ff837bfba tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:30:58.327509 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-413b2a59-2321-454e-8df4-d36ff837bfba tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:30:58.340498 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-413b2a59-2321-454e-8df4-d36ff837bfba tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:30:58.341926 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-413b2a59-2321-454e-8df4-d36ff837bfba tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:30:58.429663 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-413b2a59-2321-454e-8df4-d36ff837bfba tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:58.436147 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-413b2a59-2321-454e-8df4-d36ff837bfba tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:58.441374 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-413b2a59-2321-454e-8df4-d36ff837bfba tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:58.442051 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-413b2a59-2321-454e-8df4-d36ff837bfba tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:58.515331 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-413b2a59-2321-454e-8df4-d36ff837bfba tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Getting quotas for project ac5db9a43df045ea89156bf5f45f5108. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:30:58.540709 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-413b2a59-2321-454e-8df4-d36ff837bfba tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Getting quotas for user b9299d3b336b4ca8b3ac5e8497e26ad7 and project ac5db9a43df045ea89156bf5f45f5108. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:30:58.588262 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-413b2a59-2321-454e-8df4-d36ff837bfba tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:30:58.599086 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-413b2a59-2321-454e-8df4-d36ff837bfba tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] [instance: 122b7de0-abb6-4349-8559-f7cee46ef7d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:30:58.741319 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-413b2a59-2321-454e-8df4-d36ff837bfba tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.933462 Jul 18 02:30:58.749025 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1645/3295] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:30:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:30:58.755426 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cc1e3571-6456-4d5a-a0c0-b0ac3f607b12 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:58.758419 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cc1e3571-6456-4d5a-a0c0-b0ac3f607b12 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] [instance: 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:58.784244 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cc1e3571-6456-4d5a-a0c0-b0ac3f607b12 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:58.785504 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cc1e3571-6456-4d5a-a0c0-b0ac3f607b12 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:58.786597 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cc1e3571-6456-4d5a-a0c0-b0ac3f607b12 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:58.791753 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cc1e3571-6456-4d5a-a0c0-b0ac3f607b12 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:59.457267 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c557947d-f336-474c-8d3b-c3bde91e89a2 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.750018 Jul 18 02:30:59.458679 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1651/3296] 10.222.0.57 () {60 vars in 1179 bytes} [Mon Jul 18 02:30:57 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:30:59.461309 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cc1e3571-6456-4d5a-a0c0-b0ac3f607b12 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:59.470215 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6ad49612-7465-4181-996a-f901e8f7839d tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:59.473921 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6ad49612-7465-4181-996a-f901e8f7839d tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 6faedf52-1ea8-4a05-8857-d0f8be1fadf9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:59.488555 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cc1e3571-6456-4d5a-a0c0-b0ac3f607b12 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:59.492587 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cc1e3571-6456-4d5a-a0c0-b0ac3f607b12 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:59.494239 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cc1e3571-6456-4d5a-a0c0-b0ac3f607b12 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] 10.222.0.57 "GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5" status: 200 len: 1358 microversion: 2.21 time: 0.743380 Jul 18 02:30:59.501757 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1646/3297] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:30:58 2022] GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 => generated 1358 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:30:59.510148 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b42db5a1-b72c-4f89-a8c3-b7885ff5ec60 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:59.512790 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b42db5a1-b72c-4f89-a8c3-b7885ff5ec60 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] [instance: 122b7de0-abb6-4349-8559-f7cee46ef7d1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:59.541107 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6ad49612-7465-4181-996a-f901e8f7839d tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:59.542434 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6ad49612-7465-4181-996a-f901e8f7839d tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:59.543718 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6ad49612-7465-4181-996a-f901e8f7839d tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:59.545459 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6ad49612-7465-4181-996a-f901e8f7839d tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:59.613208 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b42db5a1-b72c-4f89-a8c3-b7885ff5ec60 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9299d3b336b4ca8b3ac5e8497e26ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5db9a43df045ea89156bf5f45f5108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:59.625577 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b42db5a1-b72c-4f89-a8c3-b7885ff5ec60 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] 10.222.0.57 "GET /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1" status: 200 len: 1214 microversion: 2.1 time: 0.129345 Jul 18 02:30:59.628062 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1647/3298] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:59 2022] GET /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1 => generated 1214 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:59.676613 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6ad49612-7465-4181-996a-f901e8f7839d tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:59.688560 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6ad49612-7465-4181-996a-f901e8f7839d tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9" status: 200 len: 1270 microversion: 2.1 time: 0.228096 Jul 18 02:30:59.690500 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1652/3299] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:59 2022] GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9 => generated 1270 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:59.716399 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a71d1d0d-46f6-4ad7-8005-9a846a5c1093 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-94350813", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "05f51095-6f49-45f8-82bd-47fad9cad04f"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:30:59.825771 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-a71d1d0d-46f6-4ad7-8005-9a846a5c1093 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] validate_networks() for [('05f51095-6f49-45f8-82bd-47fad9cad04f', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:30:59.830988 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-24a5edd8-b50a-4579-b976-d3e3c204aaa6 tempest-ServerGroup264TestJSON-1931608807 tempest-ServerGroup264TestJSON-1931608807-project] Action: 'create', calling method: .version_select at 0x7ff49bc79e50>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:30:59.880399 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-24a5edd8-b50a-4579-b976-d3e3c204aaa6 tempest-ServerGroup264TestJSON-1931608807 tempest-ServerGroup264TestJSON-1931608807-project] Getting quotas for project bdc6cc49933e47b6b18e65df7e78fb2b. Resources: {'server_groups'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:30:59.897523 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-24a5edd8-b50a-4579-b976-d3e3c204aaa6 tempest-ServerGroup264TestJSON-1931608807 tempest-ServerGroup264TestJSON-1931608807-project] Getting quotas for user 8954654c884842068d641b5a05f7dd40 and project bdc6cc49933e47b6b18e65df7e78fb2b. Resources: {'server_groups'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:31:00.017471 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-24a5edd8-b50a-4579-b976-d3e3c204aaa6 tempest-ServerGroup264TestJSON-1931608807 tempest-ServerGroup264TestJSON-1931608807-project] Getting quotas for project bdc6cc49933e47b6b18e65df7e78fb2b. Resources: {'server_groups'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:31:00.024841 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-24a5edd8-b50a-4579-b976-d3e3c204aaa6 tempest-ServerGroup264TestJSON-1931608807 tempest-ServerGroup264TestJSON-1931608807-project] Getting quotas for user 8954654c884842068d641b5a05f7dd40 and project bdc6cc49933e47b6b18e65df7e78fb2b. Resources: {'server_groups'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:31:00.042314 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-24a5edd8-b50a-4579-b976-d3e3c204aaa6 tempest-ServerGroup264TestJSON-1931608807 tempest-ServerGroup264TestJSON-1931608807-project] 10.222.0.57 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.411740 Jul 18 02:31:00.043719 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1648/3300] 10.222.0.57 () {62 vars in 1213 bytes} [Mon Jul 18 02:30:59 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:31:00.062244 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-19fa8a70-ca1b-4725-96a3-c2329814ba5a tempest-ServerGroup264TestJSON-1931608807 tempest-ServerGroup264TestJSON-1931608807-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:00.085067 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-19fa8a70-ca1b-4725-96a3-c2329814ba5a tempest-ServerGroup264TestJSON-1931608807 tempest-ServerGroup264TestJSON-1931608807-project] 10.222.0.57 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.031257 Jul 18 02:31:00.094668 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1649/3301] 10.222.0.57 () {60 vars in 1192 bytes} [Mon Jul 18 02:31:00 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:31:00.110050 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-588b3910-474b-45bb-a486-c00d60a2ce6b tempest-ServerGroup264TestJSON-1931608807 tempest-ServerGroup264TestJSON-1931608807-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:00.134793 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-588b3910-474b-45bb-a486-c00d60a2ce6b tempest-ServerGroup264TestJSON-1931608807 tempest-ServerGroup264TestJSON-1931608807-project] 10.222.0.57 "GET /compute/v2.1/os-server-groups/b819807a-9b6d-4cc8-a4aa-9075880f1789" status: 200 len: 235 microversion: 2.64 time: 0.038169 Jul 18 02:31:00.136932 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1650/3302] 10.222.0.57 () {60 vars in 1303 bytes} [Mon Jul 18 02:31:00 2022] GET /compute/v2.1/os-server-groups/b819807a-9b6d-4cc8-a4aa-9075880f1789 => generated 235 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:31:00.156340 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5828b857-33ee-4a8f-884a-432bd63d5484 tempest-ServerGroup264TestJSON-1931608807 tempest-ServerGroup264TestJSON-1931608807-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:00.208846 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5828b857-33ee-4a8f-884a-432bd63d5484 tempest-ServerGroup264TestJSON-1931608807 tempest-ServerGroup264TestJSON-1931608807-project] 10.222.0.57 "DELETE /compute/v2.1/os-server-groups/b819807a-9b6d-4cc8-a4aa-9075880f1789" status: 204 len: 0 microversion: 2.64 time: 0.060482 Jul 18 02:31:00.217875 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1651/3303] 10.222.0.57 () {60 vars in 1306 bytes} [Mon Jul 18 02:31:00 2022] DELETE /compute/v2.1/os-server-groups/b819807a-9b6d-4cc8-a4aa-9075880f1789 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:31:00.227177 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5eb45b94-1416-4211-afa6-593eb3cd526f tempest-ServerGroup264TestJSON-1931608807 tempest-ServerGroup264TestJSON-1931608807-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:00.253473 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-5eb45b94-1416-4211-afa6-593eb3cd526f tempest-ServerGroup264TestJSON-1931608807 tempest-ServerGroup264TestJSON-1931608807-project] HTTP exception thrown: Instance group b819807a-9b6d-4cc8-a4aa-9075880f1789 could not be found. Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5eb45b94-1416-4211-afa6-593eb3cd526f tempest-ServerGroup264TestJSON-1931608807 tempest-ServerGroup264TestJSON-1931608807-project] Request method failure captured: Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/os-server-groups/b819807a-9b6d-4cc8-a4aa-9075880f1789 HTTP/1.1 Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MXi4TeZ5SqRFn4c3plnoTrf6DphSgoMLF91jHTrebgXwnLQgBruzCGFrf-NKnw7ZhrUa10t8Qr0lKowrzQiRQzORot32cjH7k5K99n1kyc5ncd-93Gh7iy9YP5mYtkbu-jNcN7xnw18RTXKobcohyesl5kunOtQBhyBhP48T369OI4 Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: X-Openstack-Nova-Api-Version: 2.64 Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: bdc6cc49933e47b6b18e65df7e78fb2b Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServerGroup264TestJSON-1931608807 Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_bdc6cc49933e47b6b18e65df7e78fb2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bdc6cc49933e47b6b18e65df7e78fb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bdc6cc49933e47b6b18e65df7e78fb2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/bdc6cc49933e47b6b18e65df7e78fb2b"}]}] Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServerGroup264TestJSON-1931608807 Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: bdc6cc49933e47b6b18e65df7e78fb2b Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1931608807 Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServerGroup264TestJSON-1931608807-project Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 8954654c884842068d641b5a05f7dd40 Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServerGroup264TestJSON-1931608807-project Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance group b819807a-9b6d-4cc8-a4aa-9075880f1789 could not be found. Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'b819807a-9b6d-4cc8-a4aa-9075880f1789'} Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group b819807a-9b6d-4cc8-a4aa-9075880f1789 could not be found. Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group b819807a-9b6d-4cc8-a4aa-9075880f1789 could not be found. Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:31:00.279290 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:00.303454 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:31:00.303454 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:31:00.303454 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:31:00.303454 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:31:00.303454 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group b819807a-9b6d-4cc8-a4aa-9075880f1789 could not be found. Jul 18 02:31:00.303454 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:31:00.311129 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5eb45b94-1416-4211-afa6-593eb3cd526f tempest-ServerGroup264TestJSON-1931608807 tempest-ServerGroup264TestJSON-1931608807-project] Returning 404 to user: Instance group b819807a-9b6d-4cc8-a4aa-9075880f1789 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:31:00.311129 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5eb45b94-1416-4211-afa6-593eb3cd526f tempest-ServerGroup264TestJSON-1931608807 tempest-ServerGroup264TestJSON-1931608807-project] 10.222.0.57 "DELETE /compute/v2.1/os-server-groups/b819807a-9b6d-4cc8-a4aa-9075880f1789" status: 404 len: 117 microversion: 2.64 time: 0.088052 Jul 18 02:31:00.311655 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1652/3304] 10.222.0.57 () {60 vars in 1306 bytes} [Mon Jul 18 02:31:00 2022] DELETE /compute/v2.1/os-server-groups/b819807a-9b6d-4cc8-a4aa-9075880f1789 => generated 117 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:31:00.517737 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c705d81d-0f47-40d7-9475-58e872562cdb tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:00.519846 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c705d81d-0f47-40d7-9475-58e872562cdb tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] [instance: 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:00.538611 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c705d81d-0f47-40d7-9475-58e872562cdb tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:00.542187 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c705d81d-0f47-40d7-9475-58e872562cdb tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:00.544868 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c705d81d-0f47-40d7-9475-58e872562cdb tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:00.545496 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c705d81d-0f47-40d7-9475-58e872562cdb tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:01.547956 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c705d81d-0f47-40d7-9475-58e872562cdb tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:01.561200 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c705d81d-0f47-40d7-9475-58e872562cdb tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:01.565912 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c705d81d-0f47-40d7-9475-58e872562cdb tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:01.574417 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c705d81d-0f47-40d7-9475-58e872562cdb tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] 10.222.0.57 "GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5" status: 200 len: 1358 microversion: 2.21 time: 1.065012 Jul 18 02:31:01.585573 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1653/3305] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:31:00 2022] GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 => generated 1358 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:31:01.594431 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ba4a0067-19bc-4c3a-8b57-8edea042aba9 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:01.595077 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ba4a0067-19bc-4c3a-8b57-8edea042aba9 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] [instance: 122b7de0-abb6-4349-8559-f7cee46ef7d1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:01.636116 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ba4a0067-19bc-4c3a-8b57-8edea042aba9 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:01.636992 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ba4a0067-19bc-4c3a-8b57-8edea042aba9 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:01.638045 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ba4a0067-19bc-4c3a-8b57-8edea042aba9 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:01.638684 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ba4a0067-19bc-4c3a-8b57-8edea042aba9 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:01.917143 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ba4a0067-19bc-4c3a-8b57-8edea042aba9 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9299d3b336b4ca8b3ac5e8497e26ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5db9a43df045ea89156bf5f45f5108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:01.928693 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ba4a0067-19bc-4c3a-8b57-8edea042aba9 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] 10.222.0.57 "GET /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1" status: 200 len: 1218 microversion: 2.1 time: 0.339055 Jul 18 02:31:01.932875 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1654/3306] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:01 2022] GET /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1 => generated 1218 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:01.947462 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-be28917b-93de-497b-aa16-b3df91214633 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:01.951716 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-be28917b-93de-497b-aa16-b3df91214633 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 6faedf52-1ea8-4a05-8857-d0f8be1fadf9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:01.969363 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-be28917b-93de-497b-aa16-b3df91214633 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:01.969857 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-be28917b-93de-497b-aa16-b3df91214633 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:01.970924 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-be28917b-93de-497b-aa16-b3df91214633 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:01.971381 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-be28917b-93de-497b-aa16-b3df91214633 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:02.910312 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-be28917b-93de-497b-aa16-b3df91214633 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:02.936874 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-be28917b-93de-497b-aa16-b3df91214633 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9" status: 200 len: 1312 microversion: 2.1 time: 1.001506 Jul 18 02:31:02.938895 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1655/3307] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:01 2022] GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9 => generated 1312 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:02.953598 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-14b3df0a-8d8d-4ab0-b7cf-dcfa9db0cf99 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:02.957918 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-14b3df0a-8d8d-4ab0-b7cf-dcfa9db0cf99 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] [instance: 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:02.979774 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14b3df0a-8d8d-4ab0-b7cf-dcfa9db0cf99 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:02.980776 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14b3df0a-8d8d-4ab0-b7cf-dcfa9db0cf99 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:02.984925 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14b3df0a-8d8d-4ab0-b7cf-dcfa9db0cf99 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:02.985491 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14b3df0a-8d8d-4ab0-b7cf-dcfa9db0cf99 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:03.361144 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-a71d1d0d-46f6-4ad7-8005-9a846a5c1093 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:31:03.362148 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-a71d1d0d-46f6-4ad7-8005-9a846a5c1093 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:31:03.363455 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-a71d1d0d-46f6-4ad7-8005-9a846a5c1093 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:31:03.364239 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-a71d1d0d-46f6-4ad7-8005-9a846a5c1093 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:31:03.365022 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-a71d1d0d-46f6-4ad7-8005-9a846a5c1093 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:31:03.407270 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a71d1d0d-46f6-4ad7-8005-9a846a5c1093 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:03.407914 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a71d1d0d-46f6-4ad7-8005-9a846a5c1093 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:03.414242 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a71d1d0d-46f6-4ad7-8005-9a846a5c1093 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:03.415606 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a71d1d0d-46f6-4ad7-8005-9a846a5c1093 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:03.479372 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-a71d1d0d-46f6-4ad7-8005-9a846a5c1093 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Getting quotas for project afe99772712849608ba124613bb5cc26. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:31:03.488625 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-a71d1d0d-46f6-4ad7-8005-9a846a5c1093 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Getting quotas for user 2374fa8610714b72b6034726ee1c2373 and project afe99772712849608ba124613bb5cc26. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:31:03.506342 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a71d1d0d-46f6-4ad7-8005-9a846a5c1093 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:31:03.509237 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a71d1d0d-46f6-4ad7-8005-9a846a5c1093 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: c6d44f85-b513-4d3e-87de-71341677a30b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:31:03.593430 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a71d1d0d-46f6-4ad7-8005-9a846a5c1093 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.888726 Jul 18 02:31:03.601087 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1653/3308] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:30:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 3897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:31:03.608904 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bf8c859b-05b6-4590-ae45-1fb276d9ae06 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:03.609862 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bf8c859b-05b6-4590-ae45-1fb276d9ae06 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] [instance: 122b7de0-abb6-4349-8559-f7cee46ef7d1] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:03.618667 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bf8c859b-05b6-4590-ae45-1fb276d9ae06 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:03.619643 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bf8c859b-05b6-4590-ae45-1fb276d9ae06 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:03.620655 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bf8c859b-05b6-4590-ae45-1fb276d9ae06 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:03.621615 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bf8c859b-05b6-4590-ae45-1fb276d9ae06 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:03.701239 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-14b3df0a-8d8d-4ab0-b7cf-dcfa9db0cf99 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:03.716256 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-14b3df0a-8d8d-4ab0-b7cf-dcfa9db0cf99 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:03.718002 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-14b3df0a-8d8d-4ab0-b7cf-dcfa9db0cf99 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:03.719439 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-14b3df0a-8d8d-4ab0-b7cf-dcfa9db0cf99 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] 10.222.0.57 "GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5" status: 200 len: 1358 microversion: 2.21 time: 0.779400 Jul 18 02:31:03.721126 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1656/3309] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:31:02 2022] GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 => generated 1358 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:31:03.727571 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1ca79a4e-f96f-4bd5-809d-ba0f72761201 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:03.728504 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1ca79a4e-f96f-4bd5-809d-ba0f72761201 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: c6d44f85-b513-4d3e-87de-71341677a30b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:04.468175 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1ca79a4e-f96f-4bd5-809d-ba0f72761201 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2374fa8610714b72b6034726ee1c2373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe99772712849608ba124613bb5cc26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:04.479776 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1ca79a4e-f96f-4bd5-809d-ba0f72761201 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b" status: 200 len: 1214 microversion: 2.1 time: 0.756955 Jul 18 02:31:04.482237 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1657/3310] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:03 2022] GET /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b => generated 1214 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:04.509545 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5a19ead2-6e79-4ec2-bf66-6359af2f07d7 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:04.510249 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5a19ead2-6e79-4ec2-bf66-6359af2f07d7 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 6faedf52-1ea8-4a05-8857-d0f8be1fadf9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:04.528376 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5a19ead2-6e79-4ec2-bf66-6359af2f07d7 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:04.528829 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5a19ead2-6e79-4ec2-bf66-6359af2f07d7 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:04.529655 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5a19ead2-6e79-4ec2-bf66-6359af2f07d7 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:04.536282 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5a19ead2-6e79-4ec2-bf66-6359af2f07d7 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:04.799810 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bf8c859b-05b6-4590-ae45-1fb276d9ae06 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9299d3b336b4ca8b3ac5e8497e26ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5db9a43df045ea89156bf5f45f5108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:04.815294 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bf8c859b-05b6-4590-ae45-1fb276d9ae06 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] 10.222.0.57 "GET /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1" status: 200 len: 1272 microversion: 2.1 time: 1.211022 Jul 18 02:31:04.816605 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1654/3311] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:03 2022] GET /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1 => generated 1272 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:04.833310 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-94c10053-ba5c-4440-8a54-da1240700cec tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:04.834450 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-94c10053-ba5c-4440-8a54-da1240700cec tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] [instance: 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:04.847077 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-94c10053-ba5c-4440-8a54-da1240700cec tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:04.848059 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-94c10053-ba5c-4440-8a54-da1240700cec tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:04.849452 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-94c10053-ba5c-4440-8a54-da1240700cec tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:04.850175 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-94c10053-ba5c-4440-8a54-da1240700cec tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:05.419898 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-94c10053-ba5c-4440-8a54-da1240700cec tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:05.424914 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5a19ead2-6e79-4ec2-bf66-6359af2f07d7 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:05.436990 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-94c10053-ba5c-4440-8a54-da1240700cec tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:05.438671 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-94c10053-ba5c-4440-8a54-da1240700cec tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:05.439751 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5a19ead2-6e79-4ec2-bf66-6359af2f07d7 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9" status: 200 len: 1333 microversion: 2.1 time: 0.949338 Jul 18 02:31:05.439953 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-94c10053-ba5c-4440-8a54-da1240700cec tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] 10.222.0.57 "GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5" status: 200 len: 1358 microversion: 2.21 time: 0.610911 Jul 18 02:31:05.441762 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1658/3312] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:04 2022] GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9 => generated 1333 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:05.445189 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1655/3313] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:31:04 2022] GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 => generated 1358 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:31:05.500453 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0cb12a8b-5089-4f43-a8ac-bed71b84bee1 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:05.501604 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0cb12a8b-5089-4f43-a8ac-bed71b84bee1 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: c6d44f85-b513-4d3e-87de-71341677a30b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:05.511676 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0cb12a8b-5089-4f43-a8ac-bed71b84bee1 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:05.512581 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0cb12a8b-5089-4f43-a8ac-bed71b84bee1 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:05.513892 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0cb12a8b-5089-4f43-a8ac-bed71b84bee1 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:05.517488 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0cb12a8b-5089-4f43-a8ac-bed71b84bee1 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:05.685155 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0cb12a8b-5089-4f43-a8ac-bed71b84bee1 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2374fa8610714b72b6034726ee1c2373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe99772712849608ba124613bb5cc26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:05.700931 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0cb12a8b-5089-4f43-a8ac-bed71b84bee1 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b" status: 200 len: 1266 microversion: 2.1 time: 0.204162 Jul 18 02:31:05.702080 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1659/3314] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:05 2022] GET /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:05.835053 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0108dda4-a4ae-47c8-859e-3ff5127cf4cc tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:05.836973 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0108dda4-a4ae-47c8-859e-3ff5127cf4cc tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] [instance: 122b7de0-abb6-4349-8559-f7cee46ef7d1] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:05.867225 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0108dda4-a4ae-47c8-859e-3ff5127cf4cc tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:05.869350 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0108dda4-a4ae-47c8-859e-3ff5127cf4cc tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:05.872491 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0108dda4-a4ae-47c8-859e-3ff5127cf4cc tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:05.874134 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0108dda4-a4ae-47c8-859e-3ff5127cf4cc tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:06.232643 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0108dda4-a4ae-47c8-859e-3ff5127cf4cc tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9299d3b336b4ca8b3ac5e8497e26ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5db9a43df045ea89156bf5f45f5108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:06.232643 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0108dda4-a4ae-47c8-859e-3ff5127cf4cc tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] 10.222.0.57 "GET /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1" status: 200 len: 1272 microversion: 2.1 time: 0.377530 Jul 18 02:31:06.232643 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1656/3315] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:05 2022] GET /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1 => generated 1272 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:06.459359 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7801d97b-31e5-4a1c-b31a-2059d7055885 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:06.459998 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7801d97b-31e5-4a1c-b31a-2059d7055885 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 6faedf52-1ea8-4a05-8857-d0f8be1fadf9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:06.476749 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-55719477-649a-43b4-bdc6-f672fbc57f74 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:06.482075 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7801d97b-31e5-4a1c-b31a-2059d7055885 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:06.482546 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7801d97b-31e5-4a1c-b31a-2059d7055885 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:06.483379 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7801d97b-31e5-4a1c-b31a-2059d7055885 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:06.486452 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-55719477-649a-43b4-bdc6-f672fbc57f74 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] [instance: 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:06.488126 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7801d97b-31e5-4a1c-b31a-2059d7055885 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:06.590595 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-55719477-649a-43b4-bdc6-f672fbc57f74 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:06.596430 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-55719477-649a-43b4-bdc6-f672fbc57f74 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.052s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:06.605874 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-55719477-649a-43b4-bdc6-f672fbc57f74 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:06.609836 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-55719477-649a-43b4-bdc6-f672fbc57f74 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:07.438125 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7801d97b-31e5-4a1c-b31a-2059d7055885 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:07.480497 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7801d97b-31e5-4a1c-b31a-2059d7055885 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9" status: 200 len: 1333 microversion: 2.1 time: 1.023291 Jul 18 02:31:07.498846 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1660/3316] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:06 2022] GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9 => generated 1333 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:07.529164 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c3804e2a-f3a9-4e31-bee8-766c4e4a9248 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:07.531246 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c3804e2a-f3a9-4e31-bee8-766c4e4a9248 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: c6d44f85-b513-4d3e-87de-71341677a30b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:07.574626 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c3804e2a-f3a9-4e31-bee8-766c4e4a9248 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:07.575436 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c3804e2a-f3a9-4e31-bee8-766c4e4a9248 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:07.576672 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c3804e2a-f3a9-4e31-bee8-766c4e4a9248 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:07.577417 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c3804e2a-f3a9-4e31-bee8-766c4e4a9248 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:08.276645 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c3804e2a-f3a9-4e31-bee8-766c4e4a9248 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2374fa8610714b72b6034726ee1c2373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe99772712849608ba124613bb5cc26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:08.311106 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c3804e2a-f3a9-4e31-bee8-766c4e4a9248 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b" status: 200 len: 1272 microversion: 2.1 time: 0.808397 Jul 18 02:31:08.315783 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1661/3317] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:07 2022] GET /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b => generated 1272 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:08.349531 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-345221ca-789b-4e94-8930-12ff2ae5bf09 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:08.351679 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-345221ca-789b-4e94-8930-12ff2ae5bf09 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] [instance: 122b7de0-abb6-4349-8559-f7cee46ef7d1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:08.372726 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-345221ca-789b-4e94-8930-12ff2ae5bf09 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:08.374143 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-345221ca-789b-4e94-8930-12ff2ae5bf09 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:08.375990 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-345221ca-789b-4e94-8930-12ff2ae5bf09 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:08.377288 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-345221ca-789b-4e94-8930-12ff2ae5bf09 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:08.493608 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=4 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:31:08.510132 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-55719477-649a-43b4-bdc6-f672fbc57f74 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:08.537575 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-55719477-649a-43b4-bdc6-f672fbc57f74 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:08.544134 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-55719477-649a-43b4-bdc6-f672fbc57f74 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:08.561830 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-55719477-649a-43b4-bdc6-f672fbc57f74 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] 10.222.0.57 "GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5" status: 200 len: 1358 microversion: 2.21 time: 2.079958 Jul 18 02:31:08.564436 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1657/3318] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:31:06 2022] GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 => generated 1358 bytes in 2100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:31:08.591385 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-146c6f73-a2ea-4807-8878-76fe72565872 req-d6768125-951f-43ca-8392-b5ae935ecaf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5", "name": "network-vif-plugged", "status": "completed", "tag": "646d4409-4837-4982-857b-78930b5b5535"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:08.627306 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-146c6f73-a2ea-4807-8878-76fe72565872 req-d6768125-951f-43ca-8392-b5ae935ecaf3 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:08.629212 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-146c6f73-a2ea-4807-8878-76fe72565872 req-d6768125-951f-43ca-8392-b5ae935ecaf3 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:08.650645 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-146c6f73-a2ea-4807-8878-76fe72565872 req-d6768125-951f-43ca-8392-b5ae935ecaf3 service nova] Creating event network-vif-plugged:646d4409-4837-4982-857b-78930b5b5535 for instance 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 on n-h1-465891-3 Jul 18 02:31:08.658074 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-146c6f73-a2ea-4807-8878-76fe72565872 req-d6768125-951f-43ca-8392-b5ae935ecaf3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091326 Jul 18 02:31:08.659096 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1658/3319] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:31:08.665799 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-695339ba-29e8-48aa-a854-ec67532c5acf tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:08.666512 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-695339ba-29e8-48aa-a854-ec67532c5acf tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 6faedf52-1ea8-4a05-8857-d0f8be1fadf9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:08.675236 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-695339ba-29e8-48aa-a854-ec67532c5acf tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:08.675976 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-695339ba-29e8-48aa-a854-ec67532c5acf tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:08.677313 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-695339ba-29e8-48aa-a854-ec67532c5acf tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:08.678082 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-695339ba-29e8-48aa-a854-ec67532c5acf tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:09.572164 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-345221ca-789b-4e94-8930-12ff2ae5bf09 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9299d3b336b4ca8b3ac5e8497e26ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5db9a43df045ea89156bf5f45f5108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:09.586905 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-345221ca-789b-4e94-8930-12ff2ae5bf09 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] 10.222.0.57 "GET /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1" status: 200 len: 1314 microversion: 2.1 time: 1.267437 Jul 18 02:31:09.590886 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1662/3320] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:08 2022] GET /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1 => generated 1314 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:09.598208 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-44d19f1b-0c51-4d41-a9a3-bd0f28407696 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:09.599208 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-44d19f1b-0c51-4d41-a9a3-bd0f28407696 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: c6d44f85-b513-4d3e-87de-71341677a30b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:09.632503 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-44d19f1b-0c51-4d41-a9a3-bd0f28407696 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:09.632975 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-44d19f1b-0c51-4d41-a9a3-bd0f28407696 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:09.637004 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-44d19f1b-0c51-4d41-a9a3-bd0f28407696 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:09.637470 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-44d19f1b-0c51-4d41-a9a3-bd0f28407696 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:09.880582 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-44d19f1b-0c51-4d41-a9a3-bd0f28407696 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2374fa8610714b72b6034726ee1c2373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe99772712849608ba124613bb5cc26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:09.884504 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-695339ba-29e8-48aa-a854-ec67532c5acf tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:09.909369 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-695339ba-29e8-48aa-a854-ec67532c5acf tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9" status: 200 len: 1333 microversion: 2.1 time: 1.238893 Jul 18 02:31:09.911792 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1659/3321] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:08 2022] GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9 => generated 1333 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:09.911908 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-44d19f1b-0c51-4d41-a9a3-bd0f28407696 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b" status: 200 len: 1272 microversion: 2.1 time: 0.318054 Jul 18 02:31:09.919120 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-33f40c74-e060-4f95-9cc8-b31723e69161 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:09.924456 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-33f40c74-e060-4f95-9cc8-b31723e69161 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] [instance: 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:09.931794 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1663/3322] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:09 2022] GET /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b => generated 1272 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:09.941880 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-33f40c74-e060-4f95-9cc8-b31723e69161 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:09.942329 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-33f40c74-e060-4f95-9cc8-b31723e69161 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:09.944664 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-33f40c74-e060-4f95-9cc8-b31723e69161 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:09.945395 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-33f40c74-e060-4f95-9cc8-b31723e69161 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:10.483227 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-33f40c74-e060-4f95-9cc8-b31723e69161 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:10.499157 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-33f40c74-e060-4f95-9cc8-b31723e69161 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:10.500799 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-33f40c74-e060-4f95-9cc8-b31723e69161 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:10.502514 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-33f40c74-e060-4f95-9cc8-b31723e69161 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] 10.222.0.57 "GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5" status: 200 len: 1358 microversion: 2.21 time: 0.589408 Jul 18 02:31:10.502948 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1660/3323] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:31:09 2022] GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 => generated 1358 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:31:10.624662 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-979224d5-40a1-41e6-a919-e4f648613f38 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:10.625955 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-979224d5-40a1-41e6-a919-e4f648613f38 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] [instance: 122b7de0-abb6-4349-8559-f7cee46ef7d1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:10.655051 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-979224d5-40a1-41e6-a919-e4f648613f38 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:10.655519 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-979224d5-40a1-41e6-a919-e4f648613f38 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:10.656347 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-979224d5-40a1-41e6-a919-e4f648613f38 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:10.656932 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-979224d5-40a1-41e6-a919-e4f648613f38 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:10.950431 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c788d908-d4c0-4d6f-83b9-372687c5f5e4 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:10.952538 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c788d908-d4c0-4d6f-83b9-372687c5f5e4 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 6faedf52-1ea8-4a05-8857-d0f8be1fadf9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:10.970391 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c788d908-d4c0-4d6f-83b9-372687c5f5e4 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:10.971234 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c788d908-d4c0-4d6f-83b9-372687c5f5e4 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:10.972283 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c788d908-d4c0-4d6f-83b9-372687c5f5e4 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:10.972982 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c788d908-d4c0-4d6f-83b9-372687c5f5e4 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:12.046158 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-979224d5-40a1-41e6-a919-e4f648613f38 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9299d3b336b4ca8b3ac5e8497e26ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5db9a43df045ea89156bf5f45f5108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:12.060475 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-979224d5-40a1-41e6-a919-e4f648613f38 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] 10.222.0.57 "GET /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1" status: 200 len: 1314 microversion: 2.1 time: 1.443096 Jul 18 02:31:12.083635 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1664/3324] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:10 2022] GET /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1 => generated 1314 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:12.092111 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2eb15ebf-2d70-443c-85a8-df5fcaf74bfa tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:12.092762 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2eb15ebf-2d70-443c-85a8-df5fcaf74bfa tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: c6d44f85-b513-4d3e-87de-71341677a30b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:12.113886 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2eb15ebf-2d70-443c-85a8-df5fcaf74bfa tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:12.114601 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2eb15ebf-2d70-443c-85a8-df5fcaf74bfa tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:12.115656 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2eb15ebf-2d70-443c-85a8-df5fcaf74bfa tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:12.116388 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2eb15ebf-2d70-443c-85a8-df5fcaf74bfa tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:12.399933 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c788d908-d4c0-4d6f-83b9-372687c5f5e4 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:12.457559 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c788d908-d4c0-4d6f-83b9-372687c5f5e4 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9" status: 200 len: 1354 microversion: 2.1 time: 1.520568 Jul 18 02:31:12.480363 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1661/3325] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:10 2022] GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9 => generated 1354 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:12.491338 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c71c58ad-9c75-45ee-bf04-a6e8c1f817e5 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:12.493012 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c71c58ad-9c75-45ee-bf04-a6e8c1f817e5 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] [instance: 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:12.525335 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c71c58ad-9c75-45ee-bf04-a6e8c1f817e5 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:12.528544 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c71c58ad-9c75-45ee-bf04-a6e8c1f817e5 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:12.536500 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c71c58ad-9c75-45ee-bf04-a6e8c1f817e5 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:12.538664 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c71c58ad-9c75-45ee-bf04-a6e8c1f817e5 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:13.451629 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:31:13.498445 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:31:14.169127 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2eb15ebf-2d70-443c-85a8-df5fcaf74bfa tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2374fa8610714b72b6034726ee1c2373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe99772712849608ba124613bb5cc26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:14.184992 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2eb15ebf-2d70-443c-85a8-df5fcaf74bfa tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b" status: 200 len: 1314 microversion: 2.1 time: 2.099725 Jul 18 02:31:14.194259 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1665/3326] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:12 2022] GET /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b => generated 1314 bytes in 2110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:14.210102 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c71c58ad-9c75-45ee-bf04-a6e8c1f817e5 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:14.212724 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=100 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:31:14.220807 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-1c90f276-b5c8-416d-b3a3-4e05a8cb9ec8 req-4071fdf1-1b95-459f-b74a-f6afefb4d550 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "122b7de0-abb6-4349-8559-f7cee46ef7d1", "tag": "3a9ceb82-5570-44ca-ba02-95c394949ab3"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:14.224379 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c71c58ad-9c75-45ee-bf04-a6e8c1f817e5 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:14.228659 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c71c58ad-9c75-45ee-bf04-a6e8c1f817e5 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:14.230833 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c71c58ad-9c75-45ee-bf04-a6e8c1f817e5 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] 10.222.0.57 "GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5" status: 200 len: 1550 microversion: 2.21 time: 1.747821 Jul 18 02:31:14.231531 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1662/3327] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:31:12 2022] GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 => generated 1550 bytes in 1750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:31:14.238386 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-72b9df4f-cb7c-4121-a16e-80409410da74 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:14.239822 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-1c90f276-b5c8-416d-b3a3-4e05a8cb9ec8 req-4071fdf1-1b95-459f-b74a-f6afefb4d550 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:14.240109 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-72b9df4f-cb7c-4121-a16e-80409410da74 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] [instance: 122b7de0-abb6-4349-8559-f7cee46ef7d1] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:14.241364 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-1c90f276-b5c8-416d-b3a3-4e05a8cb9ec8 req-4071fdf1-1b95-459f-b74a-f6afefb4d550 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:14.251666 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-72b9df4f-cb7c-4121-a16e-80409410da74 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:14.253163 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-72b9df4f-cb7c-4121-a16e-80409410da74 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:14.257395 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-72b9df4f-cb7c-4121-a16e-80409410da74 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:14.260833 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-72b9df4f-cb7c-4121-a16e-80409410da74 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:14.277394 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-1c90f276-b5c8-416d-b3a3-4e05a8cb9ec8 req-4071fdf1-1b95-459f-b74a-f6afefb4d550 service nova] Creating event network-changed:3a9ceb82-5570-44ca-ba02-95c394949ab3 for instance 122b7de0-abb6-4349-8559-f7cee46ef7d1 on n-h1-465891-3 Jul 18 02:31:14.301744 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-1c90f276-b5c8-416d-b3a3-4e05a8cb9ec8 req-4071fdf1-1b95-459f-b74a-f6afefb4d550 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105585 Jul 18 02:31:14.303751 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1666/3328] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:31:14.320851 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1e99cf95-3f0c-49c3-a9aa-340f787a8f61 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:14.325687 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1e99cf95-3f0c-49c3-a9aa-340f787a8f61 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 6faedf52-1ea8-4a05-8857-d0f8be1fadf9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:14.347319 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1e99cf95-3f0c-49c3-a9aa-340f787a8f61 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:14.350108 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1e99cf95-3f0c-49c3-a9aa-340f787a8f61 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:14.352187 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1e99cf95-3f0c-49c3-a9aa-340f787a8f61 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:14.354503 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1e99cf95-3f0c-49c3-a9aa-340f787a8f61 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:14.474351 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=26 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:31:15.207400 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-72b9df4f-cb7c-4121-a16e-80409410da74 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9299d3b336b4ca8b3ac5e8497e26ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5db9a43df045ea89156bf5f45f5108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:15.221541 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1e99cf95-3f0c-49c3-a9aa-340f787a8f61 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:15.243781 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1e99cf95-3f0c-49c3-a9aa-340f787a8f61 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9" status: 200 len: 1354 microversion: 2.1 time: 0.936723 Jul 18 02:31:15.244641 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1667/3329] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:14 2022] GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9 => generated 1354 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:15.260195 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-72b9df4f-cb7c-4121-a16e-80409410da74 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] 10.222.0.57 "GET /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1" status: 200 len: 1314 microversion: 2.1 time: 1.027028 Jul 18 02:31:15.261218 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1663/3330] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:14 2022] GET /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1 => generated 1314 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:15.263553 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-50ed06d9-3a5a-4b19-a18b-66e8a8226369 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:15.264911 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-50ed06d9-3a5a-4b19-a18b-66e8a8226369 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] [instance: 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:15.277406 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-48b2c28d-1c9c-4033-9412-76e1a3f7bdb8 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:15.278160 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-48b2c28d-1c9c-4033-9412-76e1a3f7bdb8 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: c6d44f85-b513-4d3e-87de-71341677a30b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:15.280223 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-50ed06d9-3a5a-4b19-a18b-66e8a8226369 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:15.280924 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-50ed06d9-3a5a-4b19-a18b-66e8a8226369 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:15.281964 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-50ed06d9-3a5a-4b19-a18b-66e8a8226369 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:15.282563 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-50ed06d9-3a5a-4b19-a18b-66e8a8226369 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:15.298985 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-48b2c28d-1c9c-4033-9412-76e1a3f7bdb8 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:15.299537 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-48b2c28d-1c9c-4033-9412-76e1a3f7bdb8 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:15.300466 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-48b2c28d-1c9c-4033-9412-76e1a3f7bdb8 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:15.300924 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-48b2c28d-1c9c-4033-9412-76e1a3f7bdb8 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:15.333218 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-50ed06d9-3a5a-4b19-a18b-66e8a8226369 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] [instance: 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:31:15.390724 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:31:15.463871 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:31:15.471449 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-50ed06d9-3a5a-4b19-a18b-66e8a8226369 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] 10.222.0.57 "DELETE /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5" status: 204 len: 0 microversion: 2.21 time: 0.213682 Jul 18 02:31:15.472972 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1668/3331] 10.222.0.57 () {60 vars in 1279 bytes} [Mon Jul 18 02:31:15 2022] DELETE /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:31:15.487466 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e4ed6fc4-ab9a-4ba2-a352-14347206a1ad tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:15.488232 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e4ed6fc4-ab9a-4ba2-a352-14347206a1ad tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] [instance: 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:15.497025 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e4ed6fc4-ab9a-4ba2-a352-14347206a1ad tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:15.497470 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e4ed6fc4-ab9a-4ba2-a352-14347206a1ad tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:15.498369 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e4ed6fc4-ab9a-4ba2-a352-14347206a1ad tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:15.498903 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e4ed6fc4-ab9a-4ba2-a352-14347206a1ad tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:15.947816 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-48b2c28d-1c9c-4033-9412-76e1a3f7bdb8 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2374fa8610714b72b6034726ee1c2373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe99772712849608ba124613bb5cc26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:15.966940 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-48b2c28d-1c9c-4033-9412-76e1a3f7bdb8 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b" status: 200 len: 1314 microversion: 2.1 time: 0.701423 Jul 18 02:31:15.971686 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1664/3332] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:15 2022] GET /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b => generated 1314 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:16.033074 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e4ed6fc4-ab9a-4ba2-a352-14347206a1ad tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:16.056780 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e4ed6fc4-ab9a-4ba2-a352-14347206a1ad tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:16.058551 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e4ed6fc4-ab9a-4ba2-a352-14347206a1ad tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:16.059844 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e4ed6fc4-ab9a-4ba2-a352-14347206a1ad tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] 10.222.0.57 "GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5" status: 200 len: 1556 microversion: 2.21 time: 0.582160 Jul 18 02:31:16.060442 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1669/3333] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:31:15 2022] GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 => generated 1556 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:31:16.257961 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-6021bf35-dd77-4489-a89a-a5b7508d6e9a req-f73c68b0-70a1-4de5-abdb-03ad045861d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6d44f85-b513-4d3e-87de-71341677a30b", "tag": "a415076e-e7de-4e2a-a80b-075323147f76"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:16.262242 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ce931699-9d50-481f-8c6b-65aaccb09d94 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:16.263534 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ce931699-9d50-481f-8c6b-65aaccb09d94 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 6faedf52-1ea8-4a05-8857-d0f8be1fadf9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:16.273569 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ce931699-9d50-481f-8c6b-65aaccb09d94 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:16.278051 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ce931699-9d50-481f-8c6b-65aaccb09d94 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:16.279461 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ce931699-9d50-481f-8c6b-65aaccb09d94 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:16.284291 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ce931699-9d50-481f-8c6b-65aaccb09d94 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:16.352485 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-6021bf35-dd77-4489-a89a-a5b7508d6e9a req-f73c68b0-70a1-4de5-abdb-03ad045861d0 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:16.356501 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-6021bf35-dd77-4489-a89a-a5b7508d6e9a req-f73c68b0-70a1-4de5-abdb-03ad045861d0 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:16.389028 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-6021bf35-dd77-4489-a89a-a5b7508d6e9a req-f73c68b0-70a1-4de5-abdb-03ad045861d0 service nova] Creating event network-changed:a415076e-e7de-4e2a-a80b-075323147f76 for instance c6d44f85-b513-4d3e-87de-71341677a30b on n-h2-465891-3 Jul 18 02:31:16.402219 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-6021bf35-dd77-4489-a89a-a5b7508d6e9a req-f73c68b0-70a1-4de5-abdb-03ad045861d0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152084 Jul 18 02:31:16.408876 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1665/3334] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:31:16.422329 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-989eeb90-3585-43d1-b95e-acc111a563be tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:16.423960 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-989eeb90-3585-43d1-b95e-acc111a563be tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] [instance: 122b7de0-abb6-4349-8559-f7cee46ef7d1] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:16.451455 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-989eeb90-3585-43d1-b95e-acc111a563be tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:16.452980 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-989eeb90-3585-43d1-b95e-acc111a563be tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:16.454784 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-989eeb90-3585-43d1-b95e-acc111a563be tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:16.455511 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-989eeb90-3585-43d1-b95e-acc111a563be tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:17.277496 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ce931699-9d50-481f-8c6b-65aaccb09d94 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:17.303328 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ce931699-9d50-481f-8c6b-65aaccb09d94 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9" status: 200 len: 1354 microversion: 2.1 time: 1.044891 Jul 18 02:31:17.326016 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1670/3335] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:16 2022] GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9 => generated 1354 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:31:17.337749 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-04818970-787e-4f72-8ea1-eab744b6c289 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:17.340988 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-04818970-787e-4f72-8ea1-eab744b6c289 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: c6d44f85-b513-4d3e-87de-71341677a30b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:17.356975 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-04818970-787e-4f72-8ea1-eab744b6c289 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:17.358537 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-04818970-787e-4f72-8ea1-eab744b6c289 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:17.361464 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-04818970-787e-4f72-8ea1-eab744b6c289 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:17.363330 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-04818970-787e-4f72-8ea1-eab744b6c289 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:17.767894 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-989eeb90-3585-43d1-b95e-acc111a563be tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9299d3b336b4ca8b3ac5e8497e26ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5db9a43df045ea89156bf5f45f5108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:17.782669 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-989eeb90-3585-43d1-b95e-acc111a563be tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] 10.222.0.57 "GET /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1" status: 200 len: 1314 microversion: 2.1 time: 1.370672 Jul 18 02:31:17.783864 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1666/3336] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:16 2022] GET /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1 => generated 1314 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:17.790729 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c0957d15-db74-49ef-a234-55264e5515d6 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:17.791693 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c0957d15-db74-49ef-a234-55264e5515d6 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] [instance: 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:17.804366 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c0957d15-db74-49ef-a234-55264e5515d6 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:17.805197 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c0957d15-db74-49ef-a234-55264e5515d6 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:17.806345 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c0957d15-db74-49ef-a234-55264e5515d6 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:17.806972 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c0957d15-db74-49ef-a234-55264e5515d6 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:19.112478 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-04818970-787e-4f72-8ea1-eab744b6c289 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2374fa8610714b72b6034726ee1c2373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe99772712849608ba124613bb5cc26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:19.136975 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-04818970-787e-4f72-8ea1-eab744b6c289 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b" status: 200 len: 1314 microversion: 2.1 time: 1.808138 Jul 18 02:31:19.138896 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1671/3337] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:17 2022] GET /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b => generated 1314 bytes in 1812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:19.148488 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-56815b07-1db5-45aa-95de-d462ae746918 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:19.150614 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-56815b07-1db5-45aa-95de-d462ae746918 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 6faedf52-1ea8-4a05-8857-d0f8be1fadf9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:19.163299 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56815b07-1db5-45aa-95de-d462ae746918 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:19.164541 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56815b07-1db5-45aa-95de-d462ae746918 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:19.167097 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56815b07-1db5-45aa-95de-d462ae746918 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:19.168591 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56815b07-1db5-45aa-95de-d462ae746918 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:19.340597 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c0957d15-db74-49ef-a234-55264e5515d6 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:19.374713 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c0957d15-db74-49ef-a234-55264e5515d6 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:19.383556 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c0957d15-db74-49ef-a234-55264e5515d6 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:19.388534 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c0957d15-db74-49ef-a234-55264e5515d6 tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] 10.222.0.57 "GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5" status: 200 len: 1556 microversion: 2.21 time: 1.601766 Jul 18 02:31:19.420253 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1667/3338] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:31:17 2022] GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 => generated 1556 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:31:19.435667 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-707eae9f-a268-48a0-80d6-4b677dfd9fa8 req-e360be38-27c8-4029-9813-7da7f90dc696 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6faedf52-1ea8-4a05-8857-d0f8be1fadf9", "tag": "cd0b98f1-7816-4d96-9904-dec1420e3c34"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:19.458749 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-707eae9f-a268-48a0-80d6-4b677dfd9fa8 req-e360be38-27c8-4029-9813-7da7f90dc696 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:19.460058 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-707eae9f-a268-48a0-80d6-4b677dfd9fa8 req-e360be38-27c8-4029-9813-7da7f90dc696 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:19.495271 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-707eae9f-a268-48a0-80d6-4b677dfd9fa8 req-e360be38-27c8-4029-9813-7da7f90dc696 service nova] Creating event network-changed:cd0b98f1-7816-4d96-9904-dec1420e3c34 for instance 6faedf52-1ea8-4a05-8857-d0f8be1fadf9 on n-h2-465891-3 Jul 18 02:31:19.503140 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-707eae9f-a268-48a0-80d6-4b677dfd9fa8 req-e360be38-27c8-4029-9813-7da7f90dc696 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080175 Jul 18 02:31:19.504523 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1668/3339] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:31:19.511907 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c6f80177-3657-4ad9-81ab-2e5927aa7a77 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:19.512945 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c6f80177-3657-4ad9-81ab-2e5927aa7a77 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] [instance: 122b7de0-abb6-4349-8559-f7cee46ef7d1] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:19.538098 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c6f80177-3657-4ad9-81ab-2e5927aa7a77 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:19.538823 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c6f80177-3657-4ad9-81ab-2e5927aa7a77 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:19.547896 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c6f80177-3657-4ad9-81ab-2e5927aa7a77 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:19.548851 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c6f80177-3657-4ad9-81ab-2e5927aa7a77 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:20.064992 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-56815b07-1db5-45aa-95de-d462ae746918 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:20.094782 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-56815b07-1db5-45aa-95de-d462ae746918 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9" status: 200 len: 1354 microversion: 2.1 time: 0.953683 Jul 18 02:31:20.113111 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1672/3340] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:19 2022] GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9 => generated 1354 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:20.169037 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-485a914f-8830-4cfe-82d7-5726dff9abef tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:20.170824 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-485a914f-8830-4cfe-82d7-5726dff9abef tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: c6d44f85-b513-4d3e-87de-71341677a30b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:20.200552 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-485a914f-8830-4cfe-82d7-5726dff9abef tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:20.202117 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-485a914f-8830-4cfe-82d7-5726dff9abef tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:20.207176 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-485a914f-8830-4cfe-82d7-5726dff9abef tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:20.208593 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-485a914f-8830-4cfe-82d7-5726dff9abef tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:20.374449 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c6f80177-3657-4ad9-81ab-2e5927aa7a77 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9299d3b336b4ca8b3ac5e8497e26ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5db9a43df045ea89156bf5f45f5108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:20.394961 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c6f80177-3657-4ad9-81ab-2e5927aa7a77 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] 10.222.0.57 "GET /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1" status: 200 len: 1314 microversion: 2.1 time: 0.887964 Jul 18 02:31:20.397161 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1669/3341] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:19 2022] GET /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1 => generated 1314 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:20.433859 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bb087231-b8a2-47bb-955b-f22a7fd84aba tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:20.435861 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bb087231-b8a2-47bb-955b-f22a7fd84aba tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] [instance: 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:20.458417 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb087231-b8a2-47bb-955b-f22a7fd84aba tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:20.459765 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb087231-b8a2-47bb-955b-f22a7fd84aba tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:20.463106 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb087231-b8a2-47bb-955b-f22a7fd84aba tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:20.464389 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb087231-b8a2-47bb-955b-f22a7fd84aba tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:21.759167 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bb087231-b8a2-47bb-955b-f22a7fd84aba tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:21.778898 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bb087231-b8a2-47bb-955b-f22a7fd84aba tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:21.782868 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bb087231-b8a2-47bb-955b-f22a7fd84aba tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:21.786506 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bb087231-b8a2-47bb-955b-f22a7fd84aba tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] 10.222.0.57 "GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5" status: 200 len: 1556 microversion: 2.21 time: 1.361234 Jul 18 02:31:21.804057 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1670/3342] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:31:20 2022] GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 => generated 1556 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:31:21.822719 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4e684392-36f0-491b-9e42-edd7c99271c5 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:21.825559 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4e684392-36f0-491b-9e42-edd7c99271c5 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 6faedf52-1ea8-4a05-8857-d0f8be1fadf9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:21.838547 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e684392-36f0-491b-9e42-edd7c99271c5 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:21.839429 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e684392-36f0-491b-9e42-edd7c99271c5 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:21.840443 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e684392-36f0-491b-9e42-edd7c99271c5 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:21.841059 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e684392-36f0-491b-9e42-edd7c99271c5 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:22.354276 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-485a914f-8830-4cfe-82d7-5726dff9abef tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2374fa8610714b72b6034726ee1c2373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe99772712849608ba124613bb5cc26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:22.386588 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-485a914f-8830-4cfe-82d7-5726dff9abef tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b" status: 200 len: 1314 microversion: 2.1 time: 2.230936 Jul 18 02:31:22.387700 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1673/3343] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:20 2022] GET /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b => generated 1314 bytes in 2234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:22.410301 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b7360655-9ed4-46f7-8ae5-0a9afb723bf3 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:22.411995 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b7360655-9ed4-46f7-8ae5-0a9afb723bf3 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] [instance: 122b7de0-abb6-4349-8559-f7cee46ef7d1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:22.431859 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b7360655-9ed4-46f7-8ae5-0a9afb723bf3 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:22.433330 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b7360655-9ed4-46f7-8ae5-0a9afb723bf3 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:22.435309 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b7360655-9ed4-46f7-8ae5-0a9afb723bf3 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:22.436777 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b7360655-9ed4-46f7-8ae5-0a9afb723bf3 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:24.047270 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4e684392-36f0-491b-9e42-edd7c99271c5 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:24.092979 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4e684392-36f0-491b-9e42-edd7c99271c5 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9" status: 200 len: 1354 microversion: 2.1 time: 2.285765 Jul 18 02:31:24.095132 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1671/3344] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:21 2022] GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9 => generated 1354 bytes in 2290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:24.120618 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2a849c97-b591-462c-a50e-41d8f20c581a tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:24.124236 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2a849c97-b591-462c-a50e-41d8f20c581a tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] [instance: 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:24.135908 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:31:24.139255 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2a849c97-b591-462c-a50e-41d8f20c581a tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:24.140412 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2a849c97-b591-462c-a50e-41d8f20c581a tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:24.142184 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2a849c97-b591-462c-a50e-41d8f20c581a tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:24.143464 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2a849c97-b591-462c-a50e-41d8f20c581a tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:24.270701 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2a849c97-b591-462c-a50e-41d8f20c581a tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:24.273300 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2a849c97-b591-462c-a50e-41d8f20c581a tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:24.277032 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-2a849c97-b591-462c-a50e-41d8f20c581a tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lazy-loading 'fault' on Instance uuid 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:31:24.556559 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2a849c97-b591-462c-a50e-41d8f20c581a tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:24.583976 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2a849c97-b591-462c-a50e-41d8f20c581a tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:24.589867 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2a849c97-b591-462c-a50e-41d8f20c581a tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f973a57c7be4a4892065eb6bbe23e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a37eb4e7dc04c2e858a1723665d77c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:24.591709 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2a849c97-b591-462c-a50e-41d8f20c581a tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] 10.222.0.57 "GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5" status: 200 len: 1348 microversion: 2.21 time: 0.493951 Jul 18 02:31:24.593065 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1672/3345] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:31:24 2022] GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 => generated 1348 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:31:24.599451 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5098f4f6-fc67-411c-9ef9-2e734a9da527 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:24.600598 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5098f4f6-fc67-411c-9ef9-2e734a9da527 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: c6d44f85-b513-4d3e-87de-71341677a30b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:24.609631 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5098f4f6-fc67-411c-9ef9-2e734a9da527 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:24.610508 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5098f4f6-fc67-411c-9ef9-2e734a9da527 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:24.613551 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5098f4f6-fc67-411c-9ef9-2e734a9da527 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:24.614404 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5098f4f6-fc67-411c-9ef9-2e734a9da527 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:24.969418 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b7360655-9ed4-46f7-8ae5-0a9afb723bf3 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9299d3b336b4ca8b3ac5e8497e26ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5db9a43df045ea89156bf5f45f5108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:24.988986 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b7360655-9ed4-46f7-8ae5-0a9afb723bf3 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] 10.222.0.57 "GET /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1" status: 200 len: 1314 microversion: 2.1 time: 2.595511 Jul 18 02:31:24.990609 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1674/3346] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:22 2022] GET /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1 => generated 1314 bytes in 2601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:24.997358 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-59bf725a-1571-4ef3-a4c8-ba40d3e63884 req-837be454-d84b-4250-9dfe-4d79d80d5847 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5", "name": "network-vif-deleted", "tag": "646d4409-4837-4982-857b-78930b5b5535"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:25.020749 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-59bf725a-1571-4ef3-a4c8-ba40d3e63884 req-837be454-d84b-4250-9dfe-4d79d80d5847 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:25.022417 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-59bf725a-1571-4ef3-a4c8-ba40d3e63884 req-837be454-d84b-4250-9dfe-4d79d80d5847 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:25.067469 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-59bf725a-1571-4ef3-a4c8-ba40d3e63884 req-837be454-d84b-4250-9dfe-4d79d80d5847 service nova] Creating event network-vif-deleted:646d4409-4837-4982-857b-78930b5b5535 for instance 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 on n-h1-465891-3 Jul 18 02:31:25.076475 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-59bf725a-1571-4ef3-a4c8-ba40d3e63884 req-837be454-d84b-4250-9dfe-4d79d80d5847 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084083 Jul 18 02:31:25.078075 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1675/3347] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:31:25.132123 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d4814274-98d1-4f61-8784-d5a13c212b64 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:25.133150 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d4814274-98d1-4f61-8784-d5a13c212b64 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 6faedf52-1ea8-4a05-8857-d0f8be1fadf9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:25.155381 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d4814274-98d1-4f61-8784-d5a13c212b64 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:25.158209 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d4814274-98d1-4f61-8784-d5a13c212b64 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:25.162079 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d4814274-98d1-4f61-8784-d5a13c212b64 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:25.163979 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d4814274-98d1-4f61-8784-d5a13c212b64 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:25.769683 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5098f4f6-fc67-411c-9ef9-2e734a9da527 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2374fa8610714b72b6034726ee1c2373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe99772712849608ba124613bb5cc26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:25.788180 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5098f4f6-fc67-411c-9ef9-2e734a9da527 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b" status: 200 len: 1314 microversion: 2.1 time: 1.192687 Jul 18 02:31:25.793314 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1673/3348] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:24 2022] GET /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b => generated 1314 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:25.809468 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-58564604-2ad0-4eb8-8c50-62a3a7442b4a tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:25.810845 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-58564604-2ad0-4eb8-8c50-62a3a7442b4a tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] [instance: 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:25.830923 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-58564604-2ad0-4eb8-8c50-62a3a7442b4a tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:25.831709 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-58564604-2ad0-4eb8-8c50-62a3a7442b4a tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:25.833213 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-58564604-2ad0-4eb8-8c50-62a3a7442b4a tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:25.836624 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-58564604-2ad0-4eb8-8c50-62a3a7442b4a tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:25.884206 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-58564604-2ad0-4eb8-8c50-62a3a7442b4a tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] HTTP exception thrown: Instance 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 could not be found. Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-58564604-2ad0-4eb8-8c50-62a3a7442b4a tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Request method failure captured: Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 HTTP/1.1 Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MXCy0iUhiomuEb7GiOHgyiz8bEfNdR7Vi_mtvYHoa29JzULXyQ44pPaO-5rEBFpPKbq1tcvpVMFfvkB83wAJYX8EIzr0Xjw1W2yW8naMOib1fu9bmmGqlnxuKmcyWdVawQXwAbqkm8Jr6QeBHbbaHyVbO2prat8sBMaQ_oDMNmVRt4 Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: X-Openstack-Nova-Api-Version: 2.21 Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 1a37eb4e7dc04c2e858a1723665d77c2 Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-InstanceActionsV221TestJSON-397205035 Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1a37eb4e7dc04c2e858a1723665d77c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1a37eb4e7dc04c2e858a1723665d77c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1a37eb4e7dc04c2e858a1723665d77c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1a37eb4e7dc04c2e858a1723665d77c2"}]}] Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-InstanceActionsV221TestJSON-397205035 Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 1a37eb4e7dc04c2e858a1723665d77c2 Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-397205035 Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-InstanceActionsV221TestJSON-397205035-project Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 0f973a57c7be4a4892065eb6bbe23e39 Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-InstanceActionsV221TestJSON-397205035-project Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 could not be found. Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5'} Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 could not be found. Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 could not be found. Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:31:25.894159 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:25.902417 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:31:25.902417 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:25.902417 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:31:25.902417 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:31:25.902417 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:31:25.902417 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:31:25.902417 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 could not be found. Jul 18 02:31:25.902417 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:31:25.902417 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-58564604-2ad0-4eb8-8c50-62a3a7442b4a tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Returning 404 to user: Instance 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:31:25.902417 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-58564604-2ad0-4eb8-8c50-62a3a7442b4a tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] 10.222.0.57 "GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5" status: 404 len: 111 microversion: 2.21 time: 0.101490 Jul 18 02:31:25.910840 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1674/3349] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:31:25 2022] GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:31:25.927810 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2fe6e854-1164-4105-b265-f605874336ae tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Calling method '.version_select at 0x7ff49bd94e50>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:25.928608 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2fe6e854-1164-4105-b265-f605874336ae tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] [instance: 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:25.938063 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2fe6e854-1164-4105-b265-f605874336ae tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:25.938990 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2fe6e854-1164-4105-b265-f605874336ae tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:25.939976 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2fe6e854-1164-4105-b265-f605874336ae tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:25.940506 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2fe6e854-1164-4105-b265-f605874336ae tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:26.124429 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2fe6e854-1164-4105-b265-f605874336ae tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] 10.222.0.57 "GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.206317 Jul 18 02:31:26.129597 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1675/3350] 10.222.0.57 () {60 vars in 1336 bytes} [Mon Jul 18 02:31:25 2022] GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5/os-instance-actions => generated 611 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 02:31:26.146140 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b07bb43b-f399-49ad-9770-d77783afd8f7 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:26.146781 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b07bb43b-f399-49ad-9770-d77783afd8f7 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] [instance: 122b7de0-abb6-4349-8559-f7cee46ef7d1] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:26.160881 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b07bb43b-f399-49ad-9770-d77783afd8f7 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:26.161818 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b07bb43b-f399-49ad-9770-d77783afd8f7 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:26.164760 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b07bb43b-f399-49ad-9770-d77783afd8f7 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:26.165657 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b07bb43b-f399-49ad-9770-d77783afd8f7 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:26.304628 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d4814274-98d1-4f61-8784-d5a13c212b64 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:26.329648 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d4814274-98d1-4f61-8784-d5a13c212b64 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9" status: 200 len: 1354 microversion: 2.1 time: 1.203154 Jul 18 02:31:26.331839 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1676/3351] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:25 2022] GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9 => generated 1354 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:31:26.359992 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a9c1935b-b4e9-4a2d-bb9b-83c42ac2f5ea tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:26.366353 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a9c1935b-b4e9-4a2d-bb9b-83c42ac2f5ea tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] [instance: 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:26.385846 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9c1935b-b4e9-4a2d-bb9b-83c42ac2f5ea tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:26.388552 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9c1935b-b4e9-4a2d-bb9b-83c42ac2f5ea tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:26.390713 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9c1935b-b4e9-4a2d-bb9b-83c42ac2f5ea tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:26.392706 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9c1935b-b4e9-4a2d-bb9b-83c42ac2f5ea tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:26.429356 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-a9c1935b-b4e9-4a2d-bb9b-83c42ac2f5ea tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] HTTP exception thrown: Instance 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 could not be found. Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a9c1935b-b4e9-4a2d-bb9b-83c42ac2f5ea tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Request method failure captured: Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 HTTP/1.1 Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MXCy0iUhiomuEb7GiOHgyiz8bEfNdR7Vi_mtvYHoa29JzULXyQ44pPaO-5rEBFpPKbq1tcvpVMFfvkB83wAJYX8EIzr0Xjw1W2yW8naMOib1fu9bmmGqlnxuKmcyWdVawQXwAbqkm8Jr6QeBHbbaHyVbO2prat8sBMaQ_oDMNmVRt4 Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: X-Openstack-Nova-Api-Version: 2.21 Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 1a37eb4e7dc04c2e858a1723665d77c2 Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-InstanceActionsV221TestJSON-397205035 Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1a37eb4e7dc04c2e858a1723665d77c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1a37eb4e7dc04c2e858a1723665d77c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1a37eb4e7dc04c2e858a1723665d77c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1a37eb4e7dc04c2e858a1723665d77c2"}]}] Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-InstanceActionsV221TestJSON-397205035 Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 1a37eb4e7dc04c2e858a1723665d77c2 Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-397205035 Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-InstanceActionsV221TestJSON-397205035-project Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 0f973a57c7be4a4892065eb6bbe23e39 Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-InstanceActionsV221TestJSON-397205035-project Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 could not be found. Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5'} Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 could not be found. Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:31:26.435355 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:31:26.447053 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 could not be found. Jul 18 02:31:26.447053 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:31:26.447053 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:26.447053 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:31:26.447053 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:26.447053 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:31:26.447053 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:31:26.447053 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:31:26.447053 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:31:26.447053 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 could not be found. Jul 18 02:31:26.447053 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:31:26.451566 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a9c1935b-b4e9-4a2d-bb9b-83c42ac2f5ea tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Returning 404 to user: Instance 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:31:26.454304 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a9c1935b-b4e9-4a2d-bb9b-83c42ac2f5ea tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] 10.222.0.57 "DELETE /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5" status: 404 len: 111 microversion: 2.21 time: 0.120118 Jul 18 02:31:26.463655 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1677/3352] 10.222.0.57 () {60 vars in 1279 bytes} [Mon Jul 18 02:31:26 2022] DELETE /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:31:26.471800 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3c7c6cd7-03d8-4795-87b2-afda819a852f tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:26.473609 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3c7c6cd7-03d8-4795-87b2-afda819a852f tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] [instance: 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:26.495458 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3c7c6cd7-03d8-4795-87b2-afda819a852f tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:26.496825 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3c7c6cd7-03d8-4795-87b2-afda819a852f tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:26.498223 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3c7c6cd7-03d8-4795-87b2-afda819a852f tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:26.499917 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3c7c6cd7-03d8-4795-87b2-afda819a852f tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:26.536086 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-3c7c6cd7-03d8-4795-87b2-afda819a852f tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] HTTP exception thrown: Instance 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 could not be found. Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3c7c6cd7-03d8-4795-87b2-afda819a852f tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Request method failure captured: Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 HTTP/1.1 Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MXCy0iUhiomuEb7GiOHgyiz8bEfNdR7Vi_mtvYHoa29JzULXyQ44pPaO-5rEBFpPKbq1tcvpVMFfvkB83wAJYX8EIzr0Xjw1W2yW8naMOib1fu9bmmGqlnxuKmcyWdVawQXwAbqkm8Jr6QeBHbbaHyVbO2prat8sBMaQ_oDMNmVRt4 Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: X-Openstack-Nova-Api-Version: 2.21 Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 1a37eb4e7dc04c2e858a1723665d77c2 Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-InstanceActionsV221TestJSON-397205035 Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1a37eb4e7dc04c2e858a1723665d77c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1a37eb4e7dc04c2e858a1723665d77c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1a37eb4e7dc04c2e858a1723665d77c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1a37eb4e7dc04c2e858a1723665d77c2"}]}] Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-InstanceActionsV221TestJSON-397205035 Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 1a37eb4e7dc04c2e858a1723665d77c2 Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-397205035 Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-InstanceActionsV221TestJSON-397205035-project Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 0f973a57c7be4a4892065eb6bbe23e39 Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-InstanceActionsV221TestJSON-397205035-project Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 could not be found. Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5'} Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 could not be found. Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 could not be found. Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:31:26.570528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:26.580262 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:31:26.580262 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:26.580262 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:31:26.580262 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:31:26.580262 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:31:26.580262 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:31:26.580262 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 could not be found. Jul 18 02:31:26.580262 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:31:26.580262 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3c7c6cd7-03d8-4795-87b2-afda819a852f tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] Returning 404 to user: Instance 6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:31:26.583549 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3c7c6cd7-03d8-4795-87b2-afda819a852f tempest-InstanceActionsV221TestJSON-397205035 tempest-InstanceActionsV221TestJSON-397205035-project] 10.222.0.57 "GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5" status: 404 len: 111 microversion: 2.21 time: 0.115525 Jul 18 02:31:26.595061 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1678/3353] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:31:26 2022] GET /compute/v2.1/servers/6c2a2131-681f-4b6c-a1ad-d579e7ab0dc5 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:31:26.831324 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-d83b4bf3-951d-422b-821a-3db8bdeae40d req-e0592e5d-660d-4d71-b9f5-af23cde1a2e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "122b7de0-abb6-4349-8559-f7cee46ef7d1", "name": "network-vif-plugged", "status": "completed", "tag": "3a9ceb82-5570-44ca-ba02-95c394949ab3"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:26.865206 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-d83b4bf3-951d-422b-821a-3db8bdeae40d req-e0592e5d-660d-4d71-b9f5-af23cde1a2e1 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:26.866427 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-d83b4bf3-951d-422b-821a-3db8bdeae40d req-e0592e5d-660d-4d71-b9f5-af23cde1a2e1 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:26.891841 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-d83b4bf3-951d-422b-821a-3db8bdeae40d req-e0592e5d-660d-4d71-b9f5-af23cde1a2e1 service nova] Creating event network-vif-plugged:3a9ceb82-5570-44ca-ba02-95c394949ab3 for instance 122b7de0-abb6-4349-8559-f7cee46ef7d1 on n-h1-465891-3 Jul 18 02:31:26.908915 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-d83b4bf3-951d-422b-821a-3db8bdeae40d req-e0592e5d-660d-4d71-b9f5-af23cde1a2e1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098001 Jul 18 02:31:26.911557 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1679/3354] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:31:26.929662 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-30479a88-7481-4488-a91d-492de7b4183f tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:26.934813 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-30479a88-7481-4488-a91d-492de7b4183f tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: c6d44f85-b513-4d3e-87de-71341677a30b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:26.946295 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-30479a88-7481-4488-a91d-492de7b4183f tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:26.947005 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-30479a88-7481-4488-a91d-492de7b4183f tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:26.950062 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-30479a88-7481-4488-a91d-492de7b4183f tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:26.998038 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-30479a88-7481-4488-a91d-492de7b4183f tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:27.267588 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b07bb43b-f399-49ad-9770-d77783afd8f7 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9299d3b336b4ca8b3ac5e8497e26ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5db9a43df045ea89156bf5f45f5108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:27.309218 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b07bb43b-f399-49ad-9770-d77783afd8f7 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] 10.222.0.57 "GET /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1" status: 200 len: 1314 microversion: 2.1 time: 1.173101 Jul 18 02:31:27.310892 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1676/3355] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:26 2022] GET /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1 => generated 1314 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:27.326618 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-e2d0a5e0-3de1-49f1-a0a1-5ad87e5d4015 req-6fb645e6-4c99-43fe-aa02-e0888be24f82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6faedf52-1ea8-4a05-8857-d0f8be1fadf9", "tag": "a2743901-0f11-4760-a3f9-8ba646c29310"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:27.357438 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-e2d0a5e0-3de1-49f1-a0a1-5ad87e5d4015 req-6fb645e6-4c99-43fe-aa02-e0888be24f82 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:27.361777 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-e2d0a5e0-3de1-49f1-a0a1-5ad87e5d4015 req-6fb645e6-4c99-43fe-aa02-e0888be24f82 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:27.394571 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-e2d0a5e0-3de1-49f1-a0a1-5ad87e5d4015 req-6fb645e6-4c99-43fe-aa02-e0888be24f82 service nova] Creating event network-changed:a2743901-0f11-4760-a3f9-8ba646c29310 for instance 6faedf52-1ea8-4a05-8857-d0f8be1fadf9 on n-h2-465891-3 Jul 18 02:31:27.403475 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-e2d0a5e0-3de1-49f1-a0a1-5ad87e5d4015 req-6fb645e6-4c99-43fe-aa02-e0888be24f82 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088869 Jul 18 02:31:27.404919 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1677/3356] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:31:27.411727 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-80a07d7f-9db2-4c01-b90e-6634806cb241 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:27.412804 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-80a07d7f-9db2-4c01-b90e-6634806cb241 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 6faedf52-1ea8-4a05-8857-d0f8be1fadf9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:27.422407 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-80a07d7f-9db2-4c01-b90e-6634806cb241 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:27.424074 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-80a07d7f-9db2-4c01-b90e-6634806cb241 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:27.425182 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-80a07d7f-9db2-4c01-b90e-6634806cb241 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:27.425998 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-80a07d7f-9db2-4c01-b90e-6634806cb241 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:28.520790 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-30479a88-7481-4488-a91d-492de7b4183f tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2374fa8610714b72b6034726ee1c2373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe99772712849608ba124613bb5cc26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:28.560170 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-30479a88-7481-4488-a91d-492de7b4183f tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b" status: 200 len: 1314 microversion: 2.1 time: 1.645054 Jul 18 02:31:28.566186 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1680/3357] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:26 2022] GET /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b => generated 1314 bytes in 1654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:28.592841 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4eead082-45e6-49d0-afb2-f930bba063af tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:28.594069 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4eead082-45e6-49d0-afb2-f930bba063af tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] [instance: 122b7de0-abb6-4349-8559-f7cee46ef7d1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:28.606755 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4eead082-45e6-49d0-afb2-f930bba063af tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:28.607887 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4eead082-45e6-49d0-afb2-f930bba063af tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:28.609858 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4eead082-45e6-49d0-afb2-f930bba063af tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:28.610966 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4eead082-45e6-49d0-afb2-f930bba063af tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:28.824937 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-80a07d7f-9db2-4c01-b90e-6634806cb241 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:28.850302 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-80a07d7f-9db2-4c01-b90e-6634806cb241 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9" status: 200 len: 1354 microversion: 2.1 time: 1.437968 Jul 18 02:31:28.851183 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1678/3358] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:27 2022] GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9 => generated 1354 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:28.949873 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-fac3e996-baab-4ab2-b677-ea891374fbbd req-8b9b9add-52ab-423f-a480-fe9be5177305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6d44f85-b513-4d3e-87de-71341677a30b", "name": "network-vif-plugged", "status": "completed", "tag": "a415076e-e7de-4e2a-a80b-075323147f76"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:28.976636 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-fac3e996-baab-4ab2-b677-ea891374fbbd req-8b9b9add-52ab-423f-a480-fe9be5177305 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:28.977294 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-fac3e996-baab-4ab2-b677-ea891374fbbd req-8b9b9add-52ab-423f-a480-fe9be5177305 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:29.017912 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-fac3e996-baab-4ab2-b677-ea891374fbbd req-8b9b9add-52ab-423f-a480-fe9be5177305 service nova] Creating event network-vif-plugged:a415076e-e7de-4e2a-a80b-075323147f76 for instance c6d44f85-b513-4d3e-87de-71341677a30b on n-h2-465891-3 Jul 18 02:31:29.034713 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-fac3e996-baab-4ab2-b677-ea891374fbbd req-8b9b9add-52ab-423f-a480-fe9be5177305 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088868 Jul 18 02:31:29.035816 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1679/3359] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:31:29.597090 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6215870e-0c9b-4b47-8e2f-ae6ad7cab3ef tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:29.598171 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6215870e-0c9b-4b47-8e2f-ae6ad7cab3ef tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: c6d44f85-b513-4d3e-87de-71341677a30b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:29.614121 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6215870e-0c9b-4b47-8e2f-ae6ad7cab3ef tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:29.621577 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6215870e-0c9b-4b47-8e2f-ae6ad7cab3ef tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:29.622748 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6215870e-0c9b-4b47-8e2f-ae6ad7cab3ef tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:29.623333 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6215870e-0c9b-4b47-8e2f-ae6ad7cab3ef tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:29.898861 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4eead082-45e6-49d0-afb2-f930bba063af tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9299d3b336b4ca8b3ac5e8497e26ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5db9a43df045ea89156bf5f45f5108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:29.934728 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4eead082-45e6-49d0-afb2-f930bba063af tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] 10.222.0.57 "GET /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1" status: 200 len: 1314 microversion: 2.1 time: 1.350785 Jul 18 02:31:29.954210 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1681/3360] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:28 2022] GET /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1 => generated 1314 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:29.983794 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7e3fd981-c7b1-468b-b06e-0cf1cde1f291 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:29.985982 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7e3fd981-c7b1-468b-b06e-0cf1cde1f291 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 6faedf52-1ea8-4a05-8857-d0f8be1fadf9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:30.020208 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7e3fd981-c7b1-468b-b06e-0cf1cde1f291 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:30.022354 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7e3fd981-c7b1-468b-b06e-0cf1cde1f291 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:30.024191 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7e3fd981-c7b1-468b-b06e-0cf1cde1f291 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:30.035775 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7e3fd981-c7b1-468b-b06e-0cf1cde1f291 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:30.488543 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6215870e-0c9b-4b47-8e2f-ae6ad7cab3ef tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2374fa8610714b72b6034726ee1c2373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe99772712849608ba124613bb5cc26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:30.505849 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6215870e-0c9b-4b47-8e2f-ae6ad7cab3ef tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b" status: 200 len: 1314 microversion: 2.1 time: 0.913316 Jul 18 02:31:30.520849 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1680/3361] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:29 2022] GET /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b => generated 1314 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:30.526932 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-87078d45-b4f5-46ae-b4fd-32bd9ee63719 req-7d17b87e-b2d7-43c9-8135-89721b54ae6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6faedf52-1ea8-4a05-8857-d0f8be1fadf9", "tag": "9a5f7450-58f9-4649-8d0f-1989ae009bd3"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:30.541190 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-87078d45-b4f5-46ae-b4fd-32bd9ee63719 req-7d17b87e-b2d7-43c9-8135-89721b54ae6b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:30.542272 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-87078d45-b4f5-46ae-b4fd-32bd9ee63719 req-7d17b87e-b2d7-43c9-8135-89721b54ae6b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:30.582782 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-87078d45-b4f5-46ae-b4fd-32bd9ee63719 req-7d17b87e-b2d7-43c9-8135-89721b54ae6b service nova] Creating event network-changed:9a5f7450-58f9-4649-8d0f-1989ae009bd3 for instance 6faedf52-1ea8-4a05-8857-d0f8be1fadf9 on n-h2-465891-3 Jul 18 02:31:30.592790 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-87078d45-b4f5-46ae-b4fd-32bd9ee63719 req-7d17b87e-b2d7-43c9-8135-89721b54ae6b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070342 Jul 18 02:31:30.594889 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1681/3362] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:31:30.955825 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-71a6da0e-eb0c-41f2-b091-a6eede0938f8 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:30.956599 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-71a6da0e-eb0c-41f2-b091-a6eede0938f8 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] [instance: 122b7de0-abb6-4349-8559-f7cee46ef7d1] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:30.978067 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-71a6da0e-eb0c-41f2-b091-a6eede0938f8 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:30.978672 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-71a6da0e-eb0c-41f2-b091-a6eede0938f8 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:30.982687 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-71a6da0e-eb0c-41f2-b091-a6eede0938f8 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:30.985794 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-71a6da0e-eb0c-41f2-b091-a6eede0938f8 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:31.054906 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7e3fd981-c7b1-468b-b06e-0cf1cde1f291 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:31.063268 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7e3fd981-c7b1-468b-b06e-0cf1cde1f291 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9" status: 200 len: 1354 microversion: 2.1 time: 1.107359 Jul 18 02:31:31.074181 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1682/3363] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:29 2022] GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9 => generated 1354 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:31.457865 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-71a6da0e-eb0c-41f2-b091-a6eede0938f8 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9299d3b336b4ca8b3ac5e8497e26ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5db9a43df045ea89156bf5f45f5108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:31.508020 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-71a6da0e-eb0c-41f2-b091-a6eede0938f8 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] 10.222.0.57 "GET /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1" status: 200 len: 1464 microversion: 2.1 time: 0.557839 Jul 18 02:31:31.523111 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1682/3364] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:30 2022] GET /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1 => generated 1464 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:31.526420 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-593ea962-d4c3-4990-97b0-364bcb9df3ec tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:31.527698 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-593ea962-d4c3-4990-97b0-364bcb9df3ec tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: c6d44f85-b513-4d3e-87de-71341677a30b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:31.540623 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a0a401af-4bfd-4dde-be0b-3f904f1cc96e tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14158273-2f3d-496c-8292-754e537ac460", "device": "/dev/sdb"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:31.550474 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a0a401af-4bfd-4dde-be0b-3f904f1cc96e tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] [instance: 122b7de0-abb6-4349-8559-f7cee46ef7d1] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:31.562930 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-593ea962-d4c3-4990-97b0-364bcb9df3ec tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:31.566908 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-593ea962-d4c3-4990-97b0-364bcb9df3ec tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:31.573592 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-593ea962-d4c3-4990-97b0-364bcb9df3ec tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:31.574176 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-593ea962-d4c3-4990-97b0-364bcb9df3ec tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:31.575717 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a0a401af-4bfd-4dde-be0b-3f904f1cc96e tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:31.576581 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a0a401af-4bfd-4dde-be0b-3f904f1cc96e tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:31.578819 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a0a401af-4bfd-4dde-be0b-3f904f1cc96e tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:31.585052 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a0a401af-4bfd-4dde-be0b-3f904f1cc96e tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:31.638798 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=100 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:31:32.138991 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a0a401af-4bfd-4dde-be0b-3f904f1cc96e tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] 10.222.0.57 "POST /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.600351 Jul 18 02:31:32.140098 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1683/3365] 10.222.0.57 () {60 vars in 1322 bytes} [Mon Jul 18 02:31:31 2022] POST /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1/os-volume_attachments => generated 194 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:31:32.188199 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d702529f-3d84-4254-8518-92441b2670dd tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:32.192010 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d702529f-3d84-4254-8518-92441b2670dd tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 6faedf52-1ea8-4a05-8857-d0f8be1fadf9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:32.216928 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d702529f-3d84-4254-8518-92441b2670dd tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:32.219903 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d702529f-3d84-4254-8518-92441b2670dd tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:32.222307 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d702529f-3d84-4254-8518-92441b2670dd tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:32.225096 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d702529f-3d84-4254-8518-92441b2670dd tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:32.750044 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-593ea962-d4c3-4990-97b0-364bcb9df3ec tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2374fa8610714b72b6034726ee1c2373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe99772712849608ba124613bb5cc26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:32.761893 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-593ea962-d4c3-4990-97b0-364bcb9df3ec tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b" status: 200 len: 1314 microversion: 2.1 time: 1.240724 Jul 18 02:31:32.762492 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1683/3366] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:31 2022] GET /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b => generated 1314 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:31:33.726167 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d702529f-3d84-4254-8518-92441b2670dd tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:33.762829 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d702529f-3d84-4254-8518-92441b2670dd tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9" status: 200 len: 1354 microversion: 2.1 time: 1.618533 Jul 18 02:31:33.786456 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1684/3367] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:32 2022] GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9 => generated 1354 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:33.795929 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3db585f5-de3c-456e-a551-8586fe309b7c tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:33.800474 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3db585f5-de3c-456e-a551-8586fe309b7c tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: c6d44f85-b513-4d3e-87de-71341677a30b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:33.830772 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3db585f5-de3c-456e-a551-8586fe309b7c tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:33.834898 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3db585f5-de3c-456e-a551-8586fe309b7c tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:33.836984 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3db585f5-de3c-456e-a551-8586fe309b7c tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:33.843260 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3db585f5-de3c-456e-a551-8586fe309b7c tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:34.784808 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1333bad6-1af7-4c77-a826-a32ace78760c tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:34.786075 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1333bad6-1af7-4c77-a826-a32ace78760c tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 6faedf52-1ea8-4a05-8857-d0f8be1fadf9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:34.801209 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1333bad6-1af7-4c77-a826-a32ace78760c tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:34.806843 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1333bad6-1af7-4c77-a826-a32ace78760c tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:34.809019 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1333bad6-1af7-4c77-a826-a32ace78760c tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:34.813861 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1333bad6-1af7-4c77-a826-a32ace78760c tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:35.317559 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3db585f5-de3c-456e-a551-8586fe309b7c tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2374fa8610714b72b6034726ee1c2373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe99772712849608ba124613bb5cc26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:35.361082 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3db585f5-de3c-456e-a551-8586fe309b7c tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b" status: 200 len: 1502 microversion: 2.1 time: 1.572736 Jul 18 02:31:35.375415 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1684/3368] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:33 2022] GET /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b => generated 1502 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:31:35.394320 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0dd1252e-acd3-4a4f-b47b-350f8578a811 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-415684415"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:35.396635 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0dd1252e-acd3-4a4f-b47b-350f8578a811 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: c6d44f85-b513-4d3e-87de-71341677a30b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:35.455959 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0dd1252e-acd3-4a4f-b47b-350f8578a811 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:35.462511 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0dd1252e-acd3-4a4f-b47b-350f8578a811 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:35.464752 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0dd1252e-acd3-4a4f-b47b-350f8578a811 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:35.467583 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0dd1252e-acd3-4a4f-b47b-350f8578a811 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:36.134473 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1333bad6-1af7-4c77-a826-a32ace78760c tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:36.178756 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1333bad6-1af7-4c77-a826-a32ace78760c tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9" status: 200 len: 1354 microversion: 2.1 time: 1.398652 Jul 18 02:31:36.179995 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1685/3369] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:34 2022] GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9 => generated 1354 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:31:36.410336 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.network.security_group_api [None req-0dd1252e-acd3-4a4f-b47b-350f8578a811 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Adding security group a30a8694-2fde-4258-bc27-670762ef063b to port a415076e-e7de-4e2a-a80b-075323147f76 Jul 18 02:31:37.205426 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6c24480e-3694-4dde-9076-f510e139d9a1 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:37.206130 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6c24480e-3694-4dde-9076-f510e139d9a1 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 6faedf52-1ea8-4a05-8857-d0f8be1fadf9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:37.224345 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6c24480e-3694-4dde-9076-f510e139d9a1 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:37.224643 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6c24480e-3694-4dde-9076-f510e139d9a1 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:37.226007 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6c24480e-3694-4dde-9076-f510e139d9a1 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:37.226659 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6c24480e-3694-4dde-9076-f510e139d9a1 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:38.000555 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0dd1252e-acd3-4a4f-b47b-350f8578a811 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "POST /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b/action" status: 202 len: 0 microversion: 2.1 time: 2.622262 Jul 18 02:31:38.003207 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1685/3370] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:31:35 2022] POST /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b/action => generated 0 bytes in 2627 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:31:38.036641 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-68466378-fb4e-4c9f-ba98-7ee746b11808 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-603328228"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:38.040747 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-68466378-fb4e-4c9f-ba98-7ee746b11808 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: c6d44f85-b513-4d3e-87de-71341677a30b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:38.084403 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-68466378-fb4e-4c9f-ba98-7ee746b11808 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:38.091105 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-68466378-fb4e-4c9f-ba98-7ee746b11808 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:38.095469 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-68466378-fb4e-4c9f-ba98-7ee746b11808 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:38.096440 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-68466378-fb4e-4c9f-ba98-7ee746b11808 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:38.271092 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6c24480e-3694-4dde-9076-f510e139d9a1 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:38.284658 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6c24480e-3694-4dde-9076-f510e139d9a1 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9" status: 200 len: 1354 microversion: 2.1 time: 1.083250 Jul 18 02:31:38.298118 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1686/3371] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:37 2022] GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9 => generated 1354 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:31:38.303371 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-25aaf762-2f74-4f04-b2b3-cfc3214c8567 req-56ca2eea-61cc-45c4-85c8-48d807f6c8fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6d44f85-b513-4d3e-87de-71341677a30b", "tag": "a415076e-e7de-4e2a-a80b-075323147f76"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:38.320363 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-25aaf762-2f74-4f04-b2b3-cfc3214c8567 req-56ca2eea-61cc-45c4-85c8-48d807f6c8fe service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:38.321328 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-25aaf762-2f74-4f04-b2b3-cfc3214c8567 req-56ca2eea-61cc-45c4-85c8-48d807f6c8fe service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:38.350456 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-25aaf762-2f74-4f04-b2b3-cfc3214c8567 req-56ca2eea-61cc-45c4-85c8-48d807f6c8fe service nova] Creating event network-changed:a415076e-e7de-4e2a-a80b-075323147f76 for instance c6d44f85-b513-4d3e-87de-71341677a30b on n-h2-465891-3 Jul 18 02:31:38.358386 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-25aaf762-2f74-4f04-b2b3-cfc3214c8567 req-56ca2eea-61cc-45c4-85c8-48d807f6c8fe service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058548 Jul 18 02:31:38.361720 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1687/3372] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:31:38.660737 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.network.security_group_api [None req-68466378-fb4e-4c9f-ba98-7ee746b11808 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Adding security group 8d81923e-fff7-4d88-9d0a-ca98354f8ffa to port a415076e-e7de-4e2a-a80b-075323147f76 Jul 18 02:31:39.302561 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-05608cad-ae89-470d-9bb6-2babefb001e8 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:39.303387 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-05608cad-ae89-470d-9bb6-2babefb001e8 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 6faedf52-1ea8-4a05-8857-d0f8be1fadf9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:39.321181 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-05608cad-ae89-470d-9bb6-2babefb001e8 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:39.324018 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-05608cad-ae89-470d-9bb6-2babefb001e8 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:39.327064 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-05608cad-ae89-470d-9bb6-2babefb001e8 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:39.328159 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-05608cad-ae89-470d-9bb6-2babefb001e8 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:40.340914 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-05608cad-ae89-470d-9bb6-2babefb001e8 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:40.350941 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-68466378-fb4e-4c9f-ba98-7ee746b11808 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "POST /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b/action" status: 202 len: 0 microversion: 2.1 time: 2.341773 Jul 18 02:31:40.355244 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1686/3373] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:31:38 2022] POST /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b/action => generated 0 bytes in 2347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:31:40.366443 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b3ad1c28-8002-4ef6-b1f5-07eb41e9b562 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:40.367719 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b3ad1c28-8002-4ef6-b1f5-07eb41e9b562 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: c6d44f85-b513-4d3e-87de-71341677a30b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:40.376147 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-05608cad-ae89-470d-9bb6-2babefb001e8 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9" status: 200 len: 1354 microversion: 2.1 time: 1.077654 Jul 18 02:31:40.377375 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b3ad1c28-8002-4ef6-b1f5-07eb41e9b562 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:40.377996 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b3ad1c28-8002-4ef6-b1f5-07eb41e9b562 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:40.379119 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b3ad1c28-8002-4ef6-b1f5-07eb41e9b562 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:40.380616 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b3ad1c28-8002-4ef6-b1f5-07eb41e9b562 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:40.386115 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1688/3374] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:39 2022] GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9 => generated 1354 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:40.495063 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-7a877639-c165-4ff2-a4d7-7b5171ea1a78 req-d5adb41d-e61a-4c3d-a4fb-88b0ef732f7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6d44f85-b513-4d3e-87de-71341677a30b", "tag": "a415076e-e7de-4e2a-a80b-075323147f76"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:40.520148 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-7a877639-c165-4ff2-a4d7-7b5171ea1a78 req-d5adb41d-e61a-4c3d-a4fb-88b0ef732f7e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:40.520878 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-7a877639-c165-4ff2-a4d7-7b5171ea1a78 req-d5adb41d-e61a-4c3d-a4fb-88b0ef732f7e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:40.549299 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-7a877639-c165-4ff2-a4d7-7b5171ea1a78 req-d5adb41d-e61a-4c3d-a4fb-88b0ef732f7e service nova] Creating event network-changed:a415076e-e7de-4e2a-a80b-075323147f76 for instance c6d44f85-b513-4d3e-87de-71341677a30b on n-h2-465891-3 Jul 18 02:31:40.560797 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-7a877639-c165-4ff2-a4d7-7b5171ea1a78 req-d5adb41d-e61a-4c3d-a4fb-88b0ef732f7e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078460 Jul 18 02:31:40.562256 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1689/3375] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:31:40.959957 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b3ad1c28-8002-4ef6-b1f5-07eb41e9b562 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.603023 Jul 18 02:31:40.960578 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1687/3376] 10.222.0.57 () {58 vars in 1292 bytes} [Mon Jul 18 02:31:40 2022] GET /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b/os-security-groups => generated 1157 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:31:41.016097 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-20e46f57-9e7a-47c9-ae2d-7e08e3f35cd0 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Action: 'create', calling method: .version_select at 0x7ff49b875ca0>, body: {"security_group": {"name": " tempest-securitygroup -317163876 ", "description": "tempest-description-1277668253"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:41.406082 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-68bdfd8b-9c7e-4af5-85f5-8c4302a7d75f tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:41.406697 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-68bdfd8b-9c7e-4af5-85f5-8c4302a7d75f tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 6faedf52-1ea8-4a05-8857-d0f8be1fadf9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:41.442769 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-68bdfd8b-9c7e-4af5-85f5-8c4302a7d75f tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:41.446954 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-68bdfd8b-9c7e-4af5-85f5-8c4302a7d75f tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:41.446954 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-68bdfd8b-9c7e-4af5-85f5-8c4302a7d75f tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:41.454668 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-68bdfd8b-9c7e-4af5-85f5-8c4302a7d75f tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:41.493903 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:31:42.455749 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-68bdfd8b-9c7e-4af5-85f5-8c4302a7d75f tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:42.500873 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-68bdfd8b-9c7e-4af5-85f5-8c4302a7d75f tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9" status: 200 len: 1354 microversion: 2.1 time: 1.097136 Jul 18 02:31:42.518846 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1688/3377] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:41 2022] GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9 => generated 1354 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:43.341161 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-20e46f57-9e7a-47c9-ae2d-7e08e3f35cd0 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 2.330198 Jul 18 02:31:43.347974 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1690/3378] 10.222.0.57 () {60 vars in 1179 bytes} [Mon Jul 18 02:31:40 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 2352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:31:43.363533 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e457cf30-0e17-45df-9112-bdd729e5b4cb tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '.version_select at 0x7ff4add803a0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:43.525490 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-70443f7b-4d85-48da-80ed-5504181e1e38 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:43.525681 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-70443f7b-4d85-48da-80ed-5504181e1e38 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 6faedf52-1ea8-4a05-8857-d0f8be1fadf9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:43.536091 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-70443f7b-4d85-48da-80ed-5504181e1e38 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:43.536543 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-70443f7b-4d85-48da-80ed-5504181e1e38 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:43.537564 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-70443f7b-4d85-48da-80ed-5504181e1e38 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:43.538284 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-70443f7b-4d85-48da-80ed-5504181e1e38 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:43.898123 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e457cf30-0e17-45df-9112-bdd729e5b4cb tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/os-security-groups/68219ecc-ba73-4ca6-bca3-6c167d4aff9a" status: 200 len: 223 microversion: 2.1 time: 0.540036 Jul 18 02:31:43.910830 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1689/3379] 10.222.0.57 () {58 vars in 1268 bytes} [Mon Jul 18 02:31:43 2022] GET /compute/v2.1/os-security-groups/68219ecc-ba73-4ca6-bca3-6c167d4aff9a => generated 223 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:31:43.929632 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ff494895-ea2f-477b-b366-3225f6359882 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '.version_select at 0x7ff4a80220d0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:44.683642 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-70443f7b-4d85-48da-80ed-5504181e1e38 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:44.701218 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-70443f7b-4d85-48da-80ed-5504181e1e38 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9" status: 200 len: 1354 microversion: 2.1 time: 1.180508 Jul 18 02:31:44.703715 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1691/3380] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:43 2022] GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9 => generated 1354 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:45.024363 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3b168083-f4d5-4e6d-b9f4-dcc0c1c5c203 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-307234825", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "1d6c1d95-c845-4d67-b060-08740dbab0e9"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:45.163274 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-3b168083-f4d5-4e6d-b9f4-dcc0c1c5c203 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] validate_networks() for [('1d6c1d95-c845-4d67-b060-08740dbab0e9', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:31:46.090131 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ff494895-ea2f-477b-b366-3225f6359882 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/68219ecc-ba73-4ca6-bca3-6c167d4aff9a" status: 202 len: 0 microversion: 2.1 time: 2.177701 Jul 18 02:31:46.095318 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1690/3381] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 02:31:43 2022] DELETE /compute/v2.1/os-security-groups/68219ecc-ba73-4ca6-bca3-6c167d4aff9a => generated 0 bytes in 2183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:31:46.100562 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fa40b2f6-9b93-4604-887a-e17a68143e46 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:46.101200 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fa40b2f6-9b93-4604-887a-e17a68143e46 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 6faedf52-1ea8-4a05-8857-d0f8be1fadf9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:46.120654 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=42 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:31:46.122440 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fa40b2f6-9b93-4604-887a-e17a68143e46 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:46.122898 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fa40b2f6-9b93-4604-887a-e17a68143e46 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:46.123712 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fa40b2f6-9b93-4604-887a-e17a68143e46 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:46.124158 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fa40b2f6-9b93-4604-887a-e17a68143e46 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:46.751640 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fa40b2f6-9b93-4604-887a-e17a68143e46 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:46.776550 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fa40b2f6-9b93-4604-887a-e17a68143e46 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9" status: 200 len: 1354 microversion: 2.1 time: 0.679569 Jul 18 02:31:46.778286 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1691/3382] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:46 2022] GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9 => generated 1354 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:46.819128 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c92715bc-9d86-4a24-96fb-b87c22beaa5e tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '.version_select at 0x7ff4add60040>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:46.973570 n-d-465891-3 devstack@n-api.service[119543]: DEBUG neutronclient.v2_0.client [None req-c92715bc-9d86-4a24-96fb-b87c22beaa5e tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 68219ecc-ba73-4ca6-bca3-6c167d4aff9a does not exist", "detail": ""}} {{(pid=119543) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:31:46.974894 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.security_group_api [None req-c92715bc-9d86-4a24-96fb-b87c22beaa5e tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Neutron security group 68219ecc-ba73-4ca6-bca3-6c167d4aff9a not found {{(pid=119543) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 02:31:46.976078 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-c92715bc-9d86-4a24-96fb-b87c22beaa5e tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] HTTP exception thrown: Security group 68219ecc-ba73-4ca6-bca3-6c167d4aff9a does not exist Jul 18 02:31:46.976078 n-d-465891-3 devstack@n-api.service[119543]: Neutron server returns request_ids: ['req-9aa1252c-fe6f-4565-854c-a686ffffd659'] Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c92715bc-9d86-4a24-96fb-b87c22beaa5e tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Request method failure captured: Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/os-security-groups/68219ecc-ba73-4ca6-bca3-6c167d4aff9a HTTP/1.1 Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MXdApAd8jCQLuDQ4GDVob3WlO5TGoerQppREc0ccYssaOHle4VdpCa3zbolI9kA3vBsm6toj834_HQ72z_BEBH3fK1DoWoIDaDTMEsKRnNxFFmWRX0hetMPDmWg_gNY33hhTytVVTi3zUdfIo_ja5VJys5KWb2G5Exx3CV-M4e89mI Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: afe99772712849608ba124613bb5cc26 Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_afe99772712849608ba124613bb5cc26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/afe99772712849608ba124613bb5cc26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/afe99772712849608ba124613bb5cc26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/afe99772712849608ba124613bb5cc26"}]}] Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: afe99772712849608ba124613bb5cc26 Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-SecurityGroupsTestJSON-235723186-project Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 2374fa8610714b72b6034726ee1c2373 Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-SecurityGroupsTestJSON-235723186-project Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: exception: Security group 68219ecc-ba73-4ca6-bca3-6c167d4aff9a does not exist Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: Neutron server returns request_ids: ['req-9aa1252c-fe6f-4565-854c-a686ffffd659'] Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '68219ecc-ba73-4ca6-bca3-6c167d4aff9a'} Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:31:46.981333 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 68219ecc-ba73-4ca6-bca3-6c167d4aff9a does not exist Jul 18 02:31:46.991111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9aa1252c-fe6f-4565-854c-a686ffffd659'] Jul 18 02:31:46.991111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:31:46.991111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:46.991111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:31:46.991111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:46.991111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 18 02:31:46.991111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 18 02:31:46.991111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 02:31:46.991111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 02:31:46.991111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 68219ecc-ba73-4ca6-bca3-6c167d4aff9a does not exist Jul 18 02:31:46.991111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9aa1252c-fe6f-4565-854c-a686ffffd659'] Jul 18 02:31:46.991111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:31:46.991111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:46.991111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:31:46.991111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:46.991111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:31:46.991111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:31:46.991111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:31:46.991111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:31:46.991111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:31:46.991111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:31:46.991111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:31:46.991111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:31:46.991111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 18 02:31:46.991111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 02:31:46.991111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 68219ecc-ba73-4ca6-bca3-6c167d4aff9a does not exist Jul 18 02:31:46.991111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9aa1252c-fe6f-4565-854c-a686ffffd659'] Jul 18 02:31:46.991111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:31:46.991111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:46.991111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:31:46.991111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:46.991111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:31:46.991111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:31:46.991111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:31:46.991111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:31:46.991111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 68219ecc-ba73-4ca6-bca3-6c167d4aff9a does not exist Jul 18 02:31:46.991111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9aa1252c-fe6f-4565-854c-a686ffffd659'] Jul 18 02:31:46.991111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:31:47.004088 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c92715bc-9d86-4a24-96fb-b87c22beaa5e tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Returning 404 to user: Security group 68219ecc-ba73-4ca6-bca3-6c167d4aff9a does not exist Jul 18 02:31:47.004088 n-d-465891-3 devstack@n-api.service[119543]: Neutron server returns request_ids: ['req-9aa1252c-fe6f-4565-854c-a686ffffd659'] {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:31:47.015464 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c92715bc-9d86-4a24-96fb-b87c22beaa5e tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/os-security-groups/68219ecc-ba73-4ca6-bca3-6c167d4aff9a" status: 404 len: 194 microversion: 2.1 time: 0.203542 Jul 18 02:31:47.036696 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1692/3383] 10.222.0.57 () {58 vars in 1268 bytes} [Mon Jul 18 02:31:46 2022] GET /compute/v2.1/os-security-groups/68219ecc-ba73-4ca6-bca3-6c167d4aff9a => generated 194 bytes in 228 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:31:47.063683 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-83cd3bf8-ee56-446c-be20-157c2a0a4135 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Action: 'create', calling method: .version_select at 0x7ff4adcfc0d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1979032184", "description": "tempest-description-1887424420"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:48.793111 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-83cd3bf8-ee56-446c-be20-157c2a0a4135 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.752832 Jul 18 02:31:48.794703 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1693/3384] 10.222.0.57 () {60 vars in 1179 bytes} [Mon Jul 18 02:31:47 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:31:48.818781 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-3b168083-f4d5-4e6d-b9f4-dcc0c1c5c203 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:31:48.819284 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-3b168083-f4d5-4e6d-b9f4-dcc0c1c5c203 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:31:48.819851 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-3b168083-f4d5-4e6d-b9f4-dcc0c1c5c203 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:31:48.820072 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-3b168083-f4d5-4e6d-b9f4-dcc0c1c5c203 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:31:48.820497 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-3b168083-f4d5-4e6d-b9f4-dcc0c1c5c203 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:31:48.830020 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e0458ed8-947b-45a9-a13d-46814fe80b51 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:48.837184 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e0458ed8-947b-45a9-a13d-46814fe80b51 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 6faedf52-1ea8-4a05-8857-d0f8be1fadf9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:48.852000 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b168083-f4d5-4e6d-b9f4-dcc0c1c5c203 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:48.852546 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b168083-f4d5-4e6d-b9f4-dcc0c1c5c203 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:48.853524 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b168083-f4d5-4e6d-b9f4-dcc0c1c5c203 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:48.854426 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b168083-f4d5-4e6d-b9f4-dcc0c1c5c203 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:48.907518 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e0458ed8-947b-45a9-a13d-46814fe80b51 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:48.909238 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e0458ed8-947b-45a9-a13d-46814fe80b51 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:48.913093 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e0458ed8-947b-45a9-a13d-46814fe80b51 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:48.914194 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e0458ed8-947b-45a9-a13d-46814fe80b51 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:48.916319 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-3b168083-f4d5-4e6d-b9f4-dcc0c1c5c203 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Getting quotas for project b1287da2aeae4737a8ce953c8edbac7b. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:31:48.923860 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-3b168083-f4d5-4e6d-b9f4-dcc0c1c5c203 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Getting quotas for user 42fa2740ac30453b941b9ea3a57cbd63 and project b1287da2aeae4737a8ce953c8edbac7b. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:31:48.962183 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3b168083-f4d5-4e6d-b9f4-dcc0c1c5c203 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:31:48.964675 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3b168083-f4d5-4e6d-b9f4-dcc0c1c5c203 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] [instance: 3651ac1a-8110-424f-ac77-b2ab0f7f93a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:31:49.114602 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3b168083-f4d5-4e6d-b9f4-dcc0c1c5c203 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.409165 Jul 18 02:31:49.115285 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1692/3385] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:31:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 4411 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:31:49.124726 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fb77c1f0-f4d5-4522-93ba-964efadfa30a tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Action: 'create', calling method: .version_select at 0x7ff4adb3ce50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1575236763", "description": "tempest-description-1101135883"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:50.059119 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e0458ed8-947b-45a9-a13d-46814fe80b51 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:50.072311 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e0458ed8-947b-45a9-a13d-46814fe80b51 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9" status: 200 len: 1354 microversion: 2.1 time: 1.273518 Jul 18 02:31:50.081773 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1694/3386] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:48 2022] GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9 => generated 1354 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:50.084243 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c831613d-1471-4cef-a730-29419fd18ddd tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:50.088302 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c831613d-1471-4cef-a730-29419fd18ddd tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] [instance: 3651ac1a-8110-424f-ac77-b2ab0f7f93a7] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:50.111610 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c831613d-1471-4cef-a730-29419fd18ddd tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:50.114127 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c831613d-1471-4cef-a730-29419fd18ddd tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:50.115250 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c831613d-1471-4cef-a730-29419fd18ddd tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:50.117078 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c831613d-1471-4cef-a730-29419fd18ddd tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:50.237052 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c831613d-1471-4cef-a730-29419fd18ddd tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fa2740ac30453b941b9ea3a57cbd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1287da2aeae4737a8ce953c8edbac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:50.252666 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c831613d-1471-4cef-a730-29419fd18ddd tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] 10.222.0.57 "GET /compute/v2.1/servers/3651ac1a-8110-424f-ac77-b2ab0f7f93a7" status: 200 len: 1219 microversion: 2.1 time: 0.176679 Jul 18 02:31:50.262396 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1695/3387] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:50 2022] GET /compute/v2.1/servers/3651ac1a-8110-424f-ac77-b2ab0f7f93a7 => generated 1219 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:50.533606 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fb77c1f0-f4d5-4522-93ba-964efadfa30a tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.414673 Jul 18 02:31:50.543500 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1693/3388] 10.222.0.57 () {60 vars in 1179 bytes} [Mon Jul 18 02:31:49 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:31:50.550831 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3ba1c005-2563-4295-a2fd-afa0f831ba66 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Action: 'create', calling method: .version_select at 0x7ff49bb7d430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2095628507", "description": "tempest-description-1817231148"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:51.089173 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-456976a0-7b69-484d-93c1-e9117d8e45ad tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:51.091542 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-456976a0-7b69-484d-93c1-e9117d8e45ad tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 6faedf52-1ea8-4a05-8857-d0f8be1fadf9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:51.103284 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-456976a0-7b69-484d-93c1-e9117d8e45ad tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:51.111283 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-456976a0-7b69-484d-93c1-e9117d8e45ad tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:51.112810 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-456976a0-7b69-484d-93c1-e9117d8e45ad tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:51.113505 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-456976a0-7b69-484d-93c1-e9117d8e45ad tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:52.557954 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3ba1c005-2563-4295-a2fd-afa0f831ba66 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 2.016037 Jul 18 02:31:52.560694 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1696/3389] 10.222.0.57 () {60 vars in 1179 bytes} [Mon Jul 18 02:31:50 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 2019 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:31:52.566849 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7e3235f5-8d59-4c72-8c88-9d2343559880 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:52.568857 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7e3235f5-8d59-4c72-8c88-9d2343559880 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] [instance: 3651ac1a-8110-424f-ac77-b2ab0f7f93a7] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:52.593217 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7e3235f5-8d59-4c72-8c88-9d2343559880 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:52.597895 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7e3235f5-8d59-4c72-8c88-9d2343559880 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:52.599775 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7e3235f5-8d59-4c72-8c88-9d2343559880 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:52.606768 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7e3235f5-8d59-4c72-8c88-9d2343559880 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:53.081294 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7e3235f5-8d59-4c72-8c88-9d2343559880 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fa2740ac30453b941b9ea3a57cbd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1287da2aeae4737a8ce953c8edbac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:53.090628 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7e3235f5-8d59-4c72-8c88-9d2343559880 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] 10.222.0.57 "GET /compute/v2.1/servers/3651ac1a-8110-424f-ac77-b2ab0f7f93a7" status: 200 len: 1273 microversion: 2.1 time: 0.528180 Jul 18 02:31:53.096368 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1697/3390] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:52 2022] GET /compute/v2.1/servers/3651ac1a-8110-424f-ac77-b2ab0f7f93a7 => generated 1273 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:53.130543 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-3137cd6d-746c-4745-bc97-fd4110da6858 req-ec7a8031-da00-41b4-8e98-0b416fd3343e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6faedf52-1ea8-4a05-8857-d0f8be1fadf9", "name": "network-vif-plugged", "status": "completed", "tag": "9a5f7450-58f9-4649-8d0f-1989ae009bd3"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:53.161040 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-3137cd6d-746c-4745-bc97-fd4110da6858 req-ec7a8031-da00-41b4-8e98-0b416fd3343e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:53.161558 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-3137cd6d-746c-4745-bc97-fd4110da6858 req-ec7a8031-da00-41b4-8e98-0b416fd3343e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:53.180584 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-3137cd6d-746c-4745-bc97-fd4110da6858 req-ec7a8031-da00-41b4-8e98-0b416fd3343e service nova] Creating event network-vif-plugged:9a5f7450-58f9-4649-8d0f-1989ae009bd3 for instance 6faedf52-1ea8-4a05-8857-d0f8be1fadf9 on n-h2-465891-3 Jul 18 02:31:53.189464 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-3137cd6d-746c-4745-bc97-fd4110da6858 req-ec7a8031-da00-41b4-8e98-0b416fd3343e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079840 Jul 18 02:31:53.191082 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1698/3391] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:31:53.199565 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dc8b4cea-cc85-47ee-8f79-5f24254f4591 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '.version_select at 0x7ff49bc4f550>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:53.243677 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-456976a0-7b69-484d-93c1-e9117d8e45ad tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:53.260310 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-456976a0-7b69-484d-93c1-e9117d8e45ad tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9" status: 200 len: 1354 microversion: 2.1 time: 2.170853 Jul 18 02:31:53.265982 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1694/3392] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:51 2022] GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9 => generated 1354 bytes in 2181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:31:54.116180 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cd58cede-df1a-4620-a67b-166d60d5c0d3 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:54.116826 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cd58cede-df1a-4620-a67b-166d60d5c0d3 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] [instance: 3651ac1a-8110-424f-ac77-b2ab0f7f93a7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:54.136106 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cd58cede-df1a-4620-a67b-166d60d5c0d3 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:54.138419 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cd58cede-df1a-4620-a67b-166d60d5c0d3 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:54.140243 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cd58cede-df1a-4620-a67b-166d60d5c0d3 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:54.140811 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cd58cede-df1a-4620-a67b-166d60d5c0d3 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:54.581444 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-cd58cede-df1a-4620-a67b-166d60d5c0d3 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fa2740ac30453b941b9ea3a57cbd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1287da2aeae4737a8ce953c8edbac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:54.598610 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cd58cede-df1a-4620-a67b-166d60d5c0d3 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] 10.222.0.57 "GET /compute/v2.1/servers/3651ac1a-8110-424f-ac77-b2ab0f7f93a7" status: 200 len: 1273 microversion: 2.1 time: 0.486243 Jul 18 02:31:54.599530 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1695/3393] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:54 2022] GET /compute/v2.1/servers/3651ac1a-8110-424f-ac77-b2ab0f7f93a7 => generated 1273 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:31:54.610302 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-864945fd-e194-4932-8150-33d82e8a18eb tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:54.613079 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-864945fd-e194-4932-8150-33d82e8a18eb tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 6faedf52-1ea8-4a05-8857-d0f8be1fadf9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:54.629139 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:31:54.631307 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-864945fd-e194-4932-8150-33d82e8a18eb tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:54.634171 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-864945fd-e194-4932-8150-33d82e8a18eb tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:54.639423 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-864945fd-e194-4932-8150-33d82e8a18eb tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:54.640072 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-864945fd-e194-4932-8150-33d82e8a18eb tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:56.472737 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-864945fd-e194-4932-8150-33d82e8a18eb tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:56.484470 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-864945fd-e194-4932-8150-33d82e8a18eb tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9" status: 200 len: 1354 microversion: 2.1 time: 1.883518 Jul 18 02:31:56.490531 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1696/3394] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:54 2022] GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9 => generated 1354 bytes in 1890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:56.514165 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-3b7ee504-39fd-460d-96a5-9d375a1d6c26 req-3dfcfe81-9b3f-47c5-b6a2-5275656bddfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6faedf52-1ea8-4a05-8857-d0f8be1fadf9", "name": "network-vif-plugged", "status": "completed", "tag": "a2743901-0f11-4760-a3f9-8ba646c29310"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:56.538393 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-3b7ee504-39fd-460d-96a5-9d375a1d6c26 req-3dfcfe81-9b3f-47c5-b6a2-5275656bddfe service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:56.538978 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-3b7ee504-39fd-460d-96a5-9d375a1d6c26 req-3dfcfe81-9b3f-47c5-b6a2-5275656bddfe service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:56.587158 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-3b7ee504-39fd-460d-96a5-9d375a1d6c26 req-3dfcfe81-9b3f-47c5-b6a2-5275656bddfe service nova] Creating event network-vif-plugged:a2743901-0f11-4760-a3f9-8ba646c29310 for instance 6faedf52-1ea8-4a05-8857-d0f8be1fadf9 on n-h2-465891-3 Jul 18 02:31:56.605289 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-3b7ee504-39fd-460d-96a5-9d375a1d6c26 req-3dfcfe81-9b3f-47c5-b6a2-5275656bddfe service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104269 Jul 18 02:31:56.615364 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1697/3395] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:31:56.640501 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e3df6511-a490-4737-aa13-f202fbdec83d tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:56.648632 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e3df6511-a490-4737-aa13-f202fbdec83d tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] [instance: 3651ac1a-8110-424f-ac77-b2ab0f7f93a7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:56.685959 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e3df6511-a490-4737-aa13-f202fbdec83d tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:56.689255 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e3df6511-a490-4737-aa13-f202fbdec83d tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:56.691205 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e3df6511-a490-4737-aa13-f202fbdec83d tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:56.695576 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e3df6511-a490-4737-aa13-f202fbdec83d tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:58.415755 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e3df6511-a490-4737-aa13-f202fbdec83d tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fa2740ac30453b941b9ea3a57cbd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1287da2aeae4737a8ce953c8edbac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:58.417028 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-dc8b4cea-cc85-47ee-8f79-5f24254f4591 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/os-security-groups" status: 200 len: 1835 microversion: 2.1 time: 5.223101 Jul 18 02:31:58.430324 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1699/3396] 10.222.0.57 () {58 vars in 1157 bytes} [Mon Jul 18 02:31:53 2022] GET /compute/v2.1/os-security-groups => generated 1835 bytes in 5227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:58.446922 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b669b5d6-318e-4429-be76-2abc1db5197a tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:58.447617 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e3df6511-a490-4737-aa13-f202fbdec83d tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] 10.222.0.57 "GET /compute/v2.1/servers/3651ac1a-8110-424f-ac77-b2ab0f7f93a7" status: 200 len: 1315 microversion: 2.1 time: 1.829081 Jul 18 02:31:58.448738 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1698/3397] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:56 2022] GET /compute/v2.1/servers/3651ac1a-8110-424f-ac77-b2ab0f7f93a7 => generated 1315 bytes in 1833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:58.460543 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ea6886e1-0ddf-42af-90cb-979fe5d6980b tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '.version_select at 0x7ff4adba1a60>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:58.478438 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b669b5d6-318e-4429-be76-2abc1db5197a tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 6faedf52-1ea8-4a05-8857-d0f8be1fadf9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:58.528750 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b669b5d6-318e-4429-be76-2abc1db5197a tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:58.530157 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b669b5d6-318e-4429-be76-2abc1db5197a tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:58.533450 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b669b5d6-318e-4429-be76-2abc1db5197a tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:58.534583 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b669b5d6-318e-4429-be76-2abc1db5197a tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:58.884813 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:31:58.951387 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:00.631938 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ea6886e1-0ddf-42af-90cb-979fe5d6980b tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/39b13129-4640-4677-929a-6871715c2cea" status: 202 len: 0 microversion: 2.1 time: 2.181031 Jul 18 02:32:00.632922 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1699/3398] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 02:31:58 2022] DELETE /compute/v2.1/os-security-groups/39b13129-4640-4677-929a-6871715c2cea => generated 0 bytes in 2183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:32:00.639082 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-1609c12e-c4fa-4265-8aff-9e264f4e31d0 req-bb99e971-2e17-4bc0-863f-f0bdaf02ba4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6faedf52-1ea8-4a05-8857-d0f8be1fadf9", "name": "network-vif-plugged", "status": "completed", "tag": "cd0b98f1-7816-4d96-9904-dec1420e3c34"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:00.667975 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-1609c12e-c4fa-4265-8aff-9e264f4e31d0 req-bb99e971-2e17-4bc0-863f-f0bdaf02ba4a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:00.673243 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-1609c12e-c4fa-4265-8aff-9e264f4e31d0 req-bb99e971-2e17-4bc0-863f-f0bdaf02ba4a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:00.704739 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-1609c12e-c4fa-4265-8aff-9e264f4e31d0 req-bb99e971-2e17-4bc0-863f-f0bdaf02ba4a service nova] Creating event network-vif-plugged:cd0b98f1-7816-4d96-9904-dec1420e3c34 for instance 6faedf52-1ea8-4a05-8857-d0f8be1fadf9 on n-h2-465891-3 Jul 18 02:32:00.739032 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-1609c12e-c4fa-4265-8aff-9e264f4e31d0 req-bb99e971-2e17-4bc0-863f-f0bdaf02ba4a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104609 Jul 18 02:32:00.740103 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1700/3399] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:32:00.766842 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cf9e7009-53d8-4b51-ac54-375a21d8209f tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:00.770358 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cf9e7009-53d8-4b51-ac54-375a21d8209f tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] [instance: 3651ac1a-8110-424f-ac77-b2ab0f7f93a7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:00.783220 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cf9e7009-53d8-4b51-ac54-375a21d8209f tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:00.786083 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cf9e7009-53d8-4b51-ac54-375a21d8209f tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:00.791749 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cf9e7009-53d8-4b51-ac54-375a21d8209f tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:00.792619 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cf9e7009-53d8-4b51-ac54-375a21d8209f tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:01.672308 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b669b5d6-318e-4429-be76-2abc1db5197a tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:01.684675 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b669b5d6-318e-4429-be76-2abc1db5197a tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9" status: 200 len: 1354 microversion: 2.1 time: 3.259603 Jul 18 02:32:01.687822 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1700/3400] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:58 2022] GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9 => generated 1354 bytes in 3268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:01.695137 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-558f24f7-eddb-4a5d-93a2-651822491f3c tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '.version_select at 0x7ff4a9051b80>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:01.823326 n-d-465891-3 devstack@n-api.service[119543]: DEBUG neutronclient.v2_0.client [None req-558f24f7-eddb-4a5d-93a2-651822491f3c tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 39b13129-4640-4677-929a-6871715c2cea does not exist", "detail": ""}} {{(pid=119543) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:32:01.823980 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.security_group_api [None req-558f24f7-eddb-4a5d-93a2-651822491f3c tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Neutron security group 39b13129-4640-4677-929a-6871715c2cea not found {{(pid=119543) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 02:32:01.824517 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-558f24f7-eddb-4a5d-93a2-651822491f3c tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] HTTP exception thrown: Security group 39b13129-4640-4677-929a-6871715c2cea does not exist Jul 18 02:32:01.824517 n-d-465891-3 devstack@n-api.service[119543]: Neutron server returns request_ids: ['req-3481ca01-7575-4561-b9c1-669d280a3064'] Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-558f24f7-eddb-4a5d-93a2-651822491f3c tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Request method failure captured: Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/os-security-groups/39b13129-4640-4677-929a-6871715c2cea HTTP/1.1 Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MXdApAd8jCQLuDQ4GDVob3WlO5TGoerQppREc0ccYssaOHle4VdpCa3zbolI9kA3vBsm6toj834_HQ72z_BEBH3fK1DoWoIDaDTMEsKRnNxFFmWRX0hetMPDmWg_gNY33hhTytVVTi3zUdfIo_ja5VJys5KWb2G5Exx3CV-M4e89mI Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: afe99772712849608ba124613bb5cc26 Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_afe99772712849608ba124613bb5cc26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/afe99772712849608ba124613bb5cc26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/afe99772712849608ba124613bb5cc26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/afe99772712849608ba124613bb5cc26"}]}] Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: afe99772712849608ba124613bb5cc26 Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-SecurityGroupsTestJSON-235723186-project Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 2374fa8610714b72b6034726ee1c2373 Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-SecurityGroupsTestJSON-235723186-project Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: exception: Security group 39b13129-4640-4677-929a-6871715c2cea does not exist Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: Neutron server returns request_ids: ['req-3481ca01-7575-4561-b9c1-669d280a3064'] Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '39b13129-4640-4677-929a-6871715c2cea'} Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:32:01.834147 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 39b13129-4640-4677-929a-6871715c2cea does not exist Jul 18 02:32:01.842383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3481ca01-7575-4561-b9c1-669d280a3064'] Jul 18 02:32:01.842383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:32:01.842383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:32:01.842383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:32:01.842383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:01.842383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 18 02:32:01.842383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 18 02:32:01.842383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 02:32:01.842383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 02:32:01.842383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 39b13129-4640-4677-929a-6871715c2cea does not exist Jul 18 02:32:01.842383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3481ca01-7575-4561-b9c1-669d280a3064'] Jul 18 02:32:01.842383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:32:01.842383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:32:01.842383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:32:01.842383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:01.842383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:32:01.842383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:32:01.842383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:32:01.842383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:32:01.842383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:32:01.842383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:32:01.842383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:32:01.842383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:32:01.842383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 18 02:32:01.842383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 02:32:01.842383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 39b13129-4640-4677-929a-6871715c2cea does not exist Jul 18 02:32:01.842383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3481ca01-7575-4561-b9c1-669d280a3064'] Jul 18 02:32:01.842383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:32:01.842383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:32:01.842383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:32:01.842383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:01.842383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:32:01.842383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:32:01.842383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:32:01.842383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:32:01.842383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 39b13129-4640-4677-929a-6871715c2cea does not exist Jul 18 02:32:01.842383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3481ca01-7575-4561-b9c1-669d280a3064'] Jul 18 02:32:01.842383 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:32:01.842383 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-558f24f7-eddb-4a5d-93a2-651822491f3c tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Returning 404 to user: Security group 39b13129-4640-4677-929a-6871715c2cea does not exist Jul 18 02:32:01.842383 n-d-465891-3 devstack@n-api.service[119543]: Neutron server returns request_ids: ['req-3481ca01-7575-4561-b9c1-669d280a3064'] {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:32:01.842383 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-558f24f7-eddb-4a5d-93a2-651822491f3c tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/os-security-groups/39b13129-4640-4677-929a-6871715c2cea" status: 404 len: 194 microversion: 2.1 time: 0.150751 Jul 18 02:32:01.848186 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1701/3401] 10.222.0.57 () {58 vars in 1268 bytes} [Mon Jul 18 02:32:01 2022] GET /compute/v2.1/os-security-groups/39b13129-4640-4677-929a-6871715c2cea => generated 194 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:32:02.407186 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-cf9e7009-53d8-4b51-ac54-375a21d8209f tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fa2740ac30453b941b9ea3a57cbd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1287da2aeae4737a8ce953c8edbac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:02.438629 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:02.467854 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-139cfd2b-4251-4de0-809f-0ffffcce07fc tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-264742581", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:02.477303 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cf9e7009-53d8-4b51-ac54-375a21d8209f tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] 10.222.0.57 "GET /compute/v2.1/servers/3651ac1a-8110-424f-ac77-b2ab0f7f93a7" status: 200 len: 1315 microversion: 2.1 time: 1.734655 Jul 18 02:32:02.483780 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1701/3402] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:00 2022] GET /compute/v2.1/servers/3651ac1a-8110-424f-ac77-b2ab0f7f93a7 => generated 1315 bytes in 1743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:02.518623 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-aa33ba2b-bba8-42d6-88c2-691698160102 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '.version_select at 0x7ff4adb2fee0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:02.689564 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-139cfd2b-4251-4de0-809f-0ffffcce07fc tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] validate_networks() for [('57435243-a5cb-431a-9114-648f368de400', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:32:05.880962 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-aa33ba2b-bba8-42d6-88c2-691698160102 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/a5b55d47-d9be-4f21-b30f-1a09c659aaae" status: 202 len: 0 microversion: 2.1 time: 3.394710 Jul 18 02:32:05.881599 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1702/3403] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 02:32:02 2022] DELETE /compute/v2.1/os-security-groups/a5b55d47-d9be-4f21-b30f-1a09c659aaae => generated 0 bytes in 3397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:32:05.891916 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-44ef0793-7cc6-4b2f-b525-32ee18320a2c tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:05.892580 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-44ef0793-7cc6-4b2f-b525-32ee18320a2c tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 6faedf52-1ea8-4a05-8857-d0f8be1fadf9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:05.927654 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-44ef0793-7cc6-4b2f-b525-32ee18320a2c tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:05.928108 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-44ef0793-7cc6-4b2f-b525-32ee18320a2c tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:05.928994 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-44ef0793-7cc6-4b2f-b525-32ee18320a2c tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:05.929379 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-44ef0793-7cc6-4b2f-b525-32ee18320a2c tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:07.981167 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-139cfd2b-4251-4de0-809f-0ffffcce07fc tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:32:07.982377 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-139cfd2b-4251-4de0-809f-0ffffcce07fc tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:32:07.983397 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-139cfd2b-4251-4de0-809f-0ffffcce07fc tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:32:07.984112 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-139cfd2b-4251-4de0-809f-0ffffcce07fc tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:32:07.985066 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-139cfd2b-4251-4de0-809f-0ffffcce07fc tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:32:08.006440 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-139cfd2b-4251-4de0-809f-0ffffcce07fc tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:08.007287 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-139cfd2b-4251-4de0-809f-0ffffcce07fc tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:08.012485 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-139cfd2b-4251-4de0-809f-0ffffcce07fc tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:08.013951 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-139cfd2b-4251-4de0-809f-0ffffcce07fc tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:08.117587 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-139cfd2b-4251-4de0-809f-0ffffcce07fc tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Getting quotas for project 1594a06c4e7c4bb7b184d916342933ba. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:32:08.173250 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-139cfd2b-4251-4de0-809f-0ffffcce07fc tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Getting quotas for user 6f30a2016d954121bb251894fad6dd39 and project 1594a06c4e7c4bb7b184d916342933ba. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:32:08.225944 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-139cfd2b-4251-4de0-809f-0ffffcce07fc tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:32:08.232647 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-139cfd2b-4251-4de0-809f-0ffffcce07fc tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: 02425120-f4dc-4f02-99c5-9bf0fe7e1931] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:32:08.464786 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-139cfd2b-4251-4de0-809f-0ffffcce07fc tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.616389 Jul 18 02:32:08.472162 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1702/3404] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:32:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 6624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:32:08.505087 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7e15929f-4e2c-4b70-a07b-b96ee7800bd1 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:08.508293 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7e15929f-4e2c-4b70-a07b-b96ee7800bd1 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] [instance: 3651ac1a-8110-424f-ac77-b2ab0f7f93a7] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:08.530322 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7e15929f-4e2c-4b70-a07b-b96ee7800bd1 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:08.547324 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7e15929f-4e2c-4b70-a07b-b96ee7800bd1 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:08.553878 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7e15929f-4e2c-4b70-a07b-b96ee7800bd1 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:08.554814 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7e15929f-4e2c-4b70-a07b-b96ee7800bd1 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:08.927839 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-44ef0793-7cc6-4b2f-b525-32ee18320a2c tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:08.966715 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-44ef0793-7cc6-4b2f-b525-32ee18320a2c tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9" status: 200 len: 1804 microversion: 2.1 time: 3.078335 Jul 18 02:32:08.969922 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1703/3405] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:05 2022] GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9 => generated 1804 bytes in 3088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:08.993621 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b6a4eaab-2c3c-42d9-8d8d-1f9bdb7b859e tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '.version_select at 0x7ff4adb3c3a0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:09.350037 n-d-465891-3 devstack@n-api.service[119544]: DEBUG neutronclient.v2_0.client [None req-b6a4eaab-2c3c-42d9-8d8d-1f9bdb7b859e tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a5b55d47-d9be-4f21-b30f-1a09c659aaae does not exist", "detail": ""}} {{(pid=119544) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:32:09.351579 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.security_group_api [None req-b6a4eaab-2c3c-42d9-8d8d-1f9bdb7b859e tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Neutron security group a5b55d47-d9be-4f21-b30f-1a09c659aaae not found {{(pid=119544) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 02:32:09.354955 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-b6a4eaab-2c3c-42d9-8d8d-1f9bdb7b859e tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] HTTP exception thrown: Security group a5b55d47-d9be-4f21-b30f-1a09c659aaae does not exist Jul 18 02:32:09.354955 n-d-465891-3 devstack@n-api.service[119544]: Neutron server returns request_ids: ['req-d11b0777-8ff5-4e30-9143-04edfa7abc39'] Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b6a4eaab-2c3c-42d9-8d8d-1f9bdb7b859e tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Request method failure captured: Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/os-security-groups/a5b55d47-d9be-4f21-b30f-1a09c659aaae HTTP/1.1 Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MXdApAd8jCQLuDQ4GDVob3WlO5TGoerQppREc0ccYssaOHle4VdpCa3zbolI9kA3vBsm6toj834_HQ72z_BEBH3fK1DoWoIDaDTMEsKRnNxFFmWRX0hetMPDmWg_gNY33hhTytVVTi3zUdfIo_ja5VJys5KWb2G5Exx3CV-M4e89mI Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: afe99772712849608ba124613bb5cc26 Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_afe99772712849608ba124613bb5cc26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/afe99772712849608ba124613bb5cc26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/afe99772712849608ba124613bb5cc26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/afe99772712849608ba124613bb5cc26"}]}] Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: afe99772712849608ba124613bb5cc26 Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-SecurityGroupsTestJSON-235723186-project Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 2374fa8610714b72b6034726ee1c2373 Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-SecurityGroupsTestJSON-235723186-project Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: exception: Security group a5b55d47-d9be-4f21-b30f-1a09c659aaae does not exist Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: Neutron server returns request_ids: ['req-d11b0777-8ff5-4e30-9143-04edfa7abc39'] Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'a5b55d47-d9be-4f21-b30f-1a09c659aaae'} Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:32:09.363902 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a5b55d47-d9be-4f21-b30f-1a09c659aaae does not exist Jul 18 02:32:09.370497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d11b0777-8ff5-4e30-9143-04edfa7abc39'] Jul 18 02:32:09.370497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:32:09.370497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:32:09.370497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:32:09.370497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:09.370497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 18 02:32:09.370497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 18 02:32:09.370497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 02:32:09.370497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 02:32:09.370497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a5b55d47-d9be-4f21-b30f-1a09c659aaae does not exist Jul 18 02:32:09.370497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d11b0777-8ff5-4e30-9143-04edfa7abc39'] Jul 18 02:32:09.370497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:32:09.370497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:32:09.370497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:32:09.370497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:09.370497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:32:09.370497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:32:09.370497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:32:09.370497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:32:09.370497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:32:09.370497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:32:09.370497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:32:09.370497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:32:09.370497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 18 02:32:09.370497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 02:32:09.370497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a5b55d47-d9be-4f21-b30f-1a09c659aaae does not exist Jul 18 02:32:09.370497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d11b0777-8ff5-4e30-9143-04edfa7abc39'] Jul 18 02:32:09.370497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:32:09.370497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:32:09.370497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:32:09.370497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:09.370497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:32:09.370497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:32:09.370497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:32:09.370497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:32:09.370497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a5b55d47-d9be-4f21-b30f-1a09c659aaae does not exist Jul 18 02:32:09.370497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d11b0777-8ff5-4e30-9143-04edfa7abc39'] Jul 18 02:32:09.370497 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:32:09.381974 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b6a4eaab-2c3c-42d9-8d8d-1f9bdb7b859e tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Returning 404 to user: Security group a5b55d47-d9be-4f21-b30f-1a09c659aaae does not exist Jul 18 02:32:09.381974 n-d-465891-3 devstack@n-api.service[119544]: Neutron server returns request_ids: ['req-d11b0777-8ff5-4e30-9143-04edfa7abc39'] {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:32:09.384928 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b6a4eaab-2c3c-42d9-8d8d-1f9bdb7b859e tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/os-security-groups/a5b55d47-d9be-4f21-b30f-1a09c659aaae" status: 404 len: 194 microversion: 2.1 time: 0.412155 Jul 18 02:32:09.389838 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1704/3406] 10.222.0.57 () {58 vars in 1268 bytes} [Mon Jul 18 02:32:08 2022] GET /compute/v2.1/os-security-groups/a5b55d47-d9be-4f21-b30f-1a09c659aaae => generated 194 bytes in 419 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:32:09.749164 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-003d8389-33a7-431d-876a-01a3b1d143bf tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1503138264", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "4d7e50c4-cfa3-4324-a23e-fa4be7704fd6"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:09.823296 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7e15929f-4e2c-4b70-a07b-b96ee7800bd1 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fa2740ac30453b941b9ea3a57cbd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1287da2aeae4737a8ce953c8edbac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:09.843164 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7e15929f-4e2c-4b70-a07b-b96ee7800bd1 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] 10.222.0.57 "GET /compute/v2.1/servers/3651ac1a-8110-424f-ac77-b2ab0f7f93a7" status: 200 len: 1315 microversion: 2.1 time: 1.365102 Jul 18 02:32:09.863247 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1703/3407] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:08 2022] GET /compute/v2.1/servers/3651ac1a-8110-424f-ac77-b2ab0f7f93a7 => generated 1315 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:09.871442 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-793ad14f-9724-45c2-82a4-d6e2e3b136a5 req-9ac938b7-d103-471e-946b-10d3106587df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3651ac1a-8110-424f-ac77-b2ab0f7f93a7", "tag": "1bfe89a6-b9aa-47eb-8a21-fe3b8e02575b"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:09.881454 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-793ad14f-9724-45c2-82a4-d6e2e3b136a5 req-9ac938b7-d103-471e-946b-10d3106587df service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:09.882313 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-793ad14f-9724-45c2-82a4-d6e2e3b136a5 req-9ac938b7-d103-471e-946b-10d3106587df service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:09.897542 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-793ad14f-9724-45c2-82a4-d6e2e3b136a5 req-9ac938b7-d103-471e-946b-10d3106587df service nova] Creating event network-changed:1bfe89a6-b9aa-47eb-8a21-fe3b8e02575b for instance 3651ac1a-8110-424f-ac77-b2ab0f7f93a7 on n-h1-465891-3 Jul 18 02:32:09.909489 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-793ad14f-9724-45c2-82a4-d6e2e3b136a5 req-9ac938b7-d103-471e-946b-10d3106587df service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042546 Jul 18 02:32:09.913022 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1704/3408] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:32:09.919747 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3d5ecedd-69dc-4f32-9aa0-29a4be12a3d0 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:09.921587 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3d5ecedd-69dc-4f32-9aa0-29a4be12a3d0 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: 02425120-f4dc-4f02-99c5-9bf0fe7e1931] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:10.091702 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-003d8389-33a7-431d-876a-01a3b1d143bf tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] validate_networks() for [('4d7e50c4-cfa3-4324-a23e-fa4be7704fd6', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:32:10.284655 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3d5ecedd-69dc-4f32-9aa0-29a4be12a3d0 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:10.312388 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3d5ecedd-69dc-4f32-9aa0-29a4be12a3d0 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931" status: 200 len: 1221 microversion: 2.1 time: 0.396032 Jul 18 02:32:10.336265 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1705/3409] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:09 2022] GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931 => generated 1221 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:10.371565 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f35aceb0-8714-423f-92be-d8bcdd889797 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:10.378223 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f35aceb0-8714-423f-92be-d8bcdd889797 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 6faedf52-1ea8-4a05-8857-d0f8be1fadf9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:10.401477 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f35aceb0-8714-423f-92be-d8bcdd889797 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:10.412938 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f35aceb0-8714-423f-92be-d8bcdd889797 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:10.427064 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f35aceb0-8714-423f-92be-d8bcdd889797 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:10.428290 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f35aceb0-8714-423f-92be-d8bcdd889797 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:10.560563 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f35aceb0-8714-423f-92be-d8bcdd889797 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9/ips" status: 200 len: 218 microversion: 2.1 time: 0.221007 Jul 18 02:32:10.576822 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1706/3410] 10.222.0.57 () {58 vars in 1247 bytes} [Mon Jul 18 02:32:10 2022] GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9/ips => generated 218 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:32:10.629619 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-47fca183-de93-4808-9dc1-5dcbc8e2bbc3 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '.version_select at 0x7ff4a8b1d3a0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:12.338351 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-47fca183-de93-4808-9dc1-5dcbc8e2bbc3 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/25b2e6af-ea8b-4fa1-9444-49780c70f287" status: 202 len: 0 microversion: 2.1 time: 1.756033 Jul 18 02:32:12.344466 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1707/3411] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 02:32:10 2022] DELETE /compute/v2.1/os-security-groups/25b2e6af-ea8b-4fa1-9444-49780c70f287 => generated 0 bytes in 1767 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:32:12.351078 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-02b232ca-35e6-402e-b91f-19d85f1f6e87 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1352394437", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:12.463671 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-02b232ca-35e6-402e-b91f-19d85f1f6e87 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] validate_networks() for [('57435243-a5cb-431a-9114-648f368de400', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:32:13.121842 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-003d8389-33a7-431d-876a-01a3b1d143bf tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:32:13.124049 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-003d8389-33a7-431d-876a-01a3b1d143bf tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:32:13.126180 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-003d8389-33a7-431d-876a-01a3b1d143bf tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:32:13.127453 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-003d8389-33a7-431d-876a-01a3b1d143bf tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:32:13.128584 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-003d8389-33a7-431d-876a-01a3b1d143bf tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:32:13.183745 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-003d8389-33a7-431d-876a-01a3b1d143bf tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:13.186649 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-003d8389-33a7-431d-876a-01a3b1d143bf tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:13.218269 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-003d8389-33a7-431d-876a-01a3b1d143bf tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:13.220320 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-003d8389-33a7-431d-876a-01a3b1d143bf tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:13.342287 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-003d8389-33a7-431d-876a-01a3b1d143bf tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Getting quotas for project 1facd579386e4d918990bc99c41fc83f. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:32:13.354995 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-003d8389-33a7-431d-876a-01a3b1d143bf tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Getting quotas for user d150cd3869454560b98dc2dc3cada35a and project 1facd579386e4d918990bc99c41fc83f. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:32:13.402678 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-003d8389-33a7-431d-876a-01a3b1d143bf tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:32:13.405531 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-003d8389-33a7-431d-876a-01a3b1d143bf tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] [instance: b1398a49-8799-4931-a320-455eb2848bcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:32:13.520761 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-003d8389-33a7-431d-876a-01a3b1d143bf tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.121636 Jul 18 02:32:13.527556 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1705/3412] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:32:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 4130 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:32:13.548153 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cae01773-cbcb-40d2-aa58-83405dcb90dc tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:13.563082 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cae01773-cbcb-40d2-aa58-83405dcb90dc tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 6faedf52-1ea8-4a05-8857-d0f8be1fadf9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:13.582942 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cae01773-cbcb-40d2-aa58-83405dcb90dc tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:13.583831 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cae01773-cbcb-40d2-aa58-83405dcb90dc tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:13.584916 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cae01773-cbcb-40d2-aa58-83405dcb90dc tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:13.585820 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cae01773-cbcb-40d2-aa58-83405dcb90dc tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:13.664855 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cae01773-cbcb-40d2-aa58-83405dcb90dc tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 6faedf52-1ea8-4a05-8857-d0f8be1fadf9] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:32:13.975988 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cae01773-cbcb-40d2-aa58-83405dcb90dc tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "DELETE /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9" status: 204 len: 0 microversion: 2.1 time: 0.445039 Jul 18 02:32:13.983060 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1706/3413] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:32:13 2022] DELETE /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:32:13.998695 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-69fa9843-96d5-4c9f-a939-79bb1403a803 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:14.000774 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-69fa9843-96d5-4c9f-a939-79bb1403a803 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] [instance: 3651ac1a-8110-424f-ac77-b2ab0f7f93a7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:14.024324 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69fa9843-96d5-4c9f-a939-79bb1403a803 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:14.034575 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69fa9843-96d5-4c9f-a939-79bb1403a803 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:14.036203 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69fa9843-96d5-4c9f-a939-79bb1403a803 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:14.036922 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69fa9843-96d5-4c9f-a939-79bb1403a803 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:15.556326 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-69fa9843-96d5-4c9f-a939-79bb1403a803 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fa2740ac30453b941b9ea3a57cbd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1287da2aeae4737a8ce953c8edbac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:15.636871 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-69fa9843-96d5-4c9f-a939-79bb1403a803 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] 10.222.0.57 "GET /compute/v2.1/servers/3651ac1a-8110-424f-ac77-b2ab0f7f93a7" status: 200 len: 1315 microversion: 2.1 time: 1.651392 Jul 18 02:32:15.655232 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1707/3414] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:13 2022] GET /compute/v2.1/servers/3651ac1a-8110-424f-ac77-b2ab0f7f93a7 => generated 1315 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:15.672411 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cc67d8c9-7e83-46fb-bc5d-344b64d20f43 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '.version_select at 0x7ff49b81d700>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:15.799484 n-d-465891-3 devstack@n-api.service[119544]: DEBUG neutronclient.v2_0.client [None req-cc67d8c9-7e83-46fb-bc5d-344b64d20f43 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 25b2e6af-ea8b-4fa1-9444-49780c70f287 does not exist", "detail": ""}} {{(pid=119544) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:32:15.800384 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.security_group_api [None req-cc67d8c9-7e83-46fb-bc5d-344b64d20f43 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Neutron security group 25b2e6af-ea8b-4fa1-9444-49780c70f287 not found {{(pid=119544) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 02:32:15.805266 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-cc67d8c9-7e83-46fb-bc5d-344b64d20f43 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] HTTP exception thrown: Security group 25b2e6af-ea8b-4fa1-9444-49780c70f287 does not exist Jul 18 02:32:15.805266 n-d-465891-3 devstack@n-api.service[119544]: Neutron server returns request_ids: ['req-8e5a2495-d52d-47af-8246-48381394450c'] Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cc67d8c9-7e83-46fb-bc5d-344b64d20f43 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Request method failure captured: Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/os-security-groups/25b2e6af-ea8b-4fa1-9444-49780c70f287 HTTP/1.1 Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MXdApAd8jCQLuDQ4GDVob3WlO5TGoerQppREc0ccYssaOHle4VdpCa3zbolI9kA3vBsm6toj834_HQ72z_BEBH3fK1DoWoIDaDTMEsKRnNxFFmWRX0hetMPDmWg_gNY33hhTytVVTi3zUdfIo_ja5VJys5KWb2G5Exx3CV-M4e89mI Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: afe99772712849608ba124613bb5cc26 Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_afe99772712849608ba124613bb5cc26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/afe99772712849608ba124613bb5cc26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/afe99772712849608ba124613bb5cc26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/afe99772712849608ba124613bb5cc26"}]}] Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: afe99772712849608ba124613bb5cc26 Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-SecurityGroupsTestJSON-235723186-project Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 2374fa8610714b72b6034726ee1c2373 Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-SecurityGroupsTestJSON-235723186-project Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: exception: Security group 25b2e6af-ea8b-4fa1-9444-49780c70f287 does not exist Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: Neutron server returns request_ids: ['req-8e5a2495-d52d-47af-8246-48381394450c'] Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '25b2e6af-ea8b-4fa1-9444-49780c70f287'} Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:32:15.811993 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 25b2e6af-ea8b-4fa1-9444-49780c70f287 does not exist Jul 18 02:32:15.815471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e5a2495-d52d-47af-8246-48381394450c'] Jul 18 02:32:15.815471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:32:15.815471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:32:15.815471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:32:15.815471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:15.815471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 18 02:32:15.815471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 18 02:32:15.815471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 02:32:15.815471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 02:32:15.815471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 25b2e6af-ea8b-4fa1-9444-49780c70f287 does not exist Jul 18 02:32:15.815471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e5a2495-d52d-47af-8246-48381394450c'] Jul 18 02:32:15.815471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:32:15.815471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:32:15.815471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:32:15.815471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:15.815471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:32:15.815471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:32:15.815471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:32:15.815471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:32:15.815471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:32:15.815471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:32:15.815471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:32:15.815471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:32:15.815471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 18 02:32:15.815471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 02:32:15.815471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 25b2e6af-ea8b-4fa1-9444-49780c70f287 does not exist Jul 18 02:32:15.815471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e5a2495-d52d-47af-8246-48381394450c'] Jul 18 02:32:15.815471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:32:15.815471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:32:15.815471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:32:15.815471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:15.815471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:32:15.815471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:32:15.815471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:32:15.815471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:32:15.815471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 25b2e6af-ea8b-4fa1-9444-49780c70f287 does not exist Jul 18 02:32:15.815471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e5a2495-d52d-47af-8246-48381394450c'] Jul 18 02:32:15.815471 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:32:15.819028 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cc67d8c9-7e83-46fb-bc5d-344b64d20f43 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Returning 404 to user: Security group 25b2e6af-ea8b-4fa1-9444-49780c70f287 does not exist Jul 18 02:32:15.819028 n-d-465891-3 devstack@n-api.service[119544]: Neutron server returns request_ids: ['req-8e5a2495-d52d-47af-8246-48381394450c'] {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:32:15.823601 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cc67d8c9-7e83-46fb-bc5d-344b64d20f43 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/os-security-groups/25b2e6af-ea8b-4fa1-9444-49780c70f287" status: 404 len: 194 microversion: 2.1 time: 0.164686 Jul 18 02:32:15.824744 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1708/3415] 10.222.0.57 () {58 vars in 1268 bytes} [Mon Jul 18 02:32:15 2022] GET /compute/v2.1/os-security-groups/25b2e6af-ea8b-4fa1-9444-49780c70f287 => generated 194 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:32:15.839693 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2ab2d390-e74f-4ed8-b78b-795622bd1bbc tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:15.841746 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2ab2d390-e74f-4ed8-b78b-795622bd1bbc tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] [instance: b1398a49-8799-4931-a320-455eb2848bcd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:15.874627 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ab2d390-e74f-4ed8-b78b-795622bd1bbc tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:15.878048 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ab2d390-e74f-4ed8-b78b-795622bd1bbc tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:15.879181 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ab2d390-e74f-4ed8-b78b-795622bd1bbc tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:15.879711 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ab2d390-e74f-4ed8-b78b-795622bd1bbc tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:16.180786 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2ab2d390-e74f-4ed8-b78b-795622bd1bbc tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd150cd3869454560b98dc2dc3cada35a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1facd579386e4d918990bc99c41fc83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:16.198162 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2ab2d390-e74f-4ed8-b78b-795622bd1bbc tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] 10.222.0.57 "GET /compute/v2.1/servers/b1398a49-8799-4931-a320-455eb2848bcd" status: 200 len: 1277 microversion: 2.1 time: 0.371915 Jul 18 02:32:16.198777 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1709/3416] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:15 2022] GET /compute/v2.1/servers/b1398a49-8799-4931-a320-455eb2848bcd => generated 1277 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:16.225972 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-23089b3c-e5e3-4916-9110-a2f15cd1fae6 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:16.233535 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-23089b3c-e5e3-4916-9110-a2f15cd1fae6 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 6faedf52-1ea8-4a05-8857-d0f8be1fadf9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:16.259959 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-23089b3c-e5e3-4916-9110-a2f15cd1fae6 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:16.260320 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-23089b3c-e5e3-4916-9110-a2f15cd1fae6 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:16.261219 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-23089b3c-e5e3-4916-9110-a2f15cd1fae6 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:16.262061 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-23089b3c-e5e3-4916-9110-a2f15cd1fae6 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:16.970743 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-02b232ca-35e6-402e-b91f-19d85f1f6e87 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:32:16.971527 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-02b232ca-35e6-402e-b91f-19d85f1f6e87 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:32:16.972762 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-02b232ca-35e6-402e-b91f-19d85f1f6e87 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:32:16.973573 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-02b232ca-35e6-402e-b91f-19d85f1f6e87 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:32:16.975121 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-02b232ca-35e6-402e-b91f-19d85f1f6e87 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:32:16.992401 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:17.060849 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-02b232ca-35e6-402e-b91f-19d85f1f6e87 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:17.064961 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-02b232ca-35e6-402e-b91f-19d85f1f6e87 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:17.076803 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-02b232ca-35e6-402e-b91f-19d85f1f6e87 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:17.079780 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-02b232ca-35e6-402e-b91f-19d85f1f6e87 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:17.183776 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=50 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:17.267408 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-02b232ca-35e6-402e-b91f-19d85f1f6e87 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Getting quotas for project 1594a06c4e7c4bb7b184d916342933ba. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:32:17.299837 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-02b232ca-35e6-402e-b91f-19d85f1f6e87 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Getting quotas for user 6f30a2016d954121bb251894fad6dd39 and project 1594a06c4e7c4bb7b184d916342933ba. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:32:17.349885 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-02b232ca-35e6-402e-b91f-19d85f1f6e87 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:32:17.370918 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-02b232ca-35e6-402e-b91f-19d85f1f6e87 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: f4822dbd-f6d6-4c66-8661-69a15acf9df4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:32:17.624747 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-02b232ca-35e6-402e-b91f-19d85f1f6e87 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.278566 Jul 18 02:32:17.636856 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1708/3417] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:32:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 5292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:32:17.663361 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-55c2228c-5e25-4691-87d3-cd561f2204e7 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '.version_select at 0x7ff49bda2e50>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:18.673973 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-23089b3c-e5e3-4916-9110-a2f15cd1fae6 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:18.688537 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-23089b3c-e5e3-4916-9110-a2f15cd1fae6 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9" status: 200 len: 1810 microversion: 2.1 time: 2.485120 Jul 18 02:32:18.693634 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1710/3418] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:16 2022] GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9 => generated 1810 bytes in 2491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:18.699054 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6b0ad668-10f2-4baf-ba56-fa80c8cd41fe tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:18.722504 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6b0ad668-10f2-4baf-ba56-fa80c8cd41fe tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] [instance: 3651ac1a-8110-424f-ac77-b2ab0f7f93a7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:18.741668 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b0ad668-10f2-4baf-ba56-fa80c8cd41fe tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:18.742157 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b0ad668-10f2-4baf-ba56-fa80c8cd41fe tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:18.754588 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b0ad668-10f2-4baf-ba56-fa80c8cd41fe tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:18.755563 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b0ad668-10f2-4baf-ba56-fa80c8cd41fe tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:21.247342 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6b0ad668-10f2-4baf-ba56-fa80c8cd41fe tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fa2740ac30453b941b9ea3a57cbd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1287da2aeae4737a8ce953c8edbac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:21.281858 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6b0ad668-10f2-4baf-ba56-fa80c8cd41fe tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] 10.222.0.57 "GET /compute/v2.1/servers/3651ac1a-8110-424f-ac77-b2ab0f7f93a7" status: 200 len: 1315 microversion: 2.1 time: 2.578942 Jul 18 02:32:21.283201 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1711/3419] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:18 2022] GET /compute/v2.1/servers/3651ac1a-8110-424f-ac77-b2ab0f7f93a7 => generated 1315 bytes in 2589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:21.298290 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-350d4a7d-ec66-4d00-a8ec-2e7cf18c7d3b tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:21.299243 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-350d4a7d-ec66-4d00-a8ec-2e7cf18c7d3b tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] [instance: b1398a49-8799-4931-a320-455eb2848bcd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:21.323407 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-350d4a7d-ec66-4d00-a8ec-2e7cf18c7d3b tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:21.323867 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-350d4a7d-ec66-4d00-a8ec-2e7cf18c7d3b tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:21.329535 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-350d4a7d-ec66-4d00-a8ec-2e7cf18c7d3b tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:21.330670 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-350d4a7d-ec66-4d00-a8ec-2e7cf18c7d3b tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:21.335226 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-55c2228c-5e25-4691-87d3-cd561f2204e7 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 3.685053 Jul 18 02:32:21.336526 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1709/3420] 10.222.0.57 () {58 vars in 1157 bytes} [Mon Jul 18 02:32:17 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 3699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:21.350935 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c77df970-0c97-4dea-8f76-b9794a52e0f9 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:21.354879 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c77df970-0c97-4dea-8f76-b9794a52e0f9 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: f4822dbd-f6d6-4c66-8661-69a15acf9df4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:21.399952 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c77df970-0c97-4dea-8f76-b9794a52e0f9 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:21.402891 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c77df970-0c97-4dea-8f76-b9794a52e0f9 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:21.405416 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c77df970-0c97-4dea-8f76-b9794a52e0f9 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:21.407282 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c77df970-0c97-4dea-8f76-b9794a52e0f9 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:22.270479 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c77df970-0c97-4dea-8f76-b9794a52e0f9 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:22.299029 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c77df970-0c97-4dea-8f76-b9794a52e0f9 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4" status: 200 len: 1280 microversion: 2.1 time: 0.958939 Jul 18 02:32:22.301128 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1710/3421] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:21 2022] GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4 => generated 1280 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:22.313438 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-f06c68db-13cf-4ce1-8748-72b36bcf5906 req-ebc613ab-5bb1-46b6-9aad-9a7763c9e790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6faedf52-1ea8-4a05-8857-d0f8be1fadf9", "name": "network-vif-deleted", "tag": "9a5f7450-58f9-4649-8d0f-1989ae009bd3"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:22.332310 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-f06c68db-13cf-4ce1-8748-72b36bcf5906 req-ebc613ab-5bb1-46b6-9aad-9a7763c9e790 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:22.333578 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-f06c68db-13cf-4ce1-8748-72b36bcf5906 req-ebc613ab-5bb1-46b6-9aad-9a7763c9e790 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:22.358937 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-f06c68db-13cf-4ce1-8748-72b36bcf5906 req-ebc613ab-5bb1-46b6-9aad-9a7763c9e790 service nova] Creating event network-vif-deleted:9a5f7450-58f9-4649-8d0f-1989ae009bd3 for instance 6faedf52-1ea8-4a05-8857-d0f8be1fadf9 on n-h2-465891-3 Jul 18 02:32:22.379169 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-f06c68db-13cf-4ce1-8748-72b36bcf5906 req-ebc613ab-5bb1-46b6-9aad-9a7763c9e790 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075979 Jul 18 02:32:22.382720 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1711/3422] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:32:22.397886 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6c6113e9-6fa4-4b9b-9080-200a5d1f7842 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:22.405189 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6c6113e9-6fa4-4b9b-9080-200a5d1f7842 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 6faedf52-1ea8-4a05-8857-d0f8be1fadf9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:22.419319 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6c6113e9-6fa4-4b9b-9080-200a5d1f7842 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:22.423075 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6c6113e9-6fa4-4b9b-9080-200a5d1f7842 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:22.424245 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6c6113e9-6fa4-4b9b-9080-200a5d1f7842 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:22.431983 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6c6113e9-6fa4-4b9b-9080-200a5d1f7842 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:22.710201 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-350d4a7d-ec66-4d00-a8ec-2e7cf18c7d3b tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd150cd3869454560b98dc2dc3cada35a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1facd579386e4d918990bc99c41fc83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:22.742667 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-350d4a7d-ec66-4d00-a8ec-2e7cf18c7d3b tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] 10.222.0.57 "GET /compute/v2.1/servers/b1398a49-8799-4931-a320-455eb2848bcd" status: 200 len: 1325 microversion: 2.1 time: 1.457683 Jul 18 02:32:22.750450 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1712/3423] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:21 2022] GET /compute/v2.1/servers/b1398a49-8799-4931-a320-455eb2848bcd => generated 1325 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:22.768109 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-7bd1f0b9-84f3-414a-a8aa-48490a00614b req-fc1c5423-b5ac-46ed-900b-0b842908fc2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6faedf52-1ea8-4a05-8857-d0f8be1fadf9", "name": "network-vif-unplugged", "status": "completed", "tag": "a2743901-0f11-4760-a3f9-8ba646c29310"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:22.799219 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-7bd1f0b9-84f3-414a-a8aa-48490a00614b req-fc1c5423-b5ac-46ed-900b-0b842908fc2a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:22.799949 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-7bd1f0b9-84f3-414a-a8aa-48490a00614b req-fc1c5423-b5ac-46ed-900b-0b842908fc2a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:22.818753 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-7bd1f0b9-84f3-414a-a8aa-48490a00614b req-fc1c5423-b5ac-46ed-900b-0b842908fc2a service nova] Creating event network-vif-unplugged:a2743901-0f11-4760-a3f9-8ba646c29310 for instance 6faedf52-1ea8-4a05-8857-d0f8be1fadf9 on n-h2-465891-3 Jul 18 02:32:22.836921 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-7bd1f0b9-84f3-414a-a8aa-48490a00614b req-fc1c5423-b5ac-46ed-900b-0b842908fc2a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077144 Jul 18 02:32:22.840412 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1713/3424] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:32:22.856548 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-54911712-0506-4dcd-8104-6cc632c7702d tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Action: 'create', calling method: .version_select at 0x7ff49b804820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2091015935", "description": "tempest-description-757660793"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:23.176770 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6c6113e9-6fa4-4b9b-9080-200a5d1f7842 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:23.195441 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6c6113e9-6fa4-4b9b-9080-200a5d1f7842 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9" status: 200 len: 1653 microversion: 2.1 time: 0.807393 Jul 18 02:32:23.197715 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1712/3425] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:22 2022] GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9 => generated 1653 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:23.213456 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b3b219c7-efdb-49ce-be78-4d2355431ef3 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:23.214520 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b3b219c7-efdb-49ce-be78-4d2355431ef3 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] [instance: 3651ac1a-8110-424f-ac77-b2ab0f7f93a7] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:23.229764 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b3b219c7-efdb-49ce-be78-4d2355431ef3 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:23.232792 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b3b219c7-efdb-49ce-be78-4d2355431ef3 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:23.234449 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b3b219c7-efdb-49ce-be78-4d2355431ef3 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:23.237984 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b3b219c7-efdb-49ce-be78-4d2355431ef3 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:23.301649 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:23.377523 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:23.615992 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-54911712-0506-4dcd-8104-6cc632c7702d tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.773579 Jul 18 02:32:23.616806 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1714/3426] 10.222.0.57 () {60 vars in 1179 bytes} [Mon Jul 18 02:32:22 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:32:23.623381 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3fb4f14c-e39d-47c5-b234-3f58f73aea96 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:23.624611 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3fb4f14c-e39d-47c5-b234-3f58f73aea96 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: f4822dbd-f6d6-4c66-8661-69a15acf9df4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:23.642505 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3fb4f14c-e39d-47c5-b234-3f58f73aea96 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:23.643242 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3fb4f14c-e39d-47c5-b234-3f58f73aea96 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:23.644827 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3fb4f14c-e39d-47c5-b234-3f58f73aea96 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:23.645594 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3fb4f14c-e39d-47c5-b234-3f58f73aea96 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:24.389007 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b3b219c7-efdb-49ce-be78-4d2355431ef3 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fa2740ac30453b941b9ea3a57cbd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1287da2aeae4737a8ce953c8edbac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:24.402361 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b3b219c7-efdb-49ce-be78-4d2355431ef3 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] 10.222.0.57 "GET /compute/v2.1/servers/3651ac1a-8110-424f-ac77-b2ab0f7f93a7" status: 200 len: 1315 microversion: 2.1 time: 1.201339 Jul 18 02:32:24.405076 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1713/3427] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:23 2022] GET /compute/v2.1/servers/3651ac1a-8110-424f-ac77-b2ab0f7f93a7 => generated 1315 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:24.417885 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fed134b5-6501-4f37-84cc-6d98d3caba4e tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Action: 'create', calling method: .version_select at 0x7ff49bb7d430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1349707044", "description": "tempest-description-599449924"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:24.570755 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3fb4f14c-e39d-47c5-b234-3f58f73aea96 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:24.599153 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3fb4f14c-e39d-47c5-b234-3f58f73aea96 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4" status: 200 len: 1322 microversion: 2.1 time: 0.977378 Jul 18 02:32:24.605114 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1715/3428] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:23 2022] GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4 => generated 1322 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:24.654333 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-11346244-0bb6-4e79-a8e6-bcf59ffa45b4 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:24.659975 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-11346244-0bb6-4e79-a8e6-bcf59ffa45b4 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] [instance: b1398a49-8799-4931-a320-455eb2848bcd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:24.667753 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-11346244-0bb6-4e79-a8e6-bcf59ffa45b4 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:24.672558 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-11346244-0bb6-4e79-a8e6-bcf59ffa45b4 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:24.673898 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-11346244-0bb6-4e79-a8e6-bcf59ffa45b4 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:24.674601 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-11346244-0bb6-4e79-a8e6-bcf59ffa45b4 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:25.538181 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fed134b5-6501-4f37-84cc-6d98d3caba4e tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.130392 Jul 18 02:32:25.540155 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1714/3429] 10.222.0.57 () {60 vars in 1179 bytes} [Mon Jul 18 02:32:24 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:32:25.545910 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-760470ff-b34a-4020-ac24-0e9e835589c2 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:25.546859 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-760470ff-b34a-4020-ac24-0e9e835589c2 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 6faedf52-1ea8-4a05-8857-d0f8be1fadf9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:25.559752 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-11346244-0bb6-4e79-a8e6-bcf59ffa45b4 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd150cd3869454560b98dc2dc3cada35a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1facd579386e4d918990bc99c41fc83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:25.571156 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-11346244-0bb6-4e79-a8e6-bcf59ffa45b4 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] 10.222.0.57 "GET /compute/v2.1/servers/b1398a49-8799-4931-a320-455eb2848bcd" status: 200 len: 1325 microversion: 2.1 time: 0.964073 Jul 18 02:32:25.578537 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1716/3430] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:24 2022] GET /compute/v2.1/servers/b1398a49-8799-4931-a320-455eb2848bcd => generated 1325 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:25.583680 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-a6bdbfa7-0d3c-4ab5-b6a5-8cb881589573 req-f99e6255-6200-411a-a83b-cec9a81e1388 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6faedf52-1ea8-4a05-8857-d0f8be1fadf9", "name": "network-vif-deleted", "tag": "cd0b98f1-7816-4d96-9904-dec1420e3c34"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:25.612603 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-760470ff-b34a-4020-ac24-0e9e835589c2 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:25.619343 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-760470ff-b34a-4020-ac24-0e9e835589c2 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:25.620572 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-760470ff-b34a-4020-ac24-0e9e835589c2 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:25.621246 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-760470ff-b34a-4020-ac24-0e9e835589c2 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:25.622413 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:25.624752 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-a6bdbfa7-0d3c-4ab5-b6a5-8cb881589573 req-f99e6255-6200-411a-a83b-cec9a81e1388 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:25.625211 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-a6bdbfa7-0d3c-4ab5-b6a5-8cb881589573 req-f99e6255-6200-411a-a83b-cec9a81e1388 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:25.668998 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-a6bdbfa7-0d3c-4ab5-b6a5-8cb881589573 req-f99e6255-6200-411a-a83b-cec9a81e1388 service nova] Creating event network-vif-deleted:cd0b98f1-7816-4d96-9904-dec1420e3c34 for instance 6faedf52-1ea8-4a05-8857-d0f8be1fadf9 on n-h2-465891-3 Jul 18 02:32:25.681125 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-a6bdbfa7-0d3c-4ab5-b6a5-8cb881589573 req-f99e6255-6200-411a-a83b-cec9a81e1388 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097888 Jul 18 02:32:25.683406 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1717/3431] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:32:25.721311 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-ba201043-b85c-4cdb-9729-7dae165e9347 req-38746a85-0597-4297-be77-3569b4482072 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3651ac1a-8110-424f-ac77-b2ab0f7f93a7", "name": "network-vif-plugged", "status": "completed", "tag": "1bfe89a6-b9aa-47eb-8a21-fe3b8e02575b"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:25.770275 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-ba201043-b85c-4cdb-9729-7dae165e9347 req-38746a85-0597-4297-be77-3569b4482072 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:25.771877 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-ba201043-b85c-4cdb-9729-7dae165e9347 req-38746a85-0597-4297-be77-3569b4482072 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:25.800671 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-760470ff-b34a-4020-ac24-0e9e835589c2 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:25.810320 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-760470ff-b34a-4020-ac24-0e9e835589c2 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:25.811709 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-760470ff-b34a-4020-ac24-0e9e835589c2 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lazy-loading 'fault' on Instance uuid 6faedf52-1ea8-4a05-8857-d0f8be1fadf9 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:32:25.850563 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-ba201043-b85c-4cdb-9729-7dae165e9347 req-38746a85-0597-4297-be77-3569b4482072 service nova] Creating event network-vif-plugged:1bfe89a6-b9aa-47eb-8a21-fe3b8e02575b for instance 3651ac1a-8110-424f-ac77-b2ab0f7f93a7 on n-h1-465891-3 Jul 18 02:32:25.891565 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-ba201043-b85c-4cdb-9729-7dae165e9347 req-38746a85-0597-4297-be77-3569b4482072 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.196993 Jul 18 02:32:25.903338 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1718/3432] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:32:25.971050 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cfeb0354-a396-444a-8a64-3d9a8cf65d1d tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:25.977894 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cfeb0354-a396-444a-8a64-3d9a8cf65d1d tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] [instance: 3651ac1a-8110-424f-ac77-b2ab0f7f93a7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:26.024000 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cfeb0354-a396-444a-8a64-3d9a8cf65d1d tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:26.026406 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cfeb0354-a396-444a-8a64-3d9a8cf65d1d tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:26.030850 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cfeb0354-a396-444a-8a64-3d9a8cf65d1d tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:26.031942 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cfeb0354-a396-444a-8a64-3d9a8cf65d1d tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:26.087371 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-760470ff-b34a-4020-ac24-0e9e835589c2 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:26.119156 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-760470ff-b34a-4020-ac24-0e9e835589c2 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9" status: 200 len: 1302 microversion: 2.1 time: 0.576959 Jul 18 02:32:26.128816 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1715/3433] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:25 2022] GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9 => generated 1302 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:26.155011 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-10fe83dc-e020-46a7-8807-e8ec30958125 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:26.160777 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-10fe83dc-e020-46a7-8807-e8ec30958125 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: f4822dbd-f6d6-4c66-8661-69a15acf9df4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:26.187520 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-10fe83dc-e020-46a7-8807-e8ec30958125 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:26.188344 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-10fe83dc-e020-46a7-8807-e8ec30958125 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:26.190175 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-10fe83dc-e020-46a7-8807-e8ec30958125 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:26.191268 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-10fe83dc-e020-46a7-8807-e8ec30958125 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:27.185252 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=4 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:27.336334 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=14 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:27.488546 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-10fe83dc-e020-46a7-8807-e8ec30958125 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:27.509210 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-10fe83dc-e020-46a7-8807-e8ec30958125 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4" status: 200 len: 1322 microversion: 2.1 time: 1.378337 Jul 18 02:32:27.511029 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1716/3434] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:26 2022] GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4 => generated 1322 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:27.561818 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fdaee076-1254-4c8a-9285-809491a474a2 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-635567275", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "05f51095-6f49-45f8-82bd-47fad9cad04f"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:27.579793 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-cfeb0354-a396-444a-8a64-3d9a8cf65d1d tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fa2740ac30453b941b9ea3a57cbd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1287da2aeae4737a8ce953c8edbac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:27.596141 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cfeb0354-a396-444a-8a64-3d9a8cf65d1d tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] 10.222.0.57 "GET /compute/v2.1/servers/3651ac1a-8110-424f-ac77-b2ab0f7f93a7" status: 200 len: 1315 microversion: 2.1 time: 1.685523 Jul 18 02:32:27.612520 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1719/3435] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:25 2022] GET /compute/v2.1/servers/3651ac1a-8110-424f-ac77-b2ab0f7f93a7 => generated 1315 bytes in 1706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:27.624791 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-084a4ad9-f204-4235-a62d-8b4bcefd7e5b tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:27.626054 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-084a4ad9-f204-4235-a62d-8b4bcefd7e5b tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] [instance: b1398a49-8799-4931-a320-455eb2848bcd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:27.643830 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-084a4ad9-f204-4235-a62d-8b4bcefd7e5b tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:27.644299 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-084a4ad9-f204-4235-a62d-8b4bcefd7e5b tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:27.645132 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-084a4ad9-f204-4235-a62d-8b4bcefd7e5b tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:27.648607 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-084a4ad9-f204-4235-a62d-8b4bcefd7e5b tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:27.724195 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-fdaee076-1254-4c8a-9285-809491a474a2 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] validate_networks() for [('05f51095-6f49-45f8-82bd-47fad9cad04f', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:32:29.244649 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-084a4ad9-f204-4235-a62d-8b4bcefd7e5b tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd150cd3869454560b98dc2dc3cada35a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1facd579386e4d918990bc99c41fc83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:29.261492 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-084a4ad9-f204-4235-a62d-8b4bcefd7e5b tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] 10.222.0.57 "GET /compute/v2.1/servers/b1398a49-8799-4931-a320-455eb2848bcd" status: 200 len: 1325 microversion: 2.1 time: 1.647741 Jul 18 02:32:29.262142 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1720/3436] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:27 2022] GET /compute/v2.1/servers/b1398a49-8799-4931-a320-455eb2848bcd => generated 1325 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:29.287121 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-03305f2e-97f2-46c8-bda1-25acead61f9f tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:29.297561 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-03305f2e-97f2-46c8-bda1-25acead61f9f tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 6faedf52-1ea8-4a05-8857-d0f8be1fadf9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:29.315758 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-03305f2e-97f2-46c8-bda1-25acead61f9f tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:29.316504 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-03305f2e-97f2-46c8-bda1-25acead61f9f tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:29.317520 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-03305f2e-97f2-46c8-bda1-25acead61f9f tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:29.321308 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-03305f2e-97f2-46c8-bda1-25acead61f9f tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:29.371802 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-03305f2e-97f2-46c8-bda1-25acead61f9f tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] HTTP exception thrown: Instance 6faedf52-1ea8-4a05-8857-d0f8be1fadf9 could not be found. Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-03305f2e-97f2-46c8-bda1-25acead61f9f tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Request method failure captured: Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9 HTTP/1.1 Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MXCIOaod40m20WbrLAhvejXGgWGYoScZiJAmiZ3HizCiwZHoCKVassRVJDupAhRDpTMtTimuOSkPApLvzXSkpOpBrwwrergLjoegz_JjcMtdTQfoVFrmGdxUcPNhAsxqRnRRjAYgmYy-Lg7-6jhiq3gGYKCnlWdIaGKSFm4o5hpmOw Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 2a2eddce815546778247c5d0c9986610 Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersTestMultiNic-942367850 Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2a2eddce815546778247c5d0c9986610"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2a2eddce815546778247c5d0c9986610"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2a2eddce815546778247c5d0c9986610"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2a2eddce815546778247c5d0c9986610"}]}] Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersTestMultiNic-942367850 Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 2a2eddce815546778247c5d0c9986610 Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersTestMultiNic-942367850 Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersTestMultiNic-942367850-project Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: c12b1d209c7c4bdfaa3f18b95095e065 Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersTestMultiNic-942367850-project Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 6faedf52-1ea8-4a05-8857-d0f8be1fadf9 could not be found. Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '6faedf52-1ea8-4a05-8857-d0f8be1fadf9'} Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6faedf52-1ea8-4a05-8857-d0f8be1fadf9 could not be found. Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6faedf52-1ea8-4a05-8857-d0f8be1fadf9 could not be found. Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:32:29.375798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:32:29.386842 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:29.386842 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:32:29.386842 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:32:29.386842 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:32:29.386842 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:32:29.386842 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6faedf52-1ea8-4a05-8857-d0f8be1fadf9 could not be found. Jul 18 02:32:29.386842 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:32:29.386842 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-03305f2e-97f2-46c8-bda1-25acead61f9f tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Returning 404 to user: Instance 6faedf52-1ea8-4a05-8857-d0f8be1fadf9 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:32:29.386842 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-03305f2e-97f2-46c8-bda1-25acead61f9f tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9" status: 404 len: 111 microversion: 2.1 time: 0.104871 Jul 18 02:32:29.386842 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1721/3437] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:29 2022] GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:32:29.399114 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-5dc87691-fd83-43b8-9e48-af8026ef5bd5 req-ff85b9b4-ca6b-4054-a0ea-0388d72ecede service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02425120-f4dc-4f02-99c5-9bf0fe7e1931", "tag": "0cb635f0-d31b-4491-a882-a1e3c6656f22"}, {"server_uuid": "6faedf52-1ea8-4a05-8857-d0f8be1fadf9", "name": "network-vif-deleted", "tag": "a2743901-0f11-4760-a3f9-8ba646c29310"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:29.432509 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-5dc87691-fd83-43b8-9e48-af8026ef5bd5 req-ff85b9b4-ca6b-4054-a0ea-0388d72ecede service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:29.432983 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-5dc87691-fd83-43b8-9e48-af8026ef5bd5 req-ff85b9b4-ca6b-4054-a0ea-0388d72ecede service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:29.493424 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-5dc87691-fd83-43b8-9e48-af8026ef5bd5 req-ff85b9b4-ca6b-4054-a0ea-0388d72ecede service nova] Creating event network-changed:0cb635f0-d31b-4491-a882-a1e3c6656f22 for instance 02425120-f4dc-4f02-99c5-9bf0fe7e1931 on n-h1-465891-3 Jul 18 02:32:29.496501 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-5dc87691-fd83-43b8-9e48-af8026ef5bd5 req-ff85b9b4-ca6b-4054-a0ea-0388d72ecede service nova] Creating event network-vif-deleted:a2743901-0f11-4760-a3f9-8ba646c29310 for instance 6faedf52-1ea8-4a05-8857-d0f8be1fadf9 on n-h2-465891-3 Jul 18 02:32:29.533483 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-5dc87691-fd83-43b8-9e48-af8026ef5bd5 req-ff85b9b4-ca6b-4054-a0ea-0388d72ecede service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.128875 Jul 18 02:32:29.535119 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1722/3438] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:32:29.560517 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8811d653-c150-40c5-be83-5efb393b9f12 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:29.567893 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8811d653-c150-40c5-be83-5efb393b9f12 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: f4822dbd-f6d6-4c66-8661-69a15acf9df4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:29.596831 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8811d653-c150-40c5-be83-5efb393b9f12 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:29.602206 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8811d653-c150-40c5-be83-5efb393b9f12 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:29.603885 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8811d653-c150-40c5-be83-5efb393b9f12 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:29.604720 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8811d653-c150-40c5-be83-5efb393b9f12 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:30.498037 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8811d653-c150-40c5-be83-5efb393b9f12 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:30.514741 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8811d653-c150-40c5-be83-5efb393b9f12 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4" status: 200 len: 1322 microversion: 2.1 time: 0.973437 Jul 18 02:32:30.516722 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1723/3439] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:29 2022] GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4 => generated 1322 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:30.528540 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-666b6ce7-afc9-47d5-8d6a-5122fe61accb tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:30.529422 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-666b6ce7-afc9-47d5-8d6a-5122fe61accb tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] [instance: 3651ac1a-8110-424f-ac77-b2ab0f7f93a7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:30.536721 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-666b6ce7-afc9-47d5-8d6a-5122fe61accb tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:30.537422 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-666b6ce7-afc9-47d5-8d6a-5122fe61accb tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:30.539111 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-666b6ce7-afc9-47d5-8d6a-5122fe61accb tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:30.539744 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-666b6ce7-afc9-47d5-8d6a-5122fe61accb tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:31.462315 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-fdaee076-1254-4c8a-9285-809491a474a2 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:32:31.463116 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-fdaee076-1254-4c8a-9285-809491a474a2 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:32:31.464550 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-fdaee076-1254-4c8a-9285-809491a474a2 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:32:31.464550 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-fdaee076-1254-4c8a-9285-809491a474a2 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:32:31.464550 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-fdaee076-1254-4c8a-9285-809491a474a2 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:32:31.486427 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fdaee076-1254-4c8a-9285-809491a474a2 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:31.486897 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fdaee076-1254-4c8a-9285-809491a474a2 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:31.487700 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fdaee076-1254-4c8a-9285-809491a474a2 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:31.488153 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fdaee076-1254-4c8a-9285-809491a474a2 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:31.522099 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-fdaee076-1254-4c8a-9285-809491a474a2 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Getting quotas for project afe99772712849608ba124613bb5cc26. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:32:31.546910 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-fdaee076-1254-4c8a-9285-809491a474a2 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Getting quotas for user 2374fa8610714b72b6034726ee1c2373 and project afe99772712849608ba124613bb5cc26. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:32:31.585548 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fdaee076-1254-4c8a-9285-809491a474a2 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:32:31.588611 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fdaee076-1254-4c8a-9285-809491a474a2 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:32:31.677426 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fdaee076-1254-4c8a-9285-809491a474a2 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.164673 Jul 18 02:32:31.683284 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1717/3440] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:32:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 4171 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:32:31.689360 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-17f64116-fccf-4a37-9451-90c234d37d21 req-22847ca8-6043-4926-9d43-534003b86a7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1398a49-8799-4931-a320-455eb2848bcd", "tag": "6eb31cd7-3f4c-40a6-8e5e-909b2736159e"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:31.729004 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-17f64116-fccf-4a37-9451-90c234d37d21 req-22847ca8-6043-4926-9d43-534003b86a7f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:31.729464 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-17f64116-fccf-4a37-9451-90c234d37d21 req-22847ca8-6043-4926-9d43-534003b86a7f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:31.771094 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-17f64116-fccf-4a37-9451-90c234d37d21 req-22847ca8-6043-4926-9d43-534003b86a7f service nova] Creating event network-changed:6eb31cd7-3f4c-40a6-8e5e-909b2736159e for instance b1398a49-8799-4931-a320-455eb2848bcd on n-h2-465891-3 Jul 18 02:32:31.781408 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-17f64116-fccf-4a37-9451-90c234d37d21 req-22847ca8-6043-4926-9d43-534003b86a7f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096176 Jul 18 02:32:31.789895 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1718/3441] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:32:31.807939 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5b2f8796-7ef7-4bd8-ab27-fde42ddae17b tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:31.817863 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5b2f8796-7ef7-4bd8-ab27-fde42ddae17b tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] [instance: b1398a49-8799-4931-a320-455eb2848bcd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:31.846102 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5b2f8796-7ef7-4bd8-ab27-fde42ddae17b tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:31.851961 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5b2f8796-7ef7-4bd8-ab27-fde42ddae17b tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:31.865553 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5b2f8796-7ef7-4bd8-ab27-fde42ddae17b tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:31.866882 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5b2f8796-7ef7-4bd8-ab27-fde42ddae17b tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:32.030832 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-666b6ce7-afc9-47d5-8d6a-5122fe61accb tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fa2740ac30453b941b9ea3a57cbd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1287da2aeae4737a8ce953c8edbac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:32.033559 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:32.046922 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-666b6ce7-afc9-47d5-8d6a-5122fe61accb tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] 10.222.0.57 "GET /compute/v2.1/servers/3651ac1a-8110-424f-ac77-b2ab0f7f93a7" status: 200 len: 1315 microversion: 2.1 time: 1.528861 Jul 18 02:32:32.047810 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1724/3442] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:30 2022] GET /compute/v2.1/servers/3651ac1a-8110-424f-ac77-b2ab0f7f93a7 => generated 1315 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:32.061595 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6cecaf5d-1f74-4cc2-90e2-ecb5efe2072e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:32.062405 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6cecaf5d-1f74-4cc2-90e2-ecb5efe2072e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: f4822dbd-f6d6-4c66-8661-69a15acf9df4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:32.080654 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6cecaf5d-1f74-4cc2-90e2-ecb5efe2072e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:32.085678 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6cecaf5d-1f74-4cc2-90e2-ecb5efe2072e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:32.086777 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6cecaf5d-1f74-4cc2-90e2-ecb5efe2072e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:32.091131 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6cecaf5d-1f74-4cc2-90e2-ecb5efe2072e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:33.322007 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5b2f8796-7ef7-4bd8-ab27-fde42ddae17b tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd150cd3869454560b98dc2dc3cada35a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1facd579386e4d918990bc99c41fc83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:33.346139 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5b2f8796-7ef7-4bd8-ab27-fde42ddae17b tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] 10.222.0.57 "GET /compute/v2.1/servers/b1398a49-8799-4931-a320-455eb2848bcd" status: 200 len: 1325 microversion: 2.1 time: 1.553514 Jul 18 02:32:33.348083 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1719/3443] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:31 2022] GET /compute/v2.1/servers/b1398a49-8799-4931-a320-455eb2848bcd => generated 1325 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:33.369967 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6cecaf5d-1f74-4cc2-90e2-ecb5efe2072e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:33.421045 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f8d1049c-24ae-4b92-8ed4-51264febbdae tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:33.423186 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f8d1049c-24ae-4b92-8ed4-51264febbdae tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:33.427524 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6cecaf5d-1f74-4cc2-90e2-ecb5efe2072e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4" status: 200 len: 1322 microversion: 2.1 time: 1.377736 Jul 18 02:32:33.450507 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1725/3444] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:32 2022] GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4 => generated 1322 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:33.452215 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f8d1049c-24ae-4b92-8ed4-51264febbdae tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:33.452792 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f8d1049c-24ae-4b92-8ed4-51264febbdae tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:33.454009 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f8d1049c-24ae-4b92-8ed4-51264febbdae tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:33.454571 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f8d1049c-24ae-4b92-8ed4-51264febbdae tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:33.461597 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-7754281f-920e-4f03-ab48-1f8f61e83252 req-64cb04a9-3107-4f0a-ade6-7c689f067ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02425120-f4dc-4f02-99c5-9bf0fe7e1931", "name": "network-vif-plugged", "status": "completed", "tag": "0cb635f0-d31b-4491-a882-a1e3c6656f22"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:33.504145 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-7754281f-920e-4f03-ab48-1f8f61e83252 req-64cb04a9-3107-4f0a-ade6-7c689f067ed7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:33.505479 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-7754281f-920e-4f03-ab48-1f8f61e83252 req-64cb04a9-3107-4f0a-ade6-7c689f067ed7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:33.594179 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-7754281f-920e-4f03-ab48-1f8f61e83252 req-64cb04a9-3107-4f0a-ade6-7c689f067ed7 service nova] Creating event network-vif-plugged:0cb635f0-d31b-4491-a882-a1e3c6656f22 for instance 02425120-f4dc-4f02-99c5-9bf0fe7e1931 on n-h1-465891-3 Jul 18 02:32:33.611522 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-7754281f-920e-4f03-ab48-1f8f61e83252 req-64cb04a9-3107-4f0a-ade6-7c689f067ed7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155283 Jul 18 02:32:33.617950 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1726/3445] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:32:33.638290 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0ad0fddf-dd0f-452f-9c9b-617d782abf63 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:33.639482 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0ad0fddf-dd0f-452f-9c9b-617d782abf63 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] [instance: 3651ac1a-8110-424f-ac77-b2ab0f7f93a7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:33.665733 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0ad0fddf-dd0f-452f-9c9b-617d782abf63 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:33.666482 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0ad0fddf-dd0f-452f-9c9b-617d782abf63 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:33.676154 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0ad0fddf-dd0f-452f-9c9b-617d782abf63 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:33.679126 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0ad0fddf-dd0f-452f-9c9b-617d782abf63 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:33.872386 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f8d1049c-24ae-4b92-8ed4-51264febbdae tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2374fa8610714b72b6034726ee1c2373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe99772712849608ba124613bb5cc26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:33.882969 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f8d1049c-24ae-4b92-8ed4-51264febbdae tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9" status: 200 len: 1211 microversion: 2.1 time: 0.531414 Jul 18 02:32:33.884629 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1720/3446] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:33 2022] GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 => generated 1211 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:34.096756 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-16a0a9e9-d9a8-4d97-b3b1-5bc52ef50422 req-847e6661-dbbd-4ec9-8db2-4441fed178d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4822dbd-f6d6-4c66-8661-69a15acf9df4", "tag": "ea9b8a5b-73f4-4379-b880-4c9fd9e3877f"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:34.145048 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-16a0a9e9-d9a8-4d97-b3b1-5bc52ef50422 req-847e6661-dbbd-4ec9-8db2-4441fed178d7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:34.145872 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-16a0a9e9-d9a8-4d97-b3b1-5bc52ef50422 req-847e6661-dbbd-4ec9-8db2-4441fed178d7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:34.201887 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-16a0a9e9-d9a8-4d97-b3b1-5bc52ef50422 req-847e6661-dbbd-4ec9-8db2-4441fed178d7 service nova] Creating event network-changed:ea9b8a5b-73f4-4379-b880-4c9fd9e3877f for instance f4822dbd-f6d6-4c66-8661-69a15acf9df4 on n-h1-465891-3 Jul 18 02:32:34.224284 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-16a0a9e9-d9a8-4d97-b3b1-5bc52ef50422 req-847e6661-dbbd-4ec9-8db2-4441fed178d7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140647 Jul 18 02:32:34.227664 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1721/3447] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:32:34.370594 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-535856fc-c82b-44c6-8d0f-fdf81e91ed0c tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:34.372000 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-535856fc-c82b-44c6-8d0f-fdf81e91ed0c tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] [instance: b1398a49-8799-4931-a320-455eb2848bcd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:34.401787 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-535856fc-c82b-44c6-8d0f-fdf81e91ed0c tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:34.404314 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-535856fc-c82b-44c6-8d0f-fdf81e91ed0c tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:34.406563 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-535856fc-c82b-44c6-8d0f-fdf81e91ed0c tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:34.409139 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-535856fc-c82b-44c6-8d0f-fdf81e91ed0c tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:35.112609 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0ad0fddf-dd0f-452f-9c9b-617d782abf63 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fa2740ac30453b941b9ea3a57cbd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1287da2aeae4737a8ce953c8edbac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:35.152052 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0ad0fddf-dd0f-452f-9c9b-617d782abf63 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] 10.222.0.57 "GET /compute/v2.1/servers/3651ac1a-8110-424f-ac77-b2ab0f7f93a7" status: 200 len: 1504 microversion: 2.1 time: 1.533725 Jul 18 02:32:35.153583 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1727/3448] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:33 2022] GET /compute/v2.1/servers/3651ac1a-8110-424f-ac77-b2ab0f7f93a7 => generated 1504 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:35.170495 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6bd838ee-7641-4e02-8a45-b623212e5ffa tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:35.171698 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6bd838ee-7641-4e02-8a45-b623212e5ffa tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: f4822dbd-f6d6-4c66-8661-69a15acf9df4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:35.184426 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6bd838ee-7641-4e02-8a45-b623212e5ffa tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:35.185786 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6bd838ee-7641-4e02-8a45-b623212e5ffa tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:35.187557 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6bd838ee-7641-4e02-8a45-b623212e5ffa tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:35.189019 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6bd838ee-7641-4e02-8a45-b623212e5ffa tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:35.752623 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-535856fc-c82b-44c6-8d0f-fdf81e91ed0c tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd150cd3869454560b98dc2dc3cada35a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1facd579386e4d918990bc99c41fc83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:35.761732 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-535856fc-c82b-44c6-8d0f-fdf81e91ed0c tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] 10.222.0.57 "GET /compute/v2.1/servers/b1398a49-8799-4931-a320-455eb2848bcd" status: 200 len: 1325 microversion: 2.1 time: 1.399955 Jul 18 02:32:35.765502 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1722/3449] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:34 2022] GET /compute/v2.1/servers/b1398a49-8799-4931-a320-455eb2848bcd => generated 1325 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:35.776260 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-eb8c1f4d-44d3-4f96-a40c-5d29f6478e7a tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:35.786866 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-eb8c1f4d-44d3-4f96-a40c-5d29f6478e7a tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:35.800964 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eb8c1f4d-44d3-4f96-a40c-5d29f6478e7a tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:35.801818 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eb8c1f4d-44d3-4f96-a40c-5d29f6478e7a tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:35.805170 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eb8c1f4d-44d3-4f96-a40c-5d29f6478e7a tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:35.810047 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eb8c1f4d-44d3-4f96-a40c-5d29f6478e7a tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:36.142226 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6bd838ee-7641-4e02-8a45-b623212e5ffa tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:36.154366 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6bd838ee-7641-4e02-8a45-b623212e5ffa tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4" status: 200 len: 1322 microversion: 2.1 time: 0.996279 Jul 18 02:32:36.157992 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1728/3450] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:35 2022] GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4 => generated 1322 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:36.172796 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c5bac826-303f-4081-bbf4-e570502cd8e6 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:36.179863 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c5bac826-303f-4081-bbf4-e570502cd8e6 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] [instance: 3651ac1a-8110-424f-ac77-b2ab0f7f93a7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:36.205498 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c5bac826-303f-4081-bbf4-e570502cd8e6 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:36.206978 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c5bac826-303f-4081-bbf4-e570502cd8e6 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:36.208507 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c5bac826-303f-4081-bbf4-e570502cd8e6 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:36.214068 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c5bac826-303f-4081-bbf4-e570502cd8e6 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:36.308222 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-eb8c1f4d-44d3-4f96-a40c-5d29f6478e7a tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2374fa8610714b72b6034726ee1c2373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe99772712849608ba124613bb5cc26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:36.319870 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-eb8c1f4d-44d3-4f96-a40c-5d29f6478e7a tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9" status: 200 len: 1273 microversion: 2.1 time: 0.547234 Jul 18 02:32:36.329895 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1723/3451] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:35 2022] GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 => generated 1273 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:36.339257 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c5bac826-303f-4081-bbf4-e570502cd8e6 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3651ac1a-8110-424f-ac77-b2ab0f7f93a7/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.178864 Jul 18 02:32:36.340071 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1729/3452] 10.222.0.57 () {58 vars in 1295 bytes} [Mon Jul 18 02:32:36 2022] DELETE /compute/v2.1/servers/3651ac1a-8110-424f-ac77-b2ab0f7f93a7/os-server-password => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:32:36.349828 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-20b84141-1b6f-4324-aa37-4bf48cc868c1 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:36.351526 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-20b84141-1b6f-4324-aa37-4bf48cc868c1 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] [instance: 3651ac1a-8110-424f-ac77-b2ab0f7f93a7] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:36.361327 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20b84141-1b6f-4324-aa37-4bf48cc868c1 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:36.362295 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20b84141-1b6f-4324-aa37-4bf48cc868c1 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:36.363570 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20b84141-1b6f-4324-aa37-4bf48cc868c1 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:36.364377 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20b84141-1b6f-4324-aa37-4bf48cc868c1 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:36.394874 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-20b84141-1b6f-4324-aa37-4bf48cc868c1 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] 10.222.0.57 "GET /compute/v2.1/servers/3651ac1a-8110-424f-ac77-b2ab0f7f93a7/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.049181 Jul 18 02:32:36.403650 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1724/3453] 10.222.0.57 () {58 vars in 1292 bytes} [Mon Jul 18 02:32:36 2022] GET /compute/v2.1/servers/3651ac1a-8110-424f-ac77-b2ab0f7f93a7/os-server-password => generated 16 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 02:32:36.406668 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3e36c96d-425c-4afd-84c3-f300b24a5743 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:36.407183 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3e36c96d-425c-4afd-84c3-f300b24a5743 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] [instance: 3651ac1a-8110-424f-ac77-b2ab0f7f93a7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:36.428739 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3e36c96d-425c-4afd-84c3-f300b24a5743 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:36.429840 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3e36c96d-425c-4afd-84c3-f300b24a5743 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:36.431144 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3e36c96d-425c-4afd-84c3-f300b24a5743 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:36.431857 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3e36c96d-425c-4afd-84c3-f300b24a5743 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:36.465419 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3e36c96d-425c-4afd-84c3-f300b24a5743 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] [instance: 3651ac1a-8110-424f-ac77-b2ab0f7f93a7] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:32:36.684291 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3e36c96d-425c-4afd-84c3-f300b24a5743 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3651ac1a-8110-424f-ac77-b2ab0f7f93a7" status: 204 len: 0 microversion: 2.1 time: 0.267812 Jul 18 02:32:36.685375 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1730/3454] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:32:36 2022] DELETE /compute/v2.1/servers/3651ac1a-8110-424f-ac77-b2ab0f7f93a7 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:32:36.697874 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-02d0a5fd-a601-4440-a5ad-acfe073ce889 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:36.698695 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-02d0a5fd-a601-4440-a5ad-acfe073ce889 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] [instance: 3651ac1a-8110-424f-ac77-b2ab0f7f93a7] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:36.708254 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-02d0a5fd-a601-4440-a5ad-acfe073ce889 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:36.708881 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-02d0a5fd-a601-4440-a5ad-acfe073ce889 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:36.710773 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-02d0a5fd-a601-4440-a5ad-acfe073ce889 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:36.711362 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-02d0a5fd-a601-4440-a5ad-acfe073ce889 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:36.805778 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0e51922c-7ae6-4711-a2ef-de4954943238 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:36.805778 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0e51922c-7ae6-4711-a2ef-de4954943238 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] [instance: b1398a49-8799-4931-a320-455eb2848bcd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:36.820006 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0e51922c-7ae6-4711-a2ef-de4954943238 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:36.820006 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0e51922c-7ae6-4711-a2ef-de4954943238 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:36.820006 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0e51922c-7ae6-4711-a2ef-de4954943238 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:36.820006 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0e51922c-7ae6-4711-a2ef-de4954943238 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:37.790666 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0e51922c-7ae6-4711-a2ef-de4954943238 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd150cd3869454560b98dc2dc3cada35a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1facd579386e4d918990bc99c41fc83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:37.803459 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0e51922c-7ae6-4711-a2ef-de4954943238 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] 10.222.0.57 "GET /compute/v2.1/servers/b1398a49-8799-4931-a320-455eb2848bcd" status: 200 len: 1325 microversion: 2.1 time: 1.007799 Jul 18 02:32:37.813603 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1731/3455] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:36 2022] GET /compute/v2.1/servers/b1398a49-8799-4931-a320-455eb2848bcd => generated 1325 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:32:37.822843 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c49889b7-ef74-41ec-b2c6-55512988c3b4 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:37.826142 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c49889b7-ef74-41ec-b2c6-55512988c3b4 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: f4822dbd-f6d6-4c66-8661-69a15acf9df4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:37.836227 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c49889b7-ef74-41ec-b2c6-55512988c3b4 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:37.842388 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c49889b7-ef74-41ec-b2c6-55512988c3b4 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:37.849586 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c49889b7-ef74-41ec-b2c6-55512988c3b4 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:37.852088 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c49889b7-ef74-41ec-b2c6-55512988c3b4 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:38.276561 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c49889b7-ef74-41ec-b2c6-55512988c3b4 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:38.294556 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c49889b7-ef74-41ec-b2c6-55512988c3b4 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4" status: 200 len: 1322 microversion: 2.1 time: 0.478816 Jul 18 02:32:38.308900 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1732/3456] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:37 2022] GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4 => generated 1322 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:38.314226 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fabebafd-7425-4ddf-91f4-5df90c775edf tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:38.314861 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fabebafd-7425-4ddf-91f4-5df90c775edf tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:38.322569 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fabebafd-7425-4ddf-91f4-5df90c775edf tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:38.323031 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fabebafd-7425-4ddf-91f4-5df90c775edf tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:38.324214 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fabebafd-7425-4ddf-91f4-5df90c775edf tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:38.324678 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fabebafd-7425-4ddf-91f4-5df90c775edf tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:38.409884 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-02d0a5fd-a601-4440-a5ad-acfe073ce889 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fa2740ac30453b941b9ea3a57cbd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1287da2aeae4737a8ce953c8edbac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:38.427249 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-02d0a5fd-a601-4440-a5ad-acfe073ce889 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] 10.222.0.57 "GET /compute/v2.1/servers/3651ac1a-8110-424f-ac77-b2ab0f7f93a7" status: 200 len: 1510 microversion: 2.1 time: 1.734962 Jul 18 02:32:38.431838 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1725/3457] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:36 2022] GET /compute/v2.1/servers/3651ac1a-8110-424f-ac77-b2ab0f7f93a7 => generated 1510 bytes in 1742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:32:38.800452 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fabebafd-7425-4ddf-91f4-5df90c775edf tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2374fa8610714b72b6034726ee1c2373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe99772712849608ba124613bb5cc26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:38.814025 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fabebafd-7425-4ddf-91f4-5df90c775edf tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9" status: 200 len: 1315 microversion: 2.1 time: 0.503823 Jul 18 02:32:38.828409 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1733/3458] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:38 2022] GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 => generated 1315 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:38.841221 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-99679eb4-e348-452e-8cb0-c2ccbf10bacb tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:38.843040 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-99679eb4-e348-452e-8cb0-c2ccbf10bacb tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] [instance: b1398a49-8799-4931-a320-455eb2848bcd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:38.866381 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-99679eb4-e348-452e-8cb0-c2ccbf10bacb tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:38.867666 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-99679eb4-e348-452e-8cb0-c2ccbf10bacb tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:38.869065 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-99679eb4-e348-452e-8cb0-c2ccbf10bacb tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:38.869748 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-99679eb4-e348-452e-8cb0-c2ccbf10bacb tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:39.315817 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ddf3aae7-9dba-4d66-8195-5d7a1278bff6 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:39.316795 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ddf3aae7-9dba-4d66-8195-5d7a1278bff6 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: f4822dbd-f6d6-4c66-8661-69a15acf9df4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:39.337950 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ddf3aae7-9dba-4d66-8195-5d7a1278bff6 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:39.341936 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ddf3aae7-9dba-4d66-8195-5d7a1278bff6 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:39.345354 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ddf3aae7-9dba-4d66-8195-5d7a1278bff6 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:39.346751 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ddf3aae7-9dba-4d66-8195-5d7a1278bff6 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:39.588876 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-99679eb4-e348-452e-8cb0-c2ccbf10bacb tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd150cd3869454560b98dc2dc3cada35a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1facd579386e4d918990bc99c41fc83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:39.633541 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-99679eb4-e348-452e-8cb0-c2ccbf10bacb tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] 10.222.0.57 "GET /compute/v2.1/servers/b1398a49-8799-4931-a320-455eb2848bcd" status: 200 len: 1325 microversion: 2.1 time: 0.802220 Jul 18 02:32:39.637074 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1726/3459] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:38 2022] GET /compute/v2.1/servers/b1398a49-8799-4931-a320-455eb2848bcd => generated 1325 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:39.651572 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-93baafd3-1133-4f42-8bcd-ac0c9f9c5298 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:39.656429 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-93baafd3-1133-4f42-8bcd-ac0c9f9c5298 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] [instance: 3651ac1a-8110-424f-ac77-b2ab0f7f93a7] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:39.681134 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-93baafd3-1133-4f42-8bcd-ac0c9f9c5298 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:39.682383 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-93baafd3-1133-4f42-8bcd-ac0c9f9c5298 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:39.684476 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-93baafd3-1133-4f42-8bcd-ac0c9f9c5298 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:39.685306 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-93baafd3-1133-4f42-8bcd-ac0c9f9c5298 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:40.289875 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-93baafd3-1133-4f42-8bcd-ac0c9f9c5298 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fa2740ac30453b941b9ea3a57cbd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1287da2aeae4737a8ce953c8edbac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:40.317313 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-93baafd3-1133-4f42-8bcd-ac0c9f9c5298 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] 10.222.0.57 "GET /compute/v2.1/servers/3651ac1a-8110-424f-ac77-b2ab0f7f93a7" status: 200 len: 1468 microversion: 2.1 time: 0.677616 Jul 18 02:32:40.319978 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1727/3460] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:39 2022] GET /compute/v2.1/servers/3651ac1a-8110-424f-ac77-b2ab0f7f93a7 => generated 1468 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:40.333184 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-fc31ed8d-b6c0-4951-92a8-a183edd12c28 req-ccdb5182-277b-420e-8529-9082742ca745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1398a49-8799-4931-a320-455eb2848bcd", "name": "network-vif-plugged", "status": "completed", "tag": "6eb31cd7-3f4c-40a6-8e5e-909b2736159e"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:40.369949 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-fc31ed8d-b6c0-4951-92a8-a183edd12c28 req-ccdb5182-277b-420e-8529-9082742ca745 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:40.375000 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-fc31ed8d-b6c0-4951-92a8-a183edd12c28 req-ccdb5182-277b-420e-8529-9082742ca745 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:40.432074 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-fc31ed8d-b6c0-4951-92a8-a183edd12c28 req-ccdb5182-277b-420e-8529-9082742ca745 service nova] Creating event network-vif-plugged:6eb31cd7-3f4c-40a6-8e5e-909b2736159e for instance b1398a49-8799-4931-a320-455eb2848bcd on n-h2-465891-3 Jul 18 02:32:40.447429 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-fc31ed8d-b6c0-4951-92a8-a183edd12c28 req-ccdb5182-277b-420e-8529-9082742ca745 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125461 Jul 18 02:32:40.449565 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1728/3461] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:32:40.471620 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1153fb83-4b24-4cda-ab79-b50933248a30 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:40.477249 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1153fb83-4b24-4cda-ab79-b50933248a30 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:40.500196 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1153fb83-4b24-4cda-ab79-b50933248a30 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:40.502413 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1153fb83-4b24-4cda-ab79-b50933248a30 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:40.508047 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1153fb83-4b24-4cda-ab79-b50933248a30 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:40.508663 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1153fb83-4b24-4cda-ab79-b50933248a30 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:41.216417 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ddf3aae7-9dba-4d66-8195-5d7a1278bff6 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:41.226482 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ddf3aae7-9dba-4d66-8195-5d7a1278bff6 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4" status: 200 len: 1322 microversion: 2.1 time: 1.916448 Jul 18 02:32:41.237497 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1734/3462] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:39 2022] GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4 => generated 1322 bytes in 1928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:32:41.251047 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e94e75ca-e24f-48eb-8c27-912e94b918a6 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:41.252697 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e94e75ca-e24f-48eb-8c27-912e94b918a6 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] [instance: b1398a49-8799-4931-a320-455eb2848bcd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:41.275406 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e94e75ca-e24f-48eb-8c27-912e94b918a6 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:41.277919 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e94e75ca-e24f-48eb-8c27-912e94b918a6 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:41.279700 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e94e75ca-e24f-48eb-8c27-912e94b918a6 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:41.295759 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e94e75ca-e24f-48eb-8c27-912e94b918a6 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:41.499228 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:41.569465 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:41.762572 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1153fb83-4b24-4cda-ab79-b50933248a30 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2374fa8610714b72b6034726ee1c2373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe99772712849608ba124613bb5cc26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:41.790524 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1153fb83-4b24-4cda-ab79-b50933248a30 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9" status: 200 len: 1315 microversion: 2.1 time: 1.335584 Jul 18 02:32:41.792581 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1729/3463] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:40 2022] GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 => generated 1315 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:41.804177 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-449d4bf7-0011-46e8-b6ab-70259ff07e42 req-1c952f76-b187-43e1-acc0-53102e64863c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3651ac1a-8110-424f-ac77-b2ab0f7f93a7", "name": "network-vif-deleted", "tag": "1bfe89a6-b9aa-47eb-8a21-fe3b8e02575b"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:41.830687 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-449d4bf7-0011-46e8-b6ab-70259ff07e42 req-1c952f76-b187-43e1-acc0-53102e64863c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:41.832765 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-449d4bf7-0011-46e8-b6ab-70259ff07e42 req-1c952f76-b187-43e1-acc0-53102e64863c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:41.862120 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e94e75ca-e24f-48eb-8c27-912e94b918a6 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd150cd3869454560b98dc2dc3cada35a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1facd579386e4d918990bc99c41fc83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:41.883076 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e94e75ca-e24f-48eb-8c27-912e94b918a6 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] 10.222.0.57 "GET /compute/v2.1/servers/b1398a49-8799-4931-a320-455eb2848bcd" status: 200 len: 1325 microversion: 2.1 time: 0.644217 Jul 18 02:32:41.884432 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1735/3464] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:41 2022] GET /compute/v2.1/servers/b1398a49-8799-4931-a320-455eb2848bcd => generated 1325 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:41.888549 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-449d4bf7-0011-46e8-b6ab-70259ff07e42 req-1c952f76-b187-43e1-acc0-53102e64863c service nova] Creating event network-vif-deleted:1bfe89a6-b9aa-47eb-8a21-fe3b8e02575b for instance 3651ac1a-8110-424f-ac77-b2ab0f7f93a7 on n-h1-465891-3 Jul 18 02:32:41.898894 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-13ff9c81-9ebb-443c-9064-c4b1b49a2454 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:41.900319 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-13ff9c81-9ebb-443c-9064-c4b1b49a2454 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] [instance: 3651ac1a-8110-424f-ac77-b2ab0f7f93a7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:41.917666 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-449d4bf7-0011-46e8-b6ab-70259ff07e42 req-1c952f76-b187-43e1-acc0-53102e64863c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122918 Jul 18 02:32:41.918581 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1730/3465] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:32:41.924189 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-13ff9c81-9ebb-443c-9064-c4b1b49a2454 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:41.925007 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-13ff9c81-9ebb-443c-9064-c4b1b49a2454 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:41.938288 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-13ff9c81-9ebb-443c-9064-c4b1b49a2454 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:41.939605 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-13ff9c81-9ebb-443c-9064-c4b1b49a2454 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:42.000484 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-13ff9c81-9ebb-443c-9064-c4b1b49a2454 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] HTTP exception thrown: Instance 3651ac1a-8110-424f-ac77-b2ab0f7f93a7 could not be found. Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-13ff9c81-9ebb-443c-9064-c4b1b49a2454 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Request method failure captured: Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/3651ac1a-8110-424f-ac77-b2ab0f7f93a7 HTTP/1.1 Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MYP8P85BDIBrtXw5VAG5CcvS7RLtKthUE-x_nEuZ-Rz4W0ag2jWfdLcoP-np5j6-X_FyLOfialJvn56L5kwlbsNMJnbu_5aa_s9DqaEUUeAJDKqBmSBLXIxiRN0_1oQNEreF0OG3Bf4L1cgn4VbofY118rLPEKClTa08z_8vlRxHQU Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: b1287da2aeae4737a8ce953c8edbac7b Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServerPasswordTestJSON-1578475986 Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b1287da2aeae4737a8ce953c8edbac7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b1287da2aeae4737a8ce953c8edbac7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b1287da2aeae4737a8ce953c8edbac7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b1287da2aeae4737a8ce953c8edbac7b"}]}] Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServerPasswordTestJSON-1578475986 Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: b1287da2aeae4737a8ce953c8edbac7b Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1578475986 Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServerPasswordTestJSON-1578475986-project Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 42fa2740ac30453b941b9ea3a57cbd63 Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServerPasswordTestJSON-1578475986-project Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 3651ac1a-8110-424f-ac77-b2ab0f7f93a7 could not be found. Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '3651ac1a-8110-424f-ac77-b2ab0f7f93a7'} Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3651ac1a-8110-424f-ac77-b2ab0f7f93a7 could not be found. Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3651ac1a-8110-424f-ac77-b2ab0f7f93a7 could not be found. Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:32:42.005359 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:32:42.012647 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:42.012647 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:32:42.012647 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:32:42.012647 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:32:42.012647 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:32:42.012647 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3651ac1a-8110-424f-ac77-b2ab0f7f93a7 could not be found. Jul 18 02:32:42.012647 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:32:42.012647 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-13ff9c81-9ebb-443c-9064-c4b1b49a2454 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] Returning 404 to user: Instance 3651ac1a-8110-424f-ac77-b2ab0f7f93a7 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:32:42.012647 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-13ff9c81-9ebb-443c-9064-c4b1b49a2454 tempest-ServerPasswordTestJSON-1578475986 tempest-ServerPasswordTestJSON-1578475986-project] 10.222.0.57 "GET /compute/v2.1/servers/3651ac1a-8110-424f-ac77-b2ab0f7f93a7" status: 404 len: 111 microversion: 2.1 time: 0.123277 Jul 18 02:32:42.012647 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1736/3466] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:41 2022] GET /compute/v2.1/servers/3651ac1a-8110-424f-ac77-b2ab0f7f93a7 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:32:42.257260 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-25be3683-3756-459e-9631-f5fa2fa46fa8 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:42.258336 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-25be3683-3756-459e-9631-f5fa2fa46fa8 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: f4822dbd-f6d6-4c66-8661-69a15acf9df4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:42.280122 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-25be3683-3756-459e-9631-f5fa2fa46fa8 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:42.281305 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-25be3683-3756-459e-9631-f5fa2fa46fa8 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:42.283107 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-25be3683-3756-459e-9631-f5fa2fa46fa8 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:42.284259 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-25be3683-3756-459e-9631-f5fa2fa46fa8 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:42.325556 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:42.595780 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-3e03117f-afef-4f8f-8dff-692c791e5f88 req-8659f82e-a4d2-44aa-b881-f0433297286c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4822dbd-f6d6-4c66-8661-69a15acf9df4", "name": "network-vif-plugged", "status": "completed", "tag": "ea9b8a5b-73f4-4379-b880-4c9fd9e3877f"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:42.617058 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-3e03117f-afef-4f8f-8dff-692c791e5f88 req-8659f82e-a4d2-44aa-b881-f0433297286c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:42.618842 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-3e03117f-afef-4f8f-8dff-692c791e5f88 req-8659f82e-a4d2-44aa-b881-f0433297286c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:42.670412 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-3e03117f-afef-4f8f-8dff-692c791e5f88 req-8659f82e-a4d2-44aa-b881-f0433297286c service nova] Creating event network-vif-plugged:ea9b8a5b-73f4-4379-b880-4c9fd9e3877f for instance f4822dbd-f6d6-4c66-8661-69a15acf9df4 on n-h1-465891-3 Jul 18 02:32:42.684815 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-3e03117f-afef-4f8f-8dff-692c791e5f88 req-8659f82e-a4d2-44aa-b881-f0433297286c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098400 Jul 18 02:32:42.691175 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1737/3467] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:32:42.813144 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-626a9d1b-1dfc-450c-9f1c-4f3a15f52432 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:42.815868 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-626a9d1b-1dfc-450c-9f1c-4f3a15f52432 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:42.848032 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-626a9d1b-1dfc-450c-9f1c-4f3a15f52432 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:42.849444 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-626a9d1b-1dfc-450c-9f1c-4f3a15f52432 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:42.852682 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-626a9d1b-1dfc-450c-9f1c-4f3a15f52432 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:42.853796 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-626a9d1b-1dfc-450c-9f1c-4f3a15f52432 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:42.931731 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-25be3683-3756-459e-9631-f5fa2fa46fa8 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:42.944765 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-25be3683-3756-459e-9631-f5fa2fa46fa8 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4" status: 200 len: 1322 microversion: 2.1 time: 0.691277 Jul 18 02:32:42.945741 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1731/3468] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:42 2022] GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4 => generated 1322 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:42.961851 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6d9e4c65-6809-469c-97df-7002f50534c5 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:42.963087 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6d9e4c65-6809-469c-97df-7002f50534c5 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] [instance: b1398a49-8799-4931-a320-455eb2848bcd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:42.975912 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6d9e4c65-6809-469c-97df-7002f50534c5 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:42.976646 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6d9e4c65-6809-469c-97df-7002f50534c5 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:42.983806 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6d9e4c65-6809-469c-97df-7002f50534c5 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:42.984781 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6d9e4c65-6809-469c-97df-7002f50534c5 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:43.515256 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6d9e4c65-6809-469c-97df-7002f50534c5 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd150cd3869454560b98dc2dc3cada35a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1facd579386e4d918990bc99c41fc83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:43.529222 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6d9e4c65-6809-469c-97df-7002f50534c5 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] 10.222.0.57 "GET /compute/v2.1/servers/b1398a49-8799-4931-a320-455eb2848bcd" status: 200 len: 1522 microversion: 2.1 time: 0.580209 Jul 18 02:32:43.538672 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1732/3469] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:42 2022] GET /compute/v2.1/servers/b1398a49-8799-4931-a320-455eb2848bcd => generated 1522 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:43.566505 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-626a9d1b-1dfc-450c-9f1c-4f3a15f52432 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2374fa8610714b72b6034726ee1c2373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe99772712849608ba124613bb5cc26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:43.582554 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-206c4b36-3a75-48d3-8c64-5d2f77262078 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:43.583128 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-206c4b36-3a75-48d3-8c64-5d2f77262078 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] [instance: b1398a49-8799-4931-a320-455eb2848bcd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:43.591755 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-626a9d1b-1dfc-450c-9f1c-4f3a15f52432 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9" status: 200 len: 1315 microversion: 2.1 time: 0.784403 Jul 18 02:32:43.609537 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1738/3470] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:42 2022] GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 => generated 1315 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:43.652273 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-206c4b36-3a75-48d3-8c64-5d2f77262078 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:43.653408 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-206c4b36-3a75-48d3-8c64-5d2f77262078 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:43.654965 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-206c4b36-3a75-48d3-8c64-5d2f77262078 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:43.655914 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-206c4b36-3a75-48d3-8c64-5d2f77262078 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:43.723251 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-19769ccf-dcbe-4f8d-b716-583ecb43dc35 req-42b751cc-f94c-40e5-af92-906859dbd54c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9", "tag": "6f939eb0-ce87-4bf6-aa4f-2e850201052a"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:43.758989 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-206c4b36-3a75-48d3-8c64-5d2f77262078 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] HTTP exception thrown: Action 999 not found Jul 18 02:32:43.768980 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-19769ccf-dcbe-4f8d-b716-583ecb43dc35 req-42b751cc-f94c-40e5-af92-906859dbd54c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:43.769732 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-19769ccf-dcbe-4f8d-b716-583ecb43dc35 req-42b751cc-f94c-40e5-af92-906859dbd54c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-206c4b36-3a75-48d3-8c64-5d2f77262078 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Request method failure captured: Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/b1398a49-8799-4931-a320-455eb2848bcd/os-instance-actions/999 HTTP/1.1 Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MYny80VCzZPkgj9NZfhyKTbU2hDfPN-0di5mgjP4062NamWryL-VjST5JGrq2cuaWy3W5JQ8sndtU1j3yCOLAgoRIAtZ-n81hr8_4C9qxmaZIvhSmNs8a1T5qv4qImx0jOZZAzvgnVSiGyq0EMw7icRUvK5aLxcI3ovV8iQHyvyhiE Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 1facd579386e4d918990bc99c41fc83f Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-260895599 Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1facd579386e4d918990bc99c41fc83f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1facd579386e4d918990bc99c41fc83f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1facd579386e4d918990bc99c41fc83f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1facd579386e4d918990bc99c41fc83f"}]}] Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-260895599 Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 1facd579386e4d918990bc99c41fc83f Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-260895599 Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-InstanceActionsNegativeTestJSON-260895599-project Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: d150cd3869454560b98dc2dc3cada35a Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-260895599-project Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: exception: Action 999 not found Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'server_id': 'b1398a49-8799-4931-a320-455eb2848bcd', 'id': '999'} Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Jul 18 02:32:43.771106 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:32:43.779802 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-206c4b36-3a75-48d3-8c64-5d2f77262078 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Returning 404 to user: Action 999 not found {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:32:43.781580 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-206c4b36-3a75-48d3-8c64-5d2f77262078 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] 10.222.0.57 "GET /compute/v2.1/servers/b1398a49-8799-4931-a320-455eb2848bcd/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.210669 Jul 18 02:32:43.783527 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1733/3471] 10.222.0.57 () {58 vars in 1307 bytes} [Mon Jul 18 02:32:43 2022] GET /compute/v2.1/servers/b1398a49-8799-4931-a320-455eb2848bcd/os-instance-actions/999 => generated 66 bytes in 213 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:32:43.806324 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e6e92d27-8306-445d-9522-639a9fb048d0 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Calling method '.version_select at 0x7ff49b9cc820>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:43.810595 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e6e92d27-8306-445d-9522-639a9fb048d0 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] [instance: a8643a3e-c008-4191-871f-3b419f0bfd97] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:43.824014 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-19769ccf-dcbe-4f8d-b716-583ecb43dc35 req-42b751cc-f94c-40e5-af92-906859dbd54c service nova] Creating event network-changed:6f939eb0-ce87-4bf6-aa4f-2e850201052a for instance 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 on n-h2-465891-3 Jul 18 02:32:43.831252 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-e6e92d27-8306-445d-9522-639a9fb048d0 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] HTTP exception thrown: Instance a8643a3e-c008-4191-871f-3b419f0bfd97 could not be found. Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e6e92d27-8306-445d-9522-639a9fb048d0 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Request method failure captured: Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/a8643a3e-c008-4191-871f-3b419f0bfd97/os-instance-actions HTTP/1.1 Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MYny80VCzZPkgj9NZfhyKTbU2hDfPN-0di5mgjP4062NamWryL-VjST5JGrq2cuaWy3W5JQ8sndtU1j3yCOLAgoRIAtZ-n81hr8_4C9qxmaZIvhSmNs8a1T5qv4qImx0jOZZAzvgnVSiGyq0EMw7icRUvK5aLxcI3ovV8iQHyvyhiE Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 1facd579386e4d918990bc99c41fc83f Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-260895599 Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1facd579386e4d918990bc99c41fc83f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1facd579386e4d918990bc99c41fc83f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1facd579386e4d918990bc99c41fc83f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1facd579386e4d918990bc99c41fc83f"}]}] Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-260895599 Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 1facd579386e4d918990bc99c41fc83f Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-260895599 Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-InstanceActionsNegativeTestJSON-260895599-project Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: d150cd3869454560b98dc2dc3cada35a Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-260895599-project Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance a8643a3e-c008-4191-871f-3b419f0bfd97 could not be found. Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'server_id': 'a8643a3e-c008-4191-871f-3b419f0bfd97'} Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8643a3e-c008-4191-871f-3b419f0bfd97 could not be found. Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:32:43.834782 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:32:43.842861 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8643a3e-c008-4191-871f-3b419f0bfd97 could not be found. Jul 18 02:32:43.842861 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:32:43.842861 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:32:43.842861 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:32:43.842861 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:43.842861 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:32:43.842861 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:32:43.842861 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:32:43.842861 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:32:43.842861 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8643a3e-c008-4191-871f-3b419f0bfd97 could not be found. Jul 18 02:32:43.842861 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:32:43.842861 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e6e92d27-8306-445d-9522-639a9fb048d0 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Returning 404 to user: Instance a8643a3e-c008-4191-871f-3b419f0bfd97 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:32:43.842861 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e6e92d27-8306-445d-9522-639a9fb048d0 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] 10.222.0.57 "GET /compute/v2.1/servers/a8643a3e-c008-4191-871f-3b419f0bfd97/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.046727 Jul 18 02:32:43.853085 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1734/3472] 10.222.0.57 () {58 vars in 1295 bytes} [Mon Jul 18 02:32:43 2022] GET /compute/v2.1/servers/a8643a3e-c008-4191-871f-3b419f0bfd97/os-instance-actions => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:32:43.869568 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-19769ccf-dcbe-4f8d-b716-583ecb43dc35 req-42b751cc-f94c-40e5-af92-906859dbd54c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120077 Jul 18 02:32:43.872006 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1739/3473] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:32:43.882672 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-96e37520-5914-4151-ad43-95426135e15b tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:43.883649 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-96e37520-5914-4151-ad43-95426135e15b tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] [instance: b1398a49-8799-4931-a320-455eb2848bcd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:43.902460 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-96e37520-5914-4151-ad43-95426135e15b tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:43.903252 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-96e37520-5914-4151-ad43-95426135e15b tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:43.905054 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-96e37520-5914-4151-ad43-95426135e15b tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:43.905858 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-96e37520-5914-4151-ad43-95426135e15b tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:43.968603 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f2bf02ee-b216-449d-9f87-4fa3ea08033b tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:43.972134 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f2bf02ee-b216-449d-9f87-4fa3ea08033b tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: f4822dbd-f6d6-4c66-8661-69a15acf9df4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:43.988353 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f2bf02ee-b216-449d-9f87-4fa3ea08033b tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:43.989602 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f2bf02ee-b216-449d-9f87-4fa3ea08033b tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:43.992389 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f2bf02ee-b216-449d-9f87-4fa3ea08033b tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:43.993500 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f2bf02ee-b216-449d-9f87-4fa3ea08033b tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:44.024889 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-96e37520-5914-4151-ad43-95426135e15b tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] [instance: b1398a49-8799-4931-a320-455eb2848bcd] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:32:44.403593 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-96e37520-5914-4151-ad43-95426135e15b tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b1398a49-8799-4931-a320-455eb2848bcd" status: 204 len: 0 microversion: 2.1 time: 0.533390 Jul 18 02:32:44.423888 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1735/3474] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:32:43 2022] DELETE /compute/v2.1/servers/b1398a49-8799-4931-a320-455eb2848bcd => generated 0 bytes in 572 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:32:44.445916 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8c9fc6ed-a069-47cb-88f1-58166f75d315 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:44.447773 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8c9fc6ed-a069-47cb-88f1-58166f75d315 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] [instance: b1398a49-8799-4931-a320-455eb2848bcd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:44.473607 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8c9fc6ed-a069-47cb-88f1-58166f75d315 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:44.476302 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8c9fc6ed-a069-47cb-88f1-58166f75d315 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:44.477942 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8c9fc6ed-a069-47cb-88f1-58166f75d315 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:44.478622 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8c9fc6ed-a069-47cb-88f1-58166f75d315 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:44.484446 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f2bf02ee-b216-449d-9f87-4fa3ea08033b tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:44.494843 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f2bf02ee-b216-449d-9f87-4fa3ea08033b tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4" status: 200 len: 1322 microversion: 2.1 time: 0.535494 Jul 18 02:32:44.503917 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1740/3475] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:43 2022] GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4 => generated 1322 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:44.620041 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0c1011af-7fbe-42bf-8182-f120f2e3b25d tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:44.621048 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0c1011af-7fbe-42bf-8182-f120f2e3b25d tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:44.640361 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c1011af-7fbe-42bf-8182-f120f2e3b25d tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:44.641027 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c1011af-7fbe-42bf-8182-f120f2e3b25d tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:44.651037 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c1011af-7fbe-42bf-8182-f120f2e3b25d tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:44.651648 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c1011af-7fbe-42bf-8182-f120f2e3b25d tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:44.656480 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:44.871463 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8c9fc6ed-a069-47cb-88f1-58166f75d315 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd150cd3869454560b98dc2dc3cada35a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1facd579386e4d918990bc99c41fc83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:44.883330 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8c9fc6ed-a069-47cb-88f1-58166f75d315 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] 10.222.0.57 "GET /compute/v2.1/servers/b1398a49-8799-4931-a320-455eb2848bcd" status: 200 len: 1528 microversion: 2.1 time: 0.452833 Jul 18 02:32:44.899721 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1736/3476] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:44 2022] GET /compute/v2.1/servers/b1398a49-8799-4931-a320-455eb2848bcd => generated 1528 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:45.002331 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0c1011af-7fbe-42bf-8182-f120f2e3b25d tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2374fa8610714b72b6034726ee1c2373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe99772712849608ba124613bb5cc26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:45.014115 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0c1011af-7fbe-42bf-8182-f120f2e3b25d tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9" status: 200 len: 1315 microversion: 2.1 time: 0.404697 Jul 18 02:32:45.017935 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1741/3477] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:44 2022] GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:32:45.523400 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-245f9b13-4524-49d8-affd-928310042744 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:45.524040 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-245f9b13-4524-49d8-affd-928310042744 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: f4822dbd-f6d6-4c66-8661-69a15acf9df4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:45.555784 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-245f9b13-4524-49d8-affd-928310042744 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:45.556097 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-245f9b13-4524-49d8-affd-928310042744 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:45.557126 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-245f9b13-4524-49d8-affd-928310042744 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:45.559425 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-245f9b13-4524-49d8-affd-928310042744 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:45.922424 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f365839f-3756-4790-b193-7590e861942e tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:45.924075 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f365839f-3756-4790-b193-7590e861942e tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] [instance: b1398a49-8799-4931-a320-455eb2848bcd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:45.948730 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f365839f-3756-4790-b193-7590e861942e tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:45.956458 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f365839f-3756-4790-b193-7590e861942e tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:45.959406 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f365839f-3756-4790-b193-7590e861942e tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:45.962550 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f365839f-3756-4790-b193-7590e861942e tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:46.532778 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-245f9b13-4524-49d8-affd-928310042744 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:46.566353 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-245f9b13-4524-49d8-affd-928310042744 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4" status: 200 len: 1516 microversion: 2.1 time: 1.048568 Jul 18 02:32:46.584161 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1737/3478] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:45 2022] GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4 => generated 1516 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:46.602393 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5d16d0eb-47e3-4f25-9401-e53af6c0ca9c tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:46.603604 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5d16d0eb-47e3-4f25-9401-e53af6c0ca9c tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:46.619232 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5d16d0eb-47e3-4f25-9401-e53af6c0ca9c tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:46.620050 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5d16d0eb-47e3-4f25-9401-e53af6c0ca9c tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:46.621447 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5d16d0eb-47e3-4f25-9401-e53af6c0ca9c tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:46.622268 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5d16d0eb-47e3-4f25-9401-e53af6c0ca9c tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:46.892724 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f365839f-3756-4790-b193-7590e861942e tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd150cd3869454560b98dc2dc3cada35a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1facd579386e4d918990bc99c41fc83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:46.906668 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f365839f-3756-4790-b193-7590e861942e tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] 10.222.0.57 "GET /compute/v2.1/servers/b1398a49-8799-4931-a320-455eb2848bcd" status: 200 len: 1528 microversion: 2.1 time: 0.995811 Jul 18 02:32:46.909005 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1742/3479] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:45 2022] GET /compute/v2.1/servers/b1398a49-8799-4931-a320-455eb2848bcd => generated 1528 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:32:46.916190 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-034d369b-d75d-4443-8e41-b453a59cbb26 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:46.919648 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-034d369b-d75d-4443-8e41-b453a59cbb26 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: f4822dbd-f6d6-4c66-8661-69a15acf9df4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:46.937463 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-034d369b-d75d-4443-8e41-b453a59cbb26 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:46.938853 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-034d369b-d75d-4443-8e41-b453a59cbb26 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:46.940179 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-034d369b-d75d-4443-8e41-b453a59cbb26 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:46.940923 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-034d369b-d75d-4443-8e41-b453a59cbb26 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:46.987895 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-034d369b-d75d-4443-8e41-b453a59cbb26 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lazy-loading 'flavor' on Instance uuid f4822dbd-f6d6-4c66-8661-69a15acf9df4 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:32:47.174185 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5d16d0eb-47e3-4f25-9401-e53af6c0ca9c tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2374fa8610714b72b6034726ee1c2373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe99772712849608ba124613bb5cc26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:47.178260 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-034d369b-d75d-4443-8e41-b453a59cbb26 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "POST /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4/action" status: 200 len: 32 microversion: 2.1 time: 0.266718 Jul 18 02:32:47.179703 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1743/3480] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:32:46 2022] POST /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4/action => generated 32 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:32:47.190936 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5d16d0eb-47e3-4f25-9401-e53af6c0ca9c tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9" status: 200 len: 1315 microversion: 2.1 time: 0.603577 Jul 18 02:32:47.192127 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1738/3481] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:46 2022] GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 => generated 1315 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:47.199351 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-37446ae9-222e-42bd-a51f-fec231fa58de tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:47.200286 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-37446ae9-222e-42bd-a51f-fec231fa58de tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: f4822dbd-f6d6-4c66-8661-69a15acf9df4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:47.226874 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-37446ae9-222e-42bd-a51f-fec231fa58de tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:47.227503 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-37446ae9-222e-42bd-a51f-fec231fa58de tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:47.228652 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-37446ae9-222e-42bd-a51f-fec231fa58de tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:47.229656 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-37446ae9-222e-42bd-a51f-fec231fa58de tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:47.937804 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-48baf82a-3b20-4444-a381-37c40e9a7f83 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:47.938666 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-48baf82a-3b20-4444-a381-37c40e9a7f83 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] [instance: b1398a49-8799-4931-a320-455eb2848bcd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:47.945915 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:47.968869 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-48baf82a-3b20-4444-a381-37c40e9a7f83 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:47.970816 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-48baf82a-3b20-4444-a381-37c40e9a7f83 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:47.971932 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-48baf82a-3b20-4444-a381-37c40e9a7f83 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:47.972714 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-48baf82a-3b20-4444-a381-37c40e9a7f83 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:48.742434 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-48baf82a-3b20-4444-a381-37c40e9a7f83 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd150cd3869454560b98dc2dc3cada35a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1facd579386e4d918990bc99c41fc83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:48.752660 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-48baf82a-3b20-4444-a381-37c40e9a7f83 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] 10.222.0.57 "GET /compute/v2.1/servers/b1398a49-8799-4931-a320-455eb2848bcd" status: 200 len: 1486 microversion: 2.1 time: 0.819846 Jul 18 02:32:48.754734 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1739/3482] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:47 2022] GET /compute/v2.1/servers/b1398a49-8799-4931-a320-455eb2848bcd => generated 1486 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:48.761515 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ba5c09b8-9521-48b2-809c-45f74ce9fd09 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:48.762490 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ba5c09b8-9521-48b2-809c-45f74ce9fd09 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:48.835919 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ba5c09b8-9521-48b2-809c-45f74ce9fd09 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:48.837325 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ba5c09b8-9521-48b2-809c-45f74ce9fd09 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:48.841132 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ba5c09b8-9521-48b2-809c-45f74ce9fd09 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:48.844741 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ba5c09b8-9521-48b2-809c-45f74ce9fd09 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:48.962968 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-37446ae9-222e-42bd-a51f-fec231fa58de tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:48.988094 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-37446ae9-222e-42bd-a51f-fec231fa58de tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4" status: 200 len: 1522 microversion: 2.1 time: 1.800594 Jul 18 02:32:48.991993 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1744/3483] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:47 2022] GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4 => generated 1522 bytes in 1806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:49.011504 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-8b478e58-d982-4e0a-9873-c764d3cc7cc9 req-dfb09138-67a5-4ac2-bdb7-001e9d957bff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1398a49-8799-4931-a320-455eb2848bcd", "name": "network-vif-deleted", "tag": "6eb31cd7-3f4c-40a6-8e5e-909b2736159e"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:49.047458 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-8b478e58-d982-4e0a-9873-c764d3cc7cc9 req-dfb09138-67a5-4ac2-bdb7-001e9d957bff service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:49.048272 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-8b478e58-d982-4e0a-9873-c764d3cc7cc9 req-dfb09138-67a5-4ac2-bdb7-001e9d957bff service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:49.095694 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-8b478e58-d982-4e0a-9873-c764d3cc7cc9 req-dfb09138-67a5-4ac2-bdb7-001e9d957bff service nova] Creating event network-vif-deleted:6eb31cd7-3f4c-40a6-8e5e-909b2736159e for instance b1398a49-8799-4931-a320-455eb2848bcd on n-h2-465891-3 Jul 18 02:32:49.126723 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-8b478e58-d982-4e0a-9873-c764d3cc7cc9 req-dfb09138-67a5-4ac2-bdb7-001e9d957bff service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122533 Jul 18 02:32:49.128220 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1745/3484] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:32:49.142276 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f746a2ef-3436-412a-a0b3-2ea35ed1fd29 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1623847141", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "022518d6-1487-4e4a-ac8a-efa7d1e289eb"}, {"uuid": "b2bcc9e4-3636-43d5-a273-4df1b0f3ef63"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:49.305547 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-f746a2ef-3436-412a-a0b3-2ea35ed1fd29 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] validate_networks() for [('022518d6-1487-4e4a-ac8a-efa7d1e289eb', None, None, None, None, None), ('b2bcc9e4-3636-43d5-a273-4df1b0f3ef63', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:32:49.871385 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ba5c09b8-9521-48b2-809c-45f74ce9fd09 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2374fa8610714b72b6034726ee1c2373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe99772712849608ba124613bb5cc26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:49.888420 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ba5c09b8-9521-48b2-809c-45f74ce9fd09 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9" status: 200 len: 1315 microversion: 2.1 time: 1.131945 Jul 18 02:32:49.890468 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1740/3485] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:48 2022] GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 => generated 1315 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:49.919070 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3a16379c-219e-46a4-a463-6e07f675ef22 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:49.921600 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3a16379c-219e-46a4-a463-6e07f675ef22 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] [instance: b1398a49-8799-4931-a320-455eb2848bcd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:49.945461 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3a16379c-219e-46a4-a463-6e07f675ef22 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:49.948237 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3a16379c-219e-46a4-a463-6e07f675ef22 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:49.950564 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3a16379c-219e-46a4-a463-6e07f675ef22 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:49.952877 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3a16379c-219e-46a4-a463-6e07f675ef22 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:49.996178 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-3a16379c-219e-46a4-a463-6e07f675ef22 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] HTTP exception thrown: Instance b1398a49-8799-4931-a320-455eb2848bcd could not be found. Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3a16379c-219e-46a4-a463-6e07f675ef22 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Request method failure captured: Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/b1398a49-8799-4931-a320-455eb2848bcd HTTP/1.1 Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MYny80VCzZPkgj9NZfhyKTbU2hDfPN-0di5mgjP4062NamWryL-VjST5JGrq2cuaWy3W5JQ8sndtU1j3yCOLAgoRIAtZ-n81hr8_4C9qxmaZIvhSmNs8a1T5qv4qImx0jOZZAzvgnVSiGyq0EMw7icRUvK5aLxcI3ovV8iQHyvyhiE Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 1facd579386e4d918990bc99c41fc83f Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-260895599 Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1facd579386e4d918990bc99c41fc83f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1facd579386e4d918990bc99c41fc83f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1facd579386e4d918990bc99c41fc83f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1facd579386e4d918990bc99c41fc83f"}]}] Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-260895599 Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 1facd579386e4d918990bc99c41fc83f Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-260895599 Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-InstanceActionsNegativeTestJSON-260895599-project Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: d150cd3869454560b98dc2dc3cada35a Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-260895599-project Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance b1398a49-8799-4931-a320-455eb2848bcd could not be found. Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'b1398a49-8799-4931-a320-455eb2848bcd'} Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1398a49-8799-4931-a320-455eb2848bcd could not be found. Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1398a49-8799-4931-a320-455eb2848bcd could not be found. Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:32:49.998548 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:32:50.001994 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:32:50.001994 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:50.001994 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:32:50.001994 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:32:50.001994 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:32:50.001994 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:32:50.001994 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1398a49-8799-4931-a320-455eb2848bcd could not be found. Jul 18 02:32:50.001994 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:32:50.003930 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3a16379c-219e-46a4-a463-6e07f675ef22 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] Returning 404 to user: Instance b1398a49-8799-4931-a320-455eb2848bcd could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:32:50.006016 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3a16379c-219e-46a4-a463-6e07f675ef22 tempest-InstanceActionsNegativeTestJSON-260895599 tempest-InstanceActionsNegativeTestJSON-260895599-project] 10.222.0.57 "GET /compute/v2.1/servers/b1398a49-8799-4931-a320-455eb2848bcd" status: 404 len: 111 microversion: 2.1 time: 0.100316 Jul 18 02:32:50.007361 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1741/3486] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:49 2022] GET /compute/v2.1/servers/b1398a49-8799-4931-a320-455eb2848bcd => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:32:50.024829 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-88db0ab9-b2c7-4544-9877-f8e80e39734b tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:50.026273 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-88db0ab9-b2c7-4544-9877-f8e80e39734b tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: f4822dbd-f6d6-4c66-8661-69a15acf9df4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:50.034330 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-88db0ab9-b2c7-4544-9877-f8e80e39734b tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:50.034794 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-88db0ab9-b2c7-4544-9877-f8e80e39734b tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:50.035609 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-88db0ab9-b2c7-4544-9877-f8e80e39734b tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:50.036120 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-88db0ab9-b2c7-4544-9877-f8e80e39734b tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:50.778543 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-88db0ab9-b2c7-4544-9877-f8e80e39734b tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:50.800538 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-88db0ab9-b2c7-4544-9877-f8e80e39734b tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4" status: 200 len: 1522 microversion: 2.1 time: 0.779723 Jul 18 02:32:50.806579 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1742/3487] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:50 2022] GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4 => generated 1522 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:32:50.908508 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-397c0324-a67b-48b0-896a-d7f59e2ebf34 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:50.912150 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-397c0324-a67b-48b0-896a-d7f59e2ebf34 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:50.931039 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-397c0324-a67b-48b0-896a-d7f59e2ebf34 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:50.931698 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-397c0324-a67b-48b0-896a-d7f59e2ebf34 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:50.932782 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-397c0324-a67b-48b0-896a-d7f59e2ebf34 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:50.933240 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-397c0324-a67b-48b0-896a-d7f59e2ebf34 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:51.378084 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-f746a2ef-3436-412a-a0b3-2ea35ed1fd29 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:32:51.379019 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-f746a2ef-3436-412a-a0b3-2ea35ed1fd29 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:32:51.379019 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-f746a2ef-3436-412a-a0b3-2ea35ed1fd29 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:32:51.379358 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-f746a2ef-3436-412a-a0b3-2ea35ed1fd29 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:32:51.379980 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-f746a2ef-3436-412a-a0b3-2ea35ed1fd29 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:32:51.401638 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f746a2ef-3436-412a-a0b3-2ea35ed1fd29 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:51.402426 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f746a2ef-3436-412a-a0b3-2ea35ed1fd29 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:51.403477 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f746a2ef-3436-412a-a0b3-2ea35ed1fd29 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:51.404090 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f746a2ef-3436-412a-a0b3-2ea35ed1fd29 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:51.498624 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-f746a2ef-3436-412a-a0b3-2ea35ed1fd29 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Getting quotas for project 2a2eddce815546778247c5d0c9986610. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:32:51.513417 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-f746a2ef-3436-412a-a0b3-2ea35ed1fd29 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Getting quotas for user c12b1d209c7c4bdfaa3f18b95095e065 and project 2a2eddce815546778247c5d0c9986610. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:32:51.559394 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f746a2ef-3436-412a-a0b3-2ea35ed1fd29 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:32:51.563656 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f746a2ef-3436-412a-a0b3-2ea35ed1fd29 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 11b342d8-ebdd-4072-a6ec-d6bc21761582] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:32:51.627974 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-397c0324-a67b-48b0-896a-d7f59e2ebf34 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2374fa8610714b72b6034726ee1c2373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe99772712849608ba124613bb5cc26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:51.658447 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-397c0324-a67b-48b0-896a-d7f59e2ebf34 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9" status: 200 len: 1315 microversion: 2.1 time: 0.750566 Jul 18 02:32:51.664583 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1743/3488] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:50 2022] GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 => generated 1315 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:51.686907 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f746a2ef-3436-412a-a0b3-2ea35ed1fd29 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.556629 Jul 18 02:32:51.688241 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1746/3489] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:32:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:32:51.710343 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-77c665f2-5118-42f5-8d56-1ce6cc8cbc87 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:51.711378 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-77c665f2-5118-42f5-8d56-1ce6cc8cbc87 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 11b342d8-ebdd-4072-a6ec-d6bc21761582] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:51.828572 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-dbb94997-e85c-475c-a99f-1381812c4cca tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:51.828729 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-dbb94997-e85c-475c-a99f-1381812c4cca tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: f4822dbd-f6d6-4c66-8661-69a15acf9df4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:51.853806 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dbb94997-e85c-475c-a99f-1381812c4cca tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:51.854572 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dbb94997-e85c-475c-a99f-1381812c4cca tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:51.855616 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dbb94997-e85c-475c-a99f-1381812c4cca tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:51.856275 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dbb94997-e85c-475c-a99f-1381812c4cca tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:51.984547 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-77c665f2-5118-42f5-8d56-1ce6cc8cbc87 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:51.994721 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-77c665f2-5118-42f5-8d56-1ce6cc8cbc87 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582" status: 200 len: 1213 microversion: 2.1 time: 0.299670 Jul 18 02:32:51.995375 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1744/3490] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:51 2022] GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582 => generated 1213 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:52.080837 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 02:32:52.081035 n-d-465891-3 devstack@n-api.service[119544]: Mon Jul 18 02:32:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4 (ip 10.222.0.57) !!! Jul 18 02:32:52.300777 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-dbb94997-e85c-475c-a99f-1381812c4cca tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:52.315196 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-dbb94997-e85c-475c-a99f-1381812c4cca tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4" status: 200 len: 1522 microversion: 2.1 time: 0.493276 Jul 18 02:32:52.318524 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1747/3491] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:51 2022] GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4 => generated 1522 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:32:52.678820 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7612d46f-0e1a-45d1-839f-ee7b77a02a02 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:52.679504 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7612d46f-0e1a-45d1-839f-ee7b77a02a02 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:52.700371 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7612d46f-0e1a-45d1-839f-ee7b77a02a02 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:52.700842 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7612d46f-0e1a-45d1-839f-ee7b77a02a02 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:52.701676 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7612d46f-0e1a-45d1-839f-ee7b77a02a02 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:52.708886 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7612d46f-0e1a-45d1-839f-ee7b77a02a02 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:53.012305 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-82d9cf2f-4271-4e3b-85b9-2f169b4a252a tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:53.013579 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-82d9cf2f-4271-4e3b-85b9-2f169b4a252a tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 11b342d8-ebdd-4072-a6ec-d6bc21761582] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:53.324627 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-82d9cf2f-4271-4e3b-85b9-2f169b4a252a tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:53.337746 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-82d9cf2f-4271-4e3b-85b9-2f169b4a252a tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582" status: 200 len: 1213 microversion: 2.1 time: 0.329183 Jul 18 02:32:53.338772 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1748/3492] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:53 2022] GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582 => generated 1213 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:53.357934 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-21d2bd87-2b66-4ac9-b801-046471307275 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:53.358974 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-21d2bd87-2b66-4ac9-b801-046471307275 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: f4822dbd-f6d6-4c66-8661-69a15acf9df4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:53.384961 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-21d2bd87-2b66-4ac9-b801-046471307275 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:53.388952 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-21d2bd87-2b66-4ac9-b801-046471307275 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:53.390400 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-21d2bd87-2b66-4ac9-b801-046471307275 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:53.391098 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-21d2bd87-2b66-4ac9-b801-046471307275 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:53.641435 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7612d46f-0e1a-45d1-839f-ee7b77a02a02 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2374fa8610714b72b6034726ee1c2373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe99772712849608ba124613bb5cc26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:53.680552 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7612d46f-0e1a-45d1-839f-ee7b77a02a02 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9" status: 200 len: 1315 microversion: 2.1 time: 1.006594 Jul 18 02:32:53.688604 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1745/3493] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:52 2022] GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 => generated 1315 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:32:54.099517 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-21d2bd87-2b66-4ac9-b801-046471307275 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:54.116842 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-21d2bd87-2b66-4ac9-b801-046471307275 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4" status: 200 len: 1522 microversion: 2.1 time: 0.769804 Jul 18 02:32:54.121624 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1749/3494] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:53 2022] GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4 => generated 1522 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:54.380504 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c2a5f56a-66e9-48c8-8fd7-2982d510a6f5 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:54.382750 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c2a5f56a-66e9-48c8-8fd7-2982d510a6f5 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 11b342d8-ebdd-4072-a6ec-d6bc21761582] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:54.445758 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c2a5f56a-66e9-48c8-8fd7-2982d510a6f5 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:54.446684 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c2a5f56a-66e9-48c8-8fd7-2982d510a6f5 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:54.461624 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c2a5f56a-66e9-48c8-8fd7-2982d510a6f5 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:54.462375 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c2a5f56a-66e9-48c8-8fd7-2982d510a6f5 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:54.713080 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d4958080-1df4-4013-8a13-292eb38c32e7 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:54.713757 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d4958080-1df4-4013-8a13-292eb38c32e7 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:54.726066 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d4958080-1df4-4013-8a13-292eb38c32e7 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:54.726531 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d4958080-1df4-4013-8a13-292eb38c32e7 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:54.727928 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d4958080-1df4-4013-8a13-292eb38c32e7 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:54.727928 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d4958080-1df4-4013-8a13-292eb38c32e7 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:54.978013 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c2a5f56a-66e9-48c8-8fd7-2982d510a6f5 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:54.988653 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c2a5f56a-66e9-48c8-8fd7-2982d510a6f5 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582" status: 200 len: 1273 microversion: 2.1 time: 0.622610 Jul 18 02:32:54.993104 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1746/3495] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:54 2022] GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582 => generated 1273 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:55.147138 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5b189779-f8b1-4940-9fff-fa00bd664b41 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:55.147964 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5b189779-f8b1-4940-9fff-fa00bd664b41 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: f4822dbd-f6d6-4c66-8661-69a15acf9df4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:55.158834 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5b189779-f8b1-4940-9fff-fa00bd664b41 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:55.173813 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5b189779-f8b1-4940-9fff-fa00bd664b41 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:55.174908 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5b189779-f8b1-4940-9fff-fa00bd664b41 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:55.175500 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5b189779-f8b1-4940-9fff-fa00bd664b41 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:55.789090 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5b189779-f8b1-4940-9fff-fa00bd664b41 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:55.799890 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d4958080-1df4-4013-8a13-292eb38c32e7 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2374fa8610714b72b6034726ee1c2373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe99772712849608ba124613bb5cc26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:55.804609 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5b189779-f8b1-4940-9fff-fa00bd664b41 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4" status: 200 len: 1522 microversion: 2.1 time: 0.661506 Jul 18 02:32:55.818782 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1747/3496] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:55 2022] GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4 => generated 1522 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:55.824944 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d4958080-1df4-4013-8a13-292eb38c32e7 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9" status: 200 len: 1315 microversion: 2.1 time: 1.117739 Jul 18 02:32:55.827076 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1750/3497] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:54 2022] GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 => generated 1315 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:55.859886 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-fdee75c6-179b-4692-90fc-da4af702a265 req-72c670c8-d5af-4855-a8bb-fa10d8d23174 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9", "name": "network-vif-plugged", "status": "completed", "tag": "6f939eb0-ce87-4bf6-aa4f-2e850201052a"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:55.881805 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-fdee75c6-179b-4692-90fc-da4af702a265 req-72c670c8-d5af-4855-a8bb-fa10d8d23174 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:55.882839 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-fdee75c6-179b-4692-90fc-da4af702a265 req-72c670c8-d5af-4855-a8bb-fa10d8d23174 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:55.937080 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-fdee75c6-179b-4692-90fc-da4af702a265 req-72c670c8-d5af-4855-a8bb-fa10d8d23174 service nova] Creating event network-vif-plugged:6f939eb0-ce87-4bf6-aa4f-2e850201052a for instance 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 on n-h2-465891-3 Jul 18 02:32:55.951381 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-fdee75c6-179b-4692-90fc-da4af702a265 req-72c670c8-d5af-4855-a8bb-fa10d8d23174 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099056 Jul 18 02:32:55.954996 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1748/3498] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:32:56.035633 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-58012e72-2009-44bc-a653-117160ee3cb8 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:56.040464 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-58012e72-2009-44bc-a653-117160ee3cb8 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 11b342d8-ebdd-4072-a6ec-d6bc21761582] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:56.058573 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:56.062491 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-58012e72-2009-44bc-a653-117160ee3cb8 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:56.064901 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-58012e72-2009-44bc-a653-117160ee3cb8 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:56.067314 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-58012e72-2009-44bc-a653-117160ee3cb8 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:56.069607 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-58012e72-2009-44bc-a653-117160ee3cb8 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:56.248020 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-58012e72-2009-44bc-a653-117160ee3cb8 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:56.261052 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-58012e72-2009-44bc-a653-117160ee3cb8 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582" status: 200 len: 1271 microversion: 2.1 time: 0.241344 Jul 18 02:32:56.266312 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1751/3499] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:56 2022] GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582 => generated 1271 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:56.844613 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-57df483f-f817-4161-83d2-e3bca9e1b7e6 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:56.845383 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-57df483f-f817-4161-83d2-e3bca9e1b7e6 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:56.853109 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-eb5da52c-8cb2-4dc4-bfea-fc3d2ebbf491 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:56.855172 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-eb5da52c-8cb2-4dc4-bfea-fc3d2ebbf491 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: f4822dbd-f6d6-4c66-8661-69a15acf9df4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:56.866209 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-57df483f-f817-4161-83d2-e3bca9e1b7e6 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:56.866942 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-57df483f-f817-4161-83d2-e3bca9e1b7e6 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:56.867986 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-57df483f-f817-4161-83d2-e3bca9e1b7e6 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:56.868608 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-57df483f-f817-4161-83d2-e3bca9e1b7e6 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:56.878481 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eb5da52c-8cb2-4dc4-bfea-fc3d2ebbf491 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:56.879330 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eb5da52c-8cb2-4dc4-bfea-fc3d2ebbf491 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:56.889982 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eb5da52c-8cb2-4dc4-bfea-fc3d2ebbf491 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:56.891062 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eb5da52c-8cb2-4dc4-bfea-fc3d2ebbf491 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:57.695822 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-57df483f-f817-4161-83d2-e3bca9e1b7e6 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2374fa8610714b72b6034726ee1c2373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe99772712849608ba124613bb5cc26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:57.734125 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-57df483f-f817-4161-83d2-e3bca9e1b7e6 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9" status: 200 len: 1315 microversion: 2.1 time: 0.878933 Jul 18 02:32:57.735485 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1752/3500] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:56 2022] GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 => generated 1315 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:57.757196 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-add2568b-77e8-4022-95c4-7b9414de9e50 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:57.759641 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-add2568b-77e8-4022-95c4-7b9414de9e50 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 11b342d8-ebdd-4072-a6ec-d6bc21761582] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:57.772225 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-add2568b-77e8-4022-95c4-7b9414de9e50 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:57.773672 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-add2568b-77e8-4022-95c4-7b9414de9e50 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:57.775664 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-add2568b-77e8-4022-95c4-7b9414de9e50 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:57.776367 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-add2568b-77e8-4022-95c4-7b9414de9e50 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:57.829038 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-eb5da52c-8cb2-4dc4-bfea-fc3d2ebbf491 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:57.842026 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:57.868635 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-eb5da52c-8cb2-4dc4-bfea-fc3d2ebbf491 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4" status: 200 len: 1522 microversion: 2.1 time: 1.044817 Jul 18 02:32:57.871440 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1749/3501] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:56 2022] GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4 => generated 1522 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:57.975941 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-add2568b-77e8-4022-95c4-7b9414de9e50 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:57.987018 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-add2568b-77e8-4022-95c4-7b9414de9e50 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582" status: 200 len: 1271 microversion: 2.1 time: 0.248205 Jul 18 02:32:57.992931 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1753/3502] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:57 2022] GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582 => generated 1271 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:58.756483 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4e93da56-7f06-4555-9c62-3a456a0c1c96 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:58.758237 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4e93da56-7f06-4555-9c62-3a456a0c1c96 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:58.772355 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4e93da56-7f06-4555-9c62-3a456a0c1c96 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:58.773127 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4e93da56-7f06-4555-9c62-3a456a0c1c96 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:58.774224 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4e93da56-7f06-4555-9c62-3a456a0c1c96 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:58.774861 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4e93da56-7f06-4555-9c62-3a456a0c1c96 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:58.890013 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f3e8c438-b05b-407c-bac2-3ef4ae553342 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:58.891587 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f3e8c438-b05b-407c-bac2-3ef4ae553342 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: f4822dbd-f6d6-4c66-8661-69a15acf9df4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:58.928475 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f3e8c438-b05b-407c-bac2-3ef4ae553342 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:58.938995 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f3e8c438-b05b-407c-bac2-3ef4ae553342 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:58.940483 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f3e8c438-b05b-407c-bac2-3ef4ae553342 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:58.941308 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f3e8c438-b05b-407c-bac2-3ef4ae553342 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:59.807003 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f3e8c438-b05b-407c-bac2-3ef4ae553342 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:59.841877 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f3e8c438-b05b-407c-bac2-3ef4ae553342 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4" status: 200 len: 1522 microversion: 2.1 time: 0.956661 Jul 18 02:32:59.844881 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1754/3503] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:58 2022] GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4 => generated 1522 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:32:59.866172 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c53cc93c-c830-467d-9ccf-7cc1de9581de tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:59.868460 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c53cc93c-c830-467d-9ccf-7cc1de9581de tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 11b342d8-ebdd-4072-a6ec-d6bc21761582] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:59.889018 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c53cc93c-c830-467d-9ccf-7cc1de9581de tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:59.892068 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c53cc93c-c830-467d-9ccf-7cc1de9581de tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:59.894214 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c53cc93c-c830-467d-9ccf-7cc1de9581de tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:59.894693 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c53cc93c-c830-467d-9ccf-7cc1de9581de tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:59.939621 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4e93da56-7f06-4555-9c62-3a456a0c1c96 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2374fa8610714b72b6034726ee1c2373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe99772712849608ba124613bb5cc26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:59.970868 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4e93da56-7f06-4555-9c62-3a456a0c1c96 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9" status: 200 len: 1504 microversion: 2.1 time: 1.217919 Jul 18 02:32:59.972185 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1750/3504] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:58 2022] GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 => generated 1504 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:59.996849 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d08a68ed-117d-4515-be20-c88e637623af tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2091015935"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:59.999079 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d08a68ed-117d-4515-be20-c88e637623af tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:00.019248 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d08a68ed-117d-4515-be20-c88e637623af tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:00.022175 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d08a68ed-117d-4515-be20-c88e637623af tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:00.024123 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d08a68ed-117d-4515-be20-c88e637623af tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:00.027807 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d08a68ed-117d-4515-be20-c88e637623af tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:00.834482 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c53cc93c-c830-467d-9ccf-7cc1de9581de tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:00.890435 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c53cc93c-c830-467d-9ccf-7cc1de9581de tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582" status: 200 len: 1313 microversion: 2.1 time: 1.041228 Jul 18 02:33:00.892704 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1755/3505] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:59 2022] GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582 => generated 1313 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:00.906558 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-89ed8e6b-3579-4523-86c5-f344acbc9518 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:00.908511 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-89ed8e6b-3579-4523-86c5-f344acbc9518 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: f4822dbd-f6d6-4c66-8661-69a15acf9df4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:00.924994 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-89ed8e6b-3579-4523-86c5-f344acbc9518 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:00.925948 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-89ed8e6b-3579-4523-86c5-f344acbc9518 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:00.929074 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-89ed8e6b-3579-4523-86c5-f344acbc9518 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:00.930215 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-89ed8e6b-3579-4523-86c5-f344acbc9518 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:01.057528 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.network.security_group_api [None req-d08a68ed-117d-4515-be20-c88e637623af tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Adding security group 52bbb4d7-3b5d-4a3b-8314-181610297d5b to port 6f939eb0-ce87-4bf6-aa4f-2e850201052a Jul 18 02:33:01.445850 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:01.990498 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:02.606412 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-89ed8e6b-3579-4523-86c5-f344acbc9518 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:02.621599 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-89ed8e6b-3579-4523-86c5-f344acbc9518 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4" status: 200 len: 1522 microversion: 2.1 time: 1.726727 Jul 18 02:33:02.627297 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1756/3506] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:00 2022] GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4 => generated 1522 bytes in 1734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:02.647510 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c3d51f35-7aed-4c26-a56b-4fea5f4eb3ab tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:02.649822 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c3d51f35-7aed-4c26-a56b-4fea5f4eb3ab tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 11b342d8-ebdd-4072-a6ec-d6bc21761582] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:02.669119 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c3d51f35-7aed-4c26-a56b-4fea5f4eb3ab tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:02.671975 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c3d51f35-7aed-4c26-a56b-4fea5f4eb3ab tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:02.673253 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c3d51f35-7aed-4c26-a56b-4fea5f4eb3ab tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:02.677912 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c3d51f35-7aed-4c26-a56b-4fea5f4eb3ab tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:03.329801 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=8 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:03.645921 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c3d51f35-7aed-4c26-a56b-4fea5f4eb3ab tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:03.661261 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c3d51f35-7aed-4c26-a56b-4fea5f4eb3ab tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582" status: 200 len: 1313 microversion: 2.1 time: 1.029463 Jul 18 02:33:03.664532 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1757/3507] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:02 2022] GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582 => generated 1313 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:03.676660 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2109a080-fe60-418d-9fa7-727252112b55 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:03.677292 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2109a080-fe60-418d-9fa7-727252112b55 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: f4822dbd-f6d6-4c66-8661-69a15acf9df4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:03.699441 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2109a080-fe60-418d-9fa7-727252112b55 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:03.700513 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2109a080-fe60-418d-9fa7-727252112b55 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:03.702037 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2109a080-fe60-418d-9fa7-727252112b55 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:03.702887 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2109a080-fe60-418d-9fa7-727252112b55 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:03.764506 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:04.469775 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d08a68ed-117d-4515-be20-c88e637623af tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "POST /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9/action" status: 202 len: 0 microversion: 2.1 time: 4.483583 Jul 18 02:33:04.472039 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1751/3508] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:32:59 2022] POST /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9/action => generated 0 bytes in 4488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:33:04.534933 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3a28910c-ff48-41c2-9f8d-35091a15938e tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '.version_select at 0x7ff49b751430>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:05.204246 n-d-465891-3 devstack@n-api.service[119543]: DEBUG neutronclient.v2_0.client [None req-3a28910c-ff48-41c2-9f8d-35091a15938e tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 52bbb4d7-3b5d-4a3b-8314-181610297d5b in use.", "detail": ""}} {{(pid=119543) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:33:05.204957 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-3a28910c-ff48-41c2-9f8d-35091a15938e tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] HTTP exception thrown: Security Group 52bbb4d7-3b5d-4a3b-8314-181610297d5b in use. Jul 18 02:33:05.204957 n-d-465891-3 devstack@n-api.service[119543]: Neutron server returns request_ids: ['req-5d2f80a9-54f4-41bd-a9e5-dfe683ba59c1'] Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3a28910c-ff48-41c2-9f8d-35091a15938e tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Request method failure captured: Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/os-security-groups/52bbb4d7-3b5d-4a3b-8314-181610297d5b HTTP/1.1 Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MXdApAd8jCQLuDQ4GDVob3WlO5TGoerQppREc0ccYssaOHle4VdpCa3zbolI9kA3vBsm6toj834_HQ72z_BEBH3fK1DoWoIDaDTMEsKRnNxFFmWRX0hetMPDmWg_gNY33hhTytVVTi3zUdfIo_ja5VJys5KWb2G5Exx3CV-M4e89mI Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: afe99772712849608ba124613bb5cc26 Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_afe99772712849608ba124613bb5cc26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/afe99772712849608ba124613bb5cc26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/afe99772712849608ba124613bb5cc26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/afe99772712849608ba124613bb5cc26"}]}] Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: afe99772712849608ba124613bb5cc26 Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-SecurityGroupsTestJSON-235723186-project Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 2374fa8610714b72b6034726ee1c2373 Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-SecurityGroupsTestJSON-235723186-project Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: exception: Security Group 52bbb4d7-3b5d-4a3b-8314-181610297d5b in use. Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: Neutron server returns request_ids: ['req-5d2f80a9-54f4-41bd-a9e5-dfe683ba59c1'] Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '52bbb4d7-3b5d-4a3b-8314-181610297d5b'} Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:33:05.207901 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 52bbb4d7-3b5d-4a3b-8314-181610297d5b in use. Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5d2f80a9-54f4-41bd-a9e5-dfe683ba59c1'] Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 52bbb4d7-3b5d-4a3b-8314-181610297d5b in use. Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5d2f80a9-54f4-41bd-a9e5-dfe683ba59c1'] Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 52bbb4d7-3b5d-4a3b-8314-181610297d5b in use. Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5d2f80a9-54f4-41bd-a9e5-dfe683ba59c1'] Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 52bbb4d7-3b5d-4a3b-8314-181610297d5b in use. Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5d2f80a9-54f4-41bd-a9e5-dfe683ba59c1'] Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3a28910c-ff48-41c2-9f8d-35091a15938e tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Returning 400 to user: Security Group 52bbb4d7-3b5d-4a3b-8314-181610297d5b in use. Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: Neutron server returns request_ids: ['req-5d2f80a9-54f4-41bd-a9e5-dfe683ba59c1'] {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3a28910c-ff48-41c2-9f8d-35091a15938e tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/52bbb4d7-3b5d-4a3b-8314-181610297d5b" status: 400 len: 185 microversion: 2.1 time: 0.731765 Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1752/3509] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 02:33:04 2022] DELETE /compute/v2.1/os-security-groups/52bbb4d7-3b5d-4a3b-8314-181610297d5b => generated 185 bytes in 734 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:33:05.218455 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-ad4aa2db-a56d-418f-9ca8-3ed876fe3e16 req-86cbe1a5-4b80-4125-ac87-f43e218bcac9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9", "tag": "6f939eb0-ce87-4bf6-aa4f-2e850201052a"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:05.266915 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-ad4aa2db-a56d-418f-9ca8-3ed876fe3e16 req-86cbe1a5-4b80-4125-ac87-f43e218bcac9 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:05.272609 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2109a080-fe60-418d-9fa7-727252112b55 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:05.278061 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-ad4aa2db-a56d-418f-9ca8-3ed876fe3e16 req-86cbe1a5-4b80-4125-ac87-f43e218bcac9 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:05.284256 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2109a080-fe60-418d-9fa7-727252112b55 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4" status: 200 len: 1522 microversion: 2.1 time: 1.617498 Jul 18 02:33:05.288778 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1758/3510] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:03 2022] GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4 => generated 1522 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:05.304713 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-ad4aa2db-a56d-418f-9ca8-3ed876fe3e16 req-86cbe1a5-4b80-4125-ac87-f43e218bcac9 service nova] Creating event network-changed:6f939eb0-ce87-4bf6-aa4f-2e850201052a for instance 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 on n-h2-465891-3 Jul 18 02:33:05.315337 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-ad4aa2db-a56d-418f-9ca8-3ed876fe3e16 req-86cbe1a5-4b80-4125-ac87-f43e218bcac9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103531 Jul 18 02:33:05.318292 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1753/3511] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:05.326349 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5df0ebe3-7831-4048-b1f8-6c4fc738558a tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:05.329555 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5df0ebe3-7831-4048-b1f8-6c4fc738558a tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:05.329800 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d85c1f9b-c426-4ef3-920b-9d1f0b0c1f4d tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:05.340678 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d85c1f9b-c426-4ef3-920b-9d1f0b0c1f4d tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 11b342d8-ebdd-4072-a6ec-d6bc21761582] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:05.345789 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5df0ebe3-7831-4048-b1f8-6c4fc738558a tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:05.346540 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5df0ebe3-7831-4048-b1f8-6c4fc738558a tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:05.347570 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5df0ebe3-7831-4048-b1f8-6c4fc738558a tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:05.348320 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5df0ebe3-7831-4048-b1f8-6c4fc738558a tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:05.368889 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d85c1f9b-c426-4ef3-920b-9d1f0b0c1f4d tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:05.369452 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d85c1f9b-c426-4ef3-920b-9d1f0b0c1f4d tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:05.381553 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d85c1f9b-c426-4ef3-920b-9d1f0b0c1f4d tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:05.382198 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d85c1f9b-c426-4ef3-920b-9d1f0b0c1f4d tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:05.460771 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5df0ebe3-7831-4048-b1f8-6c4fc738558a tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "POST /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9/action" status: 202 len: 0 microversion: 2.1 time: 0.140094 Jul 18 02:33:05.463971 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1754/3512] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:33:05 2022] POST /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:33:05.514101 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-271a6e76-87c8-481e-b3da-a22e392a640e tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:05.518017 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-271a6e76-87c8-481e-b3da-a22e392a640e tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:05.547758 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-271a6e76-87c8-481e-b3da-a22e392a640e tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:05.549250 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-271a6e76-87c8-481e-b3da-a22e392a640e tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:05.551128 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-271a6e76-87c8-481e-b3da-a22e392a640e tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:05.552251 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-271a6e76-87c8-481e-b3da-a22e392a640e tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:06.633787 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d85c1f9b-c426-4ef3-920b-9d1f0b0c1f4d tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:06.644262 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d85c1f9b-c426-4ef3-920b-9d1f0b0c1f4d tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582" status: 200 len: 1334 microversion: 2.1 time: 1.353990 Jul 18 02:33:06.658528 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1759/3513] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:05 2022] GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582 => generated 1334 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:06.679756 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-dc8a7f7e-03bc-4430-b7b1-cf2fbc17e271 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:06.682306 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-dc8a7f7e-03bc-4430-b7b1-cf2fbc17e271 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: f4822dbd-f6d6-4c66-8661-69a15acf9df4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:06.720500 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dc8a7f7e-03bc-4430-b7b1-cf2fbc17e271 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:06.721263 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dc8a7f7e-03bc-4430-b7b1-cf2fbc17e271 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:06.723325 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dc8a7f7e-03bc-4430-b7b1-cf2fbc17e271 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:06.727528 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dc8a7f7e-03bc-4430-b7b1-cf2fbc17e271 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:07.624741 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-271a6e76-87c8-481e-b3da-a22e392a640e tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2374fa8610714b72b6034726ee1c2373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe99772712849608ba124613bb5cc26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:07.634561 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-271a6e76-87c8-481e-b3da-a22e392a640e tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9" status: 200 len: 1575 microversion: 2.1 time: 2.154092 Jul 18 02:33:07.644204 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1755/3514] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:05 2022] GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 => generated 1575 bytes in 2169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:07.650107 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-d38b5019-6652-4b66-8f8c-ca011c525129 req-f8f375ad-04b8-4e41-ad2d-1694bae0b703 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11b342d8-ebdd-4072-a6ec-d6bc21761582", "tag": "02142832-94da-4d1d-85a0-b0a50bbcf698"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:07.668345 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-d38b5019-6652-4b66-8f8c-ca011c525129 req-f8f375ad-04b8-4e41-ad2d-1694bae0b703 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:07.673485 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-d38b5019-6652-4b66-8f8c-ca011c525129 req-f8f375ad-04b8-4e41-ad2d-1694bae0b703 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:07.700176 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-d38b5019-6652-4b66-8f8c-ca011c525129 req-f8f375ad-04b8-4e41-ad2d-1694bae0b703 service nova] Creating event network-changed:02142832-94da-4d1d-85a0-b0a50bbcf698 for instance 11b342d8-ebdd-4072-a6ec-d6bc21761582 on n-h2-465891-3 Jul 18 02:33:07.715771 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-d38b5019-6652-4b66-8f8c-ca011c525129 req-f8f375ad-04b8-4e41-ad2d-1694bae0b703 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069268 Jul 18 02:33:07.717147 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1756/3515] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:07.723372 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bc629691-f887-47ad-b21b-cf621814fcad tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:07.724365 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bc629691-f887-47ad-b21b-cf621814fcad tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 11b342d8-ebdd-4072-a6ec-d6bc21761582] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:07.734665 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bc629691-f887-47ad-b21b-cf621814fcad tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:07.742852 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bc629691-f887-47ad-b21b-cf621814fcad tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:07.744167 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bc629691-f887-47ad-b21b-cf621814fcad tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:07.744650 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bc629691-f887-47ad-b21b-cf621814fcad tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:08.395922 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-dc8a7f7e-03bc-4430-b7b1-cf2fbc17e271 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:08.438075 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-dc8a7f7e-03bc-4430-b7b1-cf2fbc17e271 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4" status: 200 len: 1522 microversion: 2.1 time: 1.775437 Jul 18 02:33:08.439391 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1760/3516] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:06 2022] GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4 => generated 1522 bytes in 1778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:08.666492 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-13091ca5-3490-483d-a49a-c91bc4919358 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:08.666972 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-13091ca5-3490-483d-a49a-c91bc4919358 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:08.690105 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-13091ca5-3490-483d-a49a-c91bc4919358 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:08.690787 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-13091ca5-3490-483d-a49a-c91bc4919358 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:08.693075 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-13091ca5-3490-483d-a49a-c91bc4919358 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:08.693527 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-13091ca5-3490-483d-a49a-c91bc4919358 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:09.829586 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bc629691-f887-47ad-b21b-cf621814fcad tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:09.882352 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bc629691-f887-47ad-b21b-cf621814fcad tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582" status: 200 len: 1334 microversion: 2.1 time: 2.163291 Jul 18 02:33:09.897604 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1757/3517] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:07 2022] GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582 => generated 1334 bytes in 2179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:09.908714 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ba4a1276-1f0f-4f76-996a-961260293a31 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:09.910756 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ba4a1276-1f0f-4f76-996a-961260293a31 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: f4822dbd-f6d6-4c66-8661-69a15acf9df4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:09.956774 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ba4a1276-1f0f-4f76-996a-961260293a31 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:09.958190 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ba4a1276-1f0f-4f76-996a-961260293a31 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:09.965433 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ba4a1276-1f0f-4f76-996a-961260293a31 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:09.968832 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ba4a1276-1f0f-4f76-996a-961260293a31 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:10.733440 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-13091ca5-3490-483d-a49a-c91bc4919358 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2374fa8610714b72b6034726ee1c2373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe99772712849608ba124613bb5cc26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:10.758738 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-13091ca5-3490-483d-a49a-c91bc4919358 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9" status: 200 len: 1575 microversion: 2.1 time: 2.096242 Jul 18 02:33:10.772066 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1761/3518] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:08 2022] GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 => generated 1575 bytes in 2114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:10.786029 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-c29b3e0f-5d07-41fc-ad86-066037d92c98 req-02150aa5-637c-46de-a3c9-6d41ebd9dd16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11b342d8-ebdd-4072-a6ec-d6bc21761582", "tag": "4a17857b-b706-4a20-9efd-43851f356de5"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:10.817061 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-c29b3e0f-5d07-41fc-ad86-066037d92c98 req-02150aa5-637c-46de-a3c9-6d41ebd9dd16 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:10.818241 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-c29b3e0f-5d07-41fc-ad86-066037d92c98 req-02150aa5-637c-46de-a3c9-6d41ebd9dd16 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:10.886558 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-c29b3e0f-5d07-41fc-ad86-066037d92c98 req-02150aa5-637c-46de-a3c9-6d41ebd9dd16 service nova] Creating event network-changed:4a17857b-b706-4a20-9efd-43851f356de5 for instance 11b342d8-ebdd-4072-a6ec-d6bc21761582 on n-h2-465891-3 Jul 18 02:33:10.896045 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-c29b3e0f-5d07-41fc-ad86-066037d92c98 req-02150aa5-637c-46de-a3c9-6d41ebd9dd16 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122564 Jul 18 02:33:10.901684 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1762/3519] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:10.918325 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-558fe88b-701d-4979-b367-4907d86ba948 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:10.919081 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-558fe88b-701d-4979-b367-4907d86ba948 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 11b342d8-ebdd-4072-a6ec-d6bc21761582] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:10.937820 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-558fe88b-701d-4979-b367-4907d86ba948 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:10.938681 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-558fe88b-701d-4979-b367-4907d86ba948 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:10.939888 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-558fe88b-701d-4979-b367-4907d86ba948 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:10.940671 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-558fe88b-701d-4979-b367-4907d86ba948 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:12.112118 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-558fe88b-701d-4979-b367-4907d86ba948 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:12.124576 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-558fe88b-701d-4979-b367-4907d86ba948 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582" status: 200 len: 1334 microversion: 2.1 time: 1.220389 Jul 18 02:33:12.131925 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1763/3520] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:10 2022] GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582 => generated 1334 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:12.145495 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-17f93e11-f360-4890-97c8-e8c976232002 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:12.148171 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-17f93e11-f360-4890-97c8-e8c976232002 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:12.174633 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-17f93e11-f360-4890-97c8-e8c976232002 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:12.178666 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-17f93e11-f360-4890-97c8-e8c976232002 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:12.180936 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-17f93e11-f360-4890-97c8-e8c976232002 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:12.180936 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-17f93e11-f360-4890-97c8-e8c976232002 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:12.457353 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ba4a1276-1f0f-4f76-996a-961260293a31 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:12.501424 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ba4a1276-1f0f-4f76-996a-961260293a31 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4" status: 200 len: 1522 microversion: 2.1 time: 2.599148 Jul 18 02:33:12.503210 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1758/3521] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:09 2022] GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4 => generated 1522 bytes in 2605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:12.949801 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-17f93e11-f360-4890-97c8-e8c976232002 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2374fa8610714b72b6034726ee1c2373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe99772712849608ba124613bb5cc26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:12.964215 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-17f93e11-f360-4890-97c8-e8c976232002 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9" status: 200 len: 1575 microversion: 2.1 time: 0.830536 Jul 18 02:33:12.965140 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1764/3522] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:12 2022] GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 => generated 1575 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:13.158603 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9f576a71-5099-4611-8dfe-b55b6aeefe06 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:13.160274 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9f576a71-5099-4611-8dfe-b55b6aeefe06 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 11b342d8-ebdd-4072-a6ec-d6bc21761582] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:13.170457 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9f576a71-5099-4611-8dfe-b55b6aeefe06 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:13.171650 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9f576a71-5099-4611-8dfe-b55b6aeefe06 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:13.172976 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9f576a71-5099-4611-8dfe-b55b6aeefe06 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:13.173840 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9f576a71-5099-4611-8dfe-b55b6aeefe06 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:13.525840 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-72cf3750-9c96-4f04-92fb-cef40f3ea0f5 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:13.527125 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-72cf3750-9c96-4f04-92fb-cef40f3ea0f5 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: f4822dbd-f6d6-4c66-8661-69a15acf9df4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:13.535064 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-72cf3750-9c96-4f04-92fb-cef40f3ea0f5 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:13.535788 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-72cf3750-9c96-4f04-92fb-cef40f3ea0f5 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:13.536970 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-72cf3750-9c96-4f04-92fb-cef40f3ea0f5 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:13.537601 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-72cf3750-9c96-4f04-92fb-cef40f3ea0f5 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:14.306397 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9f576a71-5099-4611-8dfe-b55b6aeefe06 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:14.314312 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9f576a71-5099-4611-8dfe-b55b6aeefe06 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582" status: 200 len: 1334 microversion: 2.1 time: 1.162638 Jul 18 02:33:14.328219 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1759/3523] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:13 2022] GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582 => generated 1334 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:14.333878 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-73f73b71-9085-4617-b88f-7c6a2bb799a1 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:14.336189 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-73f73b71-9085-4617-b88f-7c6a2bb799a1 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:14.358593 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-73f73b71-9085-4617-b88f-7c6a2bb799a1 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:14.359021 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-73f73b71-9085-4617-b88f-7c6a2bb799a1 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:14.363610 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-73f73b71-9085-4617-b88f-7c6a2bb799a1 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:14.365373 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-73f73b71-9085-4617-b88f-7c6a2bb799a1 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:14.771741 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-72cf3750-9c96-4f04-92fb-cef40f3ea0f5 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:14.809466 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-72cf3750-9c96-4f04-92fb-cef40f3ea0f5 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4" status: 200 len: 1522 microversion: 2.1 time: 1.287677 Jul 18 02:33:14.845886 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1765/3524] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:13 2022] GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4 => generated 1522 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:14.971514 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-73f73b71-9085-4617-b88f-7c6a2bb799a1 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2374fa8610714b72b6034726ee1c2373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe99772712849608ba124613bb5cc26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:15.000548 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-73f73b71-9085-4617-b88f-7c6a2bb799a1 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9" status: 200 len: 1580 microversion: 2.1 time: 0.670763 Jul 18 02:33:15.003310 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1760/3525] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:14 2022] GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 => generated 1580 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:15.334476 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4c847d41-ea53-47d7-81ea-6ee71d6cbe93 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:15.336796 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4c847d41-ea53-47d7-81ea-6ee71d6cbe93 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 11b342d8-ebdd-4072-a6ec-d6bc21761582] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:15.351915 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4c847d41-ea53-47d7-81ea-6ee71d6cbe93 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:15.352958 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4c847d41-ea53-47d7-81ea-6ee71d6cbe93 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:15.356099 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4c847d41-ea53-47d7-81ea-6ee71d6cbe93 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:15.356968 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4c847d41-ea53-47d7-81ea-6ee71d6cbe93 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:15.851067 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4c847d41-ea53-47d7-81ea-6ee71d6cbe93 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:15.851745 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-23a1af7e-5844-4521-9ae8-0bc4f60838e3 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:15.852686 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-23a1af7e-5844-4521-9ae8-0bc4f60838e3 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: f4822dbd-f6d6-4c66-8661-69a15acf9df4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:15.883365 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4c847d41-ea53-47d7-81ea-6ee71d6cbe93 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582" status: 200 len: 1334 microversion: 2.1 time: 0.552688 Jul 18 02:33:15.884091 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-23a1af7e-5844-4521-9ae8-0bc4f60838e3 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:15.887387 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1766/3526] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:15 2022] GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582 => generated 1334 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:33:15.887519 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-23a1af7e-5844-4521-9ae8-0bc4f60838e3 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:15.891790 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-23a1af7e-5844-4521-9ae8-0bc4f60838e3 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:15.893316 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-23a1af7e-5844-4521-9ae8-0bc4f60838e3 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:16.029886 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-37529955-fa97-483b-b491-a1b7c100a36a tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:16.031355 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-37529955-fa97-483b-b491-a1b7c100a36a tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:16.049334 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-37529955-fa97-483b-b491-a1b7c100a36a tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:16.050249 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-37529955-fa97-483b-b491-a1b7c100a36a tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:16.051260 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-37529955-fa97-483b-b491-a1b7c100a36a tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:16.051896 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-37529955-fa97-483b-b491-a1b7c100a36a tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:16.327805 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-37529955-fa97-483b-b491-a1b7c100a36a tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2374fa8610714b72b6034726ee1c2373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe99772712849608ba124613bb5cc26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:16.341871 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-37529955-fa97-483b-b491-a1b7c100a36a tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9" status: 200 len: 1573 microversion: 2.1 time: 0.317941 Jul 18 02:33:16.343846 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1767/3527] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:16 2022] GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 => generated 1573 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:33:16.377397 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f71d108a-7b86-4dba-ab8b-a590c5b27f76 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1349707044"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:16.379947 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f71d108a-7b86-4dba-ab8b-a590c5b27f76 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:16.404342 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f71d108a-7b86-4dba-ab8b-a590c5b27f76 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:16.407538 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f71d108a-7b86-4dba-ab8b-a590c5b27f76 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:16.410046 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f71d108a-7b86-4dba-ab8b-a590c5b27f76 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:16.411074 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f71d108a-7b86-4dba-ab8b-a590c5b27f76 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:16.418457 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-23a1af7e-5844-4521-9ae8-0bc4f60838e3 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:16.446347 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-23a1af7e-5844-4521-9ae8-0bc4f60838e3 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4" status: 200 len: 1502 microversion: 2.1 time: 0.604334 Jul 18 02:33:16.448128 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1761/3528] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:15 2022] GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4 => generated 1502 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:16.477526 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b0db0e5f-6ac8-4053-b0fc-fe51d024b698 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:16.478734 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b0db0e5f-6ac8-4053-b0fc-fe51d024b698 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: 02425120-f4dc-4f02-99c5-9bf0fe7e1931] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:16.494404 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b0db0e5f-6ac8-4053-b0fc-fe51d024b698 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:16.495642 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b0db0e5f-6ac8-4053-b0fc-fe51d024b698 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:16.497862 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b0db0e5f-6ac8-4053-b0fc-fe51d024b698 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:16.500371 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b0db0e5f-6ac8-4053-b0fc-fe51d024b698 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:17.383510 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.network.security_group_api [None req-f71d108a-7b86-4dba-ab8b-a590c5b27f76 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Adding security group 0d20e90f-2bee-46d1-b824-5a234ee45c27 to port 6f939eb0-ce87-4bf6-aa4f-2e850201052a Jul 18 02:33:17.507595 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b0db0e5f-6ac8-4053-b0fc-fe51d024b698 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:17.540896 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b0db0e5f-6ac8-4053-b0fc-fe51d024b698 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931" status: 200 len: 1516 microversion: 2.1 time: 1.069885 Jul 18 02:33:17.542210 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1762/3529] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:16 2022] GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931 => generated 1516 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:33:17.552264 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5df9fb51-f05a-43d4-b756-ba13b89e69d6 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:17.552582 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5df9fb51-f05a-43d4-b756-ba13b89e69d6 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 11b342d8-ebdd-4072-a6ec-d6bc21761582] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:17.573950 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5df9fb51-f05a-43d4-b756-ba13b89e69d6 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:17.574419 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5df9fb51-f05a-43d4-b756-ba13b89e69d6 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:17.575341 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5df9fb51-f05a-43d4-b756-ba13b89e69d6 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:17.575897 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5df9fb51-f05a-43d4-b756-ba13b89e69d6 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:18.331420 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5df9fb51-f05a-43d4-b756-ba13b89e69d6 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:18.347370 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5df9fb51-f05a-43d4-b756-ba13b89e69d6 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582" status: 200 len: 1334 microversion: 2.1 time: 0.802249 Jul 18 02:33:18.348200 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1763/3530] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:17 2022] GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582 => generated 1334 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:19.248727 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0ef3248c-8b8e-4641-a955-95a86199541f tempest-MultipleCreateNegativeTestJSON-890024565 tempest-MultipleCreateNegativeTestJSON-890024565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-102136501", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:19.255707 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-0ef3248c-8b8e-4641-a955-95a86199541f tempest-MultipleCreateNegativeTestJSON-890024565 tempest-MultipleCreateNegativeTestJSON-890024565-project] HTTP exception thrown: min_count must be <= max_count Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0ef3248c-8b8e-4641-a955-95a86199541f tempest-MultipleCreateNegativeTestJSON-890024565 tempest-MultipleCreateNegativeTestJSON-890024565-project] Request method failure captured: Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 183 Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MZsaG0SZujdkflBlRFfvzTsPY9Veh27JxbYyVtSdjAIeVIUujnmMqSNWmu12i0IHlM4BsDV8keyE5uFTE2rFTlo7w1iBeBYqE6eYek3nyNaShffpJI02aU9_R-3npNI4ntUtgNNtj3SpmO_uDvpoK9V5iTTft7vanloTZ3Mevd0mZY Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: aa42a541203f446e92f78883d558c56f Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-890024565 Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_aa42a541203f446e92f78883d558c56f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa42a541203f446e92f78883d558c56f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa42a541203f446e92f78883d558c56f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/aa42a541203f446e92f78883d558c56f"}]}] Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-890024565 Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: aa42a541203f446e92f78883d558c56f Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-890024565 Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-MultipleCreateNegativeTestJSON-890024565-project Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 60637c2690cd496292eae61a928a3bb5 Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-890024565-project Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-102136501", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "min_count": 3, "max_count": 2}} Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: exception: min_count must be <= max_count Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-102136501', 'imageRef': '3bb0a19f-5b69-48ee-a771-8fd416f92f36', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Jul 18 02:33:19.270237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:19.275892 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0ef3248c-8b8e-4641-a955-95a86199541f tempest-MultipleCreateNegativeTestJSON-890024565 tempest-MultipleCreateNegativeTestJSON-890024565-project] Returning 400 to user: min_count must be <= max_count {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:33:19.279976 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0ef3248c-8b8e-4641-a955-95a86199541f tempest-MultipleCreateNegativeTestJSON-890024565 tempest-MultipleCreateNegativeTestJSON-890024565-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.928543 Jul 18 02:33:19.285667 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1764/3531] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:33:18 2022] POST /compute/v2.1/servers => generated 74 bytes in 936 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 18 02:33:19.316365 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-652e5e85-ced0-4300-9827-4e986fb452b8 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:19.325029 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-652e5e85-ced0-4300-9827-4e986fb452b8 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: 16f6c6cd-fa50-4d1b-9bc4-0f9c6395dd46] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:19.353455 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=50 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:19.355652 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-652e5e85-ced0-4300-9827-4e986fb452b8 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] HTTP exception thrown: Instance 16f6c6cd-fa50-4d1b-9bc4-0f9c6395dd46 could not be found. Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-652e5e85-ced0-4300-9827-4e986fb452b8 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Request method failure captured: Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/servers/16f6c6cd-fa50-4d1b-9bc4-0f9c6395dd46/action HTTP/1.1 Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 14 Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MYgsMpQMGg_x4SatJimijJMXDATUd7K8pbmJMir06_hhN9kc6nEv2UNuBHWPOsjhgniijNTcv86Pv1g5if6jfxnXnFgylGVtP-ES0p4q8KsL3cpv9H2D_niEdkyIvqxweiHovqWE9ZMi6DufO28-UhMwnDHb097CRDIZ6xtrA6LrKI Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 1594a06c4e7c4bb7b184d916342933ba Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1345973443 Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1594a06c4e7c4bb7b184d916342933ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1594a06c4e7c4bb7b184d916342933ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1594a06c4e7c4bb7b184d916342933ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1594a06c4e7c4bb7b184d916342933ba"}]}] Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1345973443 Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 1594a06c4e7c4bb7b184d916342933ba Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1345973443 Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServerRescueNegativeTestJSON-1345973443-project Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 6f30a2016d954121bb251894fad6dd39 Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1345973443-project Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: {"rescue": {}} Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 16f6c6cd-fa50-4d1b-9bc4-0f9c6395dd46 could not be found. Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '16f6c6cd-fa50-4d1b-9bc4-0f9c6395dd46', 'body': {'rescue': {}}} Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16f6c6cd-fa50-4d1b-9bc4-0f9c6395dd46 could not be found. Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16f6c6cd-fa50-4d1b-9bc4-0f9c6395dd46 could not be found. Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:19.369776 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:19.378068 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:19.378068 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:19.378068 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:33:19.378068 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:33:19.378068 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16f6c6cd-fa50-4d1b-9bc4-0f9c6395dd46 could not be found. Jul 18 02:33:19.378068 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:19.378838 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-652e5e85-ced0-4300-9827-4e986fb452b8 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Returning 404 to user: Instance 16f6c6cd-fa50-4d1b-9bc4-0f9c6395dd46 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:33:19.380133 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-652e5e85-ced0-4300-9827-4e986fb452b8 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "POST /compute/v2.1/servers/16f6c6cd-fa50-4d1b-9bc4-0f9c6395dd46/action" status: 404 len: 111 microversion: 2.1 time: 0.092374 Jul 18 02:33:19.385415 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1765/3532] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:33:19 2022] POST /compute/v2.1/servers/16f6c6cd-fa50-4d1b-9bc4-0f9c6395dd46/action => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:33:19.406339 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-da2e1584-042e-48ee-ae1f-038aaaeb42d6 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:19.411753 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-da2e1584-042e-48ee-ae1f-038aaaeb42d6 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 11b342d8-ebdd-4072-a6ec-d6bc21761582] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:19.460203 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-da2e1584-042e-48ee-ae1f-038aaaeb42d6 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:19.461396 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-da2e1584-042e-48ee-ae1f-038aaaeb42d6 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:19.467631 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-da2e1584-042e-48ee-ae1f-038aaaeb42d6 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:19.468816 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-da2e1584-042e-48ee-ae1f-038aaaeb42d6 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:20.956944 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f71d108a-7b86-4dba-ab8b-a590c5b27f76 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "POST /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9/action" status: 202 len: 0 microversion: 2.1 time: 4.587235 Jul 18 02:33:20.957963 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1768/3533] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:33:16 2022] POST /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9/action => generated 0 bytes in 4590 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:33:20.963055 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1bd66d67-6741-4601-a780-22ff349df642 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:20.963609 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1bd66d67-6741-4601-a780-22ff349df642 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: 02425120-f4dc-4f02-99c5-9bf0fe7e1931] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:20.984030 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1bd66d67-6741-4601-a780-22ff349df642 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:20.987676 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1bd66d67-6741-4601-a780-22ff349df642 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:20.987986 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1bd66d67-6741-4601-a780-22ff349df642 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:20.988521 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1bd66d67-6741-4601-a780-22ff349df642 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:21.195740 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-da2e1584-042e-48ee-ae1f-038aaaeb42d6 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:21.218363 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-da2e1584-042e-48ee-ae1f-038aaaeb42d6 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582" status: 200 len: 1334 microversion: 2.1 time: 1.826556 Jul 18 02:33:21.219135 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1766/3534] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:19 2022] GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582 => generated 1334 bytes in 1833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:21.230080 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1bd66d67-6741-4601-a780-22ff349df642 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "POST /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931/action" status: 202 len: 0 microversion: 2.1 time: 0.270542 Jul 18 02:33:21.231224 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1769/3535] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:33:20 2022] POST /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:33:21.239777 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9d4562d3-a285-4990-a353-56a30432b0de tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '.version_select at 0x7ff4a8256040>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:21.267830 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c456362f-baaa-4642-8335-060d100edbe9 tempest-MultipleCreateNegativeTestJSON-890024565 tempest-MultipleCreateNegativeTestJSON-890024565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1887127915", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "max_count": 0}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c456362f-baaa-4642-8335-060d100edbe9 tempest-MultipleCreateNegativeTestJSON-890024565 tempest-MultipleCreateNegativeTestJSON-890024565-project] Request method failure captured: Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 168 Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MZsaG0SZujdkflBlRFfvzTsPY9Veh27JxbYyVtSdjAIeVIUujnmMqSNWmu12i0IHlM4BsDV8keyE5uFTE2rFTlo7w1iBeBYqE6eYek3nyNaShffpJI02aU9_R-3npNI4ntUtgNNtj3SpmO_uDvpoK9V5iTTft7vanloTZ3Mevd0mZY Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: aa42a541203f446e92f78883d558c56f Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-890024565 Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_aa42a541203f446e92f78883d558c56f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa42a541203f446e92f78883d558c56f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa42a541203f446e92f78883d558c56f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/aa42a541203f446e92f78883d558c56f"}]}] Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-890024565 Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: aa42a541203f446e92f78883d558c56f Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-890024565 Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-MultipleCreateNegativeTestJSON-890024565-project Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 60637c2690cd496292eae61a928a3bb5 Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-890024565-project Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1887127915", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "max_count": 0}} Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1887127915', 'imageRef': '3bb0a19f-5b69-48ee-a771-8fd416f92f36', 'flavorRef': '452', 'max_count': 0}}} Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi 0 Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:33:21.287104 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:33:21.292340 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:33:21.292340 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:33:21.292340 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:33:21.292340 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 18 02:33:21.292340 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:21.292340 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:21.292340 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:21.292340 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:21.292340 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:21.292340 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:21.292340 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:33:21.292340 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:33:21.292340 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 18 02:33:21.292340 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:21.293984 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c456362f-baaa-4642-8335-060d100edbe9 tempest-MultipleCreateNegativeTestJSON-890024565 tempest-MultipleCreateNegativeTestJSON-890024565-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:33:21.293984 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c456362f-baaa-4642-8335-060d100edbe9 tempest-MultipleCreateNegativeTestJSON-890024565 tempest-MultipleCreateNegativeTestJSON-890024565-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.057867 Jul 18 02:33:21.306378 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1767/3536] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:33:21 2022] POST /compute/v2.1/servers => generated 130 bytes in 86 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:33:21.329059 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-1649a355-0592-4e4f-b277-16c76c922dca req-8c328087-e09d-46f6-9931-b810045327f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9", "tag": "6f939eb0-ce87-4bf6-aa4f-2e850201052a"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:21.354531 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-1649a355-0592-4e4f-b277-16c76c922dca req-8c328087-e09d-46f6-9931-b810045327f3 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:21.358039 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-1649a355-0592-4e4f-b277-16c76c922dca req-8c328087-e09d-46f6-9931-b810045327f3 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:21.385974 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-1649a355-0592-4e4f-b277-16c76c922dca req-8c328087-e09d-46f6-9931-b810045327f3 service nova] Creating event network-changed:6f939eb0-ce87-4bf6-aa4f-2e850201052a for instance 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 on n-h2-465891-3 Jul 18 02:33:21.400393 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-1649a355-0592-4e4f-b277-16c76c922dca req-8c328087-e09d-46f6-9931-b810045327f3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090827 Jul 18 02:33:21.401675 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1768/3537] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:21.432820 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-63d56820-b73c-437c-8225-c7c035fc740e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:21.433889 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-63d56820-b73c-437c-8225-c7c035fc740e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: 02425120-f4dc-4f02-99c5-9bf0fe7e1931] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:21.489745 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-63d56820-b73c-437c-8225-c7c035fc740e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:21.490903 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-63d56820-b73c-437c-8225-c7c035fc740e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:21.493418 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-63d56820-b73c-437c-8225-c7c035fc740e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:21.496229 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-63d56820-b73c-437c-8225-c7c035fc740e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:21.765153 n-d-465891-3 devstack@n-api.service[119544]: DEBUG neutronclient.v2_0.client [None req-9d4562d3-a285-4990-a353-56a30432b0de tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 0d20e90f-2bee-46d1-b824-5a234ee45c27 in use.", "detail": ""}} {{(pid=119544) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:33:21.766028 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-9d4562d3-a285-4990-a353-56a30432b0de tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] HTTP exception thrown: Security Group 0d20e90f-2bee-46d1-b824-5a234ee45c27 in use. Jul 18 02:33:21.766028 n-d-465891-3 devstack@n-api.service[119544]: Neutron server returns request_ids: ['req-2eb760df-f2ac-4c7e-97af-855af88fc0a7'] Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9d4562d3-a285-4990-a353-56a30432b0de tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Request method failure captured: Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/os-security-groups/0d20e90f-2bee-46d1-b824-5a234ee45c27 HTTP/1.1 Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MXdApAd8jCQLuDQ4GDVob3WlO5TGoerQppREc0ccYssaOHle4VdpCa3zbolI9kA3vBsm6toj834_HQ72z_BEBH3fK1DoWoIDaDTMEsKRnNxFFmWRX0hetMPDmWg_gNY33hhTytVVTi3zUdfIo_ja5VJys5KWb2G5Exx3CV-M4e89mI Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: afe99772712849608ba124613bb5cc26 Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_afe99772712849608ba124613bb5cc26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/afe99772712849608ba124613bb5cc26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/afe99772712849608ba124613bb5cc26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/afe99772712849608ba124613bb5cc26"}]}] Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: afe99772712849608ba124613bb5cc26 Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-SecurityGroupsTestJSON-235723186-project Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 2374fa8610714b72b6034726ee1c2373 Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-SecurityGroupsTestJSON-235723186-project Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: exception: Security Group 0d20e90f-2bee-46d1-b824-5a234ee45c27 in use. Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: Neutron server returns request_ids: ['req-2eb760df-f2ac-4c7e-97af-855af88fc0a7'] Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '0d20e90f-2bee-46d1-b824-5a234ee45c27'} Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:33:21.770787 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 0d20e90f-2bee-46d1-b824-5a234ee45c27 in use. Jul 18 02:33:21.775641 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2eb760df-f2ac-4c7e-97af-855af88fc0a7'] Jul 18 02:33:21.775641 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:21.775641 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:21.775641 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:21.775641 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:21.775641 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 18 02:33:21.775641 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 18 02:33:21.775641 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 18 02:33:21.775641 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 18 02:33:21.775641 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 0d20e90f-2bee-46d1-b824-5a234ee45c27 in use. Jul 18 02:33:21.775641 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2eb760df-f2ac-4c7e-97af-855af88fc0a7'] Jul 18 02:33:21.775641 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:21.775641 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:21.775641 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:21.775641 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:21.775641 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:21.775641 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:21.775641 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:33:21.775641 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:33:21.775641 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:33:21.775641 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:33:21.775641 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:33:21.775641 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:33:21.775641 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 18 02:33:21.775641 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 18 02:33:21.775641 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 0d20e90f-2bee-46d1-b824-5a234ee45c27 in use. Jul 18 02:33:21.775641 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2eb760df-f2ac-4c7e-97af-855af88fc0a7'] Jul 18 02:33:21.775641 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:21.775641 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:21.775641 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:21.775641 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:21.775641 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:21.775641 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:21.775641 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:33:21.775641 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:33:21.775641 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 0d20e90f-2bee-46d1-b824-5a234ee45c27 in use. Jul 18 02:33:21.775641 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2eb760df-f2ac-4c7e-97af-855af88fc0a7'] Jul 18 02:33:21.775641 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:21.775641 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9d4562d3-a285-4990-a353-56a30432b0de tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Returning 400 to user: Security Group 0d20e90f-2bee-46d1-b824-5a234ee45c27 in use. Jul 18 02:33:21.775641 n-d-465891-3 devstack@n-api.service[119544]: Neutron server returns request_ids: ['req-2eb760df-f2ac-4c7e-97af-855af88fc0a7'] {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:33:21.775641 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9d4562d3-a285-4990-a353-56a30432b0de tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/0d20e90f-2bee-46d1-b824-5a234ee45c27" status: 400 len: 185 microversion: 2.1 time: 0.539932 Jul 18 02:33:21.775641 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1770/3538] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 02:33:21 2022] DELETE /compute/v2.1/os-security-groups/0d20e90f-2bee-46d1-b824-5a234ee45c27 => generated 185 bytes in 541 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:33:21.789603 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-312ad076-9ec0-4fe2-99e6-ebef872ea51c tempest-MultipleCreateNegativeTestJSON-890024565 tempest-MultipleCreateNegativeTestJSON-890024565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1670511116", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "max_count": 2.5}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-312ad076-9ec0-4fe2-99e6-ebef872ea51c tempest-MultipleCreateNegativeTestJSON-890024565 tempest-MultipleCreateNegativeTestJSON-890024565-project] Request method failure captured: Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 170 Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MZsaG0SZujdkflBlRFfvzTsPY9Veh27JxbYyVtSdjAIeVIUujnmMqSNWmu12i0IHlM4BsDV8keyE5uFTE2rFTlo7w1iBeBYqE6eYek3nyNaShffpJI02aU9_R-3npNI4ntUtgNNtj3SpmO_uDvpoK9V5iTTft7vanloTZ3Mevd0mZY Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: aa42a541203f446e92f78883d558c56f Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-890024565 Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_aa42a541203f446e92f78883d558c56f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa42a541203f446e92f78883d558c56f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa42a541203f446e92f78883d558c56f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/aa42a541203f446e92f78883d558c56f"}]}] Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-890024565 Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: aa42a541203f446e92f78883d558c56f Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-890024565 Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-MultipleCreateNegativeTestJSON-890024565-project Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 60637c2690cd496292eae61a928a3bb5 Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-890024565-project Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1670511116", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "max_count": 2.5}} Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1670511116', 'imageRef': '3bb0a19f-5b69-48ee-a771-8fd416f92f36', 'flavorRef': '452', 'max_count': 2.5}}} Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 2.5 Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:33:21.797841 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:33:21.802672 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:33:21.802672 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:33:21.802672 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:33:21.802672 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:33:21.802672 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 18 02:33:21.802672 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:21.802672 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:21.802672 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:21.802672 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:21.802672 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:21.802672 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:21.802672 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:33:21.802672 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:33:21.802672 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 18 02:33:21.802672 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:21.802672 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-312ad076-9ec0-4fe2-99e6-ebef872ea51c tempest-MultipleCreateNegativeTestJSON-890024565 tempest-MultipleCreateNegativeTestJSON-890024565-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:33:21.804704 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-312ad076-9ec0-4fe2-99e6-ebef872ea51c tempest-MultipleCreateNegativeTestJSON-890024565 tempest-MultipleCreateNegativeTestJSON-890024565-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.028023 Jul 18 02:33:21.813778 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1771/3539] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:33:21 2022] POST /compute/v2.1/servers => generated 139 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:33:21.825135 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-36ab60e1-595d-45a4-9257-8ff5cbaeda0a tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:21.832058 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-36ab60e1-595d-45a4-9257-8ff5cbaeda0a tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:21.856322 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-36ab60e1-595d-45a4-9257-8ff5cbaeda0a tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:21.856772 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-36ab60e1-595d-45a4-9257-8ff5cbaeda0a tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:21.864084 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-36ab60e1-595d-45a4-9257-8ff5cbaeda0a tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:21.867140 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-36ab60e1-595d-45a4-9257-8ff5cbaeda0a tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:21.935109 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-36ab60e1-595d-45a4-9257-8ff5cbaeda0a tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:33:22.064835 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-63d56820-b73c-437c-8225-c7c035fc740e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:22.089321 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-63d56820-b73c-437c-8225-c7c035fc740e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931" status: 200 len: 1521 microversion: 2.1 time: 0.686006 Jul 18 02:33:22.095219 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1769/3540] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:21 2022] GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931 => generated 1521 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:22.101560 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0b351081-749a-4028-befe-5417927b9db9 tempest-MultipleCreateNegativeTestJSON-890024565 tempest-MultipleCreateNegativeTestJSON-890024565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2056762390", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "min_count": 0}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0b351081-749a-4028-befe-5417927b9db9 tempest-MultipleCreateNegativeTestJSON-890024565 tempest-MultipleCreateNegativeTestJSON-890024565-project] Request method failure captured: Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 168 Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MZsaG0SZujdkflBlRFfvzTsPY9Veh27JxbYyVtSdjAIeVIUujnmMqSNWmu12i0IHlM4BsDV8keyE5uFTE2rFTlo7w1iBeBYqE6eYek3nyNaShffpJI02aU9_R-3npNI4ntUtgNNtj3SpmO_uDvpoK9V5iTTft7vanloTZ3Mevd0mZY Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: aa42a541203f446e92f78883d558c56f Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-890024565 Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_aa42a541203f446e92f78883d558c56f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa42a541203f446e92f78883d558c56f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa42a541203f446e92f78883d558c56f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/aa42a541203f446e92f78883d558c56f"}]}] Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-890024565 Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: aa42a541203f446e92f78883d558c56f Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-890024565 Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-MultipleCreateNegativeTestJSON-890024565-project Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 60637c2690cd496292eae61a928a3bb5 Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-890024565-project Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2056762390", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "min_count": 0}} Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2056762390', 'imageRef': '3bb0a19f-5b69-48ee-a771-8fd416f92f36', 'flavorRef': '452', 'min_count': 0}}} Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi 0 Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:33:22.120765 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:33:22.124991 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:33:22.124991 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:33:22.124991 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:33:22.124991 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 18 02:33:22.124991 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:22.124991 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:22.124991 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:22.124991 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:22.124991 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:22.124991 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:22.124991 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:33:22.124991 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:33:22.124991 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 18 02:33:22.124991 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:22.137145 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0b351081-749a-4028-befe-5417927b9db9 tempest-MultipleCreateNegativeTestJSON-890024565 tempest-MultipleCreateNegativeTestJSON-890024565-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:33:22.156563 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0b351081-749a-4028-befe-5417927b9db9 tempest-MultipleCreateNegativeTestJSON-890024565 tempest-MultipleCreateNegativeTestJSON-890024565-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.059661 Jul 18 02:33:22.177452 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1770/3541] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:33:22 2022] POST /compute/v2.1/servers => generated 130 bytes in 81 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:33:22.246042 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9a8db9ad-e73e-468a-a3bf-feafe9eb1f7d tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:22.247025 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9a8db9ad-e73e-468a-a3bf-feafe9eb1f7d tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 11b342d8-ebdd-4072-a6ec-d6bc21761582] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:22.289822 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9a8db9ad-e73e-468a-a3bf-feafe9eb1f7d tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:22.291892 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9a8db9ad-e73e-468a-a3bf-feafe9eb1f7d tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:22.298129 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9a8db9ad-e73e-468a-a3bf-feafe9eb1f7d tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:22.300182 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9a8db9ad-e73e-468a-a3bf-feafe9eb1f7d tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:22.349832 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-36ab60e1-595d-45a4-9257-8ff5cbaeda0a tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9" status: 204 len: 0 microversion: 2.1 time: 0.540184 Jul 18 02:33:22.356884 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1772/3542] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:33:21 2022] DELETE /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:33:22.415141 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-33a8eb76-abe6-4c0d-b5da-f5bf4406935f tempest-MultipleCreateNegativeTestJSON-890024565 tempest-MultipleCreateNegativeTestJSON-890024565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-574432055", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "min_count": 2.5}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-33a8eb76-abe6-4c0d-b5da-f5bf4406935f tempest-MultipleCreateNegativeTestJSON-890024565 tempest-MultipleCreateNegativeTestJSON-890024565-project] Request method failure captured: Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 169 Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MZsaG0SZujdkflBlRFfvzTsPY9Veh27JxbYyVtSdjAIeVIUujnmMqSNWmu12i0IHlM4BsDV8keyE5uFTE2rFTlo7w1iBeBYqE6eYek3nyNaShffpJI02aU9_R-3npNI4ntUtgNNtj3SpmO_uDvpoK9V5iTTft7vanloTZ3Mevd0mZY Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: aa42a541203f446e92f78883d558c56f Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-890024565 Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_aa42a541203f446e92f78883d558c56f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa42a541203f446e92f78883d558c56f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa42a541203f446e92f78883d558c56f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/aa42a541203f446e92f78883d558c56f"}]}] Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-890024565 Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: aa42a541203f446e92f78883d558c56f Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-890024565 Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-MultipleCreateNegativeTestJSON-890024565-project Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 60637c2690cd496292eae61a928a3bb5 Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-890024565-project Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-574432055", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "min_count": 2.5}} Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-574432055', 'imageRef': '3bb0a19f-5b69-48ee-a771-8fd416f92f36', 'flavorRef': '452', 'min_count': 2.5}}} Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 2.5 Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:33:22.431001 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:33:22.447849 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:33:22.447849 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:33:22.447849 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:33:22.447849 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:33:22.447849 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 18 02:33:22.447849 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:22.447849 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:22.447849 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:22.447849 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:22.447849 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:22.447849 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:22.447849 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:33:22.447849 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:33:22.447849 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 18 02:33:22.447849 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:22.486583 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-33a8eb76-abe6-4c0d-b5da-f5bf4406935f tempest-MultipleCreateNegativeTestJSON-890024565 tempest-MultipleCreateNegativeTestJSON-890024565-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:33:22.486583 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-33a8eb76-abe6-4c0d-b5da-f5bf4406935f tempest-MultipleCreateNegativeTestJSON-890024565 tempest-MultipleCreateNegativeTestJSON-890024565-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.095459 Jul 18 02:33:22.486583 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1773/3543] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:33:22 2022] POST /compute/v2.1/servers => generated 139 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:33:22.492441 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ec4d14f8-531c-4f1b-92cf-357b1438713f tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:22.493208 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ec4d14f8-531c-4f1b-92cf-357b1438713f tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:22.532263 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ec4d14f8-531c-4f1b-92cf-357b1438713f tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:22.532721 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ec4d14f8-531c-4f1b-92cf-357b1438713f tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:22.533546 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ec4d14f8-531c-4f1b-92cf-357b1438713f tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:22.534605 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ec4d14f8-531c-4f1b-92cf-357b1438713f tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:22.745094 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9a8db9ad-e73e-468a-a3bf-feafe9eb1f7d tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:22.781999 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9a8db9ad-e73e-468a-a3bf-feafe9eb1f7d tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582" status: 200 len: 1334 microversion: 2.1 time: 0.545879 Jul 18 02:33:22.786387 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1771/3544] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:22 2022] GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582 => generated 1334 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:23.121902 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6f91c912-34e8-41c0-82f1-deeb8860400e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:23.126533 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6f91c912-34e8-41c0-82f1-deeb8860400e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: 02425120-f4dc-4f02-99c5-9bf0fe7e1931] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:23.165646 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6f91c912-34e8-41c0-82f1-deeb8860400e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:23.170824 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6f91c912-34e8-41c0-82f1-deeb8860400e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:23.179353 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6f91c912-34e8-41c0-82f1-deeb8860400e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:23.180771 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6f91c912-34e8-41c0-82f1-deeb8860400e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:23.290417 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ec4d14f8-531c-4f1b-92cf-357b1438713f tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2374fa8610714b72b6034726ee1c2373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe99772712849608ba124613bb5cc26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:23.309756 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ec4d14f8-531c-4f1b-92cf-357b1438713f tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9" status: 200 len: 1648 microversion: 2.1 time: 0.838373 Jul 18 02:33:23.327510 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1774/3545] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:22 2022] GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 => generated 1648 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:23.778488 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6f91c912-34e8-41c0-82f1-deeb8860400e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:23.809310 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:23.817416 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6f91c912-34e8-41c0-82f1-deeb8860400e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931" status: 200 len: 1501 microversion: 2.1 time: 0.701383 Jul 18 02:33:23.829305 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e260224f-83cf-4454-bb11-982ef2f36798 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:23.833676 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e260224f-83cf-4454-bb11-982ef2f36798 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 11b342d8-ebdd-4072-a6ec-d6bc21761582] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:23.856542 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e260224f-83cf-4454-bb11-982ef2f36798 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:23.861223 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e260224f-83cf-4454-bb11-982ef2f36798 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:23.866238 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1772/3546] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:23 2022] GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931 => generated 1501 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:23.867224 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e260224f-83cf-4454-bb11-982ef2f36798 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:23.869618 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e260224f-83cf-4454-bb11-982ef2f36798 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:23.891940 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-07b46d7b-b75f-4641-b733-49e02b2d83be tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:23.901950 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-07b46d7b-b75f-4641-b733-49e02b2d83be tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: 02425120-f4dc-4f02-99c5-9bf0fe7e1931] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:23.923474 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-07b46d7b-b75f-4641-b733-49e02b2d83be tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:23.923936 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-07b46d7b-b75f-4641-b733-49e02b2d83be tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:23.926144 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-07b46d7b-b75f-4641-b733-49e02b2d83be tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:23.929597 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-07b46d7b-b75f-4641-b733-49e02b2d83be tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:23.969469 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-07b46d7b-b75f-4641-b733-49e02b2d83be tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lazy-loading 'flavor' on Instance uuid 02425120-f4dc-4f02-99c5-9bf0fe7e1931 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:33:23.999826 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-07b46d7b-b75f-4641-b733-49e02b2d83be tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] HTTP exception thrown: Cannot 'rescue' instance 02425120-f4dc-4f02-99c5-9bf0fe7e1931 while it is in vm_state paused Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-07b46d7b-b75f-4641-b733-49e02b2d83be tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Request method failure captured: Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931/action HTTP/1.1 Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 14 Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MYgsMpQMGg_x4SatJimijJMXDATUd7K8pbmJMir06_hhN9kc6nEv2UNuBHWPOsjhgniijNTcv86Pv1g5if6jfxnXnFgylGVtP-ES0p4q8KsL3cpv9H2D_niEdkyIvqxweiHovqWE9ZMi6DufO28-UhMwnDHb097CRDIZ6xtrA6LrKI Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 1594a06c4e7c4bb7b184d916342933ba Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1345973443 Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1594a06c4e7c4bb7b184d916342933ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1594a06c4e7c4bb7b184d916342933ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1594a06c4e7c4bb7b184d916342933ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1594a06c4e7c4bb7b184d916342933ba"}]}] Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1345973443 Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 1594a06c4e7c4bb7b184d916342933ba Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1345973443 Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServerRescueNegativeTestJSON-1345973443-project Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 6f30a2016d954121bb251894fad6dd39 Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1345973443-project Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: {"rescue": {}} Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: exception: Cannot 'rescue' instance 02425120-f4dc-4f02-99c5-9bf0fe7e1931 while it is in vm_state paused Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '02425120-f4dc-4f02-99c5-9bf0fe7e1931', 'body': {'rescue': {}}} Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 02425120-f4dc-4f02-99c5-9bf0fe7e1931 in vm_state paused. Cannot rescue while the instance is in this state. Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 02425120-f4dc-4f02-99c5-9bf0fe7e1931 while it is in vm_state paused Jul 18 02:33:24.004890 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:24.014999 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:24.014999 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:24.014999 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:24.014999 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:24.014999 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:24.014999 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:33:24.014999 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:33:24.014999 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 02425120-f4dc-4f02-99c5-9bf0fe7e1931 while it is in vm_state paused Jul 18 02:33:24.014999 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:24.021801 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-07b46d7b-b75f-4641-b733-49e02b2d83be tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Returning 409 to user: Cannot 'rescue' instance 02425120-f4dc-4f02-99c5-9bf0fe7e1931 while it is in vm_state paused {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:33:24.024723 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-07b46d7b-b75f-4641-b733-49e02b2d83be tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "POST /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931/action" status: 409 len: 144 microversion: 2.1 time: 0.141928 Jul 18 02:33:24.026183 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1773/3547] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:33:23 2022] POST /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931/action => generated 144 bytes in 159 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:33:24.040528 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fc7abdcf-f977-4f0c-9a37-4d9337ec1ec8 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:24.042123 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fc7abdcf-f977-4f0c-9a37-4d9337ec1ec8 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: 02425120-f4dc-4f02-99c5-9bf0fe7e1931] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:24.057889 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fc7abdcf-f977-4f0c-9a37-4d9337ec1ec8 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:24.059155 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fc7abdcf-f977-4f0c-9a37-4d9337ec1ec8 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:24.061431 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fc7abdcf-f977-4f0c-9a37-4d9337ec1ec8 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:24.062605 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fc7abdcf-f977-4f0c-9a37-4d9337ec1ec8 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:24.211189 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fc7abdcf-f977-4f0c-9a37-4d9337ec1ec8 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "POST /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931/action" status: 202 len: 0 microversion: 2.1 time: 0.178573 Jul 18 02:33:24.215399 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1774/3548] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:33:24 2022] POST /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:33:24.230487 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7855d8f7-81d8-4cae-b200-36cd87c2bb84 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:24.231294 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7855d8f7-81d8-4cae-b200-36cd87c2bb84 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: 02425120-f4dc-4f02-99c5-9bf0fe7e1931] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:24.243274 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7855d8f7-81d8-4cae-b200-36cd87c2bb84 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:24.244062 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7855d8f7-81d8-4cae-b200-36cd87c2bb84 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:24.245375 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7855d8f7-81d8-4cae-b200-36cd87c2bb84 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:24.246178 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7855d8f7-81d8-4cae-b200-36cd87c2bb84 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:24.826477 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e260224f-83cf-4454-bb11-982ef2f36798 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:24.854026 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e260224f-83cf-4454-bb11-982ef2f36798 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582" status: 200 len: 1334 microversion: 2.1 time: 1.039262 Jul 18 02:33:24.864835 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1775/3549] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:23 2022] GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582 => generated 1334 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:24.879866 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d565f56e-1b1e-4756-88ee-2dbdcdbebd02 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:24.880837 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d565f56e-1b1e-4756-88ee-2dbdcdbebd02 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:24.910918 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d565f56e-1b1e-4756-88ee-2dbdcdbebd02 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:24.911721 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d565f56e-1b1e-4756-88ee-2dbdcdbebd02 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:24.912702 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d565f56e-1b1e-4756-88ee-2dbdcdbebd02 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:24.913333 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d565f56e-1b1e-4756-88ee-2dbdcdbebd02 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:24.918641 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:24.974499 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7855d8f7-81d8-4cae-b200-36cd87c2bb84 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:25.003574 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7855d8f7-81d8-4cae-b200-36cd87c2bb84 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931" status: 200 len: 1508 microversion: 2.1 time: 0.780297 Jul 18 02:33:25.004633 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1775/3550] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:24 2022] GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931 => generated 1508 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:25.018141 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-b5c0b852-28b1-486e-b3d6-9b2d493a8a02 req-7c8cfa5c-ab46-47e8-aa08-c897dfddc805 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11b342d8-ebdd-4072-a6ec-d6bc21761582", "name": "network-vif-plugged", "status": "completed", "tag": "02142832-94da-4d1d-85a0-b0a50bbcf698"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:25.046819 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-b5c0b852-28b1-486e-b3d6-9b2d493a8a02 req-7c8cfa5c-ab46-47e8-aa08-c897dfddc805 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:25.047562 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-b5c0b852-28b1-486e-b3d6-9b2d493a8a02 req-7c8cfa5c-ab46-47e8-aa08-c897dfddc805 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:25.075744 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-b5c0b852-28b1-486e-b3d6-9b2d493a8a02 req-7c8cfa5c-ab46-47e8-aa08-c897dfddc805 service nova] Creating event network-vif-plugged:02142832-94da-4d1d-85a0-b0a50bbcf698 for instance 11b342d8-ebdd-4072-a6ec-d6bc21761582 on n-h2-465891-3 Jul 18 02:33:25.083344 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-b5c0b852-28b1-486e-b3d6-9b2d493a8a02 req-7c8cfa5c-ab46-47e8-aa08-c897dfddc805 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075924 Jul 18 02:33:25.084795 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1776/3551] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:25.606106 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d565f56e-1b1e-4756-88ee-2dbdcdbebd02 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2374fa8610714b72b6034726ee1c2373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe99772712849608ba124613bb5cc26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:25.643926 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d565f56e-1b1e-4756-88ee-2dbdcdbebd02 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9" status: 200 len: 1648 microversion: 2.1 time: 0.775235 Jul 18 02:33:25.662928 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1776/3552] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:24 2022] GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 => generated 1648 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:25.885312 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-828ab0fc-4949-4dae-a483-754718e7f692 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:25.886894 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-828ab0fc-4949-4dae-a483-754718e7f692 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 11b342d8-ebdd-4072-a6ec-d6bc21761582] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:25.950358 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-828ab0fc-4949-4dae-a483-754718e7f692 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:25.951513 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-828ab0fc-4949-4dae-a483-754718e7f692 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:25.956530 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-828ab0fc-4949-4dae-a483-754718e7f692 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:25.963058 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-828ab0fc-4949-4dae-a483-754718e7f692 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:26.034312 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1695aa43-fc23-434a-bf8b-4180cc8c9ecd tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:26.035100 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1695aa43-fc23-434a-bf8b-4180cc8c9ecd tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: 02425120-f4dc-4f02-99c5-9bf0fe7e1931] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:26.085357 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1695aa43-fc23-434a-bf8b-4180cc8c9ecd tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:26.088537 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1695aa43-fc23-434a-bf8b-4180cc8c9ecd tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:26.094302 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1695aa43-fc23-434a-bf8b-4180cc8c9ecd tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:26.101155 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1695aa43-fc23-434a-bf8b-4180cc8c9ecd tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:26.935156 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1695aa43-fc23-434a-bf8b-4180cc8c9ecd tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:26.944633 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1695aa43-fc23-434a-bf8b-4180cc8c9ecd tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931" status: 200 len: 1516 microversion: 2.1 time: 0.915313 Jul 18 02:33:26.954803 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1777/3553] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:26 2022] GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931 => generated 1516 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:26.960962 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-e6cd67c9-c625-4077-8c8c-a30d5995a5ba req-0a324451-46d1-4e38-be89-78ad6fecd911 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9", "name": "network-vif-deleted", "tag": "6f939eb0-ce87-4bf6-aa4f-2e850201052a"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:26.991442 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:27.024436 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-e6cd67c9-c625-4077-8c8c-a30d5995a5ba req-0a324451-46d1-4e38-be89-78ad6fecd911 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:27.025001 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-e6cd67c9-c625-4077-8c8c-a30d5995a5ba req-0a324451-46d1-4e38-be89-78ad6fecd911 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:27.060862 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-828ab0fc-4949-4dae-a483-754718e7f692 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:27.070746 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-828ab0fc-4949-4dae-a483-754718e7f692 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582" status: 200 len: 1334 microversion: 2.1 time: 1.193444 Jul 18 02:33:27.072642 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1777/3554] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:25 2022] GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582 => generated 1334 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:33:27.075903 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-e6cd67c9-c625-4077-8c8c-a30d5995a5ba req-0a324451-46d1-4e38-be89-78ad6fecd911 service nova] Creating event network-vif-deleted:6f939eb0-ce87-4bf6-aa4f-2e850201052a for instance 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 on n-h2-465891-3 Jul 18 02:33:27.095038 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6b07aa8c-cce1-4242-aaef-02167971a731 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:27.095365 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-e6cd67c9-c625-4077-8c8c-a30d5995a5ba req-0a324451-46d1-4e38-be89-78ad6fecd911 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137076 Jul 18 02:33:27.095365 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1778/3555] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:27.095878 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6b07aa8c-cce1-4242-aaef-02167971a731 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:27.121372 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6b07aa8c-cce1-4242-aaef-02167971a731 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:27.121875 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6b07aa8c-cce1-4242-aaef-02167971a731 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:27.122693 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6b07aa8c-cce1-4242-aaef-02167971a731 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:27.123135 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6b07aa8c-cce1-4242-aaef-02167971a731 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:27.191601 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-6b07aa8c-cce1-4242-aaef-02167971a731 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] HTTP exception thrown: Instance 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 could not be found. Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6b07aa8c-cce1-4242-aaef-02167971a731 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Request method failure captured: Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 HTTP/1.1 Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MXdApAd8jCQLuDQ4GDVob3WlO5TGoerQppREc0ccYssaOHle4VdpCa3zbolI9kA3vBsm6toj834_HQ72z_BEBH3fK1DoWoIDaDTMEsKRnNxFFmWRX0hetMPDmWg_gNY33hhTytVVTi3zUdfIo_ja5VJys5KWb2G5Exx3CV-M4e89mI Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: afe99772712849608ba124613bb5cc26 Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_afe99772712849608ba124613bb5cc26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/afe99772712849608ba124613bb5cc26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/afe99772712849608ba124613bb5cc26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/afe99772712849608ba124613bb5cc26"}]}] Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: afe99772712849608ba124613bb5cc26 Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-SecurityGroupsTestJSON-235723186-project Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 2374fa8610714b72b6034726ee1c2373 Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-SecurityGroupsTestJSON-235723186-project Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 could not be found. Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9'} Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 could not be found. Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 could not be found. Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:27.191778 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:27.196733 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:27.196733 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:27.196733 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:27.196733 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:33:27.196733 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:33:27.196733 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 could not be found. Jul 18 02:33:27.196733 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:27.196733 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6b07aa8c-cce1-4242-aaef-02167971a731 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Returning 404 to user: Instance 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:33:27.198316 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-655d867d-b1bd-40f1-995e-cdefdd5b3b07 req-0f71b1f6-8111-4abb-8337-5cc3005377a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11b342d8-ebdd-4072-a6ec-d6bc21761582", "name": "network-vif-plugged", "status": "completed", "tag": "4a17857b-b706-4a20-9efd-43851f356de5"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:27.206131 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6b07aa8c-cce1-4242-aaef-02167971a731 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9" status: 404 len: 111 microversion: 2.1 time: 0.129628 Jul 18 02:33:27.213634 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1778/3556] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:27 2022] GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:33:27.225159 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-655d867d-b1bd-40f1-995e-cdefdd5b3b07 req-0f71b1f6-8111-4abb-8337-5cc3005377a1 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:27.225393 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-884cf361-fb13-48a5-8942-f05fdf2e7a2d tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '.version_select at 0x7ff49b8ac670>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:27.225862 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-655d867d-b1bd-40f1-995e-cdefdd5b3b07 req-0f71b1f6-8111-4abb-8337-5cc3005377a1 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:27.249639 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-655d867d-b1bd-40f1-995e-cdefdd5b3b07 req-0f71b1f6-8111-4abb-8337-5cc3005377a1 service nova] Creating event network-vif-plugged:4a17857b-b706-4a20-9efd-43851f356de5 for instance 11b342d8-ebdd-4072-a6ec-d6bc21761582 on n-h2-465891-3 Jul 18 02:33:27.265324 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-655d867d-b1bd-40f1-995e-cdefdd5b3b07 req-0f71b1f6-8111-4abb-8337-5cc3005377a1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077639 Jul 18 02:33:27.266665 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1779/3557] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:28.476528 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-884cf361-fb13-48a5-8942-f05fdf2e7a2d tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/52bbb4d7-3b5d-4a3b-8314-181610297d5b" status: 202 len: 0 microversion: 2.1 time: 1.260210 Jul 18 02:33:28.479352 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1779/3558] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 02:33:27 2022] DELETE /compute/v2.1/os-security-groups/52bbb4d7-3b5d-4a3b-8314-181610297d5b => generated 0 bytes in 1264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:33:28.513108 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d7c67d6e-cbce-451b-a63e-4c7c0967cafe tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:28.514495 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d7c67d6e-cbce-451b-a63e-4c7c0967cafe tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 11b342d8-ebdd-4072-a6ec-d6bc21761582] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:28.569412 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d7c67d6e-cbce-451b-a63e-4c7c0967cafe tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:28.570930 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d7c67d6e-cbce-451b-a63e-4c7c0967cafe tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:28.574900 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d7c67d6e-cbce-451b-a63e-4c7c0967cafe tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:28.589542 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d7c67d6e-cbce-451b-a63e-4c7c0967cafe tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:28.819905 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5c67c799-97b7-4b67-9fa9-a44d3de960cb tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-914472265", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": "none"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:28.992014 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-5c67c799-97b7-4b67-9fa9-a44d3de960cb tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:33:28.993061 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-5c67c799-97b7-4b67-9fa9-a44d3de960cb tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:33:28.994148 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-5c67c799-97b7-4b67-9fa9-a44d3de960cb tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:33:28.995104 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-5c67c799-97b7-4b67-9fa9-a44d3de960cb tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:33:28.996074 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-5c67c799-97b7-4b67-9fa9-a44d3de960cb tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:33:29.015812 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5c67c799-97b7-4b67-9fa9-a44d3de960cb tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:29.016873 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5c67c799-97b7-4b67-9fa9-a44d3de960cb tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:29.019591 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5c67c799-97b7-4b67-9fa9-a44d3de960cb tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:29.020614 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5c67c799-97b7-4b67-9fa9-a44d3de960cb tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:29.089325 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-5c67c799-97b7-4b67-9fa9-a44d3de960cb tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Getting quotas for project c157f0d5a90443128bbac95ebf44f217. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:33:29.102487 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-5c67c799-97b7-4b67-9fa9-a44d3de960cb tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Getting quotas for user 85e323992800458ab12cfa024ff40c64 and project c157f0d5a90443128bbac95ebf44f217. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:33:29.132753 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5c67c799-97b7-4b67-9fa9-a44d3de960cb tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:33:29.138389 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5c67c799-97b7-4b67-9fa9-a44d3de960cb tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 545d6340-7e49-4e8b-99e9-d7755448005b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:33:29.281005 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5c67c799-97b7-4b67-9fa9-a44d3de960cb tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 1.296553 Jul 18 02:33:29.299479 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1780/3559] 10.222.0.57 () {62 vars in 1187 bytes} [Mon Jul 18 02:33:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1310 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 02:33:29.320431 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4b9f0e50-4cf0-40d9-9a31-e068419de553 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '.version_select at 0x7ff49b7b1a60>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:30.242400 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d7c67d6e-cbce-451b-a63e-4c7c0967cafe tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:30.256999 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d7c67d6e-cbce-451b-a63e-4c7c0967cafe tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582" status: 200 len: 1334 microversion: 2.1 time: 1.775535 Jul 18 02:33:30.260069 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1780/3560] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:28 2022] GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582 => generated 1334 bytes in 1780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:30.276534 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9b41ed27-1afc-4ea9-a4b4-b705390ab31d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:30.277456 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9b41ed27-1afc-4ea9-a4b4-b705390ab31d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 545d6340-7e49-4e8b-99e9-d7755448005b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:30.614122 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9b41ed27-1afc-4ea9-a4b4-b705390ab31d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:30.627156 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9b41ed27-1afc-4ea9-a4b4-b705390ab31d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:30.635773 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9b41ed27-1afc-4ea9-a4b4-b705390ab31d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:30.641507 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9b41ed27-1afc-4ea9-a4b4-b705390ab31d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "GET /compute/v2.1/servers/545d6340-7e49-4e8b-99e9-d7755448005b" status: 200 len: 1277 microversion: 2.47 time: 0.377179 Jul 18 02:33:30.669280 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1781/3561] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:33:30 2022] GET /compute/v2.1/servers/545d6340-7e49-4e8b-99e9-d7755448005b => generated 1277 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:33:31.027525 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6bc8f590-4280-4fa4-93ee-ff2ab2915b73 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1827056342", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": "none"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:31.194967 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4b9f0e50-4cf0-40d9-9a31-e068419de553 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/0d20e90f-2bee-46d1-b824-5a234ee45c27" status: 202 len: 0 microversion: 2.1 time: 1.898025 Jul 18 02:33:31.196491 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1781/3562] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 02:33:29 2022] DELETE /compute/v2.1/os-security-groups/0d20e90f-2bee-46d1-b824-5a234ee45c27 => generated 0 bytes in 1900 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:33:31.215522 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-16a74e8e-6017-47d2-a172-78e8b4da72b6 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Action: 'create', calling method: .version_select at 0x7ff49b7a90d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1099232015", "description": "tempest-description-1415308237"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:31.248883 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-6bc8f590-4280-4fa4-93ee-ff2ab2915b73 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:33:31.249730 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-6bc8f590-4280-4fa4-93ee-ff2ab2915b73 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:33:31.249918 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-6bc8f590-4280-4fa4-93ee-ff2ab2915b73 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:33:31.250404 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-6bc8f590-4280-4fa4-93ee-ff2ab2915b73 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:33:31.250830 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-6bc8f590-4280-4fa4-93ee-ff2ab2915b73 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:33:31.309039 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6bc8f590-4280-4fa4-93ee-ff2ab2915b73 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:31.310722 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6bc8f590-4280-4fa4-93ee-ff2ab2915b73 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:31.312682 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6bc8f590-4280-4fa4-93ee-ff2ab2915b73 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:31.320626 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6bc8f590-4280-4fa4-93ee-ff2ab2915b73 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:31.415865 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-6bc8f590-4280-4fa4-93ee-ff2ab2915b73 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Getting quotas for project c157f0d5a90443128bbac95ebf44f217. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:33:31.438410 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-6bc8f590-4280-4fa4-93ee-ff2ab2915b73 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Getting quotas for user 85e323992800458ab12cfa024ff40c64 and project c157f0d5a90443128bbac95ebf44f217. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:33:31.484790 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6bc8f590-4280-4fa4-93ee-ff2ab2915b73 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:33:31.492005 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6bc8f590-4280-4fa4-93ee-ff2ab2915b73 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 15dfd562-5a76-41af-937e-41e44c96b4c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:33:31.710413 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6bc8f590-4280-4fa4-93ee-ff2ab2915b73 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.687041 Jul 18 02:33:31.711569 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1782/3563] 10.222.0.57 () {62 vars in 1187 bytes} [Mon Jul 18 02:33:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 02:33:31.746580 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-50b82ef3-9664-45c7-93f9-31b9a26f4c82 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:31.749079 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-50b82ef3-9664-45c7-93f9-31b9a26f4c82 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: 02425120-f4dc-4f02-99c5-9bf0fe7e1931] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:31.764134 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-50b82ef3-9664-45c7-93f9-31b9a26f4c82 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:31.764616 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-50b82ef3-9664-45c7-93f9-31b9a26f4c82 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:31.765408 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-50b82ef3-9664-45c7-93f9-31b9a26f4c82 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:31.771772 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-50b82ef3-9664-45c7-93f9-31b9a26f4c82 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:31.862869 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-50b82ef3-9664-45c7-93f9-31b9a26f4c82 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lazy-loading 'flavor' on Instance uuid 02425120-f4dc-4f02-99c5-9bf0fe7e1931 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:33:32.139367 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-50b82ef3-9664-45c7-93f9-31b9a26f4c82 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "POST /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931/action" status: 200 len: 32 microversion: 2.1 time: 0.423263 Jul 18 02:33:32.166316 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1783/3564] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:33:31 2022] POST /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931/action => generated 32 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:33:32.173801 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-68f31a88-d371-4b0f-a13e-de80ebaef453 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:32.175270 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-68f31a88-d371-4b0f-a13e-de80ebaef453 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 11b342d8-ebdd-4072-a6ec-d6bc21761582] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:32.201678 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-68f31a88-d371-4b0f-a13e-de80ebaef453 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:32.202383 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-68f31a88-d371-4b0f-a13e-de80ebaef453 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:32.203540 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-68f31a88-d371-4b0f-a13e-de80ebaef453 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:32.204137 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-68f31a88-d371-4b0f-a13e-de80ebaef453 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:33.114867 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-68f31a88-d371-4b0f-a13e-de80ebaef453 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:33.132444 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-68f31a88-d371-4b0f-a13e-de80ebaef453 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582" status: 200 len: 1669 microversion: 2.1 time: 0.963881 Jul 18 02:33:33.135832 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1784/3565] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:32 2022] GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582 => generated 1669 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:33.151838 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b89408a0-269a-4f31-8c02-263b46a027e1 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:33.155528 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b89408a0-269a-4f31-8c02-263b46a027e1 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 15dfd562-5a76-41af-937e-41e44c96b4c1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:33.174520 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b89408a0-269a-4f31-8c02-263b46a027e1 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:33.175389 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b89408a0-269a-4f31-8c02-263b46a027e1 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:33.178178 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b89408a0-269a-4f31-8c02-263b46a027e1 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:33.178924 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b89408a0-269a-4f31-8c02-263b46a027e1 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:33.278219 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-16a74e8e-6017-47d2-a172-78e8b4da72b6 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 2.073139 Jul 18 02:33:33.284855 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1782/3566] 10.222.0.57 () {60 vars in 1179 bytes} [Mon Jul 18 02:33:31 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 2075 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:33.284855 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6b6b97dc-792e-44af-a55c-659ebaa89b7d tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:33.284855 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6b6b97dc-792e-44af-a55c-659ebaa89b7d tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: 02425120-f4dc-4f02-99c5-9bf0fe7e1931] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:33.296383 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b89408a0-269a-4f31-8c02-263b46a027e1 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "PUT /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1" status: 200 len: 1048 microversion: 2.47 time: 0.157011 Jul 18 02:33:33.305280 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b6b97dc-792e-44af-a55c-659ebaa89b7d tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:33.306179 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b6b97dc-792e-44af-a55c-659ebaa89b7d tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:33.307270 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b6b97dc-792e-44af-a55c-659ebaa89b7d tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:33.307956 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b6b97dc-792e-44af-a55c-659ebaa89b7d tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:33.310488 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1785/3567] 10.222.0.57 () {62 vars in 1296 bytes} [Mon Jul 18 02:33:33 2022] PUT /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1 => generated 1048 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:33:33.325524 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2cf88e8c-e9d7-43d7-aebd-55b32f76fe9b tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:33.327723 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2cf88e8c-e9d7-43d7-aebd-55b32f76fe9b tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 11b342d8-ebdd-4072-a6ec-d6bc21761582] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:33.347937 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2cf88e8c-e9d7-43d7-aebd-55b32f76fe9b tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:33.348420 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2cf88e8c-e9d7-43d7-aebd-55b32f76fe9b tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:33.349271 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2cf88e8c-e9d7-43d7-aebd-55b32f76fe9b tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:33.349738 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2cf88e8c-e9d7-43d7-aebd-55b32f76fe9b tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:33.420555 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2cf88e8c-e9d7-43d7-aebd-55b32f76fe9b tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582/ips" status: 200 len: 179 microversion: 2.1 time: 0.106204 Jul 18 02:33:33.429140 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1786/3568] 10.222.0.57 () {58 vars in 1247 bytes} [Mon Jul 18 02:33:33 2022] GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582/ips => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:33.436892 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4f3535ef-e5bb-4f3f-964a-d43228de8d5a tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Action: 'update', calling method: .version_select at 0x7ff49b7048b0>, body: {"security_group": {"name": "tempest-sg-hth-2013088151", "description": "tempest-description-hth-1697527493"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:33.931917 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6b6b97dc-792e-44af-a55c-659ebaa89b7d tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:33.946805 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6b6b97dc-792e-44af-a55c-659ebaa89b7d tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931" status: 200 len: 1522 microversion: 2.1 time: 0.666317 Jul 18 02:33:33.948147 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1783/3569] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:33 2022] GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931 => generated 1522 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:33.970301 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ba44c904-7ce9-4e53-a86d-ae68539d7e1a tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:33.972418 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ba44c904-7ce9-4e53-a86d-ae68539d7e1a tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 15dfd562-5a76-41af-937e-41e44c96b4c1] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:33.998547 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba44c904-7ce9-4e53-a86d-ae68539d7e1a tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:34.003358 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba44c904-7ce9-4e53-a86d-ae68539d7e1a tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:34.004767 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba44c904-7ce9-4e53-a86d-ae68539d7e1a tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:34.006708 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba44c904-7ce9-4e53-a86d-ae68539d7e1a tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:34.291297 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4f3535ef-e5bb-4f3f-964a-d43228de8d5a tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "PUT /compute/v2.1/os-security-groups/3a0d0aca-5f6d-4f02-9f67-90a01af12b1c" status: 200 len: 218 microversion: 2.1 time: 0.859984 Jul 18 02:33:34.293762 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1787/3570] 10.222.0.57 () {60 vars in 1289 bytes} [Mon Jul 18 02:33:33 2022] PUT /compute/v2.1/os-security-groups/3a0d0aca-5f6d-4f02-9f67-90a01af12b1c => generated 218 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:34.317458 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ae08939d-2ffe-43e7-9d84-e4f11c60d23f tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:34.319776 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ae08939d-2ffe-43e7-9d84-e4f11c60d23f tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 11b342d8-ebdd-4072-a6ec-d6bc21761582] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:34.347028 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ae08939d-2ffe-43e7-9d84-e4f11c60d23f tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:34.347942 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ae08939d-2ffe-43e7-9d84-e4f11c60d23f tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:34.350586 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ae08939d-2ffe-43e7-9d84-e4f11c60d23f tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:34.355235 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ae08939d-2ffe-43e7-9d84-e4f11c60d23f tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:34.417460 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ba44c904-7ce9-4e53-a86d-ae68539d7e1a tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:34.430946 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ae08939d-2ffe-43e7-9d84-e4f11c60d23f tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 11b342d8-ebdd-4072-a6ec-d6bc21761582] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:33:34.435152 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ba44c904-7ce9-4e53-a86d-ae68539d7e1a tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:34.436900 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ba44c904-7ce9-4e53-a86d-ae68539d7e1a tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:34.443090 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ba44c904-7ce9-4e53-a86d-ae68539d7e1a tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1" status: 200 len: 1338 microversion: 2.47 time: 0.485877 Jul 18 02:33:34.446696 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1784/3571] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:33:33 2022] GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1 => generated 1338 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:33:34.465855 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-af83f52a-a7ff-47e1-99e5-28ca26d41913 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '.version_select at 0x7ff49b77c820>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:34.662218 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-af83f52a-a7ff-47e1-99e5-28ca26d41913 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/os-security-groups/3a0d0aca-5f6d-4f02-9f67-90a01af12b1c" status: 200 len: 218 microversion: 2.1 time: 0.213434 Jul 18 02:33:34.664057 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1785/3572] 10.222.0.57 () {58 vars in 1268 bytes} [Mon Jul 18 02:33:34 2022] GET /compute/v2.1/os-security-groups/3a0d0aca-5f6d-4f02-9f67-90a01af12b1c => generated 218 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:34.682966 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-67300c90-7dc2-4428-b1f1-0a61de79cfaa tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '.version_select at 0x7ff49b77cd30>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:34.808407 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ae08939d-2ffe-43e7-9d84-e4f11c60d23f tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "DELETE /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582" status: 204 len: 0 microversion: 2.1 time: 0.512169 Jul 18 02:33:34.811467 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1788/3573] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:33:34 2022] DELETE /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:33:34.839795 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7dbbd50c-cb8a-467c-b48f-e1e84b391e18 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:34.847258 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7dbbd50c-cb8a-467c-b48f-e1e84b391e18 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 11b342d8-ebdd-4072-a6ec-d6bc21761582] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:34.876485 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7dbbd50c-cb8a-467c-b48f-e1e84b391e18 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:34.878462 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7dbbd50c-cb8a-467c-b48f-e1e84b391e18 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:34.880293 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7dbbd50c-cb8a-467c-b48f-e1e84b391e18 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:34.881200 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7dbbd50c-cb8a-467c-b48f-e1e84b391e18 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:36.012187 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7dbbd50c-cb8a-467c-b48f-e1e84b391e18 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:36.043142 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7dbbd50c-cb8a-467c-b48f-e1e84b391e18 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582" status: 200 len: 1675 microversion: 2.1 time: 1.225841 Jul 18 02:33:36.065122 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1789/3574] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:34 2022] GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582 => generated 1675 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:36.096653 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-67300c90-7dc2-4428-b1f1-0a61de79cfaa tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/3a0d0aca-5f6d-4f02-9f67-90a01af12b1c" status: 202 len: 0 microversion: 2.1 time: 1.422842 Jul 18 02:33:36.097732 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1786/3575] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 02:33:34 2022] DELETE /compute/v2.1/os-security-groups/3a0d0aca-5f6d-4f02-9f67-90a01af12b1c => generated 0 bytes in 1425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:33:36.103885 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-58158272-45b7-4d32-bf40-dac630c9d99b tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:36.105622 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-58158272-45b7-4d32-bf40-dac630c9d99b tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 15dfd562-5a76-41af-937e-41e44c96b4c1] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:36.106174 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2bbd272a-2fc2-4dfd-be2b-d5fcea0ed2a0 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:36.107718 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2bbd272a-2fc2-4dfd-be2b-d5fcea0ed2a0 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: 02425120-f4dc-4f02-99c5-9bf0fe7e1931] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:36.174927 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-58158272-45b7-4d32-bf40-dac630c9d99b tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:36.177762 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-58158272-45b7-4d32-bf40-dac630c9d99b tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:36.181762 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-58158272-45b7-4d32-bf40-dac630c9d99b tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:36.185235 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-58158272-45b7-4d32-bf40-dac630c9d99b tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:36.209402 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2bbd272a-2fc2-4dfd-be2b-d5fcea0ed2a0 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:36.212258 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2bbd272a-2fc2-4dfd-be2b-d5fcea0ed2a0 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:36.215863 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2bbd272a-2fc2-4dfd-be2b-d5fcea0ed2a0 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:36.217612 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2bbd272a-2fc2-4dfd-be2b-d5fcea0ed2a0 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:36.292911 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:36.827528 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-58158272-45b7-4d32-bf40-dac630c9d99b tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:36.856453 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-58158272-45b7-4d32-bf40-dac630c9d99b tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:36.872416 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-58158272-45b7-4d32-bf40-dac630c9d99b tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:36.873654 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-58158272-45b7-4d32-bf40-dac630c9d99b tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1" status: 200 len: 1336 microversion: 2.47 time: 0.774849 Jul 18 02:33:36.875941 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1787/3576] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:33:36 2022] GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1 => generated 1336 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:33:36.906095 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d65f6e85-1e01-451b-a0e0-ebc78c2b1be4 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:36.906793 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d65f6e85-1e01-451b-a0e0-ebc78c2b1be4 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:36.917645 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d65f6e85-1e01-451b-a0e0-ebc78c2b1be4 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:36.919035 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d65f6e85-1e01-451b-a0e0-ebc78c2b1be4 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:36.921054 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d65f6e85-1e01-451b-a0e0-ebc78c2b1be4 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:36.921604 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d65f6e85-1e01-451b-a0e0-ebc78c2b1be4 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:36.979019 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-d65f6e85-1e01-451b-a0e0-ebc78c2b1be4 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] HTTP exception thrown: Instance 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 could not be found. Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d65f6e85-1e01-451b-a0e0-ebc78c2b1be4 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Request method failure captured: Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 HTTP/1.1 Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MXdApAd8jCQLuDQ4GDVob3WlO5TGoerQppREc0ccYssaOHle4VdpCa3zbolI9kA3vBsm6toj834_HQ72z_BEBH3fK1DoWoIDaDTMEsKRnNxFFmWRX0hetMPDmWg_gNY33hhTytVVTi3zUdfIo_ja5VJys5KWb2G5Exx3CV-M4e89mI Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: afe99772712849608ba124613bb5cc26 Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_afe99772712849608ba124613bb5cc26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/afe99772712849608ba124613bb5cc26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/afe99772712849608ba124613bb5cc26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/afe99772712849608ba124613bb5cc26"}]}] Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: afe99772712849608ba124613bb5cc26 Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-SecurityGroupsTestJSON-235723186-project Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 2374fa8610714b72b6034726ee1c2373 Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-SecurityGroupsTestJSON-235723186-project Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 could not be found. Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9'} Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 could not be found. Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:33:36.985736 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:33:36.990717 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 could not be found. Jul 18 02:33:36.990717 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:36.990717 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:36.990717 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:36.990717 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:36.990717 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:36.990717 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:36.990717 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:33:36.990717 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:33:36.990717 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 could not be found. Jul 18 02:33:36.990717 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:36.990717 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d65f6e85-1e01-451b-a0e0-ebc78c2b1be4 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Returning 404 to user: Instance 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:33:36.992544 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d65f6e85-1e01-451b-a0e0-ebc78c2b1be4 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9" status: 404 len: 111 microversion: 2.1 time: 0.108756 Jul 18 02:33:36.993796 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1788/3577] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:33:36 2022] DELETE /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:33:37.008271 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-28f4d0c9-c204-47fc-8f15-aaa13059d118 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:37.009300 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-28f4d0c9-c204-47fc-8f15-aaa13059d118 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:37.032079 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-28f4d0c9-c204-47fc-8f15-aaa13059d118 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:37.032785 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-28f4d0c9-c204-47fc-8f15-aaa13059d118 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:37.035441 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-28f4d0c9-c204-47fc-8f15-aaa13059d118 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:37.037270 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-28f4d0c9-c204-47fc-8f15-aaa13059d118 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:37.085796 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-28f4d0c9-c204-47fc-8f15-aaa13059d118 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] HTTP exception thrown: Instance 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 could not be found. Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-28f4d0c9-c204-47fc-8f15-aaa13059d118 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Request method failure captured: Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 HTTP/1.1 Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MXdApAd8jCQLuDQ4GDVob3WlO5TGoerQppREc0ccYssaOHle4VdpCa3zbolI9kA3vBsm6toj834_HQ72z_BEBH3fK1DoWoIDaDTMEsKRnNxFFmWRX0hetMPDmWg_gNY33hhTytVVTi3zUdfIo_ja5VJys5KWb2G5Exx3CV-M4e89mI Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: afe99772712849608ba124613bb5cc26 Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_afe99772712849608ba124613bb5cc26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/afe99772712849608ba124613bb5cc26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/afe99772712849608ba124613bb5cc26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/afe99772712849608ba124613bb5cc26"}]}] Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: afe99772712849608ba124613bb5cc26 Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-SecurityGroupsTestJSON-235723186-project Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 2374fa8610714b72b6034726ee1c2373 Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-SecurityGroupsTestJSON-235723186-project Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 could not be found. Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9'} Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 could not be found. Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 could not be found. Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:37.089955 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:37.094350 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:37.094350 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:37.094350 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:37.094350 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:33:37.094350 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:33:37.094350 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 could not be found. Jul 18 02:33:37.094350 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:37.102956 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-28f4d0c9-c204-47fc-8f15-aaa13059d118 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Returning 404 to user: Instance 4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:33:37.107004 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-28f4d0c9-c204-47fc-8f15-aaa13059d118 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9" status: 404 len: 111 microversion: 2.1 time: 0.106298 Jul 18 02:33:37.111762 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1789/3578] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:36 2022] GET /compute/v2.1/servers/4d1bf919-0bf8-41ca-a45d-b294bb6c1ab9 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:33:37.121444 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cd6558c6-f499-4e79-9a30-19ee6c1eefc8 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:37.122539 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cd6558c6-f499-4e79-9a30-19ee6c1eefc8 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 11b342d8-ebdd-4072-a6ec-d6bc21761582] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:37.134104 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cd6558c6-f499-4e79-9a30-19ee6c1eefc8 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:37.134778 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cd6558c6-f499-4e79-9a30-19ee6c1eefc8 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:37.135890 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cd6558c6-f499-4e79-9a30-19ee6c1eefc8 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:37.137059 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cd6558c6-f499-4e79-9a30-19ee6c1eefc8 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:37.344679 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2bbd272a-2fc2-4dfd-be2b-d5fcea0ed2a0 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:37.360147 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2bbd272a-2fc2-4dfd-be2b-d5fcea0ed2a0 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931" status: 200 len: 1522 microversion: 2.1 time: 1.290141 Jul 18 02:33:37.360779 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1790/3579] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:36 2022] GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931 => generated 1522 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:37.388794 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d2f0e7d8-5987-45c7-823b-08918b4e302d tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '.version_select at 0x7ff49b8ac040>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:37.871106 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-cd6558c6-f499-4e79-9a30-19ee6c1eefc8 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:37.880196 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cd6558c6-f499-4e79-9a30-19ee6c1eefc8 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582" status: 200 len: 1675 microversion: 2.1 time: 0.766038 Jul 18 02:33:37.889081 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1790/3580] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:37 2022] GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582 => generated 1675 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:37.907344 n-d-465891-3 devstack@n-api.service[119543]: DEBUG neutronclient.v2_0.client [None req-d2f0e7d8-5987-45c7-823b-08918b4e302d tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0d20e90f-2bee-46d1-b824-5a234ee45c27 does not exist", "detail": ""}} {{(pid=119543) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:33:37.908248 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.security_group_api [None req-d2f0e7d8-5987-45c7-823b-08918b4e302d tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Neutron security group 0d20e90f-2bee-46d1-b824-5a234ee45c27 not found {{(pid=119543) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 02:33:37.908823 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0106c7ab-b27d-4434-9cbf-7adbbaccbb2e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:37.908966 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-d2f0e7d8-5987-45c7-823b-08918b4e302d tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] HTTP exception thrown: Security group 0d20e90f-2bee-46d1-b824-5a234ee45c27 does not exist Jul 18 02:33:37.908966 n-d-465891-3 devstack@n-api.service[119543]: Neutron server returns request_ids: ['req-1e8cd10d-7614-424a-b106-146ca4d3ed56'] Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d2f0e7d8-5987-45c7-823b-08918b4e302d tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Request method failure captured: Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/os-security-groups/0d20e90f-2bee-46d1-b824-5a234ee45c27 HTTP/1.1 Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MXdApAd8jCQLuDQ4GDVob3WlO5TGoerQppREc0ccYssaOHle4VdpCa3zbolI9kA3vBsm6toj834_HQ72z_BEBH3fK1DoWoIDaDTMEsKRnNxFFmWRX0hetMPDmWg_gNY33hhTytVVTi3zUdfIo_ja5VJys5KWb2G5Exx3CV-M4e89mI Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: afe99772712849608ba124613bb5cc26 Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_afe99772712849608ba124613bb5cc26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/afe99772712849608ba124613bb5cc26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/afe99772712849608ba124613bb5cc26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/afe99772712849608ba124613bb5cc26"}]}] Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: afe99772712849608ba124613bb5cc26 Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-SecurityGroupsTestJSON-235723186-project Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 2374fa8610714b72b6034726ee1c2373 Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-SecurityGroupsTestJSON-235723186-project Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: exception: Security group 0d20e90f-2bee-46d1-b824-5a234ee45c27 does not exist Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: Neutron server returns request_ids: ['req-1e8cd10d-7614-424a-b106-146ca4d3ed56'] Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '0d20e90f-2bee-46d1-b824-5a234ee45c27'} Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:33:37.911152 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0d20e90f-2bee-46d1-b824-5a234ee45c27 does not exist Jul 18 02:33:37.915086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1e8cd10d-7614-424a-b106-146ca4d3ed56'] Jul 18 02:33:37.915086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:37.915086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:37.915086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:37.915086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:37.915086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 18 02:33:37.915086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 18 02:33:37.915086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 02:33:37.915086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 02:33:37.915086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0d20e90f-2bee-46d1-b824-5a234ee45c27 does not exist Jul 18 02:33:37.915086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1e8cd10d-7614-424a-b106-146ca4d3ed56'] Jul 18 02:33:37.915086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:37.915086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:37.915086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:37.915086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:37.915086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:37.915086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:37.915086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:33:37.915086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:33:37.915086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:33:37.915086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:33:37.915086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:33:37.915086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:33:37.915086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 18 02:33:37.915086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 02:33:37.915086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0d20e90f-2bee-46d1-b824-5a234ee45c27 does not exist Jul 18 02:33:37.915086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1e8cd10d-7614-424a-b106-146ca4d3ed56'] Jul 18 02:33:37.915086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:37.915086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:37.915086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:37.915086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:37.915086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:37.915086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:37.915086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:33:37.915086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:33:37.915086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0d20e90f-2bee-46d1-b824-5a234ee45c27 does not exist Jul 18 02:33:37.915086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1e8cd10d-7614-424a-b106-146ca4d3ed56'] Jul 18 02:33:37.915086 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:37.915086 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d2f0e7d8-5987-45c7-823b-08918b4e302d tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Returning 404 to user: Security group 0d20e90f-2bee-46d1-b824-5a234ee45c27 does not exist Jul 18 02:33:37.915086 n-d-465891-3 devstack@n-api.service[119543]: Neutron server returns request_ids: ['req-1e8cd10d-7614-424a-b106-146ca4d3ed56'] {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:33:37.915086 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d2f0e7d8-5987-45c7-823b-08918b4e302d tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/0d20e90f-2bee-46d1-b824-5a234ee45c27" status: 404 len: 194 microversion: 2.1 time: 0.547754 Jul 18 02:33:37.917290 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0106c7ab-b27d-4434-9cbf-7adbbaccbb2e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 15dfd562-5a76-41af-937e-41e44c96b4c1] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:37.917368 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1791/3581] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 02:33:37 2022] DELETE /compute/v2.1/os-security-groups/0d20e90f-2bee-46d1-b824-5a234ee45c27 => generated 194 bytes in 554 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:33:37.927689 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4520ba6c-c7cd-411d-ae90-e94117c4dd1c tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '.version_select at 0x7ff49b755d30>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:37.953994 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0106c7ab-b27d-4434-9cbf-7adbbaccbb2e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:37.955488 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0106c7ab-b27d-4434-9cbf-7adbbaccbb2e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:37.961663 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0106c7ab-b27d-4434-9cbf-7adbbaccbb2e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:37.962664 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0106c7ab-b27d-4434-9cbf-7adbbaccbb2e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:38.061989 n-d-465891-3 devstack@n-api.service[119543]: DEBUG neutronclient.v2_0.client [None req-4520ba6c-c7cd-411d-ae90-e94117c4dd1c tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 52bbb4d7-3b5d-4a3b-8314-181610297d5b does not exist", "detail": ""}} {{(pid=119543) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:33:38.062614 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.security_group_api [None req-4520ba6c-c7cd-411d-ae90-e94117c4dd1c tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Neutron security group 52bbb4d7-3b5d-4a3b-8314-181610297d5b not found {{(pid=119543) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 02:33:38.063398 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-4520ba6c-c7cd-411d-ae90-e94117c4dd1c tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] HTTP exception thrown: Security group 52bbb4d7-3b5d-4a3b-8314-181610297d5b does not exist Jul 18 02:33:38.063398 n-d-465891-3 devstack@n-api.service[119543]: Neutron server returns request_ids: ['req-b55c6ebb-b5c3-4ccf-b0f4-08aacc22017e'] Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4520ba6c-c7cd-411d-ae90-e94117c4dd1c tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Request method failure captured: Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/os-security-groups/52bbb4d7-3b5d-4a3b-8314-181610297d5b HTTP/1.1 Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MXdApAd8jCQLuDQ4GDVob3WlO5TGoerQppREc0ccYssaOHle4VdpCa3zbolI9kA3vBsm6toj834_HQ72z_BEBH3fK1DoWoIDaDTMEsKRnNxFFmWRX0hetMPDmWg_gNY33hhTytVVTi3zUdfIo_ja5VJys5KWb2G5Exx3CV-M4e89mI Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: afe99772712849608ba124613bb5cc26 Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_afe99772712849608ba124613bb5cc26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/afe99772712849608ba124613bb5cc26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/afe99772712849608ba124613bb5cc26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/afe99772712849608ba124613bb5cc26"}]}] Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: afe99772712849608ba124613bb5cc26 Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-SecurityGroupsTestJSON-235723186-project Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 2374fa8610714b72b6034726ee1c2373 Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-SecurityGroupsTestJSON-235723186-project Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: exception: Security group 52bbb4d7-3b5d-4a3b-8314-181610297d5b does not exist Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: Neutron server returns request_ids: ['req-b55c6ebb-b5c3-4ccf-b0f4-08aacc22017e'] Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '52bbb4d7-3b5d-4a3b-8314-181610297d5b'} Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:33:38.066803 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 52bbb4d7-3b5d-4a3b-8314-181610297d5b does not exist Jul 18 02:33:38.070256 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b55c6ebb-b5c3-4ccf-b0f4-08aacc22017e'] Jul 18 02:33:38.070256 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:38.070256 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:38.070256 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:38.070256 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:38.070256 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 18 02:33:38.070256 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 18 02:33:38.070256 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 02:33:38.070256 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 02:33:38.070256 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 52bbb4d7-3b5d-4a3b-8314-181610297d5b does not exist Jul 18 02:33:38.070256 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b55c6ebb-b5c3-4ccf-b0f4-08aacc22017e'] Jul 18 02:33:38.070256 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:38.070256 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:38.070256 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:38.070256 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:38.070256 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:38.070256 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:38.070256 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:33:38.070256 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:33:38.070256 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:33:38.070256 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:33:38.070256 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:33:38.070256 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:33:38.070256 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 18 02:33:38.070256 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 02:33:38.070256 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 52bbb4d7-3b5d-4a3b-8314-181610297d5b does not exist Jul 18 02:33:38.070256 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b55c6ebb-b5c3-4ccf-b0f4-08aacc22017e'] Jul 18 02:33:38.070256 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:38.070256 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:38.070256 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:38.070256 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:38.070256 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:38.070256 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:38.070256 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:33:38.070256 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:33:38.070256 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 52bbb4d7-3b5d-4a3b-8314-181610297d5b does not exist Jul 18 02:33:38.070256 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b55c6ebb-b5c3-4ccf-b0f4-08aacc22017e'] Jul 18 02:33:38.070256 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:38.070256 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4520ba6c-c7cd-411d-ae90-e94117c4dd1c tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Returning 404 to user: Security group 52bbb4d7-3b5d-4a3b-8314-181610297d5b does not exist Jul 18 02:33:38.070256 n-d-465891-3 devstack@n-api.service[119543]: Neutron server returns request_ids: ['req-b55c6ebb-b5c3-4ccf-b0f4-08aacc22017e'] {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:33:38.070256 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4520ba6c-c7cd-411d-ae90-e94117c4dd1c tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/52bbb4d7-3b5d-4a3b-8314-181610297d5b" status: 404 len: 194 microversion: 2.1 time: 0.150312 Jul 18 02:33:38.072536 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1792/3582] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 02:33:37 2022] DELETE /compute/v2.1/os-security-groups/52bbb4d7-3b5d-4a3b-8314-181610297d5b => generated 194 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:33:38.092319 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-75ec24af-c42d-42ef-8eb6-268eef1e9dd9 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '.version_select at 0x7ff49be260d0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:38.237592 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0106c7ab-b27d-4434-9cbf-7adbbaccbb2e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:38.254596 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0106c7ab-b27d-4434-9cbf-7adbbaccbb2e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:38.261296 n-d-465891-3 devstack@n-api.service[119543]: DEBUG neutronclient.v2_0.client [None req-75ec24af-c42d-42ef-8eb6-268eef1e9dd9 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 25b2e6af-ea8b-4fa1-9444-49780c70f287 does not exist", "detail": ""}} {{(pid=119543) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:33:38.262647 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.security_group_api [None req-75ec24af-c42d-42ef-8eb6-268eef1e9dd9 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Neutron security group 25b2e6af-ea8b-4fa1-9444-49780c70f287 not found {{(pid=119543) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 02:33:38.262935 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0106c7ab-b27d-4434-9cbf-7adbbaccbb2e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:38.263734 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-75ec24af-c42d-42ef-8eb6-268eef1e9dd9 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] HTTP exception thrown: Security group 25b2e6af-ea8b-4fa1-9444-49780c70f287 does not exist Jul 18 02:33:38.263734 n-d-465891-3 devstack@n-api.service[119543]: Neutron server returns request_ids: ['req-c14b3fa3-eaf4-4d6c-b131-d2e5e236ea01'] Jul 18 02:33:38.266251 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0106c7ab-b27d-4434-9cbf-7adbbaccbb2e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1" status: 200 len: 1336 microversion: 2.47 time: 0.363543 Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-75ec24af-c42d-42ef-8eb6-268eef1e9dd9 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Request method failure captured: Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/os-security-groups/25b2e6af-ea8b-4fa1-9444-49780c70f287 HTTP/1.1 Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MXdApAd8jCQLuDQ4GDVob3WlO5TGoerQppREc0ccYssaOHle4VdpCa3zbolI9kA3vBsm6toj834_HQ72z_BEBH3fK1DoWoIDaDTMEsKRnNxFFmWRX0hetMPDmWg_gNY33hhTytVVTi3zUdfIo_ja5VJys5KWb2G5Exx3CV-M4e89mI Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: afe99772712849608ba124613bb5cc26 Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_afe99772712849608ba124613bb5cc26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/afe99772712849608ba124613bb5cc26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/afe99772712849608ba124613bb5cc26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/afe99772712849608ba124613bb5cc26"}]}] Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: afe99772712849608ba124613bb5cc26 Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-SecurityGroupsTestJSON-235723186-project Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 2374fa8610714b72b6034726ee1c2373 Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-SecurityGroupsTestJSON-235723186-project Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: exception: Security group 25b2e6af-ea8b-4fa1-9444-49780c70f287 does not exist Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: Neutron server returns request_ids: ['req-c14b3fa3-eaf4-4d6c-b131-d2e5e236ea01'] Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '25b2e6af-ea8b-4fa1-9444-49780c70f287'} Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:33:38.268038 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 25b2e6af-ea8b-4fa1-9444-49780c70f287 does not exist Jul 18 02:33:38.271540 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c14b3fa3-eaf4-4d6c-b131-d2e5e236ea01'] Jul 18 02:33:38.271540 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:38.271540 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:38.271540 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:38.271540 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:38.271540 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 18 02:33:38.271540 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 18 02:33:38.271540 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 02:33:38.271540 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 02:33:38.271540 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 25b2e6af-ea8b-4fa1-9444-49780c70f287 does not exist Jul 18 02:33:38.271540 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c14b3fa3-eaf4-4d6c-b131-d2e5e236ea01'] Jul 18 02:33:38.271540 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:38.271540 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:38.271540 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:38.271540 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:38.271540 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:38.271540 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:38.271540 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:33:38.271540 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:33:38.271540 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:33:38.271540 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:33:38.271540 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:33:38.271540 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:33:38.271540 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 18 02:33:38.271540 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 02:33:38.271540 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 25b2e6af-ea8b-4fa1-9444-49780c70f287 does not exist Jul 18 02:33:38.271540 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c14b3fa3-eaf4-4d6c-b131-d2e5e236ea01'] Jul 18 02:33:38.271540 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:38.271540 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:38.271540 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:38.271540 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:38.271540 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:38.271540 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:38.271540 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:33:38.271540 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:33:38.271540 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 25b2e6af-ea8b-4fa1-9444-49780c70f287 does not exist Jul 18 02:33:38.271540 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c14b3fa3-eaf4-4d6c-b131-d2e5e236ea01'] Jul 18 02:33:38.271540 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:38.271540 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-75ec24af-c42d-42ef-8eb6-268eef1e9dd9 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Returning 404 to user: Security group 25b2e6af-ea8b-4fa1-9444-49780c70f287 does not exist Jul 18 02:33:38.271540 n-d-465891-3 devstack@n-api.service[119543]: Neutron server returns request_ids: ['req-c14b3fa3-eaf4-4d6c-b131-d2e5e236ea01'] {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:33:38.275038 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-75ec24af-c42d-42ef-8eb6-268eef1e9dd9 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/25b2e6af-ea8b-4fa1-9444-49780c70f287" status: 404 len: 194 microversion: 2.1 time: 0.200549 Jul 18 02:33:38.277725 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1791/3583] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:33:37 2022] GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1 => generated 1336 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:33:38.278879 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1793/3584] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 02:33:38 2022] DELETE /compute/v2.1/os-security-groups/25b2e6af-ea8b-4fa1-9444-49780c70f287 => generated 194 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:33:38.293221 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-389adb74-618e-4259-ada3-60b9b4ab03c1 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '.version_select at 0x7ff49b7a94c0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:38.389653 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8413a30e-a6f1-4891-9eaf-b440874efb7f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:38.391151 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8413a30e-a6f1-4891-9eaf-b440874efb7f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: 02425120-f4dc-4f02-99c5-9bf0fe7e1931] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:38.408410 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8413a30e-a6f1-4891-9eaf-b440874efb7f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:38.412806 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8413a30e-a6f1-4891-9eaf-b440874efb7f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:38.414134 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8413a30e-a6f1-4891-9eaf-b440874efb7f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:38.415594 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8413a30e-a6f1-4891-9eaf-b440874efb7f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:38.480432 n-d-465891-3 devstack@n-api.service[119544]: DEBUG neutronclient.v2_0.client [None req-389adb74-618e-4259-ada3-60b9b4ab03c1 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a5b55d47-d9be-4f21-b30f-1a09c659aaae does not exist", "detail": ""}} {{(pid=119544) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:33:38.484270 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.security_group_api [None req-389adb74-618e-4259-ada3-60b9b4ab03c1 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Neutron security group a5b55d47-d9be-4f21-b30f-1a09c659aaae not found {{(pid=119544) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 02:33:38.484920 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-389adb74-618e-4259-ada3-60b9b4ab03c1 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] HTTP exception thrown: Security group a5b55d47-d9be-4f21-b30f-1a09c659aaae does not exist Jul 18 02:33:38.484920 n-d-465891-3 devstack@n-api.service[119544]: Neutron server returns request_ids: ['req-ce4fea32-d2f0-4442-b412-1ceb161c1c45'] Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-389adb74-618e-4259-ada3-60b9b4ab03c1 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Request method failure captured: Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/os-security-groups/a5b55d47-d9be-4f21-b30f-1a09c659aaae HTTP/1.1 Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MXdApAd8jCQLuDQ4GDVob3WlO5TGoerQppREc0ccYssaOHle4VdpCa3zbolI9kA3vBsm6toj834_HQ72z_BEBH3fK1DoWoIDaDTMEsKRnNxFFmWRX0hetMPDmWg_gNY33hhTytVVTi3zUdfIo_ja5VJys5KWb2G5Exx3CV-M4e89mI Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: afe99772712849608ba124613bb5cc26 Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_afe99772712849608ba124613bb5cc26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/afe99772712849608ba124613bb5cc26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/afe99772712849608ba124613bb5cc26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/afe99772712849608ba124613bb5cc26"}]}] Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: afe99772712849608ba124613bb5cc26 Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-SecurityGroupsTestJSON-235723186-project Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 2374fa8610714b72b6034726ee1c2373 Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-SecurityGroupsTestJSON-235723186-project Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: exception: Security group a5b55d47-d9be-4f21-b30f-1a09c659aaae does not exist Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: Neutron server returns request_ids: ['req-ce4fea32-d2f0-4442-b412-1ceb161c1c45'] Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'a5b55d47-d9be-4f21-b30f-1a09c659aaae'} Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:33:38.487236 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a5b55d47-d9be-4f21-b30f-1a09c659aaae does not exist Jul 18 02:33:38.495035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce4fea32-d2f0-4442-b412-1ceb161c1c45'] Jul 18 02:33:38.495035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:38.495035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:38.495035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:38.495035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:38.495035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 18 02:33:38.495035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 18 02:33:38.495035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 02:33:38.495035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 02:33:38.495035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a5b55d47-d9be-4f21-b30f-1a09c659aaae does not exist Jul 18 02:33:38.495035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce4fea32-d2f0-4442-b412-1ceb161c1c45'] Jul 18 02:33:38.495035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:38.495035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:38.495035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:38.495035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:38.495035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:38.495035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:38.495035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:33:38.495035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:33:38.495035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:33:38.495035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:33:38.495035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:33:38.495035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:33:38.495035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 18 02:33:38.495035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 02:33:38.495035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a5b55d47-d9be-4f21-b30f-1a09c659aaae does not exist Jul 18 02:33:38.495035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce4fea32-d2f0-4442-b412-1ceb161c1c45'] Jul 18 02:33:38.495035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:38.495035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:38.495035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:38.495035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:38.495035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:38.495035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:38.495035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:33:38.495035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:33:38.495035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a5b55d47-d9be-4f21-b30f-1a09c659aaae does not exist Jul 18 02:33:38.495035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce4fea32-d2f0-4442-b412-1ceb161c1c45'] Jul 18 02:33:38.495035 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:38.495035 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-389adb74-618e-4259-ada3-60b9b4ab03c1 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Returning 404 to user: Security group a5b55d47-d9be-4f21-b30f-1a09c659aaae does not exist Jul 18 02:33:38.495035 n-d-465891-3 devstack@n-api.service[119544]: Neutron server returns request_ids: ['req-ce4fea32-d2f0-4442-b412-1ceb161c1c45'] {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:33:38.495035 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-389adb74-618e-4259-ada3-60b9b4ab03c1 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/a5b55d47-d9be-4f21-b30f-1a09c659aaae" status: 404 len: 194 microversion: 2.1 time: 0.201010 Jul 18 02:33:38.495035 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1792/3585] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 02:33:38 2022] DELETE /compute/v2.1/os-security-groups/a5b55d47-d9be-4f21-b30f-1a09c659aaae => generated 194 bytes in 204 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:33:38.509943 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e400d275-d8f2-44ed-a421-6f6fb33600df tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '.version_select at 0x7ff49b7b19d0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:38.645804 n-d-465891-3 devstack@n-api.service[119544]: DEBUG neutronclient.v2_0.client [None req-e400d275-d8f2-44ed-a421-6f6fb33600df tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 39b13129-4640-4677-929a-6871715c2cea does not exist", "detail": ""}} {{(pid=119544) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:33:38.646442 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.security_group_api [None req-e400d275-d8f2-44ed-a421-6f6fb33600df tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Neutron security group 39b13129-4640-4677-929a-6871715c2cea not found {{(pid=119544) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 02:33:38.647069 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-e400d275-d8f2-44ed-a421-6f6fb33600df tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] HTTP exception thrown: Security group 39b13129-4640-4677-929a-6871715c2cea does not exist Jul 18 02:33:38.647069 n-d-465891-3 devstack@n-api.service[119544]: Neutron server returns request_ids: ['req-52edff11-cdac-4663-a049-fa506534ce04'] Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e400d275-d8f2-44ed-a421-6f6fb33600df tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Request method failure captured: Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/os-security-groups/39b13129-4640-4677-929a-6871715c2cea HTTP/1.1 Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MXdApAd8jCQLuDQ4GDVob3WlO5TGoerQppREc0ccYssaOHle4VdpCa3zbolI9kA3vBsm6toj834_HQ72z_BEBH3fK1DoWoIDaDTMEsKRnNxFFmWRX0hetMPDmWg_gNY33hhTytVVTi3zUdfIo_ja5VJys5KWb2G5Exx3CV-M4e89mI Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: afe99772712849608ba124613bb5cc26 Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_afe99772712849608ba124613bb5cc26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/afe99772712849608ba124613bb5cc26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/afe99772712849608ba124613bb5cc26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/afe99772712849608ba124613bb5cc26"}]}] Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: afe99772712849608ba124613bb5cc26 Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-SecurityGroupsTestJSON-235723186-project Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 2374fa8610714b72b6034726ee1c2373 Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-SecurityGroupsTestJSON-235723186-project Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: exception: Security group 39b13129-4640-4677-929a-6871715c2cea does not exist Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: Neutron server returns request_ids: ['req-52edff11-cdac-4663-a049-fa506534ce04'] Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '39b13129-4640-4677-929a-6871715c2cea'} Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:33:38.649605 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 39b13129-4640-4677-929a-6871715c2cea does not exist Jul 18 02:33:38.659527 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-52edff11-cdac-4663-a049-fa506534ce04'] Jul 18 02:33:38.659527 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:38.659527 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:38.659527 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:38.659527 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:38.659527 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 18 02:33:38.659527 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 18 02:33:38.659527 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 02:33:38.659527 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 02:33:38.659527 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 39b13129-4640-4677-929a-6871715c2cea does not exist Jul 18 02:33:38.659527 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-52edff11-cdac-4663-a049-fa506534ce04'] Jul 18 02:33:38.659527 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:38.659527 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:38.659527 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:38.659527 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:38.659527 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:38.659527 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:38.659527 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:33:38.659527 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:33:38.659527 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:33:38.659527 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:33:38.659527 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:33:38.659527 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:33:38.659527 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 18 02:33:38.659527 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 02:33:38.659527 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 39b13129-4640-4677-929a-6871715c2cea does not exist Jul 18 02:33:38.659527 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-52edff11-cdac-4663-a049-fa506534ce04'] Jul 18 02:33:38.659527 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:38.659527 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:38.659527 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:38.659527 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:38.659527 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:38.659527 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:38.659527 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:33:38.659527 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:33:38.659527 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 39b13129-4640-4677-929a-6871715c2cea does not exist Jul 18 02:33:38.659527 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-52edff11-cdac-4663-a049-fa506534ce04'] Jul 18 02:33:38.659527 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:38.659527 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e400d275-d8f2-44ed-a421-6f6fb33600df tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Returning 404 to user: Security group 39b13129-4640-4677-929a-6871715c2cea does not exist Jul 18 02:33:38.659527 n-d-465891-3 devstack@n-api.service[119544]: Neutron server returns request_ids: ['req-52edff11-cdac-4663-a049-fa506534ce04'] {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:33:38.659527 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e400d275-d8f2-44ed-a421-6f6fb33600df tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/39b13129-4640-4677-929a-6871715c2cea" status: 404 len: 194 microversion: 2.1 time: 0.153233 Jul 18 02:33:38.659527 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1793/3586] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 02:33:38 2022] DELETE /compute/v2.1/os-security-groups/39b13129-4640-4677-929a-6871715c2cea => generated 194 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:33:38.665405 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-da8f7462-765f-4b68-b6e4-7d8a3efed74e tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '.version_select at 0x7ff49b7a9280>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:38.807976 n-d-465891-3 devstack@n-api.service[119544]: DEBUG neutronclient.v2_0.client [None req-da8f7462-765f-4b68-b6e4-7d8a3efed74e tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 68219ecc-ba73-4ca6-bca3-6c167d4aff9a does not exist", "detail": ""}} {{(pid=119544) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:33:38.808742 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.security_group_api [None req-da8f7462-765f-4b68-b6e4-7d8a3efed74e tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Neutron security group 68219ecc-ba73-4ca6-bca3-6c167d4aff9a not found {{(pid=119544) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 02:33:38.809343 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-da8f7462-765f-4b68-b6e4-7d8a3efed74e tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] HTTP exception thrown: Security group 68219ecc-ba73-4ca6-bca3-6c167d4aff9a does not exist Jul 18 02:33:38.809343 n-d-465891-3 devstack@n-api.service[119544]: Neutron server returns request_ids: ['req-28b30ba4-b26d-4081-b297-801e579affb5'] Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-da8f7462-765f-4b68-b6e4-7d8a3efed74e tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Request method failure captured: Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/os-security-groups/68219ecc-ba73-4ca6-bca3-6c167d4aff9a HTTP/1.1 Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MXdApAd8jCQLuDQ4GDVob3WlO5TGoerQppREc0ccYssaOHle4VdpCa3zbolI9kA3vBsm6toj834_HQ72z_BEBH3fK1DoWoIDaDTMEsKRnNxFFmWRX0hetMPDmWg_gNY33hhTytVVTi3zUdfIo_ja5VJys5KWb2G5Exx3CV-M4e89mI Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: afe99772712849608ba124613bb5cc26 Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_afe99772712849608ba124613bb5cc26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/afe99772712849608ba124613bb5cc26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/afe99772712849608ba124613bb5cc26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/afe99772712849608ba124613bb5cc26"}]}] Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: afe99772712849608ba124613bb5cc26 Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-SecurityGroupsTestJSON-235723186-project Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 2374fa8610714b72b6034726ee1c2373 Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-SecurityGroupsTestJSON-235723186-project Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: exception: Security group 68219ecc-ba73-4ca6-bca3-6c167d4aff9a does not exist Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: Neutron server returns request_ids: ['req-28b30ba4-b26d-4081-b297-801e579affb5'] Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '68219ecc-ba73-4ca6-bca3-6c167d4aff9a'} Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:33:38.811849 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 68219ecc-ba73-4ca6-bca3-6c167d4aff9a does not exist Jul 18 02:33:38.825855 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-28b30ba4-b26d-4081-b297-801e579affb5'] Jul 18 02:33:38.825855 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:38.825855 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:38.825855 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:38.825855 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:38.825855 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 18 02:33:38.825855 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 18 02:33:38.825855 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 02:33:38.825855 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 02:33:38.825855 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 68219ecc-ba73-4ca6-bca3-6c167d4aff9a does not exist Jul 18 02:33:38.825855 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-28b30ba4-b26d-4081-b297-801e579affb5'] Jul 18 02:33:38.825855 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:38.825855 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:38.825855 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:38.825855 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:38.825855 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:38.825855 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:38.825855 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:33:38.825855 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:33:38.825855 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:33:38.825855 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:33:38.825855 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:33:38.825855 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:33:38.825855 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 18 02:33:38.825855 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 02:33:38.825855 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 68219ecc-ba73-4ca6-bca3-6c167d4aff9a does not exist Jul 18 02:33:38.825855 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-28b30ba4-b26d-4081-b297-801e579affb5'] Jul 18 02:33:38.825855 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:38.825855 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:38.825855 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:38.825855 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:38.825855 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:38.825855 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:38.825855 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:33:38.825855 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:33:38.825855 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 68219ecc-ba73-4ca6-bca3-6c167d4aff9a does not exist Jul 18 02:33:38.825855 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-28b30ba4-b26d-4081-b297-801e579affb5'] Jul 18 02:33:38.825855 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:38.825855 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-da8f7462-765f-4b68-b6e4-7d8a3efed74e tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Returning 404 to user: Security group 68219ecc-ba73-4ca6-bca3-6c167d4aff9a does not exist Jul 18 02:33:38.825855 n-d-465891-3 devstack@n-api.service[119544]: Neutron server returns request_ids: ['req-28b30ba4-b26d-4081-b297-801e579affb5'] {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:33:38.825855 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-da8f7462-765f-4b68-b6e4-7d8a3efed74e tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/68219ecc-ba73-4ca6-bca3-6c167d4aff9a" status: 404 len: 194 microversion: 2.1 time: 0.155685 Jul 18 02:33:38.825855 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1794/3587] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 02:33:38 2022] DELETE /compute/v2.1/os-security-groups/68219ecc-ba73-4ca6-bca3-6c167d4aff9a => generated 194 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:33:38.831611 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6da24ab5-b813-4150-ac7a-82d85cca9bbd tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:38.831611 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6da24ab5-b813-4150-ac7a-82d85cca9bbd tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: c6d44f85-b513-4d3e-87de-71341677a30b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:38.851029 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6da24ab5-b813-4150-ac7a-82d85cca9bbd tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:38.851410 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6da24ab5-b813-4150-ac7a-82d85cca9bbd tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:38.852422 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6da24ab5-b813-4150-ac7a-82d85cca9bbd tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:38.852866 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6da24ab5-b813-4150-ac7a-82d85cca9bbd tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:38.915234 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6da24ab5-b813-4150-ac7a-82d85cca9bbd tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: c6d44f85-b513-4d3e-87de-71341677a30b] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:33:39.047074 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:39.147105 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:39.191076 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8413a30e-a6f1-4891-9eaf-b440874efb7f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:39.198907 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6da24ab5-b813-4150-ac7a-82d85cca9bbd tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b" status: 204 len: 0 microversion: 2.1 time: 0.377683 Jul 18 02:33:39.199789 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1795/3588] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:33:38 2022] DELETE /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:33:39.211249 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7fd7316a-9d43-44b9-8972-f8b2571c605f tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:39.212193 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7fd7316a-9d43-44b9-8972-f8b2571c605f tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 11b342d8-ebdd-4072-a6ec-d6bc21761582] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:39.221111 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7fd7316a-9d43-44b9-8972-f8b2571c605f tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:39.222178 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7fd7316a-9d43-44b9-8972-f8b2571c605f tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:39.223167 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7fd7316a-9d43-44b9-8972-f8b2571c605f tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:39.223617 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7fd7316a-9d43-44b9-8972-f8b2571c605f tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:39.232680 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8413a30e-a6f1-4891-9eaf-b440874efb7f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931" status: 200 len: 1522 microversion: 2.1 time: 0.848499 Jul 18 02:33:39.236790 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1794/3589] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:38 2022] GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931 => generated 1522 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:39.246428 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3dfa6ce6-8ddb-44dd-8433-b26f5342bf73 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:39.253061 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3dfa6ce6-8ddb-44dd-8433-b26f5342bf73 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: c6d44f85-b513-4d3e-87de-71341677a30b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:39.271840 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3dfa6ce6-8ddb-44dd-8433-b26f5342bf73 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:39.275171 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3dfa6ce6-8ddb-44dd-8433-b26f5342bf73 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:39.276529 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3dfa6ce6-8ddb-44dd-8433-b26f5342bf73 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:39.283397 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3dfa6ce6-8ddb-44dd-8433-b26f5342bf73 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:39.810106 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7fd7316a-9d43-44b9-8972-f8b2571c605f tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:39.827149 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7fd7316a-9d43-44b9-8972-f8b2571c605f tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582" status: 200 len: 1654 microversion: 2.1 time: 0.620572 Jul 18 02:33:39.828174 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1796/3590] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:39 2022] GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582 => generated 1654 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:39.840684 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d15c0229-f23b-4a8a-9e42-0feb991bbba9 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:39.846953 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d15c0229-f23b-4a8a-9e42-0feb991bbba9 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 15dfd562-5a76-41af-937e-41e44c96b4c1] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:39.866232 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d15c0229-f23b-4a8a-9e42-0feb991bbba9 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:39.866978 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d15c0229-f23b-4a8a-9e42-0feb991bbba9 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:39.868034 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d15c0229-f23b-4a8a-9e42-0feb991bbba9 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:39.871500 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d15c0229-f23b-4a8a-9e42-0feb991bbba9 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:39.880579 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3dfa6ce6-8ddb-44dd-8433-b26f5342bf73 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2374fa8610714b72b6034726ee1c2373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe99772712849608ba124613bb5cc26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:39.905757 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3dfa6ce6-8ddb-44dd-8433-b26f5342bf73 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b" status: 200 len: 1644 microversion: 2.1 time: 0.667454 Jul 18 02:33:39.910314 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1795/3591] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:39 2022] GET /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b => generated 1644 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:39.917451 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-2519e875-0975-481b-8b6e-f2ba15b7dd30 req-f39aae7f-75ab-40de-b239-f5e18a755c7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11b342d8-ebdd-4072-a6ec-d6bc21761582", "name": "network-vif-deleted", "tag": "02142832-94da-4d1d-85a0-b0a50bbcf698"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:39.955844 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-2519e875-0975-481b-8b6e-f2ba15b7dd30 req-f39aae7f-75ab-40de-b239-f5e18a755c7e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:39.956261 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-2519e875-0975-481b-8b6e-f2ba15b7dd30 req-f39aae7f-75ab-40de-b239-f5e18a755c7e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:40.008568 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-2519e875-0975-481b-8b6e-f2ba15b7dd30 req-f39aae7f-75ab-40de-b239-f5e18a755c7e service nova] Creating event network-vif-deleted:02142832-94da-4d1d-85a0-b0a50bbcf698 for instance 11b342d8-ebdd-4072-a6ec-d6bc21761582 on n-h2-465891-3 Jul 18 02:33:40.026246 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-2519e875-0975-481b-8b6e-f2ba15b7dd30 req-f39aae7f-75ab-40de-b239-f5e18a755c7e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113781 Jul 18 02:33:40.027492 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1796/3592] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:40.029665 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d15c0229-f23b-4a8a-9e42-0feb991bbba9 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:40.039641 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d15c0229-f23b-4a8a-9e42-0feb991bbba9 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:40.041241 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d15c0229-f23b-4a8a-9e42-0feb991bbba9 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:40.051815 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d15c0229-f23b-4a8a-9e42-0feb991bbba9 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1" status: 200 len: 1336 microversion: 2.47 time: 0.222193 Jul 18 02:33:40.052682 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1797/3593] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:33:39 2022] GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1 => generated 1336 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:33:40.261574 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c352cdb2-f18b-4d3d-bd65-2208cd4c1002 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:40.262688 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c352cdb2-f18b-4d3d-bd65-2208cd4c1002 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: 02425120-f4dc-4f02-99c5-9bf0fe7e1931] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:40.279686 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c352cdb2-f18b-4d3d-bd65-2208cd4c1002 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:40.280797 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c352cdb2-f18b-4d3d-bd65-2208cd4c1002 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:40.284075 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c352cdb2-f18b-4d3d-bd65-2208cd4c1002 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:40.290343 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c352cdb2-f18b-4d3d-bd65-2208cd4c1002 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:40.774917 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-a403d3ef-5482-4c94-973e-71611cdbfc9e req-0493dbb7-d129-4065-9102-5b0f02d8e803 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11b342d8-ebdd-4072-a6ec-d6bc21761582", "name": "network-vif-unplugged", "status": "completed", "tag": "4a17857b-b706-4a20-9efd-43851f356de5"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:40.808971 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-a403d3ef-5482-4c94-973e-71611cdbfc9e req-0493dbb7-d129-4065-9102-5b0f02d8e803 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:40.811464 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-a403d3ef-5482-4c94-973e-71611cdbfc9e req-0493dbb7-d129-4065-9102-5b0f02d8e803 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:40.846434 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-a403d3ef-5482-4c94-973e-71611cdbfc9e req-0493dbb7-d129-4065-9102-5b0f02d8e803 service nova] Creating event network-vif-unplugged:4a17857b-b706-4a20-9efd-43851f356de5 for instance 11b342d8-ebdd-4072-a6ec-d6bc21761582 on n-h2-465891-3 Jul 18 02:33:40.858899 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-a403d3ef-5482-4c94-973e-71611cdbfc9e req-0493dbb7-d129-4065-9102-5b0f02d8e803 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088650 Jul 18 02:33:40.864273 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1798/3594] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:33:40.878884 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-69bfc00f-7e60-41bf-9036-47cfa6b86f79 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:40.881045 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-69bfc00f-7e60-41bf-9036-47cfa6b86f79 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 11b342d8-ebdd-4072-a6ec-d6bc21761582] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:40.903357 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69bfc00f-7e60-41bf-9036-47cfa6b86f79 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:40.904545 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69bfc00f-7e60-41bf-9036-47cfa6b86f79 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:40.905577 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69bfc00f-7e60-41bf-9036-47cfa6b86f79 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:40.906255 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69bfc00f-7e60-41bf-9036-47cfa6b86f79 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:41.374985 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:41.464819 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=8 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:41.591786 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c352cdb2-f18b-4d3d-bd65-2208cd4c1002 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:41.606783 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c352cdb2-f18b-4d3d-bd65-2208cd4c1002 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931" status: 200 len: 1522 microversion: 2.1 time: 1.349425 Jul 18 02:33:41.610495 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1797/3595] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:40 2022] GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931 => generated 1522 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:41.618696 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e39a58b7-a890-4cce-8a27-a41060e385a8 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:41.619539 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e39a58b7-a890-4cce-8a27-a41060e385a8 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: c6d44f85-b513-4d3e-87de-71341677a30b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:41.661838 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e39a58b7-a890-4cce-8a27-a41060e385a8 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:41.662300 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e39a58b7-a890-4cce-8a27-a41060e385a8 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:41.664109 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e39a58b7-a890-4cce-8a27-a41060e385a8 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:41.665355 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e39a58b7-a890-4cce-8a27-a41060e385a8 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:42.160051 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-69bfc00f-7e60-41bf-9036-47cfa6b86f79 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:42.190189 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-69bfc00f-7e60-41bf-9036-47cfa6b86f79 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582" status: 200 len: 1496 microversion: 2.1 time: 1.318922 Jul 18 02:33:42.192128 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1799/3596] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:40 2022] GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582 => generated 1496 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:42.206398 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2bc3d171-edd4-44e0-b2f2-a3073819ee5d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:42.207040 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2bc3d171-edd4-44e0-b2f2-a3073819ee5d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 15dfd562-5a76-41af-937e-41e44c96b4c1] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:42.222265 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2bc3d171-edd4-44e0-b2f2-a3073819ee5d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:42.222612 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2bc3d171-edd4-44e0-b2f2-a3073819ee5d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:42.230334 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2bc3d171-edd4-44e0-b2f2-a3073819ee5d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:42.230786 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2bc3d171-edd4-44e0-b2f2-a3073819ee5d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:42.490442 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2bc3d171-edd4-44e0-b2f2-a3073819ee5d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:42.518948 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2bc3d171-edd4-44e0-b2f2-a3073819ee5d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:42.533074 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2bc3d171-edd4-44e0-b2f2-a3073819ee5d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:42.536497 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2bc3d171-edd4-44e0-b2f2-a3073819ee5d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1" status: 200 len: 1357 microversion: 2.47 time: 0.334742 Jul 18 02:33:42.539164 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1800/3597] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:33:42 2022] GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1 => generated 1357 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:33:42.580746 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-318eed7e-a456-4c1b-8e28-08db4f9c6279 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:42.585313 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-318eed7e-a456-4c1b-8e28-08db4f9c6279 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 15dfd562-5a76-41af-937e-41e44c96b4c1] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:42.613268 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-318eed7e-a456-4c1b-8e28-08db4f9c6279 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:42.616254 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-318eed7e-a456-4c1b-8e28-08db4f9c6279 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:42.620030 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-318eed7e-a456-4c1b-8e28-08db4f9c6279 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:42.621161 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-318eed7e-a456-4c1b-8e28-08db4f9c6279 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:42.794542 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-318eed7e-a456-4c1b-8e28-08db4f9c6279 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:33:42.795411 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-318eed7e-a456-4c1b-8e28-08db4f9c6279 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:33:42.796051 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-318eed7e-a456-4c1b-8e28-08db4f9c6279 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:33:42.797601 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-318eed7e-a456-4c1b-8e28-08db4f9c6279 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:33:42.799428 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-318eed7e-a456-4c1b-8e28-08db4f9c6279 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:33:42.812526 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:42.922118 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-318eed7e-a456-4c1b-8e28-08db4f9c6279 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 15dfd562-5a76-41af-937e-41e44c96b4c1] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:42.933989 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-318eed7e-a456-4c1b-8e28-08db4f9c6279 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:42.934684 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-318eed7e-a456-4c1b-8e28-08db4f9c6279 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:42.936142 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-318eed7e-a456-4c1b-8e28-08db4f9c6279 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:42.936809 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-318eed7e-a456-4c1b-8e28-08db4f9c6279 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:42.984930 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-318eed7e-a456-4c1b-8e28-08db4f9c6279 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "POST /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1/action" status: 202 len: 1079 microversion: 2.47 time: 0.413873 Jul 18 02:33:42.994816 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1801/3598] 10.222.0.57 () {62 vars in 1318 bytes} [Mon Jul 18 02:33:42 2022] POST /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1/action => generated 1079 bytes in 425 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 18 02:33:43.005431 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-34a9728a-39ee-4138-9bda-f033915928fa tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:43.006182 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-34a9728a-39ee-4138-9bda-f033915928fa tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: 02425120-f4dc-4f02-99c5-9bf0fe7e1931] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:43.015695 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-34a9728a-39ee-4138-9bda-f033915928fa tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:43.016313 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-34a9728a-39ee-4138-9bda-f033915928fa tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:43.018430 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-34a9728a-39ee-4138-9bda-f033915928fa tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:43.019105 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-34a9728a-39ee-4138-9bda-f033915928fa tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:43.145848 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e39a58b7-a890-4cce-8a27-a41060e385a8 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2374fa8610714b72b6034726ee1c2373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe99772712849608ba124613bb5cc26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:43.159013 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e39a58b7-a890-4cce-8a27-a41060e385a8 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b" status: 200 len: 1644 microversion: 2.1 time: 1.546602 Jul 18 02:33:43.160475 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1798/3599] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:41 2022] GET /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b => generated 1644 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:43.181029 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c210e923-e27e-4f8c-b8fa-ef3779fd15af tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:43.181658 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c210e923-e27e-4f8c-b8fa-ef3779fd15af tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 15dfd562-5a76-41af-937e-41e44c96b4c1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:43.202638 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c210e923-e27e-4f8c-b8fa-ef3779fd15af tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:43.203288 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c210e923-e27e-4f8c-b8fa-ef3779fd15af tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:43.207546 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c210e923-e27e-4f8c-b8fa-ef3779fd15af tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:43.208028 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c210e923-e27e-4f8c-b8fa-ef3779fd15af tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:43.851488 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c210e923-e27e-4f8c-b8fa-ef3779fd15af tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:43.889481 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c210e923-e27e-4f8c-b8fa-ef3779fd15af tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:43.895778 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c210e923-e27e-4f8c-b8fa-ef3779fd15af tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:43.906528 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c210e923-e27e-4f8c-b8fa-ef3779fd15af tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1" status: 200 len: 1366 microversion: 2.47 time: 0.730751 Jul 18 02:33:43.913055 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1799/3600] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:33:43 2022] GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1 => generated 1366 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:33:43.933943 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d5859767-d99c-455f-8659-6516e0aa6132 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:43.937950 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d5859767-d99c-455f-8659-6516e0aa6132 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 11b342d8-ebdd-4072-a6ec-d6bc21761582] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:43.951084 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5859767-d99c-455f-8659-6516e0aa6132 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:43.952323 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5859767-d99c-455f-8659-6516e0aa6132 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:43.955521 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5859767-d99c-455f-8659-6516e0aa6132 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:43.958581 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5859767-d99c-455f-8659-6516e0aa6132 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:44.328489 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d5859767-d99c-455f-8659-6516e0aa6132 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12b1d209c7c4bdfaa3f18b95095e065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2eddce815546778247c5d0c9986610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:44.339899 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d5859767-d99c-455f-8659-6516e0aa6132 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582" status: 200 len: 1454 microversion: 2.1 time: 0.424120 Jul 18 02:33:44.346121 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1800/3601] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:43 2022] GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582 => generated 1454 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:44.584749 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-34a9728a-39ee-4138-9bda-f033915928fa tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:44.637038 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-34a9728a-39ee-4138-9bda-f033915928fa tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931" status: 200 len: 1522 microversion: 2.1 time: 1.639289 Jul 18 02:33:44.664083 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1802/3602] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:42 2022] GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931 => generated 1522 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:44.681977 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-dbdb8b60-d78c-4ce4-9c3a-7866f35682e1 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:44.689942 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-dbdb8b60-d78c-4ce4-9c3a-7866f35682e1 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: c6d44f85-b513-4d3e-87de-71341677a30b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:44.690675 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-8a07d4d8-b48f-4c7c-be3c-cdf09034e1c6 req-74dd0c43-b41b-4c9d-8a2e-daf4967c317f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11b342d8-ebdd-4072-a6ec-d6bc21761582", "name": "network-vif-deleted", "tag": "4a17857b-b706-4a20-9efd-43851f356de5"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:44.709678 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dbdb8b60-d78c-4ce4-9c3a-7866f35682e1 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:44.715002 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dbdb8b60-d78c-4ce4-9c3a-7866f35682e1 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:44.718479 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dbdb8b60-d78c-4ce4-9c3a-7866f35682e1 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:44.723889 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dbdb8b60-d78c-4ce4-9c3a-7866f35682e1 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:44.857256 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-8a07d4d8-b48f-4c7c-be3c-cdf09034e1c6 req-74dd0c43-b41b-4c9d-8a2e-daf4967c317f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:44.858495 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-8a07d4d8-b48f-4c7c-be3c-cdf09034e1c6 req-74dd0c43-b41b-4c9d-8a2e-daf4967c317f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:44.913851 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-8a07d4d8-b48f-4c7c-be3c-cdf09034e1c6 req-74dd0c43-b41b-4c9d-8a2e-daf4967c317f service nova] Creating event network-vif-deleted:4a17857b-b706-4a20-9efd-43851f356de5 for instance 11b342d8-ebdd-4072-a6ec-d6bc21761582 on n-h2-465891-3 Jul 18 02:33:44.935757 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-8a07d4d8-b48f-4c7c-be3c-cdf09034e1c6 req-74dd0c43-b41b-4c9d-8a2e-daf4967c317f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.587404 Jul 18 02:33:44.960083 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1801/3603] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:44.992897 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6c102127-1823-4540-9432-d23f381b90bb tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:44.998041 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6c102127-1823-4540-9432-d23f381b90bb tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 15dfd562-5a76-41af-937e-41e44c96b4c1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:45.071627 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6c102127-1823-4540-9432-d23f381b90bb tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:45.072088 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6c102127-1823-4540-9432-d23f381b90bb tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:45.081209 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6c102127-1823-4540-9432-d23f381b90bb tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:45.081825 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6c102127-1823-4540-9432-d23f381b90bb tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:45.099621 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-dbdb8b60-d78c-4ce4-9c3a-7866f35682e1 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2374fa8610714b72b6034726ee1c2373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe99772712849608ba124613bb5cc26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:45.157153 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-dbdb8b60-d78c-4ce4-9c3a-7866f35682e1 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b" status: 200 len: 1466 microversion: 2.1 time: 0.491398 Jul 18 02:33:45.176556 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1803/3604] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:44 2022] GET /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b => generated 1466 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:45.338470 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6c102127-1823-4540-9432-d23f381b90bb tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:45.370546 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c81b6cca-d296-4033-9dcf-58c42b10ccd4 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:45.371444 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c81b6cca-d296-4033-9dcf-58c42b10ccd4 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 11b342d8-ebdd-4072-a6ec-d6bc21761582] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:45.384841 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6c102127-1823-4540-9432-d23f381b90bb tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:45.396644 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c81b6cca-d296-4033-9dcf-58c42b10ccd4 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:45.397228 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c81b6cca-d296-4033-9dcf-58c42b10ccd4 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:45.401625 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6c102127-1823-4540-9432-d23f381b90bb tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:45.418064 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6c102127-1823-4540-9432-d23f381b90bb tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1" status: 200 len: 1366 microversion: 2.47 time: 0.446517 Jul 18 02:33:45.423609 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1802/3605] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:33:44 2022] GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1 => generated 1366 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:33:45.430819 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c81b6cca-d296-4033-9dcf-58c42b10ccd4 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:45.431809 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c81b6cca-d296-4033-9dcf-58c42b10ccd4 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:45.519966 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-c81b6cca-d296-4033-9dcf-58c42b10ccd4 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] HTTP exception thrown: Instance 11b342d8-ebdd-4072-a6ec-d6bc21761582 could not be found. Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c81b6cca-d296-4033-9dcf-58c42b10ccd4 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Request method failure captured: Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582 HTTP/1.1 Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MXCIOaod40m20WbrLAhvejXGgWGYoScZiJAmiZ3HizCiwZHoCKVassRVJDupAhRDpTMtTimuOSkPApLvzXSkpOpBrwwrergLjoegz_JjcMtdTQfoVFrmGdxUcPNhAsxqRnRRjAYgmYy-Lg7-6jhiq3gGYKCnlWdIaGKSFm4o5hpmOw Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 2a2eddce815546778247c5d0c9986610 Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersTestMultiNic-942367850 Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2a2eddce815546778247c5d0c9986610"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2a2eddce815546778247c5d0c9986610"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2a2eddce815546778247c5d0c9986610"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2a2eddce815546778247c5d0c9986610"}]}] Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersTestMultiNic-942367850 Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 2a2eddce815546778247c5d0c9986610 Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersTestMultiNic-942367850 Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersTestMultiNic-942367850-project Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: c12b1d209c7c4bdfaa3f18b95095e065 Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersTestMultiNic-942367850-project Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 11b342d8-ebdd-4072-a6ec-d6bc21761582 could not be found. Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '11b342d8-ebdd-4072-a6ec-d6bc21761582'} Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11b342d8-ebdd-4072-a6ec-d6bc21761582 could not be found. Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11b342d8-ebdd-4072-a6ec-d6bc21761582 could not be found. Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:45.534513 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:45.545504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:45.545504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:45.545504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:45.545504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:33:45.545504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:33:45.545504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11b342d8-ebdd-4072-a6ec-d6bc21761582 could not be found. Jul 18 02:33:45.545504 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:45.545504 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c81b6cca-d296-4033-9dcf-58c42b10ccd4 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Returning 404 to user: Instance 11b342d8-ebdd-4072-a6ec-d6bc21761582 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:33:45.552811 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c81b6cca-d296-4033-9dcf-58c42b10ccd4 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582" status: 404 len: 111 microversion: 2.1 time: 0.186719 Jul 18 02:33:45.553422 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1804/3606] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:45 2022] GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582 => generated 111 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:33:45.674837 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e2ebb282-d5bb-42bf-a05e-12fb00d1c5e3 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:45.676156 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e2ebb282-d5bb-42bf-a05e-12fb00d1c5e3 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: 02425120-f4dc-4f02-99c5-9bf0fe7e1931] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:45.726120 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e2ebb282-d5bb-42bf-a05e-12fb00d1c5e3 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:45.727023 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e2ebb282-d5bb-42bf-a05e-12fb00d1c5e3 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:45.732604 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e2ebb282-d5bb-42bf-a05e-12fb00d1c5e3 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:45.733423 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e2ebb282-d5bb-42bf-a05e-12fb00d1c5e3 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:46.198892 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0a31e3a5-499e-4d43-9143-6f67eaf6bfd0 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:46.198892 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0a31e3a5-499e-4d43-9143-6f67eaf6bfd0 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: c6d44f85-b513-4d3e-87de-71341677a30b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:46.229198 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a31e3a5-499e-4d43-9143-6f67eaf6bfd0 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:46.234944 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a31e3a5-499e-4d43-9143-6f67eaf6bfd0 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:46.237651 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a31e3a5-499e-4d43-9143-6f67eaf6bfd0 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:46.238587 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a31e3a5-499e-4d43-9143-6f67eaf6bfd0 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:46.460620 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a31e3a5-499e-4d43-9143-6f67eaf6bfd0 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:46.471116 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a31e3a5-499e-4d43-9143-6f67eaf6bfd0 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:46.473824 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-0a31e3a5-499e-4d43-9143-6f67eaf6bfd0 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lazy-loading 'fault' on Instance uuid c6d44f85-b513-4d3e-87de-71341677a30b {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:33:46.534135 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e2ebb282-d5bb-42bf-a05e-12fb00d1c5e3 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:46.563769 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e2ebb282-d5bb-42bf-a05e-12fb00d1c5e3 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931" status: 200 len: 1522 microversion: 2.1 time: 0.894665 Jul 18 02:33:46.564624 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1803/3607] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:45 2022] GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931 => generated 1522 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:46.588721 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9a85d120-ce72-476c-96bc-c82265686482 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:46.603172 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9a85d120-ce72-476c-96bc-c82265686482 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 15dfd562-5a76-41af-937e-41e44c96b4c1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:46.622535 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9a85d120-ce72-476c-96bc-c82265686482 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:46.624789 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9a85d120-ce72-476c-96bc-c82265686482 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:46.628065 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9a85d120-ce72-476c-96bc-c82265686482 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:46.632713 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9a85d120-ce72-476c-96bc-c82265686482 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:46.709112 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0a31e3a5-499e-4d43-9143-6f67eaf6bfd0 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2374fa8610714b72b6034726ee1c2373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe99772712849608ba124613bb5cc26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:46.729025 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0a31e3a5-499e-4d43-9143-6f67eaf6bfd0 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b" status: 200 len: 1304 microversion: 2.1 time: 0.535307 Jul 18 02:33:46.746876 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1805/3608] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:46 2022] GET /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b => generated 1304 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:46.810858 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9a85d120-ce72-476c-96bc-c82265686482 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:46.822841 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9a85d120-ce72-476c-96bc-c82265686482 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:46.824397 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9a85d120-ce72-476c-96bc-c82265686482 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:46.825638 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9a85d120-ce72-476c-96bc-c82265686482 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1" status: 200 len: 1366 microversion: 2.47 time: 0.251193 Jul 18 02:33:46.826238 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1804/3609] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:33:46 2022] GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1 => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:33:47.599031 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d856e80a-fb23-4164-8038-683f76543ea9 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:47.600116 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d856e80a-fb23-4164-8038-683f76543ea9 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: 02425120-f4dc-4f02-99c5-9bf0fe7e1931] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:47.640881 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d856e80a-fb23-4164-8038-683f76543ea9 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:47.642251 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d856e80a-fb23-4164-8038-683f76543ea9 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:47.655433 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d856e80a-fb23-4164-8038-683f76543ea9 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:47.656353 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d856e80a-fb23-4164-8038-683f76543ea9 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:47.662066 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-95798eda-2bf0-467b-bf80-c9c7a768186d req-d56d2e68-1871-4845-b0cc-2cf2ad333f3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6d44f85-b513-4d3e-87de-71341677a30b", "name": "network-vif-deleted", "tag": "a415076e-e7de-4e2a-a80b-075323147f76"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:47.745553 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-95798eda-2bf0-467b-bf80-c9c7a768186d req-d56d2e68-1871-4845-b0cc-2cf2ad333f3d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:47.754523 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-95798eda-2bf0-467b-bf80-c9c7a768186d req-d56d2e68-1871-4845-b0cc-2cf2ad333f3d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:47.804553 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-95798eda-2bf0-467b-bf80-c9c7a768186d req-d56d2e68-1871-4845-b0cc-2cf2ad333f3d service nova] Creating event network-vif-deleted:a415076e-e7de-4e2a-a80b-075323147f76 for instance c6d44f85-b513-4d3e-87de-71341677a30b on n-h2-465891-3 Jul 18 02:33:47.829657 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-95798eda-2bf0-467b-bf80-c9c7a768186d req-d56d2e68-1871-4845-b0cc-2cf2ad333f3d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174581 Jul 18 02:33:47.836123 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1805/3610] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:47.852772 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-99fe2c74-f0e3-45fd-b739-bb39cbac1b00 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:47.859270 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-99fe2c74-f0e3-45fd-b739-bb39cbac1b00 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] [instance: c6d44f85-b513-4d3e-87de-71341677a30b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:47.878508 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-99fe2c74-f0e3-45fd-b739-bb39cbac1b00 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:47.879117 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-99fe2c74-f0e3-45fd-b739-bb39cbac1b00 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:47.880010 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-99fe2c74-f0e3-45fd-b739-bb39cbac1b00 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:47.880466 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-99fe2c74-f0e3-45fd-b739-bb39cbac1b00 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:47.954171 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-99fe2c74-f0e3-45fd-b739-bb39cbac1b00 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] HTTP exception thrown: Instance c6d44f85-b513-4d3e-87de-71341677a30b could not be found. Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-99fe2c74-f0e3-45fd-b739-bb39cbac1b00 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Request method failure captured: Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b HTTP/1.1 Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MXdApAd8jCQLuDQ4GDVob3WlO5TGoerQppREc0ccYssaOHle4VdpCa3zbolI9kA3vBsm6toj834_HQ72z_BEBH3fK1DoWoIDaDTMEsKRnNxFFmWRX0hetMPDmWg_gNY33hhTytVVTi3zUdfIo_ja5VJys5KWb2G5Exx3CV-M4e89mI Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: afe99772712849608ba124613bb5cc26 Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_afe99772712849608ba124613bb5cc26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/afe99772712849608ba124613bb5cc26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/afe99772712849608ba124613bb5cc26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/afe99772712849608ba124613bb5cc26"}]}] Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: afe99772712849608ba124613bb5cc26 Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-235723186 Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-SecurityGroupsTestJSON-235723186-project Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 2374fa8610714b72b6034726ee1c2373 Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-SecurityGroupsTestJSON-235723186-project Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance c6d44f85-b513-4d3e-87de-71341677a30b could not be found. Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'c6d44f85-b513-4d3e-87de-71341677a30b'} Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6d44f85-b513-4d3e-87de-71341677a30b could not be found. Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6d44f85-b513-4d3e-87de-71341677a30b could not be found. Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:47.967740 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:47.981050 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:47.981050 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:47.981050 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:47.981050 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:33:47.981050 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:33:47.981050 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6d44f85-b513-4d3e-87de-71341677a30b could not be found. Jul 18 02:33:47.981050 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:47.983975 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-99fe2c74-f0e3-45fd-b739-bb39cbac1b00 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Returning 404 to user: Instance c6d44f85-b513-4d3e-87de-71341677a30b could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:33:47.986823 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-99fe2c74-f0e3-45fd-b739-bb39cbac1b00 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "GET /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b" status: 404 len: 111 microversion: 2.1 time: 0.147692 Jul 18 02:33:47.986823 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1806/3611] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:47 2022] GET /compute/v2.1/servers/c6d44f85-b513-4d3e-87de-71341677a30b => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:33:48.008705 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a1c545de-909d-47f9-9a16-3c8f0842279f tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:48.009536 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a1c545de-909d-47f9-9a16-3c8f0842279f tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 15dfd562-5a76-41af-937e-41e44c96b4c1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:48.040794 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a1c545de-909d-47f9-9a16-3c8f0842279f tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:48.041589 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a1c545de-909d-47f9-9a16-3c8f0842279f tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:48.059670 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a1c545de-909d-47f9-9a16-3c8f0842279f tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:48.060660 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a1c545de-909d-47f9-9a16-3c8f0842279f tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:48.211177 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d856e80a-fb23-4164-8038-683f76543ea9 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:48.245427 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d856e80a-fb23-4164-8038-683f76543ea9 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931" status: 200 len: 1522 microversion: 2.1 time: 0.654114 Jul 18 02:33:48.247722 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1806/3612] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:47 2022] GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931 => generated 1522 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:48.258073 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-89eaa70e-0d2c-4569-90bf-c21d624bbcf1 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '.version_select at 0x7ff49b7484c0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:48.381874 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a1c545de-909d-47f9-9a16-3c8f0842279f tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:48.412976 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a1c545de-909d-47f9-9a16-3c8f0842279f tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:48.427789 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a1c545de-909d-47f9-9a16-3c8f0842279f tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:48.430502 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a1c545de-909d-47f9-9a16-3c8f0842279f tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1" status: 200 len: 1366 microversion: 2.47 time: 0.442135 Jul 18 02:33:48.437455 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1807/3613] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:33:47 2022] GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1 => generated 1366 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:33:49.289247 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b9440807-b71f-4614-adf0-fb6afae35960 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:49.299404 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b9440807-b71f-4614-adf0-fb6afae35960 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: 02425120-f4dc-4f02-99c5-9bf0fe7e1931] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:49.366379 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b9440807-b71f-4614-adf0-fb6afae35960 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:49.367202 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b9440807-b71f-4614-adf0-fb6afae35960 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:49.368756 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b9440807-b71f-4614-adf0-fb6afae35960 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:49.379201 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b9440807-b71f-4614-adf0-fb6afae35960 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:49.542646 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-89eaa70e-0d2c-4569-90bf-c21d624bbcf1 tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/8d81923e-fff7-4d88-9d0a-ca98354f8ffa" status: 202 len: 0 microversion: 2.1 time: 1.292746 Jul 18 02:33:49.546641 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1807/3614] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 02:33:48 2022] DELETE /compute/v2.1/os-security-groups/8d81923e-fff7-4d88-9d0a-ca98354f8ffa => generated 0 bytes in 1298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:33:49.571702 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-56a44d8f-638f-455f-ac3f-9bc4427b92ed tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:49.572846 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-56a44d8f-638f-455f-ac3f-9bc4427b92ed tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 15dfd562-5a76-41af-937e-41e44c96b4c1] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:49.605111 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-56a44d8f-638f-455f-ac3f-9bc4427b92ed tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:49.605938 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-56a44d8f-638f-455f-ac3f-9bc4427b92ed tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:49.625351 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-56a44d8f-638f-455f-ac3f-9bc4427b92ed tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:49.631370 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-56a44d8f-638f-455f-ac3f-9bc4427b92ed tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:50.388224 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-56a44d8f-638f-455f-ac3f-9bc4427b92ed tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:50.462964 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-56a44d8f-638f-455f-ac3f-9bc4427b92ed tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:50.466642 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-56a44d8f-638f-455f-ac3f-9bc4427b92ed tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:50.494627 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-56a44d8f-638f-455f-ac3f-9bc4427b92ed tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1" status: 200 len: 1366 microversion: 2.47 time: 0.944587 Jul 18 02:33:50.495723 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1808/3615] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:33:49 2022] GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1 => generated 1366 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:33:50.538356 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2666cf9b-9029-47e3-916c-f0966261214d tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] Calling method '.version_select at 0x7ff49b7a6f70>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:50.892190 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b9440807-b71f-4614-adf0-fb6afae35960 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:50.936185 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b9440807-b71f-4614-adf0-fb6afae35960 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931" status: 200 len: 1522 microversion: 2.1 time: 1.671705 Jul 18 02:33:50.939045 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1808/3616] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:49 2022] GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931 => generated 1522 bytes in 1675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:51.428159 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2666cf9b-9029-47e3-916c-f0966261214d tempest-SecurityGroupsTestJSON-235723186 tempest-SecurityGroupsTestJSON-235723186-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/a30a8694-2fde-4258-bc27-670762ef063b" status: 202 len: 0 microversion: 2.1 time: 0.929586 Jul 18 02:33:51.429851 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1809/3617] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 02:33:50 2022] DELETE /compute/v2.1/os-security-groups/a30a8694-2fde-4258-bc27-670762ef063b => generated 0 bytes in 934 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:33:51.517178 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5d516b3a-2722-4377-bab3-4f9ac8fad1a9 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:51.528216 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5d516b3a-2722-4377-bab3-4f9ac8fad1a9 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 15dfd562-5a76-41af-937e-41e44c96b4c1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:51.539325 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:51.568056 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5d516b3a-2722-4377-bab3-4f9ac8fad1a9 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:51.568524 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5d516b3a-2722-4377-bab3-4f9ac8fad1a9 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:51.569351 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-687c556e-117a-480a-a051-230a1bf2f6b7 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:51.569530 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5d516b3a-2722-4377-bab3-4f9ac8fad1a9 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:51.569941 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5d516b3a-2722-4377-bab3-4f9ac8fad1a9 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:51.570523 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-687c556e-117a-480a-a051-230a1bf2f6b7 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] [instance: 122b7de0-abb6-4349-8559-f7cee46ef7d1] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:51.578658 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-687c556e-117a-480a-a051-230a1bf2f6b7 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:51.579884 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-687c556e-117a-480a-a051-230a1bf2f6b7 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:51.581316 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-687c556e-117a-480a-a051-230a1bf2f6b7 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:51.582059 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-687c556e-117a-480a-a051-230a1bf2f6b7 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:51.762564 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-687c556e-117a-480a-a051-230a1bf2f6b7 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lazy-loading 'services' on Instance uuid 122b7de0-abb6-4349-8559-f7cee46ef7d1 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:33:51.861329 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5d516b3a-2722-4377-bab3-4f9ac8fad1a9 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:51.882889 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5d516b3a-2722-4377-bab3-4f9ac8fad1a9 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:51.887518 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5d516b3a-2722-4377-bab3-4f9ac8fad1a9 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:51.890631 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5d516b3a-2722-4377-bab3-4f9ac8fad1a9 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1" status: 200 len: 1366 microversion: 2.47 time: 0.378450 Jul 18 02:33:51.910519 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1809/3618] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:33:51 2022] GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1 => generated 1366 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:33:51.966541 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d3922cbb-854a-4577-b587-e47d1aa5b2e3 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:51.967242 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d3922cbb-854a-4577-b587-e47d1aa5b2e3 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: 02425120-f4dc-4f02-99c5-9bf0fe7e1931] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:52.005258 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d3922cbb-854a-4577-b587-e47d1aa5b2e3 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:52.009642 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d3922cbb-854a-4577-b587-e47d1aa5b2e3 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:52.014902 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d3922cbb-854a-4577-b587-e47d1aa5b2e3 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:52.018120 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d3922cbb-854a-4577-b587-e47d1aa5b2e3 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:52.018632 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-687c556e-117a-480a-a051-230a1bf2f6b7 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] 10.222.0.57 "DELETE /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1/os-volume_attachments/14158273-2f3d-496c-8292-754e537ac460" status: 202 len: 0 microversion: 2.1 time: 0.454033 Jul 18 02:33:52.022123 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1810/3619] 10.222.0.57 () {58 vars in 1415 bytes} [Mon Jul 18 02:33:51 2022] DELETE /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1/os-volume_attachments/14158273-2f3d-496c-8292-754e537ac460 => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:33:52.350871 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d3922cbb-854a-4577-b587-e47d1aa5b2e3 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:52.364412 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d3922cbb-854a-4577-b587-e47d1aa5b2e3 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931" status: 200 len: 1522 microversion: 2.1 time: 0.402220 Jul 18 02:33:52.368327 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1810/3620] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:51 2022] GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931 => generated 1522 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:33:52.928573 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-de7d7b31-489b-4567-b695-e498e4ec24d0 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:52.930778 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-de7d7b31-489b-4567-b695-e498e4ec24d0 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 15dfd562-5a76-41af-937e-41e44c96b4c1] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:52.962097 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-de7d7b31-489b-4567-b695-e498e4ec24d0 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:52.966468 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-de7d7b31-489b-4567-b695-e498e4ec24d0 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:52.971643 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-de7d7b31-489b-4567-b695-e498e4ec24d0 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:52.972309 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-de7d7b31-489b-4567-b695-e498e4ec24d0 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:53.115595 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-de7d7b31-489b-4567-b695-e498e4ec24d0 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:53.134997 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-de7d7b31-489b-4567-b695-e498e4ec24d0 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:53.138381 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-de7d7b31-489b-4567-b695-e498e4ec24d0 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:53.140726 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-de7d7b31-489b-4567-b695-e498e4ec24d0 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1" status: 200 len: 1366 microversion: 2.47 time: 0.219598 Jul 18 02:33:53.148030 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1811/3621] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:33:52 2022] GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:33:53.400712 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6aa0a0cd-dc7d-427c-8b0d-ad1b92c383db tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:53.401434 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6aa0a0cd-dc7d-427c-8b0d-ad1b92c383db tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: 02425120-f4dc-4f02-99c5-9bf0fe7e1931] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:53.411572 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6aa0a0cd-dc7d-427c-8b0d-ad1b92c383db tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:53.412230 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6aa0a0cd-dc7d-427c-8b0d-ad1b92c383db tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:53.413392 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6aa0a0cd-dc7d-427c-8b0d-ad1b92c383db tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:53.414122 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6aa0a0cd-dc7d-427c-8b0d-ad1b92c383db tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:53.723909 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6aa0a0cd-dc7d-427c-8b0d-ad1b92c383db tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:53.749113 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6aa0a0cd-dc7d-427c-8b0d-ad1b92c383db tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931" status: 200 len: 1522 microversion: 2.1 time: 0.353632 Jul 18 02:33:53.751707 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1811/3622] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:53 2022] GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931 => generated 1522 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:53.783752 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c6b0143d-6cb1-4f17-ad1d-6552da3b8745 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:53.785257 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c6b0143d-6cb1-4f17-ad1d-6552da3b8745 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 11b342d8-ebdd-4072-a6ec-d6bc21761582] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:53.798064 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c6b0143d-6cb1-4f17-ad1d-6552da3b8745 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:53.799365 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c6b0143d-6cb1-4f17-ad1d-6552da3b8745 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:53.801108 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c6b0143d-6cb1-4f17-ad1d-6552da3b8745 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:53.802338 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c6b0143d-6cb1-4f17-ad1d-6552da3b8745 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:53.852998 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-c6b0143d-6cb1-4f17-ad1d-6552da3b8745 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] HTTP exception thrown: Instance 11b342d8-ebdd-4072-a6ec-d6bc21761582 could not be found. Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c6b0143d-6cb1-4f17-ad1d-6552da3b8745 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Request method failure captured: Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582 HTTP/1.1 Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MXCIOaod40m20WbrLAhvejXGgWGYoScZiJAmiZ3HizCiwZHoCKVassRVJDupAhRDpTMtTimuOSkPApLvzXSkpOpBrwwrergLjoegz_JjcMtdTQfoVFrmGdxUcPNhAsxqRnRRjAYgmYy-Lg7-6jhiq3gGYKCnlWdIaGKSFm4o5hpmOw Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 2a2eddce815546778247c5d0c9986610 Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersTestMultiNic-942367850 Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2a2eddce815546778247c5d0c9986610"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2a2eddce815546778247c5d0c9986610"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2a2eddce815546778247c5d0c9986610"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2a2eddce815546778247c5d0c9986610"}]}] Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersTestMultiNic-942367850 Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 2a2eddce815546778247c5d0c9986610 Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersTestMultiNic-942367850 Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersTestMultiNic-942367850-project Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: c12b1d209c7c4bdfaa3f18b95095e065 Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersTestMultiNic-942367850-project Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 11b342d8-ebdd-4072-a6ec-d6bc21761582 could not be found. Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '11b342d8-ebdd-4072-a6ec-d6bc21761582'} Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11b342d8-ebdd-4072-a6ec-d6bc21761582 could not be found. Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:33:53.864000 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11b342d8-ebdd-4072-a6ec-d6bc21761582 could not be found. Jul 18 02:33:53.875730 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:53.875730 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:53.875730 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:53.875730 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:53.875730 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:53.875730 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:53.875730 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:33:53.875730 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:33:53.875730 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11b342d8-ebdd-4072-a6ec-d6bc21761582 could not be found. Jul 18 02:33:53.875730 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:53.883561 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c6b0143d-6cb1-4f17-ad1d-6552da3b8745 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Returning 404 to user: Instance 11b342d8-ebdd-4072-a6ec-d6bc21761582 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:33:53.885769 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c6b0143d-6cb1-4f17-ad1d-6552da3b8745 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "DELETE /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582" status: 404 len: 111 microversion: 2.1 time: 0.109409 Jul 18 02:33:53.896387 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1812/3623] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:33:53 2022] DELETE /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:33:53.903860 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1f319d4d-7eaa-480a-8666-0827b08b9e5a tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:53.905767 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1f319d4d-7eaa-480a-8666-0827b08b9e5a tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 11b342d8-ebdd-4072-a6ec-d6bc21761582] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:53.931882 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1f319d4d-7eaa-480a-8666-0827b08b9e5a tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:53.942550 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1f319d4d-7eaa-480a-8666-0827b08b9e5a tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:53.944253 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1f319d4d-7eaa-480a-8666-0827b08b9e5a tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:53.945091 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1f319d4d-7eaa-480a-8666-0827b08b9e5a tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:53.988266 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-1f319d4d-7eaa-480a-8666-0827b08b9e5a tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] HTTP exception thrown: Instance 11b342d8-ebdd-4072-a6ec-d6bc21761582 could not be found. Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1f319d4d-7eaa-480a-8666-0827b08b9e5a tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Request method failure captured: Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582 HTTP/1.1 Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MXCIOaod40m20WbrLAhvejXGgWGYoScZiJAmiZ3HizCiwZHoCKVassRVJDupAhRDpTMtTimuOSkPApLvzXSkpOpBrwwrergLjoegz_JjcMtdTQfoVFrmGdxUcPNhAsxqRnRRjAYgmYy-Lg7-6jhiq3gGYKCnlWdIaGKSFm4o5hpmOw Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 2a2eddce815546778247c5d0c9986610 Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersTestMultiNic-942367850 Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2a2eddce815546778247c5d0c9986610"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2a2eddce815546778247c5d0c9986610"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2a2eddce815546778247c5d0c9986610"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2a2eddce815546778247c5d0c9986610"}]}] Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersTestMultiNic-942367850 Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 2a2eddce815546778247c5d0c9986610 Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersTestMultiNic-942367850 Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersTestMultiNic-942367850-project Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: c12b1d209c7c4bdfaa3f18b95095e065 Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersTestMultiNic-942367850-project Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 11b342d8-ebdd-4072-a6ec-d6bc21761582 could not be found. Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '11b342d8-ebdd-4072-a6ec-d6bc21761582'} Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11b342d8-ebdd-4072-a6ec-d6bc21761582 could not be found. Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11b342d8-ebdd-4072-a6ec-d6bc21761582 could not be found. Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:53.990810 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:53.994558 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:53.994558 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:53.994558 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:53.994558 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:33:53.994558 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:33:53.994558 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11b342d8-ebdd-4072-a6ec-d6bc21761582 could not be found. Jul 18 02:33:53.994558 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:53.996971 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1f319d4d-7eaa-480a-8666-0827b08b9e5a tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Returning 404 to user: Instance 11b342d8-ebdd-4072-a6ec-d6bc21761582 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:33:53.998224 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1f319d4d-7eaa-480a-8666-0827b08b9e5a tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582" status: 404 len: 111 microversion: 2.1 time: 0.102755 Jul 18 02:33:53.999579 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1812/3624] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:53 2022] GET /compute/v2.1/servers/11b342d8-ebdd-4072-a6ec-d6bc21761582 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:33:54.010692 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-612eae91-e3f2-4e7e-8756-9b85a8cd6d62 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:54.012365 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-612eae91-e3f2-4e7e-8756-9b85a8cd6d62 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 6faedf52-1ea8-4a05-8857-d0f8be1fadf9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:54.023214 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-612eae91-e3f2-4e7e-8756-9b85a8cd6d62 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:54.024127 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-612eae91-e3f2-4e7e-8756-9b85a8cd6d62 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:54.025323 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-612eae91-e3f2-4e7e-8756-9b85a8cd6d62 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:54.025941 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-612eae91-e3f2-4e7e-8756-9b85a8cd6d62 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:54.070749 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-612eae91-e3f2-4e7e-8756-9b85a8cd6d62 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] HTTP exception thrown: Instance 6faedf52-1ea8-4a05-8857-d0f8be1fadf9 could not be found. Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-612eae91-e3f2-4e7e-8756-9b85a8cd6d62 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Request method failure captured: Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9 HTTP/1.1 Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MXCIOaod40m20WbrLAhvejXGgWGYoScZiJAmiZ3HizCiwZHoCKVassRVJDupAhRDpTMtTimuOSkPApLvzXSkpOpBrwwrergLjoegz_JjcMtdTQfoVFrmGdxUcPNhAsxqRnRRjAYgmYy-Lg7-6jhiq3gGYKCnlWdIaGKSFm4o5hpmOw Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 2a2eddce815546778247c5d0c9986610 Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersTestMultiNic-942367850 Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2a2eddce815546778247c5d0c9986610"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2a2eddce815546778247c5d0c9986610"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2a2eddce815546778247c5d0c9986610"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2a2eddce815546778247c5d0c9986610"}]}] Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersTestMultiNic-942367850 Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 2a2eddce815546778247c5d0c9986610 Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersTestMultiNic-942367850 Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersTestMultiNic-942367850-project Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: c12b1d209c7c4bdfaa3f18b95095e065 Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersTestMultiNic-942367850-project Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 6faedf52-1ea8-4a05-8857-d0f8be1fadf9 could not be found. Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '6faedf52-1ea8-4a05-8857-d0f8be1fadf9'} Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6faedf52-1ea8-4a05-8857-d0f8be1fadf9 could not be found. Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:33:54.072798 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6faedf52-1ea8-4a05-8857-d0f8be1fadf9 could not be found. Jul 18 02:33:54.077204 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:54.077204 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:54.077204 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:54.077204 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:54.077204 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:54.077204 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:54.077204 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:33:54.077204 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:33:54.077204 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6faedf52-1ea8-4a05-8857-d0f8be1fadf9 could not be found. Jul 18 02:33:54.077204 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:54.079491 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-612eae91-e3f2-4e7e-8756-9b85a8cd6d62 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Returning 404 to user: Instance 6faedf52-1ea8-4a05-8857-d0f8be1fadf9 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:33:54.080791 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-612eae91-e3f2-4e7e-8756-9b85a8cd6d62 tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "DELETE /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9" status: 404 len: 111 microversion: 2.1 time: 0.074869 Jul 18 02:33:54.082795 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1813/3625] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:33:54 2022] DELETE /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:33:54.097139 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ec26def9-dcc0-4d00-bc6c-467470412bba tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:54.097671 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ec26def9-dcc0-4d00-bc6c-467470412bba tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] [instance: 6faedf52-1ea8-4a05-8857-d0f8be1fadf9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:54.107038 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ec26def9-dcc0-4d00-bc6c-467470412bba tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:54.107507 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ec26def9-dcc0-4d00-bc6c-467470412bba tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:54.108326 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ec26def9-dcc0-4d00-bc6c-467470412bba tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:54.108841 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ec26def9-dcc0-4d00-bc6c-467470412bba tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:54.128336 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-ec26def9-dcc0-4d00-bc6c-467470412bba tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] HTTP exception thrown: Instance 6faedf52-1ea8-4a05-8857-d0f8be1fadf9 could not be found. Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ec26def9-dcc0-4d00-bc6c-467470412bba tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Request method failure captured: Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9 HTTP/1.1 Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MXCIOaod40m20WbrLAhvejXGgWGYoScZiJAmiZ3HizCiwZHoCKVassRVJDupAhRDpTMtTimuOSkPApLvzXSkpOpBrwwrergLjoegz_JjcMtdTQfoVFrmGdxUcPNhAsxqRnRRjAYgmYy-Lg7-6jhiq3gGYKCnlWdIaGKSFm4o5hpmOw Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 2a2eddce815546778247c5d0c9986610 Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersTestMultiNic-942367850 Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2a2eddce815546778247c5d0c9986610"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2a2eddce815546778247c5d0c9986610"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2a2eddce815546778247c5d0c9986610"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2a2eddce815546778247c5d0c9986610"}]}] Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersTestMultiNic-942367850 Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 2a2eddce815546778247c5d0c9986610 Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersTestMultiNic-942367850 Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersTestMultiNic-942367850-project Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: c12b1d209c7c4bdfaa3f18b95095e065 Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersTestMultiNic-942367850-project Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 6faedf52-1ea8-4a05-8857-d0f8be1fadf9 could not be found. Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '6faedf52-1ea8-4a05-8857-d0f8be1fadf9'} Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6faedf52-1ea8-4a05-8857-d0f8be1fadf9 could not be found. Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6faedf52-1ea8-4a05-8857-d0f8be1fadf9 could not be found. Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:54.130203 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:54.133958 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:54.133958 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:54.133958 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:54.133958 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:33:54.133958 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:33:54.133958 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6faedf52-1ea8-4a05-8857-d0f8be1fadf9 could not be found. Jul 18 02:33:54.133958 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:33:54.133958 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ec26def9-dcc0-4d00-bc6c-467470412bba tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] Returning 404 to user: Instance 6faedf52-1ea8-4a05-8857-d0f8be1fadf9 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:33:54.133958 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ec26def9-dcc0-4d00-bc6c-467470412bba tempest-ServersTestMultiNic-942367850 tempest-ServersTestMultiNic-942367850-project] 10.222.0.57 "GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9" status: 404 len: 111 microversion: 2.1 time: 0.043996 Jul 18 02:33:54.133958 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1813/3626] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:54 2022] GET /compute/v2.1/servers/6faedf52-1ea8-4a05-8857-d0f8be1fadf9 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:33:54.166502 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-13297736-8200-4cb4-bc63-de604e9c5e49 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:54.167651 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-13297736-8200-4cb4-bc63-de604e9c5e49 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 15dfd562-5a76-41af-937e-41e44c96b4c1] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:54.181958 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-13297736-8200-4cb4-bc63-de604e9c5e49 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:54.182910 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-13297736-8200-4cb4-bc63-de604e9c5e49 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:54.185906 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-13297736-8200-4cb4-bc63-de604e9c5e49 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:54.187173 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-13297736-8200-4cb4-bc63-de604e9c5e49 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:54.421982 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-13297736-8200-4cb4-bc63-de604e9c5e49 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:54.434964 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-13297736-8200-4cb4-bc63-de604e9c5e49 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:54.438860 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-13297736-8200-4cb4-bc63-de604e9c5e49 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:54.440659 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-13297736-8200-4cb4-bc63-de604e9c5e49 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1" status: 200 len: 1366 microversion: 2.47 time: 0.281393 Jul 18 02:33:54.441609 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1814/3627] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:33:54 2022] GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1 => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:33:54.777819 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1e753265-f170-4004-b729-9b4112de2e35 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:54.778468 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1e753265-f170-4004-b729-9b4112de2e35 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: 02425120-f4dc-4f02-99c5-9bf0fe7e1931] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:54.792824 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1e753265-f170-4004-b729-9b4112de2e35 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:54.793297 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1e753265-f170-4004-b729-9b4112de2e35 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:54.794253 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1e753265-f170-4004-b729-9b4112de2e35 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:54.794703 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1e753265-f170-4004-b729-9b4112de2e35 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:54.798852 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:55.266867 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1e753265-f170-4004-b729-9b4112de2e35 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:55.292865 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1e753265-f170-4004-b729-9b4112de2e35 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931" status: 200 len: 1502 microversion: 2.1 time: 0.518452 Jul 18 02:33:55.296524 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1814/3628] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:54 2022] GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931 => generated 1502 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:55.334898 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6fb30cf1-b2aa-457c-b61d-4eea6a9fa858 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7b83cbf-59f7-459a-a8ed-3e50503f20d0"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:55.337005 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6fb30cf1-b2aa-457c-b61d-4eea6a9fa858 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: 02425120-f4dc-4f02-99c5-9bf0fe7e1931] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:55.380282 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6fb30cf1-b2aa-457c-b61d-4eea6a9fa858 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:55.381632 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6fb30cf1-b2aa-457c-b61d-4eea6a9fa858 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:55.385104 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6fb30cf1-b2aa-457c-b61d-4eea6a9fa858 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:55.387812 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6fb30cf1-b2aa-457c-b61d-4eea6a9fa858 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:55.485689 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1fcdfa23-6356-4e1b-b43a-a4620714458d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:55.495050 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1fcdfa23-6356-4e1b-b43a-a4620714458d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 15dfd562-5a76-41af-937e-41e44c96b4c1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:55.519027 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-6fb30cf1-b2aa-457c-b61d-4eea6a9fa858 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] HTTP exception thrown: Cannot 'attach_volume' instance 02425120-f4dc-4f02-99c5-9bf0fe7e1931 while it is in vm_state rescued Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6fb30cf1-b2aa-457c-b61d-4eea6a9fa858 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Request method failure captured: Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931/os-volume_attachments HTTP/1.1 Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 74 Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MYgsMpQMGg_x4SatJimijJMXDATUd7K8pbmJMir06_hhN9kc6nEv2UNuBHWPOsjhgniijNTcv86Pv1g5if6jfxnXnFgylGVtP-ES0p4q8KsL3cpv9H2D_niEdkyIvqxweiHovqWE9ZMi6DufO28-UhMwnDHb097CRDIZ6xtrA6LrKI Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 1594a06c4e7c4bb7b184d916342933ba Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1345973443 Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1594a06c4e7c4bb7b184d916342933ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1594a06c4e7c4bb7b184d916342933ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1594a06c4e7c4bb7b184d916342933ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1594a06c4e7c4bb7b184d916342933ba"}]}] Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1345973443 Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 1594a06c4e7c4bb7b184d916342933ba Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1345973443 Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServerRescueNegativeTestJSON-1345973443-project Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 6f30a2016d954121bb251894fad6dd39 Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1345973443-project Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: {"volumeAttachment": {"volumeId": "f7b83cbf-59f7-459a-a8ed-3e50503f20d0"}} Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: exception: Cannot 'attach_volume' instance 02425120-f4dc-4f02-99c5-9bf0fe7e1931 while it is in vm_state rescued Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'server_id': '02425120-f4dc-4f02-99c5-9bf0fe7e1931', 'body': {'volumeAttachment': {'volumeId': 'f7b83cbf-59f7-459a-a8ed-3e50503f20d0'}}} Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 02425120-f4dc-4f02-99c5-9bf0fe7e1931 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 18 02:33:55.526265 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 02:33:55.534506 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 02:33:55.534506 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 02:33:55.534506 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 02425120-f4dc-4f02-99c5-9bf0fe7e1931 while it is in vm_state rescued Jul 18 02:33:55.534506 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:55.534506 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:55.534506 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:55.534506 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:55.534506 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:55.534506 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:55.534506 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:33:55.534506 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:33:55.534506 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 02425120-f4dc-4f02-99c5-9bf0fe7e1931 while it is in vm_state rescued Jul 18 02:33:55.534506 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:33:55.536781 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1fcdfa23-6356-4e1b-b43a-a4620714458d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:55.536781 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1fcdfa23-6356-4e1b-b43a-a4620714458d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:55.538772 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6fb30cf1-b2aa-457c-b61d-4eea6a9fa858 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Returning 409 to user: Cannot 'attach_volume' instance 02425120-f4dc-4f02-99c5-9bf0fe7e1931 while it is in vm_state rescued {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:33:55.540034 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6fb30cf1-b2aa-457c-b61d-4eea6a9fa858 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "POST /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.215169 Jul 18 02:33:55.541306 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1fcdfa23-6356-4e1b-b43a-a4620714458d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:55.546643 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1815/3629] 10.222.0.57 () {60 vars in 1322 bytes} [Mon Jul 18 02:33:55 2022] POST /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931/os-volume_attachments => generated 152 bytes in 223 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:33:55.547612 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1fcdfa23-6356-4e1b-b43a-a4620714458d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:55.561046 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ef8fcd31-5f0a-49b8-ae83-3881e3e91204 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:55.567206 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ef8fcd31-5f0a-49b8-ae83-3881e3e91204 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: 02425120-f4dc-4f02-99c5-9bf0fe7e1931] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:55.597888 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ef8fcd31-5f0a-49b8-ae83-3881e3e91204 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:55.599159 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ef8fcd31-5f0a-49b8-ae83-3881e3e91204 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:55.600189 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ef8fcd31-5f0a-49b8-ae83-3881e3e91204 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:55.600819 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ef8fcd31-5f0a-49b8-ae83-3881e3e91204 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:55.749825 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ef8fcd31-5f0a-49b8-ae83-3881e3e91204 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "POST /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931/action" status: 202 len: 0 microversion: 2.1 time: 0.199382 Jul 18 02:33:55.758460 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1816/3630] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:33:55 2022] POST /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:33:55.772403 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2f93f49c-d63c-443e-802f-8f2d576f0364 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:55.777922 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2f93f49c-d63c-443e-802f-8f2d576f0364 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: 02425120-f4dc-4f02-99c5-9bf0fe7e1931] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:55.791738 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2f93f49c-d63c-443e-802f-8f2d576f0364 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:55.796998 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2f93f49c-d63c-443e-802f-8f2d576f0364 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:55.799310 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2f93f49c-d63c-443e-802f-8f2d576f0364 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:55.800572 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2f93f49c-d63c-443e-802f-8f2d576f0364 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:55.897108 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1fcdfa23-6356-4e1b-b43a-a4620714458d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:55.919899 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1fcdfa23-6356-4e1b-b43a-a4620714458d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:55.926878 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1fcdfa23-6356-4e1b-b43a-a4620714458d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:55.949241 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1fcdfa23-6356-4e1b-b43a-a4620714458d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1" status: 200 len: 1366 microversion: 2.47 time: 0.474166 Jul 18 02:33:55.951225 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1815/3631] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:33:55 2022] GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1 => generated 1366 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:33:56.990149 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1d96246b-e7c3-4f3c-9fb6-c3059ab6e4ed tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:56.993792 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1d96246b-e7c3-4f3c-9fb6-c3059ab6e4ed tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 15dfd562-5a76-41af-937e-41e44c96b4c1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:57.019005 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1d96246b-e7c3-4f3c-9fb6-c3059ab6e4ed tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:57.025638 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1d96246b-e7c3-4f3c-9fb6-c3059ab6e4ed tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:57.027970 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1d96246b-e7c3-4f3c-9fb6-c3059ab6e4ed tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:57.029249 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1d96246b-e7c3-4f3c-9fb6-c3059ab6e4ed tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:58.058516 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1d96246b-e7c3-4f3c-9fb6-c3059ab6e4ed tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:58.092123 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1d96246b-e7c3-4f3c-9fb6-c3059ab6e4ed tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:58.098356 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1d96246b-e7c3-4f3c-9fb6-c3059ab6e4ed tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:58.100724 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1d96246b-e7c3-4f3c-9fb6-c3059ab6e4ed tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1" status: 200 len: 1366 microversion: 2.47 time: 1.118585 Jul 18 02:33:58.101844 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1816/3632] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:33:56 2022] GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1 => generated 1366 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:33:58.214167 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2f93f49c-d63c-443e-802f-8f2d576f0364 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:58.258446 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2f93f49c-d63c-443e-802f-8f2d576f0364 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931" status: 200 len: 1510 microversion: 2.1 time: 2.492488 Jul 18 02:33:58.259483 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1817/3633] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:55 2022] GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931 => generated 1510 bytes in 2496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:33:59.128866 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8457b92a-a8e6-4dda-aa18-b5144f0de40e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:59.132003 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8457b92a-a8e6-4dda-aa18-b5144f0de40e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 15dfd562-5a76-41af-937e-41e44c96b4c1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:59.168383 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8457b92a-a8e6-4dda-aa18-b5144f0de40e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:59.171813 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8457b92a-a8e6-4dda-aa18-b5144f0de40e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:59.173725 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8457b92a-a8e6-4dda-aa18-b5144f0de40e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:59.178525 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8457b92a-a8e6-4dda-aa18-b5144f0de40e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:59.293104 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-65b531fa-3359-4889-af12-d1c5876fab5e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:59.294797 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-65b531fa-3359-4889-af12-d1c5876fab5e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: 02425120-f4dc-4f02-99c5-9bf0fe7e1931] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:59.319737 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:59.324888 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65b531fa-3359-4889-af12-d1c5876fab5e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:59.327598 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65b531fa-3359-4889-af12-d1c5876fab5e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:59.329949 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65b531fa-3359-4889-af12-d1c5876fab5e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:59.330983 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65b531fa-3359-4889-af12-d1c5876fab5e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:59.565252 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8457b92a-a8e6-4dda-aa18-b5144f0de40e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:59.608302 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8457b92a-a8e6-4dda-aa18-b5144f0de40e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:59.614932 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8457b92a-a8e6-4dda-aa18-b5144f0de40e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:59.621900 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8457b92a-a8e6-4dda-aa18-b5144f0de40e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1" status: 200 len: 1366 microversion: 2.47 time: 0.499483 Jul 18 02:33:59.626183 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1817/3634] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:33:59 2022] GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1 => generated 1366 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:00.052135 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-65b531fa-3359-4889-af12-d1c5876fab5e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:00.086294 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-65b531fa-3359-4889-af12-d1c5876fab5e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931" status: 200 len: 1510 microversion: 2.1 time: 0.787802 Jul 18 02:34:00.087889 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1818/3635] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:59 2022] GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931 => generated 1510 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:00.686516 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8a74fcfa-dd6c-4ac6-9945-4cf871f07665 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:00.694506 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8a74fcfa-dd6c-4ac6-9945-4cf871f07665 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 15dfd562-5a76-41af-937e-41e44c96b4c1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:00.735987 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8a74fcfa-dd6c-4ac6-9945-4cf871f07665 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:00.737372 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8a74fcfa-dd6c-4ac6-9945-4cf871f07665 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:00.746525 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8a74fcfa-dd6c-4ac6-9945-4cf871f07665 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:00.747340 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8a74fcfa-dd6c-4ac6-9945-4cf871f07665 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:00.979100 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8a74fcfa-dd6c-4ac6-9945-4cf871f07665 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:01.005938 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8a74fcfa-dd6c-4ac6-9945-4cf871f07665 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:01.024694 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8a74fcfa-dd6c-4ac6-9945-4cf871f07665 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:01.026004 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8a74fcfa-dd6c-4ac6-9945-4cf871f07665 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1" status: 200 len: 1366 microversion: 2.47 time: 0.382669 Jul 18 02:34:01.026605 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1818/3636] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:00 2022] GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1 => generated 1366 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:01.112031 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b95ac5f7-2d58-496d-ab20-817318222fff tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:01.113351 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b95ac5f7-2d58-496d-ab20-817318222fff tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: 02425120-f4dc-4f02-99c5-9bf0fe7e1931] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:01.151936 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b95ac5f7-2d58-496d-ab20-817318222fff tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:01.153062 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b95ac5f7-2d58-496d-ab20-817318222fff tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:01.154796 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b95ac5f7-2d58-496d-ab20-817318222fff tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:01.159437 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b95ac5f7-2d58-496d-ab20-817318222fff tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:01.189065 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:01.999580 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b95ac5f7-2d58-496d-ab20-817318222fff tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:02.059267 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8e6751fc-a77a-47a7-a8c0-2aab6c4ea086 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:02.062022 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8e6751fc-a77a-47a7-a8c0-2aab6c4ea086 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 15dfd562-5a76-41af-937e-41e44c96b4c1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:02.084608 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b95ac5f7-2d58-496d-ab20-817318222fff tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931" status: 200 len: 1510 microversion: 2.1 time: 0.982812 Jul 18 02:34:02.086073 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1819/3637] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:01 2022] GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931 => generated 1510 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:02.110194 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8e6751fc-a77a-47a7-a8c0-2aab6c4ea086 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:02.113190 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8e6751fc-a77a-47a7-a8c0-2aab6c4ea086 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:02.118796 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8e6751fc-a77a-47a7-a8c0-2aab6c4ea086 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:02.120382 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8e6751fc-a77a-47a7-a8c0-2aab6c4ea086 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:02.277111 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8e6751fc-a77a-47a7-a8c0-2aab6c4ea086 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:02.304449 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8e6751fc-a77a-47a7-a8c0-2aab6c4ea086 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:02.306299 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8e6751fc-a77a-47a7-a8c0-2aab6c4ea086 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:02.307541 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8e6751fc-a77a-47a7-a8c0-2aab6c4ea086 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1" status: 200 len: 1366 microversion: 2.47 time: 0.262151 Jul 18 02:34:02.315959 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1819/3638] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:02 2022] GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1 => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:02.637389 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-36967358-d7b3-47d9-9ac1-a9f4e901dd54 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:02.639864 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-36967358-d7b3-47d9-9ac1-a9f4e901dd54 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] [instance: 122b7de0-abb6-4349-8559-f7cee46ef7d1] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:02.668636 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-36967358-d7b3-47d9-9ac1-a9f4e901dd54 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:02.669843 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-36967358-d7b3-47d9-9ac1-a9f4e901dd54 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:02.674001 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-36967358-d7b3-47d9-9ac1-a9f4e901dd54 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:02.676475 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-36967358-d7b3-47d9-9ac1-a9f4e901dd54 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:02.742082 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-36967358-d7b3-47d9-9ac1-a9f4e901dd54 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] [instance: 122b7de0-abb6-4349-8559-f7cee46ef7d1] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:34:02.999808 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-36967358-d7b3-47d9-9ac1-a9f4e901dd54 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] 10.222.0.57 "DELETE /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1" status: 204 len: 0 microversion: 2.1 time: 0.369573 Jul 18 02:34:03.007401 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1820/3639] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:34:02 2022] DELETE /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:34:03.017258 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3d534f11-e619-4b0d-a265-6ee393419e21 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:03.018106 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3d534f11-e619-4b0d-a265-6ee393419e21 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] [instance: 122b7de0-abb6-4349-8559-f7cee46ef7d1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:03.044090 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3d534f11-e619-4b0d-a265-6ee393419e21 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:03.044090 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3d534f11-e619-4b0d-a265-6ee393419e21 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:03.044090 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3d534f11-e619-4b0d-a265-6ee393419e21 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:03.044090 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3d534f11-e619-4b0d-a265-6ee393419e21 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:03.105271 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-00d7695d-9f16-43c5-98ae-4296dde712b4 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:03.106224 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-00d7695d-9f16-43c5-98ae-4296dde712b4 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: 02425120-f4dc-4f02-99c5-9bf0fe7e1931] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:03.126714 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-00d7695d-9f16-43c5-98ae-4296dde712b4 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:03.127066 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-00d7695d-9f16-43c5-98ae-4296dde712b4 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:03.130998 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-00d7695d-9f16-43c5-98ae-4296dde712b4 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:03.132311 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-00d7695d-9f16-43c5-98ae-4296dde712b4 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:03.503061 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3d534f11-e619-4b0d-a265-6ee393419e21 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9299d3b336b4ca8b3ac5e8497e26ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5db9a43df045ea89156bf5f45f5108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:03.512419 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3d534f11-e619-4b0d-a265-6ee393419e21 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] 10.222.0.57 "GET /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1" status: 200 len: 1470 microversion: 2.1 time: 0.500750 Jul 18 02:34:03.518212 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1820/3640] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:03 2022] GET /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1 => generated 1470 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:03.523817 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5c9502e8-281b-4ff1-895f-197e7150f004 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:03.524649 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5c9502e8-281b-4ff1-895f-197e7150f004 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 15dfd562-5a76-41af-937e-41e44c96b4c1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:03.553013 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5c9502e8-281b-4ff1-895f-197e7150f004 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:03.555495 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5c9502e8-281b-4ff1-895f-197e7150f004 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:03.559767 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5c9502e8-281b-4ff1-895f-197e7150f004 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:03.560488 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5c9502e8-281b-4ff1-895f-197e7150f004 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:03.704342 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-00d7695d-9f16-43c5-98ae-4296dde712b4 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:03.717475 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-00d7695d-9f16-43c5-98ae-4296dde712b4 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931" status: 200 len: 1516 microversion: 2.1 time: 0.616856 Jul 18 02:34:03.721028 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1821/3641] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:03 2022] GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931 => generated 1516 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:03.801966 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5c9502e8-281b-4ff1-895f-197e7150f004 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:03.831913 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5c9502e8-281b-4ff1-895f-197e7150f004 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:03.834474 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5c9502e8-281b-4ff1-895f-197e7150f004 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:03.837471 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5c9502e8-281b-4ff1-895f-197e7150f004 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1" status: 200 len: 1366 microversion: 2.47 time: 0.318036 Jul 18 02:34:03.841666 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1821/3642] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:03 2022] GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1 => generated 1366 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:04.641034 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-66e140ea-7767-4cd1-bbe5-6268ae2da5dc tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:04.641865 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-66e140ea-7767-4cd1-bbe5-6268ae2da5dc tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] [instance: 122b7de0-abb6-4349-8559-f7cee46ef7d1] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:04.650480 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-66e140ea-7767-4cd1-bbe5-6268ae2da5dc tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:04.651326 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-66e140ea-7767-4cd1-bbe5-6268ae2da5dc tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:04.652393 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-66e140ea-7767-4cd1-bbe5-6268ae2da5dc tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:04.653059 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-66e140ea-7767-4cd1-bbe5-6268ae2da5dc tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:04.881202 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8882e26e-1861-41b4-ae81-8519a748e3d4 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:04.884518 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8882e26e-1861-41b4-ae81-8519a748e3d4 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 15dfd562-5a76-41af-937e-41e44c96b4c1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:04.907669 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8882e26e-1861-41b4-ae81-8519a748e3d4 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:04.909063 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8882e26e-1861-41b4-ae81-8519a748e3d4 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:04.911088 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8882e26e-1861-41b4-ae81-8519a748e3d4 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:04.912190 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8882e26e-1861-41b4-ae81-8519a748e3d4 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:05.427999 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8882e26e-1861-41b4-ae81-8519a748e3d4 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:05.449689 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8882e26e-1861-41b4-ae81-8519a748e3d4 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:05.452448 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8882e26e-1861-41b4-ae81-8519a748e3d4 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:05.454497 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8882e26e-1861-41b4-ae81-8519a748e3d4 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1" status: 200 len: 1366 microversion: 2.47 time: 0.590812 Jul 18 02:34:05.455867 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1822/3643] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:04 2022] GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1 => generated 1366 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:05.753202 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-66e140ea-7767-4cd1-bbe5-6268ae2da5dc tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9299d3b336b4ca8b3ac5e8497e26ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5db9a43df045ea89156bf5f45f5108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:05.772724 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-66e140ea-7767-4cd1-bbe5-6268ae2da5dc tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] 10.222.0.57 "GET /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1" status: 200 len: 1470 microversion: 2.1 time: 1.135610 Jul 18 02:34:05.774790 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1822/3644] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:04 2022] GET /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1 => generated 1470 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:06.478338 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0dae7fa0-40a5-4596-9262-dc3ee85f419b tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:06.480011 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0dae7fa0-40a5-4596-9262-dc3ee85f419b tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 15dfd562-5a76-41af-937e-41e44c96b4c1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:06.494550 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0dae7fa0-40a5-4596-9262-dc3ee85f419b tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:06.495616 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0dae7fa0-40a5-4596-9262-dc3ee85f419b tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:06.497586 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0dae7fa0-40a5-4596-9262-dc3ee85f419b tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:06.499258 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0dae7fa0-40a5-4596-9262-dc3ee85f419b tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:06.744396 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8ff12d5b-139b-4055-8135-e256ac4c2e4e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Action: 'create', calling method: .version_select at 0x7ff49b86dee0>, body: {"keypair": {"name": "tempest-keypair-1298173662", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFavm6suVT2DIVMhVsOz1Dg3fSe1og+XQwILhEDI+WqjK8eslMN20gZuQpXV7VYBdIfw/ZT2ef3mWr9LKbvv50F7szNeej1NPnpUFjO0pZcv5w94FUvld7CGNF2nq6/xw=="}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:34:06.779918 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-8ff12d5b-139b-4055-8135-e256ac4c2e4e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Getting quotas for project 1594a06c4e7c4bb7b184d916342933ba. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:34:06.793837 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-8ff12d5b-139b-4055-8135-e256ac4c2e4e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Getting quotas for user 6f30a2016d954121bb251894fad6dd39 and project 1594a06c4e7c4bb7b184d916342933ba. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:34:06.886243 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8ff12d5b-139b-4055-8135-e256ac4c2e4e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.148239 Jul 18 02:34:06.887399 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1823/3645] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 02:34:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:34:06.913746 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-57f5f532-6565-4eef-9ed1-a3aa76d11b43 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:06.914857 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-57f5f532-6565-4eef-9ed1-a3aa76d11b43 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] [instance: 122b7de0-abb6-4349-8559-f7cee46ef7d1] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:06.924032 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-57f5f532-6565-4eef-9ed1-a3aa76d11b43 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:06.924778 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-57f5f532-6565-4eef-9ed1-a3aa76d11b43 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:06.926349 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-57f5f532-6565-4eef-9ed1-a3aa76d11b43 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:06.927018 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-57f5f532-6565-4eef-9ed1-a3aa76d11b43 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:07.212151 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0dae7fa0-40a5-4596-9262-dc3ee85f419b tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:07.223627 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0dae7fa0-40a5-4596-9262-dc3ee85f419b tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:07.225912 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0dae7fa0-40a5-4596-9262-dc3ee85f419b tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:07.227676 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0dae7fa0-40a5-4596-9262-dc3ee85f419b tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1" status: 200 len: 1366 microversion: 2.47 time: 0.755967 Jul 18 02:34:07.242296 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1823/3646] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:06 2022] GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1 => generated 1366 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:34:07.309138 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-57f5f532-6565-4eef-9ed1-a3aa76d11b43 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9299d3b336b4ca8b3ac5e8497e26ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5db9a43df045ea89156bf5f45f5108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:07.323411 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-57f5f532-6565-4eef-9ed1-a3aa76d11b43 tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] 10.222.0.57 "GET /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1" status: 200 len: 1470 microversion: 2.1 time: 0.433355 Jul 18 02:34:07.324545 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1824/3647] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:06 2022] GET /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1 => generated 1470 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:07.572575 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-49b0b1fb-dc3f-4c80-a670-af357edd5093 req-cd6d8e0b-596d-4f15-a542-4d9114ddb4d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "122b7de0-abb6-4349-8559-f7cee46ef7d1", "name": "network-vif-deleted", "tag": "3a9ceb82-5570-44ca-ba02-95c394949ab3"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:34:07.599980 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-49b0b1fb-dc3f-4c80-a670-af357edd5093 req-cd6d8e0b-596d-4f15-a542-4d9114ddb4d8 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:07.609830 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-49b0b1fb-dc3f-4c80-a670-af357edd5093 req-cd6d8e0b-596d-4f15-a542-4d9114ddb4d8 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:07.667376 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-49b0b1fb-dc3f-4c80-a670-af357edd5093 req-cd6d8e0b-596d-4f15-a542-4d9114ddb4d8 service nova] Creating event network-vif-deleted:3a9ceb82-5570-44ca-ba02-95c394949ab3 for instance 122b7de0-abb6-4349-8559-f7cee46ef7d1 on n-h1-465891-3 Jul 18 02:34:07.685075 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-49b0b1fb-dc3f-4c80-a670-af357edd5093 req-cd6d8e0b-596d-4f15-a542-4d9114ddb4d8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116146 Jul 18 02:34:07.687007 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1824/3648] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:34:08.248022 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7e63b97c-1d2e-4240-a0c3-e2e24dabff77 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:08.249418 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7e63b97c-1d2e-4240-a0c3-e2e24dabff77 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 15dfd562-5a76-41af-937e-41e44c96b4c1] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:08.268914 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7e63b97c-1d2e-4240-a0c3-e2e24dabff77 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:08.269531 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7e63b97c-1d2e-4240-a0c3-e2e24dabff77 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:08.270390 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7e63b97c-1d2e-4240-a0c3-e2e24dabff77 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:08.271028 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7e63b97c-1d2e-4240-a0c3-e2e24dabff77 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:08.361214 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-57e1e17d-06a8-4e62-a20b-7f44089f733e tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:08.378711 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-57e1e17d-06a8-4e62-a20b-7f44089f733e tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] [instance: 122b7de0-abb6-4349-8559-f7cee46ef7d1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:08.403520 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7e63b97c-1d2e-4240-a0c3-e2e24dabff77 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:08.414470 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7e63b97c-1d2e-4240-a0c3-e2e24dabff77 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:08.416166 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-57e1e17d-06a8-4e62-a20b-7f44089f733e tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:08.416921 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7e63b97c-1d2e-4240-a0c3-e2e24dabff77 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:08.418866 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7e63b97c-1d2e-4240-a0c3-e2e24dabff77 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1" status: 200 len: 1366 microversion: 2.47 time: 0.174812 Jul 18 02:34:08.420165 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1825/3649] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:08 2022] GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:08.424631 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-57e1e17d-06a8-4e62-a20b-7f44089f733e tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:08.425581 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-57e1e17d-06a8-4e62-a20b-7f44089f733e tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:08.426064 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-57e1e17d-06a8-4e62-a20b-7f44089f733e tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:08.572865 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-57e1e17d-06a8-4e62-a20b-7f44089f733e tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:08.573541 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-57e1e17d-06a8-4e62-a20b-7f44089f733e tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:08.587206 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-57e1e17d-06a8-4e62-a20b-7f44089f733e tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lazy-loading 'fault' on Instance uuid 122b7de0-abb6-4349-8559-f7cee46ef7d1 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:34:08.666359 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-57e1e17d-06a8-4e62-a20b-7f44089f733e tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9299d3b336b4ca8b3ac5e8497e26ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5db9a43df045ea89156bf5f45f5108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:08.677822 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-57e1e17d-06a8-4e62-a20b-7f44089f733e tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] 10.222.0.57 "GET /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1" status: 200 len: 1304 microversion: 2.1 time: 0.323883 Jul 18 02:34:08.679310 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1825/3650] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:08 2022] GET /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1 => generated 1304 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:34:09.455449 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2059b686-c970-4d63-9fea-8d107219e56f tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:09.457279 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2059b686-c970-4d63-9fea-8d107219e56f tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 15dfd562-5a76-41af-937e-41e44c96b4c1] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:09.473761 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2059b686-c970-4d63-9fea-8d107219e56f tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:09.475840 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2059b686-c970-4d63-9fea-8d107219e56f tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:09.479680 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2059b686-c970-4d63-9fea-8d107219e56f tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:09.480885 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2059b686-c970-4d63-9fea-8d107219e56f tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:09.704638 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2059b686-c970-4d63-9fea-8d107219e56f tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:09.712001 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-84432901-9f59-4e9b-bc4f-634c26c9437e tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:09.717927 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-84432901-9f59-4e9b-bc4f-634c26c9437e tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] [instance: 122b7de0-abb6-4349-8559-f7cee46ef7d1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:09.736952 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2059b686-c970-4d63-9fea-8d107219e56f tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:09.744093 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2059b686-c970-4d63-9fea-8d107219e56f tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:09.746324 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-84432901-9f59-4e9b-bc4f-634c26c9437e tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:09.747662 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-84432901-9f59-4e9b-bc4f-634c26c9437e tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:09.749410 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2059b686-c970-4d63-9fea-8d107219e56f tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1" status: 200 len: 1366 microversion: 2.47 time: 0.299670 Jul 18 02:34:09.752772 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-84432901-9f59-4e9b-bc4f-634c26c9437e tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:09.753611 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-84432901-9f59-4e9b-bc4f-634c26c9437e tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:09.754101 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1826/3651] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:09 2022] GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1 => generated 1366 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:09.775356 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-84432901-9f59-4e9b-bc4f-634c26c9437e tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] HTTP exception thrown: Instance 122b7de0-abb6-4349-8559-f7cee46ef7d1 could not be found. Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-84432901-9f59-4e9b-bc4f-634c26c9437e tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Request method failure captured: Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1 HTTP/1.1 Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MXad6Uxviq8TUC-Iop4EWuWhHOJOkETIgGKqdykf6n38SMATz925tU01ySJBgY5sPf0ZL9VQPME2t_doTLVDd3FYWMw63u1JCyHvthm3JAxyFfruXtpGDrflZ-IbndFBWMU-FvzWQbpvta0W5suLDB8UN2kbl6FVArzCK-jHjWsPUY Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: ac5db9a43df045ea89156bf5f45f5108 Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-VolumesBackupsTest-1608345129 Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ac5db9a43df045ea89156bf5f45f5108"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ac5db9a43df045ea89156bf5f45f5108"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ac5db9a43df045ea89156bf5f45f5108"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ac5db9a43df045ea89156bf5f45f5108"}]}] Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-VolumesBackupsTest-1608345129 Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: ac5db9a43df045ea89156bf5f45f5108 Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-VolumesBackupsTest-1608345129 Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-VolumesBackupsTest-1608345129-project Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: b9299d3b336b4ca8b3ac5e8497e26ad7 Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-VolumesBackupsTest-1608345129-project Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 122b7de0-abb6-4349-8559-f7cee46ef7d1 could not be found. Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '122b7de0-abb6-4349-8559-f7cee46ef7d1'} Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 122b7de0-abb6-4349-8559-f7cee46ef7d1 could not be found. Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 122b7de0-abb6-4349-8559-f7cee46ef7d1 could not be found. Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:34:09.779178 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:34:09.783869 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:09.783869 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:34:09.783869 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:34:09.783869 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:34:09.783869 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:34:09.783869 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 122b7de0-abb6-4349-8559-f7cee46ef7d1 could not be found. Jul 18 02:34:09.783869 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:34:09.786496 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-84432901-9f59-4e9b-bc4f-634c26c9437e tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] Returning 404 to user: Instance 122b7de0-abb6-4349-8559-f7cee46ef7d1 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:34:09.787893 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-84432901-9f59-4e9b-bc4f-634c26c9437e tempest-VolumesBackupsTest-1608345129 tempest-VolumesBackupsTest-1608345129-project] 10.222.0.57 "GET /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1" status: 404 len: 111 microversion: 2.1 time: 0.089133 Jul 18 02:34:09.789382 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1826/3652] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:09 2022] GET /compute/v2.1/servers/122b7de0-abb6-4349-8559-f7cee46ef7d1 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:34:10.793239 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b75c6865-8e1c-4048-b9d8-29655a71effe tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:10.795730 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b75c6865-8e1c-4048-b9d8-29655a71effe tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 15dfd562-5a76-41af-937e-41e44c96b4c1] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:10.820227 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b75c6865-8e1c-4048-b9d8-29655a71effe tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:10.826460 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b75c6865-8e1c-4048-b9d8-29655a71effe tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:10.831872 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b75c6865-8e1c-4048-b9d8-29655a71effe tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:10.837683 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b75c6865-8e1c-4048-b9d8-29655a71effe tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:11.135717 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b75c6865-8e1c-4048-b9d8-29655a71effe tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:11.144920 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b75c6865-8e1c-4048-b9d8-29655a71effe tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:11.159270 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b75c6865-8e1c-4048-b9d8-29655a71effe tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:11.161605 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b75c6865-8e1c-4048-b9d8-29655a71effe tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1" status: 200 len: 1384 microversion: 2.47 time: 0.372116 Jul 18 02:34:11.162965 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1827/3653] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:10 2022] GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1 => generated 1384 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:34:12.197040 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2979db5d-bb4f-4b80-aca2-97c73325e319 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:12.197992 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2979db5d-bb4f-4b80-aca2-97c73325e319 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 15dfd562-5a76-41af-937e-41e44c96b4c1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:12.211494 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2979db5d-bb4f-4b80-aca2-97c73325e319 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:12.212256 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2979db5d-bb4f-4b80-aca2-97c73325e319 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:12.214547 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2979db5d-bb4f-4b80-aca2-97c73325e319 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:12.216751 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2979db5d-bb4f-4b80-aca2-97c73325e319 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:12.523992 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2979db5d-bb4f-4b80-aca2-97c73325e319 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:12.533446 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2979db5d-bb4f-4b80-aca2-97c73325e319 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:12.545411 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2979db5d-bb4f-4b80-aca2-97c73325e319 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:12.552664 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2979db5d-bb4f-4b80-aca2-97c73325e319 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1" status: 200 len: 1372 microversion: 2.47 time: 0.360251 Jul 18 02:34:12.555643 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1827/3654] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:12 2022] GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1 => generated 1372 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:34:13.579881 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-34bbd0c0-4cb7-4aa6-a4a5-7f80f6ed7e07 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:13.580579 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-34bbd0c0-4cb7-4aa6-a4a5-7f80f6ed7e07 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 15dfd562-5a76-41af-937e-41e44c96b4c1] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:13.606200 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-34bbd0c0-4cb7-4aa6-a4a5-7f80f6ed7e07 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:13.606659 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-34bbd0c0-4cb7-4aa6-a4a5-7f80f6ed7e07 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:13.607485 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-34bbd0c0-4cb7-4aa6-a4a5-7f80f6ed7e07 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:13.607934 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-34bbd0c0-4cb7-4aa6-a4a5-7f80f6ed7e07 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:13.956013 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-34bbd0c0-4cb7-4aa6-a4a5-7f80f6ed7e07 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:14.020199 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-34bbd0c0-4cb7-4aa6-a4a5-7f80f6ed7e07 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:14.023173 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-34bbd0c0-4cb7-4aa6-a4a5-7f80f6ed7e07 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:14.025381 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-34bbd0c0-4cb7-4aa6-a4a5-7f80f6ed7e07 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1" status: 200 len: 1372 microversion: 2.47 time: 0.450815 Jul 18 02:34:14.031603 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1828/3655] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:13 2022] GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1 => generated 1372 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:14.367323 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a5818682-d070-41a1-ac7c-ff80a474e032 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1265850155", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "57435243-a5cb-431a-9114-648f368de400"}], "security_groups": [{"name": "tempest-securitygroup--524438393"}], "key_name": "tempest-keypair-1298173662", "user_data": "}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:34:14.671740 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-a5818682-d070-41a1-ac7c-ff80a474e032 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] validate_networks() for [('57435243-a5cb-431a-9114-648f368de400', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:34:15.050616 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-13c08689-e8db-4250-9b0b-e6007a831d79 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:15.051239 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-13c08689-e8db-4250-9b0b-e6007a831d79 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 15dfd562-5a76-41af-937e-41e44c96b4c1] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:15.067520 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-13c08689-e8db-4250-9b0b-e6007a831d79 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:15.068189 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-13c08689-e8db-4250-9b0b-e6007a831d79 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:15.080150 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-13c08689-e8db-4250-9b0b-e6007a831d79 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:15.080776 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-13c08689-e8db-4250-9b0b-e6007a831d79 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:15.237936 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-13c08689-e8db-4250-9b0b-e6007a831d79 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:15.271375 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-13c08689-e8db-4250-9b0b-e6007a831d79 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:15.279343 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-13c08689-e8db-4250-9b0b-e6007a831d79 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:15.291284 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-13c08689-e8db-4250-9b0b-e6007a831d79 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1" status: 200 len: 1372 microversion: 2.47 time: 0.245022 Jul 18 02:34:15.306886 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1829/3656] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:15 2022] GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1 => generated 1372 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:34:15.932295 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-a5818682-d070-41a1-ac7c-ff80a474e032 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:34:15.932864 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-a5818682-d070-41a1-ac7c-ff80a474e032 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:34:15.933196 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-a5818682-d070-41a1-ac7c-ff80a474e032 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:34:15.933600 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-a5818682-d070-41a1-ac7c-ff80a474e032 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:34:15.934408 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-a5818682-d070-41a1-ac7c-ff80a474e032 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:34:15.953154 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a5818682-d070-41a1-ac7c-ff80a474e032 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:15.958216 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a5818682-d070-41a1-ac7c-ff80a474e032 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:15.961282 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a5818682-d070-41a1-ac7c-ff80a474e032 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:15.961988 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a5818682-d070-41a1-ac7c-ff80a474e032 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:16.048935 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-a5818682-d070-41a1-ac7c-ff80a474e032 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Getting quotas for project 1594a06c4e7c4bb7b184d916342933ba. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:34:16.066300 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-a5818682-d070-41a1-ac7c-ff80a474e032 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Getting quotas for user 6f30a2016d954121bb251894fad6dd39 and project 1594a06c4e7c4bb7b184d916342933ba. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:34:16.092311 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a5818682-d070-41a1-ac7c-ff80a474e032 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:34:16.098093 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a5818682-d070-41a1-ac7c-ff80a474e032 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:34:16.202795 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a5818682-d070-41a1-ac7c-ff80a474e032 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.852759 Jul 18 02:34:16.204247 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1828/3657] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:34:14 2022] POST /compute/v2.1/servers => generated 408 bytes in 1855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:34:16.219002 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-69426352-c745-46da-af0e-877765b821e3 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:16.219955 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-69426352-c745-46da-af0e-877765b821e3 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:16.317094 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9baf0859-d6d6-4f37-a6fe-45fd723d124e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:16.325795 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9baf0859-d6d6-4f37-a6fe-45fd723d124e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 15dfd562-5a76-41af-937e-41e44c96b4c1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:16.351092 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9baf0859-d6d6-4f37-a6fe-45fd723d124e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:16.352037 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9baf0859-d6d6-4f37-a6fe-45fd723d124e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:16.361893 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9baf0859-d6d6-4f37-a6fe-45fd723d124e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:16.363941 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9baf0859-d6d6-4f37-a6fe-45fd723d124e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:16.430592 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-69426352-c745-46da-af0e-877765b821e3 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:16.443030 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-69426352-c745-46da-af0e-877765b821e3 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 200 len: 1246 microversion: 2.1 time: 0.231136 Jul 18 02:34:16.459723 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1830/3658] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:16 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 1246 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:16.623673 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9baf0859-d6d6-4f37-a6fe-45fd723d124e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:16.665064 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9baf0859-d6d6-4f37-a6fe-45fd723d124e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:16.676634 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9baf0859-d6d6-4f37-a6fe-45fd723d124e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:16.690470 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9baf0859-d6d6-4f37-a6fe-45fd723d124e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1" status: 200 len: 1372 microversion: 2.47 time: 0.376829 Jul 18 02:34:16.691483 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1829/3659] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:16 2022] GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1 => generated 1372 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:34:17.469522 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4a1ffdfd-1602-4a05-8258-a003534d31a3 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:17.476510 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4a1ffdfd-1602-4a05-8258-a003534d31a3 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:17.716801 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9e6a1e81-c958-497e-bdcb-659743f2048e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:17.719034 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9e6a1e81-c958-497e-bdcb-659743f2048e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 15dfd562-5a76-41af-937e-41e44c96b4c1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:17.721414 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4a1ffdfd-1602-4a05-8258-a003534d31a3 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:17.743678 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4a1ffdfd-1602-4a05-8258-a003534d31a3 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 200 len: 1246 microversion: 2.1 time: 0.285202 Jul 18 02:34:17.745043 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1831/3660] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:17 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 1246 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:17.770328 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e6a1e81-c958-497e-bdcb-659743f2048e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:17.773637 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e6a1e81-c958-497e-bdcb-659743f2048e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:17.775522 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e6a1e81-c958-497e-bdcb-659743f2048e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:17.776338 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e6a1e81-c958-497e-bdcb-659743f2048e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:18.129591 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9e6a1e81-c958-497e-bdcb-659743f2048e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:18.154999 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9e6a1e81-c958-497e-bdcb-659743f2048e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:18.161311 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9e6a1e81-c958-497e-bdcb-659743f2048e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:18.162633 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9e6a1e81-c958-497e-bdcb-659743f2048e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1" status: 200 len: 1357 microversion: 2.47 time: 0.455408 Jul 18 02:34:18.163229 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1830/3661] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:17 2022] GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1 => generated 1357 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:18.204660 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2e2da590-0d16-4240-8f4d-6915980a45ba tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:18.211696 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2e2da590-0d16-4240-8f4d-6915980a45ba tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:18.218951 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2e2da590-0d16-4240-8f4d-6915980a45ba tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Searching by: {'deleted': False, 'project_id': 'c157f0d5a90443128bbac95ebf44f217'} {{(pid=119544) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:34:18.242957 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2e2da590-0d16-4240-8f4d-6915980a45ba tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:18.243411 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2e2da590-0d16-4240-8f4d-6915980a45ba tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:18.244239 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2e2da590-0d16-4240-8f4d-6915980a45ba tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:18.244683 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2e2da590-0d16-4240-8f4d-6915980a45ba tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:18.700894 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.multi_cell_list [None req-2e2da590-0d16-4240-8f4d-6915980a45ba tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119544) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:34:18.772023 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3fcb6d1d-7bd8-41fd-a287-186e17fd63c2 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:18.772664 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3fcb6d1d-7bd8-41fd-a287-186e17fd63c2 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:18.791421 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3fcb6d1d-7bd8-41fd-a287-186e17fd63c2 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:18.791890 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3fcb6d1d-7bd8-41fd-a287-186e17fd63c2 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:18.803026 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3fcb6d1d-7bd8-41fd-a287-186e17fd63c2 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:18.803482 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3fcb6d1d-7bd8-41fd-a287-186e17fd63c2 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:18.954554 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2e2da590-0d16-4240-8f4d-6915980a45ba tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:18.962902 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2e2da590-0d16-4240-8f4d-6915980a45ba tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:18.963572 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2e2da590-0d16-4240-8f4d-6915980a45ba tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:18.998156 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2e2da590-0d16-4240-8f4d-6915980a45ba tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:19.000834 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2e2da590-0d16-4240-8f4d-6915980a45ba tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:19.046659 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3fcb6d1d-7bd8-41fd-a287-186e17fd63c2 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:19.099704 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3fcb6d1d-7bd8-41fd-a287-186e17fd63c2 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 200 len: 1298 microversion: 2.1 time: 0.328958 Jul 18 02:34:19.105356 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1831/3662] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:18 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 1298 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:34:19.125046 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2e2da590-0d16-4240-8f4d-6915980a45ba tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.925677 Jul 18 02:34:19.126276 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1832/3663] 10.222.0.57 () {60 vars in 1186 bytes} [Mon Jul 18 02:34:18 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:34:19.167006 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dae711cd-866f-4568-8577-cb03ae938793 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:19.168349 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-dae711cd-866f-4568-8577-cb03ae938793 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 15dfd562-5a76-41af-937e-41e44c96b4c1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:19.194059 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dae711cd-866f-4568-8577-cb03ae938793 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:19.194919 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dae711cd-866f-4568-8577-cb03ae938793 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:19.197296 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dae711cd-866f-4568-8577-cb03ae938793 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:19.199862 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dae711cd-866f-4568-8577-cb03ae938793 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:19.279460 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:19.304080 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-dae711cd-866f-4568-8577-cb03ae938793 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 15dfd562-5a76-41af-937e-41e44c96b4c1] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:34:19.634448 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-dae711cd-866f-4568-8577-cb03ae938793 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "DELETE /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1" status: 204 len: 0 microversion: 2.47 time: 0.478244 Jul 18 02:34:19.636412 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1832/3664] 10.222.0.57 () {60 vars in 1279 bytes} [Mon Jul 18 02:34:19 2022] DELETE /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:34:19.664150 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-11da0666-3643-4a23-a058-56a492db886b tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:19.670304 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-11da0666-3643-4a23-a058-56a492db886b tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 15dfd562-5a76-41af-937e-41e44c96b4c1] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:19.716078 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-11da0666-3643-4a23-a058-56a492db886b tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:19.723302 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-11da0666-3643-4a23-a058-56a492db886b tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:19.727534 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-11da0666-3643-4a23-a058-56a492db886b tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:19.732156 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-11da0666-3643-4a23-a058-56a492db886b tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:20.126232 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f60e5dcf-f473-4549-b5c3-061fbe715dd4 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:20.127640 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f60e5dcf-f473-4549-b5c3-061fbe715dd4 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:20.148579 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f60e5dcf-f473-4549-b5c3-061fbe715dd4 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:20.156482 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f60e5dcf-f473-4549-b5c3-061fbe715dd4 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:20.162648 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f60e5dcf-f473-4549-b5c3-061fbe715dd4 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:20.164216 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f60e5dcf-f473-4549-b5c3-061fbe715dd4 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:20.180043 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-11da0666-3643-4a23-a058-56a492db886b tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:20.250979 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-11da0666-3643-4a23-a058-56a492db886b tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:20.271533 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-11da0666-3643-4a23-a058-56a492db886b tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:20.281195 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-11da0666-3643-4a23-a058-56a492db886b tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1" status: 200 len: 1363 microversion: 2.47 time: 0.635168 Jul 18 02:34:20.289980 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1833/3665] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:19 2022] GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1 => generated 1363 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:21.328549 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-015d6c17-65f9-4824-a350-7d194014a84e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:21.330267 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-015d6c17-65f9-4824-a350-7d194014a84e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 15dfd562-5a76-41af-937e-41e44c96b4c1] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:21.345471 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-015d6c17-65f9-4824-a350-7d194014a84e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:21.345974 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-015d6c17-65f9-4824-a350-7d194014a84e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:21.347006 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-015d6c17-65f9-4824-a350-7d194014a84e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:21.347454 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-015d6c17-65f9-4824-a350-7d194014a84e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:21.761091 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f60e5dcf-f473-4549-b5c3-061fbe715dd4 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:21.771548 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f60e5dcf-f473-4549-b5c3-061fbe715dd4 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 200 len: 1304 microversion: 2.1 time: 1.650620 Jul 18 02:34:21.796921 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1833/3666] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:20 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 1304 bytes in 1677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:21.815895 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-015d6c17-65f9-4824-a350-7d194014a84e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:21.830836 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-015d6c17-65f9-4824-a350-7d194014a84e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:21.840179 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-015d6c17-65f9-4824-a350-7d194014a84e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:21.841641 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-015d6c17-65f9-4824-a350-7d194014a84e tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1" status: 200 len: 1363 microversion: 2.47 time: 0.535082 Jul 18 02:34:21.851268 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1834/3667] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:21 2022] GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1 => generated 1363 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:34:22.803814 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4ba9bc8c-df3d-4805-a8e1-f4f69d9be9f7 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:22.805202 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4ba9bc8c-df3d-4805-a8e1-f4f69d9be9f7 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:22.808992 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:22.829651 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4ba9bc8c-df3d-4805-a8e1-f4f69d9be9f7 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:22.830499 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4ba9bc8c-df3d-4805-a8e1-f4f69d9be9f7 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:22.831525 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4ba9bc8c-df3d-4805-a8e1-f4f69d9be9f7 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:22.832318 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4ba9bc8c-df3d-4805-a8e1-f4f69d9be9f7 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:22.871341 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f047ea7e-ed9b-4463-8e62-c6868693c5df tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:22.873123 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f047ea7e-ed9b-4463-8e62-c6868693c5df tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 15dfd562-5a76-41af-937e-41e44c96b4c1] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:22.888712 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f047ea7e-ed9b-4463-8e62-c6868693c5df tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:22.893100 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f047ea7e-ed9b-4463-8e62-c6868693c5df tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:22.894579 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f047ea7e-ed9b-4463-8e62-c6868693c5df tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:22.895319 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f047ea7e-ed9b-4463-8e62-c6868693c5df tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:23.517229 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f047ea7e-ed9b-4463-8e62-c6868693c5df tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:23.547384 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f047ea7e-ed9b-4463-8e62-c6868693c5df tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:23.553251 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f047ea7e-ed9b-4463-8e62-c6868693c5df tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:23.555011 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f047ea7e-ed9b-4463-8e62-c6868693c5df tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1" status: 200 len: 1363 microversion: 2.47 time: 0.688129 Jul 18 02:34:23.556216 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1835/3668] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:22 2022] GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1 => generated 1363 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:34:23.582790 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4ba9bc8c-df3d-4805-a8e1-f4f69d9be9f7 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:23.597048 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4ba9bc8c-df3d-4805-a8e1-f4f69d9be9f7 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 200 len: 1304 microversion: 2.1 time: 0.797126 Jul 18 02:34:23.614618 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1834/3669] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:22 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 1304 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:24.597344 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-41b7caad-e901-4cb5-8855-b14329e6887d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:24.601774 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-41b7caad-e901-4cb5-8855-b14329e6887d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 15dfd562-5a76-41af-937e-41e44c96b4c1] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:24.623161 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e66ebcf5-80d5-41e1-aa52-385e8f13dccc tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:24.634077 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e66ebcf5-80d5-41e1-aa52-385e8f13dccc tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:24.654996 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-41b7caad-e901-4cb5-8855-b14329e6887d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:24.659693 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e66ebcf5-80d5-41e1-aa52-385e8f13dccc tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:24.661265 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-41b7caad-e901-4cb5-8855-b14329e6887d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:24.663147 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-41b7caad-e901-4cb5-8855-b14329e6887d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:24.664327 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-41b7caad-e901-4cb5-8855-b14329e6887d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:24.670922 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e66ebcf5-80d5-41e1-aa52-385e8f13dccc tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:24.672990 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e66ebcf5-80d5-41e1-aa52-385e8f13dccc tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:24.674295 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e66ebcf5-80d5-41e1-aa52-385e8f13dccc tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:24.774697 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-41b7caad-e901-4cb5-8855-b14329e6887d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] HTTP exception thrown: Instance 15dfd562-5a76-41af-937e-41e44c96b4c1 could not be found. Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-41b7caad-e901-4cb5-8855-b14329e6887d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Request method failure captured: Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1 HTTP/1.1 Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MZ3A-oOxnCOElNFSl9vP-I9y_CzYY2Bi8wJ-Hp0UF-jU-eR-6Y1PUuKBM7e5fNJ8f1gwfK3S9j8RACBrPOjhHcXV2ONpFHOk3Blp3wjT0p6RvCUdtX11p7LtZBeD51ulE60-CJWk6xoNTI_-ZP9BMISKXyHCd-RNxM03oPdd75_OJk Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: X-Openstack-Nova-Api-Version: 2.47 Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: c157f0d5a90443128bbac95ebf44f217 Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServerShowV247Test-2046307171 Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c157f0d5a90443128bbac95ebf44f217"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c157f0d5a90443128bbac95ebf44f217"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c157f0d5a90443128bbac95ebf44f217"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c157f0d5a90443128bbac95ebf44f217"}]}] Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServerShowV247Test-2046307171 Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: c157f0d5a90443128bbac95ebf44f217 Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServerShowV247Test-2046307171 Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServerShowV247Test-2046307171-project Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 85e323992800458ab12cfa024ff40c64 Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServerShowV247Test-2046307171-project Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 15dfd562-5a76-41af-937e-41e44c96b4c1 could not be found. Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '15dfd562-5a76-41af-937e-41e44c96b4c1'} Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15dfd562-5a76-41af-937e-41e44c96b4c1 could not be found. Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15dfd562-5a76-41af-937e-41e44c96b4c1 could not be found. Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:34:24.780058 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:34:24.785274 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:24.785274 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:34:24.785274 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:34:24.785274 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:34:24.785274 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:34:24.785274 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15dfd562-5a76-41af-937e-41e44c96b4c1 could not be found. Jul 18 02:34:24.785274 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:34:24.785274 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-41b7caad-e901-4cb5-8855-b14329e6887d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Returning 404 to user: Instance 15dfd562-5a76-41af-937e-41e44c96b4c1 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:34:24.785274 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-41b7caad-e901-4cb5-8855-b14329e6887d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1" status: 404 len: 111 microversion: 2.47 time: 0.201466 Jul 18 02:34:24.796885 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1836/3670] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:24 2022] GET /compute/v2.1/servers/15dfd562-5a76-41af-937e-41e44c96b4c1 => generated 111 bytes in 216 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:34:24.806135 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c066ef39-7c3e-4583-b2a4-7c893c78b5e2 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:24.807028 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c066ef39-7c3e-4583-b2a4-7c893c78b5e2 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 545d6340-7e49-4e8b-99e9-d7755448005b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:24.823402 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c066ef39-7c3e-4583-b2a4-7c893c78b5e2 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:24.824592 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c066ef39-7c3e-4583-b2a4-7c893c78b5e2 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:24.826687 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c066ef39-7c3e-4583-b2a4-7c893c78b5e2 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:24.828427 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c066ef39-7c3e-4583-b2a4-7c893c78b5e2 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:24.920586 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:24.931468 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c066ef39-7c3e-4583-b2a4-7c893c78b5e2 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 545d6340-7e49-4e8b-99e9-d7755448005b] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:34:25.050512 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e66ebcf5-80d5-41e1-aa52-385e8f13dccc tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:25.060556 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e66ebcf5-80d5-41e1-aa52-385e8f13dccc tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 200 len: 1304 microversion: 2.1 time: 0.444993 Jul 18 02:34:25.078498 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1835/3671] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:24 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 1304 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:34:25.242341 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c066ef39-7c3e-4583-b2a4-7c893c78b5e2 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "DELETE /compute/v2.1/servers/545d6340-7e49-4e8b-99e9-d7755448005b" status: 204 len: 0 microversion: 2.47 time: 0.443216 Jul 18 02:34:25.243435 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1837/3672] 10.222.0.57 () {60 vars in 1279 bytes} [Mon Jul 18 02:34:24 2022] DELETE /compute/v2.1/servers/545d6340-7e49-4e8b-99e9-d7755448005b => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:34:25.256048 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7d7b0c64-8521-4bd3-8ee4-bbf2fab0df4b tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:25.257533 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7d7b0c64-8521-4bd3-8ee4-bbf2fab0df4b tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 545d6340-7e49-4e8b-99e9-d7755448005b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:25.274246 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7d7b0c64-8521-4bd3-8ee4-bbf2fab0df4b tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:25.275358 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7d7b0c64-8521-4bd3-8ee4-bbf2fab0df4b tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:25.276481 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7d7b0c64-8521-4bd3-8ee4-bbf2fab0df4b tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:25.281177 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7d7b0c64-8521-4bd3-8ee4-bbf2fab0df4b tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:25.976284 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7d7b0c64-8521-4bd3-8ee4-bbf2fab0df4b tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:25.999020 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7d7b0c64-8521-4bd3-8ee4-bbf2fab0df4b tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:26.002953 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7d7b0c64-8521-4bd3-8ee4-bbf2fab0df4b tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:26.006872 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7d7b0c64-8521-4bd3-8ee4-bbf2fab0df4b tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "GET /compute/v2.1/servers/545d6340-7e49-4e8b-99e9-d7755448005b" status: 200 len: 1362 microversion: 2.47 time: 0.755148 Jul 18 02:34:26.008658 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1836/3673] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:25 2022] GET /compute/v2.1/servers/545d6340-7e49-4e8b-99e9-d7755448005b => generated 1362 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:34:26.085433 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d2f5798f-18d5-4c69-bbc2-d3d36f16505b tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:26.086249 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d2f5798f-18d5-4c69-bbc2-d3d36f16505b tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:26.113876 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d2f5798f-18d5-4c69-bbc2-d3d36f16505b tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:26.117572 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d2f5798f-18d5-4c69-bbc2-d3d36f16505b tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:26.118626 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d2f5798f-18d5-4c69-bbc2-d3d36f16505b tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:26.119284 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d2f5798f-18d5-4c69-bbc2-d3d36f16505b tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:27.024259 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d2f5798f-18d5-4c69-bbc2-d3d36f16505b tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:27.036033 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d2f5798f-18d5-4c69-bbc2-d3d36f16505b tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 200 len: 1304 microversion: 2.1 time: 0.955061 Jul 18 02:34:27.042901 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1838/3674] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:26 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 1304 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:27.044259 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-afd4212b-5a71-49d4-a3cf-cf7b5c6cd0f6 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:27.044984 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-afd4212b-5a71-49d4-a3cf-cf7b5c6cd0f6 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 545d6340-7e49-4e8b-99e9-d7755448005b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:27.083972 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:27.084743 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:27.106809 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-afd4212b-5a71-49d4-a3cf-cf7b5c6cd0f6 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:27.106809 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-afd4212b-5a71-49d4-a3cf-cf7b5c6cd0f6 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:27.126814 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-afd4212b-5a71-49d4-a3cf-cf7b5c6cd0f6 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:27.127636 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-afd4212b-5a71-49d4-a3cf-cf7b5c6cd0f6 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:27.359468 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-afd4212b-5a71-49d4-a3cf-cf7b5c6cd0f6 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:27.381622 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-afd4212b-5a71-49d4-a3cf-cf7b5c6cd0f6 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:27.389189 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-afd4212b-5a71-49d4-a3cf-cf7b5c6cd0f6 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:27.392009 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-afd4212b-5a71-49d4-a3cf-cf7b5c6cd0f6 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "GET /compute/v2.1/servers/545d6340-7e49-4e8b-99e9-d7755448005b" status: 200 len: 1362 microversion: 2.47 time: 0.357578 Jul 18 02:34:27.406070 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1837/3675] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:27 2022] GET /compute/v2.1/servers/545d6340-7e49-4e8b-99e9-d7755448005b => generated 1362 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:28.057621 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-210bab75-85f9-4121-975a-af4d45811dca tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:28.059166 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-210bab75-85f9-4121-975a-af4d45811dca tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:28.113172 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-210bab75-85f9-4121-975a-af4d45811dca tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:28.113638 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-210bab75-85f9-4121-975a-af4d45811dca tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:28.115119 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-210bab75-85f9-4121-975a-af4d45811dca tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:28.115119 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-210bab75-85f9-4121-975a-af4d45811dca tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:28.423616 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6e62b659-14df-4249-a68b-652f8052ae7d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:28.424728 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6e62b659-14df-4249-a68b-652f8052ae7d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 545d6340-7e49-4e8b-99e9-d7755448005b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:28.432768 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:28.506977 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e62b659-14df-4249-a68b-652f8052ae7d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:28.510303 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e62b659-14df-4249-a68b-652f8052ae7d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:28.519852 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e62b659-14df-4249-a68b-652f8052ae7d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:28.527410 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e62b659-14df-4249-a68b-652f8052ae7d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:28.938460 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=10 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:29.664130 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6e62b659-14df-4249-a68b-652f8052ae7d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:29.690463 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6e62b659-14df-4249-a68b-652f8052ae7d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:29.692333 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6e62b659-14df-4249-a68b-652f8052ae7d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85e323992800458ab12cfa024ff40c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c157f0d5a90443128bbac95ebf44f217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:29.695367 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6e62b659-14df-4249-a68b-652f8052ae7d tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "GET /compute/v2.1/servers/545d6340-7e49-4e8b-99e9-d7755448005b" status: 200 len: 1362 microversion: 2.47 time: 1.283909 Jul 18 02:34:29.708459 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1838/3676] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:28 2022] GET /compute/v2.1/servers/545d6340-7e49-4e8b-99e9-d7755448005b => generated 1362 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:30.251570 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-210bab75-85f9-4121-975a-af4d45811dca tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:30.295871 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-210bab75-85f9-4121-975a-af4d45811dca tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 200 len: 1371 microversion: 2.1 time: 2.242603 Jul 18 02:34:30.337555 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1839/3677] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:28 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 1371 bytes in 2280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:30.716466 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ffef272f-fb9f-44a4-8fb2-827cfd403874 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:30.717168 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ffef272f-fb9f-44a4-8fb2-827cfd403874 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] [instance: 545d6340-7e49-4e8b-99e9-d7755448005b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:30.759089 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ffef272f-fb9f-44a4-8fb2-827cfd403874 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:30.767913 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ffef272f-fb9f-44a4-8fb2-827cfd403874 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:30.775061 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ffef272f-fb9f-44a4-8fb2-827cfd403874 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:30.783102 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ffef272f-fb9f-44a4-8fb2-827cfd403874 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:30.869261 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-ffef272f-fb9f-44a4-8fb2-827cfd403874 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] HTTP exception thrown: Instance 545d6340-7e49-4e8b-99e9-d7755448005b could not be found. Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ffef272f-fb9f-44a4-8fb2-827cfd403874 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Request method failure captured: Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/545d6340-7e49-4e8b-99e9-d7755448005b HTTP/1.1 Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MZ3A-oOxnCOElNFSl9vP-I9y_CzYY2Bi8wJ-Hp0UF-jU-eR-6Y1PUuKBM7e5fNJ8f1gwfK3S9j8RACBrPOjhHcXV2ONpFHOk3Blp3wjT0p6RvCUdtX11p7LtZBeD51ulE60-CJWk6xoNTI_-ZP9BMISKXyHCd-RNxM03oPdd75_OJk Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: X-Openstack-Nova-Api-Version: 2.47 Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: c157f0d5a90443128bbac95ebf44f217 Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServerShowV247Test-2046307171 Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c157f0d5a90443128bbac95ebf44f217"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c157f0d5a90443128bbac95ebf44f217"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c157f0d5a90443128bbac95ebf44f217"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c157f0d5a90443128bbac95ebf44f217"}]}] Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServerShowV247Test-2046307171 Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: c157f0d5a90443128bbac95ebf44f217 Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServerShowV247Test-2046307171 Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServerShowV247Test-2046307171-project Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 85e323992800458ab12cfa024ff40c64 Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServerShowV247Test-2046307171-project Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 545d6340-7e49-4e8b-99e9-d7755448005b could not be found. Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '545d6340-7e49-4e8b-99e9-d7755448005b'} Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 545d6340-7e49-4e8b-99e9-d7755448005b could not be found. Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 545d6340-7e49-4e8b-99e9-d7755448005b could not be found. Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:34:30.885817 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:34:30.890385 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:30.890385 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:34:30.890385 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:34:30.890385 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:34:30.890385 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:34:30.890385 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 545d6340-7e49-4e8b-99e9-d7755448005b could not be found. Jul 18 02:34:30.890385 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:34:30.894747 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ffef272f-fb9f-44a4-8fb2-827cfd403874 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] Returning 404 to user: Instance 545d6340-7e49-4e8b-99e9-d7755448005b could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:34:30.920351 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ffef272f-fb9f-44a4-8fb2-827cfd403874 tempest-ServerShowV247Test-2046307171 tempest-ServerShowV247Test-2046307171-project] 10.222.0.57 "GET /compute/v2.1/servers/545d6340-7e49-4e8b-99e9-d7755448005b" status: 404 len: 111 microversion: 2.47 time: 0.207166 Jul 18 02:34:30.937105 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1839/3678] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:30 2022] GET /compute/v2.1/servers/545d6340-7e49-4e8b-99e9-d7755448005b => generated 111 bytes in 225 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:34:31.347710 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-61938320-580d-4cae-bda2-a40464079214 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:31.351938 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-61938320-580d-4cae-bda2-a40464079214 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:31.368513 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:31.371949 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-61938320-580d-4cae-bda2-a40464079214 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:31.378156 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-61938320-580d-4cae-bda2-a40464079214 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:31.384214 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-61938320-580d-4cae-bda2-a40464079214 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:31.389234 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-61938320-580d-4cae-bda2-a40464079214 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:32.685165 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-61938320-580d-4cae-bda2-a40464079214 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:32.729502 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-61938320-580d-4cae-bda2-a40464079214 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 200 len: 1371 microversion: 2.1 time: 1.400106 Jul 18 02:34:32.735186 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1840/3679] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:31 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 1371 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:33.751862 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0bbb6f39-d967-4098-a204-56456f5e6d3a tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:33.753266 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0bbb6f39-d967-4098-a204-56456f5e6d3a tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:33.770538 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0bbb6f39-d967-4098-a204-56456f5e6d3a tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:33.771249 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0bbb6f39-d967-4098-a204-56456f5e6d3a tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:33.772205 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0bbb6f39-d967-4098-a204-56456f5e6d3a tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:33.782488 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0bbb6f39-d967-4098-a204-56456f5e6d3a tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:35.105379 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0bbb6f39-d967-4098-a204-56456f5e6d3a tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:35.119012 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0bbb6f39-d967-4098-a204-56456f5e6d3a tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 200 len: 1371 microversion: 2.1 time: 1.371936 Jul 18 02:34:35.122044 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1840/3680] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:33 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 1371 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:35.941139 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-4838c25c-dd07-447a-9be0-d84b2439ae8a req-fb152f83-5254-4553-870a-32b8193fef20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec655fda-37a0-4b96-b478-3ca18ffa37f2", "tag": "163ed416-80e6-4cc5-ad3e-9045d5ee4529"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:34:36.010513 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-4838c25c-dd07-447a-9be0-d84b2439ae8a req-fb152f83-5254-4553-870a-32b8193fef20 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:36.017210 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-4838c25c-dd07-447a-9be0-d84b2439ae8a req-fb152f83-5254-4553-870a-32b8193fef20 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:36.110407 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-4838c25c-dd07-447a-9be0-d84b2439ae8a req-fb152f83-5254-4553-870a-32b8193fef20 service nova] Creating event network-changed:163ed416-80e6-4cc5-ad3e-9045d5ee4529 for instance ec655fda-37a0-4b96-b478-3ca18ffa37f2 on n-h2-465891-3 Jul 18 02:34:36.148873 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-4838c25c-dd07-447a-9be0-d84b2439ae8a req-fb152f83-5254-4553-870a-32b8193fef20 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.216960 Jul 18 02:34:36.154145 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1841/3681] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:34:36.159216 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f964fa7d-8237-4c45-8ba4-ced4315228b2 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:36.160297 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f964fa7d-8237-4c45-8ba4-ced4315228b2 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:36.194325 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f964fa7d-8237-4c45-8ba4-ced4315228b2 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:36.199349 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f964fa7d-8237-4c45-8ba4-ced4315228b2 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:36.201234 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f964fa7d-8237-4c45-8ba4-ced4315228b2 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:36.203510 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f964fa7d-8237-4c45-8ba4-ced4315228b2 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:37.758149 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f964fa7d-8237-4c45-8ba4-ced4315228b2 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:37.835732 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f964fa7d-8237-4c45-8ba4-ced4315228b2 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 200 len: 1371 microversion: 2.1 time: 1.685198 Jul 18 02:34:37.854082 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1841/3682] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:36 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 1371 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:34:38.871227 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e2b158e9-f307-4a51-8a05-85017ad0dadc tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:38.875459 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e2b158e9-f307-4a51-8a05-85017ad0dadc tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:38.887635 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e2b158e9-f307-4a51-8a05-85017ad0dadc tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:38.888483 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e2b158e9-f307-4a51-8a05-85017ad0dadc tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:38.890169 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e2b158e9-f307-4a51-8a05-85017ad0dadc tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:38.891123 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e2b158e9-f307-4a51-8a05-85017ad0dadc tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:39.295703 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e2b158e9-f307-4a51-8a05-85017ad0dadc tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:39.314319 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e2b158e9-f307-4a51-8a05-85017ad0dadc tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 200 len: 1371 microversion: 2.1 time: 0.443640 Jul 18 02:34:39.315396 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1842/3683] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:38 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 1371 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:39.645459 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-129df48d-a878-49a9-92df-ec4ad573f8fb tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Action: 'create', calling method: .version_select at 0x7ff49b6d1700>, body: {"keypair": {"name": "tempest-keypair-1503615496", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUrA/lVaWTewvYkwQ6/b6WZfXoqSDAgv6lvQ35avGI0e/lMRkAStPyOa9Hfb1psWkG8zfUksV5jlE0p6FPbbfLezYy+VivaAA2b0pFVxuaHJjl7ZJO6mxRGPqWZUzQYkQ=="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:34:39.703612 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-129df48d-a878-49a9-92df-ec4ad573f8fb tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Getting quotas for project 10687185688149cfb184fdcfdbc1b69e. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:34:39.731296 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-129df48d-a878-49a9-92df-ec4ad573f8fb tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Getting quotas for user 22bad5add9ab4b05a2fced0106b8e680 and project 10687185688149cfb184fdcfdbc1b69e. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:34:39.823068 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-129df48d-a878-49a9-92df-ec4ad573f8fb tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.669221 Jul 18 02:34:39.826934 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1842/3684] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 02:34:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:34:40.338389 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fbadb12a-8edc-4462-b307-2c626a19d649 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:40.339496 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fbadb12a-8edc-4462-b307-2c626a19d649 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:40.395015 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fbadb12a-8edc-4462-b307-2c626a19d649 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:40.397324 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fbadb12a-8edc-4462-b307-2c626a19d649 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:40.400583 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fbadb12a-8edc-4462-b307-2c626a19d649 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:40.402758 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fbadb12a-8edc-4462-b307-2c626a19d649 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:41.245637 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2f0879c9-03ae-4fde-bd50-71f56c30c22f tempest-ExtensionsTest-1977155476 tempest-ExtensionsTest-1977155476-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:41.256974 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2f0879c9-03ae-4fde-bd50-71f56c30c22f tempest-ExtensionsTest-1977155476 tempest-ExtensionsTest-1977155476-project] 10.222.0.57 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.930759 Jul 18 02:34:41.269044 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1843/3685] 10.222.0.57 () {58 vars in 1169 bytes} [Mon Jul 18 02:34:40 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:34:41.283016 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d714e40a-3352-4a1b-b0f5-3d099505b049 tempest-ExtensionsTest-1977155476 tempest-ExtensionsTest-1977155476-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:41.289293 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d714e40a-3352-4a1b-b0f5-3d099505b049 tempest-ExtensionsTest-1977155476 tempest-ExtensionsTest-1977155476-project] 10.222.0.57 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.016727 Jul 18 02:34:41.348935 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1844/3686] 10.222.0.57 () {58 vars in 1133 bytes} [Mon Jul 18 02:34:41 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:34:41.355323 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fbadb12a-8edc-4462-b307-2c626a19d649 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:41.380493 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fbadb12a-8edc-4462-b307-2c626a19d649 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 200 len: 1371 microversion: 2.1 time: 1.051641 Jul 18 02:34:41.391149 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1843/3687] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:40 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 1371 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:42.408775 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0ca1fd27-28da-4ccc-b1f6-8243618a3a78 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:42.414505 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0ca1fd27-28da-4ccc-b1f6-8243618a3a78 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:42.466516 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0ca1fd27-28da-4ccc-b1f6-8243618a3a78 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:42.483788 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0ca1fd27-28da-4ccc-b1f6-8243618a3a78 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:42.491901 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0ca1fd27-28da-4ccc-b1f6-8243618a3a78 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:42.493385 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0ca1fd27-28da-4ccc-b1f6-8243618a3a78 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:44.123467 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0ca1fd27-28da-4ccc-b1f6-8243618a3a78 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:44.142376 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0ca1fd27-28da-4ccc-b1f6-8243618a3a78 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 200 len: 1371 microversion: 2.1 time: 1.738219 Jul 18 02:34:44.144301 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1845/3688] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:42 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 1371 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:45.195864 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-57d1da30-6bda-4a5f-a80a-a833af46c92f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:45.198923 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-57d1da30-6bda-4a5f-a80a-a833af46c92f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:45.246739 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-57d1da30-6bda-4a5f-a80a-a833af46c92f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:45.249163 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-57d1da30-6bda-4a5f-a80a-a833af46c92f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:45.252891 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-57d1da30-6bda-4a5f-a80a-a833af46c92f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:45.254800 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-57d1da30-6bda-4a5f-a80a-a833af46c92f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:46.058526 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-57d1da30-6bda-4a5f-a80a-a833af46c92f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:46.174153 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-57d1da30-6bda-4a5f-a80a-a833af46c92f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 200 len: 1371 microversion: 2.1 time: 0.984770 Jul 18 02:34:46.174900 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1844/3689] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:45 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 1371 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:47.206446 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c8df95fb-4ec6-4c95-989f-46bf6e590b59 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:47.213571 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c8df95fb-4ec6-4c95-989f-46bf6e590b59 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:47.258088 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c8df95fb-4ec6-4c95-989f-46bf6e590b59 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:47.261159 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c8df95fb-4ec6-4c95-989f-46bf6e590b59 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:47.266650 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c8df95fb-4ec6-4c95-989f-46bf6e590b59 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:47.274223 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c8df95fb-4ec6-4c95-989f-46bf6e590b59 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:47.764257 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c8df95fb-4ec6-4c95-989f-46bf6e590b59 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:47.783257 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c8df95fb-4ec6-4c95-989f-46bf6e590b59 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 200 len: 1371 microversion: 2.1 time: 0.588659 Jul 18 02:34:47.803158 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1846/3690] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:47 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 1371 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:48.816536 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-46ff94fa-0219-4668-b62b-746b66597713 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:48.817648 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-46ff94fa-0219-4668-b62b-746b66597713 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:48.860666 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-46ff94fa-0219-4668-b62b-746b66597713 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:48.861889 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-46ff94fa-0219-4668-b62b-746b66597713 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:48.863603 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-46ff94fa-0219-4668-b62b-746b66597713 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:48.864653 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-46ff94fa-0219-4668-b62b-746b66597713 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:49.751762 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=4 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:50.211561 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-46ff94fa-0219-4668-b62b-746b66597713 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:50.214939 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:50.230278 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-46ff94fa-0219-4668-b62b-746b66597713 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 200 len: 1371 microversion: 2.1 time: 1.421483 Jul 18 02:34:50.244270 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1845/3691] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:48 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 1371 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:50.791677 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-fa882099-3b8e-4295-b35b-7f8de7a72fdd req-40a94b11-9547-4145-bcb7-b89f34d783b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec655fda-37a0-4b96-b478-3ca18ffa37f2", "name": "network-vif-plugged", "status": "completed", "tag": "163ed416-80e6-4cc5-ad3e-9045d5ee4529"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:34:50.802096 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-fa882099-3b8e-4295-b35b-7f8de7a72fdd req-40a94b11-9547-4145-bcb7-b89f34d783b3 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:50.802267 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-fa882099-3b8e-4295-b35b-7f8de7a72fdd req-40a94b11-9547-4145-bcb7-b89f34d783b3 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:50.839379 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-fa882099-3b8e-4295-b35b-7f8de7a72fdd req-40a94b11-9547-4145-bcb7-b89f34d783b3 service nova] Creating event network-vif-plugged:163ed416-80e6-4cc5-ad3e-9045d5ee4529 for instance ec655fda-37a0-4b96-b478-3ca18ffa37f2 on n-h2-465891-3 Jul 18 02:34:50.844913 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-fa882099-3b8e-4295-b35b-7f8de7a72fdd req-40a94b11-9547-4145-bcb7-b89f34d783b3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.745831 Jul 18 02:34:50.846349 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1847/3692] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:34:51.262841 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c0f926ad-6e19-41a0-ba32-b395fac86b8e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:51.270686 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c0f926ad-6e19-41a0-ba32-b395fac86b8e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:51.326841 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c0f926ad-6e19-41a0-ba32-b395fac86b8e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:51.335495 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c0f926ad-6e19-41a0-ba32-b395fac86b8e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:51.340271 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c0f926ad-6e19-41a0-ba32-b395fac86b8e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:51.341638 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c0f926ad-6e19-41a0-ba32-b395fac86b8e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:51.436292 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8ff8a747-5350-425f-9266-eba4cc98778e tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "1167b293-8bf4-42bc-9c05-a5990b0aaf3e"}], "security_groups": [{"name": "tempest-securitygroup--531010762"}], "key_name": "tempest-keypair-1503615496", "user_data": "}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:34:52.030363 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-8ff8a747-5350-425f-9266-eba4cc98778e tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] validate_networks() for [('1167b293-8bf4-42bc-9c05-a5990b0aaf3e', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:34:52.691115 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c0f926ad-6e19-41a0-ba32-b395fac86b8e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:52.709031 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c0f926ad-6e19-41a0-ba32-b395fac86b8e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 200 len: 1371 microversion: 2.1 time: 1.451614 Jul 18 02:34:52.713386 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1846/3693] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:51 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 1371 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:53.749222 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ff837136-1954-4080-a318-4fbae114c01b tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:53.757201 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ff837136-1954-4080-a318-4fbae114c01b tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:53.822931 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:53.836729 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ff837136-1954-4080-a318-4fbae114c01b tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:53.837822 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ff837136-1954-4080-a318-4fbae114c01b tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:53.844156 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ff837136-1954-4080-a318-4fbae114c01b tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:53.845656 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ff837136-1954-4080-a318-4fbae114c01b tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:55.889116 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ff837136-1954-4080-a318-4fbae114c01b tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:55.921952 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ff837136-1954-4080-a318-4fbae114c01b tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 200 len: 1565 microversion: 2.1 time: 2.182839 Jul 18 02:34:55.946338 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1847/3694] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:53 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 1565 bytes in 2208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:34:55.980305 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ab08cc4c-49d3-4d34-bbdf-919b72b6f572 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:55.981795 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ab08cc4c-49d3-4d34-bbdf-919b72b6f572 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:56.023668 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ab08cc4c-49d3-4d34-bbdf-919b72b6f572 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:56.025222 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ab08cc4c-49d3-4d34-bbdf-919b72b6f572 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:56.030260 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-8ff8a747-5350-425f-9266-eba4cc98778e tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:34:56.031105 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-8ff8a747-5350-425f-9266-eba4cc98778e tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:34:56.032065 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-8ff8a747-5350-425f-9266-eba4cc98778e tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:34:56.033361 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-8ff8a747-5350-425f-9266-eba4cc98778e tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:34:56.034297 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-8ff8a747-5350-425f-9266-eba4cc98778e tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:34:56.035150 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ab08cc4c-49d3-4d34-bbdf-919b72b6f572 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:56.037518 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ab08cc4c-49d3-4d34-bbdf-919b72b6f572 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:56.093462 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8ff8a747-5350-425f-9266-eba4cc98778e tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:56.094199 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8ff8a747-5350-425f-9266-eba4cc98778e tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:56.095550 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8ff8a747-5350-425f-9266-eba4cc98778e tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:56.096242 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8ff8a747-5350-425f-9266-eba4cc98778e tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:56.131926 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:56.153147 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-8ff8a747-5350-425f-9266-eba4cc98778e tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Getting quotas for project 10687185688149cfb184fdcfdbc1b69e. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:34:56.177338 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-8ff8a747-5350-425f-9266-eba4cc98778e tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Getting quotas for user 22bad5add9ab4b05a2fced0106b8e680 and project 10687185688149cfb184fdcfdbc1b69e. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:34:56.225205 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8ff8a747-5350-425f-9266-eba4cc98778e tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:34:56.231284 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8ff8a747-5350-425f-9266-eba4cc98778e tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] [instance: 59f937b8-6fb3-47d1-9090-a729a3c0fa51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:34:56.347747 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ab08cc4c-49d3-4d34-bbdf-919b72b6f572 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.398792 Jul 18 02:34:56.360571 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1848/3695] 10.222.0.57 () {58 vars in 1274 bytes} [Mon Jul 18 02:34:55 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2/os-interface => generated 284 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:34:56.405089 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8ff8a747-5350-425f-9266-eba4cc98778e tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 4.990835 Jul 18 02:34:56.407200 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1848/3696] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:34:51 2022] POST /compute/v2.1/servers => generated 408 bytes in 4998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:34:56.421589 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-170ecf7f-85d6-44f3-ad68-4c178e9a9fdb tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:56.422248 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-170ecf7f-85d6-44f3-ad68-4c178e9a9fdb tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] [instance: 59f937b8-6fb3-47d1-9090-a729a3c0fa51] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:56.617888 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-170ecf7f-85d6-44f3-ad68-4c178e9a9fdb tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bad5add9ab4b05a2fced0106b8e680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10687185688149cfb184fdcfdbc1b69e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:56.645650 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-170ecf7f-85d6-44f3-ad68-4c178e9a9fdb tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] 10.222.0.57 "GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51" status: 200 len: 1226 microversion: 2.1 time: 0.228538 Jul 18 02:34:56.654536 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1849/3697] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:56 2022] GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51 => generated 1226 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:57.681472 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2c2b7e54-80f8-4f3d-b1df-62522ee57502 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:57.682837 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2c2b7e54-80f8-4f3d-b1df-62522ee57502 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] [instance: 59f937b8-6fb3-47d1-9090-a729a3c0fa51] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:58.781319 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2c2b7e54-80f8-4f3d-b1df-62522ee57502 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bad5add9ab4b05a2fced0106b8e680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10687185688149cfb184fdcfdbc1b69e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:58.792852 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2c2b7e54-80f8-4f3d-b1df-62522ee57502 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] 10.222.0.57 "GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51" status: 200 len: 1226 microversion: 2.1 time: 1.116122 Jul 18 02:34:58.796483 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1849/3698] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:57 2022] GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51 => generated 1226 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:59.812269 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7a9e58c1-1b66-433e-9643-6853b4f4c445 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:59.815489 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7a9e58c1-1b66-433e-9643-6853b4f4c445 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] [instance: 59f937b8-6fb3-47d1-9090-a729a3c0fa51] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:59.841414 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7a9e58c1-1b66-433e-9643-6853b4f4c445 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:59.842054 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7a9e58c1-1b66-433e-9643-6853b4f4c445 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:59.847858 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7a9e58c1-1b66-433e-9643-6853b4f4c445 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:59.848533 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7a9e58c1-1b66-433e-9643-6853b4f4c445 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:00.267466 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7a9e58c1-1b66-433e-9643-6853b4f4c445 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bad5add9ab4b05a2fced0106b8e680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10687185688149cfb184fdcfdbc1b69e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:00.317435 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7a9e58c1-1b66-433e-9643-6853b4f4c445 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] 10.222.0.57 "GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51" status: 200 len: 1284 microversion: 2.1 time: 0.501328 Jul 18 02:35:00.344196 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1850/3699] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:59 2022] GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51 => generated 1284 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:01.361661 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6301168e-e236-41aa-a568-a3e79317284d tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:01.362816 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6301168e-e236-41aa-a568-a3e79317284d tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] [instance: 59f937b8-6fb3-47d1-9090-a729a3c0fa51] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:01.379627 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6301168e-e236-41aa-a568-a3e79317284d tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:01.380064 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6301168e-e236-41aa-a568-a3e79317284d tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:01.387304 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6301168e-e236-41aa-a568-a3e79317284d tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:01.390317 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6301168e-e236-41aa-a568-a3e79317284d tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:01.551648 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6301168e-e236-41aa-a568-a3e79317284d tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bad5add9ab4b05a2fced0106b8e680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10687185688149cfb184fdcfdbc1b69e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:01.577537 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6301168e-e236-41aa-a568-a3e79317284d tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] 10.222.0.57 "GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51" status: 200 len: 1284 microversion: 2.1 time: 0.222448 Jul 18 02:35:01.579769 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1850/3700] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:01 2022] GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51 => generated 1284 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:02.644533 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1c2feff6-cd25-49ee-94b5-fb843a7d6598 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:02.650063 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1c2feff6-cd25-49ee-94b5-fb843a7d6598 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] [instance: 59f937b8-6fb3-47d1-9090-a729a3c0fa51] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:02.714902 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c2feff6-cd25-49ee-94b5-fb843a7d6598 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:02.723126 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c2feff6-cd25-49ee-94b5-fb843a7d6598 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:02.731114 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c2feff6-cd25-49ee-94b5-fb843a7d6598 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:02.737498 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c2feff6-cd25-49ee-94b5-fb843a7d6598 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:03.215583 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1c2feff6-cd25-49ee-94b5-fb843a7d6598 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bad5add9ab4b05a2fced0106b8e680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10687185688149cfb184fdcfdbc1b69e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:03.255354 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1c2feff6-cd25-49ee-94b5-fb843a7d6598 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] 10.222.0.57 "GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51" status: 200 len: 1284 microversion: 2.1 time: 0.635323 Jul 18 02:35:03.273225 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1851/3701] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:02 2022] GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51 => generated 1284 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:04.289342 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-916e8dbd-6388-4d4f-805f-70e7bf09d09d tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:04.291008 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-916e8dbd-6388-4d4f-805f-70e7bf09d09d tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] [instance: 59f937b8-6fb3-47d1-9090-a729a3c0fa51] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:04.294388 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:04.320874 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-916e8dbd-6388-4d4f-805f-70e7bf09d09d tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:04.324486 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-916e8dbd-6388-4d4f-805f-70e7bf09d09d tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:04.327654 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-916e8dbd-6388-4d4f-805f-70e7bf09d09d tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:04.328742 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-916e8dbd-6388-4d4f-805f-70e7bf09d09d tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:04.957421 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-916e8dbd-6388-4d4f-805f-70e7bf09d09d tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bad5add9ab4b05a2fced0106b8e680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10687185688149cfb184fdcfdbc1b69e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:04.987665 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-916e8dbd-6388-4d4f-805f-70e7bf09d09d tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] 10.222.0.57 "GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51" status: 200 len: 1284 microversion: 2.1 time: 0.690903 Jul 18 02:35:04.991713 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1851/3702] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:04 2022] GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51 => generated 1284 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:06.009441 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-19b25608-0a6d-4680-8ba1-8506395fbd7f tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:06.011033 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-19b25608-0a6d-4680-8ba1-8506395fbd7f tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] [instance: 59f937b8-6fb3-47d1-9090-a729a3c0fa51] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:06.026198 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-19b25608-0a6d-4680-8ba1-8506395fbd7f tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:06.026888 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-19b25608-0a6d-4680-8ba1-8506395fbd7f tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:06.027972 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-19b25608-0a6d-4680-8ba1-8506395fbd7f tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:06.030754 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-19b25608-0a6d-4680-8ba1-8506395fbd7f tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:06.630512 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:06.667814 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-19b25608-0a6d-4680-8ba1-8506395fbd7f tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bad5add9ab4b05a2fced0106b8e680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10687185688149cfb184fdcfdbc1b69e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:06.739794 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-19b25608-0a6d-4680-8ba1-8506395fbd7f tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] 10.222.0.57 "GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51" status: 200 len: 1351 microversion: 2.1 time: 0.734072 Jul 18 02:35:06.742149 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1852/3703] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:06 2022] GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51 => generated 1351 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:07.440749 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:07.766764 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-adba8ebb-a944-4a83-af72-8db8173ef78c tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:07.770611 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-adba8ebb-a944-4a83-af72-8db8173ef78c tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] [instance: 59f937b8-6fb3-47d1-9090-a729a3c0fa51] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:07.868379 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-adba8ebb-a944-4a83-af72-8db8173ef78c tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:07.869812 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-adba8ebb-a944-4a83-af72-8db8173ef78c tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:07.871381 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-adba8ebb-a944-4a83-af72-8db8173ef78c tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:07.879054 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-adba8ebb-a944-4a83-af72-8db8173ef78c tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:08.111893 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-34b4791e-6571-4732-8b74-22f2ac85a0bb req-d170be9e-61cd-44bc-bdae-cdedeb9a3e22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec655fda-37a0-4b96-b478-3ca18ffa37f2", "tag": "163ed416-80e6-4cc5-ad3e-9045d5ee4529"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:08.139351 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-34b4791e-6571-4732-8b74-22f2ac85a0bb req-d170be9e-61cd-44bc-bdae-cdedeb9a3e22 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:08.145764 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-34b4791e-6571-4732-8b74-22f2ac85a0bb req-d170be9e-61cd-44bc-bdae-cdedeb9a3e22 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:08.182784 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-34b4791e-6571-4732-8b74-22f2ac85a0bb req-d170be9e-61cd-44bc-bdae-cdedeb9a3e22 service nova] Creating event network-changed:163ed416-80e6-4cc5-ad3e-9045d5ee4529 for instance ec655fda-37a0-4b96-b478-3ca18ffa37f2 on n-h2-465891-3 Jul 18 02:35:08.195714 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-34b4791e-6571-4732-8b74-22f2ac85a0bb req-d170be9e-61cd-44bc-bdae-cdedeb9a3e22 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.761335 Jul 18 02:35:08.197538 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1852/3704] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:09.470958 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-adba8ebb-a944-4a83-af72-8db8173ef78c tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bad5add9ab4b05a2fced0106b8e680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10687185688149cfb184fdcfdbc1b69e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:09.522355 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-adba8ebb-a944-4a83-af72-8db8173ef78c tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] 10.222.0.57 "GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51" status: 200 len: 1351 microversion: 2.1 time: 1.766970 Jul 18 02:35:09.523432 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1853/3705] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:07 2022] GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51 => generated 1351 bytes in 1770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:10.565667 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7b9e08ca-4aa7-4512-90be-4538ec156272 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:10.566623 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7b9e08ca-4aa7-4512-90be-4538ec156272 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] [instance: 59f937b8-6fb3-47d1-9090-a729a3c0fa51] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:10.576525 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=8 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:10.598145 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7b9e08ca-4aa7-4512-90be-4538ec156272 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:10.598939 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7b9e08ca-4aa7-4512-90be-4538ec156272 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:10.600968 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7b9e08ca-4aa7-4512-90be-4538ec156272 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:10.603245 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7b9e08ca-4aa7-4512-90be-4538ec156272 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:13.715388 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7b9e08ca-4aa7-4512-90be-4538ec156272 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bad5add9ab4b05a2fced0106b8e680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10687185688149cfb184fdcfdbc1b69e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:13.738937 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7b9e08ca-4aa7-4512-90be-4538ec156272 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] 10.222.0.57 "GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51" status: 200 len: 1351 microversion: 2.1 time: 3.200573 Jul 18 02:35:13.757634 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1853/3706] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:10 2022] GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51 => generated 1351 bytes in 3218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:14.014075 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-b99b8280-bc8d-42a3-ad43-27d781c62bc6 req-ea0bcf4f-92bb-487a-a891-b52b63f55515 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59f937b8-6fb3-47d1-9090-a729a3c0fa51", "tag": "68571bd9-6db3-4e03-b3c8-bc14842873b7"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:14.037436 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-b99b8280-bc8d-42a3-ad43-27d781c62bc6 req-ea0bcf4f-92bb-487a-a891-b52b63f55515 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:14.038753 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-b99b8280-bc8d-42a3-ad43-27d781c62bc6 req-ea0bcf4f-92bb-487a-a891-b52b63f55515 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:14.084421 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-b99b8280-bc8d-42a3-ad43-27d781c62bc6 req-ea0bcf4f-92bb-487a-a891-b52b63f55515 service nova] Creating event network-changed:68571bd9-6db3-4e03-b3c8-bc14842873b7 for instance 59f937b8-6fb3-47d1-9090-a729a3c0fa51 on n-h2-465891-3 Jul 18 02:35:14.098136 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-b99b8280-bc8d-42a3-ad43-27d781c62bc6 req-ea0bcf4f-92bb-487a-a891-b52b63f55515 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089072 Jul 18 02:35:14.104539 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1854/3707] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:35:14.768343 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-192efe7b-f0e4-4d43-9c58-9ca9eb03f4ca tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:14.769746 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-192efe7b-f0e4-4d43-9c58-9ca9eb03f4ca tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] [instance: 59f937b8-6fb3-47d1-9090-a729a3c0fa51] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:14.793549 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-192efe7b-f0e4-4d43-9c58-9ca9eb03f4ca tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:14.795806 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-192efe7b-f0e4-4d43-9c58-9ca9eb03f4ca tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:14.798608 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-192efe7b-f0e4-4d43-9c58-9ca9eb03f4ca tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:14.803120 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-192efe7b-f0e4-4d43-9c58-9ca9eb03f4ca tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:15.788229 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-32181523-f614-4df9-8125-7911c26d550e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Action: 'create', calling method: .version_select at 0x7ff49b99ab80>, body: {"keypair": {"name": "tempest-keypair-78782430", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJa1s1lWEVVeALRza12cyCFqA+til6pL84pjXgKwvZYHNFfwMgCZ9iMiRULWQFFY1fGPB+HjwicCj3oUDxeJ2adgn4IV2YEfvBMD1ciY+AH8RcuVWNGy9+GFZKlcGOq6gA=="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:15.879256 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-32181523-f614-4df9-8125-7911c26d550e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Getting quotas for project cef74061ad8b4af695d4277c07cf6479. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:35:15.916135 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-32181523-f614-4df9-8125-7911c26d550e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Getting quotas for user c913445c97f74198a8b4bf441759848d and project cef74061ad8b4af695d4277c07cf6479. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:35:16.049022 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-32181523-f614-4df9-8125-7911c26d550e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.753119 Jul 18 02:35:16.050975 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1855/3708] 10.222.0.57 () {62 vars in 1199 bytes} [Mon Jul 18 02:35:15 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 757 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 18 02:35:16.270715 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-192efe7b-f0e4-4d43-9c58-9ca9eb03f4ca tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bad5add9ab4b05a2fced0106b8e680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10687185688149cfb184fdcfdbc1b69e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:16.302132 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-192efe7b-f0e4-4d43-9c58-9ca9eb03f4ca tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] 10.222.0.57 "GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51" status: 200 len: 1351 microversion: 2.1 time: 1.544438 Jul 18 02:35:16.320821 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1854/3709] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:14 2022] GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51 => generated 1351 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:17.342509 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5588c51b-f1fa-4708-b379-cf0d406e2cf3 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:17.366539 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5588c51b-f1fa-4708-b379-cf0d406e2cf3 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] [instance: 59f937b8-6fb3-47d1-9090-a729a3c0fa51] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:17.414084 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5588c51b-f1fa-4708-b379-cf0d406e2cf3 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:17.427346 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5588c51b-f1fa-4708-b379-cf0d406e2cf3 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:17.435322 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5588c51b-f1fa-4708-b379-cf0d406e2cf3 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:17.436090 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5588c51b-f1fa-4708-b379-cf0d406e2cf3 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:18.172209 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5588c51b-f1fa-4708-b379-cf0d406e2cf3 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bad5add9ab4b05a2fced0106b8e680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10687185688149cfb184fdcfdbc1b69e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:18.194428 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5588c51b-f1fa-4708-b379-cf0d406e2cf3 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] 10.222.0.57 "GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51" status: 200 len: 1351 microversion: 2.1 time: 0.865546 Jul 18 02:35:18.195629 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1856/3710] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:17 2022] GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51 => generated 1351 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:19.221072 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5906b0d5-0938-4ad8-acb4-43e47dd9a887 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:19.233261 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5906b0d5-0938-4ad8-acb4-43e47dd9a887 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] [instance: 59f937b8-6fb3-47d1-9090-a729a3c0fa51] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:19.254146 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5906b0d5-0938-4ad8-acb4-43e47dd9a887 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:19.254753 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5906b0d5-0938-4ad8-acb4-43e47dd9a887 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:19.264880 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5906b0d5-0938-4ad8-acb4-43e47dd9a887 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:19.265646 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5906b0d5-0938-4ad8-acb4-43e47dd9a887 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:20.087868 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5906b0d5-0938-4ad8-acb4-43e47dd9a887 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bad5add9ab4b05a2fced0106b8e680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10687185688149cfb184fdcfdbc1b69e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:20.104491 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5906b0d5-0938-4ad8-acb4-43e47dd9a887 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] 10.222.0.57 "GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51" status: 200 len: 1351 microversion: 2.1 time: 0.888896 Jul 18 02:35:20.112338 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1855/3711] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:19 2022] GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51 => generated 1351 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:21.137064 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7523564d-247c-4380-800d-0f057bc2071e tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:21.138011 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7523564d-247c-4380-800d-0f057bc2071e tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] [instance: 59f937b8-6fb3-47d1-9090-a729a3c0fa51] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:21.162648 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7523564d-247c-4380-800d-0f057bc2071e tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:21.163080 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7523564d-247c-4380-800d-0f057bc2071e tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:21.170070 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7523564d-247c-4380-800d-0f057bc2071e tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:21.173173 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7523564d-247c-4380-800d-0f057bc2071e tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:21.603854 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7523564d-247c-4380-800d-0f057bc2071e tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bad5add9ab4b05a2fced0106b8e680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10687185688149cfb184fdcfdbc1b69e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:21.607190 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=54 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:21.623669 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7523564d-247c-4380-800d-0f057bc2071e tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] 10.222.0.57 "GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51" status: 200 len: 1351 microversion: 2.1 time: 0.491157 Jul 18 02:35:21.637797 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1857/3712] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:21 2022] GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51 => generated 1351 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:22.664468 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-924dfc03-c9ec-427e-ab63-a06e61870420 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:22.665109 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-924dfc03-c9ec-427e-ab63-a06e61870420 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] [instance: 59f937b8-6fb3-47d1-9090-a729a3c0fa51] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:22.682028 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-924dfc03-c9ec-427e-ab63-a06e61870420 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:22.684379 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-924dfc03-c9ec-427e-ab63-a06e61870420 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:22.685654 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-924dfc03-c9ec-427e-ab63-a06e61870420 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:22.689876 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-924dfc03-c9ec-427e-ab63-a06e61870420 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:23.037840 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-924dfc03-c9ec-427e-ab63-a06e61870420 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bad5add9ab4b05a2fced0106b8e680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10687185688149cfb184fdcfdbc1b69e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:23.064607 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-924dfc03-c9ec-427e-ab63-a06e61870420 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] 10.222.0.57 "GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51" status: 200 len: 1351 microversion: 2.1 time: 0.415575 Jul 18 02:35:23.081211 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1856/3713] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:22 2022] GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51 => generated 1351 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:24.025762 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0d5cc9fa-7aea-43fa-b4e0-ab1512ac0387 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1158908422", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d6341e11-e29f-4753-a51f-094f3b3268ed"}], "security_groups": [{"name": "tempest-securitygroup--611096619"}], "key_name": "tempest-keypair-78782430", "user_data": "}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:24.068342 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:24.091525 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5ad1d2bf-5659-4f40-a817-7d57913338f4 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:24.092675 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5ad1d2bf-5659-4f40-a817-7d57913338f4 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] [instance: 59f937b8-6fb3-47d1-9090-a729a3c0fa51] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:24.120750 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ad1d2bf-5659-4f40-a817-7d57913338f4 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:24.133526 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ad1d2bf-5659-4f40-a817-7d57913338f4 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:24.135292 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ad1d2bf-5659-4f40-a817-7d57913338f4 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:24.135755 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ad1d2bf-5659-4f40-a817-7d57913338f4 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:24.667017 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5ad1d2bf-5659-4f40-a817-7d57913338f4 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bad5add9ab4b05a2fced0106b8e680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10687185688149cfb184fdcfdbc1b69e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:24.691400 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5ad1d2bf-5659-4f40-a817-7d57913338f4 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] 10.222.0.57 "GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51" status: 200 len: 1351 microversion: 2.1 time: 0.609862 Jul 18 02:35:24.693626 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1857/3714] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:24 2022] GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51 => generated 1351 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:24.708201 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-66ad3962-75cd-42aa-b891-a6725e1e8f41 req-21c8cec8-7809-42c1-b9a8-dfdea1357fee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59f937b8-6fb3-47d1-9090-a729a3c0fa51", "name": "network-vif-plugged", "status": "completed", "tag": "68571bd9-6db3-4e03-b3c8-bc14842873b7"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:24.744226 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-66ad3962-75cd-42aa-b891-a6725e1e8f41 req-21c8cec8-7809-42c1-b9a8-dfdea1357fee service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:24.745049 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-66ad3962-75cd-42aa-b891-a6725e1e8f41 req-21c8cec8-7809-42c1-b9a8-dfdea1357fee service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:24.768471 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-66ad3962-75cd-42aa-b891-a6725e1e8f41 req-21c8cec8-7809-42c1-b9a8-dfdea1357fee service nova] Creating event network-vif-plugged:68571bd9-6db3-4e03-b3c8-bc14842873b7 for instance 59f937b8-6fb3-47d1-9090-a729a3c0fa51 on n-h2-465891-3 Jul 18 02:35:24.775693 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-66ad3962-75cd-42aa-b891-a6725e1e8f41 req-21c8cec8-7809-42c1-b9a8-dfdea1357fee service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079033 Jul 18 02:35:24.782374 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1858/3715] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:25.470173 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-0d5cc9fa-7aea-43fa-b4e0-ab1512ac0387 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] validate_networks() for [('d6341e11-e29f-4753-a51f-094f3b3268ed', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:35:25.725194 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9883e5fc-8880-42f7-9412-6945ff0a5bbc tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:25.734000 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9883e5fc-8880-42f7-9412-6945ff0a5bbc tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] [instance: 59f937b8-6fb3-47d1-9090-a729a3c0fa51] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:25.784022 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9883e5fc-8880-42f7-9412-6945ff0a5bbc tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:25.784730 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9883e5fc-8880-42f7-9412-6945ff0a5bbc tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:25.786357 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9883e5fc-8880-42f7-9412-6945ff0a5bbc tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:25.797379 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9883e5fc-8880-42f7-9412-6945ff0a5bbc tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:25.973629 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=4 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:26.764140 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9883e5fc-8880-42f7-9412-6945ff0a5bbc tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bad5add9ab4b05a2fced0106b8e680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10687185688149cfb184fdcfdbc1b69e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:26.771811 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=52 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:26.809407 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9883e5fc-8880-42f7-9412-6945ff0a5bbc tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] 10.222.0.57 "GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51" status: 200 len: 1351 microversion: 2.1 time: 1.102015 Jul 18 02:35:26.823380 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1859/3716] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:25 2022] GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51 => generated 1351 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:27.344302 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-0d5cc9fa-7aea-43fa-b4e0-ab1512ac0387 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:35:27.348727 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-0d5cc9fa-7aea-43fa-b4e0-ab1512ac0387 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:35:27.350908 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-0d5cc9fa-7aea-43fa-b4e0-ab1512ac0387 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:35:27.352455 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-0d5cc9fa-7aea-43fa-b4e0-ab1512ac0387 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:35:27.353997 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-0d5cc9fa-7aea-43fa-b4e0-ab1512ac0387 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:35:27.388517 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0d5cc9fa-7aea-43fa-b4e0-ab1512ac0387 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:27.394793 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0d5cc9fa-7aea-43fa-b4e0-ab1512ac0387 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:27.399954 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0d5cc9fa-7aea-43fa-b4e0-ab1512ac0387 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:27.408850 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0d5cc9fa-7aea-43fa-b4e0-ab1512ac0387 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:27.541465 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-0d5cc9fa-7aea-43fa-b4e0-ab1512ac0387 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Getting quotas for project cef74061ad8b4af695d4277c07cf6479. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:35:27.588789 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-0d5cc9fa-7aea-43fa-b4e0-ab1512ac0387 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Getting quotas for user c913445c97f74198a8b4bf441759848d and project cef74061ad8b4af695d4277c07cf6479. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:35:27.634940 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0d5cc9fa-7aea-43fa-b4e0-ab1512ac0387 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:35:27.640401 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0d5cc9fa-7aea-43fa-b4e0-ab1512ac0387 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:35:27.847730 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0d5cc9fa-7aea-43fa-b4e0-ab1512ac0387 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.829686 Jul 18 02:35:27.853516 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1858/3717] 10.222.0.57 () {62 vars in 1187 bytes} [Mon Jul 18 02:35:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 3836 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 02:35:27.856552 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8d2f0fa8-2204-4a30-b65c-9c6052ff3fca tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:27.861279 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8d2f0fa8-2204-4a30-b65c-9c6052ff3fca tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] [instance: 59f937b8-6fb3-47d1-9090-a729a3c0fa51] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:27.877612 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-11882dc2-cf5a-4279-a0f2-059531959d5a tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:27.879502 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-11882dc2-cf5a-4279-a0f2-059531959d5a tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:27.910879 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8d2f0fa8-2204-4a30-b65c-9c6052ff3fca tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:27.914507 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8d2f0fa8-2204-4a30-b65c-9c6052ff3fca tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:27.928615 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8d2f0fa8-2204-4a30-b65c-9c6052ff3fca tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:27.929641 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8d2f0fa8-2204-4a30-b65c-9c6052ff3fca tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:28.469177 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-11882dc2-cf5a-4279-a0f2-059531959d5a tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:28.492264 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-11882dc2-cf5a-4279-a0f2-059531959d5a tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:28.494379 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-11882dc2-cf5a-4279-a0f2-059531959d5a tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:28.503642 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-11882dc2-cf5a-4279-a0f2-059531959d5a tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1280 microversion: 2.20 time: 0.643152 Jul 18 02:35:28.504960 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1859/3718] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:27 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1280 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:28.563762 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-77173ba8-1b0b-4894-b80f-2a67fc5fa428 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be7e808b-40c5-46b9-85e6-38b862e1b9bb"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:28.565095 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-77173ba8-1b0b-4894-b80f-2a67fc5fa428 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:28.574731 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77173ba8-1b0b-4894-b80f-2a67fc5fa428 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:28.598091 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77173ba8-1b0b-4894-b80f-2a67fc5fa428 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:28.600162 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77173ba8-1b0b-4894-b80f-2a67fc5fa428 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:28.601087 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77173ba8-1b0b-4894-b80f-2a67fc5fa428 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:28.830972 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8d2f0fa8-2204-4a30-b65c-9c6052ff3fca tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bad5add9ab4b05a2fced0106b8e680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10687185688149cfb184fdcfdbc1b69e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:28.893329 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8d2f0fa8-2204-4a30-b65c-9c6052ff3fca tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] 10.222.0.57 "GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51" status: 200 len: 1541 microversion: 2.1 time: 1.058766 Jul 18 02:35:28.900487 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1860/3719] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:27 2022] GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51 => generated 1541 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:28.951191 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fed7df5d-0479-43c6-8beb-d78ba148b6d8 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:28.958517 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fed7df5d-0479-43c6-8beb-d78ba148b6d8 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] [instance: 59f937b8-6fb3-47d1-9090-a729a3c0fa51] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:29.015672 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fed7df5d-0479-43c6-8beb-d78ba148b6d8 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:29.024979 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fed7df5d-0479-43c6-8beb-d78ba148b6d8 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:29.031387 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fed7df5d-0479-43c6-8beb-d78ba148b6d8 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:29.037098 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fed7df5d-0479-43c6-8beb-d78ba148b6d8 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:29.524893 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fed7df5d-0479-43c6-8beb-d78ba148b6d8 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] 10.222.0.57 "GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.601967 Jul 18 02:35:29.526320 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1861/3720] 10.222.0.57 () {58 vars in 1274 bytes} [Mon Jul 18 02:35:28 2022] GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51/os-interface => generated 284 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:29.565641 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-702d2442-d427-466f-8972-86e54222661c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:29.566333 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-702d2442-d427-466f-8972-86e54222661c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:29.588098 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-702d2442-d427-466f-8972-86e54222661c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:29.589485 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-702d2442-d427-466f-8972-86e54222661c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:29.595709 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-702d2442-d427-466f-8972-86e54222661c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:29.596162 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-702d2442-d427-466f-8972-86e54222661c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:29.604560 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-77173ba8-1b0b-4894-b80f-2a67fc5fa428 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "POST /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.049798 Jul 18 02:35:29.610508 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1860/3721] 10.222.0.57 () {60 vars in 1322 bytes} [Mon Jul 18 02:35:28 2022] POST /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2/os-volume_attachments => generated 194 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:30.024249 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-702d2442-d427-466f-8972-86e54222661c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:30.071898 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-702d2442-d427-466f-8972-86e54222661c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:30.091211 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-702d2442-d427-466f-8972-86e54222661c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:30.100555 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-702d2442-d427-466f-8972-86e54222661c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1276 microversion: 2.20 time: 0.543341 Jul 18 02:35:30.143484 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1862/3722] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:29 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1276 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:31.198973 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e9c896b7-9aac-4333-b3f0-92f45af63468 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:31.207266 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e9c896b7-9aac-4333-b3f0-92f45af63468 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:31.248694 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e9c896b7-9aac-4333-b3f0-92f45af63468 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:31.251828 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e9c896b7-9aac-4333-b3f0-92f45af63468 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:31.259515 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e9c896b7-9aac-4333-b3f0-92f45af63468 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:31.264717 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e9c896b7-9aac-4333-b3f0-92f45af63468 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:31.843799 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e9c896b7-9aac-4333-b3f0-92f45af63468 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:31.877112 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e9c896b7-9aac-4333-b3f0-92f45af63468 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:31.881093 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e9c896b7-9aac-4333-b3f0-92f45af63468 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:31.890916 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e9c896b7-9aac-4333-b3f0-92f45af63468 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1338 microversion: 2.20 time: 0.730093 Jul 18 02:35:31.899615 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1861/3723] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:31 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1338 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:32.914697 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-227c727a-e683-4486-8065-64c5aab1f5d9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:32.915426 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-227c727a-e683-4486-8065-64c5aab1f5d9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:32.942248 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-227c727a-e683-4486-8065-64c5aab1f5d9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:32.945047 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-227c727a-e683-4486-8065-64c5aab1f5d9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:32.952975 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-227c727a-e683-4486-8065-64c5aab1f5d9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:32.953445 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-227c727a-e683-4486-8065-64c5aab1f5d9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:33.267535 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-227c727a-e683-4486-8065-64c5aab1f5d9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:33.292463 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-227c727a-e683-4486-8065-64c5aab1f5d9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:33.309456 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-227c727a-e683-4486-8065-64c5aab1f5d9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:33.310903 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-227c727a-e683-4486-8065-64c5aab1f5d9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1338 microversion: 2.20 time: 0.403683 Jul 18 02:35:33.353555 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1863/3724] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:32 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1338 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:34.350402 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-deeb8b9f-73d4-4ae3-919e-487ead0eb86a tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:34.351248 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-deeb8b9f-73d4-4ae3-919e-487ead0eb86a tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:34.410780 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-deeb8b9f-73d4-4ae3-919e-487ead0eb86a tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:34.411597 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-deeb8b9f-73d4-4ae3-919e-487ead0eb86a tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:34.424242 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-deeb8b9f-73d4-4ae3-919e-487ead0eb86a tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:34.425198 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-deeb8b9f-73d4-4ae3-919e-487ead0eb86a tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:34.954565 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-deeb8b9f-73d4-4ae3-919e-487ead0eb86a tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:34.969330 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-deeb8b9f-73d4-4ae3-919e-487ead0eb86a tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:34.984605 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-deeb8b9f-73d4-4ae3-919e-487ead0eb86a tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:34.995822 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-deeb8b9f-73d4-4ae3-919e-487ead0eb86a tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1338 microversion: 2.20 time: 0.653275 Jul 18 02:35:35.016097 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1862/3725] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:34 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1338 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:35:36.018278 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d312635a-66d3-4949-bdf7-2cfb7f529578 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:36.019796 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d312635a-66d3-4949-bdf7-2cfb7f529578 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:36.033435 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=26 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:36.056339 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d312635a-66d3-4949-bdf7-2cfb7f529578 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:36.059329 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d312635a-66d3-4949-bdf7-2cfb7f529578 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:36.064968 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d312635a-66d3-4949-bdf7-2cfb7f529578 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:36.067524 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d312635a-66d3-4949-bdf7-2cfb7f529578 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:36.249978 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d312635a-66d3-4949-bdf7-2cfb7f529578 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:36.261144 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d312635a-66d3-4949-bdf7-2cfb7f529578 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:36.269688 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d312635a-66d3-4949-bdf7-2cfb7f529578 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:36.273326 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d312635a-66d3-4949-bdf7-2cfb7f529578 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1338 microversion: 2.20 time: 0.261129 Jul 18 02:35:36.275984 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1864/3726] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:36 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1338 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:37.309282 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-83c9d351-3d11-4b06-9149-d7c54f7b0ef1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:37.311001 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-83c9d351-3d11-4b06-9149-d7c54f7b0ef1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:37.321450 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-83c9d351-3d11-4b06-9149-d7c54f7b0ef1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:37.322792 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-83c9d351-3d11-4b06-9149-d7c54f7b0ef1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:37.324080 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-83c9d351-3d11-4b06-9149-d7c54f7b0ef1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:37.325348 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-83c9d351-3d11-4b06-9149-d7c54f7b0ef1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:37.477383 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:37.921444 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-83c9d351-3d11-4b06-9149-d7c54f7b0ef1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:37.938061 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-83c9d351-3d11-4b06-9149-d7c54f7b0ef1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:37.941143 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-83c9d351-3d11-4b06-9149-d7c54f7b0ef1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:37.947554 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-83c9d351-3d11-4b06-9149-d7c54f7b0ef1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1405 microversion: 2.20 time: 0.643708 Jul 18 02:35:37.955694 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1863/3727] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:37 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1405 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:35:39.010565 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-04c70abc-d489-4cf7-ac0c-ae7deb9b6cc7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:39.017012 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-04c70abc-d489-4cf7-ac0c-ae7deb9b6cc7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:39.054445 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-04c70abc-d489-4cf7-ac0c-ae7deb9b6cc7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:39.056542 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-04c70abc-d489-4cf7-ac0c-ae7deb9b6cc7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:39.058369 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-04c70abc-d489-4cf7-ac0c-ae7deb9b6cc7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:39.064495 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-04c70abc-d489-4cf7-ac0c-ae7deb9b6cc7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:39.814482 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-04c70abc-d489-4cf7-ac0c-ae7deb9b6cc7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:39.852683 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-04c70abc-d489-4cf7-ac0c-ae7deb9b6cc7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:39.857576 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-04c70abc-d489-4cf7-ac0c-ae7deb9b6cc7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:39.877102 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-04c70abc-d489-4cf7-ac0c-ae7deb9b6cc7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1405 microversion: 2.20 time: 0.889949 Jul 18 02:35:39.878170 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1865/3728] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:38 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1405 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:40.198464 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-3dce8ad6-27bf-4734-b821-2d10cdcd02d2 req-67e41a88-aa80-4903-830b-6189576383c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59f937b8-6fb3-47d1-9090-a729a3c0fa51", "tag": "68571bd9-6db3-4e03-b3c8-bc14842873b7"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:40.216417 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=8 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:40.239406 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-3dce8ad6-27bf-4734-b821-2d10cdcd02d2 req-67e41a88-aa80-4903-830b-6189576383c6 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:40.240794 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-3dce8ad6-27bf-4734-b821-2d10cdcd02d2 req-67e41a88-aa80-4903-830b-6189576383c6 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:40.271331 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-3dce8ad6-27bf-4734-b821-2d10cdcd02d2 req-67e41a88-aa80-4903-830b-6189576383c6 service nova] Creating event network-changed:68571bd9-6db3-4e03-b3c8-bc14842873b7 for instance 59f937b8-6fb3-47d1-9090-a729a3c0fa51 on n-h2-465891-3 Jul 18 02:35:40.280781 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-3dce8ad6-27bf-4734-b821-2d10cdcd02d2 req-67e41a88-aa80-4903-830b-6189576383c6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096793 Jul 18 02:35:40.286538 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1864/3729] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:40.921838 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fdf6920a-170d-434c-b77b-9fe494921190 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:40.936350 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fdf6920a-170d-434c-b77b-9fe494921190 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:40.974563 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fdf6920a-170d-434c-b77b-9fe494921190 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:40.975444 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fdf6920a-170d-434c-b77b-9fe494921190 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:40.976777 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fdf6920a-170d-434c-b77b-9fe494921190 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:40.978611 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fdf6920a-170d-434c-b77b-9fe494921190 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:42.899570 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fdf6920a-170d-434c-b77b-9fe494921190 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:42.916164 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fdf6920a-170d-434c-b77b-9fe494921190 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:42.917942 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fdf6920a-170d-434c-b77b-9fe494921190 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:42.934527 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fdf6920a-170d-434c-b77b-9fe494921190 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1405 microversion: 2.20 time: 2.024995 Jul 18 02:35:42.936759 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1866/3730] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:40 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1405 bytes in 2044 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:43.027015 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-5559cecd-b3de-471f-b578-d0db12b5e017 req-f9993b42-0c5d-4fd9-b765-dd758190ebe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d18d284e-d055-4fe5-af1c-b41ee803d426", "tag": "6ca46669-298c-45bb-bc10-3dd6fed58f4a"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:43.088685 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-5559cecd-b3de-471f-b578-d0db12b5e017 req-f9993b42-0c5d-4fd9-b765-dd758190ebe7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:43.089149 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-5559cecd-b3de-471f-b578-d0db12b5e017 req-f9993b42-0c5d-4fd9-b765-dd758190ebe7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:43.106439 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-5559cecd-b3de-471f-b578-d0db12b5e017 req-f9993b42-0c5d-4fd9-b765-dd758190ebe7 service nova] Creating event network-changed:6ca46669-298c-45bb-bc10-3dd6fed58f4a for instance d18d284e-d055-4fe5-af1c-b41ee803d426 on n-h1-465891-3 Jul 18 02:35:43.117257 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-5559cecd-b3de-471f-b578-d0db12b5e017 req-f9993b42-0c5d-4fd9-b765-dd758190ebe7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108663 Jul 18 02:35:43.122666 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1865/3731] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:43.969745 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4a6ba019-d98a-43ee-a5eb-5b576e78fd61 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:43.971790 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4a6ba019-d98a-43ee-a5eb-5b576e78fd61 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:43.988335 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4a6ba019-d98a-43ee-a5eb-5b576e78fd61 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:43.993056 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4a6ba019-d98a-43ee-a5eb-5b576e78fd61 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:43.994404 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4a6ba019-d98a-43ee-a5eb-5b576e78fd61 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:43.997196 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4a6ba019-d98a-43ee-a5eb-5b576e78fd61 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:44.428936 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4a6ba019-d98a-43ee-a5eb-5b576e78fd61 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:44.448632 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4a6ba019-d98a-43ee-a5eb-5b576e78fd61 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:44.459198 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4a6ba019-d98a-43ee-a5eb-5b576e78fd61 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:44.462413 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4a6ba019-d98a-43ee-a5eb-5b576e78fd61 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1405 microversion: 2.20 time: 0.497480 Jul 18 02:35:44.474478 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1867/3732] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:43 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1405 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:45.488290 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-eca50d47-611d-4087-bcb5-1126d695df50 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:45.497907 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-eca50d47-611d-4087-bcb5-1126d695df50 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:45.540105 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eca50d47-611d-4087-bcb5-1126d695df50 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:45.540911 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eca50d47-611d-4087-bcb5-1126d695df50 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:45.558242 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eca50d47-611d-4087-bcb5-1126d695df50 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:45.560918 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eca50d47-611d-4087-bcb5-1126d695df50 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:46.773311 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-eca50d47-611d-4087-bcb5-1126d695df50 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:46.820767 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-eca50d47-611d-4087-bcb5-1126d695df50 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:46.824742 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-eca50d47-611d-4087-bcb5-1126d695df50 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:46.830625 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-eca50d47-611d-4087-bcb5-1126d695df50 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1405 microversion: 2.20 time: 1.351802 Jul 18 02:35:46.837845 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1866/3733] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:45 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1405 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:47.871439 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e5c74636-9a06-425f-b2d8-b2c57bcbc212 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:47.874828 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e5c74636-9a06-425f-b2d8-b2c57bcbc212 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:47.898522 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e5c74636-9a06-425f-b2d8-b2c57bcbc212 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:47.899069 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e5c74636-9a06-425f-b2d8-b2c57bcbc212 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:47.899923 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e5c74636-9a06-425f-b2d8-b2c57bcbc212 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:47.900364 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e5c74636-9a06-425f-b2d8-b2c57bcbc212 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:49.944353 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e5c74636-9a06-425f-b2d8-b2c57bcbc212 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:49.984047 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e5c74636-9a06-425f-b2d8-b2c57bcbc212 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:50.003336 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e5c74636-9a06-425f-b2d8-b2c57bcbc212 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:50.006325 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e5c74636-9a06-425f-b2d8-b2c57bcbc212 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1405 microversion: 2.20 time: 2.144313 Jul 18 02:35:50.014935 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1868/3734] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:47 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1405 bytes in 2154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:35:51.048493 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3ffb8e12-5002-4bde-ac97-94c1b270b3e4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:51.052626 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3ffb8e12-5002-4bde-ac97-94c1b270b3e4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:51.104788 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3ffb8e12-5002-4bde-ac97-94c1b270b3e4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:51.107030 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3ffb8e12-5002-4bde-ac97-94c1b270b3e4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:51.108548 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3ffb8e12-5002-4bde-ac97-94c1b270b3e4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:51.114095 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3ffb8e12-5002-4bde-ac97-94c1b270b3e4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:52.008686 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3ffb8e12-5002-4bde-ac97-94c1b270b3e4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:52.044538 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:52.094115 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3ffb8e12-5002-4bde-ac97-94c1b270b3e4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:52.095843 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3ffb8e12-5002-4bde-ac97-94c1b270b3e4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:52.097173 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3ffb8e12-5002-4bde-ac97-94c1b270b3e4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1405 microversion: 2.20 time: 1.057994 Jul 18 02:35:52.097908 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1867/3735] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:51 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1405 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:35:53.134313 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3b4e30ec-29e3-4d5a-84c5-d66faa939397 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:53.135890 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3b4e30ec-29e3-4d5a-84c5-d66faa939397 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:53.153773 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b4e30ec-29e3-4d5a-84c5-d66faa939397 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:53.154632 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b4e30ec-29e3-4d5a-84c5-d66faa939397 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:53.155933 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b4e30ec-29e3-4d5a-84c5-d66faa939397 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:53.160893 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b4e30ec-29e3-4d5a-84c5-d66faa939397 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:53.709802 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-a6cd2a05-535f-429e-842d-cef11da7d0ee req-40fc616e-3970-4506-9f5f-e0844bd78cc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d18d284e-d055-4fe5-af1c-b41ee803d426", "name": "network-vif-plugged", "status": "completed", "tag": "6ca46669-298c-45bb-bc10-3dd6fed58f4a"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:53.736977 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3b4e30ec-29e3-4d5a-84c5-d66faa939397 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:53.738890 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-a6cd2a05-535f-429e-842d-cef11da7d0ee req-40fc616e-3970-4506-9f5f-e0844bd78cc9 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:53.739460 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-a6cd2a05-535f-429e-842d-cef11da7d0ee req-40fc616e-3970-4506-9f5f-e0844bd78cc9 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:53.772808 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-a6cd2a05-535f-429e-842d-cef11da7d0ee req-40fc616e-3970-4506-9f5f-e0844bd78cc9 service nova] Creating event network-vif-plugged:6ca46669-298c-45bb-bc10-3dd6fed58f4a for instance d18d284e-d055-4fe5-af1c-b41ee803d426 on n-h1-465891-3 Jul 18 02:35:53.790743 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-a6cd2a05-535f-429e-842d-cef11da7d0ee req-40fc616e-3970-4506-9f5f-e0844bd78cc9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084887 Jul 18 02:35:53.791545 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1868/3736] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:35:53.799532 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3b4e30ec-29e3-4d5a-84c5-d66faa939397 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:53.806136 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3b4e30ec-29e3-4d5a-84c5-d66faa939397 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:53.815275 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3b4e30ec-29e3-4d5a-84c5-d66faa939397 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1405 microversion: 2.20 time: 0.685039 Jul 18 02:35:53.817443 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1869/3737] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:53 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1405 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:54.456909 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-82e2a17a-7751-4997-b199-501941b834be tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:54.459349 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-82e2a17a-7751-4997-b199-501941b834be tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:54.493692 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:54.503885 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-82e2a17a-7751-4997-b199-501941b834be tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:54.503885 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-82e2a17a-7751-4997-b199-501941b834be tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:54.505442 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-82e2a17a-7751-4997-b199-501941b834be tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:54.506510 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-82e2a17a-7751-4997-b199-501941b834be tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:54.616668 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-82e2a17a-7751-4997-b199-501941b834be tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lazy-loading 'flavor' on Instance uuid ec655fda-37a0-4b96-b478-3ca18ffa37f2 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:35:54.857044 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ad94e781-d911-4bb9-a094-e1ba4d5f518e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:54.866724 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ad94e781-d911-4bb9-a094-e1ba4d5f518e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:54.904745 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ad94e781-d911-4bb9-a094-e1ba4d5f518e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:54.921562 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ad94e781-d911-4bb9-a094-e1ba4d5f518e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:54.937210 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ad94e781-d911-4bb9-a094-e1ba4d5f518e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:54.940109 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ad94e781-d911-4bb9-a094-e1ba4d5f518e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:55.334108 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-82e2a17a-7751-4997-b199-501941b834be tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "POST /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2/action" status: 200 len: 32 microversion: 2.1 time: 0.888293 Jul 18 02:35:55.335370 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ad94e781-d911-4bb9-a094-e1ba4d5f518e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:55.336703 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1869/3738] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:35:54 2022] POST /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2/action => generated 32 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:35:55.351823 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-acadfec9-e222-449e-ae6a-deecb7198d9a tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:55.366985 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-acadfec9-e222-449e-ae6a-deecb7198d9a tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:55.380507 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ad94e781-d911-4bb9-a094-e1ba4d5f518e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:55.384270 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-acadfec9-e222-449e-ae6a-deecb7198d9a tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:55.384508 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ad94e781-d911-4bb9-a094-e1ba4d5f518e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:55.384930 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-acadfec9-e222-449e-ae6a-deecb7198d9a tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:55.387195 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ad94e781-d911-4bb9-a094-e1ba4d5f518e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1405 microversion: 2.20 time: 0.537771 Jul 18 02:35:55.387658 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-acadfec9-e222-449e-ae6a-deecb7198d9a tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:55.388779 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1870/3739] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:54 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1405 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:55.390097 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-acadfec9-e222-449e-ae6a-deecb7198d9a tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:56.157558 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-acadfec9-e222-449e-ae6a-deecb7198d9a tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:56.168485 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-acadfec9-e222-449e-ae6a-deecb7198d9a tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 200 len: 1736 microversion: 2.1 time: 0.824209 Jul 18 02:35:56.169309 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1870/3740] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:55 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 1736 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:56.408708 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-989a7c43-8817-4630-9259-b4fb87dd2c6d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:56.410102 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-989a7c43-8817-4630-9259-b4fb87dd2c6d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:56.428557 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-989a7c43-8817-4630-9259-b4fb87dd2c6d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:56.429427 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-989a7c43-8817-4630-9259-b4fb87dd2c6d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:56.430509 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-989a7c43-8817-4630-9259-b4fb87dd2c6d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:56.436375 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-989a7c43-8817-4630-9259-b4fb87dd2c6d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:56.927715 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-989a7c43-8817-4630-9259-b4fb87dd2c6d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:56.946238 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-989a7c43-8817-4630-9259-b4fb87dd2c6d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:56.969481 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-989a7c43-8817-4630-9259-b4fb87dd2c6d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:56.972902 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-989a7c43-8817-4630-9259-b4fb87dd2c6d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1597 microversion: 2.20 time: 0.568701 Jul 18 02:35:56.979654 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1871/3741] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:56 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1597 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:35:57.015134 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3c10ccd4-244e-48e4-b080-dcde2245cd2c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:57.018924 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3c10ccd4-244e-48e4-b080-dcde2245cd2c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:57.061141 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3c10ccd4-244e-48e4-b080-dcde2245cd2c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:57.063762 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3c10ccd4-244e-48e4-b080-dcde2245cd2c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:57.065856 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3c10ccd4-244e-48e4-b080-dcde2245cd2c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:57.067054 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3c10ccd4-244e-48e4-b080-dcde2245cd2c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:57.201890 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-01daea4f-27f2-49da-a6bb-c37e0892aee0 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:57.203594 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-01daea4f-27f2-49da-a6bb-c37e0892aee0 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:57.253036 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-01daea4f-27f2-49da-a6bb-c37e0892aee0 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:57.259729 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3c10ccd4-244e-48e4-b080-dcde2245cd2c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.251765 Jul 18 02:35:57.266774 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1871/3742] 10.222.0.57 () {60 vars in 1315 bytes} [Mon Jul 18 02:35:57 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/os-interface => generated 284 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:35:57.266991 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-01daea4f-27f2-49da-a6bb-c37e0892aee0 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:57.266991 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-01daea4f-27f2-49da-a6bb-c37e0892aee0 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:57.266991 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-01daea4f-27f2-49da-a6bb-c37e0892aee0 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:57.815092 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-01daea4f-27f2-49da-a6bb-c37e0892aee0 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:57.834857 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-01daea4f-27f2-49da-a6bb-c37e0892aee0 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 200 len: 1736 microversion: 2.1 time: 0.649761 Jul 18 02:35:57.836894 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1872/3743] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:57 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 1736 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:58.861281 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-68f2016d-6f52-45a4-be97-5508dc5d6de8 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:58.863472 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-68f2016d-6f52-45a4-be97-5508dc5d6de8 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:58.874119 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-68f2016d-6f52-45a4-be97-5508dc5d6de8 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:58.875251 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-68f2016d-6f52-45a4-be97-5508dc5d6de8 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:58.876965 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-68f2016d-6f52-45a4-be97-5508dc5d6de8 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:58.878066 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-68f2016d-6f52-45a4-be97-5508dc5d6de8 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:00.565450 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-68f2016d-6f52-45a4-be97-5508dc5d6de8 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:00.602883 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-68f2016d-6f52-45a4-be97-5508dc5d6de8 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 200 len: 1736 microversion: 2.1 time: 1.750792 Jul 18 02:36:00.604675 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1872/3744] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:58 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 1736 bytes in 1754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:01.639770 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b55c2d39-9835-46d6-9663-909de14a6741 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:01.640770 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b55c2d39-9835-46d6-9663-909de14a6741 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:01.666336 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b55c2d39-9835-46d6-9663-909de14a6741 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:01.668366 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b55c2d39-9835-46d6-9663-909de14a6741 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:01.672869 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b55c2d39-9835-46d6-9663-909de14a6741 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:01.674761 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b55c2d39-9835-46d6-9663-909de14a6741 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:01.686329 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=78 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:01.711354 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-676077d8-c4a2-456f-bad3-90dff79fc7a9 req-ec56fba9-84d8-4100-ace5-5a90bce80071 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d18d284e-d055-4fe5-af1c-b41ee803d426", "tag": "6ca46669-298c-45bb-bc10-3dd6fed58f4a"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:01.764126 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-676077d8-c4a2-456f-bad3-90dff79fc7a9 req-ec56fba9-84d8-4100-ace5-5a90bce80071 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:01.764902 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-676077d8-c4a2-456f-bad3-90dff79fc7a9 req-ec56fba9-84d8-4100-ace5-5a90bce80071 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:01.825104 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-676077d8-c4a2-456f-bad3-90dff79fc7a9 req-ec56fba9-84d8-4100-ace5-5a90bce80071 service nova] Creating event network-changed:6ca46669-298c-45bb-bc10-3dd6fed58f4a for instance d18d284e-d055-4fe5-af1c-b41ee803d426 on n-h1-465891-3 Jul 18 02:36:01.835631 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-676077d8-c4a2-456f-bad3-90dff79fc7a9 req-ec56fba9-84d8-4100-ace5-5a90bce80071 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137600 Jul 18 02:36:01.837574 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1873/3745] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:36:02.866488 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b55c2d39-9835-46d6-9663-909de14a6741 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:02.918653 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b55c2d39-9835-46d6-9663-909de14a6741 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 200 len: 1736 microversion: 2.1 time: 1.282438 Jul 18 02:36:02.936598 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1873/3746] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:01 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 1736 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:03.972656 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6e1d6890-a8bd-4566-b13a-2ae565538b51 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:03.978764 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6e1d6890-a8bd-4566-b13a-2ae565538b51 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:04.010919 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e1d6890-a8bd-4566-b13a-2ae565538b51 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:04.013219 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e1d6890-a8bd-4566-b13a-2ae565538b51 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:04.021907 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e1d6890-a8bd-4566-b13a-2ae565538b51 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:04.026203 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e1d6890-a8bd-4566-b13a-2ae565538b51 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:04.451840 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-774f0f83-600f-4fed-be28-71b4b1bea5dd tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:04.452673 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-774f0f83-600f-4fed-be28-71b4b1bea5dd tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] [instance: 59f937b8-6fb3-47d1-9090-a729a3c0fa51] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:04.498400 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-774f0f83-600f-4fed-be28-71b4b1bea5dd tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:04.498841 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-774f0f83-600f-4fed-be28-71b4b1bea5dd tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:04.505648 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-774f0f83-600f-4fed-be28-71b4b1bea5dd tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:04.506352 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-774f0f83-600f-4fed-be28-71b4b1bea5dd tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:04.617560 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-774f0f83-600f-4fed-be28-71b4b1bea5dd tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] [instance: 59f937b8-6fb3-47d1-9090-a729a3c0fa51] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:36:04.652890 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6e1d6890-a8bd-4566-b13a-2ae565538b51 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:04.687928 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6e1d6890-a8bd-4566-b13a-2ae565538b51 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 200 len: 1736 microversion: 2.1 time: 0.739161 Jul 18 02:36:04.695808 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1874/3747] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:03 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 1736 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:05.017488 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-774f0f83-600f-4fed-be28-71b4b1bea5dd tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] 10.222.0.57 "DELETE /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51" status: 204 len: 0 microversion: 2.1 time: 0.570983 Jul 18 02:36:05.018587 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1874/3748] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:36:04 2022] DELETE /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:36:05.038680 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6b81c21d-0300-4020-b2f8-e77c3a6cc703 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:05.039659 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6b81c21d-0300-4020-b2f8-e77c3a6cc703 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] [instance: 59f937b8-6fb3-47d1-9090-a729a3c0fa51] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:05.080032 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6b81c21d-0300-4020-b2f8-e77c3a6cc703 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:05.080528 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6b81c21d-0300-4020-b2f8-e77c3a6cc703 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:05.083639 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6b81c21d-0300-4020-b2f8-e77c3a6cc703 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:05.090731 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6b81c21d-0300-4020-b2f8-e77c3a6cc703 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:05.738026 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b8861b0b-4a19-4740-87d5-6551b7348fad tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:05.740553 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b8861b0b-4a19-4740-87d5-6551b7348fad tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:05.765001 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b8861b0b-4a19-4740-87d5-6551b7348fad tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:05.765766 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b8861b0b-4a19-4740-87d5-6551b7348fad tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:05.768771 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b8861b0b-4a19-4740-87d5-6551b7348fad tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:05.770540 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b8861b0b-4a19-4740-87d5-6551b7348fad tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:06.126470 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6b81c21d-0300-4020-b2f8-e77c3a6cc703 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bad5add9ab4b05a2fced0106b8e680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10687185688149cfb184fdcfdbc1b69e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:06.156121 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6b81c21d-0300-4020-b2f8-e77c3a6cc703 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] 10.222.0.57 "GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51" status: 200 len: 1666 microversion: 2.1 time: 1.125014 Jul 18 02:36:06.169819 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1875/3749] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:05 2022] GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51 => generated 1666 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:06.775453 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b8861b0b-4a19-4740-87d5-6551b7348fad tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:06.820877 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b8861b0b-4a19-4740-87d5-6551b7348fad tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 200 len: 1736 microversion: 2.1 time: 1.098813 Jul 18 02:36:06.831283 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1875/3750] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:05 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 1736 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:07.202972 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e9d1210b-83d6-441d-b87c-9c5dac8c022c tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:07.204460 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e9d1210b-83d6-441d-b87c-9c5dac8c022c tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] [instance: 59f937b8-6fb3-47d1-9090-a729a3c0fa51] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:07.224510 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e9d1210b-83d6-441d-b87c-9c5dac8c022c tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:07.225410 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e9d1210b-83d6-441d-b87c-9c5dac8c022c tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:07.226739 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e9d1210b-83d6-441d-b87c-9c5dac8c022c tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:07.227472 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e9d1210b-83d6-441d-b87c-9c5dac8c022c tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:07.858523 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-faf346a1-b486-4da7-b68b-5f5970c40537 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:07.861410 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-faf346a1-b486-4da7-b68b-5f5970c40537 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:07.888340 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:07.890136 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-faf346a1-b486-4da7-b68b-5f5970c40537 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:07.890593 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-faf346a1-b486-4da7-b68b-5f5970c40537 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:07.903786 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-faf346a1-b486-4da7-b68b-5f5970c40537 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:07.904255 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-faf346a1-b486-4da7-b68b-5f5970c40537 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:08.362331 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e9d1210b-83d6-441d-b87c-9c5dac8c022c tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bad5add9ab4b05a2fced0106b8e680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10687185688149cfb184fdcfdbc1b69e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:08.363360 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-faf346a1-b486-4da7-b68b-5f5970c40537 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:08.375366 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-faf346a1-b486-4da7-b68b-5f5970c40537 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 200 len: 1736 microversion: 2.1 time: 0.523398 Jul 18 02:36:08.389418 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1876/3751] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:07 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 1736 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:36:08.430051 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e9d1210b-83d6-441d-b87c-9c5dac8c022c tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] 10.222.0.57 "GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51" status: 200 len: 1666 microversion: 2.1 time: 1.227126 Jul 18 02:36:08.431624 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1876/3752] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:07 2022] GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51 => generated 1666 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:09.415196 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1dc604cd-6c42-4044-800e-d98f138a22dd tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:09.424578 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1dc604cd-6c42-4044-800e-d98f138a22dd tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:09.456693 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6aa39e32-0f73-47d4-8254-35684233d641 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:09.457518 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6aa39e32-0f73-47d4-8254-35684233d641 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] [instance: 59f937b8-6fb3-47d1-9090-a729a3c0fa51] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:09.458803 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1dc604cd-6c42-4044-800e-d98f138a22dd tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:09.468729 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1dc604cd-6c42-4044-800e-d98f138a22dd tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:09.470947 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1dc604cd-6c42-4044-800e-d98f138a22dd tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:09.471934 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1dc604cd-6c42-4044-800e-d98f138a22dd tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:09.507443 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6aa39e32-0f73-47d4-8254-35684233d641 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:09.508229 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6aa39e32-0f73-47d4-8254-35684233d641 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:09.509092 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6aa39e32-0f73-47d4-8254-35684233d641 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:09.516659 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6aa39e32-0f73-47d4-8254-35684233d641 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:09.935159 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6aa39e32-0f73-47d4-8254-35684233d641 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bad5add9ab4b05a2fced0106b8e680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10687185688149cfb184fdcfdbc1b69e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:09.970860 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6aa39e32-0f73-47d4-8254-35684233d641 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] 10.222.0.57 "GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51" status: 200 len: 1599 microversion: 2.1 time: 0.519018 Jul 18 02:36:09.972239 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1877/3753] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:09 2022] GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51 => generated 1599 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:10.172964 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1dc604cd-6c42-4044-800e-d98f138a22dd tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:10.191288 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1dc604cd-6c42-4044-800e-d98f138a22dd tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 200 len: 1736 microversion: 2.1 time: 0.798902 Jul 18 02:36:10.214601 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1877/3754] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:09 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 1736 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:10.387662 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-7eb8b10a-08cd-4152-9efb-d56fe90f323d req-164c8b0d-5653-49b2-a305-d2630a8483b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59f937b8-6fb3-47d1-9090-a729a3c0fa51", "name": "network-vif-deleted", "tag": "68571bd9-6db3-4e03-b3c8-bc14842873b7"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:10.414324 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-7eb8b10a-08cd-4152-9efb-d56fe90f323d req-164c8b0d-5653-49b2-a305-d2630a8483b0 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:10.415728 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-7eb8b10a-08cd-4152-9efb-d56fe90f323d req-164c8b0d-5653-49b2-a305-d2630a8483b0 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:10.454817 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-7eb8b10a-08cd-4152-9efb-d56fe90f323d req-164c8b0d-5653-49b2-a305-d2630a8483b0 service nova] Creating event network-vif-deleted:68571bd9-6db3-4e03-b3c8-bc14842873b7 for instance 59f937b8-6fb3-47d1-9090-a729a3c0fa51 on n-h2-465891-3 Jul 18 02:36:10.471191 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-7eb8b10a-08cd-4152-9efb-d56fe90f323d req-164c8b0d-5653-49b2-a305-d2630a8483b0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086688 Jul 18 02:36:10.475165 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1878/3755] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:36:10.996148 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5c0a68d8-99c8-42cd-af1e-ff98f9de5278 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:10.996999 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5c0a68d8-99c8-42cd-af1e-ff98f9de5278 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] [instance: 59f937b8-6fb3-47d1-9090-a729a3c0fa51] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:11.014236 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5c0a68d8-99c8-42cd-af1e-ff98f9de5278 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:11.014775 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5c0a68d8-99c8-42cd-af1e-ff98f9de5278 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:11.015683 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5c0a68d8-99c8-42cd-af1e-ff98f9de5278 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:11.016134 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5c0a68d8-99c8-42cd-af1e-ff98f9de5278 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:11.097478 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5c0a68d8-99c8-42cd-af1e-ff98f9de5278 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:11.102304 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5c0a68d8-99c8-42cd-af1e-ff98f9de5278 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:11.103002 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-5c0a68d8-99c8-42cd-af1e-ff98f9de5278 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lazy-loading 'fault' on Instance uuid 59f937b8-6fb3-47d1-9090-a729a3c0fa51 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:36:11.211613 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-93bbfb5f-46d4-4206-ac14-4f414c3ad626 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:11.212510 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-93bbfb5f-46d4-4206-ac14-4f414c3ad626 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:11.233650 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-93bbfb5f-46d4-4206-ac14-4f414c3ad626 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:11.234585 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-93bbfb5f-46d4-4206-ac14-4f414c3ad626 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:11.235790 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-93bbfb5f-46d4-4206-ac14-4f414c3ad626 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:11.236458 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-93bbfb5f-46d4-4206-ac14-4f414c3ad626 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:12.012793 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5c0a68d8-99c8-42cd-af1e-ff98f9de5278 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bad5add9ab4b05a2fced0106b8e680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10687185688149cfb184fdcfdbc1b69e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:12.052569 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5c0a68d8-99c8-42cd-af1e-ff98f9de5278 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] 10.222.0.57 "GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51" status: 200 len: 1316 microversion: 2.1 time: 1.062017 Jul 18 02:36:12.058871 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1878/3756] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:10 2022] GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51 => generated 1316 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:12.598826 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-93bbfb5f-46d4-4206-ac14-4f414c3ad626 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:12.612590 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-93bbfb5f-46d4-4206-ac14-4f414c3ad626 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 200 len: 1736 microversion: 2.1 time: 1.405849 Jul 18 02:36:12.613283 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1879/3757] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:11 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 1736 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:36:13.107324 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-07d86903-b6fc-4581-a9ae-d90d2d555766 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:13.115122 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-07d86903-b6fc-4581-a9ae-d90d2d555766 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] [instance: 59f937b8-6fb3-47d1-9090-a729a3c0fa51] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:13.179573 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-07d86903-b6fc-4581-a9ae-d90d2d555766 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:13.180407 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-07d86903-b6fc-4581-a9ae-d90d2d555766 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:13.181843 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-07d86903-b6fc-4581-a9ae-d90d2d555766 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:13.182647 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-07d86903-b6fc-4581-a9ae-d90d2d555766 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:13.313646 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-07d86903-b6fc-4581-a9ae-d90d2d555766 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] HTTP exception thrown: Instance 59f937b8-6fb3-47d1-9090-a729a3c0fa51 could not be found. Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-07d86903-b6fc-4581-a9ae-d90d2d555766 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Request method failure captured: Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51 HTTP/1.1 Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1Ma--V8yNL5RoFB3_Prd3-cahgS89aoePhRkLXso2pHtWPuSRnEKLx2W5D13LnZeEovlJP2SXZ5o8DfgagcGb_mlDohPe1XxdchIJl501-HWhuPLu-lzGGWGnFJyjt4tj33L2_MrkWtELVV7GUueEI5IFp0Dhv2BL7BfFPTibf5_vTc Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 10687185688149cfb184fdcfdbc1b69e Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersTestFqdnHostnames-1671132510 Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_10687185688149cfb184fdcfdbc1b69e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/10687185688149cfb184fdcfdbc1b69e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/10687185688149cfb184fdcfdbc1b69e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/10687185688149cfb184fdcfdbc1b69e"}]}] Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersTestFqdnHostnames-1671132510 Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 10687185688149cfb184fdcfdbc1b69e Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1671132510 Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersTestFqdnHostnames-1671132510-project Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 22bad5add9ab4b05a2fced0106b8e680 Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersTestFqdnHostnames-1671132510-project Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 59f937b8-6fb3-47d1-9090-a729a3c0fa51 could not be found. Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '59f937b8-6fb3-47d1-9090-a729a3c0fa51'} Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59f937b8-6fb3-47d1-9090-a729a3c0fa51 could not be found. Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59f937b8-6fb3-47d1-9090-a729a3c0fa51 could not be found. Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:13.325237 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:36:13.340263 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:13.340263 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:13.340263 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:13.340263 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:36:13.340263 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:36:13.340263 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59f937b8-6fb3-47d1-9090-a729a3c0fa51 could not be found. Jul 18 02:36:13.340263 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:36:13.340263 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-07d86903-b6fc-4581-a9ae-d90d2d555766 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Returning 404 to user: Instance 59f937b8-6fb3-47d1-9090-a729a3c0fa51 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:36:13.360226 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-07d86903-b6fc-4581-a9ae-d90d2d555766 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] 10.222.0.57 "GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51" status: 404 len: 111 microversion: 2.1 time: 0.285028 Jul 18 02:36:13.362926 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1879/3758] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:13 2022] GET /compute/v2.1/servers/59f937b8-6fb3-47d1-9090-a729a3c0fa51 => generated 111 bytes in 290 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:36:13.385114 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-35528632-84c2-44f2-8487-36041e473b07 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] Calling method '.version_select at 0x7ff49b73eee0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:13.440208 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-35528632-84c2-44f2-8487-36041e473b07 tempest-ServersTestFqdnHostnames-1671132510 tempest-ServersTestFqdnHostnames-1671132510-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1503615496" status: 202 len: 0 microversion: 2.1 time: 0.071015 Jul 18 02:36:13.444979 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1880/3759] 10.222.0.57 () {58 vars in 1220 bytes} [Mon Jul 18 02:36:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1503615496 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:36:13.639218 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-01d615c6-2111-4e58-905b-618664e656d7 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:13.644029 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-01d615c6-2111-4e58-905b-618664e656d7 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:13.673187 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-01d615c6-2111-4e58-905b-618664e656d7 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:13.678246 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-01d615c6-2111-4e58-905b-618664e656d7 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:13.681547 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-01d615c6-2111-4e58-905b-618664e656d7 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:13.685465 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-01d615c6-2111-4e58-905b-618664e656d7 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:14.900499 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-01d615c6-2111-4e58-905b-618664e656d7 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:14.985066 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-01d615c6-2111-4e58-905b-618664e656d7 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 200 len: 1736 microversion: 2.1 time: 1.357471 Jul 18 02:36:15.004958 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1880/3760] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:13 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 1736 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:16.017193 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-531df6bc-4626-4f46-8649-a1e347c63968 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:16.018764 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-531df6bc-4626-4f46-8649-a1e347c63968 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:16.034919 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-531df6bc-4626-4f46-8649-a1e347c63968 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:16.038600 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-531df6bc-4626-4f46-8649-a1e347c63968 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:16.039773 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-531df6bc-4626-4f46-8649-a1e347c63968 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:16.044858 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-531df6bc-4626-4f46-8649-a1e347c63968 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:16.928218 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-531df6bc-4626-4f46-8649-a1e347c63968 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:16.992108 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-531df6bc-4626-4f46-8649-a1e347c63968 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 200 len: 1736 microversion: 2.1 time: 0.978464 Jul 18 02:36:16.993140 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1881/3761] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:16 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 1736 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:18.012144 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-098b22d2-1ea7-49d7-8452-bc7c92c3f847 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:18.014170 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-098b22d2-1ea7-49d7-8452-bc7c92c3f847 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:18.046764 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-098b22d2-1ea7-49d7-8452-bc7c92c3f847 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:18.047113 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-098b22d2-1ea7-49d7-8452-bc7c92c3f847 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:18.061034 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-098b22d2-1ea7-49d7-8452-bc7c92c3f847 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:18.067800 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-098b22d2-1ea7-49d7-8452-bc7c92c3f847 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:19.020625 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-098b22d2-1ea7-49d7-8452-bc7c92c3f847 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:19.063734 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-098b22d2-1ea7-49d7-8452-bc7c92c3f847 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 200 len: 1736 microversion: 2.1 time: 1.055781 Jul 18 02:36:19.065015 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1881/3762] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:18 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 1736 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:20.101032 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8c1079cf-b3b1-405f-bde2-a6cbc751c8b1 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:20.129284 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8c1079cf-b3b1-405f-bde2-a6cbc751c8b1 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:20.207722 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8c1079cf-b3b1-405f-bde2-a6cbc751c8b1 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:20.208108 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8c1079cf-b3b1-405f-bde2-a6cbc751c8b1 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:20.208935 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8c1079cf-b3b1-405f-bde2-a6cbc751c8b1 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:20.216965 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8c1079cf-b3b1-405f-bde2-a6cbc751c8b1 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:20.831787 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8c1079cf-b3b1-405f-bde2-a6cbc751c8b1 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:20.862448 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8c1079cf-b3b1-405f-bde2-a6cbc751c8b1 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 200 len: 1736 microversion: 2.1 time: 0.768489 Jul 18 02:36:20.869384 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1882/3763] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:20 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 1736 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:21.902830 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-16c22388-22c2-4289-bf4d-f98651280383 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:21.904410 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-16c22388-22c2-4289-bf4d-f98651280383 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:21.920949 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-16c22388-22c2-4289-bf4d-f98651280383 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:21.921690 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-16c22388-22c2-4289-bf4d-f98651280383 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:21.922721 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-16c22388-22c2-4289-bf4d-f98651280383 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:21.924805 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-16c22388-22c2-4289-bf4d-f98651280383 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:22.900577 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-16c22388-22c2-4289-bf4d-f98651280383 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:22.912833 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-16c22388-22c2-4289-bf4d-f98651280383 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 200 len: 1716 microversion: 2.1 time: 1.014081 Jul 18 02:36:22.923930 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1882/3764] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:21 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 1716 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:23.337520 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-35fea6fa-15bc-4206-b5ab-9020fb37d171 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:23.344803 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-35fea6fa-15bc-4206-b5ab-9020fb37d171 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:23.449381 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-35fea6fa-15bc-4206-b5ab-9020fb37d171 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:23.449748 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-35fea6fa-15bc-4206-b5ab-9020fb37d171 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:23.453278 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-35fea6fa-15bc-4206-b5ab-9020fb37d171 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:23.453278 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-35fea6fa-15bc-4206-b5ab-9020fb37d171 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:23.686137 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-35fea6fa-15bc-4206-b5ab-9020fb37d171 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] HTTP exception thrown: Cannot 'detach_volume' instance ec655fda-37a0-4b96-b478-3ca18ffa37f2 while it is in vm_state rescued Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-35fea6fa-15bc-4206-b5ab-9020fb37d171 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Request method failure captured: Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2/os-volume_attachments/be7e808b-40c5-46b9-85e6-38b862e1b9bb HTTP/1.1 Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MYgsMpQMGg_x4SatJimijJMXDATUd7K8pbmJMir06_hhN9kc6nEv2UNuBHWPOsjhgniijNTcv86Pv1g5if6jfxnXnFgylGVtP-ES0p4q8KsL3cpv9H2D_niEdkyIvqxweiHovqWE9ZMi6DufO28-UhMwnDHb097CRDIZ6xtrA6LrKI Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 1594a06c4e7c4bb7b184d916342933ba Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1345973443 Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1594a06c4e7c4bb7b184d916342933ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1594a06c4e7c4bb7b184d916342933ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1594a06c4e7c4bb7b184d916342933ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1594a06c4e7c4bb7b184d916342933ba"}]}] Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1345973443 Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 1594a06c4e7c4bb7b184d916342933ba Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1345973443 Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServerRescueNegativeTestJSON-1345973443-project Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 6f30a2016d954121bb251894fad6dd39 Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1345973443-project Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: exception: Cannot 'detach_volume' instance ec655fda-37a0-4b96-b478-3ca18ffa37f2 while it is in vm_state rescued Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'server_id': 'ec655fda-37a0-4b96-b478-3ca18ffa37f2', 'id': 'be7e808b-40c5-46b9-85e6-38b862e1b9bb'} Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ec655fda-37a0-4b96-b478-3ca18ffa37f2 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance ec655fda-37a0-4b96-b478-3ca18ffa37f2 while it is in vm_state rescued Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:36:23.691573 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:23.697315 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:23.697315 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:23.697315 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:36:23.697315 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:36:23.697315 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance ec655fda-37a0-4b96-b478-3ca18ffa37f2 while it is in vm_state rescued Jul 18 02:36:23.697315 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:36:23.722102 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-35fea6fa-15bc-4206-b5ab-9020fb37d171 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Returning 409 to user: Cannot 'detach_volume' instance ec655fda-37a0-4b96-b478-3ca18ffa37f2 while it is in vm_state rescued {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:36:23.741395 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-35fea6fa-15bc-4206-b5ab-9020fb37d171 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2/os-volume_attachments/be7e808b-40c5-46b9-85e6-38b862e1b9bb" status: 409 len: 152 microversion: 2.1 time: 0.397987 Jul 18 02:36:23.751376 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1883/3765] 10.222.0.57 () {58 vars in 1415 bytes} [Mon Jul 18 02:36:23 2022] DELETE /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2/os-volume_attachments/be7e808b-40c5-46b9-85e6-38b862e1b9bb => generated 152 bytes in 427 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:36:23.752792 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8ae80b43-ba26-452f-b1e9-9c474de45151 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:23.753801 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8ae80b43-ba26-452f-b1e9-9c474de45151 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:23.771862 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8ae80b43-ba26-452f-b1e9-9c474de45151 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:23.772612 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8ae80b43-ba26-452f-b1e9-9c474de45151 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:23.775269 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8ae80b43-ba26-452f-b1e9-9c474de45151 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:23.779943 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8ae80b43-ba26-452f-b1e9-9c474de45151 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:23.993792 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8ae80b43-ba26-452f-b1e9-9c474de45151 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "POST /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2/action" status: 202 len: 0 microversion: 2.1 time: 0.244711 Jul 18 02:36:23.995747 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1883/3766] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:36:23 2022] POST /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:36:24.026373 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9efe89a3-6b7f-4e4a-b6ab-084d3a4f7b22 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:24.036046 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9efe89a3-6b7f-4e4a-b6ab-084d3a4f7b22 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:24.098197 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9efe89a3-6b7f-4e4a-b6ab-084d3a4f7b22 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:24.104468 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9efe89a3-6b7f-4e4a-b6ab-084d3a4f7b22 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:24.106882 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9efe89a3-6b7f-4e4a-b6ab-084d3a4f7b22 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:24.108043 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9efe89a3-6b7f-4e4a-b6ab-084d3a4f7b22 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:24.319670 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-728897ad-237e-4480-b18c-bad76305c5d4 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Action: 'create', calling method: .version_select at 0x7ff4a8514670>, body: {"keypair": {"name": "tempest-keypair-1279992318", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNSQHkcQquAUW5ygU+yqUarSXV0mupA+vwOg3MBKlpDnDP3OqxfSlH5UkJAo78zbYvqtNe8ZrUVXkuEHKtSji5mmZ5ZAZJpDiGmsAkaWcyZCdR1pMXKu8h7H8lIM1WqArQ=="}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:24.364434 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-728897ad-237e-4480-b18c-bad76305c5d4 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Getting quotas for project 336d3f06bd2b47a9a233ea5a842318ee. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:36:24.375613 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-728897ad-237e-4480-b18c-bad76305c5d4 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Getting quotas for user c2d2800b4df544c9a7c2465f0fc9ba3d and project 336d3f06bd2b47a9a233ea5a842318ee. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:36:24.462135 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-728897ad-237e-4480-b18c-bad76305c5d4 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.130558 Jul 18 02:36:24.463349 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1884/3767] 10.222.0.57 () {62 vars in 1199 bytes} [Mon Jul 18 02:36:24 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 150 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 18 02:36:25.509031 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9efe89a3-6b7f-4e4a-b6ab-084d3a4f7b22 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:25.515822 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:25.588028 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9efe89a3-6b7f-4e4a-b6ab-084d3a4f7b22 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 200 len: 1724 microversion: 2.1 time: 1.582494 Jul 18 02:36:25.616811 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1884/3768] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:24 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 1724 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:26.640065 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d47815ae-84ff-4613-9ff0-62bba33de29b tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:26.646554 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d47815ae-84ff-4613-9ff0-62bba33de29b tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:26.726615 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d47815ae-84ff-4613-9ff0-62bba33de29b tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:26.731627 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d47815ae-84ff-4613-9ff0-62bba33de29b tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:26.740808 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d47815ae-84ff-4613-9ff0-62bba33de29b tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:26.741614 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d47815ae-84ff-4613-9ff0-62bba33de29b tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:28.256756 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d47815ae-84ff-4613-9ff0-62bba33de29b tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:28.296119 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d47815ae-84ff-4613-9ff0-62bba33de29b tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 200 len: 1724 microversion: 2.1 time: 1.675689 Jul 18 02:36:28.299798 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1885/3769] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:26 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 1724 bytes in 1681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:29.316854 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a39fbe25-fe1a-47c4-be36-4a2dda524ae0 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:29.317865 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a39fbe25-fe1a-47c4-be36-4a2dda524ae0 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:29.320680 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:29.336316 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a39fbe25-fe1a-47c4-be36-4a2dda524ae0 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:29.347492 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a39fbe25-fe1a-47c4-be36-4a2dda524ae0 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:29.348553 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a39fbe25-fe1a-47c4-be36-4a2dda524ae0 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:29.349117 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a39fbe25-fe1a-47c4-be36-4a2dda524ae0 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:29.683588 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a39fbe25-fe1a-47c4-be36-4a2dda524ae0 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:29.697001 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a39fbe25-fe1a-47c4-be36-4a2dda524ae0 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 200 len: 1730 microversion: 2.1 time: 0.384237 Jul 18 02:36:29.697886 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1885/3770] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:29 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 1730 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:36:29.729119 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e77efa59-8f3e-479f-8454-0f57e6e53fa7 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:29.747465 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e77efa59-8f3e-479f-8454-0f57e6e53fa7 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:29.798926 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e77efa59-8f3e-479f-8454-0f57e6e53fa7 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:29.804927 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e77efa59-8f3e-479f-8454-0f57e6e53fa7 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:29.811920 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e77efa59-8f3e-479f-8454-0f57e6e53fa7 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:29.816251 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e77efa59-8f3e-479f-8454-0f57e6e53fa7 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:30.072374 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e77efa59-8f3e-479f-8454-0f57e6e53fa7 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.359777 Jul 18 02:36:30.072996 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1886/3771] 10.222.0.57 () {58 vars in 1274 bytes} [Mon Jul 18 02:36:29 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2/os-interface => generated 284 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:36:32.939499 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-41091adc-8396-48b1-869e-01efc6f2ec30 req-24d806ee-9122-4e93-9d91-efd055458aaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec655fda-37a0-4b96-b478-3ca18ffa37f2", "tag": "163ed416-80e6-4cc5-ad3e-9045d5ee4529"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:33.007138 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-41091adc-8396-48b1-869e-01efc6f2ec30 req-24d806ee-9122-4e93-9d91-efd055458aaa service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:33.013127 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-41091adc-8396-48b1-869e-01efc6f2ec30 req-24d806ee-9122-4e93-9d91-efd055458aaa service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:33.096237 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-41091adc-8396-48b1-869e-01efc6f2ec30 req-24d806ee-9122-4e93-9d91-efd055458aaa service nova] Creating event network-changed:163ed416-80e6-4cc5-ad3e-9045d5ee4529 for instance ec655fda-37a0-4b96-b478-3ca18ffa37f2 on n-h2-465891-3 Jul 18 02:36:33.130699 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-41091adc-8396-48b1-869e-01efc6f2ec30 req-24d806ee-9122-4e93-9d91-efd055458aaa service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.205704 Jul 18 02:36:33.138432 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1886/3772] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:36:35.868440 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-8e4d82dd-5fe4-4124-a6ac-7013a2f6ceb0 req-a507bb4a-f836-4d26-b9c1-962f327d8b62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec655fda-37a0-4b96-b478-3ca18ffa37f2", "tag": "163ed416-80e6-4cc5-ad3e-9045d5ee4529"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:35.878181 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:35.906325 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-8e4d82dd-5fe4-4124-a6ac-7013a2f6ceb0 req-a507bb4a-f836-4d26-b9c1-962f327d8b62 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:35.908214 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-8e4d82dd-5fe4-4124-a6ac-7013a2f6ceb0 req-a507bb4a-f836-4d26-b9c1-962f327d8b62 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:35.925957 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:35.992610 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-8e4d82dd-5fe4-4124-a6ac-7013a2f6ceb0 req-a507bb4a-f836-4d26-b9c1-962f327d8b62 service nova] Creating event network-changed:163ed416-80e6-4cc5-ad3e-9045d5ee4529 for instance ec655fda-37a0-4b96-b478-3ca18ffa37f2 on n-h2-465891-3 Jul 18 02:36:36.016302 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-8e4d82dd-5fe4-4124-a6ac-7013a2f6ceb0 req-a507bb4a-f836-4d26-b9c1-962f327d8b62 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150955 Jul 18 02:36:36.021321 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1887/3773] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:36:39.393898 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-563b3f1c-9875-41f1-8e68-7d949b34edd2 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1032614150", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "6d6693bb-1b3c-491b-836d-8be25b8dd92f"}, {"port": "8b71a464-9b9d-4a74-a0e5-f2fd6b5f29c1", "tag": "port-1"}, {"port": "a9898ef4-9a1c-48a1-91ff-fa0ef93ce449", "tag": "port-2"}, {"uuid": "22ad2e2e-486e-477d-bed1-adc086413145", "tag": "net-1"}, {"uuid": "22ad2e2e-486e-477d-bed1-adc086413145"}, {"uuid": "6a599c07-3352-42ba-bc57-18d08da87c83", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "6a599c07-3352-42ba-bc57-18d08da87c83", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "14e95985-72b2-473b-a447-2f1e891d5625", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "7e2fe7a9-223a-4532-9530-ef121de1570f", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "c8b795da-1adc-44c2-9efe-9c64e3d4933a", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--188040642"}], "key_name": "tempest-keypair-1279992318", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:39.822754 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-563b3f1c-9875-41f1-8e68-7d949b34edd2 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] validate_networks() for [('6d6693bb-1b3c-491b-836d-8be25b8dd92f', None, None, None, None, None), (None, None, '8b71a464-9b9d-4a74-a0e5-f2fd6b5f29c1', None, None, None), (None, None, 'a9898ef4-9a1c-48a1-91ff-fa0ef93ce449', None, None, None), ('22ad2e2e-486e-477d-bed1-adc086413145', None, None, None, None, None), ('22ad2e2e-486e-477d-bed1-adc086413145', None, None, None, None, None), ('6a599c07-3352-42ba-bc57-18d08da87c83', '10.2.2.100', None, None, None, None), ('6a599c07-3352-42ba-bc57-18d08da87c83', '10.2.2.200', None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:36:43.045442 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=9 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:47.517879 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-563b3f1c-9875-41f1-8e68-7d949b34edd2 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:36:47.518851 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-563b3f1c-9875-41f1-8e68-7d949b34edd2 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:36:47.519774 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-563b3f1c-9875-41f1-8e68-7d949b34edd2 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:36:47.520205 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-563b3f1c-9875-41f1-8e68-7d949b34edd2 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:36:47.520625 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-563b3f1c-9875-41f1-8e68-7d949b34edd2 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:36:47.563947 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-563b3f1c-9875-41f1-8e68-7d949b34edd2 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:47.565605 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-563b3f1c-9875-41f1-8e68-7d949b34edd2 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:47.567695 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-563b3f1c-9875-41f1-8e68-7d949b34edd2 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:47.568544 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-563b3f1c-9875-41f1-8e68-7d949b34edd2 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:47.633401 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-563b3f1c-9875-41f1-8e68-7d949b34edd2 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Getting quotas for project 336d3f06bd2b47a9a233ea5a842318ee. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:36:47.696711 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-563b3f1c-9875-41f1-8e68-7d949b34edd2 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Getting quotas for user c2d2800b4df544c9a7c2465f0fc9ba3d and project 336d3f06bd2b47a9a233ea5a842318ee. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:36:48.388923 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-563b3f1c-9875-41f1-8e68-7d949b34edd2 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:36:48.392924 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-563b3f1c-9875-41f1-8e68-7d949b34edd2 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='14e95985-72b2-473b-a447-2f1e891d5625',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='7e2fe7a9-223a-4532-9530-ef121de1570f',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c8b795da-1adc-44c2-9efe-9c64e3d4933a',volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:36:49.565538 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-563b3f1c-9875-41f1-8e68-7d949b34edd2 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 10.185334 Jul 18 02:36:49.584092 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1887/3774] 10.222.0.57 () {62 vars in 1188 bytes} [Mon Jul 18 02:36:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 10205 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 02:36:49.588384 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e216757a-12fc-4816-9e2b-1839ee677075 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:49.594509 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e216757a-12fc-4816-9e2b-1839ee677075 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:49.657056 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:49.665822 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:50.169071 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e216757a-12fc-4816-9e2b-1839ee677075 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:50.213068 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e216757a-12fc-4816-9e2b-1839ee677075 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:50.222413 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e216757a-12fc-4816-9e2b-1839ee677075 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:50.227389 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e216757a-12fc-4816-9e2b-1839ee677075 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1286 microversion: 2.32 time: 0.649288 Jul 18 02:36:50.232836 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1888/3775] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:36:49 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1286 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:36:51.258183 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-be22989b-b074-4c3b-b094-ad3c73240701 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:51.270921 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-be22989b-b074-4c3b-b094-ad3c73240701 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:51.649331 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-be22989b-b074-4c3b-b094-ad3c73240701 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:51.674643 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-be22989b-b074-4c3b-b094-ad3c73240701 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:51.689266 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-be22989b-b074-4c3b-b094-ad3c73240701 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:51.691239 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-be22989b-b074-4c3b-b094-ad3c73240701 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1286 microversion: 2.32 time: 0.442023 Jul 18 02:36:51.705185 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1888/3776] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:36:51 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1286 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:36:52.732039 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-910b1766-a965-4584-bec4-7d98862edc44 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:52.741308 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-910b1766-a965-4584-bec4-7d98862edc44 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:52.778677 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-910b1766-a965-4584-bec4-7d98862edc44 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:52.779522 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-910b1766-a965-4584-bec4-7d98862edc44 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:52.780788 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-910b1766-a965-4584-bec4-7d98862edc44 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:52.781945 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-910b1766-a965-4584-bec4-7d98862edc44 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:53.036456 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-910b1766-a965-4584-bec4-7d98862edc44 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:53.093180 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-910b1766-a965-4584-bec4-7d98862edc44 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:53.098499 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-910b1766-a965-4584-bec4-7d98862edc44 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:53.108551 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-910b1766-a965-4584-bec4-7d98862edc44 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1520 microversion: 2.32 time: 0.392967 Jul 18 02:36:53.114095 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1889/3777] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:36:52 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1520 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:36:54.136674 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b0671078-5186-4f20-ba25-41d7d8082a36 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:54.137576 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b0671078-5186-4f20-ba25-41d7d8082a36 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:54.158301 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b0671078-5186-4f20-ba25-41d7d8082a36 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:54.158905 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b0671078-5186-4f20-ba25-41d7d8082a36 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:54.159794 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b0671078-5186-4f20-ba25-41d7d8082a36 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:54.160333 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b0671078-5186-4f20-ba25-41d7d8082a36 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:54.908562 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b0671078-5186-4f20-ba25-41d7d8082a36 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:54.931018 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b0671078-5186-4f20-ba25-41d7d8082a36 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:54.933649 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b0671078-5186-4f20-ba25-41d7d8082a36 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:54.942924 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b0671078-5186-4f20-ba25-41d7d8082a36 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1584 microversion: 2.32 time: 0.811964 Jul 18 02:36:54.943893 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1889/3778] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:36:54 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1584 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:36:55.967387 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ae64c1ad-eda7-43dd-bcaf-2c90d9106b63 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:55.968819 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ae64c1ad-eda7-43dd-bcaf-2c90d9106b63 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:55.989052 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ae64c1ad-eda7-43dd-bcaf-2c90d9106b63 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:55.990856 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ae64c1ad-eda7-43dd-bcaf-2c90d9106b63 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:55.992017 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ae64c1ad-eda7-43dd-bcaf-2c90d9106b63 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:55.998332 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ae64c1ad-eda7-43dd-bcaf-2c90d9106b63 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:56.189183 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ae64c1ad-eda7-43dd-bcaf-2c90d9106b63 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:56.202703 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ae64c1ad-eda7-43dd-bcaf-2c90d9106b63 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:56.205368 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ae64c1ad-eda7-43dd-bcaf-2c90d9106b63 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:56.207534 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ae64c1ad-eda7-43dd-bcaf-2c90d9106b63 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1594 microversion: 2.32 time: 0.246154 Jul 18 02:36:56.211407 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1890/3779] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:36:55 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1594 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:36:56.992755 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-758208b6-316b-4706-bcb2-ed88353b7e48 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1736524827", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:57.140849 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-758208b6-316b-4706-bcb2-ed88353b7e48 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] validate_networks() for [('2a35edaa-55e6-45d8-8dc7-3b4e4400c7ab', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:36:57.259217 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-62c10197-a542-4280-b977-42e693e2df1a tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:57.263590 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-62c10197-a542-4280-b977-42e693e2df1a tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:57.328126 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-62c10197-a542-4280-b977-42e693e2df1a tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:57.337188 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-62c10197-a542-4280-b977-42e693e2df1a tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:57.342898 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-62c10197-a542-4280-b977-42e693e2df1a tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:57.346330 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-62c10197-a542-4280-b977-42e693e2df1a tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:57.582682 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:58.287624 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-62c10197-a542-4280-b977-42e693e2df1a tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:58.315743 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-62c10197-a542-4280-b977-42e693e2df1a tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:58.327214 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-62c10197-a542-4280-b977-42e693e2df1a tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:58.328708 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-62c10197-a542-4280-b977-42e693e2df1a tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1594 microversion: 2.32 time: 1.079763 Jul 18 02:36:58.337597 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1891/3780] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:36:57 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1594 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:36:59.355870 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d846a6f6-421d-46b4-9351-0d2752993027 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:59.357615 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d846a6f6-421d-46b4-9351-0d2752993027 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:59.377080 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d846a6f6-421d-46b4-9351-0d2752993027 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:59.378192 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d846a6f6-421d-46b4-9351-0d2752993027 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:59.379314 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d846a6f6-421d-46b4-9351-0d2752993027 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:59.379953 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d846a6f6-421d-46b4-9351-0d2752993027 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:59.802935 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d846a6f6-421d-46b4-9351-0d2752993027 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:59.817586 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-758208b6-316b-4706-bcb2-ed88353b7e48 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:36:59.819069 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-758208b6-316b-4706-bcb2-ed88353b7e48 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:36:59.821001 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-758208b6-316b-4706-bcb2-ed88353b7e48 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:36:59.824304 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d846a6f6-421d-46b4-9351-0d2752993027 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:59.827572 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d846a6f6-421d-46b4-9351-0d2752993027 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:59.833953 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d846a6f6-421d-46b4-9351-0d2752993027 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1661 microversion: 2.32 time: 0.481332 Jul 18 02:36:59.848400 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-758208b6-316b-4706-bcb2-ed88353b7e48 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:36:59.848400 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-758208b6-316b-4706-bcb2-ed88353b7e48 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:36:59.850106 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1892/3781] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:36:59 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1661 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:36:59.865440 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:59.931199 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-758208b6-316b-4706-bcb2-ed88353b7e48 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:59.931803 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-758208b6-316b-4706-bcb2-ed88353b7e48 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:59.933323 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-758208b6-316b-4706-bcb2-ed88353b7e48 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:59.947611 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-758208b6-316b-4706-bcb2-ed88353b7e48 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:59.990850 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-758208b6-316b-4706-bcb2-ed88353b7e48 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Getting quotas for project c127c80896564bbaa6b36fb919f22b8b. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:37:00.010223 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-758208b6-316b-4706-bcb2-ed88353b7e48 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Getting quotas for user ceb7f59020ba46ed99897971ebfb84c3 and project c127c80896564bbaa6b36fb919f22b8b. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:37:00.048025 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-758208b6-316b-4706-bcb2-ed88353b7e48 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:37:00.050720 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-758208b6-316b-4706-bcb2-ed88353b7e48 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: 5a35d492-b3d5-4fc8-8b1d-4629b95fde09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:37:00.178991 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-758208b6-316b-4706-bcb2-ed88353b7e48 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.332960 Jul 18 02:37:00.183637 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1890/3782] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:36:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 3338 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:37:00.192853 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b1ccf237-f6d3-4409-9112-d5a88ef65e10 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:00.193931 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b1ccf237-f6d3-4409-9112-d5a88ef65e10 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: 5a35d492-b3d5-4fc8-8b1d-4629b95fde09] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:00.207305 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:00.705209 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b1ccf237-f6d3-4409-9112-d5a88ef65e10 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:00.731493 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b1ccf237-f6d3-4409-9112-d5a88ef65e10 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09" status: 200 len: 1214 microversion: 2.1 time: 0.541882 Jul 18 02:37:00.754213 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1893/3783] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:00 2022] GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09 => generated 1214 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:00.858836 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4b4482c7-17ec-4469-a037-31ed97ece233 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:00.860391 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4b4482c7-17ec-4469-a037-31ed97ece233 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:00.877263 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4b4482c7-17ec-4469-a037-31ed97ece233 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:00.883882 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4b4482c7-17ec-4469-a037-31ed97ece233 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:00.888647 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4b4482c7-17ec-4469-a037-31ed97ece233 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:00.889856 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4b4482c7-17ec-4469-a037-31ed97ece233 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:01.756467 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7cfab56e-3700-4cac-9a50-8a327d9e8c38 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:01.757628 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7cfab56e-3700-4cac-9a50-8a327d9e8c38 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: 5a35d492-b3d5-4fc8-8b1d-4629b95fde09] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:01.840761 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7cfab56e-3700-4cac-9a50-8a327d9e8c38 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:01.842452 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7cfab56e-3700-4cac-9a50-8a327d9e8c38 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:01.853110 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7cfab56e-3700-4cac-9a50-8a327d9e8c38 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:01.857329 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7cfab56e-3700-4cac-9a50-8a327d9e8c38 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:02.048618 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4b4482c7-17ec-4469-a037-31ed97ece233 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:02.177248 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7cfab56e-3700-4cac-9a50-8a327d9e8c38 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:02.199007 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7cfab56e-3700-4cac-9a50-8a327d9e8c38 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09" status: 200 len: 1210 microversion: 2.1 time: 0.453786 Jul 18 02:37:02.202713 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1894/3784] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:01 2022] GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09 => generated 1210 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:02.224701 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4b4482c7-17ec-4469-a037-31ed97ece233 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:02.228941 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4b4482c7-17ec-4469-a037-31ed97ece233 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:02.232993 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4b4482c7-17ec-4469-a037-31ed97ece233 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1661 microversion: 2.32 time: 1.378642 Jul 18 02:37:02.250933 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1891/3785] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:00 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1661 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:03.236963 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-754af265-0af0-42bf-8c6f-ac228f4f7b1a tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:03.245259 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-754af265-0af0-42bf-8c6f-ac228f4f7b1a tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: 5a35d492-b3d5-4fc8-8b1d-4629b95fde09] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:03.268156 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-754af265-0af0-42bf-8c6f-ac228f4f7b1a tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:03.268440 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-327c34a1-e8a5-44c2-b150-edbe7042793b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:03.272536 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-327c34a1-e8a5-44c2-b150-edbe7042793b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:03.281444 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-754af265-0af0-42bf-8c6f-ac228f4f7b1a tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:03.284588 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-754af265-0af0-42bf-8c6f-ac228f4f7b1a tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:03.286803 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-754af265-0af0-42bf-8c6f-ac228f4f7b1a tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:03.330861 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-327c34a1-e8a5-44c2-b150-edbe7042793b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:03.334426 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-327c34a1-e8a5-44c2-b150-edbe7042793b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:03.344889 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-327c34a1-e8a5-44c2-b150-edbe7042793b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:03.348901 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-327c34a1-e8a5-44c2-b150-edbe7042793b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:03.497546 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-754af265-0af0-42bf-8c6f-ac228f4f7b1a tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:03.510352 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-754af265-0af0-42bf-8c6f-ac228f4f7b1a tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09" status: 200 len: 1284 microversion: 2.1 time: 0.285077 Jul 18 02:37:03.515455 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1895/3786] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:03 2022] GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09 => generated 1284 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:03.863080 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-25f718a3-1d95-4478-beae-99009cd8fd12 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:03.863595 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-25f718a3-1d95-4478-beae-99009cd8fd12 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:03.886032 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25f718a3-1d95-4478-beae-99009cd8fd12 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:03.886825 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25f718a3-1d95-4478-beae-99009cd8fd12 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:03.893180 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25f718a3-1d95-4478-beae-99009cd8fd12 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:03.896778 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25f718a3-1d95-4478-beae-99009cd8fd12 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:04.019814 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-327c34a1-e8a5-44c2-b150-edbe7042793b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:04.063988 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-327c34a1-e8a5-44c2-b150-edbe7042793b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:04.073589 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-327c34a1-e8a5-44c2-b150-edbe7042793b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:04.093203 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-327c34a1-e8a5-44c2-b150-edbe7042793b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1753 microversion: 2.32 time: 0.828143 Jul 18 02:37:04.096774 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1892/3787] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:03 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1753 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:04.470014 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-25f718a3-1d95-4478-beae-99009cd8fd12 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lazy-loading 'services' on Instance uuid ec655fda-37a0-4b96-b478-3ca18ffa37f2 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:37:04.539719 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8fa6f79c-e8e4-445c-83a9-777c55f6a45b tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:04.573683 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8fa6f79c-e8e4-445c-83a9-777c55f6a45b tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: 5a35d492-b3d5-4fc8-8b1d-4629b95fde09] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:04.653509 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8fa6f79c-e8e4-445c-83a9-777c55f6a45b tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:04.659200 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8fa6f79c-e8e4-445c-83a9-777c55f6a45b tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:04.664539 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8fa6f79c-e8e4-445c-83a9-777c55f6a45b tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:04.680738 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8fa6f79c-e8e4-445c-83a9-777c55f6a45b tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:05.127406 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8fa6f79c-e8e4-445c-83a9-777c55f6a45b tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:05.167593 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8fa6f79c-e8e4-445c-83a9-777c55f6a45b tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09" status: 200 len: 1272 microversion: 2.1 time: 0.638152 Jul 18 02:37:05.174245 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1893/3788] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:04 2022] GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09 => generated 1272 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:05.224558 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-eaaa682c-80cf-4111-a6d0-215b0738364f tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:05.225793 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-eaaa682c-80cf-4111-a6d0-215b0738364f tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:05.258782 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-25f718a3-1d95-4478-beae-99009cd8fd12 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2/os-volume_attachments/be7e808b-40c5-46b9-85e6-38b862e1b9bb" status: 202 len: 0 microversion: 2.1 time: 1.383788 Jul 18 02:37:05.260978 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1896/3789] 10.222.0.57 () {58 vars in 1415 bytes} [Mon Jul 18 02:37:03 2022] DELETE /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2/os-volume_attachments/be7e808b-40c5-46b9-85e6-38b862e1b9bb => generated 0 bytes in 1403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:37:05.280557 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eaaa682c-80cf-4111-a6d0-215b0738364f tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:05.281368 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eaaa682c-80cf-4111-a6d0-215b0738364f tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:05.293644 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eaaa682c-80cf-4111-a6d0-215b0738364f tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:05.297497 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eaaa682c-80cf-4111-a6d0-215b0738364f tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:05.310368 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-888f55bc-b116-42d7-aeaf-db292a7cf0bb tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:05.317772 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-888f55bc-b116-42d7-aeaf-db292a7cf0bb tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:05.380030 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-888f55bc-b116-42d7-aeaf-db292a7cf0bb tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:05.389619 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-888f55bc-b116-42d7-aeaf-db292a7cf0bb tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:05.395659 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-888f55bc-b116-42d7-aeaf-db292a7cf0bb tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:05.398219 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-888f55bc-b116-42d7-aeaf-db292a7cf0bb tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:05.661505 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-888f55bc-b116-42d7-aeaf-db292a7cf0bb tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.377709 Jul 18 02:37:05.672371 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1897/3790] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:37:05 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2/os-volume_attachments => generated 197 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:06.185955 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8bde856b-1884-457d-9d95-ab8a92b21c0f tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:06.186605 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8bde856b-1884-457d-9d95-ab8a92b21c0f tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: 5a35d492-b3d5-4fc8-8b1d-4629b95fde09] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:06.210850 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-eaaa682c-80cf-4111-a6d0-215b0738364f tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:06.211433 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8bde856b-1884-457d-9d95-ab8a92b21c0f tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:06.215493 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8bde856b-1884-457d-9d95-ab8a92b21c0f tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:06.218576 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8bde856b-1884-457d-9d95-ab8a92b21c0f tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:06.224344 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8bde856b-1884-457d-9d95-ab8a92b21c0f tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:06.224649 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-eaaa682c-80cf-4111-a6d0-215b0738364f tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:06.240870 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-eaaa682c-80cf-4111-a6d0-215b0738364f tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:06.254156 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-eaaa682c-80cf-4111-a6d0-215b0738364f tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1753 microversion: 2.32 time: 1.076164 Jul 18 02:37:06.255468 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1894/3791] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:05 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1753 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:06.683516 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3c50a59a-91b1-4e98-96f5-a0aa16e59de2 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:06.684863 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3c50a59a-91b1-4e98-96f5-a0aa16e59de2 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:06.709841 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3c50a59a-91b1-4e98-96f5-a0aa16e59de2 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:06.710645 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3c50a59a-91b1-4e98-96f5-a0aa16e59de2 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:06.712509 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3c50a59a-91b1-4e98-96f5-a0aa16e59de2 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:06.712969 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3c50a59a-91b1-4e98-96f5-a0aa16e59de2 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:06.822761 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3c50a59a-91b1-4e98-96f5-a0aa16e59de2 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145472 Jul 18 02:37:06.826193 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1895/3792] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:37:06 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:07.010685 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8bde856b-1884-457d-9d95-ab8a92b21c0f tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:07.045927 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8bde856b-1884-457d-9d95-ab8a92b21c0f tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09" status: 200 len: 1314 microversion: 2.1 time: 0.865108 Jul 18 02:37:07.057854 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1898/3793] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:06 2022] GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09 => generated 1314 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:07.295994 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d17e720c-4361-40a5-bf1a-f8568fc9dc95 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:07.297338 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d17e720c-4361-40a5-bf1a-f8568fc9dc95 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:07.320839 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d17e720c-4361-40a5-bf1a-f8568fc9dc95 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:07.321570 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d17e720c-4361-40a5-bf1a-f8568fc9dc95 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:07.322748 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d17e720c-4361-40a5-bf1a-f8568fc9dc95 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:07.328813 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d17e720c-4361-40a5-bf1a-f8568fc9dc95 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:07.837998 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-29e8069c-47b2-477b-bad9-3480e76d8244 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:07.839808 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-29e8069c-47b2-477b-bad9-3480e76d8244 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:07.860436 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-29e8069c-47b2-477b-bad9-3480e76d8244 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:07.861362 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-29e8069c-47b2-477b-bad9-3480e76d8244 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:07.862440 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-29e8069c-47b2-477b-bad9-3480e76d8244 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:07.864458 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-29e8069c-47b2-477b-bad9-3480e76d8244 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:07.908678 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d17e720c-4361-40a5-bf1a-f8568fc9dc95 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:07.926528 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d17e720c-4361-40a5-bf1a-f8568fc9dc95 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:07.942054 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d17e720c-4361-40a5-bf1a-f8568fc9dc95 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:07.947619 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d17e720c-4361-40a5-bf1a-f8568fc9dc95 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1753 microversion: 2.32 time: 0.656070 Jul 18 02:37:07.954593 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1896/3794] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:07 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1753 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:07.978628 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-29e8069c-47b2-477b-bad9-3480e76d8244 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145440 Jul 18 02:37:07.982175 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1899/3795] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:37:07 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:08.065107 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-76b9941a-f15f-458f-afbc-e18ce97f44a1 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:08.065834 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-76b9941a-f15f-458f-afbc-e18ce97f44a1 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: 5a35d492-b3d5-4fc8-8b1d-4629b95fde09] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:08.078057 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-76b9941a-f15f-458f-afbc-e18ce97f44a1 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:08.079048 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-76b9941a-f15f-458f-afbc-e18ce97f44a1 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:08.081427 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-76b9941a-f15f-458f-afbc-e18ce97f44a1 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:08.083411 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-76b9941a-f15f-458f-afbc-e18ce97f44a1 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:08.963101 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-76b9941a-f15f-458f-afbc-e18ce97f44a1 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:08.997310 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8565d0c7-46ab-4745-889e-9d7a8edc4045 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:08.998323 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8565d0c7-46ab-4745-889e-9d7a8edc4045 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:09.011948 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-76b9941a-f15f-458f-afbc-e18ce97f44a1 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09" status: 200 len: 1314 microversion: 2.1 time: 0.951115 Jul 18 02:37:09.016010 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8565d0c7-46ab-4745-889e-9d7a8edc4045 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:09.019533 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1897/3796] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:08 2022] GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09 => generated 1314 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:09.029778 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8565d0c7-46ab-4745-889e-9d7a8edc4045 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:09.041680 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-86bc816f-8e16-490b-b966-16fc31dd6587 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:09.047115 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8565d0c7-46ab-4745-889e-9d7a8edc4045 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:09.051390 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-86bc816f-8e16-490b-b966-16fc31dd6587 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:09.051853 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8565d0c7-46ab-4745-889e-9d7a8edc4045 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:09.060143 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-86bc816f-8e16-490b-b966-16fc31dd6587 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:09.061166 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-86bc816f-8e16-490b-b966-16fc31dd6587 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:09.062431 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-86bc816f-8e16-490b-b966-16fc31dd6587 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:09.063148 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-86bc816f-8e16-490b-b966-16fc31dd6587 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:09.172484 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8565d0c7-46ab-4745-889e-9d7a8edc4045 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.178911 Jul 18 02:37:09.179339 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1900/3797] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:37:08 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2/os-volume_attachments => generated 197 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:09.976359 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:10.038822 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=14 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:10.039639 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b9e5a8bf-138a-43f0-a5c0-db9bf7593430 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:10.040626 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b9e5a8bf-138a-43f0-a5c0-db9bf7593430 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: 5a35d492-b3d5-4fc8-8b1d-4629b95fde09] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:10.066238 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b9e5a8bf-138a-43f0-a5c0-db9bf7593430 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:10.069992 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b9e5a8bf-138a-43f0-a5c0-db9bf7593430 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:10.076747 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b9e5a8bf-138a-43f0-a5c0-db9bf7593430 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:10.080797 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b9e5a8bf-138a-43f0-a5c0-db9bf7593430 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:10.723286 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:11.046689 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b9e5a8bf-138a-43f0-a5c0-db9bf7593430 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:11.076386 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b9e5a8bf-138a-43f0-a5c0-db9bf7593430 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09" status: 200 len: 1314 microversion: 2.1 time: 1.042801 Jul 18 02:37:11.077454 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1901/3798] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:10 2022] GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09 => generated 1314 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:11.102148 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b987906e-c90f-4818-bd49-ba2a7a5ab848 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:11.106958 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b987906e-c90f-4818-bd49-ba2a7a5ab848 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:11.146040 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b987906e-c90f-4818-bd49-ba2a7a5ab848 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:11.150897 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b987906e-c90f-4818-bd49-ba2a7a5ab848 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:11.156866 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b987906e-c90f-4818-bd49-ba2a7a5ab848 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:11.157349 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b987906e-c90f-4818-bd49-ba2a7a5ab848 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:11.227486 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-86bc816f-8e16-490b-b966-16fc31dd6587 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:11.267287 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b987906e-c90f-4818-bd49-ba2a7a5ab848 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.181734 Jul 18 02:37:11.269154 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1902/3799] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:37:11 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2/os-volume_attachments => generated 197 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:11.451920 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-86bc816f-8e16-490b-b966-16fc31dd6587 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:11.486855 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-86bc816f-8e16-490b-b966-16fc31dd6587 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:11.488080 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-86bc816f-8e16-490b-b966-16fc31dd6587 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1799 microversion: 2.32 time: 2.456236 Jul 18 02:37:11.488760 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1898/3800] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:09 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1799 bytes in 2458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:12.110744 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-153aa84b-3231-4308-aa85-fb5be47fe1db tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:12.115673 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-153aa84b-3231-4308-aa85-fb5be47fe1db tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: 5a35d492-b3d5-4fc8-8b1d-4629b95fde09] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:12.206072 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-153aa84b-3231-4308-aa85-fb5be47fe1db tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:12.207568 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-153aa84b-3231-4308-aa85-fb5be47fe1db tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:12.223467 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-153aa84b-3231-4308-aa85-fb5be47fe1db tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:12.228559 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-153aa84b-3231-4308-aa85-fb5be47fe1db tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:12.296400 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c8ca8eae-f442-424b-9de2-caa8046dda3e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:12.302652 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c8ca8eae-f442-424b-9de2-caa8046dda3e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:12.428145 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c8ca8eae-f442-424b-9de2-caa8046dda3e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:12.429470 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c8ca8eae-f442-424b-9de2-caa8046dda3e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:12.431002 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c8ca8eae-f442-424b-9de2-caa8046dda3e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:12.451366 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c8ca8eae-f442-424b-9de2-caa8046dda3e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:12.760009 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c8ca8eae-f442-424b-9de2-caa8046dda3e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.481519 Jul 18 02:37:12.774987 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1899/3801] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:37:12 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2/os-volume_attachments => generated 197 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:37:12.818998 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7b9a236b-ed17-46fd-a366-5567a7974329 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:12.821603 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7b9a236b-ed17-46fd-a366-5567a7974329 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:12.835881 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7b9a236b-ed17-46fd-a366-5567a7974329 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:12.837173 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7b9a236b-ed17-46fd-a366-5567a7974329 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:12.839406 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7b9a236b-ed17-46fd-a366-5567a7974329 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:12.842069 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7b9a236b-ed17-46fd-a366-5567a7974329 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:14.534546 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-153aa84b-3231-4308-aa85-fb5be47fe1db tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:14.544312 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-153aa84b-3231-4308-aa85-fb5be47fe1db tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09" status: 200 len: 1314 microversion: 2.1 time: 2.452242 Jul 18 02:37:14.554122 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1903/3802] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:12 2022] GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09 => generated 1314 bytes in 2463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:14.571828 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-0018e669-fc07-49fb-b8ac-9c09cc6f266a req-59a540fd-1488-4e80-a00d-9ee3b8d1944e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a35d492-b3d5-4fc8-8b1d-4629b95fde09", "tag": "255c6f05-e3dd-49b3-9e22-88b80e4ac186"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:14.592745 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7b9a236b-ed17-46fd-a366-5567a7974329 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:14.593506 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-0018e669-fc07-49fb-b8ac-9c09cc6f266a req-59a540fd-1488-4e80-a00d-9ee3b8d1944e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:14.594334 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-0018e669-fc07-49fb-b8ac-9c09cc6f266a req-59a540fd-1488-4e80-a00d-9ee3b8d1944e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:14.598388 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=69 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:14.629337 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-0018e669-fc07-49fb-b8ac-9c09cc6f266a req-59a540fd-1488-4e80-a00d-9ee3b8d1944e service nova] Creating event network-changed:255c6f05-e3dd-49b3-9e22-88b80e4ac186 for instance 5a35d492-b3d5-4fc8-8b1d-4629b95fde09 on n-h2-465891-3 Jul 18 02:37:14.645234 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-0018e669-fc07-49fb-b8ac-9c09cc6f266a req-59a540fd-1488-4e80-a00d-9ee3b8d1944e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089422 Jul 18 02:37:14.648816 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7b9a236b-ed17-46fd-a366-5567a7974329 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:14.650190 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1904/3803] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:14.661018 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f0c7cf14-a4a3-4694-acb5-26d95bbf73e2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:14.662328 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f0c7cf14-a4a3-4694-acb5-26d95bbf73e2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:14.667954 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7b9a236b-ed17-46fd-a366-5567a7974329 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:14.672934 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7b9a236b-ed17-46fd-a366-5567a7974329 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1845 microversion: 2.32 time: 1.889430 Jul 18 02:37:14.682143 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f0c7cf14-a4a3-4694-acb5-26d95bbf73e2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:14.685654 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1900/3804] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:12 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1845 bytes in 1909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:14.686797 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f0c7cf14-a4a3-4694-acb5-26d95bbf73e2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:14.687853 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f0c7cf14-a4a3-4694-acb5-26d95bbf73e2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:14.688474 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f0c7cf14-a4a3-4694-acb5-26d95bbf73e2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:14.727832 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a8b3be8d-25f0-4359-b4fa-52aba3c4eb4a tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:14.732215 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a8b3be8d-25f0-4359-b4fa-52aba3c4eb4a tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:14.764605 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f0c7cf14-a4a3-4694-acb5-26d95bbf73e2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/ips" status: 200 len: 152 microversion: 2.20 time: 0.112725 Jul 18 02:37:14.767318 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1905/3805] 10.222.0.57 () {60 vars in 1288 bytes} [Mon Jul 18 02:37:14 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/ips => generated 152 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:37:14.778541 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a8b3be8d-25f0-4359-b4fa-52aba3c4eb4a tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:14.779350 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a8b3be8d-25f0-4359-b4fa-52aba3c4eb4a tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:14.786742 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a8b3be8d-25f0-4359-b4fa-52aba3c4eb4a tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:14.787763 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a8b3be8d-25f0-4359-b4fa-52aba3c4eb4a tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:15.168477 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a8b3be8d-25f0-4359-b4fa-52aba3c4eb4a tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.467381 Jul 18 02:37:15.182142 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1901/3806] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:37:14 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2/os-volume_attachments => generated 197 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:15.569745 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-860f8b93-2adf-4b8b-a617-e08d3faccbb0 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:15.571021 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-860f8b93-2adf-4b8b-a617-e08d3faccbb0 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: 5a35d492-b3d5-4fc8-8b1d-4629b95fde09] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:15.590840 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-860f8b93-2adf-4b8b-a617-e08d3faccbb0 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:15.591980 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-860f8b93-2adf-4b8b-a617-e08d3faccbb0 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:15.593321 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-860f8b93-2adf-4b8b-a617-e08d3faccbb0 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:15.594068 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-860f8b93-2adf-4b8b-a617-e08d3faccbb0 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:15.716036 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-901e263e-f3b3-4266-aca1-0911474c16dd tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:15.716678 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-901e263e-f3b3-4266-aca1-0911474c16dd tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:15.729123 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-901e263e-f3b3-4266-aca1-0911474c16dd tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:15.740271 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-901e263e-f3b3-4266-aca1-0911474c16dd tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:15.741429 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-901e263e-f3b3-4266-aca1-0911474c16dd tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:15.741945 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-901e263e-f3b3-4266-aca1-0911474c16dd tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:16.180700 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-901e263e-f3b3-4266-aca1-0911474c16dd tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:16.205015 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-901e263e-f3b3-4266-aca1-0911474c16dd tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:16.210167 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-901e263e-f3b3-4266-aca1-0911474c16dd tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:16.217530 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-901e263e-f3b3-4266-aca1-0911474c16dd tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1845 microversion: 2.32 time: 0.501062 Jul 18 02:37:16.220978 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1902/3807] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:15 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1845 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:16.241271 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-73b239bd-bedd-42db-9061-6f0954beb3db req-0f186b5a-2295-4c47-bce3-2ded56b52587 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e6dc16e-f557-44c2-b61c-92981b9915d4", "tag": "8ae7216b-c181-431a-959d-513873271b5b"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:16.252861 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-860f8b93-2adf-4b8b-a617-e08d3faccbb0 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:16.257282 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:16.259492 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-73b239bd-bedd-42db-9061-6f0954beb3db req-0f186b5a-2295-4c47-bce3-2ded56b52587 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:16.263228 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-73b239bd-bedd-42db-9061-6f0954beb3db req-0f186b5a-2295-4c47-bce3-2ded56b52587 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:16.282467 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-860f8b93-2adf-4b8b-a617-e08d3faccbb0 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09" status: 200 len: 1314 microversion: 2.1 time: 0.718174 Jul 18 02:37:16.284222 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1906/3808] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:15 2022] GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09 => generated 1314 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:16.302273 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-38583e64-4030-4303-bc52-aad472db4732 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:16.313461 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-38583e64-4030-4303-bc52-aad472db4732 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:16.328187 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-73b239bd-bedd-42db-9061-6f0954beb3db req-0f186b5a-2295-4c47-bce3-2ded56b52587 service nova] Creating event network-changed:8ae7216b-c181-431a-959d-513873271b5b for instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 on n-h1-465891-3 Jul 18 02:37:16.336258 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-38583e64-4030-4303-bc52-aad472db4732 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:16.337032 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-38583e64-4030-4303-bc52-aad472db4732 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:16.338080 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-38583e64-4030-4303-bc52-aad472db4732 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:16.339326 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-38583e64-4030-4303-bc52-aad472db4732 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:16.353493 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-73b239bd-bedd-42db-9061-6f0954beb3db req-0f186b5a-2295-4c47-bce3-2ded56b52587 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128730 Jul 18 02:37:16.355596 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1903/3809] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:16.422998 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-38583e64-4030-4303-bc52-aad472db4732 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130529 Jul 18 02:37:16.429311 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1907/3810] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:37:16 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:17.248856 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-14b0e52f-e784-452a-b7f2-dc87184a69ab tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:17.264233 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-14b0e52f-e784-452a-b7f2-dc87184a69ab tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:17.293102 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14b0e52f-e784-452a-b7f2-dc87184a69ab tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:17.296709 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14b0e52f-e784-452a-b7f2-dc87184a69ab tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:17.298805 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14b0e52f-e784-452a-b7f2-dc87184a69ab tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:17.301340 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6be506cd-c144-44d3-84e1-e4e9bae24c09 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:17.302526 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6be506cd-c144-44d3-84e1-e4e9bae24c09 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: 5a35d492-b3d5-4fc8-8b1d-4629b95fde09] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:17.303484 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14b0e52f-e784-452a-b7f2-dc87184a69ab tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:17.317918 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6be506cd-c144-44d3-84e1-e4e9bae24c09 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:17.318435 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6be506cd-c144-44d3-84e1-e4e9bae24c09 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:17.319314 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6be506cd-c144-44d3-84e1-e4e9bae24c09 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:17.319866 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6be506cd-c144-44d3-84e1-e4e9bae24c09 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:18.601985 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-14b0e52f-e784-452a-b7f2-dc87184a69ab tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:18.628587 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-14b0e52f-e784-452a-b7f2-dc87184a69ab tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:18.636118 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-14b0e52f-e784-452a-b7f2-dc87184a69ab tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:18.639399 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-14b0e52f-e784-452a-b7f2-dc87184a69ab tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1866 microversion: 2.32 time: 1.401381 Jul 18 02:37:18.645015 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1904/3811] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:17 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1866 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:18.660493 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f9efb9cf-aa57-4ee5-9b04-d0aeefdfde46 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:18.664226 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f9efb9cf-aa57-4ee5-9b04-d0aeefdfde46 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:18.665109 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6be506cd-c144-44d3-84e1-e4e9bae24c09 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:18.679448 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6be506cd-c144-44d3-84e1-e4e9bae24c09 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09" status: 200 len: 1314 microversion: 2.1 time: 1.382056 Jul 18 02:37:18.684374 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f9efb9cf-aa57-4ee5-9b04-d0aeefdfde46 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:18.685583 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f9efb9cf-aa57-4ee5-9b04-d0aeefdfde46 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:18.687419 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1908/3812] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:17 2022] GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09 => generated 1314 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:18.691473 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f9efb9cf-aa57-4ee5-9b04-d0aeefdfde46 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:18.692525 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f9efb9cf-aa57-4ee5-9b04-d0aeefdfde46 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:18.715892 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-bf7300b4-9c5b-4458-99b8-55634d31bb47 req-d4a371ab-3506-4874-97cf-dcff18b0f523 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e6dc16e-f557-44c2-b61c-92981b9915d4", "tag": "8b71a464-9b9d-4a74-a0e5-f2fd6b5f29c1"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:18.739550 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-bf7300b4-9c5b-4458-99b8-55634d31bb47 req-d4a371ab-3506-4874-97cf-dcff18b0f523 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:18.742972 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-bf7300b4-9c5b-4458-99b8-55634d31bb47 req-d4a371ab-3506-4874-97cf-dcff18b0f523 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:18.788060 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-bf7300b4-9c5b-4458-99b8-55634d31bb47 req-d4a371ab-3506-4874-97cf-dcff18b0f523 service nova] Creating event network-changed:8b71a464-9b9d-4a74-a0e5-f2fd6b5f29c1 for instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 on n-h1-465891-3 Jul 18 02:37:18.805323 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-bf7300b4-9c5b-4458-99b8-55634d31bb47 req-d4a371ab-3506-4874-97cf-dcff18b0f523 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116231 Jul 18 02:37:18.809087 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1909/3813] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:18.828646 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f9efb9cf-aa57-4ee5-9b04-d0aeefdfde46 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.181644 Jul 18 02:37:18.841906 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1905/3814] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:37:18 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2/os-volume_attachments => generated 197 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:19.678387 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-639cf2bf-8f6d-4d4f-bdcc-db51b5e00354 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:19.679283 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-639cf2bf-8f6d-4d4f-bdcc-db51b5e00354 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:19.698488 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-639cf2bf-8f6d-4d4f-bdcc-db51b5e00354 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:19.699054 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-639cf2bf-8f6d-4d4f-bdcc-db51b5e00354 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:19.699505 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-639cf2bf-8f6d-4d4f-bdcc-db51b5e00354 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:19.700026 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-639cf2bf-8f6d-4d4f-bdcc-db51b5e00354 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:19.724326 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-60996563-d08a-45d1-95fe-ea70fba3a065 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:19.743894 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-60996563-d08a-45d1-95fe-ea70fba3a065 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: 5a35d492-b3d5-4fc8-8b1d-4629b95fde09] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:19.792862 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60996563-d08a-45d1-95fe-ea70fba3a065 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:19.806633 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60996563-d08a-45d1-95fe-ea70fba3a065 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:19.810919 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60996563-d08a-45d1-95fe-ea70fba3a065 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:19.821745 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60996563-d08a-45d1-95fe-ea70fba3a065 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:20.894778 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-639cf2bf-8f6d-4d4f-bdcc-db51b5e00354 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:20.947543 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-639cf2bf-8f6d-4d4f-bdcc-db51b5e00354 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:20.952184 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-639cf2bf-8f6d-4d4f-bdcc-db51b5e00354 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:20.954776 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-639cf2bf-8f6d-4d4f-bdcc-db51b5e00354 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1887 microversion: 2.32 time: 1.282308 Jul 18 02:37:20.960153 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1910/3815] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:19 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1887 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:37:20.972684 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6b576aaa-c61e-414d-955f-0e9680c4bb3f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:20.979007 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6b576aaa-c61e-414d-955f-0e9680c4bb3f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:20.987965 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=51 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:21.003522 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b576aaa-c61e-414d-955f-0e9680c4bb3f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:21.004278 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b576aaa-c61e-414d-955f-0e9680c4bb3f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:21.005276 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b576aaa-c61e-414d-955f-0e9680c4bb3f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:21.006191 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b576aaa-c61e-414d-955f-0e9680c4bb3f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:21.108960 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6b576aaa-c61e-414d-955f-0e9680c4bb3f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133751 Jul 18 02:37:21.110053 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1911/3816] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:37:20 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:21.131702 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-835db435-8128-4089-abe3-f67f4ca71f86 req-d95413f5-a096-49d1-867b-fcaa90ff4ac5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e6dc16e-f557-44c2-b61c-92981b9915d4", "tag": "a9898ef4-9a1c-48a1-91ff-fa0ef93ce449"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:21.139978 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-60996563-d08a-45d1-95fe-ea70fba3a065 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:21.160008 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-835db435-8128-4089-abe3-f67f4ca71f86 req-d95413f5-a096-49d1-867b-fcaa90ff4ac5 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:21.160455 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-835db435-8128-4089-abe3-f67f4ca71f86 req-d95413f5-a096-49d1-867b-fcaa90ff4ac5 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:21.176613 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-60996563-d08a-45d1-95fe-ea70fba3a065 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09" status: 200 len: 1314 microversion: 2.1 time: 1.463724 Jul 18 02:37:21.195499 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1906/3817] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:19 2022] GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09 => generated 1314 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:21.196045 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-835db435-8128-4089-abe3-f67f4ca71f86 req-d95413f5-a096-49d1-867b-fcaa90ff4ac5 service nova] Creating event network-changed:a9898ef4-9a1c-48a1-91ff-fa0ef93ce449 for instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 on n-h1-465891-3 Jul 18 02:37:21.202119 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-835db435-8128-4089-abe3-f67f4ca71f86 req-d95413f5-a096-49d1-867b-fcaa90ff4ac5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088514 Jul 18 02:37:21.203003 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1912/3818] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:22.009870 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8f94bc58-9c0b-43c7-8605-53c0adb1dddd tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:22.019037 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8f94bc58-9c0b-43c7-8605-53c0adb1dddd tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:22.052306 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8f94bc58-9c0b-43c7-8605-53c0adb1dddd tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:22.058108 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8f94bc58-9c0b-43c7-8605-53c0adb1dddd tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:22.063748 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8f94bc58-9c0b-43c7-8605-53c0adb1dddd tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:22.066961 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8f94bc58-9c0b-43c7-8605-53c0adb1dddd tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:22.147126 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e1e68910-bccd-4bc0-b857-08dc85efd767 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:22.154522 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e1e68910-bccd-4bc0-b857-08dc85efd767 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:22.183582 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e1e68910-bccd-4bc0-b857-08dc85efd767 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:22.184431 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e1e68910-bccd-4bc0-b857-08dc85efd767 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:22.185488 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e1e68910-bccd-4bc0-b857-08dc85efd767 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:22.186224 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e1e68910-bccd-4bc0-b857-08dc85efd767 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:22.264945 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e1e68910-bccd-4bc0-b857-08dc85efd767 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142463 Jul 18 02:37:22.282249 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1913/3819] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:37:22 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:22.295266 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0fd5d1f6-63ad-4c29-a9b5-65bcd13ccbac tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:22.303653 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0fd5d1f6-63ad-4c29-a9b5-65bcd13ccbac tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: 5a35d492-b3d5-4fc8-8b1d-4629b95fde09] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:22.325503 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0fd5d1f6-63ad-4c29-a9b5-65bcd13ccbac tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:22.328955 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0fd5d1f6-63ad-4c29-a9b5-65bcd13ccbac tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:22.332596 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0fd5d1f6-63ad-4c29-a9b5-65bcd13ccbac tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:22.337672 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0fd5d1f6-63ad-4c29-a9b5-65bcd13ccbac tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:22.940192 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0fd5d1f6-63ad-4c29-a9b5-65bcd13ccbac tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:23.000772 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0fd5d1f6-63ad-4c29-a9b5-65bcd13ccbac tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09" status: 200 len: 1314 microversion: 2.1 time: 0.716391 Jul 18 02:37:23.005358 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1914/3820] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:22 2022] GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09 => generated 1314 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:23.020984 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-d256d08c-3205-4d22-9f2e-980d734a6199 req-dbcefe4e-7e06-46e3-8a92-d2202125ac0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a35d492-b3d5-4fc8-8b1d-4629b95fde09", "name": "network-vif-plugged", "status": "completed", "tag": "255c6f05-e3dd-49b3-9e22-88b80e4ac186"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:23.024241 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8f94bc58-9c0b-43c7-8605-53c0adb1dddd tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:23.043819 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-d256d08c-3205-4d22-9f2e-980d734a6199 req-dbcefe4e-7e06-46e3-8a92-d2202125ac0a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:23.044271 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-d256d08c-3205-4d22-9f2e-980d734a6199 req-dbcefe4e-7e06-46e3-8a92-d2202125ac0a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:23.077472 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-d256d08c-3205-4d22-9f2e-980d734a6199 req-dbcefe4e-7e06-46e3-8a92-d2202125ac0a service nova] Creating event network-vif-plugged:255c6f05-e3dd-49b3-9e22-88b80e4ac186 for instance 5a35d492-b3d5-4fc8-8b1d-4629b95fde09 on n-h2-465891-3 Jul 18 02:37:23.080676 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8f94bc58-9c0b-43c7-8605-53c0adb1dddd tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:23.086067 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-d256d08c-3205-4d22-9f2e-980d734a6199 req-dbcefe4e-7e06-46e3-8a92-d2202125ac0a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079160 Jul 18 02:37:23.093755 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1915/3821] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:23.101842 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8f94bc58-9c0b-43c7-8605-53c0adb1dddd tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:23.107639 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8f94bc58-9c0b-43c7-8605-53c0adb1dddd tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1887 microversion: 2.32 time: 1.125649 Jul 18 02:37:23.112322 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1907/3822] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:21 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1887 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:23.308872 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-26a23e4d-e6e3-48fc-8749-987ae4d6a464 req-fef39781-2dad-4c6a-810a-f7f72690a7f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e6dc16e-f557-44c2-b61c-92981b9915d4", "tag": "5008bbd8-4311-4133-b2fb-b4f029c22c41"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:23.338924 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ba8e0222-dc24-437b-82dc-4b8a1b66cc99 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:23.346024 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ba8e0222-dc24-437b-82dc-4b8a1b66cc99 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:23.389340 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-26a23e4d-e6e3-48fc-8749-987ae4d6a464 req-fef39781-2dad-4c6a-810a-f7f72690a7f4 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:23.405154 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-26a23e4d-e6e3-48fc-8749-987ae4d6a464 req-fef39781-2dad-4c6a-810a-f7f72690a7f4 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:23.417559 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba8e0222-dc24-437b-82dc-4b8a1b66cc99 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:23.424996 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba8e0222-dc24-437b-82dc-4b8a1b66cc99 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:23.428837 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba8e0222-dc24-437b-82dc-4b8a1b66cc99 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:23.434567 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba8e0222-dc24-437b-82dc-4b8a1b66cc99 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:23.497175 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-26a23e4d-e6e3-48fc-8749-987ae4d6a464 req-fef39781-2dad-4c6a-810a-f7f72690a7f4 service nova] Creating event network-changed:5008bbd8-4311-4133-b2fb-b4f029c22c41 for instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 on n-h1-465891-3 Jul 18 02:37:23.517314 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-26a23e4d-e6e3-48fc-8749-987ae4d6a464 req-fef39781-2dad-4c6a-810a-f7f72690a7f4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.215442 Jul 18 02:37:23.530191 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1908/3823] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:23.630204 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ba8e0222-dc24-437b-82dc-4b8a1b66cc99 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.338055 Jul 18 02:37:23.637061 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1916/3824] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:37:23 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2/os-volume_attachments => generated 25 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 02:37:24.035644 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-463be423-e6f1-40aa-92de-634e2cc7fb49 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:24.036897 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-463be423-e6f1-40aa-92de-634e2cc7fb49 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: 5a35d492-b3d5-4fc8-8b1d-4629b95fde09] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:24.077195 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-463be423-e6f1-40aa-92de-634e2cc7fb49 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:24.089273 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-463be423-e6f1-40aa-92de-634e2cc7fb49 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:24.093118 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-463be423-e6f1-40aa-92de-634e2cc7fb49 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:24.094055 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-463be423-e6f1-40aa-92de-634e2cc7fb49 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:24.150247 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d03d278d-8d01-4873-9dee-76485a3eaf4d tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:24.152600 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d03d278d-8d01-4873-9dee-76485a3eaf4d tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:24.187474 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d03d278d-8d01-4873-9dee-76485a3eaf4d tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:24.193848 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d03d278d-8d01-4873-9dee-76485a3eaf4d tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:24.202753 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d03d278d-8d01-4873-9dee-76485a3eaf4d tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:24.203693 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d03d278d-8d01-4873-9dee-76485a3eaf4d tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:25.983087 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d03d278d-8d01-4873-9dee-76485a3eaf4d tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:26.037668 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d03d278d-8d01-4873-9dee-76485a3eaf4d tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:26.053565 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d03d278d-8d01-4873-9dee-76485a3eaf4d tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:26.064319 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d03d278d-8d01-4873-9dee-76485a3eaf4d tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1887 microversion: 2.32 time: 1.914980 Jul 18 02:37:26.085757 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1917/3825] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:24 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1887 bytes in 1928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:37:26.096460 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-45b462fb-1e88-4ac7-9294-e31b7fd04587 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:26.097032 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-463be423-e6f1-40aa-92de-634e2cc7fb49 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:26.098244 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-45b462fb-1e88-4ac7-9294-e31b7fd04587 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: f4822dbd-f6d6-4c66-8661-69a15acf9df4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:26.113254 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-463be423-e6f1-40aa-92de-634e2cc7fb49 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09" status: 200 len: 1314 microversion: 2.1 time: 2.084502 Jul 18 02:37:26.124865 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-45b462fb-1e88-4ac7-9294-e31b7fd04587 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:26.125503 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1909/3826] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:24 2022] GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09 => generated 1314 bytes in 2098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:26.128374 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-45b462fb-1e88-4ac7-9294-e31b7fd04587 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:26.130682 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-45b462fb-1e88-4ac7-9294-e31b7fd04587 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:26.131526 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-45b462fb-1e88-4ac7-9294-e31b7fd04587 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:26.150131 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-bf638a0c-a683-45d5-93e8-bb6b41176eaf req-ce2d854e-e4a5-4c53-b94a-d823a306838d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e6dc16e-f557-44c2-b61c-92981b9915d4", "tag": "2b179498-569c-4e0a-88a2-4c73687919da"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:26.198916 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-bf638a0c-a683-45d5-93e8-bb6b41176eaf req-ce2d854e-e4a5-4c53-b94a-d823a306838d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:26.199463 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-bf638a0c-a683-45d5-93e8-bb6b41176eaf req-ce2d854e-e4a5-4c53-b94a-d823a306838d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:26.217592 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-45b462fb-1e88-4ac7-9294-e31b7fd04587 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] HTTP exception thrown: Cannot 'reboot' instance f4822dbd-f6d6-4c66-8661-69a15acf9df4 while it is in vm_state rescued Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-45b462fb-1e88-4ac7-9294-e31b7fd04587 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Request method failure captured: Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4/action HTTP/1.1 Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 28 Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MYgsMpQMGg_x4SatJimijJMXDATUd7K8pbmJMir06_hhN9kc6nEv2UNuBHWPOsjhgniijNTcv86Pv1g5if6jfxnXnFgylGVtP-ES0p4q8KsL3cpv9H2D_niEdkyIvqxweiHovqWE9ZMi6DufO28-UhMwnDHb097CRDIZ6xtrA6LrKI Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 1594a06c4e7c4bb7b184d916342933ba Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1345973443 Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1594a06c4e7c4bb7b184d916342933ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1594a06c4e7c4bb7b184d916342933ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1594a06c4e7c4bb7b184d916342933ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1594a06c4e7c4bb7b184d916342933ba"}]}] Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1345973443 Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 1594a06c4e7c4bb7b184d916342933ba Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1345973443 Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServerRescueNegativeTestJSON-1345973443-project Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 6f30a2016d954121bb251894fad6dd39 Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1345973443-project Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: {"reboot": {"type": "HARD"}} Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: exception: Cannot 'reboot' instance f4822dbd-f6d6-4c66-8661-69a15acf9df4 while it is in vm_state rescued Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'f4822dbd-f6d6-4c66-8661-69a15acf9df4', 'body': {'reboot': {'type': 'HARD'}}} Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3497, in reboot Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f4822dbd-f6d6-4c66-8661-69a15acf9df4 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 02:37:26.220005 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 02:37:26.224650 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance f4822dbd-f6d6-4c66-8661-69a15acf9df4 while it is in vm_state rescued Jul 18 02:37:26.224650 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:37:26.224650 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:37:26.224650 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:37:26.224650 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:37:26.224650 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:37:26.224650 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:37:26.224650 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:37:26.224650 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:37:26.224650 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance f4822dbd-f6d6-4c66-8661-69a15acf9df4 while it is in vm_state rescued Jul 18 02:37:26.224650 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:37:26.232451 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-45b462fb-1e88-4ac7-9294-e31b7fd04587 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Returning 409 to user: Cannot 'reboot' instance f4822dbd-f6d6-4c66-8661-69a15acf9df4 while it is in vm_state rescued {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:37:26.233976 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-45b462fb-1e88-4ac7-9294-e31b7fd04587 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "POST /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4/action" status: 409 len: 145 microversion: 2.1 time: 0.157319 Jul 18 02:37:26.239216 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1918/3827] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:37:26 2022] POST /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4/action => generated 145 bytes in 164 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:37:26.248563 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-bf638a0c-a683-45d5-93e8-bb6b41176eaf req-ce2d854e-e4a5-4c53-b94a-d823a306838d service nova] Creating event network-changed:2b179498-569c-4e0a-88a2-4c73687919da for instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 on n-h1-465891-3 Jul 18 02:37:26.255366 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-29fba098-b78f-4543-ac00-50ba2a850f3e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:26.258445 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-29fba098-b78f-4543-ac00-50ba2a850f3e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: f4822dbd-f6d6-4c66-8661-69a15acf9df4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:26.280031 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-bf638a0c-a683-45d5-93e8-bb6b41176eaf req-ce2d854e-e4a5-4c53-b94a-d823a306838d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149608 Jul 18 02:37:26.283001 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1910/3828] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:26.283998 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-29fba098-b78f-4543-ac00-50ba2a850f3e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:26.284468 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-29fba098-b78f-4543-ac00-50ba2a850f3e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:26.287021 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-29fba098-b78f-4543-ac00-50ba2a850f3e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:26.287580 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-29fba098-b78f-4543-ac00-50ba2a850f3e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:26.392326 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-29fba098-b78f-4543-ac00-50ba2a850f3e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] HTTP exception thrown: Cannot 'rebuild' instance f4822dbd-f6d6-4c66-8661-69a15acf9df4 while it is in vm_state rescued Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-29fba098-b78f-4543-ac00-50ba2a850f3e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Request method failure captured: Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4/action HTTP/1.1 Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 65 Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MYgsMpQMGg_x4SatJimijJMXDATUd7K8pbmJMir06_hhN9kc6nEv2UNuBHWPOsjhgniijNTcv86Pv1g5if6jfxnXnFgylGVtP-ES0p4q8KsL3cpv9H2D_niEdkyIvqxweiHovqWE9ZMi6DufO28-UhMwnDHb097CRDIZ6xtrA6LrKI Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 1594a06c4e7c4bb7b184d916342933ba Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1345973443 Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1594a06c4e7c4bb7b184d916342933ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1594a06c4e7c4bb7b184d916342933ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1594a06c4e7c4bb7b184d916342933ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1594a06c4e7c4bb7b184d916342933ba"}]}] Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1345973443 Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 1594a06c4e7c4bb7b184d916342933ba Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1345973443 Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServerRescueNegativeTestJSON-1345973443-project Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 6f30a2016d954121bb251894fad6dd39 Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1345973443-project Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: {"rebuild": {"imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36"}} Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: exception: Cannot 'rebuild' instance f4822dbd-f6d6-4c66-8661-69a15acf9df4 while it is in vm_state rescued Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'f4822dbd-f6d6-4c66-8661-69a15acf9df4', 'body': {'rebuild': {'imageRef': '3bb0a19f-5b69-48ee-a771-8fd416f92f36'}}} Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f4822dbd-f6d6-4c66-8661-69a15acf9df4 in vm_state rescued. Cannot rebuild while the instance is in this state. Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:37:26.395228 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:37:26.399832 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:37:26.399832 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 18 02:37:26.399832 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Jul 18 02:37:26.399832 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 02:37:26.399832 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 02:37:26.399832 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 02:37:26.399832 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance f4822dbd-f6d6-4c66-8661-69a15acf9df4 while it is in vm_state rescued Jul 18 02:37:26.399832 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:37:26.399832 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:37:26.399832 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:37:26.399832 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:37:26.399832 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:37:26.399832 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:37:26.399832 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:37:26.399832 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:37:26.399832 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance f4822dbd-f6d6-4c66-8661-69a15acf9df4 while it is in vm_state rescued Jul 18 02:37:26.399832 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:37:26.399832 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-29fba098-b78f-4543-ac00-50ba2a850f3e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Returning 409 to user: Cannot 'rebuild' instance f4822dbd-f6d6-4c66-8661-69a15acf9df4 while it is in vm_state rescued {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:37:26.405901 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-29fba098-b78f-4543-ac00-50ba2a850f3e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "POST /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4/action" status: 409 len: 146 microversion: 2.1 time: 0.164727 Jul 18 02:37:26.410319 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1919/3829] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:37:26 2022] POST /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4/action => generated 146 bytes in 167 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 18 02:37:26.417843 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6635c557-3754-4107-b5c5-9de6efa7f2de tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:26.418789 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6635c557-3754-4107-b5c5-9de6efa7f2de tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:26.440893 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6635c557-3754-4107-b5c5-9de6efa7f2de tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:26.446180 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6635c557-3754-4107-b5c5-9de6efa7f2de tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:26.447403 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6635c557-3754-4107-b5c5-9de6efa7f2de tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:26.450609 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6635c557-3754-4107-b5c5-9de6efa7f2de tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:26.581990 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6635c557-3754-4107-b5c5-9de6efa7f2de tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:37:26.847440 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6635c557-3754-4107-b5c5-9de6efa7f2de tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 204 len: 0 microversion: 2.1 time: 0.434747 Jul 18 02:37:26.849649 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1911/3830] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:37:26 2022] DELETE /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:37:26.864857 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5c79425c-dd0c-4013-8055-70c1ad51034a tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:26.865480 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5c79425c-dd0c-4013-8055-70c1ad51034a tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:26.884498 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5c79425c-dd0c-4013-8055-70c1ad51034a tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:26.901890 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5c79425c-dd0c-4013-8055-70c1ad51034a tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:26.902985 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5c79425c-dd0c-4013-8055-70c1ad51034a tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:26.903608 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5c79425c-dd0c-4013-8055-70c1ad51034a tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:27.104893 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a2060fff-391b-45c9-a7d3-b255342590ce tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:27.106791 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a2060fff-391b-45c9-a7d3-b255342590ce tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:27.135593 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a2060fff-391b-45c9-a7d3-b255342590ce tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:27.140899 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a2060fff-391b-45c9-a7d3-b255342590ce tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:27.145468 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a2060fff-391b-45c9-a7d3-b255342590ce tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:27.146923 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a2060fff-391b-45c9-a7d3-b255342590ce tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:28.984507 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5c79425c-dd0c-4013-8055-70c1ad51034a tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:29.016273 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5c79425c-dd0c-4013-8055-70c1ad51034a tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 200 len: 1690 microversion: 2.1 time: 2.157833 Jul 18 02:37:29.030384 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1920/3831] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:26 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 1690 bytes in 2168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:29.053409 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8ebf5ff6-e303-4bc8-bab1-0d5bb6368af4 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:29.057967 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8ebf5ff6-e303-4bc8-bab1-0d5bb6368af4 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: 5a35d492-b3d5-4fc8-8b1d-4629b95fde09] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:29.080963 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8ebf5ff6-e303-4bc8-bab1-0d5bb6368af4 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:29.081435 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8ebf5ff6-e303-4bc8-bab1-0d5bb6368af4 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:29.086706 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8ebf5ff6-e303-4bc8-bab1-0d5bb6368af4 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:29.087709 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8ebf5ff6-e303-4bc8-bab1-0d5bb6368af4 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:29.205250 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a2060fff-391b-45c9-a7d3-b255342590ce tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:29.276559 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a2060fff-391b-45c9-a7d3-b255342590ce tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:29.314089 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a2060fff-391b-45c9-a7d3-b255342590ce tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:29.338999 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a2060fff-391b-45c9-a7d3-b255342590ce tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1887 microversion: 2.32 time: 2.229642 Jul 18 02:37:29.347734 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1912/3832] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:27 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1887 bytes in 2252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:37:29.415899 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-88a6ce2f-8016-4862-b23b-7cb8a06b8640 req-41e3cd98-bf33-4aeb-9ec4-b94c4115733a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e6dc16e-f557-44c2-b61c-92981b9915d4", "tag": "d1abc038-d96b-4cc7-87d7-6e9e2bbd7be2"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:29.490606 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-88a6ce2f-8016-4862-b23b-7cb8a06b8640 req-41e3cd98-bf33-4aeb-9ec4-b94c4115733a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:29.498468 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-88a6ce2f-8016-4862-b23b-7cb8a06b8640 req-41e3cd98-bf33-4aeb-9ec4-b94c4115733a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:29.592967 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-88a6ce2f-8016-4862-b23b-7cb8a06b8640 req-41e3cd98-bf33-4aeb-9ec4-b94c4115733a service nova] Creating event network-changed:d1abc038-d96b-4cc7-87d7-6e9e2bbd7be2 for instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 on n-h1-465891-3 Jul 18 02:37:29.615686 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-88a6ce2f-8016-4862-b23b-7cb8a06b8640 req-41e3cd98-bf33-4aeb-9ec4-b94c4115733a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.264854 Jul 18 02:37:29.619638 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1913/3833] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:29.636583 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c25ae51c-7658-49e9-b932-498d1ad14ef4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:29.637630 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c25ae51c-7658-49e9-b932-498d1ad14ef4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:29.675901 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c25ae51c-7658-49e9-b932-498d1ad14ef4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:29.676637 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c25ae51c-7658-49e9-b932-498d1ad14ef4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:29.677691 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c25ae51c-7658-49e9-b932-498d1ad14ef4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:29.680042 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c25ae51c-7658-49e9-b932-498d1ad14ef4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:29.749351 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-c25ae51c-7658-49e9-b932-498d1ad14ef4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lazy-loading 'flavor' on Instance uuid d18d284e-d055-4fe5-af1c-b41ee803d426 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:37:30.565007 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8ebf5ff6-e303-4bc8-bab1-0d5bb6368af4 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:30.598329 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8ebf5ff6-e303-4bc8-bab1-0d5bb6368af4 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09" status: 200 len: 1500 microversion: 2.1 time: 1.573706 Jul 18 02:37:30.614419 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1921/3834] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:29 2022] GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09 => generated 1500 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:30.676256 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6e057761-bd2e-498c-943f-47f54587cedf tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:30.687926 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6e057761-bd2e-498c-943f-47f54587cedf tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:30.710710 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6e057761-bd2e-498c-943f-47f54587cedf tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:30.712762 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6e057761-bd2e-498c-943f-47f54587cedf tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:30.715356 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6e057761-bd2e-498c-943f-47f54587cedf tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:30.719385 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6e057761-bd2e-498c-943f-47f54587cedf tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:31.053413 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c25ae51c-7658-49e9-b932-498d1ad14ef4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "POST /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/action" status: 202 len: 0 microversion: 2.20 time: 1.425589 Jul 18 02:37:31.055167 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1914/3835] 10.222.0.57 () {62 vars in 1318 bytes} [Mon Jul 18 02:37:29 2022] POST /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/action => generated 0 bytes in 1433 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:37:31.071401 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0bbbec2f-f460-4856-a10e-943fea65ffff tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:31.085148 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0bbbec2f-f460-4856-a10e-943fea65ffff tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:31.113433 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:31.129450 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0bbbec2f-f460-4856-a10e-943fea65ffff tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:31.134827 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0bbbec2f-f460-4856-a10e-943fea65ffff tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:31.136602 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0bbbec2f-f460-4856-a10e-943fea65ffff tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:31.138398 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0bbbec2f-f460-4856-a10e-943fea65ffff tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:31.998519 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0bbbec2f-f460-4856-a10e-943fea65ffff tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:32.012432 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0bbbec2f-f460-4856-a10e-943fea65ffff tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:32.014213 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0bbbec2f-f460-4856-a10e-943fea65ffff tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:32.015476 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0bbbec2f-f460-4856-a10e-943fea65ffff tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1887 microversion: 2.32 time: 0.959096 Jul 18 02:37:32.016075 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1915/3836] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:31 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1887 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:32.041344 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a9e71077-e9a2-4b6a-afaf-15cd412fadf7 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:32.047283 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a9e71077-e9a2-4b6a-afaf-15cd412fadf7 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: 5a35d492-b3d5-4fc8-8b1d-4629b95fde09] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:32.068768 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9e71077-e9a2-4b6a-afaf-15cd412fadf7 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:32.069423 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9e71077-e9a2-4b6a-afaf-15cd412fadf7 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:32.070088 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9e71077-e9a2-4b6a-afaf-15cd412fadf7 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:32.070547 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9e71077-e9a2-4b6a-afaf-15cd412fadf7 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:32.090449 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6e057761-bd2e-498c-943f-47f54587cedf tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:32.103516 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6e057761-bd2e-498c-943f-47f54587cedf tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 200 len: 1690 microversion: 2.1 time: 1.480919 Jul 18 02:37:32.133296 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1922/3837] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:30 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 1690 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:32.139216 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4e060326-5db3-4a08-99f5-535770e0c95d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:32.139852 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4e060326-5db3-4a08-99f5-535770e0c95d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:32.150211 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:32.159256 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-a9e71077-e9a2-4b6a-afaf-15cd412fadf7 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lazy-loading 'flavor' on Instance uuid 5a35d492-b3d5-4fc8-8b1d-4629b95fde09 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:37:32.170086 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e060326-5db3-4a08-99f5-535770e0c95d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:32.173468 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e060326-5db3-4a08-99f5-535770e0c95d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:32.175915 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e060326-5db3-4a08-99f5-535770e0c95d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:32.177493 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e060326-5db3-4a08-99f5-535770e0c95d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:32.474770 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a9e71077-e9a2-4b6a-afaf-15cd412fadf7 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "POST /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09/action" status: 200 len: 32 microversion: 2.1 time: 0.436772 Jul 18 02:37:32.485430 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1916/3838] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:37:32 2022] POST /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09/action => generated 32 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:37:32.512935 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-89dca431-9936-4d60-b6e0-cb156fe668ca req-f04eb061-d532-46c6-9bb5-9a9f25193550 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e6dc16e-f557-44c2-b61c-92981b9915d4", "tag": "4e48952d-6c79-460b-a0c6-59c7c8c1573e"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:32.567351 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-89dca431-9936-4d60-b6e0-cb156fe668ca req-f04eb061-d532-46c6-9bb5-9a9f25193550 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:32.573209 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-89dca431-9936-4d60-b6e0-cb156fe668ca req-f04eb061-d532-46c6-9bb5-9a9f25193550 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:32.621286 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-89dca431-9936-4d60-b6e0-cb156fe668ca req-f04eb061-d532-46c6-9bb5-9a9f25193550 service nova] Creating event network-changed:4e48952d-6c79-460b-a0c6-59c7c8c1573e for instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 on n-h1-465891-3 Jul 18 02:37:32.642334 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-89dca431-9936-4d60-b6e0-cb156fe668ca req-f04eb061-d532-46c6-9bb5-9a9f25193550 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152793 Jul 18 02:37:32.646284 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1917/3839] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:32.660879 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bca23c1c-b1f4-41a1-a85a-74762dc1b2d4 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:32.702577 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bca23c1c-b1f4-41a1-a85a-74762dc1b2d4 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: 5a35d492-b3d5-4fc8-8b1d-4629b95fde09] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:32.725734 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bca23c1c-b1f4-41a1-a85a-74762dc1b2d4 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:32.726697 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bca23c1c-b1f4-41a1-a85a-74762dc1b2d4 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:32.736140 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bca23c1c-b1f4-41a1-a85a-74762dc1b2d4 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:32.737025 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bca23c1c-b1f4-41a1-a85a-74762dc1b2d4 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:33.865862 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bca23c1c-b1f4-41a1-a85a-74762dc1b2d4 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:33.881489 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bca23c1c-b1f4-41a1-a85a-74762dc1b2d4 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09" status: 200 len: 1506 microversion: 2.1 time: 1.232940 Jul 18 02:37:33.890297 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1918/3840] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:32 2022] GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09 => generated 1506 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:33.895950 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-05c19158-9822-418b-af2c-8c0bb2a20d0b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:33.899652 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-05c19158-9822-418b-af2c-8c0bb2a20d0b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:33.907074 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4e060326-5db3-4a08-99f5-535770e0c95d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:33.924409 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4e060326-5db3-4a08-99f5-535770e0c95d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:33.929079 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4e060326-5db3-4a08-99f5-535770e0c95d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:33.931244 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-05c19158-9822-418b-af2c-8c0bb2a20d0b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:33.934192 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4e060326-5db3-4a08-99f5-535770e0c95d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1722 microversion: 2.20 time: 1.798774 Jul 18 02:37:33.934192 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1923/3841] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:32 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1722 bytes in 1800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:33.938513 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-05c19158-9822-418b-af2c-8c0bb2a20d0b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:33.939631 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-05c19158-9822-418b-af2c-8c0bb2a20d0b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:33.940462 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-05c19158-9822-418b-af2c-8c0bb2a20d0b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:33.957532 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1602fdb7-5879-408d-8ff9-49c00faa07de tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:33.958621 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1602fdb7-5879-408d-8ff9-49c00faa07de tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:33.987160 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1602fdb7-5879-408d-8ff9-49c00faa07de tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:33.987702 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1602fdb7-5879-408d-8ff9-49c00faa07de tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:33.992598 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1602fdb7-5879-408d-8ff9-49c00faa07de tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:33.994058 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1602fdb7-5879-408d-8ff9-49c00faa07de tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:35.379312 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1602fdb7-5879-408d-8ff9-49c00faa07de tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:35.397357 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1602fdb7-5879-408d-8ff9-49c00faa07de tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 200 len: 1690 microversion: 2.1 time: 1.450984 Jul 18 02:37:35.401687 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1924/3842] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:33 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 1690 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:35.413553 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-e2a814d9-07ea-4b6e-8a63-53187657fcd7 req-aa18de4c-f320-4960-bd46-cf7f692fdf1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec655fda-37a0-4b96-b478-3ca18ffa37f2", "name": "network-vif-unplugged", "status": "completed", "tag": "163ed416-80e6-4cc5-ad3e-9045d5ee4529"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:35.452103 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-e2a814d9-07ea-4b6e-8a63-53187657fcd7 req-aa18de4c-f320-4960-bd46-cf7f692fdf1c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:35.455076 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-e2a814d9-07ea-4b6e-8a63-53187657fcd7 req-aa18de4c-f320-4960-bd46-cf7f692fdf1c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:35.492575 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-e2a814d9-07ea-4b6e-8a63-53187657fcd7 req-aa18de4c-f320-4960-bd46-cf7f692fdf1c service nova] Creating event network-vif-unplugged:163ed416-80e6-4cc5-ad3e-9045d5ee4529 for instance ec655fda-37a0-4b96-b478-3ca18ffa37f2 on n-h2-465891-3 Jul 18 02:37:35.508552 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-e2a814d9-07ea-4b6e-8a63-53187657fcd7 req-aa18de4c-f320-4960-bd46-cf7f692fdf1c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103655 Jul 18 02:37:35.514714 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1925/3843] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:35.527122 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-72d8fb0a-9820-442a-8e7d-a8aa71ef38d7 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:35.527852 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-72d8fb0a-9820-442a-8e7d-a8aa71ef38d7 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: 5a35d492-b3d5-4fc8-8b1d-4629b95fde09] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:35.547569 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-72d8fb0a-9820-442a-8e7d-a8aa71ef38d7 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:35.548026 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-72d8fb0a-9820-442a-8e7d-a8aa71ef38d7 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:35.548825 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-72d8fb0a-9820-442a-8e7d-a8aa71ef38d7 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:35.549265 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-72d8fb0a-9820-442a-8e7d-a8aa71ef38d7 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:36.439897 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-05c19158-9822-418b-af2c-8c0bb2a20d0b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:36.492775 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-05c19158-9822-418b-af2c-8c0bb2a20d0b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:36.537872 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-05c19158-9822-418b-af2c-8c0bb2a20d0b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:36.540287 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-05c19158-9822-418b-af2c-8c0bb2a20d0b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1887 microversion: 2.32 time: 2.648220 Jul 18 02:37:36.541276 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1919/3844] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:33 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1887 bytes in 2650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:36.589582 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6b8c9951-a9d7-4820-b7db-9680dfd47644 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:36.590752 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6b8c9951-a9d7-4820-b7db-9680dfd47644 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:36.621728 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6b8c9951-a9d7-4820-b7db-9680dfd47644 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:36.626559 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6b8c9951-a9d7-4820-b7db-9680dfd47644 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:36.630421 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6b8c9951-a9d7-4820-b7db-9680dfd47644 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:36.631265 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6b8c9951-a9d7-4820-b7db-9680dfd47644 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:38.349740 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6b8c9951-a9d7-4820-b7db-9680dfd47644 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:38.379381 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6b8c9951-a9d7-4820-b7db-9680dfd47644 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:38.383583 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6b8c9951-a9d7-4820-b7db-9680dfd47644 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:38.387288 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6b8c9951-a9d7-4820-b7db-9680dfd47644 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1722 microversion: 2.20 time: 1.821183 Jul 18 02:37:38.388958 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1920/3845] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:36 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1722 bytes in 1847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:38.400335 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4693b7e3-cd00-4ed1-aaa6-3691b87e86de tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:38.404098 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4693b7e3-cd00-4ed1-aaa6-3691b87e86de tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:38.428073 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4693b7e3-cd00-4ed1-aaa6-3691b87e86de tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:38.429276 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4693b7e3-cd00-4ed1-aaa6-3691b87e86de tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:38.431200 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4693b7e3-cd00-4ed1-aaa6-3691b87e86de tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:38.433457 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4693b7e3-cd00-4ed1-aaa6-3691b87e86de tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:38.595104 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-72d8fb0a-9820-442a-8e7d-a8aa71ef38d7 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:38.602028 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=100 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:38.648835 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-72d8fb0a-9820-442a-8e7d-a8aa71ef38d7 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09" status: 200 len: 1506 microversion: 2.1 time: 3.131605 Jul 18 02:37:38.655306 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1926/3846] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:35 2022] GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09 => generated 1506 bytes in 3140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:38.682882 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4b4ec4aa-c29f-4c85-b562-7fe73b7d4ad0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:38.687372 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4b4ec4aa-c29f-4c85-b562-7fe73b7d4ad0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:38.717498 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4b4ec4aa-c29f-4c85-b562-7fe73b7d4ad0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:38.718786 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4b4ec4aa-c29f-4c85-b562-7fe73b7d4ad0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:38.720633 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4b4ec4aa-c29f-4c85-b562-7fe73b7d4ad0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:38.721846 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4b4ec4aa-c29f-4c85-b562-7fe73b7d4ad0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:38.802578 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4693b7e3-cd00-4ed1-aaa6-3691b87e86de tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:38.818084 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4693b7e3-cd00-4ed1-aaa6-3691b87e86de tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 200 len: 1623 microversion: 2.1 time: 0.427373 Jul 18 02:37:38.818715 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1921/3847] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:38 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 1623 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:39.408064 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-56eb0bf6-f586-464a-b830-01f63716e094 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:39.409407 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-56eb0bf6-f586-464a-b830-01f63716e094 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:39.430411 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56eb0bf6-f586-464a-b830-01f63716e094 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:39.430888 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56eb0bf6-f586-464a-b830-01f63716e094 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:39.431729 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56eb0bf6-f586-464a-b830-01f63716e094 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:39.432352 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56eb0bf6-f586-464a-b830-01f63716e094 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:39.962282 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4b4ec4aa-c29f-4c85-b562-7fe73b7d4ad0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:40.008517 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4b4ec4aa-c29f-4c85-b562-7fe73b7d4ad0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:40.037249 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4b4ec4aa-c29f-4c85-b562-7fe73b7d4ad0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:40.059447 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4b4ec4aa-c29f-4c85-b562-7fe73b7d4ad0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1887 microversion: 2.32 time: 1.391850 Jul 18 02:37:40.060070 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1927/3848] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:38 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1887 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:40.103139 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fa272d09-7072-4021-9f94-4894be145488 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:40.103695 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fa272d09-7072-4021-9f94-4894be145488 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: 5a35d492-b3d5-4fc8-8b1d-4629b95fde09] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:40.138832 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fa272d09-7072-4021-9f94-4894be145488 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:40.143359 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fa272d09-7072-4021-9f94-4894be145488 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:40.144305 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fa272d09-7072-4021-9f94-4894be145488 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:40.144764 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fa272d09-7072-4021-9f94-4894be145488 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:40.591151 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fa272d09-7072-4021-9f94-4894be145488 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:40.679305 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fa272d09-7072-4021-9f94-4894be145488 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09" status: 200 len: 1506 microversion: 2.1 time: 0.598223 Jul 18 02:37:40.685339 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1928/3849] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:40 2022] GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09 => generated 1506 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:40.734151 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-83396a3a-5160-47b1-989e-6aa7b5b057e1 req-0ef89525-8d52-4dee-944d-6f7742ef5c07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec655fda-37a0-4b96-b478-3ca18ffa37f2", "name": "network-vif-deleted", "tag": "163ed416-80e6-4cc5-ad3e-9045d5ee4529"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:40.758493 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-83396a3a-5160-47b1-989e-6aa7b5b057e1 req-0ef89525-8d52-4dee-944d-6f7742ef5c07 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:40.759202 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-83396a3a-5160-47b1-989e-6aa7b5b057e1 req-0ef89525-8d52-4dee-944d-6f7742ef5c07 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:40.775598 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-83396a3a-5160-47b1-989e-6aa7b5b057e1 req-0ef89525-8d52-4dee-944d-6f7742ef5c07 service nova] Creating event network-vif-deleted:163ed416-80e6-4cc5-ad3e-9045d5ee4529 for instance ec655fda-37a0-4b96-b478-3ca18ffa37f2 on n-h2-465891-3 Jul 18 02:37:40.786374 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-83396a3a-5160-47b1-989e-6aa7b5b057e1 req-0ef89525-8d52-4dee-944d-6f7742ef5c07 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098398 Jul 18 02:37:40.796251 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1929/3850] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:40.807582 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fa04ce6f-9387-4599-8117-9b0043496668 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:40.815480 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fa04ce6f-9387-4599-8117-9b0043496668 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:40.836732 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fa04ce6f-9387-4599-8117-9b0043496668 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:40.841850 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fa04ce6f-9387-4599-8117-9b0043496668 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:40.842949 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fa04ce6f-9387-4599-8117-9b0043496668 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:40.863812 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fa04ce6f-9387-4599-8117-9b0043496668 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:40.985445 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fa04ce6f-9387-4599-8117-9b0043496668 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:40.992912 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fa04ce6f-9387-4599-8117-9b0043496668 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:40.993649 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-fa04ce6f-9387-4599-8117-9b0043496668 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lazy-loading 'fault' on Instance uuid ec655fda-37a0-4b96-b478-3ca18ffa37f2 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:37:41.490544 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fa04ce6f-9387-4599-8117-9b0043496668 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:41.519295 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fa04ce6f-9387-4599-8117-9b0043496668 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 200 len: 1336 microversion: 2.1 time: 0.720969 Jul 18 02:37:41.528206 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1930/3851] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:40 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 1336 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:41.545444 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-644224fd-ee69-4736-96a0-ee6846f2e46b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:41.546292 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-644224fd-ee69-4736-96a0-ee6846f2e46b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:41.575697 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-644224fd-ee69-4736-96a0-ee6846f2e46b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:41.576350 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-644224fd-ee69-4736-96a0-ee6846f2e46b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:41.577412 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-644224fd-ee69-4736-96a0-ee6846f2e46b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:41.578096 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-644224fd-ee69-4736-96a0-ee6846f2e46b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:42.224111 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-56eb0bf6-f586-464a-b830-01f63716e094 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:42.238619 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-56eb0bf6-f586-464a-b830-01f63716e094 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:42.248624 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-56eb0bf6-f586-464a-b830-01f63716e094 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:42.253935 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-56eb0bf6-f586-464a-b830-01f63716e094 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1722 microversion: 2.20 time: 2.847162 Jul 18 02:37:42.270241 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1922/3852] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:39 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1722 bytes in 2867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:37:42.279701 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7bcafd4f-c5cf-42a0-9ff6-2f08c68c089d tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:42.298751 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7bcafd4f-c5cf-42a0-9ff6-2f08c68c089d tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: 5a35d492-b3d5-4fc8-8b1d-4629b95fde09] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:42.312899 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7bcafd4f-c5cf-42a0-9ff6-2f08c68c089d tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:42.313361 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7bcafd4f-c5cf-42a0-9ff6-2f08c68c089d tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:42.314398 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7bcafd4f-c5cf-42a0-9ff6-2f08c68c089d tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:42.314846 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7bcafd4f-c5cf-42a0-9ff6-2f08c68c089d tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:42.689639 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7bcafd4f-c5cf-42a0-9ff6-2f08c68c089d tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:42.709635 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7bcafd4f-c5cf-42a0-9ff6-2f08c68c089d tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09" status: 200 len: 1506 microversion: 2.1 time: 0.437901 Jul 18 02:37:42.711084 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1923/3853] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:42 2022] GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09 => generated 1506 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:42.724251 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-60092073-7e36-4732-9bbe-ce803856ea9f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:42.724876 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-60092073-7e36-4732-9bbe-ce803856ea9f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: ec655fda-37a0-4b96-b478-3ca18ffa37f2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:42.761227 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60092073-7e36-4732-9bbe-ce803856ea9f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:42.769347 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60092073-7e36-4732-9bbe-ce803856ea9f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:42.770450 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60092073-7e36-4732-9bbe-ce803856ea9f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:42.772433 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60092073-7e36-4732-9bbe-ce803856ea9f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:42.821060 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-60092073-7e36-4732-9bbe-ce803856ea9f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] HTTP exception thrown: Instance ec655fda-37a0-4b96-b478-3ca18ffa37f2 could not be found. Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-60092073-7e36-4732-9bbe-ce803856ea9f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Request method failure captured: Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 HTTP/1.1 Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MYgsMpQMGg_x4SatJimijJMXDATUd7K8pbmJMir06_hhN9kc6nEv2UNuBHWPOsjhgniijNTcv86Pv1g5if6jfxnXnFgylGVtP-ES0p4q8KsL3cpv9H2D_niEdkyIvqxweiHovqWE9ZMi6DufO28-UhMwnDHb097CRDIZ6xtrA6LrKI Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 1594a06c4e7c4bb7b184d916342933ba Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1345973443 Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1594a06c4e7c4bb7b184d916342933ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1594a06c4e7c4bb7b184d916342933ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1594a06c4e7c4bb7b184d916342933ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1594a06c4e7c4bb7b184d916342933ba"}]}] Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1345973443 Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 1594a06c4e7c4bb7b184d916342933ba Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1345973443 Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServerRescueNegativeTestJSON-1345973443-project Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 6f30a2016d954121bb251894fad6dd39 Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1345973443-project Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance ec655fda-37a0-4b96-b478-3ca18ffa37f2 could not be found. Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'ec655fda-37a0-4b96-b478-3ca18ffa37f2'} Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec655fda-37a0-4b96-b478-3ca18ffa37f2 could not be found. Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec655fda-37a0-4b96-b478-3ca18ffa37f2 could not be found. Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:37:42.835721 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:37:42.840582 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:37:42.840582 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:37:42.840582 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:37:42.840582 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:37:42.840582 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:37:42.840582 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:37:42.840582 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec655fda-37a0-4b96-b478-3ca18ffa37f2 could not be found. Jul 18 02:37:42.840582 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:37:42.841106 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-644224fd-ee69-4736-96a0-ee6846f2e46b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:42.845559 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-60092073-7e36-4732-9bbe-ce803856ea9f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Returning 404 to user: Instance ec655fda-37a0-4b96-b478-3ca18ffa37f2 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:37:42.846719 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-60092073-7e36-4732-9bbe-ce803856ea9f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2" status: 404 len: 111 microversion: 2.1 time: 0.134644 Jul 18 02:37:42.851898 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-644224fd-ee69-4736-96a0-ee6846f2e46b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:42.853021 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1924/3854] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:42 2022] GET /compute/v2.1/servers/ec655fda-37a0-4b96-b478-3ca18ffa37f2 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:37:42.853662 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-644224fd-ee69-4736-96a0-ee6846f2e46b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:42.862925 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-799e2b41-e1a8-4c56-ba75-e6d420078c65 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '.version_select at 0x7ff49b621e50>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:42.886050 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-644224fd-ee69-4736-96a0-ee6846f2e46b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1887 microversion: 2.32 time: 1.348711 Jul 18 02:37:42.886867 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1931/3855] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:41 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1887 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:42.930370 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-799e2b41-e1a8-4c56-ba75-e6d420078c65 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1298173662" status: 202 len: 0 microversion: 2.1 time: 0.071896 Jul 18 02:37:42.934017 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1925/3856] 10.222.0.57 () {58 vars in 1220 bytes} [Mon Jul 18 02:37:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1298173662 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:37:43.275389 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4f105329-da2f-4d05-8749-72fd3e264c61 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:43.276671 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4f105329-da2f-4d05-8749-72fd3e264c61 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:43.299205 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4f105329-da2f-4d05-8749-72fd3e264c61 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:43.299669 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4f105329-da2f-4d05-8749-72fd3e264c61 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:43.300522 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4f105329-da2f-4d05-8749-72fd3e264c61 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:43.300976 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4f105329-da2f-4d05-8749-72fd3e264c61 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:43.726951 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4f105329-da2f-4d05-8749-72fd3e264c61 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:43.739429 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4f105329-da2f-4d05-8749-72fd3e264c61 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:43.741806 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-85f1c20e-0c6c-4579-9a35-2f2894087509 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:43.742504 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-85f1c20e-0c6c-4579-9a35-2f2894087509 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: 5a35d492-b3d5-4fc8-8b1d-4629b95fde09] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:43.744451 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4f105329-da2f-4d05-8749-72fd3e264c61 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:43.757561 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85f1c20e-0c6c-4579-9a35-2f2894087509 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:43.758051 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85f1c20e-0c6c-4579-9a35-2f2894087509 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:43.758470 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4f105329-da2f-4d05-8749-72fd3e264c61 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1722 microversion: 2.20 time: 0.487044 Jul 18 02:37:43.758860 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85f1c20e-0c6c-4579-9a35-2f2894087509 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:43.759304 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85f1c20e-0c6c-4579-9a35-2f2894087509 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:43.778163 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1932/3857] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:43 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1722 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:43.911767 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4aab56bb-73a3-4845-b9a1-aa9d2f3ee892 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:43.913420 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4aab56bb-73a3-4845-b9a1-aa9d2f3ee892 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:43.929054 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4aab56bb-73a3-4845-b9a1-aa9d2f3ee892 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:43.932831 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4aab56bb-73a3-4845-b9a1-aa9d2f3ee892 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:43.934086 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4aab56bb-73a3-4845-b9a1-aa9d2f3ee892 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:43.941508 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4aab56bb-73a3-4845-b9a1-aa9d2f3ee892 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:44.515437 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4aab56bb-73a3-4845-b9a1-aa9d2f3ee892 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:44.535193 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4aab56bb-73a3-4845-b9a1-aa9d2f3ee892 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:44.542475 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4aab56bb-73a3-4845-b9a1-aa9d2f3ee892 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:44.544388 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4aab56bb-73a3-4845-b9a1-aa9d2f3ee892 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1887 microversion: 2.32 time: 0.636816 Jul 18 02:37:44.560617 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1933/3858] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:43 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1887 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:44.785514 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-aae3d5eb-d990-4546-936c-445429dd4997 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:44.786337 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-aae3d5eb-d990-4546-936c-445429dd4997 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:44.810647 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aae3d5eb-d990-4546-936c-445429dd4997 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:44.812140 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aae3d5eb-d990-4546-936c-445429dd4997 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:44.815868 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aae3d5eb-d990-4546-936c-445429dd4997 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:44.818080 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aae3d5eb-d990-4546-936c-445429dd4997 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:44.896682 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-85f1c20e-0c6c-4579-9a35-2f2894087509 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:44.919691 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-85f1c20e-0c6c-4579-9a35-2f2894087509 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09" status: 200 len: 1506 microversion: 2.1 time: 1.178217 Jul 18 02:37:44.923940 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1926/3859] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:43 2022] GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09 => generated 1506 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:45.535204 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-aae3d5eb-d990-4546-936c-445429dd4997 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:45.564983 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-11660439-c7dc-435c-9bc8-ba4c8bb6c48f tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:45.566943 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-11660439-c7dc-435c-9bc8-ba4c8bb6c48f tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:45.584856 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-11660439-c7dc-435c-9bc8-ba4c8bb6c48f tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:45.589651 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-aae3d5eb-d990-4546-936c-445429dd4997 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:45.592051 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-aae3d5eb-d990-4546-936c-445429dd4997 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:45.592791 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-11660439-c7dc-435c-9bc8-ba4c8bb6c48f tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:45.597790 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-11660439-c7dc-435c-9bc8-ba4c8bb6c48f tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:45.598411 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-11660439-c7dc-435c-9bc8-ba4c8bb6c48f tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:45.602112 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-aae3d5eb-d990-4546-936c-445429dd4997 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1722 microversion: 2.20 time: 0.819055 Jul 18 02:37:45.610502 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1934/3860] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:44 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1722 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:37:45.953289 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-25927370-d689-4b0f-a101-1aa81dd42149 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:45.954947 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-25927370-d689-4b0f-a101-1aa81dd42149 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: 5a35d492-b3d5-4fc8-8b1d-4629b95fde09] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:46.003781 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25927370-d689-4b0f-a101-1aa81dd42149 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:46.004584 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25927370-d689-4b0f-a101-1aa81dd42149 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:46.006090 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25927370-d689-4b0f-a101-1aa81dd42149 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:46.006902 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25927370-d689-4b0f-a101-1aa81dd42149 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:46.238499 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-11660439-c7dc-435c-9bc8-ba4c8bb6c48f tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:46.295215 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-11660439-c7dc-435c-9bc8-ba4c8bb6c48f tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:46.298962 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-11660439-c7dc-435c-9bc8-ba4c8bb6c48f tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:46.311281 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-11660439-c7dc-435c-9bc8-ba4c8bb6c48f tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1887 microversion: 2.32 time: 0.746108 Jul 18 02:37:46.312101 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1927/3861] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:45 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1887 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:37:46.643896 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b570f0b0-330f-4b63-b3f1-967109115a55 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:46.644512 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b570f0b0-330f-4b63-b3f1-967109115a55 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:46.659740 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b570f0b0-330f-4b63-b3f1-967109115a55 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:46.660060 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b570f0b0-330f-4b63-b3f1-967109115a55 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:46.668972 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b570f0b0-330f-4b63-b3f1-967109115a55 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:46.669842 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b570f0b0-330f-4b63-b3f1-967109115a55 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:46.736124 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-25927370-d689-4b0f-a101-1aa81dd42149 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:46.752006 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-25927370-d689-4b0f-a101-1aa81dd42149 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09" status: 200 len: 1506 microversion: 2.1 time: 0.804377 Jul 18 02:37:46.752627 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1935/3862] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:45 2022] GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09 => generated 1506 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:47.363271 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ee91e294-c43e-4fe9-9b9f-0d1640a23656 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:47.383992 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ee91e294-c43e-4fe9-9b9f-0d1640a23656 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:47.422718 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ee91e294-c43e-4fe9-9b9f-0d1640a23656 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:47.423628 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ee91e294-c43e-4fe9-9b9f-0d1640a23656 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:47.425157 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ee91e294-c43e-4fe9-9b9f-0d1640a23656 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:47.440580 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ee91e294-c43e-4fe9-9b9f-0d1640a23656 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:47.795712 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b570f0b0-330f-4b63-b3f1-967109115a55 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:47.837075 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b570f0b0-330f-4b63-b3f1-967109115a55 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:47.852000 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b570f0b0-330f-4b63-b3f1-967109115a55 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:47.870627 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b570f0b0-330f-4b63-b3f1-967109115a55 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1722 microversion: 2.20 time: 1.229661 Jul 18 02:37:47.883578 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1928/3863] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:46 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1722 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:47.896546 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ff4c8f8a-dee1-4581-bac0-ed131ec51b39 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:47.897451 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ff4c8f8a-dee1-4581-bac0-ed131ec51b39 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: 5a35d492-b3d5-4fc8-8b1d-4629b95fde09] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:47.912309 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ff4c8f8a-dee1-4581-bac0-ed131ec51b39 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:47.918701 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ff4c8f8a-dee1-4581-bac0-ed131ec51b39 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:47.919883 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ff4c8f8a-dee1-4581-bac0-ed131ec51b39 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:47.920526 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ff4c8f8a-dee1-4581-bac0-ed131ec51b39 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:48.549216 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ee91e294-c43e-4fe9-9b9f-0d1640a23656 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:48.579217 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ee91e294-c43e-4fe9-9b9f-0d1640a23656 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:48.586142 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ee91e294-c43e-4fe9-9b9f-0d1640a23656 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:48.587662 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ee91e294-c43e-4fe9-9b9f-0d1640a23656 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1887 microversion: 2.32 time: 1.255651 Jul 18 02:37:48.604104 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1936/3864] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:47 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1887 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:48.699732 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ff4c8f8a-dee1-4581-bac0-ed131ec51b39 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:48.716197 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ff4c8f8a-dee1-4581-bac0-ed131ec51b39 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09" status: 200 len: 1506 microversion: 2.1 time: 0.828660 Jul 18 02:37:48.720674 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1929/3865] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:47 2022] GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09 => generated 1506 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:48.891492 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-957820b8-b56b-48fd-a702-eded2e6d8343 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:48.894854 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-957820b8-b56b-48fd-a702-eded2e6d8343 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:48.918302 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-957820b8-b56b-48fd-a702-eded2e6d8343 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:48.918778 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-957820b8-b56b-48fd-a702-eded2e6d8343 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:48.919723 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-957820b8-b56b-48fd-a702-eded2e6d8343 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:48.920044 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-957820b8-b56b-48fd-a702-eded2e6d8343 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:49.608959 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4e67bc47-701e-4aa5-8776-c8e189d12486 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:49.609850 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4e67bc47-701e-4aa5-8776-c8e189d12486 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:49.628167 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4e67bc47-701e-4aa5-8776-c8e189d12486 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:49.628648 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4e67bc47-701e-4aa5-8776-c8e189d12486 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:49.629475 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4e67bc47-701e-4aa5-8776-c8e189d12486 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:49.629959 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4e67bc47-701e-4aa5-8776-c8e189d12486 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:51.253917 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4e67bc47-701e-4aa5-8776-c8e189d12486 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:51.272403 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4e67bc47-701e-4aa5-8776-c8e189d12486 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:51.284879 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4e67bc47-701e-4aa5-8776-c8e189d12486 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:51.288308 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4e67bc47-701e-4aa5-8776-c8e189d12486 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1887 microversion: 2.32 time: 1.684491 Jul 18 02:37:51.296903 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1930/3866] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:49 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1887 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:51.312608 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b3ab35db-905b-4599-9d77-b5a5dbd9f6c8 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:51.313559 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b3ab35db-905b-4599-9d77-b5a5dbd9f6c8 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: 5a35d492-b3d5-4fc8-8b1d-4629b95fde09] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:51.336836 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b3ab35db-905b-4599-9d77-b5a5dbd9f6c8 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:51.339241 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b3ab35db-905b-4599-9d77-b5a5dbd9f6c8 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:51.342013 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b3ab35db-905b-4599-9d77-b5a5dbd9f6c8 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:51.343476 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b3ab35db-905b-4599-9d77-b5a5dbd9f6c8 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:51.550529 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-957820b8-b56b-48fd-a702-eded2e6d8343 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:51.578434 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-957820b8-b56b-48fd-a702-eded2e6d8343 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:51.584488 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-957820b8-b56b-48fd-a702-eded2e6d8343 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:51.586251 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-957820b8-b56b-48fd-a702-eded2e6d8343 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1743 microversion: 2.20 time: 2.699587 Jul 18 02:37:51.607996 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1937/3867] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:48 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1743 bytes in 2722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:37:51.839382 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b3ab35db-905b-4599-9d77-b5a5dbd9f6c8 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:51.850539 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b3ab35db-905b-4599-9d77-b5a5dbd9f6c8 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09" status: 200 len: 1506 microversion: 2.1 time: 0.549073 Jul 18 02:37:51.851726 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1931/3868] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:51 2022] GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09 => generated 1506 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:52.211256 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 02:37:52.211901 n-d-465891-3 devstack@n-api.service[119544]: Mon Jul 18 02:37:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 02:37:52.313284 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bedecfa2-2cbc-4a87-87b8-42a6fca258b3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:52.319478 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bedecfa2-2cbc-4a87-87b8-42a6fca258b3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:52.319478 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=56 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:52.349940 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bedecfa2-2cbc-4a87-87b8-42a6fca258b3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:52.350482 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bedecfa2-2cbc-4a87-87b8-42a6fca258b3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:52.351342 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bedecfa2-2cbc-4a87-87b8-42a6fca258b3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:52.351792 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bedecfa2-2cbc-4a87-87b8-42a6fca258b3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:52.616307 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3b07965c-d90e-41c9-af32-15a3eee592b9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:52.618506 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3b07965c-d90e-41c9-af32-15a3eee592b9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:52.668434 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3b07965c-d90e-41c9-af32-15a3eee592b9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:52.699502 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3b07965c-d90e-41c9-af32-15a3eee592b9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:52.707571 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3b07965c-d90e-41c9-af32-15a3eee592b9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:52.721946 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3b07965c-d90e-41c9-af32-15a3eee592b9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:54.251172 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bedecfa2-2cbc-4a87-87b8-42a6fca258b3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:54.316317 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bedecfa2-2cbc-4a87-87b8-42a6fca258b3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:54.322509 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bedecfa2-2cbc-4a87-87b8-42a6fca258b3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:54.328853 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bedecfa2-2cbc-4a87-87b8-42a6fca258b3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1887 microversion: 2.32 time: 2.018318 Jul 18 02:37:54.331365 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1938/3869] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:52 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1887 bytes in 2023 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:37:54.349645 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-93a1c2b5-eacb-4c8e-bcb6-2a31b6abe60f tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:54.350798 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-93a1c2b5-eacb-4c8e-bcb6-2a31b6abe60f tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: 5a35d492-b3d5-4fc8-8b1d-4629b95fde09] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:54.367255 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3b07965c-d90e-41c9-af32-15a3eee592b9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:54.369033 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-93a1c2b5-eacb-4c8e-bcb6-2a31b6abe60f tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:54.371829 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-93a1c2b5-eacb-4c8e-bcb6-2a31b6abe60f tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:54.374460 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-93a1c2b5-eacb-4c8e-bcb6-2a31b6abe60f tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:54.376565 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-93a1c2b5-eacb-4c8e-bcb6-2a31b6abe60f tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:54.437856 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3b07965c-d90e-41c9-af32-15a3eee592b9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:54.455035 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3b07965c-d90e-41c9-af32-15a3eee592b9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:54.466058 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3b07965c-d90e-41c9-af32-15a3eee592b9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1743 microversion: 2.20 time: 1.852021 Jul 18 02:37:54.469348 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1932/3870] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:52 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1743 bytes in 1861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:54.757034 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-93a1c2b5-eacb-4c8e-bcb6-2a31b6abe60f tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:54.811318 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-93a1c2b5-eacb-4c8e-bcb6-2a31b6abe60f tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09" status: 200 len: 1506 microversion: 2.1 time: 0.475875 Jul 18 02:37:54.825803 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1939/3871] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:54 2022] GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09 => generated 1506 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:55.365180 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-766ad67b-1bff-45f4-a07f-5919e5cf41d6 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:55.369072 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-766ad67b-1bff-45f4-a07f-5919e5cf41d6 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:55.406165 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-766ad67b-1bff-45f4-a07f-5919e5cf41d6 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:55.408024 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-766ad67b-1bff-45f4-a07f-5919e5cf41d6 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:55.410315 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-766ad67b-1bff-45f4-a07f-5919e5cf41d6 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:55.411575 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-766ad67b-1bff-45f4-a07f-5919e5cf41d6 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:55.490203 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:55.499022 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-232697de-35a7-4c13-8a38-3c5872f0bada tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:55.507223 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-232697de-35a7-4c13-8a38-3c5872f0bada tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:55.591900 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-232697de-35a7-4c13-8a38-3c5872f0bada tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:55.601657 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-232697de-35a7-4c13-8a38-3c5872f0bada tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:55.631031 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-232697de-35a7-4c13-8a38-3c5872f0bada tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:55.634883 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-232697de-35a7-4c13-8a38-3c5872f0bada tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:56.866333 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-766ad67b-1bff-45f4-a07f-5919e5cf41d6 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:56.922095 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-766ad67b-1bff-45f4-a07f-5919e5cf41d6 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:56.925485 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-766ad67b-1bff-45f4-a07f-5919e5cf41d6 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:56.927718 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-766ad67b-1bff-45f4-a07f-5919e5cf41d6 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1887 microversion: 2.32 time: 1.578866 Jul 18 02:37:56.928652 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1933/3872] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:55 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1887 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:56.968433 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-89883bf6-9a48-451e-8969-d8ba86a33ba6 req-168c3939-fb05-4966-9584-20af6b051869 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d18d284e-d055-4fe5-af1c-b41ee803d426", "name": "network-vif-plugged", "status": "completed", "tag": "6ca46669-298c-45bb-bc10-3dd6fed58f4a"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:57.012208 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-89883bf6-9a48-451e-8969-d8ba86a33ba6 req-168c3939-fb05-4966-9584-20af6b051869 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:57.012795 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-89883bf6-9a48-451e-8969-d8ba86a33ba6 req-168c3939-fb05-4966-9584-20af6b051869 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:57.056016 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-89883bf6-9a48-451e-8969-d8ba86a33ba6 req-168c3939-fb05-4966-9584-20af6b051869 service nova] Creating event network-vif-plugged:6ca46669-298c-45bb-bc10-3dd6fed58f4a for instance d18d284e-d055-4fe5-af1c-b41ee803d426 on n-h1-465891-3 Jul 18 02:37:57.064467 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-89883bf6-9a48-451e-8969-d8ba86a33ba6 req-168c3939-fb05-4966-9584-20af6b051869 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119297 Jul 18 02:37:57.065101 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1934/3873] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:57.095027 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-94e29a8a-8631-47f0-ac27-e00084629639 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:57.095826 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-94e29a8a-8631-47f0-ac27-e00084629639 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: 5a35d492-b3d5-4fc8-8b1d-4629b95fde09] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:57.113571 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-94e29a8a-8631-47f0-ac27-e00084629639 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:57.114281 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-94e29a8a-8631-47f0-ac27-e00084629639 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:57.117745 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-94e29a8a-8631-47f0-ac27-e00084629639 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:57.118220 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-94e29a8a-8631-47f0-ac27-e00084629639 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:57.603420 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-232697de-35a7-4c13-8a38-3c5872f0bada tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:57.646153 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-232697de-35a7-4c13-8a38-3c5872f0bada tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:57.656595 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-232697de-35a7-4c13-8a38-3c5872f0bada tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:57.677973 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-232697de-35a7-4c13-8a38-3c5872f0bada tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1738 microversion: 2.20 time: 2.175696 Jul 18 02:37:57.688039 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1940/3874] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:55 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1738 bytes in 2204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:57.886398 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-94e29a8a-8631-47f0-ac27-e00084629639 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:57.899532 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-94e29a8a-8631-47f0-ac27-e00084629639 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09" status: 200 len: 1486 microversion: 2.1 time: 0.824848 Jul 18 02:37:57.900142 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1935/3875] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:57 2022] GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09 => generated 1486 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:57.949955 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-91a5fb38-ffca-4ba2-a3dc-8340f37a789d tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:57.950872 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-91a5fb38-ffca-4ba2-a3dc-8340f37a789d tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:57.974141 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91a5fb38-ffca-4ba2-a3dc-8340f37a789d tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:57.976127 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91a5fb38-ffca-4ba2-a3dc-8340f37a789d tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:57.977188 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91a5fb38-ffca-4ba2-a3dc-8340f37a789d tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:57.977784 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91a5fb38-ffca-4ba2-a3dc-8340f37a789d tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:58.611184 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d465be1c-102f-4ed9-a6a8-16b7764e1993 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1719944039", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:58.714503 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-d465be1c-102f-4ed9-a6a8-16b7764e1993 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] validate_networks() for [('2a35edaa-55e6-45d8-8dc7-3b4e4400c7ab', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:37:59.346767 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-91a5fb38-ffca-4ba2-a3dc-8340f37a789d tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:59.406056 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-91a5fb38-ffca-4ba2-a3dc-8340f37a789d tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:59.429791 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-91a5fb38-ffca-4ba2-a3dc-8340f37a789d tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:59.466566 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-91a5fb38-ffca-4ba2-a3dc-8340f37a789d tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1887 microversion: 2.32 time: 1.521123 Jul 18 02:37:59.467568 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1941/3876] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:57 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1887 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:59.499807 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5ded7481-c4c6-4c26-b5b3-4ed0fb047a7f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:59.500816 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5ded7481-c4c6-4c26-b5b3-4ed0fb047a7f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:59.532634 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ded7481-c4c6-4c26-b5b3-4ed0fb047a7f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:59.534663 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ded7481-c4c6-4c26-b5b3-4ed0fb047a7f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:59.547387 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ded7481-c4c6-4c26-b5b3-4ed0fb047a7f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:59.551240 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ded7481-c4c6-4c26-b5b3-4ed0fb047a7f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:00.511020 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5ded7481-c4c6-4c26-b5b3-4ed0fb047a7f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:00.584508 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5ded7481-c4c6-4c26-b5b3-4ed0fb047a7f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:00.591881 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5ded7481-c4c6-4c26-b5b3-4ed0fb047a7f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:00.608390 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5ded7481-c4c6-4c26-b5b3-4ed0fb047a7f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1738 microversion: 2.20 time: 1.125051 Jul 18 02:38:00.615575 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1942/3877] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:59 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1738 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:00.639211 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-de7fbf61-7d82-4f5e-b994-9d8f5921d155 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:00.644354 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-de7fbf61-7d82-4f5e-b994-9d8f5921d155 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:00.674972 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-de7fbf61-7d82-4f5e-b994-9d8f5921d155 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:00.683088 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-de7fbf61-7d82-4f5e-b994-9d8f5921d155 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:00.687829 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-de7fbf61-7d82-4f5e-b994-9d8f5921d155 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:00.688814 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-de7fbf61-7d82-4f5e-b994-9d8f5921d155 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:01.364388 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-d465be1c-102f-4ed9-a6a8-16b7764e1993 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:38:01.365715 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-d465be1c-102f-4ed9-a6a8-16b7764e1993 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:38:01.366419 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-d465be1c-102f-4ed9-a6a8-16b7764e1993 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:38:01.367003 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-d465be1c-102f-4ed9-a6a8-16b7764e1993 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:38:01.367586 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-d465be1c-102f-4ed9-a6a8-16b7764e1993 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:38:01.376299 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:01.412433 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d465be1c-102f-4ed9-a6a8-16b7764e1993 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:01.424410 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d465be1c-102f-4ed9-a6a8-16b7764e1993 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:01.425919 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d465be1c-102f-4ed9-a6a8-16b7764e1993 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:01.434073 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d465be1c-102f-4ed9-a6a8-16b7764e1993 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:01.522129 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-d465be1c-102f-4ed9-a6a8-16b7764e1993 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Getting quotas for project c127c80896564bbaa6b36fb919f22b8b. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:38:01.544074 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-d465be1c-102f-4ed9-a6a8-16b7764e1993 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Getting quotas for user ceb7f59020ba46ed99897971ebfb84c3 and project c127c80896564bbaa6b36fb919f22b8b. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:38:01.610020 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d465be1c-102f-4ed9-a6a8-16b7764e1993 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:38:01.624288 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d465be1c-102f-4ed9-a6a8-16b7764e1993 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: fdee1a08-4bd5-4b65-afc9-46c5b798ba0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:38:01.839376 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d465be1c-102f-4ed9-a6a8-16b7764e1993 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.231446 Jul 18 02:38:01.851260 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1936/3878] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:37:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 3245 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:38:01.871044 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b87142d0-1e16-4ed1-9c40-aae6a873ffd9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:01.882085 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b87142d0-1e16-4ed1-9c40-aae6a873ffd9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:01.918287 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b87142d0-1e16-4ed1-9c40-aae6a873ffd9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:01.919215 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b87142d0-1e16-4ed1-9c40-aae6a873ffd9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:01.925224 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b87142d0-1e16-4ed1-9c40-aae6a873ffd9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:01.925911 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b87142d0-1e16-4ed1-9c40-aae6a873ffd9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:02.003068 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-de7fbf61-7d82-4f5e-b994-9d8f5921d155 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:02.007666 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=100 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:02.027598 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-de7fbf61-7d82-4f5e-b994-9d8f5921d155 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:02.029184 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-de7fbf61-7d82-4f5e-b994-9d8f5921d155 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:02.050784 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-de7fbf61-7d82-4f5e-b994-9d8f5921d155 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1875 microversion: 2.32 time: 1.431479 Jul 18 02:38:02.074214 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1943/3879] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:00 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1875 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:02.106784 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-42673b63-34ac-4ee3-a7c7-b835fbe9ca0f tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:02.108060 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-42673b63-34ac-4ee3-a7c7-b835fbe9ca0f tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: fdee1a08-4bd5-4b65-afc9-46c5b798ba0d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:02.316655 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-42673b63-34ac-4ee3-a7c7-b835fbe9ca0f tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:02.328570 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-42673b63-34ac-4ee3-a7c7-b835fbe9ca0f tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d" status: 200 len: 1214 microversion: 2.1 time: 0.235499 Jul 18 02:38:02.334649 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1944/3880] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:02 2022] GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d => generated 1214 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:03.053455 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b87142d0-1e16-4ed1-9c40-aae6a873ffd9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:03.075773 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b87142d0-1e16-4ed1-9c40-aae6a873ffd9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:03.086330 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b87142d0-1e16-4ed1-9c40-aae6a873ffd9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:03.087653 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b87142d0-1e16-4ed1-9c40-aae6a873ffd9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1738 microversion: 2.20 time: 1.230454 Jul 18 02:38:03.097019 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-53b78e86-83ef-4ca5-9efb-c4ba546d300f tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:03.097635 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-53b78e86-83ef-4ca5-9efb-c4ba546d300f tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:03.110928 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1937/3881] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:01 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1738 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:03.137089 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-53b78e86-83ef-4ca5-9efb-c4ba546d300f tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:03.139108 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-53b78e86-83ef-4ca5-9efb-c4ba546d300f tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:03.145253 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-53b78e86-83ef-4ca5-9efb-c4ba546d300f tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:03.146067 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-53b78e86-83ef-4ca5-9efb-c4ba546d300f tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:03.357787 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dcfdc156-fbc1-4b33-a8c4-913b104012d2 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:03.359525 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-dcfdc156-fbc1-4b33-a8c4-913b104012d2 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: fdee1a08-4bd5-4b65-afc9-46c5b798ba0d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:03.404396 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dcfdc156-fbc1-4b33-a8c4-913b104012d2 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:03.410940 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dcfdc156-fbc1-4b33-a8c4-913b104012d2 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:03.420246 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dcfdc156-fbc1-4b33-a8c4-913b104012d2 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:03.421332 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dcfdc156-fbc1-4b33-a8c4-913b104012d2 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:03.809070 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-dcfdc156-fbc1-4b33-a8c4-913b104012d2 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:03.825082 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-dcfdc156-fbc1-4b33-a8c4-913b104012d2 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d" status: 200 len: 1218 microversion: 2.1 time: 0.475095 Jul 18 02:38:03.830547 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1938/3882] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:03 2022] GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d => generated 1218 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:38:04.130454 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6fd84326-c1bb-4cb6-9cee-e251a6b9d537 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:04.131489 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6fd84326-c1bb-4cb6-9cee-e251a6b9d537 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:04.148355 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6fd84326-c1bb-4cb6-9cee-e251a6b9d537 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:04.148726 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6fd84326-c1bb-4cb6-9cee-e251a6b9d537 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:04.155963 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6fd84326-c1bb-4cb6-9cee-e251a6b9d537 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:04.156455 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6fd84326-c1bb-4cb6-9cee-e251a6b9d537 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:04.379366 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-53b78e86-83ef-4ca5-9efb-c4ba546d300f tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:04.407157 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-53b78e86-83ef-4ca5-9efb-c4ba546d300f tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:04.417472 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-53b78e86-83ef-4ca5-9efb-c4ba546d300f tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:04.418808 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-53b78e86-83ef-4ca5-9efb-c4ba546d300f tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1875 microversion: 2.32 time: 1.326294 Jul 18 02:38:04.430341 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1945/3883] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:03 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1875 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:38:04.852587 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2f6b6232-fb78-40ca-a13a-1dd2ea689912 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:04.853099 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2f6b6232-fb78-40ca-a13a-1dd2ea689912 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: fdee1a08-4bd5-4b65-afc9-46c5b798ba0d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:04.882282 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2f6b6232-fb78-40ca-a13a-1dd2ea689912 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:04.882959 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2f6b6232-fb78-40ca-a13a-1dd2ea689912 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:04.888344 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2f6b6232-fb78-40ca-a13a-1dd2ea689912 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:04.888814 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2f6b6232-fb78-40ca-a13a-1dd2ea689912 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:05.743107 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2f6b6232-fb78-40ca-a13a-1dd2ea689912 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:05.761416 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2f6b6232-fb78-40ca-a13a-1dd2ea689912 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d" status: 200 len: 1272 microversion: 2.1 time: 0.905699 Jul 18 02:38:05.778301 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1946/3884] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:04 2022] GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d => generated 1272 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:05.785553 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-19ca5612-8233-47e9-9ee6-bbc79ab017fb tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:05.793747 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-19ca5612-8233-47e9-9ee6-bbc79ab017fb tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:05.828749 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-19ca5612-8233-47e9-9ee6-bbc79ab017fb tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:05.829213 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-19ca5612-8233-47e9-9ee6-bbc79ab017fb tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:05.830070 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-19ca5612-8233-47e9-9ee6-bbc79ab017fb tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:05.830521 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-19ca5612-8233-47e9-9ee6-bbc79ab017fb tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:06.684087 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6fd84326-c1bb-4cb6-9cee-e251a6b9d537 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:06.720263 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6fd84326-c1bb-4cb6-9cee-e251a6b9d537 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:06.721656 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6fd84326-c1bb-4cb6-9cee-e251a6b9d537 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:06.728632 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6fd84326-c1bb-4cb6-9cee-e251a6b9d537 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1738 microversion: 2.20 time: 2.602490 Jul 18 02:38:06.734759 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1939/3885] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:04 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1738 bytes in 2609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:06.781080 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e49d1677-fa8e-43b4-a458-2c686336e30c tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:06.781940 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e49d1677-fa8e-43b4-a458-2c686336e30c tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: fdee1a08-4bd5-4b65-afc9-46c5b798ba0d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:06.829111 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e49d1677-fa8e-43b4-a458-2c686336e30c tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:06.830424 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e49d1677-fa8e-43b4-a458-2c686336e30c tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:06.831699 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e49d1677-fa8e-43b4-a458-2c686336e30c tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:06.832422 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e49d1677-fa8e-43b4-a458-2c686336e30c tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:07.850955 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e49d1677-fa8e-43b4-a458-2c686336e30c tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:07.909834 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e49d1677-fa8e-43b4-a458-2c686336e30c tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d" status: 200 len: 1272 microversion: 2.1 time: 1.131992 Jul 18 02:38:07.934060 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1940/3886] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:06 2022] GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d => generated 1272 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:07.952414 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8bcb9b2e-ffea-4595-b118-bc9027205a3f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:07.953326 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8bcb9b2e-ffea-4595-b118-bc9027205a3f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: f4822dbd-f6d6-4c66-8661-69a15acf9df4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:07.986910 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8bcb9b2e-ffea-4595-b118-bc9027205a3f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:07.987402 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8bcb9b2e-ffea-4595-b118-bc9027205a3f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:07.988527 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8bcb9b2e-ffea-4595-b118-bc9027205a3f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:07.989181 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8bcb9b2e-ffea-4595-b118-bc9027205a3f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:08.076427 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8bcb9b2e-ffea-4595-b118-bc9027205a3f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: f4822dbd-f6d6-4c66-8661-69a15acf9df4] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:38:08.535457 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8bcb9b2e-ffea-4595-b118-bc9027205a3f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4" status: 204 len: 0 microversion: 2.1 time: 0.599169 Jul 18 02:38:08.536425 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1941/3887] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:38:07 2022] DELETE /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:38:08.579251 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a64013e5-d262-476a-9335-df577850acbf tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:08.579801 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a64013e5-d262-476a-9335-df577850acbf tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:08.607307 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a64013e5-d262-476a-9335-df577850acbf tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:08.607953 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a64013e5-d262-476a-9335-df577850acbf tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:08.608815 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a64013e5-d262-476a-9335-df577850acbf tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:08.609289 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a64013e5-d262-476a-9335-df577850acbf tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:09.016736 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-19ca5612-8233-47e9-9ee6-bbc79ab017fb tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:09.086698 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-19ca5612-8233-47e9-9ee6-bbc79ab017fb tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:09.102149 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-19ca5612-8233-47e9-9ee6-bbc79ab017fb tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:09.104758 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-19ca5612-8233-47e9-9ee6-bbc79ab017fb tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1875 microversion: 2.32 time: 3.324511 Jul 18 02:38:09.118092 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1947/3888] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:05 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1875 bytes in 3339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:09.131743 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f4b20e4e-029d-4140-8695-fcafe7c17eae tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:09.133081 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f4b20e4e-029d-4140-8695-fcafe7c17eae tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: f4822dbd-f6d6-4c66-8661-69a15acf9df4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:09.154585 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f4b20e4e-029d-4140-8695-fcafe7c17eae tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:09.155459 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f4b20e4e-029d-4140-8695-fcafe7c17eae tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:09.158477 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f4b20e4e-029d-4140-8695-fcafe7c17eae tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:09.160195 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f4b20e4e-029d-4140-8695-fcafe7c17eae tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:09.458398 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a64013e5-d262-476a-9335-df577850acbf tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:09.488946 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a64013e5-d262-476a-9335-df577850acbf tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:09.496595 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a64013e5-d262-476a-9335-df577850acbf tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:09.502896 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a64013e5-d262-476a-9335-df577850acbf tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1738 microversion: 2.20 time: 0.960969 Jul 18 02:38:09.503839 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1942/3889] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:08 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1738 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:09.521553 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0a5a946d-07db-4662-9c26-99304289e272 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:09.532539 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0a5a946d-07db-4662-9c26-99304289e272 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: fdee1a08-4bd5-4b65-afc9-46c5b798ba0d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:09.569408 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0a5a946d-07db-4662-9c26-99304289e272 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:09.569733 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0a5a946d-07db-4662-9c26-99304289e272 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:09.570594 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0a5a946d-07db-4662-9c26-99304289e272 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:09.571314 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0a5a946d-07db-4662-9c26-99304289e272 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:09.926774 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0a5a946d-07db-4662-9c26-99304289e272 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:09.953760 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0a5a946d-07db-4662-9c26-99304289e272 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d" status: 200 len: 1272 microversion: 2.1 time: 0.443733 Jul 18 02:38:09.972093 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1943/3890] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:09 2022] GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d => generated 1272 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:10.131513 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4149f0ae-48fc-4677-b7bf-42d265eca036 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:10.132614 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4149f0ae-48fc-4677-b7bf-42d265eca036 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:10.171257 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4149f0ae-48fc-4677-b7bf-42d265eca036 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:10.172372 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4149f0ae-48fc-4677-b7bf-42d265eca036 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:10.173943 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4149f0ae-48fc-4677-b7bf-42d265eca036 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:10.174774 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4149f0ae-48fc-4677-b7bf-42d265eca036 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:10.265601 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f4b20e4e-029d-4140-8695-fcafe7c17eae tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:10.304171 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f4b20e4e-029d-4140-8695-fcafe7c17eae tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4" status: 200 len: 1508 microversion: 2.1 time: 1.176090 Jul 18 02:38:10.311803 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1948/3891] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:09 2022] GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4 => generated 1508 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:10.526465 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2ecbd774-10c8-48ae-9de1-c7cc2e4fb538 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:10.528479 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2ecbd774-10c8-48ae-9de1-c7cc2e4fb538 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:10.597675 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ecbd774-10c8-48ae-9de1-c7cc2e4fb538 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:10.598535 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ecbd774-10c8-48ae-9de1-c7cc2e4fb538 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:10.599996 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ecbd774-10c8-48ae-9de1-c7cc2e4fb538 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:10.623430 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ecbd774-10c8-48ae-9de1-c7cc2e4fb538 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:11.206333 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4149f0ae-48fc-4677-b7bf-42d265eca036 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:11.240095 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4149f0ae-48fc-4677-b7bf-42d265eca036 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:11.243665 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4149f0ae-48fc-4677-b7bf-42d265eca036 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:11.249642 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4149f0ae-48fc-4677-b7bf-42d265eca036 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1875 microversion: 2.32 time: 1.123302 Jul 18 02:38:11.250692 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1944/3892] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:10 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1875 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:11.264538 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-455244d8-8a93-4ea4-95b1-37e16d0dabef tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:11.265487 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-455244d8-8a93-4ea4-95b1-37e16d0dabef tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: fdee1a08-4bd5-4b65-afc9-46c5b798ba0d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:11.279813 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-455244d8-8a93-4ea4-95b1-37e16d0dabef tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:11.282396 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-455244d8-8a93-4ea4-95b1-37e16d0dabef tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:11.283434 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-455244d8-8a93-4ea4-95b1-37e16d0dabef tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:11.298463 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-455244d8-8a93-4ea4-95b1-37e16d0dabef tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:11.479927 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:11.582755 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:12.325367 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:12.335394 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2ecbd774-10c8-48ae-9de1-c7cc2e4fb538 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:12.397055 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2ecbd774-10c8-48ae-9de1-c7cc2e4fb538 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:12.399090 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2ecbd774-10c8-48ae-9de1-c7cc2e4fb538 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:12.400324 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2ecbd774-10c8-48ae-9de1-c7cc2e4fb538 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1738 microversion: 2.20 time: 1.882059 Jul 18 02:38:12.401528 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1949/3893] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:10 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1738 bytes in 1884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:12.460242 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7fb37e26-eb84-48ee-aa9d-70ea3dbe989e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:12.467227 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7fb37e26-eb84-48ee-aa9d-70ea3dbe989e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: f4822dbd-f6d6-4c66-8661-69a15acf9df4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:12.489523 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7fb37e26-eb84-48ee-aa9d-70ea3dbe989e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:12.511160 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7fb37e26-eb84-48ee-aa9d-70ea3dbe989e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:12.512148 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7fb37e26-eb84-48ee-aa9d-70ea3dbe989e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:12.512628 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7fb37e26-eb84-48ee-aa9d-70ea3dbe989e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:13.742522 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-455244d8-8a93-4ea4-95b1-37e16d0dabef tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:13.756180 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-455244d8-8a93-4ea4-95b1-37e16d0dabef tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d" status: 200 len: 1272 microversion: 2.1 time: 2.504063 Jul 18 02:38:13.756898 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1945/3894] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:11 2022] GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d => generated 1272 bytes in 2505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:13.768568 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7fb37e26-eb84-48ee-aa9d-70ea3dbe989e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:13.778093 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7fb37e26-eb84-48ee-aa9d-70ea3dbe989e tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4" status: 200 len: 1293 microversion: 2.1 time: 1.343030 Jul 18 02:38:13.780204 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1950/3895] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:12 2022] GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4 => generated 1293 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:13.788566 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d35ae3ec-e574-4562-823b-4efba335144b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:13.800746 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-0cc36684-1161-4781-8ad4-172be165a0f0 req-aa7f645b-6711-44c5-9f4a-ec6d3c684329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4822dbd-f6d6-4c66-8661-69a15acf9df4", "name": "network-vif-deleted", "tag": "ea9b8a5b-73f4-4379-b880-4c9fd9e3877f"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:13.802708 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d35ae3ec-e574-4562-823b-4efba335144b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:13.846684 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d35ae3ec-e574-4562-823b-4efba335144b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:13.850340 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d35ae3ec-e574-4562-823b-4efba335144b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:13.856355 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d35ae3ec-e574-4562-823b-4efba335144b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:13.860433 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d35ae3ec-e574-4562-823b-4efba335144b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:13.875629 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-0cc36684-1161-4781-8ad4-172be165a0f0 req-aa7f645b-6711-44c5-9f4a-ec6d3c684329 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:13.878392 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-0cc36684-1161-4781-8ad4-172be165a0f0 req-aa7f645b-6711-44c5-9f4a-ec6d3c684329 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:13.922362 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-0cc36684-1161-4781-8ad4-172be165a0f0 req-aa7f645b-6711-44c5-9f4a-ec6d3c684329 service nova] Creating event network-vif-deleted:ea9b8a5b-73f4-4379-b880-4c9fd9e3877f for instance f4822dbd-f6d6-4c66-8661-69a15acf9df4 on n-h1-465891-3 Jul 18 02:38:13.951821 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-0cc36684-1161-4781-8ad4-172be165a0f0 req-aa7f645b-6711-44c5-9f4a-ec6d3c684329 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167185 Jul 18 02:38:13.952462 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1951/3896] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:38:13.961223 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0ee33eeb-ccf4-40cb-987f-de07955918e5 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:13.962597 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0ee33eeb-ccf4-40cb-987f-de07955918e5 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:14.000849 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0ee33eeb-ccf4-40cb-987f-de07955918e5 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:14.001552 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0ee33eeb-ccf4-40cb-987f-de07955918e5 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:14.002750 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0ee33eeb-ccf4-40cb-987f-de07955918e5 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:14.003375 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0ee33eeb-ccf4-40cb-987f-de07955918e5 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:15.256545 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d35ae3ec-e574-4562-823b-4efba335144b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:15.272704 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d35ae3ec-e574-4562-823b-4efba335144b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:15.287440 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d35ae3ec-e574-4562-823b-4efba335144b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:15.290051 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d35ae3ec-e574-4562-823b-4efba335144b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1875 microversion: 2.32 time: 1.510870 Jul 18 02:38:15.294500 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1946/3897] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:13 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1875 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:15.311914 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4cf363df-b653-45d1-951e-0a92496cec99 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:15.314276 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4cf363df-b653-45d1-951e-0a92496cec99 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: fdee1a08-4bd5-4b65-afc9-46c5b798ba0d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:15.343720 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4cf363df-b653-45d1-951e-0a92496cec99 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:15.349598 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0ee33eeb-ccf4-40cb-987f-de07955918e5 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:15.358355 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4cf363df-b653-45d1-951e-0a92496cec99 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:15.362977 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0ee33eeb-ccf4-40cb-987f-de07955918e5 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:15.365156 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4cf363df-b653-45d1-951e-0a92496cec99 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:15.370513 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4cf363df-b653-45d1-951e-0a92496cec99 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:15.376739 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0ee33eeb-ccf4-40cb-987f-de07955918e5 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:15.386874 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0ee33eeb-ccf4-40cb-987f-de07955918e5 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1738 microversion: 2.20 time: 1.430229 Jul 18 02:38:15.396316 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1952/3898] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:13 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1738 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:15.410985 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a614ccd0-471b-4f57-ab8a-980dd508e193 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:15.414577 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a614ccd0-471b-4f57-ab8a-980dd508e193 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: f4822dbd-f6d6-4c66-8661-69a15acf9df4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:15.436975 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a614ccd0-471b-4f57-ab8a-980dd508e193 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:15.442052 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a614ccd0-471b-4f57-ab8a-980dd508e193 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:15.450515 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a614ccd0-471b-4f57-ab8a-980dd508e193 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:15.454496 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a614ccd0-471b-4f57-ab8a-980dd508e193 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:15.507621 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-a614ccd0-471b-4f57-ab8a-980dd508e193 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] HTTP exception thrown: Instance f4822dbd-f6d6-4c66-8661-69a15acf9df4 could not be found. Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a614ccd0-471b-4f57-ab8a-980dd508e193 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Request method failure captured: Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4 HTTP/1.1 Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MYgsMpQMGg_x4SatJimijJMXDATUd7K8pbmJMir06_hhN9kc6nEv2UNuBHWPOsjhgniijNTcv86Pv1g5if6jfxnXnFgylGVtP-ES0p4q8KsL3cpv9H2D_niEdkyIvqxweiHovqWE9ZMi6DufO28-UhMwnDHb097CRDIZ6xtrA6LrKI Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 1594a06c4e7c4bb7b184d916342933ba Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1345973443 Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1594a06c4e7c4bb7b184d916342933ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1594a06c4e7c4bb7b184d916342933ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1594a06c4e7c4bb7b184d916342933ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1594a06c4e7c4bb7b184d916342933ba"}]}] Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1345973443 Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 1594a06c4e7c4bb7b184d916342933ba Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1345973443 Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServerRescueNegativeTestJSON-1345973443-project Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 6f30a2016d954121bb251894fad6dd39 Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1345973443-project Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance f4822dbd-f6d6-4c66-8661-69a15acf9df4 could not be found. Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'f4822dbd-f6d6-4c66-8661-69a15acf9df4'} Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4822dbd-f6d6-4c66-8661-69a15acf9df4 could not be found. Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4822dbd-f6d6-4c66-8661-69a15acf9df4 could not be found. Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:38:15.515633 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:38:15.520190 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:38:15.520190 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:38:15.520190 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:38:15.520190 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:38:15.520190 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:38:15.520190 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:38:15.520190 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4822dbd-f6d6-4c66-8661-69a15acf9df4 could not be found. Jul 18 02:38:15.520190 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:38:15.534746 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a614ccd0-471b-4f57-ab8a-980dd508e193 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Returning 404 to user: Instance f4822dbd-f6d6-4c66-8661-69a15acf9df4 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:38:15.535933 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a614ccd0-471b-4f57-ab8a-980dd508e193 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4" status: 404 len: 111 microversion: 2.1 time: 0.138123 Jul 18 02:38:15.536913 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1953/3899] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:15 2022] GET /compute/v2.1/servers/f4822dbd-f6d6-4c66-8661-69a15acf9df4 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:38:15.551401 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f6c9b35d-8a81-44da-ab43-ddaa2be922a1 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:15.554441 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f6c9b35d-8a81-44da-ab43-ddaa2be922a1 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: 02425120-f4dc-4f02-99c5-9bf0fe7e1931] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:15.593736 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f6c9b35d-8a81-44da-ab43-ddaa2be922a1 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:15.602485 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f6c9b35d-8a81-44da-ab43-ddaa2be922a1 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:15.607418 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f6c9b35d-8a81-44da-ab43-ddaa2be922a1 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:15.608601 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f6c9b35d-8a81-44da-ab43-ddaa2be922a1 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:15.691236 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f6c9b35d-8a81-44da-ab43-ddaa2be922a1 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: 02425120-f4dc-4f02-99c5-9bf0fe7e1931] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:38:15.994115 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f6c9b35d-8a81-44da-ab43-ddaa2be922a1 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "DELETE /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931" status: 204 len: 0 microversion: 2.1 time: 0.442022 Jul 18 02:38:15.996054 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1954/3900] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:38:15 2022] DELETE /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:38:16.025534 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c950d733-5ce5-47f7-954f-fe903dac2d20 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:16.037404 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c950d733-5ce5-47f7-954f-fe903dac2d20 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: 02425120-f4dc-4f02-99c5-9bf0fe7e1931] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:16.067631 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c950d733-5ce5-47f7-954f-fe903dac2d20 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:16.074821 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c950d733-5ce5-47f7-954f-fe903dac2d20 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:16.077369 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c950d733-5ce5-47f7-954f-fe903dac2d20 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:16.086824 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c950d733-5ce5-47f7-954f-fe903dac2d20 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:16.216269 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4cf363df-b653-45d1-951e-0a92496cec99 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:16.229892 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4cf363df-b653-45d1-951e-0a92496cec99 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d" status: 200 len: 1314 microversion: 2.1 time: 0.929394 Jul 18 02:38:16.238346 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1947/3901] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:15 2022] GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d => generated 1314 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:16.316180 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8c894ca1-d3f9-4a44-b1a7-1653d7d84167 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:16.317239 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8c894ca1-d3f9-4a44-b1a7-1653d7d84167 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:16.331839 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8c894ca1-d3f9-4a44-b1a7-1653d7d84167 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:16.332305 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8c894ca1-d3f9-4a44-b1a7-1653d7d84167 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:16.333118 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8c894ca1-d3f9-4a44-b1a7-1653d7d84167 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:16.333569 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8c894ca1-d3f9-4a44-b1a7-1653d7d84167 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:17.389145 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c950d733-5ce5-47f7-954f-fe903dac2d20 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:17.473008 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c950d733-5ce5-47f7-954f-fe903dac2d20 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931" status: 200 len: 1522 microversion: 2.1 time: 1.469095 Jul 18 02:38:17.481828 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1955/3902] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:15 2022] GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931 => generated 1522 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:17.511857 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9589b933-67e1-4923-995c-68c75a86a38e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:17.520420 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9589b933-67e1-4923-995c-68c75a86a38e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:17.614288 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9589b933-67e1-4923-995c-68c75a86a38e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:17.616578 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9589b933-67e1-4923-995c-68c75a86a38e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:17.628162 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9589b933-67e1-4923-995c-68c75a86a38e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:17.629887 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9589b933-67e1-4923-995c-68c75a86a38e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:17.851034 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8c894ca1-d3f9-4a44-b1a7-1653d7d84167 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:17.932594 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8c894ca1-d3f9-4a44-b1a7-1653d7d84167 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:17.942751 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8c894ca1-d3f9-4a44-b1a7-1653d7d84167 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:17.973597 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8c894ca1-d3f9-4a44-b1a7-1653d7d84167 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1875 microversion: 2.32 time: 1.658650 Jul 18 02:38:17.978258 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1948/3903] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:16 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1875 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:18.004590 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-76d4105e-0423-4ce3-8226-9b23d72fb8a1 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:18.009398 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-76d4105e-0423-4ce3-8226-9b23d72fb8a1 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: fdee1a08-4bd5-4b65-afc9-46c5b798ba0d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:18.070271 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-76d4105e-0423-4ce3-8226-9b23d72fb8a1 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:18.074672 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-76d4105e-0423-4ce3-8226-9b23d72fb8a1 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:18.079096 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-76d4105e-0423-4ce3-8226-9b23d72fb8a1 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:18.089320 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9589b933-67e1-4923-995c-68c75a86a38e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:18.107261 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-76d4105e-0423-4ce3-8226-9b23d72fb8a1 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:18.114887 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9589b933-67e1-4923-995c-68c75a86a38e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:18.127949 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9589b933-67e1-4923-995c-68c75a86a38e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:18.138253 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9589b933-67e1-4923-995c-68c75a86a38e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1738 microversion: 2.20 time: 0.654665 Jul 18 02:38:18.150411 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1956/3904] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:17 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1738 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:18.502216 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-978469b6-a4ef-4fff-bbdc-ea5f94222447 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:18.503607 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-978469b6-a4ef-4fff-bbdc-ea5f94222447 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: 02425120-f4dc-4f02-99c5-9bf0fe7e1931] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:18.523683 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-978469b6-a4ef-4fff-bbdc-ea5f94222447 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:18.524151 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-978469b6-a4ef-4fff-bbdc-ea5f94222447 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:18.525228 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-978469b6-a4ef-4fff-bbdc-ea5f94222447 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:18.531398 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-978469b6-a4ef-4fff-bbdc-ea5f94222447 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:18.569494 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-76d4105e-0423-4ce3-8226-9b23d72fb8a1 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:18.576472 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:18.588650 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-76d4105e-0423-4ce3-8226-9b23d72fb8a1 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d" status: 200 len: 1314 microversion: 2.1 time: 0.606043 Jul 18 02:38:18.593957 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1949/3905] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:17 2022] GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d => generated 1314 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:19.008987 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-92e762bc-a58f-4e93-b6c6-f879be319104 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:19.010118 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-92e762bc-a58f-4e93-b6c6-f879be319104 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:19.037312 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-92e762bc-a58f-4e93-b6c6-f879be319104 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:19.041068 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-92e762bc-a58f-4e93-b6c6-f879be319104 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:19.052776 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-92e762bc-a58f-4e93-b6c6-f879be319104 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:19.053995 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-92e762bc-a58f-4e93-b6c6-f879be319104 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:19.403841 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-978469b6-a4ef-4fff-bbdc-ea5f94222447 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:19.418884 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-978469b6-a4ef-4fff-bbdc-ea5f94222447 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931" status: 200 len: 1522 microversion: 2.1 time: 0.920566 Jul 18 02:38:19.419898 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1957/3906] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:18 2022] GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931 => generated 1522 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:38:19.424949 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a8c729f4-0e3d-4971-83f2-f089eec5ba43 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:19.425566 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a8c729f4-0e3d-4971-83f2-f089eec5ba43 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:19.464659 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a8c729f4-0e3d-4971-83f2-f089eec5ba43 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:19.465082 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a8c729f4-0e3d-4971-83f2-f089eec5ba43 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:19.466244 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a8c729f4-0e3d-4971-83f2-f089eec5ba43 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:19.466868 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a8c729f4-0e3d-4971-83f2-f089eec5ba43 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:20.528073 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-92e762bc-a58f-4e93-b6c6-f879be319104 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:20.596642 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-92e762bc-a58f-4e93-b6c6-f879be319104 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:20.599651 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-92e762bc-a58f-4e93-b6c6-f879be319104 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:20.602185 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-92e762bc-a58f-4e93-b6c6-f879be319104 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1875 microversion: 2.32 time: 1.597279 Jul 18 02:38:20.630794 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1950/3907] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:19 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1875 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:20.644039 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-aaf40b34-28b5-4865-b196-cd21a4d6d3eb req-ac5181c8-c86b-42c5-8200-f7c0c4f747db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdee1a08-4bd5-4b65-afc9-46c5b798ba0d", "tag": "6fb4b926-d001-4d15-8053-9c058c41f98e"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:20.678947 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-aaf40b34-28b5-4865-b196-cd21a4d6d3eb req-ac5181c8-c86b-42c5-8200-f7c0c4f747db service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:20.680158 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-aaf40b34-28b5-4865-b196-cd21a4d6d3eb req-ac5181c8-c86b-42c5-8200-f7c0c4f747db service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:20.709379 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-aaf40b34-28b5-4865-b196-cd21a4d6d3eb req-ac5181c8-c86b-42c5-8200-f7c0c4f747db service nova] Creating event network-changed:6fb4b926-d001-4d15-8053-9c058c41f98e for instance fdee1a08-4bd5-4b65-afc9-46c5b798ba0d on n-h2-465891-3 Jul 18 02:38:20.785593 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-aaf40b34-28b5-4865-b196-cd21a4d6d3eb req-ac5181c8-c86b-42c5-8200-f7c0c4f747db service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134243 Jul 18 02:38:20.790436 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1951/3908] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:38:20.816599 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e749c88a-5a3f-4b26-8b11-7de6e197cc92 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:20.817652 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e749c88a-5a3f-4b26-8b11-7de6e197cc92 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: fdee1a08-4bd5-4b65-afc9-46c5b798ba0d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:20.839839 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e749c88a-5a3f-4b26-8b11-7de6e197cc92 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:20.840346 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e749c88a-5a3f-4b26-8b11-7de6e197cc92 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:20.841597 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e749c88a-5a3f-4b26-8b11-7de6e197cc92 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:20.842270 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e749c88a-5a3f-4b26-8b11-7de6e197cc92 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:20.889193 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a8c729f4-0e3d-4971-83f2-f089eec5ba43 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:20.930249 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a8c729f4-0e3d-4971-83f2-f089eec5ba43 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:20.935574 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a8c729f4-0e3d-4971-83f2-f089eec5ba43 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:20.943241 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a8c729f4-0e3d-4971-83f2-f089eec5ba43 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1738 microversion: 2.20 time: 1.522197 Jul 18 02:38:20.949114 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1958/3909] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:19 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1738 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:20.970596 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ac5d4107-282d-4286-a8ac-d16acb1e4a18 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:20.971775 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ac5d4107-282d-4286-a8ac-d16acb1e4a18 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: 02425120-f4dc-4f02-99c5-9bf0fe7e1931] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:20.994446 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ac5d4107-282d-4286-a8ac-d16acb1e4a18 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:20.995077 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ac5d4107-282d-4286-a8ac-d16acb1e4a18 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:20.996299 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ac5d4107-282d-4286-a8ac-d16acb1e4a18 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:20.996951 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ac5d4107-282d-4286-a8ac-d16acb1e4a18 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:22.152345 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e749c88a-5a3f-4b26-8b11-7de6e197cc92 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:22.185497 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e749c88a-5a3f-4b26-8b11-7de6e197cc92 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d" status: 200 len: 1314 microversion: 2.1 time: 1.389221 Jul 18 02:38:22.188322 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1952/3910] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:20 2022] GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d => generated 1314 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:22.216393 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4ed5ec37-5828-42c1-ace8-e9ff0efd36b6 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:22.222207 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4ed5ec37-5828-42c1-ace8-e9ff0efd36b6 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:22.249219 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4ed5ec37-5828-42c1-ace8-e9ff0efd36b6 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:22.252950 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4ed5ec37-5828-42c1-ace8-e9ff0efd36b6 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:22.257232 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4ed5ec37-5828-42c1-ace8-e9ff0efd36b6 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:22.269185 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4ed5ec37-5828-42c1-ace8-e9ff0efd36b6 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:22.524059 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ac5d4107-282d-4286-a8ac-d16acb1e4a18 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:22.597801 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ac5d4107-282d-4286-a8ac-d16acb1e4a18 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931" status: 200 len: 1522 microversion: 2.1 time: 1.623743 Jul 18 02:38:22.618337 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1959/3911] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:20 2022] GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931 => generated 1522 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:22.630270 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8089ad09-e604-4634-98a7-3bc82bb2632b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:22.633581 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8089ad09-e604-4634-98a7-3bc82bb2632b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:22.654659 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:22.658681 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8089ad09-e604-4634-98a7-3bc82bb2632b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:22.663317 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8089ad09-e604-4634-98a7-3bc82bb2632b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:22.664518 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8089ad09-e604-4634-98a7-3bc82bb2632b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:22.668412 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8089ad09-e604-4634-98a7-3bc82bb2632b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:24.254293 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8089ad09-e604-4634-98a7-3bc82bb2632b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:24.324481 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8089ad09-e604-4634-98a7-3bc82bb2632b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:24.328040 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8089ad09-e604-4634-98a7-3bc82bb2632b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:24.340029 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8089ad09-e604-4634-98a7-3bc82bb2632b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1738 microversion: 2.20 time: 1.709805 Jul 18 02:38:24.344689 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1960/3912] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:22 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1738 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:24.390258 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e255eae0-909c-4960-8c87-dbd9871352af tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:24.391960 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e255eae0-909c-4960-8c87-dbd9871352af tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: fdee1a08-4bd5-4b65-afc9-46c5b798ba0d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:24.422315 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e255eae0-909c-4960-8c87-dbd9871352af tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:24.423190 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e255eae0-909c-4960-8c87-dbd9871352af tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:24.424647 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e255eae0-909c-4960-8c87-dbd9871352af tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:24.425418 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e255eae0-909c-4960-8c87-dbd9871352af tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:24.446179 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:24.453278 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4ed5ec37-5828-42c1-ace8-e9ff0efd36b6 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:24.491850 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4ed5ec37-5828-42c1-ace8-e9ff0efd36b6 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:24.500699 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4ed5ec37-5828-42c1-ace8-e9ff0efd36b6 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:24.502985 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4ed5ec37-5828-42c1-ace8-e9ff0efd36b6 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1875 microversion: 2.32 time: 2.309092 Jul 18 02:38:24.512858 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1953/3913] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:22 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1875 bytes in 2323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:24.530835 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-79caf970-da3e-4897-a059-ff175de73c6f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:24.548577 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-79caf970-da3e-4897-a059-ff175de73c6f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: 02425120-f4dc-4f02-99c5-9bf0fe7e1931] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:24.582098 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-79caf970-da3e-4897-a059-ff175de73c6f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:24.582911 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-79caf970-da3e-4897-a059-ff175de73c6f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:24.584386 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-79caf970-da3e-4897-a059-ff175de73c6f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:24.585202 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-79caf970-da3e-4897-a059-ff175de73c6f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:25.284473 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-79caf970-da3e-4897-a059-ff175de73c6f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:25.346873 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-79caf970-da3e-4897-a059-ff175de73c6f tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931" status: 200 len: 1522 microversion: 2.1 time: 0.824024 Jul 18 02:38:25.351491 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1954/3914] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:24 2022] GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931 => generated 1522 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:25.398215 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1565a57a-7cd9-46ec-bb4b-f140bfc03b42 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:25.399418 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1565a57a-7cd9-46ec-bb4b-f140bfc03b42 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:25.413766 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e255eae0-909c-4960-8c87-dbd9871352af tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:25.424290 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e255eae0-909c-4960-8c87-dbd9871352af tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d" status: 200 len: 1314 microversion: 2.1 time: 1.060107 Jul 18 02:38:25.435043 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1961/3915] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:24 2022] GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d => generated 1314 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:25.451778 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1565a57a-7cd9-46ec-bb4b-f140bfc03b42 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:25.457857 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1565a57a-7cd9-46ec-bb4b-f140bfc03b42 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:25.461381 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1565a57a-7cd9-46ec-bb4b-f140bfc03b42 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:25.467500 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1565a57a-7cd9-46ec-bb4b-f140bfc03b42 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:25.540970 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b50572e5-81f5-49ca-97c7-066e3b46a80b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:25.542693 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b50572e5-81f5-49ca-97c7-066e3b46a80b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:25.587817 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b50572e5-81f5-49ca-97c7-066e3b46a80b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:25.595805 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b50572e5-81f5-49ca-97c7-066e3b46a80b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:25.600123 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b50572e5-81f5-49ca-97c7-066e3b46a80b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:25.607047 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b50572e5-81f5-49ca-97c7-066e3b46a80b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:27.864930 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b50572e5-81f5-49ca-97c7-066e3b46a80b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:27.945618 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b50572e5-81f5-49ca-97c7-066e3b46a80b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:27.978053 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b50572e5-81f5-49ca-97c7-066e3b46a80b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:27.988256 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b50572e5-81f5-49ca-97c7-066e3b46a80b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1875 microversion: 2.32 time: 2.460328 Jul 18 02:38:28.001157 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1962/3916] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:25 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1875 bytes in 2475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:28.043657 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-06ce606a-540c-4772-a3e7-469da2a62e84 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:28.048778 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-06ce606a-540c-4772-a3e7-469da2a62e84 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: 02425120-f4dc-4f02-99c5-9bf0fe7e1931] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:28.086132 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-06ce606a-540c-4772-a3e7-469da2a62e84 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:28.096654 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-06ce606a-540c-4772-a3e7-469da2a62e84 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:28.100339 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-06ce606a-540c-4772-a3e7-469da2a62e84 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:28.101582 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-06ce606a-540c-4772-a3e7-469da2a62e84 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:28.252854 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-06ce606a-540c-4772-a3e7-469da2a62e84 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:28.258058 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-06ce606a-540c-4772-a3e7-469da2a62e84 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:28.259722 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-06ce606a-540c-4772-a3e7-469da2a62e84 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lazy-loading 'fault' on Instance uuid 02425120-f4dc-4f02-99c5-9bf0fe7e1931 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:38:28.473127 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1565a57a-7cd9-46ec-bb4b-f140bfc03b42 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:28.494904 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1565a57a-7cd9-46ec-bb4b-f140bfc03b42 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:28.500009 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1565a57a-7cd9-46ec-bb4b-f140bfc03b42 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:28.506270 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1565a57a-7cd9-46ec-bb4b-f140bfc03b42 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1738 microversion: 2.20 time: 3.131328 Jul 18 02:38:28.518456 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1955/3917] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:25 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1738 bytes in 3145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:28.545881 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-98116ed4-7e75-42fc-a43f-6b6e7bb9cd7c tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:28.550965 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-98116ed4-7e75-42fc-a43f-6b6e7bb9cd7c tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: fdee1a08-4bd5-4b65-afc9-46c5b798ba0d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:28.564398 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-06ce606a-540c-4772-a3e7-469da2a62e84 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f30a2016d954121bb251894fad6dd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1594a06c4e7c4bb7b184d916342933ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:28.574439 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-06ce606a-540c-4772-a3e7-469da2a62e84 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931" status: 200 len: 1311 microversion: 2.1 time: 0.571283 Jul 18 02:38:28.576687 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-98116ed4-7e75-42fc-a43f-6b6e7bb9cd7c tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:28.577490 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-98116ed4-7e75-42fc-a43f-6b6e7bb9cd7c tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:28.579204 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-98116ed4-7e75-42fc-a43f-6b6e7bb9cd7c tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:28.579734 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1963/3918] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:28 2022] GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931 => generated 1311 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:28.581143 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-98116ed4-7e75-42fc-a43f-6b6e7bb9cd7c tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:28.587526 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-37978670-0585-4759-a2a5-3de4b2f67a86 req-9a6fc81c-bd15-48ff-90e5-2e7b6529b83f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02425120-f4dc-4f02-99c5-9bf0fe7e1931", "name": "network-vif-deleted", "tag": "0cb635f0-d31b-4491-a882-a1e3c6656f22"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:28.613653 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-37978670-0585-4759-a2a5-3de4b2f67a86 req-9a6fc81c-bd15-48ff-90e5-2e7b6529b83f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:28.618269 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-37978670-0585-4759-a2a5-3de4b2f67a86 req-9a6fc81c-bd15-48ff-90e5-2e7b6529b83f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:28.649427 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-37978670-0585-4759-a2a5-3de4b2f67a86 req-9a6fc81c-bd15-48ff-90e5-2e7b6529b83f service nova] Creating event network-vif-deleted:0cb635f0-d31b-4491-a882-a1e3c6656f22 for instance 02425120-f4dc-4f02-99c5-9bf0fe7e1931 on n-h1-465891-3 Jul 18 02:38:28.660495 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-37978670-0585-4759-a2a5-3de4b2f67a86 req-9a6fc81c-bd15-48ff-90e5-2e7b6529b83f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079394 Jul 18 02:38:28.668342 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1964/3919] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:38:29.046446 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-79322f16-cd29-4d79-be07-c50e06897487 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:29.046446 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-79322f16-cd29-4d79-be07-c50e06897487 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:29.053110 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-79322f16-cd29-4d79-be07-c50e06897487 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:29.053584 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-79322f16-cd29-4d79-be07-c50e06897487 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:29.060888 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-79322f16-cd29-4d79-be07-c50e06897487 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:29.061331 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-79322f16-cd29-4d79-be07-c50e06897487 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:30.144299 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-98116ed4-7e75-42fc-a43f-6b6e7bb9cd7c tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:30.235793 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-98116ed4-7e75-42fc-a43f-6b6e7bb9cd7c tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d" status: 200 len: 1314 microversion: 2.1 time: 1.715725 Jul 18 02:38:30.238757 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1956/3920] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:28 2022] GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d => generated 1314 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:30.253677 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a26cdb76-a1df-4526-9ce3-a256f39ec025 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:30.254939 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a26cdb76-a1df-4526-9ce3-a256f39ec025 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:30.281127 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a26cdb76-a1df-4526-9ce3-a256f39ec025 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:30.282956 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a26cdb76-a1df-4526-9ce3-a256f39ec025 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:30.284109 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a26cdb76-a1df-4526-9ce3-a256f39ec025 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:30.286563 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a26cdb76-a1df-4526-9ce3-a256f39ec025 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:30.746719 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-79322f16-cd29-4d79-be07-c50e06897487 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:30.802998 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-79322f16-cd29-4d79-be07-c50e06897487 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:30.822256 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-79322f16-cd29-4d79-be07-c50e06897487 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:30.836724 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-79322f16-cd29-4d79-be07-c50e06897487 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1875 microversion: 2.32 time: 1.801564 Jul 18 02:38:30.840037 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1965/3921] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:29 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1875 bytes in 1810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:38:30.863969 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ca1866a9-708d-4661-ba4b-a22d33cbe682 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:30.871518 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ca1866a9-708d-4661-ba4b-a22d33cbe682 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] [instance: 02425120-f4dc-4f02-99c5-9bf0fe7e1931] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:30.919655 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ca1866a9-708d-4661-ba4b-a22d33cbe682 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:30.921529 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ca1866a9-708d-4661-ba4b-a22d33cbe682 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:30.927998 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ca1866a9-708d-4661-ba4b-a22d33cbe682 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:30.928560 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ca1866a9-708d-4661-ba4b-a22d33cbe682 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:30.995372 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-ca1866a9-708d-4661-ba4b-a22d33cbe682 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] HTTP exception thrown: Instance 02425120-f4dc-4f02-99c5-9bf0fe7e1931 could not be found. Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ca1866a9-708d-4661-ba4b-a22d33cbe682 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Request method failure captured: Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931 HTTP/1.1 Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MYgsMpQMGg_x4SatJimijJMXDATUd7K8pbmJMir06_hhN9kc6nEv2UNuBHWPOsjhgniijNTcv86Pv1g5if6jfxnXnFgylGVtP-ES0p4q8KsL3cpv9H2D_niEdkyIvqxweiHovqWE9ZMi6DufO28-UhMwnDHb097CRDIZ6xtrA6LrKI Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 1594a06c4e7c4bb7b184d916342933ba Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1345973443 Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1594a06c4e7c4bb7b184d916342933ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1594a06c4e7c4bb7b184d916342933ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1594a06c4e7c4bb7b184d916342933ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1594a06c4e7c4bb7b184d916342933ba"}]}] Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1345973443 Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 1594a06c4e7c4bb7b184d916342933ba Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1345973443 Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServerRescueNegativeTestJSON-1345973443-project Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 6f30a2016d954121bb251894fad6dd39 Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1345973443-project Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 02425120-f4dc-4f02-99c5-9bf0fe7e1931 could not be found. Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '02425120-f4dc-4f02-99c5-9bf0fe7e1931'} Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02425120-f4dc-4f02-99c5-9bf0fe7e1931 could not be found. Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02425120-f4dc-4f02-99c5-9bf0fe7e1931 could not be found. Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:38:31.009013 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:38:31.024444 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:38:31.024444 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:38:31.024444 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:38:31.024444 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:38:31.024444 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:38:31.024444 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:38:31.024444 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02425120-f4dc-4f02-99c5-9bf0fe7e1931 could not be found. Jul 18 02:38:31.024444 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:38:31.024444 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ca1866a9-708d-4661-ba4b-a22d33cbe682 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] Returning 404 to user: Instance 02425120-f4dc-4f02-99c5-9bf0fe7e1931 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:38:31.024444 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ca1866a9-708d-4661-ba4b-a22d33cbe682 tempest-ServerRescueNegativeTestJSON-1345973443 tempest-ServerRescueNegativeTestJSON-1345973443-project] 10.222.0.57 "GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931" status: 404 len: 111 microversion: 2.1 time: 0.168936 Jul 18 02:38:31.024444 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1966/3922] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:30 2022] GET /compute/v2.1/servers/02425120-f4dc-4f02-99c5-9bf0fe7e1931 => generated 111 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:38:31.202618 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a26cdb76-a1df-4526-9ce3-a256f39ec025 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:31.202618 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a26cdb76-a1df-4526-9ce3-a256f39ec025 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:31.211028 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a26cdb76-a1df-4526-9ce3-a256f39ec025 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:31.213235 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a26cdb76-a1df-4526-9ce3-a256f39ec025 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1738 microversion: 2.20 time: 0.972824 Jul 18 02:38:31.233188 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1957/3923] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:30 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1738 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:31.267852 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-52a43038-8b28-436a-8544-aff705768a4a tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:31.268486 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-52a43038-8b28-436a-8544-aff705768a4a tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: fdee1a08-4bd5-4b65-afc9-46c5b798ba0d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:31.305948 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-52a43038-8b28-436a-8544-aff705768a4a tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:31.309427 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-52a43038-8b28-436a-8544-aff705768a4a tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:31.313541 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-52a43038-8b28-436a-8544-aff705768a4a tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:31.314114 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-52a43038-8b28-436a-8544-aff705768a4a tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:31.863254 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2fecf8b3-ec5a-4f8e-87ff-c66d2b2497c3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:31.863886 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2fecf8b3-ec5a-4f8e-87ff-c66d2b2497c3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:31.871769 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:31.895538 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2fecf8b3-ec5a-4f8e-87ff-c66d2b2497c3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:31.895994 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2fecf8b3-ec5a-4f8e-87ff-c66d2b2497c3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:31.896817 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2fecf8b3-ec5a-4f8e-87ff-c66d2b2497c3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:31.897262 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2fecf8b3-ec5a-4f8e-87ff-c66d2b2497c3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:31.983425 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-52a43038-8b28-436a-8544-aff705768a4a tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:32.034559 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-52a43038-8b28-436a-8544-aff705768a4a tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d" status: 200 len: 1314 microversion: 2.1 time: 0.768664 Jul 18 02:38:32.051796 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1967/3924] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:31 2022] GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d => generated 1314 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:32.239019 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-31217538-33ec-41f7-9b7b-c53e49d469e4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:32.239656 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-31217538-33ec-41f7-9b7b-c53e49d469e4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:32.259144 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-31217538-33ec-41f7-9b7b-c53e49d469e4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:32.262835 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-31217538-33ec-41f7-9b7b-c53e49d469e4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:32.263707 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-31217538-33ec-41f7-9b7b-c53e49d469e4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:32.267339 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-31217538-33ec-41f7-9b7b-c53e49d469e4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:32.457764 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2fecf8b3-ec5a-4f8e-87ff-c66d2b2497c3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:32.508329 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2fecf8b3-ec5a-4f8e-87ff-c66d2b2497c3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:32.510260 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2fecf8b3-ec5a-4f8e-87ff-c66d2b2497c3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:32.511882 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2fecf8b3-ec5a-4f8e-87ff-c66d2b2497c3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1875 microversion: 2.32 time: 0.654994 Jul 18 02:38:32.512766 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1958/3925] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:31 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1875 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:32.928090 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-31217538-33ec-41f7-9b7b-c53e49d469e4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:33.016610 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-31217538-33ec-41f7-9b7b-c53e49d469e4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:33.039989 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-31217538-33ec-41f7-9b7b-c53e49d469e4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:33.054740 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-31217538-33ec-41f7-9b7b-c53e49d469e4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1738 microversion: 2.20 time: 0.816244 Jul 18 02:38:33.066494 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1968/3926] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:32 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1738 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:38:33.080237 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dc80e62a-3ffe-44c5-b20d-df198d6fa315 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:33.081378 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-dc80e62a-3ffe-44c5-b20d-df198d6fa315 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: fdee1a08-4bd5-4b65-afc9-46c5b798ba0d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:33.125606 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dc80e62a-3ffe-44c5-b20d-df198d6fa315 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:33.126702 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dc80e62a-3ffe-44c5-b20d-df198d6fa315 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:33.133545 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dc80e62a-3ffe-44c5-b20d-df198d6fa315 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:33.140147 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dc80e62a-3ffe-44c5-b20d-df198d6fa315 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:33.581960 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7dd15dca-d76a-4868-a3fb-e09fe8db45e0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:33.599920 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7dd15dca-d76a-4868-a3fb-e09fe8db45e0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:33.660493 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7dd15dca-d76a-4868-a3fb-e09fe8db45e0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:33.664774 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7dd15dca-d76a-4868-a3fb-e09fe8db45e0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:33.673992 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7dd15dca-d76a-4868-a3fb-e09fe8db45e0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:33.701623 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7dd15dca-d76a-4868-a3fb-e09fe8db45e0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:34.917686 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-dc80e62a-3ffe-44c5-b20d-df198d6fa315 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:34.933077 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-dc80e62a-3ffe-44c5-b20d-df198d6fa315 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d" status: 200 len: 1314 microversion: 2.1 time: 1.856555 Jul 18 02:38:34.950432 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1959/3927] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:33 2022] GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d => generated 1314 bytes in 1875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:34.957784 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a42ca2a8-094b-4273-aa51-0f5c80f48e69 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:34.964333 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a42ca2a8-094b-4273-aa51-0f5c80f48e69 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:34.992855 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a42ca2a8-094b-4273-aa51-0f5c80f48e69 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:34.993322 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a42ca2a8-094b-4273-aa51-0f5c80f48e69 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:34.994181 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a42ca2a8-094b-4273-aa51-0f5c80f48e69 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:34.994663 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a42ca2a8-094b-4273-aa51-0f5c80f48e69 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:35.585316 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7dd15dca-d76a-4868-a3fb-e09fe8db45e0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:35.685322 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7dd15dca-d76a-4868-a3fb-e09fe8db45e0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:35.699790 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7dd15dca-d76a-4868-a3fb-e09fe8db45e0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:35.703134 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7dd15dca-d76a-4868-a3fb-e09fe8db45e0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1875 microversion: 2.32 time: 2.174606 Jul 18 02:38:35.709124 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1969/3928] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:33 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1875 bytes in 2182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:35.967929 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3ea90f61-c8a5-47ce-819c-b54e1e18d3ee tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:35.969097 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3ea90f61-c8a5-47ce-819c-b54e1e18d3ee tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: fdee1a08-4bd5-4b65-afc9-46c5b798ba0d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:36.041227 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3ea90f61-c8a5-47ce-819c-b54e1e18d3ee tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:36.049155 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3ea90f61-c8a5-47ce-819c-b54e1e18d3ee tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:36.075280 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3ea90f61-c8a5-47ce-819c-b54e1e18d3ee tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:36.080200 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3ea90f61-c8a5-47ce-819c-b54e1e18d3ee tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:36.098163 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a42ca2a8-094b-4273-aa51-0f5c80f48e69 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:36.111235 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a42ca2a8-094b-4273-aa51-0f5c80f48e69 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:36.115425 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a42ca2a8-094b-4273-aa51-0f5c80f48e69 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:36.135910 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a42ca2a8-094b-4273-aa51-0f5c80f48e69 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1738 microversion: 2.20 time: 1.183763 Jul 18 02:38:36.136949 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1960/3929] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:34 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1738 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:36.710045 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3ea90f61-c8a5-47ce-819c-b54e1e18d3ee tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:36.724752 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-11583e4a-3f48-4874-8654-bf8eb5182c95 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:36.725386 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-11583e4a-3f48-4874-8654-bf8eb5182c95 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:36.735728 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-11583e4a-3f48-4874-8654-bf8eb5182c95 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:36.736195 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3ea90f61-c8a5-47ce-819c-b54e1e18d3ee tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d" status: 200 len: 1314 microversion: 2.1 time: 0.778559 Jul 18 02:38:36.736838 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-11583e4a-3f48-4874-8654-bf8eb5182c95 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:36.736962 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1970/3930] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:35 2022] GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d => generated 1314 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:36.738043 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-11583e4a-3f48-4874-8654-bf8eb5182c95 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:36.738697 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-11583e4a-3f48-4874-8654-bf8eb5182c95 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:37.176843 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9e972318-e69d-4736-a80c-20b83239a9c7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:37.179383 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9e972318-e69d-4736-a80c-20b83239a9c7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:37.220883 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9e972318-e69d-4736-a80c-20b83239a9c7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:37.230447 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9e972318-e69d-4736-a80c-20b83239a9c7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:37.233802 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9e972318-e69d-4736-a80c-20b83239a9c7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:37.238527 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9e972318-e69d-4736-a80c-20b83239a9c7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:37.585031 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-11583e4a-3f48-4874-8654-bf8eb5182c95 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:37.640499 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-11583e4a-3f48-4874-8654-bf8eb5182c95 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:37.653465 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-11583e4a-3f48-4874-8654-bf8eb5182c95 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:37.658959 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-11583e4a-3f48-4874-8654-bf8eb5182c95 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1875 microversion: 2.32 time: 0.938443 Jul 18 02:38:37.685966 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1961/3931] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:36 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1875 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:37.710977 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-5203e21e-2ebe-405e-8b4f-dc76c09da99e req-d0d0cbc4-12f3-42bd-bf73-3c5793c642dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdee1a08-4bd5-4b65-afc9-46c5b798ba0d", "name": "network-vif-plugged", "status": "completed", "tag": "6fb4b926-d001-4d15-8053-9c058c41f98e"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:37.774408 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-5203e21e-2ebe-405e-8b4f-dc76c09da99e req-d0d0cbc4-12f3-42bd-bf73-3c5793c642dc service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:37.775609 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-5203e21e-2ebe-405e-8b4f-dc76c09da99e req-d0d0cbc4-12f3-42bd-bf73-3c5793c642dc service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:37.826091 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-5203e21e-2ebe-405e-8b4f-dc76c09da99e req-d0d0cbc4-12f3-42bd-bf73-3c5793c642dc service nova] Creating event network-vif-plugged:6fb4b926-d001-4d15-8053-9c058c41f98e for instance fdee1a08-4bd5-4b65-afc9-46c5b798ba0d on n-h2-465891-3 Jul 18 02:38:37.849193 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-5203e21e-2ebe-405e-8b4f-dc76c09da99e req-d0d0cbc4-12f3-42bd-bf73-3c5793c642dc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160586 Jul 18 02:38:37.850460 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1962/3932] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:38:37.877458 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7a4c8d3c-62db-4113-a0b5-048838ff6bf2 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:37.887526 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7a4c8d3c-62db-4113-a0b5-048838ff6bf2 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: fdee1a08-4bd5-4b65-afc9-46c5b798ba0d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:37.906795 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7a4c8d3c-62db-4113-a0b5-048838ff6bf2 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:37.907828 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7a4c8d3c-62db-4113-a0b5-048838ff6bf2 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:37.912642 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7a4c8d3c-62db-4113-a0b5-048838ff6bf2 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:37.913689 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7a4c8d3c-62db-4113-a0b5-048838ff6bf2 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:38.155484 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9e972318-e69d-4736-a80c-20b83239a9c7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:38.169666 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9e972318-e69d-4736-a80c-20b83239a9c7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:38.175017 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9e972318-e69d-4736-a80c-20b83239a9c7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:38.176313 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9e972318-e69d-4736-a80c-20b83239a9c7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1720 microversion: 2.20 time: 1.010025 Jul 18 02:38:38.176913 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1971/3933] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:37 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1720 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:38.444557 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7a4c8d3c-62db-4113-a0b5-048838ff6bf2 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:38.478578 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7a4c8d3c-62db-4113-a0b5-048838ff6bf2 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d" status: 200 len: 1314 microversion: 2.1 time: 0.620371 Jul 18 02:38:38.489808 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1963/3934] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:37 2022] GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d => generated 1314 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:38.703095 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ca4a97ad-0871-4707-bea5-f9712d035890 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:38.704395 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ca4a97ad-0871-4707-bea5-f9712d035890 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:38.725851 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ca4a97ad-0871-4707-bea5-f9712d035890 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:38.728358 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ca4a97ad-0871-4707-bea5-f9712d035890 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:38.731273 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ca4a97ad-0871-4707-bea5-f9712d035890 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:38.740258 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ca4a97ad-0871-4707-bea5-f9712d035890 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:39.200381 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-98666952-9dbc-4e1b-b7b6-7797dbb10ed1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:39.206143 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-98666952-9dbc-4e1b-b7b6-7797dbb10ed1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:39.233410 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-98666952-9dbc-4e1b-b7b6-7797dbb10ed1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:39.239012 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-98666952-9dbc-4e1b-b7b6-7797dbb10ed1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:39.240320 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-98666952-9dbc-4e1b-b7b6-7797dbb10ed1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:39.241048 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-98666952-9dbc-4e1b-b7b6-7797dbb10ed1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:40.492256 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ca4a97ad-0871-4707-bea5-f9712d035890 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:40.511025 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ca4a97ad-0871-4707-bea5-f9712d035890 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:40.525229 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ca4a97ad-0871-4707-bea5-f9712d035890 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:40.528131 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ca4a97ad-0871-4707-bea5-f9712d035890 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1875 microversion: 2.32 time: 1.830394 Jul 18 02:38:40.539782 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1972/3935] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:38 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1875 bytes in 1843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:40.545914 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-99046e0f-39f5-4b1d-96d4-df95079bd9a9 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:40.546529 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-99046e0f-39f5-4b1d-96d4-df95079bd9a9 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: fdee1a08-4bd5-4b65-afc9-46c5b798ba0d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:40.554436 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-99046e0f-39f5-4b1d-96d4-df95079bd9a9 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:40.554898 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-99046e0f-39f5-4b1d-96d4-df95079bd9a9 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:40.555710 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-99046e0f-39f5-4b1d-96d4-df95079bd9a9 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:40.556163 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-99046e0f-39f5-4b1d-96d4-df95079bd9a9 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:40.910652 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-98666952-9dbc-4e1b-b7b6-7797dbb10ed1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:40.941835 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-98666952-9dbc-4e1b-b7b6-7797dbb10ed1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:40.952161 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-98666952-9dbc-4e1b-b7b6-7797dbb10ed1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:40.953426 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-98666952-9dbc-4e1b-b7b6-7797dbb10ed1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1720 microversion: 2.20 time: 1.760811 Jul 18 02:38:40.959843 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1964/3936] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:39 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1720 bytes in 1768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:40.975435 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-d53fb4a4-3603-4d58-b3f0-04c949e588f3 req-26c3d598-80f8-47c8-8195-f227facbd527 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6dc16e-f557-44c2-b61c-92981b9915d4", "name": "network-vif-plugged", "status": "completed", "tag": "d1abc038-d96b-4cc7-87d7-6e9e2bbd7be2"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:41.000528 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-d53fb4a4-3603-4d58-b3f0-04c949e588f3 req-26c3d598-80f8-47c8-8195-f227facbd527 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:41.001366 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-d53fb4a4-3603-4d58-b3f0-04c949e588f3 req-26c3d598-80f8-47c8-8195-f227facbd527 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:41.017225 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-d53fb4a4-3603-4d58-b3f0-04c949e588f3 req-26c3d598-80f8-47c8-8195-f227facbd527 service nova] Creating event network-vif-plugged:d1abc038-d96b-4cc7-87d7-6e9e2bbd7be2 for instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 on n-h1-465891-3 Jul 18 02:38:41.025042 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-d53fb4a4-3603-4d58-b3f0-04c949e588f3 req-26c3d598-80f8-47c8-8195-f227facbd527 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064195 Jul 18 02:38:41.026746 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1965/3937] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:38:41.214294 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-99046e0f-39f5-4b1d-96d4-df95079bd9a9 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:41.223238 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-99046e0f-39f5-4b1d-96d4-df95079bd9a9 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d" status: 200 len: 1499 microversion: 2.1 time: 0.681515 Jul 18 02:38:41.224993 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1973/3938] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:40 2022] GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d => generated 1499 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:41.267944 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-49339346-bc0d-4b8e-b30f-6e57a89ca69e tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:41.270215 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-49339346-bc0d-4b8e-b30f-6e57a89ca69e tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: fdee1a08-4bd5-4b65-afc9-46c5b798ba0d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:41.285162 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-49339346-bc0d-4b8e-b30f-6e57a89ca69e tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:41.286363 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-49339346-bc0d-4b8e-b30f-6e57a89ca69e tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:41.287924 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-49339346-bc0d-4b8e-b30f-6e57a89ca69e tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:41.288861 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-49339346-bc0d-4b8e-b30f-6e57a89ca69e tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:41.338416 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-49339346-bc0d-4b8e-b30f-6e57a89ca69e tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lazy-loading 'flavor' on Instance uuid fdee1a08-4bd5-4b65-afc9-46c5b798ba0d {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:38:41.512043 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:41.552687 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c41be238-5931-4fc7-8a80-d32009a5f9d4 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:41.559036 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c41be238-5931-4fc7-8a80-d32009a5f9d4 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:41.605877 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-49339346-bc0d-4b8e-b30f-6e57a89ca69e tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "POST /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d/action" status: 200 len: 32 microversion: 2.1 time: 0.345548 Jul 18 02:38:41.619099 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1966/3939] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:38:41 2022] POST /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d/action => generated 32 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:38:41.621869 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c41be238-5931-4fc7-8a80-d32009a5f9d4 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:41.631936 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3d9af20d-c681-4669-97c3-2975b5c03c69 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:41.632219 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c41be238-5931-4fc7-8a80-d32009a5f9d4 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:41.634330 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c41be238-5931-4fc7-8a80-d32009a5f9d4 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:41.634809 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c41be238-5931-4fc7-8a80-d32009a5f9d4 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:41.635354 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3d9af20d-c681-4669-97c3-2975b5c03c69 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: fdee1a08-4bd5-4b65-afc9-46c5b798ba0d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:41.653569 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3d9af20d-c681-4669-97c3-2975b5c03c69 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:41.655577 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3d9af20d-c681-4669-97c3-2975b5c03c69 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:41.658546 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3d9af20d-c681-4669-97c3-2975b5c03c69 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:41.660509 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3d9af20d-c681-4669-97c3-2975b5c03c69 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:43.976224 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c41be238-5931-4fc7-8a80-d32009a5f9d4 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:43.995734 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3d9af20d-c681-4669-97c3-2975b5c03c69 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:44.005498 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c41be238-5931-4fc7-8a80-d32009a5f9d4 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:44.008757 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3d9af20d-c681-4669-97c3-2975b5c03c69 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d" status: 200 len: 1505 microversion: 2.1 time: 2.387380 Jul 18 02:38:44.010121 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1967/3940] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:41 2022] GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d => generated 1505 bytes in 2391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:44.017804 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c41be238-5931-4fc7-8a80-d32009a5f9d4 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:44.023310 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c41be238-5931-4fc7-8a80-d32009a5f9d4 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1875 microversion: 2.32 time: 2.475838 Jul 18 02:38:44.024647 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1974/3941] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:41 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1875 bytes in 2478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:38:44.030044 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f4a59a06-96af-4b98-a287-ac7f3d1678a3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:44.031095 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f4a59a06-96af-4b98-a287-ac7f3d1678a3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:44.036966 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-d90e57c6-093f-4e41-97cc-7434bfb29cdf req-0b80dbcc-9b3f-4a60-b087-eb431e8eb69c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6dc16e-f557-44c2-b61c-92981b9915d4", "name": "network-vif-plugged", "status": "completed", "tag": "8b71a464-9b9d-4a74-a0e5-f2fd6b5f29c1"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:44.059857 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f4a59a06-96af-4b98-a287-ac7f3d1678a3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:44.060502 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f4a59a06-96af-4b98-a287-ac7f3d1678a3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:44.061427 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f4a59a06-96af-4b98-a287-ac7f3d1678a3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:44.064008 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f4a59a06-96af-4b98-a287-ac7f3d1678a3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:44.075946 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-d90e57c6-093f-4e41-97cc-7434bfb29cdf req-0b80dbcc-9b3f-4a60-b087-eb431e8eb69c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:44.087430 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-d90e57c6-093f-4e41-97cc-7434bfb29cdf req-0b80dbcc-9b3f-4a60-b087-eb431e8eb69c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:44.214052 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-d90e57c6-093f-4e41-97cc-7434bfb29cdf req-0b80dbcc-9b3f-4a60-b087-eb431e8eb69c service nova] Creating event network-vif-plugged:8b71a464-9b9d-4a74-a0e5-f2fd6b5f29c1 for instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 on n-h1-465891-3 Jul 18 02:38:44.256990 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-d90e57c6-093f-4e41-97cc-7434bfb29cdf req-0b80dbcc-9b3f-4a60-b087-eb431e8eb69c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.228974 Jul 18 02:38:44.267009 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1975/3942] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:38:45.036110 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0d91acc1-18d6-48f6-b65b-600d7702aeab tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:45.043098 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0d91acc1-18d6-48f6-b65b-600d7702aeab tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: fdee1a08-4bd5-4b65-afc9-46c5b798ba0d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:45.106988 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0d91acc1-18d6-48f6-b65b-600d7702aeab tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:45.114394 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0d91acc1-18d6-48f6-b65b-600d7702aeab tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:45.117790 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0d91acc1-18d6-48f6-b65b-600d7702aeab tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:45.123221 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0d91acc1-18d6-48f6-b65b-600d7702aeab tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:45.218675 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f4a59a06-96af-4b98-a287-ac7f3d1678a3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:45.256974 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f4a59a06-96af-4b98-a287-ac7f3d1678a3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:45.277644 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f4a59a06-96af-4b98-a287-ac7f3d1678a3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:45.280030 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f4a59a06-96af-4b98-a287-ac7f3d1678a3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1663 microversion: 2.20 time: 1.267763 Jul 18 02:38:45.295809 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1968/3943] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:44 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1663 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:45.325772 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e1cd5b31-dcc1-4f7e-9a0e-38e91a867f9e tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:45.326901 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e1cd5b31-dcc1-4f7e-9a0e-38e91a867f9e tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:45.366548 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e1cd5b31-dcc1-4f7e-9a0e-38e91a867f9e tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:45.367342 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e1cd5b31-dcc1-4f7e-9a0e-38e91a867f9e tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:45.370679 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e1cd5b31-dcc1-4f7e-9a0e-38e91a867f9e tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:45.373260 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e1cd5b31-dcc1-4f7e-9a0e-38e91a867f9e tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:46.296534 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0d91acc1-18d6-48f6-b65b-600d7702aeab tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:46.337462 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0d91acc1-18d6-48f6-b65b-600d7702aeab tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d" status: 200 len: 1505 microversion: 2.1 time: 1.312989 Jul 18 02:38:46.341904 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1976/3944] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:45 2022] GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d => generated 1505 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:46.361567 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b4549dcc-b651-4523-9ebe-65ef029697ae tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f253c50-56b1-41de-9608-7717671936e7"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:46.372401 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b4549dcc-b651-4523-9ebe-65ef029697ae tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:46.398952 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b4549dcc-b651-4523-9ebe-65ef029697ae tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:46.402381 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b4549dcc-b651-4523-9ebe-65ef029697ae tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:46.404341 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b4549dcc-b651-4523-9ebe-65ef029697ae tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:46.409498 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b4549dcc-b651-4523-9ebe-65ef029697ae tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:46.494892 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e1cd5b31-dcc1-4f7e-9a0e-38e91a867f9e tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:46.549345 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e1cd5b31-dcc1-4f7e-9a0e-38e91a867f9e tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:46.567306 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e1cd5b31-dcc1-4f7e-9a0e-38e91a867f9e tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:46.581234 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e1cd5b31-dcc1-4f7e-9a0e-38e91a867f9e tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1875 microversion: 2.32 time: 1.271953 Jul 18 02:38:46.582354 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1969/3945] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:45 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1875 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:46.634899 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-4ee5ff66-2021-4c87-929c-307cd2c74cb4 req-fc4f5821-3ada-4814-8d99-e42022cfa376 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6dc16e-f557-44c2-b61c-92981b9915d4", "name": "network-vif-plugged", "status": "completed", "tag": "4e48952d-6c79-460b-a0c6-59c7c8c1573e"}, {"server_uuid": "0e6dc16e-f557-44c2-b61c-92981b9915d4", "name": "network-vif-plugged", "status": "completed", "tag": "8ae7216b-c181-431a-959d-513873271b5b"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:46.714377 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-4ee5ff66-2021-4c87-929c-307cd2c74cb4 req-fc4f5821-3ada-4814-8d99-e42022cfa376 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:46.715108 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-4ee5ff66-2021-4c87-929c-307cd2c74cb4 req-fc4f5821-3ada-4814-8d99-e42022cfa376 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:46.815465 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-4ee5ff66-2021-4c87-929c-307cd2c74cb4 req-fc4f5821-3ada-4814-8d99-e42022cfa376 service nova] Creating event network-vif-plugged:4e48952d-6c79-460b-a0c6-59c7c8c1573e for instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 on n-h1-465891-3 Jul 18 02:38:46.821785 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-4ee5ff66-2021-4c87-929c-307cd2c74cb4 req-fc4f5821-3ada-4814-8d99-e42022cfa376 service nova] Creating event network-vif-plugged:8ae7216b-c181-431a-959d-513873271b5b for instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 on n-h1-465891-3 Jul 18 02:38:46.849922 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-4ee5ff66-2021-4c87-929c-307cd2c74cb4 req-fc4f5821-3ada-4814-8d99-e42022cfa376 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.265804 Jul 18 02:38:46.850564 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1970/3946] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:38:47.374372 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9dbd1dc3-b36a-4934-8239-4576731ec72a tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:47.378545 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9dbd1dc3-b36a-4934-8239-4576731ec72a tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: fdee1a08-4bd5-4b65-afc9-46c5b798ba0d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:47.411408 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9dbd1dc3-b36a-4934-8239-4576731ec72a tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:47.412383 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9dbd1dc3-b36a-4934-8239-4576731ec72a tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:47.416481 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9dbd1dc3-b36a-4934-8239-4576731ec72a tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:47.420728 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9dbd1dc3-b36a-4934-8239-4576731ec72a tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:47.616665 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:48.148278 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b4549dcc-b651-4523-9ebe-65ef029697ae tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "POST /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.803885 Jul 18 02:38:48.174971 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1977/3947] 10.222.0.57 () {62 vars in 1363 bytes} [Mon Jul 18 02:38:46 2022] POST /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/os-volume_attachments => generated 188 bytes in 1831 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:38:48.219603 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3b1447a6-8905-44a1-bbcd-6934e91e72b2 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:48.228315 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3b1447a6-8905-44a1-bbcd-6934e91e72b2 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:48.259012 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9dbd1dc3-b36a-4934-8239-4576731ec72a tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:48.269725 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9dbd1dc3-b36a-4934-8239-4576731ec72a tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d" status: 200 len: 1505 microversion: 2.1 time: 0.907573 Jul 18 02:38:48.273354 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b1447a6-8905-44a1-bbcd-6934e91e72b2 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:48.274130 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b1447a6-8905-44a1-bbcd-6934e91e72b2 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:48.276634 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b1447a6-8905-44a1-bbcd-6934e91e72b2 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:48.277491 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1971/3948] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:47 2022] GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d => generated 1505 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:48.278561 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b1447a6-8905-44a1-bbcd-6934e91e72b2 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:48.717412 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-800ee687-0aba-4c5b-ba29-c861508987d2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:48.723328 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-800ee687-0aba-4c5b-ba29-c861508987d2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:48.748935 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-800ee687-0aba-4c5b-ba29-c861508987d2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:48.752902 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-800ee687-0aba-4c5b-ba29-c861508987d2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:48.759979 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-800ee687-0aba-4c5b-ba29-c861508987d2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:48.763002 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-800ee687-0aba-4c5b-ba29-c861508987d2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:49.154797 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-800ee687-0aba-4c5b-ba29-c861508987d2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "POST /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/action" status: 202 len: 0 microversion: 2.20 time: 0.442894 Jul 18 02:38:49.161199 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1972/3949] 10.222.0.57 () {62 vars in 1318 bytes} [Mon Jul 18 02:38:48 2022] POST /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/action => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:38:49.188073 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-8c670cb7-800a-4cd6-bc7f-7f608898fe5f req-6559d786-723b-4134-9bb9-644fc5186005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6dc16e-f557-44c2-b61c-92981b9915d4", "name": "network-vif-plugged", "status": "completed", "tag": "5008bbd8-4311-4133-b2fb-b4f029c22c41"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:49.235787 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-8c670cb7-800a-4cd6-bc7f-7f608898fe5f req-6559d786-723b-4134-9bb9-644fc5186005 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:49.236634 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-8c670cb7-800a-4cd6-bc7f-7f608898fe5f req-6559d786-723b-4134-9bb9-644fc5186005 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:49.321154 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-8c670cb7-800a-4cd6-bc7f-7f608898fe5f req-6559d786-723b-4134-9bb9-644fc5186005 service nova] Creating event network-vif-plugged:5008bbd8-4311-4133-b2fb-b4f029c22c41 for instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 on n-h1-465891-3 Jul 18 02:38:49.356434 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-8c670cb7-800a-4cd6-bc7f-7f608898fe5f req-6559d786-723b-4134-9bb9-644fc5186005 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188865 Jul 18 02:38:49.365722 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1973/3950] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:38:49.393542 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-864a1851-4abd-40b0-99e0-6e1fa28a8076 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:49.393542 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-864a1851-4abd-40b0-99e0-6e1fa28a8076 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:49.427359 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-864a1851-4abd-40b0-99e0-6e1fa28a8076 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:49.429757 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-864a1851-4abd-40b0-99e0-6e1fa28a8076 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:49.431299 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-864a1851-4abd-40b0-99e0-6e1fa28a8076 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:49.436666 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-864a1851-4abd-40b0-99e0-6e1fa28a8076 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:49.660877 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3b1447a6-8905-44a1-bbcd-6934e91e72b2 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:49.718402 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3b1447a6-8905-44a1-bbcd-6934e91e72b2 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:49.736523 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3b1447a6-8905-44a1-bbcd-6934e91e72b2 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:49.752320 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3b1447a6-8905-44a1-bbcd-6934e91e72b2 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1875 microversion: 2.32 time: 1.575492 Jul 18 02:38:49.769281 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1978/3951] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:48 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1875 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:49.804240 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7a00a48f-6ec0-4f22-af5d-93e790394237 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:49.816558 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7a00a48f-6ec0-4f22-af5d-93e790394237 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: fdee1a08-4bd5-4b65-afc9-46c5b798ba0d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:49.862232 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7a00a48f-6ec0-4f22-af5d-93e790394237 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:49.865123 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7a00a48f-6ec0-4f22-af5d-93e790394237 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:49.867902 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7a00a48f-6ec0-4f22-af5d-93e790394237 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:49.869058 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7a00a48f-6ec0-4f22-af5d-93e790394237 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:50.692887 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-864a1851-4abd-40b0-99e0-6e1fa28a8076 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:50.716829 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-864a1851-4abd-40b0-99e0-6e1fa28a8076 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:50.722949 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-864a1851-4abd-40b0-99e0-6e1fa28a8076 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:50.726475 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-864a1851-4abd-40b0-99e0-6e1fa28a8076 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1749 microversion: 2.20 time: 1.357090 Jul 18 02:38:50.729435 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1974/3952] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:49 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1749 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:50.789091 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a7b49562-f7ef-4a38-a298-705aeb625e25 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:50.790386 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a7b49562-f7ef-4a38-a298-705aeb625e25 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:50.814251 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a7b49562-f7ef-4a38-a298-705aeb625e25 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:50.816336 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a7b49562-f7ef-4a38-a298-705aeb625e25 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:50.818663 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a7b49562-f7ef-4a38-a298-705aeb625e25 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:50.848538 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a7b49562-f7ef-4a38-a298-705aeb625e25 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:51.533514 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7a00a48f-6ec0-4f22-af5d-93e790394237 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:51.571285 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7a00a48f-6ec0-4f22-af5d-93e790394237 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d" status: 200 len: 1505 microversion: 2.1 time: 1.791159 Jul 18 02:38:51.585089 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1979/3953] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:49 2022] GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d => generated 1505 bytes in 1814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:51.631437 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-c0b31fee-07a2-4eaf-951a-5f4e40ed5c97 req-f8c501a9-f25a-46ee-b5d5-ba1b208ae9dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6dc16e-f557-44c2-b61c-92981b9915d4", "name": "network-vif-plugged", "status": "completed", "tag": "2b179498-569c-4e0a-88a2-4c73687919da"}, {"server_uuid": "0e6dc16e-f557-44c2-b61c-92981b9915d4", "name": "network-vif-plugged", "status": "completed", "tag": "a9898ef4-9a1c-48a1-91ff-fa0ef93ce449"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:51.673307 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-c0b31fee-07a2-4eaf-951a-5f4e40ed5c97 req-f8c501a9-f25a-46ee-b5d5-ba1b208ae9dc service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:51.674120 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-c0b31fee-07a2-4eaf-951a-5f4e40ed5c97 req-f8c501a9-f25a-46ee-b5d5-ba1b208ae9dc service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:51.751355 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-c0b31fee-07a2-4eaf-951a-5f4e40ed5c97 req-f8c501a9-f25a-46ee-b5d5-ba1b208ae9dc service nova] Creating event network-vif-plugged:2b179498-569c-4e0a-88a2-4c73687919da for instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 on n-h1-465891-3 Jul 18 02:38:51.752238 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-c0b31fee-07a2-4eaf-951a-5f4e40ed5c97 req-f8c501a9-f25a-46ee-b5d5-ba1b208ae9dc service nova] Creating event network-vif-plugged:a9898ef4-9a1c-48a1-91ff-fa0ef93ce449 for instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 on n-h1-465891-3 Jul 18 02:38:51.779211 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-c0b31fee-07a2-4eaf-951a-5f4e40ed5c97 req-f8c501a9-f25a-46ee-b5d5-ba1b208ae9dc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.155314 Jul 18 02:38:51.783916 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1980/3954] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:38:51.838080 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-41084aca-6e01-4a14-b5a8-e8c1f86dae20 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:51.846181 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-41084aca-6e01-4a14-b5a8-e8c1f86dae20 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:51.891953 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-41084aca-6e01-4a14-b5a8-e8c1f86dae20 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:51.894160 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-41084aca-6e01-4a14-b5a8-e8c1f86dae20 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:51.899760 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-41084aca-6e01-4a14-b5a8-e8c1f86dae20 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:51.903323 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-41084aca-6e01-4a14-b5a8-e8c1f86dae20 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:52.112958 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a7b49562-f7ef-4a38-a298-705aeb625e25 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:52.149549 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a7b49562-f7ef-4a38-a298-705aeb625e25 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:52.172468 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a7b49562-f7ef-4a38-a298-705aeb625e25 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:52.189266 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a7b49562-f7ef-4a38-a298-705aeb625e25 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1875 microversion: 2.32 time: 1.403762 Jul 18 02:38:52.190035 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1975/3955] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:50 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1875 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:38:52.603905 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a69f9011-ff32-49b3-a678-d1b96aba3033 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:52.605379 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a69f9011-ff32-49b3-a678-d1b96aba3033 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: fdee1a08-4bd5-4b65-afc9-46c5b798ba0d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:52.643997 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a69f9011-ff32-49b3-a678-d1b96aba3033 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:52.644823 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a69f9011-ff32-49b3-a678-d1b96aba3033 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:52.666783 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a69f9011-ff32-49b3-a678-d1b96aba3033 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:52.668079 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a69f9011-ff32-49b3-a678-d1b96aba3033 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:52.988448 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-41084aca-6e01-4a14-b5a8-e8c1f86dae20 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:53.019670 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-41084aca-6e01-4a14-b5a8-e8c1f86dae20 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:53.024598 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-41084aca-6e01-4a14-b5a8-e8c1f86dae20 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:53.031341 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-41084aca-6e01-4a14-b5a8-e8c1f86dae20 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1749 microversion: 2.20 time: 1.242950 Jul 18 02:38:53.035823 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1981/3956] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:51 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1749 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:53.142947 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a69f9011-ff32-49b3-a678-d1b96aba3033 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:53.186955 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a69f9011-ff32-49b3-a678-d1b96aba3033 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d" status: 200 len: 1505 microversion: 2.1 time: 0.590563 Jul 18 02:38:53.188883 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1976/3957] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:52 2022] GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d => generated 1505 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:38:53.233599 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-352af864-da17-47c6-a8d8-801affeca0b0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:53.248211 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-352af864-da17-47c6-a8d8-801affeca0b0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:53.295353 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=46 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:53.298340 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-352af864-da17-47c6-a8d8-801affeca0b0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:53.299167 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-352af864-da17-47c6-a8d8-801affeca0b0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:53.305008 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-352af864-da17-47c6-a8d8-801affeca0b0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:53.305683 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-352af864-da17-47c6-a8d8-801affeca0b0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:53.846989 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-eb8ac1f6-cdb5-4a1d-9e3c-ce834a4c54cb req-7184e29c-23dc-4c1c-9779-6c139de7350d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d18d284e-d055-4fe5-af1c-b41ee803d426", "name": "network-vif-unplugged", "status": "completed", "tag": "6ca46669-298c-45bb-bc10-3dd6fed58f4a"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:53.877636 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-eb8ac1f6-cdb5-4a1d-9e3c-ce834a4c54cb req-7184e29c-23dc-4c1c-9779-6c139de7350d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:53.879000 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-eb8ac1f6-cdb5-4a1d-9e3c-ce834a4c54cb req-7184e29c-23dc-4c1c-9779-6c139de7350d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:53.926785 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.compute.server_external_events [req-eb8ac1f6-cdb5-4a1d-9e3c-ce834a4c54cb req-7184e29c-23dc-4c1c-9779-6c139de7350d service nova] Unable to find a host for instance d18d284e-d055-4fe5-af1c-b41ee803d426. Dropping event network-vif-unplugged {{(pid=119543) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 18 02:38:53.930604 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-eb8ac1f6-cdb5-4a1d-9e3c-ce834a4c54cb req-7184e29c-23dc-4c1c-9779-6c139de7350d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.097084 Jul 18 02:38:53.933572 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1977/3958] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 101 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 18 02:38:54.055759 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1a05937c-d8c7-428d-b782-df0f0046b8cb tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:54.062352 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1a05937c-d8c7-428d-b782-df0f0046b8cb tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:54.097126 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1a05937c-d8c7-428d-b782-df0f0046b8cb tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:54.104098 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1a05937c-d8c7-428d-b782-df0f0046b8cb tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:54.109687 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1a05937c-d8c7-428d-b782-df0f0046b8cb tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:54.112322 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1a05937c-d8c7-428d-b782-df0f0046b8cb tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:54.415115 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-352af864-da17-47c6-a8d8-801affeca0b0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:54.462209 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-352af864-da17-47c6-a8d8-801affeca0b0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:54.473223 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-352af864-da17-47c6-a8d8-801affeca0b0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:54.479663 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-352af864-da17-47c6-a8d8-801affeca0b0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1875 microversion: 2.32 time: 1.254229 Jul 18 02:38:54.483113 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1982/3959] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:53 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1875 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:54.508205 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b2df9806-f266-4e74-8c0b-fdeecfa01b11 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:54.512057 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b2df9806-f266-4e74-8c0b-fdeecfa01b11 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: fdee1a08-4bd5-4b65-afc9-46c5b798ba0d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:54.517505 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1a05937c-d8c7-428d-b782-df0f0046b8cb tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:54.541187 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b2df9806-f266-4e74-8c0b-fdeecfa01b11 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:54.549937 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b2df9806-f266-4e74-8c0b-fdeecfa01b11 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:54.553867 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b2df9806-f266-4e74-8c0b-fdeecfa01b11 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:54.555635 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b2df9806-f266-4e74-8c0b-fdeecfa01b11 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:54.577881 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1a05937c-d8c7-428d-b782-df0f0046b8cb tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:54.583213 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1a05937c-d8c7-428d-b782-df0f0046b8cb tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:54.590667 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1a05937c-d8c7-428d-b782-df0f0046b8cb tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1751 microversion: 2.20 time: 0.538021 Jul 18 02:38:54.605502 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1978/3960] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:54 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1751 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:55.011493 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b2df9806-f266-4e74-8c0b-fdeecfa01b11 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:55.085330 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b2df9806-f266-4e74-8c0b-fdeecfa01b11 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d" status: 200 len: 1505 microversion: 2.1 time: 0.598258 Jul 18 02:38:55.086026 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1983/3961] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:54 2022] GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d => generated 1505 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:55.506004 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1dc5005a-71ab-43c4-974e-c7b6534f6b7e tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:55.507722 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1dc5005a-71ab-43c4-974e-c7b6534f6b7e tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:55.530986 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1dc5005a-71ab-43c4-974e-c7b6534f6b7e tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:55.532279 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1dc5005a-71ab-43c4-974e-c7b6534f6b7e tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:55.533385 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1dc5005a-71ab-43c4-974e-c7b6534f6b7e tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:55.537052 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1dc5005a-71ab-43c4-974e-c7b6534f6b7e tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:55.615472 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3016cfe2-0b4b-4b9b-bf29-7fa4ca78dab0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:55.616642 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3016cfe2-0b4b-4b9b-bf29-7fa4ca78dab0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:55.653469 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3016cfe2-0b4b-4b9b-bf29-7fa4ca78dab0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:55.654840 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3016cfe2-0b4b-4b9b-bf29-7fa4ca78dab0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:55.656817 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3016cfe2-0b4b-4b9b-bf29-7fa4ca78dab0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:55.669745 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3016cfe2-0b4b-4b9b-bf29-7fa4ca78dab0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:56.424050 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3016cfe2-0b4b-4b9b-bf29-7fa4ca78dab0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:56.446445 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3016cfe2-0b4b-4b9b-bf29-7fa4ca78dab0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:56.452089 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3016cfe2-0b4b-4b9b-bf29-7fa4ca78dab0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:56.454527 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3016cfe2-0b4b-4b9b-bf29-7fa4ca78dab0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1751 microversion: 2.20 time: 0.846719 Jul 18 02:38:56.457481 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1984/3962] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:55 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1751 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:56.473819 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b55d2811-8580-4052-9ac5-581d2e5d08ee tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:56.474335 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b55d2811-8580-4052-9ac5-581d2e5d08ee tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: fdee1a08-4bd5-4b65-afc9-46c5b798ba0d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:56.490753 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b55d2811-8580-4052-9ac5-581d2e5d08ee tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:56.493026 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b55d2811-8580-4052-9ac5-581d2e5d08ee tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:56.496636 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b55d2811-8580-4052-9ac5-581d2e5d08ee tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:56.497409 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b55d2811-8580-4052-9ac5-581d2e5d08ee tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:57.074788 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1dc5005a-71ab-43c4-974e-c7b6534f6b7e tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:57.109505 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1dc5005a-71ab-43c4-974e-c7b6534f6b7e tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:57.118033 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1dc5005a-71ab-43c4-974e-c7b6534f6b7e tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:57.127008 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1dc5005a-71ab-43c4-974e-c7b6534f6b7e tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 2827 microversion: 2.32 time: 1.625004 Jul 18 02:38:57.130383 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1979/3963] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:55 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 2827 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:57.156605 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f21d6107-ffde-41fe-9dee-a6a263307726 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:57.159568 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f21d6107-ffde-41fe-9dee-a6a263307726 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:57.184135 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f21d6107-ffde-41fe-9dee-a6a263307726 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:57.190186 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f21d6107-ffde-41fe-9dee-a6a263307726 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:57.195291 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f21d6107-ffde-41fe-9dee-a6a263307726 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:57.196502 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f21d6107-ffde-41fe-9dee-a6a263307726 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:57.209057 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b55d2811-8580-4052-9ac5-581d2e5d08ee tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:57.228421 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b55d2811-8580-4052-9ac5-581d2e5d08ee tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d" status: 200 len: 1505 microversion: 2.1 time: 0.769550 Jul 18 02:38:57.229036 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1985/3964] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:56 2022] GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d => generated 1505 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:57.479988 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3c54b504-52ae-4249-b71f-8e3cfe982b7c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:57.481166 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3c54b504-52ae-4249-b71f-8e3cfe982b7c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:57.504991 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3c54b504-52ae-4249-b71f-8e3cfe982b7c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:57.523316 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3c54b504-52ae-4249-b71f-8e3cfe982b7c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:57.525375 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3c54b504-52ae-4249-b71f-8e3cfe982b7c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:57.527710 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3c54b504-52ae-4249-b71f-8e3cfe982b7c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:57.637346 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f21d6107-ffde-41fe-9dee-a6a263307726 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.489576 Jul 18 02:38:57.646389 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1980/3965] 10.222.0.57 () {60 vars in 1315 bytes} [Mon Jul 18 02:38:57 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4/os-interface => generated 1831 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:58.273870 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fdab1aad-3b17-4447-ad10-53c8605a6ff1 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:58.274992 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fdab1aad-3b17-4447-ad10-53c8605a6ff1 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: fdee1a08-4bd5-4b65-afc9-46c5b798ba0d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:58.294576 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fdab1aad-3b17-4447-ad10-53c8605a6ff1 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:58.295086 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fdab1aad-3b17-4447-ad10-53c8605a6ff1 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:58.299042 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fdab1aad-3b17-4447-ad10-53c8605a6ff1 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:58.299856 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fdab1aad-3b17-4447-ad10-53c8605a6ff1 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:00.108445 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3c54b504-52ae-4249-b71f-8e3cfe982b7c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:00.140589 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3c54b504-52ae-4249-b71f-8e3cfe982b7c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:00.152379 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3c54b504-52ae-4249-b71f-8e3cfe982b7c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:00.159421 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3c54b504-52ae-4249-b71f-8e3cfe982b7c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1751 microversion: 2.20 time: 2.680711 Jul 18 02:39:00.160602 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1986/3966] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:57 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1751 bytes in 2689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:39:00.375570 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fdab1aad-3b17-4447-ad10-53c8605a6ff1 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:00.407799 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fdab1aad-3b17-4447-ad10-53c8605a6ff1 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d" status: 200 len: 1505 microversion: 2.1 time: 2.136692 Jul 18 02:39:00.410406 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1981/3967] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:58 2022] GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d => generated 1505 bytes in 2142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:39:01.201695 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-db0c7cf1-3d1a-4935-8d68-6a1108d8d282 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:01.202429 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-db0c7cf1-3d1a-4935-8d68-6a1108d8d282 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:01.217135 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-db0c7cf1-3d1a-4935-8d68-6a1108d8d282 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:01.217600 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-db0c7cf1-3d1a-4935-8d68-6a1108d8d282 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:01.231447 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-db0c7cf1-3d1a-4935-8d68-6a1108d8d282 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:01.231447 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-db0c7cf1-3d1a-4935-8d68-6a1108d8d282 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:01.427956 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-abe532f4-e887-4420-9e8b-d592bf0741d0 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:01.430007 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-abe532f4-e887-4420-9e8b-d592bf0741d0 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: fdee1a08-4bd5-4b65-afc9-46c5b798ba0d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:01.463387 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-abe532f4-e887-4420-9e8b-d592bf0741d0 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:01.474252 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-abe532f4-e887-4420-9e8b-d592bf0741d0 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:01.479826 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-abe532f4-e887-4420-9e8b-d592bf0741d0 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:01.480289 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-abe532f4-e887-4420-9e8b-d592bf0741d0 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:02.803653 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-abe532f4-e887-4420-9e8b-d592bf0741d0 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:02.819965 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-abe532f4-e887-4420-9e8b-d592bf0741d0 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d" status: 200 len: 1505 microversion: 2.1 time: 1.395877 Jul 18 02:39:02.829295 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1982/3968] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:01 2022] GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d => generated 1505 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:03.290912 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-db0c7cf1-3d1a-4935-8d68-6a1108d8d282 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:03.317645 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-db0c7cf1-3d1a-4935-8d68-6a1108d8d282 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:03.319304 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-db0c7cf1-3d1a-4935-8d68-6a1108d8d282 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:03.320612 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-db0c7cf1-3d1a-4935-8d68-6a1108d8d282 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1751 microversion: 2.20 time: 2.124721 Jul 18 02:39:03.321209 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1987/3969] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:01 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1751 bytes in 2126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:03.847789 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-92142d63-eb84-4d4c-a1cc-8313e4e00ab2 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:03.849310 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-92142d63-eb84-4d4c-a1cc-8313e4e00ab2 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: fdee1a08-4bd5-4b65-afc9-46c5b798ba0d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:03.864913 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=52 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:03.873680 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-92142d63-eb84-4d4c-a1cc-8313e4e00ab2 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:03.874648 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-92142d63-eb84-4d4c-a1cc-8313e4e00ab2 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:03.878808 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-92142d63-eb84-4d4c-a1cc-8313e4e00ab2 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:03.888014 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-92142d63-eb84-4d4c-a1cc-8313e4e00ab2 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:04.353669 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bbb4aa3e-510d-495a-ae27-49158bbc5c84 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:04.355577 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bbb4aa3e-510d-495a-ae27-49158bbc5c84 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:04.373415 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bbb4aa3e-510d-495a-ae27-49158bbc5c84 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:04.377059 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bbb4aa3e-510d-495a-ae27-49158bbc5c84 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:04.378293 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bbb4aa3e-510d-495a-ae27-49158bbc5c84 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:04.378913 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bbb4aa3e-510d-495a-ae27-49158bbc5c84 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:05.615832 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bbb4aa3e-510d-495a-ae27-49158bbc5c84 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:05.631356 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-92142d63-eb84-4d4c-a1cc-8313e4e00ab2 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:05.641894 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bbb4aa3e-510d-495a-ae27-49158bbc5c84 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:05.647832 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bbb4aa3e-510d-495a-ae27-49158bbc5c84 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:05.655424 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bbb4aa3e-510d-495a-ae27-49158bbc5c84 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1751 microversion: 2.20 time: 1.306683 Jul 18 02:39:05.671587 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1988/3970] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:04 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1751 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:39:05.747709 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-92142d63-eb84-4d4c-a1cc-8313e4e00ab2 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d" status: 200 len: 1505 microversion: 2.1 time: 1.905301 Jul 18 02:39:05.758565 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1983/3971] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:03 2022] GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d => generated 1505 bytes in 1917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:06.179434 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-fcf7ff38-20f0-4a64-9671-362176a022b8 req-f5fb5ba4-c553-4d5c-bce9-dbb540dcdaba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e6dc16e-f557-44c2-b61c-92981b9915d4", "tag": "8ae7216b-c181-431a-959d-513873271b5b"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:06.220566 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-fcf7ff38-20f0-4a64-9671-362176a022b8 req-f5fb5ba4-c553-4d5c-bce9-dbb540dcdaba service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:06.221349 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-fcf7ff38-20f0-4a64-9671-362176a022b8 req-f5fb5ba4-c553-4d5c-bce9-dbb540dcdaba service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:06.286875 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-fcf7ff38-20f0-4a64-9671-362176a022b8 req-f5fb5ba4-c553-4d5c-bce9-dbb540dcdaba service nova] Creating event network-changed:8ae7216b-c181-431a-959d-513873271b5b for instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 on n-h1-465891-3 Jul 18 02:39:06.329693 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-fcf7ff38-20f0-4a64-9671-362176a022b8 req-f5fb5ba4-c553-4d5c-bce9-dbb540dcdaba service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.656322 Jul 18 02:39:06.333791 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1989/3972] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:39:06.684877 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fcfededc-d724-4962-88fc-fd05a966701a tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:06.718877 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fcfededc-d724-4962-88fc-fd05a966701a tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:06.769458 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fcfededc-d724-4962-88fc-fd05a966701a tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:06.771112 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fcfededc-d724-4962-88fc-fd05a966701a tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:06.773971 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fcfededc-d724-4962-88fc-fd05a966701a tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:06.777651 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fcfededc-d724-4962-88fc-fd05a966701a tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:06.779031 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-faf8c5fb-c153-4391-af9d-2f8a6b7c4e40 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:06.780511 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-faf8c5fb-c153-4391-af9d-2f8a6b7c4e40 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: fdee1a08-4bd5-4b65-afc9-46c5b798ba0d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:06.811123 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-faf8c5fb-c153-4391-af9d-2f8a6b7c4e40 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:06.811511 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-faf8c5fb-c153-4391-af9d-2f8a6b7c4e40 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:06.818930 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-faf8c5fb-c153-4391-af9d-2f8a6b7c4e40 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:06.819393 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-faf8c5fb-c153-4391-af9d-2f8a6b7c4e40 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:06.875592 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:08.493278 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fcfededc-d724-4962-88fc-fd05a966701a tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:08.529432 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fcfededc-d724-4962-88fc-fd05a966701a tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:08.534838 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fcfededc-d724-4962-88fc-fd05a966701a tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:08.542519 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fcfededc-d724-4962-88fc-fd05a966701a tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1751 microversion: 2.20 time: 1.866003 Jul 18 02:39:08.559602 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1984/3973] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:06 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1751 bytes in 1889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:08.590479 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-faf8c5fb-c153-4391-af9d-2f8a6b7c4e40 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:08.621231 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-faf8c5fb-c153-4391-af9d-2f8a6b7c4e40 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d" status: 200 len: 1485 microversion: 2.1 time: 1.848319 Jul 18 02:39:08.622578 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1990/3974] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:06 2022] GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d => generated 1485 bytes in 1850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:08.652461 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1c060e9e-476b-46f0-98e4-5b96d661f8a9 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:08.653522 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1c060e9e-476b-46f0-98e4-5b96d661f8a9 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: fdee1a08-4bd5-4b65-afc9-46c5b798ba0d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:08.674290 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c060e9e-476b-46f0-98e4-5b96d661f8a9 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:08.675126 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c060e9e-476b-46f0-98e4-5b96d661f8a9 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:08.676231 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c060e9e-476b-46f0-98e4-5b96d661f8a9 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:08.676921 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c060e9e-476b-46f0-98e4-5b96d661f8a9 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:09.081000 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1c060e9e-476b-46f0-98e4-5b96d661f8a9 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "POST /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d/action" status: 202 len: 0 microversion: 2.1 time: 0.433506 Jul 18 02:39:09.083206 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1985/3975] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:39:08 2022] POST /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d/action => generated 0 bytes in 437 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:39:09.106451 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3c8693d7-b221-466f-a61c-c799cf492fa5 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:09.109133 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3c8693d7-b221-466f-a61c-c799cf492fa5 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: fdee1a08-4bd5-4b65-afc9-46c5b798ba0d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:09.178553 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3c8693d7-b221-466f-a61c-c799cf492fa5 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:09.184931 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3c8693d7-b221-466f-a61c-c799cf492fa5 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:09.187458 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3c8693d7-b221-466f-a61c-c799cf492fa5 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:09.191950 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3c8693d7-b221-466f-a61c-c799cf492fa5 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:09.582322 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cfc50860-b4b6-4978-8d3c-00aed56eda5b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:09.593451 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cfc50860-b4b6-4978-8d3c-00aed56eda5b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:09.617167 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cfc50860-b4b6-4978-8d3c-00aed56eda5b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:09.619153 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cfc50860-b4b6-4978-8d3c-00aed56eda5b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:09.621098 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cfc50860-b4b6-4978-8d3c-00aed56eda5b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:09.622330 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cfc50860-b4b6-4978-8d3c-00aed56eda5b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:10.575713 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3c8693d7-b221-466f-a61c-c799cf492fa5 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:10.596218 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3c8693d7-b221-466f-a61c-c799cf492fa5 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d" status: 200 len: 1493 microversion: 2.1 time: 1.495893 Jul 18 02:39:10.598246 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1991/3976] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:09 2022] GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d => generated 1493 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:39:10.802337 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cfc50860-b4b6-4978-8d3c-00aed56eda5b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:10.872337 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cfc50860-b4b6-4978-8d3c-00aed56eda5b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:10.875868 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cfc50860-b4b6-4978-8d3c-00aed56eda5b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:10.905890 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cfc50860-b4b6-4978-8d3c-00aed56eda5b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1751 microversion: 2.20 time: 1.316098 Jul 18 02:39:10.910498 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1986/3977] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:09 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1751 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:11.633190 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c3de3f7d-22ac-4f53-88b5-23fd639ea1fe tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:11.641126 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c3de3f7d-22ac-4f53-88b5-23fd639ea1fe tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: fdee1a08-4bd5-4b65-afc9-46c5b798ba0d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:11.692204 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c3de3f7d-22ac-4f53-88b5-23fd639ea1fe tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:11.703439 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c3de3f7d-22ac-4f53-88b5-23fd639ea1fe tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:11.706670 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c3de3f7d-22ac-4f53-88b5-23fd639ea1fe tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:11.712948 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c3de3f7d-22ac-4f53-88b5-23fd639ea1fe tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:11.941410 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-15babcf5-c10a-4f23-9956-cef5fdc872e1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:11.947456 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-15babcf5-c10a-4f23-9956-cef5fdc872e1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:11.977087 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-15babcf5-c10a-4f23-9956-cef5fdc872e1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:11.978499 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-15babcf5-c10a-4f23-9956-cef5fdc872e1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:11.980784 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-15babcf5-c10a-4f23-9956-cef5fdc872e1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:11.981992 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-15babcf5-c10a-4f23-9956-cef5fdc872e1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:12.359518 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c3de3f7d-22ac-4f53-88b5-23fd639ea1fe tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:12.375973 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c3de3f7d-22ac-4f53-88b5-23fd639ea1fe tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d" status: 200 len: 1493 microversion: 2.1 time: 0.750112 Jul 18 02:39:12.377431 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1992/3978] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:11 2022] GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d => generated 1493 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:12.973914 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-15babcf5-c10a-4f23-9956-cef5fdc872e1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:12.989282 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-15babcf5-c10a-4f23-9956-cef5fdc872e1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:13.000507 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-15babcf5-c10a-4f23-9956-cef5fdc872e1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:13.005450 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-15babcf5-c10a-4f23-9956-cef5fdc872e1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1751 microversion: 2.20 time: 1.078081 Jul 18 02:39:13.025742 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1987/3979] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:11 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1751 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:13.440816 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e8684d4a-728b-4c2f-b973-611537f80f3a tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:13.442795 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e8684d4a-728b-4c2f-b973-611537f80f3a tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: fdee1a08-4bd5-4b65-afc9-46c5b798ba0d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:13.499322 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e8684d4a-728b-4c2f-b973-611537f80f3a tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:13.500159 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e8684d4a-728b-4c2f-b973-611537f80f3a tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:13.502407 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e8684d4a-728b-4c2f-b973-611537f80f3a tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:13.508913 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e8684d4a-728b-4c2f-b973-611537f80f3a tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:14.035636 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3714ecc9-3f94-4fc1-9006-bc286898dcb4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:14.036849 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3714ecc9-3f94-4fc1-9006-bc286898dcb4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:14.067924 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3714ecc9-3f94-4fc1-9006-bc286898dcb4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:14.068933 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3714ecc9-3f94-4fc1-9006-bc286898dcb4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:14.069985 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3714ecc9-3f94-4fc1-9006-bc286898dcb4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:14.070582 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3714ecc9-3f94-4fc1-9006-bc286898dcb4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:14.474307 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e8684d4a-728b-4c2f-b973-611537f80f3a tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:14.500207 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e8684d4a-728b-4c2f-b973-611537f80f3a tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d" status: 200 len: 1493 microversion: 2.1 time: 1.093603 Jul 18 02:39:14.502364 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1993/3980] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:13 2022] GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d => generated 1493 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:14.646118 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3714ecc9-3f94-4fc1-9006-bc286898dcb4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:14.672580 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3714ecc9-3f94-4fc1-9006-bc286898dcb4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:14.693943 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3714ecc9-3f94-4fc1-9006-bc286898dcb4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:14.705780 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3714ecc9-3f94-4fc1-9006-bc286898dcb4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1751 microversion: 2.20 time: 0.674311 Jul 18 02:39:14.709927 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1988/3981] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:14 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1751 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:15.538998 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fdfdf47d-52de-4b26-ac00-48fa0de725d4 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:15.540866 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fdfdf47d-52de-4b26-ac00-48fa0de725d4 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: fdee1a08-4bd5-4b65-afc9-46c5b798ba0d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:15.541745 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e0b9b613-25da-4258-8cf0-3df98ab0f2a0 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-935967934", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "50eca4b7-7cf5-4855-842c-efaae85ced84"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:15.579600 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fdfdf47d-52de-4b26-ac00-48fa0de725d4 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:15.583042 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fdfdf47d-52de-4b26-ac00-48fa0de725d4 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:15.584659 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fdfdf47d-52de-4b26-ac00-48fa0de725d4 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:15.585462 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fdfdf47d-52de-4b26-ac00-48fa0de725d4 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:15.761348 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-e0b9b613-25da-4258-8cf0-3df98ab0f2a0 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] validate_networks() for [('50eca4b7-7cf5-4855-842c-efaae85ced84', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:39:17.985756 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fdfdf47d-52de-4b26-ac00-48fa0de725d4 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:18.028016 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fdfdf47d-52de-4b26-ac00-48fa0de725d4 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d" status: 200 len: 1499 microversion: 2.1 time: 2.497834 Jul 18 02:39:18.032697 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1989/3982] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:15 2022] GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d => generated 1499 bytes in 2504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:39:18.056572 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b8cc31cc-33fa-4af3-ae31-4068450bc5aa tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:18.059390 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b8cc31cc-33fa-4af3-ae31-4068450bc5aa tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:18.132454 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b8cc31cc-33fa-4af3-ae31-4068450bc5aa tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:18.161668 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b8cc31cc-33fa-4af3-ae31-4068450bc5aa tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:18.179409 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b8cc31cc-33fa-4af3-ae31-4068450bc5aa tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:18.190040 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b8cc31cc-33fa-4af3-ae31-4068450bc5aa tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:19.487142 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b8cc31cc-33fa-4af3-ae31-4068450bc5aa tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:19.500687 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b8cc31cc-33fa-4af3-ae31-4068450bc5aa tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:19.512726 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b8cc31cc-33fa-4af3-ae31-4068450bc5aa tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:19.516010 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b8cc31cc-33fa-4af3-ae31-4068450bc5aa tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1807 microversion: 2.20 time: 1.479592 Jul 18 02:39:19.536722 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1990/3983] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:18 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1807 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:19.569474 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-531d16ca-9a6b-4f92-9050-f9fdee5cacf9 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:19.570358 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-531d16ca-9a6b-4f92-9050-f9fdee5cacf9 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: fdee1a08-4bd5-4b65-afc9-46c5b798ba0d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:19.580063 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-531d16ca-9a6b-4f92-9050-f9fdee5cacf9 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:19.581439 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-531d16ca-9a6b-4f92-9050-f9fdee5cacf9 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:19.582543 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-531d16ca-9a6b-4f92-9050-f9fdee5cacf9 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:19.583317 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-531d16ca-9a6b-4f92-9050-f9fdee5cacf9 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:19.620393 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-531d16ca-9a6b-4f92-9050-f9fdee5cacf9 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: fdee1a08-4bd5-4b65-afc9-46c5b798ba0d] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:39:19.727048 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-e0b9b613-25da-4258-8cf0-3df98ab0f2a0 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:39:19.728886 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-e0b9b613-25da-4258-8cf0-3df98ab0f2a0 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:39:19.730650 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-e0b9b613-25da-4258-8cf0-3df98ab0f2a0 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:39:19.732672 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-e0b9b613-25da-4258-8cf0-3df98ab0f2a0 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:39:19.735843 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-e0b9b613-25da-4258-8cf0-3df98ab0f2a0 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:39:19.798796 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-531d16ca-9a6b-4f92-9050-f9fdee5cacf9 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "DELETE /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d" status: 204 len: 0 microversion: 2.1 time: 0.260280 Jul 18 02:39:19.800230 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1991/3984] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:39:19 2022] DELETE /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:39:19.807272 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e0b9b613-25da-4258-8cf0-3df98ab0f2a0 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:19.812595 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e0b9b613-25da-4258-8cf0-3df98ab0f2a0 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:19.815547 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e0b9b613-25da-4258-8cf0-3df98ab0f2a0 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:19.817995 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-da503624-9a75-4792-aa97-aa8b24a14729 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:19.825270 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-da503624-9a75-4792-aa97-aa8b24a14729 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: fdee1a08-4bd5-4b65-afc9-46c5b798ba0d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:19.834742 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e0b9b613-25da-4258-8cf0-3df98ab0f2a0 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:19.842127 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-da503624-9a75-4792-aa97-aa8b24a14729 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:19.842949 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-da503624-9a75-4792-aa97-aa8b24a14729 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:19.846746 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-da503624-9a75-4792-aa97-aa8b24a14729 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:19.848357 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-da503624-9a75-4792-aa97-aa8b24a14729 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:19.946533 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=92,nova_cell1:UPDATE=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:20.004072 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-e0b9b613-25da-4258-8cf0-3df98ab0f2a0 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Getting quotas for project 4b674b176eb24ca1956e2165c1f6eeb3. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:39:20.048688 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-e0b9b613-25da-4258-8cf0-3df98ab0f2a0 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Getting quotas for user 1a722484c55d4003a3c3637bb35ce87a and project 4b674b176eb24ca1956e2165c1f6eeb3. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:39:20.080066 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e0b9b613-25da-4258-8cf0-3df98ab0f2a0 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:39:20.090510 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e0b9b613-25da-4258-8cf0-3df98ab0f2a0 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] [instance: 85864d4e-3b46-4275-8ca7-5050fd3338af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:39:20.283815 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e0b9b613-25da-4258-8cf0-3df98ab0f2a0 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 4.952682 Jul 18 02:39:20.299468 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1994/3985] 10.222.0.57 () {62 vars in 1187 bytes} [Mon Jul 18 02:39:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 4969 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 18 02:39:20.305404 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4a0f4c12-8841-4579-8092-1c0593759ac9 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:20.322292 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4a0f4c12-8841-4579-8092-1c0593759ac9 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] [instance: 85864d4e-3b46-4275-8ca7-5050fd3338af] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:20.617446 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4a0f4c12-8841-4579-8092-1c0593759ac9 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:20.636798 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4a0f4c12-8841-4579-8092-1c0593759ac9 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:20.638973 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4a0f4c12-8841-4579-8092-1c0593759ac9 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:20.642374 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4a0f4c12-8841-4579-8092-1c0593759ac9 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] 10.222.0.57 "GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af" status: 200 len: 1261 microversion: 2.26 time: 0.341228 Jul 18 02:39:20.643393 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1995/3986] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:20 2022] GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af => generated 1261 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:20.675204 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-39973cc4-a098-4fb9-a2b7-767c0b241135 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:20.676237 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-39973cc4-a098-4fb9-a2b7-767c0b241135 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:20.697519 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-39973cc4-a098-4fb9-a2b7-767c0b241135 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:20.698360 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-39973cc4-a098-4fb9-a2b7-767c0b241135 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:20.699706 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-39973cc4-a098-4fb9-a2b7-767c0b241135 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:20.700373 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-39973cc4-a098-4fb9-a2b7-767c0b241135 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:20.856511 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-da503624-9a75-4792-aa97-aa8b24a14729 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:20.915313 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-da503624-9a75-4792-aa97-aa8b24a14729 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d" status: 200 len: 1505 microversion: 2.1 time: 1.108935 Jul 18 02:39:20.946915 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1992/3987] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:19 2022] GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d => generated 1505 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:39:21.693917 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-819cb6b8-8e71-4671-973c-8be61c2c82b1 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:21.695104 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-819cb6b8-8e71-4671-973c-8be61c2c82b1 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] [instance: 85864d4e-3b46-4275-8ca7-5050fd3338af] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:22.097245 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-39973cc4-a098-4fb9-a2b7-767c0b241135 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:22.205303 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-39973cc4-a098-4fb9-a2b7-767c0b241135 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:22.269930 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-39973cc4-a098-4fb9-a2b7-767c0b241135 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:22.280673 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-39973cc4-a098-4fb9-a2b7-767c0b241135 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1807 microversion: 2.20 time: 1.629803 Jul 18 02:39:22.290927 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-819cb6b8-8e71-4671-973c-8be61c2c82b1 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:22.294471 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1996/3988] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:20 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1807 bytes in 1650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:22.332898 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-819cb6b8-8e71-4671-973c-8be61c2c82b1 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:22.336308 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0bcb2d8a-65e5-430a-b34c-313417b28bb2 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:22.338966 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-819cb6b8-8e71-4671-973c-8be61c2c82b1 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:22.347103 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-819cb6b8-8e71-4671-973c-8be61c2c82b1 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] 10.222.0.57 "GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af" status: 200 len: 1261 microversion: 2.26 time: 0.668373 Jul 18 02:39:22.350802 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0bcb2d8a-65e5-430a-b34c-313417b28bb2 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: fdee1a08-4bd5-4b65-afc9-46c5b798ba0d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:22.353422 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1993/3989] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:21 2022] GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af => generated 1261 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:22.422101 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0bcb2d8a-65e5-430a-b34c-313417b28bb2 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:22.424941 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0bcb2d8a-65e5-430a-b34c-313417b28bb2 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:22.428253 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0bcb2d8a-65e5-430a-b34c-313417b28bb2 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:22.428979 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0bcb2d8a-65e5-430a-b34c-313417b28bb2 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:23.333553 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-636149a8-2328-4efb-8c9c-5f2a6739c722 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:23.336768 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-636149a8-2328-4efb-8c9c-5f2a6739c722 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:23.365198 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-636149a8-2328-4efb-8c9c-5f2a6739c722 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:23.368912 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-636149a8-2328-4efb-8c9c-5f2a6739c722 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:23.371182 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-636149a8-2328-4efb-8c9c-5f2a6739c722 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:23.379996 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-636149a8-2328-4efb-8c9c-5f2a6739c722 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:24.306785 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0bcb2d8a-65e5-430a-b34c-313417b28bb2 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:24.356909 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0bcb2d8a-65e5-430a-b34c-313417b28bb2 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d" status: 200 len: 1505 microversion: 2.1 time: 2.058060 Jul 18 02:39:24.360379 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1997/3990] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:22 2022] GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d => generated 1505 bytes in 2065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:24.394039 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-597716b0-732a-49bd-ac95-1eb13814c4b6 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:24.396545 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-597716b0-732a-49bd-ac95-1eb13814c4b6 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] [instance: 85864d4e-3b46-4275-8ca7-5050fd3338af] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:24.404412 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:24.431745 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-597716b0-732a-49bd-ac95-1eb13814c4b6 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:24.442638 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-597716b0-732a-49bd-ac95-1eb13814c4b6 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:24.449414 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-597716b0-732a-49bd-ac95-1eb13814c4b6 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:24.461883 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-597716b0-732a-49bd-ac95-1eb13814c4b6 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:25.395505 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-597716b0-732a-49bd-ac95-1eb13814c4b6 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:25.493243 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-597716b0-732a-49bd-ac95-1eb13814c4b6 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:25.508958 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-597716b0-732a-49bd-ac95-1eb13814c4b6 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:25.522847 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-636149a8-2328-4efb-8c9c-5f2a6739c722 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:25.526230 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-597716b0-732a-49bd-ac95-1eb13814c4b6 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] 10.222.0.57 "GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af" status: 200 len: 1321 microversion: 2.26 time: 1.131534 Jul 18 02:39:25.529587 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1998/3991] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:24 2022] GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af => generated 1321 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:25.545208 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1cba60f8-0a21-4d6c-aefe-36d618d81d67 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:25.550699 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1cba60f8-0a21-4d6c-aefe-36d618d81d67 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: fdee1a08-4bd5-4b65-afc9-46c5b798ba0d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:25.566318 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-636149a8-2328-4efb-8c9c-5f2a6739c722 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:25.570787 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-636149a8-2328-4efb-8c9c-5f2a6739c722 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:25.582604 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1cba60f8-0a21-4d6c-aefe-36d618d81d67 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:25.590729 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1cba60f8-0a21-4d6c-aefe-36d618d81d67 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:25.590729 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1cba60f8-0a21-4d6c-aefe-36d618d81d67 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:25.590729 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1cba60f8-0a21-4d6c-aefe-36d618d81d67 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:25.606669 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-636149a8-2328-4efb-8c9c-5f2a6739c722 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1807 microversion: 2.20 time: 2.277263 Jul 18 02:39:25.607720 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1994/3992] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:23 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1807 bytes in 2286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:26.559465 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-65a6522f-7bcf-4772-a99a-5bf5982f8ead tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:26.564120 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-65a6522f-7bcf-4772-a99a-5bf5982f8ead tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] [instance: 85864d4e-3b46-4275-8ca7-5050fd3338af] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:26.623214 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-65a6522f-7bcf-4772-a99a-5bf5982f8ead tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:26.623214 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-65a6522f-7bcf-4772-a99a-5bf5982f8ead tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:26.623214 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-65a6522f-7bcf-4772-a99a-5bf5982f8ead tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:26.626154 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-65a6522f-7bcf-4772-a99a-5bf5982f8ead tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:27.177370 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1cba60f8-0a21-4d6c-aefe-36d618d81d67 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:27.191273 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1cba60f8-0a21-4d6c-aefe-36d618d81d67 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d" status: 200 len: 1505 microversion: 2.1 time: 1.658999 Jul 18 02:39:27.199907 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 1999/3993] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:25 2022] GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d => generated 1505 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:27.221426 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8373fca4-27fd-483a-bc4e-0224ac1cbf78 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:27.233577 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8373fca4-27fd-483a-bc4e-0224ac1cbf78 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:27.328416 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8373fca4-27fd-483a-bc4e-0224ac1cbf78 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:27.329318 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8373fca4-27fd-483a-bc4e-0224ac1cbf78 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.055s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:27.330295 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8373fca4-27fd-483a-bc4e-0224ac1cbf78 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:27.330874 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8373fca4-27fd-483a-bc4e-0224ac1cbf78 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:27.692023 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-65a6522f-7bcf-4772-a99a-5bf5982f8ead tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:27.738763 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-65a6522f-7bcf-4772-a99a-5bf5982f8ead tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:27.750085 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-65a6522f-7bcf-4772-a99a-5bf5982f8ead tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:27.758228 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-65a6522f-7bcf-4772-a99a-5bf5982f8ead tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] 10.222.0.57 "GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af" status: 200 len: 1319 microversion: 2.26 time: 1.202528 Jul 18 02:39:27.762106 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1995/3994] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:26 2022] GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af => generated 1319 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:27.785150 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-fa3d1d24-e0d7-474c-9ac1-97639c7fa23f req-d7ebfae2-918e-4412-8024-926984d775cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdee1a08-4bd5-4b65-afc9-46c5b798ba0d", "name": "network-vif-unplugged", "status": "completed", "tag": "6fb4b926-d001-4d15-8053-9c058c41f98e"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:27.815044 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-fa3d1d24-e0d7-474c-9ac1-97639c7fa23f req-d7ebfae2-918e-4412-8024-926984d775cf service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:27.815790 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-fa3d1d24-e0d7-474c-9ac1-97639c7fa23f req-d7ebfae2-918e-4412-8024-926984d775cf service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:27.830327 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-fa3d1d24-e0d7-474c-9ac1-97639c7fa23f req-d7ebfae2-918e-4412-8024-926984d775cf service nova] Creating event network-vif-unplugged:6fb4b926-d001-4d15-8053-9c058c41f98e for instance fdee1a08-4bd5-4b65-afc9-46c5b798ba0d on n-h2-465891-3 Jul 18 02:39:27.839752 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-fa3d1d24-e0d7-474c-9ac1-97639c7fa23f req-d7ebfae2-918e-4412-8024-926984d775cf service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073897 Jul 18 02:39:27.840814 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1996/3995] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:39:28.230751 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7504427b-8912-4501-820f-07ec5f970481 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:28.231809 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7504427b-8912-4501-820f-07ec5f970481 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: fdee1a08-4bd5-4b65-afc9-46c5b798ba0d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:28.265172 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7504427b-8912-4501-820f-07ec5f970481 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:28.273994 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7504427b-8912-4501-820f-07ec5f970481 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:28.275039 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7504427b-8912-4501-820f-07ec5f970481 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:28.275641 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7504427b-8912-4501-820f-07ec5f970481 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:28.892785 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8373fca4-27fd-483a-bc4e-0224ac1cbf78 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:28.919804 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8373fca4-27fd-483a-bc4e-0224ac1cbf78 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:28.930137 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8373fca4-27fd-483a-bc4e-0224ac1cbf78 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:28.937393 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8373fca4-27fd-483a-bc4e-0224ac1cbf78 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1807 microversion: 2.20 time: 1.728119 Jul 18 02:39:28.945517 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2000/3996] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:27 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1807 bytes in 1744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:28.951744 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-348f31bb-6164-44ef-8dee-728ca0c6f34d tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:28.952709 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-348f31bb-6164-44ef-8dee-728ca0c6f34d tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] [instance: 85864d4e-3b46-4275-8ca7-5050fd3338af] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:28.977135 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-348f31bb-6164-44ef-8dee-728ca0c6f34d tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:28.980877 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-348f31bb-6164-44ef-8dee-728ca0c6f34d tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:28.986859 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-348f31bb-6164-44ef-8dee-728ca0c6f34d tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:28.987606 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-348f31bb-6164-44ef-8dee-728ca0c6f34d tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:29.464849 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-348f31bb-6164-44ef-8dee-728ca0c6f34d tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:29.477531 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-348f31bb-6164-44ef-8dee-728ca0c6f34d tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:29.489772 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-348f31bb-6164-44ef-8dee-728ca0c6f34d tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:29.494117 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-348f31bb-6164-44ef-8dee-728ca0c6f34d tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] 10.222.0.57 "GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af" status: 200 len: 1361 microversion: 2.26 time: 0.546863 Jul 18 02:39:29.506514 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2001/3997] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:28 2022] GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af => generated 1361 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:29.631528 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7504427b-8912-4501-820f-07ec5f970481 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:29.654268 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7504427b-8912-4501-820f-07ec5f970481 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d" status: 200 len: 1505 microversion: 2.1 time: 1.430241 Jul 18 02:39:29.655163 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1997/3998] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:28 2022] GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d => generated 1505 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:39:29.963246 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a53b79fb-51f2-491d-8713-c53c02ab67a1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:29.965040 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a53b79fb-51f2-491d-8713-c53c02ab67a1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:29.982050 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:30.003581 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a53b79fb-51f2-491d-8713-c53c02ab67a1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:30.007104 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a53b79fb-51f2-491d-8713-c53c02ab67a1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:30.009355 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a53b79fb-51f2-491d-8713-c53c02ab67a1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:30.013525 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a53b79fb-51f2-491d-8713-c53c02ab67a1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:30.525251 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e3715da7-588e-417f-8e2a-94a164a7da60 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:30.525820 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e3715da7-588e-417f-8e2a-94a164a7da60 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] [instance: 85864d4e-3b46-4275-8ca7-5050fd3338af] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:30.543492 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e3715da7-588e-417f-8e2a-94a164a7da60 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:30.543956 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e3715da7-588e-417f-8e2a-94a164a7da60 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:30.544795 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e3715da7-588e-417f-8e2a-94a164a7da60 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:30.545251 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e3715da7-588e-417f-8e2a-94a164a7da60 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:30.629187 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=8 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:32.096136 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 02:39:32.096854 n-d-465891-3 devstack@n-api.service[119544]: Mon Jul 18 02:39:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 (ip 10.222.0.57) !!! Jul 18 02:39:32.191636 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a53b79fb-51f2-491d-8713-c53c02ab67a1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:32.212409 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a53b79fb-51f2-491d-8713-c53c02ab67a1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:32.214986 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a53b79fb-51f2-491d-8713-c53c02ab67a1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:32.216541 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a53b79fb-51f2-491d-8713-c53c02ab67a1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1807 microversion: 2.20 time: 2.257774 Jul 18 02:39:32.241471 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2002/3999] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:29 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1807 bytes in 2283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:32.277663 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0cd87e1c-b47f-4ec0-b240-02f401601699 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:32.279179 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0cd87e1c-b47f-4ec0-b240-02f401601699 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: fdee1a08-4bd5-4b65-afc9-46c5b798ba0d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:32.329580 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:32.366343 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0cd87e1c-b47f-4ec0-b240-02f401601699 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:32.367044 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0cd87e1c-b47f-4ec0-b240-02f401601699 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:32.372620 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0cd87e1c-b47f-4ec0-b240-02f401601699 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:32.375289 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0cd87e1c-b47f-4ec0-b240-02f401601699 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:32.465878 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-0cd87e1c-b47f-4ec0-b240-02f401601699 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] HTTP exception thrown: Instance fdee1a08-4bd5-4b65-afc9-46c5b798ba0d could not be found. Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0cd87e1c-b47f-4ec0-b240-02f401601699 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Request method failure captured: Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d HTTP/1.1 Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MdILYMx6ORU4Zdd50QdrKLyOuaon0PyPmKf5EXSCfabiYWOAwErAOblzJX5BEAW7qp4rCGfAbSvv5vYohXHdQjGqCY76FD1NvX4aeSJnkkYhZMa5ZP89aVjSMFztlczbQCl1PcYnwlj7nvc3tICXzaQo9hk_ljtEr9JiXaD_l1wdVo Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: c127c80896564bbaa6b36fb919f22b8b Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServerRescueTestJSON-66869915 Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c127c80896564bbaa6b36fb919f22b8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c127c80896564bbaa6b36fb919f22b8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c127c80896564bbaa6b36fb919f22b8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c127c80896564bbaa6b36fb919f22b8b"}]}] Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServerRescueTestJSON-66869915 Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: c127c80896564bbaa6b36fb919f22b8b Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServerRescueTestJSON-66869915 Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServerRescueTestJSON-66869915-project Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: ceb7f59020ba46ed99897971ebfb84c3 Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServerRescueTestJSON-66869915-project Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance fdee1a08-4bd5-4b65-afc9-46c5b798ba0d could not be found. Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'fdee1a08-4bd5-4b65-afc9-46c5b798ba0d'} Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdee1a08-4bd5-4b65-afc9-46c5b798ba0d could not be found. Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdee1a08-4bd5-4b65-afc9-46c5b798ba0d could not be found. Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:32.467845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:39:32.478677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:32.478677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:32.478677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:32.478677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:39:32.478677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:39:32.478677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdee1a08-4bd5-4b65-afc9-46c5b798ba0d could not be found. Jul 18 02:39:32.478677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:39:32.478677 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0cd87e1c-b47f-4ec0-b240-02f401601699 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Returning 404 to user: Instance fdee1a08-4bd5-4b65-afc9-46c5b798ba0d could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:39:32.478677 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0cd87e1c-b47f-4ec0-b240-02f401601699 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d" status: 404 len: 111 microversion: 2.1 time: 0.234335 Jul 18 02:39:32.478677 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2003/4000] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:32 2022] GET /compute/v2.1/servers/fdee1a08-4bd5-4b65-afc9-46c5b798ba0d => generated 111 bytes in 236 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:39:32.502423 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-6d18cbbe-9d8e-4d72-98b1-87d8bb10982c req-2dbed829-53cb-4e30-934c-84dfc46a2efc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdee1a08-4bd5-4b65-afc9-46c5b798ba0d", "name": "network-vif-deleted", "tag": "6fb4b926-d001-4d15-8053-9c058c41f98e"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:32.535733 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e3715da7-588e-417f-8e2a-94a164a7da60 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:32.555502 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e3715da7-588e-417f-8e2a-94a164a7da60 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:32.562398 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-6d18cbbe-9d8e-4d72-98b1-87d8bb10982c req-2dbed829-53cb-4e30-934c-84dfc46a2efc service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:32.572731 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e3715da7-588e-417f-8e2a-94a164a7da60 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:32.575983 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e3715da7-588e-417f-8e2a-94a164a7da60 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] 10.222.0.57 "GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af" status: 200 len: 1361 microversion: 2.26 time: 2.055085 Jul 18 02:39:32.576991 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-6d18cbbe-9d8e-4d72-98b1-87d8bb10982c req-2dbed829-53cb-4e30-934c-84dfc46a2efc service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:32.590740 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1998/4001] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:30 2022] GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af => generated 1361 bytes in 2071 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:39:32.599033 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ee4a9862-f9af-4ef1-98c0-3e73ee5205cf tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:32.627674 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ee4a9862-f9af-4ef1-98c0-3e73ee5205cf tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: 5a35d492-b3d5-4fc8-8b1d-4629b95fde09] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:32.639009 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-6d18cbbe-9d8e-4d72-98b1-87d8bb10982c req-2dbed829-53cb-4e30-934c-84dfc46a2efc service nova] Creating event network-vif-deleted:6fb4b926-d001-4d15-8053-9c058c41f98e for instance fdee1a08-4bd5-4b65-afc9-46c5b798ba0d on n-h2-465891-3 Jul 18 02:39:32.663766 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ee4a9862-f9af-4ef1-98c0-3e73ee5205cf tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:32.664596 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ee4a9862-f9af-4ef1-98c0-3e73ee5205cf tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:32.669101 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ee4a9862-f9af-4ef1-98c0-3e73ee5205cf tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:32.674297 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-6d18cbbe-9d8e-4d72-98b1-87d8bb10982c req-2dbed829-53cb-4e30-934c-84dfc46a2efc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194337 Jul 18 02:39:32.675359 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ee4a9862-f9af-4ef1-98c0-3e73ee5205cf tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:32.681003 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2004/4002] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:39:32.702182 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-38e05d67-3884-418b-b126-e9088e4bd7ba req-8e847962-5855-428c-88b2-d8dfdcab7620 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85864d4e-3b46-4275-8ca7-5050fd3338af", "tag": "43b9d5ee-e342-4562-a544-a7ffad4a2ea2"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:32.749074 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-38e05d67-3884-418b-b126-e9088e4bd7ba req-8e847962-5855-428c-88b2-d8dfdcab7620 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:32.759178 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-38e05d67-3884-418b-b126-e9088e4bd7ba req-8e847962-5855-428c-88b2-d8dfdcab7620 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:32.823026 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ee4a9862-f9af-4ef1-98c0-3e73ee5205cf tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: 5a35d492-b3d5-4fc8-8b1d-4629b95fde09] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:39:32.835118 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-38e05d67-3884-418b-b126-e9088e4bd7ba req-8e847962-5855-428c-88b2-d8dfdcab7620 service nova] Creating event network-changed:43b9d5ee-e342-4562-a544-a7ffad4a2ea2 for instance 85864d4e-3b46-4275-8ca7-5050fd3338af on n-h1-465891-3 Jul 18 02:39:32.859854 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-38e05d67-3884-418b-b126-e9088e4bd7ba req-8e847962-5855-428c-88b2-d8dfdcab7620 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174208 Jul 18 02:39:32.872561 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2005/4003] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:39:32.974220 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:33.258457 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ee4a9862-f9af-4ef1-98c0-3e73ee5205cf tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "DELETE /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09" status: 204 len: 0 microversion: 2.1 time: 0.658834 Jul 18 02:39:33.260478 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 1999/4004] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:39:32 2022] DELETE /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:39:33.277716 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-752a03fe-534a-41a4-9b4e-0e3742d8d873 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:33.284740 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-752a03fe-534a-41a4-9b4e-0e3742d8d873 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:33.301823 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-50f1d154-5abb-47fe-81b3-183cf0677a08 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:33.303214 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-50f1d154-5abb-47fe-81b3-183cf0677a08 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: 5a35d492-b3d5-4fc8-8b1d-4629b95fde09] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:33.337136 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-50f1d154-5abb-47fe-81b3-183cf0677a08 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:33.337894 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-50f1d154-5abb-47fe-81b3-183cf0677a08 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:33.338009 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-752a03fe-534a-41a4-9b4e-0e3742d8d873 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:33.341139 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-752a03fe-534a-41a4-9b4e-0e3742d8d873 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:33.346064 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-752a03fe-534a-41a4-9b4e-0e3742d8d873 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:33.350073 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-752a03fe-534a-41a4-9b4e-0e3742d8d873 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:33.354416 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-50f1d154-5abb-47fe-81b3-183cf0677a08 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:33.355921 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-50f1d154-5abb-47fe-81b3-183cf0677a08 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:34.925631 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-752a03fe-534a-41a4-9b4e-0e3742d8d873 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:34.970387 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-50f1d154-5abb-47fe-81b3-183cf0677a08 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:35.014938 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-50f1d154-5abb-47fe-81b3-183cf0677a08 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09" status: 200 len: 1492 microversion: 2.1 time: 1.743893 Jul 18 02:39:35.021871 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2000/4005] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:33 2022] GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09 => generated 1492 bytes in 1752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:35.037271 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0d2804df-b98c-4cb8-a7a5-b7bd8fa81bcc tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:35.051438 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0d2804df-b98c-4cb8-a7a5-b7bd8fa81bcc tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] [instance: 85864d4e-3b46-4275-8ca7-5050fd3338af] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:35.055364 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-752a03fe-534a-41a4-9b4e-0e3742d8d873 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:35.064249 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-752a03fe-534a-41a4-9b4e-0e3742d8d873 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:35.070353 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-752a03fe-534a-41a4-9b4e-0e3742d8d873 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1807 microversion: 2.20 time: 1.808913 Jul 18 02:39:35.075993 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2006/4006] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:33 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1807 bytes in 1816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:35.106152 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:35.113675 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0d2804df-b98c-4cb8-a7a5-b7bd8fa81bcc tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:35.113675 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0d2804df-b98c-4cb8-a7a5-b7bd8fa81bcc tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:35.114576 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0d2804df-b98c-4cb8-a7a5-b7bd8fa81bcc tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:35.115470 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0d2804df-b98c-4cb8-a7a5-b7bd8fa81bcc tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:35.736519 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0d2804df-b98c-4cb8-a7a5-b7bd8fa81bcc tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:35.751503 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0d2804df-b98c-4cb8-a7a5-b7bd8fa81bcc tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:35.757040 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0d2804df-b98c-4cb8-a7a5-b7bd8fa81bcc tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:35.762397 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0d2804df-b98c-4cb8-a7a5-b7bd8fa81bcc tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] 10.222.0.57 "GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af" status: 200 len: 1361 microversion: 2.26 time: 0.735256 Jul 18 02:39:35.763612 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2001/4007] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:35 2022] GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af => generated 1361 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:36.053517 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3959d5d1-5ac7-4438-b9e9-ac0b35ce8fa9 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:36.056120 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3959d5d1-5ac7-4438-b9e9-ac0b35ce8fa9 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: 5a35d492-b3d5-4fc8-8b1d-4629b95fde09] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:36.069755 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3959d5d1-5ac7-4438-b9e9-ac0b35ce8fa9 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:36.070583 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3959d5d1-5ac7-4438-b9e9-ac0b35ce8fa9 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:36.071897 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3959d5d1-5ac7-4438-b9e9-ac0b35ce8fa9 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:36.072685 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3959d5d1-5ac7-4438-b9e9-ac0b35ce8fa9 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:36.108994 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2848016a-acfc-4b55-8904-400feed805c1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:36.111854 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2848016a-acfc-4b55-8904-400feed805c1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:36.138668 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2848016a-acfc-4b55-8904-400feed805c1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:36.145908 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2848016a-acfc-4b55-8904-400feed805c1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:36.151729 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2848016a-acfc-4b55-8904-400feed805c1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:36.156127 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2848016a-acfc-4b55-8904-400feed805c1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:37.595997 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3959d5d1-5ac7-4438-b9e9-ac0b35ce8fa9 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:37.612118 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3959d5d1-5ac7-4438-b9e9-ac0b35ce8fa9 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09" status: 200 len: 1492 microversion: 2.1 time: 1.566154 Jul 18 02:39:37.613530 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2007/4008] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:36 2022] GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09 => generated 1492 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:37.620077 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2848016a-acfc-4b55-8904-400feed805c1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:37.626173 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7379fb47-8889-4c92-b07a-2a5ea9ecca27 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:37.631264 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7379fb47-8889-4c92-b07a-2a5ea9ecca27 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] [instance: 85864d4e-3b46-4275-8ca7-5050fd3338af] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:37.649992 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7379fb47-8889-4c92-b07a-2a5ea9ecca27 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:37.650668 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7379fb47-8889-4c92-b07a-2a5ea9ecca27 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:37.652532 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7379fb47-8889-4c92-b07a-2a5ea9ecca27 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:37.653595 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7379fb47-8889-4c92-b07a-2a5ea9ecca27 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:37.668450 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2848016a-acfc-4b55-8904-400feed805c1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:37.676621 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2848016a-acfc-4b55-8904-400feed805c1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:37.682395 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2848016a-acfc-4b55-8904-400feed805c1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1807 microversion: 2.20 time: 1.580469 Jul 18 02:39:37.690012 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2002/4009] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:36 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1807 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:38.047954 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7379fb47-8889-4c92-b07a-2a5ea9ecca27 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:38.066571 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7379fb47-8889-4c92-b07a-2a5ea9ecca27 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:38.072380 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7379fb47-8889-4c92-b07a-2a5ea9ecca27 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:38.077215 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7379fb47-8889-4c92-b07a-2a5ea9ecca27 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] 10.222.0.57 "GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af" status: 200 len: 1361 microversion: 2.26 time: 0.462196 Jul 18 02:39:38.082356 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2008/4010] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:37 2022] GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af => generated 1361 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:38.445693 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-dbd4100a-27ef-4daf-ae2f-9a60662888eb req-1d996798-624c-4b07-b3a2-61ded87b9bb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a35d492-b3d5-4fc8-8b1d-4629b95fde09", "name": "network-vif-deleted", "tag": "255c6f05-e3dd-49b3-9e22-88b80e4ac186"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:38.531561 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-dbd4100a-27ef-4daf-ae2f-9a60662888eb req-1d996798-624c-4b07-b3a2-61ded87b9bb0 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:38.534327 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-dbd4100a-27ef-4daf-ae2f-9a60662888eb req-1d996798-624c-4b07-b3a2-61ded87b9bb0 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:38.588112 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-dbd4100a-27ef-4daf-ae2f-9a60662888eb req-1d996798-624c-4b07-b3a2-61ded87b9bb0 service nova] Creating event network-vif-deleted:255c6f05-e3dd-49b3-9e22-88b80e4ac186 for instance 5a35d492-b3d5-4fc8-8b1d-4629b95fde09 on n-h2-465891-3 Jul 18 02:39:38.633296 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-dbd4100a-27ef-4daf-ae2f-9a60662888eb req-1d996798-624c-4b07-b3a2-61ded87b9bb0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181713 Jul 18 02:39:38.638849 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c1d7757a-5ec8-4b69-90e0-7843d8c95153 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:38.639537 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c1d7757a-5ec8-4b69-90e0-7843d8c95153 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: 5a35d492-b3d5-4fc8-8b1d-4629b95fde09] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:38.642406 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2003/4011] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:39:38.685099 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c1d7757a-5ec8-4b69-90e0-7843d8c95153 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:38.689263 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c1d7757a-5ec8-4b69-90e0-7843d8c95153 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:38.691959 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c1d7757a-5ec8-4b69-90e0-7843d8c95153 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:38.692978 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c1d7757a-5ec8-4b69-90e0-7843d8c95153 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:38.709113 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-531ff3a6-25bf-4725-8d40-a0b99f205022 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:38.727340 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-531ff3a6-25bf-4725-8d40-a0b99f205022 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:38.764645 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-531ff3a6-25bf-4725-8d40-a0b99f205022 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:38.765345 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-531ff3a6-25bf-4725-8d40-a0b99f205022 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:38.797476 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-531ff3a6-25bf-4725-8d40-a0b99f205022 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:38.801639 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-531ff3a6-25bf-4725-8d40-a0b99f205022 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:38.962914 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c1d7757a-5ec8-4b69-90e0-7843d8c95153 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceb7f59020ba46ed99897971ebfb84c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127c80896564bbaa6b36fb919f22b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:38.983293 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c1d7757a-5ec8-4b69-90e0-7843d8c95153 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09" status: 200 len: 1285 microversion: 2.1 time: 0.349960 Jul 18 02:39:38.986016 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2009/4012] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:38 2022] GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09 => generated 1285 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:39.107579 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-340276f4-405b-4d7b-a9fa-78f14102a915 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:39.108021 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-340276f4-405b-4d7b-a9fa-78f14102a915 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] [instance: 85864d4e-3b46-4275-8ca7-5050fd3338af] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:39.140076 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-340276f4-405b-4d7b-a9fa-78f14102a915 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:39.140686 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-340276f4-405b-4d7b-a9fa-78f14102a915 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:39.151910 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-340276f4-405b-4d7b-a9fa-78f14102a915 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:39.154558 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-340276f4-405b-4d7b-a9fa-78f14102a915 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:39.383506 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-531ff3a6-25bf-4725-8d40-a0b99f205022 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:39.405248 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-531ff3a6-25bf-4725-8d40-a0b99f205022 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:39.407006 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-531ff3a6-25bf-4725-8d40-a0b99f205022 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:39.408409 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-531ff3a6-25bf-4725-8d40-a0b99f205022 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1807 microversion: 2.20 time: 0.708779 Jul 18 02:39:39.426330 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2004/4013] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:38 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1807 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:39.871899 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-340276f4-405b-4d7b-a9fa-78f14102a915 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:39.899894 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-340276f4-405b-4d7b-a9fa-78f14102a915 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:39.908524 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-340276f4-405b-4d7b-a9fa-78f14102a915 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:39.913478 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-340276f4-405b-4d7b-a9fa-78f14102a915 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] 10.222.0.57 "GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af" status: 200 len: 1361 microversion: 2.26 time: 0.811225 Jul 18 02:39:39.931983 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2010/4014] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:39 2022] GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af => generated 1361 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:39:40.003667 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-de39b4a0-db34-4f06-8efd-dd27f3930556 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:40.005191 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-de39b4a0-db34-4f06-8efd-dd27f3930556 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] [instance: 5a35d492-b3d5-4fc8-8b1d-4629b95fde09] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:40.024644 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-de39b4a0-db34-4f06-8efd-dd27f3930556 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:40.025439 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-de39b4a0-db34-4f06-8efd-dd27f3930556 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:40.026496 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-de39b4a0-db34-4f06-8efd-dd27f3930556 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:40.028859 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-de39b4a0-db34-4f06-8efd-dd27f3930556 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:40.070123 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-de39b4a0-db34-4f06-8efd-dd27f3930556 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] HTTP exception thrown: Instance 5a35d492-b3d5-4fc8-8b1d-4629b95fde09 could not be found. Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-de39b4a0-db34-4f06-8efd-dd27f3930556 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Request method failure captured: Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09 HTTP/1.1 Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MdILYMx6ORU4Zdd50QdrKLyOuaon0PyPmKf5EXSCfabiYWOAwErAOblzJX5BEAW7qp4rCGfAbSvv5vYohXHdQjGqCY76FD1NvX4aeSJnkkYhZMa5ZP89aVjSMFztlczbQCl1PcYnwlj7nvc3tICXzaQo9hk_ljtEr9JiXaD_l1wdVo Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: c127c80896564bbaa6b36fb919f22b8b Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServerRescueTestJSON-66869915 Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c127c80896564bbaa6b36fb919f22b8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c127c80896564bbaa6b36fb919f22b8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c127c80896564bbaa6b36fb919f22b8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c127c80896564bbaa6b36fb919f22b8b"}]}] Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServerRescueTestJSON-66869915 Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: c127c80896564bbaa6b36fb919f22b8b Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServerRescueTestJSON-66869915 Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServerRescueTestJSON-66869915-project Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: ceb7f59020ba46ed99897971ebfb84c3 Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServerRescueTestJSON-66869915-project Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 5a35d492-b3d5-4fc8-8b1d-4629b95fde09 could not be found. Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '5a35d492-b3d5-4fc8-8b1d-4629b95fde09'} Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a35d492-b3d5-4fc8-8b1d-4629b95fde09 could not be found. Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a35d492-b3d5-4fc8-8b1d-4629b95fde09 could not be found. Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:40.079095 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:39:40.083877 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:40.083877 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:40.083877 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:40.083877 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:39:40.083877 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:39:40.083877 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a35d492-b3d5-4fc8-8b1d-4629b95fde09 could not be found. Jul 18 02:39:40.083877 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:39:40.083877 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-de39b4a0-db34-4f06-8efd-dd27f3930556 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] Returning 404 to user: Instance 5a35d492-b3d5-4fc8-8b1d-4629b95fde09 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:39:40.083877 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-de39b4a0-db34-4f06-8efd-dd27f3930556 tempest-ServerRescueTestJSON-66869915 tempest-ServerRescueTestJSON-66869915-project] 10.222.0.57 "GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09" status: 404 len: 111 microversion: 2.1 time: 0.082966 Jul 18 02:39:40.085201 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2005/4015] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:39 2022] GET /compute/v2.1/servers/5a35d492-b3d5-4fc8-8b1d-4629b95fde09 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:39:40.451598 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8b9655ea-c2a9-431b-8944-eb063c37c1fd tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:40.452901 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8b9655ea-c2a9-431b-8944-eb063c37c1fd tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:40.473913 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8b9655ea-c2a9-431b-8944-eb063c37c1fd tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:40.474814 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8b9655ea-c2a9-431b-8944-eb063c37c1fd tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:40.477423 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8b9655ea-c2a9-431b-8944-eb063c37c1fd tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:40.478344 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8b9655ea-c2a9-431b-8944-eb063c37c1fd tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:40.939649 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e0079320-ba19-46e2-ae78-27fac78cb319 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:40.940567 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e0079320-ba19-46e2-ae78-27fac78cb319 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] [instance: 85864d4e-3b46-4275-8ca7-5050fd3338af] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:40.968691 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e0079320-ba19-46e2-ae78-27fac78cb319 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:40.969740 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e0079320-ba19-46e2-ae78-27fac78cb319 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:40.973575 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e0079320-ba19-46e2-ae78-27fac78cb319 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:40.975625 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e0079320-ba19-46e2-ae78-27fac78cb319 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:41.510437 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8b9655ea-c2a9-431b-8944-eb063c37c1fd tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:41.572399 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8b9655ea-c2a9-431b-8944-eb063c37c1fd tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:41.601239 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8b9655ea-c2a9-431b-8944-eb063c37c1fd tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:41.613044 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8b9655ea-c2a9-431b-8944-eb063c37c1fd tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1807 microversion: 2.20 time: 1.164615 Jul 18 02:39:41.617381 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2011/4016] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:40 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1807 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:41.853938 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e0079320-ba19-46e2-ae78-27fac78cb319 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:41.908970 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e0079320-ba19-46e2-ae78-27fac78cb319 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:41.944796 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e0079320-ba19-46e2-ae78-27fac78cb319 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:41.957179 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e0079320-ba19-46e2-ae78-27fac78cb319 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] 10.222.0.57 "GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af" status: 200 len: 1361 microversion: 2.26 time: 1.018842 Jul 18 02:39:41.958533 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2006/4017] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:40 2022] GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af => generated 1361 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:42.658187 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2406edec-bb93-44ee-bd76-601261168f2b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:42.664627 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2406edec-bb93-44ee-bd76-601261168f2b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:42.728024 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-2e18bbed-6e5f-41ec-86ba-039e9bb360a0 req-d3566597-672c-46d8-b913-7bf00d6d2f65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85864d4e-3b46-4275-8ca7-5050fd3338af", "name": "network-vif-plugged", "status": "completed", "tag": "43b9d5ee-e342-4562-a544-a7ffad4a2ea2"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:42.733534 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2406edec-bb93-44ee-bd76-601261168f2b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:42.735795 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2406edec-bb93-44ee-bd76-601261168f2b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:42.744629 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2406edec-bb93-44ee-bd76-601261168f2b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:42.758248 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-2e18bbed-6e5f-41ec-86ba-039e9bb360a0 req-d3566597-672c-46d8-b913-7bf00d6d2f65 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:42.759631 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-2e18bbed-6e5f-41ec-86ba-039e9bb360a0 req-d3566597-672c-46d8-b913-7bf00d6d2f65 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:42.765627 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2406edec-bb93-44ee-bd76-601261168f2b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:42.799413 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-2e18bbed-6e5f-41ec-86ba-039e9bb360a0 req-d3566597-672c-46d8-b913-7bf00d6d2f65 service nova] Creating event network-vif-plugged:43b9d5ee-e342-4562-a544-a7ffad4a2ea2 for instance 85864d4e-3b46-4275-8ca7-5050fd3338af on n-h1-465891-3 Jul 18 02:39:42.821669 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-2e18bbed-6e5f-41ec-86ba-039e9bb360a0 req-d3566597-672c-46d8-b913-7bf00d6d2f65 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100140 Jul 18 02:39:42.827849 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2007/4018] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:39:42.986402 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-86a33fa2-56d6-41a1-8f43-e3f60ed22d68 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:42.998699 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-86a33fa2-56d6-41a1-8f43-e3f60ed22d68 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] [instance: 85864d4e-3b46-4275-8ca7-5050fd3338af] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:43.015172 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-86a33fa2-56d6-41a1-8f43-e3f60ed22d68 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:43.016001 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-86a33fa2-56d6-41a1-8f43-e3f60ed22d68 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:43.019414 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-86a33fa2-56d6-41a1-8f43-e3f60ed22d68 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:43.020494 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-86a33fa2-56d6-41a1-8f43-e3f60ed22d68 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:43.194114 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2406edec-bb93-44ee-bd76-601261168f2b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:43.211185 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2406edec-bb93-44ee-bd76-601261168f2b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:43.225491 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2406edec-bb93-44ee-bd76-601261168f2b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:43.230324 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2406edec-bb93-44ee-bd76-601261168f2b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1807 microversion: 2.20 time: 0.586054 Jul 18 02:39:43.241578 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2012/4019] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:42 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1807 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:43.313135 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-86a33fa2-56d6-41a1-8f43-e3f60ed22d68 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:43.330065 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-86a33fa2-56d6-41a1-8f43-e3f60ed22d68 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:43.331971 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-86a33fa2-56d6-41a1-8f43-e3f60ed22d68 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:43.335231 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-86a33fa2-56d6-41a1-8f43-e3f60ed22d68 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] 10.222.0.57 "GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af" status: 200 len: 1361 microversion: 2.26 time: 0.359906 Jul 18 02:39:43.337214 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2008/4020] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:42 2022] GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af => generated 1361 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:44.262575 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4044cd3a-af55-47c4-95ab-b94e94b12e59 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:44.263508 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4044cd3a-af55-47c4-95ab-b94e94b12e59 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:44.279887 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4044cd3a-af55-47c4-95ab-b94e94b12e59 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:44.280636 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4044cd3a-af55-47c4-95ab-b94e94b12e59 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:44.281873 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4044cd3a-af55-47c4-95ab-b94e94b12e59 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:44.282588 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4044cd3a-af55-47c4-95ab-b94e94b12e59 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:44.358824 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7ad5b704-0c8c-420b-a052-8c6f6c861ab4 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:44.359464 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7ad5b704-0c8c-420b-a052-8c6f6c861ab4 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] [instance: 85864d4e-3b46-4275-8ca7-5050fd3338af] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:44.374004 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7ad5b704-0c8c-420b-a052-8c6f6c861ab4 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:44.374470 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7ad5b704-0c8c-420b-a052-8c6f6c861ab4 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:44.375302 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7ad5b704-0c8c-420b-a052-8c6f6c861ab4 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:44.375748 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7ad5b704-0c8c-420b-a052-8c6f6c861ab4 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:45.103695 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7ad5b704-0c8c-420b-a052-8c6f6c861ab4 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:45.156087 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7ad5b704-0c8c-420b-a052-8c6f6c861ab4 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:45.162621 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7ad5b704-0c8c-420b-a052-8c6f6c861ab4 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:45.185108 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7ad5b704-0c8c-420b-a052-8c6f6c861ab4 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] 10.222.0.57 "GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af" status: 200 len: 1361 microversion: 2.26 time: 0.831588 Jul 18 02:39:45.190030 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2009/4021] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:44 2022] GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af => generated 1361 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:45.241194 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4044cd3a-af55-47c4-95ab-b94e94b12e59 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:45.325886 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4044cd3a-af55-47c4-95ab-b94e94b12e59 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:45.336939 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4044cd3a-af55-47c4-95ab-b94e94b12e59 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:45.338820 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4044cd3a-af55-47c4-95ab-b94e94b12e59 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1807 microversion: 2.20 time: 1.081373 Jul 18 02:39:45.346221 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2013/4022] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:44 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1807 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:46.260911 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c4af5c4a-a246-4384-a9fd-b618073bb9bd tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:46.265677 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c4af5c4a-a246-4384-a9fd-b618073bb9bd tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] [instance: 85864d4e-3b46-4275-8ca7-5050fd3338af] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:46.329536 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c4af5c4a-a246-4384-a9fd-b618073bb9bd tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:46.330506 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c4af5c4a-a246-4384-a9fd-b618073bb9bd tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:46.336466 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c4af5c4a-a246-4384-a9fd-b618073bb9bd tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:46.338067 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c4af5c4a-a246-4384-a9fd-b618073bb9bd tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:46.383937 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5c3cf0ae-dcb1-4702-a1bc-4c5bda0393c7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:46.387160 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5c3cf0ae-dcb1-4702-a1bc-4c5bda0393c7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:46.413017 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5c3cf0ae-dcb1-4702-a1bc-4c5bda0393c7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:46.426625 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5c3cf0ae-dcb1-4702-a1bc-4c5bda0393c7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:46.432802 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5c3cf0ae-dcb1-4702-a1bc-4c5bda0393c7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:46.442166 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5c3cf0ae-dcb1-4702-a1bc-4c5bda0393c7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:46.532446 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=100 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:48.704912 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c4af5c4a-a246-4384-a9fd-b618073bb9bd tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:48.748113 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c4af5c4a-a246-4384-a9fd-b618073bb9bd tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:48.757351 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c4af5c4a-a246-4384-a9fd-b618073bb9bd tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:48.770729 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c4af5c4a-a246-4384-a9fd-b618073bb9bd tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] 10.222.0.57 "GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af" status: 200 len: 1361 microversion: 2.26 time: 2.545409 Jul 18 02:39:48.806400 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2010/4023] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:46 2022] GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af => generated 1361 bytes in 2586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:48.883981 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5c3cf0ae-dcb1-4702-a1bc-4c5bda0393c7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:48.956656 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5c3cf0ae-dcb1-4702-a1bc-4c5bda0393c7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:48.982203 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5c3cf0ae-dcb1-4702-a1bc-4c5bda0393c7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:48.987137 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5c3cf0ae-dcb1-4702-a1bc-4c5bda0393c7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1807 microversion: 2.20 time: 2.612673 Jul 18 02:39:48.990119 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2014/4024] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:46 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1807 bytes in 2620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:39:49.818530 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-388359bd-579b-45c8-b715-6c4d7e5793cf tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:49.819832 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-388359bd-579b-45c8-b715-6c4d7e5793cf tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] [instance: 85864d4e-3b46-4275-8ca7-5050fd3338af] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:49.863836 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-388359bd-579b-45c8-b715-6c4d7e5793cf tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:49.864541 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-388359bd-579b-45c8-b715-6c4d7e5793cf tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:49.872002 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-388359bd-579b-45c8-b715-6c4d7e5793cf tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:49.872816 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-388359bd-579b-45c8-b715-6c4d7e5793cf tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:50.063684 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7dbc2e46-ea36-4c10-a73e-57697b3f0123 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:50.068892 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7dbc2e46-ea36-4c10-a73e-57697b3f0123 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:50.088890 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7dbc2e46-ea36-4c10-a73e-57697b3f0123 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:50.090390 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7dbc2e46-ea36-4c10-a73e-57697b3f0123 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:50.094841 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7dbc2e46-ea36-4c10-a73e-57697b3f0123 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:50.097573 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7dbc2e46-ea36-4c10-a73e-57697b3f0123 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:50.690505 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-388359bd-579b-45c8-b715-6c4d7e5793cf tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:50.703409 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-388359bd-579b-45c8-b715-6c4d7e5793cf tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:50.705327 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-388359bd-579b-45c8-b715-6c4d7e5793cf tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:50.713222 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-388359bd-579b-45c8-b715-6c4d7e5793cf tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] 10.222.0.57 "GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af" status: 200 len: 1546 microversion: 2.26 time: 0.904782 Jul 18 02:39:50.714887 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2011/4025] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:49 2022] GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af => generated 1546 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:50.756738 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ce894a32-657a-4be9-a3e3-04421e9bf6af tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Calling method '.version_select at 0x7ff49b9b5940>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:50.766796 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ce894a32-657a-4be9-a3e3-04421e9bf6af tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:50.767734 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ce894a32-657a-4be9-a3e3-04421e9bf6af tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:50.768457 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ce894a32-657a-4be9-a3e3-04421e9bf6af tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] [instance: 85864d4e-3b46-4275-8ca7-5050fd3338af] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:50.775381 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ce894a32-657a-4be9-a3e3-04421e9bf6af tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:50.776136 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ce894a32-657a-4be9-a3e3-04421e9bf6af tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:50.778237 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ce894a32-657a-4be9-a3e3-04421e9bf6af tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:50.779049 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ce894a32-657a-4be9-a3e3-04421e9bf6af tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:50.831237 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ce894a32-657a-4be9-a3e3-04421e9bf6af tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:50.832186 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ce894a32-657a-4be9-a3e3-04421e9bf6af tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:50.900662 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ce894a32-657a-4be9-a3e3-04421e9bf6af tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:50.902458 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ce894a32-657a-4be9-a3e3-04421e9bf6af tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:50.987581 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-ce894a32-657a-4be9-a3e3-04421e9bf6af tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lazy-loading 'flavor' on Instance uuid 85864d4e-3b46-4275-8ca7-5050fd3338af {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:39:51.071066 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ce894a32-657a-4be9-a3e3-04421e9bf6af tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] 10.222.0.57 "PUT /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af/tags/tempest-tag-2036753680" status: 201 len: 0 microversion: 2.26 time: 0.318038 Jul 18 02:39:51.072762 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2012/4026] 10.222.0.57 () {62 vars in 1379 bytes} [Mon Jul 18 02:39:50 2022] PUT /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af/tags/tempest-tag-2036753680 => generated 0 bytes in 321 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 18 02:39:51.102647 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-97fd98d3-f3ad-417a-98dc-6bbe47141b42 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Calling method '.version_select at 0x7ff49ba52dc0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:51.121661 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-97fd98d3-f3ad-417a-98dc-6bbe47141b42 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:51.127899 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-97fd98d3-f3ad-417a-98dc-6bbe47141b42 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:51.173383 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-97fd98d3-f3ad-417a-98dc-6bbe47141b42 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] 10.222.0.57 "GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af/tags/tempest-tag-2036753680" status: 204 len: 0 microversion: 2.26 time: 0.089841 Jul 18 02:39:51.176798 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2013/4027] 10.222.0.57 () {60 vars in 1360 bytes} [Mon Jul 18 02:39:51 2022] GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af/tags/tempest-tag-2036753680 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:39:51.201464 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7dbc2e46-ea36-4c10-a73e-57697b3f0123 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:51.212476 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4fa1a9a8-5435-43a6-882b-e07cc4b2b627 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Calling method '.version_select at 0x7ff49bf965e0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:51.223268 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7dbc2e46-ea36-4c10-a73e-57697b3f0123 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:51.227433 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7dbc2e46-ea36-4c10-a73e-57697b3f0123 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:51.237049 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7dbc2e46-ea36-4c10-a73e-57697b3f0123 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1807 microversion: 2.20 time: 1.213909 Jul 18 02:39:51.239260 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4fa1a9a8-5435-43a6-882b-e07cc4b2b627 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:51.239628 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2015/4028] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:50 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1807 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:51.240165 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4fa1a9a8-5435-43a6-882b-e07cc4b2b627 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:51.240681 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4fa1a9a8-5435-43a6-882b-e07cc4b2b627 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] [instance: 85864d4e-3b46-4275-8ca7-5050fd3338af] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:51.265382 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4fa1a9a8-5435-43a6-882b-e07cc4b2b627 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:51.269974 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4fa1a9a8-5435-43a6-882b-e07cc4b2b627 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:51.278309 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4fa1a9a8-5435-43a6-882b-e07cc4b2b627 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:51.279261 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4fa1a9a8-5435-43a6-882b-e07cc4b2b627 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:51.364832 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4fa1a9a8-5435-43a6-882b-e07cc4b2b627 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:51.365506 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4fa1a9a8-5435-43a6-882b-e07cc4b2b627 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:51.391182 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-4fa1a9a8-5435-43a6-882b-e07cc4b2b627 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lazy-loading 'flavor' on Instance uuid 85864d4e-3b46-4275-8ca7-5050fd3338af {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:39:51.451935 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4fa1a9a8-5435-43a6-882b-e07cc4b2b627 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] 10.222.0.57 "DELETE /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af/tags" status: 204 len: 0 microversion: 2.26 time: 0.263118 Jul 18 02:39:51.455743 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2014/4029] 10.222.0.57 () {60 vars in 1294 bytes} [Mon Jul 18 02:39:51 2022] DELETE /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af/tags => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:39:51.481649 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e2251593-858e-47f8-a7d8-ad57374d7824 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Calling method '.version_select at 0x7ff49bf16820>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:51.509153 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e2251593-858e-47f8-a7d8-ad57374d7824 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:51.510928 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e2251593-858e-47f8-a7d8-ad57374d7824 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:51.603534 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e2251593-858e-47f8-a7d8-ad57374d7824 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] 10.222.0.57 "GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af/tags" status: 200 len: 12 microversion: 2.26 time: 0.132990 Jul 18 02:39:51.613981 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2016/4030] 10.222.0.57 () {60 vars in 1291 bytes} [Mon Jul 18 02:39:51 2022] GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af/tags => generated 12 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:51.630088 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2c10ecce-85c5-45e1-8205-b0f955db064d tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Calling method '.version_select at 0x7ff4a8037430>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:51.685027 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2c10ecce-85c5-45e1-8205-b0f955db064d tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:51.690144 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2c10ecce-85c5-45e1-8205-b0f955db064d tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:51.690775 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2c10ecce-85c5-45e1-8205-b0f955db064d tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] [instance: 85864d4e-3b46-4275-8ca7-5050fd3338af] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:51.705610 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2c10ecce-85c5-45e1-8205-b0f955db064d tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:51.706494 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2c10ecce-85c5-45e1-8205-b0f955db064d tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:51.707355 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2c10ecce-85c5-45e1-8205-b0f955db064d tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:51.707808 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2c10ecce-85c5-45e1-8205-b0f955db064d tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:51.713263 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:51.768429 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2c10ecce-85c5-45e1-8205-b0f955db064d tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:51.769359 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2c10ecce-85c5-45e1-8205-b0f955db064d tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:51.794901 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2c10ecce-85c5-45e1-8205-b0f955db064d tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:51.795535 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2c10ecce-85c5-45e1-8205-b0f955db064d tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:51.868027 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-2c10ecce-85c5-45e1-8205-b0f955db064d tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lazy-loading 'flavor' on Instance uuid 85864d4e-3b46-4275-8ca7-5050fd3338af {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:39:51.920356 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2c10ecce-85c5-45e1-8205-b0f955db064d tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] 10.222.0.57 "PUT /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af/tags/tempest-tag-1415966213" status: 201 len: 0 microversion: 2.26 time: 0.302577 Jul 18 02:39:51.922962 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2015/4031] 10.222.0.57 () {62 vars in 1379 bytes} [Mon Jul 18 02:39:51 2022] PUT /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af/tags/tempest-tag-1415966213 => generated 0 bytes in 308 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 18 02:39:51.946267 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2ecc32a8-38b7-4835-8354-3e1738cf2bf0 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Calling method '.version_select at 0x7ff4a85caf70>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:51.982824 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ecc32a8-38b7-4835-8354-3e1738cf2bf0 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:51.983917 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ecc32a8-38b7-4835-8354-3e1738cf2bf0 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:52.055365 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2ecc32a8-38b7-4835-8354-3e1738cf2bf0 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] 10.222.0.57 "GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af/tags" status: 200 len: 36 microversion: 2.26 time: 0.120217 Jul 18 02:39:52.056542 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2017/4032] 10.222.0.57 () {60 vars in 1291 bytes} [Mon Jul 18 02:39:51 2022] GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af/tags => generated 36 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:52.080417 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3967541b-5a2f-4d20-afb1-a3e6019e9bc8 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Calling method '.version_select at 0x7ff49ba52820>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:52.244804 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3967541b-5a2f-4d20-afb1-a3e6019e9bc8 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:52.253205 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3967541b-5a2f-4d20-afb1-a3e6019e9bc8 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:52.256017 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3967541b-5a2f-4d20-afb1-a3e6019e9bc8 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] [instance: 85864d4e-3b46-4275-8ca7-5050fd3338af] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:52.307490 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2eadaeaa-059c-4106-9df7-7a6ab8074666 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:52.317575 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2eadaeaa-059c-4106-9df7-7a6ab8074666 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:52.329597 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3967541b-5a2f-4d20-afb1-a3e6019e9bc8 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:52.332392 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3967541b-5a2f-4d20-afb1-a3e6019e9bc8 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:52.338576 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3967541b-5a2f-4d20-afb1-a3e6019e9bc8 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:52.344351 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3967541b-5a2f-4d20-afb1-a3e6019e9bc8 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:52.374255 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2eadaeaa-059c-4106-9df7-7a6ab8074666 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:52.383282 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2eadaeaa-059c-4106-9df7-7a6ab8074666 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:52.416856 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2eadaeaa-059c-4106-9df7-7a6ab8074666 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:52.417901 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2eadaeaa-059c-4106-9df7-7a6ab8074666 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:52.542821 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3967541b-5a2f-4d20-afb1-a3e6019e9bc8 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:52.551173 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3967541b-5a2f-4d20-afb1-a3e6019e9bc8 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:52.765562 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-3967541b-5a2f-4d20-afb1-a3e6019e9bc8 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lazy-loading 'flavor' on Instance uuid 85864d4e-3b46-4275-8ca7-5050fd3338af {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:39:52.874660 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3967541b-5a2f-4d20-afb1-a3e6019e9bc8 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] 10.222.0.57 "DELETE /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af/tags/tempest-tag-1415966213" status: 204 len: 0 microversion: 2.26 time: 0.807406 Jul 18 02:39:52.877482 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2016/4033] 10.222.0.57 () {60 vars in 1363 bytes} [Mon Jul 18 02:39:52 2022] DELETE /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af/tags/tempest-tag-1415966213 => generated 0 bytes in 811 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:39:52.893044 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0d3a5b82-d656-4e5e-b218-1a8672c2c0d8 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Calling method '.version_select at 0x7ff49bf960d0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:52.941926 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0d3a5b82-d656-4e5e-b218-1a8672c2c0d8 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:52.945161 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0d3a5b82-d656-4e5e-b218-1a8672c2c0d8 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:52.983442 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0d3a5b82-d656-4e5e-b218-1a8672c2c0d8 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] 10.222.0.57 "GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af/tags" status: 200 len: 12 microversion: 2.26 time: 0.095245 Jul 18 02:39:52.989603 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2017/4034] 10.222.0.57 () {60 vars in 1291 bytes} [Mon Jul 18 02:39:52 2022] GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af/tags => generated 12 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:53.003964 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0fd708eb-85d1-48d9-8bf0-f92c4bb1a287 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Calling method '.version_select at 0x7ff49bc79ee0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:53.024139 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0fd708eb-85d1-48d9-8bf0-f92c4bb1a287 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:53.032564 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0fd708eb-85d1-48d9-8bf0-f92c4bb1a287 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:53.034571 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0fd708eb-85d1-48d9-8bf0-f92c4bb1a287 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] [instance: 85864d4e-3b46-4275-8ca7-5050fd3338af] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:53.067542 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2eadaeaa-059c-4106-9df7-7a6ab8074666 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:53.076659 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0fd708eb-85d1-48d9-8bf0-f92c4bb1a287 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:53.077996 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0fd708eb-85d1-48d9-8bf0-f92c4bb1a287 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:53.081175 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0fd708eb-85d1-48d9-8bf0-f92c4bb1a287 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:53.081986 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0fd708eb-85d1-48d9-8bf0-f92c4bb1a287 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:53.141242 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2eadaeaa-059c-4106-9df7-7a6ab8074666 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:53.171330 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2eadaeaa-059c-4106-9df7-7a6ab8074666 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:53.172976 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2eadaeaa-059c-4106-9df7-7a6ab8074666 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1807 microversion: 2.20 time: 0.904104 Jul 18 02:39:53.181145 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2018/4035] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:52 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1807 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:53.227217 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0fd708eb-85d1-48d9-8bf0-f92c4bb1a287 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:53.227680 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0fd708eb-85d1-48d9-8bf0-f92c4bb1a287 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:53.258718 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-0fd708eb-85d1-48d9-8bf0-f92c4bb1a287 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lazy-loading 'flavor' on Instance uuid 85864d4e-3b46-4275-8ca7-5050fd3338af {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:39:53.313070 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0fd708eb-85d1-48d9-8bf0-f92c4bb1a287 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] 10.222.0.57 "DELETE /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af/tags" status: 204 len: 0 microversion: 2.26 time: 0.315855 Jul 18 02:39:53.317011 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2018/4036] 10.222.0.57 () {60 vars in 1294 bytes} [Mon Jul 18 02:39:52 2022] DELETE /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af/tags => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:39:53.336996 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ba6c745d-4417-48dd-a403-fb7c61dff9f4 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Calling method '.version_select at 0x7ff4a88b3820>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:53.350696 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba6c745d-4417-48dd-a403-fb7c61dff9f4 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:53.351586 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba6c745d-4417-48dd-a403-fb7c61dff9f4 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:53.352328 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ba6c745d-4417-48dd-a403-fb7c61dff9f4 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] [instance: 85864d4e-3b46-4275-8ca7-5050fd3338af] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:53.362868 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba6c745d-4417-48dd-a403-fb7c61dff9f4 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:53.363944 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba6c745d-4417-48dd-a403-fb7c61dff9f4 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:53.365467 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba6c745d-4417-48dd-a403-fb7c61dff9f4 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:53.366192 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba6c745d-4417-48dd-a403-fb7c61dff9f4 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:53.405415 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba6c745d-4417-48dd-a403-fb7c61dff9f4 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:53.406253 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba6c745d-4417-48dd-a403-fb7c61dff9f4 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:53.420144 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba6c745d-4417-48dd-a403-fb7c61dff9f4 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:53.421685 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba6c745d-4417-48dd-a403-fb7c61dff9f4 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:53.482679 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-ba6c745d-4417-48dd-a403-fb7c61dff9f4 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lazy-loading 'flavor' on Instance uuid 85864d4e-3b46-4275-8ca7-5050fd3338af {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:39:53.576765 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ba6c745d-4417-48dd-a403-fb7c61dff9f4 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] 10.222.0.57 "PUT /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af/tags/tempest-tag-143475240" status: 201 len: 0 microversion: 2.26 time: 0.246803 Jul 18 02:39:53.583304 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2019/4037] 10.222.0.57 () {62 vars in 1376 bytes} [Mon Jul 18 02:39:53 2022] PUT /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af/tags/tempest-tag-143475240 => generated 0 bytes in 254 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 18 02:39:53.646529 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-294ac3f1-ec00-4884-9c6b-1b3179645817 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Calling method '.version_select at 0x7ff4a8c5d160>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:53.663435 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-294ac3f1-ec00-4884-9c6b-1b3179645817 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:53.664670 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-294ac3f1-ec00-4884-9c6b-1b3179645817 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:53.665780 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-294ac3f1-ec00-4884-9c6b-1b3179645817 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] [instance: 85864d4e-3b46-4275-8ca7-5050fd3338af] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:53.685324 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-294ac3f1-ec00-4884-9c6b-1b3179645817 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:53.686735 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-294ac3f1-ec00-4884-9c6b-1b3179645817 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:53.689524 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-294ac3f1-ec00-4884-9c6b-1b3179645817 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:53.691319 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-294ac3f1-ec00-4884-9c6b-1b3179645817 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:53.744036 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-294ac3f1-ec00-4884-9c6b-1b3179645817 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:53.745186 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-294ac3f1-ec00-4884-9c6b-1b3179645817 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:53.772150 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-294ac3f1-ec00-4884-9c6b-1b3179645817 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:53.773192 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-294ac3f1-ec00-4884-9c6b-1b3179645817 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:53.829064 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-294ac3f1-ec00-4884-9c6b-1b3179645817 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lazy-loading 'flavor' on Instance uuid 85864d4e-3b46-4275-8ca7-5050fd3338af {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:39:53.885436 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-294ac3f1-ec00-4884-9c6b-1b3179645817 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] 10.222.0.57 "PUT /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af/tags/tempest-tag-1237171718" status: 201 len: 0 microversion: 2.26 time: 0.263387 Jul 18 02:39:53.888645 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2019/4038] 10.222.0.57 () {62 vars in 1379 bytes} [Mon Jul 18 02:39:53 2022] PUT /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af/tags/tempest-tag-1237171718 => generated 0 bytes in 290 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 18 02:39:53.899264 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-08e2fb4a-005d-4ecf-9af4-62e6258d05e7 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Calling method '.version_select at 0x7ff49bd90670>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:53.911034 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-08e2fb4a-005d-4ecf-9af4-62e6258d05e7 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:53.914852 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-08e2fb4a-005d-4ecf-9af4-62e6258d05e7 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:53.916069 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-08e2fb4a-005d-4ecf-9af4-62e6258d05e7 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] [instance: 85864d4e-3b46-4275-8ca7-5050fd3338af] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:53.929579 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-08e2fb4a-005d-4ecf-9af4-62e6258d05e7 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:53.934592 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-08e2fb4a-005d-4ecf-9af4-62e6258d05e7 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:53.938129 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-08e2fb4a-005d-4ecf-9af4-62e6258d05e7 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:53.939064 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-08e2fb4a-005d-4ecf-9af4-62e6258d05e7 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:53.976266 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-08e2fb4a-005d-4ecf-9af4-62e6258d05e7 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:53.977442 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-08e2fb4a-005d-4ecf-9af4-62e6258d05e7 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:54.023252 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-08e2fb4a-005d-4ecf-9af4-62e6258d05e7 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lazy-loading 'flavor' on Instance uuid 85864d4e-3b46-4275-8ca7-5050fd3338af {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:39:54.063562 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-08e2fb4a-005d-4ecf-9af4-62e6258d05e7 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] 10.222.0.57 "DELETE /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af/tags" status: 204 len: 0 microversion: 2.26 time: 0.169004 Jul 18 02:39:54.064247 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2020/4039] 10.222.0.57 () {60 vars in 1294 bytes} [Mon Jul 18 02:39:53 2022] DELETE /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af/tags => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:39:54.083994 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0c4cc5e2-c683-4b12-9ecb-7b20d61f4bf4 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Calling method '.version_select at 0x7ff4a801eee0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:54.103766 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c4cc5e2-c683-4b12-9ecb-7b20d61f4bf4 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:54.104619 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c4cc5e2-c683-4b12-9ecb-7b20d61f4bf4 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:54.175337 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0c4cc5e2-c683-4b12-9ecb-7b20d61f4bf4 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] 10.222.0.57 "GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af/tags" status: 200 len: 12 microversion: 2.26 time: 0.105327 Jul 18 02:39:54.186590 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2020/4040] 10.222.0.57 () {60 vars in 1291 bytes} [Mon Jul 18 02:39:54 2022] GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af/tags => generated 12 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:39:54.193640 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-59fa62eb-3a2e-4f17-8798-26a5d8d2bd4b tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Calling method '.version_select at 0x7ff4a8856670>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:54.228755 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-59fa62eb-3a2e-4f17-8798-26a5d8d2bd4b tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:54.233431 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-59fa62eb-3a2e-4f17-8798-26a5d8d2bd4b tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:54.234356 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-59fa62eb-3a2e-4f17-8798-26a5d8d2bd4b tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] [instance: 85864d4e-3b46-4275-8ca7-5050fd3338af] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:54.236363 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6839e83c-e908-49f3-baef-16c17e11cb59 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:54.243382 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6839e83c-e908-49f3-baef-16c17e11cb59 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:54.270865 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6839e83c-e908-49f3-baef-16c17e11cb59 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:54.272161 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6839e83c-e908-49f3-baef-16c17e11cb59 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:54.273465 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-59fa62eb-3a2e-4f17-8798-26a5d8d2bd4b tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:54.273982 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-59fa62eb-3a2e-4f17-8798-26a5d8d2bd4b tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:54.274785 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-59fa62eb-3a2e-4f17-8798-26a5d8d2bd4b tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:54.275222 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-59fa62eb-3a2e-4f17-8798-26a5d8d2bd4b tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:54.283372 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6839e83c-e908-49f3-baef-16c17e11cb59 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:54.284715 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6839e83c-e908-49f3-baef-16c17e11cb59 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:54.328902 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-59fa62eb-3a2e-4f17-8798-26a5d8d2bd4b tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:54.329731 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-59fa62eb-3a2e-4f17-8798-26a5d8d2bd4b tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:54.358843 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-59fa62eb-3a2e-4f17-8798-26a5d8d2bd4b tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lazy-loading 'flavor' on Instance uuid 85864d4e-3b46-4275-8ca7-5050fd3338af {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:39:54.418347 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-59fa62eb-3a2e-4f17-8798-26a5d8d2bd4b tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] 10.222.0.57 "DELETE /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af/tags" status: 204 len: 0 microversion: 2.26 time: 0.228628 Jul 18 02:39:54.426849 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2021/4041] 10.222.0.57 () {60 vars in 1294 bytes} [Mon Jul 18 02:39:54 2022] DELETE /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af/tags => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:39:54.448155 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c7ea5597-70d0-4992-a170-694e843e30c5 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Calling method '.version_select at 0x7ff4a89d7a60>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:54.482645 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=54 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:54.495408 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c7ea5597-70d0-4992-a170-694e843e30c5 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:54.507694 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c7ea5597-70d0-4992-a170-694e843e30c5 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:54.509472 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c7ea5597-70d0-4992-a170-694e843e30c5 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] [instance: 85864d4e-3b46-4275-8ca7-5050fd3338af] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:54.586063 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c7ea5597-70d0-4992-a170-694e843e30c5 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:54.587356 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c7ea5597-70d0-4992-a170-694e843e30c5 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:54.588321 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c7ea5597-70d0-4992-a170-694e843e30c5 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:54.588775 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c7ea5597-70d0-4992-a170-694e843e30c5 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:54.655437 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c7ea5597-70d0-4992-a170-694e843e30c5 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:54.655863 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c7ea5597-70d0-4992-a170-694e843e30c5 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:54.704200 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c7ea5597-70d0-4992-a170-694e843e30c5 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:54.706016 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c7ea5597-70d0-4992-a170-694e843e30c5 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:54.719919 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6839e83c-e908-49f3-baef-16c17e11cb59 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:54.739749 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6839e83c-e908-49f3-baef-16c17e11cb59 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:54.747747 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6839e83c-e908-49f3-baef-16c17e11cb59 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:54.751036 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6839e83c-e908-49f3-baef-16c17e11cb59 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1807 microversion: 2.20 time: 0.551641 Jul 18 02:39:54.753673 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2021/4042] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:54 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1807 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:54.775720 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-c7ea5597-70d0-4992-a170-694e843e30c5 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lazy-loading 'flavor' on Instance uuid 85864d4e-3b46-4275-8ca7-5050fd3338af {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:39:54.776308 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ef1c78a2-fa3a-4bf0-bfd8-904ed5cd6484 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:54.777067 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ef1c78a2-fa3a-4bf0-bfd8-904ed5cd6484 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:54.797630 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ef1c78a2-fa3a-4bf0-bfd8-904ed5cd6484 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:54.798186 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ef1c78a2-fa3a-4bf0-bfd8-904ed5cd6484 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:54.799074 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ef1c78a2-fa3a-4bf0-bfd8-904ed5cd6484 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:54.799754 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ef1c78a2-fa3a-4bf0-bfd8-904ed5cd6484 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:54.808203 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c7ea5597-70d0-4992-a170-694e843e30c5 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] 10.222.0.57 "PUT /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af/tags/tempest-tag-1011057045" status: 201 len: 0 microversion: 2.26 time: 0.378952 Jul 18 02:39:54.808203 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2022/4043] 10.222.0.57 () {62 vars in 1379 bytes} [Mon Jul 18 02:39:54 2022] PUT /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af/tags/tempest-tag-1011057045 => generated 0 bytes in 381 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 18 02:39:54.818138 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-26be491a-4534-411f-8451-78d903562dd3 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Calling method '.version_select at 0x7ff49bd90d30>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:54.837878 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26be491a-4534-411f-8451-78d903562dd3 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:54.838334 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26be491a-4534-411f-8451-78d903562dd3 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:54.838825 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-26be491a-4534-411f-8451-78d903562dd3 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] [instance: 85864d4e-3b46-4275-8ca7-5050fd3338af] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:54.858044 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26be491a-4534-411f-8451-78d903562dd3 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:54.858506 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26be491a-4534-411f-8451-78d903562dd3 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:54.859345 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26be491a-4534-411f-8451-78d903562dd3 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:54.859791 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26be491a-4534-411f-8451-78d903562dd3 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:54.929103 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26be491a-4534-411f-8451-78d903562dd3 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:54.929566 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26be491a-4534-411f-8451-78d903562dd3 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:54.966810 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26be491a-4534-411f-8451-78d903562dd3 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:54.967277 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26be491a-4534-411f-8451-78d903562dd3 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:55.023886 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-26be491a-4534-411f-8451-78d903562dd3 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lazy-loading 'flavor' on Instance uuid 85864d4e-3b46-4275-8ca7-5050fd3338af {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:39:55.070865 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-26be491a-4534-411f-8451-78d903562dd3 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] 10.222.0.57 "PUT /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af/tags/tempest-tag-1394409867" status: 201 len: 0 microversion: 2.26 time: 0.256924 Jul 18 02:39:55.079922 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2023/4044] 10.222.0.57 () {62 vars in 1379 bytes} [Mon Jul 18 02:39:54 2022] PUT /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af/tags/tempest-tag-1394409867 => generated 0 bytes in 266 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 18 02:39:55.087565 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-25d2cf46-5980-49ce-b435-6c06ad2f1405 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Action: 'update_all', calling method: .version_select at 0x7ff4a85503a0>, body: {"tags": ["tempest-tag-248132741", "tempest-tag-1317966360"]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:55.123071 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25d2cf46-5980-49ce-b435-6c06ad2f1405 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:55.139328 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25d2cf46-5980-49ce-b435-6c06ad2f1405 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:55.140666 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-25d2cf46-5980-49ce-b435-6c06ad2f1405 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] [instance: 85864d4e-3b46-4275-8ca7-5050fd3338af] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:55.154067 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25d2cf46-5980-49ce-b435-6c06ad2f1405 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:55.154882 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25d2cf46-5980-49ce-b435-6c06ad2f1405 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:55.156472 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25d2cf46-5980-49ce-b435-6c06ad2f1405 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:55.170869 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25d2cf46-5980-49ce-b435-6c06ad2f1405 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:55.326597 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25d2cf46-5980-49ce-b435-6c06ad2f1405 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:55.327429 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25d2cf46-5980-49ce-b435-6c06ad2f1405 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:55.426452 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=87,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=4,nova_cell1:RELEASE=3,nova_cell1:DELETE=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:55.476630 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-25d2cf46-5980-49ce-b435-6c06ad2f1405 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lazy-loading 'flavor' on Instance uuid 85864d4e-3b46-4275-8ca7-5050fd3338af {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:39:55.522839 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-25d2cf46-5980-49ce-b435-6c06ad2f1405 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] 10.222.0.57 "PUT /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af/tags" status: 200 len: 61 microversion: 2.26 time: 0.439323 Jul 18 02:39:55.525503 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2024/4045] 10.222.0.57 () {62 vars in 1311 bytes} [Mon Jul 18 02:39:55 2022] PUT /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af/tags => generated 61 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:55.537572 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f2488786-4f4d-49db-965c-301361ecde78 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Calling method '.version_select at 0x7ff4a8514b80>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:55.565832 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f2488786-4f4d-49db-965c-301361ecde78 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:55.566565 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f2488786-4f4d-49db-965c-301361ecde78 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:55.590967 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f2488786-4f4d-49db-965c-301361ecde78 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] 10.222.0.57 "GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af/tags" status: 200 len: 61 microversion: 2.26 time: 0.060634 Jul 18 02:39:55.601816 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2025/4046] 10.222.0.57 () {60 vars in 1291 bytes} [Mon Jul 18 02:39:55 2022] GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af/tags => generated 61 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:55.612005 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9a300106-65ee-4e60-bfca-70b72abeb78d tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Calling method '.version_select at 0x7ff4a8550f70>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:55.626378 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9a300106-65ee-4e60-bfca-70b72abeb78d tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:55.627310 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9a300106-65ee-4e60-bfca-70b72abeb78d tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:55.628019 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9a300106-65ee-4e60-bfca-70b72abeb78d tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] [instance: 85864d4e-3b46-4275-8ca7-5050fd3338af] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:55.655444 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9a300106-65ee-4e60-bfca-70b72abeb78d tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:55.657884 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9a300106-65ee-4e60-bfca-70b72abeb78d tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:55.660543 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9a300106-65ee-4e60-bfca-70b72abeb78d tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:55.661389 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9a300106-65ee-4e60-bfca-70b72abeb78d tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:55.666969 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ef1c78a2-fa3a-4bf0-bfd8-904ed5cd6484 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:55.718819 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ef1c78a2-fa3a-4bf0-bfd8-904ed5cd6484 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:55.729563 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ef1c78a2-fa3a-4bf0-bfd8-904ed5cd6484 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:55.745561 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ef1c78a2-fa3a-4bf0-bfd8-904ed5cd6484 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 2946 microversion: 2.32 time: 0.982959 Jul 18 02:39:55.762079 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2022/4047] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:54 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 2946 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:55.762908 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9a300106-65ee-4e60-bfca-70b72abeb78d tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:55.764196 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9a300106-65ee-4e60-bfca-70b72abeb78d tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:55.793036 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-63f9db73-1bed-41b7-b42a-2c960a61b3b8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:55.797131 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-63f9db73-1bed-41b7-b42a-2c960a61b3b8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:55.803771 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-9a300106-65ee-4e60-bfca-70b72abeb78d tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lazy-loading 'flavor' on Instance uuid 85864d4e-3b46-4275-8ca7-5050fd3338af {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:39:55.828026 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-63f9db73-1bed-41b7-b42a-2c960a61b3b8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:55.829103 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-63f9db73-1bed-41b7-b42a-2c960a61b3b8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:55.834287 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9a300106-65ee-4e60-bfca-70b72abeb78d tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] 10.222.0.57 "DELETE /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af/tags" status: 204 len: 0 microversion: 2.26 time: 0.230931 Jul 18 02:39:55.836471 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-63f9db73-1bed-41b7-b42a-2c960a61b3b8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:55.838464 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-63f9db73-1bed-41b7-b42a-2c960a61b3b8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:55.840687 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2026/4048] 10.222.0.57 () {60 vars in 1294 bytes} [Mon Jul 18 02:39:55 2022] DELETE /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af/tags => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:39:55.858015 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-210893ff-3fb2-457d-a158-8bb03140b785 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:55.858852 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-210893ff-3fb2-457d-a158-8bb03140b785 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:55.878985 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-210893ff-3fb2-457d-a158-8bb03140b785 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:55.885404 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-210893ff-3fb2-457d-a158-8bb03140b785 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:55.887244 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-210893ff-3fb2-457d-a158-8bb03140b785 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:55.888616 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-210893ff-3fb2-457d-a158-8bb03140b785 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:56.418657 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-210893ff-3fb2-457d-a158-8bb03140b785 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.574953 Jul 18 02:39:56.420317 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2027/4049] 10.222.0.57 () {60 vars in 1315 bytes} [Mon Jul 18 02:39:55 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4/os-interface => generated 1831 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:56.426336 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3d58d088-aff4-4cb5-8bfd-3a924350a0a2 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:56.428957 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3d58d088-aff4-4cb5-8bfd-3a924350a0a2 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] [instance: 85864d4e-3b46-4275-8ca7-5050fd3338af] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:56.456019 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3d58d088-aff4-4cb5-8bfd-3a924350a0a2 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:56.459596 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3d58d088-aff4-4cb5-8bfd-3a924350a0a2 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:56.472028 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3d58d088-aff4-4cb5-8bfd-3a924350a0a2 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:56.475080 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3d58d088-aff4-4cb5-8bfd-3a924350a0a2 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:56.671118 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3d58d088-aff4-4cb5-8bfd-3a924350a0a2 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] [instance: 85864d4e-3b46-4275-8ca7-5050fd3338af] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:39:56.705281 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-63f9db73-1bed-41b7-b42a-2c960a61b3b8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:56.720843 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-63f9db73-1bed-41b7-b42a-2c960a61b3b8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:56.723679 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-63f9db73-1bed-41b7-b42a-2c960a61b3b8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:56.729869 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-63f9db73-1bed-41b7-b42a-2c960a61b3b8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1807 microversion: 2.20 time: 0.957175 Jul 18 02:39:56.735079 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2023/4050] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:55 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1807 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:39:56.989212 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3d58d088-aff4-4cb5-8bfd-3a924350a0a2 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] 10.222.0.57 "DELETE /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af" status: 204 len: 0 microversion: 2.26 time: 0.566261 Jul 18 02:39:56.994918 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2028/4051] 10.222.0.57 () {60 vars in 1279 bytes} [Mon Jul 18 02:39:56 2022] DELETE /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af => generated 0 bytes in 569 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:39:57.028676 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bb5b46ee-a051-4dcc-ac51-0e1a813a8b5b tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:57.030258 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bb5b46ee-a051-4dcc-ac51-0e1a813a8b5b tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] [instance: 85864d4e-3b46-4275-8ca7-5050fd3338af] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:57.070967 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb5b46ee-a051-4dcc-ac51-0e1a813a8b5b tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:57.072157 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb5b46ee-a051-4dcc-ac51-0e1a813a8b5b tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:57.082482 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb5b46ee-a051-4dcc-ac51-0e1a813a8b5b tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:57.088838 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb5b46ee-a051-4dcc-ac51-0e1a813a8b5b tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:57.596259 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-085367ae-87fc-4564-a93b-062b6e21384a req-17226db4-08d5-4d16-a356-6a24e87d7e03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d18d284e-d055-4fe5-af1c-b41ee803d426", "name": "network-vif-plugged", "status": "completed", "tag": "6ca46669-298c-45bb-bc10-3dd6fed58f4a"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:57.693455 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-085367ae-87fc-4564-a93b-062b6e21384a req-17226db4-08d5-4d16-a356-6a24e87d7e03 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:57.694476 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-085367ae-87fc-4564-a93b-062b6e21384a req-17226db4-08d5-4d16-a356-6a24e87d7e03 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:57.715418 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-085367ae-87fc-4564-a93b-062b6e21384a req-17226db4-08d5-4d16-a356-6a24e87d7e03 service nova] Creating event network-vif-plugged:6ca46669-298c-45bb-bc10-3dd6fed58f4a for instance d18d284e-d055-4fe5-af1c-b41ee803d426 on n-h1-465891-3 Jul 18 02:39:57.735796 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-085367ae-87fc-4564-a93b-062b6e21384a req-17226db4-08d5-4d16-a356-6a24e87d7e03 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.995387 Jul 18 02:39:57.742831 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2024/4052] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:39:57.769757 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-939fdef3-0b07-4094-8472-d5fb438c64f9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:57.771104 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-939fdef3-0b07-4094-8472-d5fb438c64f9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:57.798597 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-939fdef3-0b07-4094-8472-d5fb438c64f9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:57.799795 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-939fdef3-0b07-4094-8472-d5fb438c64f9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:57.801299 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-939fdef3-0b07-4094-8472-d5fb438c64f9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:57.811663 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-939fdef3-0b07-4094-8472-d5fb438c64f9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:58.059807 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bb5b46ee-a051-4dcc-ac51-0e1a813a8b5b tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:58.094582 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bb5b46ee-a051-4dcc-ac51-0e1a813a8b5b tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:58.107113 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bb5b46ee-a051-4dcc-ac51-0e1a813a8b5b tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:58.117048 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bb5b46ee-a051-4dcc-ac51-0e1a813a8b5b tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] 10.222.0.57 "GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af" status: 200 len: 1552 microversion: 2.26 time: 1.115883 Jul 18 02:39:58.121738 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2029/4053] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:56 2022] GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af => generated 1552 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:58.586779 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-939fdef3-0b07-4094-8472-d5fb438c64f9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:58.601756 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-939fdef3-0b07-4094-8472-d5fb438c64f9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:58.603431 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-939fdef3-0b07-4094-8472-d5fb438c64f9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:58.609911 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-939fdef3-0b07-4094-8472-d5fb438c64f9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1807 microversion: 2.20 time: 0.840083 Jul 18 02:39:58.612429 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2025/4054] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:57 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1807 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:59.145508 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a6eaed3a-ab02-4cbf-8657-80279047672e tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:59.146727 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a6eaed3a-ab02-4cbf-8657-80279047672e tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] [instance: 85864d4e-3b46-4275-8ca7-5050fd3338af] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:59.189391 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a6eaed3a-ab02-4cbf-8657-80279047672e tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:59.190216 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a6eaed3a-ab02-4cbf-8657-80279047672e tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:59.195634 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a6eaed3a-ab02-4cbf-8657-80279047672e tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:59.205558 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a6eaed3a-ab02-4cbf-8657-80279047672e tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:59.649669 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6f2cedaf-24ff-4a79-9a6c-a5900c16bdc1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:59.651164 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6f2cedaf-24ff-4a79-9a6c-a5900c16bdc1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:59.688263 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6f2cedaf-24ff-4a79-9a6c-a5900c16bdc1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:59.691130 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6f2cedaf-24ff-4a79-9a6c-a5900c16bdc1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:59.730253 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6f2cedaf-24ff-4a79-9a6c-a5900c16bdc1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:59.733070 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6f2cedaf-24ff-4a79-9a6c-a5900c16bdc1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:00.120830 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a6eaed3a-ab02-4cbf-8657-80279047672e tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:00.163388 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a6eaed3a-ab02-4cbf-8657-80279047672e tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:00.172333 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a6eaed3a-ab02-4cbf-8657-80279047672e tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:00.178140 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a6eaed3a-ab02-4cbf-8657-80279047672e tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] 10.222.0.57 "GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af" status: 200 len: 1552 microversion: 2.26 time: 1.038339 Jul 18 02:40:00.183979 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2030/4055] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:59 2022] GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af => generated 1552 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:40:00.633203 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6f2cedaf-24ff-4a79-9a6c-a5900c16bdc1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:00.717429 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6f2cedaf-24ff-4a79-9a6c-a5900c16bdc1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:00.719211 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6f2cedaf-24ff-4a79-9a6c-a5900c16bdc1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:00.722484 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6f2cedaf-24ff-4a79-9a6c-a5900c16bdc1 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1807 microversion: 2.20 time: 1.082894 Jul 18 02:40:00.723019 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2026/4056] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:59 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1807 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:40:00.910676 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-88af02ad-ff21-4a89-9777-f35506a1d947 req-746e34b3-d055-4943-82d0-98d524e37756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85864d4e-3b46-4275-8ca7-5050fd3338af", "name": "network-vif-deleted", "tag": "43b9d5ee-e342-4562-a544-a7ffad4a2ea2"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:40:00.976040 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-88af02ad-ff21-4a89-9777-f35506a1d947 req-746e34b3-d055-4943-82d0-98d524e37756 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:00.982110 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-88af02ad-ff21-4a89-9777-f35506a1d947 req-746e34b3-d055-4943-82d0-98d524e37756 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:01.080461 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-88af02ad-ff21-4a89-9777-f35506a1d947 req-746e34b3-d055-4943-82d0-98d524e37756 service nova] Creating event network-vif-deleted:43b9d5ee-e342-4562-a544-a7ffad4a2ea2 for instance 85864d4e-3b46-4275-8ca7-5050fd3338af on n-h1-465891-3 Jul 18 02:40:01.130121 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-88af02ad-ff21-4a89-9777-f35506a1d947 req-746e34b3-d055-4943-82d0-98d524e37756 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.217839 Jul 18 02:40:01.137527 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2031/4057] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:40:01.226464 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a9cfab69-fd60-416f-b0cc-d4d3db80c664 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:01.228524 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a9cfab69-fd60-416f-b0cc-d4d3db80c664 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] [instance: 85864d4e-3b46-4275-8ca7-5050fd3338af] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:01.269262 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9cfab69-fd60-416f-b0cc-d4d3db80c664 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:01.270646 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9cfab69-fd60-416f-b0cc-d4d3db80c664 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:01.273499 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9cfab69-fd60-416f-b0cc-d4d3db80c664 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:01.277429 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9cfab69-fd60-416f-b0cc-d4d3db80c664 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:01.389889 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9cfab69-fd60-416f-b0cc-d4d3db80c664 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:01.391697 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9cfab69-fd60-416f-b0cc-d4d3db80c664 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:01.392634 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-a9cfab69-fd60-416f-b0cc-d4d3db80c664 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lazy-loading 'fault' on Instance uuid 85864d4e-3b46-4275-8ca7-5050fd3338af {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:40:01.529875 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a9cfab69-fd60-416f-b0cc-d4d3db80c664 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:01.552059 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a9cfab69-fd60-416f-b0cc-d4d3db80c664 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:01.554543 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a9cfab69-fd60-416f-b0cc-d4d3db80c664 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a722484c55d4003a3c3637bb35ce87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b674b176eb24ca1956e2165c1f6eeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:01.556429 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a9cfab69-fd60-416f-b0cc-d4d3db80c664 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] 10.222.0.57 "GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af" status: 200 len: 1351 microversion: 2.26 time: 0.340052 Jul 18 02:40:01.557744 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2027/4058] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:40:01 2022] GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af => generated 1351 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:40:01.786050 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-057eae31-dbfa-4fdf-9067-9ee2ec8a1604 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:01.790053 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-057eae31-dbfa-4fdf-9067-9ee2ec8a1604 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:01.836921 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-057eae31-dbfa-4fdf-9067-9ee2ec8a1604 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:01.838335 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-057eae31-dbfa-4fdf-9067-9ee2ec8a1604 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:01.840249 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-057eae31-dbfa-4fdf-9067-9ee2ec8a1604 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:01.842991 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-057eae31-dbfa-4fdf-9067-9ee2ec8a1604 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:02.618947 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6581437e-caa3-4236-b689-bf6fcc2fe4e1 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:02.623065 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-057eae31-dbfa-4fdf-9067-9ee2ec8a1604 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:02.632092 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6581437e-caa3-4236-b689-bf6fcc2fe4e1 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] [instance: 85864d4e-3b46-4275-8ca7-5050fd3338af] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:02.650901 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-057eae31-dbfa-4fdf-9067-9ee2ec8a1604 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:02.661807 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-057eae31-dbfa-4fdf-9067-9ee2ec8a1604 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:02.663706 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-057eae31-dbfa-4fdf-9067-9ee2ec8a1604 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1807 microversion: 2.20 time: 0.923221 Jul 18 02:40:02.665011 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2032/4059] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:40:01 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1807 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:40:02.738836 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6581437e-caa3-4236-b689-bf6fcc2fe4e1 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:02.739567 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6581437e-caa3-4236-b689-bf6fcc2fe4e1 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:02.741082 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6581437e-caa3-4236-b689-bf6fcc2fe4e1 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:02.749963 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6581437e-caa3-4236-b689-bf6fcc2fe4e1 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:02.778247 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:02.857093 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-6581437e-caa3-4236-b689-bf6fcc2fe4e1 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] HTTP exception thrown: Instance 85864d4e-3b46-4275-8ca7-5050fd3338af could not be found. Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6581437e-caa3-4236-b689-bf6fcc2fe4e1 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Request method failure captured: Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af HTTP/1.1 Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MfSGrm0-EHiYLcEU-OhTAAsGrNzgeAo9MlNtxjEqOIyB-Xn7drRQXM2eiGh8-uje_T5IczfZNkggsFo5NFJZvT_on1kIHkD1kyc_PhIeRkDOjvr7I00lplrQ7TPmpf03SjzaMSl96F2zuT-x0B1yTcHIJxboeMdFLcKmxnIoqw0E_Q Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: X-Openstack-Nova-Api-Version: 2.26 Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 4b674b176eb24ca1956e2165c1f6eeb3 Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServerTagsTestJSON-820323988 Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4b674b176eb24ca1956e2165c1f6eeb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4b674b176eb24ca1956e2165c1f6eeb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4b674b176eb24ca1956e2165c1f6eeb3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4b674b176eb24ca1956e2165c1f6eeb3"}]}] Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServerTagsTestJSON-820323988 Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 4b674b176eb24ca1956e2165c1f6eeb3 Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServerTagsTestJSON-820323988 Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServerTagsTestJSON-820323988-project Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 1a722484c55d4003a3c3637bb35ce87a Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServerTagsTestJSON-820323988-project Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 85864d4e-3b46-4275-8ca7-5050fd3338af could not be found. Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '85864d4e-3b46-4275-8ca7-5050fd3338af'} Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85864d4e-3b46-4275-8ca7-5050fd3338af could not be found. Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85864d4e-3b46-4275-8ca7-5050fd3338af could not be found. Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:40:02.873015 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:40:02.883375 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:40:02.883375 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:40:02.883375 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:40:02.883375 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:40:02.883375 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:40:02.883375 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85864d4e-3b46-4275-8ca7-5050fd3338af could not be found. Jul 18 02:40:02.883375 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:40:02.894944 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6581437e-caa3-4236-b689-bf6fcc2fe4e1 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] Returning 404 to user: Instance 85864d4e-3b46-4275-8ca7-5050fd3338af could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:40:02.903133 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6581437e-caa3-4236-b689-bf6fcc2fe4e1 tempest-ServerTagsTestJSON-820323988 tempest-ServerTagsTestJSON-820323988-project] 10.222.0.57 "GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af" status: 404 len: 111 microversion: 2.26 time: 0.308866 Jul 18 02:40:02.905894 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2028/4060] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:40:02 2022] GET /compute/v2.1/servers/85864d4e-3b46-4275-8ca7-5050fd3338af => generated 111 bytes in 322 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:40:03.712657 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d552759f-8654-45f5-ba92-ff7c52be3274 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:03.714210 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d552759f-8654-45f5-ba92-ff7c52be3274 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:03.780279 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d552759f-8654-45f5-ba92-ff7c52be3274 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:03.781068 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d552759f-8654-45f5-ba92-ff7c52be3274 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:03.792229 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d552759f-8654-45f5-ba92-ff7c52be3274 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:03.793934 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d552759f-8654-45f5-ba92-ff7c52be3274 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:04.516567 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d552759f-8654-45f5-ba92-ff7c52be3274 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:04.552288 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d552759f-8654-45f5-ba92-ff7c52be3274 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:04.574561 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d552759f-8654-45f5-ba92-ff7c52be3274 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:04.583242 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d552759f-8654-45f5-ba92-ff7c52be3274 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1807 microversion: 2.20 time: 0.873983 Jul 18 02:40:04.598801 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2033/4061] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:40:03 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1807 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:40:05.616680 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3a22c4af-0254-454f-93ff-4a9717ddc46c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:05.617569 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3a22c4af-0254-454f-93ff-4a9717ddc46c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:05.619925 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=70 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:05.650766 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3a22c4af-0254-454f-93ff-4a9717ddc46c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:05.680135 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3a22c4af-0254-454f-93ff-4a9717ddc46c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:05.680824 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3a22c4af-0254-454f-93ff-4a9717ddc46c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:05.681385 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3a22c4af-0254-454f-93ff-4a9717ddc46c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:06.720160 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3a22c4af-0254-454f-93ff-4a9717ddc46c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:06.764454 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3a22c4af-0254-454f-93ff-4a9717ddc46c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:06.771875 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3a22c4af-0254-454f-93ff-4a9717ddc46c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:06.773177 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3a22c4af-0254-454f-93ff-4a9717ddc46c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1794 microversion: 2.20 time: 1.163311 Jul 18 02:40:06.774327 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2029/4062] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:40:05 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1794 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:40:34.647206 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:34.652020 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=57,nova_cell1:DELETE=1,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:35.119336 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1bb04d8e-21c0-4a97-97fb-a0be4144a916 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1504894448", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "1573b218-2cf8-4a0f-8a49-c40025013786"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:40:35.378483 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-1bb04d8e-21c0-4a97-97fb-a0be4144a916 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] validate_networks() for [('1573b218-2cf8-4a0f-8a49-c40025013786', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:40:37.670298 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-1bb04d8e-21c0-4a97-97fb-a0be4144a916 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:40:37.671386 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-1bb04d8e-21c0-4a97-97fb-a0be4144a916 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:40:37.671862 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-1bb04d8e-21c0-4a97-97fb-a0be4144a916 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:40:37.672886 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-1bb04d8e-21c0-4a97-97fb-a0be4144a916 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:40:37.673857 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-1bb04d8e-21c0-4a97-97fb-a0be4144a916 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:40:37.743166 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1bb04d8e-21c0-4a97-97fb-a0be4144a916 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:37.759211 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1bb04d8e-21c0-4a97-97fb-a0be4144a916 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:37.760693 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1bb04d8e-21c0-4a97-97fb-a0be4144a916 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:37.761573 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1bb04d8e-21c0-4a97-97fb-a0be4144a916 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:37.935476 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-1bb04d8e-21c0-4a97-97fb-a0be4144a916 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Getting quotas for project 7ff3f555507b4f2e8905e9b2ab5b7780. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:40:38.005323 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-1bb04d8e-21c0-4a97-97fb-a0be4144a916 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Getting quotas for user 421f66a2a442482980fa2112c7c14e0d and project 7ff3f555507b4f2e8905e9b2ab5b7780. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:40:38.101530 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1bb04d8e-21c0-4a97-97fb-a0be4144a916 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:40:38.104404 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1bb04d8e-21c0-4a97-97fb-a0be4144a916 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] [instance: faffd5d9-d76f-4024-a760-9fb1d992620e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:40:38.224777 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1bb04d8e-21c0-4a97-97fb-a0be4144a916 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.580534 Jul 18 02:40:38.225564 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2034/4063] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:40:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 3588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:40:38.258635 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a0b52916-db13-44ad-8cdb-f329103f1459 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:38.271233 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a0b52916-db13-44ad-8cdb-f329103f1459 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] [instance: faffd5d9-d76f-4024-a760-9fb1d992620e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:38.288476 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:38.313515 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=7 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:38.603414 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a0b52916-db13-44ad-8cdb-f329103f1459 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421f66a2a442482980fa2112c7c14e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff3f555507b4f2e8905e9b2ab5b7780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:38.612829 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a0b52916-db13-44ad-8cdb-f329103f1459 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] 10.222.0.57 "GET /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e" status: 200 len: 1228 microversion: 2.1 time: 0.371995 Jul 18 02:40:38.626105 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2030/4064] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:38 2022] GET /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e => generated 1228 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:39.647848 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-91eaaea8-1312-4edf-b5eb-b5bcf256ffda tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:39.650827 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-91eaaea8-1312-4edf-b5eb-b5bcf256ffda tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] [instance: faffd5d9-d76f-4024-a760-9fb1d992620e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:40.111514 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-91eaaea8-1312-4edf-b5eb-b5bcf256ffda tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421f66a2a442482980fa2112c7c14e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff3f555507b4f2e8905e9b2ab5b7780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:40.142474 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-91eaaea8-1312-4edf-b5eb-b5bcf256ffda tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] 10.222.0.57 "GET /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e" status: 200 len: 1228 microversion: 2.1 time: 0.502861 Jul 18 02:40:40.145502 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2035/4065] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:39 2022] GET /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e => generated 1228 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:41.185394 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6a23d6db-b111-4d03-8b1a-887b18e460f9 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:41.190569 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6a23d6db-b111-4d03-8b1a-887b18e460f9 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] [instance: faffd5d9-d76f-4024-a760-9fb1d992620e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:41.244681 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a23d6db-b111-4d03-8b1a-887b18e460f9 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:41.245948 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a23d6db-b111-4d03-8b1a-887b18e460f9 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:41.248815 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a23d6db-b111-4d03-8b1a-887b18e460f9 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:41.254938 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a23d6db-b111-4d03-8b1a-887b18e460f9 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:41.790362 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6a23d6db-b111-4d03-8b1a-887b18e460f9 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421f66a2a442482980fa2112c7c14e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff3f555507b4f2e8905e9b2ab5b7780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:41.842230 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6a23d6db-b111-4d03-8b1a-887b18e460f9 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] 10.222.0.57 "GET /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e" status: 200 len: 1224 microversion: 2.1 time: 0.667022 Jul 18 02:40:41.844192 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2031/4066] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:41 2022] GET /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e => generated 1224 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:42.875405 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b6527213-5a97-4a49-ab27-27f00dcd8665 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:42.876609 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b6527213-5a97-4a49-ab27-27f00dcd8665 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] [instance: faffd5d9-d76f-4024-a760-9fb1d992620e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:42.946881 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6527213-5a97-4a49-ab27-27f00dcd8665 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:42.947858 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6527213-5a97-4a49-ab27-27f00dcd8665 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:42.949442 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6527213-5a97-4a49-ab27-27f00dcd8665 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:43.026496 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6527213-5a97-4a49-ab27-27f00dcd8665 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.077s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:43.321080 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b6527213-5a97-4a49-ab27-27f00dcd8665 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421f66a2a442482980fa2112c7c14e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff3f555507b4f2e8905e9b2ab5b7780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:43.393298 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b6527213-5a97-4a49-ab27-27f00dcd8665 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] 10.222.0.57 "GET /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e" status: 200 len: 1298 microversion: 2.1 time: 0.531165 Jul 18 02:40:43.399424 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2036/4067] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:42 2022] GET /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e => generated 1298 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:44.427225 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-275a5de5-43dc-4f5d-97a8-018521424b19 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:44.427912 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-275a5de5-43dc-4f5d-97a8-018521424b19 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] [instance: faffd5d9-d76f-4024-a760-9fb1d992620e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:44.447192 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-275a5de5-43dc-4f5d-97a8-018521424b19 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:44.447403 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-275a5de5-43dc-4f5d-97a8-018521424b19 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:44.448406 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-275a5de5-43dc-4f5d-97a8-018521424b19 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:44.448636 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-275a5de5-43dc-4f5d-97a8-018521424b19 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:44.777202 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-275a5de5-43dc-4f5d-97a8-018521424b19 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421f66a2a442482980fa2112c7c14e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff3f555507b4f2e8905e9b2ab5b7780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:44.816974 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-275a5de5-43dc-4f5d-97a8-018521424b19 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] 10.222.0.57 "GET /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e" status: 200 len: 1286 microversion: 2.1 time: 0.390913 Jul 18 02:40:44.836592 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2032/4068] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:44 2022] GET /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e => generated 1286 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:45.841252 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-da90d223-6299-4f14-9152-979912762e5b tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:45.847544 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-da90d223-6299-4f14-9152-979912762e5b tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] [instance: faffd5d9-d76f-4024-a760-9fb1d992620e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:45.872191 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-da90d223-6299-4f14-9152-979912762e5b tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:45.879335 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-da90d223-6299-4f14-9152-979912762e5b tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:45.880809 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-da90d223-6299-4f14-9152-979912762e5b tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:45.884805 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-da90d223-6299-4f14-9152-979912762e5b tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:46.532958 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-275a5de5-43dc-4f5d-97a8-018521424b19 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:46.534181 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-275a5de5-43dc-4f5d-97a8-018521424b19 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] 10.222.0.57 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001351 Jul 18 02:40:46.535143 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2033/4069] 10.222.0.57 () {56 vars in 885 bytes} [Mon Jul 18 02:40:46 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 18 02:40:47.067802 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-da90d223-6299-4f14-9152-979912762e5b tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421f66a2a442482980fa2112c7c14e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff3f555507b4f2e8905e9b2ab5b7780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:47.107144 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-da90d223-6299-4f14-9152-979912762e5b tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] 10.222.0.57 "GET /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e" status: 200 len: 1328 microversion: 2.1 time: 1.269307 Jul 18 02:40:47.123367 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2037/4070] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:45 2022] GET /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e => generated 1328 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:48.142209 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-351594a2-1215-4b47-9549-af163d70d2e5 req-af60d78d-a1bf-4155-9767-4c0621f3c209 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faffd5d9-d76f-4024-a760-9fb1d992620e", "tag": "aeb688a8-fc1c-49cc-9dc3-8dd969837e09"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:40:48.156325 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7ef0dc4b-dd74-4a84-902f-d56040a3d8d6 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:48.157496 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7ef0dc4b-dd74-4a84-902f-d56040a3d8d6 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] [instance: faffd5d9-d76f-4024-a760-9fb1d992620e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:48.168757 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:48.186270 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7ef0dc4b-dd74-4a84-902f-d56040a3d8d6 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:48.187979 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7ef0dc4b-dd74-4a84-902f-d56040a3d8d6 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:48.190145 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7ef0dc4b-dd74-4a84-902f-d56040a3d8d6 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:48.191491 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7ef0dc4b-dd74-4a84-902f-d56040a3d8d6 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:48.235808 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-351594a2-1215-4b47-9549-af163d70d2e5 req-af60d78d-a1bf-4155-9767-4c0621f3c209 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:48.244149 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-351594a2-1215-4b47-9549-af163d70d2e5 req-af60d78d-a1bf-4155-9767-4c0621f3c209 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:48.366811 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-351594a2-1215-4b47-9549-af163d70d2e5 req-af60d78d-a1bf-4155-9767-4c0621f3c209 service nova] Creating event network-changed:aeb688a8-fc1c-49cc-9dc3-8dd969837e09 for instance faffd5d9-d76f-4024-a760-9fb1d992620e on n-h2-465891-3 Jul 18 02:40:48.396382 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-351594a2-1215-4b47-9549-af163d70d2e5 req-af60d78d-a1bf-4155-9767-4c0621f3c209 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.293380 Jul 18 02:40:48.408756 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2034/4071] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:40:49.110751 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7ef0dc4b-dd74-4a84-902f-d56040a3d8d6 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421f66a2a442482980fa2112c7c14e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff3f555507b4f2e8905e9b2ab5b7780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:49.128661 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7ef0dc4b-dd74-4a84-902f-d56040a3d8d6 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] 10.222.0.57 "GET /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e" status: 200 len: 1328 microversion: 2.1 time: 0.983342 Jul 18 02:40:49.133524 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2038/4072] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:48 2022] GET /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e => generated 1328 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:40:50.153598 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-706a3d0d-fa3e-46e3-ab95-768568645c7c tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:50.154670 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-706a3d0d-fa3e-46e3-ab95-768568645c7c tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] [instance: faffd5d9-d76f-4024-a760-9fb1d992620e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:50.174402 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:50.218168 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-706a3d0d-fa3e-46e3-ab95-768568645c7c tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:50.219445 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-706a3d0d-fa3e-46e3-ab95-768568645c7c tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:50.221172 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-706a3d0d-fa3e-46e3-ab95-768568645c7c tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:50.222257 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-706a3d0d-fa3e-46e3-ab95-768568645c7c tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:51.680603 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-706a3d0d-fa3e-46e3-ab95-768568645c7c tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421f66a2a442482980fa2112c7c14e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff3f555507b4f2e8905e9b2ab5b7780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:51.706935 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-706a3d0d-fa3e-46e3-ab95-768568645c7c tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] 10.222.0.57 "GET /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e" status: 200 len: 1328 microversion: 2.1 time: 1.556981 Jul 18 02:40:51.711945 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2035/4073] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:50 2022] GET /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e => generated 1328 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:52.759438 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3d3acd5d-27e2-4ae0-8d65-e46d2c3dbcbc tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:52.761130 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3d3acd5d-27e2-4ae0-8d65-e46d2c3dbcbc tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] [instance: faffd5d9-d76f-4024-a760-9fb1d992620e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:52.773024 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=8 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:52.792020 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3d3acd5d-27e2-4ae0-8d65-e46d2c3dbcbc tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:52.792954 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3d3acd5d-27e2-4ae0-8d65-e46d2c3dbcbc tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:52.794514 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3d3acd5d-27e2-4ae0-8d65-e46d2c3dbcbc tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:52.795098 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3d3acd5d-27e2-4ae0-8d65-e46d2c3dbcbc tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:53.441554 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3d3acd5d-27e2-4ae0-8d65-e46d2c3dbcbc tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421f66a2a442482980fa2112c7c14e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff3f555507b4f2e8905e9b2ab5b7780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:53.466468 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3d3acd5d-27e2-4ae0-8d65-e46d2c3dbcbc tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] 10.222.0.57 "GET /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e" status: 200 len: 1328 microversion: 2.1 time: 0.736601 Jul 18 02:40:53.486808 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2039/4074] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:52 2022] GET /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e => generated 1328 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:54.506058 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c5d6a939-fee7-4306-95ec-27ce5230a9a3 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:54.507702 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c5d6a939-fee7-4306-95ec-27ce5230a9a3 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] [instance: faffd5d9-d76f-4024-a760-9fb1d992620e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:54.535872 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c5d6a939-fee7-4306-95ec-27ce5230a9a3 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:54.536733 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c5d6a939-fee7-4306-95ec-27ce5230a9a3 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:54.550917 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c5d6a939-fee7-4306-95ec-27ce5230a9a3 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:54.554270 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c5d6a939-fee7-4306-95ec-27ce5230a9a3 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:54.865452 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c5d6a939-fee7-4306-95ec-27ce5230a9a3 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421f66a2a442482980fa2112c7c14e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff3f555507b4f2e8905e9b2ab5b7780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:54.879425 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c5d6a939-fee7-4306-95ec-27ce5230a9a3 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] 10.222.0.57 "GET /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e" status: 200 len: 1328 microversion: 2.1 time: 0.384974 Jul 18 02:40:54.879425 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2036/4075] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:54 2022] GET /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e => generated 1328 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:55.904149 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cef45dd2-633c-43a6-8d34-73bbcdf95009 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:55.905271 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cef45dd2-633c-43a6-8d34-73bbcdf95009 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] [instance: faffd5d9-d76f-4024-a760-9fb1d992620e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:55.924959 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cef45dd2-633c-43a6-8d34-73bbcdf95009 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:55.926081 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cef45dd2-633c-43a6-8d34-73bbcdf95009 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:55.930966 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cef45dd2-633c-43a6-8d34-73bbcdf95009 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:55.931802 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cef45dd2-633c-43a6-8d34-73bbcdf95009 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:56.449004 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-690bcbaa-11b8-4c39-9b95-6ea2172bb710 req-8303b4dd-6975-477a-9b21-0d4e172ac2d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faffd5d9-d76f-4024-a760-9fb1d992620e", "name": "network-vif-plugged", "status": "completed", "tag": "aeb688a8-fc1c-49cc-9dc3-8dd969837e09"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:40:56.490765 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-690bcbaa-11b8-4c39-9b95-6ea2172bb710 req-8303b4dd-6975-477a-9b21-0d4e172ac2d6 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:56.492776 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-690bcbaa-11b8-4c39-9b95-6ea2172bb710 req-8303b4dd-6975-477a-9b21-0d4e172ac2d6 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:56.571538 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-690bcbaa-11b8-4c39-9b95-6ea2172bb710 req-8303b4dd-6975-477a-9b21-0d4e172ac2d6 service nova] Creating event network-vif-plugged:aeb688a8-fc1c-49cc-9dc3-8dd969837e09 for instance faffd5d9-d76f-4024-a760-9fb1d992620e on n-h2-465891-3 Jul 18 02:40:56.581896 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-690bcbaa-11b8-4c39-9b95-6ea2172bb710 req-8303b4dd-6975-477a-9b21-0d4e172ac2d6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157280 Jul 18 02:40:56.589596 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2037/4076] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:40:56.660787 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-cef45dd2-633c-43a6-8d34-73bbcdf95009 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421f66a2a442482980fa2112c7c14e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff3f555507b4f2e8905e9b2ab5b7780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:56.729652 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cef45dd2-633c-43a6-8d34-73bbcdf95009 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] 10.222.0.57 "GET /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e" status: 200 len: 1328 microversion: 2.1 time: 0.830222 Jul 18 02:40:56.751676 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2040/4077] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:55 2022] GET /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e => generated 1328 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:57.761393 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a861f16d-65aa-4905-b7c2-fb87ac3b7080 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:57.763638 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a861f16d-65aa-4905-b7c2-fb87ac3b7080 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] [instance: faffd5d9-d76f-4024-a760-9fb1d992620e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:57.779788 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a861f16d-65aa-4905-b7c2-fb87ac3b7080 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:57.780240 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a861f16d-65aa-4905-b7c2-fb87ac3b7080 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:57.781117 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a861f16d-65aa-4905-b7c2-fb87ac3b7080 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:57.783381 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a861f16d-65aa-4905-b7c2-fb87ac3b7080 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:58.219650 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a861f16d-65aa-4905-b7c2-fb87ac3b7080 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421f66a2a442482980fa2112c7c14e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff3f555507b4f2e8905e9b2ab5b7780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:58.235472 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a861f16d-65aa-4905-b7c2-fb87ac3b7080 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] 10.222.0.57 "GET /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e" status: 200 len: 1328 microversion: 2.1 time: 0.477784 Jul 18 02:40:58.237674 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2038/4078] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:57 2022] GET /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e => generated 1328 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:59.267571 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-58a2e269-b8b8-4b4f-b848-d257d2792aad tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:59.268717 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-58a2e269-b8b8-4b4f-b848-d257d2792aad tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] [instance: faffd5d9-d76f-4024-a760-9fb1d992620e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:59.289608 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-58a2e269-b8b8-4b4f-b848-d257d2792aad tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:59.290645 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-58a2e269-b8b8-4b4f-b848-d257d2792aad tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:59.292475 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-58a2e269-b8b8-4b4f-b848-d257d2792aad tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:59.294863 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-58a2e269-b8b8-4b4f-b848-d257d2792aad tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:59.481315 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-58a2e269-b8b8-4b4f-b848-d257d2792aad tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421f66a2a442482980fa2112c7c14e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff3f555507b4f2e8905e9b2ab5b7780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:59.492827 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-58a2e269-b8b8-4b4f-b848-d257d2792aad tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] 10.222.0.57 "GET /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e" status: 200 len: 1527 microversion: 2.1 time: 0.233542 Jul 18 02:40:59.494351 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2041/4079] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:59 2022] GET /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e => generated 1527 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:59.525206 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-76cda047-f534-4dc7-a7c0-9a88842b1c40 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:59.527391 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-76cda047-f534-4dc7-a7c0-9a88842b1c40 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] [instance: faffd5d9-d76f-4024-a760-9fb1d992620e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:59.578989 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-76cda047-f534-4dc7-a7c0-9a88842b1c40 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:59.583154 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-76cda047-f534-4dc7-a7c0-9a88842b1c40 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:59.585514 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-76cda047-f534-4dc7-a7c0-9a88842b1c40 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:59.587053 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-76cda047-f534-4dc7-a7c0-9a88842b1c40 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:59.790397 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-76cda047-f534-4dc7-a7c0-9a88842b1c40 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421f66a2a442482980fa2112c7c14e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff3f555507b4f2e8905e9b2ab5b7780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:59.805149 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-76cda047-f534-4dc7-a7c0-9a88842b1c40 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] 10.222.0.57 "GET /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e" status: 200 len: 1527 microversion: 2.1 time: 0.287604 Jul 18 02:40:59.806331 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2039/4080] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:59 2022] GET /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e => generated 1527 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:00.459916 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-262e2f7e-c5c8-4919-b201-9300317ec3fc tempest-ServersNegativeTestMultiTenantJSON-407825560 tempest-ServersNegativeTestMultiTenantJSON-407825560-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:00.463644 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-262e2f7e-c5c8-4919-b201-9300317ec3fc tempest-ServersNegativeTestMultiTenantJSON-407825560 tempest-ServersNegativeTestMultiTenantJSON-407825560-project] [instance: faffd5d9-d76f-4024-a760-9fb1d992620e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:00.478470 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-262e2f7e-c5c8-4919-b201-9300317ec3fc tempest-ServersNegativeTestMultiTenantJSON-407825560 tempest-ServersNegativeTestMultiTenantJSON-407825560-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:00.478933 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-262e2f7e-c5c8-4919-b201-9300317ec3fc tempest-ServersNegativeTestMultiTenantJSON-407825560 tempest-ServersNegativeTestMultiTenantJSON-407825560-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:00.479898 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-262e2f7e-c5c8-4919-b201-9300317ec3fc tempest-ServersNegativeTestMultiTenantJSON-407825560 tempest-ServersNegativeTestMultiTenantJSON-407825560-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:00.483991 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-262e2f7e-c5c8-4919-b201-9300317ec3fc tempest-ServersNegativeTestMultiTenantJSON-407825560 tempest-ServersNegativeTestMultiTenantJSON-407825560-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:00.515595 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-262e2f7e-c5c8-4919-b201-9300317ec3fc tempest-ServersNegativeTestMultiTenantJSON-407825560 tempest-ServersNegativeTestMultiTenantJSON-407825560-project] HTTP exception thrown: Instance faffd5d9-d76f-4024-a760-9fb1d992620e could not be found. Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-262e2f7e-c5c8-4919-b201-9300317ec3fc tempest-ServersNegativeTestMultiTenantJSON-407825560 tempest-ServersNegativeTestMultiTenantJSON-407825560-project] Request method failure captured: Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e HTTP/1.1 Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MgiJWgvHWqNVgkEG1s-LZ-ku1tdyR3I7h469vpCnAeUwgJTy1lUEObDfDuDOAGYvAKSvAG8XGD4jT8F8-GPsRbnmpGST-fO0ysBEP6vO40Ya0h8CiJ-n9-xp0CP4Lig-XG6N7wzjjXtgTrtXcDe0sRb30z7cSvhrVmVzE0IlvlgLFE Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: d2903b054369492fb0d2bf25cd3a09dd Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-407825560 Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d2903b054369492fb0d2bf25cd3a09dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d2903b054369492fb0d2bf25cd3a09dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d2903b054369492fb0d2bf25cd3a09dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d2903b054369492fb0d2bf25cd3a09dd"}]}] Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-407825560 Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: d2903b054369492fb0d2bf25cd3a09dd Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-407825560 Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersNegativeTestMultiTenantJSON-407825560-project Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 12dc64fc0614444f88a7c9dc0b7c8d97 Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-407825560-project Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance faffd5d9-d76f-4024-a760-9fb1d992620e could not be found. Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'faffd5d9-d76f-4024-a760-9fb1d992620e'} Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faffd5d9-d76f-4024-a760-9fb1d992620e could not be found. Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:41:00.517646 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:41:00.522781 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faffd5d9-d76f-4024-a760-9fb1d992620e could not be found. Jul 18 02:41:00.522781 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:41:00.522781 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:00.522781 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:41:00.522781 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:00.522781 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:00.522781 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:00.522781 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:41:00.522781 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:41:00.522781 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faffd5d9-d76f-4024-a760-9fb1d992620e could not be found. Jul 18 02:41:00.522781 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:41:00.525186 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-262e2f7e-c5c8-4919-b201-9300317ec3fc tempest-ServersNegativeTestMultiTenantJSON-407825560 tempest-ServersNegativeTestMultiTenantJSON-407825560-project] Returning 404 to user: Instance faffd5d9-d76f-4024-a760-9fb1d992620e could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:41:00.526339 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-262e2f7e-c5c8-4919-b201-9300317ec3fc tempest-ServersNegativeTestMultiTenantJSON-407825560 tempest-ServersNegativeTestMultiTenantJSON-407825560-project] 10.222.0.57 "DELETE /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e" status: 404 len: 111 microversion: 2.1 time: 0.695267 Jul 18 02:41:00.532962 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2042/4081] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:40:59 2022] DELETE /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e => generated 111 bytes in 702 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:41:00.542854 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8eae8bba-f5cc-4bcc-b35a-0a681a7c93ae tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:00.548264 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8eae8bba-f5cc-4bcc-b35a-0a681a7c93ae tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] [instance: faffd5d9-d76f-4024-a760-9fb1d992620e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:00.573522 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8eae8bba-f5cc-4bcc-b35a-0a681a7c93ae tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:00.579531 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8eae8bba-f5cc-4bcc-b35a-0a681a7c93ae tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:00.581257 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8eae8bba-f5cc-4bcc-b35a-0a681a7c93ae tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:00.582316 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8eae8bba-f5cc-4bcc-b35a-0a681a7c93ae tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:01.127866 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8eae8bba-f5cc-4bcc-b35a-0a681a7c93ae tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421f66a2a442482980fa2112c7c14e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff3f555507b4f2e8905e9b2ab5b7780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:01.143926 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8eae8bba-f5cc-4bcc-b35a-0a681a7c93ae tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] 10.222.0.57 "GET /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e" status: 200 len: 1527 microversion: 2.1 time: 0.608836 Jul 18 02:41:01.144561 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2040/4082] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:00 2022] GET /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e => generated 1527 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:41:01.175652 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-74009d8a-4a9d-4eb8-b876-7f3da5f4f50e tempest-ServersNegativeTestMultiTenantJSON-407825560 tempest-ServersNegativeTestMultiTenantJSON-407825560-project] Action: 'update', calling method: >, body: {"server": {"name": "faffd5d9-d76f-4024-a760-9fb1d992620e_new"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:41:01.178050 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-74009d8a-4a9d-4eb8-b876-7f3da5f4f50e tempest-ServersNegativeTestMultiTenantJSON-407825560 tempest-ServersNegativeTestMultiTenantJSON-407825560-project] [instance: faffd5d9-d76f-4024-a760-9fb1d992620e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:01.190593 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74009d8a-4a9d-4eb8-b876-7f3da5f4f50e tempest-ServersNegativeTestMultiTenantJSON-407825560 tempest-ServersNegativeTestMultiTenantJSON-407825560-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:01.191868 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74009d8a-4a9d-4eb8-b876-7f3da5f4f50e tempest-ServersNegativeTestMultiTenantJSON-407825560 tempest-ServersNegativeTestMultiTenantJSON-407825560-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:01.194359 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74009d8a-4a9d-4eb8-b876-7f3da5f4f50e tempest-ServersNegativeTestMultiTenantJSON-407825560 tempest-ServersNegativeTestMultiTenantJSON-407825560-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:01.195462 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74009d8a-4a9d-4eb8-b876-7f3da5f4f50e tempest-ServersNegativeTestMultiTenantJSON-407825560 tempest-ServersNegativeTestMultiTenantJSON-407825560-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:01.221278 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-74009d8a-4a9d-4eb8-b876-7f3da5f4f50e tempest-ServersNegativeTestMultiTenantJSON-407825560 tempest-ServersNegativeTestMultiTenantJSON-407825560-project] HTTP exception thrown: Instance faffd5d9-d76f-4024-a760-9fb1d992620e could not be found. Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-74009d8a-4a9d-4eb8-b876-7f3da5f4f50e tempest-ServersNegativeTestMultiTenantJSON-407825560 tempest-ServersNegativeTestMultiTenantJSON-407825560-project] Request method failure captured: Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: request: PUT /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e HTTP/1.1 Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 64 Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MgiJWgvHWqNVgkEG1s-LZ-ku1tdyR3I7h469vpCnAeUwgJTy1lUEObDfDuDOAGYvAKSvAG8XGD4jT8F8-GPsRbnmpGST-fO0ysBEP6vO40Ya0h8CiJ-n9-xp0CP4Lig-XG6N7wzjjXtgTrtXcDe0sRb30z7cSvhrVmVzE0IlvlgLFE Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: d2903b054369492fb0d2bf25cd3a09dd Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-407825560 Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d2903b054369492fb0d2bf25cd3a09dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d2903b054369492fb0d2bf25cd3a09dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d2903b054369492fb0d2bf25cd3a09dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d2903b054369492fb0d2bf25cd3a09dd"}]}] Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-407825560 Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: d2903b054369492fb0d2bf25cd3a09dd Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-407825560 Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersNegativeTestMultiTenantJSON-407825560-project Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 12dc64fc0614444f88a7c9dc0b7c8d97 Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-407825560-project Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: {"server": {"name": "faffd5d9-d76f-4024-a760-9fb1d992620e_new"}} Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance faffd5d9-d76f-4024-a760-9fb1d992620e could not be found. Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'faffd5d9-d76f-4024-a760-9fb1d992620e', 'body': {'server': {'name': 'faffd5d9-d76f-4024-a760-9fb1d992620e_new'}}} Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faffd5d9-d76f-4024-a760-9fb1d992620e could not be found. Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 18 02:41:01.225669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 18 02:41:01.232363 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 18 02:41:01.232363 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:41:01.232363 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:41:01.232363 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:41:01.232363 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:41:01.232363 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faffd5d9-d76f-4024-a760-9fb1d992620e could not be found. Jul 18 02:41:01.232363 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:41:01.232363 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:01.232363 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:41:01.232363 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:01.232363 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:01.232363 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:01.232363 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:41:01.232363 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:41:01.232363 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faffd5d9-d76f-4024-a760-9fb1d992620e could not be found. Jul 18 02:41:01.232363 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:41:01.232363 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-74009d8a-4a9d-4eb8-b876-7f3da5f4f50e tempest-ServersNegativeTestMultiTenantJSON-407825560 tempest-ServersNegativeTestMultiTenantJSON-407825560-project] Returning 404 to user: Instance faffd5d9-d76f-4024-a760-9fb1d992620e could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:41:01.232363 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-74009d8a-4a9d-4eb8-b876-7f3da5f4f50e tempest-ServersNegativeTestMultiTenantJSON-407825560 tempest-ServersNegativeTestMultiTenantJSON-407825560-project] 10.222.0.57 "PUT /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e" status: 404 len: 111 microversion: 2.1 time: 0.059461 Jul 18 02:41:01.238183 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2043/4083] 10.222.0.57 () {60 vars in 1255 bytes} [Mon Jul 18 02:41:01 2022] PUT /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:41:01.243548 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-67f0ded9-6d75-4987-af61-ad7965724f18 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:01.244178 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-67f0ded9-6d75-4987-af61-ad7965724f18 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] [instance: faffd5d9-d76f-4024-a760-9fb1d992620e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:01.252505 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-67f0ded9-6d75-4987-af61-ad7965724f18 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:01.252981 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-67f0ded9-6d75-4987-af61-ad7965724f18 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:01.254240 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-67f0ded9-6d75-4987-af61-ad7965724f18 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:01.254414 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-67f0ded9-6d75-4987-af61-ad7965724f18 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:01.318178 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-67f0ded9-6d75-4987-af61-ad7965724f18 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] [instance: faffd5d9-d76f-4024-a760-9fb1d992620e] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:41:01.546260 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-67f0ded9-6d75-4987-af61-ad7965724f18 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] 10.222.0.57 "DELETE /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e" status: 204 len: 0 microversion: 2.1 time: 0.296139 Jul 18 02:41:01.546260 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2041/4084] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:41:01 2022] DELETE /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:41:01.553575 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bd7de908-5888-4bdb-878b-44af76e7511b tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:01.554582 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bd7de908-5888-4bdb-878b-44af76e7511b tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] [instance: faffd5d9-d76f-4024-a760-9fb1d992620e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:01.588275 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bd7de908-5888-4bdb-878b-44af76e7511b tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:01.588927 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bd7de908-5888-4bdb-878b-44af76e7511b tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:01.590196 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bd7de908-5888-4bdb-878b-44af76e7511b tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:01.591462 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bd7de908-5888-4bdb-878b-44af76e7511b tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:01.898576 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bd7de908-5888-4bdb-878b-44af76e7511b tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421f66a2a442482980fa2112c7c14e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff3f555507b4f2e8905e9b2ab5b7780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:01.923104 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bd7de908-5888-4bdb-878b-44af76e7511b tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] 10.222.0.57 "GET /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e" status: 200 len: 1533 microversion: 2.1 time: 0.375602 Jul 18 02:41:01.925441 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2044/4085] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:01 2022] GET /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e => generated 1533 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:02.729018 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ab29fb8b-13af-46c2-931f-d89b028e8c33 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:02.737086 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ab29fb8b-13af-46c2-931f-d89b028e8c33 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:02.776267 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ab29fb8b-13af-46c2-931f-d89b028e8c33 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:02.777118 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ab29fb8b-13af-46c2-931f-d89b028e8c33 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:02.792122 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ab29fb8b-13af-46c2-931f-d89b028e8c33 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:02.797222 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ab29fb8b-13af-46c2-931f-d89b028e8c33 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:02.870954 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3eb53db4-17b4-4109-84e3-ac99316e7ee0 tempest-QuotasTestJSON-620025083 tempest-QuotasTestJSON-620025083-project] Calling method '.version_select at 0x7ff49be269d0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:02.907275 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ab29fb8b-13af-46c2-931f-d89b028e8c33 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/os-volume_attachments/9f253c50-56b1-41de-9608-7717671936e7" status: 200 len: 194 microversion: 2.20 time: 0.639901 Jul 18 02:41:02.909941 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2042/4086] 10.222.0.57 () {60 vars in 1453 bytes} [Mon Jul 18 02:41:02 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/os-volume_attachments/9f253c50-56b1-41de-9608-7717671936e7 => generated 194 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:41:02.951746 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e3650781-39a6-4a63-a3e3-4b9cf4c89935 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:02.952613 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e3650781-39a6-4a63-a3e3-4b9cf4c89935 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] [instance: faffd5d9-d76f-4024-a760-9fb1d992620e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:02.970412 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e3650781-39a6-4a63-a3e3-4b9cf4c89935 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:02.975618 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e3650781-39a6-4a63-a3e3-4b9cf4c89935 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:02.978990 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e3650781-39a6-4a63-a3e3-4b9cf4c89935 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:02.978990 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e3650781-39a6-4a63-a3e3-4b9cf4c89935 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:03.028311 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3eb53db4-17b4-4109-84e3-ac99316e7ee0 tempest-QuotasTestJSON-620025083 tempest-QuotasTestJSON-620025083-project] 10.222.0.57 "GET /compute/v2.1/os-quota-sets/31fe4c369ba04ea3b15fadd49a3a9c39/defaults" status: 200 len: 371 microversion: 2.1 time: 0.756653 Jul 18 02:41:03.042468 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2045/4087] 10.222.0.57 () {58 vars in 1268 bytes} [Mon Jul 18 02:41:02 2022] GET /compute/v2.1/os-quota-sets/31fe4c369ba04ea3b15fadd49a3a9c39/defaults => generated 371 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:41:03.112269 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-267bc258-79f6-40c3-910a-65f02d3b1610 tempest-QuotasTestJSON-620025083 tempest-QuotasTestJSON-620025083-project] Calling method '.version_select at 0x7ff49be26790>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:03.346864 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-267bc258-79f6-40c3-910a-65f02d3b1610 tempest-QuotasTestJSON-620025083 tempest-QuotasTestJSON-620025083-project] 10.222.0.57 "GET /compute/v2.1/os-quota-sets/31fe4c369ba04ea3b15fadd49a3a9c39" status: 200 len: 371 microversion: 2.1 time: 0.296934 Jul 18 02:41:03.364374 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2046/4088] 10.222.0.57 () {58 vars in 1241 bytes} [Mon Jul 18 02:41:03 2022] GET /compute/v2.1/os-quota-sets/31fe4c369ba04ea3b15fadd49a3a9c39 => generated 371 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:41:03.378146 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f09fb54e-4f68-4fc6-82cd-bbf6df8da5fb tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:03.388257 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f09fb54e-4f68-4fc6-82cd-bbf6df8da5fb tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:03.408432 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f09fb54e-4f68-4fc6-82cd-bbf6df8da5fb tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:03.415648 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f09fb54e-4f68-4fc6-82cd-bbf6df8da5fb tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:03.419765 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f09fb54e-4f68-4fc6-82cd-bbf6df8da5fb tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:03.426728 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f09fb54e-4f68-4fc6-82cd-bbf6df8da5fb tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:03.690143 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-f09fb54e-4f68-4fc6-82cd-bbf6df8da5fb tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lazy-loading 'services' on Instance uuid d18d284e-d055-4fe5-af1c-b41ee803d426 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:41:03.859425 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e3650781-39a6-4a63-a3e3-4b9cf4c89935 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421f66a2a442482980fa2112c7c14e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff3f555507b4f2e8905e9b2ab5b7780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:03.892270 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e3650781-39a6-4a63-a3e3-4b9cf4c89935 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] 10.222.0.57 "GET /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e" status: 200 len: 1533 microversion: 2.1 time: 0.947002 Jul 18 02:41:03.897511 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2043/4089] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:02 2022] GET /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e => generated 1533 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:03.921610 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-853ded5e-e13c-48b5-a7be-536adad8909d tempest-QuotasTestJSON-620025083 tempest-QuotasTestJSON-620025083-project] Calling method '.version_select at 0x7ff4a8b48280>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:03.928951 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f09fb54e-4f68-4fc6-82cd-bbf6df8da5fb tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/os-volume_attachments/9f253c50-56b1-41de-9608-7717671936e7" status: 202 len: 0 microversion: 2.20 time: 0.557557 Jul 18 02:41:03.932288 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2047/4090] 10.222.0.57 () {60 vars in 1456 bytes} [Mon Jul 18 02:41:03 2022] DELETE /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/os-volume_attachments/9f253c50-56b1-41de-9608-7717671936e7 => generated 0 bytes in 567 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:41:03.977463 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7060510d-d715-4309-8c86-2e02d883ee5e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:03.978838 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7060510d-d715-4309-8c86-2e02d883ee5e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:04.049798 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7060510d-d715-4309-8c86-2e02d883ee5e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:04.050775 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7060510d-d715-4309-8c86-2e02d883ee5e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:04.086635 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7060510d-d715-4309-8c86-2e02d883ee5e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:04.087441 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7060510d-d715-4309-8c86-2e02d883ee5e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:04.181592 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-853ded5e-e13c-48b5-a7be-536adad8909d tempest-QuotasTestJSON-620025083 tempest-QuotasTestJSON-620025083-project] 10.222.0.57 "GET /compute/v2.1/os-quota-sets/31fe4c369ba04ea3b15fadd49a3a9c39/defaults" status: 200 len: 371 microversion: 2.1 time: 0.280410 Jul 18 02:41:04.188623 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2044/4091] 10.222.0.57 () {58 vars in 1268 bytes} [Mon Jul 18 02:41:03 2022] GET /compute/v2.1/os-quota-sets/31fe4c369ba04ea3b15fadd49a3a9c39/defaults => generated 371 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:41:04.213125 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4ed59a70-6442-4ae8-a155-aa3242e2b0ba tempest-QuotasTestJSON-620025083 tempest-QuotasTestJSON-620025083-project] Calling method '.version_select at 0x7ff49bf960d0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:04.292164 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7060510d-d715-4309-8c86-2e02d883ee5e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.349524 Jul 18 02:41:04.296051 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2048/4092] 10.222.0.57 () {60 vars in 1342 bytes} [Mon Jul 18 02:41:03 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/os-volume_attachments => generated 197 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:41:04.378801 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4ed59a70-6442-4ae8-a155-aa3242e2b0ba tempest-QuotasTestJSON-620025083 tempest-QuotasTestJSON-620025083-project] 10.222.0.57 "GET /compute/v2.1/os-quota-sets/31fe4c369ba04ea3b15fadd49a3a9c39" status: 200 len: 371 microversion: 2.1 time: 0.181203 Jul 18 02:41:04.395087 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2045/4093] 10.222.0.57 () {58 vars in 1241 bytes} [Mon Jul 18 02:41:04 2022] GET /compute/v2.1/os-quota-sets/31fe4c369ba04ea3b15fadd49a3a9c39 => generated 371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:41:04.398059 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-71b025ad-d9b8-40db-a4b5-25b9d0cb5eab tempest-QuotasTestJSON-620025083 tempest-QuotasTestJSON-620025083-project] Calling method '.version_select at 0x7ff4a86144c0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:04.699420 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:04.746792 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-22dd7cd0-4e53-4d2a-b268-70c248a76f04 req-80a90585-c96d-4325-bf4f-642ca0f7d0cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faffd5d9-d76f-4024-a760-9fb1d992620e", "name": "network-vif-deleted", "tag": "aeb688a8-fc1c-49cc-9dc3-8dd969837e09"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:41:04.863304 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-22dd7cd0-4e53-4d2a-b268-70c248a76f04 req-80a90585-c96d-4325-bf4f-642ca0f7d0cb service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:04.866244 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-71b025ad-d9b8-40db-a4b5-25b9d0cb5eab tempest-QuotasTestJSON-620025083 tempest-QuotasTestJSON-620025083-project] 10.222.0.57 "GET /compute/v2.1/os-quota-sets/31fe4c369ba04ea3b15fadd49a3a9c39?user_id=ba7c9122fa784b95a679ad446a3c314f" status: 200 len: 371 microversion: 2.1 time: 0.472178 Jul 18 02:41:04.874791 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2049/4094] 10.222.0.57 () {58 vars in 1322 bytes} [Mon Jul 18 02:41:04 2022] GET /compute/v2.1/os-quota-sets/31fe4c369ba04ea3b15fadd49a3a9c39?user_id=ba7c9122fa784b95a679ad446a3c314f => generated 371 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:41:04.882247 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-22dd7cd0-4e53-4d2a-b268-70c248a76f04 req-80a90585-c96d-4325-bf4f-642ca0f7d0cb service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:04.924446 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-60bf606d-43ab-46b4-b74b-7012e262b38f tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:04.925323 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-60bf606d-43ab-46b4-b74b-7012e262b38f tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] [instance: faffd5d9-d76f-4024-a760-9fb1d992620e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:04.944667 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-60bf606d-43ab-46b4-b74b-7012e262b38f tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:04.945825 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-60bf606d-43ab-46b4-b74b-7012e262b38f tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:04.946525 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-60bf606d-43ab-46b4-b74b-7012e262b38f tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:04.951161 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-60bf606d-43ab-46b4-b74b-7012e262b38f tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:04.962214 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=64,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:04.966576 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-22dd7cd0-4e53-4d2a-b268-70c248a76f04 req-80a90585-c96d-4325-bf4f-642ca0f7d0cb service nova] Creating event network-vif-deleted:aeb688a8-fc1c-49cc-9dc3-8dd969837e09 for instance faffd5d9-d76f-4024-a760-9fb1d992620e on n-h2-465891-3 Jul 18 02:41:05.001488 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-22dd7cd0-4e53-4d2a-b268-70c248a76f04 req-80a90585-c96d-4325-bf4f-642ca0f7d0cb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.261363 Jul 18 02:41:05.008023 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2046/4095] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:41:05.086297 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-60bf606d-43ab-46b4-b74b-7012e262b38f tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:05.086297 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-60bf606d-43ab-46b4-b74b-7012e262b38f tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:05.086297 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-60bf606d-43ab-46b4-b74b-7012e262b38f tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lazy-loading 'fault' on Instance uuid faffd5d9-d76f-4024-a760-9fb1d992620e {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:41:05.182105 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-60bf606d-43ab-46b4-b74b-7012e262b38f tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421f66a2a442482980fa2112c7c14e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff3f555507b4f2e8905e9b2ab5b7780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:05.194914 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-60bf606d-43ab-46b4-b74b-7012e262b38f tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] 10.222.0.57 "GET /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e" status: 200 len: 1318 microversion: 2.1 time: 0.274448 Jul 18 02:41:05.220111 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2050/4096] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:04 2022] GET /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e => generated 1318 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:05.331312 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4e5e50d6-05e6-4612-93df-e12460496cf4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:05.334220 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4e5e50d6-05e6-4612-93df-e12460496cf4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:05.350667 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4e5e50d6-05e6-4612-93df-e12460496cf4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:05.351869 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4e5e50d6-05e6-4612-93df-e12460496cf4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:05.353194 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4e5e50d6-05e6-4612-93df-e12460496cf4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:05.354871 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4e5e50d6-05e6-4612-93df-e12460496cf4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:05.426082 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4e5e50d6-05e6-4612-93df-e12460496cf4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.113246 Jul 18 02:41:05.427357 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2047/4097] 10.222.0.57 () {60 vars in 1342 bytes} [Mon Jul 18 02:41:05 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:41:06.234529 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0c3486ce-4ddd-4eee-a06e-5edfbab58367 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:06.235620 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0c3486ce-4ddd-4eee-a06e-5edfbab58367 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] [instance: faffd5d9-d76f-4024-a760-9fb1d992620e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:06.269388 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c3486ce-4ddd-4eee-a06e-5edfbab58367 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:06.279653 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c3486ce-4ddd-4eee-a06e-5edfbab58367 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:06.282292 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c3486ce-4ddd-4eee-a06e-5edfbab58367 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:06.283619 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c3486ce-4ddd-4eee-a06e-5edfbab58367 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:06.316515 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-0c3486ce-4ddd-4eee-a06e-5edfbab58367 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] HTTP exception thrown: Instance faffd5d9-d76f-4024-a760-9fb1d992620e could not be found. Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0c3486ce-4ddd-4eee-a06e-5edfbab58367 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Request method failure captured: Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e HTTP/1.1 Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MgOrnKdcmGsMZC3Ras-v3R_mV6wWJm16rbu_C9mR-Q37yDGC0HKd-nwhroJCr53-4HzeW1yylWFAB_HNlL4jL5JwmDR6cAsjruKZ38AnFyNJOIPsO_p6hJnkcSopfCfUsNBnivkbSx8b1TaPzyVqdcT0WNDuyVOxhKxsNbKVWWTza4 Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 7ff3f555507b4f2e8905e9b2ab5b7780 Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1656773714 Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_7ff3f555507b4f2e8905e9b2ab5b7780"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7ff3f555507b4f2e8905e9b2ab5b7780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7ff3f555507b4f2e8905e9b2ab5b7780"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/7ff3f555507b4f2e8905e9b2ab5b7780"}]}] Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1656773714 Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 7ff3f555507b4f2e8905e9b2ab5b7780 Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1656773714 Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1656773714-project Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 421f66a2a442482980fa2112c7c14e0d Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1656773714-project Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance faffd5d9-d76f-4024-a760-9fb1d992620e could not be found. Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'faffd5d9-d76f-4024-a760-9fb1d992620e'} Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faffd5d9-d76f-4024-a760-9fb1d992620e could not be found. Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faffd5d9-d76f-4024-a760-9fb1d992620e could not be found. Jul 18 02:41:06.318574 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:41:06.324040 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:06.324040 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:41:06.324040 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:06.324040 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:06.324040 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:06.324040 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:41:06.324040 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:41:06.324040 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faffd5d9-d76f-4024-a760-9fb1d992620e could not be found. Jul 18 02:41:06.324040 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:41:06.327554 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0c3486ce-4ddd-4eee-a06e-5edfbab58367 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] Returning 404 to user: Instance faffd5d9-d76f-4024-a760-9fb1d992620e could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:41:06.328660 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0c3486ce-4ddd-4eee-a06e-5edfbab58367 tempest-ServersNegativeTestMultiTenantJSON-1656773714 tempest-ServersNegativeTestMultiTenantJSON-1656773714-project] 10.222.0.57 "GET /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e" status: 404 len: 111 microversion: 2.1 time: 0.104857 Jul 18 02:41:06.329574 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2051/4098] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:06 2022] GET /compute/v2.1/servers/faffd5d9-d76f-4024-a760-9fb1d992620e => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:41:06.440961 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-26d05510-c64a-4953-b637-59fcfdfa1810 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:06.442219 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-26d05510-c64a-4953-b637-59fcfdfa1810 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:06.453226 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-26d05510-c64a-4953-b637-59fcfdfa1810 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:06.453902 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-26d05510-c64a-4953-b637-59fcfdfa1810 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:06.454946 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-26d05510-c64a-4953-b637-59fcfdfa1810 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:06.456237 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-26d05510-c64a-4953-b637-59fcfdfa1810 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:06.595128 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-26d05510-c64a-4953-b637-59fcfdfa1810 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.160621 Jul 18 02:41:06.607099 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2048/4099] 10.222.0.57 () {60 vars in 1342 bytes} [Mon Jul 18 02:41:06 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:41:07.628722 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bff46c57-9293-4e1d-a89f-0a0ed8cab6e6 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:07.630714 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bff46c57-9293-4e1d-a89f-0a0ed8cab6e6 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:07.675662 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bff46c57-9293-4e1d-a89f-0a0ed8cab6e6 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:07.675662 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bff46c57-9293-4e1d-a89f-0a0ed8cab6e6 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:07.675662 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bff46c57-9293-4e1d-a89f-0a0ed8cab6e6 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:07.675662 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bff46c57-9293-4e1d-a89f-0a0ed8cab6e6 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:07.767589 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bff46c57-9293-4e1d-a89f-0a0ed8cab6e6 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.157082 Jul 18 02:41:07.774209 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2052/4100] 10.222.0.57 () {60 vars in 1342 bytes} [Mon Jul 18 02:41:07 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:41:08.781476 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c3c90868-6c26-46f5-aaa5-84c42487c933 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:08.782466 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c3c90868-6c26-46f5-aaa5-84c42487c933 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:08.787519 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:08.802151 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c3c90868-6c26-46f5-aaa5-84c42487c933 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:08.802987 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c3c90868-6c26-46f5-aaa5-84c42487c933 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:08.812318 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c3c90868-6c26-46f5-aaa5-84c42487c933 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:08.813021 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c3c90868-6c26-46f5-aaa5-84c42487c933 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:08.817056 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:08.914005 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c3c90868-6c26-46f5-aaa5-84c42487c933 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.137071 Jul 18 02:41:08.915255 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2049/4101] 10.222.0.57 () {60 vars in 1342 bytes} [Mon Jul 18 02:41:08 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:41:09.927622 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4a5b2da7-5d1b-40ff-a0bc-a653af806a39 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:09.928570 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4a5b2da7-5d1b-40ff-a0bc-a653af806a39 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:09.966163 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4a5b2da7-5d1b-40ff-a0bc-a653af806a39 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:09.971614 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4a5b2da7-5d1b-40ff-a0bc-a653af806a39 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:09.974980 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4a5b2da7-5d1b-40ff-a0bc-a653af806a39 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:09.977899 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4a5b2da7-5d1b-40ff-a0bc-a653af806a39 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:10.053159 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4a5b2da7-5d1b-40ff-a0bc-a653af806a39 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.130213 Jul 18 02:41:10.059834 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2053/4102] 10.222.0.57 () {60 vars in 1342 bytes} [Mon Jul 18 02:41:09 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:41:11.068644 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-473de8c9-5041-4c78-9e7a-527ee516870c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:11.070526 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-473de8c9-5041-4c78-9e7a-527ee516870c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:11.099490 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-473de8c9-5041-4c78-9e7a-527ee516870c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:11.101163 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-473de8c9-5041-4c78-9e7a-527ee516870c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:11.105332 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-473de8c9-5041-4c78-9e7a-527ee516870c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:11.107140 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-473de8c9-5041-4c78-9e7a-527ee516870c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:11.247079 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-473de8c9-5041-4c78-9e7a-527ee516870c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.164098 Jul 18 02:41:11.249415 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2050/4103] 10.222.0.57 () {60 vars in 1342 bytes} [Mon Jul 18 02:41:11 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:41:12.265380 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-233622a6-a88d-4eb9-978e-90cbf2090a48 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:12.265380 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-233622a6-a88d-4eb9-978e-90cbf2090a48 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:12.287469 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-233622a6-a88d-4eb9-978e-90cbf2090a48 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:12.288896 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-233622a6-a88d-4eb9-978e-90cbf2090a48 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:12.289802 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-233622a6-a88d-4eb9-978e-90cbf2090a48 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:12.290260 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-233622a6-a88d-4eb9-978e-90cbf2090a48 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:12.408313 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-233622a6-a88d-4eb9-978e-90cbf2090a48 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.151204 Jul 18 02:41:12.414862 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2054/4104] 10.222.0.57 () {60 vars in 1342 bytes} [Mon Jul 18 02:41:12 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:41:13.435015 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3ccaec18-7049-4cd3-889c-34ede58d672e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:13.442293 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3ccaec18-7049-4cd3-889c-34ede58d672e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:13.495471 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3ccaec18-7049-4cd3-889c-34ede58d672e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:13.496268 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3ccaec18-7049-4cd3-889c-34ede58d672e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:13.497828 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3ccaec18-7049-4cd3-889c-34ede58d672e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:13.512510 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3ccaec18-7049-4cd3-889c-34ede58d672e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:13.621724 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3ccaec18-7049-4cd3-889c-34ede58d672e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.204092 Jul 18 02:41:13.628506 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2051/4105] 10.222.0.57 () {60 vars in 1342 bytes} [Mon Jul 18 02:41:13 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/os-volume_attachments => generated 197 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:41:14.523104 n-d-465891-3 devstack@n-api.service[119543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 02:41:14.524226 n-d-465891-3 devstack@n-api.service[119543]: Mon Jul 18 02:41:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 02:41:14.636889 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-442953a1-56fa-4b06-a10f-81cec74418ef tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:14.644951 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-442953a1-56fa-4b06-a10f-81cec74418ef tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:14.677477 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-442953a1-56fa-4b06-a10f-81cec74418ef tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:14.682975 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-442953a1-56fa-4b06-a10f-81cec74418ef tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:14.687536 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-442953a1-56fa-4b06-a10f-81cec74418ef tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:14.690872 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-442953a1-56fa-4b06-a10f-81cec74418ef tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:14.781401 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:14.815878 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-442953a1-56fa-4b06-a10f-81cec74418ef tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.184709 Jul 18 02:41:14.828134 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2055/4106] 10.222.0.57 () {60 vars in 1342 bytes} [Mon Jul 18 02:41:14 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/os-volume_attachments => generated 197 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:41:15.833577 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2cce06bd-b90d-44f3-b0a0-92b67d016add tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:15.835375 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2cce06bd-b90d-44f3-b0a0-92b67d016add tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:15.853765 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:15.863688 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2cce06bd-b90d-44f3-b0a0-92b67d016add tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:15.865350 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2cce06bd-b90d-44f3-b0a0-92b67d016add tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:15.868769 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2cce06bd-b90d-44f3-b0a0-92b67d016add tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:15.871122 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2cce06bd-b90d-44f3-b0a0-92b67d016add tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:16.044415 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2cce06bd-b90d-44f3-b0a0-92b67d016add tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.213387 Jul 18 02:41:16.046388 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2052/4107] 10.222.0.57 () {60 vars in 1342 bytes} [Mon Jul 18 02:41:15 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/os-volume_attachments => generated 197 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:41:17.058410 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c9fa8957-376c-4d42-ac1e-1ac535d21ee5 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:17.060821 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c9fa8957-376c-4d42-ac1e-1ac535d21ee5 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:17.097273 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c9fa8957-376c-4d42-ac1e-1ac535d21ee5 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:17.105662 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c9fa8957-376c-4d42-ac1e-1ac535d21ee5 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:17.107462 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c9fa8957-376c-4d42-ac1e-1ac535d21ee5 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:17.109946 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c9fa8957-376c-4d42-ac1e-1ac535d21ee5 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:17.257638 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c9fa8957-376c-4d42-ac1e-1ac535d21ee5 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.200453 Jul 18 02:41:17.268246 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2056/4108] 10.222.0.57 () {60 vars in 1342 bytes} [Mon Jul 18 02:41:17 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/os-volume_attachments => generated 197 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:41:18.279712 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-494e81d5-9f50-4d52-abd8-dea488bfadc8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:18.291827 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-494e81d5-9f50-4d52-abd8-dea488bfadc8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:18.336579 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-494e81d5-9f50-4d52-abd8-dea488bfadc8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:18.342720 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-494e81d5-9f50-4d52-abd8-dea488bfadc8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:18.350391 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-494e81d5-9f50-4d52-abd8-dea488bfadc8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:18.351484 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-494e81d5-9f50-4d52-abd8-dea488bfadc8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:18.537681 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-494e81d5-9f50-4d52-abd8-dea488bfadc8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.267826 Jul 18 02:41:18.565074 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2053/4109] 10.222.0.57 () {60 vars in 1342 bytes} [Mon Jul 18 02:41:18 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/os-volume_attachments => generated 197 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 02:41:19.568033 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4256f59a-35ef-4cb3-ac37-556c19813398 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:19.569009 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4256f59a-35ef-4cb3-ac37-556c19813398 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:19.584957 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4256f59a-35ef-4cb3-ac37-556c19813398 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:19.585539 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4256f59a-35ef-4cb3-ac37-556c19813398 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:19.586462 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4256f59a-35ef-4cb3-ac37-556c19813398 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:19.586909 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4256f59a-35ef-4cb3-ac37-556c19813398 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:19.643727 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4256f59a-35ef-4cb3-ac37-556c19813398 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077083 Jul 18 02:41:19.645615 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2057/4110] 10.222.0.57 () {60 vars in 1342 bytes} [Mon Jul 18 02:41:19 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:41:20.661991 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-85e5a144-a7c4-419c-b6df-cbf495b50ec9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:20.663705 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-85e5a144-a7c4-419c-b6df-cbf495b50ec9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:20.693681 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85e5a144-a7c4-419c-b6df-cbf495b50ec9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:20.698151 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85e5a144-a7c4-419c-b6df-cbf495b50ec9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:20.704951 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85e5a144-a7c4-419c-b6df-cbf495b50ec9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:20.706286 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85e5a144-a7c4-419c-b6df-cbf495b50ec9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:20.814707 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-85e5a144-a7c4-419c-b6df-cbf495b50ec9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.160316 Jul 18 02:41:20.816792 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2054/4111] 10.222.0.57 () {60 vars in 1342 bytes} [Mon Jul 18 02:41:20 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:41:21.832589 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-acc669f6-4424-459e-b7ac-58787f342574 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:21.834378 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-acc669f6-4424-459e-b7ac-58787f342574 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:21.847397 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-acc669f6-4424-459e-b7ac-58787f342574 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:21.847896 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-acc669f6-4424-459e-b7ac-58787f342574 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:21.853115 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-acc669f6-4424-459e-b7ac-58787f342574 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:21.853793 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-acc669f6-4424-459e-b7ac-58787f342574 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:21.978840 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-acc669f6-4424-459e-b7ac-58787f342574 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.151658 Jul 18 02:41:21.985883 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2058/4112] 10.222.0.57 () {60 vars in 1342 bytes} [Mon Jul 18 02:41:21 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426/os-volume_attachments => generated 25 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:22.165317 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5f07e909-c6f4-4b61-97c7-c1d3e171ade3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:22.166034 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5f07e909-c6f4-4b61-97c7-c1d3e171ade3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:22.196163 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5f07e909-c6f4-4b61-97c7-c1d3e171ade3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:22.196631 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5f07e909-c6f4-4b61-97c7-c1d3e171ade3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:22.202766 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5f07e909-c6f4-4b61-97c7-c1d3e171ade3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:22.203259 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5f07e909-c6f4-4b61-97c7-c1d3e171ade3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:22.304116 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5f07e909-c6f4-4b61-97c7-c1d3e171ade3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:41:22.642622 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5f07e909-c6f4-4b61-97c7-c1d3e171ade3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 204 len: 0 microversion: 2.20 time: 0.481022 Jul 18 02:41:22.643691 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2055/4113] 10.222.0.57 () {60 vars in 1279 bytes} [Mon Jul 18 02:41:22 2022] DELETE /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:41:22.664272 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d6410e62-695e-40d6-ab84-7865a1cfaef5 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:22.665653 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d6410e62-695e-40d6-ab84-7865a1cfaef5 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:22.690899 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d6410e62-695e-40d6-ab84-7865a1cfaef5 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:22.693203 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d6410e62-695e-40d6-ab84-7865a1cfaef5 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:22.694632 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d6410e62-695e-40d6-ab84-7865a1cfaef5 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:22.697011 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d6410e62-695e-40d6-ab84-7865a1cfaef5 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:23.756718 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d6410e62-695e-40d6-ab84-7865a1cfaef5 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:23.775109 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d6410e62-695e-40d6-ab84-7865a1cfaef5 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:23.782353 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d6410e62-695e-40d6-ab84-7865a1cfaef5 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:23.788730 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d6410e62-695e-40d6-ab84-7865a1cfaef5 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1722 microversion: 2.20 time: 1.134819 Jul 18 02:41:23.802589 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2059/4114] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:22 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1722 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:24.814403 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-573efeca-c708-49c1-bb6a-5678ce5671f8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:24.815963 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-573efeca-c708-49c1-bb6a-5678ce5671f8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:24.833010 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-573efeca-c708-49c1-bb6a-5678ce5671f8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:24.833975 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-573efeca-c708-49c1-bb6a-5678ce5671f8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:24.838260 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-573efeca-c708-49c1-bb6a-5678ce5671f8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:24.839229 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-573efeca-c708-49c1-bb6a-5678ce5671f8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:25.538851 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-573efeca-c708-49c1-bb6a-5678ce5671f8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:25.553743 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-573efeca-c708-49c1-bb6a-5678ce5671f8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:25.557998 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-573efeca-c708-49c1-bb6a-5678ce5671f8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:25.559362 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-573efeca-c708-49c1-bb6a-5678ce5671f8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1722 microversion: 2.20 time: 0.750411 Jul 18 02:41:25.576924 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2056/4115] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:24 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1722 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:41:26.586291 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6595589b-8051-494f-9114-8fed341a95e0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:26.588229 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6595589b-8051-494f-9114-8fed341a95e0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:26.608586 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6595589b-8051-494f-9114-8fed341a95e0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:26.619809 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6595589b-8051-494f-9114-8fed341a95e0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:26.621396 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6595589b-8051-494f-9114-8fed341a95e0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:26.625583 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6595589b-8051-494f-9114-8fed341a95e0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:28.091021 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6595589b-8051-494f-9114-8fed341a95e0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:28.118609 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6595589b-8051-494f-9114-8fed341a95e0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:28.123720 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6595589b-8051-494f-9114-8fed341a95e0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:28.136248 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6595589b-8051-494f-9114-8fed341a95e0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1722 microversion: 2.20 time: 1.554636 Jul 18 02:41:28.140537 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2060/4116] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:26 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1722 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:29.162706 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d86052bd-a7a7-4258-86c8-f8cb35236403 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:29.168839 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d86052bd-a7a7-4258-86c8-f8cb35236403 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:29.212660 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d86052bd-a7a7-4258-86c8-f8cb35236403 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:29.216669 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d86052bd-a7a7-4258-86c8-f8cb35236403 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:29.224998 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d86052bd-a7a7-4258-86c8-f8cb35236403 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:29.233753 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d86052bd-a7a7-4258-86c8-f8cb35236403 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:29.953038 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d86052bd-a7a7-4258-86c8-f8cb35236403 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:29.965521 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d86052bd-a7a7-4258-86c8-f8cb35236403 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:30.000784 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d86052bd-a7a7-4258-86c8-f8cb35236403 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:30.009601 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d86052bd-a7a7-4258-86c8-f8cb35236403 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1655 microversion: 2.20 time: 0.853549 Jul 18 02:41:30.019865 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2057/4117] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:29 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1655 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:31.038707 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7d662a13-bf95-42c1-ad24-0565d019c04d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:31.039631 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7d662a13-bf95-42c1-ad24-0565d019c04d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:31.058622 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7d662a13-bf95-42c1-ad24-0565d019c04d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:31.059088 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7d662a13-bf95-42c1-ad24-0565d019c04d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:31.060230 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7d662a13-bf95-42c1-ad24-0565d019c04d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:31.060804 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7d662a13-bf95-42c1-ad24-0565d019c04d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:31.390682 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7d662a13-bf95-42c1-ad24-0565d019c04d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:31.400365 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7d662a13-bf95-42c1-ad24-0565d019c04d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:31.412536 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7d662a13-bf95-42c1-ad24-0565d019c04d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:31.432003 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7d662a13-bf95-42c1-ad24-0565d019c04d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1655 microversion: 2.20 time: 0.383406 Jul 18 02:41:31.454301 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2061/4118] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:31 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1655 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:32.473504 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0ab1e140-74e5-4637-a0ce-91f3f2836038 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:32.474462 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0ab1e140-74e5-4637-a0ce-91f3f2836038 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:32.499826 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0ab1e140-74e5-4637-a0ce-91f3f2836038 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:32.543400 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0ab1e140-74e5-4637-a0ce-91f3f2836038 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:32.549619 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0ab1e140-74e5-4637-a0ce-91f3f2836038 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:32.550133 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0ab1e140-74e5-4637-a0ce-91f3f2836038 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:32.641043 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0ab1e140-74e5-4637-a0ce-91f3f2836038 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:32.642328 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0ab1e140-74e5-4637-a0ce-91f3f2836038 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:32.643822 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-0ab1e140-74e5-4637-a0ce-91f3f2836038 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lazy-loading 'fault' on Instance uuid d18d284e-d055-4fe5-af1c-b41ee803d426 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:41:32.789318 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0ab1e140-74e5-4637-a0ce-91f3f2836038 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:32.811153 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0ab1e140-74e5-4637-a0ce-91f3f2836038 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:32.814639 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0ab1e140-74e5-4637-a0ce-91f3f2836038 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:32.834931 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0ab1e140-74e5-4637-a0ce-91f3f2836038 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1370 microversion: 2.20 time: 0.377969 Jul 18 02:41:32.842505 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2062/4119] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:32 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1370 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:32.854851 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-cc292d61-fe4b-40ad-8324-97615bbc006a req-a0b8d6bd-3e68-4d19-9e4a-2e5a370cf0a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d18d284e-d055-4fe5-af1c-b41ee803d426", "name": "network-vif-deleted", "tag": "6ca46669-298c-45bb-bc10-3dd6fed58f4a"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:41:32.884551 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-cc292d61-fe4b-40ad-8324-97615bbc006a req-a0b8d6bd-3e68-4d19-9e4a-2e5a370cf0a4 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:32.886183 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-cc292d61-fe4b-40ad-8324-97615bbc006a req-a0b8d6bd-3e68-4d19-9e4a-2e5a370cf0a4 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:32.943976 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-cc292d61-fe4b-40ad-8324-97615bbc006a req-a0b8d6bd-3e68-4d19-9e4a-2e5a370cf0a4 service nova] Creating event network-vif-deleted:6ca46669-298c-45bb-bc10-3dd6fed58f4a for instance d18d284e-d055-4fe5-af1c-b41ee803d426 on n-h1-465891-3 Jul 18 02:41:32.991708 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-cc292d61-fe4b-40ad-8324-97615bbc006a req-a0b8d6bd-3e68-4d19-9e4a-2e5a370cf0a4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.055179 Jul 18 02:41:33.001781 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2058/4120] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:41:33.862564 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f17b9f71-0552-4d31-9624-b5e6b8308413 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:33.863795 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f17b9f71-0552-4d31-9624-b5e6b8308413 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:33.909616 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f17b9f71-0552-4d31-9624-b5e6b8308413 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:33.913399 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f17b9f71-0552-4d31-9624-b5e6b8308413 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:33.917915 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f17b9f71-0552-4d31-9624-b5e6b8308413 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:33.922175 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f17b9f71-0552-4d31-9624-b5e6b8308413 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:34.099007 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f17b9f71-0552-4d31-9624-b5e6b8308413 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:34.100425 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f17b9f71-0552-4d31-9624-b5e6b8308413 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:34.102559 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-f17b9f71-0552-4d31-9624-b5e6b8308413 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lazy-loading 'fault' on Instance uuid d18d284e-d055-4fe5-af1c-b41ee803d426 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:41:34.323771 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f17b9f71-0552-4d31-9624-b5e6b8308413 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:34.360072 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f17b9f71-0552-4d31-9624-b5e6b8308413 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:34.374629 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f17b9f71-0552-4d31-9624-b5e6b8308413 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:34.378460 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f17b9f71-0552-4d31-9624-b5e6b8308413 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 200 len: 1370 microversion: 2.20 time: 0.527317 Jul 18 02:41:34.394212 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2063/4121] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:33 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 1370 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:35.414796 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8c167ef4-5fe6-43d0-8fb5-9b470ee39a5d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:35.418917 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8c167ef4-5fe6-43d0-8fb5-9b470ee39a5d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:35.429009 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=38 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:35.509317 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8c167ef4-5fe6-43d0-8fb5-9b470ee39a5d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:35.510286 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8c167ef4-5fe6-43d0-8fb5-9b470ee39a5d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:35.518070 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8c167ef4-5fe6-43d0-8fb5-9b470ee39a5d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:35.527087 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8c167ef4-5fe6-43d0-8fb5-9b470ee39a5d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:35.569493 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=86 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:35.589690 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-8c167ef4-5fe6-43d0-8fb5-9b470ee39a5d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] HTTP exception thrown: Instance d18d284e-d055-4fe5-af1c-b41ee803d426 could not be found. Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8c167ef4-5fe6-43d0-8fb5-9b470ee39a5d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Request method failure captured: Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 HTTP/1.1 Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MbiNKkMMelq-GsrcSpgppFL_nD1CPjdoL_gIMoK_0xP3IMz1XzDLX7g8QF3hUp1wzCfYXCEr5U6y7DDp_DFHQwFqDQND8FleYoSuoqD5Z62yD1mzU75S-Qb2KKvSMk1cR6ePwx6bBZ9UnI-pEw7fkQltABOCxnrHaiOVaFExg8xfLg Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: cef74061ad8b4af695d4277c07cf6479 Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-466839570 Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_cef74061ad8b4af695d4277c07cf6479"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/cef74061ad8b4af695d4277c07cf6479"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/cef74061ad8b4af695d4277c07cf6479"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/cef74061ad8b4af695d4277c07cf6479"}]}] Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-AttachVolumeShelveTestJSON-466839570 Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: cef74061ad8b4af695d4277c07cf6479 Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-466839570 Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-AttachVolumeShelveTestJSON-466839570-project Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: c913445c97f74198a8b4bf441759848d Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-AttachVolumeShelveTestJSON-466839570-project Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance d18d284e-d055-4fe5-af1c-b41ee803d426 could not be found. Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'd18d284e-d055-4fe5-af1c-b41ee803d426'} Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d18d284e-d055-4fe5-af1c-b41ee803d426 could not be found. Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d18d284e-d055-4fe5-af1c-b41ee803d426 could not be found. Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:41:35.598845 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:35.604862 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:41:35.604862 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:35.604862 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:35.604862 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:35.604862 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:41:35.604862 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:41:35.604862 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d18d284e-d055-4fe5-af1c-b41ee803d426 could not be found. Jul 18 02:41:35.604862 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:41:35.607219 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8c167ef4-5fe6-43d0-8fb5-9b470ee39a5d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Returning 404 to user: Instance d18d284e-d055-4fe5-af1c-b41ee803d426 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:41:35.609152 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8c167ef4-5fe6-43d0-8fb5-9b470ee39a5d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 404 len: 111 microversion: 2.20 time: 0.211927 Jul 18 02:41:35.613314 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2064/4122] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:35 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 111 bytes in 216 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:41:35.629506 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0e2c3014-a962-4535-a956-ff91fca5d8ef tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '.version_select at 0x7ff4a8a4c4c0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:35.678502 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0e2c3014-a962-4535-a956-ff91fca5d8ef tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-78782430" status: 204 len: 0 microversion: 2.20 time: 0.057931 Jul 18 02:41:35.682988 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2065/4123] 10.222.0.57 () {60 vars in 1255 bytes} [Mon Jul 18 02:41:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-78782430 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:41:36.243533 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-62f9d6ac-2e2f-458a-ad34-a0bdceb93583 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Action: 'create', calling method: .version_select at 0x7ff49b680700>, body: {"keypair": {"name": "tempest-keypair-925839999", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+4sy3pKwE84ZtIV3CPRiYzpd8B4+Q/Cl1mJFKZqbegDXAfJkkmILm0WsB2WO/mBn6oBUgxBf1jUzOs1KDXYsSZyZ5xRqu68+AkdawH8d5KU2y5WkmKGIhtS8QSxT4HSQ=="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:41:36.332592 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-62f9d6ac-2e2f-458a-ad34-a0bdceb93583 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Getting quotas for project 8fa714ec7f5a4af0a33f56b45e999a7a. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:41:36.366028 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-62f9d6ac-2e2f-458a-ad34-a0bdceb93583 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Getting quotas for user 1be686f2aa93473585ca064041bd8140 and project 8fa714ec7f5a4af0a33f56b45e999a7a. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:41:36.545499 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-62f9d6ac-2e2f-458a-ad34-a0bdceb93583 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.232941 Jul 18 02:41:36.546587 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2059/4124] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 02:41:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:41:38.394385 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5dbb3e8c-2ca3-443d-910c-25288121a371 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Action: 'create', calling method: .version_select at 0x7ff49be268b0>, body: {"keypair": {"name": "tempest-keypair-73092805", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNg+CO6VJEWgRHEh6temlIAqcvcwZyNfQnVQ4OphObqy0TxJikSVDjIUa3Ge+qOrbKNMP5Y1ARbB+aoi8lJ6qzQFTtyGgBZtuDA18ax+khFrW4LVZTXXig9UtfzR3tk+Mw=="}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:41:38.474100 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-5dbb3e8c-2ca3-443d-910c-25288121a371 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Getting quotas for project cef74061ad8b4af695d4277c07cf6479. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:41:38.502130 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-5dbb3e8c-2ca3-443d-910c-25288121a371 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Getting quotas for user c913445c97f74198a8b4bf441759848d and project cef74061ad8b4af695d4277c07cf6479. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:41:38.603845 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5dbb3e8c-2ca3-443d-910c-25288121a371 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.221777 Jul 18 02:41:38.611018 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2066/4125] 10.222.0.57 () {62 vars in 1199 bytes} [Mon Jul 18 02:41:38 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 234 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 18 02:41:42.514122 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-05ec81e2-971b-49a6-a80a-6813484d786b tempest-ComputeTenantNetworksTest-36014288 tempest-ComputeTenantNetworksTest-36014288-project] Calling method '.version_select at 0x7ff49b992af0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:42.933499 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:43.071519 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a5a878f1-c039-462e-8c44-a21087696760 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-355456748", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3d1f3f2f-8c86-416a-9c8b-88e33cae40fd"}], "security_groups": [{"name": "tempest-securitygroup--57524525"}], "key_name": "tempest-keypair-925839999", "user_data": "}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:41:44.087041 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-05ec81e2-971b-49a6-a80a-6813484d786b tempest-ComputeTenantNetworksTest-36014288 tempest-ComputeTenantNetworksTest-36014288-project] 10.222.0.57 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 3.130972 Jul 18 02:41:44.088597 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2060/4126] 10.222.0.57 () {58 vars in 1157 bytes} [Mon Jul 18 02:41:40 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 3135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:41:44.117177 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c2f45823-bbea-4f5f-a63a-5d8a28c78c7d tempest-ComputeTenantNetworksTest-36014288 tempest-ComputeTenantNetworksTest-36014288-project] Calling method '.version_select at 0x7ff4a8b48dc0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:44.420790 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-a5a878f1-c039-462e-8c44-a21087696760 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] validate_networks() for [('3d1f3f2f-8c86-416a-9c8b-88e33cae40fd', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:41:44.469608 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c2f45823-bbea-4f5f-a63a-5d8a28c78c7d tempest-ComputeTenantNetworksTest-36014288 tempest-ComputeTenantNetworksTest-36014288-project] 10.222.0.57 "GET /compute/v2.1/os-tenant-networks/e4b9e4a5-7f6e-4f34-90e6-6758734260b9" status: 200 len: 139 microversion: 2.1 time: 0.365529 Jul 18 02:41:44.475487 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2061/4127] 10.222.0.57 () {58 vars in 1268 bytes} [Mon Jul 18 02:41:44 2022] GET /compute/v2.1/os-tenant-networks/e4b9e4a5-7f6e-4f34-90e6-6758734260b9 => generated 139 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:41:45.590178 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:45.924967 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-a5a878f1-c039-462e-8c44-a21087696760 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:41:45.925808 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-a5a878f1-c039-462e-8c44-a21087696760 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:41:45.926704 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-a5a878f1-c039-462e-8c44-a21087696760 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:41:45.927460 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-a5a878f1-c039-462e-8c44-a21087696760 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:41:45.928225 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-a5a878f1-c039-462e-8c44-a21087696760 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:41:45.974616 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a5a878f1-c039-462e-8c44-a21087696760 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:45.975511 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a5a878f1-c039-462e-8c44-a21087696760 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:45.977089 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a5a878f1-c039-462e-8c44-a21087696760 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:45.977924 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a5a878f1-c039-462e-8c44-a21087696760 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:46.093187 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-a5a878f1-c039-462e-8c44-a21087696760 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Getting quotas for project 8fa714ec7f5a4af0a33f56b45e999a7a. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:41:46.144134 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-a5a878f1-c039-462e-8c44-a21087696760 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Getting quotas for user 1be686f2aa93473585ca064041bd8140 and project 8fa714ec7f5a4af0a33f56b45e999a7a. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:41:46.193049 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a5a878f1-c039-462e-8c44-a21087696760 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:41:46.200533 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a5a878f1-c039-462e-8c44-a21087696760 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 3aa190fe-c088-40db-8267-e574e0002a03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:41:46.420002 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a5a878f1-c039-462e-8c44-a21087696760 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 3.361936 Jul 18 02:41:46.429450 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2067/4128] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:41:43 2022] POST /compute/v2.1/servers => generated 400 bytes in 3374 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 02:41:46.453801 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c3f1cbd1-82c0-4743-8891-ce0206d6ddd2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:46.455594 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c3f1cbd1-82c0-4743-8891-ce0206d6ddd2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 3aa190fe-c088-40db-8267-e574e0002a03] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:46.500667 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=4 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:46.511852 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:46.589321 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2c51c477-1a96-40ac-b04c-24d032aff47f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2002689806", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d6341e11-e29f-4753-a51f-094f3b3268ed"}], "security_groups": [{"name": "tempest-securitygroup--1626880765"}], "key_name": "tempest-keypair-73092805", "user_data": "}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:41:46.823002 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c3f1cbd1-82c0-4743-8891-ce0206d6ddd2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:46.833137 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c3f1cbd1-82c0-4743-8891-ce0206d6ddd2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03" status: 200 len: 1240 microversion: 2.1 time: 0.402141 Jul 18 02:41:46.860127 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2062/4129] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:46 2022] GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03 => generated 1240 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:41:47.045760 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-2c51c477-1a96-40ac-b04c-24d032aff47f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] validate_networks() for [('d6341e11-e29f-4753-a51f-094f3b3268ed', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:41:47.866642 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d1968f69-d6bc-4a87-a6c1-6b44da079240 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:47.867488 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d1968f69-d6bc-4a87-a6c1-6b44da079240 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 3aa190fe-c088-40db-8267-e574e0002a03] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:48.169131 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d1968f69-d6bc-4a87-a6c1-6b44da079240 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:48.189584 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d1968f69-d6bc-4a87-a6c1-6b44da079240 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03" status: 200 len: 1240 microversion: 2.1 time: 0.328770 Jul 18 02:41:48.202635 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2063/4130] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:47 2022] GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03 => generated 1240 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:48.526498 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-2c51c477-1a96-40ac-b04c-24d032aff47f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:41:48.527385 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-2c51c477-1a96-40ac-b04c-24d032aff47f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:41:48.528162 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-2c51c477-1a96-40ac-b04c-24d032aff47f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:41:48.528924 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-2c51c477-1a96-40ac-b04c-24d032aff47f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:41:48.530277 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-2c51c477-1a96-40ac-b04c-24d032aff47f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:41:48.571201 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2c51c477-1a96-40ac-b04c-24d032aff47f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:48.575344 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2c51c477-1a96-40ac-b04c-24d032aff47f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:48.580121 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2c51c477-1a96-40ac-b04c-24d032aff47f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:48.581132 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2c51c477-1a96-40ac-b04c-24d032aff47f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:48.689243 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-2c51c477-1a96-40ac-b04c-24d032aff47f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Getting quotas for project cef74061ad8b4af695d4277c07cf6479. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:41:48.719688 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-2c51c477-1a96-40ac-b04c-24d032aff47f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Getting quotas for user c913445c97f74198a8b4bf441759848d and project cef74061ad8b4af695d4277c07cf6479. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:41:48.833334 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2c51c477-1a96-40ac-b04c-24d032aff47f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:41:48.853502 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2c51c477-1a96-40ac-b04c-24d032aff47f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:41:49.012323 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2c51c477-1a96-40ac-b04c-24d032aff47f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.428476 Jul 18 02:41:49.014549 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2068/4131] 10.222.0.57 () {62 vars in 1187 bytes} [Mon Jul 18 02:41:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 2432 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 18 02:41:49.028478 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2f2f61a5-95db-4a72-a504-645a6a43cffe tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:49.030207 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2f2f61a5-95db-4a72-a504-645a6a43cffe tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:49.212138 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cc6a6aa0-c34e-49d2-8817-3e14e6145da1 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:49.213283 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cc6a6aa0-c34e-49d2-8817-3e14e6145da1 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 3aa190fe-c088-40db-8267-e574e0002a03] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:49.224376 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cc6a6aa0-c34e-49d2-8817-3e14e6145da1 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:49.225279 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cc6a6aa0-c34e-49d2-8817-3e14e6145da1 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:49.227707 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cc6a6aa0-c34e-49d2-8817-3e14e6145da1 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:49.228406 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cc6a6aa0-c34e-49d2-8817-3e14e6145da1 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:49.474187 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2f2f61a5-95db-4a72-a504-645a6a43cffe tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:49.521674 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2f2f61a5-95db-4a72-a504-645a6a43cffe tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:49.547351 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2f2f61a5-95db-4a72-a504-645a6a43cffe tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:49.551143 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2f2f61a5-95db-4a72-a504-645a6a43cffe tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1280 microversion: 2.20 time: 0.526295 Jul 18 02:41:49.582259 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2064/4132] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:49 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1280 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:41:49.790430 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-cc6a6aa0-c34e-49d2-8817-3e14e6145da1 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:49.804193 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2f2f61a5-95db-4a72-a504-645a6a43cffe tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:49.805458 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2f2f61a5-95db-4a72-a504-645a6a43cffe tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001776 Jul 18 02:41:49.805864 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2065/4133] 10.222.0.57 () {56 vars in 885 bytes} [Mon Jul 18 02:41:49 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Jul 18 02:41:49.814043 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2f2f61a5-95db-4a72-a504-645a6a43cffe tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:49.815233 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2f2f61a5-95db-4a72-a504-645a6a43cffe tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001892 Jul 18 02:41:49.815679 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2066/4134] 10.222.0.57 () {54 vars in 1034 bytes} [Mon Jul 18 02:41:49 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Jul 18 02:41:49.822808 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2f2f61a5-95db-4a72-a504-645a6a43cffe tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:49.823894 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2f2f61a5-95db-4a72-a504-645a6a43cffe tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001816 Jul 18 02:41:49.825226 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2067/4135] 10.222.0.57 () {54 vars in 1040 bytes} [Mon Jul 18 02:41:49 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:41:49.833619 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2f2f61a5-95db-4a72-a504-645a6a43cffe tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:49.834717 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2f2f61a5-95db-4a72-a504-645a6a43cffe tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001440 Jul 18 02:41:49.840370 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2068/4136] 10.222.0.57 () {56 vars in 885 bytes} [Mon Jul 18 02:41:49 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 18 02:41:49.846579 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cc6a6aa0-c34e-49d2-8817-3e14e6145da1 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03" status: 200 len: 1300 microversion: 2.1 time: 0.626011 Jul 18 02:41:49.866576 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2069/4137] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:49 2022] GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03 => generated 1300 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:50.612346 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a93d4ac8-62cd-4713-8ced-15eb2d45a8a7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:50.617137 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a93d4ac8-62cd-4713-8ced-15eb2d45a8a7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:50.641288 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a93d4ac8-62cd-4713-8ced-15eb2d45a8a7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:50.642823 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a93d4ac8-62cd-4713-8ced-15eb2d45a8a7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:50.659769 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a93d4ac8-62cd-4713-8ced-15eb2d45a8a7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:50.661387 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a93d4ac8-62cd-4713-8ced-15eb2d45a8a7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:50.869078 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a93d4ac8-62cd-4713-8ced-15eb2d45a8a7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:50.885347 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a93d4ac8-62cd-4713-8ced-15eb2d45a8a7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:50.887697 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a93d4ac8-62cd-4713-8ced-15eb2d45a8a7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:50.889544 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a93d4ac8-62cd-4713-8ced-15eb2d45a8a7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1284 microversion: 2.20 time: 0.288747 Jul 18 02:41:50.890918 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-083aca2c-b79f-496f-8491-9d0aa118755a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:50.892507 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-083aca2c-b79f-496f-8491-9d0aa118755a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 3aa190fe-c088-40db-8267-e574e0002a03] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:50.892967 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2069/4138] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:50 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1284 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:50.908598 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-083aca2c-b79f-496f-8491-9d0aa118755a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:50.909526 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-083aca2c-b79f-496f-8491-9d0aa118755a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:50.910914 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-083aca2c-b79f-496f-8491-9d0aa118755a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:50.912940 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-083aca2c-b79f-496f-8491-9d0aa118755a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:51.171759 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-083aca2c-b79f-496f-8491-9d0aa118755a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:51.197657 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-083aca2c-b79f-496f-8491-9d0aa118755a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03" status: 200 len: 1298 microversion: 2.1 time: 0.312041 Jul 18 02:41:51.198758 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2070/4139] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:50 2022] GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03 => generated 1298 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:41:51.924831 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a0a57e18-b4e0-4be9-8324-e69e316ccbb7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:51.925774 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a0a57e18-b4e0-4be9-8324-e69e316ccbb7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:51.953482 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a0a57e18-b4e0-4be9-8324-e69e316ccbb7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:51.955998 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a0a57e18-b4e0-4be9-8324-e69e316ccbb7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:51.960144 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a0a57e18-b4e0-4be9-8324-e69e316ccbb7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:51.963626 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a0a57e18-b4e0-4be9-8324-e69e316ccbb7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:52.220442 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4fa729a3-b6fa-4f03-8ecb-a1f4fe1a860f tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:52.221677 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4fa729a3-b6fa-4f03-8ecb-a1f4fe1a860f tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 3aa190fe-c088-40db-8267-e574e0002a03] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:52.229022 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a0a57e18-b4e0-4be9-8324-e69e316ccbb7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:52.238952 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4fa729a3-b6fa-4f03-8ecb-a1f4fe1a860f tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:52.245501 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a0a57e18-b4e0-4be9-8324-e69e316ccbb7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:52.245991 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4fa729a3-b6fa-4f03-8ecb-a1f4fe1a860f tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:52.246856 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4fa729a3-b6fa-4f03-8ecb-a1f4fe1a860f tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:52.247309 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4fa729a3-b6fa-4f03-8ecb-a1f4fe1a860f tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:52.272746 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a0a57e18-b4e0-4be9-8324-e69e316ccbb7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:52.279636 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a0a57e18-b4e0-4be9-8324-e69e316ccbb7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1340 microversion: 2.20 time: 0.356992 Jul 18 02:41:52.281071 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2070/4140] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:51 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1340 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:53.057176 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4fa729a3-b6fa-4f03-8ecb-a1f4fe1a860f tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:53.074594 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4fa729a3-b6fa-4f03-8ecb-a1f4fe1a860f tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03" status: 200 len: 1364 microversion: 2.1 time: 0.858984 Jul 18 02:41:53.075544 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2071/4141] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:52 2022] GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03 => generated 1364 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:41:53.317123 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c1bf27c6-dd82-4484-b1b8-699d3893a9d3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:53.319816 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c1bf27c6-dd82-4484-b1b8-699d3893a9d3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:53.345486 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c1bf27c6-dd82-4484-b1b8-699d3893a9d3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:53.346044 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c1bf27c6-dd82-4484-b1b8-699d3893a9d3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:53.346911 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c1bf27c6-dd82-4484-b1b8-699d3893a9d3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:53.347365 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c1bf27c6-dd82-4484-b1b8-699d3893a9d3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:53.651986 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c1bf27c6-dd82-4484-b1b8-699d3893a9d3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:53.689105 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c1bf27c6-dd82-4484-b1b8-699d3893a9d3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:53.701237 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c1bf27c6-dd82-4484-b1b8-699d3893a9d3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:53.702518 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c1bf27c6-dd82-4484-b1b8-699d3893a9d3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1338 microversion: 2.20 time: 0.390018 Jul 18 02:41:53.715561 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2071/4142] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:53 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1338 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:54.095986 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-db0d5c55-1e51-4df2-9938-858379ac0038 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:54.097254 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-db0d5c55-1e51-4df2-9938-858379ac0038 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 3aa190fe-c088-40db-8267-e574e0002a03] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:54.108050 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-db0d5c55-1e51-4df2-9938-858379ac0038 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:54.110907 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-db0d5c55-1e51-4df2-9938-858379ac0038 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:54.112487 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-db0d5c55-1e51-4df2-9938-858379ac0038 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:54.113257 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-db0d5c55-1e51-4df2-9938-858379ac0038 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:54.552954 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-db0d5c55-1e51-4df2-9938-858379ac0038 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:54.575070 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-db0d5c55-1e51-4df2-9938-858379ac0038 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03" status: 200 len: 1364 microversion: 2.1 time: 0.485614 Jul 18 02:41:54.578529 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2072/4143] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:54 2022] GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03 => generated 1364 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:41:54.636252 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2bdbdb6c-f403-493e-a6a7-83e7833a03c9 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] Action: 'create', calling method: .version_select at 0x7ff49bf1caf0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1757786654"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:41:54.738484 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fd9ea8a7-599c-4f78-8ff2-65d38a9ec067 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:54.740186 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fd9ea8a7-599c-4f78-8ff2-65d38a9ec067 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:54.757599 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fd9ea8a7-599c-4f78-8ff2-65d38a9ec067 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:54.758355 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fd9ea8a7-599c-4f78-8ff2-65d38a9ec067 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:54.759371 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fd9ea8a7-599c-4f78-8ff2-65d38a9ec067 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:54.770161 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fd9ea8a7-599c-4f78-8ff2-65d38a9ec067 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:55.491806 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fd9ea8a7-599c-4f78-8ff2-65d38a9ec067 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:55.508259 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fd9ea8a7-599c-4f78-8ff2-65d38a9ec067 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:55.518299 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fd9ea8a7-599c-4f78-8ff2-65d38a9ec067 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:55.522723 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fd9ea8a7-599c-4f78-8ff2-65d38a9ec067 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1406 microversion: 2.20 time: 0.788789 Jul 18 02:41:55.526506 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2073/4144] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:54 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1406 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:55.597345 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5b933fbe-aba0-42fa-9f30-6751a2618395 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:55.599327 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5b933fbe-aba0-42fa-9f30-6751a2618395 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 3aa190fe-c088-40db-8267-e574e0002a03] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:55.616785 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5b933fbe-aba0-42fa-9f30-6751a2618395 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:55.617936 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5b933fbe-aba0-42fa-9f30-6751a2618395 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:55.620225 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5b933fbe-aba0-42fa-9f30-6751a2618395 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:55.621483 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5b933fbe-aba0-42fa-9f30-6751a2618395 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:56.158083 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2bdbdb6c-f403-493e-a6a7-83e7833a03c9 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.117223 Jul 18 02:41:56.161287 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2072/4145] 10.222.0.57 () {60 vars in 1154 bytes} [Mon Jul 18 02:41:54 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2122 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 18 02:41:56.198658 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-5724fc6b-10dd-449f-b145-6cf72f812cd7 req-4fb64333-aff8-429c-be80-c8c866d6eaa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aa190fe-c088-40db-8267-e574e0002a03", "tag": "55e1ba47-695a-4230-b43c-a72d640684c9"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:41:56.288971 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-5724fc6b-10dd-449f-b145-6cf72f812cd7 req-4fb64333-aff8-429c-be80-c8c866d6eaa7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:56.288971 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-5724fc6b-10dd-449f-b145-6cf72f812cd7 req-4fb64333-aff8-429c-be80-c8c866d6eaa7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:56.349395 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-5724fc6b-10dd-449f-b145-6cf72f812cd7 req-4fb64333-aff8-429c-be80-c8c866d6eaa7 service nova] Creating event network-changed:55e1ba47-695a-4230-b43c-a72d640684c9 for instance 3aa190fe-c088-40db-8267-e574e0002a03 on n-h2-465891-3 Jul 18 02:41:56.374712 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-5724fc6b-10dd-449f-b145-6cf72f812cd7 req-4fb64333-aff8-429c-be80-c8c866d6eaa7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.202422 Jul 18 02:41:56.376651 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2073/4146] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:41:56.393061 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5e766255-127b-40a3-a0b7-864cf7e0290c tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] Calling method '.version_select at 0x7ff4a8e59700>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:56.690223 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5b933fbe-aba0-42fa-9f30-6751a2618395 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:56.716623 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5b933fbe-aba0-42fa-9f30-6751a2618395 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03" status: 200 len: 1364 microversion: 2.1 time: 1.124222 Jul 18 02:41:56.723823 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2074/4147] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:55 2022] GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03 => generated 1364 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:56.768313 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-27d3dcb9-6561-4ea7-9bc3-31fceaff4f2c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:56.771402 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-27d3dcb9-6561-4ea7-9bc3-31fceaff4f2c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:56.806534 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-27d3dcb9-6561-4ea7-9bc3-31fceaff4f2c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:56.807907 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-27d3dcb9-6561-4ea7-9bc3-31fceaff4f2c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:56.808825 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-27d3dcb9-6561-4ea7-9bc3-31fceaff4f2c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:56.809299 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-27d3dcb9-6561-4ea7-9bc3-31fceaff4f2c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:56.854357 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5e766255-127b-40a3-a0b7-864cf7e0290c tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/79b6f865-f698-4393-84fe-1ba161ec1c03" status: 200 len: 345 microversion: 2.1 time: 0.474147 Jul 18 02:41:56.855313 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2074/4148] 10.222.0.57 () {58 vars in 1244 bytes} [Mon Jul 18 02:41:56 2022] GET /compute/v2.1/os-volumes/79b6f865-f698-4393-84fe-1ba161ec1c03 => generated 345 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:41:57.424617 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-428bbe7f-8cd4-45d5-8c03-5201c38b0f59 req-21db17cd-cde7-46ac-8f55-109a3fa66095 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "136d1a82-a525-4ff4-860d-31c37c826270", "tag": "16123f42-6b11-41ec-a212-278fc525a448"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:41:57.469140 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-428bbe7f-8cd4-45d5-8c03-5201c38b0f59 req-21db17cd-cde7-46ac-8f55-109a3fa66095 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:57.476470 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-428bbe7f-8cd4-45d5-8c03-5201c38b0f59 req-21db17cd-cde7-46ac-8f55-109a3fa66095 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:57.567251 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-428bbe7f-8cd4-45d5-8c03-5201c38b0f59 req-21db17cd-cde7-46ac-8f55-109a3fa66095 service nova] Creating event network-changed:16123f42-6b11-41ec-a212-278fc525a448 for instance 136d1a82-a525-4ff4-860d-31c37c826270 on n-h1-465891-3 Jul 18 02:41:57.621243 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-428bbe7f-8cd4-45d5-8c03-5201c38b0f59 req-21db17cd-cde7-46ac-8f55-109a3fa66095 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.204910 Jul 18 02:41:57.630613 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2075/4149] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:41:57.635627 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-27d3dcb9-6561-4ea7-9bc3-31fceaff4f2c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:57.653264 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-27d3dcb9-6561-4ea7-9bc3-31fceaff4f2c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:57.673467 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-27d3dcb9-6561-4ea7-9bc3-31fceaff4f2c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:57.694541 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-27d3dcb9-6561-4ea7-9bc3-31fceaff4f2c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1406 microversion: 2.20 time: 0.951770 Jul 18 02:41:57.701370 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2075/4150] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:56 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1406 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:57.764218 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fe1dee8e-599b-4af5-a96b-a6b7f669a475 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:57.770043 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fe1dee8e-599b-4af5-a96b-a6b7f669a475 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 3aa190fe-c088-40db-8267-e574e0002a03] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:57.804736 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fe1dee8e-599b-4af5-a96b-a6b7f669a475 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:57.805522 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fe1dee8e-599b-4af5-a96b-a6b7f669a475 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:57.822645 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fe1dee8e-599b-4af5-a96b-a6b7f669a475 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:57.830164 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fe1dee8e-599b-4af5-a96b-a6b7f669a475 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:57.879776 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f838f748-9055-49f3-a10a-42529258ce01 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] Calling method '.version_select at 0x7ff4a87c2670>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:58.194662 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f838f748-9055-49f3-a10a-42529258ce01 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/79b6f865-f698-4393-84fe-1ba161ec1c03" status: 200 len: 345 microversion: 2.1 time: 0.324234 Jul 18 02:41:58.195888 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2076/4151] 10.222.0.57 () {58 vars in 1244 bytes} [Mon Jul 18 02:41:57 2022] GET /compute/v2.1/os-volumes/79b6f865-f698-4393-84fe-1ba161ec1c03 => generated 345 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:41:58.627410 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fe1dee8e-599b-4af5-a96b-a6b7f669a475 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:58.650723 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:58.709856 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fe1dee8e-599b-4af5-a96b-a6b7f669a475 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03" status: 200 len: 1364 microversion: 2.1 time: 0.953407 Jul 18 02:41:58.711734 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2076/4152] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:57 2022] GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03 => generated 1364 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:58.740467 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-56e219d9-8be3-4c0c-ad42-fe52078dee45 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:58.744509 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-56e219d9-8be3-4c0c-ad42-fe52078dee45 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:58.768214 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56e219d9-8be3-4c0c-ad42-fe52078dee45 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:58.772221 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56e219d9-8be3-4c0c-ad42-fe52078dee45 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:58.773753 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56e219d9-8be3-4c0c-ad42-fe52078dee45 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:58.780023 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56e219d9-8be3-4c0c-ad42-fe52078dee45 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:59.114948 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-56e219d9-8be3-4c0c-ad42-fe52078dee45 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:59.127815 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-56e219d9-8be3-4c0c-ad42-fe52078dee45 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:59.130111 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-56e219d9-8be3-4c0c-ad42-fe52078dee45 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:59.132075 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-56e219d9-8be3-4c0c-ad42-fe52078dee45 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1406 microversion: 2.20 time: 0.403666 Jul 18 02:41:59.133805 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2077/4153] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:58 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1406 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:59.212620 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-eadf7465-1a25-4846-bce0-f8ba12b5f3f3 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] Calling method '.version_select at 0x7ff4a93b8dc0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:59.230902 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=16 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:59.336496 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-eadf7465-1a25-4846-bce0-f8ba12b5f3f3 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/79b6f865-f698-4393-84fe-1ba161ec1c03" status: 200 len: 345 microversion: 2.1 time: 0.128177 Jul 18 02:41:59.340106 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2077/4154] 10.222.0.57 () {58 vars in 1244 bytes} [Mon Jul 18 02:41:59 2022] GET /compute/v2.1/os-volumes/79b6f865-f698-4393-84fe-1ba161ec1c03 => generated 345 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:41:59.737011 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-53fc5535-ca2a-482e-aff9-053b6a91e7cd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:59.738862 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-53fc5535-ca2a-482e-aff9-053b6a91e7cd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 3aa190fe-c088-40db-8267-e574e0002a03] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:59.745561 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:59.750554 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-53fc5535-ca2a-482e-aff9-053b6a91e7cd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:59.751136 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-53fc5535-ca2a-482e-aff9-053b6a91e7cd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:59.752227 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-53fc5535-ca2a-482e-aff9-053b6a91e7cd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:59.752767 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-53fc5535-ca2a-482e-aff9-053b6a91e7cd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:00.171746 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-35e47a5f-7eac-413c-a63c-b284307bc005 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:00.187813 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-35e47a5f-7eac-413c-a63c-b284307bc005 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:00.222974 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-35e47a5f-7eac-413c-a63c-b284307bc005 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:00.224465 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-35e47a5f-7eac-413c-a63c-b284307bc005 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:00.227451 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-35e47a5f-7eac-413c-a63c-b284307bc005 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:00.229164 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-35e47a5f-7eac-413c-a63c-b284307bc005 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:00.948612 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-53fc5535-ca2a-482e-aff9-053b6a91e7cd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:00.969489 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-53fc5535-ca2a-482e-aff9-053b6a91e7cd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03" status: 200 len: 1364 microversion: 2.1 time: 1.242604 Jul 18 02:42:00.971792 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2078/4155] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:59 2022] GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03 => generated 1364 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:42:00.992780 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-35003f92-be26-4feb-a296-d4caf5d6c5eb tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] Calling method '.version_select at 0x7ff4a8a769d0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:01.111274 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-35e47a5f-7eac-413c-a63c-b284307bc005 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:01.128867 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-35e47a5f-7eac-413c-a63c-b284307bc005 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:01.130882 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-35e47a5f-7eac-413c-a63c-b284307bc005 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:01.132736 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-35e47a5f-7eac-413c-a63c-b284307bc005 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1406 microversion: 2.20 time: 0.970649 Jul 18 02:42:01.135651 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-35003f92-be26-4feb-a296-d4caf5d6c5eb tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/79b6f865-f698-4393-84fe-1ba161ec1c03" status: 200 len: 346 microversion: 2.1 time: 0.148068 Jul 18 02:42:01.136361 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2079/4156] 10.222.0.57 () {58 vars in 1244 bytes} [Mon Jul 18 02:42:00 2022] GET /compute/v2.1/os-volumes/79b6f865-f698-4393-84fe-1ba161ec1c03 => generated 346 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:01.152503 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2078/4157] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:00 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1406 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:42:01.158956 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6f9dfac0-faea-4282-8688-e693db823c56 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] Action: 'create', calling method: .version_select at 0x7ff4add4f310>, body: {"snapshot": {"volume_id": "79b6f865-f698-4393-84fe-1ba161ec1c03", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-609048519"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:42:01.682665 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6f9dfac0-faea-4282-8688-e693db823c56 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] 10.222.0.57 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.528913 Jul 18 02:42:01.683909 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2080/4158] 10.222.0.57 () {60 vars in 1161 bytes} [Mon Jul 18 02:42:01 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:01.695252 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d7d71956-8c10-48ce-8c7e-ae747afc8c8a tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] Calling method '.version_select at 0x7ff49bea29d0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:01.813792 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d7d71956-8c10-48ce-8c7e-ae747afc8c8a tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/bc29399d-988a-4726-8c71-5da362283747" status: 200 len: 286 microversion: 2.1 time: 0.123303 Jul 18 02:42:01.814732 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2079/4159] 10.222.0.57 () {58 vars in 1250 bytes} [Mon Jul 18 02:42:01 2022] GET /compute/v2.1/os-snapshots/bc29399d-988a-4726-8c71-5da362283747 => generated 286 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:01.832149 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bb9d57bf-0499-4d85-9392-1a6a0e5bcfe9 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] Calling method '.version_select at 0x7ff4a8c5d0d0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:01.914768 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bb9d57bf-0499-4d85-9392-1a6a0e5bcfe9 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.093036 Jul 18 02:42:01.916133 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2081/4160] 10.222.0.57 () {58 vars in 1139 bytes} [Mon Jul 18 02:42:01 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:01.927735 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b306768d-f5d8-412b-a635-984e7eda5704 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] Calling method '.version_select at 0x7ff4a8b039d0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:01.989363 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-22091c3f-16e2-4cd6-a174-4121c849ece9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:01.990012 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-22091c3f-16e2-4cd6-a174-4121c849ece9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 3aa190fe-c088-40db-8267-e574e0002a03] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:02.007351 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b306768d-f5d8-412b-a635-984e7eda5704 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/bc29399d-988a-4726-8c71-5da362283747" status: 200 len: 286 microversion: 2.1 time: 0.083606 Jul 18 02:42:02.008330 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2080/4161] 10.222.0.57 () {58 vars in 1250 bytes} [Mon Jul 18 02:42:01 2022] GET /compute/v2.1/os-snapshots/bc29399d-988a-4726-8c71-5da362283747 => generated 286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:02.010446 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-22091c3f-16e2-4cd6-a174-4121c849ece9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:02.011121 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-22091c3f-16e2-4cd6-a174-4121c849ece9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:02.012113 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-22091c3f-16e2-4cd6-a174-4121c849ece9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:02.020012 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-22091c3f-16e2-4cd6-a174-4121c849ece9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:02.370753 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b01c8db2-614b-40d5-a4dc-2dd2a25b5f61 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:02.373975 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b01c8db2-614b-40d5-a4dc-2dd2a25b5f61 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:02.381314 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-22091c3f-16e2-4cd6-a174-4121c849ece9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:02.412822 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-22091c3f-16e2-4cd6-a174-4121c849ece9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03" status: 200 len: 1364 microversion: 2.1 time: 0.426094 Jul 18 02:42:02.416372 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2082/4162] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:01 2022] GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03 => generated 1364 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:42:02.421424 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b01c8db2-614b-40d5-a4dc-2dd2a25b5f61 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:02.422537 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b01c8db2-614b-40d5-a4dc-2dd2a25b5f61 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:02.425071 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b01c8db2-614b-40d5-a4dc-2dd2a25b5f61 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:02.426027 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b01c8db2-614b-40d5-a4dc-2dd2a25b5f61 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:02.429867 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-10813034-1d03-4440-a59d-4521c7769d53 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:02.432197 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-10813034-1d03-4440-a59d-4521c7769d53 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:02.455684 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-10813034-1d03-4440-a59d-4521c7769d53 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:02.456572 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-10813034-1d03-4440-a59d-4521c7769d53 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:02.457664 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-10813034-1d03-4440-a59d-4521c7769d53 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:02.458374 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-10813034-1d03-4440-a59d-4521c7769d53 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:02.491494 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b01c8db2-614b-40d5-a4dc-2dd2a25b5f61 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:42:02.710742 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b01c8db2-614b-40d5-a4dc-2dd2a25b5f61 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "DELETE /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 204 len: 0 microversion: 2.32 time: 0.588612 Jul 18 02:42:02.721050 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2081/4163] 10.222.0.57 () {60 vars in 1279 bytes} [Mon Jul 18 02:42:02 2022] DELETE /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 18 02:42:02.737759 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-db5359a0-eff1-4e50-827a-613f4d6ba15a tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:02.740048 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-db5359a0-eff1-4e50-827a-613f4d6ba15a tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:02.757564 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-db5359a0-eff1-4e50-827a-613f4d6ba15a tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:02.760334 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-db5359a0-eff1-4e50-827a-613f4d6ba15a tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:02.763879 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-db5359a0-eff1-4e50-827a-613f4d6ba15a tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:02.764698 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-db5359a0-eff1-4e50-827a-613f4d6ba15a tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:02.791559 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-10813034-1d03-4440-a59d-4521c7769d53 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:02.838311 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-10813034-1d03-4440-a59d-4521c7769d53 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:02.841636 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-10813034-1d03-4440-a59d-4521c7769d53 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:02.862473 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-10813034-1d03-4440-a59d-4521c7769d53 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1406 microversion: 2.20 time: 0.426607 Jul 18 02:42:02.876151 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2083/4164] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:02 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1406 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:02.895814 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-659adcf8-2681-4e17-aea2-e3af78d1643e req-d8a0b691-8ff0-4253-b50f-271da640d90c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa190fe-c088-40db-8267-e574e0002a03", "name": "network-vif-plugged", "status": "completed", "tag": "55e1ba47-695a-4230-b43c-a72d640684c9"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:42:02.928587 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-659adcf8-2681-4e17-aea2-e3af78d1643e req-d8a0b691-8ff0-4253-b50f-271da640d90c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:02.929257 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-659adcf8-2681-4e17-aea2-e3af78d1643e req-d8a0b691-8ff0-4253-b50f-271da640d90c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:02.971270 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-659adcf8-2681-4e17-aea2-e3af78d1643e req-d8a0b691-8ff0-4253-b50f-271da640d90c service nova] Creating event network-vif-plugged:55e1ba47-695a-4230-b43c-a72d640684c9 for instance 3aa190fe-c088-40db-8267-e574e0002a03 on n-h2-465891-3 Jul 18 02:42:02.978445 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-659adcf8-2681-4e17-aea2-e3af78d1643e req-d8a0b691-8ff0-4253-b50f-271da640d90c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100609 Jul 18 02:42:02.979407 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2084/4165] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:03.021498 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7468c8ff-c080-407e-b194-09b35f6ee3af tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] Calling method '.version_select at 0x7ff4a8b3b790>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:03.073077 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7468c8ff-c080-407e-b194-09b35f6ee3af tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/bc29399d-988a-4726-8c71-5da362283747" status: 200 len: 286 microversion: 2.1 time: 0.055905 Jul 18 02:42:03.074077 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2085/4166] 10.222.0.57 () {58 vars in 1250 bytes} [Mon Jul 18 02:42:03 2022] GET /compute/v2.1/os-snapshots/bc29399d-988a-4726-8c71-5da362283747 => generated 286 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:03.298750 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-db5359a0-eff1-4e50-827a-613f4d6ba15a tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:03.311152 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-db5359a0-eff1-4e50-827a-613f4d6ba15a tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:03.313273 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-db5359a0-eff1-4e50-827a-613f4d6ba15a tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:03.314972 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-db5359a0-eff1-4e50-827a-613f4d6ba15a tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 2952 microversion: 2.32 time: 0.590261 Jul 18 02:42:03.328366 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2082/4167] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:02 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 2952 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:03.433206 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2e9c3d33-ca04-48b1-b61a-6168365f1ad6 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:03.434555 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2e9c3d33-ca04-48b1-b61a-6168365f1ad6 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 3aa190fe-c088-40db-8267-e574e0002a03] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:03.455341 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2e9c3d33-ca04-48b1-b61a-6168365f1ad6 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:03.456690 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2e9c3d33-ca04-48b1-b61a-6168365f1ad6 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:03.460565 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2e9c3d33-ca04-48b1-b61a-6168365f1ad6 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:03.461651 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2e9c3d33-ca04-48b1-b61a-6168365f1ad6 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:03.815553 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2e9c3d33-ca04-48b1-b61a-6168365f1ad6 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:03.848062 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2e9c3d33-ca04-48b1-b61a-6168365f1ad6 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03" status: 200 len: 1364 microversion: 2.1 time: 0.416075 Jul 18 02:42:03.853497 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2086/4168] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:03 2022] GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03 => generated 1364 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:42:03.897034 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d61fd8d5-6b15-48b1-b9fa-8bc854e98f0c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:03.898044 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d61fd8d5-6b15-48b1-b9fa-8bc854e98f0c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:03.916093 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d61fd8d5-6b15-48b1-b9fa-8bc854e98f0c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:03.916574 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d61fd8d5-6b15-48b1-b9fa-8bc854e98f0c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:03.917418 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d61fd8d5-6b15-48b1-b9fa-8bc854e98f0c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:03.924927 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d61fd8d5-6b15-48b1-b9fa-8bc854e98f0c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:04.095131 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6dd129d9-494b-4e51-823b-de34d7fad7ce tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] Calling method '.version_select at 0x7ff4a89640d0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:04.184677 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6dd129d9-494b-4e51-823b-de34d7fad7ce tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/bc29399d-988a-4726-8c71-5da362283747" status: 200 len: 286 microversion: 2.1 time: 0.101280 Jul 18 02:42:04.184958 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d61fd8d5-6b15-48b1-b9fa-8bc854e98f0c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:04.194198 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2087/4169] 10.222.0.57 () {58 vars in 1250 bytes} [Mon Jul 18 02:42:04 2022] GET /compute/v2.1/os-snapshots/bc29399d-988a-4726-8c71-5da362283747 => generated 286 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:04.199657 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d61fd8d5-6b15-48b1-b9fa-8bc854e98f0c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:04.201352 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d61fd8d5-6b15-48b1-b9fa-8bc854e98f0c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:04.203100 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d61fd8d5-6b15-48b1-b9fa-8bc854e98f0c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1406 microversion: 2.20 time: 0.317156 Jul 18 02:42:04.226272 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2083/4170] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:03 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1406 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:04.341394 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-456983a6-8b17-4173-b928-2dd6afd86b8b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:04.344748 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-456983a6-8b17-4173-b928-2dd6afd86b8b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:04.360646 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-456983a6-8b17-4173-b928-2dd6afd86b8b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:04.361553 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-456983a6-8b17-4173-b928-2dd6afd86b8b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:04.364262 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-456983a6-8b17-4173-b928-2dd6afd86b8b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:04.365651 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-456983a6-8b17-4173-b928-2dd6afd86b8b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:04.871578 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fe7df3ef-a0dc-48c6-aca3-b90825f829c8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:04.872420 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fe7df3ef-a0dc-48c6-aca3-b90825f829c8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 3aa190fe-c088-40db-8267-e574e0002a03] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:04.883287 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fe7df3ef-a0dc-48c6-aca3-b90825f829c8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:04.888328 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fe7df3ef-a0dc-48c6-aca3-b90825f829c8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:04.889484 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fe7df3ef-a0dc-48c6-aca3-b90825f829c8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:04.890090 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fe7df3ef-a0dc-48c6-aca3-b90825f829c8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:04.968067 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-456983a6-8b17-4173-b928-2dd6afd86b8b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:04.986532 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-456983a6-8b17-4173-b928-2dd6afd86b8b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:04.992118 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-456983a6-8b17-4173-b928-2dd6afd86b8b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:05.003006 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-456983a6-8b17-4173-b928-2dd6afd86b8b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 2952 microversion: 2.32 time: 0.669636 Jul 18 02:42:05.003615 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2088/4171] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:04 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 2952 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:05.033455 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-75509b04-4a8e-495c-91a1-b7f6de94adcc req-1bc6f692-77fa-48f6-9246-bd3bca8f5354 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "136d1a82-a525-4ff4-860d-31c37c826270", "name": "network-vif-plugged", "status": "completed", "tag": "16123f42-6b11-41ec-a212-278fc525a448"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:42:05.071715 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-75509b04-4a8e-495c-91a1-b7f6de94adcc req-1bc6f692-77fa-48f6-9246-bd3bca8f5354 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:05.072166 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-75509b04-4a8e-495c-91a1-b7f6de94adcc req-1bc6f692-77fa-48f6-9246-bd3bca8f5354 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:05.096266 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-75509b04-4a8e-495c-91a1-b7f6de94adcc req-1bc6f692-77fa-48f6-9246-bd3bca8f5354 service nova] Creating event network-vif-plugged:16123f42-6b11-41ec-a212-278fc525a448 for instance 136d1a82-a525-4ff4-860d-31c37c826270 on n-h1-465891-3 Jul 18 02:42:05.109332 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-75509b04-4a8e-495c-91a1-b7f6de94adcc req-1bc6f692-77fa-48f6-9246-bd3bca8f5354 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080185 Jul 18 02:42:05.113735 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2089/4172] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:05.206999 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fe7df3ef-a0dc-48c6-aca3-b90825f829c8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:05.217475 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fe7df3ef-a0dc-48c6-aca3-b90825f829c8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03" status: 200 len: 1554 microversion: 2.1 time: 0.349704 Jul 18 02:42:05.219591 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2084/4173] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:04 2022] GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03 => generated 1554 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:42:05.221584 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7300ac51-7508-40df-a7d2-5c88c9a05bf9 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] Calling method '.version_select at 0x7ff49b992c10>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:05.240385 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5e9509e8-d48b-42d4-94cd-d016a912a501 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:05.243457 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5e9509e8-d48b-42d4-94cd-d016a912a501 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 3aa190fe-c088-40db-8267-e574e0002a03] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:05.255037 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5e9509e8-d48b-42d4-94cd-d016a912a501 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:05.255840 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5e9509e8-d48b-42d4-94cd-d016a912a501 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:05.256703 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5e9509e8-d48b-42d4-94cd-d016a912a501 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:05.257147 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5e9509e8-d48b-42d4-94cd-d016a912a501 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:05.333008 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7300ac51-7508-40df-a7d2-5c88c9a05bf9 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/bc29399d-988a-4726-8c71-5da362283747" status: 200 len: 287 microversion: 2.1 time: 0.132665 Jul 18 02:42:05.333610 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2090/4174] 10.222.0.57 () {58 vars in 1250 bytes} [Mon Jul 18 02:42:05 2022] GET /compute/v2.1/os-snapshots/bc29399d-988a-4726-8c71-5da362283747 => generated 287 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:05.338894 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-616fe212-bdcd-4d48-a8ed-75fb0f2bc362 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:05.342712 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-616fe212-bdcd-4d48-a8ed-75fb0f2bc362 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:05.368011 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-616fe212-bdcd-4d48-a8ed-75fb0f2bc362 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:05.368507 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-616fe212-bdcd-4d48-a8ed-75fb0f2bc362 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:05.369357 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-616fe212-bdcd-4d48-a8ed-75fb0f2bc362 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:05.370033 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-616fe212-bdcd-4d48-a8ed-75fb0f2bc362 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:05.438100 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5e9509e8-d48b-42d4-94cd-d016a912a501 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.200260 Jul 18 02:42:05.438100 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2085/4175] 10.222.0.57 () {58 vars in 1274 bytes} [Mon Jul 18 02:42:05 2022] GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03/os-interface => generated 285 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:05.449154 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-618e3057-824d-415b-a08e-7821c56b5669 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] Calling method '.version_select at 0x7ff49bf25ca0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:05.635653 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-618e3057-824d-415b-a08e-7821c56b5669 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] 10.222.0.57 "DELETE /compute/v2.1/os-snapshots/bc29399d-988a-4726-8c71-5da362283747" status: 202 len: 0 microversion: 2.1 time: 0.197734 Jul 18 02:42:05.636631 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2086/4176] 10.222.0.57 () {58 vars in 1253 bytes} [Mon Jul 18 02:42:05 2022] DELETE /compute/v2.1/os-snapshots/bc29399d-988a-4726-8c71-5da362283747 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:42:05.645600 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bbea2014-4920-4c6b-95cc-3cfb29000ead tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] Calling method '.version_select at 0x7ff4a87e2160>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:05.714814 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bbea2014-4920-4c6b-95cc-3cfb29000ead tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/bc29399d-988a-4726-8c71-5da362283747" status: 200 len: 286 microversion: 2.1 time: 0.072542 Jul 18 02:42:05.716218 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2087/4177] 10.222.0.57 () {58 vars in 1250 bytes} [Mon Jul 18 02:42:05 2022] GET /compute/v2.1/os-snapshots/bc29399d-988a-4726-8c71-5da362283747 => generated 286 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:05.863011 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-616fe212-bdcd-4d48-a8ed-75fb0f2bc362 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:05.898559 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-616fe212-bdcd-4d48-a8ed-75fb0f2bc362 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:05.913479 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-616fe212-bdcd-4d48-a8ed-75fb0f2bc362 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:05.915925 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-616fe212-bdcd-4d48-a8ed-75fb0f2bc362 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1406 microversion: 2.20 time: 0.580992 Jul 18 02:42:05.919179 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2091/4178] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:05 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1406 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:06.026290 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3eb0950d-87a8-4df1-9e27-511f6b078b64 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:06.026932 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3eb0950d-87a8-4df1-9e27-511f6b078b64 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:06.046294 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=1,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:42:06.048230 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3eb0950d-87a8-4df1-9e27-511f6b078b64 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:06.048686 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3eb0950d-87a8-4df1-9e27-511f6b078b64 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:06.049500 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3eb0950d-87a8-4df1-9e27-511f6b078b64 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:06.061127 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3eb0950d-87a8-4df1-9e27-511f6b078b64 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:06.744795 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-de8af92d-55db-486f-8f33-ebed4265671e tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] Calling method '.version_select at 0x7ff4a87c2670>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:06.834445 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-de8af92d-55db-486f-8f33-ebed4265671e tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/bc29399d-988a-4726-8c71-5da362283747" status: 200 len: 286 microversion: 2.1 time: 0.106038 Jul 18 02:42:06.835952 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2092/4179] 10.222.0.57 () {58 vars in 1250 bytes} [Mon Jul 18 02:42:06 2022] GET /compute/v2.1/os-snapshots/bc29399d-988a-4726-8c71-5da362283747 => generated 286 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:06.861066 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3eb0950d-87a8-4df1-9e27-511f6b078b64 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:06.875381 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3eb0950d-87a8-4df1-9e27-511f6b078b64 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:06.877414 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3eb0950d-87a8-4df1-9e27-511f6b078b64 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:06.879054 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3eb0950d-87a8-4df1-9e27-511f6b078b64 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 2952 microversion: 2.32 time: 0.858293 Jul 18 02:42:06.893520 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2088/4180] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:06 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 2952 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:06.944148 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-22c32ba9-8032-463c-add6-786a7f46c0b4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:06.946465 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-22c32ba9-8032-463c-add6-786a7f46c0b4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:06.963353 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-22c32ba9-8032-463c-add6-786a7f46c0b4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:06.965786 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-22c32ba9-8032-463c-add6-786a7f46c0b4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:06.970508 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-22c32ba9-8032-463c-add6-786a7f46c0b4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:06.971787 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-22c32ba9-8032-463c-add6-786a7f46c0b4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:07.712753 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-22c32ba9-8032-463c-add6-786a7f46c0b4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:07.747729 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-22c32ba9-8032-463c-add6-786a7f46c0b4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:07.754683 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-22c32ba9-8032-463c-add6-786a7f46c0b4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:07.763333 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-22c32ba9-8032-463c-add6-786a7f46c0b4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1406 microversion: 2.20 time: 0.829133 Jul 18 02:42:07.767937 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2093/4181] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:06 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1406 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:07.853904 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ed025589-a072-4a4e-9639-cafec7618e73 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] Calling method '.version_select at 0x7ff49be26af0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:07.909976 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4704a661-c0a0-4a1e-88c6-4ab2c27ecb1c tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:07.913125 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4704a661-c0a0-4a1e-88c6-4ab2c27ecb1c tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:07.942680 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4704a661-c0a0-4a1e-88c6-4ab2c27ecb1c tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:07.947931 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4704a661-c0a0-4a1e-88c6-4ab2c27ecb1c tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:07.950507 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4704a661-c0a0-4a1e-88c6-4ab2c27ecb1c tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:07.953206 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4704a661-c0a0-4a1e-88c6-4ab2c27ecb1c tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:07.957803 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ed025589-a072-4a4e-9639-cafec7618e73 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/bc29399d-988a-4726-8c71-5da362283747" status: 200 len: 286 microversion: 2.1 time: 0.111841 Jul 18 02:42:07.959625 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2089/4182] 10.222.0.57 () {58 vars in 1250 bytes} [Mon Jul 18 02:42:07 2022] GET /compute/v2.1/os-snapshots/bc29399d-988a-4726-8c71-5da362283747 => generated 286 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:08.796843 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c68beeb6-4266-41d2-90d7-8236597c0ad8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:08.797550 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c68beeb6-4266-41d2-90d7-8236597c0ad8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:08.820434 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c68beeb6-4266-41d2-90d7-8236597c0ad8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:08.821151 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c68beeb6-4266-41d2-90d7-8236597c0ad8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:08.823780 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c68beeb6-4266-41d2-90d7-8236597c0ad8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:08.824706 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c68beeb6-4266-41d2-90d7-8236597c0ad8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:08.878453 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4704a661-c0a0-4a1e-88c6-4ab2c27ecb1c tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:08.886042 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:42:08.893313 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4704a661-c0a0-4a1e-88c6-4ab2c27ecb1c tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:08.904427 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4704a661-c0a0-4a1e-88c6-4ab2c27ecb1c tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:08.907340 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4704a661-c0a0-4a1e-88c6-4ab2c27ecb1c tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 2952 microversion: 2.32 time: 1.009117 Jul 18 02:42:08.908530 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2094/4183] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:07 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 2952 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:08.975286 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a9b8d6c9-0dff-4721-a5d0-5409b3673fbb tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] Calling method '.version_select at 0x7ff4add60ca0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:09.031461 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a9b8d6c9-0dff-4721-a5d0-5409b3673fbb tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/bc29399d-988a-4726-8c71-5da362283747" status: 200 len: 286 microversion: 2.1 time: 0.064629 Jul 18 02:42:09.036417 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2095/4184] 10.222.0.57 () {58 vars in 1250 bytes} [Mon Jul 18 02:42:08 2022] GET /compute/v2.1/os-snapshots/bc29399d-988a-4726-8c71-5da362283747 => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:42:09.042172 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-a114506a-33ed-49b9-9f78-32f873a57a44 req-f6620666-3332-4e6d-94a1-fe154e02608f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aa190fe-c088-40db-8267-e574e0002a03", "tag": "55e1ba47-695a-4230-b43c-a72d640684c9"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:42:09.088358 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-a114506a-33ed-49b9-9f78-32f873a57a44 req-f6620666-3332-4e6d-94a1-fe154e02608f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:09.090514 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-a114506a-33ed-49b9-9f78-32f873a57a44 req-f6620666-3332-4e6d-94a1-fe154e02608f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:09.120320 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-a114506a-33ed-49b9-9f78-32f873a57a44 req-f6620666-3332-4e6d-94a1-fe154e02608f service nova] Creating event network-changed:55e1ba47-695a-4230-b43c-a72d640684c9 for instance 3aa190fe-c088-40db-8267-e574e0002a03 on n-h2-465891-3 Jul 18 02:42:09.136184 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-a114506a-33ed-49b9-9f78-32f873a57a44 req-f6620666-3332-4e6d-94a1-fe154e02608f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095621 Jul 18 02:42:09.139570 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2096/4185] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:09.307291 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c68beeb6-4266-41d2-90d7-8236597c0ad8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:09.320453 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c68beeb6-4266-41d2-90d7-8236597c0ad8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:09.327336 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c68beeb6-4266-41d2-90d7-8236597c0ad8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:09.329148 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c68beeb6-4266-41d2-90d7-8236597c0ad8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1599 microversion: 2.20 time: 0.547928 Jul 18 02:42:09.332127 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2090/4186] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:08 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1599 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:09.348605 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2781dbd6-b3ee-4663-9369-e4a8f4d3210d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:09.349318 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2781dbd6-b3ee-4663-9369-e4a8f4d3210d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:09.368258 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2781dbd6-b3ee-4663-9369-e4a8f4d3210d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:09.368714 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2781dbd6-b3ee-4663-9369-e4a8f4d3210d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:09.369524 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2781dbd6-b3ee-4663-9369-e4a8f4d3210d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:09.369991 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2781dbd6-b3ee-4663-9369-e4a8f4d3210d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:09.722317 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2781dbd6-b3ee-4663-9369-e4a8f4d3210d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.378303 Jul 18 02:42:09.723783 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2097/4187] 10.222.0.57 () {60 vars in 1315 bytes} [Mon Jul 18 02:42:09 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270/os-interface => generated 285 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:42:09.929591 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1ecaa418-56bb-4cfe-8f28-97f2329e57f9 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:09.930472 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1ecaa418-56bb-4cfe-8f28-97f2329e57f9 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:09.941955 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ecaa418-56bb-4cfe-8f28-97f2329e57f9 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:09.942414 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ecaa418-56bb-4cfe-8f28-97f2329e57f9 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:09.946809 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ecaa418-56bb-4cfe-8f28-97f2329e57f9 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:09.947371 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ecaa418-56bb-4cfe-8f28-97f2329e57f9 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:10.046841 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-67cbd263-834c-483d-82a1-56d89132dcc3 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] Calling method '.version_select at 0x7ff4a8c5da60>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:10.093110 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-67cbd263-834c-483d-82a1-56d89132dcc3 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] HTTP exception thrown: Snapshot bc29399d-988a-4726-8c71-5da362283747 could not be found. Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-67cbd263-834c-483d-82a1-56d89132dcc3 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] Request method failure captured: Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/os-snapshots/bc29399d-988a-4726-8c71-5da362283747 HTTP/1.1 Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1Mhxi6yiotmnc2nx9a3fBgOWcJGQHZ3ZsQ-wGpTatr5I3dPVxSn6merviZV-psvpsNTuobXCVBURw1RxlxTNe9wanrcxphXLYyaJMuWjQJd6TgDif5VWNMCIocX4AZV7q0IHuY58qx6QEytY7m_H0aTEbFSHRwwDrLPhie3NU6TxyEs Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: b2b4c867c51e4463abc04e64cdc4a5a9 Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1609412553 Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b2b4c867c51e4463abc04e64cdc4a5a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b2b4c867c51e4463abc04e64cdc4a5a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b2b4c867c51e4463abc04e64cdc4a5a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b2b4c867c51e4463abc04e64cdc4a5a9"}]}] Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1609412553 Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: b2b4c867c51e4463abc04e64cdc4a5a9 Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1609412553 Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-VolumesSnapshotsTestJSON-1609412553-project Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 84f7ab10ad4c4c7c95b967e8584d9889 Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1609412553-project Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: exception: Snapshot bc29399d-988a-4726-8c71-5da362283747 could not be found. Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'bc29399d-988a-4726-8c71-5da362283747'} Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot bc29399d-988a-4726-8c71-5da362283747 could not be found. (HTTP 404) (Request-ID: req-eecfdbc4-4593-44a0-8741-db5619e59722) Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 02:42:10.103650 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot bc29399d-988a-4726-8c71-5da362283747 could not be found. Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot bc29399d-988a-4726-8c71-5da362283747 could not be found. Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot bc29399d-988a-4726-8c71-5da362283747 could not be found. Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-67cbd263-834c-483d-82a1-56d89132dcc3 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] Returning 404 to user: Snapshot bc29399d-988a-4726-8c71-5da362283747 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-67cbd263-834c-483d-82a1-56d89132dcc3 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/bc29399d-988a-4726-8c71-5da362283747" status: 404 len: 111 microversion: 2.1 time: 0.064735 Jul 18 02:42:10.108560 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2098/4188] 10.222.0.57 () {58 vars in 1250 bytes} [Mon Jul 18 02:42:10 2022] GET /compute/v2.1/os-snapshots/bc29399d-988a-4726-8c71-5da362283747 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:42:10.119232 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1410a6c2-5d97-4ae2-8180-8271716782ce tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] Calling method '.version_select at 0x7ff4a87af8b0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:10.240580 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1410a6c2-5d97-4ae2-8180-8271716782ce tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/79b6f865-f698-4393-84fe-1ba161ec1c03" status: 202 len: 0 microversion: 2.1 time: 0.127483 Jul 18 02:42:10.245477 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2099/4189] 10.222.0.57 () {58 vars in 1247 bytes} [Mon Jul 18 02:42:10 2022] DELETE /compute/v2.1/os-volumes/79b6f865-f698-4393-84fe-1ba161ec1c03 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:42:10.252123 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9c3abb27-1e87-481d-9d25-98b4fdfdb37c tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] Calling method '.version_select at 0x7ff4a8abbc10>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:10.353350 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9c3abb27-1e87-481d-9d25-98b4fdfdb37c tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/79b6f865-f698-4393-84fe-1ba161ec1c03" status: 200 len: 345 microversion: 2.1 time: 0.105879 Jul 18 02:42:10.359989 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2100/4190] 10.222.0.57 () {58 vars in 1244 bytes} [Mon Jul 18 02:42:10 2022] GET /compute/v2.1/os-volumes/79b6f865-f698-4393-84fe-1ba161ec1c03 => generated 345 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:11.013030 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1ecaa418-56bb-4cfe-8f28-97f2329e57f9 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:11.034045 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1ecaa418-56bb-4cfe-8f28-97f2329e57f9 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:11.044898 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1ecaa418-56bb-4cfe-8f28-97f2329e57f9 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:11.055367 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1ecaa418-56bb-4cfe-8f28-97f2329e57f9 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 2931 microversion: 2.32 time: 1.122591 Jul 18 02:42:11.078233 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2091/4191] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:09 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 2931 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:11.272078 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-fc99d346-a722-4ec3-98ae-a5f5488f1da7 req-bab86805-be34-4eda-a1a5-2d4f04b64325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6dc16e-f557-44c2-b61c-92981b9915d4", "name": "network-vif-unplugged", "status": "completed", "tag": "4e48952d-6c79-460b-a0c6-59c7c8c1573e"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:42:11.307362 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-fc99d346-a722-4ec3-98ae-a5f5488f1da7 req-bab86805-be34-4eda-a1a5-2d4f04b64325 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:11.307899 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-fc99d346-a722-4ec3-98ae-a5f5488f1da7 req-bab86805-be34-4eda-a1a5-2d4f04b64325 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:11.367455 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fab6cb00-f3e3-4fe5-83db-cff69a725ed3 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] Calling method '.version_select at 0x7ff49be265e0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:11.396519 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-fc99d346-a722-4ec3-98ae-a5f5488f1da7 req-bab86805-be34-4eda-a1a5-2d4f04b64325 service nova] Creating event network-vif-unplugged:4e48952d-6c79-460b-a0c6-59c7c8c1573e for instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 on n-h1-465891-3 Jul 18 02:42:11.429423 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-fc99d346-a722-4ec3-98ae-a5f5488f1da7 req-bab86805-be34-4eda-a1a5-2d4f04b64325 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.156082 Jul 18 02:42:11.430159 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2101/4192] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:42:11.571647 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fab6cb00-f3e3-4fe5-83db-cff69a725ed3 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/79b6f865-f698-4393-84fe-1ba161ec1c03" status: 200 len: 345 microversion: 2.1 time: 0.208772 Jul 18 02:42:11.577099 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2092/4193] 10.222.0.57 () {58 vars in 1244 bytes} [Mon Jul 18 02:42:11 2022] GET /compute/v2.1/os-volumes/79b6f865-f698-4393-84fe-1ba161ec1c03 => generated 345 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:12.090625 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b1e20b4c-6785-4230-bbb3-0d399895f1f1 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:12.101614 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b1e20b4c-6785-4230-bbb3-0d399895f1f1 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:12.137142 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b1e20b4c-6785-4230-bbb3-0d399895f1f1 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:12.151006 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b1e20b4c-6785-4230-bbb3-0d399895f1f1 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:12.162076 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b1e20b4c-6785-4230-bbb3-0d399895f1f1 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:12.163237 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b1e20b4c-6785-4230-bbb3-0d399895f1f1 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:12.586903 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-87e659ea-6f19-441d-8d65-e28f625f47e9 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] Calling method '.version_select at 0x7ff4adbedf70>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:12.752183 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-87e659ea-6f19-441d-8d65-e28f625f47e9 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/79b6f865-f698-4393-84fe-1ba161ec1c03" status: 200 len: 345 microversion: 2.1 time: 0.170615 Jul 18 02:42:12.752789 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2093/4194] 10.222.0.57 () {58 vars in 1244 bytes} [Mon Jul 18 02:42:12 2022] GET /compute/v2.1/os-volumes/79b6f865-f698-4393-84fe-1ba161ec1c03 => generated 345 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:42:12.985997 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-3a3f5f26-af12-4717-89db-98d901ff389f req-9d3deda9-d463-4a12-8022-3b6758cf5198 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "136d1a82-a525-4ff4-860d-31c37c826270", "tag": "16123f42-6b11-41ec-a212-278fc525a448"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:42:13.073991 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-3a3f5f26-af12-4717-89db-98d901ff389f req-9d3deda9-d463-4a12-8022-3b6758cf5198 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:13.078250 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-3a3f5f26-af12-4717-89db-98d901ff389f req-9d3deda9-d463-4a12-8022-3b6758cf5198 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:13.181826 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-3a3f5f26-af12-4717-89db-98d901ff389f req-9d3deda9-d463-4a12-8022-3b6758cf5198 service nova] Creating event network-changed:16123f42-6b11-41ec-a212-278fc525a448 for instance 136d1a82-a525-4ff4-860d-31c37c826270 on n-h1-465891-3 Jul 18 02:42:13.203274 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-3a3f5f26-af12-4717-89db-98d901ff389f req-9d3deda9-d463-4a12-8022-3b6758cf5198 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.225302 Jul 18 02:42:13.207222 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2094/4195] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:42:13.491839 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-b633bbc6-fc2e-40c1-8425-8288b2b44b7a req-62e63786-d695-4337-913f-8c2f2f89e591 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6dc16e-f557-44c2-b61c-92981b9915d4", "name": "network-vif-unplugged", "status": "completed", "tag": "d1abc038-d96b-4cc7-87d7-6e9e2bbd7be2"}, {"server_uuid": "0e6dc16e-f557-44c2-b61c-92981b9915d4", "name": "network-vif-unplugged", "status": "completed", "tag": "8ae7216b-c181-431a-959d-513873271b5b"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:42:13.518717 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-b633bbc6-fc2e-40c1-8425-8288b2b44b7a req-62e63786-d695-4337-913f-8c2f2f89e591 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:13.519269 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-b633bbc6-fc2e-40c1-8425-8288b2b44b7a req-62e63786-d695-4337-913f-8c2f2f89e591 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:13.609477 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-b633bbc6-fc2e-40c1-8425-8288b2b44b7a req-62e63786-d695-4337-913f-8c2f2f89e591 service nova] Creating event network-vif-unplugged:d1abc038-d96b-4cc7-87d7-6e9e2bbd7be2 for instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 on n-h1-465891-3 Jul 18 02:42:13.620109 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-b633bbc6-fc2e-40c1-8425-8288b2b44b7a req-62e63786-d695-4337-913f-8c2f2f89e591 service nova] Creating event network-vif-unplugged:8ae7216b-c181-431a-959d-513873271b5b for instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 on n-h1-465891-3 Jul 18 02:42:13.655281 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-b633bbc6-fc2e-40c1-8425-8288b2b44b7a req-62e63786-d695-4337-913f-8c2f2f89e591 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.159498 Jul 18 02:42:13.656362 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2095/4196] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:42:13.773090 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-02751bc2-cf9c-459e-8112-a8df76ba1824 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] Calling method '.version_select at 0x7ff49bf641f0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:13.950823 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-02751bc2-cf9c-459e-8112-a8df76ba1824 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/79b6f865-f698-4393-84fe-1ba161ec1c03" status: 200 len: 345 microversion: 2.1 time: 0.173345 Jul 18 02:42:13.950823 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2096/4197] 10.222.0.57 () {58 vars in 1244 bytes} [Mon Jul 18 02:42:13 2022] GET /compute/v2.1/os-volumes/79b6f865-f698-4393-84fe-1ba161ec1c03 => generated 345 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:14.967019 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ccb48d17-c899-43d4-ba83-e8c652706113 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] Calling method '.version_select at 0x7ff49bd90670>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:15.107637 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b1e20b4c-6785-4230-bbb3-0d399895f1f1 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:15.144249 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b1e20b4c-6785-4230-bbb3-0d399895f1f1 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:15.156140 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b1e20b4c-6785-4230-bbb3-0d399895f1f1 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:15.163568 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b1e20b4c-6785-4230-bbb3-0d399895f1f1 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 2931 microversion: 2.32 time: 3.081667 Jul 18 02:42:15.177333 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2102/4198] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:12 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 2931 bytes in 3087 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:15.190487 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ccb48d17-c899-43d4-ba83-e8c652706113 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/79b6f865-f698-4393-84fe-1ba161ec1c03" status: 200 len: 345 microversion: 2.1 time: 0.240854 Jul 18 02:42:15.191309 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2097/4199] 10.222.0.57 () {58 vars in 1244 bytes} [Mon Jul 18 02:42:14 2022] GET /compute/v2.1/os-volumes/79b6f865-f698-4393-84fe-1ba161ec1c03 => generated 345 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:15.735652 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-fcffb51f-73ac-481d-ba14-0e1a392ffe46 req-d16e0d58-4ede-49de-8dfa-2a65ee706d3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6dc16e-f557-44c2-b61c-92981b9915d4", "name": "network-vif-unplugged", "status": "completed", "tag": "5008bbd8-4311-4133-b2fb-b4f029c22c41"}, {"server_uuid": "0e6dc16e-f557-44c2-b61c-92981b9915d4", "name": "network-vif-unplugged", "status": "completed", "tag": "2b179498-569c-4e0a-88a2-4c73687919da"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:42:15.802644 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-fcffb51f-73ac-481d-ba14-0e1a392ffe46 req-d16e0d58-4ede-49de-8dfa-2a65ee706d3c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:15.806689 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-fcffb51f-73ac-481d-ba14-0e1a392ffe46 req-d16e0d58-4ede-49de-8dfa-2a65ee706d3c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:15.854717 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-fcffb51f-73ac-481d-ba14-0e1a392ffe46 req-d16e0d58-4ede-49de-8dfa-2a65ee706d3c service nova] Creating event network-vif-unplugged:5008bbd8-4311-4133-b2fb-b4f029c22c41 for instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 on n-h1-465891-3 Jul 18 02:42:15.865338 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-fcffb51f-73ac-481d-ba14-0e1a392ffe46 req-d16e0d58-4ede-49de-8dfa-2a65ee706d3c service nova] Creating event network-vif-unplugged:2b179498-569c-4e0a-88a2-4c73687919da for instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 on n-h1-465891-3 Jul 18 02:42:15.903631 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-fcffb51f-73ac-481d-ba14-0e1a392ffe46 req-d16e0d58-4ede-49de-8dfa-2a65ee706d3c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.153525 Jul 18 02:42:15.906601 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2103/4200] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:16.192542 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-10d4c2d2-5a5a-4e41-89d1-9755c87e18d0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:16.195799 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-10d4c2d2-5a5a-4e41-89d1-9755c87e18d0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:16.222738 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bd30cd97-3078-47f7-9e67-f40c84388865 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] Calling method '.version_select at 0x7ff49bbd4550>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:16.227820 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-10d4c2d2-5a5a-4e41-89d1-9755c87e18d0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:16.229159 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-10d4c2d2-5a5a-4e41-89d1-9755c87e18d0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:16.231580 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-10d4c2d2-5a5a-4e41-89d1-9755c87e18d0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:16.232777 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-10d4c2d2-5a5a-4e41-89d1-9755c87e18d0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:16.268364 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:42:16.454379 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-bd30cd97-3078-47f7-9e67-f40c84388865 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] HTTP exception thrown: Volume 79b6f865-f698-4393-84fe-1ba161ec1c03 could not be found. Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bd30cd97-3078-47f7-9e67-f40c84388865 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] Request method failure captured: Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/os-volumes/79b6f865-f698-4393-84fe-1ba161ec1c03 HTTP/1.1 Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1Mhxi6yiotmnc2nx9a3fBgOWcJGQHZ3ZsQ-wGpTatr5I3dPVxSn6merviZV-psvpsNTuobXCVBURw1RxlxTNe9wanrcxphXLYyaJMuWjQJd6TgDif5VWNMCIocX4AZV7q0IHuY58qx6QEytY7m_H0aTEbFSHRwwDrLPhie3NU6TxyEs Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: b2b4c867c51e4463abc04e64cdc4a5a9 Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1609412553 Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b2b4c867c51e4463abc04e64cdc4a5a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b2b4c867c51e4463abc04e64cdc4a5a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b2b4c867c51e4463abc04e64cdc4a5a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b2b4c867c51e4463abc04e64cdc4a5a9"}]}] Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1609412553 Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: b2b4c867c51e4463abc04e64cdc4a5a9 Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1609412553 Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-VolumesSnapshotsTestJSON-1609412553-project Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 84f7ab10ad4c4c7c95b967e8584d9889 Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1609412553-project Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: exception: Volume 79b6f865-f698-4393-84fe-1ba161ec1c03 could not be found. Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '79b6f865-f698-4393-84fe-1ba161ec1c03'} Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 79b6f865-f698-4393-84fe-1ba161ec1c03 could not be found. (HTTP 404) (Request-ID: req-445876d6-b5cf-4ad2-88b3-17bd37a25f93) Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 02:42:16.456533 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:42:16.460644 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:42:16.460644 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 02:42:16.460644 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 02:42:16.460644 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 02:42:16.460644 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 02:42:16.460644 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 02:42:16.460644 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 02:42:16.460644 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 02:42:16.460644 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 02:42:16.460644 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:42:16.460644 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:42:16.460644 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:42:16.460644 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:42:16.460644 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 79b6f865-f698-4393-84fe-1ba161ec1c03 could not be found. Jul 18 02:42:16.460644 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:42:16.460644 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:16.460644 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:42:16.460644 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:16.460644 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:16.460644 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:16.460644 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:42:16.460644 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:42:16.460644 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:42:16.460644 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:42:16.460644 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:42:16.460644 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:42:16.460644 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 02:42:16.460644 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:42:16.460644 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 79b6f865-f698-4393-84fe-1ba161ec1c03 could not be found. Jul 18 02:42:16.460644 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:42:16.460644 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:16.460644 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:42:16.460644 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:16.460644 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:16.460644 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:16.460644 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:42:16.460644 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:42:16.460644 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 79b6f865-f698-4393-84fe-1ba161ec1c03 could not be found. Jul 18 02:42:16.460644 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:42:16.464215 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bd30cd97-3078-47f7-9e67-f40c84388865 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] Returning 404 to user: Volume 79b6f865-f698-4393-84fe-1ba161ec1c03 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:42:16.465327 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bd30cd97-3078-47f7-9e67-f40c84388865 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/79b6f865-f698-4393-84fe-1ba161ec1c03" status: 404 len: 109 microversion: 2.1 time: 0.264637 Jul 18 02:42:16.466434 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2104/4201] 10.222.0.57 () {58 vars in 1244 bytes} [Mon Jul 18 02:42:16 2022] GET /compute/v2.1/os-volumes/79b6f865-f698-4393-84fe-1ba161ec1c03 => generated 109 bytes in 266 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:42:16.486773 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-aa7b8c9f-cfed-40a8-9c0a-c814db876b26 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] Calling method '.version_select at 0x7ff4a880b550>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:16.570252 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-aa7b8c9f-cfed-40a8-9c0a-c814db876b26 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] HTTP exception thrown: Volume 79b6f865-f698-4393-84fe-1ba161ec1c03 could not be found. Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-aa7b8c9f-cfed-40a8-9c0a-c814db876b26 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] Request method failure captured: Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/os-volumes/79b6f865-f698-4393-84fe-1ba161ec1c03 HTTP/1.1 Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1Mhxi6yiotmnc2nx9a3fBgOWcJGQHZ3ZsQ-wGpTatr5I3dPVxSn6merviZV-psvpsNTuobXCVBURw1RxlxTNe9wanrcxphXLYyaJMuWjQJd6TgDif5VWNMCIocX4AZV7q0IHuY58qx6QEytY7m_H0aTEbFSHRwwDrLPhie3NU6TxyEs Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: b2b4c867c51e4463abc04e64cdc4a5a9 Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1609412553 Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b2b4c867c51e4463abc04e64cdc4a5a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b2b4c867c51e4463abc04e64cdc4a5a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b2b4c867c51e4463abc04e64cdc4a5a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b2b4c867c51e4463abc04e64cdc4a5a9"}]}] Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1609412553 Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: b2b4c867c51e4463abc04e64cdc4a5a9 Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1609412553 Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-VolumesSnapshotsTestJSON-1609412553-project Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 84f7ab10ad4c4c7c95b967e8584d9889 Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1609412553-project Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: exception: Volume 79b6f865-f698-4393-84fe-1ba161ec1c03 could not be found. Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '79b6f865-f698-4393-84fe-1ba161ec1c03'} Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 79b6f865-f698-4393-84fe-1ba161ec1c03 could not be found. (HTTP 404) (Request-ID: req-e65dec5c-5886-44df-9ac7-df8cd1a3d499) Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 02:42:16.572619 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:42:16.576432 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:42:16.576432 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 02:42:16.576432 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 02:42:16.576432 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 02:42:16.576432 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 02:42:16.576432 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 02:42:16.576432 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 02:42:16.576432 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 02:42:16.576432 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 02:42:16.576432 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:42:16.576432 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:42:16.576432 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:42:16.576432 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:42:16.576432 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 79b6f865-f698-4393-84fe-1ba161ec1c03 could not be found. Jul 18 02:42:16.576432 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:42:16.576432 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:16.576432 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:42:16.576432 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:16.576432 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:16.576432 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:16.576432 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:42:16.576432 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:42:16.576432 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:42:16.576432 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:42:16.576432 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:42:16.576432 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:42:16.576432 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 02:42:16.576432 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:42:16.576432 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 79b6f865-f698-4393-84fe-1ba161ec1c03 could not be found. Jul 18 02:42:16.576432 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:42:16.576432 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:16.576432 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:42:16.576432 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:16.576432 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:16.576432 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:16.576432 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:42:16.576432 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:42:16.576432 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 79b6f865-f698-4393-84fe-1ba161ec1c03 could not be found. Jul 18 02:42:16.576432 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:42:16.583408 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-aa7b8c9f-cfed-40a8-9c0a-c814db876b26 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] Returning 404 to user: Volume 79b6f865-f698-4393-84fe-1ba161ec1c03 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:42:16.589956 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-aa7b8c9f-cfed-40a8-9c0a-c814db876b26 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/79b6f865-f698-4393-84fe-1ba161ec1c03" status: 404 len: 109 microversion: 2.1 time: 0.110078 Jul 18 02:42:16.591058 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2105/4202] 10.222.0.57 () {58 vars in 1247 bytes} [Mon Jul 18 02:42:16 2022] DELETE /compute/v2.1/os-volumes/79b6f865-f698-4393-84fe-1ba161ec1c03 => generated 109 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:42:16.612012 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3315d299-260b-4e6c-b29b-3825ae047a76 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] Calling method '.version_select at 0x7ff49bbd4040>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:16.679826 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-3315d299-260b-4e6c-b29b-3825ae047a76 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] HTTP exception thrown: Volume 79b6f865-f698-4393-84fe-1ba161ec1c03 could not be found. Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3315d299-260b-4e6c-b29b-3825ae047a76 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] Request method failure captured: Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/os-volumes/79b6f865-f698-4393-84fe-1ba161ec1c03 HTTP/1.1 Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1Mhxi6yiotmnc2nx9a3fBgOWcJGQHZ3ZsQ-wGpTatr5I3dPVxSn6merviZV-psvpsNTuobXCVBURw1RxlxTNe9wanrcxphXLYyaJMuWjQJd6TgDif5VWNMCIocX4AZV7q0IHuY58qx6QEytY7m_H0aTEbFSHRwwDrLPhie3NU6TxyEs Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: b2b4c867c51e4463abc04e64cdc4a5a9 Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1609412553 Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b2b4c867c51e4463abc04e64cdc4a5a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b2b4c867c51e4463abc04e64cdc4a5a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b2b4c867c51e4463abc04e64cdc4a5a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b2b4c867c51e4463abc04e64cdc4a5a9"}]}] Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1609412553 Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: b2b4c867c51e4463abc04e64cdc4a5a9 Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1609412553 Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-VolumesSnapshotsTestJSON-1609412553-project Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 84f7ab10ad4c4c7c95b967e8584d9889 Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1609412553-project Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: exception: Volume 79b6f865-f698-4393-84fe-1ba161ec1c03 could not be found. Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '79b6f865-f698-4393-84fe-1ba161ec1c03'} Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 79b6f865-f698-4393-84fe-1ba161ec1c03 could not be found. (HTTP 404) (Request-ID: req-3eacaebc-2b88-4c2f-89f1-08ae42a98c6c) Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 02:42:16.683726 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:42:16.690308 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:42:16.690308 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 02:42:16.690308 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 02:42:16.690308 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 02:42:16.690308 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 02:42:16.690308 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 02:42:16.690308 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 02:42:16.690308 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 02:42:16.690308 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 02:42:16.690308 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:42:16.690308 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:42:16.690308 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:42:16.690308 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:42:16.690308 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 79b6f865-f698-4393-84fe-1ba161ec1c03 could not be found. Jul 18 02:42:16.690308 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:42:16.690308 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:16.690308 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:42:16.690308 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:16.690308 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:16.690308 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:16.690308 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:42:16.690308 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:42:16.690308 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:42:16.690308 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:42:16.690308 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:42:16.690308 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:42:16.690308 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 02:42:16.690308 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:42:16.690308 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 79b6f865-f698-4393-84fe-1ba161ec1c03 could not be found. Jul 18 02:42:16.690308 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:42:16.690308 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:16.690308 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:42:16.690308 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:16.690308 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:16.690308 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:16.690308 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:42:16.690308 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:42:16.690308 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 79b6f865-f698-4393-84fe-1ba161ec1c03 could not be found. Jul 18 02:42:16.690308 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:42:16.690308 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3315d299-260b-4e6c-b29b-3825ae047a76 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] Returning 404 to user: Volume 79b6f865-f698-4393-84fe-1ba161ec1c03 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:42:16.690308 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3315d299-260b-4e6c-b29b-3825ae047a76 tempest-VolumesSnapshotsTestJSON-1609412553 tempest-VolumesSnapshotsTestJSON-1609412553-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/79b6f865-f698-4393-84fe-1ba161ec1c03" status: 404 len: 109 microversion: 2.1 time: 0.086421 Jul 18 02:42:16.711080 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2106/4203] 10.222.0.57 () {58 vars in 1244 bytes} [Mon Jul 18 02:42:16 2022] GET /compute/v2.1/os-volumes/79b6f865-f698-4393-84fe-1ba161ec1c03 => generated 109 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:42:18.459114 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-10d4c2d2-5a5a-4e41-89d1-9755c87e18d0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:18.507439 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-10d4c2d2-5a5a-4e41-89d1-9755c87e18d0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:18.509195 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-10d4c2d2-5a5a-4e41-89d1-9755c87e18d0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:18.510588 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-10d4c2d2-5a5a-4e41-89d1-9755c87e18d0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 2910 microversion: 2.32 time: 2.329291 Jul 18 02:42:18.534336 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2098/4204] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:16 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 2910 bytes in 2354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:19.566458 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4fcc3084-383f-4bd0-aec6-aa6644e74082 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:19.567219 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4fcc3084-383f-4bd0-aec6-aa6644e74082 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:19.613420 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=58 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:42:19.619848 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4fcc3084-383f-4bd0-aec6-aa6644e74082 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:19.623163 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4fcc3084-383f-4bd0-aec6-aa6644e74082 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:19.628463 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4fcc3084-383f-4bd0-aec6-aa6644e74082 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:19.630680 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4fcc3084-383f-4bd0-aec6-aa6644e74082 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:21.088257 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4fcc3084-383f-4bd0-aec6-aa6644e74082 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:21.142117 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4fcc3084-383f-4bd0-aec6-aa6644e74082 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:21.153029 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4fcc3084-383f-4bd0-aec6-aa6644e74082 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:21.169261 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4fcc3084-383f-4bd0-aec6-aa6644e74082 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 2864 microversion: 2.32 time: 1.625010 Jul 18 02:42:21.183876 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2107/4205] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:19 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 2864 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:22.229016 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-18cf7e6a-2764-4e70-b71a-f677a2ab82c5 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:22.238928 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-18cf7e6a-2764-4e70-b71a-f677a2ab82c5 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:22.277831 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-18cf7e6a-2764-4e70-b71a-f677a2ab82c5 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:22.278423 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-18cf7e6a-2764-4e70-b71a-f677a2ab82c5 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:22.280437 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-18cf7e6a-2764-4e70-b71a-f677a2ab82c5 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:22.281259 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-18cf7e6a-2764-4e70-b71a-f677a2ab82c5 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:23.642982 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-a7c45446-77f5-4993-9840-36bfcc0d7f0c req-a6a1eecc-a34d-443f-902d-98a044e924c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6dc16e-f557-44c2-b61c-92981b9915d4", "name": "network-vif-deleted", "tag": "8ae7216b-c181-431a-959d-513873271b5b"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:42:23.734198 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-a7c45446-77f5-4993-9840-36bfcc0d7f0c req-a6a1eecc-a34d-443f-902d-98a044e924c5 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:23.735699 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-a7c45446-77f5-4993-9840-36bfcc0d7f0c req-a6a1eecc-a34d-443f-902d-98a044e924c5 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:23.818534 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-a7c45446-77f5-4993-9840-36bfcc0d7f0c req-a6a1eecc-a34d-443f-902d-98a044e924c5 service nova] Creating event network-vif-deleted:8ae7216b-c181-431a-959d-513873271b5b for instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 on n-h1-465891-3 Jul 18 02:42:23.856639 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-a7c45446-77f5-4993-9840-36bfcc0d7f0c req-a6a1eecc-a34d-443f-902d-98a044e924c5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.227417 Jul 18 02:42:23.860725 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2108/4206] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:23.864928 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-18cf7e6a-2764-4e70-b71a-f677a2ab82c5 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:23.883836 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-18cf7e6a-2764-4e70-b71a-f677a2ab82c5 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:23.905882 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-18cf7e6a-2764-4e70-b71a-f677a2ab82c5 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:23.910967 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-18cf7e6a-2764-4e70-b71a-f677a2ab82c5 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 2864 microversion: 2.32 time: 1.704719 Jul 18 02:42:23.951152 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2099/4207] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:22 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 2864 bytes in 1751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:24.950836 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b50840de-643f-4d0f-8f5d-94d6b6b4fbf0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:24.975712 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b50840de-643f-4d0f-8f5d-94d6b6b4fbf0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:25.021601 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b50840de-643f-4d0f-8f5d-94d6b6b4fbf0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:25.038863 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b50840de-643f-4d0f-8f5d-94d6b6b4fbf0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:25.040385 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b50840de-643f-4d0f-8f5d-94d6b6b4fbf0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:25.041201 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b50840de-643f-4d0f-8f5d-94d6b6b4fbf0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:26.466555 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b50840de-643f-4d0f-8f5d-94d6b6b4fbf0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:26.554351 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b50840de-643f-4d0f-8f5d-94d6b6b4fbf0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:26.560477 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b50840de-643f-4d0f-8f5d-94d6b6b4fbf0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:26.569771 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b50840de-643f-4d0f-8f5d-94d6b6b4fbf0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 2577 microversion: 2.32 time: 1.640357 Jul 18 02:42:26.588123 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2109/4208] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:24 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 2577 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:27.099585 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-5273ed43-fa72-4d2b-a806-e207910bf913 req-b02bf47f-f271-4bfe-8df7-63177af448ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6dc16e-f557-44c2-b61c-92981b9915d4", "name": "network-vif-deleted", "tag": "2b179498-569c-4e0a-88a2-4c73687919da"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:42:27.133456 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-5273ed43-fa72-4d2b-a806-e207910bf913 req-b02bf47f-f271-4bfe-8df7-63177af448ae service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:27.135103 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-5273ed43-fa72-4d2b-a806-e207910bf913 req-b02bf47f-f271-4bfe-8df7-63177af448ae service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:27.191069 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-5273ed43-fa72-4d2b-a806-e207910bf913 req-b02bf47f-f271-4bfe-8df7-63177af448ae service nova] Creating event network-vif-deleted:2b179498-569c-4e0a-88a2-4c73687919da for instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 on n-h1-465891-3 Jul 18 02:42:27.223681 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-5273ed43-fa72-4d2b-a806-e207910bf913 req-b02bf47f-f271-4bfe-8df7-63177af448ae service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129115 Jul 18 02:42:27.225689 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2100/4209] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:27.609040 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-13981af1-3074-46c6-9b21-7e101d858201 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:27.609780 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-13981af1-3074-46c6-9b21-7e101d858201 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:27.632912 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-13981af1-3074-46c6-9b21-7e101d858201 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:27.633383 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-13981af1-3074-46c6-9b21-7e101d858201 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:27.634247 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-13981af1-3074-46c6-9b21-7e101d858201 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:27.634700 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-13981af1-3074-46c6-9b21-7e101d858201 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:28.817528 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-13981af1-3074-46c6-9b21-7e101d858201 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:28.829490 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-13981af1-3074-46c6-9b21-7e101d858201 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:28.849223 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-13981af1-3074-46c6-9b21-7e101d858201 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:28.858984 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-13981af1-3074-46c6-9b21-7e101d858201 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 2418 microversion: 2.32 time: 1.253333 Jul 18 02:42:28.862419 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2110/4210] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:27 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 2418 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:42:29.540162 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-ea54e95c-7420-4a62-ba2b-1ac577f0ff5c req-df602773-2f87-4b90-9b92-34f1e83f75a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6dc16e-f557-44c2-b61c-92981b9915d4", "name": "network-vif-deleted", "tag": "d1abc038-d96b-4cc7-87d7-6e9e2bbd7be2"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:42:29.577900 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-ea54e95c-7420-4a62-ba2b-1ac577f0ff5c req-df602773-2f87-4b90-9b92-34f1e83f75a2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:29.578730 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-ea54e95c-7420-4a62-ba2b-1ac577f0ff5c req-df602773-2f87-4b90-9b92-34f1e83f75a2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:29.620464 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-ea54e95c-7420-4a62-ba2b-1ac577f0ff5c req-df602773-2f87-4b90-9b92-34f1e83f75a2 service nova] Creating event network-vif-deleted:d1abc038-d96b-4cc7-87d7-6e9e2bbd7be2 for instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 on n-h1-465891-3 Jul 18 02:42:29.640095 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-ea54e95c-7420-4a62-ba2b-1ac577f0ff5c req-df602773-2f87-4b90-9b92-34f1e83f75a2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112374 Jul 18 02:42:29.644956 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2101/4211] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:42:29.899021 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a5ffe81b-c306-459e-a9a1-0c2fe9ef4d0b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:29.904362 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a5ffe81b-c306-459e-a9a1-0c2fe9ef4d0b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:29.956713 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a5ffe81b-c306-459e-a9a1-0c2fe9ef4d0b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:29.957665 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a5ffe81b-c306-459e-a9a1-0c2fe9ef4d0b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:29.959586 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a5ffe81b-c306-459e-a9a1-0c2fe9ef4d0b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:29.960144 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a5ffe81b-c306-459e-a9a1-0c2fe9ef4d0b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:31.432307 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a5ffe81b-c306-459e-a9a1-0c2fe9ef4d0b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:31.461580 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a5ffe81b-c306-459e-a9a1-0c2fe9ef4d0b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:31.464880 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a5ffe81b-c306-459e-a9a1-0c2fe9ef4d0b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:31.473806 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a5ffe81b-c306-459e-a9a1-0c2fe9ef4d0b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 2258 microversion: 2.32 time: 1.585460 Jul 18 02:42:31.474900 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2111/4212] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:29 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 2258 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:31.899310 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-af908a5a-6ccf-4733-8bfa-9c0469b6631d req-37bfd742-c905-462f-84d2-9828048718fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6dc16e-f557-44c2-b61c-92981b9915d4", "name": "network-vif-deleted", "tag": "5008bbd8-4311-4133-b2fb-b4f029c22c41"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:42:31.914212 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-af908a5a-6ccf-4733-8bfa-9c0469b6631d req-37bfd742-c905-462f-84d2-9828048718fc service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:31.914960 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-af908a5a-6ccf-4733-8bfa-9c0469b6631d req-37bfd742-c905-462f-84d2-9828048718fc service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:31.932299 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-af908a5a-6ccf-4733-8bfa-9c0469b6631d req-37bfd742-c905-462f-84d2-9828048718fc service nova] Creating event network-vif-deleted:5008bbd8-4311-4133-b2fb-b4f029c22c41 for instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 on n-h1-465891-3 Jul 18 02:42:31.940884 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-af908a5a-6ccf-4733-8bfa-9c0469b6631d req-37bfd742-c905-462f-84d2-9828048718fc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048440 Jul 18 02:42:31.942649 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2102/4213] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:42:32.512794 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8373abf7-7740-4e41-82fe-d78964052e2b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:32.512794 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8373abf7-7740-4e41-82fe-d78964052e2b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:32.538881 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8373abf7-7740-4e41-82fe-d78964052e2b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:32.539346 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8373abf7-7740-4e41-82fe-d78964052e2b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:32.541887 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8373abf7-7740-4e41-82fe-d78964052e2b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:32.541887 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8373abf7-7740-4e41-82fe-d78964052e2b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:32.835325 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8373abf7-7740-4e41-82fe-d78964052e2b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:32.854062 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8373abf7-7740-4e41-82fe-d78964052e2b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:32.855973 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8373abf7-7740-4e41-82fe-d78964052e2b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:32.857339 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8373abf7-7740-4e41-82fe-d78964052e2b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 2031 microversion: 2.32 time: 0.350192 Jul 18 02:42:32.872272 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2112/4214] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:32 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 2031 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:33.902549 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9b6cd71a-7859-49fb-9943-8669ef98e3b3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:33.904002 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9b6cd71a-7859-49fb-9943-8669ef98e3b3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:33.927004 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9b6cd71a-7859-49fb-9943-8669ef98e3b3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:33.930759 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9b6cd71a-7859-49fb-9943-8669ef98e3b3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:33.935523 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9b6cd71a-7859-49fb-9943-8669ef98e3b3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:33.945915 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9b6cd71a-7859-49fb-9943-8669ef98e3b3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:33.995454 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-7c984718-ebdf-4b6b-a166-3d8575cc8a47 req-6f72fb3d-6932-4e85-8290-ea22348eb32a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6dc16e-f557-44c2-b61c-92981b9915d4", "name": "network-vif-deleted", "tag": "4e48952d-6c79-460b-a0c6-59c7c8c1573e"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:42:34.030945 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-7c984718-ebdf-4b6b-a166-3d8575cc8a47 req-6f72fb3d-6932-4e85-8290-ea22348eb32a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:34.031431 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-7c984718-ebdf-4b6b-a166-3d8575cc8a47 req-6f72fb3d-6932-4e85-8290-ea22348eb32a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:34.106609 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-7c984718-ebdf-4b6b-a166-3d8575cc8a47 req-6f72fb3d-6932-4e85-8290-ea22348eb32a service nova] Creating event network-vif-deleted:4e48952d-6c79-460b-a0c6-59c7c8c1573e for instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 on n-h1-465891-3 Jul 18 02:42:34.132406 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-7c984718-ebdf-4b6b-a166-3d8575cc8a47 req-6f72fb3d-6932-4e85-8290-ea22348eb32a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141189 Jul 18 02:42:34.133057 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2113/4215] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:34.359105 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9b6cd71a-7859-49fb-9943-8669ef98e3b3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:34.375636 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9b6cd71a-7859-49fb-9943-8669ef98e3b3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:34.380748 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9b6cd71a-7859-49fb-9943-8669ef98e3b3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:34.384749 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9b6cd71a-7859-49fb-9943-8669ef98e3b3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1605 microversion: 2.32 time: 0.487062 Jul 18 02:42:34.390142 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2103/4216] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:33 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1605 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:42:35.485901 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-415185b3-07a8-4d2e-a333-4d5aed14bc3c tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:35.489929 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-415185b3-07a8-4d2e-a333-4d5aed14bc3c tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:35.550842 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-415185b3-07a8-4d2e-a333-4d5aed14bc3c tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:35.555728 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-415185b3-07a8-4d2e-a333-4d5aed14bc3c tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:35.570946 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-415185b3-07a8-4d2e-a333-4d5aed14bc3c tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:35.572269 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-415185b3-07a8-4d2e-a333-4d5aed14bc3c tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:36.119559 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-415185b3-07a8-4d2e-a333-4d5aed14bc3c tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:36.201116 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-415185b3-07a8-4d2e-a333-4d5aed14bc3c tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:36.224715 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-415185b3-07a8-4d2e-a333-4d5aed14bc3c tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:36.250782 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-415185b3-07a8-4d2e-a333-4d5aed14bc3c tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1605 microversion: 2.32 time: 0.793434 Jul 18 02:42:36.257895 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2114/4217] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:35 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1605 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:37.294283 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-aa1a47e7-40c7-4460-a69d-cac5a0ead21f tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:37.299221 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-aa1a47e7-40c7-4460-a69d-cac5a0ead21f tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:37.357998 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=22 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:42:37.379695 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aa1a47e7-40c7-4460-a69d-cac5a0ead21f tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:37.381551 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aa1a47e7-40c7-4460-a69d-cac5a0ead21f tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:37.383130 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aa1a47e7-40c7-4460-a69d-cac5a0ead21f tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:37.385247 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aa1a47e7-40c7-4460-a69d-cac5a0ead21f tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:37.539241 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-aa1a47e7-40c7-4460-a69d-cac5a0ead21f tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:37.572613 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-aa1a47e7-40c7-4460-a69d-cac5a0ead21f tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:37.596340 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-aa1a47e7-40c7-4460-a69d-cac5a0ead21f tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:37.601012 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-aa1a47e7-40c7-4460-a69d-cac5a0ead21f tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1605 microversion: 2.32 time: 0.330702 Jul 18 02:42:37.616813 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2104/4218] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:37 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1605 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:38.642874 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9b763e21-baec-4ec1-b330-41101de266ab tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:38.651230 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9b763e21-baec-4ec1-b330-41101de266ab tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:38.681894 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9b763e21-baec-4ec1-b330-41101de266ab tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:38.683023 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9b763e21-baec-4ec1-b330-41101de266ab tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:38.684712 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9b763e21-baec-4ec1-b330-41101de266ab tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:38.689997 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9b763e21-baec-4ec1-b330-41101de266ab tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:38.883784 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9b763e21-baec-4ec1-b330-41101de266ab tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:38.923517 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9b763e21-baec-4ec1-b330-41101de266ab tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:38.934967 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9b763e21-baec-4ec1-b330-41101de266ab tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:38.940926 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9b763e21-baec-4ec1-b330-41101de266ab tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1605 microversion: 2.32 time: 0.302466 Jul 18 02:42:38.946469 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2115/4219] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:38 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1605 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:39.969576 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f00ffdf1-2b9d-4061-96f8-570f4ea6075b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:39.975126 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f00ffdf1-2b9d-4061-96f8-570f4ea6075b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:40.004095 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f00ffdf1-2b9d-4061-96f8-570f4ea6075b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:40.004922 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f00ffdf1-2b9d-4061-96f8-570f4ea6075b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:40.006376 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f00ffdf1-2b9d-4061-96f8-570f4ea6075b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:40.007138 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f00ffdf1-2b9d-4061-96f8-570f4ea6075b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:40.285224 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f00ffdf1-2b9d-4061-96f8-570f4ea6075b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:40.330591 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f00ffdf1-2b9d-4061-96f8-570f4ea6075b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:40.340998 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f00ffdf1-2b9d-4061-96f8-570f4ea6075b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:40.350780 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f00ffdf1-2b9d-4061-96f8-570f4ea6075b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1605 microversion: 2.32 time: 0.387808 Jul 18 02:42:40.355755 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2105/4220] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:39 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1605 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:41.397355 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-23398055-ab3c-496a-ab1a-618a6b8e884d tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:41.398563 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-23398055-ab3c-496a-ab1a-618a6b8e884d tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:41.413741 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-23398055-ab3c-496a-ab1a-618a6b8e884d tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:41.414908 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-23398055-ab3c-496a-ab1a-618a6b8e884d tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:41.445846 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-23398055-ab3c-496a-ab1a-618a6b8e884d tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:41.447922 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-23398055-ab3c-496a-ab1a-618a6b8e884d tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:41.589530 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=63 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:42:41.857006 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-23398055-ab3c-496a-ab1a-618a6b8e884d tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:41.908573 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-23398055-ab3c-496a-ab1a-618a6b8e884d tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:41.923308 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-23398055-ab3c-496a-ab1a-618a6b8e884d tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:41.925785 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-23398055-ab3c-496a-ab1a-618a6b8e884d tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1605 microversion: 2.32 time: 0.539425 Jul 18 02:42:41.926800 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2116/4221] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:41 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1605 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:42.543699 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6ea2ce21-657c-48c8-b617-aeedd2c4ded9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:42.545521 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6ea2ce21-657c-48c8-b617-aeedd2c4ded9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 3aa190fe-c088-40db-8267-e574e0002a03] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:42.586797 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6ea2ce21-657c-48c8-b617-aeedd2c4ded9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:42.588097 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6ea2ce21-657c-48c8-b617-aeedd2c4ded9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:42.589967 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6ea2ce21-657c-48c8-b617-aeedd2c4ded9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:42.591243 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6ea2ce21-657c-48c8-b617-aeedd2c4ded9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:42.719886 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6ea2ce21-657c-48c8-b617-aeedd2c4ded9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03/ips" status: 200 len: 150 microversion: 2.1 time: 0.179306 Jul 18 02:42:42.722893 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2106/4222] 10.222.0.57 () {58 vars in 1247 bytes} [Mon Jul 18 02:42:42 2022] GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03/ips => generated 150 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:42.961041 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ee541fa7-a6d9-46b2-8428-3ebe3c3b1f78 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:42.961815 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ee541fa7-a6d9-46b2-8428-3ebe3c3b1f78 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:43.010409 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ee541fa7-a6d9-46b2-8428-3ebe3c3b1f78 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:43.011389 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ee541fa7-a6d9-46b2-8428-3ebe3c3b1f78 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:43.012383 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ee541fa7-a6d9-46b2-8428-3ebe3c3b1f78 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:43.012955 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ee541fa7-a6d9-46b2-8428-3ebe3c3b1f78 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:43.241263 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ee541fa7-a6d9-46b2-8428-3ebe3c3b1f78 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:43.274814 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ee541fa7-a6d9-46b2-8428-3ebe3c3b1f78 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:43.278003 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ee541fa7-a6d9-46b2-8428-3ebe3c3b1f78 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:43.289227 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ee541fa7-a6d9-46b2-8428-3ebe3c3b1f78 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1605 microversion: 2.32 time: 0.324716 Jul 18 02:42:43.294626 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2117/4223] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:42 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1605 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:44.322372 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e1a7e44f-6972-4f93-902f-88d0388ab2c8 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:44.324343 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e1a7e44f-6972-4f93-902f-88d0388ab2c8 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:44.350569 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e1a7e44f-6972-4f93-902f-88d0388ab2c8 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:44.351375 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e1a7e44f-6972-4f93-902f-88d0388ab2c8 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:44.352598 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e1a7e44f-6972-4f93-902f-88d0388ab2c8 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:44.354112 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e1a7e44f-6972-4f93-902f-88d0388ab2c8 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:44.484989 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e1a7e44f-6972-4f93-902f-88d0388ab2c8 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:44.499148 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e1a7e44f-6972-4f93-902f-88d0388ab2c8 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:44.501523 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e1a7e44f-6972-4f93-902f-88d0388ab2c8 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:44.502963 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e1a7e44f-6972-4f93-902f-88d0388ab2c8 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1605 microversion: 2.32 time: 0.188826 Jul 18 02:42:44.503557 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2107/4224] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:44 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1605 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:45.554294 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-34ff68e6-17e9-4b85-9504-078d2b7c31b6 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:45.555453 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-34ff68e6-17e9-4b85-9504-078d2b7c31b6 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:45.592233 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-34ff68e6-17e9-4b85-9504-078d2b7c31b6 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:45.593637 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-34ff68e6-17e9-4b85-9504-078d2b7c31b6 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:45.595160 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-34ff68e6-17e9-4b85-9504-078d2b7c31b6 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:45.596208 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-34ff68e6-17e9-4b85-9504-078d2b7c31b6 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:45.791299 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-34ff68e6-17e9-4b85-9504-078d2b7c31b6 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:45.802957 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-34ff68e6-17e9-4b85-9504-078d2b7c31b6 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:45.805375 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-34ff68e6-17e9-4b85-9504-078d2b7c31b6 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:45.807751 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-34ff68e6-17e9-4b85-9504-078d2b7c31b6 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1605 microversion: 2.32 time: 0.288381 Jul 18 02:42:45.809352 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2118/4225] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:45 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1605 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:46.195133 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-31923e0c-6f21-477c-95a0-709076c86402 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68686067-14ae-4949-8d63-0db66855fcc7"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:42:46.196704 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-31923e0c-6f21-477c-95a0-709076c86402 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 3aa190fe-c088-40db-8267-e574e0002a03] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:46.213683 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-31923e0c-6f21-477c-95a0-709076c86402 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:46.215757 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-31923e0c-6f21-477c-95a0-709076c86402 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:46.219140 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-31923e0c-6f21-477c-95a0-709076c86402 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:46.220119 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-31923e0c-6f21-477c-95a0-709076c86402 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:46.401030 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=50 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:42:46.801746 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-31923e0c-6f21-477c-95a0-709076c86402 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "POST /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.610948 Jul 18 02:42:46.805433 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2108/4226] 10.222.0.57 () {60 vars in 1322 bytes} [Mon Jul 18 02:42:46 2022] POST /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03/os-volume_attachments => generated 194 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:42:46.837663 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c9ac0d1e-3031-48af-9fe6-9322a2a79cf6 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:46.840025 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c9ac0d1e-3031-48af-9fe6-9322a2a79cf6 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:46.864675 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c9ac0d1e-3031-48af-9fe6-9322a2a79cf6 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:46.865419 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c9ac0d1e-3031-48af-9fe6-9322a2a79cf6 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:46.869305 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c9ac0d1e-3031-48af-9fe6-9322a2a79cf6 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:46.872042 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c9ac0d1e-3031-48af-9fe6-9322a2a79cf6 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:47.041186 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c9ac0d1e-3031-48af-9fe6-9322a2a79cf6 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:47.060189 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c9ac0d1e-3031-48af-9fe6-9322a2a79cf6 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:47.064512 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c9ac0d1e-3031-48af-9fe6-9322a2a79cf6 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:47.068274 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c9ac0d1e-3031-48af-9fe6-9322a2a79cf6 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1605 microversion: 2.32 time: 0.235033 Jul 18 02:42:47.071510 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2119/4227] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:46 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1605 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:48.122951 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7c41ebe7-5870-43a7-9e15-915c719269aa tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:48.127369 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7c41ebe7-5870-43a7-9e15-915c719269aa tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:48.146246 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7c41ebe7-5870-43a7-9e15-915c719269aa tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:48.147063 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7c41ebe7-5870-43a7-9e15-915c719269aa tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:48.148552 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7c41ebe7-5870-43a7-9e15-915c719269aa tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:48.149354 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7c41ebe7-5870-43a7-9e15-915c719269aa tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:48.389172 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7c41ebe7-5870-43a7-9e15-915c719269aa tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:48.427896 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7c41ebe7-5870-43a7-9e15-915c719269aa tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:48.433157 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7c41ebe7-5870-43a7-9e15-915c719269aa tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:48.435841 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7c41ebe7-5870-43a7-9e15-915c719269aa tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1605 microversion: 2.32 time: 0.325138 Jul 18 02:42:48.449838 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2109/4228] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:48 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1605 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:49.473787 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6e33f269-9aba-46d8-a445-f4b6733ea85b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:49.478568 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6e33f269-9aba-46d8-a445-f4b6733ea85b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:49.498616 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e33f269-9aba-46d8-a445-f4b6733ea85b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:49.499460 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e33f269-9aba-46d8-a445-f4b6733ea85b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:49.501537 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e33f269-9aba-46d8-a445-f4b6733ea85b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:49.503143 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e33f269-9aba-46d8-a445-f4b6733ea85b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:49.616944 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6e33f269-9aba-46d8-a445-f4b6733ea85b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:49.637304 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6e33f269-9aba-46d8-a445-f4b6733ea85b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:49.644506 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6e33f269-9aba-46d8-a445-f4b6733ea85b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:49.647893 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6e33f269-9aba-46d8-a445-f4b6733ea85b tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1605 microversion: 2.32 time: 0.183972 Jul 18 02:42:49.649149 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2120/4229] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:49 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1605 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:50.675160 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d585894a-32b9-49d9-bb4d-490aced5994c tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:50.677030 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d585894a-32b9-49d9-bb4d-490aced5994c tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:50.696613 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d585894a-32b9-49d9-bb4d-490aced5994c tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:50.698498 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d585894a-32b9-49d9-bb4d-490aced5994c tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:50.700252 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d585894a-32b9-49d9-bb4d-490aced5994c tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:50.703131 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d585894a-32b9-49d9-bb4d-490aced5994c tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:50.854734 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d585894a-32b9-49d9-bb4d-490aced5994c tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:50.880527 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d585894a-32b9-49d9-bb4d-490aced5994c tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:50.883778 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d585894a-32b9-49d9-bb4d-490aced5994c tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:50.885116 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d585894a-32b9-49d9-bb4d-490aced5994c tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1605 microversion: 2.32 time: 0.217358 Jul 18 02:42:50.887323 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2110/4230] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:50 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1605 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:51.924765 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3fc0fde6-3a02-40a2-b60e-75210ef9ac78 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:51.925928 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3fc0fde6-3a02-40a2-b60e-75210ef9ac78 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:51.935709 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=28 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:42:51.947239 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3fc0fde6-3a02-40a2-b60e-75210ef9ac78 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:51.948556 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3fc0fde6-3a02-40a2-b60e-75210ef9ac78 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:51.950521 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3fc0fde6-3a02-40a2-b60e-75210ef9ac78 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:51.951318 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3fc0fde6-3a02-40a2-b60e-75210ef9ac78 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:52.056565 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3fc0fde6-3a02-40a2-b60e-75210ef9ac78 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:52.068866 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3fc0fde6-3a02-40a2-b60e-75210ef9ac78 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:52.070865 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3fc0fde6-3a02-40a2-b60e-75210ef9ac78 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:52.072205 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3fc0fde6-3a02-40a2-b60e-75210ef9ac78 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1605 microversion: 2.32 time: 0.167227 Jul 18 02:42:52.073207 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2121/4231] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:51 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1605 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:53.107106 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5347e8b1-fb99-4116-9765-cab84aff20c3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:53.110156 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5347e8b1-fb99-4116-9765-cab84aff20c3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:53.127006 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5347e8b1-fb99-4116-9765-cab84aff20c3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:53.128327 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5347e8b1-fb99-4116-9765-cab84aff20c3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:53.130257 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5347e8b1-fb99-4116-9765-cab84aff20c3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:53.131342 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5347e8b1-fb99-4116-9765-cab84aff20c3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:53.263639 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5347e8b1-fb99-4116-9765-cab84aff20c3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:53.298874 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5347e8b1-fb99-4116-9765-cab84aff20c3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:53.302682 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5347e8b1-fb99-4116-9765-cab84aff20c3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:53.306288 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5347e8b1-fb99-4116-9765-cab84aff20c3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1605 microversion: 2.32 time: 0.205169 Jul 18 02:42:53.310035 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2111/4232] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:53 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1605 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:54.347329 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-171073fb-0a16-45af-85bf-30d2883aea54 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:54.350233 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-171073fb-0a16-45af-85bf-30d2883aea54 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:54.366555 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-171073fb-0a16-45af-85bf-30d2883aea54 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:54.367547 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-171073fb-0a16-45af-85bf-30d2883aea54 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:54.369973 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-171073fb-0a16-45af-85bf-30d2883aea54 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:54.371176 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-171073fb-0a16-45af-85bf-30d2883aea54 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:54.473588 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-171073fb-0a16-45af-85bf-30d2883aea54 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:54.484886 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-171073fb-0a16-45af-85bf-30d2883aea54 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:54.486792 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-171073fb-0a16-45af-85bf-30d2883aea54 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:54.488157 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-171073fb-0a16-45af-85bf-30d2883aea54 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1605 microversion: 2.32 time: 0.150271 Jul 18 02:42:54.488963 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2122/4233] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:54 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1605 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:55.526478 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ea623b26-ecc9-451f-84fb-be078b45bd96 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:55.528551 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ea623b26-ecc9-451f-84fb-be078b45bd96 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:55.541817 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea623b26-ecc9-451f-84fb-be078b45bd96 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:55.542930 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea623b26-ecc9-451f-84fb-be078b45bd96 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:55.544646 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea623b26-ecc9-451f-84fb-be078b45bd96 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:55.545767 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea623b26-ecc9-451f-84fb-be078b45bd96 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:55.707248 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ea623b26-ecc9-451f-84fb-be078b45bd96 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:55.731425 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ea623b26-ecc9-451f-84fb-be078b45bd96 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:55.737516 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ea623b26-ecc9-451f-84fb-be078b45bd96 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:55.740736 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ea623b26-ecc9-451f-84fb-be078b45bd96 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1605 microversion: 2.32 time: 0.222001 Jul 18 02:42:55.742152 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2112/4234] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:55 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1605 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:56.777812 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b16bce9f-89f7-46c4-9e52-7973f3f4a19c tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:56.778835 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b16bce9f-89f7-46c4-9e52-7973f3f4a19c tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:56.788392 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b16bce9f-89f7-46c4-9e52-7973f3f4a19c tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:56.789011 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b16bce9f-89f7-46c4-9e52-7973f3f4a19c tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:56.790159 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b16bce9f-89f7-46c4-9e52-7973f3f4a19c tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:56.791509 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b16bce9f-89f7-46c4-9e52-7973f3f4a19c tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:56.881553 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b16bce9f-89f7-46c4-9e52-7973f3f4a19c tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:56.899335 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b16bce9f-89f7-46c4-9e52-7973f3f4a19c tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:56.902628 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b16bce9f-89f7-46c4-9e52-7973f3f4a19c tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:56.904998 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b16bce9f-89f7-46c4-9e52-7973f3f4a19c tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1605 microversion: 2.32 time: 0.131360 Jul 18 02:42:56.906726 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2123/4235] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:56 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1605 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:42:57.935801 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bc0899eb-7502-4716-831a-1efb0d4d0764 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:57.936547 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bc0899eb-7502-4716-831a-1efb0d4d0764 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:57.944062 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bc0899eb-7502-4716-831a-1efb0d4d0764 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:57.944508 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bc0899eb-7502-4716-831a-1efb0d4d0764 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:57.945555 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bc0899eb-7502-4716-831a-1efb0d4d0764 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:57.946205 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bc0899eb-7502-4716-831a-1efb0d4d0764 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:58.026337 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bc0899eb-7502-4716-831a-1efb0d4d0764 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:58.039399 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bc0899eb-7502-4716-831a-1efb0d4d0764 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:58.041956 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bc0899eb-7502-4716-831a-1efb0d4d0764 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:58.043504 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bc0899eb-7502-4716-831a-1efb0d4d0764 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1605 microversion: 2.32 time: 0.112712 Jul 18 02:42:58.044092 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2113/4236] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:57 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1605 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:42:59.068430 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cdb3b5aa-f864-43ca-919d-874698a7d1d0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:59.069495 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cdb3b5aa-f864-43ca-919d-874698a7d1d0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:59.077648 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cdb3b5aa-f864-43ca-919d-874698a7d1d0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:59.078339 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cdb3b5aa-f864-43ca-919d-874698a7d1d0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:59.079308 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cdb3b5aa-f864-43ca-919d-874698a7d1d0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:59.080024 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cdb3b5aa-f864-43ca-919d-874698a7d1d0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:59.197739 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cdb3b5aa-f864-43ca-919d-874698a7d1d0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:59.222156 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cdb3b5aa-f864-43ca-919d-874698a7d1d0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:59.224035 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cdb3b5aa-f864-43ca-919d-874698a7d1d0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:59.225283 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cdb3b5aa-f864-43ca-919d-874698a7d1d0 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1605 microversion: 2.32 time: 0.165690 Jul 18 02:42:59.225894 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2124/4237] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:59 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1605 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:43:00.257557 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-55ea9903-ab37-4440-a796-1b5d21c7e533 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:00.259063 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-55ea9903-ab37-4440-a796-1b5d21c7e533 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:00.271947 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-55ea9903-ab37-4440-a796-1b5d21c7e533 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:00.272572 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-55ea9903-ab37-4440-a796-1b5d21c7e533 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:00.273724 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-55ea9903-ab37-4440-a796-1b5d21c7e533 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:00.274396 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-55ea9903-ab37-4440-a796-1b5d21c7e533 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:00.381375 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-55ea9903-ab37-4440-a796-1b5d21c7e533 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:00.393961 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-55ea9903-ab37-4440-a796-1b5d21c7e533 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:00.396779 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-55ea9903-ab37-4440-a796-1b5d21c7e533 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:00.398980 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-55ea9903-ab37-4440-a796-1b5d21c7e533 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1605 microversion: 2.32 time: 0.146139 Jul 18 02:43:00.400030 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2114/4238] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:43:00 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1605 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:43:01.427897 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2ce2f2cc-a509-4a3b-88a5-522177edc085 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:01.428940 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2ce2f2cc-a509-4a3b-88a5-522177edc085 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:01.443385 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2ce2f2cc-a509-4a3b-88a5-522177edc085 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:01.444145 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2ce2f2cc-a509-4a3b-88a5-522177edc085 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:01.445854 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2ce2f2cc-a509-4a3b-88a5-522177edc085 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:01.446573 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2ce2f2cc-a509-4a3b-88a5-522177edc085 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:01.563748 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2ce2f2cc-a509-4a3b-88a5-522177edc085 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:01.573914 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2ce2f2cc-a509-4a3b-88a5-522177edc085 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:01.575651 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2ce2f2cc-a509-4a3b-88a5-522177edc085 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:01.577006 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2ce2f2cc-a509-4a3b-88a5-522177edc085 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1605 microversion: 2.32 time: 0.158524 Jul 18 02:43:01.577593 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2125/4239] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:43:01 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1605 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:43:02.600262 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a5b20936-81a8-4fdf-9069-152ce287a2ae tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:02.609904 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a5b20936-81a8-4fdf-9069-152ce287a2ae tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:02.618262 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a5b20936-81a8-4fdf-9069-152ce287a2ae tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:02.619012 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a5b20936-81a8-4fdf-9069-152ce287a2ae tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:02.620538 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a5b20936-81a8-4fdf-9069-152ce287a2ae tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:02.621157 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a5b20936-81a8-4fdf-9069-152ce287a2ae tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:02.693866 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a5b20936-81a8-4fdf-9069-152ce287a2ae tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:02.703437 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a5b20936-81a8-4fdf-9069-152ce287a2ae tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:02.705020 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a5b20936-81a8-4fdf-9069-152ce287a2ae tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:02.707009 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a5b20936-81a8-4fdf-9069-152ce287a2ae tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1605 microversion: 2.32 time: 0.112553 Jul 18 02:43:02.709913 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2115/4240] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:43:02 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1605 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:43:03.728817 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0756c5a2-90af-4dde-bb66-0c0eb5eee3f8 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:03.730313 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0756c5a2-90af-4dde-bb66-0c0eb5eee3f8 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:03.743261 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0756c5a2-90af-4dde-bb66-0c0eb5eee3f8 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:03.744203 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0756c5a2-90af-4dde-bb66-0c0eb5eee3f8 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:03.748016 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0756c5a2-90af-4dde-bb66-0c0eb5eee3f8 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:03.748961 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0756c5a2-90af-4dde-bb66-0c0eb5eee3f8 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:03.840205 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0756c5a2-90af-4dde-bb66-0c0eb5eee3f8 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:03.851286 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0756c5a2-90af-4dde-bb66-0c0eb5eee3f8 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:03.853030 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0756c5a2-90af-4dde-bb66-0c0eb5eee3f8 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2d2800b4df544c9a7c2465f0fc9ba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d3f06bd2b47a9a233ea5a842318ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:03.854384 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0756c5a2-90af-4dde-bb66-0c0eb5eee3f8 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 200 len: 1605 microversion: 2.32 time: 0.131967 Jul 18 02:43:03.854996 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2126/4241] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:43:03 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 1605 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:43:04.884855 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-253efd53-ff83-47b8-8cdc-f3eb10aab316 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:04.885665 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-253efd53-ff83-47b8-8cdc-f3eb10aab316 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:04.897494 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-253efd53-ff83-47b8-8cdc-f3eb10aab316 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:04.901094 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-253efd53-ff83-47b8-8cdc-f3eb10aab316 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:04.904314 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-253efd53-ff83-47b8-8cdc-f3eb10aab316 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:04.905482 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-253efd53-ff83-47b8-8cdc-f3eb10aab316 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:04.947573 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-253efd53-ff83-47b8-8cdc-f3eb10aab316 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] HTTP exception thrown: Instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 could not be found. Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-253efd53-ff83-47b8-8cdc-f3eb10aab316 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Request method failure captured: Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 HTTP/1.1 Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1Ma_X527XLjt-72zTLgUGb3LzHzoPAqRKC2rXGAV9ZoQYnkBAirmp-CRFu9gy62kwsZMyCsUpldVN48L7rvdRVEePKbOsq59iJrQZqOcr_FYOe750eS70KczvtMMfW94Mqp9pz_1OO-PJZAO7R0fr_wPn1bNkInkIzbrsOWTAHKnpf0 Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: X-Openstack-Nova-Api-Version: 2.32 Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 336d3f06bd2b47a9a233ea5a842318ee Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-TaggedBootDevicesTest-742211586 Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_336d3f06bd2b47a9a233ea5a842318ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/336d3f06bd2b47a9a233ea5a842318ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/336d3f06bd2b47a9a233ea5a842318ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/336d3f06bd2b47a9a233ea5a842318ee"}]}] Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-TaggedBootDevicesTest-742211586 Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 336d3f06bd2b47a9a233ea5a842318ee Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-TaggedBootDevicesTest-742211586 Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-TaggedBootDevicesTest-742211586-project Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: c2d2800b4df544c9a7c2465f0fc9ba3d Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-TaggedBootDevicesTest-742211586-project Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 could not be found. Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '0e6dc16e-f557-44c2-b61c-92981b9915d4'} Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 could not be found. Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 could not be found. Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:43:04.950876 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:43:04.956448 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:43:04.956448 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:43:04.956448 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:43:04.956448 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:43:04.956448 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:43:04.956448 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 could not be found. Jul 18 02:43:04.956448 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:43:04.958146 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-253efd53-ff83-47b8-8cdc-f3eb10aab316 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Returning 404 to user: Instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:43:04.959790 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-253efd53-ff83-47b8-8cdc-f3eb10aab316 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 404 len: 111 microversion: 2.32 time: 0.078971 Jul 18 02:43:04.961424 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2116/4242] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:43:04 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 18 02:43:04.973259 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-911e9c3a-022c-4b2b-9724-ae94213285d9 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '.version_select at 0x7ff4a8037dc0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:04.999292 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-911e9c3a-022c-4b2b-9724-ae94213285d9 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1279992318" status: 204 len: 0 microversion: 2.32 time: 0.031672 Jul 18 02:43:05.001024 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2127/4243] 10.222.0.57 () {60 vars in 1261 bytes} [Mon Jul 18 02:43:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1279992318 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 18 02:43:12.205068 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-639f20f3-a682-4407-9a55-4a592a519cd3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:12.206049 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-639f20f3-a682-4407-9a55-4a592a519cd3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:12.210122 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=26 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:12.227613 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-639f20f3-a682-4407-9a55-4a592a519cd3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:12.228555 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-639f20f3-a682-4407-9a55-4a592a519cd3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:12.230014 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-639f20f3-a682-4407-9a55-4a592a519cd3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:12.230907 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-639f20f3-a682-4407-9a55-4a592a519cd3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:12.262485 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-639f20f3-a682-4407-9a55-4a592a519cd3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] HTTP exception thrown: Instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 could not be found. Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-639f20f3-a682-4407-9a55-4a592a519cd3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Request method failure captured: Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 HTTP/1.1 Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1Ma_X527XLjt-72zTLgUGb3LzHzoPAqRKC2rXGAV9ZoQYnkBAirmp-CRFu9gy62kwsZMyCsUpldVN48L7rvdRVEePKbOsq59iJrQZqOcr_FYOe750eS70KczvtMMfW94Mqp9pz_1OO-PJZAO7R0fr_wPn1bNkInkIzbrsOWTAHKnpf0 Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: X-Openstack-Nova-Api-Version: 2.32 Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 336d3f06bd2b47a9a233ea5a842318ee Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-TaggedBootDevicesTest-742211586 Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_336d3f06bd2b47a9a233ea5a842318ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/336d3f06bd2b47a9a233ea5a842318ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/336d3f06bd2b47a9a233ea5a842318ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/336d3f06bd2b47a9a233ea5a842318ee"}]}] Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-TaggedBootDevicesTest-742211586 Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 336d3f06bd2b47a9a233ea5a842318ee Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-TaggedBootDevicesTest-742211586 Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-TaggedBootDevicesTest-742211586-project Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: c2d2800b4df544c9a7c2465f0fc9ba3d Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-TaggedBootDevicesTest-742211586-project Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 could not be found. Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '0e6dc16e-f557-44c2-b61c-92981b9915d4'} Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 could not be found. Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:43:12.265339 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:43:12.272209 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 could not be found. Jul 18 02:43:12.272209 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:43:12.272209 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:43:12.272209 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:43:12.272209 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:43:12.272209 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:43:12.272209 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:43:12.272209 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:43:12.272209 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:43:12.272209 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 could not be found. Jul 18 02:43:12.272209 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:43:12.277905 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-639f20f3-a682-4407-9a55-4a592a519cd3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Returning 404 to user: Instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:43:12.282412 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-639f20f3-a682-4407-9a55-4a592a519cd3 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "DELETE /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 404 len: 111 microversion: 2.32 time: 0.083267 Jul 18 02:43:12.287095 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2117/4244] 10.222.0.57 () {60 vars in 1279 bytes} [Mon Jul 18 02:43:12 2022] DELETE /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:43:12.297218 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fae7ff10-8f4a-43ba-8c20-afd7dcb20db5 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:12.300912 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fae7ff10-8f4a-43ba-8c20-afd7dcb20db5 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] [instance: 0e6dc16e-f557-44c2-b61c-92981b9915d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:12.315551 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fae7ff10-8f4a-43ba-8c20-afd7dcb20db5 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:12.316592 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fae7ff10-8f4a-43ba-8c20-afd7dcb20db5 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:12.318974 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fae7ff10-8f4a-43ba-8c20-afd7dcb20db5 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:12.319981 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fae7ff10-8f4a-43ba-8c20-afd7dcb20db5 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:12.330841 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=66 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:12.358528 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-fae7ff10-8f4a-43ba-8c20-afd7dcb20db5 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] HTTP exception thrown: Instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 could not be found. Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fae7ff10-8f4a-43ba-8c20-afd7dcb20db5 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Request method failure captured: Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 HTTP/1.1 Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1Ma_X527XLjt-72zTLgUGb3LzHzoPAqRKC2rXGAV9ZoQYnkBAirmp-CRFu9gy62kwsZMyCsUpldVN48L7rvdRVEePKbOsq59iJrQZqOcr_FYOe750eS70KczvtMMfW94Mqp9pz_1OO-PJZAO7R0fr_wPn1bNkInkIzbrsOWTAHKnpf0 Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: X-Openstack-Nova-Api-Version: 2.32 Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 336d3f06bd2b47a9a233ea5a842318ee Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-TaggedBootDevicesTest-742211586 Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_336d3f06bd2b47a9a233ea5a842318ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/336d3f06bd2b47a9a233ea5a842318ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/336d3f06bd2b47a9a233ea5a842318ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/336d3f06bd2b47a9a233ea5a842318ee"}]}] Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-TaggedBootDevicesTest-742211586 Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 336d3f06bd2b47a9a233ea5a842318ee Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-TaggedBootDevicesTest-742211586 Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-TaggedBootDevicesTest-742211586-project Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: c2d2800b4df544c9a7c2465f0fc9ba3d Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-TaggedBootDevicesTest-742211586-project Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 could not be found. Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '0e6dc16e-f557-44c2-b61c-92981b9915d4'} Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 could not be found. Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 could not be found. Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:43:12.363602 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:43:12.371448 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:43:12.371448 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:43:12.371448 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:43:12.371448 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:43:12.371448 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:43:12.371448 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 could not be found. Jul 18 02:43:12.371448 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:43:12.371448 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fae7ff10-8f4a-43ba-8c20-afd7dcb20db5 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] Returning 404 to user: Instance 0e6dc16e-f557-44c2-b61c-92981b9915d4 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:43:12.371448 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fae7ff10-8f4a-43ba-8c20-afd7dcb20db5 tempest-TaggedBootDevicesTest-742211586 tempest-TaggedBootDevicesTest-742211586-project] 10.222.0.57 "GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4" status: 404 len: 111 microversion: 2.32 time: 0.076921 Jul 18 02:43:12.371448 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2128/4245] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:43:12 2022] GET /compute/v2.1/servers/0e6dc16e-f557-44c2-b61c-92981b9915d4 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:43:14.947817 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5139d021-3cd2-473b-83f2-dc793c8e81e0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:14.948552 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5139d021-3cd2-473b-83f2-dc793c8e81e0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:14.957122 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5139d021-3cd2-473b-83f2-dc793c8e81e0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:14.957660 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5139d021-3cd2-473b-83f2-dc793c8e81e0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:14.958853 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5139d021-3cd2-473b-83f2-dc793c8e81e0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:14.959544 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5139d021-3cd2-473b-83f2-dc793c8e81e0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:15.003662 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5139d021-3cd2-473b-83f2-dc793c8e81e0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270/ips" status: 200 len: 153 microversion: 2.20 time: 0.063946 Jul 18 02:43:15.012682 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2118/4246] 10.222.0.57 () {60 vars in 1288 bytes} [Mon Jul 18 02:43:14 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270/ips => generated 153 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:43:18.327400 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d1e04c14-30ae-4f6f-9fda-525db8e72186 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:43:18.329335 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d1e04c14-30ae-4f6f-9fda-525db8e72186 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:18.343184 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d1e04c14-30ae-4f6f-9fda-525db8e72186 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:18.347362 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d1e04c14-30ae-4f6f-9fda-525db8e72186 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:18.348820 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d1e04c14-30ae-4f6f-9fda-525db8e72186 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:18.351589 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d1e04c14-30ae-4f6f-9fda-525db8e72186 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:18.396354 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-d1e04c14-30ae-4f6f-9fda-525db8e72186 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lazy-loading 'flavor' on Instance uuid 136d1a82-a525-4ff4-860d-31c37c826270 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:43:19.659859 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d1e04c14-30ae-4f6f-9fda-525db8e72186 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "POST /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270/action" status: 202 len: 0 microversion: 2.20 time: 1.335964 Jul 18 02:43:19.663516 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2129/4247] 10.222.0.57 () {62 vars in 1318 bytes} [Mon Jul 18 02:43:18 2022] POST /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270/action => generated 0 bytes in 1342 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:43:19.675261 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5b4cacf9-8903-4e89-aaef-767991b673bf tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:19.677260 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5b4cacf9-8903-4e89-aaef-767991b673bf tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:19.686519 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5b4cacf9-8903-4e89-aaef-767991b673bf tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:19.687685 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5b4cacf9-8903-4e89-aaef-767991b673bf tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:19.689198 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5b4cacf9-8903-4e89-aaef-767991b673bf tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:19.690821 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5b4cacf9-8903-4e89-aaef-767991b673bf tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:19.695324 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:20.622903 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5b4cacf9-8903-4e89-aaef-767991b673bf tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:20.634508 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5b4cacf9-8903-4e89-aaef-767991b673bf tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:20.639969 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5b4cacf9-8903-4e89-aaef-767991b673bf tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:20.642414 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5b4cacf9-8903-4e89-aaef-767991b673bf tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1724 microversion: 2.20 time: 0.974715 Jul 18 02:43:20.643068 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2119/4248] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:43:19 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1724 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:43:21.665484 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-44203c68-9aa7-46fc-a120-4a4c287d4040 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:21.666329 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-44203c68-9aa7-46fc-a120-4a4c287d4040 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:21.691496 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-44203c68-9aa7-46fc-a120-4a4c287d4040 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:21.692986 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-44203c68-9aa7-46fc-a120-4a4c287d4040 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:21.694555 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-44203c68-9aa7-46fc-a120-4a4c287d4040 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:21.695368 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-44203c68-9aa7-46fc-a120-4a4c287d4040 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:22.002353 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-44203c68-9aa7-46fc-a120-4a4c287d4040 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:22.034332 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-44203c68-9aa7-46fc-a120-4a4c287d4040 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:22.038832 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-44203c68-9aa7-46fc-a120-4a4c287d4040 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:22.041540 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-44203c68-9aa7-46fc-a120-4a4c287d4040 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1724 microversion: 2.20 time: 0.381336 Jul 18 02:43:22.043936 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2130/4249] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:43:21 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1724 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:43:23.083964 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2f1e5b0b-d5c5-4507-b9c3-51c917ad612d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:23.085457 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2f1e5b0b-d5c5-4507-b9c3-51c917ad612d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:23.096180 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2f1e5b0b-d5c5-4507-b9c3-51c917ad612d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:23.097225 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2f1e5b0b-d5c5-4507-b9c3-51c917ad612d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:23.098320 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2f1e5b0b-d5c5-4507-b9c3-51c917ad612d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:23.099227 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2f1e5b0b-d5c5-4507-b9c3-51c917ad612d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:23.414526 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2f1e5b0b-d5c5-4507-b9c3-51c917ad612d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:23.442779 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2f1e5b0b-d5c5-4507-b9c3-51c917ad612d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:23.450155 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2f1e5b0b-d5c5-4507-b9c3-51c917ad612d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:23.452926 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2f1e5b0b-d5c5-4507-b9c3-51c917ad612d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1724 microversion: 2.20 time: 0.379827 Jul 18 02:43:23.455538 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2120/4250] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:43:23 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1724 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:43:24.496497 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-df37c2d1-f75a-42c9-901a-453b63faa256 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:24.498726 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-df37c2d1-f75a-42c9-901a-453b63faa256 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:24.511785 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:24.515868 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-df37c2d1-f75a-42c9-901a-453b63faa256 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:24.517326 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-df37c2d1-f75a-42c9-901a-453b63faa256 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:24.518780 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-df37c2d1-f75a-42c9-901a-453b63faa256 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:24.519600 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-df37c2d1-f75a-42c9-901a-453b63faa256 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:24.751698 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-df37c2d1-f75a-42c9-901a-453b63faa256 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:24.762744 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-df37c2d1-f75a-42c9-901a-453b63faa256 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:24.764776 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-df37c2d1-f75a-42c9-901a-453b63faa256 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:24.767042 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-df37c2d1-f75a-42c9-901a-453b63faa256 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1724 microversion: 2.20 time: 0.277766 Jul 18 02:43:24.767910 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2131/4251] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:43:24 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1724 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:43:25.214636 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4e69aae4-5418-49d6-ad9d-0c95c8d511c0 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Action: 'create', calling method: .version_select at 0x7ff4adc30af0>, body: {"keypair": {"name": "tempest-keypair-410622744", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHf7EDDKdgBAjGSxdwoDziBK4gHroJaemS4sKNX6D2rVmDo4DeTVug7D2C2jDEdPlzyjppCQRKGBzBzaKZTmUyL+wNg+YmOrLFDx5gU2I16tn2Nqa+aodVCbjvklJqNO3A=="}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:43:25.293113 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-4e69aae4-5418-49d6-ad9d-0c95c8d511c0 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Getting quotas for project 8fa714ec7f5a4af0a33f56b45e999a7a. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:43:25.303628 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-4e69aae4-5418-49d6-ad9d-0c95c8d511c0 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Getting quotas for user 1be686f2aa93473585ca064041bd8140 and project 8fa714ec7f5a4af0a33f56b45e999a7a. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:43:25.350843 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4e69aae4-5418-49d6-ad9d-0c95c8d511c0 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.139968 Jul 18 02:43:25.352214 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2121/4252] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 02:43:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:43:25.801551 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-016e8bc3-4bca-48e7-99ba-7774421e7cc8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:25.803507 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-016e8bc3-4bca-48e7-99ba-7774421e7cc8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:25.823045 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-016e8bc3-4bca-48e7-99ba-7774421e7cc8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:25.823836 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-016e8bc3-4bca-48e7-99ba-7774421e7cc8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:25.824820 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-016e8bc3-4bca-48e7-99ba-7774421e7cc8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:25.825540 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-016e8bc3-4bca-48e7-99ba-7774421e7cc8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:26.075694 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-016e8bc3-4bca-48e7-99ba-7774421e7cc8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:26.087020 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-016e8bc3-4bca-48e7-99ba-7774421e7cc8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:26.088680 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-016e8bc3-4bca-48e7-99ba-7774421e7cc8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:26.090018 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-016e8bc3-4bca-48e7-99ba-7774421e7cc8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1724 microversion: 2.20 time: 0.294929 Jul 18 02:43:26.092952 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2132/4253] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:43:25 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1724 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:43:27.118896 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c67e847f-71a8-4631-9057-891ff77913c2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:27.119517 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c67e847f-71a8-4631-9057-891ff77913c2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:27.143779 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c67e847f-71a8-4631-9057-891ff77913c2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:27.144241 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c67e847f-71a8-4631-9057-891ff77913c2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:27.145092 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c67e847f-71a8-4631-9057-891ff77913c2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:27.145824 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c67e847f-71a8-4631-9057-891ff77913c2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:27.434456 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c67e847f-71a8-4631-9057-891ff77913c2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:27.449280 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c67e847f-71a8-4631-9057-891ff77913c2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:27.452568 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c67e847f-71a8-4631-9057-891ff77913c2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:27.456196 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c67e847f-71a8-4631-9057-891ff77913c2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1724 microversion: 2.20 time: 0.342281 Jul 18 02:43:27.458319 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2122/4254] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:43:27 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1724 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:43:28.501870 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e248eec3-5e32-44a3-aa10-ab9fdf39b19c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:28.502724 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e248eec3-5e32-44a3-aa10-ab9fdf39b19c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:28.522917 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e248eec3-5e32-44a3-aa10-ab9fdf39b19c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:28.526736 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e248eec3-5e32-44a3-aa10-ab9fdf39b19c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:28.527866 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e248eec3-5e32-44a3-aa10-ab9fdf39b19c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:28.528409 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e248eec3-5e32-44a3-aa10-ab9fdf39b19c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:28.856069 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e248eec3-5e32-44a3-aa10-ab9fdf39b19c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:28.865743 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e248eec3-5e32-44a3-aa10-ab9fdf39b19c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:28.878212 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e248eec3-5e32-44a3-aa10-ab9fdf39b19c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:28.879547 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e248eec3-5e32-44a3-aa10-ab9fdf39b19c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1724 microversion: 2.20 time: 0.389627 Jul 18 02:43:28.880819 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2133/4255] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:43:28 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1724 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:43:29.469545 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-91bf05b9-2898-41cc-b943-076a8d042abc tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-33466946", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3d1f3f2f-8c86-416a-9c8b-88e33cae40fd"}], "security_groups": [{"name": "tempest-securitygroup--562185989"}], "key_name": "tempest-keypair-410622744", "user_data": "}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:43:29.753516 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-91bf05b9-2898-41cc-b943-076a8d042abc tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] validate_networks() for [('3d1f3f2f-8c86-416a-9c8b-88e33cae40fd', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:43:29.918271 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7f75eb40-1321-4851-995a-d965add0aab9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:29.919777 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7f75eb40-1321-4851-995a-d965add0aab9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:29.944153 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7f75eb40-1321-4851-995a-d965add0aab9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:29.952327 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7f75eb40-1321-4851-995a-d965add0aab9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:29.955623 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7f75eb40-1321-4851-995a-d965add0aab9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:29.956733 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7f75eb40-1321-4851-995a-d965add0aab9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:30.904139 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7f75eb40-1321-4851-995a-d965add0aab9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:30.960606 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7f75eb40-1321-4851-995a-d965add0aab9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:30.978249 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7f75eb40-1321-4851-995a-d965add0aab9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:30.980775 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7f75eb40-1321-4851-995a-d965add0aab9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1724 microversion: 2.20 time: 1.067598 Jul 18 02:43:31.014620 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2134/4256] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:43:29 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1724 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:43:31.591489 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-91bf05b9-2898-41cc-b943-076a8d042abc tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:43:31.593345 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-91bf05b9-2898-41cc-b943-076a8d042abc tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:43:31.594077 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-91bf05b9-2898-41cc-b943-076a8d042abc tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:43:31.594792 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-91bf05b9-2898-41cc-b943-076a8d042abc tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:43:31.595744 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-91bf05b9-2898-41cc-b943-076a8d042abc tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:43:31.609057 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91bf05b9-2898-41cc-b943-076a8d042abc tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:31.610659 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91bf05b9-2898-41cc-b943-076a8d042abc tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:31.612992 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91bf05b9-2898-41cc-b943-076a8d042abc tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:31.614037 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91bf05b9-2898-41cc-b943-076a8d042abc tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:31.643339 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-91bf05b9-2898-41cc-b943-076a8d042abc tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Getting quotas for project 8fa714ec7f5a4af0a33f56b45e999a7a. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:43:31.650068 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-91bf05b9-2898-41cc-b943-076a8d042abc tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Getting quotas for user 1be686f2aa93473585ca064041bd8140 and project 8fa714ec7f5a4af0a33f56b45e999a7a. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:43:31.667230 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-91bf05b9-2898-41cc-b943-076a8d042abc tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:43:31.669971 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-91bf05b9-2898-41cc-b943-076a8d042abc tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:43:31.786443 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-91bf05b9-2898-41cc-b943-076a8d042abc tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.314919 Jul 18 02:43:31.787188 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2123/4257] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:43:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 2325 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:43:31.802408 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-40ac671d-824f-4ec9-8370-9eed1252d8df tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:31.803149 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-40ac671d-824f-4ec9-8370-9eed1252d8df tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:31.957015 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-40ac671d-824f-4ec9-8370-9eed1252d8df tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:31.971020 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-40ac671d-824f-4ec9-8370-9eed1252d8df tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1" status: 200 len: 1239 microversion: 2.1 time: 0.173714 Jul 18 02:43:31.972041 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2135/4258] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:31 2022] GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 => generated 1239 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:32.027399 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-22054a13-01cf-4ca0-9a70-176e99a8e31e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:32.028103 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-22054a13-01cf-4ca0-9a70-176e99a8e31e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:32.044558 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-22054a13-01cf-4ca0-9a70-176e99a8e31e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:32.045025 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-22054a13-01cf-4ca0-9a70-176e99a8e31e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:32.045964 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-22054a13-01cf-4ca0-9a70-176e99a8e31e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:32.046505 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-22054a13-01cf-4ca0-9a70-176e99a8e31e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:32.585477 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-22054a13-01cf-4ca0-9a70-176e99a8e31e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:32.622468 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-22054a13-01cf-4ca0-9a70-176e99a8e31e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:32.627877 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-22054a13-01cf-4ca0-9a70-176e99a8e31e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:32.629612 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-22054a13-01cf-4ca0-9a70-176e99a8e31e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1724 microversion: 2.20 time: 0.606682 Jul 18 02:43:32.665157 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2124/4259] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:43:32 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1724 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:43:32.999200 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-47125129-b3de-432a-9312-fd6ac25c9c76 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:33.001411 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-47125129-b3de-432a-9312-fd6ac25c9c76 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:33.291703 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-47125129-b3de-432a-9312-fd6ac25c9c76 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:33.329083 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-47125129-b3de-432a-9312-fd6ac25c9c76 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1" status: 200 len: 1239 microversion: 2.1 time: 0.333468 Jul 18 02:43:33.333167 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2136/4260] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:32 2022] GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 => generated 1239 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:43:33.664987 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ef188e81-a1ec-4a62-96b3-31476b4c2ba9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:33.666978 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ef188e81-a1ec-4a62-96b3-31476b4c2ba9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:33.697435 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ef188e81-a1ec-4a62-96b3-31476b4c2ba9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:33.709515 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ef188e81-a1ec-4a62-96b3-31476b4c2ba9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:33.714175 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ef188e81-a1ec-4a62-96b3-31476b4c2ba9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:33.716696 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ef188e81-a1ec-4a62-96b3-31476b4c2ba9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:34.319235 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ef188e81-a1ec-4a62-96b3-31476b4c2ba9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:34.352883 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5a8cd992-9a16-4800-a4ac-d08a0d5de4f2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:34.367184 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ef188e81-a1ec-4a62-96b3-31476b4c2ba9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:34.367347 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5a8cd992-9a16-4800-a4ac-d08a0d5de4f2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:34.381315 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ef188e81-a1ec-4a62-96b3-31476b4c2ba9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:34.386127 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ef188e81-a1ec-4a62-96b3-31476b4c2ba9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1724 microversion: 2.20 time: 0.738173 Jul 18 02:43:34.403276 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5a8cd992-9a16-4800-a4ac-d08a0d5de4f2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:34.406251 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2125/4261] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:43:33 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1724 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:43:34.412040 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5a8cd992-9a16-4800-a4ac-d08a0d5de4f2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:34.415078 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5a8cd992-9a16-4800-a4ac-d08a0d5de4f2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:34.416316 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5a8cd992-9a16-4800-a4ac-d08a0d5de4f2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:34.620228 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5a8cd992-9a16-4800-a4ac-d08a0d5de4f2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:34.673737 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5a8cd992-9a16-4800-a4ac-d08a0d5de4f2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1" status: 200 len: 1291 microversion: 2.1 time: 0.328030 Jul 18 02:43:34.681292 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2137/4262] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:34 2022] GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 => generated 1291 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:43:35.415980 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ebefb9cd-0d7b-4394-b918-f3d54467e633 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:35.417679 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ebefb9cd-0d7b-4394-b918-f3d54467e633 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:35.494163 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ebefb9cd-0d7b-4394-b918-f3d54467e633 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:35.494897 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ebefb9cd-0d7b-4394-b918-f3d54467e633 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:35.495901 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ebefb9cd-0d7b-4394-b918-f3d54467e633 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:35.498807 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ebefb9cd-0d7b-4394-b918-f3d54467e633 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:35.707874 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b262e751-a8ed-453d-9434-1a849c17eef6 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:35.718453 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b262e751-a8ed-453d-9434-1a849c17eef6 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:35.796292 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b262e751-a8ed-453d-9434-1a849c17eef6 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:35.818737 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b262e751-a8ed-453d-9434-1a849c17eef6 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:35.828781 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b262e751-a8ed-453d-9434-1a849c17eef6 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:35.834464 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b262e751-a8ed-453d-9434-1a849c17eef6 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:36.365834 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b262e751-a8ed-453d-9434-1a849c17eef6 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:36.376521 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b262e751-a8ed-453d-9434-1a849c17eef6 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1" status: 200 len: 1297 microversion: 2.1 time: 0.678648 Jul 18 02:43:36.384297 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2138/4263] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:35 2022] GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 => generated 1297 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:36.584047 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ebefb9cd-0d7b-4394-b918-f3d54467e633 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:36.599705 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ebefb9cd-0d7b-4394-b918-f3d54467e633 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:36.607583 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ebefb9cd-0d7b-4394-b918-f3d54467e633 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:36.609241 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ebefb9cd-0d7b-4394-b918-f3d54467e633 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1724 microversion: 2.20 time: 1.206872 Jul 18 02:43:36.627823 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2126/4264] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:43:35 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1724 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:43:37.411870 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7d715a7c-b187-44c2-9f57-3703b8fee496 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:37.419641 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7d715a7c-b187-44c2-9f57-3703b8fee496 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:37.450671 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7d715a7c-b187-44c2-9f57-3703b8fee496 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:37.451075 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7d715a7c-b187-44c2-9f57-3703b8fee496 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:37.452091 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7d715a7c-b187-44c2-9f57-3703b8fee496 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:37.452638 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7d715a7c-b187-44c2-9f57-3703b8fee496 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:37.649131 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ddb637c1-3fc9-4571-8bfc-c22fd0ada4c7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:37.651895 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ddb637c1-3fc9-4571-8bfc-c22fd0ada4c7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:37.688371 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ddb637c1-3fc9-4571-8bfc-c22fd0ada4c7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:37.694851 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ddb637c1-3fc9-4571-8bfc-c22fd0ada4c7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:37.699414 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ddb637c1-3fc9-4571-8bfc-c22fd0ada4c7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:37.701421 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ddb637c1-3fc9-4571-8bfc-c22fd0ada4c7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:38.830091 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7d715a7c-b187-44c2-9f57-3703b8fee496 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:38.882202 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7d715a7c-b187-44c2-9f57-3703b8fee496 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1" status: 200 len: 1364 microversion: 2.1 time: 1.484137 Jul 18 02:43:38.885079 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2139/4265] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:37 2022] GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 => generated 1364 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:38.935242 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ddb637c1-3fc9-4571-8bfc-c22fd0ada4c7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:38.964015 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ddb637c1-3fc9-4571-8bfc-c22fd0ada4c7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:38.990517 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ddb637c1-3fc9-4571-8bfc-c22fd0ada4c7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:38.992201 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ddb637c1-3fc9-4571-8bfc-c22fd0ada4c7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1745 microversion: 2.20 time: 1.350504 Jul 18 02:43:39.003956 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2127/4266] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:43:37 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1745 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:43:39.916650 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6910efba-d7b0-4d35-980c-f0a1d913feca tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:39.917796 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6910efba-d7b0-4d35-980c-f0a1d913feca tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:39.966374 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6910efba-d7b0-4d35-980c-f0a1d913feca tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:39.967829 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6910efba-d7b0-4d35-980c-f0a1d913feca tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:39.970052 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6910efba-d7b0-4d35-980c-f0a1d913feca tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:39.974348 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6910efba-d7b0-4d35-980c-f0a1d913feca tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:40.029498 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-785db944-e963-49f9-84df-f3acdfe8b6ce tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:40.030904 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-785db944-e963-49f9-84df-f3acdfe8b6ce tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:40.061616 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-785db944-e963-49f9-84df-f3acdfe8b6ce tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:40.070127 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-785db944-e963-49f9-84df-f3acdfe8b6ce tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:40.071914 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-785db944-e963-49f9-84df-f3acdfe8b6ce tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:40.072962 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-785db944-e963-49f9-84df-f3acdfe8b6ce tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:40.848484 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6910efba-d7b0-4d35-980c-f0a1d913feca tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:40.883983 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6910efba-d7b0-4d35-980c-f0a1d913feca tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1" status: 200 len: 1364 microversion: 2.1 time: 0.974586 Jul 18 02:43:40.885121 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2140/4267] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:39 2022] GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 => generated 1364 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:40.895212 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-785db944-e963-49f9-84df-f3acdfe8b6ce tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:40.912311 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-785db944-e963-49f9-84df-f3acdfe8b6ce tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:40.914572 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-785db944-e963-49f9-84df-f3acdfe8b6ce tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:40.921685 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-785db944-e963-49f9-84df-f3acdfe8b6ce tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1745 microversion: 2.20 time: 0.899443 Jul 18 02:43:40.924405 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2128/4268] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:43:40 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1745 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:43:41.316216 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-a1767df2-3dbf-4139-8bb9-09e9e783f2de req-2cea8645-11af-49ea-b0a2-abd8bc899e40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1", "tag": "6391c213-3d08-4f3e-a0ab-42a473c8990d"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:43:41.355099 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-a1767df2-3dbf-4139-8bb9-09e9e783f2de req-2cea8645-11af-49ea-b0a2-abd8bc899e40 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:41.359022 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-a1767df2-3dbf-4139-8bb9-09e9e783f2de req-2cea8645-11af-49ea-b0a2-abd8bc899e40 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:41.374835 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-a1767df2-3dbf-4139-8bb9-09e9e783f2de req-2cea8645-11af-49ea-b0a2-abd8bc899e40 service nova] Creating event network-changed:6391c213-3d08-4f3e-a0ab-42a473c8990d for instance b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 on n-h1-465891-3 Jul 18 02:43:41.382048 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-a1767df2-3dbf-4139-8bb9-09e9e783f2de req-2cea8645-11af-49ea-b0a2-abd8bc899e40 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076972 Jul 18 02:43:41.388354 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2141/4269] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:43:41.925515 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-083f1cf7-19ea-4300-b076-3da59da87b7a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:41.952836 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-083f1cf7-19ea-4300-b076-3da59da87b7a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:41.966845 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-96b7ad62-8444-4d33-98c2-90b0d964922a tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:41.968723 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-96b7ad62-8444-4d33-98c2-90b0d964922a tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:41.993737 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:41.995269 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=10 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:42.037472 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-083f1cf7-19ea-4300-b076-3da59da87b7a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:42.038551 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-083f1cf7-19ea-4300-b076-3da59da87b7a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:42.040281 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-083f1cf7-19ea-4300-b076-3da59da87b7a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:42.041357 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-083f1cf7-19ea-4300-b076-3da59da87b7a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:42.043577 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-96b7ad62-8444-4d33-98c2-90b0d964922a tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:42.049542 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-96b7ad62-8444-4d33-98c2-90b0d964922a tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:42.055465 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-96b7ad62-8444-4d33-98c2-90b0d964922a tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:42.060630 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-96b7ad62-8444-4d33-98c2-90b0d964922a tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:43.322037 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=4 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:43.885823 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-083f1cf7-19ea-4300-b076-3da59da87b7a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:43.947411 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-083f1cf7-19ea-4300-b076-3da59da87b7a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1" status: 200 len: 1364 microversion: 2.1 time: 2.039559 Jul 18 02:43:43.970345 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2129/4270] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:41 2022] GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 => generated 1364 bytes in 2064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:43.978902 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-acc386c2-e4a6-4596-ad18-c85c8fc8e414 req-34bbb5ae-d580-4689-93ef-d596bfec67a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "136d1a82-a525-4ff4-860d-31c37c826270", "name": "network-vif-plugged", "status": "completed", "tag": "16123f42-6b11-41ec-a212-278fc525a448"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:43:43.994892 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-96b7ad62-8444-4d33-98c2-90b0d964922a tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:44.023106 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-96b7ad62-8444-4d33-98c2-90b0d964922a tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:44.027313 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:44.045019 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-96b7ad62-8444-4d33-98c2-90b0d964922a tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:44.047378 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-96b7ad62-8444-4d33-98c2-90b0d964922a tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1740 microversion: 2.20 time: 2.105843 Jul 18 02:43:44.048493 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2142/4271] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:43:41 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1740 bytes in 2111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:43:44.078099 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-acc386c2-e4a6-4596-ad18-c85c8fc8e414 req-34bbb5ae-d580-4689-93ef-d596bfec67a0 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:44.082182 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-acc386c2-e4a6-4596-ad18-c85c8fc8e414 req-34bbb5ae-d580-4689-93ef-d596bfec67a0 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:44.159233 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-acc386c2-e4a6-4596-ad18-c85c8fc8e414 req-34bbb5ae-d580-4689-93ef-d596bfec67a0 service nova] Creating event network-vif-plugged:16123f42-6b11-41ec-a212-278fc525a448 for instance 136d1a82-a525-4ff4-860d-31c37c826270 on n-h1-465891-3 Jul 18 02:43:44.172011 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-acc386c2-e4a6-4596-ad18-c85c8fc8e414 req-34bbb5ae-d580-4689-93ef-d596bfec67a0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197106 Jul 18 02:43:44.174441 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2130/4272] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:43:45.006028 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-35c51c93-8613-45b9-b1df-d98243a0bab1 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:45.016278 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-35c51c93-8613-45b9-b1df-d98243a0bab1 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:45.065908 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-35c51c93-8613-45b9-b1df-d98243a0bab1 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:45.066978 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-35c51c93-8613-45b9-b1df-d98243a0bab1 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:45.069017 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1acb68a8-5b3c-4799-99c4-177eb0cf1e39 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:45.070051 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1acb68a8-5b3c-4799-99c4-177eb0cf1e39 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:45.072853 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-35c51c93-8613-45b9-b1df-d98243a0bab1 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:45.075017 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-35c51c93-8613-45b9-b1df-d98243a0bab1 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:45.101003 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1acb68a8-5b3c-4799-99c4-177eb0cf1e39 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:45.101988 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1acb68a8-5b3c-4799-99c4-177eb0cf1e39 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:45.106878 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1acb68a8-5b3c-4799-99c4-177eb0cf1e39 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:45.113595 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1acb68a8-5b3c-4799-99c4-177eb0cf1e39 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:46.459604 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1acb68a8-5b3c-4799-99c4-177eb0cf1e39 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:46.491691 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1acb68a8-5b3c-4799-99c4-177eb0cf1e39 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:46.496445 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-35c51c93-8613-45b9-b1df-d98243a0bab1 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:46.517271 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1acb68a8-5b3c-4799-99c4-177eb0cf1e39 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:46.520407 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1acb68a8-5b3c-4799-99c4-177eb0cf1e39 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1740 microversion: 2.20 time: 1.456796 Jul 18 02:43:46.520650 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-35c51c93-8613-45b9-b1df-d98243a0bab1 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1" status: 200 len: 1364 microversion: 2.1 time: 1.529698 Jul 18 02:43:46.523033 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2131/4273] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:43:45 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1740 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:43:46.524202 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2143/4274] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:44 2022] GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 => generated 1364 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:47.570795 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-55400154-67bb-4de5-a741-69eb7a539ee4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:47.571602 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-55400154-67bb-4de5-a741-69eb7a539ee4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:47.575648 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a876c0d0-3630-4639-9636-f87b01524785 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:47.576470 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a876c0d0-3630-4639-9636-f87b01524785 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:47.600699 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-55400154-67bb-4de5-a741-69eb7a539ee4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:47.601147 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-55400154-67bb-4de5-a741-69eb7a539ee4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:47.619663 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-55400154-67bb-4de5-a741-69eb7a539ee4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:47.621453 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a876c0d0-3630-4639-9636-f87b01524785 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:47.624997 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a876c0d0-3630-4639-9636-f87b01524785 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:47.627946 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-55400154-67bb-4de5-a741-69eb7a539ee4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:47.637074 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a876c0d0-3630-4639-9636-f87b01524785 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:47.644559 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a876c0d0-3630-4639-9636-f87b01524785 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:48.368550 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a876c0d0-3630-4639-9636-f87b01524785 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:48.372069 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:48.402916 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a876c0d0-3630-4639-9636-f87b01524785 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1" status: 200 len: 1364 microversion: 2.1 time: 0.861542 Jul 18 02:43:48.403599 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2144/4275] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:47 2022] GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 => generated 1364 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:43:48.763995 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-55400154-67bb-4de5-a741-69eb7a539ee4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:48.778482 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-55400154-67bb-4de5-a741-69eb7a539ee4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:48.785623 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-55400154-67bb-4de5-a741-69eb7a539ee4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:48.787297 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-55400154-67bb-4de5-a741-69eb7a539ee4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1740 microversion: 2.20 time: 1.220491 Jul 18 02:43:48.788448 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2132/4276] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:43:47 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1740 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:43:49.428872 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a9a36f41-ddfc-4b47-a870-0319b8261116 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:49.435884 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a9a36f41-ddfc-4b47-a870-0319b8261116 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:49.476197 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9a36f41-ddfc-4b47-a870-0319b8261116 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:49.480849 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9a36f41-ddfc-4b47-a870-0319b8261116 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:49.483821 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9a36f41-ddfc-4b47-a870-0319b8261116 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:49.498770 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9a36f41-ddfc-4b47-a870-0319b8261116 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:49.807731 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-304e5fc7-57f6-4cde-87d5-2999139970d2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:49.808562 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-304e5fc7-57f6-4cde-87d5-2999139970d2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:49.825978 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-304e5fc7-57f6-4cde-87d5-2999139970d2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:49.835667 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-304e5fc7-57f6-4cde-87d5-2999139970d2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:49.841458 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-304e5fc7-57f6-4cde-87d5-2999139970d2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:49.842531 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-304e5fc7-57f6-4cde-87d5-2999139970d2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:49.933594 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=70 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:51.684999 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a9a36f41-ddfc-4b47-a870-0319b8261116 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:51.749725 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a9a36f41-ddfc-4b47-a870-0319b8261116 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1" status: 200 len: 1364 microversion: 2.1 time: 2.313922 Jul 18 02:43:51.752458 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2145/4277] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:49 2022] GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 => generated 1364 bytes in 2334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:51.995486 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-304e5fc7-57f6-4cde-87d5-2999139970d2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:52.031467 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-304e5fc7-57f6-4cde-87d5-2999139970d2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:52.037018 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-304e5fc7-57f6-4cde-87d5-2999139970d2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:52.040604 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-304e5fc7-57f6-4cde-87d5-2999139970d2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1740 microversion: 2.20 time: 2.236189 Jul 18 02:43:52.061790 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2133/4278] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:43:49 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1740 bytes in 2258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:43:52.788555 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c1785976-4a0e-4ec8-9745-d802eebbe589 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:52.794012 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c1785976-4a0e-4ec8-9745-d802eebbe589 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:52.825737 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c1785976-4a0e-4ec8-9745-d802eebbe589 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:52.827062 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c1785976-4a0e-4ec8-9745-d802eebbe589 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:52.829019 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c1785976-4a0e-4ec8-9745-d802eebbe589 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:52.830838 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c1785976-4a0e-4ec8-9745-d802eebbe589 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:53.080822 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c6bc85aa-710a-4898-82ad-84aed6b378b8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:53.087518 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c6bc85aa-710a-4898-82ad-84aed6b378b8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:53.113601 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c6bc85aa-710a-4898-82ad-84aed6b378b8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:53.114105 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c6bc85aa-710a-4898-82ad-84aed6b378b8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:53.120575 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c6bc85aa-710a-4898-82ad-84aed6b378b8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:53.121464 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c6bc85aa-710a-4898-82ad-84aed6b378b8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:53.553247 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c1785976-4a0e-4ec8-9745-d802eebbe589 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:53.601022 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c6bc85aa-710a-4898-82ad-84aed6b378b8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:53.611205 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c6bc85aa-710a-4898-82ad-84aed6b378b8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:53.618807 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c6bc85aa-710a-4898-82ad-84aed6b378b8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:53.624685 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c6bc85aa-710a-4898-82ad-84aed6b378b8 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1740 microversion: 2.20 time: 0.553221 Jul 18 02:43:53.625957 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2134/4279] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:43:53 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1740 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:43:53.634521 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c1785976-4a0e-4ec8-9745-d802eebbe589 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1" status: 200 len: 1364 microversion: 2.1 time: 0.853688 Jul 18 02:43:53.647119 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2146/4280] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:52 2022] GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 => generated 1364 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:54.648231 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a8c8372c-7ecb-4ccf-90e4-56be8c6f3fd4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:54.649114 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a8c8372c-7ecb-4ccf-90e4-56be8c6f3fd4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:54.672215 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a8c8372c-7ecb-4ccf-90e4-56be8c6f3fd4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:54.673892 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a8c8372c-7ecb-4ccf-90e4-56be8c6f3fd4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:54.675534 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a8c8372c-7ecb-4ccf-90e4-56be8c6f3fd4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:54.676394 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a8c8372c-7ecb-4ccf-90e4-56be8c6f3fd4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:54.690585 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-26699a1c-32b7-450e-aab8-1dd6191479c2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:54.694224 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-26699a1c-32b7-450e-aab8-1dd6191479c2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:54.754302 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=36 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:54.765745 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-26699a1c-32b7-450e-aab8-1dd6191479c2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:54.768121 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-26699a1c-32b7-450e-aab8-1dd6191479c2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:54.777403 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-26699a1c-32b7-450e-aab8-1dd6191479c2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:54.778015 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-26699a1c-32b7-450e-aab8-1dd6191479c2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:55.927214 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a8c8372c-7ecb-4ccf-90e4-56be8c6f3fd4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:55.945633 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a8c8372c-7ecb-4ccf-90e4-56be8c6f3fd4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:55.950785 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a8c8372c-7ecb-4ccf-90e4-56be8c6f3fd4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:55.956633 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a8c8372c-7ecb-4ccf-90e4-56be8c6f3fd4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1740 microversion: 2.20 time: 1.310763 Jul 18 02:43:55.959011 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2135/4281] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:43:54 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1740 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:43:55.975565 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-417e553b-fde6-4028-9207-b3c7d186c47f req-907dbc04-b10b-4031-bac2-11f12c96d9a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1", "name": "network-vif-plugged", "status": "completed", "tag": "6391c213-3d08-4f3e-a0ab-42a473c8990d"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:43:56.018186 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-417e553b-fde6-4028-9207-b3c7d186c47f req-907dbc04-b10b-4031-bac2-11f12c96d9a3 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:56.018747 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-417e553b-fde6-4028-9207-b3c7d186c47f req-907dbc04-b10b-4031-bac2-11f12c96d9a3 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:56.068240 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-417e553b-fde6-4028-9207-b3c7d186c47f req-907dbc04-b10b-4031-bac2-11f12c96d9a3 service nova] Creating event network-vif-plugged:6391c213-3d08-4f3e-a0ab-42a473c8990d for instance b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 on n-h1-465891-3 Jul 18 02:43:56.080630 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-417e553b-fde6-4028-9207-b3c7d186c47f req-907dbc04-b10b-4031-bac2-11f12c96d9a3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117809 Jul 18 02:43:56.091957 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2136/4282] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:43:56.110370 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-26699a1c-32b7-450e-aab8-1dd6191479c2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:56.119789 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-26699a1c-32b7-450e-aab8-1dd6191479c2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1" status: 200 len: 1364 microversion: 2.1 time: 1.444309 Jul 18 02:43:56.120407 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2147/4283] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:54 2022] GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 => generated 1364 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:43:56.983607 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-76e350e1-5f8a-4475-be50-47a74f4ed3cd tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:56.996410 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-76e350e1-5f8a-4475-be50-47a74f4ed3cd tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:57.043720 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-76e350e1-5f8a-4475-be50-47a74f4ed3cd tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:57.069624 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-76e350e1-5f8a-4475-be50-47a74f4ed3cd tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:57.070883 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-76e350e1-5f8a-4475-be50-47a74f4ed3cd tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:57.071355 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-76e350e1-5f8a-4475-be50-47a74f4ed3cd tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:57.155377 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ad950070-bbde-4242-841e-a3f617f404d0 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:57.168716 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ad950070-bbde-4242-841e-a3f617f404d0 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:57.227499 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ad950070-bbde-4242-841e-a3f617f404d0 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:57.233690 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ad950070-bbde-4242-841e-a3f617f404d0 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:57.243819 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ad950070-bbde-4242-841e-a3f617f404d0 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:57.250406 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ad950070-bbde-4242-841e-a3f617f404d0 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:57.832247 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-76e350e1-5f8a-4475-be50-47a74f4ed3cd tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:57.851632 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-76e350e1-5f8a-4475-be50-47a74f4ed3cd tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:57.858481 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-76e350e1-5f8a-4475-be50-47a74f4ed3cd tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:57.863280 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-76e350e1-5f8a-4475-be50-47a74f4ed3cd tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1740 microversion: 2.20 time: 0.888478 Jul 18 02:43:57.864502 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2137/4284] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:43:56 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1740 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:43:57.932096 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ad950070-bbde-4242-841e-a3f617f404d0 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:57.963155 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ad950070-bbde-4242-841e-a3f617f404d0 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1" status: 200 len: 1364 microversion: 2.1 time: 0.813490 Jul 18 02:43:57.964259 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2148/4285] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:57 2022] GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 => generated 1364 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:58.903032 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6bc88975-f311-4f9b-81c5-7aa56ca287ba tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:58.911288 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6bc88975-f311-4f9b-81c5-7aa56ca287ba tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:58.970845 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6bc88975-f311-4f9b-81c5-7aa56ca287ba tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:58.977600 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6bc88975-f311-4f9b-81c5-7aa56ca287ba tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:58.981646 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6bc88975-f311-4f9b-81c5-7aa56ca287ba tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:58.982879 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6bc88975-f311-4f9b-81c5-7aa56ca287ba tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:59.003207 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3425cd96-3280-4e01-be6b-738035b1f2f7 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:59.012116 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3425cd96-3280-4e01-be6b-738035b1f2f7 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:59.099903 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3425cd96-3280-4e01-be6b-738035b1f2f7 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:59.103889 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3425cd96-3280-4e01-be6b-738035b1f2f7 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:59.107013 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3425cd96-3280-4e01-be6b-738035b1f2f7 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:59.118890 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3425cd96-3280-4e01-be6b-738035b1f2f7 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:00.192421 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6bc88975-f311-4f9b-81c5-7aa56ca287ba tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:00.224643 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6bc88975-f311-4f9b-81c5-7aa56ca287ba tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:00.234882 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6bc88975-f311-4f9b-81c5-7aa56ca287ba tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:00.238421 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6bc88975-f311-4f9b-81c5-7aa56ca287ba tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1740 microversion: 2.20 time: 1.345566 Jul 18 02:44:00.242974 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2138/4286] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:43:58 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1740 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:00.544901 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3425cd96-3280-4e01-be6b-738035b1f2f7 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:00.613981 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3425cd96-3280-4e01-be6b-738035b1f2f7 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1" status: 200 len: 1364 microversion: 2.1 time: 1.613590 Jul 18 02:44:00.617038 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2149/4287] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:58 2022] GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 => generated 1364 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:01.308998 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-00c4ca3a-2c19-458e-856c-922863f1a14c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:01.310485 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-00c4ca3a-2c19-458e-856c-922863f1a14c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:01.397166 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-00c4ca3a-2c19-458e-856c-922863f1a14c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:01.398018 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-00c4ca3a-2c19-458e-856c-922863f1a14c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:01.399453 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-00c4ca3a-2c19-458e-856c-922863f1a14c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:01.408627 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-00c4ca3a-2c19-458e-856c-922863f1a14c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:01.649359 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-22ad752f-4478-4e5a-909c-dbe8736794d6 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:01.652975 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-22ad752f-4478-4e5a-909c-dbe8736794d6 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:01.745204 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-22ad752f-4478-4e5a-909c-dbe8736794d6 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:01.747901 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-22ad752f-4478-4e5a-909c-dbe8736794d6 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:01.749939 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-22ad752f-4478-4e5a-909c-dbe8736794d6 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:01.758896 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-22ad752f-4478-4e5a-909c-dbe8736794d6 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:02.267001 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-00c4ca3a-2c19-458e-856c-922863f1a14c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:02.298913 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-00c4ca3a-2c19-458e-856c-922863f1a14c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:02.309153 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-00c4ca3a-2c19-458e-856c-922863f1a14c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:02.319822 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-00c4ca3a-2c19-458e-856c-922863f1a14c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1740 microversion: 2.20 time: 1.040300 Jul 18 02:44:02.330824 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2139/4288] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:01 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1740 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:03.031108 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-22ad752f-4478-4e5a-909c-dbe8736794d6 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:03.061571 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-22ad752f-4478-4e5a-909c-dbe8736794d6 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1" status: 200 len: 1553 microversion: 2.1 time: 1.421696 Jul 18 02:44:03.062718 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2150/4289] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:01 2022] GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 => generated 1553 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:03.107490 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-753590e9-297a-4bbe-8b79-ae4712b53a13 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:03.108367 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-753590e9-297a-4bbe-8b79-ae4712b53a13 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:03.179253 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-753590e9-297a-4bbe-8b79-ae4712b53a13 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:03.185417 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-753590e9-297a-4bbe-8b79-ae4712b53a13 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:03.187298 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-753590e9-297a-4bbe-8b79-ae4712b53a13 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:03.188261 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-753590e9-297a-4bbe-8b79-ae4712b53a13 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:03.375353 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cadde7e4-4d28-433c-a399-1e2dcd1d25a3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:03.375995 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cadde7e4-4d28-433c-a399-1e2dcd1d25a3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:03.414233 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cadde7e4-4d28-433c-a399-1e2dcd1d25a3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:03.420859 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cadde7e4-4d28-433c-a399-1e2dcd1d25a3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:03.421992 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cadde7e4-4d28-433c-a399-1e2dcd1d25a3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:03.426473 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cadde7e4-4d28-433c-a399-1e2dcd1d25a3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:03.582367 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-753590e9-297a-4bbe-8b79-ae4712b53a13 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.492546 Jul 18 02:44:03.618310 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2140/4290] 10.222.0.57 () {58 vars in 1274 bytes} [Mon Jul 18 02:44:03 2022] GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1/os-interface => generated 284 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:44:04.636501 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cadde7e4-4d28-433c-a399-1e2dcd1d25a3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:04.662870 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cadde7e4-4d28-433c-a399-1e2dcd1d25a3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:04.669675 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cadde7e4-4d28-433c-a399-1e2dcd1d25a3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:04.674465 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cadde7e4-4d28-433c-a399-1e2dcd1d25a3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1740 microversion: 2.20 time: 1.312307 Jul 18 02:44:04.706897 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2151/4291] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:03 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1740 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:05.705897 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c7b70fdb-3260-4e87-96c2-9090849ee747 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:05.707643 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c7b70fdb-3260-4e87-96c2-9090849ee747 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:05.738586 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c7b70fdb-3260-4e87-96c2-9090849ee747 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:05.742287 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c7b70fdb-3260-4e87-96c2-9090849ee747 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:05.746326 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c7b70fdb-3260-4e87-96c2-9090849ee747 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:05.758546 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c7b70fdb-3260-4e87-96c2-9090849ee747 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:06.802372 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c7b70fdb-3260-4e87-96c2-9090849ee747 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:06.811293 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c7b70fdb-3260-4e87-96c2-9090849ee747 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:06.817749 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c7b70fdb-3260-4e87-96c2-9090849ee747 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:06.830722 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c7b70fdb-3260-4e87-96c2-9090849ee747 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1740 microversion: 2.20 time: 1.129749 Jul 18 02:44:06.834114 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2141/4292] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:05 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1740 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:07.869124 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-edf544b7-e4ac-44b1-ac2b-1c6f073cb422 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:07.871105 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-edf544b7-e4ac-44b1-ac2b-1c6f073cb422 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:07.904287 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-edf544b7-e4ac-44b1-ac2b-1c6f073cb422 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:07.908320 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-edf544b7-e4ac-44b1-ac2b-1c6f073cb422 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:07.915278 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-edf544b7-e4ac-44b1-ac2b-1c6f073cb422 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:07.920588 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-edf544b7-e4ac-44b1-ac2b-1c6f073cb422 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:08.570776 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-edf544b7-e4ac-44b1-ac2b-1c6f073cb422 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:08.595031 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-edf544b7-e4ac-44b1-ac2b-1c6f073cb422 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:08.605896 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-edf544b7-e4ac-44b1-ac2b-1c6f073cb422 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:08.608293 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-edf544b7-e4ac-44b1-ac2b-1c6f073cb422 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1740 microversion: 2.20 time: 0.744241 Jul 18 02:44:08.609413 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2152/4293] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:07 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1740 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:09.646242 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-54862b95-890e-4346-8b5c-6901da9827b9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:09.662189 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-54862b95-890e-4346-8b5c-6901da9827b9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:09.690091 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54862b95-890e-4346-8b5c-6901da9827b9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:09.703774 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54862b95-890e-4346-8b5c-6901da9827b9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:09.708490 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54862b95-890e-4346-8b5c-6901da9827b9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:09.718239 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54862b95-890e-4346-8b5c-6901da9827b9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:10.508865 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-54862b95-890e-4346-8b5c-6901da9827b9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:10.582800 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-54862b95-890e-4346-8b5c-6901da9827b9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:10.588610 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-54862b95-890e-4346-8b5c-6901da9827b9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:10.606062 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-54862b95-890e-4346-8b5c-6901da9827b9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1740 microversion: 2.20 time: 0.967778 Jul 18 02:44:10.619786 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2142/4294] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:09 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1740 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:44:11.671734 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-536e92d4-3b20-4fa7-b0f3-8b6fb17087b0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:11.685218 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-536e92d4-3b20-4fa7-b0f3-8b6fb17087b0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:11.755045 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-536e92d4-3b20-4fa7-b0f3-8b6fb17087b0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:11.756103 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-536e92d4-3b20-4fa7-b0f3-8b6fb17087b0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:11.759272 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-536e92d4-3b20-4fa7-b0f3-8b6fb17087b0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:11.763750 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-536e92d4-3b20-4fa7-b0f3-8b6fb17087b0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:12.712961 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-536e92d4-3b20-4fa7-b0f3-8b6fb17087b0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:12.756376 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-536e92d4-3b20-4fa7-b0f3-8b6fb17087b0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:12.787150 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-536e92d4-3b20-4fa7-b0f3-8b6fb17087b0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:12.795375 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-536e92d4-3b20-4fa7-b0f3-8b6fb17087b0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1740 microversion: 2.20 time: 1.163809 Jul 18 02:44:12.806467 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2153/4295] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:11 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1740 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:12.845046 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-ec971ac7-a939-4826-acdc-6ced00154730 req-58a57e29-282f-46c1-96e8-6c8039b48471 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1", "tag": "6391c213-3d08-4f3e-a0ab-42a473c8990d"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:12.891147 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-ec971ac7-a939-4826-acdc-6ced00154730 req-58a57e29-282f-46c1-96e8-6c8039b48471 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:12.892076 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-ec971ac7-a939-4826-acdc-6ced00154730 req-58a57e29-282f-46c1-96e8-6c8039b48471 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:12.927370 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-ec971ac7-a939-4826-acdc-6ced00154730 req-58a57e29-282f-46c1-96e8-6c8039b48471 service nova] Creating event network-changed:6391c213-3d08-4f3e-a0ab-42a473c8990d for instance b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 on n-h1-465891-3 Jul 18 02:44:12.947369 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-ec971ac7-a939-4826-acdc-6ced00154730 req-58a57e29-282f-46c1-96e8-6c8039b48471 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105603 Jul 18 02:44:12.948735 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2143/4296] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:44:13.835405 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0be994cf-2947-4d20-adcb-5b4bfef1d0fa tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:13.846308 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0be994cf-2947-4d20-adcb-5b4bfef1d0fa tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:13.868041 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0be994cf-2947-4d20-adcb-5b4bfef1d0fa tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:13.875187 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0be994cf-2947-4d20-adcb-5b4bfef1d0fa tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:13.877516 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0be994cf-2947-4d20-adcb-5b4bfef1d0fa tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:13.878480 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0be994cf-2947-4d20-adcb-5b4bfef1d0fa tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:15.810273 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0be994cf-2947-4d20-adcb-5b4bfef1d0fa tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:15.844663 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0be994cf-2947-4d20-adcb-5b4bfef1d0fa tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:15.854434 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0be994cf-2947-4d20-adcb-5b4bfef1d0fa tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:15.872267 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0be994cf-2947-4d20-adcb-5b4bfef1d0fa tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1740 microversion: 2.20 time: 2.046474 Jul 18 02:44:15.889602 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2154/4297] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:13 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1740 bytes in 2069 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:16.894822 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-01cbe054-9f6f-4f92-8621-7a89635da8fc tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:16.896335 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-01cbe054-9f6f-4f92-8621-7a89635da8fc tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:16.916213 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=28 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:16.919846 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-01cbe054-9f6f-4f92-8621-7a89635da8fc tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:16.921614 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-01cbe054-9f6f-4f92-8621-7a89635da8fc tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:16.922756 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-01cbe054-9f6f-4f92-8621-7a89635da8fc tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:16.934018 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-01cbe054-9f6f-4f92-8621-7a89635da8fc tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:18.645573 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-01cbe054-9f6f-4f92-8621-7a89635da8fc tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:18.670244 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-01cbe054-9f6f-4f92-8621-7a89635da8fc tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:18.675707 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-01cbe054-9f6f-4f92-8621-7a89635da8fc tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:18.678311 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-01cbe054-9f6f-4f92-8621-7a89635da8fc tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1740 microversion: 2.20 time: 1.789431 Jul 18 02:44:18.692467 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2144/4298] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:16 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1740 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:19.703613 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3db66fef-f02c-408c-9dad-141b7a269769 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:19.705624 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3db66fef-f02c-408c-9dad-141b7a269769 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:19.719264 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3db66fef-f02c-408c-9dad-141b7a269769 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:19.723028 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3db66fef-f02c-408c-9dad-141b7a269769 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:19.729032 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3db66fef-f02c-408c-9dad-141b7a269769 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:19.729656 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3db66fef-f02c-408c-9dad-141b7a269769 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:19.764820 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=62 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:20.044075 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3db66fef-f02c-408c-9dad-141b7a269769 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:20.071811 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3db66fef-f02c-408c-9dad-141b7a269769 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:20.075410 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3db66fef-f02c-408c-9dad-141b7a269769 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:20.078096 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3db66fef-f02c-408c-9dad-141b7a269769 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1740 microversion: 2.20 time: 0.378381 Jul 18 02:44:20.079701 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2155/4299] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:19 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1740 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:21.111016 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4a3f916b-2583-427a-8a04-18f55e593a51 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:21.113619 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4a3f916b-2583-427a-8a04-18f55e593a51 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:21.142452 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4a3f916b-2583-427a-8a04-18f55e593a51 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:21.158913 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4a3f916b-2583-427a-8a04-18f55e593a51 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:21.160695 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4a3f916b-2583-427a-8a04-18f55e593a51 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:21.161490 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4a3f916b-2583-427a-8a04-18f55e593a51 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:21.216632 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=62 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:22.247402 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4a3f916b-2583-427a-8a04-18f55e593a51 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:22.265409 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4a3f916b-2583-427a-8a04-18f55e593a51 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:22.279492 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4a3f916b-2583-427a-8a04-18f55e593a51 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:22.281240 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4a3f916b-2583-427a-8a04-18f55e593a51 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1722 microversion: 2.20 time: 1.186023 Jul 18 02:44:22.282092 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2145/4300] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:21 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1722 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:23.332268 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ce6348fd-19e7-4739-abdb-e36f5949399c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:23.333528 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ce6348fd-19e7-4739-abdb-e36f5949399c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:23.371280 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ce6348fd-19e7-4739-abdb-e36f5949399c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:23.372091 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ce6348fd-19e7-4739-abdb-e36f5949399c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:23.400959 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ce6348fd-19e7-4739-abdb-e36f5949399c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:23.409480 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ce6348fd-19e7-4739-abdb-e36f5949399c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:23.606734 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c5e87172-7e15-434d-9cce-adf90bb06d17 tempest-PortsAdminExtendedAttrsTestJSON-111451449 tempest-PortsAdminExtendedAttrsTestJSON-111451449-project-admin] Calling method '.version_select at 0x7ff4a8788c10>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:23.608232 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:44:23.608232 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 02:44:23.610902 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c5e87172-7e15-434d-9cce-adf90bb06d17 tempest-PortsAdminExtendedAttrsTestJSON-111451449 tempest-PortsAdminExtendedAttrsTestJSON-111451449-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:23.616552 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c5e87172-7e15-434d-9cce-adf90bb06d17 tempest-PortsAdminExtendedAttrsTestJSON-111451449 tempest-PortsAdminExtendedAttrsTestJSON-111451449-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:23.670836 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c5e87172-7e15-434d-9cce-adf90bb06d17 tempest-PortsAdminExtendedAttrsTestJSON-111451449 tempest-PortsAdminExtendedAttrsTestJSON-111451449-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:23.677392 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c5e87172-7e15-434d-9cce-adf90bb06d17 tempest-PortsAdminExtendedAttrsTestJSON-111451449 tempest-PortsAdminExtendedAttrsTestJSON-111451449-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:23.711979 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c5e87172-7e15-434d-9cce-adf90bb06d17 tempest-PortsAdminExtendedAttrsTestJSON-111451449 tempest-PortsAdminExtendedAttrsTestJSON-111451449-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:23.715115 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c5e87172-7e15-434d-9cce-adf90bb06d17 tempest-PortsAdminExtendedAttrsTestJSON-111451449 tempest-PortsAdminExtendedAttrsTestJSON-111451449-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:23.746196 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c5e87172-7e15-434d-9cce-adf90bb06d17 tempest-PortsAdminExtendedAttrsTestJSON-111451449 tempest-PortsAdminExtendedAttrsTestJSON-111451449-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.705220 Jul 18 02:44:23.747863 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2156/4301] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 02:44:23 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:44:24.175589 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ce6348fd-19e7-4739-abdb-e36f5949399c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:24.195100 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ce6348fd-19e7-4739-abdb-e36f5949399c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:24.196936 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ce6348fd-19e7-4739-abdb-e36f5949399c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:24.201604 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ce6348fd-19e7-4739-abdb-e36f5949399c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1722 microversion: 2.20 time: 0.890553 Jul 18 02:44:24.207040 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2146/4302] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:23 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1722 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:44:25.222778 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-06de673c-4799-4369-b5d7-27a52f4b8e03 req-8a165d72-a8b6-4030-9cd0-4f40d06e171e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "136d1a82-a525-4ff4-860d-31c37c826270", "name": "network-vif-unplugged", "status": "completed", "tag": "16123f42-6b11-41ec-a212-278fc525a448"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:25.247056 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-eb2c95d8-5b49-4c1e-bc4b-f5b5701964cd tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:25.250335 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-eb2c95d8-5b49-4c1e-bc4b-f5b5701964cd tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:25.272985 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=22 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:25.291104 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-06de673c-4799-4369-b5d7-27a52f4b8e03 req-8a165d72-a8b6-4030-9cd0-4f40d06e171e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:25.291922 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-06de673c-4799-4369-b5d7-27a52f4b8e03 req-8a165d72-a8b6-4030-9cd0-4f40d06e171e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:25.294963 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eb2c95d8-5b49-4c1e-bc4b-f5b5701964cd tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:25.300617 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eb2c95d8-5b49-4c1e-bc4b-f5b5701964cd tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:25.304116 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eb2c95d8-5b49-4c1e-bc4b-f5b5701964cd tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:25.305258 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eb2c95d8-5b49-4c1e-bc4b-f5b5701964cd tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:25.350067 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.compute.server_external_events [req-06de673c-4799-4369-b5d7-27a52f4b8e03 req-8a165d72-a8b6-4030-9cd0-4f40d06e171e service nova] Unable to find a host for instance 136d1a82-a525-4ff4-860d-31c37c826270. Dropping event network-vif-unplugged {{(pid=119543) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 18 02:44:25.371747 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-06de673c-4799-4369-b5d7-27a52f4b8e03 req-8a165d72-a8b6-4030-9cd0-4f40d06e171e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.156300 Jul 18 02:44:25.373670 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2157/4303] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 159 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 18 02:44:25.911747 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-eb2c95d8-5b49-4c1e-bc4b-f5b5701964cd tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:25.948293 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-eb2c95d8-5b49-4c1e-bc4b-f5b5701964cd tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:25.949901 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-eb2c95d8-5b49-4c1e-bc4b-f5b5701964cd tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:25.962200 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-eb2c95d8-5b49-4c1e-bc4b-f5b5701964cd tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1665 microversion: 2.20 time: 0.725371 Jul 18 02:44:25.964520 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2147/4304] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:25 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1665 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:44:26.023446 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7a3297b6-625d-4dc2-96ce-a1210a9255e5 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a64f5b9-8027-4a36-ac09-2a1da81a1037"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:26.034416 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7a3297b6-625d-4dc2-96ce-a1210a9255e5 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:26.079671 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7a3297b6-625d-4dc2-96ce-a1210a9255e5 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:26.080167 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7a3297b6-625d-4dc2-96ce-a1210a9255e5 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:26.081057 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7a3297b6-625d-4dc2-96ce-a1210a9255e5 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:26.081646 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7a3297b6-625d-4dc2-96ce-a1210a9255e5 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:27.162354 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7a3297b6-625d-4dc2-96ce-a1210a9255e5 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "POST /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.162426 Jul 18 02:44:27.165083 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2158/4305] 10.222.0.57 () {62 vars in 1363 bytes} [Mon Jul 18 02:44:25 2022] POST /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270/os-volume_attachments => generated 188 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 02:44:27.525143 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1e40d90a-f792-4978-902f-b449d62219a7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:27.525767 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1e40d90a-f792-4978-902f-b449d62219a7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:27.547442 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1e40d90a-f792-4978-902f-b449d62219a7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:27.552625 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1e40d90a-f792-4978-902f-b449d62219a7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:27.555745 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1e40d90a-f792-4978-902f-b449d62219a7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:27.555745 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1e40d90a-f792-4978-902f-b449d62219a7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:28.437927 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1e40d90a-f792-4978-902f-b449d62219a7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "DELETE /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270/os-volume_attachments/2a64f5b9-8027-4a36-ac09-2a1da81a1037" status: 202 len: 0 microversion: 2.20 time: 0.917523 Jul 18 02:44:28.439039 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2148/4306] 10.222.0.57 () {60 vars in 1456 bytes} [Mon Jul 18 02:44:27 2022] DELETE /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270/os-volume_attachments/2a64f5b9-8027-4a36-ac09-2a1da81a1037 => generated 0 bytes in 919 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:44:28.688458 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-35948a13-0c7d-4a00-9273-710eeb6a3bab tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:28.691174 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-35948a13-0c7d-4a00-9273-710eeb6a3bab tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:28.712969 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-35948a13-0c7d-4a00-9273-710eeb6a3bab tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:28.714253 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-35948a13-0c7d-4a00-9273-710eeb6a3bab tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:28.716048 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-35948a13-0c7d-4a00-9273-710eeb6a3bab tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:28.717243 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-35948a13-0c7d-4a00-9273-710eeb6a3bab tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:28.938028 n-d-465891-3 devstack@n-api.service[119543]: ERROR oslo.messaging._drivers.impl_rabbit [None req-35948a13-0c7d-4a00-9273-710eeb6a3bab tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [b2893d04-05b6-4e6b-bff9-dfc603076094] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 02:44:29.950236 n-d-465891-3 devstack@n-api.service[119543]: INFO oslo.messaging._drivers.impl_rabbit [None req-35948a13-0c7d-4a00-9273-710eeb6a3bab tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [b2893d04-05b6-4e6b-bff9-dfc603076094] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 53446. Jul 18 02:44:29.972798 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-35948a13-0c7d-4a00-9273-710eeb6a3bab tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "POST /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270/action" status: 202 len: 0 microversion: 2.20 time: 1.299567 Jul 18 02:44:29.986748 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2159/4307] 10.222.0.57 () {62 vars in 1318 bytes} [Mon Jul 18 02:44:28 2022] POST /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270/action => generated 0 bytes in 1319 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:44:29.993091 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1afe2876-930a-4d12-ad9b-17609c396336 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:30.007155 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1afe2876-930a-4d12-ad9b-17609c396336 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:30.041099 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1afe2876-930a-4d12-ad9b-17609c396336 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:30.041932 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1afe2876-930a-4d12-ad9b-17609c396336 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:30.043528 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1afe2876-930a-4d12-ad9b-17609c396336 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:30.044244 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1afe2876-930a-4d12-ad9b-17609c396336 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:30.501985 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1afe2876-930a-4d12-ad9b-17609c396336 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:30.572647 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1afe2876-930a-4d12-ad9b-17609c396336 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:30.576204 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1afe2876-930a-4d12-ad9b-17609c396336 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:30.601637 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1afe2876-930a-4d12-ad9b-17609c396336 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1673 microversion: 2.20 time: 0.615102 Jul 18 02:44:30.609580 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2149/4308] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:29 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1673 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:31.647062 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-55746bb1-da04-47bb-a0a0-3d0837645b79 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:31.649283 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-55746bb1-da04-47bb-a0a0-3d0837645b79 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:31.696831 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-55746bb1-da04-47bb-a0a0-3d0837645b79 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:31.697353 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-55746bb1-da04-47bb-a0a0-3d0837645b79 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:31.702255 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-55746bb1-da04-47bb-a0a0-3d0837645b79 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:31.702255 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-55746bb1-da04-47bb-a0a0-3d0837645b79 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:32.379520 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-55746bb1-da04-47bb-a0a0-3d0837645b79 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:32.436715 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-55746bb1-da04-47bb-a0a0-3d0837645b79 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:32.443450 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-55746bb1-da04-47bb-a0a0-3d0837645b79 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:32.444956 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-55746bb1-da04-47bb-a0a0-3d0837645b79 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1673 microversion: 2.20 time: 0.805051 Jul 18 02:44:32.446011 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2160/4309] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:31 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1673 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:33.478632 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c0b1d058-00ee-4fe6-9fa0-56329676bb84 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:33.479607 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c0b1d058-00ee-4fe6-9fa0-56329676bb84 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:33.498370 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c0b1d058-00ee-4fe6-9fa0-56329676bb84 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:33.499849 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c0b1d058-00ee-4fe6-9fa0-56329676bb84 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:33.504556 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c0b1d058-00ee-4fe6-9fa0-56329676bb84 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:33.506647 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c0b1d058-00ee-4fe6-9fa0-56329676bb84 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:34.402953 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c0b1d058-00ee-4fe6-9fa0-56329676bb84 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:34.433914 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c0b1d058-00ee-4fe6-9fa0-56329676bb84 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:34.437636 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c0b1d058-00ee-4fe6-9fa0-56329676bb84 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:34.448684 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c0b1d058-00ee-4fe6-9fa0-56329676bb84 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1673 microversion: 2.20 time: 0.974298 Jul 18 02:44:34.450024 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2150/4310] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:33 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1673 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:35.479466 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-da595fae-16e0-4ea4-ad63-f0ac8a882a7d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:35.480862 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-da595fae-16e0-4ea4-ad63-f0ac8a882a7d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:35.515363 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-da595fae-16e0-4ea4-ad63-f0ac8a882a7d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:35.517368 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-da595fae-16e0-4ea4-ad63-f0ac8a882a7d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:35.520369 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-da595fae-16e0-4ea4-ad63-f0ac8a882a7d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:35.522921 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-da595fae-16e0-4ea4-ad63-f0ac8a882a7d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:36.144036 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-da595fae-16e0-4ea4-ad63-f0ac8a882a7d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:36.155137 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-da595fae-16e0-4ea4-ad63-f0ac8a882a7d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:36.160322 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-da595fae-16e0-4ea4-ad63-f0ac8a882a7d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:36.161644 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-da595fae-16e0-4ea4-ad63-f0ac8a882a7d tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1673 microversion: 2.20 time: 0.691737 Jul 18 02:44:36.178004 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2161/4311] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:35 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1673 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:37.186938 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9452a1ce-513e-45ba-ab92-728eec5fc7b6 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:37.188423 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9452a1ce-513e-45ba-ab92-728eec5fc7b6 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:37.226164 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9452a1ce-513e-45ba-ab92-728eec5fc7b6 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:37.226659 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9452a1ce-513e-45ba-ab92-728eec5fc7b6 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:37.227487 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9452a1ce-513e-45ba-ab92-728eec5fc7b6 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:37.227934 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9452a1ce-513e-45ba-ab92-728eec5fc7b6 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:38.069763 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9452a1ce-513e-45ba-ab92-728eec5fc7b6 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:38.119215 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9452a1ce-513e-45ba-ab92-728eec5fc7b6 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:38.124669 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9452a1ce-513e-45ba-ab92-728eec5fc7b6 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:38.131694 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9452a1ce-513e-45ba-ab92-728eec5fc7b6 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1673 microversion: 2.20 time: 0.952614 Jul 18 02:44:38.142032 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2151/4312] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:37 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1673 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:39.162612 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f19d1fee-932e-4a52-86f7-6b9c2340d8b3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:39.163345 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f19d1fee-932e-4a52-86f7-6b9c2340d8b3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:39.200272 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f19d1fee-932e-4a52-86f7-6b9c2340d8b3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:39.202326 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f19d1fee-932e-4a52-86f7-6b9c2340d8b3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:39.207665 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f19d1fee-932e-4a52-86f7-6b9c2340d8b3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:39.208800 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f19d1fee-932e-4a52-86f7-6b9c2340d8b3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:40.136781 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f19d1fee-932e-4a52-86f7-6b9c2340d8b3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:40.158180 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f19d1fee-932e-4a52-86f7-6b9c2340d8b3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:40.163396 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f19d1fee-932e-4a52-86f7-6b9c2340d8b3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:40.175467 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f19d1fee-932e-4a52-86f7-6b9c2340d8b3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1731 microversion: 2.20 time: 1.016366 Jul 18 02:44:40.191067 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2162/4313] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:39 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1731 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:41.203797 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-11501eee-611f-4413-899f-0cf090300a8b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:41.206440 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-11501eee-611f-4413-899f-0cf090300a8b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:41.227955 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-11501eee-611f-4413-899f-0cf090300a8b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:41.231384 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-11501eee-611f-4413-899f-0cf090300a8b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:41.236525 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-11501eee-611f-4413-899f-0cf090300a8b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:41.237498 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-11501eee-611f-4413-899f-0cf090300a8b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:42.931810 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-11501eee-611f-4413-899f-0cf090300a8b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:42.977880 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-11501eee-611f-4413-899f-0cf090300a8b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:42.983607 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-11501eee-611f-4413-899f-0cf090300a8b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:42.988156 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-11501eee-611f-4413-899f-0cf090300a8b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1731 microversion: 2.20 time: 1.788198 Jul 18 02:44:42.991204 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2152/4314] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:41 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1731 bytes in 1795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:44.020318 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-dac07667-f5c1-466a-ae8b-87a2411796da tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:44.021751 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-dac07667-f5c1-466a-ae8b-87a2411796da tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:44.038419 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dac07667-f5c1-466a-ae8b-87a2411796da tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:44.039126 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dac07667-f5c1-466a-ae8b-87a2411796da tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:44.040131 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dac07667-f5c1-466a-ae8b-87a2411796da tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:44.042794 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dac07667-f5c1-466a-ae8b-87a2411796da tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:44.094229 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-cb7944fe-fe9f-4ec1-b382-fef29360be1d req-32775c87-9039-46ea-8898-5cf221d49d85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "136d1a82-a525-4ff4-860d-31c37c826270", "tag": "16123f42-6b11-41ec-a212-278fc525a448"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:44.132677 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-cb7944fe-fe9f-4ec1-b382-fef29360be1d req-32775c87-9039-46ea-8898-5cf221d49d85 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:44.134380 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-cb7944fe-fe9f-4ec1-b382-fef29360be1d req-32775c87-9039-46ea-8898-5cf221d49d85 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:44.227282 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-cb7944fe-fe9f-4ec1-b382-fef29360be1d req-32775c87-9039-46ea-8898-5cf221d49d85 service nova] Creating event network-changed:16123f42-6b11-41ec-a212-278fc525a448 for instance 136d1a82-a525-4ff4-860d-31c37c826270 on n-h2-465891-3 Jul 18 02:44:44.271654 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-cb7944fe-fe9f-4ec1-b382-fef29360be1d req-32775c87-9039-46ea-8898-5cf221d49d85 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.569510 Jul 18 02:44:44.280785 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2163/4315] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:44:44.717493 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-dac07667-f5c1-466a-ae8b-87a2411796da tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:44.739634 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-dac07667-f5c1-466a-ae8b-87a2411796da tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:44.743486 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-dac07667-f5c1-466a-ae8b-87a2411796da tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:44.752507 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-dac07667-f5c1-466a-ae8b-87a2411796da tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1731 microversion: 2.20 time: 0.736090 Jul 18 02:44:44.799592 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2153/4316] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:44 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1731 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:45.820523 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0bdbf7e1-a0ec-4088-9af4-bcfa5aa5b683 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:45.825894 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0bdbf7e1-a0ec-4088-9af4-bcfa5aa5b683 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:45.874804 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0bdbf7e1-a0ec-4088-9af4-bcfa5aa5b683 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:45.881661 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0bdbf7e1-a0ec-4088-9af4-bcfa5aa5b683 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:45.885164 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0bdbf7e1-a0ec-4088-9af4-bcfa5aa5b683 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:45.888620 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0bdbf7e1-a0ec-4088-9af4-bcfa5aa5b683 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:47.859735 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0bdbf7e1-a0ec-4088-9af4-bcfa5aa5b683 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:47.909014 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0bdbf7e1-a0ec-4088-9af4-bcfa5aa5b683 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:47.912533 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0bdbf7e1-a0ec-4088-9af4-bcfa5aa5b683 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:47.916593 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0bdbf7e1-a0ec-4088-9af4-bcfa5aa5b683 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1731 microversion: 2.20 time: 2.105271 Jul 18 02:44:47.943211 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2164/4317] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:45 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1731 bytes in 2133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:48.950712 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d8cb6b19-9995-4a83-bc80-7d8bab8841f0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:48.951797 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d8cb6b19-9995-4a83-bc80-7d8bab8841f0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:48.983399 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=20 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:49.022560 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d8cb6b19-9995-4a83-bc80-7d8bab8841f0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:49.036547 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d8cb6b19-9995-4a83-bc80-7d8bab8841f0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:49.041523 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d8cb6b19-9995-4a83-bc80-7d8bab8841f0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:49.057079 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d8cb6b19-9995-4a83-bc80-7d8bab8841f0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:50.272471 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d8cb6b19-9995-4a83-bc80-7d8bab8841f0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:50.296251 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e6374ed8-d342-42d0-95f2-2a0ae388a3f9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1498471259", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "ca05c1ce-c949-4f69-b4cd-bdb4d6611509"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:50.333917 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d8cb6b19-9995-4a83-bc80-7d8bab8841f0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:50.338471 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d8cb6b19-9995-4a83-bc80-7d8bab8841f0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:50.341006 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d8cb6b19-9995-4a83-bc80-7d8bab8841f0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1731 microversion: 2.20 time: 1.400571 Jul 18 02:44:50.350499 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2154/4318] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:48 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1731 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:50.668277 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-e6374ed8-d342-42d0-95f2-2a0ae388a3f9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] validate_networks() for [('ca05c1ce-c949-4f69-b4cd-bdb4d6611509', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:44:51.393216 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f3dcb431-35b7-422e-adca-f6a88acd9e5b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:51.405265 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f3dcb431-35b7-422e-adca-f6a88acd9e5b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:51.459346 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f3dcb431-35b7-422e-adca-f6a88acd9e5b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:51.462913 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f3dcb431-35b7-422e-adca-f6a88acd9e5b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:51.467337 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f3dcb431-35b7-422e-adca-f6a88acd9e5b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:51.472775 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f3dcb431-35b7-422e-adca-f6a88acd9e5b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:51.595044 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:52.512904 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f3dcb431-35b7-422e-adca-f6a88acd9e5b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:52.570785 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f3dcb431-35b7-422e-adca-f6a88acd9e5b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:52.572896 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f3dcb431-35b7-422e-adca-f6a88acd9e5b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:52.574470 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f3dcb431-35b7-422e-adca-f6a88acd9e5b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1731 microversion: 2.20 time: 1.202051 Jul 18 02:44:52.575459 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2155/4319] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:51 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1731 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:53.614284 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d62fbf36-acac-4e1d-b4b4-ec9bc627fbf3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:53.615029 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d62fbf36-acac-4e1d-b4b4-ec9bc627fbf3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:53.635715 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d62fbf36-acac-4e1d-b4b4-ec9bc627fbf3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:53.646700 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d62fbf36-acac-4e1d-b4b4-ec9bc627fbf3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:53.651777 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d62fbf36-acac-4e1d-b4b4-ec9bc627fbf3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:53.655451 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d62fbf36-acac-4e1d-b4b4-ec9bc627fbf3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:56.423045 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d62fbf36-acac-4e1d-b4b4-ec9bc627fbf3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:56.483887 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d62fbf36-acac-4e1d-b4b4-ec9bc627fbf3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:56.496784 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d62fbf36-acac-4e1d-b4b4-ec9bc627fbf3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:56.500437 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d62fbf36-acac-4e1d-b4b4-ec9bc627fbf3 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1731 microversion: 2.20 time: 2.891483 Jul 18 02:44:56.512082 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2156/4320] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:53 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1731 bytes in 2906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:44:56.577402 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-e6374ed8-d342-42d0-95f2-2a0ae388a3f9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:44:56.579158 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-e6374ed8-d342-42d0-95f2-2a0ae388a3f9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:44:56.580276 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-e6374ed8-d342-42d0-95f2-2a0ae388a3f9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:44:56.581288 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-e6374ed8-d342-42d0-95f2-2a0ae388a3f9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:44:56.582429 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-e6374ed8-d342-42d0-95f2-2a0ae388a3f9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:44:56.601250 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=20 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:56.637177 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e6374ed8-d342-42d0-95f2-2a0ae388a3f9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:56.643967 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e6374ed8-d342-42d0-95f2-2a0ae388a3f9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:56.652472 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e6374ed8-d342-42d0-95f2-2a0ae388a3f9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:56.653538 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e6374ed8-d342-42d0-95f2-2a0ae388a3f9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:56.673172 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=65,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:56.687581 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-e6374ed8-d342-42d0-95f2-2a0ae388a3f9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Getting quotas for project fcdf9bfc7a9d4e45acebe3c362787290. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:44:56.697891 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-e6374ed8-d342-42d0-95f2-2a0ae388a3f9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Getting quotas for user dc0bfd8ccc564f119014fceb1c9ad8ad and project fcdf9bfc7a9d4e45acebe3c362787290. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:44:56.716305 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e6374ed8-d342-42d0-95f2-2a0ae388a3f9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:44:56.723060 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e6374ed8-d342-42d0-95f2-2a0ae388a3f9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:44:56.832061 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e6374ed8-d342-42d0-95f2-2a0ae388a3f9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.064279 Jul 18 02:44:56.837743 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2165/4321] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:44:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 7073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:44:56.861257 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a72c538f-8444-4492-a867-14232187448c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:56.870032 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a72c538f-8444-4492-a867-14232187448c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:57.262035 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a72c538f-8444-4492-a867-14232187448c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:57.305213 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a72c538f-8444-4492-a867-14232187448c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1218 microversion: 2.1 time: 0.449660 Jul 18 02:44:57.310368 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2157/4322] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:56 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1218 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:44:57.553522 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6dc9b009-c272-47ab-a17d-f74145758365 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:57.555532 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6dc9b009-c272-47ab-a17d-f74145758365 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:57.586697 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6dc9b009-c272-47ab-a17d-f74145758365 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:57.591937 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6dc9b009-c272-47ab-a17d-f74145758365 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:57.600600 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6dc9b009-c272-47ab-a17d-f74145758365 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:57.601627 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6dc9b009-c272-47ab-a17d-f74145758365 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:58.115396 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6dc9b009-c272-47ab-a17d-f74145758365 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:58.132941 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6dc9b009-c272-47ab-a17d-f74145758365 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:58.141036 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6dc9b009-c272-47ab-a17d-f74145758365 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:58.143090 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6dc9b009-c272-47ab-a17d-f74145758365 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1731 microversion: 2.20 time: 0.596647 Jul 18 02:44:58.155320 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2166/4323] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:57 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1731 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:44:58.331822 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-af38506e-6b7d-4501-9d3b-1512c9346736 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:58.337520 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-af38506e-6b7d-4501-9d3b-1512c9346736 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:58.783183 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-af38506e-6b7d-4501-9d3b-1512c9346736 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:58.856997 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-af38506e-6b7d-4501-9d3b-1512c9346736 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1218 microversion: 2.1 time: 0.532382 Jul 18 02:44:58.857841 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2158/4324] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:58 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1218 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:59.171107 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ea3f614b-3abd-462e-be81-d959fc17cb4f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:59.172473 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ea3f614b-3abd-462e-be81-d959fc17cb4f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:59.231610 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ea3f614b-3abd-462e-be81-d959fc17cb4f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:59.234750 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ea3f614b-3abd-462e-be81-d959fc17cb4f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:59.236248 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ea3f614b-3abd-462e-be81-d959fc17cb4f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:59.241439 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ea3f614b-3abd-462e-be81-d959fc17cb4f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:59.755172 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ea3f614b-3abd-462e-be81-d959fc17cb4f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:59.779668 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ea3f614b-3abd-462e-be81-d959fc17cb4f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:59.814924 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ea3f614b-3abd-462e-be81-d959fc17cb4f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:59.820123 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ea3f614b-3abd-462e-be81-d959fc17cb4f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1731 microversion: 2.20 time: 0.653787 Jul 18 02:44:59.835708 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2167/4325] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:59 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1731 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:59.893280 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fcb51099-c8b4-4885-8cb7-2f5099b8247d tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:59.896435 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fcb51099-c8b4-4885-8cb7-2f5099b8247d tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:00.020883 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fcb51099-c8b4-4885-8cb7-2f5099b8247d tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:00.021648 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fcb51099-c8b4-4885-8cb7-2f5099b8247d tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:00.062628 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fcb51099-c8b4-4885-8cb7-2f5099b8247d tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:00.063383 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fcb51099-c8b4-4885-8cb7-2f5099b8247d tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:00.745229 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fcb51099-c8b4-4885-8cb7-2f5099b8247d tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:00.787269 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fcb51099-c8b4-4885-8cb7-2f5099b8247d tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1270 microversion: 2.1 time: 0.900765 Jul 18 02:45:00.819810 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2159/4326] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:59 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1270 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:00.858757 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-748c3d7f-f145-488f-aff8-6b4c7c0cd0cd tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:00.859973 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-748c3d7f-f145-488f-aff8-6b4c7c0cd0cd tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:00.892027 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-748c3d7f-f145-488f-aff8-6b4c7c0cd0cd tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:00.896827 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-748c3d7f-f145-488f-aff8-6b4c7c0cd0cd tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:00.903853 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-748c3d7f-f145-488f-aff8-6b4c7c0cd0cd tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:00.905231 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-748c3d7f-f145-488f-aff8-6b4c7c0cd0cd tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:01.829585 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1b63f31e-15ed-43d4-bb25-bd6b3810b73b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:01.837285 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1b63f31e-15ed-43d4-bb25-bd6b3810b73b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:01.912525 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1b63f31e-15ed-43d4-bb25-bd6b3810b73b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:01.931732 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1b63f31e-15ed-43d4-bb25-bd6b3810b73b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:01.935884 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1b63f31e-15ed-43d4-bb25-bd6b3810b73b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:01.939314 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1b63f31e-15ed-43d4-bb25-bd6b3810b73b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:01.992327 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-748c3d7f-f145-488f-aff8-6b4c7c0cd0cd tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:02.065562 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-748c3d7f-f145-488f-aff8-6b4c7c0cd0cd tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:02.104149 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-748c3d7f-f145-488f-aff8-6b4c7c0cd0cd tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:02.116186 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-748c3d7f-f145-488f-aff8-6b4c7c0cd0cd tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1731 microversion: 2.20 time: 1.260817 Jul 18 02:45:02.149090 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2168/4327] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:45:00 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1731 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:45:02.609043 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1b63f31e-15ed-43d4-bb25-bd6b3810b73b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:02.683236 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1b63f31e-15ed-43d4-bb25-bd6b3810b73b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1276 microversion: 2.1 time: 0.841096 Jul 18 02:45:02.690248 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2160/4328] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:01 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1276 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:03.174767 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-17d4fdcd-dbbb-48f6-a392-4307ac198e59 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:03.179952 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-17d4fdcd-dbbb-48f6-a392-4307ac198e59 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:03.245748 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-17d4fdcd-dbbb-48f6-a392-4307ac198e59 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:03.248270 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-17d4fdcd-dbbb-48f6-a392-4307ac198e59 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:03.260500 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-17d4fdcd-dbbb-48f6-a392-4307ac198e59 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:03.264600 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-17d4fdcd-dbbb-48f6-a392-4307ac198e59 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:03.731624 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1f3c763a-b468-4e31-a584-b4e6ad5a1162 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:03.748351 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1f3c763a-b468-4e31-a584-b4e6ad5a1162 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:03.810445 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1f3c763a-b468-4e31-a584-b4e6ad5a1162 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:03.812920 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1f3c763a-b468-4e31-a584-b4e6ad5a1162 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:03.835847 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1f3c763a-b468-4e31-a584-b4e6ad5a1162 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:03.849094 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1f3c763a-b468-4e31-a584-b4e6ad5a1162 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:04.383031 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1f3c763a-b468-4e31-a584-b4e6ad5a1162 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:04.446362 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1f3c763a-b468-4e31-a584-b4e6ad5a1162 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1276 microversion: 2.1 time: 0.733567 Jul 18 02:45:04.462263 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2161/4329] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:03 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1276 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:04.594335 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-17d4fdcd-dbbb-48f6-a392-4307ac198e59 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:04.674793 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-17d4fdcd-dbbb-48f6-a392-4307ac198e59 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:04.721111 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-17d4fdcd-dbbb-48f6-a392-4307ac198e59 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:04.737377 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-17d4fdcd-dbbb-48f6-a392-4307ac198e59 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1731 microversion: 2.20 time: 1.584308 Jul 18 02:45:04.774303 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2169/4330] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:45:03 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1731 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:45:05.469350 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bbce8b1f-0d5e-41eb-9ea0-e6f83acbcc21 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:05.481086 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bbce8b1f-0d5e-41eb-9ea0-e6f83acbcc21 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:05.568352 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bbce8b1f-0d5e-41eb-9ea0-e6f83acbcc21 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:05.568817 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bbce8b1f-0d5e-41eb-9ea0-e6f83acbcc21 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:05.585408 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bbce8b1f-0d5e-41eb-9ea0-e6f83acbcc21 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:05.585910 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bbce8b1f-0d5e-41eb-9ea0-e6f83acbcc21 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:05.786585 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-36439a62-8df1-42a1-93a8-2f99dd195bd4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:05.794512 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-36439a62-8df1-42a1-93a8-2f99dd195bd4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:05.852237 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-36439a62-8df1-42a1-93a8-2f99dd195bd4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:05.854574 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-36439a62-8df1-42a1-93a8-2f99dd195bd4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:05.867365 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-36439a62-8df1-42a1-93a8-2f99dd195bd4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:05.868501 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-36439a62-8df1-42a1-93a8-2f99dd195bd4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:06.674218 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:06.710610 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:06.764180 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bbce8b1f-0d5e-41eb-9ea0-e6f83acbcc21 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:06.783178 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bbce8b1f-0d5e-41eb-9ea0-e6f83acbcc21 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1318 microversion: 2.1 time: 1.320832 Jul 18 02:45:06.789878 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2162/4331] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:05 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1318 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:45:07.298348 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-36439a62-8df1-42a1-93a8-2f99dd195bd4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:07.344741 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-36439a62-8df1-42a1-93a8-2f99dd195bd4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:07.363668 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-36439a62-8df1-42a1-93a8-2f99dd195bd4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:07.370974 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-36439a62-8df1-42a1-93a8-2f99dd195bd4 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1731 microversion: 2.20 time: 1.595557 Jul 18 02:45:07.380044 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2170/4332] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:45:05 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1731 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:45:07.822789 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0026d026-1942-404d-a094-eaa863404d00 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:07.836511 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0026d026-1942-404d-a094-eaa863404d00 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:07.906141 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0026d026-1942-404d-a094-eaa863404d00 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:07.922716 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0026d026-1942-404d-a094-eaa863404d00 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:07.924263 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0026d026-1942-404d-a094-eaa863404d00 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:07.925271 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0026d026-1942-404d-a094-eaa863404d00 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:08.412027 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-83a23e00-fa04-44a1-a94e-fcf6385f4bc2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:08.419440 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-83a23e00-fa04-44a1-a94e-fcf6385f4bc2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:08.462667 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-83a23e00-fa04-44a1-a94e-fcf6385f4bc2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:08.463858 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-83a23e00-fa04-44a1-a94e-fcf6385f4bc2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:08.466787 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-83a23e00-fa04-44a1-a94e-fcf6385f4bc2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:08.468027 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-83a23e00-fa04-44a1-a94e-fcf6385f4bc2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:08.844099 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:09.391001 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-83a23e00-fa04-44a1-a94e-fcf6385f4bc2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:09.402344 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0026d026-1942-404d-a094-eaa863404d00 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:09.407606 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-83a23e00-fa04-44a1-a94e-fcf6385f4bc2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:09.418446 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0026d026-1942-404d-a094-eaa863404d00 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1318 microversion: 2.1 time: 1.604794 Jul 18 02:45:09.420535 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2163/4333] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:07 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1318 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:09.424687 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-83a23e00-fa04-44a1-a94e-fcf6385f4bc2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:09.442673 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-83a23e00-fa04-44a1-a94e-fcf6385f4bc2 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1731 microversion: 2.20 time: 1.033197 Jul 18 02:45:09.446863 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2171/4334] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:45:08 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1731 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:45:10.462298 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4f2155a3-c23c-4f3b-9604-32947a8d2799 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:10.469956 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-eb95a262-ba09-4acb-8f08-aaf58da2be06 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:10.471027 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4f2155a3-c23c-4f3b-9604-32947a8d2799 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:10.482257 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-eb95a262-ba09-4acb-8f08-aaf58da2be06 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:10.530145 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eb95a262-ba09-4acb-8f08-aaf58da2be06 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:10.531734 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4f2155a3-c23c-4f3b-9604-32947a8d2799 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:10.532490 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4f2155a3-c23c-4f3b-9604-32947a8d2799 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:10.551515 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eb95a262-ba09-4acb-8f08-aaf58da2be06 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:10.561035 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4f2155a3-c23c-4f3b-9604-32947a8d2799 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:10.567942 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4f2155a3-c23c-4f3b-9604-32947a8d2799 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:10.580709 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eb95a262-ba09-4acb-8f08-aaf58da2be06 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:10.582700 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eb95a262-ba09-4acb-8f08-aaf58da2be06 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:13.270497 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4f2155a3-c23c-4f3b-9604-32947a8d2799 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:13.278877 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4f2155a3-c23c-4f3b-9604-32947a8d2799 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1318 microversion: 2.1 time: 2.843164 Jul 18 02:45:13.285467 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2164/4335] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:10 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1318 bytes in 2851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:13.306173 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-785bbcaa-f90a-4ce0-8a42-e507bc60388d tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:13.306870 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-785bbcaa-f90a-4ce0-8a42-e507bc60388d tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:13.314131 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-785bbcaa-f90a-4ce0-8a42-e507bc60388d tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:13.314504 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-785bbcaa-f90a-4ce0-8a42-e507bc60388d tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:13.322554 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-785bbcaa-f90a-4ce0-8a42-e507bc60388d tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:13.323025 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-785bbcaa-f90a-4ce0-8a42-e507bc60388d tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:13.402320 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-785bbcaa-f90a-4ce0-8a42-e507bc60388d tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1/ips" status: 200 len: 149 microversion: 2.1 time: 0.110492 Jul 18 02:45:13.403169 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2165/4336] 10.222.0.57 () {58 vars in 1247 bytes} [Mon Jul 18 02:45:13 2022] GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1/ips => generated 149 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:45:13.423351 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1780636b-b840-4716-b055-aef6ce35a4e8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68686067-14ae-4949-8d63-0db66855fcc7"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:45:13.424585 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1780636b-b840-4716-b055-aef6ce35a4e8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:13.456848 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1780636b-b840-4716-b055-aef6ce35a4e8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:13.457651 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1780636b-b840-4716-b055-aef6ce35a4e8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:13.458542 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1780636b-b840-4716-b055-aef6ce35a4e8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:13.458990 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1780636b-b840-4716-b055-aef6ce35a4e8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:13.515295 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-eb95a262-ba09-4acb-8f08-aaf58da2be06 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:13.551896 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-eb95a262-ba09-4acb-8f08-aaf58da2be06 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:13.573470 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-eb95a262-ba09-4acb-8f08-aaf58da2be06 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:13.577603 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-eb95a262-ba09-4acb-8f08-aaf58da2be06 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1731 microversion: 2.20 time: 3.113408 Jul 18 02:45:13.591187 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2172/4337] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:45:10 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1731 bytes in 3130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:45:13.615319 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-1780636b-b840-4716-b055-aef6ce35a4e8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] HTTP exception thrown: Invalid volume: volume 68686067-14ae-4949-8d63-0db66855fcc7 is already attached to instances: 3aa190fe-c088-40db-8267-e574e0002a03 Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1780636b-b840-4716-b055-aef6ce35a4e8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Request method failure captured: Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1/os-volume_attachments HTTP/1.1 Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 74 Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MhfM0UyOyoMgRP_1BgsB5GQEFaLnp85satKIE74LtU4aati7wjZItAybGxqrHGu9HKZ07IOl-ghvuL-XVY7iiNLxZrz8uz6pnetXMm39fDBZo0QiKDc9Xu-2OCp3obDb_4yxslV3N-dd0oIabggtRNHi18D28MbZyTc-9xFAnMfxLs Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 8fa714ec7f5a4af0a33f56b45e999a7a Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-AttachVolumeNegativeTest-683705837 Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8fa714ec7f5a4af0a33f56b45e999a7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fa714ec7f5a4af0a33f56b45e999a7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fa714ec7f5a4af0a33f56b45e999a7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8fa714ec7f5a4af0a33f56b45e999a7a"}]}] Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-AttachVolumeNegativeTest-683705837 Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 8fa714ec7f5a4af0a33f56b45e999a7a Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-683705837 Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-AttachVolumeNegativeTest-683705837-project Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 1be686f2aa93473585ca064041bd8140 Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-AttachVolumeNegativeTest-683705837-project Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: {"volumeAttachment": {"volumeId": "68686067-14ae-4949-8d63-0db66855fcc7"}} Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: exception: Invalid volume: volume 68686067-14ae-4949-8d63-0db66855fcc7 is already attached to instances: 3aa190fe-c088-40db-8267-e574e0002a03 Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'server_id': 'b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1', 'body': {'volumeAttachment': {'volumeId': '68686067-14ae-4949-8d63-0db66855fcc7'}}} Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 68686067-14ae-4949-8d63-0db66855fcc7 is already attached to instances: 3aa190fe-c088-40db-8267-e574e0002a03 Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:45:13.617634 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:45:13.621579 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:45:13.621579 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:45:13.621579 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 18 02:45:13.621579 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 02:45:13.621579 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 68686067-14ae-4949-8d63-0db66855fcc7 is already attached to instances: 3aa190fe-c088-40db-8267-e574e0002a03 Jul 18 02:45:13.621579 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:45:13.621579 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:45:13.621579 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:45:13.621579 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:45:13.621579 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:45:13.621579 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:45:13.621579 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:45:13.621579 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:45:13.621579 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 68686067-14ae-4949-8d63-0db66855fcc7 is already attached to instances: 3aa190fe-c088-40db-8267-e574e0002a03 Jul 18 02:45:13.621579 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:45:13.626360 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1780636b-b840-4716-b055-aef6ce35a4e8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Returning 400 to user: Invalid volume: volume 68686067-14ae-4949-8d63-0db66855fcc7 is already attached to instances: 3aa190fe-c088-40db-8267-e574e0002a03 {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:45:13.627825 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1780636b-b840-4716-b055-aef6ce35a4e8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "POST /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.208704 Jul 18 02:45:13.630009 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2166/4338] 10.222.0.57 () {60 vars in 1322 bytes} [Mon Jul 18 02:45:13 2022] POST /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1/os-volume_attachments => generated 174 bytes in 211 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:45:13.639458 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c6842f1c-3154-4a8e-868f-2e9d9df2ca65 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:13.640479 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c6842f1c-3154-4a8e-868f-2e9d9df2ca65 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:13.654878 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c6842f1c-3154-4a8e-868f-2e9d9df2ca65 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:13.671500 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c6842f1c-3154-4a8e-868f-2e9d9df2ca65 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:13.679693 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c6842f1c-3154-4a8e-868f-2e9d9df2ca65 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:13.687786 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c6842f1c-3154-4a8e-868f-2e9d9df2ca65 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:13.748447 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c6842f1c-3154-4a8e-868f-2e9d9df2ca65 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:45:14.045895 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c6842f1c-3154-4a8e-868f-2e9d9df2ca65 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1" status: 204 len: 0 microversion: 2.1 time: 0.410665 Jul 18 02:45:14.050695 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2173/4339] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:45:13 2022] DELETE /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:45:14.060561 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4159a0ad-5c73-4881-9f0d-42af398387d9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:14.061968 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4159a0ad-5c73-4881-9f0d-42af398387d9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:14.099328 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4159a0ad-5c73-4881-9f0d-42af398387d9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:14.101017 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4159a0ad-5c73-4881-9f0d-42af398387d9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:14.105016 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4159a0ad-5c73-4881-9f0d-42af398387d9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:14.109745 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4159a0ad-5c73-4881-9f0d-42af398387d9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:14.187826 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-3584f046-7db2-4e52-b239-6baea248bf65 req-b8ca59b0-56b7-4f10-afa1-444b71774b77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5681a932-b6a9-4c1f-8797-69655e66927e", "tag": "97271a32-ec26-4a51-9a97-19f528a9ec9c"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:45:14.206194 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-3584f046-7db2-4e52-b239-6baea248bf65 req-b8ca59b0-56b7-4f10-afa1-444b71774b77 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:14.220270 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-3584f046-7db2-4e52-b239-6baea248bf65 req-b8ca59b0-56b7-4f10-afa1-444b71774b77 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:14.292636 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-3584f046-7db2-4e52-b239-6baea248bf65 req-b8ca59b0-56b7-4f10-afa1-444b71774b77 service nova] Creating event network-changed:97271a32-ec26-4a51-9a97-19f528a9ec9c for instance 5681a932-b6a9-4c1f-8797-69655e66927e on n-h1-465891-3 Jul 18 02:45:14.310028 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-3584f046-7db2-4e52-b239-6baea248bf65 req-b8ca59b0-56b7-4f10-afa1-444b71774b77 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122266 Jul 18 02:45:14.314785 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2174/4340] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:45:14.353754 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2997386c-def4-408c-8ba6-99483d686fe0 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:14.358250 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2997386c-def4-408c-8ba6-99483d686fe0 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:14.392434 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2997386c-def4-408c-8ba6-99483d686fe0 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:14.397486 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2997386c-def4-408c-8ba6-99483d686fe0 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:14.424173 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2997386c-def4-408c-8ba6-99483d686fe0 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:14.428140 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2997386c-def4-408c-8ba6-99483d686fe0 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:14.977320 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4159a0ad-5c73-4881-9f0d-42af398387d9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:15.010366 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4159a0ad-5c73-4881-9f0d-42af398387d9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1" status: 200 len: 1678 microversion: 2.1 time: 0.956957 Jul 18 02:45:15.021053 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2167/4341] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:14 2022] GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 => generated 1678 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:15.026701 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bcded5a3-6041-40c7-8227-883478a1d506 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:15.032044 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bcded5a3-6041-40c7-8227-883478a1d506 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:15.046685 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bcded5a3-6041-40c7-8227-883478a1d506 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:15.047432 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bcded5a3-6041-40c7-8227-883478a1d506 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:15.052015 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bcded5a3-6041-40c7-8227-883478a1d506 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:15.053041 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bcded5a3-6041-40c7-8227-883478a1d506 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:15.368176 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2997386c-def4-408c-8ba6-99483d686fe0 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:15.397471 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2997386c-def4-408c-8ba6-99483d686fe0 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1318 microversion: 2.1 time: 1.075306 Jul 18 02:45:15.398994 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2175/4342] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:14 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1318 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:16.056751 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c9b081aa-d503-4fb1-8cf1-6edd76182959 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:16.070218 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c9b081aa-d503-4fb1-8cf1-6edd76182959 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:16.103969 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c9b081aa-d503-4fb1-8cf1-6edd76182959 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:16.104817 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c9b081aa-d503-4fb1-8cf1-6edd76182959 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:16.122675 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c9b081aa-d503-4fb1-8cf1-6edd76182959 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:16.123564 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c9b081aa-d503-4fb1-8cf1-6edd76182959 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:16.343777 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bcded5a3-6041-40c7-8227-883478a1d506 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:16.374712 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bcded5a3-6041-40c7-8227-883478a1d506 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:16.376330 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bcded5a3-6041-40c7-8227-883478a1d506 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:16.386152 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bcded5a3-6041-40c7-8227-883478a1d506 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1731 microversion: 2.20 time: 1.363274 Jul 18 02:45:16.386831 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2168/4343] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:45:15 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1731 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:45:16.416878 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2708d341-01f9-4e40-bcf3-eb1e63de76ad tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:16.417376 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2708d341-01f9-4e40-bcf3-eb1e63de76ad tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:16.430154 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2708d341-01f9-4e40-bcf3-eb1e63de76ad tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:16.430617 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2708d341-01f9-4e40-bcf3-eb1e63de76ad tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:16.431677 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2708d341-01f9-4e40-bcf3-eb1e63de76ad tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:16.432297 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2708d341-01f9-4e40-bcf3-eb1e63de76ad tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:18.125985 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c9b081aa-d503-4fb1-8cf1-6edd76182959 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:18.139924 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c9b081aa-d503-4fb1-8cf1-6edd76182959 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1" status: 200 len: 1678 microversion: 2.1 time: 2.091743 Jul 18 02:45:18.140542 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2176/4344] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:16 2022] GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 => generated 1678 bytes in 2094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:18.184039 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f0374dca-480d-42fa-b5b6-8cf59ecd277f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:18.185009 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f0374dca-480d-42fa-b5b6-8cf59ecd277f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:18.209286 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f0374dca-480d-42fa-b5b6-8cf59ecd277f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:18.210308 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f0374dca-480d-42fa-b5b6-8cf59ecd277f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:18.211375 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f0374dca-480d-42fa-b5b6-8cf59ecd277f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:18.212015 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f0374dca-480d-42fa-b5b6-8cf59ecd277f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:18.327024 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2708d341-01f9-4e40-bcf3-eb1e63de76ad tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:18.343141 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2708d341-01f9-4e40-bcf3-eb1e63de76ad tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1318 microversion: 2.1 time: 1.930345 Jul 18 02:45:18.353903 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2169/4345] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:16 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1318 bytes in 1932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:19.235603 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f0374dca-480d-42fa-b5b6-8cf59ecd277f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:19.251575 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f0374dca-480d-42fa-b5b6-8cf59ecd277f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:19.258022 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f0374dca-480d-42fa-b5b6-8cf59ecd277f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:19.264694 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f0374dca-480d-42fa-b5b6-8cf59ecd277f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1731 microversion: 2.20 time: 1.122248 Jul 18 02:45:19.267450 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2177/4346] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:45:18 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1731 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:45:19.303379 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8910d638-ac32-4f1c-8fd6-096122af378a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:19.307051 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8910d638-ac32-4f1c-8fd6-096122af378a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:19.362920 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8910d638-ac32-4f1c-8fd6-096122af378a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:19.366550 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8910d638-ac32-4f1c-8fd6-096122af378a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:19.368277 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8910d638-ac32-4f1c-8fd6-096122af378a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:19.368947 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8910d638-ac32-4f1c-8fd6-096122af378a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:19.905933 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-886f9318-e1c4-4573-9189-a52aa6b63fed req-3bae52a6-b840-4451-92be-c376dcd5cf87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1", "name": "network-vif-unplugged", "status": "completed", "tag": "6391c213-3d08-4f3e-a0ab-42a473c8990d"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:45:19.958742 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=36 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:19.971906 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-886f9318-e1c4-4573-9189-a52aa6b63fed req-3bae52a6-b840-4451-92be-c376dcd5cf87 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:19.976432 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-886f9318-e1c4-4573-9189-a52aa6b63fed req-3bae52a6-b840-4451-92be-c376dcd5cf87 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:20.072520 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-886f9318-e1c4-4573-9189-a52aa6b63fed req-3bae52a6-b840-4451-92be-c376dcd5cf87 service nova] Creating event network-vif-unplugged:6391c213-3d08-4f3e-a0ab-42a473c8990d for instance b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 on n-h1-465891-3 Jul 18 02:45:20.092672 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-886f9318-e1c4-4573-9189-a52aa6b63fed req-3bae52a6-b840-4451-92be-c376dcd5cf87 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 1.199633 Jul 18 02:45:20.096012 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2170/4347] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:45:20.104666 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-09af7c27-9a96-4f32-8873-2e9107825d7f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:20.120293 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-09af7c27-9a96-4f32-8873-2e9107825d7f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:20.142648 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-09af7c27-9a96-4f32-8873-2e9107825d7f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:20.146934 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-09af7c27-9a96-4f32-8873-2e9107825d7f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:20.150733 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-09af7c27-9a96-4f32-8873-2e9107825d7f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:20.151484 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-09af7c27-9a96-4f32-8873-2e9107825d7f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:21.085179 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8910d638-ac32-4f1c-8fd6-096122af378a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:21.130692 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8910d638-ac32-4f1c-8fd6-096122af378a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1" status: 200 len: 1678 microversion: 2.1 time: 1.850069 Jul 18 02:45:21.132955 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2178/4348] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:19 2022] GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 => generated 1678 bytes in 1859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:21.161857 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-87f73d1b-2ef9-4982-a71d-30190a2bbf7c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:21.162889 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-87f73d1b-2ef9-4982-a71d-30190a2bbf7c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:21.177245 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-87f73d1b-2ef9-4982-a71d-30190a2bbf7c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:21.178164 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-87f73d1b-2ef9-4982-a71d-30190a2bbf7c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:21.182806 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-87f73d1b-2ef9-4982-a71d-30190a2bbf7c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:21.183749 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-87f73d1b-2ef9-4982-a71d-30190a2bbf7c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:21.936746 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-09af7c27-9a96-4f32-8873-2e9107825d7f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:21.946159 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=82 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:21.975609 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-09af7c27-9a96-4f32-8873-2e9107825d7f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1318 microversion: 2.1 time: 1.876072 Jul 18 02:45:21.992258 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2171/4349] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:20 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1318 bytes in 1895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:22.142349 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-8bff0ae8-d071-46c8-8ba6-38bd188e70cc req-10206e84-d4e2-4ed9-a1e2-775e6a3035e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "136d1a82-a525-4ff4-860d-31c37c826270", "name": "network-vif-plugged", "status": "completed", "tag": "16123f42-6b11-41ec-a212-278fc525a448"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:45:22.158419 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-8bff0ae8-d071-46c8-8ba6-38bd188e70cc req-10206e84-d4e2-4ed9-a1e2-775e6a3035e4 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:22.158814 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-8bff0ae8-d071-46c8-8ba6-38bd188e70cc req-10206e84-d4e2-4ed9-a1e2-775e6a3035e4 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:22.187743 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-8bff0ae8-d071-46c8-8ba6-38bd188e70cc req-10206e84-d4e2-4ed9-a1e2-775e6a3035e4 service nova] Creating event network-vif-plugged:16123f42-6b11-41ec-a212-278fc525a448 for instance 136d1a82-a525-4ff4-860d-31c37c826270 on n-h2-465891-3 Jul 18 02:45:22.200116 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-8bff0ae8-d071-46c8-8ba6-38bd188e70cc req-10206e84-d4e2-4ed9-a1e2-775e6a3035e4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059626 Jul 18 02:45:22.200949 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2172/4350] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:45:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:45:22.207052 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6e6bd404-e490-48bd-83fc-570735061b73 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:22.207559 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6e6bd404-e490-48bd-83fc-570735061b73 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:22.219020 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6e6bd404-e490-48bd-83fc-570735061b73 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:22.219552 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6e6bd404-e490-48bd-83fc-570735061b73 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:22.220319 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6e6bd404-e490-48bd-83fc-570735061b73 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:22.220713 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6e6bd404-e490-48bd-83fc-570735061b73 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:22.299183 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-87f73d1b-2ef9-4982-a71d-30190a2bbf7c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:22.313250 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-87f73d1b-2ef9-4982-a71d-30190a2bbf7c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:22.318131 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-87f73d1b-2ef9-4982-a71d-30190a2bbf7c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:22.330757 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-87f73d1b-2ef9-4982-a71d-30190a2bbf7c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1731 microversion: 2.20 time: 1.193802 Jul 18 02:45:22.331700 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2179/4351] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:45:21 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1731 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:45:22.674318 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6e6bd404-e490-48bd-83fc-570735061b73 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:22.693136 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6e6bd404-e490-48bd-83fc-570735061b73 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1" status: 200 len: 1611 microversion: 2.1 time: 0.487580 Jul 18 02:45:22.694291 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2173/4352] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:22 2022] GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 => generated 1611 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:23.002792 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-107fc8d6-35a5-4a06-b7bb-bb0c62e75b42 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:23.004119 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-107fc8d6-35a5-4a06-b7bb-bb0c62e75b42 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:23.035874 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-107fc8d6-35a5-4a06-b7bb-bb0c62e75b42 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:23.039537 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-107fc8d6-35a5-4a06-b7bb-bb0c62e75b42 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:23.050148 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-107fc8d6-35a5-4a06-b7bb-bb0c62e75b42 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:23.052360 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-107fc8d6-35a5-4a06-b7bb-bb0c62e75b42 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:23.356619 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-455ea5eb-a5e3-4369-99bc-09e5c75a263b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:23.357489 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-455ea5eb-a5e3-4369-99bc-09e5c75a263b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:23.379397 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-455ea5eb-a5e3-4369-99bc-09e5c75a263b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:23.379756 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-455ea5eb-a5e3-4369-99bc-09e5c75a263b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:23.383325 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-455ea5eb-a5e3-4369-99bc-09e5c75a263b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:23.383803 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-455ea5eb-a5e3-4369-99bc-09e5c75a263b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:24.951874 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-455ea5eb-a5e3-4369-99bc-09e5c75a263b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:24.965333 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-455ea5eb-a5e3-4369-99bc-09e5c75a263b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:24.975441 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-107fc8d6-35a5-4a06-b7bb-bb0c62e75b42 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:24.979801 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-455ea5eb-a5e3-4369-99bc-09e5c75a263b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:24.991895 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-455ea5eb-a5e3-4369-99bc-09e5c75a263b tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1731 microversion: 2.20 time: 1.639357 Jul 18 02:45:24.996884 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-107fc8d6-35a5-4a06-b7bb-bb0c62e75b42 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1318 microversion: 2.1 time: 2.000441 Jul 18 02:45:25.006397 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2174/4353] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:45:23 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1731 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:45:25.009116 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2180/4354] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:22 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1318 bytes in 2014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:25.047018 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c5adab89-0b45-4064-bec0-66d41ae42d07 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:25.048495 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c5adab89-0b45-4064-bec0-66d41ae42d07 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:25.067819 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-2f0e17ac-6955-4b59-ba4e-906576e994d5 req-017420a8-a0f1-4696-9cf3-ddf07fafd038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1", "name": "network-vif-deleted", "tag": "6391c213-3d08-4f3e-a0ab-42a473c8990d"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:45:25.078959 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c5adab89-0b45-4064-bec0-66d41ae42d07 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:25.090702 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c5adab89-0b45-4064-bec0-66d41ae42d07 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:25.091766 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c5adab89-0b45-4064-bec0-66d41ae42d07 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:25.092689 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c5adab89-0b45-4064-bec0-66d41ae42d07 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:25.185436 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c5adab89-0b45-4064-bec0-66d41ae42d07 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:25.186452 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c5adab89-0b45-4064-bec0-66d41ae42d07 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:25.187485 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-c5adab89-0b45-4064-bec0-66d41ae42d07 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lazy-loading 'fault' on Instance uuid b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:45:25.188458 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-2f0e17ac-6955-4b59-ba4e-906576e994d5 req-017420a8-a0f1-4696-9cf3-ddf07fafd038 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:25.202913 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-2f0e17ac-6955-4b59-ba4e-906576e994d5 req-017420a8-a0f1-4696-9cf3-ddf07fafd038 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:25.329393 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-2f0e17ac-6955-4b59-ba4e-906576e994d5 req-017420a8-a0f1-4696-9cf3-ddf07fafd038 service nova] Creating event network-vif-deleted:6391c213-3d08-4f3e-a0ab-42a473c8990d for instance b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 on n-h1-465891-3 Jul 18 02:45:25.365365 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-2f0e17ac-6955-4b59-ba4e-906576e994d5 req-017420a8-a0f1-4696-9cf3-ddf07fafd038 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.351279 Jul 18 02:45:25.374025 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2181/4355] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:45:25.679106 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c5adab89-0b45-4064-bec0-66d41ae42d07 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:25.703005 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c5adab89-0b45-4064-bec0-66d41ae42d07 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1" status: 200 len: 1329 microversion: 2.1 time: 0.694754 Jul 18 02:45:25.710528 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2175/4356] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:25 2022] GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 => generated 1329 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:26.033928 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f4f2ad9a-d0e0-4399-90bc-644c6bae28c0 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:26.038133 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a9f8bd65-635c-49bc-b00b-aa52f549fca7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:26.039978 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f4f2ad9a-d0e0-4399-90bc-644c6bae28c0 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:26.048199 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a9f8bd65-635c-49bc-b00b-aa52f549fca7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:26.099307 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f4f2ad9a-d0e0-4399-90bc-644c6bae28c0 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:26.100043 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f4f2ad9a-d0e0-4399-90bc-644c6bae28c0 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:26.100908 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f4f2ad9a-d0e0-4399-90bc-644c6bae28c0 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:26.101471 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f4f2ad9a-d0e0-4399-90bc-644c6bae28c0 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:26.109364 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9f8bd65-635c-49bc-b00b-aa52f549fca7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:26.114775 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9f8bd65-635c-49bc-b00b-aa52f549fca7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:26.115892 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9f8bd65-635c-49bc-b00b-aa52f549fca7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:26.116711 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9f8bd65-635c-49bc-b00b-aa52f549fca7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:26.170079 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:27.821179 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f4f2ad9a-d0e0-4399-90bc-644c6bae28c0 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:27.836424 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f4f2ad9a-d0e0-4399-90bc-644c6bae28c0 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1318 microversion: 2.1 time: 1.805395 Jul 18 02:45:27.837444 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2176/4357] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:26 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1318 bytes in 1814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:27.845604 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1ec64bf0-9dae-449b-a216-d150d8a1c706 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:27.846254 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1ec64bf0-9dae-449b-a216-d150d8a1c706 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:27.866130 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ec64bf0-9dae-449b-a216-d150d8a1c706 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:27.866590 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ec64bf0-9dae-449b-a216-d150d8a1c706 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:27.871058 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ec64bf0-9dae-449b-a216-d150d8a1c706 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:27.881105 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a9f8bd65-635c-49bc-b00b-aa52f549fca7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:27.885182 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ec64bf0-9dae-449b-a216-d150d8a1c706 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:27.905969 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a9f8bd65-635c-49bc-b00b-aa52f549fca7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:27.905969 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a9f8bd65-635c-49bc-b00b-aa52f549fca7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:27.905969 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a9f8bd65-635c-49bc-b00b-aa52f549fca7 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1731 microversion: 2.20 time: 1.885092 Jul 18 02:45:27.929464 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2182/4358] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:45:26 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1731 bytes in 1919 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:45:27.970916 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-1ec64bf0-9dae-449b-a216-d150d8a1c706 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] HTTP exception thrown: Instance b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 could not be found. Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1ec64bf0-9dae-449b-a216-d150d8a1c706 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Request method failure captured: Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 HTTP/1.1 Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MhfM0UyOyoMgRP_1BgsB5GQEFaLnp85satKIE74LtU4aati7wjZItAybGxqrHGu9HKZ07IOl-ghvuL-XVY7iiNLxZrz8uz6pnetXMm39fDBZo0QiKDc9Xu-2OCp3obDb_4yxslV3N-dd0oIabggtRNHi18D28MbZyTc-9xFAnMfxLs Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 8fa714ec7f5a4af0a33f56b45e999a7a Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-AttachVolumeNegativeTest-683705837 Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8fa714ec7f5a4af0a33f56b45e999a7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fa714ec7f5a4af0a33f56b45e999a7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fa714ec7f5a4af0a33f56b45e999a7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8fa714ec7f5a4af0a33f56b45e999a7a"}]}] Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-AttachVolumeNegativeTest-683705837 Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 8fa714ec7f5a4af0a33f56b45e999a7a Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-683705837 Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-AttachVolumeNegativeTest-683705837-project Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 1be686f2aa93473585ca064041bd8140 Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-AttachVolumeNegativeTest-683705837-project Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 could not be found. Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1'} Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 could not be found. Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 could not be found. Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:45:27.983137 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:45:27.993971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:45:27.993971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:45:27.993971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:45:27.993971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:45:27.993971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:45:27.993971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 could not be found. Jul 18 02:45:27.993971 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:45:28.004908 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1ec64bf0-9dae-449b-a216-d150d8a1c706 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Returning 404 to user: Instance b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:45:28.011491 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1ec64bf0-9dae-449b-a216-d150d8a1c706 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1" status: 404 len: 111 microversion: 2.1 time: 0.172327 Jul 18 02:45:28.039223 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2177/4359] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:27 2022] GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 => generated 111 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:45:28.061990 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-78853749-74cb-4159-b184-a965e02f984c tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '.version_select at 0x7ff49b85ef70>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:28.086598 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:28.136651 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-78853749-74cb-4159-b184-a965e02f984c tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-410622744" status: 202 len: 0 microversion: 2.1 time: 0.103381 Jul 18 02:45:28.149148 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2183/4360] 10.222.0.57 () {58 vars in 1217 bytes} [Mon Jul 18 02:45:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-410622744 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:45:28.860941 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-466d97da-dc03-47a8-8e11-d2eb73746274 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:28.864972 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-466d97da-dc03-47a8-8e11-d2eb73746274 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:28.898231 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-466d97da-dc03-47a8-8e11-d2eb73746274 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:28.898695 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-466d97da-dc03-47a8-8e11-d2eb73746274 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:28.905196 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-466d97da-dc03-47a8-8e11-d2eb73746274 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:28.905738 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-466d97da-dc03-47a8-8e11-d2eb73746274 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:28.939908 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e5136317-208f-48a6-a0fd-76f8e9447261 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:28.946897 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e5136317-208f-48a6-a0fd-76f8e9447261 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:28.990586 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e5136317-208f-48a6-a0fd-76f8e9447261 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:28.991910 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e5136317-208f-48a6-a0fd-76f8e9447261 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:29.000494 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e5136317-208f-48a6-a0fd-76f8e9447261 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:29.001875 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e5136317-208f-48a6-a0fd-76f8e9447261 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:29.640541 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-466d97da-dc03-47a8-8e11-d2eb73746274 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:29.657040 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-466d97da-dc03-47a8-8e11-d2eb73746274 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1318 microversion: 2.1 time: 0.806151 Jul 18 02:45:29.670629 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2178/4361] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:28 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1318 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:29.886753 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e5136317-208f-48a6-a0fd-76f8e9447261 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:29.912733 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e5136317-208f-48a6-a0fd-76f8e9447261 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:29.917094 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e5136317-208f-48a6-a0fd-76f8e9447261 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:29.926369 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e5136317-208f-48a6-a0fd-76f8e9447261 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1718 microversion: 2.20 time: 1.010351 Jul 18 02:45:29.927662 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2184/4362] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:45:28 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1718 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:45:30.032718 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-794c0e6c-524c-433e-9df8-f48a98dc9dd9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:30.033584 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-794c0e6c-524c-433e-9df8-f48a98dc9dd9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 3aa190fe-c088-40db-8267-e574e0002a03] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:30.043803 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-794c0e6c-524c-433e-9df8-f48a98dc9dd9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:30.044262 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-794c0e6c-524c-433e-9df8-f48a98dc9dd9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:30.045439 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-794c0e6c-524c-433e-9df8-f48a98dc9dd9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:30.046086 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-794c0e6c-524c-433e-9df8-f48a98dc9dd9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:30.229338 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-794c0e6c-524c-433e-9df8-f48a98dc9dd9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lazy-loading 'services' on Instance uuid 3aa190fe-c088-40db-8267-e574e0002a03 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:45:30.418743 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-794c0e6c-524c-433e-9df8-f48a98dc9dd9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03/os-volume_attachments/68686067-14ae-4949-8d63-0db66855fcc7" status: 202 len: 0 microversion: 2.1 time: 0.390083 Jul 18 02:45:30.419380 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2179/4363] 10.222.0.57 () {58 vars in 1415 bytes} [Mon Jul 18 02:45:30 2022] DELETE /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03/os-volume_attachments/68686067-14ae-4949-8d63-0db66855fcc7 => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:45:30.432055 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f90d1775-9398-4d0b-90f0-fd4502678bef tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:30.432924 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f90d1775-9398-4d0b-90f0-fd4502678bef tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 3aa190fe-c088-40db-8267-e574e0002a03] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:30.450281 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f90d1775-9398-4d0b-90f0-fd4502678bef tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:30.454197 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f90d1775-9398-4d0b-90f0-fd4502678bef tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:30.456207 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f90d1775-9398-4d0b-90f0-fd4502678bef tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:30.456883 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f90d1775-9398-4d0b-90f0-fd4502678bef tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:30.597313 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f90d1775-9398-4d0b-90f0-fd4502678bef tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.168780 Jul 18 02:45:30.599047 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2185/4364] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:45:30 2022] GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:45:30.677981 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8a5cd4d2-147e-4521-b284-d79d547a3f99 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:30.679056 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8a5cd4d2-147e-4521-b284-d79d547a3f99 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:30.694476 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a5cd4d2-147e-4521-b284-d79d547a3f99 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:30.696058 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a5cd4d2-147e-4521-b284-d79d547a3f99 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:30.700319 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a5cd4d2-147e-4521-b284-d79d547a3f99 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:30.701863 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a5cd4d2-147e-4521-b284-d79d547a3f99 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:31.103021 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-c2fad067-8a68-4c8e-8ac3-ca02d544ef7a req-84c3cd50-a1c5-47e0-ba82-fc2b6163e3fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5681a932-b6a9-4c1f-8797-69655e66927e", "name": "network-vif-plugged", "status": "completed", "tag": "97271a32-ec26-4a51-9a97-19f528a9ec9c"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:45:31.163749 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-c2fad067-8a68-4c8e-8ac3-ca02d544ef7a req-84c3cd50-a1c5-47e0-ba82-fc2b6163e3fc service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:31.164955 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-c2fad067-8a68-4c8e-8ac3-ca02d544ef7a req-84c3cd50-a1c5-47e0-ba82-fc2b6163e3fc service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:31.197673 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-c2fad067-8a68-4c8e-8ac3-ca02d544ef7a req-84c3cd50-a1c5-47e0-ba82-fc2b6163e3fc service nova] Creating event network-vif-plugged:97271a32-ec26-4a51-9a97-19f528a9ec9c for instance 5681a932-b6a9-4c1f-8797-69655e66927e on n-h1-465891-3 Jul 18 02:45:31.209078 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-c2fad067-8a68-4c8e-8ac3-ca02d544ef7a req-84c3cd50-a1c5-47e0-ba82-fc2b6163e3fc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111759 Jul 18 02:45:31.211253 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2186/4365] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:45:31.236564 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8a5cd4d2-147e-4521-b284-d79d547a3f99 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:31.269614 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8a5cd4d2-147e-4521-b284-d79d547a3f99 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1318 microversion: 2.1 time: 0.594544 Jul 18 02:45:31.274158 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2180/4366] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:30 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1318 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:45:31.616019 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bfe19ada-d0a2-41d7-98c1-147a841567f6 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:31.617021 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bfe19ada-d0a2-41d7-98c1-147a841567f6 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 3aa190fe-c088-40db-8267-e574e0002a03] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:31.630114 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bfe19ada-d0a2-41d7-98c1-147a841567f6 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:31.630826 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bfe19ada-d0a2-41d7-98c1-147a841567f6 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:31.647117 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bfe19ada-d0a2-41d7-98c1-147a841567f6 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:31.647589 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bfe19ada-d0a2-41d7-98c1-147a841567f6 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:31.763023 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bfe19ada-d0a2-41d7-98c1-147a841567f6 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.153507 Jul 18 02:45:31.769469 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2187/4367] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:45:31 2022] GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:45:32.304582 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-48f02bb1-ffd6-44b8-bd2a-a06172ef80f4 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:32.307484 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-48f02bb1-ffd6-44b8-bd2a-a06172ef80f4 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:32.330746 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-48f02bb1-ffd6-44b8-bd2a-a06172ef80f4 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:32.332134 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-48f02bb1-ffd6-44b8-bd2a-a06172ef80f4 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:32.339664 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-48f02bb1-ffd6-44b8-bd2a-a06172ef80f4 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:32.341006 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-48f02bb1-ffd6-44b8-bd2a-a06172ef80f4 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:32.755579 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-48f02bb1-ffd6-44b8-bd2a-a06172ef80f4 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:32.770344 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-48f02bb1-ffd6-44b8-bd2a-a06172ef80f4 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1318 microversion: 2.1 time: 0.480961 Jul 18 02:45:32.771516 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2181/4368] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:32 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1318 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:32.777308 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1a7221d7-3f73-464d-82b9-071f4f224c99 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:32.779000 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1a7221d7-3f73-464d-82b9-071f4f224c99 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 3aa190fe-c088-40db-8267-e574e0002a03] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:32.806247 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1a7221d7-3f73-464d-82b9-071f4f224c99 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:32.807330 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1a7221d7-3f73-464d-82b9-071f4f224c99 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:32.809053 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1a7221d7-3f73-464d-82b9-071f4f224c99 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:32.810537 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1a7221d7-3f73-464d-82b9-071f4f224c99 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:32.911887 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1a7221d7-3f73-464d-82b9-071f4f224c99 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138479 Jul 18 02:45:32.917355 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2188/4369] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:45:32 2022] GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:45:33.790380 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4be8dd4d-57a2-45dd-aa51-12d40a673945 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:33.791696 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4be8dd4d-57a2-45dd-aa51-12d40a673945 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:33.810991 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4be8dd4d-57a2-45dd-aa51-12d40a673945 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:33.812054 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4be8dd4d-57a2-45dd-aa51-12d40a673945 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:33.813147 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4be8dd4d-57a2-45dd-aa51-12d40a673945 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:33.821435 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4be8dd4d-57a2-45dd-aa51-12d40a673945 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:33.936894 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1238e763-faf7-43c0-810c-018f8323fbfb tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:33.948836 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1238e763-faf7-43c0-810c-018f8323fbfb tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 3aa190fe-c088-40db-8267-e574e0002a03] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:33.985114 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1238e763-faf7-43c0-810c-018f8323fbfb tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:33.986268 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1238e763-faf7-43c0-810c-018f8323fbfb tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:33.989279 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1238e763-faf7-43c0-810c-018f8323fbfb tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:33.992194 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1238e763-faf7-43c0-810c-018f8323fbfb tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:34.112545 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1238e763-faf7-43c0-810c-018f8323fbfb tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.183843 Jul 18 02:45:34.115954 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2189/4370] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:45:33 2022] GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:45:34.725316 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4be8dd4d-57a2-45dd-aa51-12d40a673945 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:34.734086 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4be8dd4d-57a2-45dd-aa51-12d40a673945 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1508 microversion: 2.1 time: 0.949206 Jul 18 02:45:34.757297 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-41fc1b7f-0b9f-4a94-9e28-f2866a7d9b20 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:34.759311 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2182/4371] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:33 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1508 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:34.760651 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-41fc1b7f-0b9f-4a94-9e28-f2866a7d9b20 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:34.780274 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41fc1b7f-0b9f-4a94-9e28-f2866a7d9b20 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:34.792674 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41fc1b7f-0b9f-4a94-9e28-f2866a7d9b20 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:34.793657 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41fc1b7f-0b9f-4a94-9e28-f2866a7d9b20 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:34.794154 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41fc1b7f-0b9f-4a94-9e28-f2866a7d9b20 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:35.128801 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-97506d9b-94b7-4d06-8db6-c1e698e944bd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:35.130695 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-97506d9b-94b7-4d06-8db6-c1e698e944bd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 3aa190fe-c088-40db-8267-e574e0002a03] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:35.173436 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-97506d9b-94b7-4d06-8db6-c1e698e944bd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:35.174083 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-97506d9b-94b7-4d06-8db6-c1e698e944bd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:35.174962 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-97506d9b-94b7-4d06-8db6-c1e698e944bd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:35.175415 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-97506d9b-94b7-4d06-8db6-c1e698e944bd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:35.352879 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-97506d9b-94b7-4d06-8db6-c1e698e944bd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.228636 Jul 18 02:45:35.361657 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2183/4372] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:45:35 2022] GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03/os-volume_attachments => generated 197 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:45:35.478348 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-41fc1b7f-0b9f-4a94-9e28-f2866a7d9b20 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:35.500733 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-41fc1b7f-0b9f-4a94-9e28-f2866a7d9b20 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1508 microversion: 2.1 time: 0.748378 Jul 18 02:45:35.501645 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2190/4373] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:34 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1508 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:45:35.523527 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0c9d9dbb-8864-44f6-a1f7-6fefb1c1be99 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:45:35.525421 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0c9d9dbb-8864-44f6-a1f7-6fefb1c1be99 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:35.550629 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c9d9dbb-8864-44f6-a1f7-6fefb1c1be99 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:35.554943 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c9d9dbb-8864-44f6-a1f7-6fefb1c1be99 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:35.556143 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c9d9dbb-8864-44f6-a1f7-6fefb1c1be99 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:35.568644 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c9d9dbb-8864-44f6-a1f7-6fefb1c1be99 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:35.765645 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-0c9d9dbb-8864-44f6-a1f7-6fefb1c1be99 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:45:35.767194 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-0c9d9dbb-8864-44f6-a1f7-6fefb1c1be99 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:45:35.768454 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-0c9d9dbb-8864-44f6-a1f7-6fefb1c1be99 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:45:35.769727 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-0c9d9dbb-8864-44f6-a1f7-6fefb1c1be99 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:45:35.771201 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-0c9d9dbb-8864-44f6-a1f7-6fefb1c1be99 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:45:35.980580 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0c9d9dbb-8864-44f6-a1f7-6fefb1c1be99 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:35.999299 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c9d9dbb-8864-44f6-a1f7-6fefb1c1be99 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:36.000014 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c9d9dbb-8864-44f6-a1f7-6fefb1c1be99 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:36.001104 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c9d9dbb-8864-44f6-a1f7-6fefb1c1be99 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:36.002592 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c9d9dbb-8864-44f6-a1f7-6fefb1c1be99 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:36.043199 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0c9d9dbb-8864-44f6-a1f7-6fefb1c1be99 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "POST /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e/action" status: 202 len: 1110 microversion: 2.1 time: 0.525200 Jul 18 02:45:36.044386 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2184/4374] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:45:35 2022] POST /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e/action => generated 1110 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 18 02:45:36.068629 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-974e18d5-4e91-48f2-8492-9cd1793227d1 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:36.070322 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-974e18d5-4e91-48f2-8492-9cd1793227d1 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:36.118544 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-974e18d5-4e91-48f2-8492-9cd1793227d1 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:36.126540 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-974e18d5-4e91-48f2-8492-9cd1793227d1 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:36.133432 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-974e18d5-4e91-48f2-8492-9cd1793227d1 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:36.135404 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-974e18d5-4e91-48f2-8492-9cd1793227d1 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:36.388543 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-87055486-97fc-4acc-bcb0-869084e5f55c tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:36.391431 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-87055486-97fc-4acc-bcb0-869084e5f55c tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 3aa190fe-c088-40db-8267-e574e0002a03] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:36.435549 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-87055486-97fc-4acc-bcb0-869084e5f55c tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:36.436683 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-87055486-97fc-4acc-bcb0-869084e5f55c tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:36.438663 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-87055486-97fc-4acc-bcb0-869084e5f55c tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:36.440302 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-87055486-97fc-4acc-bcb0-869084e5f55c tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:36.579658 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-87055486-97fc-4acc-bcb0-869084e5f55c tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.207527 Jul 18 02:45:36.585861 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2185/4375] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:45:36 2022] GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03/os-volume_attachments => generated 197 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:45:36.619699 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-974e18d5-4e91-48f2-8492-9cd1793227d1 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:36.637178 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-974e18d5-4e91-48f2-8492-9cd1793227d1 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1515 microversion: 2.1 time: 0.576172 Jul 18 02:45:36.650847 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2191/4376] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:36 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1515 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:45:37.598028 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-48c0a694-5aa1-4754-9f4d-792754bb3b9c tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:37.599691 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-48c0a694-5aa1-4754-9f4d-792754bb3b9c tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 3aa190fe-c088-40db-8267-e574e0002a03] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:37.628627 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-48c0a694-5aa1-4754-9f4d-792754bb3b9c tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:37.631176 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-48c0a694-5aa1-4754-9f4d-792754bb3b9c tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:37.632302 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-48c0a694-5aa1-4754-9f4d-792754bb3b9c tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:37.635813 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-48c0a694-5aa1-4754-9f4d-792754bb3b9c tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:37.657586 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0942cc33-ded9-4aef-be30-cb30d602dd03 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:37.658494 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0942cc33-ded9-4aef-be30-cb30d602dd03 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:37.685275 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0942cc33-ded9-4aef-be30-cb30d602dd03 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:37.690149 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0942cc33-ded9-4aef-be30-cb30d602dd03 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:37.691294 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0942cc33-ded9-4aef-be30-cb30d602dd03 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:37.696192 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0942cc33-ded9-4aef-be30-cb30d602dd03 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:37.794669 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:37.816980 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-48c0a694-5aa1-4754-9f4d-792754bb3b9c tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.222151 Jul 18 02:45:37.824630 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2186/4377] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:45:37 2022] GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03/os-volume_attachments => generated 197 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:45:38.069848 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0942cc33-ded9-4aef-be30-cb30d602dd03 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:38.081741 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0942cc33-ded9-4aef-be30-cb30d602dd03 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1515 microversion: 2.1 time: 0.429219 Jul 18 02:45:38.084780 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2192/4378] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:37 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1515 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:45:38.833485 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5ed4f933-b9fd-4578-a573-23fd8f3128c7 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:38.835927 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5ed4f933-b9fd-4578-a573-23fd8f3128c7 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 3aa190fe-c088-40db-8267-e574e0002a03] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:38.874419 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ed4f933-b9fd-4578-a573-23fd8f3128c7 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:38.878186 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ed4f933-b9fd-4578-a573-23fd8f3128c7 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:38.884694 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ed4f933-b9fd-4578-a573-23fd8f3128c7 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:38.886088 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ed4f933-b9fd-4578-a573-23fd8f3128c7 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:39.029508 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5ed4f933-b9fd-4578-a573-23fd8f3128c7 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.204267 Jul 18 02:45:39.031432 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2187/4379] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:45:38 2022] GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03/os-volume_attachments => generated 197 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:45:39.105899 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1108eb9a-5e39-4782-b478-15bf08f48823 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:39.119320 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1108eb9a-5e39-4782-b478-15bf08f48823 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:39.147694 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1108eb9a-5e39-4782-b478-15bf08f48823 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:39.148519 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1108eb9a-5e39-4782-b478-15bf08f48823 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:39.162300 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1108eb9a-5e39-4782-b478-15bf08f48823 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:39.163328 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1108eb9a-5e39-4782-b478-15bf08f48823 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:39.619742 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1108eb9a-5e39-4782-b478-15bf08f48823 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:39.678984 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1108eb9a-5e39-4782-b478-15bf08f48823 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1515 microversion: 2.1 time: 0.581095 Jul 18 02:45:39.686461 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2193/4380] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:39 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1515 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:40.046784 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a93d22a3-f719-4511-838a-dd11710751c4 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:40.048782 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a93d22a3-f719-4511-838a-dd11710751c4 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 3aa190fe-c088-40db-8267-e574e0002a03] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:40.103800 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a93d22a3-f719-4511-838a-dd11710751c4 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:40.104655 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a93d22a3-f719-4511-838a-dd11710751c4 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:40.106175 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a93d22a3-f719-4511-838a-dd11710751c4 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:40.106966 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a93d22a3-f719-4511-838a-dd11710751c4 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:40.223495 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a93d22a3-f719-4511-838a-dd11710751c4 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.184667 Jul 18 02:45:40.225266 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2188/4381] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:45:40 2022] GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03/os-volume_attachments => generated 197 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:45:40.706198 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-714490e5-21fa-4494-af19-24c94b21d482 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:40.707388 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-714490e5-21fa-4494-af19-24c94b21d482 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:40.742786 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-714490e5-21fa-4494-af19-24c94b21d482 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:40.750104 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-714490e5-21fa-4494-af19-24c94b21d482 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:40.751847 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-714490e5-21fa-4494-af19-24c94b21d482 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:40.753131 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-714490e5-21fa-4494-af19-24c94b21d482 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:41.085535 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-714490e5-21fa-4494-af19-24c94b21d482 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:41.099703 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-714490e5-21fa-4494-af19-24c94b21d482 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1515 microversion: 2.1 time: 0.406425 Jul 18 02:45:41.117005 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2194/4382] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:40 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1515 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:41.238469 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3d2150ad-0fd8-4023-b6fa-ddd7ecd0f406 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:41.241418 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3d2150ad-0fd8-4023-b6fa-ddd7ecd0f406 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 3aa190fe-c088-40db-8267-e574e0002a03] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:41.256625 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3d2150ad-0fd8-4023-b6fa-ddd7ecd0f406 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:41.257345 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3d2150ad-0fd8-4023-b6fa-ddd7ecd0f406 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:41.258580 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3d2150ad-0fd8-4023-b6fa-ddd7ecd0f406 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:41.259293 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3d2150ad-0fd8-4023-b6fa-ddd7ecd0f406 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:41.336391 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3d2150ad-0fd8-4023-b6fa-ddd7ecd0f406 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102764 Jul 18 02:45:41.337744 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2189/4383] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:45:41 2022] GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:45:42.121105 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ecb85b82-ae80-4b49-b63c-34723cd63f11 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:42.121946 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ecb85b82-ae80-4b49-b63c-34723cd63f11 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:42.150500 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ecb85b82-ae80-4b49-b63c-34723cd63f11 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:42.154212 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ecb85b82-ae80-4b49-b63c-34723cd63f11 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:42.160338 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ecb85b82-ae80-4b49-b63c-34723cd63f11 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:42.162094 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ecb85b82-ae80-4b49-b63c-34723cd63f11 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:42.368044 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1ccde61e-f25b-4aa5-934d-3497b58f4afb tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:42.369990 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1ccde61e-f25b-4aa5-934d-3497b58f4afb tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 3aa190fe-c088-40db-8267-e574e0002a03] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:42.388425 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ccde61e-f25b-4aa5-934d-3497b58f4afb tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:42.389499 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ccde61e-f25b-4aa5-934d-3497b58f4afb tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:42.391861 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ccde61e-f25b-4aa5-934d-3497b58f4afb tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:42.396839 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ccde61e-f25b-4aa5-934d-3497b58f4afb tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:42.479910 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1ccde61e-f25b-4aa5-934d-3497b58f4afb tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.129943 Jul 18 02:45:42.488718 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2190/4384] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:45:42 2022] GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03/os-volume_attachments => generated 25 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:45:42.626754 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c62d0b9c-382a-46d0-98a2-f19ce648fbf4 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:42.627570 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c62d0b9c-382a-46d0-98a2-f19ce648fbf4 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 3aa190fe-c088-40db-8267-e574e0002a03] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:42.643548 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c62d0b9c-382a-46d0-98a2-f19ce648fbf4 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:42.644716 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c62d0b9c-382a-46d0-98a2-f19ce648fbf4 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:42.648652 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c62d0b9c-382a-46d0-98a2-f19ce648fbf4 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:42.650168 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c62d0b9c-382a-46d0-98a2-f19ce648fbf4 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:42.730656 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c62d0b9c-382a-46d0-98a2-f19ce648fbf4 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 3aa190fe-c088-40db-8267-e574e0002a03] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:45:42.792729 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ecb85b82-ae80-4b49-b63c-34723cd63f11 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:42.816503 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ecb85b82-ae80-4b49-b63c-34723cd63f11 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1515 microversion: 2.1 time: 0.693641 Jul 18 02:45:42.819096 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2195/4385] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:42 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1515 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:45:42.993998 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c62d0b9c-382a-46d0-98a2-f19ce648fbf4 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03" status: 204 len: 0 microversion: 2.1 time: 0.370877 Jul 18 02:45:42.998596 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2191/4386] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:45:42 2022] DELETE /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:45:43.011608 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a787476b-94c0-43ff-a3a8-3f985a4b8b8b tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:43.014745 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a787476b-94c0-43ff-a3a8-3f985a4b8b8b tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 3aa190fe-c088-40db-8267-e574e0002a03] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:43.041380 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a787476b-94c0-43ff-a3a8-3f985a4b8b8b tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:43.042194 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a787476b-94c0-43ff-a3a8-3f985a4b8b8b tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:43.044639 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a787476b-94c0-43ff-a3a8-3f985a4b8b8b tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:43.045392 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a787476b-94c0-43ff-a3a8-3f985a4b8b8b tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:43.618125 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a787476b-94c0-43ff-a3a8-3f985a4b8b8b tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:43.650638 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a787476b-94c0-43ff-a3a8-3f985a4b8b8b tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03" status: 200 len: 1679 microversion: 2.1 time: 0.649754 Jul 18 02:45:43.662679 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2196/4387] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:42 2022] GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03 => generated 1679 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:45:43.839978 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-03784eb8-e66a-49bd-94ff-aaecc8780156 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:43.841948 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-03784eb8-e66a-49bd-94ff-aaecc8780156 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:43.868608 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-03784eb8-e66a-49bd-94ff-aaecc8780156 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:43.870310 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-03784eb8-e66a-49bd-94ff-aaecc8780156 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:43.872121 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-03784eb8-e66a-49bd-94ff-aaecc8780156 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:43.873864 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-03784eb8-e66a-49bd-94ff-aaecc8780156 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:44.575031 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-03784eb8-e66a-49bd-94ff-aaecc8780156 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:44.587271 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-03784eb8-e66a-49bd-94ff-aaecc8780156 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1515 microversion: 2.1 time: 0.755118 Jul 18 02:45:44.587884 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2192/4388] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:43 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1515 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:44.679824 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b9f36c33-ff2c-4837-896e-d562f2672b79 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:44.682132 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b9f36c33-ff2c-4837-896e-d562f2672b79 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 3aa190fe-c088-40db-8267-e574e0002a03] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:44.700147 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b9f36c33-ff2c-4837-896e-d562f2672b79 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:44.701398 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b9f36c33-ff2c-4837-896e-d562f2672b79 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:44.704483 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b9f36c33-ff2c-4837-896e-d562f2672b79 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:44.711219 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b9f36c33-ff2c-4837-896e-d562f2672b79 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:45.287216 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b9f36c33-ff2c-4837-896e-d562f2672b79 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:45.299412 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b9f36c33-ff2c-4837-896e-d562f2672b79 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03" status: 200 len: 1679 microversion: 2.1 time: 0.629812 Jul 18 02:45:45.315779 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2197/4389] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:44 2022] GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03 => generated 1679 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:45.617792 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b61d2605-e51d-4296-9b34-dab2f2dc028c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:45.618433 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b61d2605-e51d-4296-9b34-dab2f2dc028c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:45.643307 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b61d2605-e51d-4296-9b34-dab2f2dc028c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:45.643776 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b61d2605-e51d-4296-9b34-dab2f2dc028c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:45.644600 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b61d2605-e51d-4296-9b34-dab2f2dc028c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:45.647534 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b61d2605-e51d-4296-9b34-dab2f2dc028c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:46.190696 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b61d2605-e51d-4296-9b34-dab2f2dc028c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:46.212863 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b61d2605-e51d-4296-9b34-dab2f2dc028c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1515 microversion: 2.1 time: 0.600565 Jul 18 02:45:46.213491 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2193/4390] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:45 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1515 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:46.316932 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-14d5b6fc-6e60-4400-85f1-2b343ed88b69 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:46.319875 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-14d5b6fc-6e60-4400-85f1-2b343ed88b69 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 3aa190fe-c088-40db-8267-e574e0002a03] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:46.342603 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14d5b6fc-6e60-4400-85f1-2b343ed88b69 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:46.343060 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14d5b6fc-6e60-4400-85f1-2b343ed88b69 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:46.344351 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14d5b6fc-6e60-4400-85f1-2b343ed88b69 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:46.345051 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14d5b6fc-6e60-4400-85f1-2b343ed88b69 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:47.126126 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-14d5b6fc-6e60-4400-85f1-2b343ed88b69 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:47.136638 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-14d5b6fc-6e60-4400-85f1-2b343ed88b69 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03" status: 200 len: 1679 microversion: 2.1 time: 0.823990 Jul 18 02:45:47.144503 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2198/4391] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:46 2022] GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03 => generated 1679 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:47.244142 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f28f70d5-98fe-4f99-975d-19274a45262f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:47.245464 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f28f70d5-98fe-4f99-975d-19274a45262f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:47.258984 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f28f70d5-98fe-4f99-975d-19274a45262f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:47.266557 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f28f70d5-98fe-4f99-975d-19274a45262f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:47.271694 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f28f70d5-98fe-4f99-975d-19274a45262f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:47.272448 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f28f70d5-98fe-4f99-975d-19274a45262f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:47.377822 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-52874e1a-b7d9-44d0-9e70-2f1f4fe3b392 req-bc8bb710-fb39-4d68-8e37-4d3c5d50ee09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa190fe-c088-40db-8267-e574e0002a03", "name": "network-vif-unplugged", "status": "completed", "tag": "55e1ba47-695a-4230-b43c-a72d640684c9"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:45:47.399578 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-52874e1a-b7d9-44d0-9e70-2f1f4fe3b392 req-bc8bb710-fb39-4d68-8e37-4d3c5d50ee09 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:47.407890 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-52874e1a-b7d9-44d0-9e70-2f1f4fe3b392 req-bc8bb710-fb39-4d68-8e37-4d3c5d50ee09 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:47.452189 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-52874e1a-b7d9-44d0-9e70-2f1f4fe3b392 req-bc8bb710-fb39-4d68-8e37-4d3c5d50ee09 service nova] Creating event network-vif-unplugged:55e1ba47-695a-4230-b43c-a72d640684c9 for instance 3aa190fe-c088-40db-8267-e574e0002a03 on n-h2-465891-3 Jul 18 02:45:47.467583 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-52874e1a-b7d9-44d0-9e70-2f1f4fe3b392 req-bc8bb710-fb39-4d68-8e37-4d3c5d50ee09 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093558 Jul 18 02:45:47.470593 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2199/4392] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:45:48.170292 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fb707118-e169-4200-8b58-518083e358c4 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:48.171306 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fb707118-e169-4200-8b58-518083e358c4 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 3aa190fe-c088-40db-8267-e574e0002a03] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:48.197367 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fb707118-e169-4200-8b58-518083e358c4 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:48.204073 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fb707118-e169-4200-8b58-518083e358c4 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:48.205239 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fb707118-e169-4200-8b58-518083e358c4 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:48.205902 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fb707118-e169-4200-8b58-518083e358c4 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:48.523520 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f28f70d5-98fe-4f99-975d-19274a45262f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:48.557268 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f28f70d5-98fe-4f99-975d-19274a45262f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1515 microversion: 2.1 time: 1.313910 Jul 18 02:45:48.562075 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2194/4393] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:47 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1515 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:45:49.358918 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fb707118-e169-4200-8b58-518083e358c4 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:49.378771 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fb707118-e169-4200-8b58-518083e358c4 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03" status: 200 len: 1679 microversion: 2.1 time: 1.214355 Jul 18 02:45:49.384293 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2200/4394] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:48 2022] GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03 => generated 1679 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:49.587121 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-800a259b-3c1d-4a57-aab1-aa310844ddea tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:49.588544 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-800a259b-3c1d-4a57-aab1-aa310844ddea tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:49.606487 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-800a259b-3c1d-4a57-aab1-aa310844ddea tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:49.607388 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-800a259b-3c1d-4a57-aab1-aa310844ddea tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:49.608481 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-800a259b-3c1d-4a57-aab1-aa310844ddea tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:49.609109 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-800a259b-3c1d-4a57-aab1-aa310844ddea tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:50.351217 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-800a259b-3c1d-4a57-aab1-aa310844ddea tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:50.378523 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-800a259b-3c1d-4a57-aab1-aa310844ddea tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1515 microversion: 2.1 time: 0.796214 Jul 18 02:45:50.382773 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2195/4395] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:49 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1515 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:50.420333 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-70105aeb-ac04-431c-9c0d-1381d72c37fd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:50.421529 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-70105aeb-ac04-431c-9c0d-1381d72c37fd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 3aa190fe-c088-40db-8267-e574e0002a03] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:50.456593 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-70105aeb-ac04-431c-9c0d-1381d72c37fd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:50.462228 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-70105aeb-ac04-431c-9c0d-1381d72c37fd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:50.463541 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-70105aeb-ac04-431c-9c0d-1381d72c37fd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:50.464017 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-70105aeb-ac04-431c-9c0d-1381d72c37fd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:50.480750 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:51.191065 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-752c6c91-ae71-4606-a586-901a03134a80 req-eb92a0ef-6fbd-4ec9-9c20-44a4fd200f7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa190fe-c088-40db-8267-e574e0002a03", "name": "network-vif-deleted", "tag": "55e1ba47-695a-4230-b43c-a72d640684c9"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:45:51.203526 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-70105aeb-ac04-431c-9c0d-1381d72c37fd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:51.206069 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:51.243462 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-752c6c91-ae71-4606-a586-901a03134a80 req-eb92a0ef-6fbd-4ec9-9c20-44a4fd200f7d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:51.249838 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-752c6c91-ae71-4606-a586-901a03134a80 req-eb92a0ef-6fbd-4ec9-9c20-44a4fd200f7d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:51.303808 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-70105aeb-ac04-431c-9c0d-1381d72c37fd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03" status: 200 len: 1613 microversion: 2.1 time: 0.904406 Jul 18 02:45:51.308274 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-752c6c91-ae71-4606-a586-901a03134a80 req-eb92a0ef-6fbd-4ec9-9c20-44a4fd200f7d service nova] Creating event network-vif-deleted:55e1ba47-695a-4230-b43c-a72d640684c9 for instance 3aa190fe-c088-40db-8267-e574e0002a03 on n-h2-465891-3 Jul 18 02:45:51.330715 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2201/4396] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:50 2022] GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03 => generated 1613 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:51.357317 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-752c6c91-ae71-4606-a586-901a03134a80 req-eb92a0ef-6fbd-4ec9-9c20-44a4fd200f7d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170132 Jul 18 02:45:51.367057 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2196/4397] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:45:51.414664 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c56d4d7b-e47a-480e-8c3a-26c429630f6e tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:51.415746 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c56d4d7b-e47a-480e-8c3a-26c429630f6e tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:51.430709 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c56d4d7b-e47a-480e-8c3a-26c429630f6e tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:51.432507 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c56d4d7b-e47a-480e-8c3a-26c429630f6e tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:51.436939 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c56d4d7b-e47a-480e-8c3a-26c429630f6e tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:51.438978 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c56d4d7b-e47a-480e-8c3a-26c429630f6e tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:52.345769 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fa0868e1-d207-4f5b-939b-87cbd787e9a0 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:52.354500 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fa0868e1-d207-4f5b-939b-87cbd787e9a0 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 3aa190fe-c088-40db-8267-e574e0002a03] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:52.383203 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fa0868e1-d207-4f5b-939b-87cbd787e9a0 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:52.383953 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fa0868e1-d207-4f5b-939b-87cbd787e9a0 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:52.385402 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fa0868e1-d207-4f5b-939b-87cbd787e9a0 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:52.389525 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fa0868e1-d207-4f5b-939b-87cbd787e9a0 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:52.435697 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c56d4d7b-e47a-480e-8c3a-26c429630f6e tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:52.464522 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-fa0868e1-d207-4f5b-939b-87cbd787e9a0 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] HTTP exception thrown: Instance 3aa190fe-c088-40db-8267-e574e0002a03 could not be found. Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fa0868e1-d207-4f5b-939b-87cbd787e9a0 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Request method failure captured: Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03 HTTP/1.1 Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MhfM0UyOyoMgRP_1BgsB5GQEFaLnp85satKIE74LtU4aati7wjZItAybGxqrHGu9HKZ07IOl-ghvuL-XVY7iiNLxZrz8uz6pnetXMm39fDBZo0QiKDc9Xu-2OCp3obDb_4yxslV3N-dd0oIabggtRNHi18D28MbZyTc-9xFAnMfxLs Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 8fa714ec7f5a4af0a33f56b45e999a7a Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-AttachVolumeNegativeTest-683705837 Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8fa714ec7f5a4af0a33f56b45e999a7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fa714ec7f5a4af0a33f56b45e999a7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fa714ec7f5a4af0a33f56b45e999a7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8fa714ec7f5a4af0a33f56b45e999a7a"}]}] Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-AttachVolumeNegativeTest-683705837 Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 8fa714ec7f5a4af0a33f56b45e999a7a Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-683705837 Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-AttachVolumeNegativeTest-683705837-project Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 1be686f2aa93473585ca064041bd8140 Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-AttachVolumeNegativeTest-683705837-project Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 3aa190fe-c088-40db-8267-e574e0002a03 could not be found. Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '3aa190fe-c088-40db-8267-e574e0002a03'} Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aa190fe-c088-40db-8267-e574e0002a03 could not be found. Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aa190fe-c088-40db-8267-e574e0002a03 could not be found. Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:45:52.471463 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:45:52.479557 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:45:52.479557 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:45:52.479557 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:45:52.479557 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:45:52.479557 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:45:52.479557 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aa190fe-c088-40db-8267-e574e0002a03 could not be found. Jul 18 02:45:52.479557 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:45:52.480511 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c56d4d7b-e47a-480e-8c3a-26c429630f6e tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1515 microversion: 2.1 time: 1.071067 Jul 18 02:45:52.482761 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fa0868e1-d207-4f5b-939b-87cbd787e9a0 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Returning 404 to user: Instance 3aa190fe-c088-40db-8267-e574e0002a03 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:45:52.484884 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2202/4398] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:51 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1515 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:52.487566 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fa0868e1-d207-4f5b-939b-87cbd787e9a0 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03" status: 404 len: 111 microversion: 2.1 time: 0.154462 Jul 18 02:45:52.494253 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2197/4399] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:52 2022] GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:45:52.530314 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b8cc85be-77e7-4e6c-9e4c-bbe7ba0fb094 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '.version_select at 0x7ff49b85eaf0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:52.600698 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b8cc85be-77e7-4e6c-9e4c-bbe7ba0fb094 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-925839999" status: 202 len: 0 microversion: 2.1 time: 0.086495 Jul 18 02:45:52.602162 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2203/4400] 10.222.0.57 () {58 vars in 1217 bytes} [Mon Jul 18 02:45:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-925839999 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:45:53.512881 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ff3f3760-ce9b-4c32-b182-3d182a5ed549 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:53.514011 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ff3f3760-ce9b-4c32-b182-3d182a5ed549 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:53.550006 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ff3f3760-ce9b-4c32-b182-3d182a5ed549 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:53.550830 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ff3f3760-ce9b-4c32-b182-3d182a5ed549 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:53.572815 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ff3f3760-ce9b-4c32-b182-3d182a5ed549 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:53.573364 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ff3f3760-ce9b-4c32-b182-3d182a5ed549 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:54.397129 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ff3f3760-ce9b-4c32-b182-3d182a5ed549 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:54.409035 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ff3f3760-ce9b-4c32-b182-3d182a5ed549 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1515 microversion: 2.1 time: 0.903389 Jul 18 02:45:54.420488 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2198/4401] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:53 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1515 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:54.566882 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0ad2a955-5191-4cc0-b588-03d0aa9c7f16 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Action: 'create', calling method: .version_select at 0x7ff49bb643a0>, body: {"keypair": {"name": "tempest-keypair-1491470079", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgGwc7Gas5IzSfTPpUIl3QN6MLACpUMchL2w1G1ZdJxsBJ6pGKl8vDU1wd9sHjhjDIVPCOT55GHaN8BeFDSl31OosCstmjcNZ3kx01GFK3FloMwj6ZRGObGx/ehv24JgA=="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:45:54.641904 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-0ad2a955-5191-4cc0-b588-03d0aa9c7f16 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Getting quotas for project 8fa714ec7f5a4af0a33f56b45e999a7a. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:45:54.663487 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-0ad2a955-5191-4cc0-b588-03d0aa9c7f16 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Getting quotas for user 1be686f2aa93473585ca064041bd8140 and project 8fa714ec7f5a4af0a33f56b45e999a7a. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:45:54.728754 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0ad2a955-5191-4cc0-b588-03d0aa9c7f16 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.163560 Jul 18 02:45:54.742116 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2204/4402] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 02:45:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:45:55.451733 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a4ba614a-14c8-498e-b0dc-1b325fd06ed7 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:55.452351 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a4ba614a-14c8-498e-b0dc-1b325fd06ed7 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:55.471170 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a4ba614a-14c8-498e-b0dc-1b325fd06ed7 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:55.471945 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a4ba614a-14c8-498e-b0dc-1b325fd06ed7 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:55.472934 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a4ba614a-14c8-498e-b0dc-1b325fd06ed7 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:55.473563 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a4ba614a-14c8-498e-b0dc-1b325fd06ed7 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:55.935879 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a4ba614a-14c8-498e-b0dc-1b325fd06ed7 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:55.959488 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a4ba614a-14c8-498e-b0dc-1b325fd06ed7 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1515 microversion: 2.1 time: 0.512290 Jul 18 02:45:55.960265 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2199/4403] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:55 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1515 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:56.995862 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fda171a7-d137-4ef1-bf20-f1a1cd56a42e tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:57.009487 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fda171a7-d137-4ef1-bf20-f1a1cd56a42e tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:57.045237 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fda171a7-d137-4ef1-bf20-f1a1cd56a42e tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:57.046072 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fda171a7-d137-4ef1-bf20-f1a1cd56a42e tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:57.047553 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fda171a7-d137-4ef1-bf20-f1a1cd56a42e tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:57.057432 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fda171a7-d137-4ef1-bf20-f1a1cd56a42e tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:58.580331 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fda171a7-d137-4ef1-bf20-f1a1cd56a42e tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:58.626554 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fda171a7-d137-4ef1-bf20-f1a1cd56a42e tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1515 microversion: 2.1 time: 1.633068 Jul 18 02:45:58.635820 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2205/4404] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:56 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1515 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:59.651408 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f32d6b75-9f28-499d-bf5b-a06ac3062c50 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:59.654297 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f32d6b75-9f28-499d-bf5b-a06ac3062c50 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:59.720871 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f32d6b75-9f28-499d-bf5b-a06ac3062c50 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:59.743034 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f32d6b75-9f28-499d-bf5b-a06ac3062c50 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:59.745009 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f32d6b75-9f28-499d-bf5b-a06ac3062c50 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:59.746826 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f32d6b75-9f28-499d-bf5b-a06ac3062c50 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:01.048707 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8ede88eb-d2cb-423b-8470-4dbbe3cd9c4c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:01.049679 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8ede88eb-d2cb-423b-8470-4dbbe3cd9c4c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:01.058986 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:46:01.071848 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8ede88eb-d2cb-423b-8470-4dbbe3cd9c4c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:01.075241 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8ede88eb-d2cb-423b-8470-4dbbe3cd9c4c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:01.076164 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8ede88eb-d2cb-423b-8470-4dbbe3cd9c4c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:01.076628 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8ede88eb-d2cb-423b-8470-4dbbe3cd9c4c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:01.171599 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8ede88eb-d2cb-423b-8470-4dbbe3cd9c4c tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.128495 Jul 18 02:46:01.181791 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2206/4405] 10.222.0.57 () {60 vars in 1342 bytes} [Mon Jul 18 02:46:01 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270/os-volume_attachments => generated 25 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:01.435092 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-60c3aa0a-55e4-4484-94f8-c01c6998bb34 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:01.435952 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-60c3aa0a-55e4-4484-94f8-c01c6998bb34 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:01.447847 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f32d6b75-9f28-499d-bf5b-a06ac3062c50 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:01.500655 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60c3aa0a-55e4-4484-94f8-c01c6998bb34 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:01.520986 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60c3aa0a-55e4-4484-94f8-c01c6998bb34 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:01.526391 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f32d6b75-9f28-499d-bf5b-a06ac3062c50 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1515 microversion: 2.1 time: 1.865031 Jul 18 02:46:01.528199 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2200/4406] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:59 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1515 bytes in 1885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:01.530085 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60c3aa0a-55e4-4484-94f8-c01c6998bb34 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:01.537995 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60c3aa0a-55e4-4484-94f8-c01c6998bb34 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:01.663243 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-60c3aa0a-55e4-4484-94f8-c01c6998bb34 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:46:01.920334 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-60c3aa0a-55e4-4484-94f8-c01c6998bb34 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "DELETE /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 204 len: 0 microversion: 2.20 time: 0.493061 Jul 18 02:46:01.921403 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2207/4407] 10.222.0.57 () {60 vars in 1279 bytes} [Mon Jul 18 02:46:01 2022] DELETE /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:46:01.931412 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8df1de67-488c-4213-9126-c5026288612e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:01.932186 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8df1de67-488c-4213-9126-c5026288612e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:01.951205 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8df1de67-488c-4213-9126-c5026288612e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:01.951674 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8df1de67-488c-4213-9126-c5026288612e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:01.952514 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8df1de67-488c-4213-9126-c5026288612e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:01.952951 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8df1de67-488c-4213-9126-c5026288612e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:02.549370 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a4bef1a4-1a0d-463b-a210-19640a9bd60b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:02.550252 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a4bef1a4-1a0d-463b-a210-19640a9bd60b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:02.572650 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a4bef1a4-1a0d-463b-a210-19640a9bd60b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:02.573109 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a4bef1a4-1a0d-463b-a210-19640a9bd60b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:02.588369 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a4bef1a4-1a0d-463b-a210-19640a9bd60b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:02.589302 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a4bef1a4-1a0d-463b-a210-19640a9bd60b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:03.495406 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8df1de67-488c-4213-9126-c5026288612e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:03.508312 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8df1de67-488c-4213-9126-c5026288612e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:03.510066 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8df1de67-488c-4213-9126-c5026288612e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:03.521425 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8df1de67-488c-4213-9126-c5026288612e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1724 microversion: 2.20 time: 1.592608 Jul 18 02:46:03.522116 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2201/4408] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:46:01 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1724 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:46:03.534440 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-25e5dcbb-2d18-4464-bc79-54a299931994 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-244541659", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3d1f3f2f-8c86-416a-9c8b-88e33cae40fd"}], "security_groups": [{"name": "tempest-securitygroup--622865264"}], "key_name": "tempest-keypair-1491470079", "user_data": "}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:46:03.754138 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a4bef1a4-1a0d-463b-a210-19640a9bd60b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:03.773023 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a4bef1a4-1a0d-463b-a210-19640a9bd60b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1515 microversion: 2.1 time: 1.227923 Jul 18 02:46:03.782744 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2208/4409] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:02 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1515 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:46:04.340487 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-25e5dcbb-2d18-4464-bc79-54a299931994 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] validate_networks() for [('3d1f3f2f-8c86-416a-9c8b-88e33cae40fd', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:46:04.542402 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a6e68b88-7687-4bab-ac75-7ed72459a3be tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:04.543346 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a6e68b88-7687-4bab-ac75-7ed72459a3be tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:04.591895 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a6e68b88-7687-4bab-ac75-7ed72459a3be tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:04.593972 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a6e68b88-7687-4bab-ac75-7ed72459a3be tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:04.595800 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a6e68b88-7687-4bab-ac75-7ed72459a3be tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:04.596914 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a6e68b88-7687-4bab-ac75-7ed72459a3be tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:04.684274 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=4 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:46:05.242037 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a6e68b88-7687-4bab-ac75-7ed72459a3be tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:05.278991 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a6e68b88-7687-4bab-ac75-7ed72459a3be tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:05.286119 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a6e68b88-7687-4bab-ac75-7ed72459a3be tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:05.293197 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a6e68b88-7687-4bab-ac75-7ed72459a3be tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1724 microversion: 2.20 time: 0.754786 Jul 18 02:46:05.295117 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2209/4410] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:46:04 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1724 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:46:05.308520 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ac6cca8e-791f-4167-b991-f281b7572d1f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:05.310438 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ac6cca8e-791f-4167-b991-f281b7572d1f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:05.327910 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ac6cca8e-791f-4167-b991-f281b7572d1f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:05.329348 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ac6cca8e-791f-4167-b991-f281b7572d1f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:05.331494 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ac6cca8e-791f-4167-b991-f281b7572d1f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:05.334618 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ac6cca8e-791f-4167-b991-f281b7572d1f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:07.655467 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ac6cca8e-791f-4167-b991-f281b7572d1f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:07.670335 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ac6cca8e-791f-4167-b991-f281b7572d1f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1521 microversion: 2.1 time: 2.373195 Jul 18 02:46:07.671000 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2210/4411] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:05 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1521 bytes in 2375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:07.699473 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a0944097-ff24-4931-8d62-8b5c9c69e6b6 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:07.700351 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a0944097-ff24-4931-8d62-8b5c9c69e6b6 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:07.731279 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a0944097-ff24-4931-8d62-8b5c9c69e6b6 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:07.738449 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a0944097-ff24-4931-8d62-8b5c9c69e6b6 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:07.742354 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a0944097-ff24-4931-8d62-8b5c9c69e6b6 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:07.742824 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a0944097-ff24-4931-8d62-8b5c9c69e6b6 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:08.172840 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-25e5dcbb-2d18-4464-bc79-54a299931994 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:46:08.175357 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-25e5dcbb-2d18-4464-bc79-54a299931994 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:46:08.178034 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-25e5dcbb-2d18-4464-bc79-54a299931994 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:46:08.179098 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-25e5dcbb-2d18-4464-bc79-54a299931994 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:46:08.180022 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-25e5dcbb-2d18-4464-bc79-54a299931994 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:46:08.230671 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25e5dcbb-2d18-4464-bc79-54a299931994 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:08.231482 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25e5dcbb-2d18-4464-bc79-54a299931994 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:08.243827 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25e5dcbb-2d18-4464-bc79-54a299931994 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:08.245220 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25e5dcbb-2d18-4464-bc79-54a299931994 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:08.340845 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-25e5dcbb-2d18-4464-bc79-54a299931994 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Getting quotas for project 8fa714ec7f5a4af0a33f56b45e999a7a. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:46:08.359869 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-25e5dcbb-2d18-4464-bc79-54a299931994 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Getting quotas for user 1be686f2aa93473585ca064041bd8140 and project 8fa714ec7f5a4af0a33f56b45e999a7a. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:46:08.393549 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-25e5dcbb-2d18-4464-bc79-54a299931994 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:46:08.400775 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-25e5dcbb-2d18-4464-bc79-54a299931994 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 2e823ef6-49cc-4fb5-ae76-3d4e87041838] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:46:08.538598 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-25e5dcbb-2d18-4464-bc79-54a299931994 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 5.015308 Jul 18 02:46:08.539434 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2202/4412] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:46:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 5017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:46:08.561338 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a9336215-deec-4650-9051-dc03a29e9821 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:08.562518 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a9336215-deec-4650-9051-dc03a29e9821 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 2e823ef6-49cc-4fb5-ae76-3d4e87041838] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:08.755238 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a9336215-deec-4650-9051-dc03a29e9821 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:08.770684 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a9336215-deec-4650-9051-dc03a29e9821 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838" status: 200 len: 1241 microversion: 2.1 time: 0.213436 Jul 18 02:46:08.774533 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2203/4413] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:08 2022] GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838 => generated 1241 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:08.788164 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-64cbfefb-0b81-495f-824d-771bad1c8d49 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:08.792659 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-64cbfefb-0b81-495f-824d-771bad1c8d49 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:08.806388 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-64cbfefb-0b81-495f-824d-771bad1c8d49 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:08.809148 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-64cbfefb-0b81-495f-824d-771bad1c8d49 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:08.810930 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-64cbfefb-0b81-495f-824d-771bad1c8d49 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:08.815703 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-64cbfefb-0b81-495f-824d-771bad1c8d49 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:08.935983 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a0944097-ff24-4931-8d62-8b5c9c69e6b6 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:08.950976 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a0944097-ff24-4931-8d62-8b5c9c69e6b6 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:08.954747 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a0944097-ff24-4931-8d62-8b5c9c69e6b6 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:08.960588 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a0944097-ff24-4931-8d62-8b5c9c69e6b6 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1724 microversion: 2.20 time: 1.288446 Jul 18 02:46:08.963536 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2211/4414] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:46:07 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1724 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:46:09.565600 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-960348da-6346-4477-b91b-6279dfadbe42 req-da43b96a-639c-468d-9722-b07731ca4de6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5681a932-b6a9-4c1f-8797-69655e66927e", "name": "network-vif-unplugged", "status": "completed", "tag": "97271a32-ec26-4a51-9a97-19f528a9ec9c"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:46:09.586218 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-960348da-6346-4477-b91b-6279dfadbe42 req-da43b96a-639c-468d-9722-b07731ca4de6 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:09.597650 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-960348da-6346-4477-b91b-6279dfadbe42 req-da43b96a-639c-468d-9722-b07731ca4de6 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:09.667268 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-960348da-6346-4477-b91b-6279dfadbe42 req-da43b96a-639c-468d-9722-b07731ca4de6 service nova] Creating event network-vif-unplugged:97271a32-ec26-4a51-9a97-19f528a9ec9c for instance 5681a932-b6a9-4c1f-8797-69655e66927e on n-h1-465891-3 Jul 18 02:46:09.703521 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-960348da-6346-4477-b91b-6279dfadbe42 req-da43b96a-639c-468d-9722-b07731ca4de6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.139862 Jul 18 02:46:09.705649 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2212/4415] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:46:09.719139 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-64cbfefb-0b81-495f-824d-771bad1c8d49 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:09.723903 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:46:09.757545 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-64cbfefb-0b81-495f-824d-771bad1c8d49 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1521 microversion: 2.1 time: 0.979859 Jul 18 02:46:09.770748 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2204/4416] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:08 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1521 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:09.806860 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-85b04891-cf77-4ade-b282-70980b9de76d tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:09.807858 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-85b04891-cf77-4ade-b282-70980b9de76d tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 2e823ef6-49cc-4fb5-ae76-3d4e87041838] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:09.951856 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-85b04891-cf77-4ade-b282-70980b9de76d tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:09.967333 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-85b04891-cf77-4ade-b282-70980b9de76d tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838" status: 200 len: 1241 microversion: 2.1 time: 0.166831 Jul 18 02:46:09.977776 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2213/4417] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:09 2022] GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838 => generated 1241 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:10.004673 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1039b5e7-ce15-4e9b-b8c4-46313e68d39e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:10.006816 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1039b5e7-ce15-4e9b-b8c4-46313e68d39e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:10.034904 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1039b5e7-ce15-4e9b-b8c4-46313e68d39e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:10.045867 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1039b5e7-ce15-4e9b-b8c4-46313e68d39e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:10.047048 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1039b5e7-ce15-4e9b-b8c4-46313e68d39e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:10.048793 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1039b5e7-ce15-4e9b-b8c4-46313e68d39e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:10.400042 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1039b5e7-ce15-4e9b-b8c4-46313e68d39e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:10.411084 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1039b5e7-ce15-4e9b-b8c4-46313e68d39e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:10.448213 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1039b5e7-ce15-4e9b-b8c4-46313e68d39e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:10.458184 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1039b5e7-ce15-4e9b-b8c4-46313e68d39e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1656 microversion: 2.20 time: 0.458163 Jul 18 02:46:10.463049 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2205/4418] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:46:09 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1656 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:46:10.783491 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d2e07e8d-1066-4c3c-9670-03c8c8ba9e0b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:10.784322 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d2e07e8d-1066-4c3c-9670-03c8c8ba9e0b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:10.805394 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d2e07e8d-1066-4c3c-9670-03c8c8ba9e0b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:10.816390 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d2e07e8d-1066-4c3c-9670-03c8c8ba9e0b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:10.818627 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d2e07e8d-1066-4c3c-9670-03c8c8ba9e0b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:10.819725 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d2e07e8d-1066-4c3c-9670-03c8c8ba9e0b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:10.997369 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9c6c9f9b-ab38-4ec2-98cf-aa806043b02f tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:10.999860 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9c6c9f9b-ab38-4ec2-98cf-aa806043b02f tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 2e823ef6-49cc-4fb5-ae76-3d4e87041838] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:11.018917 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9c6c9f9b-ab38-4ec2-98cf-aa806043b02f tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:11.019823 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9c6c9f9b-ab38-4ec2-98cf-aa806043b02f tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:11.022282 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9c6c9f9b-ab38-4ec2-98cf-aa806043b02f tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:11.024605 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9c6c9f9b-ab38-4ec2-98cf-aa806043b02f tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:11.335609 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9c6c9f9b-ab38-4ec2-98cf-aa806043b02f tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:11.366260 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9c6c9f9b-ab38-4ec2-98cf-aa806043b02f tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838" status: 200 len: 1293 microversion: 2.1 time: 0.371715 Jul 18 02:46:11.369797 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2206/4419] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:10 2022] GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838 => generated 1293 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:46:11.392175 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-ef0c3608-689a-4bae-b50e-662cb0521a81 req-d195688a-1530-43ee-a65d-e43a2d9fa8a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "136d1a82-a525-4ff4-860d-31c37c826270", "name": "network-vif-deleted", "tag": "16123f42-6b11-41ec-a212-278fc525a448"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:46:11.428140 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-ef0c3608-689a-4bae-b50e-662cb0521a81 req-d195688a-1530-43ee-a65d-e43a2d9fa8a1 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:11.438066 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-ef0c3608-689a-4bae-b50e-662cb0521a81 req-d195688a-1530-43ee-a65d-e43a2d9fa8a1 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:11.514173 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-ef0c3608-689a-4bae-b50e-662cb0521a81 req-d195688a-1530-43ee-a65d-e43a2d9fa8a1 service nova] Creating event network-vif-deleted:16123f42-6b11-41ec-a212-278fc525a448 for instance 136d1a82-a525-4ff4-860d-31c37c826270 on n-h2-465891-3 Jul 18 02:46:11.542276 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-ef0c3608-689a-4bae-b50e-662cb0521a81 req-d195688a-1530-43ee-a65d-e43a2d9fa8a1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157609 Jul 18 02:46:11.546964 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2207/4420] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:46:11.566150 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-398b6e31-265d-41cc-a036-3c7794bf5cb9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:11.572212 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-398b6e31-265d-41cc-a036-3c7794bf5cb9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:11.601206 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-398b6e31-265d-41cc-a036-3c7794bf5cb9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:11.604282 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-398b6e31-265d-41cc-a036-3c7794bf5cb9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:11.607966 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-398b6e31-265d-41cc-a036-3c7794bf5cb9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:11.614015 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-398b6e31-265d-41cc-a036-3c7794bf5cb9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:11.653747 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d2e07e8d-1066-4c3c-9670-03c8c8ba9e0b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:11.690278 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d2e07e8d-1066-4c3c-9670-03c8c8ba9e0b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1521 microversion: 2.1 time: 0.910760 Jul 18 02:46:11.696068 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2214/4421] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:10 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1521 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:11.763413 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-398b6e31-265d-41cc-a036-3c7794bf5cb9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:11.765985 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-398b6e31-265d-41cc-a036-3c7794bf5cb9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:11.766717 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-398b6e31-265d-41cc-a036-3c7794bf5cb9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lazy-loading 'fault' on Instance uuid 136d1a82-a525-4ff4-860d-31c37c826270 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:46:12.127207 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 02:46:12.128316 n-d-465891-3 devstack@n-api.service[119544]: Mon Jul 18 02:46:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 (ip 10.222.0.57) !!! Jul 18 02:46:12.291255 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-398b6e31-265d-41cc-a036-3c7794bf5cb9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:12.300841 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-398b6e31-265d-41cc-a036-3c7794bf5cb9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:12.316097 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-398b6e31-265d-41cc-a036-3c7794bf5cb9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c913445c97f74198a8b4bf441759848d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef74061ad8b4af695d4277c07cf6479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:12.322569 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-398b6e31-265d-41cc-a036-3c7794bf5cb9 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 200 len: 1370 microversion: 2.20 time: 0.772441 Jul 18 02:46:12.324901 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2208/4422] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:46:11 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 1370 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:46:12.393750 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f19cf00a-a853-439a-b3df-026688c05d54 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:12.396906 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f19cf00a-a853-439a-b3df-026688c05d54 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 2e823ef6-49cc-4fb5-ae76-3d4e87041838] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:12.426524 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f19cf00a-a853-439a-b3df-026688c05d54 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:12.427231 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f19cf00a-a853-439a-b3df-026688c05d54 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:12.428874 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f19cf00a-a853-439a-b3df-026688c05d54 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:12.433269 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f19cf00a-a853-439a-b3df-026688c05d54 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:12.701996 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f19cf00a-a853-439a-b3df-026688c05d54 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:12.715243 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-025eccf2-68d3-4365-8c1b-94d17d7a6d8d tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:12.723223 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-025eccf2-68d3-4365-8c1b-94d17d7a6d8d tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:12.742666 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f19cf00a-a853-439a-b3df-026688c05d54 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838" status: 200 len: 1299 microversion: 2.1 time: 0.358116 Jul 18 02:46:12.750219 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2215/4423] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:12 2022] GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838 => generated 1299 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:46:12.758585 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-025eccf2-68d3-4365-8c1b-94d17d7a6d8d tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:12.768827 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-025eccf2-68d3-4365-8c1b-94d17d7a6d8d tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:12.773370 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-025eccf2-68d3-4365-8c1b-94d17d7a6d8d tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:12.775138 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-025eccf2-68d3-4365-8c1b-94d17d7a6d8d tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:13.392476 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4eacc092-1928-4a3f-80c7-90035e31a656 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:13.393798 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4eacc092-1928-4a3f-80c7-90035e31a656 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:13.416585 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4eacc092-1928-4a3f-80c7-90035e31a656 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:13.417259 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4eacc092-1928-4a3f-80c7-90035e31a656 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:13.418540 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4eacc092-1928-4a3f-80c7-90035e31a656 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:13.419530 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4eacc092-1928-4a3f-80c7-90035e31a656 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:13.488976 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-4eacc092-1928-4a3f-80c7-90035e31a656 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] HTTP exception thrown: Instance 136d1a82-a525-4ff4-860d-31c37c826270 could not be found. Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4eacc092-1928-4a3f-80c7-90035e31a656 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Request method failure captured: Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 HTTP/1.1 Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MbiNKkMMelq-GsrcSpgppFL_nD1CPjdoL_gIMoK_0xP3IMz1XzDLX7g8QF3hUp1wzCfYXCEr5U6y7DDp_DFHQwFqDQND8FleYoSuoqD5Z62yD1mzU75S-Qb2KKvSMk1cR6ePwx6bBZ9UnI-pEw7fkQltABOCxnrHaiOVaFExg8xfLg Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: cef74061ad8b4af695d4277c07cf6479 Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-466839570 Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_cef74061ad8b4af695d4277c07cf6479"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/cef74061ad8b4af695d4277c07cf6479"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/cef74061ad8b4af695d4277c07cf6479"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/cef74061ad8b4af695d4277c07cf6479"}]}] Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-AttachVolumeShelveTestJSON-466839570 Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: cef74061ad8b4af695d4277c07cf6479 Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-466839570 Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-AttachVolumeShelveTestJSON-466839570-project Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: c913445c97f74198a8b4bf441759848d Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-AttachVolumeShelveTestJSON-466839570-project Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 136d1a82-a525-4ff4-860d-31c37c826270 could not be found. Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '136d1a82-a525-4ff4-860d-31c37c826270'} Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 136d1a82-a525-4ff4-860d-31c37c826270 could not be found. Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 136d1a82-a525-4ff4-860d-31c37c826270 could not be found. Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:46:13.493488 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:46:13.504782 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:46:13.504782 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:46:13.504782 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:46:13.504782 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:46:13.504782 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:46:13.504782 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:46:13.504782 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 136d1a82-a525-4ff4-860d-31c37c826270 could not be found. Jul 18 02:46:13.504782 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:46:13.504782 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4eacc092-1928-4a3f-80c7-90035e31a656 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Returning 404 to user: Instance 136d1a82-a525-4ff4-860d-31c37c826270 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:46:13.524194 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4eacc092-1928-4a3f-80c7-90035e31a656 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 404 len: 111 microversion: 2.20 time: 0.152022 Jul 18 02:46:13.536881 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2216/4424] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:46:13 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 18 02:46:13.576629 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a043e274-52b6-4a92-948e-a220d5d0509e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '.version_select at 0x7ff49ba9cb80>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:13.656942 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a043e274-52b6-4a92-948e-a220d5d0509e tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-73092805" status: 204 len: 0 microversion: 2.20 time: 0.095614 Jul 18 02:46:13.673817 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2217/4425] 10.222.0.57 () {60 vars in 1255 bytes} [Mon Jul 18 02:46:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-73092805 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:46:13.703020 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-025eccf2-68d3-4365-8c1b-94d17d7a6d8d tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:13.728352 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-025eccf2-68d3-4365-8c1b-94d17d7a6d8d tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1521 microversion: 2.1 time: 1.020310 Jul 18 02:46:13.731389 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2209/4426] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:12 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1521 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:46:13.765430 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-990bf91d-3f20-44d8-a880-1ffb2b578c3a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:13.769320 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-990bf91d-3f20-44d8-a880-1ffb2b578c3a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 2e823ef6-49cc-4fb5-ae76-3d4e87041838] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:13.797749 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-990bf91d-3f20-44d8-a880-1ffb2b578c3a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:13.800370 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-990bf91d-3f20-44d8-a880-1ffb2b578c3a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:13.812408 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-990bf91d-3f20-44d8-a880-1ffb2b578c3a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:13.813333 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-990bf91d-3f20-44d8-a880-1ffb2b578c3a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:14.151012 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-990bf91d-3f20-44d8-a880-1ffb2b578c3a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:14.188812 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-990bf91d-3f20-44d8-a880-1ffb2b578c3a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838" status: 200 len: 1299 microversion: 2.1 time: 0.425875 Jul 18 02:46:14.193906 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2218/4427] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:13 2022] GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838 => generated 1299 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:14.753320 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b6c15837-f154-4a03-b6a0-929edbfc4d54 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:14.754926 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b6c15837-f154-4a03-b6a0-929edbfc4d54 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:14.769909 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6c15837-f154-4a03-b6a0-929edbfc4d54 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:14.779337 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6c15837-f154-4a03-b6a0-929edbfc4d54 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:14.780484 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6c15837-f154-4a03-b6a0-929edbfc4d54 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:14.781159 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6c15837-f154-4a03-b6a0-929edbfc4d54 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:15.218435 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-509074f0-12ae-4efb-b94c-7d35e2b34e5b tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:15.224309 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-509074f0-12ae-4efb-b94c-7d35e2b34e5b tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 2e823ef6-49cc-4fb5-ae76-3d4e87041838] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:15.265289 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-509074f0-12ae-4efb-b94c-7d35e2b34e5b tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:15.268592 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-509074f0-12ae-4efb-b94c-7d35e2b34e5b tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:15.274733 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-509074f0-12ae-4efb-b94c-7d35e2b34e5b tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:15.279281 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-509074f0-12ae-4efb-b94c-7d35e2b34e5b tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:15.797338 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-509074f0-12ae-4efb-b94c-7d35e2b34e5b tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:15.838245 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-509074f0-12ae-4efb-b94c-7d35e2b34e5b tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838" status: 200 len: 1299 microversion: 2.1 time: 0.626019 Jul 18 02:46:15.842722 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2219/4428] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:15 2022] GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838 => generated 1299 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:15.913957 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b6c15837-f154-4a03-b6a0-929edbfc4d54 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:15.934131 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b6c15837-f154-4a03-b6a0-929edbfc4d54 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1521 microversion: 2.1 time: 1.184500 Jul 18 02:46:15.947119 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2210/4429] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:14 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1521 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:16.865637 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6a197768-f628-46a7-8c45-a4aa0a9a1b41 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:16.867294 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6a197768-f628-46a7-8c45-a4aa0a9a1b41 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 2e823ef6-49cc-4fb5-ae76-3d4e87041838] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:16.884555 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a197768-f628-46a7-8c45-a4aa0a9a1b41 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:16.885121 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a197768-f628-46a7-8c45-a4aa0a9a1b41 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:16.886043 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a197768-f628-46a7-8c45-a4aa0a9a1b41 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:16.886497 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a197768-f628-46a7-8c45-a4aa0a9a1b41 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:16.964666 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1bf147ff-6ae3-4ee9-93ae-e73838f75748 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:16.965566 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1bf147ff-6ae3-4ee9-93ae-e73838f75748 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:16.976796 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1bf147ff-6ae3-4ee9-93ae-e73838f75748 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:16.977287 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1bf147ff-6ae3-4ee9-93ae-e73838f75748 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:16.978129 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1bf147ff-6ae3-4ee9-93ae-e73838f75748 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:16.978571 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1bf147ff-6ae3-4ee9-93ae-e73838f75748 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:17.494514 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1bf147ff-6ae3-4ee9-93ae-e73838f75748 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:17.520572 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1bf147ff-6ae3-4ee9-93ae-e73838f75748 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1521 microversion: 2.1 time: 0.559198 Jul 18 02:46:17.538504 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2211/4430] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:16 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1521 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:17.548239 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-0c022a30-ee78-4102-85d1-6fe30c02f2a1 req-1a7562d4-cca5-4a4d-a903-dff08b758db4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5681a932-b6a9-4c1f-8797-69655e66927e", "name": "network-vif-plugged", "status": "completed", "tag": "97271a32-ec26-4a51-9a97-19f528a9ec9c"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:46:17.577978 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-0c022a30-ee78-4102-85d1-6fe30c02f2a1 req-1a7562d4-cca5-4a4d-a903-dff08b758db4 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:17.590906 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-0c022a30-ee78-4102-85d1-6fe30c02f2a1 req-1a7562d4-cca5-4a4d-a903-dff08b758db4 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:17.615598 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-0c022a30-ee78-4102-85d1-6fe30c02f2a1 req-1a7562d4-cca5-4a4d-a903-dff08b758db4 service nova] Creating event network-vif-plugged:97271a32-ec26-4a51-9a97-19f528a9ec9c for instance 5681a932-b6a9-4c1f-8797-69655e66927e on n-h1-465891-3 Jul 18 02:46:17.634591 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-0c022a30-ee78-4102-85d1-6fe30c02f2a1 req-1a7562d4-cca5-4a4d-a903-dff08b758db4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092952 Jul 18 02:46:17.636575 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2212/4431] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:46:18.546135 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:46:18.555419 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9721a030-9a0d-47da-bc31-181105c1c960 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:18.560369 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9721a030-9a0d-47da-bc31-181105c1c960 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:18.593425 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9721a030-9a0d-47da-bc31-181105c1c960 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:18.594301 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9721a030-9a0d-47da-bc31-181105c1c960 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:18.595818 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9721a030-9a0d-47da-bc31-181105c1c960 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:18.596638 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9721a030-9a0d-47da-bc31-181105c1c960 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:18.768261 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=8 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:46:19.394190 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6a197768-f628-46a7-8c45-a4aa0a9a1b41 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:19.472518 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6a197768-f628-46a7-8c45-a4aa0a9a1b41 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838" status: 200 len: 1366 microversion: 2.1 time: 2.611612 Jul 18 02:46:19.473487 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2220/4432] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:16 2022] GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838 => generated 1366 bytes in 2613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:46:19.914401 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9721a030-9a0d-47da-bc31-181105c1c960 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:19.930753 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9721a030-9a0d-47da-bc31-181105c1c960 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1521 microversion: 2.1 time: 1.387949 Jul 18 02:46:19.931368 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2213/4433] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:18 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1521 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:46:20.491857 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bfd36e5f-eb09-441e-b3c8-cc508c8f9bd4 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:20.492633 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bfd36e5f-eb09-441e-b3c8-cc508c8f9bd4 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 2e823ef6-49cc-4fb5-ae76-3d4e87041838] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:20.495771 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:46:20.515346 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bfd36e5f-eb09-441e-b3c8-cc508c8f9bd4 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:20.515819 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bfd36e5f-eb09-441e-b3c8-cc508c8f9bd4 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:20.516704 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bfd36e5f-eb09-441e-b3c8-cc508c8f9bd4 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:20.517217 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bfd36e5f-eb09-441e-b3c8-cc508c8f9bd4 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:20.543328 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:46:20.960478 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-60cfd5ff-aa76-4c15-89fd-69202583d041 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:20.961247 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-60cfd5ff-aa76-4c15-89fd-69202583d041 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:20.973379 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-60cfd5ff-aa76-4c15-89fd-69202583d041 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:20.973872 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-60cfd5ff-aa76-4c15-89fd-69202583d041 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:20.975330 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-60cfd5ff-aa76-4c15-89fd-69202583d041 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:20.975778 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-60cfd5ff-aa76-4c15-89fd-69202583d041 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:21.182472 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bfd36e5f-eb09-441e-b3c8-cc508c8f9bd4 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:21.192283 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bfd36e5f-eb09-441e-b3c8-cc508c8f9bd4 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838" status: 200 len: 1366 microversion: 2.1 time: 0.705154 Jul 18 02:46:21.206142 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2221/4434] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:20 2022] GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838 => generated 1366 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:21.249766 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-2e00d2a5-8e7c-47ea-be62-672e60aa197e req-04526dfb-78e4-40e5-aadf-10875128e054 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e823ef6-49cc-4fb5-ae76-3d4e87041838", "tag": "cc27a935-d7f6-4135-927f-8f7b0181815e"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:46:21.267574 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-2e00d2a5-8e7c-47ea-be62-672e60aa197e req-04526dfb-78e4-40e5-aadf-10875128e054 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:21.268414 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-2e00d2a5-8e7c-47ea-be62-672e60aa197e req-04526dfb-78e4-40e5-aadf-10875128e054 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:21.330657 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-2e00d2a5-8e7c-47ea-be62-672e60aa197e req-04526dfb-78e4-40e5-aadf-10875128e054 service nova] Creating event network-changed:cc27a935-d7f6-4135-927f-8f7b0181815e for instance 2e823ef6-49cc-4fb5-ae76-3d4e87041838 on n-h2-465891-3 Jul 18 02:46:21.350241 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-2e00d2a5-8e7c-47ea-be62-672e60aa197e req-04526dfb-78e4-40e5-aadf-10875128e054 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104723 Jul 18 02:46:21.355931 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2222/4435] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:46:21.982592 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-60cfd5ff-aa76-4c15-89fd-69202583d041 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:21.992904 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-60cfd5ff-aa76-4c15-89fd-69202583d041 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1521 microversion: 2.1 time: 1.037095 Jul 18 02:46:21.994789 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2214/4436] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:20 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1521 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:46:22.212994 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1bbc88b5-17cd-4dc8-96cc-0e2a156d9faf tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:22.213780 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1bbc88b5-17cd-4dc8-96cc-0e2a156d9faf tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 2e823ef6-49cc-4fb5-ae76-3d4e87041838] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:22.248752 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1bbc88b5-17cd-4dc8-96cc-0e2a156d9faf tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:22.248752 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1bbc88b5-17cd-4dc8-96cc-0e2a156d9faf tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:22.252805 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1bbc88b5-17cd-4dc8-96cc-0e2a156d9faf tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:22.253266 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1bbc88b5-17cd-4dc8-96cc-0e2a156d9faf tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:22.628033 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1bbc88b5-17cd-4dc8-96cc-0e2a156d9faf tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:22.653124 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1bbc88b5-17cd-4dc8-96cc-0e2a156d9faf tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838" status: 200 len: 1366 microversion: 2.1 time: 0.446133 Jul 18 02:46:22.661480 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2223/4437] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:22 2022] GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838 => generated 1366 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:23.012465 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-87e54e6b-9d31-4953-9fc4-ce5bb6dc68df tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:23.013782 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-87e54e6b-9d31-4953-9fc4-ce5bb6dc68df tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:23.027542 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:46:23.034024 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-87e54e6b-9d31-4953-9fc4-ce5bb6dc68df tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:23.047800 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-87e54e6b-9d31-4953-9fc4-ce5bb6dc68df tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:23.052494 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-87e54e6b-9d31-4953-9fc4-ce5bb6dc68df tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:23.059044 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-87e54e6b-9d31-4953-9fc4-ce5bb6dc68df tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:23.675568 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-361398d3-723b-4f83-b71b-fef5281163c0 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:23.676889 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-361398d3-723b-4f83-b71b-fef5281163c0 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 2e823ef6-49cc-4fb5-ae76-3d4e87041838] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:23.689253 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-361398d3-723b-4f83-b71b-fef5281163c0 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:23.695437 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-361398d3-723b-4f83-b71b-fef5281163c0 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:23.696183 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-361398d3-723b-4f83-b71b-fef5281163c0 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:23.697121 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-361398d3-723b-4f83-b71b-fef5281163c0 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:23.731606 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-87e54e6b-9d31-4953-9fc4-ce5bb6dc68df tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:23.806340 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-87e54e6b-9d31-4953-9fc4-ce5bb6dc68df tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1506 microversion: 2.1 time: 0.797395 Jul 18 02:46:23.811362 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2215/4438] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:23 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1506 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:46:23.849820 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0a96a705-f82c-4e74-b79e-3a1364b9451b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:23.855408 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0a96a705-f82c-4e74-b79e-3a1364b9451b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:23.873370 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a96a705-f82c-4e74-b79e-3a1364b9451b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:23.874302 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a96a705-f82c-4e74-b79e-3a1364b9451b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:23.876464 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a96a705-f82c-4e74-b79e-3a1364b9451b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:23.877018 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a96a705-f82c-4e74-b79e-3a1364b9451b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:24.869330 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-361398d3-723b-4f83-b71b-fef5281163c0 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:24.904875 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-361398d3-723b-4f83-b71b-fef5281163c0 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838" status: 200 len: 1366 microversion: 2.1 time: 1.232660 Jul 18 02:46:24.914220 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2224/4439] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:23 2022] GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838 => generated 1366 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:46:25.126507 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0a96a705-f82c-4e74-b79e-3a1364b9451b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:25.148148 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0a96a705-f82c-4e74-b79e-3a1364b9451b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 200 len: 1506 microversion: 2.1 time: 1.322838 Jul 18 02:46:25.168744 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2216/4440] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:23 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 1506 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:25.182196 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4811cdb7-d806-4021-b5c8-0ab309266c38 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:25.184733 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4811cdb7-d806-4021-b5c8-0ab309266c38 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:25.219733 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4811cdb7-d806-4021-b5c8-0ab309266c38 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:25.224274 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4811cdb7-d806-4021-b5c8-0ab309266c38 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:25.232563 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4811cdb7-d806-4021-b5c8-0ab309266c38 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:25.234362 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4811cdb7-d806-4021-b5c8-0ab309266c38 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:25.323141 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4811cdb7-d806-4021-b5c8-0ab309266c38 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:46:25.664800 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4811cdb7-d806-4021-b5c8-0ab309266c38 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "DELETE /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 204 len: 0 microversion: 2.1 time: 0.494333 Jul 18 02:46:25.671760 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2225/4441] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:46:25 2022] DELETE /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 0 bytes in 496 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:46:25.933094 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-31a4b3e3-ef3b-4aba-b36f-5989896a6ef8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:25.951169 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-31a4b3e3-ef3b-4aba-b36f-5989896a6ef8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 2e823ef6-49cc-4fb5-ae76-3d4e87041838] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:26.030500 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-31a4b3e3-ef3b-4aba-b36f-5989896a6ef8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:26.033131 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-31a4b3e3-ef3b-4aba-b36f-5989896a6ef8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:26.041846 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-31a4b3e3-ef3b-4aba-b36f-5989896a6ef8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:26.049041 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-31a4b3e3-ef3b-4aba-b36f-5989896a6ef8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:26.156694 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0d8665d2-616d-48c2-9aa6-ea6a51dd7afa tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:26.157671 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0d8665d2-616d-48c2-9aa6-ea6a51dd7afa tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:26.248057 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0d8665d2-616d-48c2-9aa6-ea6a51dd7afa tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:26.249101 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0d8665d2-616d-48c2-9aa6-ea6a51dd7afa tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:26.250651 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0d8665d2-616d-48c2-9aa6-ea6a51dd7afa tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:26.251453 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0d8665d2-616d-48c2-9aa6-ea6a51dd7afa tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:26.381031 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-0d8665d2-616d-48c2-9aa6-ea6a51dd7afa tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] HTTP exception thrown: Instance 136d1a82-a525-4ff4-860d-31c37c826270 could not be found. Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0d8665d2-616d-48c2-9aa6-ea6a51dd7afa tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Request method failure captured: Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 HTTP/1.1 Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MbiNKkMMelq-GsrcSpgppFL_nD1CPjdoL_gIMoK_0xP3IMz1XzDLX7g8QF3hUp1wzCfYXCEr5U6y7DDp_DFHQwFqDQND8FleYoSuoqD5Z62yD1mzU75S-Qb2KKvSMk1cR6ePwx6bBZ9UnI-pEw7fkQltABOCxnrHaiOVaFExg8xfLg Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: cef74061ad8b4af695d4277c07cf6479 Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-466839570 Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_cef74061ad8b4af695d4277c07cf6479"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/cef74061ad8b4af695d4277c07cf6479"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/cef74061ad8b4af695d4277c07cf6479"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/cef74061ad8b4af695d4277c07cf6479"}]}] Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-AttachVolumeShelveTestJSON-466839570 Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: cef74061ad8b4af695d4277c07cf6479 Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-466839570 Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-AttachVolumeShelveTestJSON-466839570-project Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: c913445c97f74198a8b4bf441759848d Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-AttachVolumeShelveTestJSON-466839570-project Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 136d1a82-a525-4ff4-860d-31c37c826270 could not be found. Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '136d1a82-a525-4ff4-860d-31c37c826270'} Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 136d1a82-a525-4ff4-860d-31c37c826270 could not be found. Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:46:26.390896 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:46:26.399950 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 136d1a82-a525-4ff4-860d-31c37c826270 could not be found. Jul 18 02:46:26.399950 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:46:26.399950 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:46:26.399950 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:46:26.399950 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:46:26.399950 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:46:26.399950 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:46:26.399950 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:46:26.399950 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:46:26.399950 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 136d1a82-a525-4ff4-860d-31c37c826270 could not be found. Jul 18 02:46:26.399950 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:46:26.415149 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0d8665d2-616d-48c2-9aa6-ea6a51dd7afa tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Returning 404 to user: Instance 136d1a82-a525-4ff4-860d-31c37c826270 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:46:26.417560 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0d8665d2-616d-48c2-9aa6-ea6a51dd7afa tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "DELETE /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 404 len: 111 microversion: 2.20 time: 0.268575 Jul 18 02:46:26.425086 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2226/4442] 10.222.0.57 () {60 vars in 1279 bytes} [Mon Jul 18 02:46:26 2022] DELETE /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 111 bytes in 279 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:46:26.440270 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-948228b5-7087-44ee-8984-644c7e7d136a tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1226147165", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "ca05c1ce-c949-4f69-b4cd-bdb4d6611509"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:46:26.672392 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-948228b5-7087-44ee-8984-644c7e7d136a tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] validate_networks() for [('ca05c1ce-c949-4f69-b4cd-bdb4d6611509', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:46:28.369375 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-31a4b3e3-ef3b-4aba-b36f-5989896a6ef8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:28.419865 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-31a4b3e3-ef3b-4aba-b36f-5989896a6ef8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838" status: 200 len: 1366 microversion: 2.1 time: 2.493757 Jul 18 02:46:28.427875 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2217/4443] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:25 2022] GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838 => generated 1366 bytes in 2506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:28.468938 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0f61519f-bfd4-4ebd-bd41-42bcfb38ae88 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:28.484430 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0f61519f-bfd4-4ebd-bd41-42bcfb38ae88 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: 136d1a82-a525-4ff4-860d-31c37c826270] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:28.505403 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f61519f-bfd4-4ebd-bd41-42bcfb38ae88 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:28.506173 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f61519f-bfd4-4ebd-bd41-42bcfb38ae88 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:28.507341 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f61519f-bfd4-4ebd-bd41-42bcfb38ae88 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:28.508291 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f61519f-bfd4-4ebd-bd41-42bcfb38ae88 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:28.562369 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-0f61519f-bfd4-4ebd-bd41-42bcfb38ae88 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] HTTP exception thrown: Instance 136d1a82-a525-4ff4-860d-31c37c826270 could not be found. Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0f61519f-bfd4-4ebd-bd41-42bcfb38ae88 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Request method failure captured: Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 HTTP/1.1 Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MbiNKkMMelq-GsrcSpgppFL_nD1CPjdoL_gIMoK_0xP3IMz1XzDLX7g8QF3hUp1wzCfYXCEr5U6y7DDp_DFHQwFqDQND8FleYoSuoqD5Z62yD1mzU75S-Qb2KKvSMk1cR6ePwx6bBZ9UnI-pEw7fkQltABOCxnrHaiOVaFExg8xfLg Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: cef74061ad8b4af695d4277c07cf6479 Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-466839570 Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_cef74061ad8b4af695d4277c07cf6479"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/cef74061ad8b4af695d4277c07cf6479"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/cef74061ad8b4af695d4277c07cf6479"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/cef74061ad8b4af695d4277c07cf6479"}]}] Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-AttachVolumeShelveTestJSON-466839570 Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: cef74061ad8b4af695d4277c07cf6479 Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-466839570 Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-AttachVolumeShelveTestJSON-466839570-project Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: c913445c97f74198a8b4bf441759848d Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-AttachVolumeShelveTestJSON-466839570-project Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 136d1a82-a525-4ff4-860d-31c37c826270 could not be found. Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '136d1a82-a525-4ff4-860d-31c37c826270'} Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 136d1a82-a525-4ff4-860d-31c37c826270 could not be found. Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 136d1a82-a525-4ff4-860d-31c37c826270 could not be found. Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:46:28.584067 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:46:28.593151 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:46:28.593151 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:46:28.593151 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:46:28.593151 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:46:28.593151 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:46:28.593151 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:46:28.593151 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 136d1a82-a525-4ff4-860d-31c37c826270 could not be found. Jul 18 02:46:28.593151 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:46:28.593151 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0f61519f-bfd4-4ebd-bd41-42bcfb38ae88 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Returning 404 to user: Instance 136d1a82-a525-4ff4-860d-31c37c826270 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:46:28.593151 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0f61519f-bfd4-4ebd-bd41-42bcfb38ae88 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270" status: 404 len: 111 microversion: 2.20 time: 0.155871 Jul 18 02:46:28.593151 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2218/4444] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:46:28 2022] GET /compute/v2.1/servers/136d1a82-a525-4ff4-860d-31c37c826270 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:46:28.599761 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3ad1a3ec-235b-46c0-ba0a-fcf2d67f4910 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1911596282", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "9489ae69-ac78-4cf2-bac9-937e3ceb6fde", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ba77f5bb-f255-444f-9bd1-1e3dbe42d430"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:46:29.042005 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-3ad1a3ec-235b-46c0-ba0a-fcf2d67f4910 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] validate_networks() for [('ba77f5bb-f255-444f-9bd1-1e3dbe42d430', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:46:30.791099 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-948228b5-7087-44ee-8984-644c7e7d136a tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:46:30.791650 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-948228b5-7087-44ee-8984-644c7e7d136a tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:46:30.792076 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-948228b5-7087-44ee-8984-644c7e7d136a tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:46:30.792491 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-948228b5-7087-44ee-8984-644c7e7d136a tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:46:30.792905 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-948228b5-7087-44ee-8984-644c7e7d136a tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:46:30.816195 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-948228b5-7087-44ee-8984-644c7e7d136a tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:30.820875 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-948228b5-7087-44ee-8984-644c7e7d136a tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:30.822130 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-948228b5-7087-44ee-8984-644c7e7d136a tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:30.822643 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-948228b5-7087-44ee-8984-644c7e7d136a tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:30.861361 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-948228b5-7087-44ee-8984-644c7e7d136a tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Getting quotas for project fcdf9bfc7a9d4e45acebe3c362787290. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:46:30.876924 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-948228b5-7087-44ee-8984-644c7e7d136a tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Getting quotas for user dc0bfd8ccc564f119014fceb1c9ad8ad and project fcdf9bfc7a9d4e45acebe3c362787290. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:46:30.895225 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-948228b5-7087-44ee-8984-644c7e7d136a tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:46:30.899086 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-948228b5-7087-44ee-8984-644c7e7d136a tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 8e86c78e-45f6-425f-b575-6ade39c020ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:46:31.024101 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-948228b5-7087-44ee-8984-644c7e7d136a tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.596874 Jul 18 02:46:31.024844 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2227/4445] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:46:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 4599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:46:31.035356 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ff793a08-bf9a-4634-aa21-c5d47143fd4a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:31.045518 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ff793a08-bf9a-4634-aa21-c5d47143fd4a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 2e823ef6-49cc-4fb5-ae76-3d4e87041838] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:31.063563 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ff793a08-bf9a-4634-aa21-c5d47143fd4a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:31.064404 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ff793a08-bf9a-4634-aa21-c5d47143fd4a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:31.066696 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ff793a08-bf9a-4634-aa21-c5d47143fd4a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:31.070919 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ff793a08-bf9a-4634-aa21-c5d47143fd4a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:32.259896 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-3ad1a3ec-235b-46c0-ba0a-fcf2d67f4910 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:46:32.261867 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-3ad1a3ec-235b-46c0-ba0a-fcf2d67f4910 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:46:32.263083 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-3ad1a3ec-235b-46c0-ba0a-fcf2d67f4910 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:46:32.264099 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-3ad1a3ec-235b-46c0-ba0a-fcf2d67f4910 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:46:32.265584 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-3ad1a3ec-235b-46c0-ba0a-fcf2d67f4910 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:46:32.325005 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3ad1a3ec-235b-46c0-ba0a-fcf2d67f4910 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:32.326217 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3ad1a3ec-235b-46c0-ba0a-fcf2d67f4910 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:32.339865 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3ad1a3ec-235b-46c0-ba0a-fcf2d67f4910 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:32.341030 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3ad1a3ec-235b-46c0-ba0a-fcf2d67f4910 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:32.357646 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ff793a08-bf9a-4634-aa21-c5d47143fd4a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:32.398126 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-3ad1a3ec-235b-46c0-ba0a-fcf2d67f4910 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Getting quotas for project 2b7654e273f6487ba83382da4f96056d. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:46:32.421614 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-3ad1a3ec-235b-46c0-ba0a-fcf2d67f4910 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Getting quotas for user d1afc1702f8045a396b98e5c24b124e7 and project 2b7654e273f6487ba83382da4f96056d. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:46:32.434030 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ff793a08-bf9a-4634-aa21-c5d47143fd4a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838" status: 200 len: 1366 microversion: 2.1 time: 1.402404 Jul 18 02:46:32.439755 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2228/4446] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:31 2022] GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838 => generated 1366 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:32.479867 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-a47baea0-520a-41b9-ac4e-d468b8fa98f6 req-edfbd14a-4e8e-4f9e-a5ae-0258cd9064b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e823ef6-49cc-4fb5-ae76-3d4e87041838", "name": "network-vif-plugged", "status": "completed", "tag": "cc27a935-d7f6-4135-927f-8f7b0181815e"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:46:32.490431 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:46:32.530410 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-a47baea0-520a-41b9-ac4e-d468b8fa98f6 req-edfbd14a-4e8e-4f9e-a5ae-0258cd9064b9 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:32.531745 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-a47baea0-520a-41b9-ac4e-d468b8fa98f6 req-edfbd14a-4e8e-4f9e-a5ae-0258cd9064b9 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:32.593323 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-a47baea0-520a-41b9-ac4e-d468b8fa98f6 req-edfbd14a-4e8e-4f9e-a5ae-0258cd9064b9 service nova] Creating event network-vif-plugged:cc27a935-d7f6-4135-927f-8f7b0181815e for instance 2e823ef6-49cc-4fb5-ae76-3d4e87041838 on n-h2-465891-3 Jul 18 02:46:32.620137 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-a47baea0-520a-41b9-ac4e-d468b8fa98f6 req-edfbd14a-4e8e-4f9e-a5ae-0258cd9064b9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177525 Jul 18 02:46:32.621227 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2229/4447] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:46:32.658518 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-943ec446-2f0a-4bf5-9949-95ed3877b372 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:32.659307 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-943ec446-2f0a-4bf5-9949-95ed3877b372 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 8e86c78e-45f6-425f-b575-6ade39c020ca] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:32.688615 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3ad1a3ec-235b-46c0-ba0a-fcf2d67f4910 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:46:32.691884 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-943ec446-2f0a-4bf5-9949-95ed3877b372 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:32.692350 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-943ec446-2f0a-4bf5-9949-95ed3877b372 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:32.693164 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-943ec446-2f0a-4bf5-9949-95ed3877b372 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:32.693285 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3ad1a3ec-235b-46c0-ba0a-fcf2d67f4910 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: e47d6a60-cb4a-4271-9cf0-6faf19157794] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9489ae69-ac78-4cf2-bac9-937e3ceb6fde',volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:46:32.693641 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-943ec446-2f0a-4bf5-9949-95ed3877b372 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:32.826023 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-943ec446-2f0a-4bf5-9949-95ed3877b372 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:32.856153 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-943ec446-2f0a-4bf5-9949-95ed3877b372 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca" status: 200 len: 1270 microversion: 2.1 time: 0.218936 Jul 18 02:46:32.856844 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2230/4448] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:32 2022] GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca => generated 1270 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:32.887045 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-2a7c8e0d-0d7f-49aa-a468-e24780c70af3 req-3ceb7819-1bbe-4e31-b451-fa7524c28404 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5681a932-b6a9-4c1f-8797-69655e66927e", "name": "network-vif-deleted", "tag": "97271a32-ec26-4a51-9a97-19f528a9ec9c"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:46:32.916255 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-2a7c8e0d-0d7f-49aa-a468-e24780c70af3 req-3ceb7819-1bbe-4e31-b451-fa7524c28404 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:32.918114 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-2a7c8e0d-0d7f-49aa-a468-e24780c70af3 req-3ceb7819-1bbe-4e31-b451-fa7524c28404 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:32.964248 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-2a7c8e0d-0d7f-49aa-a468-e24780c70af3 req-3ceb7819-1bbe-4e31-b451-fa7524c28404 service nova] Creating event network-vif-deleted:97271a32-ec26-4a51-9a97-19f528a9ec9c for instance 5681a932-b6a9-4c1f-8797-69655e66927e on n-h1-465891-3 Jul 18 02:46:32.979832 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-2a7c8e0d-0d7f-49aa-a468-e24780c70af3 req-3ceb7819-1bbe-4e31-b451-fa7524c28404 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096849 Jul 18 02:46:32.980827 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2231/4449] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:46:33.366320 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3ad1a3ec-235b-46c0-ba0a-fcf2d67f4910 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.772807 Jul 18 02:46:33.378158 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2219/4450] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:46:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 4790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:46:33.379232 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-75d52b02-d79d-4a92-b1fe-cddb725e45bb tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:33.379983 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-75d52b02-d79d-4a92-b1fe-cddb725e45bb tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: e47d6a60-cb4a-4271-9cf0-6faf19157794] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:33.455384 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-96557a11-290c-48ce-b059-7d806eeb86d9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:33.456004 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-96557a11-290c-48ce-b059-7d806eeb86d9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 2e823ef6-49cc-4fb5-ae76-3d4e87041838] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:33.471519 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-96557a11-290c-48ce-b059-7d806eeb86d9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:33.471970 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-96557a11-290c-48ce-b059-7d806eeb86d9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:33.472779 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-96557a11-290c-48ce-b059-7d806eeb86d9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:33.473217 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-96557a11-290c-48ce-b059-7d806eeb86d9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:33.580642 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-75d52b02-d79d-4a92-b1fe-cddb725e45bb tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:33.594567 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-75d52b02-d79d-4a92-b1fe-cddb725e45bb tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794" status: 200 len: 1057 microversion: 2.1 time: 0.220340 Jul 18 02:46:33.612898 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2232/4451] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:33 2022] GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794 => generated 1057 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:46:33.876318 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3a57e75e-cbd1-42ae-9fb6-c0d703bdc17d tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:33.877126 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3a57e75e-cbd1-42ae-9fb6-c0d703bdc17d tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 8e86c78e-45f6-425f-b575-6ade39c020ca] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:33.898892 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3a57e75e-cbd1-42ae-9fb6-c0d703bdc17d tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:33.899579 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3a57e75e-cbd1-42ae-9fb6-c0d703bdc17d tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:33.900471 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3a57e75e-cbd1-42ae-9fb6-c0d703bdc17d tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:33.900938 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3a57e75e-cbd1-42ae-9fb6-c0d703bdc17d tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:34.562431 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-96557a11-290c-48ce-b059-7d806eeb86d9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:34.576772 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3a57e75e-cbd1-42ae-9fb6-c0d703bdc17d tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:34.593763 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-96557a11-290c-48ce-b059-7d806eeb86d9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838" status: 200 len: 1366 microversion: 2.1 time: 1.140084 Jul 18 02:46:34.595607 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2220/4452] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:33 2022] GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838 => generated 1366 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:46:34.621131 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3a57e75e-cbd1-42ae-9fb6-c0d703bdc17d tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca" status: 200 len: 1278 microversion: 2.1 time: 0.748427 Jul 18 02:46:34.621795 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2233/4453] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:33 2022] GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca => generated 1278 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:46:34.638060 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c4535e16-daa7-49cb-8200-759f8afcac1e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:34.639323 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c4535e16-daa7-49cb-8200-759f8afcac1e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: e47d6a60-cb4a-4271-9cf0-6faf19157794] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:34.990229 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c4535e16-daa7-49cb-8200-759f8afcac1e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:35.001557 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c4535e16-daa7-49cb-8200-759f8afcac1e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794" status: 200 len: 1057 microversion: 2.1 time: 0.388550 Jul 18 02:46:35.018269 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2221/4454] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:34 2022] GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794 => generated 1057 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:35.617101 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7a1132b1-4750-46d5-8049-738e75c18ca5 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:35.618749 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7a1132b1-4750-46d5-8049-738e75c18ca5 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 2e823ef6-49cc-4fb5-ae76-3d4e87041838] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:35.641764 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5cb3c3bd-7b78-466c-bf26-128689e05c17 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:35.642419 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5cb3c3bd-7b78-466c-bf26-128689e05c17 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 8e86c78e-45f6-425f-b575-6ade39c020ca] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:35.664040 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7a1132b1-4750-46d5-8049-738e75c18ca5 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:35.665770 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5cb3c3bd-7b78-466c-bf26-128689e05c17 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:35.666213 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5cb3c3bd-7b78-466c-bf26-128689e05c17 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:35.668838 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7a1132b1-4750-46d5-8049-738e75c18ca5 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:35.673371 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5cb3c3bd-7b78-466c-bf26-128689e05c17 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:35.675230 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5cb3c3bd-7b78-466c-bf26-128689e05c17 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:35.675754 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7a1132b1-4750-46d5-8049-738e75c18ca5 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:35.678210 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7a1132b1-4750-46d5-8049-738e75c18ca5 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:36.154887 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5cb3c3bd-7b78-466c-bf26-128689e05c17 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:36.179686 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5cb3c3bd-7b78-466c-bf26-128689e05c17 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca" status: 200 len: 1276 microversion: 2.1 time: 0.543859 Jul 18 02:46:36.180183 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2222/4455] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:35 2022] GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca => generated 1276 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:36.220816 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-359ea9d1-aa06-482e-bd7b-fde3f76e7fa0 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:36.221567 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-359ea9d1-aa06-482e-bd7b-fde3f76e7fa0 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: e47d6a60-cb4a-4271-9cf0-6faf19157794] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:36.243791 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-359ea9d1-aa06-482e-bd7b-fde3f76e7fa0 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:36.244253 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-359ea9d1-aa06-482e-bd7b-fde3f76e7fa0 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:36.245071 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-359ea9d1-aa06-482e-bd7b-fde3f76e7fa0 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:36.245514 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-359ea9d1-aa06-482e-bd7b-fde3f76e7fa0 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:36.956084 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-359ea9d1-aa06-482e-bd7b-fde3f76e7fa0 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:36.965402 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-359ea9d1-aa06-482e-bd7b-fde3f76e7fa0 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794" status: 200 len: 1163 microversion: 2.1 time: 0.784098 Jul 18 02:46:36.969874 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2223/4456] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:36 2022] GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794 => generated 1163 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:37.206194 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4784548b-7fec-452c-be17-2f9f4929349c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:37.210315 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4784548b-7fec-452c-be17-2f9f4929349c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 8e86c78e-45f6-425f-b575-6ade39c020ca] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:37.252789 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4784548b-7fec-452c-be17-2f9f4929349c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:37.261894 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4784548b-7fec-452c-be17-2f9f4929349c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:37.265955 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4784548b-7fec-452c-be17-2f9f4929349c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:37.267563 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4784548b-7fec-452c-be17-2f9f4929349c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:39.216282 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4784548b-7fec-452c-be17-2f9f4929349c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:39.221082 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7a1132b1-4750-46d5-8049-738e75c18ca5 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:39.224666 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=100 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:46:39.238980 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7a1132b1-4750-46d5-8049-738e75c18ca5 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838" status: 200 len: 1556 microversion: 2.1 time: 3.629304 Jul 18 02:46:39.254850 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2234/4457] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:35 2022] GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838 => generated 1556 bytes in 3647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:39.266572 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4784548b-7fec-452c-be17-2f9f4929349c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca" status: 200 len: 1318 microversion: 2.1 time: 2.061793 Jul 18 02:46:39.268217 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2224/4458] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:37 2022] GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca => generated 1318 bytes in 2076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:39.282187 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9c8e18fa-0bd3-418e-ab76-1440e7cb00c0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:39.282805 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9c8e18fa-0bd3-418e-ab76-1440e7cb00c0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:39.306061 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9c8e18fa-0bd3-418e-ab76-1440e7cb00c0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:39.306805 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9c8e18fa-0bd3-418e-ab76-1440e7cb00c0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:39.307821 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9c8e18fa-0bd3-418e-ab76-1440e7cb00c0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:39.308734 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9c8e18fa-0bd3-418e-ab76-1440e7cb00c0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:39.316395 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3f050afa-1cff-4a41-b47e-f277c250bb75 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:39.326396 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3f050afa-1cff-4a41-b47e-f277c250bb75 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: e47d6a60-cb4a-4271-9cf0-6faf19157794] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:39.360564 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-9c8e18fa-0bd3-418e-ab76-1440e7cb00c0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] HTTP exception thrown: Instance d18d284e-d055-4fe5-af1c-b41ee803d426 could not be found. Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9c8e18fa-0bd3-418e-ab76-1440e7cb00c0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Request method failure captured: Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 HTTP/1.1 Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MbiNKkMMelq-GsrcSpgppFL_nD1CPjdoL_gIMoK_0xP3IMz1XzDLX7g8QF3hUp1wzCfYXCEr5U6y7DDp_DFHQwFqDQND8FleYoSuoqD5Z62yD1mzU75S-Qb2KKvSMk1cR6ePwx6bBZ9UnI-pEw7fkQltABOCxnrHaiOVaFExg8xfLg Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: cef74061ad8b4af695d4277c07cf6479 Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-466839570 Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_cef74061ad8b4af695d4277c07cf6479"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/cef74061ad8b4af695d4277c07cf6479"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/cef74061ad8b4af695d4277c07cf6479"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/cef74061ad8b4af695d4277c07cf6479"}]}] Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-AttachVolumeShelveTestJSON-466839570 Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: cef74061ad8b4af695d4277c07cf6479 Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-466839570 Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-AttachVolumeShelveTestJSON-466839570-project Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: c913445c97f74198a8b4bf441759848d Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-AttachVolumeShelveTestJSON-466839570-project Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance d18d284e-d055-4fe5-af1c-b41ee803d426 could not be found. Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'd18d284e-d055-4fe5-af1c-b41ee803d426'} Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d18d284e-d055-4fe5-af1c-b41ee803d426 could not be found. Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:46:39.362775 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:46:39.367728 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d18d284e-d055-4fe5-af1c-b41ee803d426 could not be found. Jul 18 02:46:39.367728 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:46:39.367728 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:46:39.367728 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:46:39.367728 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:46:39.367728 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:46:39.367728 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:46:39.367728 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:46:39.367728 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:46:39.367728 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d18d284e-d055-4fe5-af1c-b41ee803d426 could not be found. Jul 18 02:46:39.367728 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:46:39.368800 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3f050afa-1cff-4a41-b47e-f277c250bb75 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:39.372680 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3f050afa-1cff-4a41-b47e-f277c250bb75 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:39.373811 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9c8e18fa-0bd3-418e-ab76-1440e7cb00c0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Returning 404 to user: Instance d18d284e-d055-4fe5-af1c-b41ee803d426 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:46:39.376150 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9c8e18fa-0bd3-418e-ab76-1440e7cb00c0 tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 404 len: 111 microversion: 2.20 time: 0.120157 Jul 18 02:46:39.376337 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3f050afa-1cff-4a41-b47e-f277c250bb75 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:39.386451 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3f050afa-1cff-4a41-b47e-f277c250bb75 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:39.386900 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2235/4459] 10.222.0.57 () {60 vars in 1279 bytes} [Mon Jul 18 02:46:39 2022] DELETE /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:46:39.398603 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4161f9a0-5c55-4974-bd6f-322653cb3888 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:39.411100 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4161f9a0-5c55-4974-bd6f-322653cb3888 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 2e823ef6-49cc-4fb5-ae76-3d4e87041838] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:39.435543 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4161f9a0-5c55-4974-bd6f-322653cb3888 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:39.436655 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4161f9a0-5c55-4974-bd6f-322653cb3888 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:39.437670 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4161f9a0-5c55-4974-bd6f-322653cb3888 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:39.438300 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4161f9a0-5c55-4974-bd6f-322653cb3888 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:39.677365 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3f050afa-1cff-4a41-b47e-f277c250bb75 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:39.722817 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3f050afa-1cff-4a41-b47e-f277c250bb75 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794" status: 200 len: 1173 microversion: 2.1 time: 0.449666 Jul 18 02:46:39.724233 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2225/4460] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:39 2022] GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794 => generated 1173 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:39.749736 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bee73d5d-11fa-49dc-a9d2-51ac555cdc5f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:39.753253 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4161f9a0-5c55-4974-bd6f-322653cb3888 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.364542 Jul 18 02:46:39.755754 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2236/4461] 10.222.0.57 () {58 vars in 1274 bytes} [Mon Jul 18 02:46:39 2022] GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838/os-interface => generated 285 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:46:39.765928 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bee73d5d-11fa-49dc-a9d2-51ac555cdc5f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] [instance: d18d284e-d055-4fe5-af1c-b41ee803d426] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:39.795011 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bee73d5d-11fa-49dc-a9d2-51ac555cdc5f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:39.811044 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bee73d5d-11fa-49dc-a9d2-51ac555cdc5f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:39.812797 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bee73d5d-11fa-49dc-a9d2-51ac555cdc5f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:39.822838 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bee73d5d-11fa-49dc-a9d2-51ac555cdc5f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:39.891918 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-bee73d5d-11fa-49dc-a9d2-51ac555cdc5f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] HTTP exception thrown: Instance d18d284e-d055-4fe5-af1c-b41ee803d426 could not be found. Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bee73d5d-11fa-49dc-a9d2-51ac555cdc5f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Request method failure captured: Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 HTTP/1.1 Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MbiNKkMMelq-GsrcSpgppFL_nD1CPjdoL_gIMoK_0xP3IMz1XzDLX7g8QF3hUp1wzCfYXCEr5U6y7DDp_DFHQwFqDQND8FleYoSuoqD5Z62yD1mzU75S-Qb2KKvSMk1cR6ePwx6bBZ9UnI-pEw7fkQltABOCxnrHaiOVaFExg8xfLg Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: cef74061ad8b4af695d4277c07cf6479 Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-466839570 Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_cef74061ad8b4af695d4277c07cf6479"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/cef74061ad8b4af695d4277c07cf6479"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/cef74061ad8b4af695d4277c07cf6479"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/cef74061ad8b4af695d4277c07cf6479"}]}] Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-AttachVolumeShelveTestJSON-466839570 Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: cef74061ad8b4af695d4277c07cf6479 Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-466839570 Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-AttachVolumeShelveTestJSON-466839570-project Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: c913445c97f74198a8b4bf441759848d Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-AttachVolumeShelveTestJSON-466839570-project Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance d18d284e-d055-4fe5-af1c-b41ee803d426 could not be found. Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'd18d284e-d055-4fe5-af1c-b41ee803d426'} Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d18d284e-d055-4fe5-af1c-b41ee803d426 could not be found. Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d18d284e-d055-4fe5-af1c-b41ee803d426 could not be found. Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:46:39.893972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:46:39.899508 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:46:39.899508 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:46:39.899508 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:46:39.899508 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:46:39.899508 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:46:39.899508 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:46:39.899508 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d18d284e-d055-4fe5-af1c-b41ee803d426 could not be found. Jul 18 02:46:39.899508 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:46:39.901927 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bee73d5d-11fa-49dc-a9d2-51ac555cdc5f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] Returning 404 to user: Instance d18d284e-d055-4fe5-af1c-b41ee803d426 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:46:39.912517 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bee73d5d-11fa-49dc-a9d2-51ac555cdc5f tempest-AttachVolumeShelveTestJSON-466839570 tempest-AttachVolumeShelveTestJSON-466839570-project] 10.222.0.57 "GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426" status: 404 len: 111 microversion: 2.20 time: 0.182088 Jul 18 02:46:39.915316 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2226/4462] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 02:46:39 2022] GET /compute/v2.1/servers/d18d284e-d055-4fe5-af1c-b41ee803d426 => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:46:40.289030 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-491334a4-8803-4b30-a3af-05419fbb7249 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:40.294964 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-491334a4-8803-4b30-a3af-05419fbb7249 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 8e86c78e-45f6-425f-b575-6ade39c020ca] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:40.316892 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-491334a4-8803-4b30-a3af-05419fbb7249 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:40.317679 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-491334a4-8803-4b30-a3af-05419fbb7249 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:40.319672 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-491334a4-8803-4b30-a3af-05419fbb7249 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:40.320457 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-491334a4-8803-4b30-a3af-05419fbb7249 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:40.755873 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fd31884c-8ad2-45cc-83f1-3e0cd1093dd7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:40.757123 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fd31884c-8ad2-45cc-83f1-3e0cd1093dd7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: e47d6a60-cb4a-4271-9cf0-6faf19157794] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:40.786387 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd31884c-8ad2-45cc-83f1-3e0cd1093dd7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:40.787609 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd31884c-8ad2-45cc-83f1-3e0cd1093dd7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:40.789187 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd31884c-8ad2-45cc-83f1-3e0cd1093dd7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:40.792746 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd31884c-8ad2-45cc-83f1-3e0cd1093dd7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:40.843153 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:46:41.302849 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fd31884c-8ad2-45cc-83f1-3e0cd1093dd7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:41.318800 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fd31884c-8ad2-45cc-83f1-3e0cd1093dd7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794" status: 200 len: 1173 microversion: 2.1 time: 0.569011 Jul 18 02:46:41.335762 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2227/4463] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:40 2022] GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794 => generated 1173 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:46:42.337443 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-73d48b08-e037-4a34-8c31-b2f378ff1950 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:42.338474 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-73d48b08-e037-4a34-8c31-b2f378ff1950 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: e47d6a60-cb4a-4271-9cf0-6faf19157794] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:42.353314 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-73d48b08-e037-4a34-8c31-b2f378ff1950 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:42.355020 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-73d48b08-e037-4a34-8c31-b2f378ff1950 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:42.355920 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-73d48b08-e037-4a34-8c31-b2f378ff1950 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:42.357855 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-73d48b08-e037-4a34-8c31-b2f378ff1950 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:42.405451 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:46:42.485280 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-491334a4-8803-4b30-a3af-05419fbb7249 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:42.506780 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-491334a4-8803-4b30-a3af-05419fbb7249 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca" status: 200 len: 1318 microversion: 2.1 time: 2.225103 Jul 18 02:46:42.507408 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2237/4464] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:40 2022] GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca => generated 1318 bytes in 2227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:42.658943 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-73d48b08-e037-4a34-8c31-b2f378ff1950 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:42.682156 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-73d48b08-e037-4a34-8c31-b2f378ff1950 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794" status: 200 len: 1173 microversion: 2.1 time: 0.338989 Jul 18 02:46:42.685689 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2228/4465] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:42 2022] GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794 => generated 1173 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:46:43.388118 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-0fc8a8ce-d532-4462-8e4e-fe0a036f73d9 req-ebdf33bd-d97c-4be2-bb95-9175079a31bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e86c78e-45f6-425f-b575-6ade39c020ca", "tag": "56a9047a-e9d8-4517-ac48-942dc91fdade"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:46:43.427351 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-0fc8a8ce-d532-4462-8e4e-fe0a036f73d9 req-ebdf33bd-d97c-4be2-bb95-9175079a31bf service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:43.430119 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-0fc8a8ce-d532-4462-8e4e-fe0a036f73d9 req-ebdf33bd-d97c-4be2-bb95-9175079a31bf service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:43.477452 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-0fc8a8ce-d532-4462-8e4e-fe0a036f73d9 req-ebdf33bd-d97c-4be2-bb95-9175079a31bf service nova] Creating event network-changed:56a9047a-e9d8-4517-ac48-942dc91fdade for instance 8e86c78e-45f6-425f-b575-6ade39c020ca on n-h1-465891-3 Jul 18 02:46:43.490950 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-0fc8a8ce-d532-4462-8e4e-fe0a036f73d9 req-ebdf33bd-d97c-4be2-bb95-9175079a31bf service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110925 Jul 18 02:46:43.496555 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2238/4466] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:46:43.526831 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-dae0fd8d-188a-4ed1-8b80-d5d2356ad853 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:43.527657 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-dae0fd8d-188a-4ed1-8b80-d5d2356ad853 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 8e86c78e-45f6-425f-b575-6ade39c020ca] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:43.542437 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dae0fd8d-188a-4ed1-8b80-d5d2356ad853 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:43.543311 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dae0fd8d-188a-4ed1-8b80-d5d2356ad853 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:43.544328 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dae0fd8d-188a-4ed1-8b80-d5d2356ad853 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:43.544964 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dae0fd8d-188a-4ed1-8b80-d5d2356ad853 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:43.712754 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7b32418d-9d4c-4275-9c91-661e405e366c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:43.713498 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7b32418d-9d4c-4275-9c91-661e405e366c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: e47d6a60-cb4a-4271-9cf0-6faf19157794] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:43.715683 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=8 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:46:43.734825 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7b32418d-9d4c-4275-9c91-661e405e366c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:43.746788 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7b32418d-9d4c-4275-9c91-661e405e366c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:43.752817 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7b32418d-9d4c-4275-9c91-661e405e366c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:43.753553 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7b32418d-9d4c-4275-9c91-661e405e366c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:44.863452 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-dae0fd8d-188a-4ed1-8b80-d5d2356ad853 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:44.866961 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7b32418d-9d4c-4275-9c91-661e405e366c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:44.876174 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7b32418d-9d4c-4275-9c91-661e405e366c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794" status: 200 len: 1215 microversion: 2.1 time: 1.168914 Jul 18 02:46:44.876779 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2239/4467] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:43 2022] GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794 => generated 1215 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:44.903400 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-dae0fd8d-188a-4ed1-8b80-d5d2356ad853 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca" status: 200 len: 1318 microversion: 2.1 time: 1.382188 Jul 18 02:46:44.905529 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2229/4468] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:43 2022] GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca => generated 1318 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:45.896458 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1d0cf873-601f-4af2-8de9-c57303a33e2b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:45.897987 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1d0cf873-601f-4af2-8de9-c57303a33e2b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: e47d6a60-cb4a-4271-9cf0-6faf19157794] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:45.921855 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1d0cf873-601f-4af2-8de9-c57303a33e2b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:45.922311 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1d0cf873-601f-4af2-8de9-c57303a33e2b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:45.923108 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1d0cf873-601f-4af2-8de9-c57303a33e2b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:45.923545 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1d0cf873-601f-4af2-8de9-c57303a33e2b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:45.941238 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a3ea5888-a3d8-41ab-907f-21a764c641d9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:45.947827 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a3ea5888-a3d8-41ab-907f-21a764c641d9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 8e86c78e-45f6-425f-b575-6ade39c020ca] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:45.979181 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=8 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:46:46.004211 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a3ea5888-a3d8-41ab-907f-21a764c641d9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:46.011903 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a3ea5888-a3d8-41ab-907f-21a764c641d9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:46.018348 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a3ea5888-a3d8-41ab-907f-21a764c641d9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:46.021310 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a3ea5888-a3d8-41ab-907f-21a764c641d9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:47.280792 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a3ea5888-a3d8-41ab-907f-21a764c641d9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:47.310978 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a3ea5888-a3d8-41ab-907f-21a764c641d9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca" status: 200 len: 1318 microversion: 2.1 time: 1.386827 Jul 18 02:46:47.314871 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2230/4469] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:45 2022] GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca => generated 1318 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:47.359992 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-a8818b5e-94de-428e-803d-25b8570d2250 req-a8a2c033-8a68-4214-b5f0-99c49d31153b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e823ef6-49cc-4fb5-ae76-3d4e87041838", "tag": "cc27a935-d7f6-4135-927f-8f7b0181815e"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:46:47.444308 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-a8818b5e-94de-428e-803d-25b8570d2250 req-a8a2c033-8a68-4214-b5f0-99c49d31153b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:47.447526 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-a8818b5e-94de-428e-803d-25b8570d2250 req-a8a2c033-8a68-4214-b5f0-99c49d31153b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:47.519672 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-a8818b5e-94de-428e-803d-25b8570d2250 req-a8a2c033-8a68-4214-b5f0-99c49d31153b service nova] Creating event network-changed:cc27a935-d7f6-4135-927f-8f7b0181815e for instance 2e823ef6-49cc-4fb5-ae76-3d4e87041838 on n-h2-465891-3 Jul 18 02:46:47.532807 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-a8818b5e-94de-428e-803d-25b8570d2250 req-a8a2c033-8a68-4214-b5f0-99c49d31153b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.212687 Jul 18 02:46:47.535192 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2231/4470] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:46:47.829845 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1d0cf873-601f-4af2-8de9-c57303a33e2b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:47.863380 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1d0cf873-601f-4af2-8de9-c57303a33e2b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794" status: 200 len: 1215 microversion: 2.1 time: 1.972318 Jul 18 02:46:47.878962 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2240/4471] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:45 2022] GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794 => generated 1215 bytes in 1989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:46:48.334239 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9108244c-50cd-4df8-b59a-49de12de9e65 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:48.336710 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9108244c-50cd-4df8-b59a-49de12de9e65 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 8e86c78e-45f6-425f-b575-6ade39c020ca] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:48.353623 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9108244c-50cd-4df8-b59a-49de12de9e65 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:48.358653 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9108244c-50cd-4df8-b59a-49de12de9e65 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:48.363330 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9108244c-50cd-4df8-b59a-49de12de9e65 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:48.368896 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9108244c-50cd-4df8-b59a-49de12de9e65 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:48.897248 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-78e9b2a0-5c86-4d04-b999-61ddbedef692 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:48.898675 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-78e9b2a0-5c86-4d04-b999-61ddbedef692 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: e47d6a60-cb4a-4271-9cf0-6faf19157794] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:48.920225 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-78e9b2a0-5c86-4d04-b999-61ddbedef692 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:48.921915 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-78e9b2a0-5c86-4d04-b999-61ddbedef692 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:48.923992 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-78e9b2a0-5c86-4d04-b999-61ddbedef692 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:48.927849 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-78e9b2a0-5c86-4d04-b999-61ddbedef692 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:50.006664 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9108244c-50cd-4df8-b59a-49de12de9e65 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:50.022460 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9108244c-50cd-4df8-b59a-49de12de9e65 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca" status: 200 len: 1318 microversion: 2.1 time: 1.694026 Jul 18 02:46:50.023115 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2232/4472] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:48 2022] GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca => generated 1318 bytes in 1696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:46:50.399234 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-78e9b2a0-5c86-4d04-b999-61ddbedef692 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:50.443549 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-e596dae0-0eb8-4feb-93e4-4d40be2faa26 req-4cdc6961-2637-4579-81c4-d5f0d9db56af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e47d6a60-cb4a-4271-9cf0-6faf19157794", "tag": "9756fcb2-6592-4b68-adcb-ad50b74305be"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:46:50.465583 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-e596dae0-0eb8-4feb-93e4-4d40be2faa26 req-4cdc6961-2637-4579-81c4-d5f0d9db56af service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:50.467796 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-e596dae0-0eb8-4feb-93e4-4d40be2faa26 req-4cdc6961-2637-4579-81c4-d5f0d9db56af service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:50.500619 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-e596dae0-0eb8-4feb-93e4-4d40be2faa26 req-4cdc6961-2637-4579-81c4-d5f0d9db56af service nova] Creating event network-changed:9756fcb2-6592-4b68-adcb-ad50b74305be for instance e47d6a60-cb4a-4271-9cf0-6faf19157794 on n-h2-465891-3 Jul 18 02:46:50.519535 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-78e9b2a0-5c86-4d04-b999-61ddbedef692 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794" status: 200 len: 1215 microversion: 2.1 time: 1.619354 Jul 18 02:46:50.520384 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-e596dae0-0eb8-4feb-93e4-4d40be2faa26 req-4cdc6961-2637-4579-81c4-d5f0d9db56af service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081558 Jul 18 02:46:50.521599 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2233/4473] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:46:50.532293 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2241/4474] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:48 2022] GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794 => generated 1215 bytes in 1640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:50.587658 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-dfc293e0-e0c5-4c84-89c1-39417cbfdbb8 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1023928431", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:46:50.712284 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-dfc293e0-e0c5-4c84-89c1-39417cbfdbb8 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] validate_networks() for None {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:46:51.044790 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2b781ac2-a20d-4018-8e85-c7be74da8146 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:51.046367 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2b781ac2-a20d-4018-8e85-c7be74da8146 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 8e86c78e-45f6-425f-b575-6ade39c020ca] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:51.068859 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b781ac2-a20d-4018-8e85-c7be74da8146 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:51.070750 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b781ac2-a20d-4018-8e85-c7be74da8146 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:51.072846 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b781ac2-a20d-4018-8e85-c7be74da8146 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:51.074124 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b781ac2-a20d-4018-8e85-c7be74da8146 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:51.128764 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:46:52.321266 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-dfc293e0-e0c5-4c84-89c1-39417cbfdbb8 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:46:52.323108 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-dfc293e0-e0c5-4c84-89c1-39417cbfdbb8 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:46:52.324232 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-dfc293e0-e0c5-4c84-89c1-39417cbfdbb8 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:46:52.325473 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-dfc293e0-e0c5-4c84-89c1-39417cbfdbb8 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:46:52.326512 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-dfc293e0-e0c5-4c84-89c1-39417cbfdbb8 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:46:52.368793 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dfc293e0-e0c5-4c84-89c1-39417cbfdbb8 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:52.369979 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dfc293e0-e0c5-4c84-89c1-39417cbfdbb8 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:52.372470 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dfc293e0-e0c5-4c84-89c1-39417cbfdbb8 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:52.373599 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dfc293e0-e0c5-4c84-89c1-39417cbfdbb8 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:52.393194 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2b781ac2-a20d-4018-8e85-c7be74da8146 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:52.418527 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2b781ac2-a20d-4018-8e85-c7be74da8146 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca" status: 200 len: 1318 microversion: 2.1 time: 1.380863 Jul 18 02:46:52.420670 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2242/4475] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:51 2022] GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca => generated 1318 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:52.446157 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b204ce9a-a9f7-4cd8-b666-4acc0e0f4993 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:52.448328 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b204ce9a-a9f7-4cd8-b666-4acc0e0f4993 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: e47d6a60-cb4a-4271-9cf0-6faf19157794] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:52.464896 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b204ce9a-a9f7-4cd8-b666-4acc0e0f4993 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:52.466162 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b204ce9a-a9f7-4cd8-b666-4acc0e0f4993 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:52.468382 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b204ce9a-a9f7-4cd8-b666-4acc0e0f4993 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:52.469533 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b204ce9a-a9f7-4cd8-b666-4acc0e0f4993 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:52.483959 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-dfc293e0-e0c5-4c84-89c1-39417cbfdbb8 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Getting quotas for project eaf57f5579384e6c98de376009ad327c. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:46:52.498327 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-dfc293e0-e0c5-4c84-89c1-39417cbfdbb8 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Getting quotas for user 2df996598ee94c26913e8e5f9794612b and project eaf57f5579384e6c98de376009ad327c. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:46:52.543022 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-dfc293e0-e0c5-4c84-89c1-39417cbfdbb8 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:46:52.549030 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-dfc293e0-e0c5-4c84-89c1-39417cbfdbb8 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] [instance: 0f1b07f2-de60-40b1-a1b6-5e11c17c38bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:46:52.687824 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-dfc293e0-e0c5-4c84-89c1-39417cbfdbb8 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.105311 Jul 18 02:46:52.689517 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2234/4476] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:46:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2108 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 02:46:52.707418 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d9ff13b8-e24e-4235-a47e-cbb2bbe5c92a tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:52.708638 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d9ff13b8-e24e-4235-a47e-cbb2bbe5c92a tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] [instance: 0f1b07f2-de60-40b1-a1b6-5e11c17c38bf] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:53.822266 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d9ff13b8-e24e-4235-a47e-cbb2bbe5c92a tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df996598ee94c26913e8e5f9794612b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf57f5579384e6c98de376009ad327c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:53.834968 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d9ff13b8-e24e-4235-a47e-cbb2bbe5c92a tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] 10.222.0.57 "GET /compute/v2.1/servers/0f1b07f2-de60-40b1-a1b6-5e11c17c38bf" status: 200 len: 1215 microversion: 2.1 time: 1.135302 Jul 18 02:46:53.838883 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2235/4477] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:52 2022] GET /compute/v2.1/servers/0f1b07f2-de60-40b1-a1b6-5e11c17c38bf => generated 1215 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:53.850246 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1821da4a-8629-475c-b432-3b9ebb47b5ec tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:53.852024 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1821da4a-8629-475c-b432-3b9ebb47b5ec tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 8e86c78e-45f6-425f-b575-6ade39c020ca] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:53.856617 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:46:53.866826 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1821da4a-8629-475c-b432-3b9ebb47b5ec tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:53.868277 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1821da4a-8629-475c-b432-3b9ebb47b5ec tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:53.869478 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1821da4a-8629-475c-b432-3b9ebb47b5ec tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:53.883677 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1821da4a-8629-475c-b432-3b9ebb47b5ec tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:54.021602 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b204ce9a-a9f7-4cd8-b666-4acc0e0f4993 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:54.047714 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b204ce9a-a9f7-4cd8-b666-4acc0e0f4993 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794" status: 200 len: 1203 microversion: 2.1 time: 1.624845 Jul 18 02:46:54.048338 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2243/4478] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:52 2022] GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794 => generated 1203 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:54.827356 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1821da4a-8629-475c-b432-3b9ebb47b5ec tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:54.838357 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1821da4a-8629-475c-b432-3b9ebb47b5ec tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca" status: 200 len: 1318 microversion: 2.1 time: 0.996925 Jul 18 02:46:54.842171 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2236/4479] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:53 2022] GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca => generated 1318 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:54.868058 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-93355eba-3a9b-42a5-a557-533506505874 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:54.868690 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-93355eba-3a9b-42a5-a557-533506505874 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] [instance: 0f1b07f2-de60-40b1-a1b6-5e11c17c38bf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:54.889368 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-15ee6756-e95f-411f-974a-a19f180ef4e3 req-08f397fe-cd01-464b-b6f7-4bb0e2109879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e86c78e-45f6-425f-b575-6ade39c020ca", "name": "network-vif-plugged", "status": "completed", "tag": "56a9047a-e9d8-4517-ac48-942dc91fdade"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:46:54.889823 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-93355eba-3a9b-42a5-a557-533506505874 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:54.890494 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-93355eba-3a9b-42a5-a557-533506505874 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:54.893242 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-93355eba-3a9b-42a5-a557-533506505874 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:54.893974 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-93355eba-3a9b-42a5-a557-533506505874 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:54.908177 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-15ee6756-e95f-411f-974a-a19f180ef4e3 req-08f397fe-cd01-464b-b6f7-4bb0e2109879 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:54.909024 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-15ee6756-e95f-411f-974a-a19f180ef4e3 req-08f397fe-cd01-464b-b6f7-4bb0e2109879 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:54.943296 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-15ee6756-e95f-411f-974a-a19f180ef4e3 req-08f397fe-cd01-464b-b6f7-4bb0e2109879 service nova] Creating event network-vif-plugged:56a9047a-e9d8-4517-ac48-942dc91fdade for instance 8e86c78e-45f6-425f-b575-6ade39c020ca on n-h1-465891-3 Jul 18 02:46:54.955762 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-15ee6756-e95f-411f-974a-a19f180ef4e3 req-08f397fe-cd01-464b-b6f7-4bb0e2109879 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071495 Jul 18 02:46:54.959166 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2237/4480] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:46:55.050296 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-93355eba-3a9b-42a5-a557-533506505874 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df996598ee94c26913e8e5f9794612b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf57f5579384e6c98de376009ad327c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:55.067503 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-93355eba-3a9b-42a5-a557-533506505874 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] 10.222.0.57 "GET /compute/v2.1/servers/0f1b07f2-de60-40b1-a1b6-5e11c17c38bf" status: 200 len: 1273 microversion: 2.1 time: 0.203996 Jul 18 02:46:55.077159 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a13b4fe1-0de5-4d16-ba7a-8e9fb0f3551b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:55.080213 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a13b4fe1-0de5-4d16-ba7a-8e9fb0f3551b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: e47d6a60-cb4a-4271-9cf0-6faf19157794] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:55.086640 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2244/4481] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:54 2022] GET /compute/v2.1/servers/0f1b07f2-de60-40b1-a1b6-5e11c17c38bf => generated 1273 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:55.108879 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a13b4fe1-0de5-4d16-ba7a-8e9fb0f3551b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:55.113360 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a13b4fe1-0de5-4d16-ba7a-8e9fb0f3551b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:55.114660 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a13b4fe1-0de5-4d16-ba7a-8e9fb0f3551b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:55.115390 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a13b4fe1-0de5-4d16-ba7a-8e9fb0f3551b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:55.873170 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6e377208-5ab7-4424-8c6c-2e94633e5a82 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:55.873923 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6e377208-5ab7-4424-8c6c-2e94633e5a82 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 8e86c78e-45f6-425f-b575-6ade39c020ca] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:55.888905 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e377208-5ab7-4424-8c6c-2e94633e5a82 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:55.893600 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e377208-5ab7-4424-8c6c-2e94633e5a82 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:55.895039 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e377208-5ab7-4424-8c6c-2e94633e5a82 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:55.895875 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e377208-5ab7-4424-8c6c-2e94633e5a82 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:56.015091 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a13b4fe1-0de5-4d16-ba7a-8e9fb0f3551b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:56.035676 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a13b4fe1-0de5-4d16-ba7a-8e9fb0f3551b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794" status: 200 len: 1203 microversion: 2.1 time: 0.969918 Jul 18 02:46:56.037673 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2238/4482] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:55 2022] GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794 => generated 1203 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:56.091833 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a592302e-728b-4c6c-b93b-1e63febcd122 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:56.093075 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a592302e-728b-4c6c-b93b-1e63febcd122 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] [instance: 0f1b07f2-de60-40b1-a1b6-5e11c17c38bf] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:56.145194 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a592302e-728b-4c6c-b93b-1e63febcd122 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:56.145927 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a592302e-728b-4c6c-b93b-1e63febcd122 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.042s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:56.147054 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a592302e-728b-4c6c-b93b-1e63febcd122 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:56.147869 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a592302e-728b-4c6c-b93b-1e63febcd122 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:56.369075 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a592302e-728b-4c6c-b93b-1e63febcd122 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df996598ee94c26913e8e5f9794612b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf57f5579384e6c98de376009ad327c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:56.392730 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a592302e-728b-4c6c-b93b-1e63febcd122 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] 10.222.0.57 "GET /compute/v2.1/servers/0f1b07f2-de60-40b1-a1b6-5e11c17c38bf" status: 200 len: 1273 microversion: 2.1 time: 0.304722 Jul 18 02:46:56.404456 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2239/4483] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:56 2022] GET /compute/v2.1/servers/0f1b07f2-de60-40b1-a1b6-5e11c17c38bf => generated 1273 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:56.801436 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6e377208-5ab7-4424-8c6c-2e94633e5a82 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:56.820353 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6e377208-5ab7-4424-8c6c-2e94633e5a82 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca" status: 200 len: 1318 microversion: 2.1 time: 0.951449 Jul 18 02:46:56.820988 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2245/4484] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:55 2022] GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca => generated 1318 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:46:57.068727 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-840d1b77-f69f-42ce-8750-c3c088f26c25 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:57.069813 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-840d1b77-f69f-42ce-8750-c3c088f26c25 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: e47d6a60-cb4a-4271-9cf0-6faf19157794] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:57.093852 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-840d1b77-f69f-42ce-8750-c3c088f26c25 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:57.097654 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-840d1b77-f69f-42ce-8750-c3c088f26c25 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:57.099549 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-840d1b77-f69f-42ce-8750-c3c088f26c25 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:57.107953 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-840d1b77-f69f-42ce-8750-c3c088f26c25 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:57.418274 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ba20c3d7-e23f-4c94-9aa3-b8226d1fe22c tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:57.431071 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ba20c3d7-e23f-4c94-9aa3-b8226d1fe22c tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] [instance: 0f1b07f2-de60-40b1-a1b6-5e11c17c38bf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:57.476746 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ba20c3d7-e23f-4c94-9aa3-b8226d1fe22c tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:57.482593 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ba20c3d7-e23f-4c94-9aa3-b8226d1fe22c tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:57.487568 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ba20c3d7-e23f-4c94-9aa3-b8226d1fe22c tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:57.493886 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ba20c3d7-e23f-4c94-9aa3-b8226d1fe22c tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:57.507492 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-840d1b77-f69f-42ce-8750-c3c088f26c25 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:57.522718 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-840d1b77-f69f-42ce-8750-c3c088f26c25 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794" status: 200 len: 1203 microversion: 2.1 time: 0.459598 Jul 18 02:46:57.525602 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2240/4485] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:57 2022] GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794 => generated 1203 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:57.778984 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ba20c3d7-e23f-4c94-9aa3-b8226d1fe22c tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df996598ee94c26913e8e5f9794612b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf57f5579384e6c98de376009ad327c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:57.812248 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ba20c3d7-e23f-4c94-9aa3-b8226d1fe22c tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] 10.222.0.57 "GET /compute/v2.1/servers/0f1b07f2-de60-40b1-a1b6-5e11c17c38bf" status: 200 len: 1273 microversion: 2.1 time: 0.403179 Jul 18 02:46:57.818527 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2246/4486] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:57 2022] GET /compute/v2.1/servers/0f1b07f2-de60-40b1-a1b6-5e11c17c38bf => generated 1273 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:57.839492 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c837659a-c85d-43a0-93c4-d0ed5d376c07 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:57.840208 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c837659a-c85d-43a0-93c4-d0ed5d376c07 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 8e86c78e-45f6-425f-b575-6ade39c020ca] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:57.855926 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c837659a-c85d-43a0-93c4-d0ed5d376c07 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:57.856396 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c837659a-c85d-43a0-93c4-d0ed5d376c07 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:57.857862 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c837659a-c85d-43a0-93c4-d0ed5d376c07 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:57.861241 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c837659a-c85d-43a0-93c4-d0ed5d376c07 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:58.246288 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c837659a-c85d-43a0-93c4-d0ed5d376c07 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:58.258792 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c837659a-c85d-43a0-93c4-d0ed5d376c07 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca" status: 200 len: 1508 microversion: 2.1 time: 0.423862 Jul 18 02:46:58.274046 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2241/4487] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:57 2022] GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca => generated 1508 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:46:58.286363 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-eaadeb4b-a679-4b7d-a957-310438dc900c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:58.290053 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-eaadeb4b-a679-4b7d-a957-310438dc900c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 8e86c78e-45f6-425f-b575-6ade39c020ca] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:58.312089 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eaadeb4b-a679-4b7d-a957-310438dc900c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:58.312922 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eaadeb4b-a679-4b7d-a957-310438dc900c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:58.314457 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eaadeb4b-a679-4b7d-a957-310438dc900c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:58.315259 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eaadeb4b-a679-4b7d-a957-310438dc900c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:58.570206 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b890552e-44a5-47a4-9c77-093d639f5834 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:58.574812 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b890552e-44a5-47a4-9c77-093d639f5834 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: e47d6a60-cb4a-4271-9cf0-6faf19157794] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:58.596400 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b890552e-44a5-47a4-9c77-093d639f5834 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:58.597694 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b890552e-44a5-47a4-9c77-093d639f5834 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:58.599377 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b890552e-44a5-47a4-9c77-093d639f5834 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:58.600373 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b890552e-44a5-47a4-9c77-093d639f5834 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:58.942050 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-eaadeb4b-a679-4b7d-a957-310438dc900c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:58.982971 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-eaadeb4b-a679-4b7d-a957-310438dc900c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca" status: 200 len: 1508 microversion: 2.1 time: 0.709352 Jul 18 02:46:59.002974 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2247/4488] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:58 2022] GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca => generated 1508 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:59.021041 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2fd06042-f9b2-43a4-a73c-0de8f2ee80b2 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:59.023823 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2fd06042-f9b2-43a4-a73c-0de8f2ee80b2 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] [instance: 0f1b07f2-de60-40b1-a1b6-5e11c17c38bf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:59.036731 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2fd06042-f9b2-43a4-a73c-0de8f2ee80b2 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:59.038110 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2fd06042-f9b2-43a4-a73c-0de8f2ee80b2 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:59.040764 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2fd06042-f9b2-43a4-a73c-0de8f2ee80b2 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:59.042056 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2fd06042-f9b2-43a4-a73c-0de8f2ee80b2 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:59.106516 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b890552e-44a5-47a4-9c77-093d639f5834 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:59.141837 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b890552e-44a5-47a4-9c77-093d639f5834 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794" status: 200 len: 1203 microversion: 2.1 time: 0.583865 Jul 18 02:46:59.155459 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2242/4489] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:58 2022] GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794 => generated 1203 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:59.161185 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6c368393-d284-4ce1-ad11-b47c078394de tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:46:59.162506 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6c368393-d284-4ce1-ad11-b47c078394de tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 8e86c78e-45f6-425f-b575-6ade39c020ca] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:59.180633 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6c368393-d284-4ce1-ad11-b47c078394de tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:59.181501 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6c368393-d284-4ce1-ad11-b47c078394de tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:59.182667 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6c368393-d284-4ce1-ad11-b47c078394de tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:59.183303 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6c368393-d284-4ce1-ad11-b47c078394de tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:59.358509 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6c368393-d284-4ce1-ad11-b47c078394de tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "PUT /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca" status: 200 len: 1080 microversion: 2.1 time: 0.201446 Jul 18 02:46:59.360077 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2243/4490] 10.222.0.57 () {60 vars in 1255 bytes} [Mon Jul 18 02:46:59 2022] PUT /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca => generated 1080 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:59.376564 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ff85603b-608f-487f-9b58-8f2374430258 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:59.377306 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ff85603b-608f-487f-9b58-8f2374430258 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 8e86c78e-45f6-425f-b575-6ade39c020ca] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:59.387926 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ff85603b-608f-487f-9b58-8f2374430258 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:59.388627 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ff85603b-608f-487f-9b58-8f2374430258 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:59.390483 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ff85603b-608f-487f-9b58-8f2374430258 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:59.390483 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ff85603b-608f-487f-9b58-8f2374430258 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:59.850963 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2fd06042-f9b2-43a4-a73c-0de8f2ee80b2 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df996598ee94c26913e8e5f9794612b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf57f5579384e6c98de376009ad327c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:59.869244 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2fd06042-f9b2-43a4-a73c-0de8f2ee80b2 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] 10.222.0.57 "GET /compute/v2.1/servers/0f1b07f2-de60-40b1-a1b6-5e11c17c38bf" status: 200 len: 1315 microversion: 2.1 time: 0.863445 Jul 18 02:46:59.871641 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2248/4491] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:59 2022] GET /compute/v2.1/servers/0f1b07f2-de60-40b1-a1b6-5e11c17c38bf => generated 1315 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:00.165836 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d642f047-ded3-4f81-b1e6-c911fe0a5f16 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:00.168216 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d642f047-ded3-4f81-b1e6-c911fe0a5f16 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: e47d6a60-cb4a-4271-9cf0-6faf19157794] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:00.181825 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d642f047-ded3-4f81-b1e6-c911fe0a5f16 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:00.183038 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d642f047-ded3-4f81-b1e6-c911fe0a5f16 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:00.184768 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d642f047-ded3-4f81-b1e6-c911fe0a5f16 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:00.185851 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d642f047-ded3-4f81-b1e6-c911fe0a5f16 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:00.281223 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ff85603b-608f-487f-9b58-8f2374430258 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:00.312898 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ff85603b-608f-487f-9b58-8f2374430258 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca" status: 200 len: 1506 microversion: 2.1 time: 0.940871 Jul 18 02:47:00.317219 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2244/4492] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:59 2022] GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca => generated 1506 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:00.348842 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b3adc511-f16a-4296-9cf3-a52b5e48b844 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:00.349803 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b3adc511-f16a-4296-9cf3-a52b5e48b844 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 8e86c78e-45f6-425f-b575-6ade39c020ca] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:00.363826 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b3adc511-f16a-4296-9cf3-a52b5e48b844 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:00.364903 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b3adc511-f16a-4296-9cf3-a52b5e48b844 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:00.367107 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b3adc511-f16a-4296-9cf3-a52b5e48b844 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:00.368263 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b3adc511-f16a-4296-9cf3-a52b5e48b844 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:00.435978 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:01.468808 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d642f047-ded3-4f81-b1e6-c911fe0a5f16 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:01.508415 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d642f047-ded3-4f81-b1e6-c911fe0a5f16 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794" status: 200 len: 1203 microversion: 2.1 time: 1.349678 Jul 18 02:47:01.516647 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2249/4493] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:00 2022] GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794 => generated 1203 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:47:01.536776 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9e94d737-b6fd-4dfe-9777-9e1ca9e3e209 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:01.544379 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9e94d737-b6fd-4dfe-9777-9e1ca9e3e209 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] [instance: 0f1b07f2-de60-40b1-a1b6-5e11c17c38bf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:01.583805 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e94d737-b6fd-4dfe-9777-9e1ca9e3e209 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:01.584543 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e94d737-b6fd-4dfe-9777-9e1ca9e3e209 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:01.585617 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e94d737-b6fd-4dfe-9777-9e1ca9e3e209 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:01.585930 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e94d737-b6fd-4dfe-9777-9e1ca9e3e209 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:01.660728 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b3adc511-f16a-4296-9cf3-a52b5e48b844 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:01.686696 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b3adc511-f16a-4296-9cf3-a52b5e48b844 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca" status: 200 len: 1506 microversion: 2.1 time: 1.341729 Jul 18 02:47:01.687594 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2245/4494] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:00 2022] GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca => generated 1506 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:47:01.721488 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3315a8f0-ae39-4492-9215-211af45d1d24 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:47:01.725018 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3315a8f0-ae39-4492-9215-211af45d1d24 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 8e86c78e-45f6-425f-b575-6ade39c020ca] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:01.740496 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3315a8f0-ae39-4492-9215-211af45d1d24 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:01.742590 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3315a8f0-ae39-4492-9215-211af45d1d24 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:01.750250 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3315a8f0-ae39-4492-9215-211af45d1d24 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:01.751223 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3315a8f0-ae39-4492-9215-211af45d1d24 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:02.010234 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-3315a8f0-ae39-4492-9215-211af45d1d24 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:47:02.011307 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-3315a8f0-ae39-4492-9215-211af45d1d24 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:47:02.012448 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-3315a8f0-ae39-4492-9215-211af45d1d24 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:47:02.013449 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-3315a8f0-ae39-4492-9215-211af45d1d24 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:47:02.014505 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-3315a8f0-ae39-4492-9215-211af45d1d24 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:47:02.123335 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9e94d737-b6fd-4dfe-9777-9e1ca9e3e209 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df996598ee94c26913e8e5f9794612b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf57f5579384e6c98de376009ad327c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:02.144845 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9e94d737-b6fd-4dfe-9777-9e1ca9e3e209 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] 10.222.0.57 "GET /compute/v2.1/servers/0f1b07f2-de60-40b1-a1b6-5e11c17c38bf" status: 200 len: 1315 microversion: 2.1 time: 0.622658 Jul 18 02:47:02.152367 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2250/4495] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:01 2022] GET /compute/v2.1/servers/0f1b07f2-de60-40b1-a1b6-5e11c17c38bf => generated 1315 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:02.159978 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3315a8f0-ae39-4492-9215-211af45d1d24 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 8e86c78e-45f6-425f-b575-6ade39c020ca] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:02.169659 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3315a8f0-ae39-4492-9215-211af45d1d24 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:02.170418 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3315a8f0-ae39-4492-9215-211af45d1d24 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:02.172706 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3315a8f0-ae39-4492-9215-211af45d1d24 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:02.173424 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3315a8f0-ae39-4492-9215-211af45d1d24 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:02.213936 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3315a8f0-ae39-4492-9215-211af45d1d24 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "POST /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca/action" status: 202 len: 1112 microversion: 2.1 time: 0.501023 Jul 18 02:47:02.254061 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2246/4496] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:47:01 2022] POST /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca/action => generated 1112 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 18 02:47:02.254307 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3ae19ea0-cefc-4438-92ff-e4b66b08fb49 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:02.254307 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3ae19ea0-cefc-4438-92ff-e4b66b08fb49 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 8e86c78e-45f6-425f-b575-6ade39c020ca] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:02.280996 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3ae19ea0-cefc-4438-92ff-e4b66b08fb49 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:02.298769 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3ae19ea0-cefc-4438-92ff-e4b66b08fb49 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:02.299799 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3ae19ea0-cefc-4438-92ff-e4b66b08fb49 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:02.300175 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3ae19ea0-cefc-4438-92ff-e4b66b08fb49 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:02.500601 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:02.521214 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-178cdcc3-a763-423f-b257-8abf91736713 req-d873aaf7-a13b-436a-9908-b45c607201bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f1b07f2-de60-40b1-a1b6-5e11c17c38bf", "tag": "c55e853f-4ddd-4ccb-9c59-b2a8eaa97aeb"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:47:02.558367 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-178cdcc3-a763-423f-b257-8abf91736713 req-d873aaf7-a13b-436a-9908-b45c607201bc service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:02.560084 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-178cdcc3-a763-423f-b257-8abf91736713 req-d873aaf7-a13b-436a-9908-b45c607201bc service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:02.592433 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-178cdcc3-a763-423f-b257-8abf91736713 req-d873aaf7-a13b-436a-9908-b45c607201bc service nova] Creating event network-changed:c55e853f-4ddd-4ccb-9c59-b2a8eaa97aeb for instance 0f1b07f2-de60-40b1-a1b6-5e11c17c38bf on n-h1-465891-3 Jul 18 02:47:02.600038 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-178cdcc3-a763-423f-b257-8abf91736713 req-d873aaf7-a13b-436a-9908-b45c607201bc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100203 Jul 18 02:47:02.601064 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2247/4497] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:47:02.650723 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c892a59a-d446-4fdd-9b89-595a5cf25f55 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:02.653438 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c892a59a-d446-4fdd-9b89-595a5cf25f55 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: e47d6a60-cb4a-4271-9cf0-6faf19157794] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:02.699872 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c892a59a-d446-4fdd-9b89-595a5cf25f55 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:02.700682 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c892a59a-d446-4fdd-9b89-595a5cf25f55 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:02.708980 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c892a59a-d446-4fdd-9b89-595a5cf25f55 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:02.709260 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c892a59a-d446-4fdd-9b89-595a5cf25f55 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:03.343888 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3ae19ea0-cefc-4438-92ff-e4b66b08fb49 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:03.390562 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3ae19ea0-cefc-4438-92ff-e4b66b08fb49 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca" status: 200 len: 1517 microversion: 2.1 time: 1.151673 Jul 18 02:47:03.394681 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2251/4498] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:02 2022] GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca => generated 1517 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:03.419666 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-aadb2e4f-4ed5-4be9-a490-372a84396af3 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:03.423842 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c892a59a-d446-4fdd-9b89-595a5cf25f55 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:03.426211 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-aadb2e4f-4ed5-4be9-a490-372a84396af3 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] [instance: 0f1b07f2-de60-40b1-a1b6-5e11c17c38bf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:03.439863 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c892a59a-d446-4fdd-9b89-595a5cf25f55 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794" status: 200 len: 1203 microversion: 2.1 time: 0.830901 Jul 18 02:47:03.459508 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2248/4499] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:02 2022] GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794 => generated 1203 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:03.493495 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=48 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:03.496276 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aadb2e4f-4ed5-4be9-a490-372a84396af3 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:03.497497 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aadb2e4f-4ed5-4be9-a490-372a84396af3 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:03.502191 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aadb2e4f-4ed5-4be9-a490-372a84396af3 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:03.502191 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aadb2e4f-4ed5-4be9-a490-372a84396af3 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:03.957490 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-aadb2e4f-4ed5-4be9-a490-372a84396af3 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df996598ee94c26913e8e5f9794612b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf57f5579384e6c98de376009ad327c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:04.001264 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-aadb2e4f-4ed5-4be9-a490-372a84396af3 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] 10.222.0.57 "GET /compute/v2.1/servers/0f1b07f2-de60-40b1-a1b6-5e11c17c38bf" status: 200 len: 1315 microversion: 2.1 time: 0.598637 Jul 18 02:47:04.003938 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2252/4500] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:03 2022] GET /compute/v2.1/servers/0f1b07f2-de60-40b1-a1b6-5e11c17c38bf => generated 1315 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:04.411736 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3691fb4c-d42b-4a29-8cbb-02a20d8f32de tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:04.413076 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3691fb4c-d42b-4a29-8cbb-02a20d8f32de tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 8e86c78e-45f6-425f-b575-6ade39c020ca] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:04.416818 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=8 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:04.450068 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3691fb4c-d42b-4a29-8cbb-02a20d8f32de tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:04.455584 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3691fb4c-d42b-4a29-8cbb-02a20d8f32de tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:04.461480 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3691fb4c-d42b-4a29-8cbb-02a20d8f32de tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:04.462338 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3691fb4c-d42b-4a29-8cbb-02a20d8f32de tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:04.496047 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2fdab031-b682-4ebb-a58c-48a569a1f596 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:04.496692 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2fdab031-b682-4ebb-a58c-48a569a1f596 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: e47d6a60-cb4a-4271-9cf0-6faf19157794] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:04.511531 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2fdab031-b682-4ebb-a58c-48a569a1f596 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:04.512269 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2fdab031-b682-4ebb-a58c-48a569a1f596 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:04.513261 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2fdab031-b682-4ebb-a58c-48a569a1f596 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:04.515665 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2fdab031-b682-4ebb-a58c-48a569a1f596 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:04.969758 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2fdab031-b682-4ebb-a58c-48a569a1f596 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:04.978234 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3691fb4c-d42b-4a29-8cbb-02a20d8f32de tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:04.990950 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2fdab031-b682-4ebb-a58c-48a569a1f596 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794" status: 200 len: 1203 microversion: 2.1 time: 0.499623 Jul 18 02:47:04.996837 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2253/4501] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:04 2022] GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794 => generated 1203 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:05.032641 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3691fb4c-d42b-4a29-8cbb-02a20d8f32de tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca" status: 200 len: 1517 microversion: 2.1 time: 0.624725 Jul 18 02:47:05.033584 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e82b8dad-1bc5-495a-aa4f-47d43dc5ccd4 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:05.034238 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e82b8dad-1bc5-495a-aa4f-47d43dc5ccd4 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] [instance: 0f1b07f2-de60-40b1-a1b6-5e11c17c38bf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:05.039092 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2249/4502] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:04 2022] GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca => generated 1517 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:05.043613 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e82b8dad-1bc5-495a-aa4f-47d43dc5ccd4 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:05.044502 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e82b8dad-1bc5-495a-aa4f-47d43dc5ccd4 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:05.045840 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e82b8dad-1bc5-495a-aa4f-47d43dc5ccd4 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:05.046967 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e82b8dad-1bc5-495a-aa4f-47d43dc5ccd4 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:05.516161 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e82b8dad-1bc5-495a-aa4f-47d43dc5ccd4 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df996598ee94c26913e8e5f9794612b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf57f5579384e6c98de376009ad327c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:05.536950 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e82b8dad-1bc5-495a-aa4f-47d43dc5ccd4 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] 10.222.0.57 "GET /compute/v2.1/servers/0f1b07f2-de60-40b1-a1b6-5e11c17c38bf" status: 200 len: 1315 microversion: 2.1 time: 0.506887 Jul 18 02:47:05.548384 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2254/4503] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:05 2022] GET /compute/v2.1/servers/0f1b07f2-de60-40b1-a1b6-5e11c17c38bf => generated 1315 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:06.027147 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-670d58a8-bbd1-4cb6-aa65-8de91ff093ba tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:06.035193 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-670d58a8-bbd1-4cb6-aa65-8de91ff093ba tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: e47d6a60-cb4a-4271-9cf0-6faf19157794] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:06.058471 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-670d58a8-bbd1-4cb6-aa65-8de91ff093ba tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:06.059321 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-670d58a8-bbd1-4cb6-aa65-8de91ff093ba tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:06.060187 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-670d58a8-bbd1-4cb6-aa65-8de91ff093ba tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:06.062841 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-670d58a8-bbd1-4cb6-aa65-8de91ff093ba tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:06.071279 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-449acd15-d7c4-476f-bcde-c105d5d5b19c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:06.072897 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-449acd15-d7c4-476f-bcde-c105d5d5b19c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 8e86c78e-45f6-425f-b575-6ade39c020ca] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:06.094370 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-449acd15-d7c4-476f-bcde-c105d5d5b19c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:06.100518 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-449acd15-d7c4-476f-bcde-c105d5d5b19c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:06.102420 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-449acd15-d7c4-476f-bcde-c105d5d5b19c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:06.103523 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-449acd15-d7c4-476f-bcde-c105d5d5b19c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:07.567288 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-449acd15-d7c4-476f-bcde-c105d5d5b19c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:07.588984 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-449acd15-d7c4-476f-bcde-c105d5d5b19c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca" status: 200 len: 1517 microversion: 2.1 time: 1.522977 Jul 18 02:47:07.593618 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2255/4504] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:06 2022] GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca => generated 1517 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:07.612057 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9c90fc36-36ce-4695-87aa-fa607a8cf987 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:07.613029 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9c90fc36-36ce-4695-87aa-fa607a8cf987 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] [instance: 0f1b07f2-de60-40b1-a1b6-5e11c17c38bf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:07.639017 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9c90fc36-36ce-4695-87aa-fa607a8cf987 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:07.640233 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9c90fc36-36ce-4695-87aa-fa607a8cf987 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:07.644949 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9c90fc36-36ce-4695-87aa-fa607a8cf987 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:07.649977 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9c90fc36-36ce-4695-87aa-fa607a8cf987 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:07.922311 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-670d58a8-bbd1-4cb6-aa65-8de91ff093ba tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:07.956981 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-670d58a8-bbd1-4cb6-aa65-8de91ff093ba tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794" status: 200 len: 1203 microversion: 2.1 time: 1.932592 Jul 18 02:47:07.958924 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2250/4505] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:06 2022] GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794 => generated 1203 bytes in 1942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:08.467299 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9c90fc36-36ce-4695-87aa-fa607a8cf987 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df996598ee94c26913e8e5f9794612b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf57f5579384e6c98de376009ad327c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:08.480496 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9c90fc36-36ce-4695-87aa-fa607a8cf987 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] 10.222.0.57 "GET /compute/v2.1/servers/0f1b07f2-de60-40b1-a1b6-5e11c17c38bf" status: 200 len: 1315 microversion: 2.1 time: 0.885270 Jul 18 02:47:08.481417 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2256/4506] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:07 2022] GET /compute/v2.1/servers/0f1b07f2-de60-40b1-a1b6-5e11c17c38bf => generated 1315 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:08.613172 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5bb29db8-91a5-44c9-8a90-820e70deb5ae tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:08.620708 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5bb29db8-91a5-44c9-8a90-820e70deb5ae tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 8e86c78e-45f6-425f-b575-6ade39c020ca] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:08.647301 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5bb29db8-91a5-44c9-8a90-820e70deb5ae tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:08.648104 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5bb29db8-91a5-44c9-8a90-820e70deb5ae tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:08.649618 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5bb29db8-91a5-44c9-8a90-820e70deb5ae tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:08.650484 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5bb29db8-91a5-44c9-8a90-820e70deb5ae tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:08.977168 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4c3eebfa-dc7f-4593-8b7b-ac388cf22238 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:08.978806 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4c3eebfa-dc7f-4593-8b7b-ac388cf22238 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: e47d6a60-cb4a-4271-9cf0-6faf19157794] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:08.998077 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4c3eebfa-dc7f-4593-8b7b-ac388cf22238 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:08.998813 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4c3eebfa-dc7f-4593-8b7b-ac388cf22238 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:08.999811 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4c3eebfa-dc7f-4593-8b7b-ac388cf22238 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:09.000695 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4c3eebfa-dc7f-4593-8b7b-ac388cf22238 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:09.382250 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5bb29db8-91a5-44c9-8a90-820e70deb5ae tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:09.406682 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5bb29db8-91a5-44c9-8a90-820e70deb5ae tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca" status: 200 len: 1517 microversion: 2.1 time: 0.801371 Jul 18 02:47:09.423252 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2251/4507] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:08 2022] GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca => generated 1517 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:09.442873 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-f0b5001b-101f-4e63-b0f3-0d62de509c7b req-d6eb8f84-a566-427b-851b-0e94ee9ee508 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e47d6a60-cb4a-4271-9cf0-6faf19157794", "name": "network-vif-plugged", "status": "completed", "tag": "9756fcb2-6592-4b68-adcb-ad50b74305be"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:47:09.465348 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-f0b5001b-101f-4e63-b0f3-0d62de509c7b req-d6eb8f84-a566-427b-851b-0e94ee9ee508 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:09.466684 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-f0b5001b-101f-4e63-b0f3-0d62de509c7b req-d6eb8f84-a566-427b-851b-0e94ee9ee508 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:09.534040 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4c3eebfa-dc7f-4593-8b7b-ac388cf22238 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:09.603153 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4c3eebfa-dc7f-4593-8b7b-ac388cf22238 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794" status: 200 len: 1203 microversion: 2.1 time: 0.624823 Jul 18 02:47:09.605105 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2257/4508] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:08 2022] GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794 => generated 1203 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:47:09.628206 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7d2c086d-746b-4262-a00c-99368cc7aa6a tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:09.634815 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7d2c086d-746b-4262-a00c-99368cc7aa6a tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] [instance: 0f1b07f2-de60-40b1-a1b6-5e11c17c38bf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:09.649414 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7d2c086d-746b-4262-a00c-99368cc7aa6a tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:09.650666 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7d2c086d-746b-4262-a00c-99368cc7aa6a tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:09.653532 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7d2c086d-746b-4262-a00c-99368cc7aa6a tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:09.654902 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7d2c086d-746b-4262-a00c-99368cc7aa6a tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:10.068443 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-f0b5001b-101f-4e63-b0f3-0d62de509c7b req-d6eb8f84-a566-427b-851b-0e94ee9ee508 service nova] Creating event network-vif-plugged:9756fcb2-6592-4b68-adcb-ad50b74305be for instance e47d6a60-cb4a-4271-9cf0-6faf19157794 on n-h2-465891-3 Jul 18 02:47:10.079287 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-f0b5001b-101f-4e63-b0f3-0d62de509c7b req-d6eb8f84-a566-427b-851b-0e94ee9ee508 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.651466 Jul 18 02:47:10.079287 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2252/4509] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:47:10.446825 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e0f3c640-07d2-4b58-afdb-d5eb7897dd1d tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:10.447549 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e0f3c640-07d2-4b58-afdb-d5eb7897dd1d tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 8e86c78e-45f6-425f-b575-6ade39c020ca] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:10.464428 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e0f3c640-07d2-4b58-afdb-d5eb7897dd1d tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:10.464902 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e0f3c640-07d2-4b58-afdb-d5eb7897dd1d tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:10.465742 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e0f3c640-07d2-4b58-afdb-d5eb7897dd1d tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:10.466198 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e0f3c640-07d2-4b58-afdb-d5eb7897dd1d tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:10.821688 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7d2c086d-746b-4262-a00c-99368cc7aa6a tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df996598ee94c26913e8e5f9794612b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf57f5579384e6c98de376009ad327c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:10.827917 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:10.856734 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7d2c086d-746b-4262-a00c-99368cc7aa6a tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] 10.222.0.57 "GET /compute/v2.1/servers/0f1b07f2-de60-40b1-a1b6-5e11c17c38bf" status: 200 len: 1315 microversion: 2.1 time: 1.238386 Jul 18 02:47:10.857786 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2258/4510] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:09 2022] GET /compute/v2.1/servers/0f1b07f2-de60-40b1-a1b6-5e11c17c38bf => generated 1315 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:10.863121 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ba9c67d0-7029-4166-8176-c26032805f7d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:10.869775 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ba9c67d0-7029-4166-8176-c26032805f7d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: e47d6a60-cb4a-4271-9cf0-6faf19157794] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:10.889223 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ba9c67d0-7029-4166-8176-c26032805f7d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:10.890001 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ba9c67d0-7029-4166-8176-c26032805f7d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:10.891028 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ba9c67d0-7029-4166-8176-c26032805f7d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:10.891646 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ba9c67d0-7029-4166-8176-c26032805f7d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:11.099435 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e0f3c640-07d2-4b58-afdb-d5eb7897dd1d tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:11.112794 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e0f3c640-07d2-4b58-afdb-d5eb7897dd1d tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca" status: 200 len: 1517 microversion: 2.1 time: 0.671478 Jul 18 02:47:11.113407 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2253/4511] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:10 2022] GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca => generated 1517 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:47:11.287351 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ba9c67d0-7029-4166-8176-c26032805f7d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:11.299017 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ba9c67d0-7029-4166-8176-c26032805f7d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794" status: 200 len: 1203 microversion: 2.1 time: 0.439850 Jul 18 02:47:11.300918 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2259/4512] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:10 2022] GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794 => generated 1203 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:11.907360 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-161ea4d3-5441-40a6-8c86-3438921d16d3 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:11.916904 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-161ea4d3-5441-40a6-8c86-3438921d16d3 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] [instance: 0f1b07f2-de60-40b1-a1b6-5e11c17c38bf] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:11.963936 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-161ea4d3-5441-40a6-8c86-3438921d16d3 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:11.965043 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-161ea4d3-5441-40a6-8c86-3438921d16d3 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:11.967741 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-161ea4d3-5441-40a6-8c86-3438921d16d3 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:11.968754 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-161ea4d3-5441-40a6-8c86-3438921d16d3 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:12.145586 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0c42be88-3234-4ea3-9e03-b24fcd4e2e3f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:12.146250 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0c42be88-3234-4ea3-9e03-b24fcd4e2e3f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 8e86c78e-45f6-425f-b575-6ade39c020ca] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:12.162730 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c42be88-3234-4ea3-9e03-b24fcd4e2e3f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:12.163580 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c42be88-3234-4ea3-9e03-b24fcd4e2e3f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:12.164861 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c42be88-3234-4ea3-9e03-b24fcd4e2e3f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:12.165555 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c42be88-3234-4ea3-9e03-b24fcd4e2e3f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:12.751575 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-161ea4d3-5441-40a6-8c86-3438921d16d3 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df996598ee94c26913e8e5f9794612b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf57f5579384e6c98de376009ad327c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:12.776445 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-161ea4d3-5441-40a6-8c86-3438921d16d3 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] 10.222.0.57 "GET /compute/v2.1/servers/0f1b07f2-de60-40b1-a1b6-5e11c17c38bf" status: 200 len: 1315 microversion: 2.1 time: 0.885178 Jul 18 02:47:12.778591 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2254/4513] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:11 2022] GET /compute/v2.1/servers/0f1b07f2-de60-40b1-a1b6-5e11c17c38bf => generated 1315 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:12.788582 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-abe0cabc-80e9-4502-8d2a-0601cb32cdc5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:12.790632 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-abe0cabc-80e9-4502-8d2a-0601cb32cdc5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: e47d6a60-cb4a-4271-9cf0-6faf19157794] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:12.817658 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-abe0cabc-80e9-4502-8d2a-0601cb32cdc5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:12.819959 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-abe0cabc-80e9-4502-8d2a-0601cb32cdc5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:12.823813 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-abe0cabc-80e9-4502-8d2a-0601cb32cdc5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:12.826010 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-abe0cabc-80e9-4502-8d2a-0601cb32cdc5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:12.870361 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0c42be88-3234-4ea3-9e03-b24fcd4e2e3f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:12.922271 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0c42be88-3234-4ea3-9e03-b24fcd4e2e3f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca" status: 200 len: 1517 microversion: 2.1 time: 0.779829 Jul 18 02:47:12.925525 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2260/4514] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:12 2022] GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca => generated 1517 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:47:13.437483 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-9e3fc45e-e8c9-4e65-8696-3fa8050caaa3 req-debd04c9-2984-49e3-b11b-901b8863e4e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f1b07f2-de60-40b1-a1b6-5e11c17c38bf", "name": "network-vif-plugged", "status": "completed", "tag": "c55e853f-4ddd-4ccb-9c59-b2a8eaa97aeb"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:47:13.455081 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-9e3fc45e-e8c9-4e65-8696-3fa8050caaa3 req-debd04c9-2984-49e3-b11b-901b8863e4e9 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:13.455763 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-9e3fc45e-e8c9-4e65-8696-3fa8050caaa3 req-debd04c9-2984-49e3-b11b-901b8863e4e9 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:13.478754 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-9e3fc45e-e8c9-4e65-8696-3fa8050caaa3 req-debd04c9-2984-49e3-b11b-901b8863e4e9 service nova] Creating event network-vif-plugged:c55e853f-4ddd-4ccb-9c59-b2a8eaa97aeb for instance 0f1b07f2-de60-40b1-a1b6-5e11c17c38bf on n-h1-465891-3 Jul 18 02:47:13.495740 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-9e3fc45e-e8c9-4e65-8696-3fa8050caaa3 req-debd04c9-2984-49e3-b11b-901b8863e4e9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062028 Jul 18 02:47:13.496968 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2261/4515] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:47:13.795736 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bbb45c37-f47c-4a6e-a784-fc996a798b26 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:13.796831 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bbb45c37-f47c-4a6e-a784-fc996a798b26 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] [instance: 0f1b07f2-de60-40b1-a1b6-5e11c17c38bf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:13.805034 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bbb45c37-f47c-4a6e-a784-fc996a798b26 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:13.806728 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bbb45c37-f47c-4a6e-a784-fc996a798b26 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:13.808186 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bbb45c37-f47c-4a6e-a784-fc996a798b26 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:13.808358 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bbb45c37-f47c-4a6e-a784-fc996a798b26 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:14.139863 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-abe0cabc-80e9-4502-8d2a-0601cb32cdc5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:14.159736 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-abe0cabc-80e9-4502-8d2a-0601cb32cdc5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794" status: 200 len: 1390 microversion: 2.1 time: 1.378669 Jul 18 02:47:14.173375 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2255/4516] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:12 2022] GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794 => generated 1390 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:14.235123 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3b8ae0b7-2a52-40dd-acf5-e73c7282fd25 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:14.236048 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3b8ae0b7-2a52-40dd-acf5-e73c7282fd25 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 8e86c78e-45f6-425f-b575-6ade39c020ca] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:14.284632 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b8ae0b7-2a52-40dd-acf5-e73c7282fd25 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:14.286344 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b8ae0b7-2a52-40dd-acf5-e73c7282fd25 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:14.288073 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b8ae0b7-2a52-40dd-acf5-e73c7282fd25 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:14.289267 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b8ae0b7-2a52-40dd-acf5-e73c7282fd25 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:14.535311 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bbb45c37-f47c-4a6e-a784-fc996a798b26 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df996598ee94c26913e8e5f9794612b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf57f5579384e6c98de376009ad327c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:14.579909 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bbb45c37-f47c-4a6e-a784-fc996a798b26 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] 10.222.0.57 "GET /compute/v2.1/servers/0f1b07f2-de60-40b1-a1b6-5e11c17c38bf" status: 200 len: 1315 microversion: 2.1 time: 0.780165 Jul 18 02:47:14.588654 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2262/4517] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:13 2022] GET /compute/v2.1/servers/0f1b07f2-de60-40b1-a1b6-5e11c17c38bf => generated 1315 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:14.616336 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5c550968-7dc3-47b7-951f-93bf289c61a5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:14.635995 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5c550968-7dc3-47b7-951f-93bf289c61a5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: e47d6a60-cb4a-4271-9cf0-6faf19157794] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:14.659524 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5c550968-7dc3-47b7-951f-93bf289c61a5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:14.660316 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5c550968-7dc3-47b7-951f-93bf289c61a5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:14.661515 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5c550968-7dc3-47b7-951f-93bf289c61a5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:14.662039 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5c550968-7dc3-47b7-951f-93bf289c61a5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:14.983347 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3b8ae0b7-2a52-40dd-acf5-e73c7282fd25 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:14.999655 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3b8ae0b7-2a52-40dd-acf5-e73c7282fd25 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca" status: 200 len: 1517 microversion: 2.1 time: 0.823254 Jul 18 02:47:15.000270 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2256/4518] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:14 2022] GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca => generated 1517 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:15.154160 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-15e9d753-2e2b-4d33-aaae-d020792d7f2a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:15.156658 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-15e9d753-2e2b-4d33-aaae-d020792d7f2a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 2e823ef6-49cc-4fb5-ae76-3d4e87041838] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:15.173121 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-15e9d753-2e2b-4d33-aaae-d020792d7f2a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:15.174183 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-15e9d753-2e2b-4d33-aaae-d020792d7f2a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:15.175257 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-15e9d753-2e2b-4d33-aaae-d020792d7f2a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:15.176090 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-15e9d753-2e2b-4d33-aaae-d020792d7f2a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:15.191532 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5c550968-7dc3-47b7-951f-93bf289c61a5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:15.226511 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5c550968-7dc3-47b7-951f-93bf289c61a5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794" status: 200 len: 1390 microversion: 2.1 time: 0.626795 Jul 18 02:47:15.237870 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2263/4519] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:14 2022] GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794 => generated 1390 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:15.262112 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-45c7ed96-a4c1-4780-a1f6-c22430a3202e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:15.263415 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-45c7ed96-a4c1-4780-a1f6-c22430a3202e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: e47d6a60-cb4a-4271-9cf0-6faf19157794] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:15.294318 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-15e9d753-2e2b-4d33-aaae-d020792d7f2a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838/ips" status: 200 len: 148 microversion: 2.1 time: 0.151008 Jul 18 02:47:15.297293 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-45c7ed96-a4c1-4780-a1f6-c22430a3202e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:15.297562 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2257/4520] 10.222.0.57 () {58 vars in 1247 bytes} [Mon Jul 18 02:47:15 2022] GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838/ips => generated 148 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:47:15.298708 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-45c7ed96-a4c1-4780-a1f6-c22430a3202e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:15.300456 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-45c7ed96-a4c1-4780-a1f6-c22430a3202e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:15.301545 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-45c7ed96-a4c1-4780-a1f6-c22430a3202e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:15.606004 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-dedf0aca-7f23-430b-be1b-d223c9865a1b tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:15.606639 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-dedf0aca-7f23-430b-be1b-d223c9865a1b tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] [instance: 0f1b07f2-de60-40b1-a1b6-5e11c17c38bf] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:15.624020 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dedf0aca-7f23-430b-be1b-d223c9865a1b tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:15.624554 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dedf0aca-7f23-430b-be1b-d223c9865a1b tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:15.625469 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dedf0aca-7f23-430b-be1b-d223c9865a1b tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:15.625958 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dedf0aca-7f23-430b-be1b-d223c9865a1b tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:16.262139 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-45c7ed96-a4c1-4780-a1f6-c22430a3202e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:16.280671 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-45c7ed96-a4c1-4780-a1f6-c22430a3202e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794" status: 200 len: 1390 microversion: 2.1 time: 1.038249 Jul 18 02:47:16.282206 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2264/4521] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:15 2022] GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794 => generated 1390 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:47:16.319736 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-dedf0aca-7f23-430b-be1b-d223c9865a1b tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df996598ee94c26913e8e5f9794612b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf57f5579384e6c98de376009ad327c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:16.361412 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-dedf0aca-7f23-430b-be1b-d223c9865a1b tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] 10.222.0.57 "GET /compute/v2.1/servers/0f1b07f2-de60-40b1-a1b6-5e11c17c38bf" status: 200 len: 1315 microversion: 2.1 time: 0.759499 Jul 18 02:47:16.367284 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2258/4522] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:15 2022] GET /compute/v2.1/servers/0f1b07f2-de60-40b1-a1b6-5e11c17c38bf => generated 1315 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:47:16.390044 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1a66c84a-6f16-47f1-938c-09a432693bce tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:16.390689 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1a66c84a-6f16-47f1-938c-09a432693bce tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 8e86c78e-45f6-425f-b575-6ade39c020ca] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:16.409518 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1a66c84a-6f16-47f1-938c-09a432693bce tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:16.409994 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1a66c84a-6f16-47f1-938c-09a432693bce tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:16.411049 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1a66c84a-6f16-47f1-938c-09a432693bce tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:16.411689 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1a66c84a-6f16-47f1-938c-09a432693bce tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:16.703871 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1747a124-fc5b-415a-bdfe-dc286ba9f995 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Action: 'create', calling method: .version_select at 0x7ff49b6f3c10>, body: {"keypair": {"name": "tempest-keypair-711062603", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1hUdu7pZJV0y9OR0oOtgoncE1r2EXRtyvdfwptUMNZ079t5zB71oLIsDrUQE2hdhxms6Lx/HfMbFv/L7OMeyihEAd23u++AMv0UKwSklBfNswJ8PzOa0S+rGXpW8T8JA=="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:47:16.742856 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-1747a124-fc5b-415a-bdfe-dc286ba9f995 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Getting quotas for project e9acec37ba95432eb3ef9b5229167fe8. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:47:16.757326 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-1747a124-fc5b-415a-bdfe-dc286ba9f995 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Getting quotas for user ba8ea645f5364b8497d3e439a2d85e54 and project e9acec37ba95432eb3ef9b5229167fe8. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:47:16.797626 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1747a124-fc5b-415a-bdfe-dc286ba9f995 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.513060 Jul 18 02:47:16.799128 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2265/4523] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 02:47:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:47:16.807489 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0414a5fa-f1bf-4683-af04-2947e93333b1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:16.808308 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0414a5fa-f1bf-4683-af04-2947e93333b1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: e47d6a60-cb4a-4271-9cf0-6faf19157794] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:16.841462 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0414a5fa-f1bf-4683-af04-2947e93333b1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:16.847056 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0414a5fa-f1bf-4683-af04-2947e93333b1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:16.848765 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0414a5fa-f1bf-4683-af04-2947e93333b1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:16.850490 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0414a5fa-f1bf-4683-af04-2947e93333b1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:16.935768 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0414a5fa-f1bf-4683-af04-2947e93333b1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: e47d6a60-cb4a-4271-9cf0-6faf19157794] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:47:16.978638 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1a66c84a-6f16-47f1-938c-09a432693bce tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:16.992775 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1a66c84a-6f16-47f1-938c-09a432693bce tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca" status: 200 len: 1517 microversion: 2.1 time: 0.615723 Jul 18 02:47:16.997954 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2259/4524] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:16 2022] GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca => generated 1517 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:17.267468 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0414a5fa-f1bf-4683-af04-2947e93333b1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "DELETE /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794" status: 204 len: 0 microversion: 2.1 time: 0.465978 Jul 18 02:47:17.269095 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2266/4525] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:47:16 2022] DELETE /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:47:17.282932 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c41057fd-fedd-4ae8-8cc7-53a44699fe61 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:17.284078 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c41057fd-fedd-4ae8-8cc7-53a44699fe61 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: e47d6a60-cb4a-4271-9cf0-6faf19157794] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:17.332827 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c41057fd-fedd-4ae8-8cc7-53a44699fe61 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:17.337514 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c41057fd-fedd-4ae8-8cc7-53a44699fe61 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:17.341362 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c41057fd-fedd-4ae8-8cc7-53a44699fe61 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:17.347017 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c41057fd-fedd-4ae8-8cc7-53a44699fe61 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:17.408512 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a918d83f-9e0d-4edf-8b7c-f7bba099e2df tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:17.418041 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a918d83f-9e0d-4edf-8b7c-f7bba099e2df tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] [instance: 0f1b07f2-de60-40b1-a1b6-5e11c17c38bf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:17.458953 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a918d83f-9e0d-4edf-8b7c-f7bba099e2df tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:17.460086 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a918d83f-9e0d-4edf-8b7c-f7bba099e2df tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:17.466406 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a918d83f-9e0d-4edf-8b7c-f7bba099e2df tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:17.467697 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a918d83f-9e0d-4edf-8b7c-f7bba099e2df tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:18.127236 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c41057fd-fedd-4ae8-8cc7-53a44699fe61 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:18.142077 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c41057fd-fedd-4ae8-8cc7-53a44699fe61 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794" status: 200 len: 1396 microversion: 2.1 time: 0.867919 Jul 18 02:47:18.154823 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2260/4526] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:17 2022] GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794 => generated 1396 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:18.182787 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-36d0a126-f37c-4383-b947-10e38df9845f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:18.183794 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-36d0a126-f37c-4383-b947-10e38df9845f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 8e86c78e-45f6-425f-b575-6ade39c020ca] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:18.198024 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-36d0a126-f37c-4383-b947-10e38df9845f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:18.201596 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-36d0a126-f37c-4383-b947-10e38df9845f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:18.205529 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-36d0a126-f37c-4383-b947-10e38df9845f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:18.216013 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-36d0a126-f37c-4383-b947-10e38df9845f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:18.246710 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:18.412877 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a918d83f-9e0d-4edf-8b7c-f7bba099e2df tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df996598ee94c26913e8e5f9794612b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf57f5579384e6c98de376009ad327c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:18.425194 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a918d83f-9e0d-4edf-8b7c-f7bba099e2df tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] 10.222.0.57 "GET /compute/v2.1/servers/0f1b07f2-de60-40b1-a1b6-5e11c17c38bf" status: 200 len: 1464 microversion: 2.1 time: 1.042022 Jul 18 02:47:18.435243 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2267/4527] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:17 2022] GET /compute/v2.1/servers/0f1b07f2-de60-40b1-a1b6-5e11c17c38bf => generated 1464 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:18.534325 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-36d0a126-f37c-4383-b947-10e38df9845f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:18.545749 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-36d0a126-f37c-4383-b947-10e38df9845f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca" status: 200 len: 1517 microversion: 2.1 time: 0.381790 Jul 18 02:47:18.557484 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2261/4528] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:18 2022] GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca => generated 1517 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:18.575873 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-606c2bac-121c-4f2c-afff-602296feaedc tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:18.576618 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-606c2bac-121c-4f2c-afff-602296feaedc tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] [instance: 0f1b07f2-de60-40b1-a1b6-5e11c17c38bf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:18.587815 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-606c2bac-121c-4f2c-afff-602296feaedc tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:18.588545 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-606c2bac-121c-4f2c-afff-602296feaedc tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:18.589507 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-606c2bac-121c-4f2c-afff-602296feaedc tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:18.590105 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-606c2bac-121c-4f2c-afff-602296feaedc tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:18.623277 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-606c2bac-121c-4f2c-afff-602296feaedc tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] [instance: 0f1b07f2-de60-40b1-a1b6-5e11c17c38bf] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:47:18.836813 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-606c2bac-121c-4f2c-afff-602296feaedc tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] 10.222.0.57 "DELETE /compute/v2.1/servers/0f1b07f2-de60-40b1-a1b6-5e11c17c38bf" status: 204 len: 0 microversion: 2.1 time: 0.265427 Jul 18 02:47:18.838193 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2268/4529] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:47:18 2022] DELETE /compute/v2.1/servers/0f1b07f2-de60-40b1-a1b6-5e11c17c38bf => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:47:18.851345 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-60ed3682-3530-4f9d-b8c7-3d00d8386ee4 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:18.852367 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-60ed3682-3530-4f9d-b8c7-3d00d8386ee4 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] [instance: 0f1b07f2-de60-40b1-a1b6-5e11c17c38bf] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:18.864111 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-60ed3682-3530-4f9d-b8c7-3d00d8386ee4 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:18.864907 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-60ed3682-3530-4f9d-b8c7-3d00d8386ee4 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:18.866325 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-60ed3682-3530-4f9d-b8c7-3d00d8386ee4 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:18.868971 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-60ed3682-3530-4f9d-b8c7-3d00d8386ee4 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:19.167414 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-aa12951a-495e-43bb-9802-ac893c0fd361 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:19.168165 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-aa12951a-495e-43bb-9802-ac893c0fd361 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: e47d6a60-cb4a-4271-9cf0-6faf19157794] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:19.193889 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aa12951a-495e-43bb-9802-ac893c0fd361 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:19.194374 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aa12951a-495e-43bb-9802-ac893c0fd361 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:19.199773 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aa12951a-495e-43bb-9802-ac893c0fd361 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:19.202158 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aa12951a-495e-43bb-9802-ac893c0fd361 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:20.027042 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-60ed3682-3530-4f9d-b8c7-3d00d8386ee4 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df996598ee94c26913e8e5f9794612b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf57f5579384e6c98de376009ad327c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:20.053926 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-60ed3682-3530-4f9d-b8c7-3d00d8386ee4 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] 10.222.0.57 "GET /compute/v2.1/servers/0f1b07f2-de60-40b1-a1b6-5e11c17c38bf" status: 200 len: 1470 microversion: 2.1 time: 1.207482 Jul 18 02:47:20.056405 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2262/4530] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:18 2022] GET /compute/v2.1/servers/0f1b07f2-de60-40b1-a1b6-5e11c17c38bf => generated 1470 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:47:20.082486 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e6ebaefb-6403-4387-905b-f2d12860e56e tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e89f938b-e3d2-49d8-a0dd-c59ccb193ede"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:47:20.087272 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e6ebaefb-6403-4387-905b-f2d12860e56e tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 2e823ef6-49cc-4fb5-ae76-3d4e87041838] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:20.105972 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e6ebaefb-6403-4387-905b-f2d12860e56e tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:20.110540 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e6ebaefb-6403-4387-905b-f2d12860e56e tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:20.111661 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e6ebaefb-6403-4387-905b-f2d12860e56e tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:20.112909 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e6ebaefb-6403-4387-905b-f2d12860e56e tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:20.709150 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-aa12951a-495e-43bb-9802-ac893c0fd361 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:20.722934 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-aa12951a-495e-43bb-9802-ac893c0fd361 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794" status: 200 len: 1396 microversion: 2.1 time: 1.561122 Jul 18 02:47:20.728694 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2269/4531] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:19 2022] GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794 => generated 1396 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:20.746110 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c2a5d3fd-a6df-4922-9eb4-e03b6d72d497 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:20.747154 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c2a5d3fd-a6df-4922-9eb4-e03b6d72d497 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 8e86c78e-45f6-425f-b575-6ade39c020ca] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:20.760933 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c2a5d3fd-a6df-4922-9eb4-e03b6d72d497 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:20.768216 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c2a5d3fd-a6df-4922-9eb4-e03b6d72d497 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:20.772231 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c2a5d3fd-a6df-4922-9eb4-e03b6d72d497 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:20.773016 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c2a5d3fd-a6df-4922-9eb4-e03b6d72d497 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:20.935122 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e6ebaefb-6403-4387-905b-f2d12860e56e tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "POST /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.857808 Jul 18 02:47:20.960683 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2263/4532] 10.222.0.57 () {60 vars in 1322 bytes} [Mon Jul 18 02:47:20 2022] POST /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838/os-volume_attachments => generated 194 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:47:21.123942 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-05020407-e8c9-440c-8127-c83ce14f980e tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:21.125803 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-05020407-e8c9-440c-8127-c83ce14f980e tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] [instance: 0f1b07f2-de60-40b1-a1b6-5e11c17c38bf] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:21.176095 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-05020407-e8c9-440c-8127-c83ce14f980e tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:21.179664 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-05020407-e8c9-440c-8127-c83ce14f980e tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:21.192929 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-05020407-e8c9-440c-8127-c83ce14f980e tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:21.194862 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-05020407-e8c9-440c-8127-c83ce14f980e tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:22.368352 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c2a5d3fd-a6df-4922-9eb4-e03b6d72d497 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:22.383710 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c2a5d3fd-a6df-4922-9eb4-e03b6d72d497 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca" status: 200 len: 1535 microversion: 2.1 time: 1.651322 Jul 18 02:47:22.397269 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2270/4533] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:20 2022] GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca => generated 1535 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:22.409678 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-589832be-63ab-4b18-9c19-c0cf29eb83a0 req-73bbf2ca-cf7e-4b22-b669-df48410504be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e47d6a60-cb4a-4271-9cf0-6faf19157794", "name": "network-vif-deleted", "tag": "9756fcb2-6592-4b68-adcb-ad50b74305be"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:47:22.433539 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-589832be-63ab-4b18-9c19-c0cf29eb83a0 req-73bbf2ca-cf7e-4b22-b669-df48410504be service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:22.434351 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-589832be-63ab-4b18-9c19-c0cf29eb83a0 req-73bbf2ca-cf7e-4b22-b669-df48410504be service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:22.470714 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-589832be-63ab-4b18-9c19-c0cf29eb83a0 req-73bbf2ca-cf7e-4b22-b669-df48410504be service nova] Creating event network-vif-deleted:9756fcb2-6592-4b68-adcb-ad50b74305be for instance e47d6a60-cb4a-4271-9cf0-6faf19157794 on n-h2-465891-3 Jul 18 02:47:22.479871 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-589832be-63ab-4b18-9c19-c0cf29eb83a0 req-73bbf2ca-cf7e-4b22-b669-df48410504be service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079787 Jul 18 02:47:22.483777 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2271/4534] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:47:22.505566 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e4d2b274-f1f4-4e66-a379-e80d0766d70d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:22.510970 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e4d2b274-f1f4-4e66-a379-e80d0766d70d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: e47d6a60-cb4a-4271-9cf0-6faf19157794] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:22.531823 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e4d2b274-f1f4-4e66-a379-e80d0766d70d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:22.533302 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e4d2b274-f1f4-4e66-a379-e80d0766d70d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:22.535803 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e4d2b274-f1f4-4e66-a379-e80d0766d70d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:22.537147 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e4d2b274-f1f4-4e66-a379-e80d0766d70d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:22.547604 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-05020407-e8c9-440c-8127-c83ce14f980e tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df996598ee94c26913e8e5f9794612b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf57f5579384e6c98de376009ad327c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:22.566147 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-05020407-e8c9-440c-8127-c83ce14f980e tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] 10.222.0.57 "GET /compute/v2.1/servers/0f1b07f2-de60-40b1-a1b6-5e11c17c38bf" status: 200 len: 1470 microversion: 2.1 time: 1.480694 Jul 18 02:47:22.572995 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2264/4535] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:21 2022] GET /compute/v2.1/servers/0f1b07f2-de60-40b1-a1b6-5e11c17c38bf => generated 1470 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:22.594416 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9dd21bbe-7f15-4205-8774-376e9d02aca4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-430906408", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "395b63d2-26ed-4dfa-9dfb-5fb6892ff72e"}], "security_groups": [{"name": "tempest-securitygroup--1551892536"}], "key_name": "tempest-keypair-711062603", "user_data": "}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:47:22.803327 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e4d2b274-f1f4-4e66-a379-e80d0766d70d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:22.819581 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e4d2b274-f1f4-4e66-a379-e80d0766d70d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794" status: 200 len: 1188 microversion: 2.1 time: 0.334221 Jul 18 02:47:22.833675 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2272/4536] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:22 2022] GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794 => generated 1188 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:22.960765 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-9dd21bbe-7f15-4205-8774-376e9d02aca4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] validate_networks() for [('395b63d2-26ed-4dfa-9dfb-5fb6892ff72e', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:47:23.406910 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d5aab56e-6569-47f2-b5d5-8001336d4428 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:23.407782 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d5aab56e-6569-47f2-b5d5-8001336d4428 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 8e86c78e-45f6-425f-b575-6ade39c020ca] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:23.426362 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5aab56e-6569-47f2-b5d5-8001336d4428 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:23.427463 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5aab56e-6569-47f2-b5d5-8001336d4428 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:23.428544 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5aab56e-6569-47f2-b5d5-8001336d4428 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:23.429192 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5aab56e-6569-47f2-b5d5-8001336d4428 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:24.191110 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d5aab56e-6569-47f2-b5d5-8001336d4428 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:24.215304 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d5aab56e-6569-47f2-b5d5-8001336d4428 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca" status: 200 len: 1523 microversion: 2.1 time: 0.815103 Jul 18 02:47:24.220428 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2273/4537] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:23 2022] GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca => generated 1523 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:24.233575 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-1f122a31-ef3d-4390-b85d-1dfdb030de94 req-29ce0ee5-6ae7-4343-a05f-2124bb26c8fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e86c78e-45f6-425f-b575-6ade39c020ca", "name": "network-vif-unplugged", "status": "completed", "tag": "56a9047a-e9d8-4517-ac48-942dc91fdade"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:47:24.272563 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-1f122a31-ef3d-4390-b85d-1dfdb030de94 req-29ce0ee5-6ae7-4343-a05f-2124bb26c8fa service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:24.276102 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-1f122a31-ef3d-4390-b85d-1dfdb030de94 req-29ce0ee5-6ae7-4343-a05f-2124bb26c8fa service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:24.362387 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-1f122a31-ef3d-4390-b85d-1dfdb030de94 req-29ce0ee5-6ae7-4343-a05f-2124bb26c8fa service nova] Creating event network-vif-unplugged:56a9047a-e9d8-4517-ac48-942dc91fdade for instance 8e86c78e-45f6-425f-b575-6ade39c020ca on n-h1-465891-3 Jul 18 02:47:24.390947 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-1f122a31-ef3d-4390-b85d-1dfdb030de94 req-29ce0ee5-6ae7-4343-a05f-2124bb26c8fa service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.164390 Jul 18 02:47:24.393088 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2274/4538] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:47:24.419084 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-087639a3-d564-41c2-ad7a-0fa566f30cd8 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:24.419996 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-087639a3-d564-41c2-ad7a-0fa566f30cd8 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] [instance: 0f1b07f2-de60-40b1-a1b6-5e11c17c38bf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:24.432292 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-087639a3-d564-41c2-ad7a-0fa566f30cd8 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:24.432915 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-087639a3-d564-41c2-ad7a-0fa566f30cd8 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:24.433860 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-9dd21bbe-7f15-4205-8774-376e9d02aca4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:47:24.434538 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-9dd21bbe-7f15-4205-8774-376e9d02aca4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:47:24.434706 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-087639a3-d564-41c2-ad7a-0fa566f30cd8 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:24.434849 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-9dd21bbe-7f15-4205-8774-376e9d02aca4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:47:24.434999 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-087639a3-d564-41c2-ad7a-0fa566f30cd8 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:24.435147 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-9dd21bbe-7f15-4205-8774-376e9d02aca4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:47:24.435566 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-9dd21bbe-7f15-4205-8774-376e9d02aca4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:47:24.439950 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:24.444536 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=66 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:24.468456 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9dd21bbe-7f15-4205-8774-376e9d02aca4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:24.468456 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9dd21bbe-7f15-4205-8774-376e9d02aca4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:24.469043 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9dd21bbe-7f15-4205-8774-376e9d02aca4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:24.469682 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9dd21bbe-7f15-4205-8774-376e9d02aca4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:24.496894 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-087639a3-d564-41c2-ad7a-0fa566f30cd8 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:24.498030 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-087639a3-d564-41c2-ad7a-0fa566f30cd8 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:24.499205 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-087639a3-d564-41c2-ad7a-0fa566f30cd8 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lazy-loading 'fault' on Instance uuid 0f1b07f2-de60-40b1-a1b6-5e11c17c38bf {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:47:24.537534 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-9dd21bbe-7f15-4205-8774-376e9d02aca4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Getting quotas for project e9acec37ba95432eb3ef9b5229167fe8. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:47:24.546715 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-9dd21bbe-7f15-4205-8774-376e9d02aca4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Getting quotas for user ba8ea645f5364b8497d3e439a2d85e54 and project e9acec37ba95432eb3ef9b5229167fe8. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:47:24.567510 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9dd21bbe-7f15-4205-8774-376e9d02aca4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:47:24.573776 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9dd21bbe-7f15-4205-8774-376e9d02aca4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:47:24.630265 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-087639a3-d564-41c2-ad7a-0fa566f30cd8 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df996598ee94c26913e8e5f9794612b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf57f5579384e6c98de376009ad327c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:24.649434 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-087639a3-d564-41c2-ad7a-0fa566f30cd8 tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] 10.222.0.57 "GET /compute/v2.1/servers/0f1b07f2-de60-40b1-a1b6-5e11c17c38bf" status: 200 len: 1305 microversion: 2.1 time: 0.253400 Jul 18 02:47:24.662963 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2275/4539] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:24 2022] GET /compute/v2.1/servers/0f1b07f2-de60-40b1-a1b6-5e11c17c38bf => generated 1305 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:24.684685 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9dd21bbe-7f15-4205-8774-376e9d02aca4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.106524 Jul 18 02:47:24.689235 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b0749ce8-3e0e-46dd-8c6c-c2c587710f8d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:24.689904 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b0749ce8-3e0e-46dd-8c6c-c2c587710f8d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: e47d6a60-cb4a-4271-9cf0-6faf19157794] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:24.698910 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2265/4540] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:47:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 2121 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:47:24.703567 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b0749ce8-3e0e-46dd-8c6c-c2c587710f8d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:24.704022 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b0749ce8-3e0e-46dd-8c6c-c2c587710f8d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:24.707120 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b0749ce8-3e0e-46dd-8c6c-c2c587710f8d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:24.707567 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b0749ce8-3e0e-46dd-8c6c-c2c587710f8d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:24.714690 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-349e7460-3af3-4581-97e6-81c25bd5935b req-afd15167-34a9-4b67-9f96-f3f40b72b268 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f1b07f2-de60-40b1-a1b6-5e11c17c38bf", "name": "network-vif-deleted", "tag": "c55e853f-4ddd-4ccb-9c59-b2a8eaa97aeb"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:47:24.761769 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-349e7460-3af3-4581-97e6-81c25bd5935b req-afd15167-34a9-4b67-9f96-f3f40b72b268 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:24.762583 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-349e7460-3af3-4581-97e6-81c25bd5935b req-afd15167-34a9-4b67-9f96-f3f40b72b268 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:24.799700 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-349e7460-3af3-4581-97e6-81c25bd5935b req-afd15167-34a9-4b67-9f96-f3f40b72b268 service nova] Creating event network-vif-deleted:c55e853f-4ddd-4ccb-9c59-b2a8eaa97aeb for instance 0f1b07f2-de60-40b1-a1b6-5e11c17c38bf on n-h1-465891-3 Jul 18 02:47:24.830876 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-349e7460-3af3-4581-97e6-81c25bd5935b req-afd15167-34a9-4b67-9f96-f3f40b72b268 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129904 Jul 18 02:47:24.838452 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2266/4541] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:47:24.864813 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5c25f6a3-9810-4311-9646-4a223fb46e80 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:24.866764 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5c25f6a3-9810-4311-9646-4a223fb46e80 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:24.905221 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b0749ce8-3e0e-46dd-8c6c-c2c587710f8d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:24.924071 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b0749ce8-3e0e-46dd-8c6c-c2c587710f8d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794" status: 200 len: 1188 microversion: 2.1 time: 0.259126 Jul 18 02:47:24.925926 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2276/4542] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:24 2022] GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794 => generated 1188 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:24.996504 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5c25f6a3-9810-4311-9646-4a223fb46e80 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:25.022325 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5c25f6a3-9810-4311-9646-4a223fb46e80 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 200 len: 1236 microversion: 2.1 time: 0.181225 Jul 18 02:47:25.042662 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2267/4543] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:24 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 1236 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:25.246044 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4c82241f-412d-4a77-84a4-50d9cec0f17a tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:25.246581 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4c82241f-412d-4a77-84a4-50d9cec0f17a tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 8e86c78e-45f6-425f-b575-6ade39c020ca] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:25.262550 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4c82241f-412d-4a77-84a4-50d9cec0f17a tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:25.263378 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4c82241f-412d-4a77-84a4-50d9cec0f17a tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:25.264439 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4c82241f-412d-4a77-84a4-50d9cec0f17a tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:25.265102 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4c82241f-412d-4a77-84a4-50d9cec0f17a tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:25.674533 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b6ada963-afc4-40be-a44f-5e940eaf926f tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:25.679523 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b6ada963-afc4-40be-a44f-5e940eaf926f tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] [instance: 0f1b07f2-de60-40b1-a1b6-5e11c17c38bf] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:25.705022 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6ada963-afc4-40be-a44f-5e940eaf926f tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:25.705615 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6ada963-afc4-40be-a44f-5e940eaf926f tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:25.707754 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6ada963-afc4-40be-a44f-5e940eaf926f tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:25.709738 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6ada963-afc4-40be-a44f-5e940eaf926f tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:25.727682 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4c82241f-412d-4a77-84a4-50d9cec0f17a tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:25.760344 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-b6ada963-afc4-40be-a44f-5e940eaf926f tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] HTTP exception thrown: Instance 0f1b07f2-de60-40b1-a1b6-5e11c17c38bf could not be found. Jul 18 02:47:25.760595 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4c82241f-412d-4a77-84a4-50d9cec0f17a tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca" status: 200 len: 1523 microversion: 2.1 time: 0.516553 Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b6ada963-afc4-40be-a44f-5e940eaf926f tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Request method failure captured: Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/0f1b07f2-de60-40b1-a1b6-5e11c17c38bf HTTP/1.1 Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MmVR-9kV3FDOw2w6QuKMCEYp1n5wVHYlyFJh4ljGvM0tK3VKvh1xbQiAfUdCCJoHdA54KvqCK27izwKKzjuN6P0Snd3ykwjAM7dB8BtFkbOccgHk3bT-OLwUoAUwg8T-IYHNjgFY43D4g3IgdOIymvqQ0AHQyFt9JIG4z_FYocCtf8 Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: eaf57f5579384e6c98de376009ad327c Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-VolumesNegativeTest-1645262454 Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_eaf57f5579384e6c98de376009ad327c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/eaf57f5579384e6c98de376009ad327c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/eaf57f5579384e6c98de376009ad327c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/eaf57f5579384e6c98de376009ad327c"}]}] Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-VolumesNegativeTest-1645262454 Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: eaf57f5579384e6c98de376009ad327c Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-VolumesNegativeTest-1645262454 Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-VolumesNegativeTest-1645262454-project Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 2df996598ee94c26913e8e5f9794612b Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-VolumesNegativeTest-1645262454-project Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 0f1b07f2-de60-40b1-a1b6-5e11c17c38bf could not be found. Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '0f1b07f2-de60-40b1-a1b6-5e11c17c38bf'} Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f1b07f2-de60-40b1-a1b6-5e11c17c38bf could not be found. Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f1b07f2-de60-40b1-a1b6-5e11c17c38bf could not be found. Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:47:25.766301 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:47:25.771614 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:47:25.771614 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:47:25.771614 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:47:25.771614 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:47:25.771614 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:47:25.771614 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f1b07f2-de60-40b1-a1b6-5e11c17c38bf could not be found. Jul 18 02:47:25.771614 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:47:25.776516 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b6ada963-afc4-40be-a44f-5e940eaf926f tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] Returning 404 to user: Instance 0f1b07f2-de60-40b1-a1b6-5e11c17c38bf could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:47:25.777741 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b6ada963-afc4-40be-a44f-5e940eaf926f tempest-VolumesNegativeTest-1645262454 tempest-VolumesNegativeTest-1645262454-project] 10.222.0.57 "GET /compute/v2.1/servers/0f1b07f2-de60-40b1-a1b6-5e11c17c38bf" status: 404 len: 111 microversion: 2.1 time: 0.111830 Jul 18 02:47:25.778978 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2277/4545] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:25 2022] GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca => generated 1523 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:25.780991 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2268/4545] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:25 2022] GET /compute/v2.1/servers/0f1b07f2-de60-40b1-a1b6-5e11c17c38bf => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:47:25.952875 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c9e2f06a-376c-4962-ad91-9c3d4293101c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:25.958545 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c9e2f06a-376c-4962-ad91-9c3d4293101c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: e47d6a60-cb4a-4271-9cf0-6faf19157794] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:25.988949 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c9e2f06a-376c-4962-ad91-9c3d4293101c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:25.990602 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c9e2f06a-376c-4962-ad91-9c3d4293101c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:25.996667 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c9e2f06a-376c-4962-ad91-9c3d4293101c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:25.999243 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c9e2f06a-376c-4962-ad91-9c3d4293101c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:26.061891 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d962e7dd-356c-49cf-8e51-69a7cd269c11 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:26.062990 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d962e7dd-356c-49cf-8e51-69a7cd269c11 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:26.126552 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d962e7dd-356c-49cf-8e51-69a7cd269c11 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:26.133675 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d962e7dd-356c-49cf-8e51-69a7cd269c11 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:26.141591 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d962e7dd-356c-49cf-8e51-69a7cd269c11 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:26.154666 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d962e7dd-356c-49cf-8e51-69a7cd269c11 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:26.538714 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d962e7dd-356c-49cf-8e51-69a7cd269c11 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:26.551084 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c9e2f06a-376c-4962-ad91-9c3d4293101c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:26.598932 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d962e7dd-356c-49cf-8e51-69a7cd269c11 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 200 len: 1240 microversion: 2.1 time: 0.545365 Jul 18 02:47:26.603714 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c9e2f06a-376c-4962-ad91-9c3d4293101c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794" status: 200 len: 1188 microversion: 2.1 time: 0.662534 Jul 18 02:47:26.622846 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2269/4546] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:26 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 1240 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:47:26.623254 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2278/4547] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:25 2022] GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794 => generated 1188 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:26.799583 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-69e9643e-05c8-4e52-aa73-461eeea8043c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:26.805982 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-69e9643e-05c8-4e52-aa73-461eeea8043c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 8e86c78e-45f6-425f-b575-6ade39c020ca] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:26.847402 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69e9643e-05c8-4e52-aa73-461eeea8043c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:26.851545 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69e9643e-05c8-4e52-aa73-461eeea8043c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:26.853388 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69e9643e-05c8-4e52-aa73-461eeea8043c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:26.853993 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69e9643e-05c8-4e52-aa73-461eeea8043c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:27.175499 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-69e9643e-05c8-4e52-aa73-461eeea8043c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:27.200888 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-69e9643e-05c8-4e52-aa73-461eeea8043c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca" status: 200 len: 1523 microversion: 2.1 time: 0.410105 Jul 18 02:47:27.204190 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2270/4548] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:26 2022] GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca => generated 1523 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:27.640616 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3a3190a2-56f1-4351-ac44-6bdf65f72894 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:27.642360 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-85ede9f6-3aeb-4a71-9b36-f50c980d4eb9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:27.643291 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3a3190a2-56f1-4351-ac44-6bdf65f72894 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:27.645444 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-85ede9f6-3aeb-4a71-9b36-f50c980d4eb9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: e47d6a60-cb4a-4271-9cf0-6faf19157794] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:27.662496 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=4 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:27.663224 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3a3190a2-56f1-4351-ac44-6bdf65f72894 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:27.666038 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3a3190a2-56f1-4351-ac44-6bdf65f72894 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:27.668662 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3a3190a2-56f1-4351-ac44-6bdf65f72894 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:27.669832 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85ede9f6-3aeb-4a71-9b36-f50c980d4eb9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:27.670626 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3a3190a2-56f1-4351-ac44-6bdf65f72894 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:27.672318 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85ede9f6-3aeb-4a71-9b36-f50c980d4eb9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:27.675262 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85ede9f6-3aeb-4a71-9b36-f50c980d4eb9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:27.679769 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85ede9f6-3aeb-4a71-9b36-f50c980d4eb9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:27.938199 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-85ede9f6-3aeb-4a71-9b36-f50c980d4eb9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:27.954832 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3a3190a2-56f1-4351-ac44-6bdf65f72894 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:27.970701 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3a3190a2-56f1-4351-ac44-6bdf65f72894 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 200 len: 1296 microversion: 2.1 time: 0.333004 Jul 18 02:47:27.972906 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-85ede9f6-3aeb-4a71-9b36-f50c980d4eb9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794" status: 200 len: 1188 microversion: 2.1 time: 0.340682 Jul 18 02:47:27.985029 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2271/4549] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:27 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 1296 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:27.986315 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2279/4550] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:27 2022] GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794 => generated 1188 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:47:28.105671 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-a7d837c0-b7d1-425f-9165-54f7d461213d req-805dfdb1-5756-4263-81ba-9fb63b08c2c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e86c78e-45f6-425f-b575-6ade39c020ca", "name": "network-vif-plugged", "status": "completed", "tag": "56a9047a-e9d8-4517-ac48-942dc91fdade"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:47:28.149117 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-a7d837c0-b7d1-425f-9165-54f7d461213d req-805dfdb1-5756-4263-81ba-9fb63b08c2c9 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:28.150223 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-a7d837c0-b7d1-425f-9165-54f7d461213d req-805dfdb1-5756-4263-81ba-9fb63b08c2c9 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:28.199566 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-a7d837c0-b7d1-425f-9165-54f7d461213d req-805dfdb1-5756-4263-81ba-9fb63b08c2c9 service nova] Creating event network-vif-plugged:56a9047a-e9d8-4517-ac48-942dc91fdade for instance 8e86c78e-45f6-425f-b575-6ade39c020ca on n-h1-465891-3 Jul 18 02:47:28.209399 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-a7d837c0-b7d1-425f-9165-54f7d461213d req-805dfdb1-5756-4263-81ba-9fb63b08c2c9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117985 Jul 18 02:47:28.211859 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2272/4551] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:47:28.221558 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-52aafd80-7db7-42b9-82dc-d12b25450c08 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:28.222583 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-52aafd80-7db7-42b9-82dc-d12b25450c08 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 8e86c78e-45f6-425f-b575-6ade39c020ca] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:28.234854 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-52aafd80-7db7-42b9-82dc-d12b25450c08 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:28.235459 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-52aafd80-7db7-42b9-82dc-d12b25450c08 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:28.243485 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-52aafd80-7db7-42b9-82dc-d12b25450c08 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:28.244455 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-52aafd80-7db7-42b9-82dc-d12b25450c08 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:28.614480 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-52aafd80-7db7-42b9-82dc-d12b25450c08 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:28.647235 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-52aafd80-7db7-42b9-82dc-d12b25450c08 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca" status: 200 len: 1523 microversion: 2.1 time: 0.430310 Jul 18 02:47:28.662368 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2280/4552] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:28 2022] GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca => generated 1523 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:29.005368 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dbefcbd5-27b9-4207-b484-c7cd5b32d374 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:29.005803 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ffcc90f9-0b8c-44f5-97f7-26fbafe46719 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:29.006583 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-dbefcbd5-27b9-4207-b484-c7cd5b32d374 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:29.011024 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ffcc90f9-0b8c-44f5-97f7-26fbafe46719 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: e47d6a60-cb4a-4271-9cf0-6faf19157794] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:29.020720 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dbefcbd5-27b9-4207-b484-c7cd5b32d374 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:29.021183 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dbefcbd5-27b9-4207-b484-c7cd5b32d374 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:29.025877 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dbefcbd5-27b9-4207-b484-c7cd5b32d374 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:29.026333 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dbefcbd5-27b9-4207-b484-c7cd5b32d374 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:29.038047 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ffcc90f9-0b8c-44f5-97f7-26fbafe46719 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:29.039321 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ffcc90f9-0b8c-44f5-97f7-26fbafe46719 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:29.068063 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ffcc90f9-0b8c-44f5-97f7-26fbafe46719 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:29.073922 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ffcc90f9-0b8c-44f5-97f7-26fbafe46719 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:29.261331 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-dbefcbd5-27b9-4207-b484-c7cd5b32d374 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:29.290459 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-dbefcbd5-27b9-4207-b484-c7cd5b32d374 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 200 len: 1294 microversion: 2.1 time: 0.289124 Jul 18 02:47:29.300240 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2281/4553] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:28 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 1294 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:47:29.366838 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ffcc90f9-0b8c-44f5-97f7-26fbafe46719 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:29.404382 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ffcc90f9-0b8c-44f5-97f7-26fbafe46719 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794" status: 200 len: 1188 microversion: 2.1 time: 0.412217 Jul 18 02:47:29.405496 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2273/4554] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:28 2022] GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794 => generated 1188 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:29.668654 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-448b0d8b-1766-4a72-890b-28dbeb1405f9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:29.670451 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-448b0d8b-1766-4a72-890b-28dbeb1405f9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 8e86c78e-45f6-425f-b575-6ade39c020ca] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:29.683532 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-448b0d8b-1766-4a72-890b-28dbeb1405f9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:29.684459 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-448b0d8b-1766-4a72-890b-28dbeb1405f9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:29.685559 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-448b0d8b-1766-4a72-890b-28dbeb1405f9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:29.687323 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-448b0d8b-1766-4a72-890b-28dbeb1405f9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:30.227674 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-448b0d8b-1766-4a72-890b-28dbeb1405f9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:30.246334 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-448b0d8b-1766-4a72-890b-28dbeb1405f9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca" status: 200 len: 1523 microversion: 2.1 time: 0.584949 Jul 18 02:47:30.249192 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2282/4555] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:29 2022] GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca => generated 1523 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:30.318604 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bb3d9a39-a6d7-4157-b670-7f77feabdf23 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:30.319810 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bb3d9a39-a6d7-4157-b670-7f77feabdf23 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:30.349252 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb3d9a39-a6d7-4157-b670-7f77feabdf23 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:30.349742 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb3d9a39-a6d7-4157-b670-7f77feabdf23 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:30.350742 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb3d9a39-a6d7-4157-b670-7f77feabdf23 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:30.351045 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb3d9a39-a6d7-4157-b670-7f77feabdf23 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:30.436693 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-772df839-7277-4dde-8c01-3886c880acb7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:30.437819 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-772df839-7277-4dde-8c01-3886c880acb7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: e47d6a60-cb4a-4271-9cf0-6faf19157794] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:30.447917 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-772df839-7277-4dde-8c01-3886c880acb7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:30.451762 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-772df839-7277-4dde-8c01-3886c880acb7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:30.452963 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-772df839-7277-4dde-8c01-3886c880acb7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:30.457522 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-772df839-7277-4dde-8c01-3886c880acb7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:30.533913 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-772df839-7277-4dde-8c01-3886c880acb7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:30.534662 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-772df839-7277-4dde-8c01-3886c880acb7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:30.535337 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-772df839-7277-4dde-8c01-3886c880acb7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lazy-loading 'fault' on Instance uuid e47d6a60-cb4a-4271-9cf0-6faf19157794 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:47:30.718833 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-772df839-7277-4dde-8c01-3886c880acb7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:30.735963 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-772df839-7277-4dde-8c01-3886c880acb7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794" status: 200 len: 1193 microversion: 2.1 time: 0.303265 Jul 18 02:47:30.736440 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2283/4556] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:30 2022] GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794 => generated 1193 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:47:30.859572 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bb3d9a39-a6d7-4157-b670-7f77feabdf23 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:30.873285 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bb3d9a39-a6d7-4157-b670-7f77feabdf23 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 200 len: 1362 microversion: 2.1 time: 0.558908 Jul 18 02:47:30.887815 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2274/4557] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:30 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 1362 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:31.277034 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8d81d715-7220-48aa-9340-36b9da511e71 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:31.277983 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8d81d715-7220-48aa-9340-36b9da511e71 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 8e86c78e-45f6-425f-b575-6ade39c020ca] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:31.286660 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8d81d715-7220-48aa-9340-36b9da511e71 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:31.295230 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8d81d715-7220-48aa-9340-36b9da511e71 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:31.296660 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8d81d715-7220-48aa-9340-36b9da511e71 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:31.300755 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8d81d715-7220-48aa-9340-36b9da511e71 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:31.766355 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ce850959-a168-4d1b-ba7c-ac3273245e0f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:31.776071 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ce850959-a168-4d1b-ba7c-ac3273245e0f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: e47d6a60-cb4a-4271-9cf0-6faf19157794] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:31.797915 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ce850959-a168-4d1b-ba7c-ac3273245e0f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:31.801164 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ce850959-a168-4d1b-ba7c-ac3273245e0f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:31.802641 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ce850959-a168-4d1b-ba7c-ac3273245e0f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:31.812772 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ce850959-a168-4d1b-ba7c-ac3273245e0f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:31.826814 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8d81d715-7220-48aa-9340-36b9da511e71 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:31.837091 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8d81d715-7220-48aa-9340-36b9da511e71 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca" status: 200 len: 1508 microversion: 2.1 time: 0.564857 Jul 18 02:47:31.837731 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2284/4558] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:31 2022] GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca => generated 1508 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:47:31.874172 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-21c9b638-1b01-4314-b0ed-d9e6f9e0e4fa tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:31.875277 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-21c9b638-1b01-4314-b0ed-d9e6f9e0e4fa tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 8e86c78e-45f6-425f-b575-6ade39c020ca] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:31.882435 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-ce850959-a168-4d1b-ba7c-ac3273245e0f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] HTTP exception thrown: Instance e47d6a60-cb4a-4271-9cf0-6faf19157794 could not be found. Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ce850959-a168-4d1b-ba7c-ac3273245e0f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Request method failure captured: Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794 HTTP/1.1 Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MliWHzVx10oBgzg24taGfvPF1POfFT53P2_RlSdFLebnrvIbeAs5qvjZ1EAd9Fni5RvXZYA8fjgna7ooKOtwOz_kbJVpuNazgX6TlGzOYOFYf5fy5vfDN_5wwJEwayQdbLz2BaqgZyDtVrhp2skZQbTuh-KNZeRA8bkIRl3oXepO1E Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 2b7654e273f6487ba83382da4f96056d Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-TestVolumeBootPattern-598001453 Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2b7654e273f6487ba83382da4f96056d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2b7654e273f6487ba83382da4f96056d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2b7654e273f6487ba83382da4f96056d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2b7654e273f6487ba83382da4f96056d"}]}] Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-TestVolumeBootPattern-598001453 Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 2b7654e273f6487ba83382da4f96056d Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-TestVolumeBootPattern-598001453 Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-TestVolumeBootPattern-598001453-project Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: d1afc1702f8045a396b98e5c24b124e7 Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-TestVolumeBootPattern-598001453-project Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance e47d6a60-cb4a-4271-9cf0-6faf19157794 could not be found. Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'e47d6a60-cb4a-4271-9cf0-6faf19157794'} Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e47d6a60-cb4a-4271-9cf0-6faf19157794 could not be found. Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e47d6a60-cb4a-4271-9cf0-6faf19157794 could not be found. Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:47:31.887450 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:47:31.892233 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:47:31.892233 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:47:31.892233 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:47:31.892233 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:47:31.892233 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:47:31.892233 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e47d6a60-cb4a-4271-9cf0-6faf19157794 could not be found. Jul 18 02:47:31.892233 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:47:31.894101 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-21c9b638-1b01-4314-b0ed-d9e6f9e0e4fa tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:31.894487 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ce850959-a168-4d1b-ba7c-ac3273245e0f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Returning 404 to user: Instance e47d6a60-cb4a-4271-9cf0-6faf19157794 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:47:31.894610 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-21c9b638-1b01-4314-b0ed-d9e6f9e0e4fa tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:31.896485 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ce850959-a168-4d1b-ba7c-ac3273245e0f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794" status: 404 len: 111 microversion: 2.1 time: 0.134566 Jul 18 02:47:31.898842 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2275/4559] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:31 2022] GET /compute/v2.1/servers/e47d6a60-cb4a-4271-9cf0-6faf19157794 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:47:31.900787 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-21c9b638-1b01-4314-b0ed-d9e6f9e0e4fa tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:31.901257 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-21c9b638-1b01-4314-b0ed-d9e6f9e0e4fa tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:31.935234 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d9099879-71fa-4886-b01c-25d0d47afe29 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:31.937944 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d9099879-71fa-4886-b01c-25d0d47afe29 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:31.970495 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d9099879-71fa-4886-b01c-25d0d47afe29 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:31.972251 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d9099879-71fa-4886-b01c-25d0d47afe29 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:31.974557 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d9099879-71fa-4886-b01c-25d0d47afe29 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:31.977721 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d9099879-71fa-4886-b01c-25d0d47afe29 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:32.614550 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d9099879-71fa-4886-b01c-25d0d47afe29 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:32.630111 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d9099879-71fa-4886-b01c-25d0d47afe29 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 200 len: 1362 microversion: 2.1 time: 0.729838 Jul 18 02:47:32.633193 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-21c9b638-1b01-4314-b0ed-d9e6f9e0e4fa tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:32.641531 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2276/4560] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:31 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 1362 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:32.676663 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-56713af0-b97d-426d-91bb-59de755042a9 req-ae555906-7827-46f5-9f40-58bc55404085 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a7139b7-9d69-45b0-a6bf-470376bdb9c5", "tag": "1ea03e2a-ad3d-4bd9-a097-f84b5e9aa228"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:47:32.698694 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-21c9b638-1b01-4314-b0ed-d9e6f9e0e4fa tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca" status: 200 len: 1508 microversion: 2.1 time: 0.836473 Jul 18 02:47:32.704514 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-56713af0-b97d-426d-91bb-59de755042a9 req-ae555906-7827-46f5-9f40-58bc55404085 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:32.705995 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-56713af0-b97d-426d-91bb-59de755042a9 req-ae555906-7827-46f5-9f40-58bc55404085 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:32.720787 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-56713af0-b97d-426d-91bb-59de755042a9 req-ae555906-7827-46f5-9f40-58bc55404085 service nova] Creating event network-changed:1ea03e2a-ad3d-4bd9-a097-f84b5e9aa228 for instance 7a7139b7-9d69-45b0-a6bf-470376bdb9c5 on n-h1-465891-3 Jul 18 02:47:32.728709 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-56713af0-b97d-426d-91bb-59de755042a9 req-ae555906-7827-46f5-9f40-58bc55404085 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056936 Jul 18 02:47:32.732569 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2285/4561] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:31 2022] GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca => generated 1508 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:32.748211 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2277/4562] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:47:32.755479 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0d89a0d6-7a14-4a7d-8660-22280e04adf5 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:32.759405 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0d89a0d6-7a14-4a7d-8660-22280e04adf5 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 8e86c78e-45f6-425f-b575-6ade39c020ca] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:32.774028 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0d89a0d6-7a14-4a7d-8660-22280e04adf5 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:32.778106 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0d89a0d6-7a14-4a7d-8660-22280e04adf5 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:32.779346 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0d89a0d6-7a14-4a7d-8660-22280e04adf5 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:32.779974 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0d89a0d6-7a14-4a7d-8660-22280e04adf5 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:32.863854 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0d89a0d6-7a14-4a7d-8660-22280e04adf5 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 8e86c78e-45f6-425f-b575-6ade39c020ca] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:47:33.142118 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:UPDATE=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:33.151368 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0d89a0d6-7a14-4a7d-8660-22280e04adf5 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca" status: 204 len: 0 microversion: 2.1 time: 0.412780 Jul 18 02:47:33.152543 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2286/4563] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:47:32 2022] DELETE /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:47:33.598975 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-32f80624-1b18-4365-9a64-1832516ca388 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-427278783", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "ca05c1ce-c949-4f69-b4cd-bdb4d6611509"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:47:33.650048 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-05c0d67e-68ef-4339-b445-a47ee06597b6 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:33.650804 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-05c0d67e-68ef-4339-b445-a47ee06597b6 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:33.695829 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-05c0d67e-68ef-4339-b445-a47ee06597b6 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:33.697201 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-05c0d67e-68ef-4339-b445-a47ee06597b6 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:33.710367 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-05c0d67e-68ef-4339-b445-a47ee06597b6 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:33.712440 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-05c0d67e-68ef-4339-b445-a47ee06597b6 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:33.774409 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-32f80624-1b18-4365-9a64-1832516ca388 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] validate_networks() for [('ca05c1ce-c949-4f69-b4cd-bdb4d6611509', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:47:34.490761 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:35.020371 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=8 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:35.156422 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-05c0d67e-68ef-4339-b445-a47ee06597b6 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:35.179041 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-05c0d67e-68ef-4339-b445-a47ee06597b6 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 200 len: 1362 microversion: 2.1 time: 1.533751 Jul 18 02:47:35.181303 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2287/4564] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:33 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 1362 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:47:36.202670 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-60cad39a-e5f4-46de-bf04-9ccba998f8e2 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:36.208834 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-60cad39a-e5f4-46de-bf04-9ccba998f8e2 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:36.264860 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60cad39a-e5f4-46de-bf04-9ccba998f8e2 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:36.270473 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60cad39a-e5f4-46de-bf04-9ccba998f8e2 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:36.271527 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60cad39a-e5f4-46de-bf04-9ccba998f8e2 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:36.272144 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60cad39a-e5f4-46de-bf04-9ccba998f8e2 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:36.564671 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-32f80624-1b18-4365-9a64-1832516ca388 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:47:36.565486 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-32f80624-1b18-4365-9a64-1832516ca388 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:47:36.565819 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-32f80624-1b18-4365-9a64-1832516ca388 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:47:36.566802 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-32f80624-1b18-4365-9a64-1832516ca388 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:47:36.567505 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-32f80624-1b18-4365-9a64-1832516ca388 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:47:36.598996 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-32f80624-1b18-4365-9a64-1832516ca388 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:36.599568 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-32f80624-1b18-4365-9a64-1832516ca388 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:36.601228 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-32f80624-1b18-4365-9a64-1832516ca388 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:36.615197 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-32f80624-1b18-4365-9a64-1832516ca388 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:36.690823 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-32f80624-1b18-4365-9a64-1832516ca388 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Getting quotas for project fcdf9bfc7a9d4e45acebe3c362787290. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:47:36.712443 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-32f80624-1b18-4365-9a64-1832516ca388 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Getting quotas for user dc0bfd8ccc564f119014fceb1c9ad8ad and project fcdf9bfc7a9d4e45acebe3c362787290. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:47:36.756211 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-32f80624-1b18-4365-9a64-1832516ca388 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:47:36.763431 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-32f80624-1b18-4365-9a64-1832516ca388 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 003f8857-2e8c-4cf0-82f6-eae8e3d2e126] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:47:36.906281 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-32f80624-1b18-4365-9a64-1832516ca388 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.306187 Jul 18 02:47:36.907065 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2278/4565] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:47:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 3315 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:47:36.938459 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cbf9808f-5619-4476-a19c-0b6d1d6eb8e9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:36.939113 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cbf9808f-5619-4476-a19c-0b6d1d6eb8e9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 003f8857-2e8c-4cf0-82f6-eae8e3d2e126] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:37.379910 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-cbf9808f-5619-4476-a19c-0b6d1d6eb8e9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:37.381171 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-60cad39a-e5f4-46de-bf04-9ccba998f8e2 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:37.394238 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cbf9808f-5619-4476-a19c-0b6d1d6eb8e9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126" status: 200 len: 1217 microversion: 2.1 time: 0.477278 Jul 18 02:47:37.410661 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2279/4566] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:36 2022] GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126 => generated 1217 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:37.442971 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-60cad39a-e5f4-46de-bf04-9ccba998f8e2 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 200 len: 1362 microversion: 2.1 time: 1.236591 Jul 18 02:47:37.447349 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2288/4567] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:36 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 1362 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:37.544469 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-852dc992-67a5-4196-831a-e41a1948f9ba req-d80b88f3-49db-430a-a48e-689b5e5a0cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e86c78e-45f6-425f-b575-6ade39c020ca", "name": "network-vif-deleted", "tag": "56a9047a-e9d8-4517-ac48-942dc91fdade"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:47:37.583616 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-852dc992-67a5-4196-831a-e41a1948f9ba req-d80b88f3-49db-430a-a48e-689b5e5a0cd5 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:37.584728 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-852dc992-67a5-4196-831a-e41a1948f9ba req-d80b88f3-49db-430a-a48e-689b5e5a0cd5 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:37.632209 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-852dc992-67a5-4196-831a-e41a1948f9ba req-d80b88f3-49db-430a-a48e-689b5e5a0cd5 service nova] Creating event network-vif-deleted:56a9047a-e9d8-4517-ac48-942dc91fdade for instance 8e86c78e-45f6-425f-b575-6ade39c020ca on n-h1-465891-3 Jul 18 02:47:37.644850 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-852dc992-67a5-4196-831a-e41a1948f9ba req-d80b88f3-49db-430a-a48e-689b5e5a0cd5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110047 Jul 18 02:47:37.663428 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2280/4568] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:47:38.424764 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e0f01eec-c9d4-4337-aece-7285f3bb1ec4 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:38.426975 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e0f01eec-c9d4-4337-aece-7285f3bb1ec4 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 003f8857-2e8c-4cf0-82f6-eae8e3d2e126] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:38.468359 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e0f01eec-c9d4-4337-aece-7285f3bb1ec4 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:38.475682 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-67a68a3b-0a09-4b27-9941-4f2aa0764015 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:38.477108 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-67a68a3b-0a09-4b27-9941-4f2aa0764015 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:38.478273 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e0f01eec-c9d4-4337-aece-7285f3bb1ec4 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:38.480408 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e0f01eec-c9d4-4337-aece-7285f3bb1ec4 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:38.486298 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e0f01eec-c9d4-4337-aece-7285f3bb1ec4 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:38.498283 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-67a68a3b-0a09-4b27-9941-4f2aa0764015 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:38.499161 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-67a68a3b-0a09-4b27-9941-4f2aa0764015 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:38.500242 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-67a68a3b-0a09-4b27-9941-4f2aa0764015 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:38.500943 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-67a68a3b-0a09-4b27-9941-4f2aa0764015 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:38.576333 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:39.001313 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e0f01eec-c9d4-4337-aece-7285f3bb1ec4 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:39.015188 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e0f01eec-c9d4-4337-aece-7285f3bb1ec4 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126" status: 200 len: 1221 microversion: 2.1 time: 0.604232 Jul 18 02:47:39.029267 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2289/4569] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:38 2022] GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126 => generated 1221 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:39.488570 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-67a68a3b-0a09-4b27-9941-4f2aa0764015 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:39.596390 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-67a68a3b-0a09-4b27-9941-4f2aa0764015 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 200 len: 1362 microversion: 2.1 time: 1.132141 Jul 18 02:47:39.616634 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2281/4570] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:38 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 1362 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:47:40.047712 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ebb8a891-49a0-4286-9181-cf2e98e5f08f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:40.049224 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ebb8a891-49a0-4286-9181-cf2e98e5f08f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 003f8857-2e8c-4cf0-82f6-eae8e3d2e126] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:40.106300 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ebb8a891-49a0-4286-9181-cf2e98e5f08f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:40.115291 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ebb8a891-49a0-4286-9181-cf2e98e5f08f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:40.120546 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ebb8a891-49a0-4286-9181-cf2e98e5f08f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:40.129251 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ebb8a891-49a0-4286-9181-cf2e98e5f08f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:40.611804 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ebb8a891-49a0-4286-9181-cf2e98e5f08f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:40.638918 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ebb8a891-49a0-4286-9181-cf2e98e5f08f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126" status: 200 len: 1277 microversion: 2.1 time: 0.607696 Jul 18 02:47:40.640666 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2290/4571] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:40 2022] GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126 => generated 1277 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:40.688327 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a44b08e2-ebf9-4b72-96ca-995dd7997449 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:40.689261 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a44b08e2-ebf9-4b72-96ca-995dd7997449 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:40.731095 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a44b08e2-ebf9-4b72-96ca-995dd7997449 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:40.734306 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a44b08e2-ebf9-4b72-96ca-995dd7997449 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:40.741943 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a44b08e2-ebf9-4b72-96ca-995dd7997449 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:40.742826 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a44b08e2-ebf9-4b72-96ca-995dd7997449 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:41.681905 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-715603ab-98e4-425e-8b35-d469ac1ef3d0 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:41.685405 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-715603ab-98e4-425e-8b35-d469ac1ef3d0 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 003f8857-2e8c-4cf0-82f6-eae8e3d2e126] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:41.712380 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-715603ab-98e4-425e-8b35-d469ac1ef3d0 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:41.713452 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-715603ab-98e4-425e-8b35-d469ac1ef3d0 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:41.717993 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-715603ab-98e4-425e-8b35-d469ac1ef3d0 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:41.728426 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-715603ab-98e4-425e-8b35-d469ac1ef3d0 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:41.962475 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a44b08e2-ebf9-4b72-96ca-995dd7997449 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:41.982813 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a44b08e2-ebf9-4b72-96ca-995dd7997449 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 200 len: 1362 microversion: 2.1 time: 1.332699 Jul 18 02:47:41.984002 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-715603ab-98e4-425e-8b35-d469ac1ef3d0 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:41.986665 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2282/4572] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:40 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 1362 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:42.046786 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-715603ab-98e4-425e-8b35-d469ac1ef3d0 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126" status: 200 len: 1275 microversion: 2.1 time: 0.390693 Jul 18 02:47:42.048090 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2291/4573] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:41 2022] GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126 => generated 1275 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:43.037983 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-59e459c3-fe1b-48c8-8710-dc17ddfb1d7c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:43.041766 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-59e459c3-fe1b-48c8-8710-dc17ddfb1d7c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:43.077000 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-60ff85c5-e79f-40a0-8acb-5b69f476cd5b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:43.078315 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-60ff85c5-e79f-40a0-8acb-5b69f476cd5b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 003f8857-2e8c-4cf0-82f6-eae8e3d2e126] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:43.079974 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-59e459c3-fe1b-48c8-8710-dc17ddfb1d7c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:43.081841 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-59e459c3-fe1b-48c8-8710-dc17ddfb1d7c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:43.085925 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-59e459c3-fe1b-48c8-8710-dc17ddfb1d7c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:43.087950 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-59e459c3-fe1b-48c8-8710-dc17ddfb1d7c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:43.117475 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60ff85c5-e79f-40a0-8acb-5b69f476cd5b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:43.119674 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60ff85c5-e79f-40a0-8acb-5b69f476cd5b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:43.122808 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60ff85c5-e79f-40a0-8acb-5b69f476cd5b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:43.123319 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60ff85c5-e79f-40a0-8acb-5b69f476cd5b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:43.606543 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-60ff85c5-e79f-40a0-8acb-5b69f476cd5b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:43.641863 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-60ff85c5-e79f-40a0-8acb-5b69f476cd5b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126" status: 200 len: 1275 microversion: 2.1 time: 0.568428 Jul 18 02:47:43.650997 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2292/4574] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:43 2022] GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126 => generated 1275 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:43.968619 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-c101444a-7de2-4efe-81e2-87dbec58e6fe req-18311cf8-afa2-49a6-b22d-d99cdc238b1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a7139b7-9d69-45b0-a6bf-470376bdb9c5", "name": "network-vif-plugged", "status": "completed", "tag": "1ea03e2a-ad3d-4bd9-a097-f84b5e9aa228"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:47:44.001589 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-c101444a-7de2-4efe-81e2-87dbec58e6fe req-18311cf8-afa2-49a6-b22d-d99cdc238b1e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:44.007141 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-c101444a-7de2-4efe-81e2-87dbec58e6fe req-18311cf8-afa2-49a6-b22d-d99cdc238b1e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:44.057038 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-c101444a-7de2-4efe-81e2-87dbec58e6fe req-18311cf8-afa2-49a6-b22d-d99cdc238b1e service nova] Creating event network-vif-plugged:1ea03e2a-ad3d-4bd9-a097-f84b5e9aa228 for instance 7a7139b7-9d69-45b0-a6bf-470376bdb9c5 on n-h1-465891-3 Jul 18 02:47:44.120420 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-c101444a-7de2-4efe-81e2-87dbec58e6fe req-18311cf8-afa2-49a6-b22d-d99cdc238b1e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158451 Jul 18 02:47:44.121556 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2293/4575] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:47:44.671135 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-83a7e0e1-96b4-4976-bc81-b444b29aabcd tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:44.673276 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-83a7e0e1-96b4-4976-bc81-b444b29aabcd tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 003f8857-2e8c-4cf0-82f6-eae8e3d2e126] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:44.714110 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-83a7e0e1-96b4-4976-bc81-b444b29aabcd tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:44.718244 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-83a7e0e1-96b4-4976-bc81-b444b29aabcd tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:44.721316 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-83a7e0e1-96b4-4976-bc81-b444b29aabcd tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:44.722789 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-83a7e0e1-96b4-4976-bc81-b444b29aabcd tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:44.731868 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-59e459c3-fe1b-48c8-8710-dc17ddfb1d7c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:44.772157 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-59e459c3-fe1b-48c8-8710-dc17ddfb1d7c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 200 len: 1362 microversion: 2.1 time: 1.740747 Jul 18 02:47:44.786096 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2283/4576] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:43 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 1362 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:45.312248 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-83a7e0e1-96b4-4976-bc81-b444b29aabcd tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:45.323506 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-83a7e0e1-96b4-4976-bc81-b444b29aabcd tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126" status: 200 len: 1317 microversion: 2.1 time: 0.659479 Jul 18 02:47:45.338234 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2294/4577] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:44 2022] GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126 => generated 1317 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:47:45.811148 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-08f7009a-2ff3-48d9-9f88-ef3500640447 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:45.812022 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-08f7009a-2ff3-48d9-9f88-ef3500640447 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:45.838749 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-08f7009a-2ff3-48d9-9f88-ef3500640447 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:45.839200 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-08f7009a-2ff3-48d9-9f88-ef3500640447 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:45.842299 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-08f7009a-2ff3-48d9-9f88-ef3500640447 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:45.844190 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-08f7009a-2ff3-48d9-9f88-ef3500640447 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:45.918280 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:46.348271 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-62716062-31d8-48ed-b320-2dc1c277059b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:46.351134 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-62716062-31d8-48ed-b320-2dc1c277059b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 003f8857-2e8c-4cf0-82f6-eae8e3d2e126] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:46.385545 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-62716062-31d8-48ed-b320-2dc1c277059b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:46.386750 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-62716062-31d8-48ed-b320-2dc1c277059b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:46.388187 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-62716062-31d8-48ed-b320-2dc1c277059b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:46.392869 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-62716062-31d8-48ed-b320-2dc1c277059b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:46.509181 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-08f7009a-2ff3-48d9-9f88-ef3500640447 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:46.543358 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-08f7009a-2ff3-48d9-9f88-ef3500640447 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 200 len: 1362 microversion: 2.1 time: 0.743219 Jul 18 02:47:46.554426 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2284/4578] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:45 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 1362 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:47.370277 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-62716062-31d8-48ed-b320-2dc1c277059b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:47.384686 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-62716062-31d8-48ed-b320-2dc1c277059b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126" status: 200 len: 1317 microversion: 2.1 time: 1.046037 Jul 18 02:47:47.396820 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2295/4579] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:46 2022] GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126 => generated 1317 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:47.588446 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-575232d0-8928-4163-996c-e1b1c5bc181e tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:47.594673 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-575232d0-8928-4163-996c-e1b1c5bc181e tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:47.624760 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:47.646853 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=8 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:47.666824 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-546245f7-40d9-4e4e-ae75-9dd6edcb03a9 req-ffd2ad95-b816-43ee-9ec8-13d64ffc2cda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "003f8857-2e8c-4cf0-82f6-eae8e3d2e126", "tag": "a8670483-5e4d-4d14-a73e-e7ea6daa97f6"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:47:47.685561 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-575232d0-8928-4163-996c-e1b1c5bc181e tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:47.689359 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-575232d0-8928-4163-996c-e1b1c5bc181e tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:47.694464 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-575232d0-8928-4163-996c-e1b1c5bc181e tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:47.700815 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-575232d0-8928-4163-996c-e1b1c5bc181e tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:47.727038 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-546245f7-40d9-4e4e-ae75-9dd6edcb03a9 req-ffd2ad95-b816-43ee-9ec8-13d64ffc2cda service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:47.730837 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-546245f7-40d9-4e4e-ae75-9dd6edcb03a9 req-ffd2ad95-b816-43ee-9ec8-13d64ffc2cda service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:47.825428 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-546245f7-40d9-4e4e-ae75-9dd6edcb03a9 req-ffd2ad95-b816-43ee-9ec8-13d64ffc2cda service nova] Creating event network-changed:a8670483-5e4d-4d14-a73e-e7ea6daa97f6 for instance 003f8857-2e8c-4cf0-82f6-eae8e3d2e126 on n-h2-465891-3 Jul 18 02:47:47.847576 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-546245f7-40d9-4e4e-ae75-9dd6edcb03a9 req-ffd2ad95-b816-43ee-9ec8-13d64ffc2cda service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194131 Jul 18 02:47:47.854671 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2296/4580] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:47:48.405407 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f3618ef8-c0c7-4d82-b220-2aafd57cbe1f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:48.407078 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f3618ef8-c0c7-4d82-b220-2aafd57cbe1f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 003f8857-2e8c-4cf0-82f6-eae8e3d2e126] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:48.456461 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f3618ef8-c0c7-4d82-b220-2aafd57cbe1f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:48.456931 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f3618ef8-c0c7-4d82-b220-2aafd57cbe1f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:48.457816 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f3618ef8-c0c7-4d82-b220-2aafd57cbe1f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:48.458275 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f3618ef8-c0c7-4d82-b220-2aafd57cbe1f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:49.922107 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-575232d0-8928-4163-996c-e1b1c5bc181e tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:49.939062 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-575232d0-8928-4163-996c-e1b1c5bc181e tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 200 len: 1547 microversion: 2.1 time: 2.360782 Jul 18 02:47:49.941020 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2285/4581] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:47 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 1547 bytes in 2364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:49.982401 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-701b292e-5a39-44fa-b2c0-b60b34ecdd55 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e89f938b-e3d2-49d8-a0dd-c59ccb193ede"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:47:49.985999 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-701b292e-5a39-44fa-b2c0-b60b34ecdd55 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 2e823ef6-49cc-4fb5-ae76-3d4e87041838] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:49.997291 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-701b292e-5a39-44fa-b2c0-b60b34ecdd55 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:50.001682 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-701b292e-5a39-44fa-b2c0-b60b34ecdd55 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:50.017056 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f3618ef8-c0c7-4d82-b220-2aafd57cbe1f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:50.025122 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-701b292e-5a39-44fa-b2c0-b60b34ecdd55 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:50.027502 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-701b292e-5a39-44fa-b2c0-b60b34ecdd55 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:50.031431 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f3618ef8-c0c7-4d82-b220-2aafd57cbe1f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126" status: 200 len: 1317 microversion: 2.1 time: 1.629789 Jul 18 02:47:50.047037 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2297/4582] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:48 2022] GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126 => generated 1317 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:47:50.066905 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f0c17768-d6bd-48ee-a8ef-b864063fe136 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:50.071587 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f0c17768-d6bd-48ee-a8ef-b864063fe136 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:50.091975 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f0c17768-d6bd-48ee-a8ef-b864063fe136 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:50.095074 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f0c17768-d6bd-48ee-a8ef-b864063fe136 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:50.097760 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f0c17768-d6bd-48ee-a8ef-b864063fe136 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:50.099457 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f0c17768-d6bd-48ee-a8ef-b864063fe136 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:50.362828 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-701b292e-5a39-44fa-b2c0-b60b34ecdd55 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] HTTP exception thrown: Invalid volume: volume e89f938b-e3d2-49d8-a0dd-c59ccb193ede is already attached to instances: 2e823ef6-49cc-4fb5-ae76-3d4e87041838 Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-701b292e-5a39-44fa-b2c0-b60b34ecdd55 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Request method failure captured: Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838/os-volume_attachments HTTP/1.1 Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 74 Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MhfM0UyOyoMgRP_1BgsB5GQEFaLnp85satKIE74LtU4aati7wjZItAybGxqrHGu9HKZ07IOl-ghvuL-XVY7iiNLxZrz8uz6pnetXMm39fDBZo0QiKDc9Xu-2OCp3obDb_4yxslV3N-dd0oIabggtRNHi18D28MbZyTc-9xFAnMfxLs Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 8fa714ec7f5a4af0a33f56b45e999a7a Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-AttachVolumeNegativeTest-683705837 Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8fa714ec7f5a4af0a33f56b45e999a7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fa714ec7f5a4af0a33f56b45e999a7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fa714ec7f5a4af0a33f56b45e999a7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8fa714ec7f5a4af0a33f56b45e999a7a"}]}] Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-AttachVolumeNegativeTest-683705837 Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 8fa714ec7f5a4af0a33f56b45e999a7a Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-683705837 Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-AttachVolumeNegativeTest-683705837-project Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 1be686f2aa93473585ca064041bd8140 Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-AttachVolumeNegativeTest-683705837-project Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: {"volumeAttachment": {"volumeId": "e89f938b-e3d2-49d8-a0dd-c59ccb193ede"}} Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: exception: Invalid volume: volume e89f938b-e3d2-49d8-a0dd-c59ccb193ede is already attached to instances: 2e823ef6-49cc-4fb5-ae76-3d4e87041838 Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'server_id': '2e823ef6-49cc-4fb5-ae76-3d4e87041838', 'body': {'volumeAttachment': {'volumeId': 'e89f938b-e3d2-49d8-a0dd-c59ccb193ede'}}} Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e89f938b-e3d2-49d8-a0dd-c59ccb193ede is already attached to instances: 2e823ef6-49cc-4fb5-ae76-3d4e87041838 Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:47:50.365395 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:47:50.371113 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:47:50.371113 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:47:50.371113 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 18 02:47:50.371113 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 02:47:50.371113 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e89f938b-e3d2-49d8-a0dd-c59ccb193ede is already attached to instances: 2e823ef6-49cc-4fb5-ae76-3d4e87041838 Jul 18 02:47:50.371113 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:47:50.371113 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:47:50.371113 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:47:50.371113 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:47:50.371113 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:47:50.371113 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:47:50.371113 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:47:50.371113 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:47:50.371113 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e89f938b-e3d2-49d8-a0dd-c59ccb193ede is already attached to instances: 2e823ef6-49cc-4fb5-ae76-3d4e87041838 Jul 18 02:47:50.371113 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:47:50.382064 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-701b292e-5a39-44fa-b2c0-b60b34ecdd55 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Returning 400 to user: Invalid volume: volume e89f938b-e3d2-49d8-a0dd-c59ccb193ede is already attached to instances: 2e823ef6-49cc-4fb5-ae76-3d4e87041838 {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:47:50.384538 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-701b292e-5a39-44fa-b2c0-b60b34ecdd55 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "POST /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.440319 Jul 18 02:47:50.386525 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2286/4583] 10.222.0.57 () {60 vars in 1322 bytes} [Mon Jul 18 02:47:49 2022] POST /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838/os-volume_attachments => generated 174 bytes in 445 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:47:50.464566 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f0c17768-d6bd-48ee-a8ef-b864063fe136 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.414790 Jul 18 02:47:50.466167 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2298/4584] 10.222.0.57 () {58 vars in 1274 bytes} [Mon Jul 18 02:47:50 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5/os-interface => generated 284 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:47:50.553467 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-633a398d-b526-4854-9396-d0a9ff2adcbe tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:50.554228 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-633a398d-b526-4854-9396-d0a9ff2adcbe tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 2e823ef6-49cc-4fb5-ae76-3d4e87041838] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:50.575712 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-633a398d-b526-4854-9396-d0a9ff2adcbe tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:50.577012 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-633a398d-b526-4854-9396-d0a9ff2adcbe tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:50.579516 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-633a398d-b526-4854-9396-d0a9ff2adcbe tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:50.580119 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-633a398d-b526-4854-9396-d0a9ff2adcbe tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:50.959388 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-633a398d-b526-4854-9396-d0a9ff2adcbe tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lazy-loading 'services' on Instance uuid 2e823ef6-49cc-4fb5-ae76-3d4e87041838 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:47:51.052593 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bef8507e-6efc-443c-b967-40b55d033d1c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:51.053253 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bef8507e-6efc-443c-b967-40b55d033d1c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 003f8857-2e8c-4cf0-82f6-eae8e3d2e126] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:51.075977 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bef8507e-6efc-443c-b967-40b55d033d1c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:51.076748 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bef8507e-6efc-443c-b967-40b55d033d1c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:51.077775 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bef8507e-6efc-443c-b967-40b55d033d1c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:51.078420 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bef8507e-6efc-443c-b967-40b55d033d1c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:51.206604 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-633a398d-b526-4854-9396-d0a9ff2adcbe tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838/os-volume_attachments/e89f938b-e3d2-49d8-a0dd-c59ccb193ede" status: 202 len: 0 microversion: 2.1 time: 0.657575 Jul 18 02:47:51.215473 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2287/4585] 10.222.0.57 () {58 vars in 1415 bytes} [Mon Jul 18 02:47:50 2022] DELETE /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838/os-volume_attachments/e89f938b-e3d2-49d8-a0dd-c59ccb193ede => generated 0 bytes in 667 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:47:51.232713 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7d9fb559-7df7-4ccc-bfeb-9341a905c7e5 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:51.234160 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7d9fb559-7df7-4ccc-bfeb-9341a905c7e5 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 2e823ef6-49cc-4fb5-ae76-3d4e87041838] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:51.285145 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7d9fb559-7df7-4ccc-bfeb-9341a905c7e5 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:51.286988 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7d9fb559-7df7-4ccc-bfeb-9341a905c7e5 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:51.290003 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7d9fb559-7df7-4ccc-bfeb-9341a905c7e5 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:51.291741 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7d9fb559-7df7-4ccc-bfeb-9341a905c7e5 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:51.345493 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7d9fb559-7df7-4ccc-bfeb-9341a905c7e5 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128578 Jul 18 02:47:51.346830 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2288/4586] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:47:51 2022] GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:47:51.840419 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bef8507e-6efc-443c-b967-40b55d033d1c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:51.855273 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bef8507e-6efc-443c-b967-40b55d033d1c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126" status: 200 len: 1317 microversion: 2.1 time: 0.806044 Jul 18 02:47:51.869816 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2299/4587] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:51 2022] GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126 => generated 1317 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:47:52.361347 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a9a76449-5ef8-459d-8ccc-4b6e0a11a4dd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:52.364425 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a9a76449-5ef8-459d-8ccc-4b6e0a11a4dd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 2e823ef6-49cc-4fb5-ae76-3d4e87041838] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:52.392903 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a9a76449-5ef8-459d-8ccc-4b6e0a11a4dd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:52.398915 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a9a76449-5ef8-459d-8ccc-4b6e0a11a4dd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:52.403108 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a9a76449-5ef8-459d-8ccc-4b6e0a11a4dd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:52.404816 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a9a76449-5ef8-459d-8ccc-4b6e0a11a4dd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:52.614661 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a9a76449-5ef8-459d-8ccc-4b6e0a11a4dd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.248100 Jul 18 02:47:52.616274 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2289/4588] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:47:52 2022] GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838/os-volume_attachments => generated 197 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:47:52.906485 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0e0fe61a-7754-4b8e-91d9-b7d8f5a021f9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:52.909506 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0e0fe61a-7754-4b8e-91d9-b7d8f5a021f9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 003f8857-2e8c-4cf0-82f6-eae8e3d2e126] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:53.038503 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0e0fe61a-7754-4b8e-91d9-b7d8f5a021f9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:53.039725 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0e0fe61a-7754-4b8e-91d9-b7d8f5a021f9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:53.051900 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0e0fe61a-7754-4b8e-91d9-b7d8f5a021f9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:53.058467 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0e0fe61a-7754-4b8e-91d9-b7d8f5a021f9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:53.627997 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5ed7ff0b-37bb-4667-aefc-b4a49d12b8b0 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:53.630054 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5ed7ff0b-37bb-4667-aefc-b4a49d12b8b0 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 2e823ef6-49cc-4fb5-ae76-3d4e87041838] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:53.644665 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ed7ff0b-37bb-4667-aefc-b4a49d12b8b0 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:53.645248 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ed7ff0b-37bb-4667-aefc-b4a49d12b8b0 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:53.648341 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ed7ff0b-37bb-4667-aefc-b4a49d12b8b0 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:53.650318 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ed7ff0b-37bb-4667-aefc-b4a49d12b8b0 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:53.741439 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5ed7ff0b-37bb-4667-aefc-b4a49d12b8b0 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117487 Jul 18 02:47:53.751807 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2290/4589] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:47:53 2022] GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:47:54.290899 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0e0fe61a-7754-4b8e-91d9-b7d8f5a021f9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:54.317597 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0e0fe61a-7754-4b8e-91d9-b7d8f5a021f9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126" status: 200 len: 1317 microversion: 2.1 time: 1.445791 Jul 18 02:47:54.320785 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2300/4590] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:52 2022] GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126 => generated 1317 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:54.688041 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-ea0b2f0e-6fa4-4f30-b6fd-a9fda4d92d74 req-0def23df-cee6-49b8-a439-1275dce13442 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a7139b7-9d69-45b0-a6bf-470376bdb9c5", "tag": "1ea03e2a-ad3d-4bd9-a097-f84b5e9aa228"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:47:54.706212 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-ea0b2f0e-6fa4-4f30-b6fd-a9fda4d92d74 req-0def23df-cee6-49b8-a439-1275dce13442 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:54.709079 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-ea0b2f0e-6fa4-4f30-b6fd-a9fda4d92d74 req-0def23df-cee6-49b8-a439-1275dce13442 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:54.798149 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-ea0b2f0e-6fa4-4f30-b6fd-a9fda4d92d74 req-0def23df-cee6-49b8-a439-1275dce13442 service nova] Creating event network-changed:1ea03e2a-ad3d-4bd9-a097-f84b5e9aa228 for instance 7a7139b7-9d69-45b0-a6bf-470376bdb9c5 on n-h1-465891-3 Jul 18 02:47:54.826202 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-971ab015-b913-4e85-a89b-9f31244f882a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Action: 'create', calling method: .version_select at 0x7ff49b648940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-191272585", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJEutV/pX5qQ0I95St9i5Opao/TG96fHSR9Dn5yH25HEkb0azyaklXymUkxMcBXBRJ8Llce+S5odmxmOWuQRzJjYeFiMds5CndkqDDP/d4LHUbb/hxakb9SUCLNNffqMJg=="}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:47:54.846159 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:54.849217 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-ea0b2f0e-6fa4-4f30-b6fd-a9fda4d92d74 req-0def23df-cee6-49b8-a439-1275dce13442 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159155 Jul 18 02:47:54.858522 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2301/4591] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:47:54.878953 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-96a3615f-12ac-4d0e-ab49-3f19552e2ab2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:54.881195 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-96a3615f-12ac-4d0e-ab49-3f19552e2ab2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 2e823ef6-49cc-4fb5-ae76-3d4e87041838] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:54.888069 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-971ab015-b913-4e85-a89b-9f31244f882a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Getting quotas for project fa240dfd375a45efb42fc04807acf847. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:47:54.899952 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-971ab015-b913-4e85-a89b-9f31244f882a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Getting quotas for user 381a2ab772ff495cb85b89a85a267cfe and project fa240dfd375a45efb42fc04807acf847. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:47:54.928052 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-96a3615f-12ac-4d0e-ab49-3f19552e2ab2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:54.929278 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-96a3615f-12ac-4d0e-ab49-3f19552e2ab2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:54.931676 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-96a3615f-12ac-4d0e-ab49-3f19552e2ab2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:54.933243 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-96a3615f-12ac-4d0e-ab49-3f19552e2ab2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:54.971309 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-971ab015-b913-4e85-a89b-9f31244f882a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.809173 Jul 18 02:47:54.971970 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2291/4592] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 02:47:54 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:47:54.999707 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-96a3615f-12ac-4d0e-ab49-3f19552e2ab2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135901 Jul 18 02:47:55.000634 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2302/4593] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:47:54 2022] GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:47:55.349196 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-dd228022-d740-4946-a126-3770a7a5605b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:55.351737 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-dd228022-d740-4946-a126-3770a7a5605b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 003f8857-2e8c-4cf0-82f6-eae8e3d2e126] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:55.392209 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dd228022-d740-4946-a126-3770a7a5605b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:55.392581 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dd228022-d740-4946-a126-3770a7a5605b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:55.393781 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dd228022-d740-4946-a126-3770a7a5605b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:55.394487 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dd228022-d740-4946-a126-3770a7a5605b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:56.018832 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e11a7361-5171-4707-875d-9744dcf33a47 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:56.020273 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e11a7361-5171-4707-875d-9744dcf33a47 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 2e823ef6-49cc-4fb5-ae76-3d4e87041838] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:56.036628 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e11a7361-5171-4707-875d-9744dcf33a47 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:56.037090 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e11a7361-5171-4707-875d-9744dcf33a47 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:56.049044 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e11a7361-5171-4707-875d-9744dcf33a47 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:56.054579 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e11a7361-5171-4707-875d-9744dcf33a47 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:56.209145 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e11a7361-5171-4707-875d-9744dcf33a47 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.194992 Jul 18 02:47:56.214003 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2303/4594] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:47:56 2022] GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838/os-volume_attachments => generated 197 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:47:56.881143 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-dd228022-d740-4946-a126-3770a7a5605b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:56.973582 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-dd228022-d740-4946-a126-3770a7a5605b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126" status: 200 len: 1317 microversion: 2.1 time: 1.628338 Jul 18 02:47:56.983865 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2292/4595] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:55 2022] GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126 => generated 1317 bytes in 1640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:57.233680 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-62f1afe2-6311-410b-8b1f-e3c6ddfd52e2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:57.239338 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-62f1afe2-6311-410b-8b1f-e3c6ddfd52e2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 2e823ef6-49cc-4fb5-ae76-3d4e87041838] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:57.274755 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-62f1afe2-6311-410b-8b1f-e3c6ddfd52e2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:57.276953 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-62f1afe2-6311-410b-8b1f-e3c6ddfd52e2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:57.289156 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-62f1afe2-6311-410b-8b1f-e3c6ddfd52e2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:57.309725 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-62f1afe2-6311-410b-8b1f-e3c6ddfd52e2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:57.472795 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-62f1afe2-6311-410b-8b1f-e3c6ddfd52e2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.249352 Jul 18 02:47:57.479620 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2304/4596] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:47:57 2022] GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838/os-volume_attachments => generated 197 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:47:58.015419 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-69263d96-200e-4e7c-8e7b-e7b0068eba15 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:58.019068 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-69263d96-200e-4e7c-8e7b-e7b0068eba15 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 003f8857-2e8c-4cf0-82f6-eae8e3d2e126] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:58.086442 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69263d96-200e-4e7c-8e7b-e7b0068eba15 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:58.087811 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69263d96-200e-4e7c-8e7b-e7b0068eba15 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:58.089556 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69263d96-200e-4e7c-8e7b-e7b0068eba15 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:58.097803 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69263d96-200e-4e7c-8e7b-e7b0068eba15 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:58.498654 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d4295679-5424-4269-a56a-a8755760db74 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:58.506865 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d4295679-5424-4269-a56a-a8755760db74 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 2e823ef6-49cc-4fb5-ae76-3d4e87041838] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:58.590210 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d4295679-5424-4269-a56a-a8755760db74 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:58.596685 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d4295679-5424-4269-a56a-a8755760db74 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:58.619845 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d4295679-5424-4269-a56a-a8755760db74 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:58.623749 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d4295679-5424-4269-a56a-a8755760db74 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:58.809333 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d4295679-5424-4269-a56a-a8755760db74 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.322890 Jul 18 02:47:58.810650 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2305/4597] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:47:58 2022] GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838/os-volume_attachments => generated 197 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:47:58.817754 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-6ed98391-735c-4654-a970-a2671435c0bf req-8893ff91-284a-44c3-b9d1-3f3ab4c7e7e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "003f8857-2e8c-4cf0-82f6-eae8e3d2e126", "name": "network-vif-plugged", "status": "completed", "tag": "a8670483-5e4d-4d14-a73e-e7ea6daa97f6"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:47:58.870188 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-6ed98391-735c-4654-a970-a2671435c0bf req-8893ff91-284a-44c3-b9d1-3f3ab4c7e7e1 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:58.876144 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-6ed98391-735c-4654-a970-a2671435c0bf req-8893ff91-284a-44c3-b9d1-3f3ab4c7e7e1 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:58.920418 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-6ed98391-735c-4654-a970-a2671435c0bf req-8893ff91-284a-44c3-b9d1-3f3ab4c7e7e1 service nova] Creating event network-vif-plugged:a8670483-5e4d-4d14-a73e-e7ea6daa97f6 for instance 003f8857-2e8c-4cf0-82f6-eae8e3d2e126 on n-h2-465891-3 Jul 18 02:47:58.930722 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-6ed98391-735c-4654-a970-a2671435c0bf req-8893ff91-284a-44c3-b9d1-3f3ab4c7e7e1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118564 Jul 18 02:47:58.937924 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2306/4598] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:47:59.058362 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-69263d96-200e-4e7c-8e7b-e7b0068eba15 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:59.074974 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-69263d96-200e-4e7c-8e7b-e7b0068eba15 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126" status: 200 len: 1317 microversion: 2.1 time: 1.066710 Jul 18 02:47:59.079888 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2293/4599] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:58 2022] GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126 => generated 1317 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:59.821605 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-28a1c5be-2469-4c5e-b807-15e810edaeb3 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:59.823759 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-28a1c5be-2469-4c5e-b807-15e810edaeb3 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 2e823ef6-49cc-4fb5-ae76-3d4e87041838] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:59.839526 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-28a1c5be-2469-4c5e-b807-15e810edaeb3 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:59.847874 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-28a1c5be-2469-4c5e-b807-15e810edaeb3 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:59.848826 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-28a1c5be-2469-4c5e-b807-15e810edaeb3 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:59.855012 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-28a1c5be-2469-4c5e-b807-15e810edaeb3 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:59.957605 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-28a1c5be-2469-4c5e-b807-15e810edaeb3 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137339 Jul 18 02:47:59.963293 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2307/4600] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:47:59 2022] GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:48:00.123765 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4e737388-90b1-44e3-a666-2f91dc03c5b4 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:00.125319 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4e737388-90b1-44e3-a666-2f91dc03c5b4 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 003f8857-2e8c-4cf0-82f6-eae8e3d2e126] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:00.143190 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e737388-90b1-44e3-a666-2f91dc03c5b4 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:00.143649 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e737388-90b1-44e3-a666-2f91dc03c5b4 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:00.144458 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e737388-90b1-44e3-a666-2f91dc03c5b4 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:00.144901 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e737388-90b1-44e3-a666-2f91dc03c5b4 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:00.407381 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4e737388-90b1-44e3-a666-2f91dc03c5b4 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:00.417388 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4e737388-90b1-44e3-a666-2f91dc03c5b4 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126" status: 200 len: 1317 microversion: 2.1 time: 0.312809 Jul 18 02:48:00.418062 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2294/4601] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:00 2022] GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126 => generated 1317 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:00.970229 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-07283086-ab13-4a56-b866-c8ecf41ec4a3 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:00.972021 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-07283086-ab13-4a56-b866-c8ecf41ec4a3 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 2e823ef6-49cc-4fb5-ae76-3d4e87041838] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:00.986929 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-07283086-ab13-4a56-b866-c8ecf41ec4a3 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:00.987701 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-07283086-ab13-4a56-b866-c8ecf41ec4a3 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:00.989889 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-07283086-ab13-4a56-b866-c8ecf41ec4a3 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:00.989889 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-07283086-ab13-4a56-b866-c8ecf41ec4a3 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:01.069041 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-07283086-ab13-4a56-b866-c8ecf41ec4a3 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102869 Jul 18 02:48:01.081747 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2308/4602] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:48:00 2022] GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:48:01.446571 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-316798c1-8388-45d3-add2-2819360ab86f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:01.448415 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-316798c1-8388-45d3-add2-2819360ab86f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 003f8857-2e8c-4cf0-82f6-eae8e3d2e126] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:01.473106 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-316798c1-8388-45d3-add2-2819360ab86f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:01.473962 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-316798c1-8388-45d3-add2-2819360ab86f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:01.475410 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-316798c1-8388-45d3-add2-2819360ab86f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:01.486951 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-316798c1-8388-45d3-add2-2819360ab86f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:01.931598 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-316798c1-8388-45d3-add2-2819360ab86f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:01.940002 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-316798c1-8388-45d3-add2-2819360ab86f tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126" status: 200 len: 1506 microversion: 2.1 time: 0.500470 Jul 18 02:48:01.941850 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2295/4603] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:01 2022] GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126 => generated 1506 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:01.959282 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-be593029-d64e-4943-8eab-d35ae2b04a88 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:01.962521 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-be593029-d64e-4943-8eab-d35ae2b04a88 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 003f8857-2e8c-4cf0-82f6-eae8e3d2e126] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:01.996282 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-be593029-d64e-4943-8eab-d35ae2b04a88 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:01.997300 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-be593029-d64e-4943-8eab-d35ae2b04a88 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:02.003268 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-be593029-d64e-4943-8eab-d35ae2b04a88 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:02.005442 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-be593029-d64e-4943-8eab-d35ae2b04a88 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:02.020070 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:02.108210 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0c51bec5-2655-4798-b761-d1744cbbcad5 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:02.110330 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0c51bec5-2655-4798-b761-d1744cbbcad5 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 2e823ef6-49cc-4fb5-ae76-3d4e87041838] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:02.140962 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c51bec5-2655-4798-b761-d1744cbbcad5 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:02.142402 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c51bec5-2655-4798-b761-d1744cbbcad5 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:02.144090 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c51bec5-2655-4798-b761-d1744cbbcad5 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:02.145149 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c51bec5-2655-4798-b761-d1744cbbcad5 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:02.291034 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-be593029-d64e-4943-8eab-d35ae2b04a88 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:02.300249 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-be593029-d64e-4943-8eab-d35ae2b04a88 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126" status: 200 len: 1506 microversion: 2.1 time: 0.346936 Jul 18 02:48:02.303105 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2309/4604] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:01 2022] GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126 => generated 1506 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:02.316336 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0c51bec5-2655-4798-b761-d1744cbbcad5 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.221355 Jul 18 02:48:02.319625 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2296/4605] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:48:02 2022] GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838/os-volume_attachments => generated 197 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:48:02.324006 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-19b202e3-a8fc-4534-bea2-7f0aecb90d8b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:48:02.326238 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-19b202e3-a8fc-4534-bea2-7f0aecb90d8b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 003f8857-2e8c-4cf0-82f6-eae8e3d2e126] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:02.333882 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-19b202e3-a8fc-4534-bea2-7f0aecb90d8b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:02.334646 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-19b202e3-a8fc-4534-bea2-7f0aecb90d8b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:02.335876 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-19b202e3-a8fc-4534-bea2-7f0aecb90d8b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:02.336546 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-19b202e3-a8fc-4534-bea2-7f0aecb90d8b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:02.450045 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-19b202e3-a8fc-4534-bea2-7f0aecb90d8b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "PUT /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126" status: 200 len: 1078 microversion: 2.1 time: 0.131114 Jul 18 02:48:02.451567 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2310/4606] 10.222.0.57 () {60 vars in 1255 bytes} [Mon Jul 18 02:48:02 2022] PUT /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126 => generated 1078 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:02.474291 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fd2145fe-1eec-4062-a9b4-e2048c2a2f5c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:02.481939 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fd2145fe-1eec-4062-a9b4-e2048c2a2f5c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 003f8857-2e8c-4cf0-82f6-eae8e3d2e126] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:02.531431 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd2145fe-1eec-4062-a9b4-e2048c2a2f5c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:02.535393 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd2145fe-1eec-4062-a9b4-e2048c2a2f5c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:02.537998 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd2145fe-1eec-4062-a9b4-e2048c2a2f5c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:02.539641 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd2145fe-1eec-4062-a9b4-e2048c2a2f5c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:02.899209 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fd2145fe-1eec-4062-a9b4-e2048c2a2f5c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:02.908070 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fd2145fe-1eec-4062-a9b4-e2048c2a2f5c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126" status: 200 len: 1504 microversion: 2.1 time: 0.442778 Jul 18 02:48:02.908690 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2297/4607] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:02 2022] GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126 => generated 1504 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:48:02.951243 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a7f1c257-aedd-41bd-95d0-4409619db9dd tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:02.951243 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a7f1c257-aedd-41bd-95d0-4409619db9dd tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 003f8857-2e8c-4cf0-82f6-eae8e3d2e126] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:02.981084 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a7f1c257-aedd-41bd-95d0-4409619db9dd tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:02.982065 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a7f1c257-aedd-41bd-95d0-4409619db9dd tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:03.001507 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a7f1c257-aedd-41bd-95d0-4409619db9dd tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:03.002221 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a7f1c257-aedd-41bd-95d0-4409619db9dd tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:03.317017 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a7f1c257-aedd-41bd-95d0-4409619db9dd tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:03.332414 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4927b6ba-df74-4c5b-b31e-b59ed66bffba tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:03.334694 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4927b6ba-df74-4c5b-b31e-b59ed66bffba tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 2e823ef6-49cc-4fb5-ae76-3d4e87041838] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:03.342283 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4927b6ba-df74-4c5b-b31e-b59ed66bffba tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:03.343033 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4927b6ba-df74-4c5b-b31e-b59ed66bffba tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:03.344370 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4927b6ba-df74-4c5b-b31e-b59ed66bffba tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:03.344809 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4927b6ba-df74-4c5b-b31e-b59ed66bffba tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:03.358994 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a7f1c257-aedd-41bd-95d0-4409619db9dd tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126" status: 200 len: 1504 microversion: 2.1 time: 0.419883 Jul 18 02:48:03.360201 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2311/4608] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:02 2022] GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126 => generated 1504 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:03.391692 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b835667a-d5cc-4674-bd87-b87316c7803d tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:48:03.395607 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b835667a-d5cc-4674-bd87-b87316c7803d tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 003f8857-2e8c-4cf0-82f6-eae8e3d2e126] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:03.410777 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4927b6ba-df74-4c5b-b31e-b59ed66bffba tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.082494 Jul 18 02:48:03.413573 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2298/4609] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:48:03 2022] GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 02:48:03.414348 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b835667a-d5cc-4674-bd87-b87316c7803d tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:03.415080 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b835667a-d5cc-4674-bd87-b87316c7803d tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:03.416721 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b835667a-d5cc-4674-bd87-b87316c7803d tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:03.417459 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b835667a-d5cc-4674-bd87-b87316c7803d tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:03.576695 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e46f5e13-1da9-4b4d-8647-d6ed4f0497a9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:03.577958 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e46f5e13-1da9-4b4d-8647-d6ed4f0497a9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 2e823ef6-49cc-4fb5-ae76-3d4e87041838] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:03.589255 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e46f5e13-1da9-4b4d-8647-d6ed4f0497a9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:03.589740 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e46f5e13-1da9-4b4d-8647-d6ed4f0497a9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:03.590580 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e46f5e13-1da9-4b4d-8647-d6ed4f0497a9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:03.591026 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e46f5e13-1da9-4b4d-8647-d6ed4f0497a9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:03.630350 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b835667a-d5cc-4674-bd87-b87316c7803d tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "PUT /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126" status: 200 len: 1080 microversion: 2.1 time: 0.254942 Jul 18 02:48:03.631813 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2312/4610] 10.222.0.57 () {60 vars in 1255 bytes} [Mon Jul 18 02:48:03 2022] PUT /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126 => generated 1080 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:03.654554 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f85cdfa9-89a0-4887-bf3d-a908c6388a44 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:03.655411 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f85cdfa9-89a0-4887-bf3d-a908c6388a44 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 003f8857-2e8c-4cf0-82f6-eae8e3d2e126] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:03.663998 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f85cdfa9-89a0-4887-bf3d-a908c6388a44 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:03.664519 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f85cdfa9-89a0-4887-bf3d-a908c6388a44 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:03.666120 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f85cdfa9-89a0-4887-bf3d-a908c6388a44 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:03.666771 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f85cdfa9-89a0-4887-bf3d-a908c6388a44 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:03.677230 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e46f5e13-1da9-4b4d-8647-d6ed4f0497a9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 2e823ef6-49cc-4fb5-ae76-3d4e87041838] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:48:03.864949 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:03.927605 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e46f5e13-1da9-4b4d-8647-d6ed4f0497a9 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838" status: 204 len: 0 microversion: 2.1 time: 0.353248 Jul 18 02:48:03.931821 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2299/4611] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:48:03 2022] DELETE /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:48:03.950870 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a921e9f7-cd96-46e7-b072-e95c66cf676c tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:03.952215 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a921e9f7-cd96-46e7-b072-e95c66cf676c tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 2e823ef6-49cc-4fb5-ae76-3d4e87041838] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:03.987091 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a921e9f7-cd96-46e7-b072-e95c66cf676c tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:03.987905 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a921e9f7-cd96-46e7-b072-e95c66cf676c tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:03.992935 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a921e9f7-cd96-46e7-b072-e95c66cf676c tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:03.993237 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a921e9f7-cd96-46e7-b072-e95c66cf676c tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:04.042704 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f85cdfa9-89a0-4887-bf3d-a908c6388a44 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:04.065662 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f85cdfa9-89a0-4887-bf3d-a908c6388a44 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126" status: 200 len: 1506 microversion: 2.1 time: 0.415373 Jul 18 02:48:04.067130 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2313/4612] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:03 2022] GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126 => generated 1506 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:48:04.122675 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-69534894-1c5d-41b5-80e2-7e749a968fe1 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:04.124294 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-69534894-1c5d-41b5-80e2-7e749a968fe1 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 003f8857-2e8c-4cf0-82f6-eae8e3d2e126] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:04.191071 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=56 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:04.197724 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-69534894-1c5d-41b5-80e2-7e749a968fe1 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:04.202844 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-69534894-1c5d-41b5-80e2-7e749a968fe1 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:04.217147 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-69534894-1c5d-41b5-80e2-7e749a968fe1 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:04.217147 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-69534894-1c5d-41b5-80e2-7e749a968fe1 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:04.611615 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a921e9f7-cd96-46e7-b072-e95c66cf676c tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:04.634854 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a921e9f7-cd96-46e7-b072-e95c66cf676c tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838" status: 200 len: 1679 microversion: 2.1 time: 0.692035 Jul 18 02:48:04.637047 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2300/4613] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:03 2022] GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838 => generated 1679 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:48:04.672459 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-69534894-1c5d-41b5-80e2-7e749a968fe1 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:04.683671 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-69534894-1c5d-41b5-80e2-7e749a968fe1 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126" status: 200 len: 1506 microversion: 2.1 time: 0.603874 Jul 18 02:48:04.695372 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2314/4614] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:04 2022] GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126 => generated 1506 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:04.710831 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-13bab00e-2c3b-4a95-a232-3e7fe82c42e9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:04.714304 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-13bab00e-2c3b-4a95-a232-3e7fe82c42e9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 003f8857-2e8c-4cf0-82f6-eae8e3d2e126] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:04.732851 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-13bab00e-2c3b-4a95-a232-3e7fe82c42e9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:04.733730 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-13bab00e-2c3b-4a95-a232-3e7fe82c42e9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:04.735207 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-13bab00e-2c3b-4a95-a232-3e7fe82c42e9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:04.735987 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-13bab00e-2c3b-4a95-a232-3e7fe82c42e9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:04.788553 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-13bab00e-2c3b-4a95-a232-3e7fe82c42e9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 003f8857-2e8c-4cf0-82f6-eae8e3d2e126] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:48:04.933107 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:05.052563 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-13bab00e-2c3b-4a95-a232-3e7fe82c42e9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "DELETE /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126" status: 204 len: 0 microversion: 2.1 time: 0.354472 Jul 18 02:48:05.053543 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2301/4615] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:48:04 2022] DELETE /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:48:05.064363 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-20591aa3-8bb5-4d6d-9086-1c2df50d645c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:05.066139 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-20591aa3-8bb5-4d6d-9086-1c2df50d645c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 003f8857-2e8c-4cf0-82f6-eae8e3d2e126] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:05.080002 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20591aa3-8bb5-4d6d-9086-1c2df50d645c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:05.082228 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20591aa3-8bb5-4d6d-9086-1c2df50d645c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:05.086735 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20591aa3-8bb5-4d6d-9086-1c2df50d645c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:05.088203 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20591aa3-8bb5-4d6d-9086-1c2df50d645c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:05.158470 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-20591aa3-8bb5-4d6d-9086-1c2df50d645c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 003f8857-2e8c-4cf0-82f6-eae8e3d2e126] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:48:05.237260 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.compute.api [None req-20591aa3-8bb5-4d6d-9086-1c2df50d645c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 003f8857-2e8c-4cf0-82f6-eae8e3d2e126] Instance is already in deleting state, ignoring this request Jul 18 02:48:05.237579 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-20591aa3-8bb5-4d6d-9086-1c2df50d645c tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "DELETE /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126" status: 204 len: 0 microversion: 2.1 time: 0.177418 Jul 18 02:48:05.241600 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2315/4616] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:48:05 2022] DELETE /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:48:05.253426 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7ebef5f6-d0b4-4a70-b619-90953484300b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:05.254773 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7ebef5f6-d0b4-4a70-b619-90953484300b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 003f8857-2e8c-4cf0-82f6-eae8e3d2e126] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:05.268632 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7ebef5f6-d0b4-4a70-b619-90953484300b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:05.270013 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7ebef5f6-d0b4-4a70-b619-90953484300b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:05.271688 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7ebef5f6-d0b4-4a70-b619-90953484300b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:05.273094 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7ebef5f6-d0b4-4a70-b619-90953484300b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:05.664184 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-14665672-a7d2-4eaa-9727-0cf8f4eeaf4c tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:05.664807 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-14665672-a7d2-4eaa-9727-0cf8f4eeaf4c tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 2e823ef6-49cc-4fb5-ae76-3d4e87041838] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:05.679836 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14665672-a7d2-4eaa-9727-0cf8f4eeaf4c tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:05.685689 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14665672-a7d2-4eaa-9727-0cf8f4eeaf4c tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:05.686931 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14665672-a7d2-4eaa-9727-0cf8f4eeaf4c tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:05.687576 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14665672-a7d2-4eaa-9727-0cf8f4eeaf4c tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:06.034532 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7ebef5f6-d0b4-4a70-b619-90953484300b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:06.052624 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7ebef5f6-d0b4-4a70-b619-90953484300b tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126" status: 200 len: 1512 microversion: 2.1 time: 0.808697 Jul 18 02:48:06.067042 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2302/4617] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:05 2022] GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126 => generated 1512 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:06.271149 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-14665672-a7d2-4eaa-9727-0cf8f4eeaf4c tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:06.298685 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-14665672-a7d2-4eaa-9727-0cf8f4eeaf4c tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838" status: 200 len: 1679 microversion: 2.1 time: 0.637287 Jul 18 02:48:06.303379 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2316/4618] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:05 2022] GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838 => generated 1679 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:48:07.071030 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-75d634fd-da62-469e-bc96-6473396b7c33 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:07.071650 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-75d634fd-da62-469e-bc96-6473396b7c33 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 003f8857-2e8c-4cf0-82f6-eae8e3d2e126] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:07.083985 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-75d634fd-da62-469e-bc96-6473396b7c33 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:07.084432 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-75d634fd-da62-469e-bc96-6473396b7c33 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:07.085248 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-75d634fd-da62-469e-bc96-6473396b7c33 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:07.085685 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-75d634fd-da62-469e-bc96-6473396b7c33 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:07.334884 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6ff6435a-91d4-4051-8c20-d0c381f68dc2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:07.354392 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6ff6435a-91d4-4051-8c20-d0c381f68dc2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 2e823ef6-49cc-4fb5-ae76-3d4e87041838] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:07.397334 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6ff6435a-91d4-4051-8c20-d0c381f68dc2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:07.399347 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6ff6435a-91d4-4051-8c20-d0c381f68dc2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:07.404505 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6ff6435a-91d4-4051-8c20-d0c381f68dc2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:07.406748 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6ff6435a-91d4-4051-8c20-d0c381f68dc2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:07.920973 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-75d634fd-da62-469e-bc96-6473396b7c33 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:07.959431 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-75d634fd-da62-469e-bc96-6473396b7c33 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126" status: 200 len: 1512 microversion: 2.1 time: 0.891769 Jul 18 02:48:07.964566 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2303/4619] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:07 2022] GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126 => generated 1512 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:08.298475 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6ff6435a-91d4-4051-8c20-d0c381f68dc2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:08.315765 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6ff6435a-91d4-4051-8c20-d0c381f68dc2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838" status: 200 len: 1679 microversion: 2.1 time: 0.990812 Jul 18 02:48:08.319369 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2317/4620] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:07 2022] GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838 => generated 1679 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:08.989164 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4d51b27c-59ab-47ef-ad40-a88da1952608 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:08.992739 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4d51b27c-59ab-47ef-ad40-a88da1952608 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 003f8857-2e8c-4cf0-82f6-eae8e3d2e126] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:09.023358 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4d51b27c-59ab-47ef-ad40-a88da1952608 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:09.026265 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4d51b27c-59ab-47ef-ad40-a88da1952608 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:09.028788 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4d51b27c-59ab-47ef-ad40-a88da1952608 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:09.033722 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4d51b27c-59ab-47ef-ad40-a88da1952608 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:09.299029 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4d51b27c-59ab-47ef-ad40-a88da1952608 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:09.314401 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-10edfa8f-0a4b-4ad6-a9a5-347d27115051 req-552d9cfa-02b1-45c7-905b-2f3f4b94fcc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "003f8857-2e8c-4cf0-82f6-eae8e3d2e126", "name": "network-vif-deleted", "tag": "a8670483-5e4d-4d14-a73e-e7ea6daa97f6"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:48:09.344791 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4d51b27c-59ab-47ef-ad40-a88da1952608 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126" status: 200 len: 1470 microversion: 2.1 time: 0.366924 Jul 18 02:48:09.365047 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2304/4621] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:08 2022] GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126 => generated 1470 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:09.371748 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3f9dd78a-530b-4769-9104-7090e68413d8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:09.378423 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3f9dd78a-530b-4769-9104-7090e68413d8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 2e823ef6-49cc-4fb5-ae76-3d4e87041838] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:09.379985 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-10edfa8f-0a4b-4ad6-a9a5-347d27115051 req-552d9cfa-02b1-45c7-905b-2f3f4b94fcc6 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:09.381740 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-10edfa8f-0a4b-4ad6-a9a5-347d27115051 req-552d9cfa-02b1-45c7-905b-2f3f4b94fcc6 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:09.418865 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3f9dd78a-530b-4769-9104-7090e68413d8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:09.423994 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3f9dd78a-530b-4769-9104-7090e68413d8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:09.434463 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3f9dd78a-530b-4769-9104-7090e68413d8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:09.440740 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3f9dd78a-530b-4769-9104-7090e68413d8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:09.535360 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-10edfa8f-0a4b-4ad6-a9a5-347d27115051 req-552d9cfa-02b1-45c7-905b-2f3f4b94fcc6 service nova] Creating event network-vif-deleted:a8670483-5e4d-4d14-a73e-e7ea6daa97f6 for instance 003f8857-2e8c-4cf0-82f6-eae8e3d2e126 on n-h2-465891-3 Jul 18 02:48:09.585186 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-10edfa8f-0a4b-4ad6-a9a5-347d27115051 req-552d9cfa-02b1-45c7-905b-2f3f4b94fcc6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.280452 Jul 18 02:48:09.585536 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2318/4622] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:48:09.902000 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3f9dd78a-530b-4769-9104-7090e68413d8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:09.976511 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3f9dd78a-530b-4769-9104-7090e68413d8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838" status: 200 len: 1612 microversion: 2.1 time: 0.620665 Jul 18 02:48:09.987144 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2305/4623] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:09 2022] GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838 => generated 1612 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:10.381095 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0dd1fe0b-15f0-44fe-9c9f-a495802c95e0 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:10.383153 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0dd1fe0b-15f0-44fe-9c9f-a495802c95e0 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 003f8857-2e8c-4cf0-82f6-eae8e3d2e126] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:10.408699 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0dd1fe0b-15f0-44fe-9c9f-a495802c95e0 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:10.410611 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0dd1fe0b-15f0-44fe-9c9f-a495802c95e0 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:10.419030 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0dd1fe0b-15f0-44fe-9c9f-a495802c95e0 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:10.449503 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0dd1fe0b-15f0-44fe-9c9f-a495802c95e0 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:10.675748 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0dd1fe0b-15f0-44fe-9c9f-a495802c95e0 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:10.676491 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0dd1fe0b-15f0-44fe-9c9f-a495802c95e0 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:10.677220 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-0dd1fe0b-15f0-44fe-9c9f-a495802c95e0 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lazy-loading 'fault' on Instance uuid 003f8857-2e8c-4cf0-82f6-eae8e3d2e126 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:48:11.004959 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ed03dc56-871d-43fa-8b26-938cec9f23c6 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:11.006146 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ed03dc56-871d-43fa-8b26-938cec9f23c6 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 2e823ef6-49cc-4fb5-ae76-3d4e87041838] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:11.028718 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ed03dc56-871d-43fa-8b26-938cec9f23c6 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:11.032324 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ed03dc56-871d-43fa-8b26-938cec9f23c6 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:11.034163 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ed03dc56-871d-43fa-8b26-938cec9f23c6 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:11.037533 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ed03dc56-871d-43fa-8b26-938cec9f23c6 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:12.055811 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0dd1fe0b-15f0-44fe-9c9f-a495802c95e0 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0bfd8ccc564f119014fceb1c9ad8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdf9bfc7a9d4e45acebe3c362787290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:12.110984 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0dd1fe0b-15f0-44fe-9c9f-a495802c95e0 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126" status: 200 len: 1307 microversion: 2.1 time: 1.729780 Jul 18 02:48:12.112207 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2319/4624] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:10 2022] GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126 => generated 1307 bytes in 1744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:12.133533 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ed03dc56-871d-43fa-8b26-938cec9f23c6 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:12.153417 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ed03dc56-871d-43fa-8b26-938cec9f23c6 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838" status: 200 len: 1612 microversion: 2.1 time: 1.152218 Jul 18 02:48:12.160895 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2306/4625] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:10 2022] GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838 => generated 1612 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:12.189971 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-f3bc63a2-3d73-477c-9b49-130cafa65540 req-a86327e6-c8e7-4244-a12a-5371eb4ece04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e823ef6-49cc-4fb5-ae76-3d4e87041838", "name": "network-vif-deleted", "tag": "cc27a935-d7f6-4135-927f-8f7b0181815e"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:48:12.247861 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-f3bc63a2-3d73-477c-9b49-130cafa65540 req-a86327e6-c8e7-4244-a12a-5371eb4ece04 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:12.249141 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-f3bc63a2-3d73-477c-9b49-130cafa65540 req-a86327e6-c8e7-4244-a12a-5371eb4ece04 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:12.334644 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-f3bc63a2-3d73-477c-9b49-130cafa65540 req-a86327e6-c8e7-4244-a12a-5371eb4ece04 service nova] Creating event network-vif-deleted:cc27a935-d7f6-4135-927f-8f7b0181815e for instance 2e823ef6-49cc-4fb5-ae76-3d4e87041838 on n-h2-465891-3 Jul 18 02:48:12.359774 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-f3bc63a2-3d73-477c-9b49-130cafa65540 req-a86327e6-c8e7-4244-a12a-5371eb4ece04 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186505 Jul 18 02:48:12.363388 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2320/4626] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:48:13.140412 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5f8d8250-b413-43f0-9f37-70debf75f1c9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:13.141537 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5f8d8250-b413-43f0-9f37-70debf75f1c9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 003f8857-2e8c-4cf0-82f6-eae8e3d2e126] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:13.198863 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5f8d8250-b413-43f0-9f37-70debf75f1c9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:13.199698 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5f8d8250-b413-43f0-9f37-70debf75f1c9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:13.201385 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5f8d8250-b413-43f0-9f37-70debf75f1c9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:13.212618 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5f8d8250-b413-43f0-9f37-70debf75f1c9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:13.215015 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6e19246b-078c-4fc2-aa3f-bba1de517fae tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:13.217936 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6e19246b-078c-4fc2-aa3f-bba1de517fae tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 2e823ef6-49cc-4fb5-ae76-3d4e87041838] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:13.242801 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e19246b-078c-4fc2-aa3f-bba1de517fae tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:13.248654 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e19246b-078c-4fc2-aa3f-bba1de517fae tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:13.251528 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e19246b-078c-4fc2-aa3f-bba1de517fae tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:13.251989 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e19246b-078c-4fc2-aa3f-bba1de517fae tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:13.274770 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-5f8d8250-b413-43f0-9f37-70debf75f1c9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] HTTP exception thrown: Instance 003f8857-2e8c-4cf0-82f6-eae8e3d2e126 could not be found. Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5f8d8250-b413-43f0-9f37-70debf75f1c9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Request method failure captured: Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126 HTTP/1.1 Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MkhKQyMqIcwOu4i0RH60e0B-LnLKycDAz0jZUJC1r0wHWOXjk1LJXWL_T7_DvRKRQ8XWUQtuQMLCbyBlYY-B80W2IR_3MDcSH7iGxj8WcdUMFvLOPqIcqGLM4pkgnzeggEV3pG9uiV7zBqzYpM5TDavzHrpc1fuB6YDvlhFsy2w5kg Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: fcdf9bfc7a9d4e45acebe3c362787290 Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServerDiskConfigTestJSON-650239955 Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fcdf9bfc7a9d4e45acebe3c362787290"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fcdf9bfc7a9d4e45acebe3c362787290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fcdf9bfc7a9d4e45acebe3c362787290"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fcdf9bfc7a9d4e45acebe3c362787290"}]}] Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServerDiskConfigTestJSON-650239955 Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: fcdf9bfc7a9d4e45acebe3c362787290 Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-650239955 Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServerDiskConfigTestJSON-650239955-project Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: dc0bfd8ccc564f119014fceb1c9ad8ad Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServerDiskConfigTestJSON-650239955-project Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 003f8857-2e8c-4cf0-82f6-eae8e3d2e126 could not be found. Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '003f8857-2e8c-4cf0-82f6-eae8e3d2e126'} Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 003f8857-2e8c-4cf0-82f6-eae8e3d2e126 could not be found. Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 003f8857-2e8c-4cf0-82f6-eae8e3d2e126 could not be found. Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:48:13.289386 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:48:13.303613 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:48:13.303613 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:48:13.303613 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:48:13.303613 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:48:13.303613 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:48:13.303613 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 003f8857-2e8c-4cf0-82f6-eae8e3d2e126 could not be found. Jul 18 02:48:13.303613 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:48:13.303613 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5f8d8250-b413-43f0-9f37-70debf75f1c9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Returning 404 to user: Instance 003f8857-2e8c-4cf0-82f6-eae8e3d2e126 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:48:13.303613 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5f8d8250-b413-43f0-9f37-70debf75f1c9 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126" status: 404 len: 111 microversion: 2.1 time: 0.160907 Jul 18 02:48:13.305105 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2307/4627] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:13 2022] GET /compute/v2.1/servers/003f8857-2e8c-4cf0-82f6-eae8e3d2e126 => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:48:13.319763 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-957d3e5c-8fe1-4185-85b5-ec87f55c9ecf tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:13.320685 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-957d3e5c-8fe1-4185-85b5-ec87f55c9ecf tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 8e86c78e-45f6-425f-b575-6ade39c020ca] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:13.364738 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-957d3e5c-8fe1-4185-85b5-ec87f55c9ecf tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:13.365527 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-957d3e5c-8fe1-4185-85b5-ec87f55c9ecf tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:13.367016 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-957d3e5c-8fe1-4185-85b5-ec87f55c9ecf tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:13.389321 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-957d3e5c-8fe1-4185-85b5-ec87f55c9ecf tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:13.405223 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e19246b-078c-4fc2-aa3f-bba1de517fae tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:13.405849 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e19246b-078c-4fc2-aa3f-bba1de517fae tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:13.406984 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-6e19246b-078c-4fc2-aa3f-bba1de517fae tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lazy-loading 'fault' on Instance uuid 2e823ef6-49cc-4fb5-ae76-3d4e87041838 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:48:13.499363 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-957d3e5c-8fe1-4185-85b5-ec87f55c9ecf tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] HTTP exception thrown: Instance 8e86c78e-45f6-425f-b575-6ade39c020ca could not be found. Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-957d3e5c-8fe1-4185-85b5-ec87f55c9ecf tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Request method failure captured: Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca HTTP/1.1 Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MkhKQyMqIcwOu4i0RH60e0B-LnLKycDAz0jZUJC1r0wHWOXjk1LJXWL_T7_DvRKRQ8XWUQtuQMLCbyBlYY-B80W2IR_3MDcSH7iGxj8WcdUMFvLOPqIcqGLM4pkgnzeggEV3pG9uiV7zBqzYpM5TDavzHrpc1fuB6YDvlhFsy2w5kg Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: fcdf9bfc7a9d4e45acebe3c362787290 Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServerDiskConfigTestJSON-650239955 Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fcdf9bfc7a9d4e45acebe3c362787290"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fcdf9bfc7a9d4e45acebe3c362787290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fcdf9bfc7a9d4e45acebe3c362787290"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fcdf9bfc7a9d4e45acebe3c362787290"}]}] Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServerDiskConfigTestJSON-650239955 Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: fcdf9bfc7a9d4e45acebe3c362787290 Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-650239955 Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServerDiskConfigTestJSON-650239955-project Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: dc0bfd8ccc564f119014fceb1c9ad8ad Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServerDiskConfigTestJSON-650239955-project Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 8e86c78e-45f6-425f-b575-6ade39c020ca could not be found. Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '8e86c78e-45f6-425f-b575-6ade39c020ca'} Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e86c78e-45f6-425f-b575-6ade39c020ca could not be found. Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:48:13.507327 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:48:13.516907 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e86c78e-45f6-425f-b575-6ade39c020ca could not be found. Jul 18 02:48:13.516907 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:48:13.516907 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:48:13.516907 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:48:13.516907 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:48:13.516907 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:48:13.516907 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:48:13.516907 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:48:13.516907 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:48:13.516907 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e86c78e-45f6-425f-b575-6ade39c020ca could not be found. Jul 18 02:48:13.516907 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:48:13.516907 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-957d3e5c-8fe1-4185-85b5-ec87f55c9ecf tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Returning 404 to user: Instance 8e86c78e-45f6-425f-b575-6ade39c020ca could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:48:13.518742 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6e19246b-078c-4fc2-aa3f-bba1de517fae tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:13.518937 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-957d3e5c-8fe1-4185-85b5-ec87f55c9ecf tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca" status: 404 len: 111 microversion: 2.1 time: 0.204607 Jul 18 02:48:13.521950 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6e19246b-078c-4fc2-aa3f-bba1de517fae tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838" status: 200 len: 1331 microversion: 2.1 time: 0.342744 Jul 18 02:48:13.522231 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2308/4628] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:48:13 2022] DELETE /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca => generated 111 bytes in 218 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:48:13.522547 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2321/4629] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:13 2022] GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838 => generated 1331 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:48:13.537156 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6d9096a1-de07-42e0-8e75-17ccf96ecede tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:13.538180 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6d9096a1-de07-42e0-8e75-17ccf96ecede tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 8e86c78e-45f6-425f-b575-6ade39c020ca] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:13.583303 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6d9096a1-de07-42e0-8e75-17ccf96ecede tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:13.589796 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6d9096a1-de07-42e0-8e75-17ccf96ecede tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:13.591327 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6d9096a1-de07-42e0-8e75-17ccf96ecede tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:13.592103 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6d9096a1-de07-42e0-8e75-17ccf96ecede tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:13.647898 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-6d9096a1-de07-42e0-8e75-17ccf96ecede tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] HTTP exception thrown: Instance 8e86c78e-45f6-425f-b575-6ade39c020ca could not be found. Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6d9096a1-de07-42e0-8e75-17ccf96ecede tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Request method failure captured: Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca HTTP/1.1 Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MkhKQyMqIcwOu4i0RH60e0B-LnLKycDAz0jZUJC1r0wHWOXjk1LJXWL_T7_DvRKRQ8XWUQtuQMLCbyBlYY-B80W2IR_3MDcSH7iGxj8WcdUMFvLOPqIcqGLM4pkgnzeggEV3pG9uiV7zBqzYpM5TDavzHrpc1fuB6YDvlhFsy2w5kg Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: fcdf9bfc7a9d4e45acebe3c362787290 Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServerDiskConfigTestJSON-650239955 Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fcdf9bfc7a9d4e45acebe3c362787290"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fcdf9bfc7a9d4e45acebe3c362787290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fcdf9bfc7a9d4e45acebe3c362787290"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fcdf9bfc7a9d4e45acebe3c362787290"}]}] Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServerDiskConfigTestJSON-650239955 Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: fcdf9bfc7a9d4e45acebe3c362787290 Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-650239955 Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServerDiskConfigTestJSON-650239955-project Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: dc0bfd8ccc564f119014fceb1c9ad8ad Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServerDiskConfigTestJSON-650239955-project Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 8e86c78e-45f6-425f-b575-6ade39c020ca could not be found. Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '8e86c78e-45f6-425f-b575-6ade39c020ca'} Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e86c78e-45f6-425f-b575-6ade39c020ca could not be found. Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e86c78e-45f6-425f-b575-6ade39c020ca could not be found. Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:48:13.660487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:48:13.668829 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:48:13.668829 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:48:13.668829 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:48:13.668829 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:48:13.668829 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:48:13.668829 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e86c78e-45f6-425f-b575-6ade39c020ca could not be found. Jul 18 02:48:13.668829 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:48:13.673485 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6d9096a1-de07-42e0-8e75-17ccf96ecede tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Returning 404 to user: Instance 8e86c78e-45f6-425f-b575-6ade39c020ca could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:48:13.683613 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6d9096a1-de07-42e0-8e75-17ccf96ecede tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca" status: 404 len: 111 microversion: 2.1 time: 0.158177 Jul 18 02:48:13.686120 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2309/4630] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:13 2022] GET /compute/v2.1/servers/8e86c78e-45f6-425f-b575-6ade39c020ca => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:48:13.697506 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-155d08ee-6df0-42e9-82b5-980f93018335 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:13.698406 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-155d08ee-6df0-42e9-82b5-980f93018335 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:13.706021 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-155d08ee-6df0-42e9-82b5-980f93018335 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:13.706822 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-155d08ee-6df0-42e9-82b5-980f93018335 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:13.708548 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-155d08ee-6df0-42e9-82b5-980f93018335 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:13.709292 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-155d08ee-6df0-42e9-82b5-980f93018335 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:13.739464 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-155d08ee-6df0-42e9-82b5-980f93018335 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] HTTP exception thrown: Instance 5681a932-b6a9-4c1f-8797-69655e66927e could not be found. Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-155d08ee-6df0-42e9-82b5-980f93018335 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Request method failure captured: Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e HTTP/1.1 Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MkhKQyMqIcwOu4i0RH60e0B-LnLKycDAz0jZUJC1r0wHWOXjk1LJXWL_T7_DvRKRQ8XWUQtuQMLCbyBlYY-B80W2IR_3MDcSH7iGxj8WcdUMFvLOPqIcqGLM4pkgnzeggEV3pG9uiV7zBqzYpM5TDavzHrpc1fuB6YDvlhFsy2w5kg Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: fcdf9bfc7a9d4e45acebe3c362787290 Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServerDiskConfigTestJSON-650239955 Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fcdf9bfc7a9d4e45acebe3c362787290"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fcdf9bfc7a9d4e45acebe3c362787290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fcdf9bfc7a9d4e45acebe3c362787290"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fcdf9bfc7a9d4e45acebe3c362787290"}]}] Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServerDiskConfigTestJSON-650239955 Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: fcdf9bfc7a9d4e45acebe3c362787290 Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-650239955 Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServerDiskConfigTestJSON-650239955-project Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: dc0bfd8ccc564f119014fceb1c9ad8ad Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServerDiskConfigTestJSON-650239955-project Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 5681a932-b6a9-4c1f-8797-69655e66927e could not be found. Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '5681a932-b6a9-4c1f-8797-69655e66927e'} Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5681a932-b6a9-4c1f-8797-69655e66927e could not be found. Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:48:13.741939 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:48:13.747956 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5681a932-b6a9-4c1f-8797-69655e66927e could not be found. Jul 18 02:48:13.747956 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:48:13.747956 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:48:13.747956 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:48:13.747956 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:48:13.747956 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:48:13.747956 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:48:13.747956 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:48:13.747956 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:48:13.747956 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5681a932-b6a9-4c1f-8797-69655e66927e could not be found. Jul 18 02:48:13.747956 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:48:13.753218 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-155d08ee-6df0-42e9-82b5-980f93018335 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Returning 404 to user: Instance 5681a932-b6a9-4c1f-8797-69655e66927e could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:48:13.754411 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-155d08ee-6df0-42e9-82b5-980f93018335 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "DELETE /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 404 len: 111 microversion: 2.1 time: 0.062315 Jul 18 02:48:13.758866 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2322/4631] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:48:13 2022] DELETE /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:48:13.774131 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1b7a9f6d-3b32-48dd-8136-f7e8ed7254a8 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:13.776216 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1b7a9f6d-3b32-48dd-8136-f7e8ed7254a8 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] [instance: 5681a932-b6a9-4c1f-8797-69655e66927e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:13.825191 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1b7a9f6d-3b32-48dd-8136-f7e8ed7254a8 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:13.826058 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1b7a9f6d-3b32-48dd-8136-f7e8ed7254a8 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:13.835732 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1b7a9f6d-3b32-48dd-8136-f7e8ed7254a8 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:13.836419 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1b7a9f6d-3b32-48dd-8136-f7e8ed7254a8 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:13.993807 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-1b7a9f6d-3b32-48dd-8136-f7e8ed7254a8 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] HTTP exception thrown: Instance 5681a932-b6a9-4c1f-8797-69655e66927e could not be found. Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1b7a9f6d-3b32-48dd-8136-f7e8ed7254a8 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Request method failure captured: Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e HTTP/1.1 Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MkhKQyMqIcwOu4i0RH60e0B-LnLKycDAz0jZUJC1r0wHWOXjk1LJXWL_T7_DvRKRQ8XWUQtuQMLCbyBlYY-B80W2IR_3MDcSH7iGxj8WcdUMFvLOPqIcqGLM4pkgnzeggEV3pG9uiV7zBqzYpM5TDavzHrpc1fuB6YDvlhFsy2w5kg Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: fcdf9bfc7a9d4e45acebe3c362787290 Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServerDiskConfigTestJSON-650239955 Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fcdf9bfc7a9d4e45acebe3c362787290"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fcdf9bfc7a9d4e45acebe3c362787290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fcdf9bfc7a9d4e45acebe3c362787290"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fcdf9bfc7a9d4e45acebe3c362787290"}]}] Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServerDiskConfigTestJSON-650239955 Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: fcdf9bfc7a9d4e45acebe3c362787290 Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-650239955 Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServerDiskConfigTestJSON-650239955-project Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: dc0bfd8ccc564f119014fceb1c9ad8ad Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServerDiskConfigTestJSON-650239955-project Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 5681a932-b6a9-4c1f-8797-69655e66927e could not be found. Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '5681a932-b6a9-4c1f-8797-69655e66927e'} Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5681a932-b6a9-4c1f-8797-69655e66927e could not be found. Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5681a932-b6a9-4c1f-8797-69655e66927e could not be found. Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:48:13.998256 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:48:14.002392 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:48:14.002392 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:48:14.002392 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:48:14.002392 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:48:14.002392 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:48:14.002392 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5681a932-b6a9-4c1f-8797-69655e66927e could not be found. Jul 18 02:48:14.002392 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:48:14.023318 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1b7a9f6d-3b32-48dd-8136-f7e8ed7254a8 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] Returning 404 to user: Instance 5681a932-b6a9-4c1f-8797-69655e66927e could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:48:14.028534 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1b7a9f6d-3b32-48dd-8136-f7e8ed7254a8 tempest-ServerDiskConfigTestJSON-650239955 tempest-ServerDiskConfigTestJSON-650239955-project] 10.222.0.57 "GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e" status: 404 len: 111 microversion: 2.1 time: 0.261829 Jul 18 02:48:14.034440 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2310/4632] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:13 2022] GET /compute/v2.1/servers/5681a932-b6a9-4c1f-8797-69655e66927e => generated 111 bytes in 270 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:48:14.574655 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-14e7bd1c-59fa-449e-95e2-09816eab7b11 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:14.575483 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-14e7bd1c-59fa-449e-95e2-09816eab7b11 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 2e823ef6-49cc-4fb5-ae76-3d4e87041838] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:14.602602 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14e7bd1c-59fa-449e-95e2-09816eab7b11 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:14.605600 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14e7bd1c-59fa-449e-95e2-09816eab7b11 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:14.607818 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14e7bd1c-59fa-449e-95e2-09816eab7b11 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:14.613137 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14e7bd1c-59fa-449e-95e2-09816eab7b11 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:14.704802 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-14e7bd1c-59fa-449e-95e2-09816eab7b11 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] HTTP exception thrown: Instance 2e823ef6-49cc-4fb5-ae76-3d4e87041838 could not be found. Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-14e7bd1c-59fa-449e-95e2-09816eab7b11 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Request method failure captured: Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838 HTTP/1.1 Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MhfM0UyOyoMgRP_1BgsB5GQEFaLnp85satKIE74LtU4aati7wjZItAybGxqrHGu9HKZ07IOl-ghvuL-XVY7iiNLxZrz8uz6pnetXMm39fDBZo0QiKDc9Xu-2OCp3obDb_4yxslV3N-dd0oIabggtRNHi18D28MbZyTc-9xFAnMfxLs Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 8fa714ec7f5a4af0a33f56b45e999a7a Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-AttachVolumeNegativeTest-683705837 Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8fa714ec7f5a4af0a33f56b45e999a7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fa714ec7f5a4af0a33f56b45e999a7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fa714ec7f5a4af0a33f56b45e999a7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8fa714ec7f5a4af0a33f56b45e999a7a"}]}] Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-AttachVolumeNegativeTest-683705837 Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 8fa714ec7f5a4af0a33f56b45e999a7a Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-683705837 Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-AttachVolumeNegativeTest-683705837-project Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 1be686f2aa93473585ca064041bd8140 Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-AttachVolumeNegativeTest-683705837-project Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 2e823ef6-49cc-4fb5-ae76-3d4e87041838 could not be found. Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '2e823ef6-49cc-4fb5-ae76-3d4e87041838'} Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e823ef6-49cc-4fb5-ae76-3d4e87041838 could not be found. Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e823ef6-49cc-4fb5-ae76-3d4e87041838 could not be found. Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:48:14.709541 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:48:14.714625 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:48:14.714625 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:48:14.714625 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:48:14.714625 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:48:14.714625 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:48:14.714625 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e823ef6-49cc-4fb5-ae76-3d4e87041838 could not be found. Jul 18 02:48:14.714625 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:48:14.716169 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-14e7bd1c-59fa-449e-95e2-09816eab7b11 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Returning 404 to user: Instance 2e823ef6-49cc-4fb5-ae76-3d4e87041838 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:48:14.717248 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-14e7bd1c-59fa-449e-95e2-09816eab7b11 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838" status: 404 len: 111 microversion: 2.1 time: 0.166532 Jul 18 02:48:14.718404 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2323/4633] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:14 2022] GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838 => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:48:14.729855 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-303c69eb-2f1e-489f-8262-7c7662d36947 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '.version_select at 0x7ff4adbed310>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:14.786639 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-303c69eb-2f1e-489f-8262-7c7662d36947 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1491470079" status: 202 len: 0 microversion: 2.1 time: 0.063257 Jul 18 02:48:14.788927 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2311/4634] 10.222.0.57 () {58 vars in 1220 bytes} [Mon Jul 18 02:48:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1491470079 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:48:18.154142 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ba601226-c52c-4cd3-8783-f84150300307 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Action: 'create', calling method: .version_select at 0x7ff4a9673d30>, body: {"keypair": {"name": "tempest-keypair-1176862568", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEl4HkFkSq0LAZ7tR+TpwRMYOlOsHckpvhOcX6GeGhIeLAth2xSs5m3KCuFFqEI46fkcl3EGtUma2Nm90xwWG8ANiCWvcmhQ51BBnF8p/FI6UgipUIKiHMcnYbY9lPtPSA=="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:48:18.223365 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-ba601226-c52c-4cd3-8783-f84150300307 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Getting quotas for project 8fa714ec7f5a4af0a33f56b45e999a7a. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:48:18.242210 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-ba601226-c52c-4cd3-8783-f84150300307 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Getting quotas for user 1be686f2aa93473585ca064041bd8140 and project 8fa714ec7f5a4af0a33f56b45e999a7a. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:48:18.316260 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ba601226-c52c-4cd3-8783-f84150300307 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.178047 Jul 18 02:48:18.322243 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2324/4635] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 02:48:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:48:18.852760 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c2c0648e-9dd0-4ca6-8825-1c995591c6ed tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1709562324", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "7de562a1-b0e6-4bf7-88e0-c04be150f263"}], "key_name": "tempest-TestNetworkAdvancedServerOps-191272585", "security_groups": [{"name": "tempest-secgroup-smoke-242152024"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:48:19.230568 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-c2c0648e-9dd0-4ca6-8825-1c995591c6ed tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] validate_networks() for [('7de562a1-b0e6-4bf7-88e0-c04be150f263', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:48:21.830138 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-c2c0648e-9dd0-4ca6-8825-1c995591c6ed tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:48:21.830894 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-c2c0648e-9dd0-4ca6-8825-1c995591c6ed tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:48:21.831442 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-c2c0648e-9dd0-4ca6-8825-1c995591c6ed tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:48:21.832700 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-c2c0648e-9dd0-4ca6-8825-1c995591c6ed tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:48:21.833374 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-c2c0648e-9dd0-4ca6-8825-1c995591c6ed tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:48:21.901245 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c2c0648e-9dd0-4ca6-8825-1c995591c6ed tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:21.902059 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c2c0648e-9dd0-4ca6-8825-1c995591c6ed tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:21.917091 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c2c0648e-9dd0-4ca6-8825-1c995591c6ed tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:21.920669 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c2c0648e-9dd0-4ca6-8825-1c995591c6ed tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:21.967075 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-c2c0648e-9dd0-4ca6-8825-1c995591c6ed tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Getting quotas for project fa240dfd375a45efb42fc04807acf847. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:48:21.975201 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-c2c0648e-9dd0-4ca6-8825-1c995591c6ed tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Getting quotas for user 381a2ab772ff495cb85b89a85a267cfe and project fa240dfd375a45efb42fc04807acf847. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:48:22.016984 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c2c0648e-9dd0-4ca6-8825-1c995591c6ed tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:48:22.019965 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c2c0648e-9dd0-4ca6-8825-1c995591c6ed tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:48:22.133731 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c2c0648e-9dd0-4ca6-8825-1c995591c6ed tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.300327 Jul 18 02:48:22.137477 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2312/4636] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:48:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 3305 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:48:22.150400 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-63be61b2-cd40-442b-bff7-82a79b3aea3a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:22.152259 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-63be61b2-cd40-442b-bff7-82a79b3aea3a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:24.705361 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:24.779306 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-63be61b2-cd40-442b-bff7-82a79b3aea3a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:24.803509 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-63be61b2-cd40-442b-bff7-82a79b3aea3a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 200 len: 1266 microversion: 2.1 time: 2.659681 Jul 18 02:48:24.818911 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2325/4637] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:22 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 1266 bytes in 2676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:25.889116 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f98bc9b8-a71f-47c3-a86f-26327d147558 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:25.889116 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f98bc9b8-a71f-47c3-a86f-26327d147558 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:25.914761 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:25.920102 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f98bc9b8-a71f-47c3-a86f-26327d147558 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:25.921447 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f98bc9b8-a71f-47c3-a86f-26327d147558 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:25.926240 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f98bc9b8-a71f-47c3-a86f-26327d147558 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:25.926240 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f98bc9b8-a71f-47c3-a86f-26327d147558 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:26.363681 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f98bc9b8-a71f-47c3-a86f-26327d147558 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:26.428735 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f98bc9b8-a71f-47c3-a86f-26327d147558 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 200 len: 1324 microversion: 2.1 time: 0.539630 Jul 18 02:48:26.430600 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2313/4638] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:25 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 1324 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:27.459255 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c466889d-eec6-4afa-9539-09443d870d87 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:27.461675 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c466889d-eec6-4afa-9539-09443d870d87 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:27.483664 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c466889d-eec6-4afa-9539-09443d870d87 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:27.484440 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c466889d-eec6-4afa-9539-09443d870d87 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:27.485518 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c466889d-eec6-4afa-9539-09443d870d87 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:27.486409 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c466889d-eec6-4afa-9539-09443d870d87 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:28.075237 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c466889d-eec6-4afa-9539-09443d870d87 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:28.143675 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c466889d-eec6-4afa-9539-09443d870d87 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 200 len: 1324 microversion: 2.1 time: 0.681783 Jul 18 02:48:28.145917 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2326/4639] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:27 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 1324 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:29.174597 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cb2e3eb5-324e-489f-8fee-f31034fa3e44 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:29.176137 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cb2e3eb5-324e-489f-8fee-f31034fa3e44 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:29.197844 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cb2e3eb5-324e-489f-8fee-f31034fa3e44 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:29.198856 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cb2e3eb5-324e-489f-8fee-f31034fa3e44 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:29.199933 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cb2e3eb5-324e-489f-8fee-f31034fa3e44 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:29.201285 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cb2e3eb5-324e-489f-8fee-f31034fa3e44 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:29.420691 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-cb2e3eb5-324e-489f-8fee-f31034fa3e44 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:29.462556 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cb2e3eb5-324e-489f-8fee-f31034fa3e44 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 200 len: 1324 microversion: 2.1 time: 0.291413 Jul 18 02:48:29.472976 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2314/4640] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:29 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 1324 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:48:29.507207 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-21dd110f-c593-439e-9a92-91e9a315eabd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1459108571", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3d1f3f2f-8c86-416a-9c8b-88e33cae40fd"}], "security_groups": [{"name": "tempest-securitygroup--1923627707"}], "key_name": "tempest-keypair-1176862568", "user_data": "}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:48:30.053549 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-21dd110f-c593-439e-9a92-91e9a315eabd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] validate_networks() for [('3d1f3f2f-8c86-416a-9c8b-88e33cae40fd', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:48:30.522452 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-05743ecc-1336-4810-a8e3-0be1697f6b02 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:30.527378 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-05743ecc-1336-4810-a8e3-0be1697f6b02 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:30.571784 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-05743ecc-1336-4810-a8e3-0be1697f6b02 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:30.572264 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-05743ecc-1336-4810-a8e3-0be1697f6b02 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:30.573219 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-05743ecc-1336-4810-a8e3-0be1697f6b02 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:30.573740 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-05743ecc-1336-4810-a8e3-0be1697f6b02 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:31.552716 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-05743ecc-1336-4810-a8e3-0be1697f6b02 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:31.595295 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-05743ecc-1336-4810-a8e3-0be1697f6b02 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 200 len: 1391 microversion: 2.1 time: 1.087502 Jul 18 02:48:31.610167 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2315/4641] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:30 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 1391 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:32.008487 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-21dd110f-c593-439e-9a92-91e9a315eabd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:48:32.015209 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-21dd110f-c593-439e-9a92-91e9a315eabd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:48:32.016601 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-21dd110f-c593-439e-9a92-91e9a315eabd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:48:32.017056 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-21dd110f-c593-439e-9a92-91e9a315eabd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:48:32.017486 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-21dd110f-c593-439e-9a92-91e9a315eabd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:48:32.038354 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-21dd110f-c593-439e-9a92-91e9a315eabd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:32.038849 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-21dd110f-c593-439e-9a92-91e9a315eabd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:32.039687 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-21dd110f-c593-439e-9a92-91e9a315eabd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:32.040134 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-21dd110f-c593-439e-9a92-91e9a315eabd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:32.096572 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-21dd110f-c593-439e-9a92-91e9a315eabd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Getting quotas for project 8fa714ec7f5a4af0a33f56b45e999a7a. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:48:32.112190 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-21dd110f-c593-439e-9a92-91e9a315eabd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Getting quotas for user 1be686f2aa93473585ca064041bd8140 and project 8fa714ec7f5a4af0a33f56b45e999a7a. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:48:32.158984 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-21dd110f-c593-439e-9a92-91e9a315eabd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:48:32.161850 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-21dd110f-c593-439e-9a92-91e9a315eabd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: dfa2f044-9f51-44f9-a87a-1f114d90e7d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:48:32.302727 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-21dd110f-c593-439e-9a92-91e9a315eabd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.837453 Jul 18 02:48:32.305966 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2327/4642] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:48:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 2851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:48:32.321057 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-78729cb2-0176-4686-90b4-4355010bf93f tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:32.327420 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-78729cb2-0176-4686-90b4-4355010bf93f tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: dfa2f044-9f51-44f9-a87a-1f114d90e7d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:32.331288 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:32.344128 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:32.632271 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7bf26d0e-0029-4711-81cd-7be3ca7c8122 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:32.635234 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-78729cb2-0176-4686-90b4-4355010bf93f tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:32.640388 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7bf26d0e-0029-4711-81cd-7be3ca7c8122 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:32.656648 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-78729cb2-0176-4686-90b4-4355010bf93f tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4" status: 200 len: 1242 microversion: 2.1 time: 0.342962 Jul 18 02:48:32.660770 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2316/4643] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:32 2022] GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4 => generated 1242 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:32.663347 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7bf26d0e-0029-4711-81cd-7be3ca7c8122 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:32.666311 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7bf26d0e-0029-4711-81cd-7be3ca7c8122 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:32.673311 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7bf26d0e-0029-4711-81cd-7be3ca7c8122 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:32.674990 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7bf26d0e-0029-4711-81cd-7be3ca7c8122 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:33.358870 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7bf26d0e-0029-4711-81cd-7be3ca7c8122 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:33.374759 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7bf26d0e-0029-4711-81cd-7be3ca7c8122 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 200 len: 1391 microversion: 2.1 time: 0.746454 Jul 18 02:48:33.382363 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2328/4644] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:32 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 1391 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:33.687961 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4e610354-fdf1-464b-a639-aa9f4443a112 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:33.698426 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4e610354-fdf1-464b-a639-aa9f4443a112 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: dfa2f044-9f51-44f9-a87a-1f114d90e7d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:34.078838 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4e610354-fdf1-464b-a639-aa9f4443a112 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:34.097013 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4e610354-fdf1-464b-a639-aa9f4443a112 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4" status: 200 len: 1242 microversion: 2.1 time: 0.420172 Jul 18 02:48:34.115350 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2317/4645] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:33 2022] GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4 => generated 1242 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:48:34.392940 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9a3ffdee-4037-452b-9c8b-efe4d75e2ed3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:34.393579 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9a3ffdee-4037-452b-9c8b-efe4d75e2ed3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:34.396607 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:34.409687 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9a3ffdee-4037-452b-9c8b-efe4d75e2ed3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:34.410473 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9a3ffdee-4037-452b-9c8b-efe4d75e2ed3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:34.411767 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9a3ffdee-4037-452b-9c8b-efe4d75e2ed3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:34.412554 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9a3ffdee-4037-452b-9c8b-efe4d75e2ed3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:34.499598 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-810a50e9-5786-4d51-aa6f-7ae71771430a req-0a7dc4dc-e43b-4072-aee1-b9e168ef83ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ce58c09-6319-4fad-ae8a-2b4199edcfd9", "tag": "7f42876f-44b2-4ca5-aea9-aa2f86f8f3ed"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:48:34.522231 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-810a50e9-5786-4d51-aa6f-7ae71771430a req-0a7dc4dc-e43b-4072-aee1-b9e168ef83ec service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:34.522971 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-810a50e9-5786-4d51-aa6f-7ae71771430a req-0a7dc4dc-e43b-4072-aee1-b9e168ef83ec service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:34.541159 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:34.549673 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-810a50e9-5786-4d51-aa6f-7ae71771430a req-0a7dc4dc-e43b-4072-aee1-b9e168ef83ec service nova] Creating event network-changed:7f42876f-44b2-4ca5-aea9-aa2f86f8f3ed for instance 5ce58c09-6319-4fad-ae8a-2b4199edcfd9 on n-h2-465891-3 Jul 18 02:48:34.558219 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-810a50e9-5786-4d51-aa6f-7ae71771430a req-0a7dc4dc-e43b-4072-aee1-b9e168ef83ec service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066730 Jul 18 02:48:34.560883 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2318/4646] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:48:35.156313 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9c768609-63ba-4974-84eb-6936446a2069 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:35.158992 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9c768609-63ba-4974-84eb-6936446a2069 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: dfa2f044-9f51-44f9-a87a-1f114d90e7d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:35.205281 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9c768609-63ba-4974-84eb-6936446a2069 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:35.206637 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9c768609-63ba-4974-84eb-6936446a2069 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:35.208485 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9c768609-63ba-4974-84eb-6936446a2069 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:35.209537 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9c768609-63ba-4974-84eb-6936446a2069 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:36.053170 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9c768609-63ba-4974-84eb-6936446a2069 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:36.085081 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9c768609-63ba-4974-84eb-6936446a2069 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4" status: 200 len: 1302 microversion: 2.1 time: 0.945311 Jul 18 02:48:36.101796 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2319/4647] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:35 2022] GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4 => generated 1302 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:48:36.576540 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9a3ffdee-4037-452b-9c8b-efe4d75e2ed3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:36.620293 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9a3ffdee-4037-452b-9c8b-efe4d75e2ed3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 200 len: 1391 microversion: 2.1 time: 2.223285 Jul 18 02:48:36.639263 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2329/4648] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:34 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 1391 bytes in 2249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:37.131906 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5875c94d-cc57-4e51-8395-fc3d15c67aa2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:37.133547 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5875c94d-cc57-4e51-8395-fc3d15c67aa2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: dfa2f044-9f51-44f9-a87a-1f114d90e7d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:37.181388 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5875c94d-cc57-4e51-8395-fc3d15c67aa2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:37.184437 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5875c94d-cc57-4e51-8395-fc3d15c67aa2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:37.189501 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5875c94d-cc57-4e51-8395-fc3d15c67aa2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:37.192135 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5875c94d-cc57-4e51-8395-fc3d15c67aa2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:37.508682 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5875c94d-cc57-4e51-8395-fc3d15c67aa2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:37.555783 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5875c94d-cc57-4e51-8395-fc3d15c67aa2 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4" status: 200 len: 1300 microversion: 2.1 time: 0.438893 Jul 18 02:48:37.581103 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2320/4649] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:37 2022] GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4 => generated 1300 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:37.658327 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5fbcc63a-9284-4301-b3fc-2e969d379c6b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:37.659478 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5fbcc63a-9284-4301-b3fc-2e969d379c6b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:37.697136 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5fbcc63a-9284-4301-b3fc-2e969d379c6b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:37.698057 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5fbcc63a-9284-4301-b3fc-2e969d379c6b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:37.699548 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5fbcc63a-9284-4301-b3fc-2e969d379c6b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:37.700366 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5fbcc63a-9284-4301-b3fc-2e969d379c6b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:38.600526 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2e5b3a4c-ab6d-402f-9c1f-28d79618e7b5 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:38.601189 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2e5b3a4c-ab6d-402f-9c1f-28d79618e7b5 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: dfa2f044-9f51-44f9-a87a-1f114d90e7d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:38.620255 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2e5b3a4c-ab6d-402f-9c1f-28d79618e7b5 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:38.620722 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2e5b3a4c-ab6d-402f-9c1f-28d79618e7b5 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:38.621900 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2e5b3a4c-ab6d-402f-9c1f-28d79618e7b5 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:38.622584 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2e5b3a4c-ab6d-402f-9c1f-28d79618e7b5 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:39.530987 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5fbcc63a-9284-4301-b3fc-2e969d379c6b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:39.577688 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5fbcc63a-9284-4301-b3fc-2e969d379c6b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 200 len: 1391 microversion: 2.1 time: 1.925107 Jul 18 02:48:39.583948 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2330/4650] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:37 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 1391 bytes in 1935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:39.993806 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2e5b3a4c-ab6d-402f-9c1f-28d79618e7b5 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:40.076114 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2e5b3a4c-ab6d-402f-9c1f-28d79618e7b5 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4" status: 200 len: 1368 microversion: 2.1 time: 1.479079 Jul 18 02:48:40.089830 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2321/4651] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:38 2022] GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4 => generated 1368 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:48:40.161799 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7e37c92d-67cd-4099-9ffa-30f498824fdc tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-28092217", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "151d72a1-b5bb-4113-a1ab-470e356fcfa1", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "ba77f5bb-f255-444f-9bd1-1e3dbe42d430"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:48:40.445764 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-7e37c92d-67cd-4099-9ffa-30f498824fdc tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] validate_networks() for [('ba77f5bb-f255-444f-9bd1-1e3dbe42d430', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:48:40.606749 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e7302e77-7538-4cb1-a3ac-10ff6adba753 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:40.613005 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e7302e77-7538-4cb1-a3ac-10ff6adba753 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:40.649573 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e7302e77-7538-4cb1-a3ac-10ff6adba753 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:40.653434 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e7302e77-7538-4cb1-a3ac-10ff6adba753 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:40.655862 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e7302e77-7538-4cb1-a3ac-10ff6adba753 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:40.657155 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e7302e77-7538-4cb1-a3ac-10ff6adba753 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:41.699595 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e7302e77-7538-4cb1-a3ac-10ff6adba753 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:41.727017 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e7302e77-7538-4cb1-a3ac-10ff6adba753 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 200 len: 1391 microversion: 2.1 time: 1.129248 Jul 18 02:48:41.733817 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2322/4652] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:40 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 1391 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:41.755051 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-06f23b66-939d-431e-9ea3-828d0e33ae34 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:41.756870 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-06f23b66-939d-431e-9ea3-828d0e33ae34 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: dfa2f044-9f51-44f9-a87a-1f114d90e7d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:41.792720 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-06f23b66-939d-431e-9ea3-828d0e33ae34 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:41.794583 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-06f23b66-939d-431e-9ea3-828d0e33ae34 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:41.799774 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-06f23b66-939d-431e-9ea3-828d0e33ae34 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:41.805069 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-06f23b66-939d-431e-9ea3-828d0e33ae34 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:42.075955 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:42.139835 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-7e37c92d-67cd-4099-9ffa-30f498824fdc tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:48:42.140708 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-7e37c92d-67cd-4099-9ffa-30f498824fdc tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:48:42.142087 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-7e37c92d-67cd-4099-9ffa-30f498824fdc tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:48:42.142765 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-7e37c92d-67cd-4099-9ffa-30f498824fdc tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:48:42.145305 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-7e37c92d-67cd-4099-9ffa-30f498824fdc tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:48:42.167268 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=12 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:42.192357 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7e37c92d-67cd-4099-9ffa-30f498824fdc tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:42.194083 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7e37c92d-67cd-4099-9ffa-30f498824fdc tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:42.197041 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7e37c92d-67cd-4099-9ffa-30f498824fdc tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:42.200111 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7e37c92d-67cd-4099-9ffa-30f498824fdc tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:42.250606 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-7e37c92d-67cd-4099-9ffa-30f498824fdc tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Getting quotas for project 2b7654e273f6487ba83382da4f96056d. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:48:42.264286 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-7e37c92d-67cd-4099-9ffa-30f498824fdc tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Getting quotas for user d1afc1702f8045a396b98e5c24b124e7 and project 2b7654e273f6487ba83382da4f96056d. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:48:42.311661 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7e37c92d-67cd-4099-9ffa-30f498824fdc tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:48:42.314061 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7e37c92d-67cd-4099-9ffa-30f498824fdc tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='151d72a1-b5bb-4113-a1ab-470e356fcfa1',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:48:42.539431 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7e37c92d-67cd-4099-9ffa-30f498824fdc tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.393240 Jul 18 02:48:42.540833 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2331/4653] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:48:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2396 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:48:42.556112 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-073dc997-aacb-40bf-99b8-e35bb5553599 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:42.557178 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-073dc997-aacb-40bf-99b8-e35bb5553599 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:42.795405 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-06f23b66-939d-431e-9ea3-828d0e33ae34 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:42.838852 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-06f23b66-939d-431e-9ea3-828d0e33ae34 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4" status: 200 len: 1368 microversion: 2.1 time: 1.102366 Jul 18 02:48:42.842385 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2323/4654] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:41 2022] GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4 => generated 1368 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:42.852182 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-073dc997-aacb-40bf-99b8-e35bb5553599 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:42.860915 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-073dc997-aacb-40bf-99b8-e35bb5553599 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c" status: 200 len: 1055 microversion: 2.1 time: 0.309338 Jul 18 02:48:42.871473 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2332/4655] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:42 2022] GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c => generated 1055 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:48:42.898644 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bc7be229-7439-459c-9717-9bf2c4d5d93f tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:42.903827 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bc7be229-7439-459c-9717-9bf2c4d5d93f tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:42.925227 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bc7be229-7439-459c-9717-9bf2c4d5d93f tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:42.935924 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bc7be229-7439-459c-9717-9bf2c4d5d93f tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:42.952502 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bc7be229-7439-459c-9717-9bf2c4d5d93f tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:42.953645 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bc7be229-7439-459c-9717-9bf2c4d5d93f tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:43.861171 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-28b1f2f9-acdd-4def-b8f3-3259f4f2ac43 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:43.861934 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-28b1f2f9-acdd-4def-b8f3-3259f4f2ac43 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: dfa2f044-9f51-44f9-a87a-1f114d90e7d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:43.885643 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-28b1f2f9-acdd-4def-b8f3-3259f4f2ac43 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:43.886636 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-28b1f2f9-acdd-4def-b8f3-3259f4f2ac43 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:43.891742 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-28b1f2f9-acdd-4def-b8f3-3259f4f2ac43 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:43.898416 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-28b1f2f9-acdd-4def-b8f3-3259f4f2ac43 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:44.086284 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:44.616657 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bc7be229-7439-459c-9717-9bf2c4d5d93f tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:44.649618 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bc7be229-7439-459c-9717-9bf2c4d5d93f tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 200 len: 1391 microversion: 2.1 time: 1.797612 Jul 18 02:48:44.651093 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2324/4656] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:42 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 1391 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:44.675900 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a1d7a173-0311-4ba1-b8bd-381ec0d4771c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:44.679041 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a1d7a173-0311-4ba1-b8bd-381ec0d4771c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:44.716192 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a1d7a173-0311-4ba1-b8bd-381ec0d4771c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:44.717011 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a1d7a173-0311-4ba1-b8bd-381ec0d4771c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:44.723984 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a1d7a173-0311-4ba1-b8bd-381ec0d4771c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:44.725389 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a1d7a173-0311-4ba1-b8bd-381ec0d4771c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:45.407538 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a1d7a173-0311-4ba1-b8bd-381ec0d4771c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:45.463590 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a1d7a173-0311-4ba1-b8bd-381ec0d4771c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c" status: 200 len: 1107 microversion: 2.1 time: 0.807850 Jul 18 02:48:45.500888 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2325/4657] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:44 2022] GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c => generated 1107 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:45.537331 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-a732d63c-09eb-462c-ba6b-4b71dea8a5ac req-40e43435-80fa-4d2d-ad19-caeb0442b7c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfa2f044-9f51-44f9-a87a-1f114d90e7d4", "tag": "783eed5b-39aa-46d8-8be0-a1006eaaf5de"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:48:45.568418 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-a732d63c-09eb-462c-ba6b-4b71dea8a5ac req-40e43435-80fa-4d2d-ad19-caeb0442b7c3 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:45.569517 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-a732d63c-09eb-462c-ba6b-4b71dea8a5ac req-40e43435-80fa-4d2d-ad19-caeb0442b7c3 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:45.603975 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-a732d63c-09eb-462c-ba6b-4b71dea8a5ac req-40e43435-80fa-4d2d-ad19-caeb0442b7c3 service nova] Creating event network-changed:783eed5b-39aa-46d8-8be0-a1006eaaf5de for instance dfa2f044-9f51-44f9-a87a-1f114d90e7d4 on n-h1-465891-3 Jul 18 02:48:45.620749 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-a732d63c-09eb-462c-ba6b-4b71dea8a5ac req-40e43435-80fa-4d2d-ad19-caeb0442b7c3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117192 Jul 18 02:48:45.622442 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2326/4658] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:48:45.671786 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4ab8f605-9ed5-47b6-9c28-dd14d54aac74 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:45.674675 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4ab8f605-9ed5-47b6-9c28-dd14d54aac74 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:45.687875 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4ab8f605-9ed5-47b6-9c28-dd14d54aac74 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:45.688697 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4ab8f605-9ed5-47b6-9c28-dd14d54aac74 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:45.689798 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4ab8f605-9ed5-47b6-9c28-dd14d54aac74 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:45.690586 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4ab8f605-9ed5-47b6-9c28-dd14d54aac74 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:46.395540 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-28b1f2f9-acdd-4def-b8f3-3259f4f2ac43 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:46.409255 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-28b1f2f9-acdd-4def-b8f3-3259f4f2ac43 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4" status: 200 len: 1368 microversion: 2.1 time: 2.554306 Jul 18 02:48:46.416681 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2333/4659] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:43 2022] GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4 => generated 1368 bytes in 2562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:48:46.431675 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-be5d4b52-8725-4286-8dc2-e36a754638c2 req-ece465b0-418d-4520-8075-5a8ca66543d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ce58c09-6319-4fad-ae8a-2b4199edcfd9", "name": "network-vif-plugged", "status": "completed", "tag": "7f42876f-44b2-4ca5-aea9-aa2f86f8f3ed"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:48:46.471569 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-be5d4b52-8725-4286-8dc2-e36a754638c2 req-ece465b0-418d-4520-8075-5a8ca66543d2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:46.472058 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-be5d4b52-8725-4286-8dc2-e36a754638c2 req-ece465b0-418d-4520-8075-5a8ca66543d2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:46.517867 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-be5d4b52-8725-4286-8dc2-e36a754638c2 req-ece465b0-418d-4520-8075-5a8ca66543d2 service nova] Creating event network-vif-plugged:7f42876f-44b2-4ca5-aea9-aa2f86f8f3ed for instance 5ce58c09-6319-4fad-ae8a-2b4199edcfd9 on n-h2-465891-3 Jul 18 02:48:46.543068 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-be5d4b52-8725-4286-8dc2-e36a754638c2 req-ece465b0-418d-4520-8075-5a8ca66543d2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118704 Jul 18 02:48:46.545905 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2334/4660] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:48:46.557576 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-916dc04c-1789-46ad-9a97-0d90bc01ce38 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:46.559625 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-916dc04c-1789-46ad-9a97-0d90bc01ce38 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:46.585845 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-916dc04c-1789-46ad-9a97-0d90bc01ce38 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:46.586449 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-916dc04c-1789-46ad-9a97-0d90bc01ce38 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:46.587314 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-916dc04c-1789-46ad-9a97-0d90bc01ce38 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:46.591648 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-916dc04c-1789-46ad-9a97-0d90bc01ce38 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:47.315226 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-916dc04c-1789-46ad-9a97-0d90bc01ce38 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:47.324746 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-916dc04c-1789-46ad-9a97-0d90bc01ce38 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c" status: 200 len: 1125 microversion: 2.1 time: 0.776281 Jul 18 02:48:47.336630 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2335/4661] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:46 2022] GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c => generated 1125 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:47.428276 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5e424055-d934-4b36-9bac-0227072d1732 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:47.428980 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5e424055-d934-4b36-9bac-0227072d1732 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: dfa2f044-9f51-44f9-a87a-1f114d90e7d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:47.436610 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5e424055-d934-4b36-9bac-0227072d1732 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:47.438881 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5e424055-d934-4b36-9bac-0227072d1732 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:47.439999 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5e424055-d934-4b36-9bac-0227072d1732 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:47.443665 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5e424055-d934-4b36-9bac-0227072d1732 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:47.587357 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4ab8f605-9ed5-47b6-9c28-dd14d54aac74 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:47.656723 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4ab8f605-9ed5-47b6-9c28-dd14d54aac74 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 200 len: 1391 microversion: 2.1 time: 1.991330 Jul 18 02:48:47.664644 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2327/4662] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:45 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 1391 bytes in 2001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:48.335855 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5e424055-d934-4b36-9bac-0227072d1732 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:48.360405 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e8b83c97-ab5f-415d-adca-cdc2357a5ca9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:48.361495 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e8b83c97-ab5f-415d-adca-cdc2357a5ca9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:48.388696 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5e424055-d934-4b36-9bac-0227072d1732 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4" status: 200 len: 1368 microversion: 2.1 time: 0.964199 Jul 18 02:48:48.388886 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e8b83c97-ab5f-415d-adca-cdc2357a5ca9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:48.390299 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e8b83c97-ab5f-415d-adca-cdc2357a5ca9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:48.395577 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e8b83c97-ab5f-415d-adca-cdc2357a5ca9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:48.400386 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e8b83c97-ab5f-415d-adca-cdc2357a5ca9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:48.410665 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2336/4663] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:47 2022] GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4 => generated 1368 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:48.687111 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e455a44c-1c88-4aef-8c76-8b30e2720997 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:48.692535 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e455a44c-1c88-4aef-8c76-8b30e2720997 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:48.727107 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e455a44c-1c88-4aef-8c76-8b30e2720997 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:48.728498 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e455a44c-1c88-4aef-8c76-8b30e2720997 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:48.734897 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e455a44c-1c88-4aef-8c76-8b30e2720997 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:48.745630 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e455a44c-1c88-4aef-8c76-8b30e2720997 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:49.174728 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e8b83c97-ab5f-415d-adca-cdc2357a5ca9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:49.210129 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e8b83c97-ab5f-415d-adca-cdc2357a5ca9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c" status: 200 len: 1125 microversion: 2.1 time: 0.856734 Jul 18 02:48:49.226025 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2328/4664] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:48 2022] GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c => generated 1125 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:49.666096 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a6759aae-43a2-4ee7-8ad5-0487e9860886 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-393137910", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "326cff9f-ae26-41d6-a163-c343b1787589"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:48:49.870253 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-a6759aae-43a2-4ee7-8ad5-0487e9860886 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] validate_networks() for [('326cff9f-ae26-41d6-a163-c343b1787589', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:48:49.970679 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e455a44c-1c88-4aef-8c76-8b30e2720997 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:49.984498 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e455a44c-1c88-4aef-8c76-8b30e2720997 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 200 len: 1391 microversion: 2.1 time: 1.304615 Jul 18 02:48:49.985625 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2337/4665] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:48 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 1391 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:50.044920 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bd19eb1d-c15e-45b4-b669-ea19ce9549b7 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:50.046246 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bd19eb1d-c15e-45b4-b669-ea19ce9549b7 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: dfa2f044-9f51-44f9-a87a-1f114d90e7d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:50.089189 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bd19eb1d-c15e-45b4-b669-ea19ce9549b7 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:50.100978 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bd19eb1d-c15e-45b4-b669-ea19ce9549b7 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:50.104024 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bd19eb1d-c15e-45b4-b669-ea19ce9549b7 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:50.108044 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bd19eb1d-c15e-45b4-b669-ea19ce9549b7 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:51.210675 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bd19eb1d-c15e-45b4-b669-ea19ce9549b7 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:51.232620 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bd19eb1d-c15e-45b4-b669-ea19ce9549b7 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4" status: 200 len: 1368 microversion: 2.1 time: 1.226938 Jul 18 02:48:51.246688 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2338/4666] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:49 2022] GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4 => generated 1368 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:51.258263 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-78367b85-6101-40cd-8943-0f7cf684ee9f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:51.259003 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-78367b85-6101-40cd-8943-0f7cf684ee9f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:51.278770 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-78367b85-6101-40cd-8943-0f7cf684ee9f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:51.279287 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-78367b85-6101-40cd-8943-0f7cf684ee9f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:51.280642 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-78367b85-6101-40cd-8943-0f7cf684ee9f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:51.281458 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-78367b85-6101-40cd-8943-0f7cf684ee9f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:52.230910 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:52.857357 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=8 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:53.462496 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-a6759aae-43a2-4ee7-8ad5-0487e9860886 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:48:53.463227 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-a6759aae-43a2-4ee7-8ad5-0487e9860886 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:48:53.463473 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-a6759aae-43a2-4ee7-8ad5-0487e9860886 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:48:53.466581 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-a6759aae-43a2-4ee7-8ad5-0487e9860886 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:48:53.483836 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-a6759aae-43a2-4ee7-8ad5-0487e9860886 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:48:53.524949 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a6759aae-43a2-4ee7-8ad5-0487e9860886 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:53.527601 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a6759aae-43a2-4ee7-8ad5-0487e9860886 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:53.534675 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a6759aae-43a2-4ee7-8ad5-0487e9860886 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:53.541519 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a6759aae-43a2-4ee7-8ad5-0487e9860886 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:53.644518 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-a6759aae-43a2-4ee7-8ad5-0487e9860886 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Getting quotas for project bdb54b64ce64462e81b9d56698da1ad6. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:48:53.686861 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-a6759aae-43a2-4ee7-8ad5-0487e9860886 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Getting quotas for user ad358704236e46e1b979af45d06d5f28 and project bdb54b64ce64462e81b9d56698da1ad6. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:48:53.726831 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-78367b85-6101-40cd-8943-0f7cf684ee9f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:53.728571 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a6759aae-43a2-4ee7-8ad5-0487e9860886 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:48:53.736212 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a6759aae-43a2-4ee7-8ad5-0487e9860886 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] [instance: d4ed54ff-f096-47d2-a44a-a17b6714091d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:48:53.775976 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-78367b85-6101-40cd-8943-0f7cf684ee9f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c" status: 200 len: 1167 microversion: 2.1 time: 2.528064 Jul 18 02:48:53.779236 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2339/4667] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:51 2022] GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c => generated 1167 bytes in 2532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:53.788688 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-670be84d-444b-4955-8429-f1a89ab1c171 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:53.803893 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-670be84d-444b-4955-8429-f1a89ab1c171 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:53.840871 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-670be84d-444b-4955-8429-f1a89ab1c171 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:53.848322 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-670be84d-444b-4955-8429-f1a89ab1c171 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:53.851940 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-670be84d-444b-4955-8429-f1a89ab1c171 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:53.853665 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-670be84d-444b-4955-8429-f1a89ab1c171 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:53.911336 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a6759aae-43a2-4ee7-8ad5-0487e9860886 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.683228 Jul 18 02:48:53.913566 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2329/4668] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:48:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 4687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:48:53.928569 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bb16a6aa-1849-4fa9-9a43-e7747fb7946d tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:53.929204 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bb16a6aa-1849-4fa9-9a43-e7747fb7946d tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: dfa2f044-9f51-44f9-a87a-1f114d90e7d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:53.952907 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb16a6aa-1849-4fa9-9a43-e7747fb7946d tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:53.958475 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb16a6aa-1849-4fa9-9a43-e7747fb7946d tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:53.959678 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb16a6aa-1849-4fa9-9a43-e7747fb7946d tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:53.960172 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb16a6aa-1849-4fa9-9a43-e7747fb7946d tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:56.047582 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-670be84d-444b-4955-8429-f1a89ab1c171 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:56.061901 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=71 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:56.119687 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-670be84d-444b-4955-8429-f1a89ab1c171 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 200 len: 1563 microversion: 2.1 time: 2.314333 Jul 18 02:48:56.133001 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2340/4669] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:53 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 1563 bytes in 2353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:56.164106 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a477fc18-0126-4e31-ab98-2ef51ac569d7 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:56.165979 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a477fc18-0126-4e31-ab98-2ef51ac569d7 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] [instance: d4ed54ff-f096-47d2-a44a-a17b6714091d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:56.184210 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a477fc18-0126-4e31-ab98-2ef51ac569d7 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:56.185464 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a477fc18-0126-4e31-ab98-2ef51ac569d7 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:56.188255 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a477fc18-0126-4e31-ab98-2ef51ac569d7 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:56.189434 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a477fc18-0126-4e31-ab98-2ef51ac569d7 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:56.396413 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bb16a6aa-1849-4fa9-9a43-e7747fb7946d tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:56.419098 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bb16a6aa-1849-4fa9-9a43-e7747fb7946d tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4" status: 200 len: 1368 microversion: 2.1 time: 2.504136 Jul 18 02:48:56.420980 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2330/4670] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:53 2022] GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4 => generated 1368 bytes in 2507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:56.434852 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-615468e2-48e5-4c14-a034-e276793a5145 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:56.436040 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-615468e2-48e5-4c14-a034-e276793a5145 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:56.455778 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:56.462478 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-615468e2-48e5-4c14-a034-e276793a5145 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:56.489793 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-615468e2-48e5-4c14-a034-e276793a5145 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:56.506707 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-615468e2-48e5-4c14-a034-e276793a5145 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:56.516423 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-615468e2-48e5-4c14-a034-e276793a5145 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:56.523507 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a477fc18-0126-4e31-ab98-2ef51ac569d7 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad358704236e46e1b979af45d06d5f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb54b64ce64462e81b9d56698da1ad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:56.551533 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a477fc18-0126-4e31-ab98-2ef51ac569d7 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] 10.222.0.57 "GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d" status: 200 len: 1212 microversion: 2.1 time: 0.416586 Jul 18 02:48:56.569868 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2341/4671] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:56 2022] GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d => generated 1212 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:56.605961 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-aa226843-383e-4e13-9c11-dfd8947a0139 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1712559763", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "bc8cd9e6-380d-4d74-be23-18035bb9d8a5"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:48:56.815614 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-aa226843-383e-4e13-9c11-dfd8947a0139 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] validate_networks() for [('bc8cd9e6-380d-4d74-be23-18035bb9d8a5', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:48:57.611709 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-615468e2-48e5-4c14-a034-e276793a5145 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:57.658916 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-615468e2-48e5-4c14-a034-e276793a5145 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c" status: 200 len: 1167 microversion: 2.1 time: 1.230221 Jul 18 02:48:57.660591 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2331/4672] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:56 2022] GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c => generated 1167 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:57.698773 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-71856ec5-0a59-460d-9fd4-26c0864a3c5c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:57.723390 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-71856ec5-0a59-460d-9fd4-26c0864a3c5c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:57.750724 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-71856ec5-0a59-460d-9fd4-26c0864a3c5c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:57.753608 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-71856ec5-0a59-460d-9fd4-26c0864a3c5c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:57.754750 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-71856ec5-0a59-460d-9fd4-26c0864a3c5c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:57.758127 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-71856ec5-0a59-460d-9fd4-26c0864a3c5c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:58.451105 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-71856ec5-0a59-460d-9fd4-26c0864a3c5c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:58.473489 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-71856ec5-0a59-460d-9fd4-26c0864a3c5c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 200 len: 1563 microversion: 2.1 time: 0.788294 Jul 18 02:48:58.474158 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2332/4673] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:57 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 1563 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:58.487952 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-19501486-264e-4820-bb05-f4090bf6c774 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:58.488465 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-19501486-264e-4820-bb05-f4090bf6c774 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:58.501396 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-19501486-264e-4820-bb05-f4090bf6c774 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:58.502020 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-19501486-264e-4820-bb05-f4090bf6c774 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:58.502651 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-19501486-264e-4820-bb05-f4090bf6c774 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:58.503377 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-19501486-264e-4820-bb05-f4090bf6c774 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:58.545049 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-19501486-264e-4820-bb05-f4090bf6c774 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5/ips" status: 200 len: 144 microversion: 2.1 time: 0.069354 Jul 18 02:48:58.546464 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2333/4674] 10.222.0.57 () {58 vars in 1247 bytes} [Mon Jul 18 02:48:58 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5/ips => generated 144 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:48:58.552890 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cb3daf96-cd85-4e6f-b250-724066585a15 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:58.554227 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cb3daf96-cd85-4e6f-b250-724066585a15 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: dfa2f044-9f51-44f9-a87a-1f114d90e7d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:58.566848 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cb3daf96-cd85-4e6f-b250-724066585a15 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:58.570310 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cb3daf96-cd85-4e6f-b250-724066585a15 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:58.577046 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cb3daf96-cd85-4e6f-b250-724066585a15 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:58.578517 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cb3daf96-cd85-4e6f-b250-724066585a15 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:59.219114 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-cb3daf96-cd85-4e6f-b250-724066585a15 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:59.252938 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cb3daf96-cd85-4e6f-b250-724066585a15 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4" status: 200 len: 1368 microversion: 2.1 time: 0.704920 Jul 18 02:48:59.259806 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2334/4675] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:58 2022] GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4 => generated 1368 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:59.286076 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6b3b7cfb-dcfb-46f7-b2cf-187bac29cc60 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:59.300851 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6b3b7cfb-dcfb-46f7-b2cf-187bac29cc60 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] [instance: d4ed54ff-f096-47d2-a44a-a17b6714091d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:59.362721 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b3b7cfb-dcfb-46f7-b2cf-187bac29cc60 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:59.367768 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b3b7cfb-dcfb-46f7-b2cf-187bac29cc60 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:59.373334 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b3b7cfb-dcfb-46f7-b2cf-187bac29cc60 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:59.375834 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b3b7cfb-dcfb-46f7-b2cf-187bac29cc60 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:59.393584 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-aa226843-383e-4e13-9c11-dfd8947a0139 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:48:59.394465 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-aa226843-383e-4e13-9c11-dfd8947a0139 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:48:59.395415 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-aa226843-383e-4e13-9c11-dfd8947a0139 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:48:59.396248 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-aa226843-383e-4e13-9c11-dfd8947a0139 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:48:59.397223 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-aa226843-383e-4e13-9c11-dfd8947a0139 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:48:59.479174 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aa226843-383e-4e13-9c11-dfd8947a0139 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:59.484547 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aa226843-383e-4e13-9c11-dfd8947a0139 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:59.496238 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aa226843-383e-4e13-9c11-dfd8947a0139 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:59.498761 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aa226843-383e-4e13-9c11-dfd8947a0139 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:59.611165 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-aa226843-383e-4e13-9c11-dfd8947a0139 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Getting quotas for project ed4a114c5309447bb74cd37c180b749d. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:48:59.625016 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-aa226843-383e-4e13-9c11-dfd8947a0139 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Getting quotas for user 949d2267438542afaa92a261f25acef7 and project ed4a114c5309447bb74cd37c180b749d. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:48:59.654033 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-aa226843-383e-4e13-9c11-dfd8947a0139 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:48:59.659407 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-aa226843-383e-4e13-9c11-dfd8947a0139 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 3dc82011-e895-461b-97a4-8c6ce6d88ec7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:48:59.820090 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6b3b7cfb-dcfb-46f7-b2cf-187bac29cc60 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad358704236e46e1b979af45d06d5f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb54b64ce64462e81b9d56698da1ad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:59.827927 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-aa226843-383e-4e13-9c11-dfd8947a0139 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.252211 Jul 18 02:48:59.831692 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2342/4676] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:48:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 3260 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:48:59.845004 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6b3b7cfb-dcfb-46f7-b2cf-187bac29cc60 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] 10.222.0.57 "GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d" status: 200 len: 1274 microversion: 2.1 time: 0.572041 Jul 18 02:48:59.850435 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2335/4677] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:59 2022] GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d => generated 1274 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:59.862859 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8ec269e8-59ca-4540-9a28-d7d4223ed849 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:59.867555 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8ec269e8-59ca-4540-9a28-d7d4223ed849 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:59.890831 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8ec269e8-59ca-4540-9a28-d7d4223ed849 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:59.892120 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8ec269e8-59ca-4540-9a28-d7d4223ed849 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:59.893438 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8ec269e8-59ca-4540-9a28-d7d4223ed849 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:59.897082 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8ec269e8-59ca-4540-9a28-d7d4223ed849 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:59.930955 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-8b1a7298-a406-49b1-bd0e-628417d49a74 req-69131a97-7f50-48d7-bcb5-65192c7a4a4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfa2f044-9f51-44f9-a87a-1f114d90e7d4", "name": "network-vif-plugged", "status": "completed", "tag": "783eed5b-39aa-46d8-8be0-a1006eaaf5de"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:48:59.998067 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-8b1a7298-a406-49b1-bd0e-628417d49a74 req-69131a97-7f50-48d7-bcb5-65192c7a4a4b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:59.998943 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-8b1a7298-a406-49b1-bd0e-628417d49a74 req-69131a97-7f50-48d7-bcb5-65192c7a4a4b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:00.097279 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-8b1a7298-a406-49b1-bd0e-628417d49a74 req-69131a97-7f50-48d7-bcb5-65192c7a4a4b service nova] Creating event network-vif-plugged:783eed5b-39aa-46d8-8be0-a1006eaaf5de for instance dfa2f044-9f51-44f9-a87a-1f114d90e7d4 on n-h1-465891-3 Jul 18 02:49:00.115562 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-8b1a7298-a406-49b1-bd0e-628417d49a74 req-69131a97-7f50-48d7-bcb5-65192c7a4a4b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.277779 Jul 18 02:49:00.116773 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2343/4678] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:49:00.136482 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-57e1acf0-869f-4bc6-8b5c-5133a795dc67 req-657e8e80-392f-4973-9505-101a89cd295e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1bb4d31-4685-48d2-b759-081bf1ddba8c", "tag": "f0c47edb-bc03-42c4-a96f-4b9b643b02fd"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:49:00.176342 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-57e1acf0-869f-4bc6-8b5c-5133a795dc67 req-657e8e80-392f-4973-9505-101a89cd295e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:00.177214 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-57e1acf0-869f-4bc6-8b5c-5133a795dc67 req-657e8e80-392f-4973-9505-101a89cd295e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:00.270455 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-57e1acf0-869f-4bc6-8b5c-5133a795dc67 req-657e8e80-392f-4973-9505-101a89cd295e service nova] Creating event network-changed:f0c47edb-bc03-42c4-a96f-4b9b643b02fd for instance b1bb4d31-4685-48d2-b759-081bf1ddba8c on n-h2-465891-3 Jul 18 02:49:00.342563 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-57e1acf0-869f-4bc6-8b5c-5133a795dc67 req-657e8e80-392f-4973-9505-101a89cd295e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.206898 Jul 18 02:49:00.343324 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2344/4679] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:49:00.386829 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2771da11-d232-47d7-a76b-d2fdc3e8aa95 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:00.388492 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2771da11-d232-47d7-a76b-d2fdc3e8aa95 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 3dc82011-e895-461b-97a4-8c6ce6d88ec7] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:01.552288 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2771da11-d232-47d7-a76b-d2fdc3e8aa95 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949d2267438542afaa92a261f25acef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a114c5309447bb74cd37c180b749d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:01.577911 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2771da11-d232-47d7-a76b-d2fdc3e8aa95 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] 10.222.0.57 "GET /compute/v2.1/servers/3dc82011-e895-461b-97a4-8c6ce6d88ec7" status: 200 len: 1219 microversion: 2.1 time: 1.231485 Jul 18 02:49:01.578552 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2345/4680] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:00 2022] GET /compute/v2.1/servers/3dc82011-e895-461b-97a4-8c6ce6d88ec7 => generated 1219 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:01.591817 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8ec269e8-59ca-4540-9a28-d7d4223ed849 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:01.599770 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-45df341d-2a61-4698-a09f-248e0cc50b65 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:01.608725 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-45df341d-2a61-4698-a09f-248e0cc50b65 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: dfa2f044-9f51-44f9-a87a-1f114d90e7d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:01.613272 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8ec269e8-59ca-4540-9a28-d7d4223ed849 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c" status: 200 len: 1167 microversion: 2.1 time: 1.759619 Jul 18 02:49:01.614631 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2336/4681] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:59 2022] GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c => generated 1167 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:01.624909 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fbfdf9aa-383b-47b6-8201-bd33e804d779 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:01.626128 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fbfdf9aa-383b-47b6-8201-bd33e804d779 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] [instance: d4ed54ff-f096-47d2-a44a-a17b6714091d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:01.646399 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-45df341d-2a61-4698-a09f-248e0cc50b65 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:01.646875 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-45df341d-2a61-4698-a09f-248e0cc50b65 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:01.658574 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fbfdf9aa-383b-47b6-8201-bd33e804d779 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:01.659620 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fbfdf9aa-383b-47b6-8201-bd33e804d779 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:01.663112 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fbfdf9aa-383b-47b6-8201-bd33e804d779 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:01.665061 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-45df341d-2a61-4698-a09f-248e0cc50b65 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:01.666488 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fbfdf9aa-383b-47b6-8201-bd33e804d779 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:01.668467 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-45df341d-2a61-4698-a09f-248e0cc50b65 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:01.681305 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=100 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:49:02.026900 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fbfdf9aa-383b-47b6-8201-bd33e804d779 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad358704236e46e1b979af45d06d5f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb54b64ce64462e81b9d56698da1ad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:02.040205 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fbfdf9aa-383b-47b6-8201-bd33e804d779 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] 10.222.0.57 "GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d" status: 200 len: 1274 microversion: 2.1 time: 0.419769 Jul 18 02:49:02.050558 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2337/4682] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:01 2022] GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d => generated 1274 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:02.206829 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-45df341d-2a61-4698-a09f-248e0cc50b65 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:02.219400 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-45df341d-2a61-4698-a09f-248e0cc50b65 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4" status: 200 len: 1368 microversion: 2.1 time: 0.639711 Jul 18 02:49:02.229213 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2346/4683] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:01 2022] GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4 => generated 1368 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:02.660455 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-48e08750-cdf7-4919-b115-c55afa51d1f9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:02.666128 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-48e08750-cdf7-4919-b115-c55afa51d1f9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:02.667595 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c806c8ee-f4fb-4c1e-aa06-b148fea2f1d2 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:02.671637 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c806c8ee-f4fb-4c1e-aa06-b148fea2f1d2 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 3dc82011-e895-461b-97a4-8c6ce6d88ec7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:02.717788 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-48e08750-cdf7-4919-b115-c55afa51d1f9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:02.721361 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-48e08750-cdf7-4919-b115-c55afa51d1f9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:02.741380 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-48e08750-cdf7-4919-b115-c55afa51d1f9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:02.748647 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-48e08750-cdf7-4919-b115-c55afa51d1f9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:02.751726 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c806c8ee-f4fb-4c1e-aa06-b148fea2f1d2 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:02.757344 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c806c8ee-f4fb-4c1e-aa06-b148fea2f1d2 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:02.778845 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c806c8ee-f4fb-4c1e-aa06-b148fea2f1d2 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:02.785361 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c806c8ee-f4fb-4c1e-aa06-b148fea2f1d2 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:03.339946 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c806c8ee-f4fb-4c1e-aa06-b148fea2f1d2 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949d2267438542afaa92a261f25acef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a114c5309447bb74cd37c180b749d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:03.396658 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c806c8ee-f4fb-4c1e-aa06-b148fea2f1d2 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] 10.222.0.57 "GET /compute/v2.1/servers/3dc82011-e895-461b-97a4-8c6ce6d88ec7" status: 200 len: 1271 microversion: 2.1 time: 0.784072 Jul 18 02:49:03.403835 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2338/4684] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:02 2022] GET /compute/v2.1/servers/3dc82011-e895-461b-97a4-8c6ce6d88ec7 => generated 1271 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:03.448051 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a3b25bf8-f115-439c-ba4c-24e6ef5017a3 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b62e32a1-decd-4564-81fe-880c62031b05"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:49:03.451584 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a3b25bf8-f115-439c-ba4c-24e6ef5017a3 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:03.502266 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a3b25bf8-f115-439c-ba4c-24e6ef5017a3 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:03.502934 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a3b25bf8-f115-439c-ba4c-24e6ef5017a3 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:03.504601 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a3b25bf8-f115-439c-ba4c-24e6ef5017a3 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:03.518861 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a3b25bf8-f115-439c-ba4c-24e6ef5017a3 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:03.642889 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:49:03.708480 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:49:04.340957 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-48e08750-cdf7-4919-b115-c55afa51d1f9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:04.400440 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-48e08750-cdf7-4919-b115-c55afa51d1f9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c" status: 200 len: 1167 microversion: 2.1 time: 1.758868 Jul 18 02:49:04.408429 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2347/4685] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:02 2022] GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c => generated 1167 bytes in 1769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:04.408739 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a3b25bf8-f115-439c-ba4c-24e6ef5017a3 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "POST /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.996361 Jul 18 02:49:04.410098 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2339/4686] 10.222.0.57 () {60 vars in 1322 bytes} [Mon Jul 18 02:49:03 2022] POST /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5/os-volume_attachments => generated 194 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:49:04.421808 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-844a0de4-7415-4bb9-83cd-cd8a04e96204 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:04.422618 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-844a0de4-7415-4bb9-83cd-cd8a04e96204 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: dfa2f044-9f51-44f9-a87a-1f114d90e7d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:04.436030 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dbbb8ff5-a5a5-4519-a567-d46ca154cc8f tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:04.441455 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-dbbb8ff5-a5a5-4519-a567-d46ca154cc8f tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] [instance: d4ed54ff-f096-47d2-a44a-a17b6714091d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:04.452630 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:49:04.457081 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dbbb8ff5-a5a5-4519-a567-d46ca154cc8f tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:04.458897 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dbbb8ff5-a5a5-4519-a567-d46ca154cc8f tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:04.461005 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dbbb8ff5-a5a5-4519-a567-d46ca154cc8f tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:04.466985 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dbbb8ff5-a5a5-4519-a567-d46ca154cc8f tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:04.468159 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-844a0de4-7415-4bb9-83cd-cd8a04e96204 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:04.470828 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-844a0de4-7415-4bb9-83cd-cd8a04e96204 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:04.472407 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-844a0de4-7415-4bb9-83cd-cd8a04e96204 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:04.473008 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-844a0de4-7415-4bb9-83cd-cd8a04e96204 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:05.298356 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-844a0de4-7415-4bb9-83cd-cd8a04e96204 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:05.308702 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-844a0de4-7415-4bb9-83cd-cd8a04e96204 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4" status: 200 len: 1558 microversion: 2.1 time: 0.897128 Jul 18 02:49:05.313326 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2340/4687] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:04 2022] GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4 => generated 1558 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:05.318630 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-22fa9ebb-820c-4bb5-940b-59fbcd78b02a tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:05.326987 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-22fa9ebb-820c-4bb5-940b-59fbcd78b02a tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 3dc82011-e895-461b-97a4-8c6ce6d88ec7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:05.341766 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-22fa9ebb-820c-4bb5-940b-59fbcd78b02a tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:05.342508 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-22fa9ebb-820c-4bb5-940b-59fbcd78b02a tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:05.343555 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-22fa9ebb-820c-4bb5-940b-59fbcd78b02a tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:05.353237 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-22fa9ebb-820c-4bb5-940b-59fbcd78b02a tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:05.597996 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-22fa9ebb-820c-4bb5-940b-59fbcd78b02a tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949d2267438542afaa92a261f25acef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a114c5309447bb74cd37c180b749d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:05.629130 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-22fa9ebb-820c-4bb5-940b-59fbcd78b02a tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] 10.222.0.57 "GET /compute/v2.1/servers/3dc82011-e895-461b-97a4-8c6ce6d88ec7" status: 200 len: 1277 microversion: 2.1 time: 0.314316 Jul 18 02:49:05.630596 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2341/4688] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:05 2022] GET /compute/v2.1/servers/3dc82011-e895-461b-97a4-8c6ce6d88ec7 => generated 1277 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:05.638647 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8c830980-85bb-48da-8b3a-c5ac4b407cdd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:05.650083 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8c830980-85bb-48da-8b3a-c5ac4b407cdd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: dfa2f044-9f51-44f9-a87a-1f114d90e7d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:05.659145 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8c830980-85bb-48da-8b3a-c5ac4b407cdd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:05.660688 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8c830980-85bb-48da-8b3a-c5ac4b407cdd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:05.664163 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8c830980-85bb-48da-8b3a-c5ac4b407cdd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:05.665840 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8c830980-85bb-48da-8b3a-c5ac4b407cdd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:05.731212 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-dbbb8ff5-a5a5-4519-a567-d46ca154cc8f tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad358704236e46e1b979af45d06d5f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb54b64ce64462e81b9d56698da1ad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:05.768948 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-dbbb8ff5-a5a5-4519-a567-d46ca154cc8f tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] 10.222.0.57 "GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d" status: 200 len: 1316 microversion: 2.1 time: 1.356751 Jul 18 02:49:05.774072 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2348/4689] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:04 2022] GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d => generated 1316 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:05.799834 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5260a90d-10c0-48a7-8a04-abd401e32484 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:05.804068 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5260a90d-10c0-48a7-8a04-abd401e32484 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:05.828081 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5260a90d-10c0-48a7-8a04-abd401e32484 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:05.828822 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5260a90d-10c0-48a7-8a04-abd401e32484 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:05.832721 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5260a90d-10c0-48a7-8a04-abd401e32484 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:05.834231 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5260a90d-10c0-48a7-8a04-abd401e32484 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:05.972091 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8c830980-85bb-48da-8b3a-c5ac4b407cdd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.339528 Jul 18 02:49:05.980213 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2342/4690] 10.222.0.57 () {58 vars in 1274 bytes} [Mon Jul 18 02:49:05 2022] GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4/os-interface => generated 285 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:49:06.422644 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5260a90d-10c0-48a7-8a04-abd401e32484 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:06.435858 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5260a90d-10c0-48a7-8a04-abd401e32484 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c" status: 200 len: 1167 microversion: 2.1 time: 0.655986 Jul 18 02:49:06.453766 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2349/4691] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:05 2022] GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c => generated 1167 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:06.650788 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2855217b-b850-4f5b-a1ad-afb49054f204 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:06.651734 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2855217b-b850-4f5b-a1ad-afb49054f204 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 3dc82011-e895-461b-97a4-8c6ce6d88ec7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:06.670940 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2855217b-b850-4f5b-a1ad-afb49054f204 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:06.671399 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2855217b-b850-4f5b-a1ad-afb49054f204 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:06.672194 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2855217b-b850-4f5b-a1ad-afb49054f204 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:06.672628 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2855217b-b850-4f5b-a1ad-afb49054f204 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:06.806536 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-28838039-05c3-4c54-8115-0d8232aa77a5 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:06.807358 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-28838039-05c3-4c54-8115-0d8232aa77a5 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] [instance: d4ed54ff-f096-47d2-a44a-a17b6714091d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:06.814416 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-28838039-05c3-4c54-8115-0d8232aa77a5 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:06.817566 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-28838039-05c3-4c54-8115-0d8232aa77a5 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:06.822903 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-28838039-05c3-4c54-8115-0d8232aa77a5 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:06.823607 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-28838039-05c3-4c54-8115-0d8232aa77a5 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:08.180593 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2855217b-b850-4f5b-a1ad-afb49054f204 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949d2267438542afaa92a261f25acef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a114c5309447bb74cd37c180b749d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:08.196974 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2855217b-b850-4f5b-a1ad-afb49054f204 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] 10.222.0.57 "GET /compute/v2.1/servers/3dc82011-e895-461b-97a4-8c6ce6d88ec7" status: 200 len: 1277 microversion: 2.1 time: 1.551940 Jul 18 02:49:08.201931 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2343/4692] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:06 2022] GET /compute/v2.1/servers/3dc82011-e895-461b-97a4-8c6ce6d88ec7 => generated 1277 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:08.210230 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5de05984-37a7-4287-a9fa-b6a83a2e3255 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:08.217749 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5de05984-37a7-4287-a9fa-b6a83a2e3255 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:08.237635 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5de05984-37a7-4287-a9fa-b6a83a2e3255 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:08.238439 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5de05984-37a7-4287-a9fa-b6a83a2e3255 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:08.240483 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5de05984-37a7-4287-a9fa-b6a83a2e3255 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:08.246736 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5de05984-37a7-4287-a9fa-b6a83a2e3255 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:08.703168 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-28838039-05c3-4c54-8115-0d8232aa77a5 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad358704236e46e1b979af45d06d5f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb54b64ce64462e81b9d56698da1ad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:08.725313 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-28838039-05c3-4c54-8115-0d8232aa77a5 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] 10.222.0.57 "GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d" status: 200 len: 1316 microversion: 2.1 time: 1.925417 Jul 18 02:49:08.738199 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2350/4693] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:06 2022] GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d => generated 1316 bytes in 1939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:08.748892 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7755e463-ad94-4ec1-9a62-f95838dcaec8 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:08.750848 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7755e463-ad94-4ec1-9a62-f95838dcaec8 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:08.778837 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7755e463-ad94-4ec1-9a62-f95838dcaec8 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:08.779798 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7755e463-ad94-4ec1-9a62-f95838dcaec8 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:08.781386 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7755e463-ad94-4ec1-9a62-f95838dcaec8 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:08.782836 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7755e463-ad94-4ec1-9a62-f95838dcaec8 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:09.585926 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:49:09.650678 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5de05984-37a7-4287-a9fa-b6a83a2e3255 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:09.695770 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5de05984-37a7-4287-a9fa-b6a83a2e3255 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c" status: 200 len: 1167 microversion: 2.1 time: 1.491768 Jul 18 02:49:09.696869 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2344/4694] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:08 2022] GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c => generated 1167 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:09.914545 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-28d8a98b-572c-4503-b7c4-b10eae5506bf req-7783223f-0238-4bed-a7f3-8c1090ec836f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ce58c09-6319-4fad-ae8a-2b4199edcfd9", "tag": "7f42876f-44b2-4ca5-aea9-aa2f86f8f3ed"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:49:09.941418 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-28d8a98b-572c-4503-b7c4-b10eae5506bf req-7783223f-0238-4bed-a7f3-8c1090ec836f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:09.942032 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-28d8a98b-572c-4503-b7c4-b10eae5506bf req-7783223f-0238-4bed-a7f3-8c1090ec836f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:09.989556 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-28d8a98b-572c-4503-b7c4-b10eae5506bf req-7783223f-0238-4bed-a7f3-8c1090ec836f service nova] Creating event network-changed:7f42876f-44b2-4ca5-aea9-aa2f86f8f3ed for instance 5ce58c09-6319-4fad-ae8a-2b4199edcfd9 on n-h2-465891-3 Jul 18 02:49:10.002319 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-28d8a98b-572c-4503-b7c4-b10eae5506bf req-7783223f-0238-4bed-a7f3-8c1090ec836f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.293791 Jul 18 02:49:10.004549 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2345/4695] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:49:10.016933 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a26cd169-49c0-490b-a382-78e7536aeab2 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:10.020309 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a26cd169-49c0-490b-a382-78e7536aeab2 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 3dc82011-e895-461b-97a4-8c6ce6d88ec7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:10.034943 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a26cd169-49c0-490b-a382-78e7536aeab2 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:10.036280 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a26cd169-49c0-490b-a382-78e7536aeab2 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:10.040667 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a26cd169-49c0-490b-a382-78e7536aeab2 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:10.043403 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a26cd169-49c0-490b-a382-78e7536aeab2 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:10.058511 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7755e463-ad94-4ec1-9a62-f95838dcaec8 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:10.100676 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7755e463-ad94-4ec1-9a62-f95838dcaec8 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 200 len: 1563 microversion: 2.1 time: 1.360040 Jul 18 02:49:10.104009 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2351/4696] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:08 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 1563 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:10.151556 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-68961a2c-ffa7-49b6-8f15-9c15c7e4bb2e tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:10.157298 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-68961a2c-ffa7-49b6-8f15-9c15c7e4bb2e tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] [instance: d4ed54ff-f096-47d2-a44a-a17b6714091d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:10.180389 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-68961a2c-ffa7-49b6-8f15-9c15c7e4bb2e tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:10.181403 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-68961a2c-ffa7-49b6-8f15-9c15c7e4bb2e tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:10.187726 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-68961a2c-ffa7-49b6-8f15-9c15c7e4bb2e tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:10.189630 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-68961a2c-ffa7-49b6-8f15-9c15c7e4bb2e tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:11.566309 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=8 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:49:11.583382 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-68961a2c-ffa7-49b6-8f15-9c15c7e4bb2e tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad358704236e46e1b979af45d06d5f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb54b64ce64462e81b9d56698da1ad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:11.609395 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-68961a2c-ffa7-49b6-8f15-9c15c7e4bb2e tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] 10.222.0.57 "GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d" status: 200 len: 1316 microversion: 2.1 time: 1.494677 Jul 18 02:49:11.619635 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2352/4697] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:10 2022] GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d => generated 1316 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:11.635229 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4ad3fe64-20cd-4421-9c59-e3d24c437343 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:11.636392 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4ad3fe64-20cd-4421-9c59-e3d24c437343 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:11.651289 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4ad3fe64-20cd-4421-9c59-e3d24c437343 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:11.652318 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4ad3fe64-20cd-4421-9c59-e3d24c437343 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:11.653467 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4ad3fe64-20cd-4421-9c59-e3d24c437343 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:11.654449 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4ad3fe64-20cd-4421-9c59-e3d24c437343 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:11.878523 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a26cd169-49c0-490b-a382-78e7536aeab2 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949d2267438542afaa92a261f25acef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a114c5309447bb74cd37c180b749d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:11.896057 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a26cd169-49c0-490b-a382-78e7536aeab2 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] 10.222.0.57 "GET /compute/v2.1/servers/3dc82011-e895-461b-97a4-8c6ce6d88ec7" status: 200 len: 1319 microversion: 2.1 time: 1.888844 Jul 18 02:49:11.897559 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2346/4698] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:10 2022] GET /compute/v2.1/servers/3dc82011-e895-461b-97a4-8c6ce6d88ec7 => generated 1319 bytes in 1892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:11.908013 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-b0d159f6-a27a-455d-a570-591b1da89820 req-6c312a42-a370-4cfb-830e-cda9ab39fc22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4ed54ff-f096-47d2-a44a-a17b6714091d", "tag": "0a560603-b229-44c3-9db2-0fbfaac9dd63"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:49:11.932417 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-b0d159f6-a27a-455d-a570-591b1da89820 req-6c312a42-a370-4cfb-830e-cda9ab39fc22 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:11.933875 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-b0d159f6-a27a-455d-a570-591b1da89820 req-6c312a42-a370-4cfb-830e-cda9ab39fc22 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:11.965965 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-b0d159f6-a27a-455d-a570-591b1da89820 req-6c312a42-a370-4cfb-830e-cda9ab39fc22 service nova] Creating event network-changed:0a560603-b229-44c3-9db2-0fbfaac9dd63 for instance d4ed54ff-f096-47d2-a44a-a17b6714091d on n-h1-465891-3 Jul 18 02:49:11.978435 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-b0d159f6-a27a-455d-a570-591b1da89820 req-6c312a42-a370-4cfb-830e-cda9ab39fc22 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077719 Jul 18 02:49:11.980818 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2347/4699] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:49:12.047119 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-5ab9b938-2926-4500-a18d-c3b847588800 req-ed988813-0a3b-4d71-a77f-01bd082cb091 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfa2f044-9f51-44f9-a87a-1f114d90e7d4", "tag": "783eed5b-39aa-46d8-8be0-a1006eaaf5de"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:49:12.074297 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-5ab9b938-2926-4500-a18d-c3b847588800 req-ed988813-0a3b-4d71-a77f-01bd082cb091 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:12.075308 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-5ab9b938-2926-4500-a18d-c3b847588800 req-ed988813-0a3b-4d71-a77f-01bd082cb091 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:12.103093 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-5ab9b938-2926-4500-a18d-c3b847588800 req-ed988813-0a3b-4d71-a77f-01bd082cb091 service nova] Creating event network-changed:783eed5b-39aa-46d8-8be0-a1006eaaf5de for instance dfa2f044-9f51-44f9-a87a-1f114d90e7d4 on n-h1-465891-3 Jul 18 02:49:12.110408 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-5ab9b938-2926-4500-a18d-c3b847588800 req-ed988813-0a3b-4d71-a77f-01bd082cb091 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074020 Jul 18 02:49:12.111926 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2348/4700] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:49:12.658506 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-940d2286-9e05-4e6d-ae8e-3f8bf8e4bd4c tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:12.659443 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-940d2286-9e05-4e6d-ae8e-3f8bf8e4bd4c tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] [instance: d4ed54ff-f096-47d2-a44a-a17b6714091d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:12.668727 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-940d2286-9e05-4e6d-ae8e-3f8bf8e4bd4c tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:12.669603 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-940d2286-9e05-4e6d-ae8e-3f8bf8e4bd4c tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:12.670703 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-940d2286-9e05-4e6d-ae8e-3f8bf8e4bd4c tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:12.671388 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-940d2286-9e05-4e6d-ae8e-3f8bf8e4bd4c tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:12.830821 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4ad3fe64-20cd-4421-9c59-e3d24c437343 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:12.845465 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4ad3fe64-20cd-4421-9c59-e3d24c437343 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c" status: 200 len: 1167 microversion: 2.1 time: 1.223692 Jul 18 02:49:12.848298 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2353/4701] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:11 2022] GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c => generated 1167 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:12.928185 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-262a01e5-2b6b-45dc-91dc-0ee8afbc8cda tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:12.929891 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-262a01e5-2b6b-45dc-91dc-0ee8afbc8cda tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 3dc82011-e895-461b-97a4-8c6ce6d88ec7] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:12.939934 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-262a01e5-2b6b-45dc-91dc-0ee8afbc8cda tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:12.940634 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-262a01e5-2b6b-45dc-91dc-0ee8afbc8cda tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:12.942203 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-262a01e5-2b6b-45dc-91dc-0ee8afbc8cda tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:12.943140 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-262a01e5-2b6b-45dc-91dc-0ee8afbc8cda tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:14.079972 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-940d2286-9e05-4e6d-ae8e-3f8bf8e4bd4c tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad358704236e46e1b979af45d06d5f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb54b64ce64462e81b9d56698da1ad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:14.111737 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-940d2286-9e05-4e6d-ae8e-3f8bf8e4bd4c tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] 10.222.0.57 "GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d" status: 200 len: 1316 microversion: 2.1 time: 1.455715 Jul 18 02:49:14.114801 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2349/4702] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:12 2022] GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d => generated 1316 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:14.127521 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-858cde81-5742-4d98-8722-9be78cc4ca25 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:14.130842 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-858cde81-5742-4d98-8722-9be78cc4ca25 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:14.157409 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-858cde81-5742-4d98-8722-9be78cc4ca25 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:14.162113 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-858cde81-5742-4d98-8722-9be78cc4ca25 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:14.169024 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-858cde81-5742-4d98-8722-9be78cc4ca25 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:14.169964 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-858cde81-5742-4d98-8722-9be78cc4ca25 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:14.198502 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-262a01e5-2b6b-45dc-91dc-0ee8afbc8cda tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949d2267438542afaa92a261f25acef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a114c5309447bb74cd37c180b749d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:14.212338 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-262a01e5-2b6b-45dc-91dc-0ee8afbc8cda tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] 10.222.0.57 "GET /compute/v2.1/servers/3dc82011-e895-461b-97a4-8c6ce6d88ec7" status: 200 len: 1319 microversion: 2.1 time: 1.287829 Jul 18 02:49:14.213647 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2354/4703] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:12 2022] GET /compute/v2.1/servers/3dc82011-e895-461b-97a4-8c6ce6d88ec7 => generated 1319 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:49:14.615111 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-858cde81-5742-4d98-8722-9be78cc4ca25 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:14.626595 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-858cde81-5742-4d98-8722-9be78cc4ca25 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c" status: 200 len: 1167 microversion: 2.1 time: 0.509836 Jul 18 02:49:14.627800 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2350/4704] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:14 2022] GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c => generated 1167 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:14.774674 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-a72c1b46-3ded-4037-bd8c-83bb5adfdf29 req-5860cb04-935e-41aa-97f8-a307cb4fbd2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dc82011-e895-461b-97a4-8c6ce6d88ec7", "tag": "320ee26c-905d-4500-be2e-9e8590053301"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:49:14.791129 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-a72c1b46-3ded-4037-bd8c-83bb5adfdf29 req-5860cb04-935e-41aa-97f8-a307cb4fbd2e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:14.791455 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-a72c1b46-3ded-4037-bd8c-83bb5adfdf29 req-5860cb04-935e-41aa-97f8-a307cb4fbd2e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:14.819866 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-a72c1b46-3ded-4037-bd8c-83bb5adfdf29 req-5860cb04-935e-41aa-97f8-a307cb4fbd2e service nova] Creating event network-changed:320ee26c-905d-4500-be2e-9e8590053301 for instance 3dc82011-e895-461b-97a4-8c6ce6d88ec7 on n-h2-465891-3 Jul 18 02:49:14.831458 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-a72c1b46-3ded-4037-bd8c-83bb5adfdf29 req-5860cb04-935e-41aa-97f8-a307cb4fbd2e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061007 Jul 18 02:49:14.838286 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2355/4705] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:49:15.158851 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6675d7c1-8fea-4ad3-80c1-46de1fea6ca8 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:15.163867 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6675d7c1-8fea-4ad3-80c1-46de1fea6ca8 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] [instance: d4ed54ff-f096-47d2-a44a-a17b6714091d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:15.201766 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6675d7c1-8fea-4ad3-80c1-46de1fea6ca8 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:15.203027 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6675d7c1-8fea-4ad3-80c1-46de1fea6ca8 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:15.204861 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6675d7c1-8fea-4ad3-80c1-46de1fea6ca8 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:15.205952 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6675d7c1-8fea-4ad3-80c1-46de1fea6ca8 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:15.243999 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-56b836be-cfe9-4a60-bd63-648dffa1af4b tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:15.245463 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-56b836be-cfe9-4a60-bd63-648dffa1af4b tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 3dc82011-e895-461b-97a4-8c6ce6d88ec7] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:15.254798 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56b836be-cfe9-4a60-bd63-648dffa1af4b tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:15.255564 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56b836be-cfe9-4a60-bd63-648dffa1af4b tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:15.256693 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56b836be-cfe9-4a60-bd63-648dffa1af4b tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:15.257952 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56b836be-cfe9-4a60-bd63-648dffa1af4b tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:15.683032 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6675d7c1-8fea-4ad3-80c1-46de1fea6ca8 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad358704236e46e1b979af45d06d5f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb54b64ce64462e81b9d56698da1ad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:15.699875 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6675d7c1-8fea-4ad3-80c1-46de1fea6ca8 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] 10.222.0.57 "GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d" status: 200 len: 1316 microversion: 2.1 time: 0.549066 Jul 18 02:49:15.705825 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2351/4706] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:15 2022] GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d => generated 1316 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:15.715500 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-56b836be-cfe9-4a60-bd63-648dffa1af4b tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949d2267438542afaa92a261f25acef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a114c5309447bb74cd37c180b749d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:15.718155 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-db79babd-46ea-4d60-8836-ba96d81618b7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:15.722179 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-db79babd-46ea-4d60-8836-ba96d81618b7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:15.724952 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-56b836be-cfe9-4a60-bd63-648dffa1af4b tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] 10.222.0.57 "GET /compute/v2.1/servers/3dc82011-e895-461b-97a4-8c6ce6d88ec7" status: 200 len: 1319 microversion: 2.1 time: 0.486078 Jul 18 02:49:15.725734 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2356/4707] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:15 2022] GET /compute/v2.1/servers/3dc82011-e895-461b-97a4-8c6ce6d88ec7 => generated 1319 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:15.746790 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-db79babd-46ea-4d60-8836-ba96d81618b7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:15.747524 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-db79babd-46ea-4d60-8836-ba96d81618b7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:15.748695 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-db79babd-46ea-4d60-8836-ba96d81618b7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:15.749238 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-db79babd-46ea-4d60-8836-ba96d81618b7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:15.935202 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-db79babd-46ea-4d60-8836-ba96d81618b7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:15.958566 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-db79babd-46ea-4d60-8836-ba96d81618b7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c" status: 200 len: 1167 microversion: 2.1 time: 0.246723 Jul 18 02:49:15.961390 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2352/4708] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:15 2022] GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c => generated 1167 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:16.733150 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-302f9cb8-3b86-41f8-8d53-0d5e8786db83 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:16.734107 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-302f9cb8-3b86-41f8-8d53-0d5e8786db83 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] [instance: d4ed54ff-f096-47d2-a44a-a17b6714091d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:16.753556 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-25a8c21f-a430-4fa2-a34c-2b010fa0ec7e tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:16.754488 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-25a8c21f-a430-4fa2-a34c-2b010fa0ec7e tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 3dc82011-e895-461b-97a4-8c6ce6d88ec7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:16.754776 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-302f9cb8-3b86-41f8-8d53-0d5e8786db83 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:16.755243 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-302f9cb8-3b86-41f8-8d53-0d5e8786db83 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:16.756066 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-302f9cb8-3b86-41f8-8d53-0d5e8786db83 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:16.758094 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-302f9cb8-3b86-41f8-8d53-0d5e8786db83 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:16.771226 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25a8c21f-a430-4fa2-a34c-2b010fa0ec7e tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:16.775619 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25a8c21f-a430-4fa2-a34c-2b010fa0ec7e tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:16.776790 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25a8c21f-a430-4fa2-a34c-2b010fa0ec7e tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:16.777400 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25a8c21f-a430-4fa2-a34c-2b010fa0ec7e tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:17.687989 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-302f9cb8-3b86-41f8-8d53-0d5e8786db83 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad358704236e46e1b979af45d06d5f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb54b64ce64462e81b9d56698da1ad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:17.733162 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-302f9cb8-3b86-41f8-8d53-0d5e8786db83 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] 10.222.0.57 "GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d" status: 200 len: 1316 microversion: 2.1 time: 0.995003 Jul 18 02:49:17.748050 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2357/4709] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:16 2022] GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d => generated 1316 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:17.765832 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9e437d86-7260-476c-9934-5760c1a93304 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:17.768421 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9e437d86-7260-476c-9934-5760c1a93304 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:17.783958 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e437d86-7260-476c-9934-5760c1a93304 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:17.785594 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e437d86-7260-476c-9934-5760c1a93304 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:17.789173 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e437d86-7260-476c-9934-5760c1a93304 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:17.790703 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e437d86-7260-476c-9934-5760c1a93304 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:18.477825 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-25a8c21f-a430-4fa2-a34c-2b010fa0ec7e tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949d2267438542afaa92a261f25acef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a114c5309447bb74cd37c180b749d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:18.497863 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-25a8c21f-a430-4fa2-a34c-2b010fa0ec7e tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] 10.222.0.57 "GET /compute/v2.1/servers/3dc82011-e895-461b-97a4-8c6ce6d88ec7" status: 200 len: 1319 microversion: 2.1 time: 1.748661 Jul 18 02:49:18.511300 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2353/4710] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:16 2022] GET /compute/v2.1/servers/3dc82011-e895-461b-97a4-8c6ce6d88ec7 => generated 1319 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:18.517320 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d2fdb395-7524-4ee1-9100-e8fd2ffb9fee tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:49:18.519181 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d2fdb395-7524-4ee1-9100-e8fd2ffb9fee tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:18.533948 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d2fdb395-7524-4ee1-9100-e8fd2ffb9fee tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:18.534981 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d2fdb395-7524-4ee1-9100-e8fd2ffb9fee tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:18.536250 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d2fdb395-7524-4ee1-9100-e8fd2ffb9fee tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:18.537882 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d2fdb395-7524-4ee1-9100-e8fd2ffb9fee tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:18.611836 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d2fdb395-7524-4ee1-9100-e8fd2ffb9fee tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "POST /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9/action" status: 200 len: 24563 microversion: 2.1 time: 0.097825 Jul 18 02:49:18.625424 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2354/4711] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:49:18 2022] POST /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9/action => generated 24563 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:49:18.771559 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b8cd7b83-1c54-445f-a6cb-b155695b7c82 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:18.774413 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b8cd7b83-1c54-445f-a6cb-b155695b7c82 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] [instance: d4ed54ff-f096-47d2-a44a-a17b6714091d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:18.786256 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b8cd7b83-1c54-445f-a6cb-b155695b7c82 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:18.786928 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b8cd7b83-1c54-445f-a6cb-b155695b7c82 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:18.788534 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b8cd7b83-1c54-445f-a6cb-b155695b7c82 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:18.791348 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b8cd7b83-1c54-445f-a6cb-b155695b7c82 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:18.829038 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:49:19.060668 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9e437d86-7260-476c-9934-5760c1a93304 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:19.072828 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9e437d86-7260-476c-9934-5760c1a93304 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c" status: 200 len: 1167 microversion: 2.1 time: 1.319334 Jul 18 02:49:19.074473 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2358/4712] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:17 2022] GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c => generated 1167 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:19.522296 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-58d3727d-a107-4fe2-932b-4ccb2bd1ad83 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:19.523706 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-58d3727d-a107-4fe2-932b-4ccb2bd1ad83 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 3dc82011-e895-461b-97a4-8c6ce6d88ec7] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:19.535360 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-58d3727d-a107-4fe2-932b-4ccb2bd1ad83 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:19.535709 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-58d3727d-a107-4fe2-932b-4ccb2bd1ad83 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:19.538409 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-58d3727d-a107-4fe2-932b-4ccb2bd1ad83 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:19.539122 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-58d3727d-a107-4fe2-932b-4ccb2bd1ad83 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:19.631722 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b8cd7b83-1c54-445f-a6cb-b155695b7c82 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad358704236e46e1b979af45d06d5f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb54b64ce64462e81b9d56698da1ad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:19.650234 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b8cd7b83-1c54-445f-a6cb-b155695b7c82 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] 10.222.0.57 "GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d" status: 200 len: 1316 microversion: 2.1 time: 0.883730 Jul 18 02:49:19.651157 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2355/4713] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:18 2022] GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d => generated 1316 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:20.097636 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5ca1d4b1-3f07-49db-b81e-61db174bdd77 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:20.098759 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5ca1d4b1-3f07-49db-b81e-61db174bdd77 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:20.112794 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ca1d4b1-3f07-49db-b81e-61db174bdd77 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:20.113620 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ca1d4b1-3f07-49db-b81e-61db174bdd77 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:20.115991 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ca1d4b1-3f07-49db-b81e-61db174bdd77 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:20.116743 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ca1d4b1-3f07-49db-b81e-61db174bdd77 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:20.149387 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-58d3727d-a107-4fe2-932b-4ccb2bd1ad83 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949d2267438542afaa92a261f25acef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a114c5309447bb74cd37c180b749d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:20.173532 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-58d3727d-a107-4fe2-932b-4ccb2bd1ad83 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] 10.222.0.57 "GET /compute/v2.1/servers/3dc82011-e895-461b-97a4-8c6ce6d88ec7" status: 200 len: 1319 microversion: 2.1 time: 0.659325 Jul 18 02:49:20.199935 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2359/4714] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:19 2022] GET /compute/v2.1/servers/3dc82011-e895-461b-97a4-8c6ce6d88ec7 => generated 1319 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:49:20.648314 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-5e986c5b-fa89-4dfe-a456-307545cc1309 req-fd774067-f7ce-4c0a-a0ab-dd86a53878b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dc82011-e895-461b-97a4-8c6ce6d88ec7", "name": "network-vif-plugged", "status": "completed", "tag": "320ee26c-905d-4500-be2e-9e8590053301"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:49:20.673747 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-5e986c5b-fa89-4dfe-a456-307545cc1309 req-fd774067-f7ce-4c0a-a0ab-dd86a53878b8 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:20.674317 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-5e986c5b-fa89-4dfe-a456-307545cc1309 req-fd774067-f7ce-4c0a-a0ab-dd86a53878b8 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:20.711578 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5ca1d4b1-3f07-49db-b81e-61db174bdd77 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:20.725609 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5ca1d4b1-3f07-49db-b81e-61db174bdd77 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c" status: 200 len: 1167 microversion: 2.1 time: 0.635646 Jul 18 02:49:20.733498 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-5e986c5b-fa89-4dfe-a456-307545cc1309 req-fd774067-f7ce-4c0a-a0ab-dd86a53878b8 service nova] Creating event network-vif-plugged:320ee26c-905d-4500-be2e-9e8590053301 for instance 3dc82011-e895-461b-97a4-8c6ce6d88ec7 on n-h2-465891-3 Jul 18 02:49:20.737020 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2356/4715] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:20 2022] GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c => generated 1167 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:49:20.745805 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4d2e3a48-ab6d-4902-860e-f5a5281bf947 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:20.746947 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4d2e3a48-ab6d-4902-860e-f5a5281bf947 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] [instance: d4ed54ff-f096-47d2-a44a-a17b6714091d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:20.748177 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-5e986c5b-fa89-4dfe-a456-307545cc1309 req-fd774067-f7ce-4c0a-a0ab-dd86a53878b8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102609 Jul 18 02:49:20.748776 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2360/4716] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:49:20.791472 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4d2e3a48-ab6d-4902-860e-f5a5281bf947 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:20.793954 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4d2e3a48-ab6d-4902-860e-f5a5281bf947 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:20.795765 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4d2e3a48-ab6d-4902-860e-f5a5281bf947 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:20.799521 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4d2e3a48-ab6d-4902-860e-f5a5281bf947 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:21.171789 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4d2e3a48-ab6d-4902-860e-f5a5281bf947 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad358704236e46e1b979af45d06d5f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb54b64ce64462e81b9d56698da1ad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:21.187497 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4d2e3a48-ab6d-4902-860e-f5a5281bf947 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] 10.222.0.57 "GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d" status: 200 len: 1316 microversion: 2.1 time: 0.448505 Jul 18 02:49:21.189168 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2357/4717] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:20 2022] GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d => generated 1316 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:21.216787 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e69d321b-5b3c-4f38-82f9-fdc8c2f2283c tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:21.217840 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e69d321b-5b3c-4f38-82f9-fdc8c2f2283c tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 3dc82011-e895-461b-97a4-8c6ce6d88ec7] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:21.225857 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e69d321b-5b3c-4f38-82f9-fdc8c2f2283c tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:21.226619 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e69d321b-5b3c-4f38-82f9-fdc8c2f2283c tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:21.227934 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e69d321b-5b3c-4f38-82f9-fdc8c2f2283c tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:21.228479 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e69d321b-5b3c-4f38-82f9-fdc8c2f2283c tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:21.437955 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e69d321b-5b3c-4f38-82f9-fdc8c2f2283c tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949d2267438542afaa92a261f25acef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a114c5309447bb74cd37c180b749d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:21.441336 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:49:21.452130 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e69d321b-5b3c-4f38-82f9-fdc8c2f2283c tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] 10.222.0.57 "GET /compute/v2.1/servers/3dc82011-e895-461b-97a4-8c6ce6d88ec7" status: 200 len: 1319 microversion: 2.1 time: 0.244659 Jul 18 02:49:21.463940 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2361/4718] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:21 2022] GET /compute/v2.1/servers/3dc82011-e895-461b-97a4-8c6ce6d88ec7 => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:21.759978 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d095d48f-e9e6-42e6-bbc5-d730b20d2d7a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:21.762754 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d095d48f-e9e6-42e6-bbc5-d730b20d2d7a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:21.776239 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d095d48f-e9e6-42e6-bbc5-d730b20d2d7a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:21.777379 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d095d48f-e9e6-42e6-bbc5-d730b20d2d7a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:21.779113 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d095d48f-e9e6-42e6-bbc5-d730b20d2d7a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:21.780040 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d095d48f-e9e6-42e6-bbc5-d730b20d2d7a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:22.035022 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d095d48f-e9e6-42e6-bbc5-d730b20d2d7a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:22.050589 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d095d48f-e9e6-42e6-bbc5-d730b20d2d7a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c" status: 200 len: 1201 microversion: 2.1 time: 0.298916 Jul 18 02:49:22.053207 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2358/4719] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:21 2022] GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c => generated 1201 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:49:22.210428 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a442a6fe-ec46-4e83-be5d-1dce5b6e2983 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:22.211425 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a442a6fe-ec46-4e83-be5d-1dce5b6e2983 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] [instance: d4ed54ff-f096-47d2-a44a-a17b6714091d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:22.221442 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a442a6fe-ec46-4e83-be5d-1dce5b6e2983 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:22.222899 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a442a6fe-ec46-4e83-be5d-1dce5b6e2983 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:22.224271 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a442a6fe-ec46-4e83-be5d-1dce5b6e2983 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:22.225005 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a442a6fe-ec46-4e83-be5d-1dce5b6e2983 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:22.449168 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a442a6fe-ec46-4e83-be5d-1dce5b6e2983 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad358704236e46e1b979af45d06d5f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb54b64ce64462e81b9d56698da1ad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:22.461912 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a442a6fe-ec46-4e83-be5d-1dce5b6e2983 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] 10.222.0.57 "GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d" status: 200 len: 1316 microversion: 2.1 time: 0.256649 Jul 18 02:49:22.470317 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2362/4720] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:22 2022] GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d => generated 1316 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:22.473057 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d7dfde67-288a-4902-ad04-ff37e97ac651 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:22.473627 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d7dfde67-288a-4902-ad04-ff37e97ac651 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 3dc82011-e895-461b-97a4-8c6ce6d88ec7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:22.485678 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d7dfde67-288a-4902-ad04-ff37e97ac651 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:22.486502 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d7dfde67-288a-4902-ad04-ff37e97ac651 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:22.487880 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d7dfde67-288a-4902-ad04-ff37e97ac651 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:22.488573 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d7dfde67-288a-4902-ad04-ff37e97ac651 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:22.704455 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d7dfde67-288a-4902-ad04-ff37e97ac651 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949d2267438542afaa92a261f25acef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a114c5309447bb74cd37c180b749d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:22.717673 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d7dfde67-288a-4902-ad04-ff37e97ac651 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] 10.222.0.57 "GET /compute/v2.1/servers/3dc82011-e895-461b-97a4-8c6ce6d88ec7" status: 200 len: 1507 microversion: 2.1 time: 0.248826 Jul 18 02:49:22.718609 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2359/4721] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:22 2022] GET /compute/v2.1/servers/3dc82011-e895-461b-97a4-8c6ce6d88ec7 => generated 1507 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:22.772923 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-d141274b-5c4f-45a4-9312-1507dbee7ff9 req-3bae812a-08ba-49d6-8815-1f705ecf4a05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4ed54ff-f096-47d2-a44a-a17b6714091d", "name": "network-vif-plugged", "status": "completed", "tag": "0a560603-b229-44c3-9db2-0fbfaac9dd63"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:49:22.783428 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-d141274b-5c4f-45a4-9312-1507dbee7ff9 req-3bae812a-08ba-49d6-8815-1f705ecf4a05 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:22.784135 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-d141274b-5c4f-45a4-9312-1507dbee7ff9 req-3bae812a-08ba-49d6-8815-1f705ecf4a05 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:22.799578 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-d141274b-5c4f-45a4-9312-1507dbee7ff9 req-3bae812a-08ba-49d6-8815-1f705ecf4a05 service nova] Creating event network-vif-plugged:0a560603-b229-44c3-9db2-0fbfaac9dd63 for instance d4ed54ff-f096-47d2-a44a-a17b6714091d on n-h1-465891-3 Jul 18 02:49:22.805907 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-d141274b-5c4f-45a4-9312-1507dbee7ff9 req-3bae812a-08ba-49d6-8815-1f705ecf4a05 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037547 Jul 18 02:49:22.812711 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2363/4722] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:49:23.079644 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-88582d5c-6e72-4086-b2c7-d94533449bf1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:23.082742 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-88582d5c-6e72-4086-b2c7-d94533449bf1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:23.092463 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-88582d5c-6e72-4086-b2c7-d94533449bf1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:23.094288 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-88582d5c-6e72-4086-b2c7-d94533449bf1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:23.096924 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-88582d5c-6e72-4086-b2c7-d94533449bf1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:23.097387 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-88582d5c-6e72-4086-b2c7-d94533449bf1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:23.315792 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-88582d5c-6e72-4086-b2c7-d94533449bf1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:23.326006 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-88582d5c-6e72-4086-b2c7-d94533449bf1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c" status: 200 len: 1201 microversion: 2.1 time: 0.251623 Jul 18 02:49:23.326908 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2360/4723] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:23 2022] GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c => generated 1201 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:23.502780 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6b05b425-1e78-428e-9769-028af88fc269 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:23.505549 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6b05b425-1e78-428e-9769-028af88fc269 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] [instance: d4ed54ff-f096-47d2-a44a-a17b6714091d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:23.521657 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6b05b425-1e78-428e-9769-028af88fc269 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:23.523268 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6b05b425-1e78-428e-9769-028af88fc269 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:23.525289 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6b05b425-1e78-428e-9769-028af88fc269 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:23.527485 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6b05b425-1e78-428e-9769-028af88fc269 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:23.862814 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6b05b425-1e78-428e-9769-028af88fc269 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad358704236e46e1b979af45d06d5f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb54b64ce64462e81b9d56698da1ad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:23.877086 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6b05b425-1e78-428e-9769-028af88fc269 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] 10.222.0.57 "GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d" status: 200 len: 1316 microversion: 2.1 time: 0.386847 Jul 18 02:49:23.878973 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2364/4724] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:23 2022] GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d => generated 1316 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:24.347206 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ca0643d5-f5e1-44fe-a378-e56342413b03 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:24.361672 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ca0643d5-f5e1-44fe-a378-e56342413b03 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:24.384061 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ca0643d5-f5e1-44fe-a378-e56342413b03 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:24.390020 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ca0643d5-f5e1-44fe-a378-e56342413b03 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:24.391509 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ca0643d5-f5e1-44fe-a378-e56342413b03 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:24.392760 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ca0643d5-f5e1-44fe-a378-e56342413b03 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:24.691614 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ca0643d5-f5e1-44fe-a378-e56342413b03 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:24.711805 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ca0643d5-f5e1-44fe-a378-e56342413b03 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c" status: 200 len: 1201 microversion: 2.1 time: 0.370189 Jul 18 02:49:24.713818 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2361/4725] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:24 2022] GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c => generated 1201 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:49:24.910334 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-43ea52df-5bf5-4eef-93d5-4d7359025697 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:24.913555 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-43ea52df-5bf5-4eef-93d5-4d7359025697 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] [instance: d4ed54ff-f096-47d2-a44a-a17b6714091d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:24.944005 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-45ea5607-c27b-4551-ba58-f3853bc37a49 tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:24.944732 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-45ea5607-c27b-4551-ba58-f3853bc37a49 tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:24.959771 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-45ea5607-c27b-4551-ba58-f3853bc37a49 tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:24.963784 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-43ea52df-5bf5-4eef-93d5-4d7359025697 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:24.964247 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-43ea52df-5bf5-4eef-93d5-4d7359025697 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:24.965158 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-43ea52df-5bf5-4eef-93d5-4d7359025697 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:24.965614 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-43ea52df-5bf5-4eef-93d5-4d7359025697 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:24.966749 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-45ea5607-c27b-4551-ba58-f3853bc37a49 tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:24.968624 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-45ea5607-c27b-4551-ba58-f3853bc37a49 tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:24.970180 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-45ea5607-c27b-4551-ba58-f3853bc37a49 tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:25.480883 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-43ea52df-5bf5-4eef-93d5-4d7359025697 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad358704236e46e1b979af45d06d5f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb54b64ce64462e81b9d56698da1ad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:25.498091 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-43ea52df-5bf5-4eef-93d5-4d7359025697 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] 10.222.0.57 "GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d" status: 200 len: 1505 microversion: 2.1 time: 0.594275 Jul 18 02:49:25.499013 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2365/4726] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:24 2022] GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d => generated 1505 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:25.521577 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9d5a4c5c-b9f5-4492-904c-54c667f88e6b tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:25.522604 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9d5a4c5c-b9f5-4492-904c-54c667f88e6b tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] [instance: d4ed54ff-f096-47d2-a44a-a17b6714091d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:25.534536 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9d5a4c5c-b9f5-4492-904c-54c667f88e6b tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:25.535668 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9d5a4c5c-b9f5-4492-904c-54c667f88e6b tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:25.537459 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9d5a4c5c-b9f5-4492-904c-54c667f88e6b tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:25.538314 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9d5a4c5c-b9f5-4492-904c-54c667f88e6b tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:25.596728 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9d5a4c5c-b9f5-4492-904c-54c667f88e6b tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'ad358704236e46e1b979af45d06d5f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb54b64ce64462e81b9d56698da1ad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:25.599907 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9d5a4c5c-b9f5-4492-904c-54c667f88e6b tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] 10.222.0.57 "GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d/os-instance-actions/req-a6759aae-43a2-4ee7-8ad5-0487e9860886" status: 200 len: 313 microversion: 2.1 time: 0.084173 Jul 18 02:49:25.606424 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2366/4727] 10.222.0.57 () {58 vars in 1418 bytes} [Mon Jul 18 02:49:25 2022] GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d/os-instance-actions/req-a6759aae-43a2-4ee7-8ad5-0487e9860886 => generated 313 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:49:25.615381 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1043ef7e-324e-455f-813e-4e6a270bdfe1 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:49:25.617288 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1043ef7e-324e-455f-813e-4e6a270bdfe1 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] [instance: d4ed54ff-f096-47d2-a44a-a17b6714091d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:25.627295 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1043ef7e-324e-455f-813e-4e6a270bdfe1 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:25.628959 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1043ef7e-324e-455f-813e-4e6a270bdfe1 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:25.631707 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1043ef7e-324e-455f-813e-4e6a270bdfe1 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:25.633391 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1043ef7e-324e-455f-813e-4e6a270bdfe1 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:25.813617 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1043ef7e-324e-455f-813e-4e6a270bdfe1 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] 10.222.0.57 "POST /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d/action" status: 202 len: 0 microversion: 2.1 time: 0.202237 Jul 18 02:49:25.815859 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2367/4728] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:49:25 2022] POST /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:49:25.856535 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-733cbed7-9257-4792-8c3a-ee2f1263fb61 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:25.859055 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-733cbed7-9257-4792-8c3a-ee2f1263fb61 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:25.873533 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-733cbed7-9257-4792-8c3a-ee2f1263fb61 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:25.874625 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-733cbed7-9257-4792-8c3a-ee2f1263fb61 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:25.875919 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-733cbed7-9257-4792-8c3a-ee2f1263fb61 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:25.876782 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-733cbed7-9257-4792-8c3a-ee2f1263fb61 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:25.902875 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-45ea5607-c27b-4551-ba58-f3853bc37a49 tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 200 len: 1833 microversion: 2.1 time: 0.964017 Jul 18 02:49:25.904529 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2362/4729] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:24 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 1833 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:49:25.930598 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-902b781c-8bf6-4657-84e1-624c92d740db tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:25.931631 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-902b781c-8bf6-4657-84e1-624c92d740db tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] [instance: d4ed54ff-f096-47d2-a44a-a17b6714091d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:25.943448 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-902b781c-8bf6-4657-84e1-624c92d740db tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:25.944262 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-902b781c-8bf6-4657-84e1-624c92d740db tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:25.945459 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-902b781c-8bf6-4657-84e1-624c92d740db tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:25.946139 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-902b781c-8bf6-4657-84e1-624c92d740db tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:26.505323 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-733cbed7-9257-4792-8c3a-ee2f1263fb61 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:26.529434 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-733cbed7-9257-4792-8c3a-ee2f1263fb61 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c" status: 200 len: 1201 microversion: 2.1 time: 0.685284 Jul 18 02:49:26.531276 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2368/4730] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:25 2022] GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c => generated 1201 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:26.550245 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-593efc93-fc28-4db9-9d75-d4bac83df3a2 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:26.552542 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-593efc93-fc28-4db9-9d75-d4bac83df3a2 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:26.561211 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-593efc93-fc28-4db9-9d75-d4bac83df3a2 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:26.562154 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-593efc93-fc28-4db9-9d75-d4bac83df3a2 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:26.563506 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-593efc93-fc28-4db9-9d75-d4bac83df3a2 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:26.564313 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-593efc93-fc28-4db9-9d75-d4bac83df3a2 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:26.585097 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-902b781c-8bf6-4657-84e1-624c92d740db tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad358704236e46e1b979af45d06d5f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb54b64ce64462e81b9d56698da1ad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:26.603708 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-902b781c-8bf6-4657-84e1-624c92d740db tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] 10.222.0.57 "GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d" status: 200 len: 1507 microversion: 2.1 time: 0.695070 Jul 18 02:49:26.606102 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2363/4731] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:25 2022] GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d => generated 1507 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:26.621374 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6f0a27fc-9d2d-434c-a256-061f34c89239 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:49:26.625730 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=66 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:49:26.639983 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6f0a27fc-9d2d-434c-a256-061f34c89239 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:26.641311 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6f0a27fc-9d2d-434c-a256-061f34c89239 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:26.689759 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6f0a27fc-9d2d-434c-a256-061f34c89239 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Going to try to stop instance {{(pid=119544) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 02:49:26.832339 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6f0a27fc-9d2d-434c-a256-061f34c89239 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "POST /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5/action" status: 202 len: 0 microversion: 2.1 time: 0.223603 Jul 18 02:49:26.838371 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2364/4732] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:49:26 2022] POST /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:49:26.875612 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-db28b207-7ef6-4b25-a5f6-66f9fefa1cbc tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:26.890009 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-db28b207-7ef6-4b25-a5f6-66f9fefa1cbc tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:26.912297 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-db28b207-7ef6-4b25-a5f6-66f9fefa1cbc tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:26.914902 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-db28b207-7ef6-4b25-a5f6-66f9fefa1cbc tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:26.917336 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-db28b207-7ef6-4b25-a5f6-66f9fefa1cbc tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:26.920070 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-db28b207-7ef6-4b25-a5f6-66f9fefa1cbc tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:26.965759 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-593efc93-fc28-4db9-9d75-d4bac83df3a2 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:26.977229 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-593efc93-fc28-4db9-9d75-d4bac83df3a2 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 200 len: 1682 microversion: 2.1 time: 0.444146 Jul 18 02:49:26.984844 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2369/4733] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:26 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 1682 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:27.265750 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-db28b207-7ef6-4b25-a5f6-66f9fefa1cbc tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:27.287341 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-db28b207-7ef6-4b25-a5f6-66f9fefa1cbc tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 200 len: 1721 microversion: 2.1 time: 0.434192 Jul 18 02:49:27.289174 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2365/4734] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:26 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 1721 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:27.291751 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0ec74af2-c651-4366-94e8-dc6e4ef4dd82 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:49:27.297043 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0ec74af2-c651-4366-94e8-dc6e4ef4dd82 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:27.320521 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0ec74af2-c651-4366-94e8-dc6e4ef4dd82 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:27.321231 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0ec74af2-c651-4366-94e8-dc6e4ef4dd82 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:27.322754 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0ec74af2-c651-4366-94e8-dc6e4ef4dd82 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:27.324080 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0ec74af2-c651-4366-94e8-dc6e4ef4dd82 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:27.563800 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d999e246-50f9-42b1-ac1f-84ea9678b323 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:27.565188 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d999e246-50f9-42b1-ac1f-84ea9678b323 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:27.585339 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0ec74af2-c651-4366-94e8-dc6e4ef4dd82 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "POST /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9/action" status: 200 len: 32634 microversion: 2.1 time: 0.304587 Jul 18 02:49:27.589461 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2370/4735] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:49:27 2022] POST /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9/action => generated 32634 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 02:49:27.599132 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d999e246-50f9-42b1-ac1f-84ea9678b323 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:27.600630 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d999e246-50f9-42b1-ac1f-84ea9678b323 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:27.602177 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d999e246-50f9-42b1-ac1f-84ea9678b323 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:27.605185 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d999e246-50f9-42b1-ac1f-84ea9678b323 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:27.626854 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0ab052dc-aa9b-4ba1-bd53-93d99650f7cd tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:27.627657 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0ab052dc-aa9b-4ba1-bd53-93d99650f7cd tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] [instance: d4ed54ff-f096-47d2-a44a-a17b6714091d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:27.663051 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0ab052dc-aa9b-4ba1-bd53-93d99650f7cd tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:27.663513 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0ab052dc-aa9b-4ba1-bd53-93d99650f7cd tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:27.668939 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0ab052dc-aa9b-4ba1-bd53-93d99650f7cd tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:27.670067 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0ab052dc-aa9b-4ba1-bd53-93d99650f7cd tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:28.038924 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d999e246-50f9-42b1-ac1f-84ea9678b323 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:28.047041 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d999e246-50f9-42b1-ac1f-84ea9678b323 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c" status: 200 len: 1201 microversion: 2.1 time: 0.491562 Jul 18 02:49:28.047872 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2366/4736] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:27 2022] GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c => generated 1201 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:28.056870 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-979687ea-3b9e-4ada-b137-b441a412a292 tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:49:28.057681 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-979687ea-3b9e-4ada-b137-b441a412a292 tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:28.058154 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0ab052dc-aa9b-4ba1-bd53-93d99650f7cd tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad358704236e46e1b979af45d06d5f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb54b64ce64462e81b9d56698da1ad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:28.068958 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0ab052dc-aa9b-4ba1-bd53-93d99650f7cd tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] 10.222.0.57 "GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d" status: 200 len: 1507 microversion: 2.1 time: 0.448016 Jul 18 02:49:28.083320 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2371/4737] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:27 2022] GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d => generated 1507 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:28.086672 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-979687ea-3b9e-4ada-b137-b441a412a292 tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:28.089368 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-979687ea-3b9e-4ada-b137-b441a412a292 tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:28.090325 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-979687ea-3b9e-4ada-b137-b441a412a292 tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:28.091765 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-979687ea-3b9e-4ada-b137-b441a412a292 tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:28.143294 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-979687ea-3b9e-4ada-b137-b441a412a292 tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0c276c8027304f30acfb01fd942387da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bc71fc2ec14dee91b9cab8a1c2bd4d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:28.144267 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-979687ea-3b9e-4ada-b137-b441a412a292 tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] flavor_id is None. Assuming migration. {{(pid=119544) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 18 02:49:28.144885 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-979687ea-3b9e-4ada-b137-b441a412a292 tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119544) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 02:49:28.311539 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-82729925-d2c2-487b-9028-7074977391f3 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:28.312285 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-82729925-d2c2-487b-9028-7074977391f3 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:28.359712 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-82729925-d2c2-487b-9028-7074977391f3 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:28.362968 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-82729925-d2c2-487b-9028-7074977391f3 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:28.364787 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-82729925-d2c2-487b-9028-7074977391f3 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:28.365311 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-82729925-d2c2-487b-9028-7074977391f3 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:28.427643 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-979687ea-3b9e-4ada-b137-b441a412a292 tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9/action" status: 202 len: 0 microversion: 2.1 time: 0.378367 Jul 18 02:49:28.429025 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2367/4738] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:49:28 2022] POST /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9/action => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:49:28.442397 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cf78f3f8-97b3-4fcf-b94e-1d7e788a9faa tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:28.443226 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cf78f3f8-97b3-4fcf-b94e-1d7e788a9faa tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:28.452409 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cf78f3f8-97b3-4fcf-b94e-1d7e788a9faa tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:28.453598 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cf78f3f8-97b3-4fcf-b94e-1d7e788a9faa tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:28.454357 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cf78f3f8-97b3-4fcf-b94e-1d7e788a9faa tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:28.455566 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cf78f3f8-97b3-4fcf-b94e-1d7e788a9faa tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:29.139290 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-82729925-d2c2-487b-9028-7074977391f3 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:29.157638 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-82729925-d2c2-487b-9028-7074977391f3 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 200 len: 1721 microversion: 2.1 time: 0.855263 Jul 18 02:49:29.176453 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2372/4739] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:28 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 1721 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:49:29.196582 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ae868042-abc3-450b-8598-f7cb15025f78 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:29.201639 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ae868042-abc3-450b-8598-f7cb15025f78 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:29.215735 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ae868042-abc3-450b-8598-f7cb15025f78 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:29.216202 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ae868042-abc3-450b-8598-f7cb15025f78 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:29.217237 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ae868042-abc3-450b-8598-f7cb15025f78 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:29.217722 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ae868042-abc3-450b-8598-f7cb15025f78 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:29.256079 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-cf78f3f8-97b3-4fcf-b94e-1d7e788a9faa tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:29.290146 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cf78f3f8-97b3-4fcf-b94e-1d7e788a9faa tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 200 len: 1691 microversion: 2.1 time: 0.853698 Jul 18 02:49:29.301740 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2368/4740] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:28 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 1691 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:49:29.301740 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-55994c85-f269-4741-b2ed-4e7be9d59123 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:29.301740 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-55994c85-f269-4741-b2ed-4e7be9d59123 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] [instance: d4ed54ff-f096-47d2-a44a-a17b6714091d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:29.305905 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-55994c85-f269-4741-b2ed-4e7be9d59123 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:29.306210 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-55994c85-f269-4741-b2ed-4e7be9d59123 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:29.307744 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-55994c85-f269-4741-b2ed-4e7be9d59123 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:29.308340 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-55994c85-f269-4741-b2ed-4e7be9d59123 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:29.311808 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:49:29.587649 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ae868042-abc3-450b-8598-f7cb15025f78 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:29.608938 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ae868042-abc3-450b-8598-f7cb15025f78 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c" status: 200 len: 1201 microversion: 2.1 time: 0.430973 Jul 18 02:49:29.611639 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2373/4741] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:29 2022] GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c => generated 1201 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:29.623509 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-55994c85-f269-4741-b2ed-4e7be9d59123 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad358704236e46e1b979af45d06d5f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb54b64ce64462e81b9d56698da1ad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:29.636651 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-55994c85-f269-4741-b2ed-4e7be9d59123 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] 10.222.0.57 "GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d" status: 200 len: 1505 microversion: 2.1 time: 0.344398 Jul 18 02:49:29.638152 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2369/4742] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:29 2022] GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d => generated 1505 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:29.658421 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c9a23602-f270-4bc0-a257-e4a521e9c9ab tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Calling method '.version_select at 0x7ff49b65d820>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:29.661759 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c9a23602-f270-4bc0-a257-e4a521e9c9ab tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] [instance: d4ed54ff-f096-47d2-a44a-a17b6714091d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:29.674789 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c9a23602-f270-4bc0-a257-e4a521e9c9ab tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:29.678377 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c9a23602-f270-4bc0-a257-e4a521e9c9ab tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:29.681350 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c9a23602-f270-4bc0-a257-e4a521e9c9ab tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:29.686448 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c9a23602-f270-4bc0-a257-e4a521e9c9ab tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:29.738301 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c9a23602-f270-4bc0-a257-e4a521e9c9ab tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] 10.222.0.57 "GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.086583 Jul 18 02:49:29.739721 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2374/4743] 10.222.0.57 () {58 vars in 1295 bytes} [Mon Jul 18 02:49:29 2022] GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d/os-instance-actions => generated 611 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:49:29.756929 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d8363d45-1c17-49ff-a864-e959fbaae03e tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:29.757443 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d8363d45-1c17-49ff-a864-e959fbaae03e tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] [instance: d4ed54ff-f096-47d2-a44a-a17b6714091d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:29.765600 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d8363d45-1c17-49ff-a864-e959fbaae03e tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:29.766480 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d8363d45-1c17-49ff-a864-e959fbaae03e tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:29.767627 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d8363d45-1c17-49ff-a864-e959fbaae03e tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:29.768246 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d8363d45-1c17-49ff-a864-e959fbaae03e tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:29.828431 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d8363d45-1c17-49ff-a864-e959fbaae03e tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] [instance: d4ed54ff-f096-47d2-a44a-a17b6714091d] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:49:29.983334 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d8363d45-1c17-49ff-a864-e959fbaae03e tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d" status: 204 len: 0 microversion: 2.1 time: 0.231342 Jul 18 02:49:29.984425 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2370/4744] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:49:29 2022] DELETE /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:49:30.004267 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-012ba984-8358-4748-bbb0-5a9574fbef4a tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:30.005378 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-012ba984-8358-4748-bbb0-5a9574fbef4a tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] [instance: d4ed54ff-f096-47d2-a44a-a17b6714091d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:30.018626 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-012ba984-8358-4748-bbb0-5a9574fbef4a tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:30.020183 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-012ba984-8358-4748-bbb0-5a9574fbef4a tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:30.021526 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-012ba984-8358-4748-bbb0-5a9574fbef4a tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:30.022385 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-012ba984-8358-4748-bbb0-5a9574fbef4a tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:30.188058 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-92b8e52d-cb03-4e48-86e5-8267142b246b tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:30.188778 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-92b8e52d-cb03-4e48-86e5-8267142b246b tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:30.197253 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-92b8e52d-cb03-4e48-86e5-8267142b246b tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:30.197748 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-92b8e52d-cb03-4e48-86e5-8267142b246b tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:30.198694 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-92b8e52d-cb03-4e48-86e5-8267142b246b tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:30.199019 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-92b8e52d-cb03-4e48-86e5-8267142b246b tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:30.509273 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-012ba984-8358-4748-bbb0-5a9574fbef4a tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad358704236e46e1b979af45d06d5f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb54b64ce64462e81b9d56698da1ad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:30.547438 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-012ba984-8358-4748-bbb0-5a9574fbef4a tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] 10.222.0.57 "GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d" status: 200 len: 1511 microversion: 2.1 time: 0.555395 Jul 18 02:49:30.555579 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2375/4745] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:29 2022] GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d => generated 1511 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:30.565172 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9d7b0551-7e09-4aa6-8080-7906d32e58a6 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:30.568615 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9d7b0551-7e09-4aa6-8080-7906d32e58a6 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:30.593277 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9d7b0551-7e09-4aa6-8080-7906d32e58a6 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:30.594139 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9d7b0551-7e09-4aa6-8080-7906d32e58a6 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:30.599695 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9d7b0551-7e09-4aa6-8080-7906d32e58a6 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:30.602801 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9d7b0551-7e09-4aa6-8080-7906d32e58a6 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:30.695368 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-92b8e52d-cb03-4e48-86e5-8267142b246b tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:30.704284 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-92b8e52d-cb03-4e48-86e5-8267142b246b tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 200 len: 1721 microversion: 2.1 time: 0.520549 Jul 18 02:49:30.704807 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2371/4746] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:30 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 1721 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:30.721666 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-942265f8-cb14-4ae1-95af-63ff264eec7a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:30.723103 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-942265f8-cb14-4ae1-95af-63ff264eec7a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:30.736522 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-942265f8-cb14-4ae1-95af-63ff264eec7a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:30.736984 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-942265f8-cb14-4ae1-95af-63ff264eec7a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:30.750274 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-942265f8-cb14-4ae1-95af-63ff264eec7a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:30.750746 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-942265f8-cb14-4ae1-95af-63ff264eec7a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:30.948640 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9d7b0551-7e09-4aa6-8080-7906d32e58a6 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:30.960936 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9d7b0551-7e09-4aa6-8080-7906d32e58a6 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 200 len: 1691 microversion: 2.1 time: 0.403695 Jul 18 02:49:30.965231 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2376/4747] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:30 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 1691 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:31.038789 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-942265f8-cb14-4ae1-95af-63ff264eec7a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:31.054885 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-942265f8-cb14-4ae1-95af-63ff264eec7a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c" status: 200 len: 1201 microversion: 2.1 time: 0.337191 Jul 18 02:49:31.056592 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2372/4748] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:30 2022] GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c => generated 1201 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:31.579862 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-61781251-c9e9-4a42-830e-0d41c1dacc12 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:31.580920 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-61781251-c9e9-4a42-830e-0d41c1dacc12 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] [instance: d4ed54ff-f096-47d2-a44a-a17b6714091d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:31.593817 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-61781251-c9e9-4a42-830e-0d41c1dacc12 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:31.594859 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-61781251-c9e9-4a42-830e-0d41c1dacc12 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:31.596308 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-61781251-c9e9-4a42-830e-0d41c1dacc12 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:31.596861 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-61781251-c9e9-4a42-830e-0d41c1dacc12 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:31.726321 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-24d9742f-ea7a-4be6-a1fb-084135b0bc29 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:31.727708 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-24d9742f-ea7a-4be6-a1fb-084135b0bc29 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:31.750210 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-24d9742f-ea7a-4be6-a1fb-084135b0bc29 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:31.751941 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-24d9742f-ea7a-4be6-a1fb-084135b0bc29 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:31.754514 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-24d9742f-ea7a-4be6-a1fb-084135b0bc29 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:31.755359 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-24d9742f-ea7a-4be6-a1fb-084135b0bc29 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:32.084142 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-61781251-c9e9-4a42-830e-0d41c1dacc12 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad358704236e46e1b979af45d06d5f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb54b64ce64462e81b9d56698da1ad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:32.100709 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-61781251-c9e9-4a42-830e-0d41c1dacc12 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] 10.222.0.57 "GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d" status: 200 len: 1511 microversion: 2.1 time: 0.525280 Jul 18 02:49:32.113805 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2377/4749] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:31 2022] GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d => generated 1511 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:49:32.113805 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7b096605-1385-4477-bbe4-f7d645ad7ab3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:32.119423 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7b096605-1385-4477-bbe4-f7d645ad7ab3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:32.129183 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7b096605-1385-4477-bbe4-f7d645ad7ab3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:32.129431 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7b096605-1385-4477-bbe4-f7d645ad7ab3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:32.130989 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7b096605-1385-4477-bbe4-f7d645ad7ab3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:32.131782 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7b096605-1385-4477-bbe4-f7d645ad7ab3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:32.165345 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:49:32.271989 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-24d9742f-ea7a-4be6-a1fb-084135b0bc29 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:32.295560 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-24d9742f-ea7a-4be6-a1fb-084135b0bc29 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 200 len: 1721 microversion: 2.1 time: 0.575919 Jul 18 02:49:32.315406 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2373/4750] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:31 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 1721 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:32.328036 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7f255c89-15af-49f7-8a74-2dd335fcc79d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:32.329294 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7f255c89-15af-49f7-8a74-2dd335fcc79d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:32.343863 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7f255c89-15af-49f7-8a74-2dd335fcc79d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:32.344857 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7f255c89-15af-49f7-8a74-2dd335fcc79d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:32.347435 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7f255c89-15af-49f7-8a74-2dd335fcc79d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:32.348256 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7f255c89-15af-49f7-8a74-2dd335fcc79d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:32.885417 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7b096605-1385-4477-bbe4-f7d645ad7ab3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:32.914986 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7b096605-1385-4477-bbe4-f7d645ad7ab3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 200 len: 1691 microversion: 2.1 time: 0.809265 Jul 18 02:49:32.915990 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2378/4751] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:32 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 1691 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:32.935387 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-726facd3-64c4-499c-9163-1a9abe345f50 req-d488e546-ec74-4bbc-a055-7d1bc508324b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1bb4d31-4685-48d2-b759-081bf1ddba8c", "name": "network-vif-plugged", "status": "completed", "tag": "f0c47edb-bc03-42c4-a96f-4b9b643b02fd"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:49:32.992498 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-726facd3-64c4-499c-9163-1a9abe345f50 req-d488e546-ec74-4bbc-a055-7d1bc508324b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:32.993731 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-726facd3-64c4-499c-9163-1a9abe345f50 req-d488e546-ec74-4bbc-a055-7d1bc508324b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:33.056129 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-726facd3-64c4-499c-9163-1a9abe345f50 req-d488e546-ec74-4bbc-a055-7d1bc508324b service nova] Creating event network-vif-plugged:f0c47edb-bc03-42c4-a96f-4b9b643b02fd for instance b1bb4d31-4685-48d2-b759-081bf1ddba8c on n-h2-465891-3 Jul 18 02:49:33.077188 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-726facd3-64c4-499c-9163-1a9abe345f50 req-d488e546-ec74-4bbc-a055-7d1bc508324b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156493 Jul 18 02:49:33.078227 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2379/4752] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:49:33.155853 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2468b6d8-7513-4af8-9b6c-55cf82a99a7e tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:33.157151 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2468b6d8-7513-4af8-9b6c-55cf82a99a7e tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] [instance: d4ed54ff-f096-47d2-a44a-a17b6714091d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:33.194851 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2468b6d8-7513-4af8-9b6c-55cf82a99a7e tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:33.198598 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2468b6d8-7513-4af8-9b6c-55cf82a99a7e tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:33.205957 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2468b6d8-7513-4af8-9b6c-55cf82a99a7e tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:33.208634 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2468b6d8-7513-4af8-9b6c-55cf82a99a7e tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:33.728205 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7f255c89-15af-49f7-8a74-2dd335fcc79d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:33.758290 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7f255c89-15af-49f7-8a74-2dd335fcc79d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c" status: 200 len: 1201 microversion: 2.1 time: 1.438422 Jul 18 02:49:33.766048 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2374/4753] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:32 2022] GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c => generated 1201 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:33.788928 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a94b0f46-d5b7-44ff-8718-c5e2af7c3238 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:33.792546 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a94b0f46-d5b7-44ff-8718-c5e2af7c3238 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:33.814876 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a94b0f46-d5b7-44ff-8718-c5e2af7c3238 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:33.816085 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a94b0f46-d5b7-44ff-8718-c5e2af7c3238 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:33.817947 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a94b0f46-d5b7-44ff-8718-c5e2af7c3238 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:33.819054 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a94b0f46-d5b7-44ff-8718-c5e2af7c3238 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:34.141787 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2468b6d8-7513-4af8-9b6c-55cf82a99a7e tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad358704236e46e1b979af45d06d5f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb54b64ce64462e81b9d56698da1ad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:34.153889 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2468b6d8-7513-4af8-9b6c-55cf82a99a7e tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] 10.222.0.57 "GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d" status: 200 len: 1511 microversion: 2.1 time: 1.027686 Jul 18 02:49:34.164500 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2380/4754] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:33 2022] GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d => generated 1511 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:49:34.169594 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7317cc4a-3da5-4012-b8d1-d04aad767c91 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:34.178774 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7317cc4a-3da5-4012-b8d1-d04aad767c91 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:34.187205 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7317cc4a-3da5-4012-b8d1-d04aad767c91 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:34.189220 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7317cc4a-3da5-4012-b8d1-d04aad767c91 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:34.190618 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7317cc4a-3da5-4012-b8d1-d04aad767c91 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:34.191521 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7317cc4a-3da5-4012-b8d1-d04aad767c91 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:34.665625 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a94b0f46-d5b7-44ff-8718-c5e2af7c3238 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:34.678908 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a94b0f46-d5b7-44ff-8718-c5e2af7c3238 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 200 len: 1721 microversion: 2.1 time: 0.908488 Jul 18 02:49:34.679507 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2375/4755] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:33 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 1721 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:34.784997 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e50e79d0-e18c-41c7-8dda-a46705f3a359 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:34.785626 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e50e79d0-e18c-41c7-8dda-a46705f3a359 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:34.802235 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e50e79d0-e18c-41c7-8dda-a46705f3a359 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:34.802564 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e50e79d0-e18c-41c7-8dda-a46705f3a359 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:34.803374 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e50e79d0-e18c-41c7-8dda-a46705f3a359 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:34.803813 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e50e79d0-e18c-41c7-8dda-a46705f3a359 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:35.007142 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7317cc4a-3da5-4012-b8d1-d04aad767c91 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:35.038491 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7317cc4a-3da5-4012-b8d1-d04aad767c91 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 200 len: 1691 microversion: 2.1 time: 0.871970 Jul 18 02:49:35.041672 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2381/4756] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:34 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 1691 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:35.065881 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-bc380d5a-f8f2-4f03-a5db-f52ecf1ca565 req-88777995-f371-43ee-92f0-fc557e335fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4ed54ff-f096-47d2-a44a-a17b6714091d", "name": "network-vif-deleted", "tag": "0a560603-b229-44c3-9db2-0fbfaac9dd63"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:49:35.099694 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=68 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:49:35.105913 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-bc380d5a-f8f2-4f03-a5db-f52ecf1ca565 req-88777995-f371-43ee-92f0-fc557e335fc7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:35.107382 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-bc380d5a-f8f2-4f03-a5db-f52ecf1ca565 req-88777995-f371-43ee-92f0-fc557e335fc7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:35.140661 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-bc380d5a-f8f2-4f03-a5db-f52ecf1ca565 req-88777995-f371-43ee-92f0-fc557e335fc7 service nova] Creating event network-vif-deleted:0a560603-b229-44c3-9db2-0fbfaac9dd63 for instance d4ed54ff-f096-47d2-a44a-a17b6714091d on n-h1-465891-3 Jul 18 02:49:35.151370 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-bc380d5a-f8f2-4f03-a5db-f52ecf1ca565 req-88777995-f371-43ee-92f0-fc557e335fc7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095514 Jul 18 02:49:35.153468 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2382/4757] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:49:35.179001 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-aa61f530-0ece-414b-b66c-406ad9a37699 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:35.182313 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-aa61f530-0ece-414b-b66c-406ad9a37699 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] [instance: d4ed54ff-f096-47d2-a44a-a17b6714091d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:35.201735 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aa61f530-0ece-414b-b66c-406ad9a37699 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:35.203717 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aa61f530-0ece-414b-b66c-406ad9a37699 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:35.205447 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aa61f530-0ece-414b-b66c-406ad9a37699 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:35.207184 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aa61f530-0ece-414b-b66c-406ad9a37699 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:35.285532 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aa61f530-0ece-414b-b66c-406ad9a37699 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:35.286916 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aa61f530-0ece-414b-b66c-406ad9a37699 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:35.288108 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-aa61f530-0ece-414b-b66c-406ad9a37699 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lazy-loading 'fault' on Instance uuid d4ed54ff-f096-47d2-a44a-a17b6714091d {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:49:35.418635 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-aa61f530-0ece-414b-b66c-406ad9a37699 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad358704236e46e1b979af45d06d5f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb54b64ce64462e81b9d56698da1ad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:35.438379 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-aa61f530-0ece-414b-b66c-406ad9a37699 tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] 10.222.0.57 "GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d" status: 200 len: 1306 microversion: 2.1 time: 0.268373 Jul 18 02:49:35.455398 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2383/4758] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:35 2022] GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d => generated 1306 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:35.529471 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e50e79d0-e18c-41c7-8dda-a46705f3a359 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:35.545929 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e50e79d0-e18c-41c7-8dda-a46705f3a359 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c" status: 200 len: 1201 microversion: 2.1 time: 0.764882 Jul 18 02:49:35.546732 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2376/4759] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:34 2022] GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c => generated 1201 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:35.715130 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2cf8e8b8-5f7b-452e-aa37-c217a927e575 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:35.717166 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2cf8e8b8-5f7b-452e-aa37-c217a927e575 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:35.736724 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2cf8e8b8-5f7b-452e-aa37-c217a927e575 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:35.738732 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2cf8e8b8-5f7b-452e-aa37-c217a927e575 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:35.740476 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2cf8e8b8-5f7b-452e-aa37-c217a927e575 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:35.741567 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2cf8e8b8-5f7b-452e-aa37-c217a927e575 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:36.065548 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2c5f011d-8707-410f-b54d-ee51170167b3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:36.066882 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2c5f011d-8707-410f-b54d-ee51170167b3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:36.087761 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2cf8e8b8-5f7b-452e-aa37-c217a927e575 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:36.105955 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2cf8e8b8-5f7b-452e-aa37-c217a927e575 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 200 len: 1721 microversion: 2.1 time: 0.408448 Jul 18 02:49:36.109657 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2c5f011d-8707-410f-b54d-ee51170167b3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:36.110445 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2c5f011d-8707-410f-b54d-ee51170167b3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:36.111370 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2384/4760] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:35 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 1721 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:49:36.120953 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2c5f011d-8707-410f-b54d-ee51170167b3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:36.121428 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2c5f011d-8707-410f-b54d-ee51170167b3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:36.471500 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7f4bb7fb-7dfe-483f-9960-cdb5bafbfadb tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:36.472586 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2c5f011d-8707-410f-b54d-ee51170167b3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:36.473778 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7f4bb7fb-7dfe-483f-9960-cdb5bafbfadb tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] [instance: d4ed54ff-f096-47d2-a44a-a17b6714091d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:36.484284 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7f4bb7fb-7dfe-483f-9960-cdb5bafbfadb tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:36.485913 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7f4bb7fb-7dfe-483f-9960-cdb5bafbfadb tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:36.491210 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7f4bb7fb-7dfe-483f-9960-cdb5bafbfadb tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:36.493773 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7f4bb7fb-7dfe-483f-9960-cdb5bafbfadb tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:36.506831 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2c5f011d-8707-410f-b54d-ee51170167b3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 200 len: 1696 microversion: 2.1 time: 0.447256 Jul 18 02:49:36.522030 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2377/4761] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:36 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 1696 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:36.542081 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-7f4bb7fb-7dfe-483f-9960-cdb5bafbfadb tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] HTTP exception thrown: Instance d4ed54ff-f096-47d2-a44a-a17b6714091d could not be found. Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7f4bb7fb-7dfe-483f-9960-cdb5bafbfadb tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Request method failure captured: Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d HTTP/1.1 Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MoQ_Aeb8-atZPd-wPveHe4vYh74sh5mIyiwkr-pFZKt4JfR2S4Q0iYIoCyBlgtkAng3crRjxOn05zIRD1y5sjAWF4tJ3f3wRyzrKuFaxh6IiiWjNcCHLE5HUZzGczxxZQfcVN_j_RPvyAq24r6yB02IvuRmv33vas6CdCQXa1-WA40 Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: bdb54b64ce64462e81b9d56698da1ad6 Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-InstanceActionsTestJSON-777458962 Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_bdb54b64ce64462e81b9d56698da1ad6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bdb54b64ce64462e81b9d56698da1ad6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bdb54b64ce64462e81b9d56698da1ad6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/bdb54b64ce64462e81b9d56698da1ad6"}]}] Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-InstanceActionsTestJSON-777458962 Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: bdb54b64ce64462e81b9d56698da1ad6 Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-InstanceActionsTestJSON-777458962 Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-InstanceActionsTestJSON-777458962-project Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: ad358704236e46e1b979af45d06d5f28 Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-InstanceActionsTestJSON-777458962-project Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance d4ed54ff-f096-47d2-a44a-a17b6714091d could not be found. Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'd4ed54ff-f096-47d2-a44a-a17b6714091d'} Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4ed54ff-f096-47d2-a44a-a17b6714091d could not be found. Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4ed54ff-f096-47d2-a44a-a17b6714091d could not be found. Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:49:36.544327 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:49:36.548771 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:49:36.548771 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:49:36.548771 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:49:36.548771 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:49:36.548771 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:49:36.548771 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4ed54ff-f096-47d2-a44a-a17b6714091d could not be found. Jul 18 02:49:36.548771 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:49:36.551428 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7f4bb7fb-7dfe-483f-9960-cdb5bafbfadb tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] Returning 404 to user: Instance d4ed54ff-f096-47d2-a44a-a17b6714091d could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:49:36.554921 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7f4bb7fb-7dfe-483f-9960-cdb5bafbfadb tempest-InstanceActionsTestJSON-777458962 tempest-InstanceActionsTestJSON-777458962-project] 10.222.0.57 "GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d" status: 404 len: 111 microversion: 2.1 time: 0.090400 Jul 18 02:49:36.556335 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2385/4762] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:36 2022] GET /compute/v2.1/servers/d4ed54ff-f096-47d2-a44a-a17b6714091d => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:49:36.580226 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a31d5ae3-dfd2-4c3a-a6e2-74f31601c706 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:36.580984 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a31d5ae3-dfd2-4c3a-a6e2-74f31601c706 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:36.594353 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a31d5ae3-dfd2-4c3a-a6e2-74f31601c706 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:36.594834 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a31d5ae3-dfd2-4c3a-a6e2-74f31601c706 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:36.597372 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a31d5ae3-dfd2-4c3a-a6e2-74f31601c706 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:36.597890 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a31d5ae3-dfd2-4c3a-a6e2-74f31601c706 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:37.107520 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a31d5ae3-dfd2-4c3a-a6e2-74f31601c706 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:37.119840 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a31d5ae3-dfd2-4c3a-a6e2-74f31601c706 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c" status: 200 len: 1388 microversion: 2.1 time: 0.547761 Jul 18 02:49:37.120565 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2378/4763] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:36 2022] GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c => generated 1388 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:37.138424 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-667f18d7-e374-4833-86c5-03c69757088f tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:37.140064 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-667f18d7-e374-4833-86c5-03c69757088f tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:37.142485 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-80f6f6a1-90e5-4fa3-9a57-0ce2cdc89e03 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:37.145803 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-80f6f6a1-90e5-4fa3-9a57-0ce2cdc89e03 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:37.153504 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-80f6f6a1-90e5-4fa3-9a57-0ce2cdc89e03 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:37.154357 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-80f6f6a1-90e5-4fa3-9a57-0ce2cdc89e03 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:37.155381 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-80f6f6a1-90e5-4fa3-9a57-0ce2cdc89e03 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:37.155928 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-667f18d7-e374-4833-86c5-03c69757088f tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:37.156329 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-80f6f6a1-90e5-4fa3-9a57-0ce2cdc89e03 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:37.157142 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-667f18d7-e374-4833-86c5-03c69757088f tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:37.160290 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-667f18d7-e374-4833-86c5-03c69757088f tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:37.161401 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-667f18d7-e374-4833-86c5-03c69757088f tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:38.089408 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-80f6f6a1-90e5-4fa3-9a57-0ce2cdc89e03 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:38.102872 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-667f18d7-e374-4833-86c5-03c69757088f tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:38.116812 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-80f6f6a1-90e5-4fa3-9a57-0ce2cdc89e03 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c" status: 200 len: 1388 microversion: 2.1 time: 0.983570 Jul 18 02:49:38.123204 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-667f18d7-e374-4833-86c5-03c69757088f tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 200 len: 1721 microversion: 2.1 time: 0.990228 Jul 18 02:49:38.130909 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2379/4764] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:37 2022] GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c => generated 1388 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:38.136941 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-32800a5c-0297-4837-9cba-042977b0cda3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:38.137954 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-32800a5c-0297-4837-9cba-042977b0cda3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:38.143019 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2386/4765] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:37 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 1721 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:38.149545 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-32800a5c-0297-4837-9cba-042977b0cda3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:38.150085 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-32800a5c-0297-4837-9cba-042977b0cda3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:38.150908 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-32800a5c-0297-4837-9cba-042977b0cda3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:38.151360 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-32800a5c-0297-4837-9cba-042977b0cda3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:38.159580 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4b21bbf7-4f1a-4699-9138-1964bec99620 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:38.161644 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4b21bbf7-4f1a-4699-9138-1964bec99620 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:38.187569 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4b21bbf7-4f1a-4699-9138-1964bec99620 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:38.190852 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4b21bbf7-4f1a-4699-9138-1964bec99620 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:38.195901 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4b21bbf7-4f1a-4699-9138-1964bec99620 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:38.201429 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4b21bbf7-4f1a-4699-9138-1964bec99620 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:38.547960 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4b21bbf7-4f1a-4699-9138-1964bec99620 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:38.562614 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4b21bbf7-4f1a-4699-9138-1964bec99620 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c" status: 200 len: 1388 microversion: 2.1 time: 0.416996 Jul 18 02:49:38.570951 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2387/4766] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:38 2022] GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c => generated 1388 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:38.692433 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a892b87f-7066-4211-be98-7b61becef6af tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:38.692951 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a892b87f-7066-4211-be98-7b61becef6af tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:38.706359 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a892b87f-7066-4211-be98-7b61becef6af tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:38.706824 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a892b87f-7066-4211-be98-7b61becef6af tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:38.707651 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a892b87f-7066-4211-be98-7b61becef6af tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:38.708101 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a892b87f-7066-4211-be98-7b61becef6af tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:38.793381 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-32800a5c-0297-4837-9cba-042977b0cda3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:38.813980 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a892b87f-7066-4211-be98-7b61becef6af tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:49:38.816155 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-32800a5c-0297-4837-9cba-042977b0cda3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 200 len: 1696 microversion: 2.1 time: 0.683520 Jul 18 02:49:38.820567 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2380/4767] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:38 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 1696 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:38.996966 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a892b87f-7066-4211-be98-7b61becef6af tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c" status: 204 len: 0 microversion: 2.1 time: 0.310678 Jul 18 02:49:39.000695 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2388/4768] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:49:38 2022] DELETE /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:49:39.009946 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0ce53cd6-2316-42cd-8d6b-baa1844e316c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:39.010736 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0ce53cd6-2316-42cd-8d6b-baa1844e316c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:39.025893 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0ce53cd6-2316-42cd-8d6b-baa1844e316c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:39.026900 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0ce53cd6-2316-42cd-8d6b-baa1844e316c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:39.030426 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0ce53cd6-2316-42cd-8d6b-baa1844e316c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:39.032180 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0ce53cd6-2316-42cd-8d6b-baa1844e316c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:39.147675 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8474ece6-c0ae-46c9-ad62-344d882499fb tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:39.149402 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8474ece6-c0ae-46c9-ad62-344d882499fb tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:39.163221 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8474ece6-c0ae-46c9-ad62-344d882499fb tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:39.166826 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8474ece6-c0ae-46c9-ad62-344d882499fb tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:39.167967 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8474ece6-c0ae-46c9-ad62-344d882499fb tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:39.168590 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8474ece6-c0ae-46c9-ad62-344d882499fb tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:39.688458 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0ce53cd6-2316-42cd-8d6b-baa1844e316c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:39.705957 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0ce53cd6-2316-42cd-8d6b-baa1844e316c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c" status: 200 len: 1394 microversion: 2.1 time: 0.700657 Jul 18 02:49:39.707962 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2381/4769] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:39 2022] GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c => generated 1394 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:39.754495 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8474ece6-c0ae-46c9-ad62-344d882499fb tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:39.780341 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8474ece6-c0ae-46c9-ad62-344d882499fb tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 200 len: 1698 microversion: 2.1 time: 0.639976 Jul 18 02:49:39.781378 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2389/4770] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:39 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 1698 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:49:39.812910 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d7a7518f-97f1-4e14-8b78-f223cc1088f5 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:49:39.820590 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d7a7518f-97f1-4e14-8b78-f223cc1088f5 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:39.821056 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d7a7518f-97f1-4e14-8b78-f223cc1088f5 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:39.837117 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-85467095-2950-49d4-94eb-5acc2ddd35d9 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:39.837788 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-85467095-2950-49d4-94eb-5acc2ddd35d9 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:39.853787 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85467095-2950-49d4-94eb-5acc2ddd35d9 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:39.854324 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85467095-2950-49d4-94eb-5acc2ddd35d9 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:39.858398 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85467095-2950-49d4-94eb-5acc2ddd35d9 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:39.859385 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85467095-2950-49d4-94eb-5acc2ddd35d9 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:39.872732 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d7a7518f-97f1-4e14-8b78-f223cc1088f5 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Going to try to start instance {{(pid=119544) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 02:49:39.976518 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d7a7518f-97f1-4e14-8b78-f223cc1088f5 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "POST /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5/action" status: 202 len: 0 microversion: 2.1 time: 0.167543 Jul 18 02:49:39.977826 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2382/4771] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:49:39 2022] POST /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:49:39.991993 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-914d277c-b784-4423-9a9d-78c689ebdb67 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:39.992837 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-914d277c-b784-4423-9a9d-78c689ebdb67 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:40.012684 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-914d277c-b784-4423-9a9d-78c689ebdb67 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:40.013484 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-914d277c-b784-4423-9a9d-78c689ebdb67 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:40.018534 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-914d277c-b784-4423-9a9d-78c689ebdb67 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:40.020361 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-914d277c-b784-4423-9a9d-78c689ebdb67 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:40.031945 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:49:40.548161 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-85467095-2950-49d4-94eb-5acc2ddd35d9 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:40.588650 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-85467095-2950-49d4-94eb-5acc2ddd35d9 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 200 len: 1696 microversion: 2.1 time: 0.755417 Jul 18 02:49:40.593264 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2390/4772] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:39 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 1696 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:49:40.731475 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d2a5cf0d-315d-4824-9d57-3a0706da03c3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:40.732655 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d2a5cf0d-315d-4824-9d57-3a0706da03c3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:40.759550 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d2a5cf0d-315d-4824-9d57-3a0706da03c3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:40.760066 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d2a5cf0d-315d-4824-9d57-3a0706da03c3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:40.762843 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d2a5cf0d-315d-4824-9d57-3a0706da03c3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:40.764252 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d2a5cf0d-315d-4824-9d57-3a0706da03c3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:40.960511 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-914d277c-b784-4423-9a9d-78c689ebdb67 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:41.003828 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-914d277c-b784-4423-9a9d-78c689ebdb67 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 200 len: 1707 microversion: 2.1 time: 1.018218 Jul 18 02:49:41.006132 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2383/4773] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:39 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 1707 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:49:41.618305 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-041a810a-8c0a-4f82-89c0-70c69430351e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:41.619390 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-041a810a-8c0a-4f82-89c0-70c69430351e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:41.643532 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-041a810a-8c0a-4f82-89c0-70c69430351e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:41.646038 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-041a810a-8c0a-4f82-89c0-70c69430351e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:41.648967 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-041a810a-8c0a-4f82-89c0-70c69430351e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:41.650534 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-041a810a-8c0a-4f82-89c0-70c69430351e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:42.214328 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d2a5cf0d-315d-4824-9d57-3a0706da03c3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:42.231144 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d2a5cf0d-315d-4824-9d57-3a0706da03c3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c" status: 200 len: 1394 microversion: 2.1 time: 1.507786 Jul 18 02:49:42.248861 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2391/4774] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:40 2022] GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c => generated 1394 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:42.248861 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e8786d75-d57e-482b-b151-b39bd1c560c3 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:42.248861 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e8786d75-d57e-482b-b151-b39bd1c560c3 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:42.275317 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e8786d75-d57e-482b-b151-b39bd1c560c3 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:42.276763 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e8786d75-d57e-482b-b151-b39bd1c560c3 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:42.278361 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e8786d75-d57e-482b-b151-b39bd1c560c3 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:42.278717 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e8786d75-d57e-482b-b151-b39bd1c560c3 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:42.629219 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-041a810a-8c0a-4f82-89c0-70c69430351e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:42.644074 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-041a810a-8c0a-4f82-89c0-70c69430351e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 200 len: 1696 microversion: 2.1 time: 1.035097 Jul 18 02:49:42.660905 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2384/4775] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:41 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 1696 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:49:43.156489 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e8786d75-d57e-482b-b151-b39bd1c560c3 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:43.166356 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e8786d75-d57e-482b-b151-b39bd1c560c3 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 200 len: 1707 microversion: 2.1 time: 0.922161 Jul 18 02:49:43.178705 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2392/4776] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:42 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 1707 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:43.258423 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-26bd304e-e3d5-406b-98e6-7147585ab0d9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:43.259798 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-26bd304e-e3d5-406b-98e6-7147585ab0d9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:43.267252 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26bd304e-e3d5-406b-98e6-7147585ab0d9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:43.268026 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26bd304e-e3d5-406b-98e6-7147585ab0d9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:43.269567 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26bd304e-e3d5-406b-98e6-7147585ab0d9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:43.270285 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26bd304e-e3d5-406b-98e6-7147585ab0d9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:43.671436 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3f3992ba-6d0b-4442-8dbc-2891c08ba381 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:43.673832 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3f3992ba-6d0b-4442-8dbc-2891c08ba381 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:43.693609 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3f3992ba-6d0b-4442-8dbc-2891c08ba381 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:43.694647 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3f3992ba-6d0b-4442-8dbc-2891c08ba381 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:43.695800 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3f3992ba-6d0b-4442-8dbc-2891c08ba381 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:43.698662 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3f3992ba-6d0b-4442-8dbc-2891c08ba381 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:44.122439 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-26bd304e-e3d5-406b-98e6-7147585ab0d9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:44.161750 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-26bd304e-e3d5-406b-98e6-7147585ab0d9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c" status: 200 len: 1394 microversion: 2.1 time: 0.907895 Jul 18 02:49:44.166506 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2385/4777] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:43 2022] GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c => generated 1394 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:44.201386 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-08c7e3d0-500b-40f5-8551-d8758c31e6d4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:44.210219 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-08c7e3d0-500b-40f5-8551-d8758c31e6d4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:44.236684 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-08c7e3d0-500b-40f5-8551-d8758c31e6d4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:44.237907 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-08c7e3d0-500b-40f5-8551-d8758c31e6d4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:44.242002 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-08c7e3d0-500b-40f5-8551-d8758c31e6d4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:44.243334 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-08c7e3d0-500b-40f5-8551-d8758c31e6d4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:44.805412 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3f3992ba-6d0b-4442-8dbc-2891c08ba381 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:44.850394 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3f3992ba-6d0b-4442-8dbc-2891c08ba381 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 200 len: 1696 microversion: 2.1 time: 1.182589 Jul 18 02:49:44.853642 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2393/4778] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:43 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 1696 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:49:45.068052 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-e33a9476-d9b3-46d3-91a6-6f508c512fcb req-ebc7707f-aafd-4a73-b492-1831092bed6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1bb4d31-4685-48d2-b759-081bf1ddba8c", "name": "network-vif-deleted", "tag": "f0c47edb-bc03-42c4-a96f-4b9b643b02fd"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:49:45.107458 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-e33a9476-d9b3-46d3-91a6-6f508c512fcb req-ebc7707f-aafd-4a73-b492-1831092bed6c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:45.108285 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-e33a9476-d9b3-46d3-91a6-6f508c512fcb req-ebc7707f-aafd-4a73-b492-1831092bed6c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:45.160311 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-08c7e3d0-500b-40f5-8551-d8758c31e6d4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:45.200473 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-e33a9476-d9b3-46d3-91a6-6f508c512fcb req-ebc7707f-aafd-4a73-b492-1831092bed6c service nova] Creating event network-vif-deleted:f0c47edb-bc03-42c4-a96f-4b9b643b02fd for instance b1bb4d31-4685-48d2-b759-081bf1ddba8c on n-h2-465891-3 Jul 18 02:49:45.207271 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-08c7e3d0-500b-40f5-8551-d8758c31e6d4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 200 len: 1707 microversion: 2.1 time: 1.013572 Jul 18 02:49:45.209292 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2386/4779] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:44 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 1707 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:45.229344 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-e33a9476-d9b3-46d3-91a6-6f508c512fcb req-ebc7707f-aafd-4a73-b492-1831092bed6c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.368913 Jul 18 02:49:45.231127 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-44df638d-6449-4052-b65c-730476deec1e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:45.232308 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-44df638d-6449-4052-b65c-730476deec1e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:45.233126 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2394/4780] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:49:45.248658 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-44df638d-6449-4052-b65c-730476deec1e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:45.250064 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-44df638d-6449-4052-b65c-730476deec1e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:45.252197 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-44df638d-6449-4052-b65c-730476deec1e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:45.253300 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-44df638d-6449-4052-b65c-730476deec1e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:45.437176 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-44df638d-6449-4052-b65c-730476deec1e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:45.482252 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-44df638d-6449-4052-b65c-730476deec1e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c" status: 200 len: 1186 microversion: 2.1 time: 0.269817 Jul 18 02:49:45.489207 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2387/4781] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:45 2022] GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c => generated 1186 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:45.899476 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2da247d7-bc52-40e7-b28c-7227bda5b97c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:45.906444 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2da247d7-bc52-40e7-b28c-7227bda5b97c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:45.942886 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2da247d7-bc52-40e7-b28c-7227bda5b97c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:45.943652 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2da247d7-bc52-40e7-b28c-7227bda5b97c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:45.945142 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2da247d7-bc52-40e7-b28c-7227bda5b97c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:45.945899 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2da247d7-bc52-40e7-b28c-7227bda5b97c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:46.231525 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-25b11db5-61db-4b5e-8bc7-e967f795207c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:46.234019 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-25b11db5-61db-4b5e-8bc7-e967f795207c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:46.252641 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25b11db5-61db-4b5e-8bc7-e967f795207c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:46.254303 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25b11db5-61db-4b5e-8bc7-e967f795207c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:46.257241 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25b11db5-61db-4b5e-8bc7-e967f795207c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:46.258815 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25b11db5-61db-4b5e-8bc7-e967f795207c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:46.350002 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2da247d7-bc52-40e7-b28c-7227bda5b97c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:46.368926 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:49:46.382836 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2da247d7-bc52-40e7-b28c-7227bda5b97c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 200 len: 1696 microversion: 2.1 time: 0.501462 Jul 18 02:49:46.382836 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2395/4782] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:45 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 1696 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:46.518843 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f6d85edb-c2dc-46a5-91a7-6eebe64a0962 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:46.519987 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f6d85edb-c2dc-46a5-91a7-6eebe64a0962 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:46.533521 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f6d85edb-c2dc-46a5-91a7-6eebe64a0962 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:46.540733 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f6d85edb-c2dc-46a5-91a7-6eebe64a0962 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:46.542711 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f6d85edb-c2dc-46a5-91a7-6eebe64a0962 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:46.543785 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f6d85edb-c2dc-46a5-91a7-6eebe64a0962 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:46.577511 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-25b11db5-61db-4b5e-8bc7-e967f795207c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:46.588725 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-25b11db5-61db-4b5e-8bc7-e967f795207c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 200 len: 1711 microversion: 2.1 time: 0.364663 Jul 18 02:49:46.593928 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2388/4783] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:46 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 1711 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:46.699742 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f6d85edb-c2dc-46a5-91a7-6eebe64a0962 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:46.730339 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f6d85edb-c2dc-46a5-91a7-6eebe64a0962 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c" status: 200 len: 1186 microversion: 2.1 time: 0.222976 Jul 18 02:49:46.730863 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2396/4784] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:46 2022] GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c => generated 1186 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:49:47.407033 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-92599de1-65d4-48da-900c-1875f8f679a6 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:47.410119 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-92599de1-65d4-48da-900c-1875f8f679a6 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:47.428575 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-92599de1-65d4-48da-900c-1875f8f679a6 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:47.431758 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-92599de1-65d4-48da-900c-1875f8f679a6 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:47.434347 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-92599de1-65d4-48da-900c-1875f8f679a6 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:47.437692 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-92599de1-65d4-48da-900c-1875f8f679a6 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:47.727243 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-92599de1-65d4-48da-900c-1875f8f679a6 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:47.736550 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-92599de1-65d4-48da-900c-1875f8f679a6 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 200 len: 1696 microversion: 2.1 time: 0.340061 Jul 18 02:49:47.747022 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2389/4785] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:47 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 1696 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:47.754244 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c8ff85df-2518-4678-9b93-ed09be402d1e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:47.755716 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c8ff85df-2518-4678-9b93-ed09be402d1e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:47.765632 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c8ff85df-2518-4678-9b93-ed09be402d1e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:47.767242 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c8ff85df-2518-4678-9b93-ed09be402d1e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:47.769171 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c8ff85df-2518-4678-9b93-ed09be402d1e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:47.770176 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c8ff85df-2518-4678-9b93-ed09be402d1e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:48.026856 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c8ff85df-2518-4678-9b93-ed09be402d1e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:48.040356 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c8ff85df-2518-4678-9b93-ed09be402d1e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c" status: 200 len: 1186 microversion: 2.1 time: 0.289902 Jul 18 02:49:48.043525 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2397/4786] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:47 2022] GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c => generated 1186 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:49:48.760061 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-aa78c2d9-9c38-45df-8f5c-8acd8d69f6d7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:48.763679 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-aa78c2d9-9c38-45df-8f5c-8acd8d69f6d7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:48.798085 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aa78c2d9-9c38-45df-8f5c-8acd8d69f6d7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:48.824631 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aa78c2d9-9c38-45df-8f5c-8acd8d69f6d7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:48.826476 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aa78c2d9-9c38-45df-8f5c-8acd8d69f6d7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:48.833056 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aa78c2d9-9c38-45df-8f5c-8acd8d69f6d7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:49.079866 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d1c88d7b-a8cb-41be-b80e-6712decb54a7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:49.084101 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d1c88d7b-a8cb-41be-b80e-6712decb54a7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:49.111853 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d1c88d7b-a8cb-41be-b80e-6712decb54a7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:49.119582 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d1c88d7b-a8cb-41be-b80e-6712decb54a7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:49.126483 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d1c88d7b-a8cb-41be-b80e-6712decb54a7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:49.134508 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d1c88d7b-a8cb-41be-b80e-6712decb54a7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:49.461313 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d1c88d7b-a8cb-41be-b80e-6712decb54a7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:49.531483 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d1c88d7b-a8cb-41be-b80e-6712decb54a7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c" status: 200 len: 1186 microversion: 2.1 time: 0.463790 Jul 18 02:49:49.555301 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2398/4787] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:49 2022] GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c => generated 1186 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:49.613187 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-aa78c2d9-9c38-45df-8f5c-8acd8d69f6d7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:49.634894 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-aa78c2d9-9c38-45df-8f5c-8acd8d69f6d7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 200 len: 1695 microversion: 2.1 time: 0.882373 Jul 18 02:49:49.636401 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2390/4788] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:48 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 1695 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:49:49.900076 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-f4ce7cc3-3830-45e6-aca7-2f1745e32f8d req-87058a18-d6b3-428c-9868-edee1c999452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ce58c09-6319-4fad-ae8a-2b4199edcfd9", "name": "network-vif-unplugged", "status": "completed", "tag": "7f42876f-44b2-4ca5-aea9-aa2f86f8f3ed"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:49:49.936808 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-f4ce7cc3-3830-45e6-aca7-2f1745e32f8d req-87058a18-d6b3-428c-9868-edee1c999452 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:49.944122 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-f4ce7cc3-3830-45e6-aca7-2f1745e32f8d req-87058a18-d6b3-428c-9868-edee1c999452 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:50.015894 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-f4ce7cc3-3830-45e6-aca7-2f1745e32f8d req-87058a18-d6b3-428c-9868-edee1c999452 service nova] Creating event network-vif-unplugged:7f42876f-44b2-4ca5-aea9-aa2f86f8f3ed for instance 5ce58c09-6319-4fad-ae8a-2b4199edcfd9 on n-h1-465891-3 Jul 18 02:49:50.040343 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [req-f4ce7cc3-3830-45e6-aca7-2f1745e32f8d req-87058a18-d6b3-428c-9868-edee1c999452 service nova] Instance 5ce58c09-6319-4fad-ae8a-2b4199edcfd9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3', 'n-h2-465891-3'} {{(pid=119543) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 02:49:50.070187 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-f4ce7cc3-3830-45e6-aca7-2f1745e32f8d req-87058a18-d6b3-428c-9868-edee1c999452 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.174028 Jul 18 02:49:50.078143 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2399/4789] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:49:50.566901 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-315ba3cb-5d2a-48f1-a1b3-3187110a29cb tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:50.570721 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-315ba3cb-5d2a-48f1-a1b3-3187110a29cb tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:50.606116 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-315ba3cb-5d2a-48f1-a1b3-3187110a29cb tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:50.607491 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-315ba3cb-5d2a-48f1-a1b3-3187110a29cb tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:50.609952 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-315ba3cb-5d2a-48f1-a1b3-3187110a29cb tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:50.611882 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-315ba3cb-5d2a-48f1-a1b3-3187110a29cb tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:50.686319 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8fed1259-79fa-4fc1-bd43-15bacac4defc tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:50.689819 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8fed1259-79fa-4fc1-bd43-15bacac4defc tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:50.732971 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8fed1259-79fa-4fc1-bd43-15bacac4defc tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:50.739196 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8fed1259-79fa-4fc1-bd43-15bacac4defc tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:50.743571 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8fed1259-79fa-4fc1-bd43-15bacac4defc tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:50.746410 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8fed1259-79fa-4fc1-bd43-15bacac4defc tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:51.420483 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-315ba3cb-5d2a-48f1-a1b3-3187110a29cb tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:51.434857 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-315ba3cb-5d2a-48f1-a1b3-3187110a29cb tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c" status: 200 len: 1186 microversion: 2.1 time: 0.874732 Jul 18 02:49:51.435481 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2391/4790] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:50 2022] GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c => generated 1186 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:51.604786 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8fed1259-79fa-4fc1-bd43-15bacac4defc tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:51.650115 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8fed1259-79fa-4fc1-bd43-15bacac4defc tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 200 len: 1695 microversion: 2.1 time: 0.981099 Jul 18 02:49:51.657835 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2400/4791] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:50 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 1695 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:52.151100 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-9686db4d-ee28-4551-aee4-1160e2bd6d4e req-47281c05-4d24-4680-9f0e-623cbb9bff62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ce58c09-6319-4fad-ae8a-2b4199edcfd9", "tag": "7f42876f-44b2-4ca5-aea9-aa2f86f8f3ed"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:49:52.175109 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-9686db4d-ee28-4551-aee4-1160e2bd6d4e req-47281c05-4d24-4680-9f0e-623cbb9bff62 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:52.182700 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-9686db4d-ee28-4551-aee4-1160e2bd6d4e req-47281c05-4d24-4680-9f0e-623cbb9bff62 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:52.228379 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-9686db4d-ee28-4551-aee4-1160e2bd6d4e req-47281c05-4d24-4680-9f0e-623cbb9bff62 service nova] Creating event network-changed:7f42876f-44b2-4ca5-aea9-aa2f86f8f3ed for instance 5ce58c09-6319-4fad-ae8a-2b4199edcfd9 on n-h1-465891-3 Jul 18 02:49:52.248457 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [req-9686db4d-ee28-4551-aee4-1160e2bd6d4e req-47281c05-4d24-4680-9f0e-623cbb9bff62 service nova] Instance 5ce58c09-6319-4fad-ae8a-2b4199edcfd9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3', 'n-h2-465891-3'} {{(pid=119544) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 02:49:52.294457 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-9686db4d-ee28-4551-aee4-1160e2bd6d4e req-47281c05-4d24-4680-9f0e-623cbb9bff62 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147388 Jul 18 02:49:52.304104 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2392/4792] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:49:52.462622 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b127227f-79dc-4de0-a2c5-981e07c85558 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:52.463402 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b127227f-79dc-4de0-a2c5-981e07c85558 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:52.487848 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b127227f-79dc-4de0-a2c5-981e07c85558 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:52.489189 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b127227f-79dc-4de0-a2c5-981e07c85558 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:52.493115 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b127227f-79dc-4de0-a2c5-981e07c85558 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:52.493770 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b127227f-79dc-4de0-a2c5-981e07c85558 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:52.691846 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b9e2dfb7-bb5c-4a88-9754-883c691f8d3d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:52.697805 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b9e2dfb7-bb5c-4a88-9754-883c691f8d3d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:52.714120 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b9e2dfb7-bb5c-4a88-9754-883c691f8d3d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:52.715772 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b9e2dfb7-bb5c-4a88-9754-883c691f8d3d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:52.717645 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b9e2dfb7-bb5c-4a88-9754-883c691f8d3d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:52.720147 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b9e2dfb7-bb5c-4a88-9754-883c691f8d3d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:52.995066 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b127227f-79dc-4de0-a2c5-981e07c85558 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:53.015533 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b127227f-79dc-4de0-a2c5-981e07c85558 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c" status: 200 len: 1186 microversion: 2.1 time: 0.555653 Jul 18 02:49:53.020983 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2401/4793] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:52 2022] GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c => generated 1186 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:53.620564 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b9e2dfb7-bb5c-4a88-9754-883c691f8d3d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:53.653556 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b9e2dfb7-bb5c-4a88-9754-883c691f8d3d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 200 len: 1695 microversion: 2.1 time: 0.980168 Jul 18 02:49:53.656455 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2393/4794] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:52 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 1695 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:54.062466 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-de47b157-beb1-40f6-971e-8d8769e38e93 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:54.064759 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-de47b157-beb1-40f6-971e-8d8769e38e93 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:54.082327 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-de47b157-beb1-40f6-971e-8d8769e38e93 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:54.084370 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-de47b157-beb1-40f6-971e-8d8769e38e93 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:54.086754 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-de47b157-beb1-40f6-971e-8d8769e38e93 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:54.088049 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-de47b157-beb1-40f6-971e-8d8769e38e93 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:54.413001 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-de47b157-beb1-40f6-971e-8d8769e38e93 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:54.436379 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-de47b157-beb1-40f6-971e-8d8769e38e93 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c" status: 200 len: 1186 microversion: 2.1 time: 0.403034 Jul 18 02:49:54.439036 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2402/4795] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:54 2022] GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c => generated 1186 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:54.675191 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-33218c6b-9e4e-4eca-b20f-05025d51233f tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:54.676535 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-33218c6b-9e4e-4eca-b20f-05025d51233f tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:54.691442 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-33218c6b-9e4e-4eca-b20f-05025d51233f tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:54.695736 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-33218c6b-9e4e-4eca-b20f-05025d51233f tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:54.698318 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-33218c6b-9e4e-4eca-b20f-05025d51233f tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:54.699194 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-33218c6b-9e4e-4eca-b20f-05025d51233f tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:55.136378 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-aded15ef-91f7-44f5-a5cb-cf5bdb7366f9 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15628c00-af7c-4d1b-a698-9096295ca946", "device": "/dev/sdb"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:49:55.138065 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-aded15ef-91f7-44f5-a5cb-cf5bdb7366f9 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 3dc82011-e895-461b-97a4-8c6ce6d88ec7] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:55.146815 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aded15ef-91f7-44f5-a5cb-cf5bdb7366f9 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:55.147289 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aded15ef-91f7-44f5-a5cb-cf5bdb7366f9 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:55.148453 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aded15ef-91f7-44f5-a5cb-cf5bdb7366f9 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:55.148914 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aded15ef-91f7-44f5-a5cb-cf5bdb7366f9 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:55.319111 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-33218c6b-9e4e-4eca-b20f-05025d51233f tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:55.338337 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-33218c6b-9e4e-4eca-b20f-05025d51233f tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 200 len: 1695 microversion: 2.1 time: 0.668820 Jul 18 02:49:55.338948 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2394/4796] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:54 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 1695 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:55.466227 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fcabe9ea-bbe8-43b9-9028-ecf98fae57fd tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:55.468507 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fcabe9ea-bbe8-43b9-9028-ecf98fae57fd tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:55.487703 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fcabe9ea-bbe8-43b9-9028-ecf98fae57fd tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:55.489186 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fcabe9ea-bbe8-43b9-9028-ecf98fae57fd tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:55.490997 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fcabe9ea-bbe8-43b9-9028-ecf98fae57fd tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:55.492381 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fcabe9ea-bbe8-43b9-9028-ecf98fae57fd tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:55.541314 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-fcabe9ea-bbe8-43b9-9028-ecf98fae57fd tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] HTTP exception thrown: Instance b1bb4d31-4685-48d2-b759-081bf1ddba8c could not be found. Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fcabe9ea-bbe8-43b9-9028-ecf98fae57fd tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Request method failure captured: Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c HTTP/1.1 Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MliWHzVx10oBgzg24taGfvPF1POfFT53P2_RlSdFLebnrvIbeAs5qvjZ1EAd9Fni5RvXZYA8fjgna7ooKOtwOz_kbJVpuNazgX6TlGzOYOFYf5fy5vfDN_5wwJEwayQdbLz2BaqgZyDtVrhp2skZQbTuh-KNZeRA8bkIRl3oXepO1E Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 2b7654e273f6487ba83382da4f96056d Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-TestVolumeBootPattern-598001453 Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2b7654e273f6487ba83382da4f96056d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2b7654e273f6487ba83382da4f96056d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2b7654e273f6487ba83382da4f96056d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2b7654e273f6487ba83382da4f96056d"}]}] Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-TestVolumeBootPattern-598001453 Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 2b7654e273f6487ba83382da4f96056d Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-TestVolumeBootPattern-598001453 Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-TestVolumeBootPattern-598001453-project Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: d1afc1702f8045a396b98e5c24b124e7 Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-TestVolumeBootPattern-598001453-project Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance b1bb4d31-4685-48d2-b759-081bf1ddba8c could not be found. Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'b1bb4d31-4685-48d2-b759-081bf1ddba8c'} Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1bb4d31-4685-48d2-b759-081bf1ddba8c could not be found. Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1bb4d31-4685-48d2-b759-081bf1ddba8c could not be found. Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:49:55.545202 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:49:55.554184 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:49:55.554184 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:49:55.554184 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:49:55.554184 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:49:55.554184 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:49:55.554184 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1bb4d31-4685-48d2-b759-081bf1ddba8c could not be found. Jul 18 02:49:55.554184 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:49:55.557649 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fcabe9ea-bbe8-43b9-9028-ecf98fae57fd tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Returning 404 to user: Instance b1bb4d31-4685-48d2-b759-081bf1ddba8c could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:49:55.560570 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fcabe9ea-bbe8-43b9-9028-ecf98fae57fd tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c" status: 404 len: 111 microversion: 2.1 time: 0.109010 Jul 18 02:49:55.562575 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2395/4797] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:55 2022] GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:49:55.709990 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-aded15ef-91f7-44f5-a5cb-cf5bdb7366f9 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] 10.222.0.57 "POST /compute/v2.1/servers/3dc82011-e895-461b-97a4-8c6ce6d88ec7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.577963 Jul 18 02:49:55.710981 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2403/4798] 10.222.0.57 () {60 vars in 1322 bytes} [Mon Jul 18 02:49:55 2022] POST /compute/v2.1/servers/3dc82011-e895-461b-97a4-8c6ce6d88ec7/os-volume_attachments => generated 194 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:49:56.366933 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-af530e3e-e7e7-4467-b87e-690489a6532a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:56.377554 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-af530e3e-e7e7-4467-b87e-690489a6532a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:56.410774 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-af530e3e-e7e7-4467-b87e-690489a6532a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:56.413861 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-af530e3e-e7e7-4467-b87e-690489a6532a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:56.419635 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-af530e3e-e7e7-4467-b87e-690489a6532a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:56.423575 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-af530e3e-e7e7-4467-b87e-690489a6532a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:57.328548 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-af530e3e-e7e7-4467-b87e-690489a6532a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:57.353230 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-af530e3e-e7e7-4467-b87e-690489a6532a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 200 len: 1693 microversion: 2.1 time: 0.995401 Jul 18 02:49:57.367755 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2396/4799] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:56 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 1693 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:58.384355 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5341deee-96af-4a48-915a-c75c499e0eb9 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:58.388236 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5341deee-96af-4a48-915a-c75c499e0eb9 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:58.413579 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5341deee-96af-4a48-915a-c75c499e0eb9 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:58.414319 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5341deee-96af-4a48-915a-c75c499e0eb9 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:58.418389 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5341deee-96af-4a48-915a-c75c499e0eb9 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:58.419210 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5341deee-96af-4a48-915a-c75c499e0eb9 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:59.168189 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fd73a383-f921-47e8-9db8-40ab6e4949de tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:59.169056 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fd73a383-f921-47e8-9db8-40ab6e4949de tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:59.206825 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:49:59.209971 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd73a383-f921-47e8-9db8-40ab6e4949de tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:59.213832 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd73a383-f921-47e8-9db8-40ab6e4949de tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:59.215638 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd73a383-f921-47e8-9db8-40ab6e4949de tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:59.216439 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd73a383-f921-47e8-9db8-40ab6e4949de tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:59.297681 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-fd73a383-f921-47e8-9db8-40ab6e4949de tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] HTTP exception thrown: Instance b1bb4d31-4685-48d2-b759-081bf1ddba8c could not be found. Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fd73a383-f921-47e8-9db8-40ab6e4949de tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Request method failure captured: Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c HTTP/1.1 Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MliWHzVx10oBgzg24taGfvPF1POfFT53P2_RlSdFLebnrvIbeAs5qvjZ1EAd9Fni5RvXZYA8fjgna7ooKOtwOz_kbJVpuNazgX6TlGzOYOFYf5fy5vfDN_5wwJEwayQdbLz2BaqgZyDtVrhp2skZQbTuh-KNZeRA8bkIRl3oXepO1E Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 2b7654e273f6487ba83382da4f96056d Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-TestVolumeBootPattern-598001453 Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2b7654e273f6487ba83382da4f96056d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2b7654e273f6487ba83382da4f96056d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2b7654e273f6487ba83382da4f96056d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2b7654e273f6487ba83382da4f96056d"}]}] Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-TestVolumeBootPattern-598001453 Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 2b7654e273f6487ba83382da4f96056d Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-TestVolumeBootPattern-598001453 Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-TestVolumeBootPattern-598001453-project Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: d1afc1702f8045a396b98e5c24b124e7 Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-TestVolumeBootPattern-598001453-project Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance b1bb4d31-4685-48d2-b759-081bf1ddba8c could not be found. Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'b1bb4d31-4685-48d2-b759-081bf1ddba8c'} Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1bb4d31-4685-48d2-b759-081bf1ddba8c could not be found. Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:49:59.320916 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:49:59.330107 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1bb4d31-4685-48d2-b759-081bf1ddba8c could not be found. Jul 18 02:49:59.330107 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:49:59.330107 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:49:59.330107 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:49:59.330107 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:49:59.330107 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:49:59.330107 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:49:59.330107 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:49:59.330107 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:49:59.330107 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1bb4d31-4685-48d2-b759-081bf1ddba8c could not be found. Jul 18 02:49:59.330107 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:49:59.333381 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fd73a383-f921-47e8-9db8-40ab6e4949de tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Returning 404 to user: Instance b1bb4d31-4685-48d2-b759-081bf1ddba8c could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:49:59.336431 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fd73a383-f921-47e8-9db8-40ab6e4949de tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c" status: 404 len: 111 microversion: 2.1 time: 0.175627 Jul 18 02:49:59.338419 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2397/4800] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:49:59 2022] DELETE /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:49:59.352602 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1c8c464a-9920-4332-9385-4ad0a3151504 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:59.363339 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1c8c464a-9920-4332-9385-4ad0a3151504 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: b1bb4d31-4685-48d2-b759-081bf1ddba8c] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:59.398261 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1c8c464a-9920-4332-9385-4ad0a3151504 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:59.399665 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1c8c464a-9920-4332-9385-4ad0a3151504 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:59.401608 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1c8c464a-9920-4332-9385-4ad0a3151504 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:59.402854 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1c8c464a-9920-4332-9385-4ad0a3151504 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:59.435933 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-1c8c464a-9920-4332-9385-4ad0a3151504 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] HTTP exception thrown: Instance b1bb4d31-4685-48d2-b759-081bf1ddba8c could not be found. Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1c8c464a-9920-4332-9385-4ad0a3151504 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Request method failure captured: Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c HTTP/1.1 Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MliWHzVx10oBgzg24taGfvPF1POfFT53P2_RlSdFLebnrvIbeAs5qvjZ1EAd9Fni5RvXZYA8fjgna7ooKOtwOz_kbJVpuNazgX6TlGzOYOFYf5fy5vfDN_5wwJEwayQdbLz2BaqgZyDtVrhp2skZQbTuh-KNZeRA8bkIRl3oXepO1E Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 2b7654e273f6487ba83382da4f96056d Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-TestVolumeBootPattern-598001453 Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2b7654e273f6487ba83382da4f96056d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2b7654e273f6487ba83382da4f96056d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2b7654e273f6487ba83382da4f96056d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2b7654e273f6487ba83382da4f96056d"}]}] Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-TestVolumeBootPattern-598001453 Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 2b7654e273f6487ba83382da4f96056d Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-TestVolumeBootPattern-598001453 Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-TestVolumeBootPattern-598001453-project Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: d1afc1702f8045a396b98e5c24b124e7 Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-TestVolumeBootPattern-598001453-project Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance b1bb4d31-4685-48d2-b759-081bf1ddba8c could not be found. Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'b1bb4d31-4685-48d2-b759-081bf1ddba8c'} Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1bb4d31-4685-48d2-b759-081bf1ddba8c could not be found. Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1bb4d31-4685-48d2-b759-081bf1ddba8c could not be found. Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:49:59.439449 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:49:59.447930 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:49:59.447930 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:49:59.447930 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:49:59.447930 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:49:59.447930 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:49:59.447930 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1bb4d31-4685-48d2-b759-081bf1ddba8c could not be found. Jul 18 02:49:59.447930 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:49:59.450547 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1c8c464a-9920-4332-9385-4ad0a3151504 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Returning 404 to user: Instance b1bb4d31-4685-48d2-b759-081bf1ddba8c could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:49:59.453179 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1c8c464a-9920-4332-9385-4ad0a3151504 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c" status: 404 len: 111 microversion: 2.1 time: 0.108246 Jul 18 02:49:59.454837 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2398/4801] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:59 2022] GET /compute/v2.1/servers/b1bb4d31-4685-48d2-b759-081bf1ddba8c => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:50:00.245551 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5341deee-96af-4a48-915a-c75c499e0eb9 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:00.274517 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5341deee-96af-4a48-915a-c75c499e0eb9 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 200 len: 1690 microversion: 2.1 time: 1.901356 Jul 18 02:50:00.297953 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2404/4802] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:58 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 1690 bytes in 1919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:00.316788 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e1ab1e05-184e-4a97-a2e5-2bd5d10a8e3e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:50:00.322394 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e1ab1e05-184e-4a97-a2e5-2bd5d10a8e3e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:00.348036 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e1ab1e05-184e-4a97-a2e5-2bd5d10a8e3e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:00.355197 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e1ab1e05-184e-4a97-a2e5-2bd5d10a8e3e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:00.357186 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e1ab1e05-184e-4a97-a2e5-2bd5d10a8e3e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:00.358993 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e1ab1e05-184e-4a97-a2e5-2bd5d10a8e3e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:00.535125 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e1ab1e05-184e-4a97-a2e5-2bd5d10a8e3e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "POST /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9/action" status: 204 len: 0 microversion: 2.1 time: 0.224898 Jul 18 02:50:00.583368 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-54831bbe-3fdb-4715-a5bf-e36e9602ba9d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:00.584561 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-54831bbe-3fdb-4715-a5bf-e36e9602ba9d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:00.589086 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2399/4803] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:50:00 2022] POST /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9/action => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:50:00.639168 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-54831bbe-3fdb-4715-a5bf-e36e9602ba9d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:00.657673 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-54831bbe-3fdb-4715-a5bf-e36e9602ba9d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:00.661788 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-54831bbe-3fdb-4715-a5bf-e36e9602ba9d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:00.671567 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-54831bbe-3fdb-4715-a5bf-e36e9602ba9d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:01.570050 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-54831bbe-3fdb-4715-a5bf-e36e9602ba9d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:01.591177 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-54831bbe-3fdb-4715-a5bf-e36e9602ba9d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 200 len: 1690 microversion: 2.1 time: 1.026677 Jul 18 02:50:01.597924 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2405/4804] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:00 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 1690 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:02.627024 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-75b0be22-35a4-42df-b590-e2872cdee4c9 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:02.631367 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-75b0be22-35a4-42df-b590-e2872cdee4c9 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:02.660467 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-75b0be22-35a4-42df-b590-e2872cdee4c9 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:02.661028 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-75b0be22-35a4-42df-b590-e2872cdee4c9 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:02.662036 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-75b0be22-35a4-42df-b590-e2872cdee4c9 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:02.663054 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-75b0be22-35a4-42df-b590-e2872cdee4c9 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:03.118366 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-75b0be22-35a4-42df-b590-e2872cdee4c9 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:03.125850 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:50:03.147534 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-75b0be22-35a4-42df-b590-e2872cdee4c9 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 200 len: 1690 microversion: 2.1 time: 0.536474 Jul 18 02:50:03.161416 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2400/4805] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:02 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 1690 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:04.175832 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b87e4eb5-7377-49a3-97f4-86151a3e65d6 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:04.180426 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b87e4eb5-7377-49a3-97f4-86151a3e65d6 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:04.198136 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b87e4eb5-7377-49a3-97f4-86151a3e65d6 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:04.199668 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b87e4eb5-7377-49a3-97f4-86151a3e65d6 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:04.203890 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b87e4eb5-7377-49a3-97f4-86151a3e65d6 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:04.207985 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b87e4eb5-7377-49a3-97f4-86151a3e65d6 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:04.833132 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b87e4eb5-7377-49a3-97f4-86151a3e65d6 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:04.872138 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b87e4eb5-7377-49a3-97f4-86151a3e65d6 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 200 len: 1682 microversion: 2.1 time: 0.703148 Jul 18 02:50:04.889646 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2406/4806] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:04 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 1682 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:07.301638 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e84b1188-fbe3-4746-9301-e0dd5f27b260 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Action: 'create', calling method: .version_select at 0x7ff4a92308b0>, body: {"keypair": {"name": "tempest-keypair-438126568", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHTG9UAfcKujmTb6ttKYmPxz1C8ydb9dKuNitXSbUSxYQ9lwHEadqQSJO1gnPTKf771JVu3ZfIoJucKvoeuqM6m4HcFKDW+Vge+B8/EjeSjjABsrwqGPbho7gdYwduegw=="}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:50:07.325321 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-e84b1188-fbe3-4746-9301-e0dd5f27b260 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Getting quotas for project 2ed8b12429e9420bb83700e52701910b. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:50:07.332520 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-e84b1188-fbe3-4746-9301-e0dd5f27b260 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Getting quotas for user 5436715af849460f87ff6b62dbd491a0 and project 2ed8b12429e9420bb83700e52701910b. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:50:07.388926 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e84b1188-fbe3-4746-9301-e0dd5f27b260 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.273764 Jul 18 02:50:07.391027 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2401/4807] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 02:50:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:50:08.294467 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-601aac57-4596-4db2-b3ff-10e28fa97e04 req-d8a8e669-8583-40f2-86ec-b0d656e766a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ce58c09-6319-4fad-ae8a-2b4199edcfd9", "name": "network-vif-plugged", "status": "completed", "tag": "7f42876f-44b2-4ca5-aea9-aa2f86f8f3ed"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:50:08.321212 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:50:08.334757 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-601aac57-4596-4db2-b3ff-10e28fa97e04 req-d8a8e669-8583-40f2-86ec-b0d656e766a5 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:08.337943 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-601aac57-4596-4db2-b3ff-10e28fa97e04 req-d8a8e669-8583-40f2-86ec-b0d656e766a5 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:08.383953 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-601aac57-4596-4db2-b3ff-10e28fa97e04 req-d8a8e669-8583-40f2-86ec-b0d656e766a5 service nova] Creating event network-vif-plugged:7f42876f-44b2-4ca5-aea9-aa2f86f8f3ed for instance 5ce58c09-6319-4fad-ae8a-2b4199edcfd9 on n-h1-465891-3 Jul 18 02:50:08.415992 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-601aac57-4596-4db2-b3ff-10e28fa97e04 req-d8a8e669-8583-40f2-86ec-b0d656e766a5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144463 Jul 18 02:50:08.424671 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2407/4808] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:50:11.142147 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5c7bd08f-19cd-4910-bac2-568c33f870e9 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1122985647", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a3f65d6b-f64d-469e-b970-581d249d8554"}], "security_groups": [{"name": "tempest-securitygroup--2039704110"}], "key_name": "tempest-keypair-438126568", "user_data": "}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:50:11.473004 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-5c7bd08f-19cd-4910-bac2-568c33f870e9 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] validate_networks() for [('a3f65d6b-f64d-469e-b970-581d249d8554', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:50:12.196435 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-5c7bd08f-19cd-4910-bac2-568c33f870e9 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:50:12.197196 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-5c7bd08f-19cd-4910-bac2-568c33f870e9 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:50:12.198304 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-5c7bd08f-19cd-4910-bac2-568c33f870e9 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:50:12.199745 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-5c7bd08f-19cd-4910-bac2-568c33f870e9 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:50:12.200418 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-5c7bd08f-19cd-4910-bac2-568c33f870e9 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:50:12.225205 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5c7bd08f-19cd-4910-bac2-568c33f870e9 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:12.226259 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5c7bd08f-19cd-4910-bac2-568c33f870e9 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:12.227864 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5c7bd08f-19cd-4910-bac2-568c33f870e9 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:12.228697 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5c7bd08f-19cd-4910-bac2-568c33f870e9 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:12.280048 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-5c7bd08f-19cd-4910-bac2-568c33f870e9 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Getting quotas for project 2ed8b12429e9420bb83700e52701910b. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:50:12.296824 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-5c7bd08f-19cd-4910-bac2-568c33f870e9 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Getting quotas for user 5436715af849460f87ff6b62dbd491a0 and project 2ed8b12429e9420bb83700e52701910b. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:50:12.334703 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5c7bd08f-19cd-4910-bac2-568c33f870e9 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:50:12.347030 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5c7bd08f-19cd-4910-bac2-568c33f870e9 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:50:12.431742 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5c7bd08f-19cd-4910-bac2-568c33f870e9 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.295150 Jul 18 02:50:12.448003 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2402/4809] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:50:11 2022] POST /compute/v2.1/servers => generated 409 bytes in 1311 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:50:12.474854 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e5564b68-b34d-4b96-9bec-40e83a7cf0b6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:12.477980 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e5564b68-b34d-4b96-9bec-40e83a7cf0b6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:12.624621 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e5564b68-b34d-4b96-9bec-40e83a7cf0b6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:12.633225 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e5564b68-b34d-4b96-9bec-40e83a7cf0b6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1238 microversion: 2.1 time: 0.169989 Jul 18 02:50:12.634249 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2408/4810] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:12 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1238 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:12.778923 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ea369abd-db60-44e4-9a80-7685f29ad8c5 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:12.779534 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ea369abd-db60-44e4-9a80-7685f29ad8c5 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: dfa2f044-9f51-44f9-a87a-1f114d90e7d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:12.790809 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea369abd-db60-44e4-9a80-7685f29ad8c5 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:12.794412 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea369abd-db60-44e4-9a80-7685f29ad8c5 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:12.797525 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea369abd-db60-44e4-9a80-7685f29ad8c5 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:12.798350 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea369abd-db60-44e4-9a80-7685f29ad8c5 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:12.865184 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ea369abd-db60-44e4-9a80-7685f29ad8c5 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4/ips" status: 200 len: 149 microversion: 2.1 time: 0.091957 Jul 18 02:50:12.867740 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2403/4811] 10.222.0.57 () {58 vars in 1247 bytes} [Mon Jul 18 02:50:12 2022] GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4/ips => generated 149 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:50:13.664654 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-010da227-afa2-4fb0-a416-af8447eefa50 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:13.666933 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-010da227-afa2-4fb0-a416-af8447eefa50 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:13.864423 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-010da227-afa2-4fb0-a416-af8447eefa50 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:13.881746 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-010da227-afa2-4fb0-a416-af8447eefa50 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1238 microversion: 2.1 time: 0.219318 Jul 18 02:50:13.891628 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2409/4812] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:13 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1238 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:14.910986 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-aff2b0d3-a5a3-47fa-a502-0bd5f6ff6708 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:14.917649 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-aff2b0d3-a5a3-47fa-a502-0bd5f6ff6708 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:14.961822 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aff2b0d3-a5a3-47fa-a502-0bd5f6ff6708 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:14.968017 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aff2b0d3-a5a3-47fa-a502-0bd5f6ff6708 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:14.974265 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aff2b0d3-a5a3-47fa-a502-0bd5f6ff6708 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:14.975189 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aff2b0d3-a5a3-47fa-a502-0bd5f6ff6708 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:15.282691 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-aff2b0d3-a5a3-47fa-a502-0bd5f6ff6708 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:15.300873 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-aff2b0d3-a5a3-47fa-a502-0bd5f6ff6708 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1290 microversion: 2.1 time: 0.402830 Jul 18 02:50:15.303789 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2404/4813] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:14 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1290 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:16.334974 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-064951ec-2355-42fc-92cb-e3a89921e725 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:16.335994 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-064951ec-2355-42fc-92cb-e3a89921e725 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:16.383094 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-064951ec-2355-42fc-92cb-e3a89921e725 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:16.383928 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-064951ec-2355-42fc-92cb-e3a89921e725 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:16.385741 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-064951ec-2355-42fc-92cb-e3a89921e725 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:16.387184 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-064951ec-2355-42fc-92cb-e3a89921e725 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:17.165207 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5dff8556-78b9-4730-9af3-c893a96ecaf3 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59fbe648-dd61-4681-9faf-6d51e1214631"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:50:17.171791 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5dff8556-78b9-4730-9af3-c893a96ecaf3 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: dfa2f044-9f51-44f9-a87a-1f114d90e7d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:17.183271 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5dff8556-78b9-4730-9af3-c893a96ecaf3 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:17.187065 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5dff8556-78b9-4730-9af3-c893a96ecaf3 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:17.194226 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5dff8556-78b9-4730-9af3-c893a96ecaf3 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:17.196779 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5dff8556-78b9-4730-9af3-c893a96ecaf3 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:17.402219 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-064951ec-2355-42fc-92cb-e3a89921e725 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:17.425227 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:50:17.438349 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-064951ec-2355-42fc-92cb-e3a89921e725 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1296 microversion: 2.1 time: 1.112115 Jul 18 02:50:17.454010 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2410/4814] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:16 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1296 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:17.801413 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5dff8556-78b9-4730-9af3-c893a96ecaf3 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "POST /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.647183 Jul 18 02:50:17.802908 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2405/4815] 10.222.0.57 () {60 vars in 1322 bytes} [Mon Jul 18 02:50:17 2022] POST /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4/os-volume_attachments => generated 194 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:50:18.488113 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-573b85f1-16d5-4f37-b909-31a8efc0d3ae tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:18.488729 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-573b85f1-16d5-4f37-b909-31a8efc0d3ae tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:18.519072 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-573b85f1-16d5-4f37-b909-31a8efc0d3ae tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:18.519887 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-573b85f1-16d5-4f37-b909-31a8efc0d3ae tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:18.520737 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-573b85f1-16d5-4f37-b909-31a8efc0d3ae tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:18.521197 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-573b85f1-16d5-4f37-b909-31a8efc0d3ae tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:18.775196 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-573b85f1-16d5-4f37-b909-31a8efc0d3ae tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:18.789988 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-573b85f1-16d5-4f37-b909-31a8efc0d3ae tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1296 microversion: 2.1 time: 0.309969 Jul 18 02:50:18.791464 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2411/4816] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:18 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1296 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:19.820333 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c171aef7-f720-4e5a-b68f-4980521f992f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:19.822610 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c171aef7-f720-4e5a-b68f-4980521f992f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:19.840017 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c171aef7-f720-4e5a-b68f-4980521f992f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:19.842566 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c171aef7-f720-4e5a-b68f-4980521f992f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:19.844143 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c171aef7-f720-4e5a-b68f-4980521f992f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:19.844819 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c171aef7-f720-4e5a-b68f-4980521f992f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:20.702967 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c171aef7-f720-4e5a-b68f-4980521f992f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:20.751320 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c171aef7-f720-4e5a-b68f-4980521f992f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1364 microversion: 2.1 time: 0.926312 Jul 18 02:50:20.761602 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2406/4817] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:19 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1364 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:21.783392 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cda88b84-63fd-46fb-9402-f267c5592ff5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:21.784269 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cda88b84-63fd-46fb-9402-f267c5592ff5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:21.837215 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cda88b84-63fd-46fb-9402-f267c5592ff5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:21.839801 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cda88b84-63fd-46fb-9402-f267c5592ff5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:21.842796 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cda88b84-63fd-46fb-9402-f267c5592ff5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:21.848787 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cda88b84-63fd-46fb-9402-f267c5592ff5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:22.405968 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cda88b84-63fd-46fb-9402-f267c5592ff5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:22.427962 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cda88b84-63fd-46fb-9402-f267c5592ff5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1364 microversion: 2.1 time: 0.648566 Jul 18 02:50:22.438857 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2412/4818] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:21 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1364 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:22.527758 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-2f133c62-a931-4a90-a8e3-39d5e0e7fc60 req-71193973-2b4f-4e9f-a996-630f03c3f990 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69bbb844-4d56-4e75-ae50-9c35c9ce6f9e", "tag": "d926d5af-f867-44cd-8b60-abb0339ecf2a"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:50:22.558753 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:50:22.561054 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=10 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:50:22.571051 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-2f133c62-a931-4a90-a8e3-39d5e0e7fc60 req-71193973-2b4f-4e9f-a996-630f03c3f990 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:22.574247 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-2f133c62-a931-4a90-a8e3-39d5e0e7fc60 req-71193973-2b4f-4e9f-a996-630f03c3f990 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:22.630312 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-2f133c62-a931-4a90-a8e3-39d5e0e7fc60 req-71193973-2b4f-4e9f-a996-630f03c3f990 service nova] Creating event network-changed:d926d5af-f867-44cd-8b60-abb0339ecf2a for instance 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e on n-h2-465891-3 Jul 18 02:50:22.647030 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-2f133c62-a931-4a90-a8e3-39d5e0e7fc60 req-71193973-2b4f-4e9f-a996-630f03c3f990 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126162 Jul 18 02:50:22.652015 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2407/4819] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:50:23.452623 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d6e6afb4-a958-4d53-b7ab-8cca338acd44 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:23.453798 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d6e6afb4-a958-4d53-b7ab-8cca338acd44 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:23.488006 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d6e6afb4-a958-4d53-b7ab-8cca338acd44 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:23.488771 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d6e6afb4-a958-4d53-b7ab-8cca338acd44 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:23.490217 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d6e6afb4-a958-4d53-b7ab-8cca338acd44 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:23.503774 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d6e6afb4-a958-4d53-b7ab-8cca338acd44 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:23.870073 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=4 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:50:23.949993 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d6e6afb4-a958-4d53-b7ab-8cca338acd44 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:23.960997 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d6e6afb4-a958-4d53-b7ab-8cca338acd44 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1364 microversion: 2.1 time: 0.517654 Jul 18 02:50:23.961628 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2413/4820] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:23 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1364 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:24.981652 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2114770b-14d3-4dbb-b9b2-8496eb741de8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:24.982412 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2114770b-14d3-4dbb-b9b2-8496eb741de8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:25.004634 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2114770b-14d3-4dbb-b9b2-8496eb741de8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:25.005345 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2114770b-14d3-4dbb-b9b2-8496eb741de8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:25.006705 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2114770b-14d3-4dbb-b9b2-8496eb741de8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:25.007465 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2114770b-14d3-4dbb-b9b2-8496eb741de8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:25.426832 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2114770b-14d3-4dbb-b9b2-8496eb741de8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:25.441690 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2114770b-14d3-4dbb-b9b2-8496eb741de8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1364 microversion: 2.1 time: 0.464133 Jul 18 02:50:25.458289 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2408/4821] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:24 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1364 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:26.495571 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cd77e664-b0bb-4d26-b8ea-a6526ad89c98 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:26.500123 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cd77e664-b0bb-4d26-b8ea-a6526ad89c98 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:26.527877 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cd77e664-b0bb-4d26-b8ea-a6526ad89c98 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:26.530382 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cd77e664-b0bb-4d26-b8ea-a6526ad89c98 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:26.531689 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cd77e664-b0bb-4d26-b8ea-a6526ad89c98 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:26.534021 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cd77e664-b0bb-4d26-b8ea-a6526ad89c98 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:26.897613 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cd77e664-b0bb-4d26-b8ea-a6526ad89c98 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:26.921161 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cd77e664-b0bb-4d26-b8ea-a6526ad89c98 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1364 microversion: 2.1 time: 0.450028 Jul 18 02:50:26.923722 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2414/4822] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:26 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1364 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:27.944492 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-537fdda2-f1e1-4430-b845-75df6c67c163 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:27.950207 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-537fdda2-f1e1-4430-b845-75df6c67c163 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:27.971769 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-537fdda2-f1e1-4430-b845-75df6c67c163 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:27.980020 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-537fdda2-f1e1-4430-b845-75df6c67c163 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:27.982768 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-537fdda2-f1e1-4430-b845-75df6c67c163 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:27.986603 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-537fdda2-f1e1-4430-b845-75df6c67c163 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:28.276869 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-537fdda2-f1e1-4430-b845-75df6c67c163 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:28.295591 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-537fdda2-f1e1-4430-b845-75df6c67c163 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1364 microversion: 2.1 time: 0.357502 Jul 18 02:50:28.296704 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2409/4823] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:27 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1364 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:29.217574 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-fb67ab98-1d6f-4177-9ffb-d207d4b93146 req-c0ce410f-672a-409c-9d90-86543001bc99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69bbb844-4d56-4e75-ae50-9c35c9ce6f9e", "name": "network-vif-plugged", "status": "completed", "tag": "d926d5af-f867-44cd-8b60-abb0339ecf2a"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:50:29.226478 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-fb67ab98-1d6f-4177-9ffb-d207d4b93146 req-c0ce410f-672a-409c-9d90-86543001bc99 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:29.226832 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-fb67ab98-1d6f-4177-9ffb-d207d4b93146 req-c0ce410f-672a-409c-9d90-86543001bc99 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:29.250550 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-fb67ab98-1d6f-4177-9ffb-d207d4b93146 req-c0ce410f-672a-409c-9d90-86543001bc99 service nova] Creating event network-vif-plugged:d926d5af-f867-44cd-8b60-abb0339ecf2a for instance 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e on n-h2-465891-3 Jul 18 02:50:29.257138 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-fb67ab98-1d6f-4177-9ffb-d207d4b93146 req-c0ce410f-672a-409c-9d90-86543001bc99 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.400105 Jul 18 02:50:29.257681 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2415/4824] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:50:29.331843 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-01e737a5-21dc-4b28-9cc1-3f97b5cb5e83 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:29.332678 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-01e737a5-21dc-4b28-9cc1-3f97b5cb5e83 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:29.349124 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-01e737a5-21dc-4b28-9cc1-3f97b5cb5e83 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:29.349124 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-01e737a5-21dc-4b28-9cc1-3f97b5cb5e83 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:29.350416 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-01e737a5-21dc-4b28-9cc1-3f97b5cb5e83 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:29.351246 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-01e737a5-21dc-4b28-9cc1-3f97b5cb5e83 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:29.673291 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-01e737a5-21dc-4b28-9cc1-3f97b5cb5e83 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:29.690481 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-01e737a5-21dc-4b28-9cc1-3f97b5cb5e83 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1364 microversion: 2.1 time: 0.365996 Jul 18 02:50:29.692089 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2410/4825] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:29 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1364 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:30.722587 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4db4c45a-c4e8-467f-a92c-bd93c588c612 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:30.723912 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4db4c45a-c4e8-467f-a92c-bd93c588c612 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:30.738700 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4db4c45a-c4e8-467f-a92c-bd93c588c612 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:30.739852 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4db4c45a-c4e8-467f-a92c-bd93c588c612 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:30.740955 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4db4c45a-c4e8-467f-a92c-bd93c588c612 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:30.741845 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4db4c45a-c4e8-467f-a92c-bd93c588c612 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:31.068791 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4db4c45a-c4e8-467f-a92c-bd93c588c612 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:31.090720 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4db4c45a-c4e8-467f-a92c-bd93c588c612 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1364 microversion: 2.1 time: 0.376355 Jul 18 02:50:31.092702 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2416/4826] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:30 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1364 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:32.127246 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1fb33b3d-1c05-450f-a7af-2611cc240afa tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:32.130837 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1fb33b3d-1c05-450f-a7af-2611cc240afa tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:32.144468 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:50:32.170172 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1fb33b3d-1c05-450f-a7af-2611cc240afa tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:32.171074 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1fb33b3d-1c05-450f-a7af-2611cc240afa tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:32.172577 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1fb33b3d-1c05-450f-a7af-2611cc240afa tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:32.173421 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1fb33b3d-1c05-450f-a7af-2611cc240afa tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:32.601210 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1fb33b3d-1c05-450f-a7af-2611cc240afa tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:32.612206 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1fb33b3d-1c05-450f-a7af-2611cc240afa tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1551 microversion: 2.1 time: 0.497355 Jul 18 02:50:32.626184 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2411/4827] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:32 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1551 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:32.634152 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-35bd8739-67e9-4019-a748-ac81eba5a37b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:32.635601 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-35bd8739-67e9-4019-a748-ac81eba5a37b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:32.653876 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-35bd8739-67e9-4019-a748-ac81eba5a37b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:32.667038 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-35bd8739-67e9-4019-a748-ac81eba5a37b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:32.669963 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-35bd8739-67e9-4019-a748-ac81eba5a37b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:32.669963 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-35bd8739-67e9-4019-a748-ac81eba5a37b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:32.825008 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-35bd8739-67e9-4019-a748-ac81eba5a37b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.197712 Jul 18 02:50:32.826171 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2417/4828] 10.222.0.57 () {58 vars in 1274 bytes} [Mon Jul 18 02:50:32 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e/os-interface => generated 284 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:50:35.087602 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-42f58ed8-8237-4a5a-a137-64bc6c1136e1 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:35.094604 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-42f58ed8-8237-4a5a-a137-64bc6c1136e1 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: dfa2f044-9f51-44f9-a87a-1f114d90e7d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:35.113799 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-42f58ed8-8237-4a5a-a137-64bc6c1136e1 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:35.114419 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-42f58ed8-8237-4a5a-a137-64bc6c1136e1 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:35.123045 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-42f58ed8-8237-4a5a-a137-64bc6c1136e1 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:35.123875 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-42f58ed8-8237-4a5a-a137-64bc6c1136e1 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:35.248004 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6e23f0a4-91b2-48ad-adcb-057c5bc852fb tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:50:35.249034 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6e23f0a4-91b2-48ad-adcb-057c5bc852fb tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:35.265556 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e23f0a4-91b2-48ad-adcb-057c5bc852fb tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:35.266063 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e23f0a4-91b2-48ad-adcb-057c5bc852fb tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:35.266930 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e23f0a4-91b2-48ad-adcb-057c5bc852fb tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:35.267323 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e23f0a4-91b2-48ad-adcb-057c5bc852fb tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:35.269566 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-42f58ed8-8237-4a5a-a137-64bc6c1136e1 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lazy-loading 'services' on Instance uuid dfa2f044-9f51-44f9-a87a-1f114d90e7d4 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:50:35.375970 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6e23f0a4-91b2-48ad-adcb-057c5bc852fb tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "POST /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9/action" status: 200 len: 24581 microversion: 2.1 time: 0.134163 Jul 18 02:50:35.377138 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2418/4829] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:50:35 2022] POST /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9/action => generated 24581 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 02:50:35.387962 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-8ea9a8ab-5d57-4da6-aee7-a4674ab95dbe req-8e06a760-42e3-4e0d-8ca5-f2406beb0930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69bbb844-4d56-4e75-ae50-9c35c9ce6f9e", "tag": "d926d5af-f867-44cd-8b60-abb0339ecf2a"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:50:35.401289 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-8ea9a8ab-5d57-4da6-aee7-a4674ab95dbe req-8e06a760-42e3-4e0d-8ca5-f2406beb0930 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:35.401837 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-8ea9a8ab-5d57-4da6-aee7-a4674ab95dbe req-8e06a760-42e3-4e0d-8ca5-f2406beb0930 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:35.409878 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-42f58ed8-8237-4a5a-a137-64bc6c1136e1 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "DELETE /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4/os-volume_attachments/59fbe648-dd61-4681-9faf-6d51e1214631" status: 202 len: 0 microversion: 2.1 time: 0.334320 Jul 18 02:50:35.415021 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2412/4830] 10.222.0.57 () {58 vars in 1415 bytes} [Mon Jul 18 02:50:35 2022] DELETE /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4/os-volume_attachments/59fbe648-dd61-4681-9faf-6d51e1214631 => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:50:35.428500 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-62b55d1b-c0e9-43a7-b2c2-7dfce9ba3ccd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:35.432541 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-62b55d1b-c0e9-43a7-b2c2-7dfce9ba3ccd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: dfa2f044-9f51-44f9-a87a-1f114d90e7d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:35.443549 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-62b55d1b-c0e9-43a7-b2c2-7dfce9ba3ccd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:35.444200 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-62b55d1b-c0e9-43a7-b2c2-7dfce9ba3ccd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:35.447078 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-62b55d1b-c0e9-43a7-b2c2-7dfce9ba3ccd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:35.449134 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-62b55d1b-c0e9-43a7-b2c2-7dfce9ba3ccd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:35.449371 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-8ea9a8ab-5d57-4da6-aee7-a4674ab95dbe req-8e06a760-42e3-4e0d-8ca5-f2406beb0930 service nova] Creating event network-changed:d926d5af-f867-44cd-8b60-abb0339ecf2a for instance 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e on n-h2-465891-3 Jul 18 02:50:35.458822 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-8ea9a8ab-5d57-4da6-aee7-a4674ab95dbe req-8e06a760-42e3-4e0d-8ca5-f2406beb0930 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079358 Jul 18 02:50:35.459881 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2419/4831] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:50:35.564048 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-62b55d1b-c0e9-43a7-b2c2-7dfce9ba3ccd tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147481 Jul 18 02:50:35.575252 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2413/4832] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:50:35 2022] GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:50:36.578593 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b404c0d4-d304-47d5-a2bd-0c25c362992a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:36.581520 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b404c0d4-d304-47d5-a2bd-0c25c362992a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: dfa2f044-9f51-44f9-a87a-1f114d90e7d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:36.601998 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b404c0d4-d304-47d5-a2bd-0c25c362992a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:36.605962 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b404c0d4-d304-47d5-a2bd-0c25c362992a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:36.609019 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b404c0d4-d304-47d5-a2bd-0c25c362992a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:36.610026 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b404c0d4-d304-47d5-a2bd-0c25c362992a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:36.702977 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b404c0d4-d304-47d5-a2bd-0c25c362992a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131330 Jul 18 02:50:36.704333 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2420/4833] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:50:36 2022] GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:50:37.716724 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a4f79897-7910-4e68-9850-c8562e83a423 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:37.717791 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a4f79897-7910-4e68-9850-c8562e83a423 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: dfa2f044-9f51-44f9-a87a-1f114d90e7d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:37.726914 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a4f79897-7910-4e68-9850-c8562e83a423 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:37.729034 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a4f79897-7910-4e68-9850-c8562e83a423 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:37.730485 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a4f79897-7910-4e68-9850-c8562e83a423 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:37.731221 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a4f79897-7910-4e68-9850-c8562e83a423 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:37.743509 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:50:37.795602 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a4f79897-7910-4e68-9850-c8562e83a423 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083279 Jul 18 02:50:37.801418 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2414/4834] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:50:37 2022] GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:50:37.982682 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f158e18b-23b4-4d12-bb9b-99f121b67c58 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:37.984079 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f158e18b-23b4-4d12-bb9b-99f121b67c58 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 3dc82011-e895-461b-97a4-8c6ce6d88ec7] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:38.002138 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f158e18b-23b4-4d12-bb9b-99f121b67c58 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:38.003093 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f158e18b-23b4-4d12-bb9b-99f121b67c58 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:38.005015 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f158e18b-23b4-4d12-bb9b-99f121b67c58 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:38.005771 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f158e18b-23b4-4d12-bb9b-99f121b67c58 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:38.113619 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-f158e18b-23b4-4d12-bb9b-99f121b67c58 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lazy-loading 'services' on Instance uuid 3dc82011-e895-461b-97a4-8c6ce6d88ec7 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:50:38.228394 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f158e18b-23b4-4d12-bb9b-99f121b67c58 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3dc82011-e895-461b-97a4-8c6ce6d88ec7/os-volume_attachments/15628c00-af7c-4d1b-a698-9096295ca946" status: 202 len: 0 microversion: 2.1 time: 0.250664 Jul 18 02:50:38.229771 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2421/4835] 10.222.0.57 () {58 vars in 1415 bytes} [Mon Jul 18 02:50:37 2022] DELETE /compute/v2.1/servers/3dc82011-e895-461b-97a4-8c6ce6d88ec7/os-volume_attachments/15628c00-af7c-4d1b-a698-9096295ca946 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:50:38.812849 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d73ea14c-9bfd-4719-b0e8-c7f4c9c3ae0d tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:38.814570 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d73ea14c-9bfd-4719-b0e8-c7f4c9c3ae0d tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: dfa2f044-9f51-44f9-a87a-1f114d90e7d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:38.838468 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d73ea14c-9bfd-4719-b0e8-c7f4c9c3ae0d tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:38.840516 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d73ea14c-9bfd-4719-b0e8-c7f4c9c3ae0d tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:38.842953 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d73ea14c-9bfd-4719-b0e8-c7f4c9c3ae0d tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:38.843409 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d73ea14c-9bfd-4719-b0e8-c7f4c9c3ae0d tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:38.917111 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d73ea14c-9bfd-4719-b0e8-c7f4c9c3ae0d tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111650 Jul 18 02:50:38.919587 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2415/4836] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:50:38 2022] GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:50:39.938357 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6fe94a42-ef69-4c91-9193-1b5c0ec74f1f tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:39.941472 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6fe94a42-ef69-4c91-9193-1b5c0ec74f1f tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: dfa2f044-9f51-44f9-a87a-1f114d90e7d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:39.946987 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=34 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:50:39.958259 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6fe94a42-ef69-4c91-9193-1b5c0ec74f1f tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:39.959504 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6fe94a42-ef69-4c91-9193-1b5c0ec74f1f tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:39.961311 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6fe94a42-ef69-4c91-9193-1b5c0ec74f1f tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:39.962581 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6fe94a42-ef69-4c91-9193-1b5c0ec74f1f tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:40.033163 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6fe94a42-ef69-4c91-9193-1b5c0ec74f1f tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102950 Jul 18 02:50:40.034791 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2422/4837] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:50:39 2022] GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:50:41.048067 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2ab60d9e-359e-48c6-857b-b1dd3e133c93 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:41.049837 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2ab60d9e-359e-48c6-857b-b1dd3e133c93 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: dfa2f044-9f51-44f9-a87a-1f114d90e7d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:41.068291 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ab60d9e-359e-48c6-857b-b1dd3e133c93 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:41.070805 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ab60d9e-359e-48c6-857b-b1dd3e133c93 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:41.073518 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ab60d9e-359e-48c6-857b-b1dd3e133c93 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:41.074483 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ab60d9e-359e-48c6-857b-b1dd3e133c93 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:41.157561 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2ab60d9e-359e-48c6-857b-b1dd3e133c93 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112094 Jul 18 02:50:41.158391 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2416/4838] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:50:41 2022] GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:50:42.175737 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6c2e7788-1675-4433-9ddd-fa7b8981463f tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:42.178154 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6c2e7788-1675-4433-9ddd-fa7b8981463f tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: dfa2f044-9f51-44f9-a87a-1f114d90e7d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:42.192015 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6c2e7788-1675-4433-9ddd-fa7b8981463f tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:42.192847 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6c2e7788-1675-4433-9ddd-fa7b8981463f tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:42.194441 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6c2e7788-1675-4433-9ddd-fa7b8981463f tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:42.196148 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6c2e7788-1675-4433-9ddd-fa7b8981463f tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:42.258100 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6c2e7788-1675-4433-9ddd-fa7b8981463f tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090171 Jul 18 02:50:42.259997 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2423/4839] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:50:42 2022] GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:50:43.280433 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ed183625-f2bc-4336-8da9-2f0c7babfbd8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:43.285935 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ed183625-f2bc-4336-8da9-2f0c7babfbd8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: dfa2f044-9f51-44f9-a87a-1f114d90e7d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:43.303501 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ed183625-f2bc-4336-8da9-2f0c7babfbd8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:43.305780 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ed183625-f2bc-4336-8da9-2f0c7babfbd8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:43.307912 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ed183625-f2bc-4336-8da9-2f0c7babfbd8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:43.308654 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ed183625-f2bc-4336-8da9-2f0c7babfbd8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:43.372364 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ed183625-f2bc-4336-8da9-2f0c7babfbd8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.102215 Jul 18 02:50:43.373293 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2417/4840] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:50:43 2022] GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4/os-volume_attachments => generated 25 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:50:43.581941 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fa2b476b-1e43-4730-82b9-3be7772bd17a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:43.589972 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fa2b476b-1e43-4730-82b9-3be7772bd17a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: dfa2f044-9f51-44f9-a87a-1f114d90e7d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:43.610530 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fa2b476b-1e43-4730-82b9-3be7772bd17a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:43.611938 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fa2b476b-1e43-4730-82b9-3be7772bd17a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:43.613441 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fa2b476b-1e43-4730-82b9-3be7772bd17a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:43.614691 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fa2b476b-1e43-4730-82b9-3be7772bd17a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:43.687635 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fa2b476b-1e43-4730-82b9-3be7772bd17a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: dfa2f044-9f51-44f9-a87a-1f114d90e7d4] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:50:43.902330 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fa2b476b-1e43-4730-82b9-3be7772bd17a tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "DELETE /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4" status: 204 len: 0 microversion: 2.1 time: 0.339698 Jul 18 02:50:43.903864 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2424/4841] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:50:43 2022] DELETE /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:50:43.935099 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bf94290f-8f5a-4e8d-b15c-da441f050478 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:43.936057 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bf94290f-8f5a-4e8d-b15c-da441f050478 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: dfa2f044-9f51-44f9-a87a-1f114d90e7d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:43.949207 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bf94290f-8f5a-4e8d-b15c-da441f050478 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:43.949735 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bf94290f-8f5a-4e8d-b15c-da441f050478 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:43.950626 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bf94290f-8f5a-4e8d-b15c-da441f050478 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:43.951076 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bf94290f-8f5a-4e8d-b15c-da441f050478 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:44.250827 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bf94290f-8f5a-4e8d-b15c-da441f050478 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:44.269903 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bf94290f-8f5a-4e8d-b15c-da441f050478 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4" status: 200 len: 1682 microversion: 2.1 time: 0.357654 Jul 18 02:50:44.271199 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2418/4842] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:43 2022] GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4 => generated 1682 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:45.299792 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1c748bc6-978e-4a00-a159-e5564e4c8c15 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:45.301872 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1c748bc6-978e-4a00-a159-e5564e4c8c15 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: dfa2f044-9f51-44f9-a87a-1f114d90e7d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:45.315827 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c748bc6-978e-4a00-a159-e5564e4c8c15 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:45.316473 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c748bc6-978e-4a00-a159-e5564e4c8c15 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:45.317832 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c748bc6-978e-4a00-a159-e5564e4c8c15 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:45.318838 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c748bc6-978e-4a00-a159-e5564e4c8c15 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:45.640269 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1c748bc6-978e-4a00-a159-e5564e4c8c15 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:45.658744 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1c748bc6-978e-4a00-a159-e5564e4c8c15 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4" status: 200 len: 1682 microversion: 2.1 time: 0.365440 Jul 18 02:50:45.659586 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2425/4843] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:45 2022] GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4 => generated 1682 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:46.369737 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c8fa2f0d-e040-4d15-bdda-94e4efb6f7e3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1985665195", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "a212f305-dd5d-4e4d-86cd-65b986c4ba18", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "ba77f5bb-f255-444f-9bd1-1e3dbe42d430"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:50:46.468628 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-c8fa2f0d-e040-4d15-bdda-94e4efb6f7e3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] validate_networks() for [('ba77f5bb-f255-444f-9bd1-1e3dbe42d430', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:50:46.687983 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-446705fa-26e1-4e48-bcdb-9db62c1350af tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:46.689525 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-446705fa-26e1-4e48-bcdb-9db62c1350af tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: dfa2f044-9f51-44f9-a87a-1f114d90e7d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:46.699455 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-446705fa-26e1-4e48-bcdb-9db62c1350af tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:46.700188 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-446705fa-26e1-4e48-bcdb-9db62c1350af tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:46.701183 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-446705fa-26e1-4e48-bcdb-9db62c1350af tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:46.701836 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-446705fa-26e1-4e48-bcdb-9db62c1350af tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:47.379990 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-446705fa-26e1-4e48-bcdb-9db62c1350af tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:47.391024 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-446705fa-26e1-4e48-bcdb-9db62c1350af tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4" status: 200 len: 1682 microversion: 2.1 time: 0.707410 Jul 18 02:50:47.391687 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2426/4844] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:46 2022] GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4 => generated 1682 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:50:47.777846 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-c8fa2f0d-e040-4d15-bdda-94e4efb6f7e3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:50:47.778670 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-c8fa2f0d-e040-4d15-bdda-94e4efb6f7e3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:50:47.779189 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-c8fa2f0d-e040-4d15-bdda-94e4efb6f7e3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:50:47.779938 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-c8fa2f0d-e040-4d15-bdda-94e4efb6f7e3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:50:47.780426 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-c8fa2f0d-e040-4d15-bdda-94e4efb6f7e3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:50:47.799081 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c8fa2f0d-e040-4d15-bdda-94e4efb6f7e3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:47.800203 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c8fa2f0d-e040-4d15-bdda-94e4efb6f7e3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:47.801927 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c8fa2f0d-e040-4d15-bdda-94e4efb6f7e3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:47.802806 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c8fa2f0d-e040-4d15-bdda-94e4efb6f7e3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:47.850365 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-c8fa2f0d-e040-4d15-bdda-94e4efb6f7e3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Getting quotas for project 2b7654e273f6487ba83382da4f96056d. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:50:47.866347 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-c8fa2f0d-e040-4d15-bdda-94e4efb6f7e3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Getting quotas for user d1afc1702f8045a396b98e5c24b124e7 and project 2b7654e273f6487ba83382da4f96056d. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:50:48.012135 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c8fa2f0d-e040-4d15-bdda-94e4efb6f7e3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:50:48.016749 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c8fa2f0d-e040-4d15-bdda-94e4efb6f7e3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a212f305-dd5d-4e4d-86cd-65b986c4ba18',volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:50:48.209790 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-03435d87-71fd-472a-882e-be120ac05b18 req-7e9d7752-ed74-49e3-8905-2746a6ae9061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfa2f044-9f51-44f9-a87a-1f114d90e7d4", "name": "network-vif-deleted", "tag": "783eed5b-39aa-46d8-8be0-a1006eaaf5de"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:50:48.236770 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-03435d87-71fd-472a-882e-be120ac05b18 req-7e9d7752-ed74-49e3-8905-2746a6ae9061 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:48.238575 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-03435d87-71fd-472a-882e-be120ac05b18 req-7e9d7752-ed74-49e3-8905-2746a6ae9061 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:48.250706 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:50:48.267693 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-03435d87-71fd-472a-882e-be120ac05b18 req-7e9d7752-ed74-49e3-8905-2746a6ae9061 service nova] Creating event network-vif-deleted:783eed5b-39aa-46d8-8be0-a1006eaaf5de for instance dfa2f044-9f51-44f9-a87a-1f114d90e7d4 on n-h1-465891-3 Jul 18 02:50:48.279836 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-03435d87-71fd-472a-882e-be120ac05b18 req-7e9d7752-ed74-49e3-8905-2746a6ae9061 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074175 Jul 18 02:50:48.282456 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2427/4845] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:50:48.423410 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-eeb86405-2ba7-4a2c-b2a5-4a664451099b tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:48.425865 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-eeb86405-2ba7-4a2c-b2a5-4a664451099b tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: dfa2f044-9f51-44f9-a87a-1f114d90e7d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:48.436697 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eeb86405-2ba7-4a2c-b2a5-4a664451099b tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:48.438258 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eeb86405-2ba7-4a2c-b2a5-4a664451099b tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:48.439925 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eeb86405-2ba7-4a2c-b2a5-4a664451099b tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:48.440675 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eeb86405-2ba7-4a2c-b2a5-4a664451099b tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:48.486068 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c8fa2f0d-e040-4d15-bdda-94e4efb6f7e3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.123915 Jul 18 02:50:48.494437 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2419/4846] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:50:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2132 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:50:48.507617 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a3866e90-f8b2-47d5-b19a-79a8cdae35ac tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:48.511923 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a3866e90-f8b2-47d5-b19a-79a8cdae35ac tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:48.535791 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eeb86405-2ba7-4a2c-b2a5-4a664451099b tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:48.538793 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eeb86405-2ba7-4a2c-b2a5-4a664451099b tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:48.541895 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-eeb86405-2ba7-4a2c-b2a5-4a664451099b tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lazy-loading 'fault' on Instance uuid dfa2f044-9f51-44f9-a87a-1f114d90e7d4 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:50:48.695886 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-eeb86405-2ba7-4a2c-b2a5-4a664451099b tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be686f2aa93473585ca064041bd8140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa714ec7f5a4af0a33f56b45e999a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:48.720064 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-eeb86405-2ba7-4a2c-b2a5-4a664451099b tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4" status: 200 len: 1332 microversion: 2.1 time: 0.300518 Jul 18 02:50:48.723503 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2428/4847] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:48 2022] GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4 => generated 1332 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:50:48.744901 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a3866e90-f8b2-47d5-b19a-79a8cdae35ac tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:48.757753 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a3866e90-f8b2-47d5-b19a-79a8cdae35ac tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799" status: 200 len: 1071 microversion: 2.1 time: 0.255196 Jul 18 02:50:48.772348 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2420/4848] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:48 2022] GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799 => generated 1071 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:49.659854 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c68ce4b7-2546-4290-8847-4c35ff7ce0ba tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:49.659854 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c68ce4b7-2546-4290-8847-4c35ff7ce0ba tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 3dc82011-e895-461b-97a4-8c6ce6d88ec7] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:49.670586 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c68ce4b7-2546-4290-8847-4c35ff7ce0ba tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:49.671250 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c68ce4b7-2546-4290-8847-4c35ff7ce0ba tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:49.672203 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c68ce4b7-2546-4290-8847-4c35ff7ce0ba tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:49.672654 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c68ce4b7-2546-4290-8847-4c35ff7ce0ba tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:49.718467 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c68ce4b7-2546-4290-8847-4c35ff7ce0ba tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 3dc82011-e895-461b-97a4-8c6ce6d88ec7] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:50:49.744050 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8f37d514-fd8b-49c9-bfa9-1a6e94b5056e tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:49.745112 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8f37d514-fd8b-49c9-bfa9-1a6e94b5056e tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: dfa2f044-9f51-44f9-a87a-1f114d90e7d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:49.763376 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8f37d514-fd8b-49c9-bfa9-1a6e94b5056e tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:49.764037 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8f37d514-fd8b-49c9-bfa9-1a6e94b5056e tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:49.765013 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8f37d514-fd8b-49c9-bfa9-1a6e94b5056e tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:49.765621 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8f37d514-fd8b-49c9-bfa9-1a6e94b5056e tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:49.792245 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-8f37d514-fd8b-49c9-bfa9-1a6e94b5056e tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] HTTP exception thrown: Instance dfa2f044-9f51-44f9-a87a-1f114d90e7d4 could not be found. Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8f37d514-fd8b-49c9-bfa9-1a6e94b5056e tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Request method failure captured: Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4 HTTP/1.1 Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MhfM0UyOyoMgRP_1BgsB5GQEFaLnp85satKIE74LtU4aati7wjZItAybGxqrHGu9HKZ07IOl-ghvuL-XVY7iiNLxZrz8uz6pnetXMm39fDBZo0QiKDc9Xu-2OCp3obDb_4yxslV3N-dd0oIabggtRNHi18D28MbZyTc-9xFAnMfxLs Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 8fa714ec7f5a4af0a33f56b45e999a7a Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-AttachVolumeNegativeTest-683705837 Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8fa714ec7f5a4af0a33f56b45e999a7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fa714ec7f5a4af0a33f56b45e999a7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fa714ec7f5a4af0a33f56b45e999a7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8fa714ec7f5a4af0a33f56b45e999a7a"}]}] Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-AttachVolumeNegativeTest-683705837 Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 8fa714ec7f5a4af0a33f56b45e999a7a Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-683705837 Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-AttachVolumeNegativeTest-683705837-project Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 1be686f2aa93473585ca064041bd8140 Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-AttachVolumeNegativeTest-683705837-project Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance dfa2f044-9f51-44f9-a87a-1f114d90e7d4 could not be found. Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'dfa2f044-9f51-44f9-a87a-1f114d90e7d4'} Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfa2f044-9f51-44f9-a87a-1f114d90e7d4 could not be found. Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfa2f044-9f51-44f9-a87a-1f114d90e7d4 could not be found. Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:50:49.797286 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:50:49.808669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:50:49.808669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:50:49.808669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:50:49.808669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:50:49.808669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:50:49.808669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfa2f044-9f51-44f9-a87a-1f114d90e7d4 could not be found. Jul 18 02:50:49.808669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:50:49.808669 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8f37d514-fd8b-49c9-bfa9-1a6e94b5056e tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Returning 404 to user: Instance dfa2f044-9f51-44f9-a87a-1f114d90e7d4 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:50:49.808669 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8f37d514-fd8b-49c9-bfa9-1a6e94b5056e tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4" status: 404 len: 111 microversion: 2.1 time: 0.062615 Jul 18 02:50:49.808669 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2421/4849] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:49 2022] GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:50:49.817015 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6b789d85-8a8b-4b5e-9b64-8add345d69db tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:49.820972 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6b789d85-8a8b-4b5e-9b64-8add345d69db tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:49.832660 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b789d85-8a8b-4b5e-9b64-8add345d69db tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:49.834421 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b789d85-8a8b-4b5e-9b64-8add345d69db tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:49.835278 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c68ce4b7-2546-4290-8847-4c35ff7ce0ba tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3dc82011-e895-461b-97a4-8c6ce6d88ec7" status: 204 len: 0 microversion: 2.1 time: 0.180073 Jul 18 02:50:49.835903 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b789d85-8a8b-4b5e-9b64-8add345d69db tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:49.836550 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b789d85-8a8b-4b5e-9b64-8add345d69db tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:49.843821 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2429/4850] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:50:49 2022] DELETE /compute/v2.1/servers/3dc82011-e895-461b-97a4-8c6ce6d88ec7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:50:49.848046 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-eea1f2b6-09a1-49e1-be40-2b0ce616f04b tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '.version_select at 0x7ff49b63e430>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:49.877091 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-eea1f2b6-09a1-49e1-be40-2b0ce616f04b tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1176862568" status: 202 len: 0 microversion: 2.1 time: 0.037532 Jul 18 02:50:49.877814 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2430/4851] 10.222.0.57 () {58 vars in 1220 bytes} [Mon Jul 18 02:50:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1176862568 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:50:49.886464 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0775d663-243d-47e7-b907-92a2000bec01 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:49.888274 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0775d663-243d-47e7-b907-92a2000bec01 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 3dc82011-e895-461b-97a4-8c6ce6d88ec7] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:49.900124 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0775d663-243d-47e7-b907-92a2000bec01 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:49.901055 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0775d663-243d-47e7-b907-92a2000bec01 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:49.902652 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0775d663-243d-47e7-b907-92a2000bec01 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:49.903544 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0775d663-243d-47e7-b907-92a2000bec01 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:50.135113 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6b789d85-8a8b-4b5e-9b64-8add345d69db tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:50.158009 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6b789d85-8a8b-4b5e-9b64-8add345d69db tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799" status: 200 len: 1169 microversion: 2.1 time: 0.348905 Jul 18 02:50:50.159723 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2422/4852] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:49 2022] GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799 => generated 1169 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:50.502316 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0775d663-243d-47e7-b907-92a2000bec01 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949d2267438542afaa92a261f25acef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a114c5309447bb74cd37c180b749d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:50.511710 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0775d663-243d-47e7-b907-92a2000bec01 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] 10.222.0.57 "GET /compute/v2.1/servers/3dc82011-e895-461b-97a4-8c6ce6d88ec7" status: 200 len: 1513 microversion: 2.1 time: 0.632741 Jul 18 02:50:50.523587 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2431/4853] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:49 2022] GET /compute/v2.1/servers/3dc82011-e895-461b-97a4-8c6ce6d88ec7 => generated 1513 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:50.670461 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-42440212-09ce-417b-ac89-e4bb77e21488 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:50.671809 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-42440212-09ce-417b-ac89-e4bb77e21488 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:50.687609 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-42440212-09ce-417b-ac89-e4bb77e21488 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:50.691153 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-42440212-09ce-417b-ac89-e4bb77e21488 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:50.693020 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-42440212-09ce-417b-ac89-e4bb77e21488 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:50.694624 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-42440212-09ce-417b-ac89-e4bb77e21488 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:50.883857 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-42440212-09ce-417b-ac89-e4bb77e21488 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lazy-loading 'services' on Instance uuid 7a7139b7-9d69-45b0-a6bf-470376bdb9c5 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:50:51.059455 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-42440212-09ce-417b-ac89-e4bb77e21488 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5/os-volume_attachments/b62e32a1-decd-4564-81fe-880c62031b05" status: 202 len: 0 microversion: 2.1 time: 0.402819 Jul 18 02:50:51.060578 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2423/4854] 10.222.0.57 () {58 vars in 1415 bytes} [Mon Jul 18 02:50:50 2022] DELETE /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5/os-volume_attachments/b62e32a1-decd-4564-81fe-880c62031b05 => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:50:51.195500 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b86ca180-92b8-4dad-bb2c-b18aad2f4d15 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:51.196593 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b86ca180-92b8-4dad-bb2c-b18aad2f4d15 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:51.243512 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b86ca180-92b8-4dad-bb2c-b18aad2f4d15 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:51.244289 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b86ca180-92b8-4dad-bb2c-b18aad2f4d15 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:51.259155 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b86ca180-92b8-4dad-bb2c-b18aad2f4d15 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:51.266576 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b86ca180-92b8-4dad-bb2c-b18aad2f4d15 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:51.440898 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b86ca180-92b8-4dad-bb2c-b18aad2f4d15 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:51.467032 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b86ca180-92b8-4dad-bb2c-b18aad2f4d15 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799" status: 200 len: 1187 microversion: 2.1 time: 0.281239 Jul 18 02:50:51.491198 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2432/4855] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:51 2022] GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799 => generated 1187 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:51.531212 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0b4721bf-7ce8-4b00-bdf4-0a38933e5b6b tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:51.532530 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0b4721bf-7ce8-4b00-bdf4-0a38933e5b6b tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 3dc82011-e895-461b-97a4-8c6ce6d88ec7] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:51.550504 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0b4721bf-7ce8-4b00-bdf4-0a38933e5b6b tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:51.551366 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0b4721bf-7ce8-4b00-bdf4-0a38933e5b6b tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:51.553088 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0b4721bf-7ce8-4b00-bdf4-0a38933e5b6b tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:51.553764 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0b4721bf-7ce8-4b00-bdf4-0a38933e5b6b tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:52.175364 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0b4721bf-7ce8-4b00-bdf4-0a38933e5b6b tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949d2267438542afaa92a261f25acef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a114c5309447bb74cd37c180b749d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:52.188471 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0b4721bf-7ce8-4b00-bdf4-0a38933e5b6b tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] 10.222.0.57 "GET /compute/v2.1/servers/3dc82011-e895-461b-97a4-8c6ce6d88ec7" status: 200 len: 1513 microversion: 2.1 time: 0.661833 Jul 18 02:50:52.206157 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2424/4856] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:51 2022] GET /compute/v2.1/servers/3dc82011-e895-461b-97a4-8c6ce6d88ec7 => generated 1513 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:50:52.498255 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4770ea88-1a68-4d88-b6d6-f01a84559f1d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:52.499785 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4770ea88-1a68-4d88-b6d6-f01a84559f1d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:52.509786 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4770ea88-1a68-4d88-b6d6-f01a84559f1d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:52.510544 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4770ea88-1a68-4d88-b6d6-f01a84559f1d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:52.511588 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4770ea88-1a68-4d88-b6d6-f01a84559f1d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:52.512190 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4770ea88-1a68-4d88-b6d6-f01a84559f1d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:53.089347 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4770ea88-1a68-4d88-b6d6-f01a84559f1d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:53.106801 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-fb6d1713-72d8-40ca-9e78-95b92dcc4e8f req-b676dc91-c6a5-490b-8d86-3ccee50d033d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dc82011-e895-461b-97a4-8c6ce6d88ec7", "name": "network-vif-deleted", "tag": "320ee26c-905d-4500-be2e-9e8590053301"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:50:53.110059 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4770ea88-1a68-4d88-b6d6-f01a84559f1d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799" status: 200 len: 1229 microversion: 2.1 time: 0.616056 Jul 18 02:50:53.112454 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2433/4857] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:52 2022] GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799 => generated 1229 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:50:53.127163 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-fb6d1713-72d8-40ca-9e78-95b92dcc4e8f req-b676dc91-c6a5-490b-8d86-3ccee50d033d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:53.127629 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-fb6d1713-72d8-40ca-9e78-95b92dcc4e8f req-b676dc91-c6a5-490b-8d86-3ccee50d033d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:53.149408 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-fb6d1713-72d8-40ca-9e78-95b92dcc4e8f req-b676dc91-c6a5-490b-8d86-3ccee50d033d service nova] Creating event network-vif-deleted:320ee26c-905d-4500-be2e-9e8590053301 for instance 3dc82011-e895-461b-97a4-8c6ce6d88ec7 on n-h2-465891-3 Jul 18 02:50:53.156564 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-fb6d1713-72d8-40ca-9e78-95b92dcc4e8f req-b676dc91-c6a5-490b-8d86-3ccee50d033d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053252 Jul 18 02:50:53.157812 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2425/4858] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:50:53.218636 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5d24b84c-b16d-437a-9b5e-1568d535fe97 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:53.220194 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5d24b84c-b16d-437a-9b5e-1568d535fe97 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 3dc82011-e895-461b-97a4-8c6ce6d88ec7] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:53.238621 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5d24b84c-b16d-437a-9b5e-1568d535fe97 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:53.239493 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5d24b84c-b16d-437a-9b5e-1568d535fe97 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:53.241460 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5d24b84c-b16d-437a-9b5e-1568d535fe97 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:53.242420 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5d24b84c-b16d-437a-9b5e-1568d535fe97 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:53.329889 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5d24b84c-b16d-437a-9b5e-1568d535fe97 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:53.330740 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5d24b84c-b16d-437a-9b5e-1568d535fe97 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:53.331699 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-5d24b84c-b16d-437a-9b5e-1568d535fe97 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lazy-loading 'fault' on Instance uuid 3dc82011-e895-461b-97a4-8c6ce6d88ec7 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:50:53.430675 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5d24b84c-b16d-437a-9b5e-1568d535fe97 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949d2267438542afaa92a261f25acef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a114c5309447bb74cd37c180b749d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:53.439356 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5d24b84c-b16d-437a-9b5e-1568d535fe97 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] 10.222.0.57 "GET /compute/v2.1/servers/3dc82011-e895-461b-97a4-8c6ce6d88ec7" status: 200 len: 1309 microversion: 2.1 time: 0.228777 Jul 18 02:50:53.440291 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2434/4859] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:53 2022] GET /compute/v2.1/servers/3dc82011-e895-461b-97a4-8c6ce6d88ec7 => generated 1309 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:54.137977 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b6cdd37b-8b0e-414d-aeaa-9cd2a63b6c73 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:54.139401 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b6cdd37b-8b0e-414d-aeaa-9cd2a63b6c73 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:54.150153 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6cdd37b-8b0e-414d-aeaa-9cd2a63b6c73 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:54.150623 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6cdd37b-8b0e-414d-aeaa-9cd2a63b6c73 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:54.151427 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6cdd37b-8b0e-414d-aeaa-9cd2a63b6c73 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:54.151874 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6cdd37b-8b0e-414d-aeaa-9cd2a63b6c73 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:54.443742 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b6cdd37b-8b0e-414d-aeaa-9cd2a63b6c73 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:54.455439 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b6cdd37b-8b0e-414d-aeaa-9cd2a63b6c73 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799" status: 200 len: 1229 microversion: 2.1 time: 0.323355 Jul 18 02:50:54.457399 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2426/4860] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:54 2022] GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799 => generated 1229 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:54.472397 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9023979c-4ef7-4427-ae0a-1cfb7a3ac1eb tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:54.474593 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9023979c-4ef7-4427-ae0a-1cfb7a3ac1eb tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 3dc82011-e895-461b-97a4-8c6ce6d88ec7] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:54.486918 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9023979c-4ef7-4427-ae0a-1cfb7a3ac1eb tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:54.487776 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9023979c-4ef7-4427-ae0a-1cfb7a3ac1eb tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:54.490310 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9023979c-4ef7-4427-ae0a-1cfb7a3ac1eb tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:54.490999 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9023979c-4ef7-4427-ae0a-1cfb7a3ac1eb tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:54.518923 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-9023979c-4ef7-4427-ae0a-1cfb7a3ac1eb tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] HTTP exception thrown: Instance 3dc82011-e895-461b-97a4-8c6ce6d88ec7 could not be found. Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9023979c-4ef7-4427-ae0a-1cfb7a3ac1eb tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Request method failure captured: Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/3dc82011-e895-461b-97a4-8c6ce6d88ec7 HTTP/1.1 Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MmWg6qwEIQeR5BclkRQ47ET0LK0nIo8C14Lk4Bmf2CenjgqTDEw3DwK_8ewGA-atuL-9Q_FIL6FRTXE8K4laBxYZoZErKRod8vH1w3nB7LpQU8h-BnHdYSt3UE_pSmFg5bCL_O-rsYrxeHrk5BWVz7V9hbVypM_LMShMK88i_GgLqw Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: ed4a114c5309447bb74cd37c180b749d Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-VolumesSnapshotTestJSON-273917156 Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ed4a114c5309447bb74cd37c180b749d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ed4a114c5309447bb74cd37c180b749d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ed4a114c5309447bb74cd37c180b749d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ed4a114c5309447bb74cd37c180b749d"}]}] Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-VolumesSnapshotTestJSON-273917156 Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: ed4a114c5309447bb74cd37c180b749d Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-273917156 Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-VolumesSnapshotTestJSON-273917156-project Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 949d2267438542afaa92a261f25acef7 Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-VolumesSnapshotTestJSON-273917156-project Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 3dc82011-e895-461b-97a4-8c6ce6d88ec7 could not be found. Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '3dc82011-e895-461b-97a4-8c6ce6d88ec7'} Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dc82011-e895-461b-97a4-8c6ce6d88ec7 could not be found. Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dc82011-e895-461b-97a4-8c6ce6d88ec7 could not be found. Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:50:54.522874 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:50:54.532273 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:50:54.532273 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:50:54.532273 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:50:54.532273 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:50:54.532273 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:50:54.532273 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dc82011-e895-461b-97a4-8c6ce6d88ec7 could not be found. Jul 18 02:50:54.532273 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:50:54.532273 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9023979c-4ef7-4427-ae0a-1cfb7a3ac1eb tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Returning 404 to user: Instance 3dc82011-e895-461b-97a4-8c6ce6d88ec7 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:50:54.532273 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9023979c-4ef7-4427-ae0a-1cfb7a3ac1eb tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] 10.222.0.57 "GET /compute/v2.1/servers/3dc82011-e895-461b-97a4-8c6ce6d88ec7" status: 404 len: 111 microversion: 2.1 time: 0.061200 Jul 18 02:50:54.532273 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2435/4861] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:54 2022] GET /compute/v2.1/servers/3dc82011-e895-461b-97a4-8c6ce6d88ec7 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:50:55.176132 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-9651e100-c3bb-48b7-8e2f-ef36f5f9ac51 req-1f8a704b-a5b9-43dc-ac95-c738577bea3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "702e7ce4-6d2d-41a3-97f9-2403df247799", "tag": "58fe3c54-fb57-4229-8be8-50d6596402ed"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:50:55.187440 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-9651e100-c3bb-48b7-8e2f-ef36f5f9ac51 req-1f8a704b-a5b9-43dc-ac95-c738577bea3c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:55.187894 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-9651e100-c3bb-48b7-8e2f-ef36f5f9ac51 req-1f8a704b-a5b9-43dc-ac95-c738577bea3c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:55.201376 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-9651e100-c3bb-48b7-8e2f-ef36f5f9ac51 req-1f8a704b-a5b9-43dc-ac95-c738577bea3c service nova] Creating event network-changed:58fe3c54-fb57-4229-8be8-50d6596402ed for instance 702e7ce4-6d2d-41a3-97f9-2403df247799 on n-h1-465891-3 Jul 18 02:50:55.207335 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-9651e100-c3bb-48b7-8e2f-ef36f5f9ac51 req-1f8a704b-a5b9-43dc-ac95-c738577bea3c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034705 Jul 18 02:50:55.208297 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2427/4862] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:50:55.476686 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4bb90ca8-a0ef-44e9-8850-d296006de4e2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:55.477523 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4bb90ca8-a0ef-44e9-8850-d296006de4e2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:55.485198 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4bb90ca8-a0ef-44e9-8850-d296006de4e2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:55.485831 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4bb90ca8-a0ef-44e9-8850-d296006de4e2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:55.486958 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4bb90ca8-a0ef-44e9-8850-d296006de4e2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:55.487504 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4bb90ca8-a0ef-44e9-8850-d296006de4e2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:55.731001 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4bb90ca8-a0ef-44e9-8850-d296006de4e2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:55.743569 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4bb90ca8-a0ef-44e9-8850-d296006de4e2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799" status: 200 len: 1229 microversion: 2.1 time: 0.273365 Jul 18 02:50:55.744429 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2436/4863] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:55 2022] GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799 => generated 1229 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:56.764352 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2895cced-c797-4972-81cf-fe816ad0ca3b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:56.765183 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2895cced-c797-4972-81cf-fe816ad0ca3b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:56.774317 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2895cced-c797-4972-81cf-fe816ad0ca3b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:56.774778 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2895cced-c797-4972-81cf-fe816ad0ca3b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:56.775594 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2895cced-c797-4972-81cf-fe816ad0ca3b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:56.776041 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2895cced-c797-4972-81cf-fe816ad0ca3b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:56.979792 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2895cced-c797-4972-81cf-fe816ad0ca3b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:56.991452 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2895cced-c797-4972-81cf-fe816ad0ca3b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799" status: 200 len: 1229 microversion: 2.1 time: 0.231472 Jul 18 02:50:56.992153 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2428/4864] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:56 2022] GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799 => generated 1229 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:50:58.010368 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fd129f7e-abe9-411b-87e9-2b074f7dd025 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:58.011000 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fd129f7e-abe9-411b-87e9-2b074f7dd025 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:58.017330 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fd129f7e-abe9-411b-87e9-2b074f7dd025 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:58.018512 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fd129f7e-abe9-411b-87e9-2b074f7dd025 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:58.018682 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fd129f7e-abe9-411b-87e9-2b074f7dd025 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:58.019061 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fd129f7e-abe9-411b-87e9-2b074f7dd025 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:58.078251 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-98be0032-c250-4b68-b9fa-a9b16a502b72 tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:58.079148 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-98be0032-c250-4b68-b9fa-a9b16a502b72 tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:58.082246 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:50:58.090065 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-98be0032-c250-4b68-b9fa-a9b16a502b72 tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:58.090600 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-98be0032-c250-4b68-b9fa-a9b16a502b72 tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:58.091496 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-98be0032-c250-4b68-b9fa-a9b16a502b72 tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:58.092037 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-98be0032-c250-4b68-b9fa-a9b16a502b72 tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:58.257496 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fd129f7e-abe9-411b-87e9-2b074f7dd025 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:58.297043 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-98be0032-c250-4b68-b9fa-a9b16a502b72 tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 200 len: 1833 microversion: 2.1 time: 0.222837 Jul 18 02:50:58.298313 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2429/4865] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:58 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 1833 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:58.302624 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fd129f7e-abe9-411b-87e9-2b074f7dd025 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799" status: 200 len: 1229 microversion: 2.1 time: 0.292760 Jul 18 02:50:58.304036 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2437/4866] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:58 2022] GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799 => generated 1229 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:50:59.331860 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e4d1876b-98a3-4433-95aa-e532e3777f68 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:59.332990 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e4d1876b-98a3-4433-95aa-e532e3777f68 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:59.336005 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=8 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:50:59.346157 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e4d1876b-98a3-4433-95aa-e532e3777f68 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:59.347253 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e4d1876b-98a3-4433-95aa-e532e3777f68 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:59.349833 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e4d1876b-98a3-4433-95aa-e532e3777f68 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:59.351552 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e4d1876b-98a3-4433-95aa-e532e3777f68 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:59.607491 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9a7c6360-ed6e-4802-a771-99773957c07d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:59.608077 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9a7c6360-ed6e-4802-a771-99773957c07d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:59.621652 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9a7c6360-ed6e-4802-a771-99773957c07d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:59.622693 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9a7c6360-ed6e-4802-a771-99773957c07d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:59.624466 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9a7c6360-ed6e-4802-a771-99773957c07d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:59.626632 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9a7c6360-ed6e-4802-a771-99773957c07d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:59.651423 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e4d1876b-98a3-4433-95aa-e532e3777f68 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:59.669249 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e4d1876b-98a3-4433-95aa-e532e3777f68 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799" status: 200 len: 1229 microversion: 2.1 time: 0.341055 Jul 18 02:50:59.670906 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2430/4867] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:59 2022] GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799 => generated 1229 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:50:59.683236 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-f1f7cd4b-5474-41e6-9bf4-c6913215fcae req-cc17701b-30f1-4ae2-9f30-c07cc31e5f77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ce58c09-6319-4fad-ae8a-2b4199edcfd9", "tag": "7f42876f-44b2-4ca5-aea9-aa2f86f8f3ed"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:50:59.687486 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9a7c6360-ed6e-4802-a771-99773957c07d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:50:59.703512 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-f1f7cd4b-5474-41e6-9bf4-c6913215fcae req-cc17701b-30f1-4ae2-9f30-c07cc31e5f77 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:59.704297 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-f1f7cd4b-5474-41e6-9bf4-c6913215fcae req-cc17701b-30f1-4ae2-9f30-c07cc31e5f77 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:59.733730 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-f1f7cd4b-5474-41e6-9bf4-c6913215fcae req-cc17701b-30f1-4ae2-9f30-c07cc31e5f77 service nova] Creating event network-changed:7f42876f-44b2-4ca5-aea9-aa2f86f8f3ed for instance 5ce58c09-6319-4fad-ae8a-2b4199edcfd9 on n-h1-465891-3 Jul 18 02:50:59.745745 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-f1f7cd4b-5474-41e6-9bf4-c6913215fcae req-cc17701b-30f1-4ae2-9f30-c07cc31e5f77 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071878 Jul 18 02:50:59.748054 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2431/4868] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:50:59.853626 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9a7c6360-ed6e-4802-a771-99773957c07d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "DELETE /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 204 len: 0 microversion: 2.1 time: 0.249573 Jul 18 02:50:59.854988 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2438/4869] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:50:59 2022] DELETE /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:50:59.874778 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5f02bdde-3296-42ae-8380-369fbacb9a20 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:59.881641 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5f02bdde-3296-42ae-8380-369fbacb9a20 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:59.900998 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5f02bdde-3296-42ae-8380-369fbacb9a20 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:59.902415 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5f02bdde-3296-42ae-8380-369fbacb9a20 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:59.904153 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5f02bdde-3296-42ae-8380-369fbacb9a20 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:59.905272 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5f02bdde-3296-42ae-8380-369fbacb9a20 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:00.184543 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5f02bdde-3296-42ae-8380-369fbacb9a20 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:00.195422 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5f02bdde-3296-42ae-8380-369fbacb9a20 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 200 len: 1688 microversion: 2.1 time: 0.334067 Jul 18 02:51:00.196049 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2432/4870] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:59 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 1688 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:00.283756 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ab6537d6-44de-4c11-a43f-2ac4c498310e tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:51:00.297016 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ab6537d6-44de-4c11-a43f-2ac4c498310e tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:00.298247 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ab6537d6-44de-4c11-a43f-2ac4c498310e tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:00.348967 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ab6537d6-44de-4c11-a43f-2ac4c498310e tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Going to try to stop instance {{(pid=119543) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 02:51:00.490153 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ab6537d6-44de-4c11-a43f-2ac4c498310e tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "POST /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5/action" status: 202 len: 0 microversion: 2.1 time: 0.213042 Jul 18 02:51:00.497877 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2439/4871] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:51:00 2022] POST /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:51:00.502734 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9798b1ba-b34b-4144-b427-a8d3c5ab0b0e tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:00.503569 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9798b1ba-b34b-4144-b427-a8d3c5ab0b0e tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:00.529539 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9798b1ba-b34b-4144-b427-a8d3c5ab0b0e tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:00.530321 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9798b1ba-b34b-4144-b427-a8d3c5ab0b0e tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:00.531621 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9798b1ba-b34b-4144-b427-a8d3c5ab0b0e tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:00.532461 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9798b1ba-b34b-4144-b427-a8d3c5ab0b0e tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:00.690070 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-07505f97-b0b3-466d-aa1b-2ae35245b391 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:00.691396 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-07505f97-b0b3-466d-aa1b-2ae35245b391 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:00.712355 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-07505f97-b0b3-466d-aa1b-2ae35245b391 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:00.712806 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-07505f97-b0b3-466d-aa1b-2ae35245b391 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:00.713847 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-07505f97-b0b3-466d-aa1b-2ae35245b391 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:00.714478 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-07505f97-b0b3-466d-aa1b-2ae35245b391 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:00.843870 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9798b1ba-b34b-4144-b427-a8d3c5ab0b0e tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:00.858424 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9798b1ba-b34b-4144-b427-a8d3c5ab0b0e tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 200 len: 1721 microversion: 2.1 time: 0.359979 Jul 18 02:51:00.869639 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2433/4872] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:00 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 1721 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:01.116687 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-07505f97-b0b3-466d-aa1b-2ae35245b391 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:01.128763 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-07505f97-b0b3-466d-aa1b-2ae35245b391 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799" status: 200 len: 1229 microversion: 2.1 time: 0.444264 Jul 18 02:51:01.133840 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2440/4873] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:00 2022] GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799 => generated 1229 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:01.222863 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d653998f-9552-47b3-9ed2-939161c11e74 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:01.223560 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d653998f-9552-47b3-9ed2-939161c11e74 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:01.245070 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d653998f-9552-47b3-9ed2-939161c11e74 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:01.245916 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d653998f-9552-47b3-9ed2-939161c11e74 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:01.248181 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d653998f-9552-47b3-9ed2-939161c11e74 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:01.249518 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d653998f-9552-47b3-9ed2-939161c11e74 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:01.297402 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:51:01.693531 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d653998f-9552-47b3-9ed2-939161c11e74 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:01.705447 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d653998f-9552-47b3-9ed2-939161c11e74 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 200 len: 1688 microversion: 2.1 time: 0.486959 Jul 18 02:51:01.706748 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2434/4874] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:01 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 1688 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:51:01.877126 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ebb305f0-9348-436c-b9f7-9cbc371fa097 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:01.878086 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ebb305f0-9348-436c-b9f7-9cbc371fa097 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:01.886164 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ebb305f0-9348-436c-b9f7-9cbc371fa097 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:01.886926 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ebb305f0-9348-436c-b9f7-9cbc371fa097 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:01.887899 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ebb305f0-9348-436c-b9f7-9cbc371fa097 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:01.888536 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ebb305f0-9348-436c-b9f7-9cbc371fa097 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:01.923274 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:51:02.161730 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bc283669-53e5-43f4-903d-b57d867c451f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:02.162368 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bc283669-53e5-43f4-903d-b57d867c451f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:02.181763 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bc283669-53e5-43f4-903d-b57d867c451f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:02.182229 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bc283669-53e5-43f4-903d-b57d867c451f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:02.183130 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bc283669-53e5-43f4-903d-b57d867c451f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:02.183584 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bc283669-53e5-43f4-903d-b57d867c451f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:03.478653 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ebb305f0-9348-436c-b9f7-9cbc371fa097 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:03.498727 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ebb305f0-9348-436c-b9f7-9cbc371fa097 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 200 len: 1675 microversion: 2.1 time: 1.623514 Jul 18 02:51:03.500623 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2441/4875] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:01 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 1675 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:03.516787 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9ff39ba7-5cb4-4a02-8c33-728357a787ac tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:03.518341 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9ff39ba7-5cb4-4a02-8c33-728357a787ac tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:03.532271 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9ff39ba7-5cb4-4a02-8c33-728357a787ac tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:03.534787 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9ff39ba7-5cb4-4a02-8c33-728357a787ac tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:03.539172 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9ff39ba7-5cb4-4a02-8c33-728357a787ac tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:03.556285 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9ff39ba7-5cb4-4a02-8c33-728357a787ac tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:03.681509 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bc283669-53e5-43f4-903d-b57d867c451f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:03.698373 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bc283669-53e5-43f4-903d-b57d867c451f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799" status: 200 len: 1229 microversion: 2.1 time: 1.540749 Jul 18 02:51:03.699003 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2435/4876] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:02 2022] GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799 => generated 1229 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:04.265453 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9ff39ba7-5cb4-4a02-8c33-728357a787ac tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:04.282610 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9ff39ba7-5cb4-4a02-8c33-728357a787ac tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 200 len: 1688 microversion: 2.1 time: 0.779297 Jul 18 02:51:04.283244 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2442/4877] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:03 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 1688 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:04.537461 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3dfe08a3-4a30-43e7-8811-3bbb0c910db8 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:04.538236 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-502906c2-d285-4d3f-b3a5-3257027aa405 req-a7178ea0-bc29-4163-bd91-c9386f3c6990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ce58c09-6319-4fad-ae8a-2b4199edcfd9", "name": "network-vif-deleted", "tag": "7f42876f-44b2-4ca5-aea9-aa2f86f8f3ed"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:51:04.538825 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3dfe08a3-4a30-43e7-8811-3bbb0c910db8 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:04.549369 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-502906c2-d285-4d3f-b3a5-3257027aa405 req-a7178ea0-bc29-4163-bd91-c9386f3c6990 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:04.550162 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-502906c2-d285-4d3f-b3a5-3257027aa405 req-a7178ea0-bc29-4163-bd91-c9386f3c6990 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:04.561413 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:51:04.596635 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3dfe08a3-4a30-43e7-8811-3bbb0c910db8 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:04.597454 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3dfe08a3-4a30-43e7-8811-3bbb0c910db8 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:04.599447 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3dfe08a3-4a30-43e7-8811-3bbb0c910db8 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:04.600234 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3dfe08a3-4a30-43e7-8811-3bbb0c910db8 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:04.602371 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-502906c2-d285-4d3f-b3a5-3257027aa405 req-a7178ea0-bc29-4163-bd91-c9386f3c6990 service nova] Creating event network-vif-deleted:7f42876f-44b2-4ca5-aea9-aa2f86f8f3ed for instance 5ce58c09-6319-4fad-ae8a-2b4199edcfd9 on n-h1-465891-3 Jul 18 02:51:04.608071 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-502906c2-d285-4d3f-b3a5-3257027aa405 req-a7178ea0-bc29-4163-bd91-c9386f3c6990 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076283 Jul 18 02:51:04.613047 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2443/4878] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:51:04.728518 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-29e458f2-b8ad-4bfb-9327-ba35042e994b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:04.728518 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-29e458f2-b8ad-4bfb-9327-ba35042e994b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:04.748589 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-29e458f2-b8ad-4bfb-9327-ba35042e994b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:04.749218 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-29e458f2-b8ad-4bfb-9327-ba35042e994b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:04.750158 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-29e458f2-b8ad-4bfb-9327-ba35042e994b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:04.750700 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-29e458f2-b8ad-4bfb-9327-ba35042e994b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:05.029484 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3dfe08a3-4a30-43e7-8811-3bbb0c910db8 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:05.056458 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3dfe08a3-4a30-43e7-8811-3bbb0c910db8 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 200 len: 1675 microversion: 2.1 time: 0.528477 Jul 18 02:51:05.073765 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2436/4879] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:04 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 1675 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:05.111530 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-29e458f2-b8ad-4bfb-9327-ba35042e994b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:05.122516 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-29e458f2-b8ad-4bfb-9327-ba35042e994b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799" status: 200 len: 1217 microversion: 2.1 time: 0.400684 Jul 18 02:51:05.124403 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2444/4880] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:04 2022] GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799 => generated 1217 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:05.303698 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ea4bcf8e-e03a-48c5-8fa0-a91cabd9f1bb tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:05.304775 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ea4bcf8e-e03a-48c5-8fa0-a91cabd9f1bb tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:05.313685 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea4bcf8e-e03a-48c5-8fa0-a91cabd9f1bb tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:05.314596 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea4bcf8e-e03a-48c5-8fa0-a91cabd9f1bb tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:05.315694 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea4bcf8e-e03a-48c5-8fa0-a91cabd9f1bb tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:05.318440 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea4bcf8e-e03a-48c5-8fa0-a91cabd9f1bb tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:05.419413 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ea4bcf8e-e03a-48c5-8fa0-a91cabd9f1bb tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:05.436110 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ea4bcf8e-e03a-48c5-8fa0-a91cabd9f1bb tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 200 len: 1502 microversion: 2.1 time: 0.138786 Jul 18 02:51:05.450443 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2437/4881] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:05 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 1502 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:51:06.094143 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6d572c88-f800-418a-b577-0afec018c1bb tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:06.095286 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6d572c88-f800-418a-b577-0afec018c1bb tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:06.150895 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6d572c88-f800-418a-b577-0afec018c1bb tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:06.151781 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6d572c88-f800-418a-b577-0afec018c1bb tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:06.152957 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a4e00846-6d88-421d-b83c-67dd47bf2b94 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:06.153801 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a4e00846-6d88-421d-b83c-67dd47bf2b94 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:06.156725 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6d572c88-f800-418a-b577-0afec018c1bb tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:06.157934 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6d572c88-f800-418a-b577-0afec018c1bb tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:06.178381 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a4e00846-6d88-421d-b83c-67dd47bf2b94 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:06.178853 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a4e00846-6d88-421d-b83c-67dd47bf2b94 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:06.179666 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a4e00846-6d88-421d-b83c-67dd47bf2b94 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:06.180112 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a4e00846-6d88-421d-b83c-67dd47bf2b94 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:06.614727 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a4e00846-6d88-421d-b83c-67dd47bf2b94 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:06.633260 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a4e00846-6d88-421d-b83c-67dd47bf2b94 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799" status: 200 len: 1217 microversion: 2.1 time: 0.484049 Jul 18 02:51:06.635574 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2438/4882] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:06 2022] GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799 => generated 1217 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:51:06.648270 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3a1a5233-7f37-40b1-aa62-f968c2d8810b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:06.650065 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3a1a5233-7f37-40b1-aa62-f968c2d8810b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: 5ce58c09-6319-4fad-ae8a-2b4199edcfd9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:06.664112 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3a1a5233-7f37-40b1-aa62-f968c2d8810b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:06.665480 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3a1a5233-7f37-40b1-aa62-f968c2d8810b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:06.667634 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3a1a5233-7f37-40b1-aa62-f968c2d8810b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:06.668863 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3a1a5233-7f37-40b1-aa62-f968c2d8810b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:06.682665 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6d572c88-f800-418a-b577-0afec018c1bb tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:06.694269 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6d572c88-f800-418a-b577-0afec018c1bb tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 200 len: 1675 microversion: 2.1 time: 0.607549 Jul 18 02:51:06.695284 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2445/4883] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:06 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 1675 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:06.710763 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-3a1a5233-7f37-40b1-aa62-f968c2d8810b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] HTTP exception thrown: Instance 5ce58c09-6319-4fad-ae8a-2b4199edcfd9 could not be found. Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3a1a5233-7f37-40b1-aa62-f968c2d8810b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Request method failure captured: Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 HTTP/1.1 Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MnYuW4W0sup_YmXu0e6TfbM8UhRRyTVhU4O9V6AVf94vohRx4aPb83sBLBZeGqAob5OT52KfbhFJyFnUckm_AKJ129CUDEeh3rlnVQskw2FZl3adXOUNXwdv2KHTFmpLHnRTO3Qsn9Vcgn_cseZ_XT0zvfydkDjvO0Y6iKbO3M5yvk Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: fa240dfd375a45efb42fc04807acf847 Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1583539660 Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fa240dfd375a45efb42fc04807acf847"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fa240dfd375a45efb42fc04807acf847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fa240dfd375a45efb42fc04807acf847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fa240dfd375a45efb42fc04807acf847"}]}] Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1583539660 Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: fa240dfd375a45efb42fc04807acf847 Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1583539660 Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-TestNetworkAdvancedServerOps-1583539660-project Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 381a2ab772ff495cb85b89a85a267cfe Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1583539660-project Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 5ce58c09-6319-4fad-ae8a-2b4199edcfd9 could not be found. Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '5ce58c09-6319-4fad-ae8a-2b4199edcfd9'} Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ce58c09-6319-4fad-ae8a-2b4199edcfd9 could not be found. Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ce58c09-6319-4fad-ae8a-2b4199edcfd9 could not be found. Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:51:06.714293 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:51:06.726717 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:51:06.726717 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:06.726717 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:51:06.726717 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:51:06.726717 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:51:06.726717 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:51:06.726717 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ce58c09-6319-4fad-ae8a-2b4199edcfd9 could not be found. Jul 18 02:51:06.726717 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:51:06.726717 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3a1a5233-7f37-40b1-aa62-f968c2d8810b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Returning 404 to user: Instance 5ce58c09-6319-4fad-ae8a-2b4199edcfd9 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:51:06.726717 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3a1a5233-7f37-40b1-aa62-f968c2d8810b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9" status: 404 len: 111 microversion: 2.1 time: 0.087218 Jul 18 02:51:06.726717 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2439/4884] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:06 2022] GET /compute/v2.1/servers/5ce58c09-6319-4fad-ae8a-2b4199edcfd9 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:51:07.652427 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-91e5cd5f-d04c-422c-8e5c-143931eacfe4 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:07.654070 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-91e5cd5f-d04c-422c-8e5c-143931eacfe4 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:07.668507 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-91e5cd5f-d04c-422c-8e5c-143931eacfe4 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:07.672925 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-91e5cd5f-d04c-422c-8e5c-143931eacfe4 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:07.681685 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-91e5cd5f-d04c-422c-8e5c-143931eacfe4 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:07.682579 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-91e5cd5f-d04c-422c-8e5c-143931eacfe4 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:07.730007 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5febea3e-c541-4864-977a-77490d07b31d tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:07.735495 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5febea3e-c541-4864-977a-77490d07b31d tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:07.760604 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5febea3e-c541-4864-977a-77490d07b31d tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:07.775103 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5febea3e-c541-4864-977a-77490d07b31d tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:07.779817 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5febea3e-c541-4864-977a-77490d07b31d tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:07.780641 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5febea3e-c541-4864-977a-77490d07b31d tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:08.229685 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-91e5cd5f-d04c-422c-8e5c-143931eacfe4 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:08.258566 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-91e5cd5f-d04c-422c-8e5c-143931eacfe4 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799" status: 200 len: 1217 microversion: 2.1 time: 0.610185 Jul 18 02:51:08.260888 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2446/4885] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:07 2022] GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799 => generated 1217 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:08.381930 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5febea3e-c541-4864-977a-77490d07b31d tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:08.419157 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5febea3e-c541-4864-977a-77490d07b31d tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 200 len: 1675 microversion: 2.1 time: 0.698440 Jul 18 02:51:08.424404 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2440/4886] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:07 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 1675 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:09.165745 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ad7bf4e9-17e9-4ad3-9f19-8453bfd6ed93 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:09.167082 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ad7bf4e9-17e9-4ad3-9f19-8453bfd6ed93 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: dfa2f044-9f51-44f9-a87a-1f114d90e7d4] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:09.177268 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ad7bf4e9-17e9-4ad3-9f19-8453bfd6ed93 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:09.178281 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ad7bf4e9-17e9-4ad3-9f19-8453bfd6ed93 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:09.179472 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ad7bf4e9-17e9-4ad3-9f19-8453bfd6ed93 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:09.180237 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ad7bf4e9-17e9-4ad3-9f19-8453bfd6ed93 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:09.198474 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-ad7bf4e9-17e9-4ad3-9f19-8453bfd6ed93 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] HTTP exception thrown: Instance dfa2f044-9f51-44f9-a87a-1f114d90e7d4 could not be found. Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ad7bf4e9-17e9-4ad3-9f19-8453bfd6ed93 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Request method failure captured: Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4 HTTP/1.1 Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MhfM0UyOyoMgRP_1BgsB5GQEFaLnp85satKIE74LtU4aati7wjZItAybGxqrHGu9HKZ07IOl-ghvuL-XVY7iiNLxZrz8uz6pnetXMm39fDBZo0QiKDc9Xu-2OCp3obDb_4yxslV3N-dd0oIabggtRNHi18D28MbZyTc-9xFAnMfxLs Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 8fa714ec7f5a4af0a33f56b45e999a7a Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-AttachVolumeNegativeTest-683705837 Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8fa714ec7f5a4af0a33f56b45e999a7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fa714ec7f5a4af0a33f56b45e999a7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fa714ec7f5a4af0a33f56b45e999a7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8fa714ec7f5a4af0a33f56b45e999a7a"}]}] Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-AttachVolumeNegativeTest-683705837 Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 8fa714ec7f5a4af0a33f56b45e999a7a Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-683705837 Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-AttachVolumeNegativeTest-683705837-project Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 1be686f2aa93473585ca064041bd8140 Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-AttachVolumeNegativeTest-683705837-project Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance dfa2f044-9f51-44f9-a87a-1f114d90e7d4 could not be found. Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'dfa2f044-9f51-44f9-a87a-1f114d90e7d4'} Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfa2f044-9f51-44f9-a87a-1f114d90e7d4 could not be found. Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:51:09.200835 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:51:09.206507 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfa2f044-9f51-44f9-a87a-1f114d90e7d4 could not be found. Jul 18 02:51:09.206507 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:09.206507 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:51:09.206507 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:09.206507 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:09.206507 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:51:09.206507 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:51:09.206507 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:51:09.206507 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:51:09.206507 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfa2f044-9f51-44f9-a87a-1f114d90e7d4 could not be found. Jul 18 02:51:09.206507 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:09.211086 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ad7bf4e9-17e9-4ad3-9f19-8453bfd6ed93 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Returning 404 to user: Instance dfa2f044-9f51-44f9-a87a-1f114d90e7d4 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:51:09.212413 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ad7bf4e9-17e9-4ad3-9f19-8453bfd6ed93 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "DELETE /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4" status: 404 len: 111 microversion: 2.1 time: 0.053503 Jul 18 02:51:09.213603 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2447/4887] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:51:09 2022] DELETE /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:51:09.229286 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bd24e323-f95c-46dc-83dc-b4f12fa6dc88 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:09.230458 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bd24e323-f95c-46dc-83dc-b4f12fa6dc88 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: dfa2f044-9f51-44f9-a87a-1f114d90e7d4] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:09.257319 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bd24e323-f95c-46dc-83dc-b4f12fa6dc88 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:09.257798 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bd24e323-f95c-46dc-83dc-b4f12fa6dc88 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:09.258616 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bd24e323-f95c-46dc-83dc-b4f12fa6dc88 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:09.259051 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bd24e323-f95c-46dc-83dc-b4f12fa6dc88 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:09.298494 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-bd24e323-f95c-46dc-83dc-b4f12fa6dc88 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] HTTP exception thrown: Instance dfa2f044-9f51-44f9-a87a-1f114d90e7d4 could not be found. Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bd24e323-f95c-46dc-83dc-b4f12fa6dc88 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Request method failure captured: Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4 HTTP/1.1 Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MhfM0UyOyoMgRP_1BgsB5GQEFaLnp85satKIE74LtU4aati7wjZItAybGxqrHGu9HKZ07IOl-ghvuL-XVY7iiNLxZrz8uz6pnetXMm39fDBZo0QiKDc9Xu-2OCp3obDb_4yxslV3N-dd0oIabggtRNHi18D28MbZyTc-9xFAnMfxLs Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 8fa714ec7f5a4af0a33f56b45e999a7a Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-AttachVolumeNegativeTest-683705837 Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8fa714ec7f5a4af0a33f56b45e999a7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fa714ec7f5a4af0a33f56b45e999a7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fa714ec7f5a4af0a33f56b45e999a7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8fa714ec7f5a4af0a33f56b45e999a7a"}]}] Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-AttachVolumeNegativeTest-683705837 Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 8fa714ec7f5a4af0a33f56b45e999a7a Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-683705837 Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-AttachVolumeNegativeTest-683705837-project Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 1be686f2aa93473585ca064041bd8140 Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-AttachVolumeNegativeTest-683705837-project Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance dfa2f044-9f51-44f9-a87a-1f114d90e7d4 could not be found. Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'dfa2f044-9f51-44f9-a87a-1f114d90e7d4'} Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfa2f044-9f51-44f9-a87a-1f114d90e7d4 could not be found. Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfa2f044-9f51-44f9-a87a-1f114d90e7d4 could not be found. Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:51:09.301748 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:51:09.307309 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:09.307309 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:51:09.307309 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:51:09.307309 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:51:09.307309 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:51:09.307309 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfa2f044-9f51-44f9-a87a-1f114d90e7d4 could not be found. Jul 18 02:51:09.307309 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:51:09.307309 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bd24e323-f95c-46dc-83dc-b4f12fa6dc88 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Returning 404 to user: Instance dfa2f044-9f51-44f9-a87a-1f114d90e7d4 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:51:09.308657 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a177ff07-8141-4f99-9c03-34412bfab880 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:09.308861 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bd24e323-f95c-46dc-83dc-b4f12fa6dc88 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4" status: 404 len: 111 microversion: 2.1 time: 0.084583 Jul 18 02:51:09.309058 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a177ff07-8141-4f99-9c03-34412bfab880 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:09.309790 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2441/4888] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:09 2022] GET /compute/v2.1/servers/dfa2f044-9f51-44f9-a87a-1f114d90e7d4 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:51:09.352232 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a177ff07-8141-4f99-9c03-34412bfab880 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:09.360401 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a177ff07-8141-4f99-9c03-34412bfab880 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:09.363395 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a177ff07-8141-4f99-9c03-34412bfab880 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:09.364837 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a177ff07-8141-4f99-9c03-34412bfab880 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:09.452663 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5b17bf44-28bd-4eed-9196-2215eca8cbf6 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:09.453844 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5b17bf44-28bd-4eed-9196-2215eca8cbf6 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:09.485158 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5b17bf44-28bd-4eed-9196-2215eca8cbf6 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:09.492230 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5b17bf44-28bd-4eed-9196-2215eca8cbf6 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:09.497419 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5b17bf44-28bd-4eed-9196-2215eca8cbf6 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:09.499699 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5b17bf44-28bd-4eed-9196-2215eca8cbf6 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:10.086555 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a177ff07-8141-4f99-9c03-34412bfab880 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:10.109056 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a177ff07-8141-4f99-9c03-34412bfab880 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799" status: 200 len: 1217 microversion: 2.1 time: 0.809242 Jul 18 02:51:10.113843 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2448/4889] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:09 2022] GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799 => generated 1217 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:51:10.127691 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4895866c-a231-44af-80ab-788069bc2ee5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:10.130030 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4895866c-a231-44af-80ab-788069bc2ee5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:10.164594 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:51:10.171364 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4895866c-a231-44af-80ab-788069bc2ee5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:10.172524 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4895866c-a231-44af-80ab-788069bc2ee5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:10.177382 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4895866c-a231-44af-80ab-788069bc2ee5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:10.178201 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4895866c-a231-44af-80ab-788069bc2ee5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:10.587592 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5b17bf44-28bd-4eed-9196-2215eca8cbf6 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:10.612976 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5b17bf44-28bd-4eed-9196-2215eca8cbf6 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 200 len: 1675 microversion: 2.1 time: 1.167762 Jul 18 02:51:10.630735 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2442/4890] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:09 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 1675 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:10.851153 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4895866c-a231-44af-80ab-788069bc2ee5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:10.880580 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4895866c-a231-44af-80ab-788069bc2ee5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 0.761654 Jul 18 02:51:10.899169 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2449/4891] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:10 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:10.915528 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-dcdea601-2207-4d69-9a4c-0d1f25778eb9 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:10.916627 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-dcdea601-2207-4d69-9a4c-0d1f25778eb9 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:10.954862 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dcdea601-2207-4d69-9a4c-0d1f25778eb9 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:10.955453 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dcdea601-2207-4d69-9a4c-0d1f25778eb9 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:10.956929 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dcdea601-2207-4d69-9a4c-0d1f25778eb9 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:10.957619 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dcdea601-2207-4d69-9a4c-0d1f25778eb9 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:11.145830 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dc81b7a1-16ba-498e-909c-ce086815f710 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:11.148182 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-dc81b7a1-16ba-498e-909c-ce086815f710 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:11.208911 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dc81b7a1-16ba-498e-909c-ce086815f710 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:11.210000 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dc81b7a1-16ba-498e-909c-ce086815f710 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:11.218546 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dc81b7a1-16ba-498e-909c-ce086815f710 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:11.226607 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dc81b7a1-16ba-498e-909c-ce086815f710 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:11.281808 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-dcdea601-2207-4d69-9a4c-0d1f25778eb9 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:11.296792 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-dcdea601-2207-4d69-9a4c-0d1f25778eb9 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 0.388605 Jul 18 02:51:11.328438 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2443/4892] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:10 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:11.334098 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-acc53eea-44ed-4c57-b32c-7e80fd04e697 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:11.340522 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-acc53eea-44ed-4c57-b32c-7e80fd04e697 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:11.364156 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-acc53eea-44ed-4c57-b32c-7e80fd04e697 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:11.364961 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-acc53eea-44ed-4c57-b32c-7e80fd04e697 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:11.366097 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-acc53eea-44ed-4c57-b32c-7e80fd04e697 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:11.366726 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-acc53eea-44ed-4c57-b32c-7e80fd04e697 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:12.072811 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-dc81b7a1-16ba-498e-909c-ce086815f710 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:12.115915 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-dc81b7a1-16ba-498e-909c-ce086815f710 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799" status: 200 len: 1217 microversion: 2.1 time: 0.982237 Jul 18 02:51:12.119438 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2450/4893] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:11 2022] GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799 => generated 1217 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:12.160549 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-41099ca2-0479-453f-a964-7aa76ccd7fcc tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:12.163423 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-41099ca2-0479-453f-a964-7aa76ccd7fcc tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:12.212616 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41099ca2-0479-453f-a964-7aa76ccd7fcc tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:12.213341 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41099ca2-0479-453f-a964-7aa76ccd7fcc tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:12.214833 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41099ca2-0479-453f-a964-7aa76ccd7fcc tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:12.215609 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41099ca2-0479-453f-a964-7aa76ccd7fcc tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:12.333823 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-acc53eea-44ed-4c57-b32c-7e80fd04e697 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:12.364020 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-acc53eea-44ed-4c57-b32c-7e80fd04e697 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 1.033977 Jul 18 02:51:12.365070 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2444/4894] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:11 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:12.404796 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9e29f6bb-87dc-4778-86a7-b8b585e7d170 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-707749111"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:51:12.407477 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9e29f6bb-87dc-4778-86a7-b8b585e7d170 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:12.421400 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9e29f6bb-87dc-4778-86a7-b8b585e7d170 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:12.423280 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9e29f6bb-87dc-4778-86a7-b8b585e7d170 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:12.425040 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9e29f6bb-87dc-4778-86a7-b8b585e7d170 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:12.426495 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9e29f6bb-87dc-4778-86a7-b8b585e7d170 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:12.997156 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-41099ca2-0479-453f-a964-7aa76ccd7fcc tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:13.030411 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-41099ca2-0479-453f-a964-7aa76ccd7fcc tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 200 len: 1652 microversion: 2.1 time: 0.883385 Jul 18 02:51:13.032480 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2451/4895] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:12 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 1652 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:13.059297 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5bec4eb6-a733-43c8-a756-a5acf9a2e49d tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:51:13.187216 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5bec4eb6-a733-43c8-a756-a5acf9a2e49d tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:13.188466 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5bec4eb6-a733-43c8-a756-a5acf9a2e49d tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:13.325627 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5bec4eb6-a733-43c8-a756-a5acf9a2e49d tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Going to try to start instance {{(pid=119543) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 02:51:13.490338 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5bec4eb6-a733-43c8-a756-a5acf9a2e49d tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "POST /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5/action" status: 202 len: 0 microversion: 2.1 time: 0.444601 Jul 18 02:51:13.495725 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2452/4896] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:51:13 2022] POST /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5/action => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:51:13.524274 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c1fa59f8-2285-464e-aad7-48d24b6ef55b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:13.531860 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c1fa59f8-2285-464e-aad7-48d24b6ef55b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:13.552654 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c1fa59f8-2285-464e-aad7-48d24b6ef55b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:13.553415 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c1fa59f8-2285-464e-aad7-48d24b6ef55b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:13.556504 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c1fa59f8-2285-464e-aad7-48d24b6ef55b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:13.557086 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c1fa59f8-2285-464e-aad7-48d24b6ef55b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:13.832488 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9e29f6bb-87dc-4778-86a7-b8b585e7d170 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "POST /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e/action" status: 202 len: 0 microversion: 2.1 time: 1.434904 Jul 18 02:51:13.838466 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2445/4897] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:51:12 2022] POST /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e/action => generated 0 bytes in 1442 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 18 02:51:13.866216 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e2f3b833-c063-4f54-b326-73f5cc4bef0d tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:13.871061 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e2f3b833-c063-4f54-b326-73f5cc4bef0d tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:13.893781 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e2f3b833-c063-4f54-b326-73f5cc4bef0d tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:13.898603 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e2f3b833-c063-4f54-b326-73f5cc4bef0d tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:13.900770 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e2f3b833-c063-4f54-b326-73f5cc4bef0d tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:13.901526 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e2f3b833-c063-4f54-b326-73f5cc4bef0d tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:14.024461 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c1fa59f8-2285-464e-aad7-48d24b6ef55b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:14.039924 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c1fa59f8-2285-464e-aad7-48d24b6ef55b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799" status: 200 len: 1217 microversion: 2.1 time: 0.536132 Jul 18 02:51:14.041100 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2453/4898] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:13 2022] GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799 => generated 1217 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:14.259889 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e2f3b833-c063-4f54-b326-73f5cc4bef0d tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:14.273889 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e2f3b833-c063-4f54-b326-73f5cc4bef0d tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 200 len: 1661 microversion: 2.1 time: 0.422091 Jul 18 02:51:14.290640 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2446/4899] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:13 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 1661 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:14.758789 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6bc6f867-417a-4d22-889a-f49dce64a75c tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1712133181", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "bc8cd9e6-380d-4d74-be23-18035bb9d8a5"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:51:14.878741 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-6bc6f867-417a-4d22-889a-f49dce64a75c tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] validate_networks() for [('bc8cd9e6-380d-4d74-be23-18035bb9d8a5', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:51:15.070806 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d3358b10-9ab3-4d0e-9cab-95416d15954e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:15.079809 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d3358b10-9ab3-4d0e-9cab-95416d15954e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:15.111510 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d3358b10-9ab3-4d0e-9cab-95416d15954e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:15.114537 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d3358b10-9ab3-4d0e-9cab-95416d15954e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:15.126016 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d3358b10-9ab3-4d0e-9cab-95416d15954e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:15.126750 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d3358b10-9ab3-4d0e-9cab-95416d15954e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:15.763438 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d3358b10-9ab3-4d0e-9cab-95416d15954e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:15.780734 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d3358b10-9ab3-4d0e-9cab-95416d15954e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799" status: 200 len: 1217 microversion: 2.1 time: 0.725345 Jul 18 02:51:15.783293 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2447/4900] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:15 2022] GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799 => generated 1217 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:15.804092 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5512425e-5ed7-4054-a8cb-9bbb67a38f43 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:15.805529 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5512425e-5ed7-4054-a8cb-9bbb67a38f43 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:15.832226 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5512425e-5ed7-4054-a8cb-9bbb67a38f43 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:15.841105 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5512425e-5ed7-4054-a8cb-9bbb67a38f43 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:15.842890 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5512425e-5ed7-4054-a8cb-9bbb67a38f43 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:15.843880 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5512425e-5ed7-4054-a8cb-9bbb67a38f43 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:16.235709 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5512425e-5ed7-4054-a8cb-9bbb67a38f43 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:16.241872 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-6bc6f867-417a-4d22-889a-f49dce64a75c tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:51:16.243290 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-6bc6f867-417a-4d22-889a-f49dce64a75c tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:51:16.244420 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-6bc6f867-417a-4d22-889a-f49dce64a75c tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:51:16.245186 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-6bc6f867-417a-4d22-889a-f49dce64a75c tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:51:16.246249 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-6bc6f867-417a-4d22-889a-f49dce64a75c tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:51:16.251135 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5512425e-5ed7-4054-a8cb-9bbb67a38f43 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 200 len: 1661 microversion: 2.1 time: 0.463934 Jul 18 02:51:16.252110 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2448/4901] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:15 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 1661 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:16.262160 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6bc6f867-417a-4d22-889a-f49dce64a75c tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:16.262618 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6bc6f867-417a-4d22-889a-f49dce64a75c tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:16.263683 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6bc6f867-417a-4d22-889a-f49dce64a75c tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:16.264758 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6bc6f867-417a-4d22-889a-f49dce64a75c tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:16.267284 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-15587ae1-a4d4-49fc-85d1-6edd993e821f tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '.version_select at 0x7ff4a826c430>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:16.290059 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-6bc6f867-417a-4d22-889a-f49dce64a75c tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Getting quotas for project ed4a114c5309447bb74cd37c180b749d. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:51:16.294608 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-15587ae1-a4d4-49fc-85d1-6edd993e821f tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-191272585" status: 202 len: 0 microversion: 2.1 time: 0.040510 Jul 18 02:51:16.295278 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2449/4902] 10.222.0.57 () {58 vars in 1280 bytes} [Mon Jul 18 02:51:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-191272585 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:51:16.307293 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-6bc6f867-417a-4d22-889a-f49dce64a75c tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Getting quotas for user 949d2267438542afaa92a261f25acef7 and project ed4a114c5309447bb74cd37c180b749d. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:51:16.332376 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6bc6f867-417a-4d22-889a-f49dce64a75c tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:51:16.333564 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fe2e57e2-f7b0-47d9-9b2f-56c0017b80f7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Action: 'create', calling method: .version_select at 0x7ff4a84c6310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1293310360", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsE2mPZMqSTAhMRTYwDQEeWagTvmqMBRbQSMo2mE4SO2KKPw4Tz6eWocsqd84TCRAM5eTDc/cgdzFG/VVNPrYOu5YfeGxXvUBFV6PBXLowx3FNUPyEuIrpFc79iIZ/U/A=="}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:51:16.338074 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6bc6f867-417a-4d22-889a-f49dce64a75c tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 4b0f1b28-e409-4b2d-ad07-b85f03fd59ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:51:16.351401 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-fe2e57e2-f7b0-47d9-9b2f-56c0017b80f7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Getting quotas for project fa240dfd375a45efb42fc04807acf847. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:51:16.360374 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-fe2e57e2-f7b0-47d9-9b2f-56c0017b80f7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Getting quotas for user 381a2ab772ff495cb85b89a85a267cfe and project fa240dfd375a45efb42fc04807acf847. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:51:16.397809 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fe2e57e2-f7b0-47d9-9b2f-56c0017b80f7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.069028 Jul 18 02:51:16.399410 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2450/4903] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 02:51:16 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:51:16.578946 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6bc6f867-417a-4d22-889a-f49dce64a75c tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.824511 Jul 18 02:51:16.583278 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2454/4904] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:51:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:51:16.597338 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-23dc87b3-79ec-4a8f-b67e-c5d5b3b1366c tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:16.597338 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-23dc87b3-79ec-4a8f-b67e-c5d5b3b1366c tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 4b0f1b28-e409-4b2d-ad07-b85f03fd59ae] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:16.758800 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-23dc87b3-79ec-4a8f-b67e-c5d5b3b1366c tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949d2267438542afaa92a261f25acef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a114c5309447bb74cd37c180b749d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:16.768197 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-23dc87b3-79ec-4a8f-b67e-c5d5b3b1366c tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] 10.222.0.57 "GET /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae" status: 200 len: 1219 microversion: 2.1 time: 0.177679 Jul 18 02:51:16.773401 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2451/4905] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:16 2022] GET /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae => generated 1219 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:16.801827 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-71706549-c222-4712-be01-79274d85eb2a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:16.802477 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-71706549-c222-4712-be01-79274d85eb2a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:16.818603 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-71706549-c222-4712-be01-79274d85eb2a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:16.819094 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-71706549-c222-4712-be01-79274d85eb2a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:16.826426 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-71706549-c222-4712-be01-79274d85eb2a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:16.836440 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-71706549-c222-4712-be01-79274d85eb2a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:17.283310 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-25f8528c-1f11-47cc-8027-b1c5ebad83f2 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:17.285410 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-25f8528c-1f11-47cc-8027-b1c5ebad83f2 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:17.299786 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25f8528c-1f11-47cc-8027-b1c5ebad83f2 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:17.300012 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25f8528c-1f11-47cc-8027-b1c5ebad83f2 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:17.300818 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25f8528c-1f11-47cc-8027-b1c5ebad83f2 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:17.309416 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25f8528c-1f11-47cc-8027-b1c5ebad83f2 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:17.426873 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-71706549-c222-4712-be01-79274d85eb2a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:17.451897 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-71706549-c222-4712-be01-79274d85eb2a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799" status: 200 len: 1217 microversion: 2.1 time: 0.652634 Jul 18 02:51:17.453452 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2455/4906] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:16 2022] GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799 => generated 1217 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:51:17.579477 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-4ebc5d52-1f9a-49b2-9c26-46674a4e8380 req-40d04728-fd3f-42b3-81d2-cfc05d5d9b00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "702e7ce4-6d2d-41a3-97f9-2403df247799", "name": "network-vif-plugged", "status": "completed", "tag": "58fe3c54-fb57-4229-8be8-50d6596402ed"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:51:17.607233 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-4ebc5d52-1f9a-49b2-9c26-46674a4e8380 req-40d04728-fd3f-42b3-81d2-cfc05d5d9b00 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:17.608500 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-4ebc5d52-1f9a-49b2-9c26-46674a4e8380 req-40d04728-fd3f-42b3-81d2-cfc05d5d9b00 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:17.631936 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-4ebc5d52-1f9a-49b2-9c26-46674a4e8380 req-40d04728-fd3f-42b3-81d2-cfc05d5d9b00 service nova] Creating event network-vif-plugged:58fe3c54-fb57-4229-8be8-50d6596402ed for instance 702e7ce4-6d2d-41a3-97f9-2403df247799 on n-h1-465891-3 Jul 18 02:51:17.644091 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-4ebc5d52-1f9a-49b2-9c26-46674a4e8380 req-40d04728-fd3f-42b3-81d2-cfc05d5d9b00 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103858 Jul 18 02:51:17.645719 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2456/4907] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:51:17.679114 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-147bc5c6-396e-4c12-bc82-8a7c703b5a80 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:17.682037 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-147bc5c6-396e-4c12-bc82-8a7c703b5a80 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 2e823ef6-49cc-4fb5-ae76-3d4e87041838] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:17.722358 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-147bc5c6-396e-4c12-bc82-8a7c703b5a80 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:17.728169 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-147bc5c6-396e-4c12-bc82-8a7c703b5a80 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:17.731140 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-147bc5c6-396e-4c12-bc82-8a7c703b5a80 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:17.733164 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-147bc5c6-396e-4c12-bc82-8a7c703b5a80 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:17.759666 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-25f8528c-1f11-47cc-8027-b1c5ebad83f2 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:17.804960 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-25f8528c-1f11-47cc-8027-b1c5ebad83f2 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 200 len: 1665 microversion: 2.1 time: 0.525550 Jul 18 02:51:17.809366 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2452/4908] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:17 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 1665 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:51:17.817720 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-147bc5c6-396e-4c12-bc82-8a7c703b5a80 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] HTTP exception thrown: Instance 2e823ef6-49cc-4fb5-ae76-3d4e87041838 could not be found. Jul 18 02:51:17.828909 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-528f49e9-a9ed-4f4f-8202-7583dce421fc tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:17.831168 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-528f49e9-a9ed-4f4f-8202-7583dce421fc tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 4b0f1b28-e409-4b2d-ad07-b85f03fd59ae] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-147bc5c6-396e-4c12-bc82-8a7c703b5a80 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Request method failure captured: Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838 HTTP/1.1 Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MhfM0UyOyoMgRP_1BgsB5GQEFaLnp85satKIE74LtU4aati7wjZItAybGxqrHGu9HKZ07IOl-ghvuL-XVY7iiNLxZrz8uz6pnetXMm39fDBZo0QiKDc9Xu-2OCp3obDb_4yxslV3N-dd0oIabggtRNHi18D28MbZyTc-9xFAnMfxLs Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 8fa714ec7f5a4af0a33f56b45e999a7a Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-AttachVolumeNegativeTest-683705837 Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8fa714ec7f5a4af0a33f56b45e999a7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fa714ec7f5a4af0a33f56b45e999a7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fa714ec7f5a4af0a33f56b45e999a7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8fa714ec7f5a4af0a33f56b45e999a7a"}]}] Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-AttachVolumeNegativeTest-683705837 Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 8fa714ec7f5a4af0a33f56b45e999a7a Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-683705837 Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-AttachVolumeNegativeTest-683705837-project Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 1be686f2aa93473585ca064041bd8140 Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-AttachVolumeNegativeTest-683705837-project Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 2e823ef6-49cc-4fb5-ae76-3d4e87041838 could not be found. Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '2e823ef6-49cc-4fb5-ae76-3d4e87041838'} Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e823ef6-49cc-4fb5-ae76-3d4e87041838 could not be found. Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:51:17.832940 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:51:17.837248 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e823ef6-49cc-4fb5-ae76-3d4e87041838 could not be found. Jul 18 02:51:17.837248 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:17.837248 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:51:17.837248 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:17.837248 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:17.837248 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:51:17.837248 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:51:17.837248 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:51:17.837248 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:51:17.837248 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e823ef6-49cc-4fb5-ae76-3d4e87041838 could not be found. Jul 18 02:51:17.837248 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:17.837248 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-147bc5c6-396e-4c12-bc82-8a7c703b5a80 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Returning 404 to user: Instance 2e823ef6-49cc-4fb5-ae76-3d4e87041838 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:51:17.844118 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-147bc5c6-396e-4c12-bc82-8a7c703b5a80 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838" status: 404 len: 111 microversion: 2.1 time: 0.172124 Jul 18 02:51:17.846605 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2457/4909] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:51:17 2022] DELETE /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838 => generated 111 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:51:17.869974 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-528f49e9-a9ed-4f4f-8202-7583dce421fc tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:17.871084 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-528f49e9-a9ed-4f4f-8202-7583dce421fc tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:17.873167 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a5ec7213-03d0-4bdb-88da-3377af9fab45 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:17.874855 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-528f49e9-a9ed-4f4f-8202-7583dce421fc tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:17.876998 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-528f49e9-a9ed-4f4f-8202-7583dce421fc tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:17.877501 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a5ec7213-03d0-4bdb-88da-3377af9fab45 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 2e823ef6-49cc-4fb5-ae76-3d4e87041838] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:17.907097 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a5ec7213-03d0-4bdb-88da-3377af9fab45 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:17.908001 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a5ec7213-03d0-4bdb-88da-3377af9fab45 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:17.909605 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a5ec7213-03d0-4bdb-88da-3377af9fab45 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:17.910715 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a5ec7213-03d0-4bdb-88da-3377af9fab45 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:17.969677 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-a5ec7213-03d0-4bdb-88da-3377af9fab45 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] HTTP exception thrown: Instance 2e823ef6-49cc-4fb5-ae76-3d4e87041838 could not be found. Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a5ec7213-03d0-4bdb-88da-3377af9fab45 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Request method failure captured: Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838 HTTP/1.1 Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MhfM0UyOyoMgRP_1BgsB5GQEFaLnp85satKIE74LtU4aati7wjZItAybGxqrHGu9HKZ07IOl-ghvuL-XVY7iiNLxZrz8uz6pnetXMm39fDBZo0QiKDc9Xu-2OCp3obDb_4yxslV3N-dd0oIabggtRNHi18D28MbZyTc-9xFAnMfxLs Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 8fa714ec7f5a4af0a33f56b45e999a7a Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-AttachVolumeNegativeTest-683705837 Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8fa714ec7f5a4af0a33f56b45e999a7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fa714ec7f5a4af0a33f56b45e999a7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fa714ec7f5a4af0a33f56b45e999a7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8fa714ec7f5a4af0a33f56b45e999a7a"}]}] Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-AttachVolumeNegativeTest-683705837 Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 8fa714ec7f5a4af0a33f56b45e999a7a Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-683705837 Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-AttachVolumeNegativeTest-683705837-project Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 1be686f2aa93473585ca064041bd8140 Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-AttachVolumeNegativeTest-683705837-project Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 2e823ef6-49cc-4fb5-ae76-3d4e87041838 could not be found. Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '2e823ef6-49cc-4fb5-ae76-3d4e87041838'} Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e823ef6-49cc-4fb5-ae76-3d4e87041838 could not be found. Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e823ef6-49cc-4fb5-ae76-3d4e87041838 could not be found. Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:51:17.976431 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:17.981231 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:17.981231 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:51:17.981231 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:51:17.981231 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:51:17.981231 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:51:17.981231 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e823ef6-49cc-4fb5-ae76-3d4e87041838 could not be found. Jul 18 02:51:17.981231 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:17.985733 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a5ec7213-03d0-4bdb-88da-3377af9fab45 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Returning 404 to user: Instance 2e823ef6-49cc-4fb5-ae76-3d4e87041838 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:51:17.991533 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a5ec7213-03d0-4bdb-88da-3377af9fab45 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838" status: 404 len: 111 microversion: 2.1 time: 0.137859 Jul 18 02:51:17.992520 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2458/4910] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:17 2022] GET /compute/v2.1/servers/2e823ef6-49cc-4fb5-ae76-3d4e87041838 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:51:18.005416 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1042a9d7-543c-46b9-aafc-77aef11af62b tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:18.006332 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1042a9d7-543c-46b9-aafc-77aef11af62b tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:18.014162 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1042a9d7-543c-46b9-aafc-77aef11af62b tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:18.015214 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1042a9d7-543c-46b9-aafc-77aef11af62b tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:18.016349 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1042a9d7-543c-46b9-aafc-77aef11af62b tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:18.017022 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1042a9d7-543c-46b9-aafc-77aef11af62b tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:18.036813 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-1042a9d7-543c-46b9-aafc-77aef11af62b tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] HTTP exception thrown: Instance b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 could not be found. Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1042a9d7-543c-46b9-aafc-77aef11af62b tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Request method failure captured: Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 HTTP/1.1 Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MhfM0UyOyoMgRP_1BgsB5GQEFaLnp85satKIE74LtU4aati7wjZItAybGxqrHGu9HKZ07IOl-ghvuL-XVY7iiNLxZrz8uz6pnetXMm39fDBZo0QiKDc9Xu-2OCp3obDb_4yxslV3N-dd0oIabggtRNHi18D28MbZyTc-9xFAnMfxLs Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 8fa714ec7f5a4af0a33f56b45e999a7a Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-AttachVolumeNegativeTest-683705837 Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8fa714ec7f5a4af0a33f56b45e999a7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fa714ec7f5a4af0a33f56b45e999a7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fa714ec7f5a4af0a33f56b45e999a7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8fa714ec7f5a4af0a33f56b45e999a7a"}]}] Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-AttachVolumeNegativeTest-683705837 Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 8fa714ec7f5a4af0a33f56b45e999a7a Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-683705837 Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-AttachVolumeNegativeTest-683705837-project Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 1be686f2aa93473585ca064041bd8140 Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-AttachVolumeNegativeTest-683705837-project Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 could not be found. Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1'} Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 could not be found. Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:51:18.038791 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:51:18.044339 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 could not be found. Jul 18 02:51:18.044339 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:18.044339 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:51:18.044339 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:18.044339 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:18.044339 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:51:18.044339 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:51:18.044339 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:51:18.044339 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:51:18.044339 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 could not be found. Jul 18 02:51:18.044339 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:18.046532 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1042a9d7-543c-46b9-aafc-77aef11af62b tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Returning 404 to user: Instance b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:51:18.047652 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1042a9d7-543c-46b9-aafc-77aef11af62b tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1" status: 404 len: 111 microversion: 2.1 time: 0.048137 Jul 18 02:51:18.048729 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2459/4911] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:51:17 2022] DELETE /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:51:18.059158 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1157b546-9862-4814-97f9-73cda40e601e tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:18.064052 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1157b546-9862-4814-97f9-73cda40e601e tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:18.076224 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-528f49e9-a9ed-4f4f-8202-7583dce421fc tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949d2267438542afaa92a261f25acef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a114c5309447bb74cd37c180b749d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:18.081859 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1157b546-9862-4814-97f9-73cda40e601e tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:18.083958 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1157b546-9862-4814-97f9-73cda40e601e tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:18.084976 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1157b546-9862-4814-97f9-73cda40e601e tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:18.087088 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1157b546-9862-4814-97f9-73cda40e601e tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:18.122971 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-528f49e9-a9ed-4f4f-8202-7583dce421fc tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] 10.222.0.57 "GET /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae" status: 200 len: 1223 microversion: 2.1 time: 0.305748 Jul 18 02:51:18.126109 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-1157b546-9862-4814-97f9-73cda40e601e tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] HTTP exception thrown: Instance b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 could not be found. Jul 18 02:51:18.128732 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2453/4912] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:17 2022] GET /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae => generated 1223 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1157b546-9862-4814-97f9-73cda40e601e tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Request method failure captured: Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 HTTP/1.1 Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MhfM0UyOyoMgRP_1BgsB5GQEFaLnp85satKIE74LtU4aati7wjZItAybGxqrHGu9HKZ07IOl-ghvuL-XVY7iiNLxZrz8uz6pnetXMm39fDBZo0QiKDc9Xu-2OCp3obDb_4yxslV3N-dd0oIabggtRNHi18D28MbZyTc-9xFAnMfxLs Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 8fa714ec7f5a4af0a33f56b45e999a7a Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-AttachVolumeNegativeTest-683705837 Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8fa714ec7f5a4af0a33f56b45e999a7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fa714ec7f5a4af0a33f56b45e999a7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fa714ec7f5a4af0a33f56b45e999a7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8fa714ec7f5a4af0a33f56b45e999a7a"}]}] Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-AttachVolumeNegativeTest-683705837 Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 8fa714ec7f5a4af0a33f56b45e999a7a Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-683705837 Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-AttachVolumeNegativeTest-683705837-project Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 1be686f2aa93473585ca064041bd8140 Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-AttachVolumeNegativeTest-683705837-project Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 could not be found. Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1'} Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 could not be found. Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 could not be found. Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:51:18.130217 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:18.135752 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:18.135752 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:51:18.135752 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:51:18.135752 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:51:18.135752 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:51:18.135752 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 could not be found. Jul 18 02:51:18.135752 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:18.135752 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1157b546-9862-4814-97f9-73cda40e601e tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Returning 404 to user: Instance b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:51:18.138849 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1157b546-9862-4814-97f9-73cda40e601e tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1" status: 404 len: 111 microversion: 2.1 time: 0.083861 Jul 18 02:51:18.141692 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2460/4913] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:18 2022] GET /compute/v2.1/servers/b0c5c5c8-7df1-404f-bc33-17fe2a70d2b1 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:51:18.487743 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-49441e70-5c57-485f-aac4-6611ac52f85e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:18.488651 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-49441e70-5c57-485f-aac4-6611ac52f85e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:18.511749 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-49441e70-5c57-485f-aac4-6611ac52f85e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:18.514899 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-49441e70-5c57-485f-aac4-6611ac52f85e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:18.515865 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-49441e70-5c57-485f-aac4-6611ac52f85e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:18.516329 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-49441e70-5c57-485f-aac4-6611ac52f85e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:18.574670 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:51:18.858425 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-49441e70-5c57-485f-aac4-6611ac52f85e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:18.872377 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-49441e70-5c57-485f-aac4-6611ac52f85e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799" status: 200 len: 1217 microversion: 2.1 time: 0.388788 Jul 18 02:51:18.873652 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2454/4914] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:18 2022] GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799 => generated 1217 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:19.163182 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c98413c3-e153-44bd-a09a-66b0618b6eff tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:19.163991 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c98413c3-e153-44bd-a09a-66b0618b6eff tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 4b0f1b28-e409-4b2d-ad07-b85f03fd59ae] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:19.192646 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c98413c3-e153-44bd-a09a-66b0618b6eff tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:19.197339 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c98413c3-e153-44bd-a09a-66b0618b6eff tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:19.202613 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c98413c3-e153-44bd-a09a-66b0618b6eff tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:19.202613 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c98413c3-e153-44bd-a09a-66b0618b6eff tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:19.441343 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c98413c3-e153-44bd-a09a-66b0618b6eff tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949d2267438542afaa92a261f25acef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a114c5309447bb74cd37c180b749d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:19.458451 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c98413c3-e153-44bd-a09a-66b0618b6eff tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] 10.222.0.57 "GET /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae" status: 200 len: 1223 microversion: 2.1 time: 0.299439 Jul 18 02:51:19.470202 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2461/4915] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:19 2022] GET /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae => generated 1223 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:51:19.693141 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-df05f65f-a037-4f2a-b68b-d58853f4456d req-1d533224-502a-4bd7-baec-bd44549f2732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69bbb844-4d56-4e75-ae50-9c35c9ce6f9e", "name": "network-vif-plugged", "status": "completed", "tag": "d926d5af-f867-44cd-8b60-abb0339ecf2a"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:51:19.704702 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-df05f65f-a037-4f2a-b68b-d58853f4456d req-1d533224-502a-4bd7-baec-bd44549f2732 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:19.706381 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-df05f65f-a037-4f2a-b68b-d58853f4456d req-1d533224-502a-4bd7-baec-bd44549f2732 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:19.733152 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-df05f65f-a037-4f2a-b68b-d58853f4456d req-1d533224-502a-4bd7-baec-bd44549f2732 service nova] Creating event network-vif-plugged:d926d5af-f867-44cd-8b60-abb0339ecf2a for instance 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e on n-h2-465891-3 Jul 18 02:51:19.749085 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-df05f65f-a037-4f2a-b68b-d58853f4456d req-1d533224-502a-4bd7-baec-bd44549f2732 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063996 Jul 18 02:51:19.750586 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2455/4916] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:51:20.292137 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c48e3038-9f00-41d1-8392-6dd90e9b0248 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:20.293836 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c48e3038-9f00-41d1-8392-6dd90e9b0248 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:20.302850 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c48e3038-9f00-41d1-8392-6dd90e9b0248 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:20.303891 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c48e3038-9f00-41d1-8392-6dd90e9b0248 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:20.304903 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c48e3038-9f00-41d1-8392-6dd90e9b0248 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:20.305543 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c48e3038-9f00-41d1-8392-6dd90e9b0248 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:20.323385 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:51:20.478417 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fd7edab2-47b4-446f-a2e0-fa5289d49295 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:20.479432 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fd7edab2-47b4-446f-a2e0-fa5289d49295 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 4b0f1b28-e409-4b2d-ad07-b85f03fd59ae] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:20.487815 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd7edab2-47b4-446f-a2e0-fa5289d49295 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:20.488609 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd7edab2-47b4-446f-a2e0-fa5289d49295 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:20.489725 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd7edab2-47b4-446f-a2e0-fa5289d49295 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:20.490541 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd7edab2-47b4-446f-a2e0-fa5289d49295 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:20.665270 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fd7edab2-47b4-446f-a2e0-fa5289d49295 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949d2267438542afaa92a261f25acef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a114c5309447bb74cd37c180b749d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:20.700214 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c48e3038-9f00-41d1-8392-6dd90e9b0248 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:20.707594 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fd7edab2-47b4-446f-a2e0-fa5289d49295 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] 10.222.0.57 "GET /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae" status: 200 len: 1223 microversion: 2.1 time: 0.220267 Jul 18 02:51:20.710183 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2456/4917] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:20 2022] GET /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae => generated 1223 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:51:20.718218 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c48e3038-9f00-41d1-8392-6dd90e9b0248 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799" status: 200 len: 1405 microversion: 2.1 time: 0.819102 Jul 18 02:51:20.738610 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2462/4918] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:19 2022] GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799 => generated 1405 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:20.755410 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6016ff0a-b560-49a9-9cce-4d05e2cfa8be tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:20.757484 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6016ff0a-b560-49a9-9cce-4d05e2cfa8be tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:20.773349 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6016ff0a-b560-49a9-9cce-4d05e2cfa8be tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:20.774837 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6016ff0a-b560-49a9-9cce-4d05e2cfa8be tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:20.776927 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6016ff0a-b560-49a9-9cce-4d05e2cfa8be tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:20.778146 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6016ff0a-b560-49a9-9cce-4d05e2cfa8be tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:21.373692 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6016ff0a-b560-49a9-9cce-4d05e2cfa8be tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:21.399144 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6016ff0a-b560-49a9-9cce-4d05e2cfa8be tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799" status: 200 len: 1405 microversion: 2.1 time: 0.652950 Jul 18 02:51:21.400241 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2457/4919] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:20 2022] GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799 => generated 1405 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:21.421089 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b2fb3537-146b-466a-9140-13f8cfa1da95 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-966813481"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:51:21.424864 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b2fb3537-146b-466a-9140-13f8cfa1da95 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:21.462024 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b2fb3537-146b-466a-9140-13f8cfa1da95 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:21.462486 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b2fb3537-146b-466a-9140-13f8cfa1da95 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:21.463991 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b2fb3537-146b-466a-9140-13f8cfa1da95 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:21.470936 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b2fb3537-146b-466a-9140-13f8cfa1da95 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:21.729677 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4922c676-70d1-4138-9204-ad7778e0c598 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:21.730575 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4922c676-70d1-4138-9204-ad7778e0c598 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 4b0f1b28-e409-4b2d-ad07-b85f03fd59ae] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:21.748595 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4922c676-70d1-4138-9204-ad7778e0c598 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:21.750315 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4922c676-70d1-4138-9204-ad7778e0c598 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:21.752273 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4922c676-70d1-4138-9204-ad7778e0c598 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:21.752724 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4922c676-70d1-4138-9204-ad7778e0c598 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:21.811825 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.compute.api [None req-b2fb3537-146b-466a-9140-13f8cfa1da95 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Attempting to quiesce instance before volume snapshot. Jul 18 02:51:21.883299 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.compute.api [None req-b2fb3537-146b-466a-9140-13f8cfa1da95 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Jul 18 02:51:22.059224 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b2fb3537-146b-466a-9140-13f8cfa1da95 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Creating snapshot from volume a212f305-dd5d-4e4d-86cd-65b986c4ba18. {{(pid=119543) snapshot_instance /opt/stack/nova/nova/compute/api.py:3454}} Jul 18 02:51:22.459981 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4922c676-70d1-4138-9204-ad7778e0c598 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949d2267438542afaa92a261f25acef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a114c5309447bb74cd37c180b749d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:22.490321 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4922c676-70d1-4138-9204-ad7778e0c598 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] 10.222.0.57 "GET /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae" status: 200 len: 1279 microversion: 2.1 time: 0.766939 Jul 18 02:51:22.490946 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2458/4920] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:21 2022] GET /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae => generated 1279 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:51:23.511637 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-96a1e040-166e-4f6e-94fc-47db175cdb0d tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:23.512700 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-96a1e040-166e-4f6e-94fc-47db175cdb0d tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 4b0f1b28-e409-4b2d-ad07-b85f03fd59ae] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:23.538363 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-96a1e040-166e-4f6e-94fc-47db175cdb0d tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:23.538850 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-96a1e040-166e-4f6e-94fc-47db175cdb0d tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:23.541269 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-96a1e040-166e-4f6e-94fc-47db175cdb0d tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:23.545367 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-96a1e040-166e-4f6e-94fc-47db175cdb0d tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:23.935416 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-96a1e040-166e-4f6e-94fc-47db175cdb0d tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949d2267438542afaa92a261f25acef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a114c5309447bb74cd37c180b749d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:23.952202 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-96a1e040-166e-4f6e-94fc-47db175cdb0d tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] 10.222.0.57 "GET /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae" status: 200 len: 1277 microversion: 2.1 time: 0.446699 Jul 18 02:51:23.952803 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2459/4921] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:23 2022] GET /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae => generated 1277 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:24.108782 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-32c0ab94-7d81-4db7-bbe8-d807f74318c8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:24.109288 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-32c0ab94-7d81-4db7-bbe8-d807f74318c8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 3aa190fe-c088-40db-8267-e574e0002a03] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:24.122334 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-32c0ab94-7d81-4db7-bbe8-d807f74318c8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:24.122783 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-32c0ab94-7d81-4db7-bbe8-d807f74318c8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:24.123583 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-32c0ab94-7d81-4db7-bbe8-d807f74318c8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:24.124026 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-32c0ab94-7d81-4db7-bbe8-d807f74318c8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:24.225548 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-32c0ab94-7d81-4db7-bbe8-d807f74318c8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] HTTP exception thrown: Instance 3aa190fe-c088-40db-8267-e574e0002a03 could not be found. Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-32c0ab94-7d81-4db7-bbe8-d807f74318c8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Request method failure captured: Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03 HTTP/1.1 Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MhfM0UyOyoMgRP_1BgsB5GQEFaLnp85satKIE74LtU4aati7wjZItAybGxqrHGu9HKZ07IOl-ghvuL-XVY7iiNLxZrz8uz6pnetXMm39fDBZo0QiKDc9Xu-2OCp3obDb_4yxslV3N-dd0oIabggtRNHi18D28MbZyTc-9xFAnMfxLs Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 8fa714ec7f5a4af0a33f56b45e999a7a Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-AttachVolumeNegativeTest-683705837 Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8fa714ec7f5a4af0a33f56b45e999a7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fa714ec7f5a4af0a33f56b45e999a7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fa714ec7f5a4af0a33f56b45e999a7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8fa714ec7f5a4af0a33f56b45e999a7a"}]}] Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-AttachVolumeNegativeTest-683705837 Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 8fa714ec7f5a4af0a33f56b45e999a7a Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-683705837 Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-AttachVolumeNegativeTest-683705837-project Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 1be686f2aa93473585ca064041bd8140 Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-AttachVolumeNegativeTest-683705837-project Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 3aa190fe-c088-40db-8267-e574e0002a03 could not be found. Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '3aa190fe-c088-40db-8267-e574e0002a03'} Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aa190fe-c088-40db-8267-e574e0002a03 could not be found. Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:51:24.228972 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:51:24.234174 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aa190fe-c088-40db-8267-e574e0002a03 could not be found. Jul 18 02:51:24.234174 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:51:24.234174 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:51:24.234174 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:51:24.234174 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:24.234174 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:51:24.234174 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:51:24.234174 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:51:24.234174 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:51:24.234174 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aa190fe-c088-40db-8267-e574e0002a03 could not be found. Jul 18 02:51:24.234174 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:51:24.256048 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-32c0ab94-7d81-4db7-bbe8-d807f74318c8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Returning 404 to user: Instance 3aa190fe-c088-40db-8267-e574e0002a03 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:51:24.257788 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-32c0ab94-7d81-4db7-bbe8-d807f74318c8 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03" status: 404 len: 111 microversion: 2.1 time: 0.152637 Jul 18 02:51:24.258717 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2460/4922] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:51:24 2022] DELETE /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:51:24.313127 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8e3ac521-9a15-4d66-a819-eaa7c5fa2238 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:24.315894 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8e3ac521-9a15-4d66-a819-eaa7c5fa2238 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] [instance: 3aa190fe-c088-40db-8267-e574e0002a03] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:24.340822 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8e3ac521-9a15-4d66-a819-eaa7c5fa2238 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:24.348220 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8e3ac521-9a15-4d66-a819-eaa7c5fa2238 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:24.350512 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8e3ac521-9a15-4d66-a819-eaa7c5fa2238 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:24.352226 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8e3ac521-9a15-4d66-a819-eaa7c5fa2238 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:24.396873 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-8e3ac521-9a15-4d66-a819-eaa7c5fa2238 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] HTTP exception thrown: Instance 3aa190fe-c088-40db-8267-e574e0002a03 could not be found. Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8e3ac521-9a15-4d66-a819-eaa7c5fa2238 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Request method failure captured: Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03 HTTP/1.1 Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MhfM0UyOyoMgRP_1BgsB5GQEFaLnp85satKIE74LtU4aati7wjZItAybGxqrHGu9HKZ07IOl-ghvuL-XVY7iiNLxZrz8uz6pnetXMm39fDBZo0QiKDc9Xu-2OCp3obDb_4yxslV3N-dd0oIabggtRNHi18D28MbZyTc-9xFAnMfxLs Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 8fa714ec7f5a4af0a33f56b45e999a7a Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-AttachVolumeNegativeTest-683705837 Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8fa714ec7f5a4af0a33f56b45e999a7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fa714ec7f5a4af0a33f56b45e999a7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fa714ec7f5a4af0a33f56b45e999a7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8fa714ec7f5a4af0a33f56b45e999a7a"}]}] Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-AttachVolumeNegativeTest-683705837 Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 8fa714ec7f5a4af0a33f56b45e999a7a Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-683705837 Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-AttachVolumeNegativeTest-683705837-project Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 1be686f2aa93473585ca064041bd8140 Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-AttachVolumeNegativeTest-683705837-project Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 3aa190fe-c088-40db-8267-e574e0002a03 could not be found. Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '3aa190fe-c088-40db-8267-e574e0002a03'} Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aa190fe-c088-40db-8267-e574e0002a03 could not be found. Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aa190fe-c088-40db-8267-e574e0002a03 could not be found. Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:51:24.399681 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:51:24.405030 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:24.405030 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:51:24.405030 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:51:24.405030 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:51:24.405030 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:51:24.405030 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aa190fe-c088-40db-8267-e574e0002a03 could not be found. Jul 18 02:51:24.405030 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:51:24.405030 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8e3ac521-9a15-4d66-a819-eaa7c5fa2238 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] Returning 404 to user: Instance 3aa190fe-c088-40db-8267-e574e0002a03 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:51:24.408294 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8e3ac521-9a15-4d66-a819-eaa7c5fa2238 tempest-AttachVolumeNegativeTest-683705837 tempest-AttachVolumeNegativeTest-683705837-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03" status: 404 len: 111 microversion: 2.1 time: 0.131088 Jul 18 02:51:24.415180 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2461/4923] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:24 2022] GET /compute/v2.1/servers/3aa190fe-c088-40db-8267-e574e0002a03 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:51:24.783731 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b2fb3537-146b-466a-9140-13f8cfa1da95 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "POST /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799/action" status: 202 len: 0 microversion: 2.1 time: 3.368705 Jul 18 02:51:24.793120 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2463/4924] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:51:21 2022] POST /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799/action => generated 0 bytes in 3376 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 18 02:51:24.983242 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9de0974f-8642-4c35-b784-1d469af20c2b tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:24.984555 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9de0974f-8642-4c35-b784-1d469af20c2b tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 4b0f1b28-e409-4b2d-ad07-b85f03fd59ae] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:25.032806 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9de0974f-8642-4c35-b784-1d469af20c2b tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:25.036711 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9de0974f-8642-4c35-b784-1d469af20c2b tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:25.043204 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9de0974f-8642-4c35-b784-1d469af20c2b tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:25.046795 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9de0974f-8642-4c35-b784-1d469af20c2b tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:26.312413 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9de0974f-8642-4c35-b784-1d469af20c2b tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949d2267438542afaa92a261f25acef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a114c5309447bb74cd37c180b749d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:26.327657 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9de0974f-8642-4c35-b784-1d469af20c2b tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] 10.222.0.57 "GET /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae" status: 200 len: 1319 microversion: 2.1 time: 1.349036 Jul 18 02:51:26.331099 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2462/4925] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:24 2022] GET /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae => generated 1319 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:27.360941 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:51:27.362349 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:51:27.366985 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d57df211-b226-4b8e-9c85-c994e0769274 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:27.368147 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d57df211-b226-4b8e-9c85-c994e0769274 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 4b0f1b28-e409-4b2d-ad07-b85f03fd59ae] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:27.422232 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d57df211-b226-4b8e-9c85-c994e0769274 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:27.423170 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d57df211-b226-4b8e-9c85-c994e0769274 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:27.427447 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d57df211-b226-4b8e-9c85-c994e0769274 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:27.435288 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d57df211-b226-4b8e-9c85-c994e0769274 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:28.409160 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d57df211-b226-4b8e-9c85-c994e0769274 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949d2267438542afaa92a261f25acef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a114c5309447bb74cd37c180b749d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:28.485052 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d57df211-b226-4b8e-9c85-c994e0769274 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] 10.222.0.57 "GET /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae" status: 200 len: 1319 microversion: 2.1 time: 1.105275 Jul 18 02:51:28.522940 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2464/4926] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:27 2022] GET /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae => generated 1319 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:51:28.930870 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5007d9be-db4c-4a5c-8539-ce54836de92e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-130066858", "imageRef": "438dc10b-bc2f-4000-ae25-caee1b3e3d63", "flavorRef": "452", "networks": [{"uuid": "ba77f5bb-f255-444f-9bd1-1e3dbe42d430"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:51:28.988469 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:51:29.189316 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-5007d9be-db4c-4a5c-8539-ce54836de92e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] validate_networks() for [('ba77f5bb-f255-444f-9bd1-1e3dbe42d430', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:51:29.522687 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-df0de4b0-264e-49b9-90a5-4fbb6b0c814d tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:29.524067 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-df0de4b0-264e-49b9-90a5-4fbb6b0c814d tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 4b0f1b28-e409-4b2d-ad07-b85f03fd59ae] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:29.536796 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-df0de4b0-264e-49b9-90a5-4fbb6b0c814d tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:29.537545 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-df0de4b0-264e-49b9-90a5-4fbb6b0c814d tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:29.538620 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-df0de4b0-264e-49b9-90a5-4fbb6b0c814d tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:29.548312 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-df0de4b0-264e-49b9-90a5-4fbb6b0c814d tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:31.446532 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-df0de4b0-264e-49b9-90a5-4fbb6b0c814d tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949d2267438542afaa92a261f25acef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a114c5309447bb74cd37c180b749d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:31.457866 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-df0de4b0-264e-49b9-90a5-4fbb6b0c814d tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] 10.222.0.57 "GET /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae" status: 200 len: 1319 microversion: 2.1 time: 1.942608 Jul 18 02:51:31.462927 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2465/4927] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:29 2022] GET /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae => generated 1319 bytes in 1948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:51:31.473889 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-4179ce56-78cd-40e5-8afc-130711152c39 req-066d96e6-52c9-4126-bb0b-876edb847d65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b0f1b28-e409-4b2d-ad07-b85f03fd59ae", "tag": "66fc5dc7-004d-47eb-9ee6-b02d78dec0b9"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:51:31.514436 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-4179ce56-78cd-40e5-8afc-130711152c39 req-066d96e6-52c9-4126-bb0b-876edb847d65 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:31.515285 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-4179ce56-78cd-40e5-8afc-130711152c39 req-066d96e6-52c9-4126-bb0b-876edb847d65 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:31.596638 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-4179ce56-78cd-40e5-8afc-130711152c39 req-066d96e6-52c9-4126-bb0b-876edb847d65 service nova] Creating event network-changed:66fc5dc7-004d-47eb-9ee6-b02d78dec0b9 for instance 4b0f1b28-e409-4b2d-ad07-b85f03fd59ae on n-h2-465891-3 Jul 18 02:51:31.642762 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-4179ce56-78cd-40e5-8afc-130711152c39 req-066d96e6-52c9-4126-bb0b-876edb847d65 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153174 Jul 18 02:51:31.653381 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2466/4928] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:51:32.518606 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5ae6099e-3f83-46c9-ba38-6f538d67b39f tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:32.524154 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5ae6099e-3f83-46c9-ba38-6f538d67b39f tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 4b0f1b28-e409-4b2d-ad07-b85f03fd59ae] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:32.565013 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5ae6099e-3f83-46c9-ba38-6f538d67b39f tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:32.566238 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5ae6099e-3f83-46c9-ba38-6f538d67b39f tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:32.572129 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5ae6099e-3f83-46c9-ba38-6f538d67b39f tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:32.576406 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5ae6099e-3f83-46c9-ba38-6f538d67b39f tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:33.522244 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-5007d9be-db4c-4a5c-8539-ce54836de92e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:51:33.523155 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-5007d9be-db4c-4a5c-8539-ce54836de92e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:51:33.523547 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-5007d9be-db4c-4a5c-8539-ce54836de92e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:51:33.523983 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-5007d9be-db4c-4a5c-8539-ce54836de92e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:51:33.525112 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-5007d9be-db4c-4a5c-8539-ce54836de92e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:51:33.583883 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5007d9be-db4c-4a5c-8539-ce54836de92e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:33.585572 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5007d9be-db4c-4a5c-8539-ce54836de92e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:33.587706 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5007d9be-db4c-4a5c-8539-ce54836de92e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:33.588213 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5007d9be-db4c-4a5c-8539-ce54836de92e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:33.655967 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-5007d9be-db4c-4a5c-8539-ce54836de92e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Getting quotas for project 2b7654e273f6487ba83382da4f96056d. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:51:33.672405 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-5007d9be-db4c-4a5c-8539-ce54836de92e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Getting quotas for user d1afc1702f8045a396b98e5c24b124e7 and project 2b7654e273f6487ba83382da4f96056d. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:51:33.712352 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5007d9be-db4c-4a5c-8539-ce54836de92e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:51:33.721329 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5007d9be-db4c-4a5c-8539-ce54836de92e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='225ec353-e691-486f-9391-27ff720bd7e4',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:51:33.896379 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5007d9be-db4c-4a5c-8539-ce54836de92e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.969286 Jul 18 02:51:33.903511 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2463/4929] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:51:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 4977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:51:33.934474 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d4108a24-6d2c-4a49-9a9c-76947bb81594 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:33.936291 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d4108a24-6d2c-4a49-9a9c-76947bb81594 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:34.177387 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5ae6099e-3f83-46c9-ba38-6f538d67b39f tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949d2267438542afaa92a261f25acef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a114c5309447bb74cd37c180b749d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:34.192979 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5ae6099e-3f83-46c9-ba38-6f538d67b39f tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] 10.222.0.57 "GET /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae" status: 200 len: 1319 microversion: 2.1 time: 1.702818 Jul 18 02:51:34.207571 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2467/4930] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:32 2022] GET /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae => generated 1319 bytes in 1720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:34.406423 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d4108a24-6d2c-4a49-9a9c-76947bb81594 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:34.481756 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d4108a24-6d2c-4a49-9a9c-76947bb81594 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1229 microversion: 2.1 time: 0.560796 Jul 18 02:51:34.482926 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2464/4931] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:33 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1229 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:35.217652 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6501b536-c870-40e8-8d21-17283b63aade tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:35.220554 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6501b536-c870-40e8-8d21-17283b63aade tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 4b0f1b28-e409-4b2d-ad07-b85f03fd59ae] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:35.242165 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6501b536-c870-40e8-8d21-17283b63aade tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:35.243067 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6501b536-c870-40e8-8d21-17283b63aade tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:35.248128 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6501b536-c870-40e8-8d21-17283b63aade tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:35.251447 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6501b536-c870-40e8-8d21-17283b63aade tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:35.521894 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-939675a0-fe62-4dc4-b0c7-ffe9de7977aa tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:35.523760 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-939675a0-fe62-4dc4-b0c7-ffe9de7977aa tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:35.574697 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:51:35.591101 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-939675a0-fe62-4dc4-b0c7-ffe9de7977aa tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:35.592716 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-939675a0-fe62-4dc4-b0c7-ffe9de7977aa tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:35.594366 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-939675a0-fe62-4dc4-b0c7-ffe9de7977aa tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:35.595236 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-939675a0-fe62-4dc4-b0c7-ffe9de7977aa tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:35.926256 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-939675a0-fe62-4dc4-b0c7-ffe9de7977aa tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:35.946246 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-939675a0-fe62-4dc4-b0c7-ffe9de7977aa tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1233 microversion: 2.1 time: 0.436049 Jul 18 02:51:35.947184 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2465/4932] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:35 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1233 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:36.745934 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6501b536-c870-40e8-8d21-17283b63aade tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949d2267438542afaa92a261f25acef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a114c5309447bb74cd37c180b749d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:36.785137 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6501b536-c870-40e8-8d21-17283b63aade tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] 10.222.0.57 "GET /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae" status: 200 len: 1319 microversion: 2.1 time: 1.561513 Jul 18 02:51:36.807238 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2468/4933] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:35 2022] GET /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae => generated 1319 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:36.982116 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-74f66a2c-5200-4eda-afe4-be31ecdbf638 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:36.987125 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-74f66a2c-5200-4eda-afe4-be31ecdbf638 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:37.022076 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74f66a2c-5200-4eda-afe4-be31ecdbf638 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:37.024017 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74f66a2c-5200-4eda-afe4-be31ecdbf638 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:37.027210 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74f66a2c-5200-4eda-afe4-be31ecdbf638 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:37.028952 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74f66a2c-5200-4eda-afe4-be31ecdbf638 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:37.227487 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-74f66a2c-5200-4eda-afe4-be31ecdbf638 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:37.240196 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-74f66a2c-5200-4eda-afe4-be31ecdbf638 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1281 microversion: 2.1 time: 0.267969 Jul 18 02:51:37.241473 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2466/4934] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:36 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1281 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:37.833204 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-eb2307ab-3055-4415-841b-777db4fac999 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:37.835924 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-eb2307ab-3055-4415-841b-777db4fac999 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 4b0f1b28-e409-4b2d-ad07-b85f03fd59ae] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:37.851996 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eb2307ab-3055-4415-841b-777db4fac999 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:37.853508 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eb2307ab-3055-4415-841b-777db4fac999 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:37.855510 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eb2307ab-3055-4415-841b-777db4fac999 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:37.858015 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eb2307ab-3055-4415-841b-777db4fac999 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:38.290563 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2a0663a0-2488-4ce4-a34a-e5dfce6fe24f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:38.294464 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2a0663a0-2488-4ce4-a34a-e5dfce6fe24f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:38.360363 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2a0663a0-2488-4ce4-a34a-e5dfce6fe24f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:38.361834 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2a0663a0-2488-4ce4-a34a-e5dfce6fe24f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:38.363844 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2a0663a0-2488-4ce4-a34a-e5dfce6fe24f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:38.367334 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2a0663a0-2488-4ce4-a34a-e5dfce6fe24f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:39.014734 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2a0663a0-2488-4ce4-a34a-e5dfce6fe24f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:39.072233 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2a0663a0-2488-4ce4-a34a-e5dfce6fe24f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1299 microversion: 2.1 time: 0.808501 Jul 18 02:51:39.097745 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2467/4935] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:38 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1299 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:39.762724 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-eb2307ab-3055-4415-841b-777db4fac999 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949d2267438542afaa92a261f25acef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a114c5309447bb74cd37c180b749d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:39.776107 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-eb2307ab-3055-4415-841b-777db4fac999 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] 10.222.0.57 "GET /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae" status: 200 len: 1319 microversion: 2.1 time: 1.953226 Jul 18 02:51:39.781390 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2469/4936] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:37 2022] GET /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae => generated 1319 bytes in 1959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:40.134205 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3db08545-5a3e-4f3b-86c3-a720bd67542f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:40.138713 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3db08545-5a3e-4f3b-86c3-a720bd67542f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:40.179311 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3db08545-5a3e-4f3b-86c3-a720bd67542f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:40.180799 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3db08545-5a3e-4f3b-86c3-a720bd67542f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:40.185327 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3db08545-5a3e-4f3b-86c3-a720bd67542f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:40.192208 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3db08545-5a3e-4f3b-86c3-a720bd67542f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:40.623119 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3db08545-5a3e-4f3b-86c3-a720bd67542f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:40.653635 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3db08545-5a3e-4f3b-86c3-a720bd67542f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1299 microversion: 2.1 time: 0.522048 Jul 18 02:51:40.655032 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2468/4937] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:40 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1299 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:51:40.808327 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ca21a4f0-2277-4d49-80f9-de4b20eb6ce0 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:40.809694 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ca21a4f0-2277-4d49-80f9-de4b20eb6ce0 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 4b0f1b28-e409-4b2d-ad07-b85f03fd59ae] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:40.819382 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:51:40.821383 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ca21a4f0-2277-4d49-80f9-de4b20eb6ce0 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:40.822159 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ca21a4f0-2277-4d49-80f9-de4b20eb6ce0 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:40.823908 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ca21a4f0-2277-4d49-80f9-de4b20eb6ce0 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:40.824604 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ca21a4f0-2277-4d49-80f9-de4b20eb6ce0 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:41.132703 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-86fa1a78-f376-4165-9154-7893dcfee556 req-56930731-8edf-4a0e-8208-1dedf1f93d6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b0f1b28-e409-4b2d-ad07-b85f03fd59ae", "name": "network-vif-plugged", "status": "completed", "tag": "66fc5dc7-004d-47eb-9ee6-b02d78dec0b9"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:51:41.160497 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-86fa1a78-f376-4165-9154-7893dcfee556 req-56930731-8edf-4a0e-8208-1dedf1f93d6f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:41.161188 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-86fa1a78-f376-4165-9154-7893dcfee556 req-56930731-8edf-4a0e-8208-1dedf1f93d6f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:41.195395 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-86fa1a78-f376-4165-9154-7893dcfee556 req-56930731-8edf-4a0e-8208-1dedf1f93d6f service nova] Creating event network-vif-plugged:66fc5dc7-004d-47eb-9ee6-b02d78dec0b9 for instance 4b0f1b28-e409-4b2d-ad07-b85f03fd59ae on n-h2-465891-3 Jul 18 02:51:41.229521 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-86fa1a78-f376-4165-9154-7893dcfee556 req-56930731-8edf-4a0e-8208-1dedf1f93d6f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100747 Jul 18 02:51:41.230233 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2469/4938] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:51:41.680524 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d85902a3-d00a-4d16-9d98-2de5ebaea266 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:41.687601 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d85902a3-d00a-4d16-9d98-2de5ebaea266 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:41.746077 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d85902a3-d00a-4d16-9d98-2de5ebaea266 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:41.759547 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d85902a3-d00a-4d16-9d98-2de5ebaea266 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:41.767786 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d85902a3-d00a-4d16-9d98-2de5ebaea266 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:41.769648 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d85902a3-d00a-4d16-9d98-2de5ebaea266 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:42.338030 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d85902a3-d00a-4d16-9d98-2de5ebaea266 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:42.377558 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d85902a3-d00a-4d16-9d98-2de5ebaea266 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1299 microversion: 2.1 time: 0.707610 Jul 18 02:51:42.379108 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2470/4939] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:41 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1299 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:51:42.793945 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ca21a4f0-2277-4d49-80f9-de4b20eb6ce0 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949d2267438542afaa92a261f25acef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a114c5309447bb74cd37c180b749d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:42.843800 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ca21a4f0-2277-4d49-80f9-de4b20eb6ce0 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] 10.222.0.57 "GET /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae" status: 200 len: 1319 microversion: 2.1 time: 2.038630 Jul 18 02:51:42.871614 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2470/4940] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:40 2022] GET /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae => generated 1319 bytes in 2068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:43.415752 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-faf3b6fa-6a95-40b9-a3ff-da470e528322 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:43.416909 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-faf3b6fa-6a95-40b9-a3ff-da470e528322 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:43.436351 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-faf3b6fa-6a95-40b9-a3ff-da470e528322 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:43.439472 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-faf3b6fa-6a95-40b9-a3ff-da470e528322 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:43.440682 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-faf3b6fa-6a95-40b9-a3ff-da470e528322 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:43.442397 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-faf3b6fa-6a95-40b9-a3ff-da470e528322 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:43.609616 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:51:43.685842 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-faf3b6fa-6a95-40b9-a3ff-da470e528322 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:43.698203 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-faf3b6fa-6a95-40b9-a3ff-da470e528322 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1299 microversion: 2.1 time: 0.292817 Jul 18 02:51:43.700376 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2471/4941] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:43 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1299 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:51:43.889358 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f0f90655-12b7-4178-a1bc-ff9dfb96ff44 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:43.910109 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f0f90655-12b7-4178-a1bc-ff9dfb96ff44 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 4b0f1b28-e409-4b2d-ad07-b85f03fd59ae] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:43.944410 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f0f90655-12b7-4178-a1bc-ff9dfb96ff44 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:43.944888 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f0f90655-12b7-4178-a1bc-ff9dfb96ff44 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:43.989668 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f0f90655-12b7-4178-a1bc-ff9dfb96ff44 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:44.002254 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f0f90655-12b7-4178-a1bc-ff9dfb96ff44 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:44.162242 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-08ac75c5-c979-4308-a298-f42d7810a80a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-305961175", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "be07432b-2b1d-474d-92f9-851b8eed4b56"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1293310360", "security_groups": [{"name": "tempest-secgroup-smoke-583682767"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:51:44.412879 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=8 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:51:45.089297 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f0f90655-12b7-4178-a1bc-ff9dfb96ff44 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949d2267438542afaa92a261f25acef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a114c5309447bb74cd37c180b749d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:45.090306 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-08ac75c5-c979-4308-a298-f42d7810a80a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] validate_networks() for [('be07432b-2b1d-474d-92f9-851b8eed4b56', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:51:45.117986 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f0f90655-12b7-4178-a1bc-ff9dfb96ff44 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] 10.222.0.57 "GET /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae" status: 200 len: 1319 microversion: 2.1 time: 1.235039 Jul 18 02:51:45.134172 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2471/4942] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:43 2022] GET /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae => generated 1319 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:45.173414 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5821a00c-ed4b-40a1-8eb7-05d6f0d1af4b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:45.174375 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5821a00c-ed4b-40a1-8eb7-05d6f0d1af4b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:45.208938 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5821a00c-ed4b-40a1-8eb7-05d6f0d1af4b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:45.209538 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5821a00c-ed4b-40a1-8eb7-05d6f0d1af4b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:45.210515 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5821a00c-ed4b-40a1-8eb7-05d6f0d1af4b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:45.210982 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5821a00c-ed4b-40a1-8eb7-05d6f0d1af4b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:46.370973 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5821a00c-ed4b-40a1-8eb7-05d6f0d1af4b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:46.441346 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5821a00c-ed4b-40a1-8eb7-05d6f0d1af4b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1341 microversion: 2.1 time: 1.305459 Jul 18 02:51:46.454844 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2472/4943] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:45 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1341 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:46.476950 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-44139a32-7cc2-4b7a-8f99-939dd8aee7a7 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:46.477617 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-44139a32-7cc2-4b7a-8f99-939dd8aee7a7 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 4b0f1b28-e409-4b2d-ad07-b85f03fd59ae] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:46.499372 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-44139a32-7cc2-4b7a-8f99-939dd8aee7a7 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:46.499853 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-44139a32-7cc2-4b7a-8f99-939dd8aee7a7 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:46.500750 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-44139a32-7cc2-4b7a-8f99-939dd8aee7a7 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:46.501214 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-44139a32-7cc2-4b7a-8f99-939dd8aee7a7 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:47.474874 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-08ac75c5-c979-4308-a298-f42d7810a80a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:51:47.477535 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-08ac75c5-c979-4308-a298-f42d7810a80a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:51:47.479605 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-08ac75c5-c979-4308-a298-f42d7810a80a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:51:47.481643 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-08ac75c5-c979-4308-a298-f42d7810a80a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:51:47.485044 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-08ac75c5-c979-4308-a298-f42d7810a80a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:51:47.551373 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-08ac75c5-c979-4308-a298-f42d7810a80a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:47.563494 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-08ac75c5-c979-4308-a298-f42d7810a80a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:47.582077 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-08ac75c5-c979-4308-a298-f42d7810a80a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:47.582750 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-08ac75c5-c979-4308-a298-f42d7810a80a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:47.594249 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-44139a32-7cc2-4b7a-8f99-939dd8aee7a7 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949d2267438542afaa92a261f25acef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a114c5309447bb74cd37c180b749d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:47.643315 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-44139a32-7cc2-4b7a-8f99-939dd8aee7a7 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] 10.222.0.57 "GET /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae" status: 200 len: 1507 microversion: 2.1 time: 1.180947 Jul 18 02:51:47.646719 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2473/4944] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:46 2022] GET /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae => generated 1507 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:47.664225 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-08ac75c5-c979-4308-a298-f42d7810a80a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Getting quotas for project fa240dfd375a45efb42fc04807acf847. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:51:47.684997 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-08ac75c5-c979-4308-a298-f42d7810a80a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Getting quotas for user 381a2ab772ff495cb85b89a85a267cfe and project fa240dfd375a45efb42fc04807acf847. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:51:47.696079 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bebca2fa-84f2-4003-9fb1-e6fa1e0df05b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:47.697742 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bebca2fa-84f2-4003-9fb1-e6fa1e0df05b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:47.734997 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bebca2fa-84f2-4003-9fb1-e6fa1e0df05b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:47.746326 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bebca2fa-84f2-4003-9fb1-e6fa1e0df05b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:47.758340 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bebca2fa-84f2-4003-9fb1-e6fa1e0df05b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:47.761014 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bebca2fa-84f2-4003-9fb1-e6fa1e0df05b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:47.762342 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-08ac75c5-c979-4308-a298-f42d7810a80a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:51:47.769453 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-08ac75c5-c979-4308-a298-f42d7810a80a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:51:47.971565 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-08ac75c5-c979-4308-a298-f42d7810a80a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.813208 Jul 18 02:51:47.973207 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2472/4945] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:51:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 3816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:51:47.981881 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-050214cc-b089-4b91-9e38-ec027dc2b8b4 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d367a78-4074-444f-9dca-4e8dddec3243", "device": "/dev/sdb"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:51:47.984199 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-050214cc-b089-4b91-9e38-ec027dc2b8b4 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 4b0f1b28-e409-4b2d-ad07-b85f03fd59ae] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:47.998435 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-050214cc-b089-4b91-9e38-ec027dc2b8b4 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:48.001405 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-050214cc-b089-4b91-9e38-ec027dc2b8b4 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:48.003065 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-050214cc-b089-4b91-9e38-ec027dc2b8b4 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:48.004490 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-050214cc-b089-4b91-9e38-ec027dc2b8b4 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:48.700356 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=90 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:51:49.063137 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bebca2fa-84f2-4003-9fb1-e6fa1e0df05b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:49.091680 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bebca2fa-84f2-4003-9fb1-e6fa1e0df05b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1341 microversion: 2.1 time: 1.439798 Jul 18 02:51:49.101788 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2474/4946] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:47 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1341 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:49.139232 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f3176f9e-9613-4dff-973d-89582966030e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:49.141465 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f3176f9e-9613-4dff-973d-89582966030e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:49.345949 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-050214cc-b089-4b91-9e38-ec027dc2b8b4 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] 10.222.0.57 "POST /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.370272 Jul 18 02:51:49.357466 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2473/4947] 10.222.0.57 () {60 vars in 1322 bytes} [Mon Jul 18 02:51:47 2022] POST /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae/os-volume_attachments => generated 194 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:51:49.438429 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f3176f9e-9613-4dff-973d-89582966030e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:49.463164 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f3176f9e-9613-4dff-973d-89582966030e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1266 microversion: 2.1 time: 0.350760 Jul 18 02:51:49.463855 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2475/4948] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:49 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1266 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:49.911174 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7c37a8d9-b40c-45e9-acf1-d5a51a7a168b tempest-VolumesNegativeTest-2033645997 tempest-VolumesNegativeTest-2033645997-project] Action: 'create', calling method: .version_select at 0x7ff4a835a3a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-738119672", "metadata": {"Type": "work"}}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7c37a8d9-b40c-45e9-acf1-d5a51a7a168b tempest-VolumesNegativeTest-2033645997 tempest-VolumesNegativeTest-2033645997-project] Request method failure captured: Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 121 Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MrEt5qonWQERyRY51LCpkR8qOaMbCdpqtbmUsTVzRXmVAiaErDGrVRHwcphYYTKElAXkKIeZXo44L60j9pMNAXyJRDUP25QxAbvL_b_vPTSjqDqwN-lwYmhFzgerTN2FLeEDuv6Z76yco7mm9WNO8oyeL75EiDP-vdtvGvgfxcrzCM Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 936550511c9b493c8703a00a82363ac5 Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-VolumesNegativeTest-2033645997 Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_936550511c9b493c8703a00a82363ac5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/936550511c9b493c8703a00a82363ac5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/936550511c9b493c8703a00a82363ac5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/936550511c9b493c8703a00a82363ac5"}]}] Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-VolumesNegativeTest-2033645997 Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 936550511c9b493c8703a00a82363ac5 Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-VolumesNegativeTest-2033645997 Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-VolumesNegativeTest-2033645997-project Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 30d786d7056549daaf782064af22b036 Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-VolumesNegativeTest-2033645997-project Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-738119672", "metadata": {"Type": "work"}}} Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-738119672', 'metadata': {'Type': 'work'}}}} Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi '#$%' Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:51:49.927264 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:51:49.937368 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 02:51:49.937368 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:51:49.937368 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:51:49.937368 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:51:49.937368 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:49.937368 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:51:49.937368 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:51:49.937368 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:51:49.937368 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:51:49.937368 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 02:51:49.937368 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:51:49.945671 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7c37a8d9-b40c-45e9-acf1-d5a51a7a168b tempest-VolumesNegativeTest-2033645997 tempest-VolumesNegativeTest-2033645997-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:51:49.950565 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7c37a8d9-b40c-45e9-acf1-d5a51a7a168b tempest-VolumesNegativeTest-2033645997 tempest-VolumesNegativeTest-2033645997-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.589211 Jul 18 02:51:49.975039 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2474/4949] 10.222.0.57 () {60 vars in 1155 bytes} [Mon Jul 18 02:51:49 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 616 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:51:49.991548 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f51da357-cc42-4dc5-9c03-3094958245f4 tempest-VolumesNegativeTest-2033645997 tempest-VolumesNegativeTest-2033645997-project] Action: 'create', calling method: .version_select at 0x7ff49b5594c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-758075893", "metadata": {"Type": "work"}}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f51da357-cc42-4dc5-9c03-3094958245f4 tempest-VolumesNegativeTest-2033645997 tempest-VolumesNegativeTest-2033645997-project] Request method failure captured: Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 119 Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MrEt5qonWQERyRY51LCpkR8qOaMbCdpqtbmUsTVzRXmVAiaErDGrVRHwcphYYTKElAXkKIeZXo44L60j9pMNAXyJRDUP25QxAbvL_b_vPTSjqDqwN-lwYmhFzgerTN2FLeEDuv6Z76yco7mm9WNO8oyeL75EiDP-vdtvGvgfxcrzCM Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 936550511c9b493c8703a00a82363ac5 Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-VolumesNegativeTest-2033645997 Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_936550511c9b493c8703a00a82363ac5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/936550511c9b493c8703a00a82363ac5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/936550511c9b493c8703a00a82363ac5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/936550511c9b493c8703a00a82363ac5"}]}] Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-VolumesNegativeTest-2033645997 Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 936550511c9b493c8703a00a82363ac5 Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-VolumesNegativeTest-2033645997 Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-VolumesNegativeTest-2033645997-project Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 30d786d7056549daaf782064af22b036 Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-VolumesNegativeTest-2033645997-project Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-758075893", "metadata": {"Type": "work"}}} Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-758075893', 'metadata': {'Type': 'work'}}}} Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi '0' Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:51:49.995283 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:51:50.005507 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 02:51:50.005507 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:50.005507 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:51:50.005507 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:50.005507 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:50.005507 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:51:50.005507 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:51:50.005507 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:51:50.005507 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:51:50.005507 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 02:51:50.005507 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:50.005507 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f51da357-cc42-4dc5-9c03-3094958245f4 tempest-VolumesNegativeTest-2033645997 tempest-VolumesNegativeTest-2033645997-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:51:50.005507 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f51da357-cc42-4dc5-9c03-3094958245f4 tempest-VolumesNegativeTest-2033645997 tempest-VolumesNegativeTest-2033645997-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011342 Jul 18 02:51:50.005507 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2476/4950] 10.222.0.57 () {60 vars in 1155 bytes} [Mon Jul 18 02:51:49 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:51:50.015536 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-62fa1128-ff2f-437f-b094-424c4e033187 tempest-VolumesNegativeTest-2033645997 tempest-VolumesNegativeTest-2033645997-project] Action: 'create', calling method: .version_select at 0x7ff4a826cb80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-268057701", "metadata": {"Type": "work"}}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-62fa1128-ff2f-437f-b094-424c4e033187 tempest-VolumesNegativeTest-2033645997 tempest-VolumesNegativeTest-2033645997-project] Request method failure captured: Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 118 Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MrEt5qonWQERyRY51LCpkR8qOaMbCdpqtbmUsTVzRXmVAiaErDGrVRHwcphYYTKElAXkKIeZXo44L60j9pMNAXyJRDUP25QxAbvL_b_vPTSjqDqwN-lwYmhFzgerTN2FLeEDuv6Z76yco7mm9WNO8oyeL75EiDP-vdtvGvgfxcrzCM Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 936550511c9b493c8703a00a82363ac5 Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-VolumesNegativeTest-2033645997 Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_936550511c9b493c8703a00a82363ac5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/936550511c9b493c8703a00a82363ac5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/936550511c9b493c8703a00a82363ac5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/936550511c9b493c8703a00a82363ac5"}]}] Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-VolumesNegativeTest-2033645997 Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 936550511c9b493c8703a00a82363ac5 Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-VolumesNegativeTest-2033645997 Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-VolumesNegativeTest-2033645997-project Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 30d786d7056549daaf782064af22b036 Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-VolumesNegativeTest-2033645997-project Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-268057701", "metadata": {"Type": "work"}}} Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: method: Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-268057701', 'metadata': {'Type': 'work'}}}} Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi '' Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:51:50.051048 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:51:50.057677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 02:51:50.057677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:51:50.057677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:51:50.057677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:51:50.057677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:50.057677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:51:50.057677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:51:50.057677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:51:50.057677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:51:50.057677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 02:51:50.057677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:51:50.057677 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-62fa1128-ff2f-437f-b094-424c4e033187 tempest-VolumesNegativeTest-2033645997 tempest-VolumesNegativeTest-2033645997-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:51:50.057677 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-62fa1128-ff2f-437f-b094-424c4e033187 tempest-VolumesNegativeTest-2033645997 tempest-VolumesNegativeTest-2033645997-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.044791 Jul 18 02:51:50.057677 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2475/4951] 10.222.0.57 () {60 vars in 1155 bytes} [Mon Jul 18 02:51:50 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 18 02:51:50.075253 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c3d6ab0a-b689-4516-8b9d-60441967487f tempest-VolumesNegativeTest-2033645997 tempest-VolumesNegativeTest-2033645997-project] Calling method '.version_select at 0x7ff49b684820>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:50.136750 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4869fb77-183a-4e7f-aa92-5c5062718a0c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:50.137840 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4869fb77-183a-4e7f-aa92-5c5062718a0c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:50.150805 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-c3d6ab0a-b689-4516-8b9d-60441967487f tempest-VolumesNegativeTest-2033645997 tempest-VolumesNegativeTest-2033645997-project] HTTP exception thrown: Volume tempest-invalid-1182260954 could not be found. Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c3d6ab0a-b689-4516-8b9d-60441967487f tempest-VolumesNegativeTest-2033645997 tempest-VolumesNegativeTest-2033645997-project] Request method failure captured: Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1182260954 HTTP/1.1 Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MrEt5qonWQERyRY51LCpkR8qOaMbCdpqtbmUsTVzRXmVAiaErDGrVRHwcphYYTKElAXkKIeZXo44L60j9pMNAXyJRDUP25QxAbvL_b_vPTSjqDqwN-lwYmhFzgerTN2FLeEDuv6Z76yco7mm9WNO8oyeL75EiDP-vdtvGvgfxcrzCM Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 936550511c9b493c8703a00a82363ac5 Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-VolumesNegativeTest-2033645997 Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_936550511c9b493c8703a00a82363ac5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/936550511c9b493c8703a00a82363ac5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/936550511c9b493c8703a00a82363ac5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/936550511c9b493c8703a00a82363ac5"}]}] Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-VolumesNegativeTest-2033645997 Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 936550511c9b493c8703a00a82363ac5 Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-VolumesNegativeTest-2033645997 Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-VolumesNegativeTest-2033645997-project Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 30d786d7056549daaf782064af22b036 Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-VolumesNegativeTest-2033645997-project Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: exception: Volume tempest-invalid-1182260954 could not be found. Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'tempest-invalid-1182260954'} Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1182260954 could not be found. (HTTP 404) (Request-ID: req-ddd15f3e-fcab-4c24-9a96-f5dbd2266a77) Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:51:50.153397 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:51:50.160402 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 02:51:50.160402 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 02:51:50.160402 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 02:51:50.160402 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 02:51:50.160402 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 02:51:50.160402 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 02:51:50.160402 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 02:51:50.160402 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 02:51:50.160402 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:51:50.160402 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:51:50.160402 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:51:50.160402 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:51:50.160402 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1182260954 could not be found. Jul 18 02:51:50.160402 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:50.160402 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:51:50.160402 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:50.160402 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:50.160402 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:51:50.160402 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:51:50.160402 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:51:50.160402 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:51:50.160402 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:51:50.160402 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:51:50.160402 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:51:50.160402 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:51:50.160402 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 02:51:50.160402 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:51:50.160402 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1182260954 could not be found. Jul 18 02:51:50.160402 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:50.160402 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:51:50.160402 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:50.160402 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:50.160402 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:51:50.160402 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:51:50.160402 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:51:50.160402 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:51:50.160402 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1182260954 could not be found. Jul 18 02:51:50.160402 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:50.160402 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c3d6ab0a-b689-4516-8b9d-60441967487f tempest-VolumesNegativeTest-2033645997 tempest-VolumesNegativeTest-2033645997-project] Returning 404 to user: Volume tempest-invalid-1182260954 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:51:50.160402 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c3d6ab0a-b689-4516-8b9d-60441967487f tempest-VolumesNegativeTest-2033645997 tempest-VolumesNegativeTest-2033645997-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1182260954" status: 404 len: 99 microversion: 2.1 time: 0.091490 Jul 18 02:51:50.160402 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2477/4952] 10.222.0.57 () {58 vars in 1217 bytes} [Mon Jul 18 02:51:50 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1182260954 => generated 99 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:51:50.177603 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4869fb77-183a-4e7f-aa92-5c5062718a0c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:50.178100 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4869fb77-183a-4e7f-aa92-5c5062718a0c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:50.178939 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4869fb77-183a-4e7f-aa92-5c5062718a0c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:50.179373 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4869fb77-183a-4e7f-aa92-5c5062718a0c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:50.188486 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b8130604-87fe-4841-9077-930004b6e11f tempest-VolumesNegativeTest-2033645997 tempest-VolumesNegativeTest-2033645997-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.015767 Jul 18 02:51:50.207653 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2478/4953] 10.222.0.57 () {58 vars in 1139 bytes} [Mon Jul 18 02:51:50 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 18 02:51:50.224301 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-554b8645-54ad-4d9d-b387-cbec4b8de4bc tempest-VolumesNegativeTest-2033645997 tempest-VolumesNegativeTest-2033645997-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.015408 Jul 18 02:51:50.224899 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2479/4954] 10.222.0.57 () {58 vars in 1136 bytes} [Mon Jul 18 02:51:50 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 18 02:51:50.256175 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-59089322-1056-406e-b281-402a7d0d7995 tempest-VolumesNegativeTest-2033645997 tempest-VolumesNegativeTest-2033645997-project] Calling method '.version_select at 0x7ff49b556310>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:50.402262 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-59089322-1056-406e-b281-402a7d0d7995 tempest-VolumesNegativeTest-2033645997 tempest-VolumesNegativeTest-2033645997-project] HTTP exception thrown: Volume c7deffdb-eb06-4b68-afd3-9990511146ff could not be found. Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-59089322-1056-406e-b281-402a7d0d7995 tempest-VolumesNegativeTest-2033645997 tempest-VolumesNegativeTest-2033645997-project] Request method failure captured: Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/os-volumes/c7deffdb-eb06-4b68-afd3-9990511146ff HTTP/1.1 Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MrEt5qonWQERyRY51LCpkR8qOaMbCdpqtbmUsTVzRXmVAiaErDGrVRHwcphYYTKElAXkKIeZXo44L60j9pMNAXyJRDUP25QxAbvL_b_vPTSjqDqwN-lwYmhFzgerTN2FLeEDuv6Z76yco7mm9WNO8oyeL75EiDP-vdtvGvgfxcrzCM Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 936550511c9b493c8703a00a82363ac5 Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-VolumesNegativeTest-2033645997 Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_936550511c9b493c8703a00a82363ac5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/936550511c9b493c8703a00a82363ac5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/936550511c9b493c8703a00a82363ac5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/936550511c9b493c8703a00a82363ac5"}]}] Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-VolumesNegativeTest-2033645997 Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 936550511c9b493c8703a00a82363ac5 Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-VolumesNegativeTest-2033645997 Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-VolumesNegativeTest-2033645997-project Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 30d786d7056549daaf782064af22b036 Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-VolumesNegativeTest-2033645997-project Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: exception: Volume c7deffdb-eb06-4b68-afd3-9990511146ff could not be found. Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'c7deffdb-eb06-4b68-afd3-9990511146ff'} Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c7deffdb-eb06-4b68-afd3-9990511146ff could not be found. (HTTP 404) (Request-ID: req-e0179edd-1b6a-49c4-9e4e-056856df9272) Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 02:51:50.406828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:51:50.416312 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:51:50.416312 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 02:51:50.416312 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 02:51:50.416312 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 02:51:50.416312 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 02:51:50.416312 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 02:51:50.416312 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 02:51:50.416312 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 02:51:50.416312 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 02:51:50.416312 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:51:50.416312 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:51:50.416312 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:51:50.416312 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:51:50.416312 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c7deffdb-eb06-4b68-afd3-9990511146ff could not be found. Jul 18 02:51:50.416312 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:50.416312 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:51:50.416312 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:50.416312 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:50.416312 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:51:50.416312 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:51:50.416312 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:51:50.416312 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:51:50.416312 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:51:50.416312 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:51:50.416312 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:51:50.416312 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:51:50.416312 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 02:51:50.416312 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:51:50.416312 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c7deffdb-eb06-4b68-afd3-9990511146ff could not be found. Jul 18 02:51:50.416312 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:50.416312 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:51:50.416312 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:50.416312 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:50.416312 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:51:50.416312 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:51:50.416312 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:51:50.416312 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:51:50.416312 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c7deffdb-eb06-4b68-afd3-9990511146ff could not be found. Jul 18 02:51:50.416312 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:50.430030 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-59089322-1056-406e-b281-402a7d0d7995 tempest-VolumesNegativeTest-2033645997 tempest-VolumesNegativeTest-2033645997-project] Returning 404 to user: Volume c7deffdb-eb06-4b68-afd3-9990511146ff could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:51:50.439226 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-59089322-1056-406e-b281-402a7d0d7995 tempest-VolumesNegativeTest-2033645997 tempest-VolumesNegativeTest-2033645997-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/c7deffdb-eb06-4b68-afd3-9990511146ff" status: 404 len: 109 microversion: 2.1 time: 0.196288 Jul 18 02:51:50.444778 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2480/4955] 10.222.0.57 () {58 vars in 1247 bytes} [Mon Jul 18 02:51:50 2022] DELETE /compute/v2.1/os-volumes/c7deffdb-eb06-4b68-afd3-9990511146ff => generated 109 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:51:50.509520 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-aeb595d3-8e05-4f5c-9dca-73d280e2cecb req-99195ff3-ef45-4c83-b639-dddf657c15e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf71e56d-5a67-439f-9781-6c0356dc8d6f", "tag": "5de70f3f-f955-4161-a978-f15f4ed4addf"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:51:50.593924 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-aeb595d3-8e05-4f5c-9dca-73d280e2cecb req-99195ff3-ef45-4c83-b639-dddf657c15e3 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:50.594966 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-aeb595d3-8e05-4f5c-9dca-73d280e2cecb req-99195ff3-ef45-4c83-b639-dddf657c15e3 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:50.700305 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:51:50.711991 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-aeb595d3-8e05-4f5c-9dca-73d280e2cecb req-99195ff3-ef45-4c83-b639-dddf657c15e3 service nova] Creating event network-changed:5de70f3f-f955-4161-a978-f15f4ed4addf for instance bf71e56d-5a67-439f-9781-6c0356dc8d6f on n-h1-465891-3 Jul 18 02:51:50.734770 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-aeb595d3-8e05-4f5c-9dca-73d280e2cecb req-99195ff3-ef45-4c83-b639-dddf657c15e3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.281515 Jul 18 02:51:50.738218 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2481/4956] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:51:50.794527 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f237b099-44ab-46af-b1c8-c99306d4b7b9 tempest-VolumesNegativeTest-2033645997 tempest-VolumesNegativeTest-2033645997-project] Calling method '.version_select at 0x7ff49b639ca0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:50.960627 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-f237b099-44ab-46af-b1c8-c99306d4b7b9 tempest-VolumesNegativeTest-2033645997 tempest-VolumesNegativeTest-2033645997-project] HTTP exception thrown: Volume 12c9962d-8812-4014-b7e2-de2d63e05a51 could not be found. Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f237b099-44ab-46af-b1c8-c99306d4b7b9 tempest-VolumesNegativeTest-2033645997 tempest-VolumesNegativeTest-2033645997-project] Request method failure captured: Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/os-volumes/12c9962d-8812-4014-b7e2-de2d63e05a51 HTTP/1.1 Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MrEt5qonWQERyRY51LCpkR8qOaMbCdpqtbmUsTVzRXmVAiaErDGrVRHwcphYYTKElAXkKIeZXo44L60j9pMNAXyJRDUP25QxAbvL_b_vPTSjqDqwN-lwYmhFzgerTN2FLeEDuv6Z76yco7mm9WNO8oyeL75EiDP-vdtvGvgfxcrzCM Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 936550511c9b493c8703a00a82363ac5 Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-VolumesNegativeTest-2033645997 Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_936550511c9b493c8703a00a82363ac5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/936550511c9b493c8703a00a82363ac5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/936550511c9b493c8703a00a82363ac5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/936550511c9b493c8703a00a82363ac5"}]}] Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-VolumesNegativeTest-2033645997 Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 936550511c9b493c8703a00a82363ac5 Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-VolumesNegativeTest-2033645997 Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-VolumesNegativeTest-2033645997-project Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 30d786d7056549daaf782064af22b036 Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-VolumesNegativeTest-2033645997-project Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: exception: Volume 12c9962d-8812-4014-b7e2-de2d63e05a51 could not be found. Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '12c9962d-8812-4014-b7e2-de2d63e05a51'} Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 12c9962d-8812-4014-b7e2-de2d63e05a51 could not be found. (HTTP 404) (Request-ID: req-08d535ee-03f4-4f2c-9cf2-37847905c651) Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 02:51:50.965127 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:51:50.980321 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:51:50.980321 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 02:51:50.980321 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 02:51:50.980321 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 02:51:50.980321 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 02:51:50.980321 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 02:51:50.980321 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 02:51:50.980321 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 02:51:50.980321 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 02:51:50.980321 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:51:50.980321 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:51:50.980321 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:51:50.980321 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:51:50.980321 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 12c9962d-8812-4014-b7e2-de2d63e05a51 could not be found. Jul 18 02:51:50.980321 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:50.980321 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:51:50.980321 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:50.980321 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:50.980321 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:51:50.980321 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:51:50.980321 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:51:50.980321 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:51:50.980321 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:51:50.980321 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:51:50.980321 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:51:50.980321 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:51:50.980321 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 02:51:50.980321 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:51:50.980321 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 12c9962d-8812-4014-b7e2-de2d63e05a51 could not be found. Jul 18 02:51:50.980321 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:50.980321 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:51:50.980321 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:50.980321 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:50.980321 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:51:50.980321 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:51:50.980321 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:51:50.980321 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:51:50.980321 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 12c9962d-8812-4014-b7e2-de2d63e05a51 could not be found. Jul 18 02:51:50.980321 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:51:50.980321 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f237b099-44ab-46af-b1c8-c99306d4b7b9 tempest-VolumesNegativeTest-2033645997 tempest-VolumesNegativeTest-2033645997-project] Returning 404 to user: Volume 12c9962d-8812-4014-b7e2-de2d63e05a51 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:51:50.980321 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f237b099-44ab-46af-b1c8-c99306d4b7b9 tempest-VolumesNegativeTest-2033645997 tempest-VolumesNegativeTest-2033645997-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/12c9962d-8812-4014-b7e2-de2d63e05a51" status: 404 len: 109 microversion: 2.1 time: 0.227091 Jul 18 02:51:50.980321 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2482/4957] 10.222.0.57 () {58 vars in 1244 bytes} [Mon Jul 18 02:51:50 2022] GET /compute/v2.1/os-volumes/12c9962d-8812-4014-b7e2-de2d63e05a51 => generated 109 bytes in 231 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:51:51.009891 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-15ed9a00-bcdc-4261-a3d8-9e1164e06981 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:51.032687 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-15ed9a00-bcdc-4261-a3d8-9e1164e06981 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:51.100128 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-15ed9a00-bcdc-4261-a3d8-9e1164e06981 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:51.101163 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-15ed9a00-bcdc-4261-a3d8-9e1164e06981 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:51.103016 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-15ed9a00-bcdc-4261-a3d8-9e1164e06981 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:51.103834 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-15ed9a00-bcdc-4261-a3d8-9e1164e06981 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:51.255159 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4869fb77-183a-4e7f-aa92-5c5062718a0c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:51.282192 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4869fb77-183a-4e7f-aa92-5c5062718a0c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1341 microversion: 2.1 time: 1.154627 Jul 18 02:51:51.310016 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2476/4958] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:50 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1341 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:51:51.520244 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-15ed9a00-bcdc-4261-a3d8-9e1164e06981 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:51.596984 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-15ed9a00-bcdc-4261-a3d8-9e1164e06981 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1318 microversion: 2.1 time: 0.619835 Jul 18 02:51:51.605521 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2483/4959] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:50 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1318 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:52.324611 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7f90783c-bf18-442e-9fbc-926590d389d5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:52.328078 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7f90783c-bf18-442e-9fbc-926590d389d5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:52.392977 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7f90783c-bf18-442e-9fbc-926590d389d5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:52.416126 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7f90783c-bf18-442e-9fbc-926590d389d5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:52.426238 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7f90783c-bf18-442e-9fbc-926590d389d5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:52.446756 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7f90783c-bf18-442e-9fbc-926590d389d5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:52.645153 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5788b8de-ba70-4597-bdad-4c5e7a6207ec tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:52.654332 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5788b8de-ba70-4597-bdad-4c5e7a6207ec tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:52.706012 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5788b8de-ba70-4597-bdad-4c5e7a6207ec tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:52.706519 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5788b8de-ba70-4597-bdad-4c5e7a6207ec tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:52.707423 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5788b8de-ba70-4597-bdad-4c5e7a6207ec tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:52.708136 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5788b8de-ba70-4597-bdad-4c5e7a6207ec tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:53.148039 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5788b8de-ba70-4597-bdad-4c5e7a6207ec tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:53.166514 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5788b8de-ba70-4597-bdad-4c5e7a6207ec tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1324 microversion: 2.1 time: 0.528343 Jul 18 02:51:53.168869 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2484/4960] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:52 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1324 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:53.565324 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7f90783c-bf18-442e-9fbc-926590d389d5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:53.591152 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7f90783c-bf18-442e-9fbc-926590d389d5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1341 microversion: 2.1 time: 1.270873 Jul 18 02:51:53.603820 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2477/4961] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:52 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1341 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:51:54.191155 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4708be21-e5f1-4e23-8108-0ab6a8862bd7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:54.192070 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4708be21-e5f1-4e23-8108-0ab6a8862bd7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:54.243555 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4708be21-e5f1-4e23-8108-0ab6a8862bd7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:54.245244 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4708be21-e5f1-4e23-8108-0ab6a8862bd7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:54.247087 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4708be21-e5f1-4e23-8108-0ab6a8862bd7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:54.248936 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4708be21-e5f1-4e23-8108-0ab6a8862bd7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:54.616894 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d9c1518c-32f4-4407-86d2-8d99f403dc49 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:54.627168 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d9c1518c-32f4-4407-86d2-8d99f403dc49 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:54.660189 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d9c1518c-32f4-4407-86d2-8d99f403dc49 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:54.661571 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d9c1518c-32f4-4407-86d2-8d99f403dc49 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:54.671589 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d9c1518c-32f4-4407-86d2-8d99f403dc49 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:54.676272 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d9c1518c-32f4-4407-86d2-8d99f403dc49 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:54.699193 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4708be21-e5f1-4e23-8108-0ab6a8862bd7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:54.750343 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4708be21-e5f1-4e23-8108-0ab6a8862bd7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1324 microversion: 2.1 time: 0.567550 Jul 18 02:51:54.766593 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2485/4962] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:54 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1324 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:55.785905 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e1e99086-140f-4c2d-97f9-134217683a3d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:55.788439 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e1e99086-140f-4c2d-97f9-134217683a3d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:55.846914 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e1e99086-140f-4c2d-97f9-134217683a3d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:55.856479 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e1e99086-140f-4c2d-97f9-134217683a3d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:55.861213 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e1e99086-140f-4c2d-97f9-134217683a3d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:55.870636 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e1e99086-140f-4c2d-97f9-134217683a3d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:56.474034 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e1e99086-140f-4c2d-97f9-134217683a3d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:56.489443 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e1e99086-140f-4c2d-97f9-134217683a3d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1324 microversion: 2.1 time: 0.713275 Jul 18 02:51:56.495667 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2486/4963] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:55 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1324 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:51:56.724605 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d9c1518c-32f4-4407-86d2-8d99f403dc49 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:56.761866 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d9c1518c-32f4-4407-86d2-8d99f403dc49 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1341 microversion: 2.1 time: 2.151595 Jul 18 02:51:56.779866 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2478/4964] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:54 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1341 bytes in 2171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:57.525486 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9f5623a7-b95c-4421-9557-dc25906b3174 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:57.526351 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9f5623a7-b95c-4421-9557-dc25906b3174 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:57.574734 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9f5623a7-b95c-4421-9557-dc25906b3174 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:57.585430 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9f5623a7-b95c-4421-9557-dc25906b3174 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:57.597185 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9f5623a7-b95c-4421-9557-dc25906b3174 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:57.598227 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9f5623a7-b95c-4421-9557-dc25906b3174 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:57.797893 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d2656042-f1ee-4177-949a-6000938634f2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:57.798932 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d2656042-f1ee-4177-949a-6000938634f2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:57.800929 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:51:57.806026 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:51:57.829326 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d2656042-f1ee-4177-949a-6000938634f2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:57.829326 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d2656042-f1ee-4177-949a-6000938634f2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:57.830223 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d2656042-f1ee-4177-949a-6000938634f2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:57.830689 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d2656042-f1ee-4177-949a-6000938634f2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:58.018972 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9f5623a7-b95c-4421-9557-dc25906b3174 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:58.065688 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9f5623a7-b95c-4421-9557-dc25906b3174 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1324 microversion: 2.1 time: 0.547841 Jul 18 02:51:58.079950 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2487/4965] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:57 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1324 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:59.100800 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-80be6987-afd8-4351-b6d4-27ec33440b69 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:59.101603 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-80be6987-afd8-4351-b6d4-27ec33440b69 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:59.129541 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-80be6987-afd8-4351-b6d4-27ec33440b69 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:59.130046 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-80be6987-afd8-4351-b6d4-27ec33440b69 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:59.135171 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-80be6987-afd8-4351-b6d4-27ec33440b69 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:59.140601 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-80be6987-afd8-4351-b6d4-27ec33440b69 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:59.212283 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d2656042-f1ee-4177-949a-6000938634f2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:59.237074 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d2656042-f1ee-4177-949a-6000938634f2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1341 microversion: 2.1 time: 1.441158 Jul 18 02:51:59.254509 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2479/4966] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:57 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1341 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:52:00.272115 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0f7b3d68-7ebd-43a2-b56f-3d134072919c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:00.283725 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:52:00.286259 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0f7b3d68-7ebd-43a2-b56f-3d134072919c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:00.320808 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f7b3d68-7ebd-43a2-b56f-3d134072919c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:00.329126 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f7b3d68-7ebd-43a2-b56f-3d134072919c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:00.339700 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f7b3d68-7ebd-43a2-b56f-3d134072919c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:00.343182 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f7b3d68-7ebd-43a2-b56f-3d134072919c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:01.616444 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0f7b3d68-7ebd-43a2-b56f-3d134072919c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:01.630985 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0f7b3d68-7ebd-43a2-b56f-3d134072919c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1341 microversion: 2.1 time: 1.372349 Jul 18 02:52:01.634582 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2480/4967] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:00 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1341 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:01.644431 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-80be6987-afd8-4351-b6d4-27ec33440b69 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:01.658334 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-80be6987-afd8-4351-b6d4-27ec33440b69 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1391 microversion: 2.1 time: 2.568436 Jul 18 02:52:01.659565 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2488/4968] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:59 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1391 bytes in 2572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:02.678424 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d8878e86-5686-40b9-8d12-0e278a75bcf9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:02.689718 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d8878e86-5686-40b9-8d12-0e278a75bcf9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:02.720734 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d8878e86-5686-40b9-8d12-0e278a75bcf9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:02.724085 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d8878e86-5686-40b9-8d12-0e278a75bcf9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:02.753269 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d8878e86-5686-40b9-8d12-0e278a75bcf9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:02.756981 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d8878e86-5686-40b9-8d12-0e278a75bcf9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:03.113284 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c834ac76-a273-4c52-8101-8fef1aeccc29 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-797753968", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "f1f26ed6-586a-467c-9157-5484c33591b4"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:52:03.261013 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-c834ac76-a273-4c52-8101-8fef1aeccc29 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] validate_networks() for [('f1f26ed6-586a-467c-9157-5484c33591b4', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:52:03.644966 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d8878e86-5686-40b9-8d12-0e278a75bcf9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:03.681504 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d8878e86-5686-40b9-8d12-0e278a75bcf9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1341 microversion: 2.1 time: 1.023634 Jul 18 02:52:03.686083 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2489/4969] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:02 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1341 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:03.711689 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1cb32e7a-690c-43b7-a8bc-6a4bc70cb3a7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:03.713684 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1cb32e7a-690c-43b7-a8bc-6a4bc70cb3a7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:03.735481 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1cb32e7a-690c-43b7-a8bc-6a4bc70cb3a7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:03.736035 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1cb32e7a-690c-43b7-a8bc-6a4bc70cb3a7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:03.740910 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1cb32e7a-690c-43b7-a8bc-6a4bc70cb3a7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:03.740910 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1cb32e7a-690c-43b7-a8bc-6a4bc70cb3a7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:04.461525 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1cb32e7a-690c-43b7-a8bc-6a4bc70cb3a7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:04.490849 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1cb32e7a-690c-43b7-a8bc-6a4bc70cb3a7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1391 microversion: 2.1 time: 0.800178 Jul 18 02:52:04.503424 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2490/4970] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:03 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1391 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:04.509826 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-78646e88-7756-4051-8408-b27f4140df34 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:04.511070 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-78646e88-7756-4051-8408-b27f4140df34 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:04.520323 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-78646e88-7756-4051-8408-b27f4140df34 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:04.521312 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-78646e88-7756-4051-8408-b27f4140df34 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:04.522498 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-78646e88-7756-4051-8408-b27f4140df34 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:04.523892 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-78646e88-7756-4051-8408-b27f4140df34 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:04.901470 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-78646e88-7756-4051-8408-b27f4140df34 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:04.945394 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-78646e88-7756-4051-8408-b27f4140df34 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 0.435812 Jul 18 02:52:04.959479 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2491/4971] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:04 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:04.973250 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-d0308ed8-cdf6-420d-a65f-f9616bbd182b req-18f5af4d-886e-4f48-b538-7358495d5d2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7e39afc-8fed-4b7d-92d3-171c7958f9a3", "tag": "244acca8-8b4b-42ec-8102-3eaf458487ea"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:52:04.975905 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-c834ac76-a273-4c52-8101-8fef1aeccc29 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:52:04.978892 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-c834ac76-a273-4c52-8101-8fef1aeccc29 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:52:04.980753 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-c834ac76-a273-4c52-8101-8fef1aeccc29 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:52:04.985614 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-c834ac76-a273-4c52-8101-8fef1aeccc29 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:52:04.989347 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-c834ac76-a273-4c52-8101-8fef1aeccc29 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:52:05.000774 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-d0308ed8-cdf6-420d-a65f-f9616bbd182b req-18f5af4d-886e-4f48-b538-7358495d5d2a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:05.001591 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-d0308ed8-cdf6-420d-a65f-f9616bbd182b req-18f5af4d-886e-4f48-b538-7358495d5d2a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:05.032938 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c834ac76-a273-4c52-8101-8fef1aeccc29 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:05.035633 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c834ac76-a273-4c52-8101-8fef1aeccc29 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:05.038055 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c834ac76-a273-4c52-8101-8fef1aeccc29 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:05.039355 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c834ac76-a273-4c52-8101-8fef1aeccc29 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:05.041151 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-d0308ed8-cdf6-420d-a65f-f9616bbd182b req-18f5af4d-886e-4f48-b538-7358495d5d2a service nova] Creating event network-changed:244acca8-8b4b-42ec-8102-3eaf458487ea for instance c7e39afc-8fed-4b7d-92d3-171c7958f9a3 on n-h2-465891-3 Jul 18 02:52:05.051242 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-d0308ed8-cdf6-420d-a65f-f9616bbd182b req-18f5af4d-886e-4f48-b538-7358495d5d2a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084288 Jul 18 02:52:05.052313 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2492/4972] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:52:05.062077 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-251f0dc6-15b1-49f8-ae4d-947fde6c528a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:05.063228 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-251f0dc6-15b1-49f8-ae4d-947fde6c528a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:05.072990 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-c834ac76-a273-4c52-8101-8fef1aeccc29 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Getting quotas for project a0e9412ed01a461abd5b33d4881af25f. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:52:05.073496 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-251f0dc6-15b1-49f8-ae4d-947fde6c528a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:05.074128 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-251f0dc6-15b1-49f8-ae4d-947fde6c528a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:05.077958 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-251f0dc6-15b1-49f8-ae4d-947fde6c528a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:05.078503 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-251f0dc6-15b1-49f8-ae4d-947fde6c528a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:05.081616 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-c834ac76-a273-4c52-8101-8fef1aeccc29 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Getting quotas for user bce09d11ea674ed5a4b257c4fee6037a and project a0e9412ed01a461abd5b33d4881af25f. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:52:05.103256 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c834ac76-a273-4c52-8101-8fef1aeccc29 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:52:05.107833 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c834ac76-a273-4c52-8101-8fef1aeccc29 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] [instance: 478ddfd6-6a86-4727-aa35-10f859812f64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:52:05.182052 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c834ac76-a273-4c52-8101-8fef1aeccc29 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.013276 Jul 18 02:52:05.190828 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2481/4973] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:52:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 3024 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:52:05.197988 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6c84bb10-e90c-409e-a42a-fed53f91beb9 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-889135518"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:52:05.201839 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6c84bb10-e90c-409e-a42a-fed53f91beb9 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:05.212118 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6c84bb10-e90c-409e-a42a-fed53f91beb9 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:05.212951 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6c84bb10-e90c-409e-a42a-fed53f91beb9 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:05.213916 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6c84bb10-e90c-409e-a42a-fed53f91beb9 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:05.214613 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6c84bb10-e90c-409e-a42a-fed53f91beb9 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:05.430175 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-251f0dc6-15b1-49f8-ae4d-947fde6c528a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:05.441760 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-251f0dc6-15b1-49f8-ae4d-947fde6c528a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1341 microversion: 2.1 time: 0.387905 Jul 18 02:52:05.442776 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2493/4974] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:05 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1341 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:05.453228 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-20c556db-8ed6-461c-9139-c15a33c92b68 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:05.454342 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-20c556db-8ed6-461c-9139-c15a33c92b68 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] [instance: 478ddfd6-6a86-4727-aa35-10f859812f64] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:05.610268 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-20c556db-8ed6-461c-9139-c15a33c92b68 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce09d11ea674ed5a4b257c4fee6037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e9412ed01a461abd5b33d4881af25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:05.620899 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-20c556db-8ed6-461c-9139-c15a33c92b68 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] 10.222.0.57 "GET /compute/v2.1/servers/478ddfd6-6a86-4727-aa35-10f859812f64" status: 200 len: 1213 microversion: 2.1 time: 0.176963 Jul 18 02:52:05.623002 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2494/4975] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:05 2022] GET /compute/v2.1/servers/478ddfd6-6a86-4727-aa35-10f859812f64 => generated 1213 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:05.629087 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c0dbf8e6-bcc5-489e-8f52-e2f7b4ecf34a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:05.630179 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c0dbf8e6-bcc5-489e-8f52-e2f7b4ecf34a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:05.641458 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c0dbf8e6-bcc5-489e-8f52-e2f7b4ecf34a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:05.643503 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c0dbf8e6-bcc5-489e-8f52-e2f7b4ecf34a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:05.647143 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c0dbf8e6-bcc5-489e-8f52-e2f7b4ecf34a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:05.648060 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c0dbf8e6-bcc5-489e-8f52-e2f7b4ecf34a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:05.873146 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6c84bb10-e90c-409e-a42a-fed53f91beb9 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "POST /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e/action" status: 202 len: 0 microversion: 2.1 time: 0.679115 Jul 18 02:52:05.875634 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2482/4976] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:52:05 2022] POST /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e/action => generated 0 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 18 02:52:05.988256 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c0dbf8e6-bcc5-489e-8f52-e2f7b4ecf34a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:06.000915 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c0dbf8e6-bcc5-489e-8f52-e2f7b4ecf34a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1391 microversion: 2.1 time: 0.375776 Jul 18 02:52:06.001658 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2495/4977] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:05 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1391 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:06.469857 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d58cd6df-2425-441a-ac55-90d271a13123 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:06.470786 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d58cd6df-2425-441a-ac55-90d271a13123 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:06.473317 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:52:06.520997 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d58cd6df-2425-441a-ac55-90d271a13123 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:06.524174 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d58cd6df-2425-441a-ac55-90d271a13123 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:06.531911 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d58cd6df-2425-441a-ac55-90d271a13123 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:06.534308 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d58cd6df-2425-441a-ac55-90d271a13123 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:06.640466 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ac80b4c3-2889-4aeb-a785-6a3c76e47e0a tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:06.641110 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ac80b4c3-2889-4aeb-a785-6a3c76e47e0a tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] [instance: 478ddfd6-6a86-4727-aa35-10f859812f64] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:06.651722 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ac80b4c3-2889-4aeb-a785-6a3c76e47e0a tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:06.652193 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ac80b4c3-2889-4aeb-a785-6a3c76e47e0a tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:06.653595 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ac80b4c3-2889-4aeb-a785-6a3c76e47e0a tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:06.661926 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ac80b4c3-2889-4aeb-a785-6a3c76e47e0a tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:06.890028 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ac80b4c3-2889-4aeb-a785-6a3c76e47e0a tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce09d11ea674ed5a4b257c4fee6037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e9412ed01a461abd5b33d4881af25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:06.900372 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ac80b4c3-2889-4aeb-a785-6a3c76e47e0a tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] 10.222.0.57 "GET /compute/v2.1/servers/478ddfd6-6a86-4727-aa35-10f859812f64" status: 200 len: 1209 microversion: 2.1 time: 0.264683 Jul 18 02:52:06.912760 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2496/4978] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:06 2022] GET /compute/v2.1/servers/478ddfd6-6a86-4727-aa35-10f859812f64 => generated 1209 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:52:07.019762 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b30195e8-7ae4-4e4d-83ce-b56905d9e0a9 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:07.021544 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b30195e8-7ae4-4e4d-83ce-b56905d9e0a9 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:07.035784 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b30195e8-7ae4-4e4d-83ce-b56905d9e0a9 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:07.037581 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b30195e8-7ae4-4e4d-83ce-b56905d9e0a9 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:07.041844 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b30195e8-7ae4-4e4d-83ce-b56905d9e0a9 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:07.042467 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b30195e8-7ae4-4e4d-83ce-b56905d9e0a9 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:07.058540 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d58cd6df-2425-441a-ac55-90d271a13123 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:07.071686 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d58cd6df-2425-441a-ac55-90d271a13123 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1341 microversion: 2.1 time: 0.607339 Jul 18 02:52:07.073236 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2483/4979] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:06 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1341 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:07.536578 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b30195e8-7ae4-4e4d-83ce-b56905d9e0a9 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:07.576465 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b30195e8-7ae4-4e4d-83ce-b56905d9e0a9 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1391 microversion: 2.1 time: 0.561399 Jul 18 02:52:07.577544 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2497/4980] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:07 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1391 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:52:07.889246 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-6af18745-92fa-407a-926f-3996c4dab036 req-0b6e9841-7ad9-4356-8096-220f4c005537 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69bbb844-4d56-4e75-ae50-9c35c9ce6f9e", "name": "network-vif-unplugged", "status": "completed", "tag": "d926d5af-f867-44cd-8b60-abb0339ecf2a"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:52:07.903425 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-6af18745-92fa-407a-926f-3996c4dab036 req-0b6e9841-7ad9-4356-8096-220f4c005537 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:07.904395 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-6af18745-92fa-407a-926f-3996c4dab036 req-0b6e9841-7ad9-4356-8096-220f4c005537 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:07.919652 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-91f45450-2b02-4739-80be-16df1a520c24 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:07.920695 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-91f45450-2b02-4739-80be-16df1a520c24 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] [instance: 478ddfd6-6a86-4727-aa35-10f859812f64] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:07.931659 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-91f45450-2b02-4739-80be-16df1a520c24 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:07.932686 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-91f45450-2b02-4739-80be-16df1a520c24 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:07.934050 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-91f45450-2b02-4739-80be-16df1a520c24 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:07.935087 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-91f45450-2b02-4739-80be-16df1a520c24 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:07.955693 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-6af18745-92fa-407a-926f-3996c4dab036 req-0b6e9841-7ad9-4356-8096-220f4c005537 service nova] Creating event network-vif-unplugged:d926d5af-f867-44cd-8b60-abb0339ecf2a for instance 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e on n-h2-465891-3 Jul 18 02:52:07.962553 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-6af18745-92fa-407a-926f-3996c4dab036 req-0b6e9841-7ad9-4356-8096-220f4c005537 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081303 Jul 18 02:52:07.964354 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2484/4981] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:52:08.033095 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-91f45450-2b02-4739-80be-16df1a520c24 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce09d11ea674ed5a4b257c4fee6037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e9412ed01a461abd5b33d4881af25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:08.053090 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-91f45450-2b02-4739-80be-16df1a520c24 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] 10.222.0.57 "GET /compute/v2.1/servers/478ddfd6-6a86-4727-aa35-10f859812f64" status: 200 len: 1271 microversion: 2.1 time: 0.136785 Jul 18 02:52:08.055422 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2498/4982] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:07 2022] GET /compute/v2.1/servers/478ddfd6-6a86-4727-aa35-10f859812f64 => generated 1271 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:08.104255 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d4237bae-de8a-4e97-bf58-71b64ec6140c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:08.105391 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d4237bae-de8a-4e97-bf58-71b64ec6140c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:08.114610 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d4237bae-de8a-4e97-bf58-71b64ec6140c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:08.115267 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d4237bae-de8a-4e97-bf58-71b64ec6140c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:08.116243 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d4237bae-de8a-4e97-bf58-71b64ec6140c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:08.117020 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d4237bae-de8a-4e97-bf58-71b64ec6140c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:08.483742 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d4237bae-de8a-4e97-bf58-71b64ec6140c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:08.495101 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d4237bae-de8a-4e97-bf58-71b64ec6140c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1341 microversion: 2.1 time: 0.396264 Jul 18 02:52:08.498801 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2485/4983] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:08 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1341 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:08.606591 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b12b66c7-2bcb-4bc4-a1db-bbe4f820e81f tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:08.609618 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b12b66c7-2bcb-4bc4-a1db-bbe4f820e81f tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:08.629884 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b12b66c7-2bcb-4bc4-a1db-bbe4f820e81f tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:08.631158 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b12b66c7-2bcb-4bc4-a1db-bbe4f820e81f tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:08.633931 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b12b66c7-2bcb-4bc4-a1db-bbe4f820e81f tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:08.634733 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b12b66c7-2bcb-4bc4-a1db-bbe4f820e81f tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:09.082101 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8075c2c1-35c6-4234-bf66-b2e46f649fff tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:09.085440 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8075c2c1-35c6-4234-bf66-b2e46f649fff tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] [instance: 478ddfd6-6a86-4727-aa35-10f859812f64] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:09.110829 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8075c2c1-35c6-4234-bf66-b2e46f649fff tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:09.126194 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8075c2c1-35c6-4234-bf66-b2e46f649fff tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:09.131137 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8075c2c1-35c6-4234-bf66-b2e46f649fff tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:09.131917 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8075c2c1-35c6-4234-bf66-b2e46f649fff tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:09.316754 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8075c2c1-35c6-4234-bf66-b2e46f649fff tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce09d11ea674ed5a4b257c4fee6037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e9412ed01a461abd5b33d4881af25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:09.330879 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8075c2c1-35c6-4234-bf66-b2e46f649fff tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] 10.222.0.57 "GET /compute/v2.1/servers/478ddfd6-6a86-4727-aa35-10f859812f64" status: 200 len: 1271 microversion: 2.1 time: 0.261585 Jul 18 02:52:09.331905 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2486/4984] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:09 2022] GET /compute/v2.1/servers/478ddfd6-6a86-4727-aa35-10f859812f64 => generated 1271 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:09.480491 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b12b66c7-2bcb-4bc4-a1db-bbe4f820e81f tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:09.498544 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b12b66c7-2bcb-4bc4-a1db-bbe4f820e81f tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1391 microversion: 2.1 time: 0.905380 Jul 18 02:52:09.509383 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2499/4985] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:08 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1391 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:09.523902 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-17ae917d-1026-4c17-b905-853d89e732ee tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:09.525083 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-17ae917d-1026-4c17-b905-853d89e732ee tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:09.537964 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-17ae917d-1026-4c17-b905-853d89e732ee tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:09.538654 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-17ae917d-1026-4c17-b905-853d89e732ee tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:09.540214 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-17ae917d-1026-4c17-b905-853d89e732ee tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:09.540695 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-17ae917d-1026-4c17-b905-853d89e732ee tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:09.982515 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-17ae917d-1026-4c17-b905-853d89e732ee tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:09.998060 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-17ae917d-1026-4c17-b905-853d89e732ee tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1341 microversion: 2.1 time: 0.481695 Jul 18 02:52:09.999150 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2487/4986] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:09 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1341 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:10.028713 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-8dc67257-f734-40af-981e-bd1b2dcd2200 req-8ba775f9-b30d-4c33-9b27-a8e897809e63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e39afc-8fed-4b7d-92d3-171c7958f9a3", "name": "network-vif-plugged", "status": "completed", "tag": "244acca8-8b4b-42ec-8102-3eaf458487ea"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:52:10.057269 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-8dc67257-f734-40af-981e-bd1b2dcd2200 req-8ba775f9-b30d-4c33-9b27-a8e897809e63 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:10.060425 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-8dc67257-f734-40af-981e-bd1b2dcd2200 req-8ba775f9-b30d-4c33-9b27-a8e897809e63 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:10.089038 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-8dc67257-f734-40af-981e-bd1b2dcd2200 req-8ba775f9-b30d-4c33-9b27-a8e897809e63 service nova] Creating event network-vif-plugged:244acca8-8b4b-42ec-8102-3eaf458487ea for instance c7e39afc-8fed-4b7d-92d3-171c7958f9a3 on n-h2-465891-3 Jul 18 02:52:10.101541 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-8dc67257-f734-40af-981e-bd1b2dcd2200 req-8ba775f9-b30d-4c33-9b27-a8e897809e63 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084580 Jul 18 02:52:10.103501 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2500/4987] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:52:10.371591 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a752cbf7-b3e9-4beb-b089-0dce863e87fe tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:10.374611 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a752cbf7-b3e9-4beb-b089-0dce863e87fe tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] [instance: 478ddfd6-6a86-4727-aa35-10f859812f64] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:10.394087 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a752cbf7-b3e9-4beb-b089-0dce863e87fe tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:10.394786 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a752cbf7-b3e9-4beb-b089-0dce863e87fe tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:10.395830 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a752cbf7-b3e9-4beb-b089-0dce863e87fe tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:10.396424 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a752cbf7-b3e9-4beb-b089-0dce863e87fe tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:10.517446 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dab8a2c8-580c-4e46-9994-08a23f041667 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:10.522378 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-dab8a2c8-580c-4e46-9994-08a23f041667 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:10.539216 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dab8a2c8-580c-4e46-9994-08a23f041667 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:10.540015 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dab8a2c8-580c-4e46-9994-08a23f041667 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:10.541328 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dab8a2c8-580c-4e46-9994-08a23f041667 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:10.542052 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dab8a2c8-580c-4e46-9994-08a23f041667 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:10.889628 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a752cbf7-b3e9-4beb-b089-0dce863e87fe tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce09d11ea674ed5a4b257c4fee6037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e9412ed01a461abd5b33d4881af25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:10.903408 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a752cbf7-b3e9-4beb-b089-0dce863e87fe tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] 10.222.0.57 "GET /compute/v2.1/servers/478ddfd6-6a86-4727-aa35-10f859812f64" status: 200 len: 1313 microversion: 2.1 time: 0.541350 Jul 18 02:52:10.907295 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2488/4988] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:10 2022] GET /compute/v2.1/servers/478ddfd6-6a86-4727-aa35-10f859812f64 => generated 1313 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:11.027404 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d1a68767-eb7a-4ffa-bb1c-419bf93d2d62 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:11.029109 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d1a68767-eb7a-4ffa-bb1c-419bf93d2d62 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:11.039779 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d1a68767-eb7a-4ffa-bb1c-419bf93d2d62 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:11.040245 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d1a68767-eb7a-4ffa-bb1c-419bf93d2d62 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:11.044435 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d1a68767-eb7a-4ffa-bb1c-419bf93d2d62 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:11.045167 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d1a68767-eb7a-4ffa-bb1c-419bf93d2d62 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:11.273472 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-dab8a2c8-580c-4e46-9994-08a23f041667 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:11.283560 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:52:11.316909 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-dab8a2c8-580c-4e46-9994-08a23f041667 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1391 microversion: 2.1 time: 0.801955 Jul 18 02:52:11.325383 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2501/4989] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:10 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1391 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:52:11.493042 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d1a68767-eb7a-4ffa-bb1c-419bf93d2d62 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:11.516779 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d1a68767-eb7a-4ffa-bb1c-419bf93d2d62 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1341 microversion: 2.1 time: 0.493097 Jul 18 02:52:11.518540 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2489/4990] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:11 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1341 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:52:11.951954 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e4367e1a-2742-4437-b309-dd82c615056b tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:11.955968 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e4367e1a-2742-4437-b309-dd82c615056b tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] [instance: 478ddfd6-6a86-4727-aa35-10f859812f64] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:11.976322 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=56 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:52:12.012956 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e4367e1a-2742-4437-b309-dd82c615056b tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:12.014577 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e4367e1a-2742-4437-b309-dd82c615056b tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:12.031139 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e4367e1a-2742-4437-b309-dd82c615056b tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:12.039286 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e4367e1a-2742-4437-b309-dd82c615056b tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:12.258877 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-b5efbcf5-a133-4c40-89ef-cf4e9cb9b830 req-f81e305b-121a-4691-b437-7868d692668b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "478ddfd6-6a86-4727-aa35-10f859812f64", "tag": "c7b18272-5545-44ed-acf7-93d0b8a87e4f"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:52:12.272992 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-b5efbcf5-a133-4c40-89ef-cf4e9cb9b830 req-f81e305b-121a-4691-b437-7868d692668b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:12.282510 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-b5efbcf5-a133-4c40-89ef-cf4e9cb9b830 req-f81e305b-121a-4691-b437-7868d692668b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:12.328956 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-b5efbcf5-a133-4c40-89ef-cf4e9cb9b830 req-f81e305b-121a-4691-b437-7868d692668b service nova] Creating event network-changed:c7b18272-5545-44ed-acf7-93d0b8a87e4f for instance 478ddfd6-6a86-4727-aa35-10f859812f64 on n-h1-465891-3 Jul 18 02:52:12.340354 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-b5efbcf5-a133-4c40-89ef-cf4e9cb9b830 req-f81e305b-121a-4691-b437-7868d692668b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080722 Jul 18 02:52:12.343651 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2490/4991] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:52:12.369291 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d992592f-8570-4b48-9fbd-f72c54dcf03d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:12.378887 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d992592f-8570-4b48-9fbd-f72c54dcf03d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:12.388518 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d992592f-8570-4b48-9fbd-f72c54dcf03d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:12.394590 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d992592f-8570-4b48-9fbd-f72c54dcf03d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:12.395764 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d992592f-8570-4b48-9fbd-f72c54dcf03d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:12.396412 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d992592f-8570-4b48-9fbd-f72c54dcf03d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:12.998984 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e4367e1a-2742-4437-b309-dd82c615056b tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce09d11ea674ed5a4b257c4fee6037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e9412ed01a461abd5b33d4881af25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:13.030106 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e4367e1a-2742-4437-b309-dd82c615056b tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] 10.222.0.57 "GET /compute/v2.1/servers/478ddfd6-6a86-4727-aa35-10f859812f64" status: 200 len: 1313 microversion: 2.1 time: 1.096332 Jul 18 02:52:13.031232 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2502/4992] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:11 2022] GET /compute/v2.1/servers/478ddfd6-6a86-4727-aa35-10f859812f64 => generated 1313 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:13.062742 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a5963461-55ab-43a2-8681-3f054444f54a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:13.064024 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a5963461-55ab-43a2-8681-3f054444f54a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:13.087530 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a5963461-55ab-43a2-8681-3f054444f54a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:13.088495 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a5963461-55ab-43a2-8681-3f054444f54a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:13.091529 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a5963461-55ab-43a2-8681-3f054444f54a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:13.092449 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a5963461-55ab-43a2-8681-3f054444f54a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:13.314074 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d992592f-8570-4b48-9fbd-f72c54dcf03d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:13.331103 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d992592f-8570-4b48-9fbd-f72c54dcf03d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1391 microversion: 2.1 time: 0.977483 Jul 18 02:52:13.337844 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2491/4993] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:12 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1391 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:13.928644 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a5963461-55ab-43a2-8681-3f054444f54a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:13.936676 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-774e601b-40d8-45a9-899e-7ae8bee8b2a8 req-b15e56da-67b5-48f4-91f0-cbadc4e0004c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69bbb844-4d56-4e75-ae50-9c35c9ce6f9e", "name": "network-vif-plugged", "status": "completed", "tag": "d926d5af-f867-44cd-8b60-abb0339ecf2a"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:52:13.947219 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-774e601b-40d8-45a9-899e-7ae8bee8b2a8 req-b15e56da-67b5-48f4-91f0-cbadc4e0004c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:13.951993 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-774e601b-40d8-45a9-899e-7ae8bee8b2a8 req-b15e56da-67b5-48f4-91f0-cbadc4e0004c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:13.954415 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a5963461-55ab-43a2-8681-3f054444f54a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1341 microversion: 2.1 time: 0.916934 Jul 18 02:52:13.959017 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2503/4994] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:13 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1341 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:13.965259 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:52:14.013146 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-774e601b-40d8-45a9-899e-7ae8bee8b2a8 req-b15e56da-67b5-48f4-91f0-cbadc4e0004c service nova] Creating event network-vif-plugged:d926d5af-f867-44cd-8b60-abb0339ecf2a for instance 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e on n-h2-465891-3 Jul 18 02:52:14.037920 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-774e601b-40d8-45a9-899e-7ae8bee8b2a8 req-b15e56da-67b5-48f4-91f0-cbadc4e0004c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114736 Jul 18 02:52:14.038284 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2492/4995] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 18 02:52:14.070623 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-18ca920c-8431-4f24-826e-97aaa7b67c4d tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:14.076915 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-18ca920c-8431-4f24-826e-97aaa7b67c4d tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] [instance: 478ddfd6-6a86-4727-aa35-10f859812f64] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:14.097688 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-18ca920c-8431-4f24-826e-97aaa7b67c4d tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:14.099109 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-18ca920c-8431-4f24-826e-97aaa7b67c4d tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:14.102221 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-18ca920c-8431-4f24-826e-97aaa7b67c4d tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:14.103558 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-18ca920c-8431-4f24-826e-97aaa7b67c4d tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:14.379549 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-06c1ed3d-9bd8-4091-9c36-d559816744d8 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:14.381263 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-06c1ed3d-9bd8-4091-9c36-d559816744d8 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:14.429379 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-06c1ed3d-9bd8-4091-9c36-d559816744d8 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:14.430188 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-06c1ed3d-9bd8-4091-9c36-d559816744d8 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:14.431518 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-06c1ed3d-9bd8-4091-9c36-d559816744d8 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:14.453043 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-06c1ed3d-9bd8-4091-9c36-d559816744d8 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:14.573581 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-18ca920c-8431-4f24-826e-97aaa7b67c4d tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce09d11ea674ed5a4b257c4fee6037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e9412ed01a461abd5b33d4881af25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:14.588936 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-18ca920c-8431-4f24-826e-97aaa7b67c4d tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] 10.222.0.57 "GET /compute/v2.1/servers/478ddfd6-6a86-4727-aa35-10f859812f64" status: 200 len: 1313 microversion: 2.1 time: 0.542180 Jul 18 02:52:14.610647 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2504/4996] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:14 2022] GET /compute/v2.1/servers/478ddfd6-6a86-4727-aa35-10f859812f64 => generated 1313 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:14.892974 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-06c1ed3d-9bd8-4091-9c36-d559816744d8 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:15.041095 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-06c1ed3d-9bd8-4091-9c36-d559816744d8 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1564 microversion: 2.1 time: 0.670069 Jul 18 02:52:15.041508 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3e575c2b-8441-44e4-a7dc-2c3673099e34 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:15.044046 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3e575c2b-8441-44e4-a7dc-2c3673099e34 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:15.057456 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2493/4997] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:14 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1564 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:15.105971 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2fd84e74-56ac-455d-8350-f14c45ca364b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:15.110892 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2fd84e74-56ac-455d-8350-f14c45ca364b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:15.114038 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3e575c2b-8441-44e4-a7dc-2c3673099e34 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:15.135377 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3e575c2b-8441-44e4-a7dc-2c3673099e34 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:15.138290 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3e575c2b-8441-44e4-a7dc-2c3673099e34 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:15.154447 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3e575c2b-8441-44e4-a7dc-2c3673099e34 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:15.169419 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:52:15.171159 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:52:15.185988 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2fd84e74-56ac-455d-8350-f14c45ca364b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:15.186790 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2fd84e74-56ac-455d-8350-f14c45ca364b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:15.206548 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2fd84e74-56ac-455d-8350-f14c45ca364b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:15.207447 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2fd84e74-56ac-455d-8350-f14c45ca364b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:15.618985 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:52:15.660574 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3e575c2b-8441-44e4-a7dc-2c3673099e34 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:15.676544 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3e575c2b-8441-44e4-a7dc-2c3673099e34 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1341 microversion: 2.1 time: 0.654181 Jul 18 02:52:15.690339 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2505/4998] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:15 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1341 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:15.703157 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9c0034c7-4e6c-4d34-ad1c-0baed654f7d4 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:15.704704 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9c0034c7-4e6c-4d34-ad1c-0baed654f7d4 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] [instance: 478ddfd6-6a86-4727-aa35-10f859812f64] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:15.716547 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9c0034c7-4e6c-4d34-ad1c-0baed654f7d4 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:15.717831 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9c0034c7-4e6c-4d34-ad1c-0baed654f7d4 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:15.719464 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9c0034c7-4e6c-4d34-ad1c-0baed654f7d4 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:15.720469 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9c0034c7-4e6c-4d34-ad1c-0baed654f7d4 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:15.834965 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2fd84e74-56ac-455d-8350-f14c45ca364b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:15.868309 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2fd84e74-56ac-455d-8350-f14c45ca364b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1564 microversion: 2.1 time: 0.799037 Jul 18 02:52:15.870890 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2494/4999] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:15 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1564 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:16.104699 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9c0034c7-4e6c-4d34-ad1c-0baed654f7d4 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce09d11ea674ed5a4b257c4fee6037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e9412ed01a461abd5b33d4881af25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:16.124601 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9c0034c7-4e6c-4d34-ad1c-0baed654f7d4 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] 10.222.0.57 "GET /compute/v2.1/servers/478ddfd6-6a86-4727-aa35-10f859812f64" status: 200 len: 1313 microversion: 2.1 time: 0.431994 Jul 18 02:52:16.134487 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2506/5000] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:15 2022] GET /compute/v2.1/servers/478ddfd6-6a86-4727-aa35-10f859812f64 => generated 1313 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:16.709116 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2dcd71cd-7876-461a-ae72-6531caea9e5f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:16.712493 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2dcd71cd-7876-461a-ae72-6531caea9e5f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:16.743246 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2dcd71cd-7876-461a-ae72-6531caea9e5f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:16.748038 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2dcd71cd-7876-461a-ae72-6531caea9e5f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:16.750551 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2dcd71cd-7876-461a-ae72-6531caea9e5f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:16.751814 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2dcd71cd-7876-461a-ae72-6531caea9e5f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:17.165866 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-eeb30c06-baea-4fe1-b3ab-d8dc182e0222 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:17.168990 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-eeb30c06-baea-4fe1-b3ab-d8dc182e0222 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] [instance: 478ddfd6-6a86-4727-aa35-10f859812f64] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:17.196032 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eeb30c06-baea-4fe1-b3ab-d8dc182e0222 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:17.197213 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eeb30c06-baea-4fe1-b3ab-d8dc182e0222 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:17.199586 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eeb30c06-baea-4fe1-b3ab-d8dc182e0222 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:17.200833 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eeb30c06-baea-4fe1-b3ab-d8dc182e0222 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:18.073692 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2dcd71cd-7876-461a-ae72-6531caea9e5f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:18.097481 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2dcd71cd-7876-461a-ae72-6531caea9e5f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1387 microversion: 2.1 time: 1.394852 Jul 18 02:52:18.098838 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2495/5001] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:16 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1387 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:18.248262 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-eeb30c06-baea-4fe1-b3ab-d8dc182e0222 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce09d11ea674ed5a4b257c4fee6037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e9412ed01a461abd5b33d4881af25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:18.272422 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-eeb30c06-baea-4fe1-b3ab-d8dc182e0222 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] 10.222.0.57 "GET /compute/v2.1/servers/478ddfd6-6a86-4727-aa35-10f859812f64" status: 200 len: 1313 microversion: 2.1 time: 1.121972 Jul 18 02:52:18.281346 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2507/5002] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:17 2022] GET /compute/v2.1/servers/478ddfd6-6a86-4727-aa35-10f859812f64 => generated 1313 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:52:19.140296 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-98f0d20d-23b9-4e77-ab88-4ed8798d96a2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:19.147460 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-98f0d20d-23b9-4e77-ab88-4ed8798d96a2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:19.204848 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-98f0d20d-23b9-4e77-ab88-4ed8798d96a2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:19.205635 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-98f0d20d-23b9-4e77-ab88-4ed8798d96a2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:19.207620 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-98f0d20d-23b9-4e77-ab88-4ed8798d96a2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:19.208433 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-98f0d20d-23b9-4e77-ab88-4ed8798d96a2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:19.309502 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b885185a-65e4-41d8-b5d4-4bdba2b57748 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:19.311403 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b885185a-65e4-41d8-b5d4-4bdba2b57748 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] [instance: 478ddfd6-6a86-4727-aa35-10f859812f64] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:19.373457 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b885185a-65e4-41d8-b5d4-4bdba2b57748 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:19.377385 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b885185a-65e4-41d8-b5d4-4bdba2b57748 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:19.379165 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b885185a-65e4-41d8-b5d4-4bdba2b57748 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:19.380057 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b885185a-65e4-41d8-b5d4-4bdba2b57748 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:20.681496 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-98f0d20d-23b9-4e77-ab88-4ed8798d96a2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:20.700842 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-98f0d20d-23b9-4e77-ab88-4ed8798d96a2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1375 microversion: 2.1 time: 1.571043 Jul 18 02:52:20.701789 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2496/5003] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:19 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1375 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:20.849667 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b885185a-65e4-41d8-b5d4-4bdba2b57748 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce09d11ea674ed5a4b257c4fee6037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e9412ed01a461abd5b33d4881af25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:20.904950 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b885185a-65e4-41d8-b5d4-4bdba2b57748 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] 10.222.0.57 "GET /compute/v2.1/servers/478ddfd6-6a86-4727-aa35-10f859812f64" status: 200 len: 1313 microversion: 2.1 time: 1.598521 Jul 18 02:52:20.932197 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2508/5004] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:19 2022] GET /compute/v2.1/servers/478ddfd6-6a86-4727-aa35-10f859812f64 => generated 1313 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:21.741748 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bb1d47cc-6e8d-45c5-bb49-9ca9aa8e20bf tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:21.746677 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bb1d47cc-6e8d-45c5-bb49-9ca9aa8e20bf tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:21.796953 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb1d47cc-6e8d-45c5-bb49-9ca9aa8e20bf tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:21.798350 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb1d47cc-6e8d-45c5-bb49-9ca9aa8e20bf tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:21.800135 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb1d47cc-6e8d-45c5-bb49-9ca9aa8e20bf tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:21.801522 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb1d47cc-6e8d-45c5-bb49-9ca9aa8e20bf tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:21.946784 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bc55d7a8-fef5-4b4b-ba76-405850991f10 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:21.946784 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bc55d7a8-fef5-4b4b-ba76-405850991f10 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] [instance: 478ddfd6-6a86-4727-aa35-10f859812f64] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:22.000943 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bc55d7a8-fef5-4b4b-ba76-405850991f10 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:22.006944 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bc55d7a8-fef5-4b4b-ba76-405850991f10 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:22.013117 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bc55d7a8-fef5-4b4b-ba76-405850991f10 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:22.014028 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bc55d7a8-fef5-4b4b-ba76-405850991f10 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:23.279438 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bb1d47cc-6e8d-45c5-bb49-9ca9aa8e20bf tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:23.291330 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bc55d7a8-fef5-4b4b-ba76-405850991f10 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce09d11ea674ed5a4b257c4fee6037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e9412ed01a461abd5b33d4881af25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:23.318323 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bc55d7a8-fef5-4b4b-ba76-405850991f10 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] 10.222.0.57 "GET /compute/v2.1/servers/478ddfd6-6a86-4727-aa35-10f859812f64" status: 200 len: 1313 microversion: 2.1 time: 1.378482 Jul 18 02:52:23.320252 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bb1d47cc-6e8d-45c5-bb49-9ca9aa8e20bf tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1375 microversion: 2.1 time: 1.590785 Jul 18 02:52:23.328446 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2497/5005] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:21 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1375 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:23.331891 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2509/5006] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:21 2022] GET /compute/v2.1/servers/478ddfd6-6a86-4727-aa35-10f859812f64 => generated 1313 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:23.343436 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2d26d6c1-ab4d-435f-a25f-71b2c6cfe733 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:23.344396 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2d26d6c1-ab4d-435f-a25f-71b2c6cfe733 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:23.381877 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2d26d6c1-ab4d-435f-a25f-71b2c6cfe733 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:23.387965 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2d26d6c1-ab4d-435f-a25f-71b2c6cfe733 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:23.395404 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2d26d6c1-ab4d-435f-a25f-71b2c6cfe733 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:23.395956 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2d26d6c1-ab4d-435f-a25f-71b2c6cfe733 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:23.535010 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2d26d6c1-ab4d-435f-a25f-71b2c6cfe733 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.202171 Jul 18 02:52:23.580433 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2498/5007] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:52:23 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5/os-volume_attachments => generated 25 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:52:23.731631 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-308ef64d-208d-44ff-ad22-a92fe8a9b5c4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:23.732622 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-308ef64d-208d-44ff-ad22-a92fe8a9b5c4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:23.748497 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-308ef64d-208d-44ff-ad22-a92fe8a9b5c4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:23.751345 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-308ef64d-208d-44ff-ad22-a92fe8a9b5c4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:23.763569 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-308ef64d-208d-44ff-ad22-a92fe8a9b5c4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:23.768789 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-308ef64d-208d-44ff-ad22-a92fe8a9b5c4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:23.863048 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-308ef64d-208d-44ff-ad22-a92fe8a9b5c4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:52:24.023890 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-9fb2f615-e2d4-4a25-a196-ebd6db98c895 req-2b8118fa-6fc7-431e-aa63-1e2b7c9cd059 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "478ddfd6-6a86-4727-aa35-10f859812f64", "name": "network-vif-plugged", "status": "completed", "tag": "c7b18272-5545-44ed-acf7-93d0b8a87e4f"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:52:24.066887 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-9fb2f615-e2d4-4a25-a196-ebd6db98c895 req-2b8118fa-6fc7-431e-aa63-1e2b7c9cd059 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:24.071276 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-9fb2f615-e2d4-4a25-a196-ebd6db98c895 req-2b8118fa-6fc7-431e-aa63-1e2b7c9cd059 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:24.128752 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-308ef64d-208d-44ff-ad22-a92fe8a9b5c4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 204 len: 0 microversion: 2.1 time: 0.402097 Jul 18 02:52:24.138295 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2510/5008] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:52:23 2022] DELETE /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:52:24.159849 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d7fccffb-9908-4342-ad2f-c28c30bbdf88 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:24.172574 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d7fccffb-9908-4342-ad2f-c28c30bbdf88 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:24.195769 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-9fb2f615-e2d4-4a25-a196-ebd6db98c895 req-2b8118fa-6fc7-431e-aa63-1e2b7c9cd059 service nova] Creating event network-vif-plugged:c7b18272-5545-44ed-acf7-93d0b8a87e4f for instance 478ddfd6-6a86-4727-aa35-10f859812f64 on n-h1-465891-3 Jul 18 02:52:24.228550 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d7fccffb-9908-4342-ad2f-c28c30bbdf88 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:24.230050 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d7fccffb-9908-4342-ad2f-c28c30bbdf88 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:24.231200 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d7fccffb-9908-4342-ad2f-c28c30bbdf88 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:24.235396 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-9fb2f615-e2d4-4a25-a196-ebd6db98c895 req-2b8118fa-6fc7-431e-aa63-1e2b7c9cd059 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.215286 Jul 18 02:52:24.239007 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d7fccffb-9908-4342-ad2f-c28c30bbdf88 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:24.240833 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2499/5009] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:52:24.365956 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bb53effa-b267-4751-917d-83716b87106a tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:24.367836 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bb53effa-b267-4751-917d-83716b87106a tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] [instance: 478ddfd6-6a86-4727-aa35-10f859812f64] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:24.384488 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb53effa-b267-4751-917d-83716b87106a tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:24.392983 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb53effa-b267-4751-917d-83716b87106a tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:24.394542 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb53effa-b267-4751-917d-83716b87106a tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:24.398060 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb53effa-b267-4751-917d-83716b87106a tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:25.055495 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d7fccffb-9908-4342-ad2f-c28c30bbdf88 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:25.090769 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d7fccffb-9908-4342-ad2f-c28c30bbdf88 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 200 len: 1671 microversion: 2.1 time: 0.939100 Jul 18 02:52:25.102983 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2511/5010] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:24 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 1671 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:25.142144 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bb53effa-b267-4751-917d-83716b87106a tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce09d11ea674ed5a4b257c4fee6037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e9412ed01a461abd5b33d4881af25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:25.145504 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-75e2e9da-360a-4e2a-b9a6-13cb42bd4429 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:25.153577 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-75e2e9da-360a-4e2a-b9a6-13cb42bd4429 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:25.181728 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-75e2e9da-360a-4e2a-b9a6-13cb42bd4429 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:25.188465 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bb53effa-b267-4751-917d-83716b87106a tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] 10.222.0.57 "GET /compute/v2.1/servers/478ddfd6-6a86-4727-aa35-10f859812f64" status: 200 len: 1313 microversion: 2.1 time: 0.851369 Jul 18 02:52:25.189540 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2500/5011] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:24 2022] GET /compute/v2.1/servers/478ddfd6-6a86-4727-aa35-10f859812f64 => generated 1313 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:25.190608 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-75e2e9da-360a-4e2a-b9a6-13cb42bd4429 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:25.194298 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-75e2e9da-360a-4e2a-b9a6-13cb42bd4429 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:25.195499 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-75e2e9da-360a-4e2a-b9a6-13cb42bd4429 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:25.678369 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-75e2e9da-360a-4e2a-b9a6-13cb42bd4429 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:25.704983 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-75e2e9da-360a-4e2a-b9a6-13cb42bd4429 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1375 microversion: 2.1 time: 0.591203 Jul 18 02:52:25.708685 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2512/5012] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:25 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1375 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:26.038425 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8a6bb7cd-cc6d-4bb6-a5c9-cffa46f6ca81 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:26.061206 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8a6bb7cd-cc6d-4bb6-a5c9-cffa46f6ca81 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:26.063613 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-0ab4707e-2478-47ad-bafa-2f988adf8783 req-4d2b22b7-24b1-4c82-850b-5b5a85f52608 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7e39afc-8fed-4b7d-92d3-171c7958f9a3", "tag": "244acca8-8b4b-42ec-8102-3eaf458487ea"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:52:26.133519 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a6bb7cd-cc6d-4bb6-a5c9-cffa46f6ca81 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:26.141061 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a6bb7cd-cc6d-4bb6-a5c9-cffa46f6ca81 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:26.149827 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a6bb7cd-cc6d-4bb6-a5c9-cffa46f6ca81 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:26.153301 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-0ab4707e-2478-47ad-bafa-2f988adf8783 req-4d2b22b7-24b1-4c82-850b-5b5a85f52608 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:26.154960 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a6bb7cd-cc6d-4bb6-a5c9-cffa46f6ca81 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:26.159435 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-0ab4707e-2478-47ad-bafa-2f988adf8783 req-4d2b22b7-24b1-4c82-850b-5b5a85f52608 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:26.222700 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-0ab4707e-2478-47ad-bafa-2f988adf8783 req-4d2b22b7-24b1-4c82-850b-5b5a85f52608 service nova] Creating event network-changed:244acca8-8b4b-42ec-8102-3eaf458487ea for instance c7e39afc-8fed-4b7d-92d3-171c7958f9a3 on n-h2-465891-3 Jul 18 02:52:26.253518 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-0ab4707e-2478-47ad-bafa-2f988adf8783 req-4d2b22b7-24b1-4c82-850b-5b5a85f52608 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.201861 Jul 18 02:52:26.256067 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2513/5013] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:52:26.284447 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c76e2c91-b233-492d-a3de-07b343122eee tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:26.292913 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c76e2c91-b233-492d-a3de-07b343122eee tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:26.360962 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c76e2c91-b233-492d-a3de-07b343122eee tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:26.366841 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c76e2c91-b233-492d-a3de-07b343122eee tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:26.374414 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c76e2c91-b233-492d-a3de-07b343122eee tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:26.384467 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c76e2c91-b233-492d-a3de-07b343122eee tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:27.830342 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c76e2c91-b233-492d-a3de-07b343122eee tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:27.845407 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c76e2c91-b233-492d-a3de-07b343122eee tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 200 len: 1671 microversion: 2.1 time: 1.587404 Jul 18 02:52:27.846415 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2514/5014] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:26 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 1671 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:27.851934 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-68ef3b19-705c-4fe2-919e-000339f18a14 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:27.860826 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-68ef3b19-705c-4fe2-919e-000339f18a14 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] [instance: 478ddfd6-6a86-4727-aa35-10f859812f64] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:27.877919 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-68ef3b19-705c-4fe2-919e-000339f18a14 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:27.881096 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-68ef3b19-705c-4fe2-919e-000339f18a14 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:27.883226 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-68ef3b19-705c-4fe2-919e-000339f18a14 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:27.885910 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-68ef3b19-705c-4fe2-919e-000339f18a14 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:29.122213 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-68ef3b19-705c-4fe2-919e-000339f18a14 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce09d11ea674ed5a4b257c4fee6037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e9412ed01a461abd5b33d4881af25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:29.139974 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-68ef3b19-705c-4fe2-919e-000339f18a14 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] 10.222.0.57 "GET /compute/v2.1/servers/478ddfd6-6a86-4727-aa35-10f859812f64" status: 200 len: 1313 microversion: 2.1 time: 1.292073 Jul 18 02:52:29.140600 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2515/5015] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:27 2022] GET /compute/v2.1/servers/478ddfd6-6a86-4727-aa35-10f859812f64 => generated 1313 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:29.166711 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-56ac2c7e-580a-47ee-b68e-2cb1bb5b62e7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:29.178467 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-56ac2c7e-580a-47ee-b68e-2cb1bb5b62e7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:29.189529 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8a6bb7cd-cc6d-4bb6-a5c9-cffa46f6ca81 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:29.212484 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56ac2c7e-580a-47ee-b68e-2cb1bb5b62e7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:29.212927 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56ac2c7e-580a-47ee-b68e-2cb1bb5b62e7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:29.214705 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56ac2c7e-580a-47ee-b68e-2cb1bb5b62e7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:29.215241 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56ac2c7e-580a-47ee-b68e-2cb1bb5b62e7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:29.248769 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8a6bb7cd-cc6d-4bb6-a5c9-cffa46f6ca81 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1564 microversion: 2.1 time: 3.235933 Jul 18 02:52:29.271722 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2501/5016] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:26 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1564 bytes in 3264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:29.313750 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-168a1912-4a29-4544-9589-2bd172208ccb tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:29.321374 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-168a1912-4a29-4544-9589-2bd172208ccb tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:29.353006 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-168a1912-4a29-4544-9589-2bd172208ccb tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:29.357021 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-168a1912-4a29-4544-9589-2bd172208ccb tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:29.358948 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-168a1912-4a29-4544-9589-2bd172208ccb tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:29.364891 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-168a1912-4a29-4544-9589-2bd172208ccb tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:29.976162 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-168a1912-4a29-4544-9589-2bd172208ccb tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:29.989655 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-168a1912-4a29-4544-9589-2bd172208ccb tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 200 len: 1603 microversion: 2.1 time: 0.713753 Jul 18 02:52:29.998821 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2502/5017] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:29 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 1603 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:30.175898 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fbe99ed6-abe8-4289-9ac6-f1c11ceb9d62 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:30.177126 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fbe99ed6-abe8-4289-9ac6-f1c11ceb9d62 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] [instance: 478ddfd6-6a86-4727-aa35-10f859812f64] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:30.208050 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fbe99ed6-abe8-4289-9ac6-f1c11ceb9d62 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:30.232183 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fbe99ed6-abe8-4289-9ac6-f1c11ceb9d62 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:30.234047 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fbe99ed6-abe8-4289-9ac6-f1c11ceb9d62 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:30.235081 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fbe99ed6-abe8-4289-9ac6-f1c11ceb9d62 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:30.642511 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-56ac2c7e-580a-47ee-b68e-2cb1bb5b62e7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:30.676133 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-56ac2c7e-580a-47ee-b68e-2cb1bb5b62e7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1375 microversion: 2.1 time: 1.510856 Jul 18 02:52:30.679337 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2516/5018] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:29 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1375 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:31.024254 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c534bb64-2962-4017-a02c-e0a8917617f4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:31.028454 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c534bb64-2962-4017-a02c-e0a8917617f4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:31.060993 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c534bb64-2962-4017-a02c-e0a8917617f4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:31.061886 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c534bb64-2962-4017-a02c-e0a8917617f4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:31.063455 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c534bb64-2962-4017-a02c-e0a8917617f4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:31.075261 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c534bb64-2962-4017-a02c-e0a8917617f4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:31.192627 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:52:31.485748 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fbe99ed6-abe8-4289-9ac6-f1c11ceb9d62 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce09d11ea674ed5a4b257c4fee6037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e9412ed01a461abd5b33d4881af25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:31.514686 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fbe99ed6-abe8-4289-9ac6-f1c11ceb9d62 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] 10.222.0.57 "GET /compute/v2.1/servers/478ddfd6-6a86-4727-aa35-10f859812f64" status: 200 len: 1497 microversion: 2.1 time: 1.345844 Jul 18 02:52:31.518163 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2503/5019] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:30 2022] GET /compute/v2.1/servers/478ddfd6-6a86-4727-aa35-10f859812f64 => generated 1497 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:31.542428 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-49bf0c1b-a03d-4605-989d-56a800103a8a req-459dc3d8-70f4-49c9-ba30-252426b89383 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a7139b7-9d69-45b0-a6bf-470376bdb9c5", "name": "network-vif-deleted", "tag": "1ea03e2a-ad3d-4bd9-a097-f84b5e9aa228"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:52:31.600229 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-49bf0c1b-a03d-4605-989d-56a800103a8a req-459dc3d8-70f4-49c9-ba30-252426b89383 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:31.608316 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-49bf0c1b-a03d-4605-989d-56a800103a8a req-459dc3d8-70f4-49c9-ba30-252426b89383 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:31.688389 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c534bb64-2962-4017-a02c-e0a8917617f4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:31.700840 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-49bf0c1b-a03d-4605-989d-56a800103a8a req-459dc3d8-70f4-49c9-ba30-252426b89383 service nova] Creating event network-vif-deleted:1ea03e2a-ad3d-4bd9-a097-f84b5e9aa228 for instance 7a7139b7-9d69-45b0-a6bf-470376bdb9c5 on n-h1-465891-3 Jul 18 02:52:31.741671 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c534bb64-2962-4017-a02c-e0a8917617f4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 200 len: 1603 microversion: 2.1 time: 0.724182 Jul 18 02:52:31.771631 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-49bf0c1b-a03d-4605-989d-56a800103a8a req-459dc3d8-70f4-49c9-ba30-252426b89383 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.247032 Jul 18 02:52:31.772779 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2504/5020] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:52:31.773333 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2517/5021] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:31 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 1603 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:31.790682 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-44291bbd-ab25-4a91-b9e8-3948a2bf6470 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:31.792015 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-44291bbd-ab25-4a91-b9e8-3948a2bf6470 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:31.832580 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-44291bbd-ab25-4a91-b9e8-3948a2bf6470 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:31.833518 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-44291bbd-ab25-4a91-b9e8-3948a2bf6470 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:31.835609 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-44291bbd-ab25-4a91-b9e8-3948a2bf6470 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:31.839453 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-44291bbd-ab25-4a91-b9e8-3948a2bf6470 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:32.402085 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-44291bbd-ab25-4a91-b9e8-3948a2bf6470 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:32.431368 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-44291bbd-ab25-4a91-b9e8-3948a2bf6470 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1375 microversion: 2.1 time: 0.651013 Jul 18 02:52:32.434829 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2518/5022] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:31 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1375 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:32.797380 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c6446008-f1a0-45dc-9ca1-6ee70a74029c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:32.804701 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c6446008-f1a0-45dc-9ca1-6ee70a74029c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:32.835873 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c6446008-f1a0-45dc-9ca1-6ee70a74029c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:32.836712 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c6446008-f1a0-45dc-9ca1-6ee70a74029c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:32.839653 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c6446008-f1a0-45dc-9ca1-6ee70a74029c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:32.841215 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c6446008-f1a0-45dc-9ca1-6ee70a74029c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:32.948202 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-c6446008-f1a0-45dc-9ca1-6ee70a74029c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] HTTP exception thrown: Instance 7a7139b7-9d69-45b0-a6bf-470376bdb9c5 could not be found. Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c6446008-f1a0-45dc-9ca1-6ee70a74029c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Request method failure captured: Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 HTTP/1.1 Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1Mmzt2I9RlA6VEggBfRLShSXRaBuXjrVrPNlWO6AFdGcTHbVp2kQCiHz7Ex0iPFnQ6OMMIZinbDEVI1KOVeP4bskTlV5IxDPGX95DhpKc5DI9xePXSABpXDandv4aW8bK6yk3AXLmHawMw9CXg1Gm9JCYpdfA_nyr-OhgxOnBlhCDAk Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: e9acec37ba95432eb3ef9b5229167fe8 Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-AttachVolumeTestJSON-1393062758 Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e9acec37ba95432eb3ef9b5229167fe8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e9acec37ba95432eb3ef9b5229167fe8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e9acec37ba95432eb3ef9b5229167fe8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e9acec37ba95432eb3ef9b5229167fe8"}]}] Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-AttachVolumeTestJSON-1393062758 Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: e9acec37ba95432eb3ef9b5229167fe8 Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1393062758 Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-AttachVolumeTestJSON-1393062758-project Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: ba8ea645f5364b8497d3e439a2d85e54 Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-AttachVolumeTestJSON-1393062758-project Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 7a7139b7-9d69-45b0-a6bf-470376bdb9c5 could not be found. Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '7a7139b7-9d69-45b0-a6bf-470376bdb9c5'} Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a7139b7-9d69-45b0-a6bf-470376bdb9c5 could not be found. Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a7139b7-9d69-45b0-a6bf-470376bdb9c5 could not be found. Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:52:32.964269 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:52:32.969623 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:52:32.969623 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:52:32.969623 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:52:32.969623 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:52:32.969623 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:52:32.969623 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a7139b7-9d69-45b0-a6bf-470376bdb9c5 could not be found. Jul 18 02:52:32.969623 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:52:32.972703 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c6446008-f1a0-45dc-9ca1-6ee70a74029c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Returning 404 to user: Instance 7a7139b7-9d69-45b0-a6bf-470376bdb9c5 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:52:32.974851 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c6446008-f1a0-45dc-9ca1-6ee70a74029c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 404 len: 111 microversion: 2.1 time: 0.190173 Jul 18 02:52:32.982681 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2505/5023] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:32 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 111 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:52:32.991585 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-36b935b2-7970-4ed9-9ce1-e3cab38e2310 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '.version_select at 0x7ff49b7510d0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:33.071290 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-36b935b2-7970-4ed9-9ce1-e3cab38e2310 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-711062603" status: 202 len: 0 microversion: 2.1 time: 0.086180 Jul 18 02:52:33.078128 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2519/5024] 10.222.0.57 () {58 vars in 1217 bytes} [Mon Jul 18 02:52:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-711062603 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:52:33.470919 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c62365d0-b458-42ab-bf00-af68b997185c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:33.479188 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c62365d0-b458-42ab-bf00-af68b997185c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:33.532250 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c62365d0-b458-42ab-bf00-af68b997185c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:33.535723 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c62365d0-b458-42ab-bf00-af68b997185c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:33.559030 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c62365d0-b458-42ab-bf00-af68b997185c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:33.559673 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c62365d0-b458-42ab-bf00-af68b997185c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:34.208603 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c62365d0-b458-42ab-bf00-af68b997185c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:34.218447 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c62365d0-b458-42ab-bf00-af68b997185c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1375 microversion: 2.1 time: 0.759538 Jul 18 02:52:34.224470 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2506/5025] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:33 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1375 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:34.768142 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-01a87810-07ee-401f-b5a0-7f5702e3c9a4 req-7c6d4dba-4ed2-456b-818c-61fe851b77d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf71e56d-5a67-439f-9781-6c0356dc8d6f", "name": "network-vif-plugged", "status": "completed", "tag": "5de70f3f-f955-4161-a978-f15f4ed4addf"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:52:34.788626 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-01a87810-07ee-401f-b5a0-7f5702e3c9a4 req-7c6d4dba-4ed2-456b-818c-61fe851b77d5 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:34.792763 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-01a87810-07ee-401f-b5a0-7f5702e3c9a4 req-7c6d4dba-4ed2-456b-818c-61fe851b77d5 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:34.816657 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-01a87810-07ee-401f-b5a0-7f5702e3c9a4 req-7c6d4dba-4ed2-456b-818c-61fe851b77d5 service nova] Creating event network-vif-plugged:5de70f3f-f955-4161-a978-f15f4ed4addf for instance bf71e56d-5a67-439f-9781-6c0356dc8d6f on n-h1-465891-3 Jul 18 02:52:34.831496 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-01a87810-07ee-401f-b5a0-7f5702e3c9a4 req-7c6d4dba-4ed2-456b-818c-61fe851b77d5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067176 Jul 18 02:52:34.832792 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2520/5026] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:52:35.257972 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9ec4497a-c492-4b80-91ad-a6f53fbe49c7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:35.259224 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9ec4497a-c492-4b80-91ad-a6f53fbe49c7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:35.315728 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9ec4497a-c492-4b80-91ad-a6f53fbe49c7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:35.316638 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9ec4497a-c492-4b80-91ad-a6f53fbe49c7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:35.328151 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9ec4497a-c492-4b80-91ad-a6f53fbe49c7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:35.328342 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9ec4497a-c492-4b80-91ad-a6f53fbe49c7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:35.954851 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9ec4497a-c492-4b80-91ad-a6f53fbe49c7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:35.990485 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9ec4497a-c492-4b80-91ad-a6f53fbe49c7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1375 microversion: 2.1 time: 0.737040 Jul 18 02:52:36.014772 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2507/5027] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:35 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1375 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:36.301404 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-50871a19-fbb3-41de-ab32-29169834a782 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Action: 'create', calling method: .version_select at 0x7ff49b954790>, body: {"keypair": {"name": "tempest-keypair-1075332678", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFnK7b2p9nnIPBZc1Eo+7pruGlg33h153ElwDX4fyhYzIlaDeJiZBVvVBx/ZKd8iXCtJnmIl/UmUyr1Yin7j/HK+3jI2bCxgdfY5fVt7FKFi1oGcyEXEOlt6aHyXDPcGoQ=="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:52:36.357774 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-50871a19-fbb3-41de-ab32-29169834a782 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Getting quotas for project e9acec37ba95432eb3ef9b5229167fe8. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:52:36.380525 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-50871a19-fbb3-41de-ab32-29169834a782 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Getting quotas for user ba8ea645f5364b8497d3e439a2d85e54 and project e9acec37ba95432eb3ef9b5229167fe8. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:52:36.508537 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-50871a19-fbb3-41de-ab32-29169834a782 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.205470 Jul 18 02:52:36.511960 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2521/5028] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 02:52:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:52:36.578091 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5781b5c5-7755-43b5-be86-29fa9307d1b9 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:36.578860 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5781b5c5-7755-43b5-be86-29fa9307d1b9 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 4b0f1b28-e409-4b2d-ad07-b85f03fd59ae] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:36.620799 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=50 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:52:36.632798 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5781b5c5-7755-43b5-be86-29fa9307d1b9 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:36.641425 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5781b5c5-7755-43b5-be86-29fa9307d1b9 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:36.643178 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5781b5c5-7755-43b5-be86-29fa9307d1b9 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:36.646426 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5781b5c5-7755-43b5-be86-29fa9307d1b9 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:36.980460 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-5781b5c5-7755-43b5-be86-29fa9307d1b9 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lazy-loading 'services' on Instance uuid 4b0f1b28-e409-4b2d-ad07-b85f03fd59ae {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:52:37.042659 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1067bd6f-d9e4-4527-abbb-605caccc198b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:37.045502 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1067bd6f-d9e4-4527-abbb-605caccc198b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:37.092017 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1067bd6f-d9e4-4527-abbb-605caccc198b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:37.098799 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1067bd6f-d9e4-4527-abbb-605caccc198b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:37.107796 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1067bd6f-d9e4-4527-abbb-605caccc198b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:37.111529 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1067bd6f-d9e4-4527-abbb-605caccc198b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:37.278454 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5781b5c5-7755-43b5-be86-29fa9307d1b9 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae/os-volume_attachments/5d367a78-4074-444f-9dca-4e8dddec3243" status: 202 len: 0 microversion: 2.1 time: 0.709267 Jul 18 02:52:37.291667 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2508/5029] 10.222.0.57 () {58 vars in 1415 bytes} [Mon Jul 18 02:52:36 2022] DELETE /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae/os-volume_attachments/5d367a78-4074-444f-9dca-4e8dddec3243 => generated 0 bytes in 726 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:52:37.655595 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1067bd6f-d9e4-4527-abbb-605caccc198b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:37.678181 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1067bd6f-d9e4-4527-abbb-605caccc198b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1375 microversion: 2.1 time: 0.649369 Jul 18 02:52:37.691537 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2522/5030] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:37 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1375 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:38.718846 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7c8dae3b-5862-4c81-8ee2-8fe408d5cb6c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:38.723742 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7c8dae3b-5862-4c81-8ee2-8fe408d5cb6c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:38.752380 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7c8dae3b-5862-4c81-8ee2-8fe408d5cb6c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:38.753229 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7c8dae3b-5862-4c81-8ee2-8fe408d5cb6c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:38.754893 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7c8dae3b-5862-4c81-8ee2-8fe408d5cb6c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:38.755697 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7c8dae3b-5862-4c81-8ee2-8fe408d5cb6c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:39.610751 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-62bf8707-91ed-4dbe-b6b9-168034cbf397 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:39.611487 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-62bf8707-91ed-4dbe-b6b9-168034cbf397 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] [instance: 478ddfd6-6a86-4727-aa35-10f859812f64] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:39.638579 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-62bf8707-91ed-4dbe-b6b9-168034cbf397 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:39.639450 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-62bf8707-91ed-4dbe-b6b9-168034cbf397 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:39.640559 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-62bf8707-91ed-4dbe-b6b9-168034cbf397 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:39.641259 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-62bf8707-91ed-4dbe-b6b9-168034cbf397 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:39.726828 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-62bf8707-91ed-4dbe-b6b9-168034cbf397 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] [instance: 478ddfd6-6a86-4727-aa35-10f859812f64] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:52:40.013182 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-62bf8707-91ed-4dbe-b6b9-168034cbf397 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] 10.222.0.57 "DELETE /compute/v2.1/servers/478ddfd6-6a86-4727-aa35-10f859812f64" status: 204 len: 0 microversion: 2.1 time: 0.402371 Jul 18 02:52:40.026098 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2523/5031] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:52:39 2022] DELETE /compute/v2.1/servers/478ddfd6-6a86-4727-aa35-10f859812f64 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:52:40.072465 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f4fb3232-21b7-4533-9833-70c4368f3e72 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:52:40.079950 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f4fb3232-21b7-4533-9833-70c4368f3e72 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:40.110790 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f4fb3232-21b7-4533-9833-70c4368f3e72 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:40.111632 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f4fb3232-21b7-4533-9833-70c4368f3e72 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:40.116138 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f4fb3232-21b7-4533-9833-70c4368f3e72 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:40.117321 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f4fb3232-21b7-4533-9833-70c4368f3e72 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:40.170108 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7c8dae3b-5862-4c81-8ee2-8fe408d5cb6c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:40.228389 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7c8dae3b-5862-4c81-8ee2-8fe408d5cb6c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1563 microversion: 2.1 time: 1.534634 Jul 18 02:52:40.229349 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2509/5032] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:38 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1563 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:40.252277 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7bffd8ee-ee53-42ae-98a7-014be40eb545 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:40.262235 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f4fb3232-21b7-4533-9833-70c4368f3e72 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "POST /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3/action" status: 200 len: 24567 microversion: 2.1 time: 0.231438 Jul 18 02:52:40.264834 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2524/5033] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:52:40 2022] POST /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3/action => generated 24567 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:52:40.269982 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7bffd8ee-ee53-42ae-98a7-014be40eb545 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] [instance: 478ddfd6-6a86-4727-aa35-10f859812f64] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:40.279902 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-250b5ccb-b5ca-405e-8a97-434d8858a728 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:40.282683 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-250b5ccb-b5ca-405e-8a97-434d8858a728 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:40.324355 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7bffd8ee-ee53-42ae-98a7-014be40eb545 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:40.325093 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7bffd8ee-ee53-42ae-98a7-014be40eb545 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:40.326822 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7bffd8ee-ee53-42ae-98a7-014be40eb545 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:40.327608 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7bffd8ee-ee53-42ae-98a7-014be40eb545 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:40.334418 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-250b5ccb-b5ca-405e-8a97-434d8858a728 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:40.335897 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-250b5ccb-b5ca-405e-8a97-434d8858a728 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:40.341976 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-250b5ccb-b5ca-405e-8a97-434d8858a728 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:40.344592 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-250b5ccb-b5ca-405e-8a97-434d8858a728 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:41.027097 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-250b5ccb-b5ca-405e-8a97-434d8858a728 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:41.050617 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-250b5ccb-b5ca-405e-8a97-434d8858a728 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1563 microversion: 2.1 time: 0.783316 Jul 18 02:52:41.057297 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2525/5034] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:40 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1563 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:41.095646 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7bffd8ee-ee53-42ae-98a7-014be40eb545 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce09d11ea674ed5a4b257c4fee6037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e9412ed01a461abd5b33d4881af25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:41.107241 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:52:41.113365 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7bffd8ee-ee53-42ae-98a7-014be40eb545 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] 10.222.0.57 "GET /compute/v2.1/servers/478ddfd6-6a86-4727-aa35-10f859812f64" status: 200 len: 1503 microversion: 2.1 time: 0.882488 Jul 18 02:52:41.117932 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2510/5035] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:40 2022] GET /compute/v2.1/servers/478ddfd6-6a86-4727-aa35-10f859812f64 => generated 1503 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:41.282237 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-912f1883-6b73-45bd-92ed-33b0065c83f4 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:41.283382 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-912f1883-6b73-45bd-92ed-33b0065c83f4 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:41.308343 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-912f1883-6b73-45bd-92ed-33b0065c83f4 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:41.311022 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-912f1883-6b73-45bd-92ed-33b0065c83f4 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:41.314311 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-912f1883-6b73-45bd-92ed-33b0065c83f4 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:41.315628 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-912f1883-6b73-45bd-92ed-33b0065c83f4 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:41.411770 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-912f1883-6b73-45bd-92ed-33b0065c83f4 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:52:41.709863 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-912f1883-6b73-45bd-92ed-33b0065c83f4 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "DELETE /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 204 len: 0 microversion: 2.1 time: 0.442537 Jul 18 02:52:41.710176 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2526/5036] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:52:41 2022] DELETE /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:52:41.720914 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-53fd6852-59f2-4656-b850-154795104994 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:41.721559 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-53fd6852-59f2-4656-b850-154795104994 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:41.754887 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-53fd6852-59f2-4656-b850-154795104994 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:41.756247 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-53fd6852-59f2-4656-b850-154795104994 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:41.761363 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-53fd6852-59f2-4656-b850-154795104994 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:41.762521 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-53fd6852-59f2-4656-b850-154795104994 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:42.156067 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5c881a6c-f93d-4d76-bdd6-32b301294c54 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:42.158582 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5c881a6c-f93d-4d76-bdd6-32b301294c54 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] [instance: 478ddfd6-6a86-4727-aa35-10f859812f64] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:42.188648 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:52:42.196097 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5c881a6c-f93d-4d76-bdd6-32b301294c54 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:42.201118 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5c881a6c-f93d-4d76-bdd6-32b301294c54 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:42.204702 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5c881a6c-f93d-4d76-bdd6-32b301294c54 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:42.207061 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5c881a6c-f93d-4d76-bdd6-32b301294c54 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:42.312490 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-53fd6852-59f2-4656-b850-154795104994 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:42.325532 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-53fd6852-59f2-4656-b850-154795104994 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1569 microversion: 2.1 time: 0.609938 Jul 18 02:52:42.327288 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2511/5037] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:41 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1569 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:52:42.373475 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f71a036b-f59e-42da-a110-7f1d395bd6ea tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1700530735", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "395b63d2-26ed-4dfa-9dfb-5fb6892ff72e"}], "security_groups": [{"name": "tempest-securitygroup--78666347"}], "key_name": "tempest-keypair-1075332678", "user_data": "}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:52:42.848003 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-f71a036b-f59e-42da-a110-7f1d395bd6ea tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] validate_networks() for [('395b63d2-26ed-4dfa-9dfb-5fb6892ff72e', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:52:43.113672 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5c881a6c-f93d-4d76-bdd6-32b301294c54 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce09d11ea674ed5a4b257c4fee6037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e9412ed01a461abd5b33d4881af25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:43.127375 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5c881a6c-f93d-4d76-bdd6-32b301294c54 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] 10.222.0.57 "GET /compute/v2.1/servers/478ddfd6-6a86-4727-aa35-10f859812f64" status: 200 len: 1503 microversion: 2.1 time: 0.983793 Jul 18 02:52:43.154023 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2527/5038] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:42 2022] GET /compute/v2.1/servers/478ddfd6-6a86-4727-aa35-10f859812f64 => generated 1503 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:43.345449 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-877058f0-eee9-48b2-9d75-6250ffe5aae1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:43.346349 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-877058f0-eee9-48b2-9d75-6250ffe5aae1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:43.359855 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-877058f0-eee9-48b2-9d75-6250ffe5aae1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:43.365164 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-877058f0-eee9-48b2-9d75-6250ffe5aae1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:43.366585 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-877058f0-eee9-48b2-9d75-6250ffe5aae1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:43.367179 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-877058f0-eee9-48b2-9d75-6250ffe5aae1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:43.782535 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-f71a036b-f59e-42da-a110-7f1d395bd6ea tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:52:43.783977 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-f71a036b-f59e-42da-a110-7f1d395bd6ea tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:52:43.786014 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-f71a036b-f59e-42da-a110-7f1d395bd6ea tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:52:43.787530 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-f71a036b-f59e-42da-a110-7f1d395bd6ea tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:52:43.788712 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-f71a036b-f59e-42da-a110-7f1d395bd6ea tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:52:43.812840 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f71a036b-f59e-42da-a110-7f1d395bd6ea tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:43.819540 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f71a036b-f59e-42da-a110-7f1d395bd6ea tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:43.825795 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f71a036b-f59e-42da-a110-7f1d395bd6ea tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:43.834083 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f71a036b-f59e-42da-a110-7f1d395bd6ea tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:43.900279 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-f71a036b-f59e-42da-a110-7f1d395bd6ea tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Getting quotas for project e9acec37ba95432eb3ef9b5229167fe8. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:52:43.908467 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-f71a036b-f59e-42da-a110-7f1d395bd6ea tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Getting quotas for user ba8ea645f5364b8497d3e439a2d85e54 and project e9acec37ba95432eb3ef9b5229167fe8. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:52:43.925425 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f71a036b-f59e-42da-a110-7f1d395bd6ea tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:52:43.928686 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f71a036b-f59e-42da-a110-7f1d395bd6ea tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: a8abc31e-bc67-4e33-b91b-39ec0dcb43b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:52:44.020668 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f71a036b-f59e-42da-a110-7f1d395bd6ea tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.653168 Jul 18 02:52:44.022013 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2512/5039] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:52:42 2022] POST /compute/v2.1/servers => generated 400 bytes in 1656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:52:44.037572 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-877058f0-eee9-48b2-9d75-6250ffe5aae1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:44.039012 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fc772bd0-47b3-4aef-8b7e-31977bb93f1d tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:44.041037 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fc772bd0-47b3-4aef-8b7e-31977bb93f1d tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: a8abc31e-bc67-4e33-b91b-39ec0dcb43b8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:44.088627 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-877058f0-eee9-48b2-9d75-6250ffe5aae1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1569 microversion: 2.1 time: 0.747397 Jul 18 02:52:44.095636 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2528/5040] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:43 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1569 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:52:44.159811 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b96063b9-fffc-4cae-afc9-ae5714dc7f75 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:44.161048 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b96063b9-fffc-4cae-afc9-ae5714dc7f75 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] [instance: 478ddfd6-6a86-4727-aa35-10f859812f64] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:44.177426 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b96063b9-fffc-4cae-afc9-ae5714dc7f75 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:44.178308 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b96063b9-fffc-4cae-afc9-ae5714dc7f75 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:44.180401 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b96063b9-fffc-4cae-afc9-ae5714dc7f75 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:44.192117 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b96063b9-fffc-4cae-afc9-ae5714dc7f75 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:44.333895 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fc772bd0-47b3-4aef-8b7e-31977bb93f1d tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:44.385528 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fc772bd0-47b3-4aef-8b7e-31977bb93f1d tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8" status: 200 len: 1238 microversion: 2.1 time: 0.352007 Jul 18 02:52:44.413900 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2513/5041] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:44 2022] GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 => generated 1238 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:44.577528 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b96063b9-fffc-4cae-afc9-ae5714dc7f75 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce09d11ea674ed5a4b257c4fee6037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e9412ed01a461abd5b33d4881af25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:44.601263 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f1dca061-3795-4dac-826a-a16d9ae621cb tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:44.601918 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f1dca061-3795-4dac-826a-a16d9ae621cb tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:44.603144 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b96063b9-fffc-4cae-afc9-ae5714dc7f75 tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] 10.222.0.57 "GET /compute/v2.1/servers/478ddfd6-6a86-4727-aa35-10f859812f64" status: 200 len: 1461 microversion: 2.1 time: 0.446083 Jul 18 02:52:44.605636 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2529/5042] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:44 2022] GET /compute/v2.1/servers/478ddfd6-6a86-4727-aa35-10f859812f64 => generated 1461 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:52:44.619403 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f1dca061-3795-4dac-826a-a16d9ae621cb tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:44.619872 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f1dca061-3795-4dac-826a-a16d9ae621cb tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:44.620857 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f1dca061-3795-4dac-826a-a16d9ae621cb tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:44.621129 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f1dca061-3795-4dac-826a-a16d9ae621cb tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:44.662619 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-d970d52f-a3ce-4f3a-a9ea-05166122f864 req-6c7c5169-53a2-4d48-9110-2640e247953e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "478ddfd6-6a86-4727-aa35-10f859812f64", "name": "network-vif-deleted", "tag": "c7b18272-5545-44ed-acf7-93d0b8a87e4f"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:52:44.719625 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-d970d52f-a3ce-4f3a-a9ea-05166122f864 req-6c7c5169-53a2-4d48-9110-2640e247953e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:44.722251 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-d970d52f-a3ce-4f3a-a9ea-05166122f864 req-6c7c5169-53a2-4d48-9110-2640e247953e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:44.786457 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-d970d52f-a3ce-4f3a-a9ea-05166122f864 req-6c7c5169-53a2-4d48-9110-2640e247953e service nova] Creating event network-vif-deleted:c7b18272-5545-44ed-acf7-93d0b8a87e4f for instance 478ddfd6-6a86-4727-aa35-10f859812f64 on n-h1-465891-3 Jul 18 02:52:44.805347 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-d970d52f-a3ce-4f3a-a9ea-05166122f864 req-6c7c5169-53a2-4d48-9110-2640e247953e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149398 Jul 18 02:52:44.811456 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2530/5043] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:52:45.116219 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8efbeb57-a3b2-429d-b48d-56cd0a52bf98 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:45.117259 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8efbeb57-a3b2-429d-b48d-56cd0a52bf98 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:45.139456 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8efbeb57-a3b2-429d-b48d-56cd0a52bf98 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:45.140741 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8efbeb57-a3b2-429d-b48d-56cd0a52bf98 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:45.141944 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8efbeb57-a3b2-429d-b48d-56cd0a52bf98 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:45.142627 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8efbeb57-a3b2-429d-b48d-56cd0a52bf98 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:45.164390 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f1dca061-3795-4dac-826a-a16d9ae621cb tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:45.198699 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f1dca061-3795-4dac-826a-a16d9ae621cb tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 0.596415 Jul 18 02:52:45.240192 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2514/5044] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:44 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:52:45.267677 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1b34a623-a9ff-4b28-9fb5-1f026c30a131 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-331368555"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:52:45.275054 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1b34a623-a9ff-4b28-9fb5-1f026c30a131 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:45.301465 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1b34a623-a9ff-4b28-9fb5-1f026c30a131 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:45.303288 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1b34a623-a9ff-4b28-9fb5-1f026c30a131 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:45.305242 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1b34a623-a9ff-4b28-9fb5-1f026c30a131 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:45.310434 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1b34a623-a9ff-4b28-9fb5-1f026c30a131 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:46.100631 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1b34a623-a9ff-4b28-9fb5-1f026c30a131 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "POST /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e/action" status: 202 len: 0 microversion: 2.1 time: 0.856881 Jul 18 02:52:46.115735 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2515/5045] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:52:45 2022] POST /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e/action => generated 0 bytes in 868 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 18 02:52:46.136793 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-baa85e21-e412-4b9b-a2c2-572de3123a81 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:46.142402 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-baa85e21-e412-4b9b-a2c2-572de3123a81 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: a8abc31e-bc67-4e33-b91b-39ec0dcb43b8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:46.166324 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8efbeb57-a3b2-429d-b48d-56cd0a52bf98 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:46.185150 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8efbeb57-a3b2-429d-b48d-56cd0a52bf98 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1569 microversion: 2.1 time: 1.074923 Jul 18 02:52:46.188134 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2531/5046] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:45 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1569 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:46.198558 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-baa85e21-e412-4b9b-a2c2-572de3123a81 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:46.203983 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b92d5894-58c7-4304-b783-8f907820308b tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:46.204887 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b92d5894-58c7-4304-b783-8f907820308b tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] [instance: 478ddfd6-6a86-4727-aa35-10f859812f64] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:46.205238 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-baa85e21-e412-4b9b-a2c2-572de3123a81 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:46.210014 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-baa85e21-e412-4b9b-a2c2-572de3123a81 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:46.216430 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-baa85e21-e412-4b9b-a2c2-572de3123a81 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:46.241197 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b92d5894-58c7-4304-b783-8f907820308b tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:46.241751 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b92d5894-58c7-4304-b783-8f907820308b tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:46.242639 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b92d5894-58c7-4304-b783-8f907820308b tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:46.255808 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b92d5894-58c7-4304-b783-8f907820308b tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:46.315030 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-b92d5894-58c7-4304-b783-8f907820308b tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] HTTP exception thrown: Instance 478ddfd6-6a86-4727-aa35-10f859812f64 could not be found. Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b92d5894-58c7-4304-b783-8f907820308b tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Request method failure captured: Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/478ddfd6-6a86-4727-aa35-10f859812f64 HTTP/1.1 Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MrMmP0vmxrdfb_acn3SmWtedOMGf7LYtc5jbJcERwhrpfGcRJ6XDbOhUPAZQBT93uyqyFzgV-IaBu0PHPaYPdSADk79HJ2aam3HVsm0hkhv5Uy_r4Whqn3wgJm1Q0D47eiVnCuMGiZ2wrXqhzXV-v_RICzhd6DNxycGTk2orv8NuV8 Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: a0e9412ed01a461abd5b33d4881af25f Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-VolumesActionsTest-1063394236 Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_a0e9412ed01a461abd5b33d4881af25f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/a0e9412ed01a461abd5b33d4881af25f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/a0e9412ed01a461abd5b33d4881af25f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/a0e9412ed01a461abd5b33d4881af25f"}]}] Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-VolumesActionsTest-1063394236 Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: a0e9412ed01a461abd5b33d4881af25f Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-VolumesActionsTest-1063394236 Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-VolumesActionsTest-1063394236-project Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: bce09d11ea674ed5a4b257c4fee6037a Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-VolumesActionsTest-1063394236-project Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 478ddfd6-6a86-4727-aa35-10f859812f64 could not be found. Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '478ddfd6-6a86-4727-aa35-10f859812f64'} Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 478ddfd6-6a86-4727-aa35-10f859812f64 could not be found. Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 478ddfd6-6a86-4727-aa35-10f859812f64 could not be found. Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:52:46.330743 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:52:46.336250 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:52:46.336250 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:52:46.336250 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:52:46.336250 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:52:46.336250 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:52:46.336250 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 478ddfd6-6a86-4727-aa35-10f859812f64 could not be found. Jul 18 02:52:46.336250 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:52:46.337797 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b92d5894-58c7-4304-b783-8f907820308b tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] Returning 404 to user: Instance 478ddfd6-6a86-4727-aa35-10f859812f64 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:52:46.339675 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b92d5894-58c7-4304-b783-8f907820308b tempest-VolumesActionsTest-1063394236 tempest-VolumesActionsTest-1063394236-project] 10.222.0.57 "GET /compute/v2.1/servers/478ddfd6-6a86-4727-aa35-10f859812f64" status: 404 len: 111 microversion: 2.1 time: 0.141090 Jul 18 02:52:46.340412 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2532/5047] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:46 2022] GET /compute/v2.1/servers/478ddfd6-6a86-4727-aa35-10f859812f64 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:52:46.357137 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d3e60da1-f6f6-49cc-8e80-b43390f84ee8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:46.358008 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d3e60da1-f6f6-49cc-8e80-b43390f84ee8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:46.379530 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d3e60da1-f6f6-49cc-8e80-b43390f84ee8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:46.380471 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d3e60da1-f6f6-49cc-8e80-b43390f84ee8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:46.383315 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d3e60da1-f6f6-49cc-8e80-b43390f84ee8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:46.390606 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d3e60da1-f6f6-49cc-8e80-b43390f84ee8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:46.431985 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-baa85e21-e412-4b9b-a2c2-572de3123a81 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:46.433662 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=4 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:52:46.445728 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-baa85e21-e412-4b9b-a2c2-572de3123a81 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8" status: 200 len: 1290 microversion: 2.1 time: 0.330667 Jul 18 02:52:46.449893 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2516/5048] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:46 2022] GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 => generated 1290 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:46.461167 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-9a09e7ed-c7df-4fd4-9862-82302ca7a81f req-ee8d15e6-a706-4fb1-b985-37b02d8fac77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf71e56d-5a67-439f-9781-6c0356dc8d6f", "name": "network-vif-deleted", "tag": "5de70f3f-f955-4161-a978-f15f4ed4addf"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:52:46.496005 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-9a09e7ed-c7df-4fd4-9862-82302ca7a81f req-ee8d15e6-a706-4fb1-b985-37b02d8fac77 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:46.497007 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-9a09e7ed-c7df-4fd4-9862-82302ca7a81f req-ee8d15e6-a706-4fb1-b985-37b02d8fac77 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:46.544148 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-9a09e7ed-c7df-4fd4-9862-82302ca7a81f req-ee8d15e6-a706-4fb1-b985-37b02d8fac77 service nova] Creating event network-vif-deleted:5de70f3f-f955-4161-a978-f15f4ed4addf for instance bf71e56d-5a67-439f-9781-6c0356dc8d6f on n-h1-465891-3 Jul 18 02:52:46.554837 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-9a09e7ed-c7df-4fd4-9862-82302ca7a81f req-ee8d15e6-a706-4fb1-b985-37b02d8fac77 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103262 Jul 18 02:52:46.556899 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2517/5049] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:52:46.984687 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d3e60da1-f6f6-49cc-8e80-b43390f84ee8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:47.023547 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d3e60da1-f6f6-49cc-8e80-b43390f84ee8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1680 microversion: 2.1 time: 0.681455 Jul 18 02:52:47.024709 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2533/5050] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:46 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1680 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:47.206547 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-becf01d7-34fd-4636-bb40-3b8b649aba6a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:47.207753 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-becf01d7-34fd-4636-bb40-3b8b649aba6a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:47.226891 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-becf01d7-34fd-4636-bb40-3b8b649aba6a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:47.228222 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-becf01d7-34fd-4636-bb40-3b8b649aba6a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:47.229278 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-becf01d7-34fd-4636-bb40-3b8b649aba6a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:47.230078 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-becf01d7-34fd-4636-bb40-3b8b649aba6a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:47.392947 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-becf01d7-34fd-4636-bb40-3b8b649aba6a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:47.407466 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-becf01d7-34fd-4636-bb40-3b8b649aba6a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1360 microversion: 2.1 time: 0.206424 Jul 18 02:52:47.419516 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2518/5051] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:47 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1360 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:47.483025 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1a32c604-a7cb-4ddf-b580-73cffccaf68a tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:47.484324 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1a32c604-a7cb-4ddf-b580-73cffccaf68a tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: a8abc31e-bc67-4e33-b91b-39ec0dcb43b8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:47.504000 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1a32c604-a7cb-4ddf-b580-73cffccaf68a tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:47.505430 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1a32c604-a7cb-4ddf-b580-73cffccaf68a tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:47.507407 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1a32c604-a7cb-4ddf-b580-73cffccaf68a tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:47.509269 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1a32c604-a7cb-4ddf-b580-73cffccaf68a tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:47.684568 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1a32c604-a7cb-4ddf-b580-73cffccaf68a tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:47.716519 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1a32c604-a7cb-4ddf-b580-73cffccaf68a tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8" status: 200 len: 1296 microversion: 2.1 time: 0.242896 Jul 18 02:52:47.720563 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2534/5052] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:47 2022] GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 => generated 1296 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:48.065197 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c2890d8e-d28c-4cd7-9431-555dc531fa79 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:48.068994 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c2890d8e-d28c-4cd7-9431-555dc531fa79 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:48.115467 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c2890d8e-d28c-4cd7-9431-555dc531fa79 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:48.116226 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c2890d8e-d28c-4cd7-9431-555dc531fa79 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:48.132444 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c2890d8e-d28c-4cd7-9431-555dc531fa79 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:48.133430 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c2890d8e-d28c-4cd7-9431-555dc531fa79 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:48.430778 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e64ffd35-78e5-48bd-aa84-f66ea3afd33b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:48.432000 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e64ffd35-78e5-48bd-aa84-f66ea3afd33b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:48.466730 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e64ffd35-78e5-48bd-aa84-f66ea3afd33b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:48.471358 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e64ffd35-78e5-48bd-aa84-f66ea3afd33b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:48.476429 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e64ffd35-78e5-48bd-aa84-f66ea3afd33b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:48.478197 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e64ffd35-78e5-48bd-aa84-f66ea3afd33b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:48.486356 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:52:48.725392 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e64ffd35-78e5-48bd-aa84-f66ea3afd33b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:48.741864 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e64ffd35-78e5-48bd-aa84-f66ea3afd33b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1360 microversion: 2.1 time: 0.319218 Jul 18 02:52:48.753939 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2535/5053] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:48 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1360 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:48.760373 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4e63eeda-5015-48bd-bb45-62b0911980eb tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:48.761612 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4e63eeda-5015-48bd-bb45-62b0911980eb tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: a8abc31e-bc67-4e33-b91b-39ec0dcb43b8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:48.770368 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4e63eeda-5015-48bd-bb45-62b0911980eb tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:48.771182 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4e63eeda-5015-48bd-bb45-62b0911980eb tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:48.772198 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4e63eeda-5015-48bd-bb45-62b0911980eb tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:48.772625 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c2890d8e-d28c-4cd7-9431-555dc531fa79 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:48.775075 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4e63eeda-5015-48bd-bb45-62b0911980eb tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:48.796105 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c2890d8e-d28c-4cd7-9431-555dc531fa79 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1688 microversion: 2.1 time: 0.740250 Jul 18 02:52:48.796797 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2519/5054] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:48 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1688 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:49.074882 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4e63eeda-5015-48bd-bb45-62b0911980eb tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:49.077461 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-61cc0c82-9562-488f-b6e1-5ddf6838c9f5 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:49.078145 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-61cc0c82-9562-488f-b6e1-5ddf6838c9f5 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 4b0f1b28-e409-4b2d-ad07-b85f03fd59ae] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:49.091315 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-61cc0c82-9562-488f-b6e1-5ddf6838c9f5 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:49.092477 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4e63eeda-5015-48bd-bb45-62b0911980eb tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8" status: 200 len: 1362 microversion: 2.1 time: 0.336676 Jul 18 02:52:49.095057 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-61cc0c82-9562-488f-b6e1-5ddf6838c9f5 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:49.095230 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2536/5055] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:48 2022] GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 => generated 1362 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:49.105855 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-61cc0c82-9562-488f-b6e1-5ddf6838c9f5 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:49.106684 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-61cc0c82-9562-488f-b6e1-5ddf6838c9f5 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:49.171663 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-61cc0c82-9562-488f-b6e1-5ddf6838c9f5 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 4b0f1b28-e409-4b2d-ad07-b85f03fd59ae] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:52:49.329440 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-61cc0c82-9562-488f-b6e1-5ddf6838c9f5 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae" status: 204 len: 0 microversion: 2.1 time: 0.257567 Jul 18 02:52:49.334815 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2520/5056] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:52:49 2022] DELETE /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:52:49.341151 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cdd1ef58-ab16-42f6-a7a0-d806b569bf08 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:49.342597 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cdd1ef58-ab16-42f6-a7a0-d806b569bf08 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 4b0f1b28-e409-4b2d-ad07-b85f03fd59ae] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:49.360476 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cdd1ef58-ab16-42f6-a7a0-d806b569bf08 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:49.361146 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cdd1ef58-ab16-42f6-a7a0-d806b569bf08 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:49.362167 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cdd1ef58-ab16-42f6-a7a0-d806b569bf08 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:49.364654 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cdd1ef58-ab16-42f6-a7a0-d806b569bf08 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:49.762901 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5c87e09a-ee22-4891-8084-299f3fe78b53 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:49.763650 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5c87e09a-ee22-4891-8084-299f3fe78b53 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:49.776371 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5c87e09a-ee22-4891-8084-299f3fe78b53 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:49.777305 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5c87e09a-ee22-4891-8084-299f3fe78b53 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:49.784381 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5c87e09a-ee22-4891-8084-299f3fe78b53 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:49.784873 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5c87e09a-ee22-4891-8084-299f3fe78b53 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:50.260023 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5c87e09a-ee22-4891-8084-299f3fe78b53 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:50.273682 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5c87e09a-ee22-4891-8084-299f3fe78b53 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1360 microversion: 2.1 time: 0.516303 Jul 18 02:52:50.274801 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2521/5057] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:49 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1360 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:52:50.298148 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-87ddab1c-1c50-4bcd-8649-d339c4216ad3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:50.299656 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-87ddab1c-1c50-4bcd-8649-d339c4216ad3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:50.315618 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-87ddab1c-1c50-4bcd-8649-d339c4216ad3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:50.316367 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-87ddab1c-1c50-4bcd-8649-d339c4216ad3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:50.317404 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-87ddab1c-1c50-4bcd-8649-d339c4216ad3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:50.318064 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-87ddab1c-1c50-4bcd-8649-d339c4216ad3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:50.965189 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cdd1ef58-ab16-42f6-a7a0-d806b569bf08 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949d2267438542afaa92a261f25acef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a114c5309447bb74cd37c180b749d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:51.000734 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cdd1ef58-ab16-42f6-a7a0-d806b569bf08 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] 10.222.0.57 "GET /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae" status: 200 len: 1513 microversion: 2.1 time: 1.656683 Jul 18 02:52:51.006620 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2537/5058] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:49 2022] GET /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae => generated 1513 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:52:51.013262 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-24ddc4f2-ee63-47a7-9275-b69307c55b4e req-aae6847e-4d18-4950-8aa6-ce69fe89c792 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69bbb844-4d56-4e75-ae50-9c35c9ce6f9e", "name": "network-vif-unplugged", "status": "completed", "tag": "d926d5af-f867-44cd-8b60-abb0339ecf2a"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:52:51.042038 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-24ddc4f2-ee63-47a7-9275-b69307c55b4e req-aae6847e-4d18-4950-8aa6-ce69fe89c792 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:51.042518 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-24ddc4f2-ee63-47a7-9275-b69307c55b4e req-aae6847e-4d18-4950-8aa6-ce69fe89c792 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:51.067414 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-87ddab1c-1c50-4bcd-8649-d339c4216ad3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:51.075258 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-24ddc4f2-ee63-47a7-9275-b69307c55b4e req-aae6847e-4d18-4950-8aa6-ce69fe89c792 service nova] Creating event network-vif-unplugged:d926d5af-f867-44cd-8b60-abb0339ecf2a for instance 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e on n-h2-465891-3 Jul 18 02:52:51.085007 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-24ddc4f2-ee63-47a7-9275-b69307c55b4e req-aae6847e-4d18-4950-8aa6-ce69fe89c792 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076997 Jul 18 02:52:51.085648 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2538/5059] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:52:51.102541 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f4e63648-a825-40f3-80eb-10e7172bfec1 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:51.103288 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f4e63648-a825-40f3-80eb-10e7172bfec1 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: a8abc31e-bc67-4e33-b91b-39ec0dcb43b8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:51.113954 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-87ddab1c-1c50-4bcd-8649-d339c4216ad3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1688 microversion: 2.1 time: 0.828152 Jul 18 02:52:51.117078 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2522/5060] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:50 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1688 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:51.121242 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f4e63648-a825-40f3-80eb-10e7172bfec1 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:51.121740 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f4e63648-a825-40f3-80eb-10e7172bfec1 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:51.122562 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f4e63648-a825-40f3-80eb-10e7172bfec1 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:51.123007 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f4e63648-a825-40f3-80eb-10e7172bfec1 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:51.266492 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-02da9ab6-f934-4043-b747-36e40d2e3f7e tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:51.270568 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-02da9ab6-f934-4043-b747-36e40d2e3f7e tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:51.308366 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-02da9ab6-f934-4043-b747-36e40d2e3f7e tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:51.309580 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-02da9ab6-f934-4043-b747-36e40d2e3f7e tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:51.316336 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-02da9ab6-f934-4043-b747-36e40d2e3f7e tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:51.324715 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-02da9ab6-f934-4043-b747-36e40d2e3f7e tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:52.357417 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f4e63648-a825-40f3-80eb-10e7172bfec1 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:52.421956 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f4e63648-a825-40f3-80eb-10e7172bfec1 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8" status: 200 len: 1362 microversion: 2.1 time: 1.333866 Jul 18 02:52:52.427390 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2539/5061] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:51 2022] GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 => generated 1362 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:52.442890 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ec09d402-1d22-434b-a90d-3edfa75c9f9a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:52.444507 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ec09d402-1d22-434b-a90d-3edfa75c9f9a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:52.479475 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ec09d402-1d22-434b-a90d-3edfa75c9f9a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:52.480853 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ec09d402-1d22-434b-a90d-3edfa75c9f9a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:52.489915 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ec09d402-1d22-434b-a90d-3edfa75c9f9a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:52.493849 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ec09d402-1d22-434b-a90d-3edfa75c9f9a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:52.595285 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-02da9ab6-f934-4043-b747-36e40d2e3f7e tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1834 microversion: 2.1 time: 1.349714 Jul 18 02:52:52.607565 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2523/5062] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:51 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1834 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:52:52.617159 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-d27523ab-0c70-4b90-84f5-4b4197f1fdca req-8a1be6cf-da13-4d30-96dc-c4ee331d11a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8abc31e-bc67-4e33-b91b-39ec0dcb43b8", "tag": "346afce5-8af0-43f5-af5f-0ef4ee5d398a"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:52:52.655598 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-d27523ab-0c70-4b90-84f5-4b4197f1fdca req-8a1be6cf-da13-4d30-96dc-c4ee331d11a0 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:52.659139 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-d27523ab-0c70-4b90-84f5-4b4197f1fdca req-8a1be6cf-da13-4d30-96dc-c4ee331d11a0 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:52.722766 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-d27523ab-0c70-4b90-84f5-4b4197f1fdca req-8a1be6cf-da13-4d30-96dc-c4ee331d11a0 service nova] Creating event network-changed:346afce5-8af0-43f5-af5f-0ef4ee5d398a for instance a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 on n-h2-465891-3 Jul 18 02:52:52.750508 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-d27523ab-0c70-4b90-84f5-4b4197f1fdca req-8a1be6cf-da13-4d30-96dc-c4ee331d11a0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136678 Jul 18 02:52:52.759126 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2524/5063] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:52:52.790519 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ea58d48a-6c43-457e-9228-c2752fab9c1e tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:52.792955 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ea58d48a-6c43-457e-9228-c2752fab9c1e tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 4b0f1b28-e409-4b2d-ad07-b85f03fd59ae] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:52.827654 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea58d48a-6c43-457e-9228-c2752fab9c1e tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:52.832862 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea58d48a-6c43-457e-9228-c2752fab9c1e tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:52.842392 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea58d48a-6c43-457e-9228-c2752fab9c1e tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:52.847872 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea58d48a-6c43-457e-9228-c2752fab9c1e tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:52.954833 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ec09d402-1d22-434b-a90d-3edfa75c9f9a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:52.980182 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ec09d402-1d22-434b-a90d-3edfa75c9f9a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1360 microversion: 2.1 time: 0.550661 Jul 18 02:52:52.986120 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2540/5064] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:52 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1360 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:53.005871 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-936facbf-9fbb-4fce-b525-93ef0dbcea1a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:53.013680 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-936facbf-9fbb-4fce-b525-93ef0dbcea1a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:53.066004 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-936facbf-9fbb-4fce-b525-93ef0dbcea1a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:53.068383 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-936facbf-9fbb-4fce-b525-93ef0dbcea1a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:53.073298 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-936facbf-9fbb-4fce-b525-93ef0dbcea1a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:53.079146 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-936facbf-9fbb-4fce-b525-93ef0dbcea1a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:53.868888 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:52:54.300542 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-936facbf-9fbb-4fce-b525-93ef0dbcea1a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:54.317951 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-936facbf-9fbb-4fce-b525-93ef0dbcea1a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1683 microversion: 2.1 time: 1.329734 Jul 18 02:52:54.318865 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2541/5065] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:52 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1683 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:54.378042 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=8 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:52:54.433742 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ea58d48a-6c43-457e-9228-c2752fab9c1e tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949d2267438542afaa92a261f25acef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a114c5309447bb74cd37c180b749d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:54.442878 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ea58d48a-6c43-457e-9228-c2752fab9c1e tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] 10.222.0.57 "GET /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae" status: 200 len: 1513 microversion: 2.1 time: 1.677876 Jul 18 02:52:54.451570 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2525/5066] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:52 2022] GET /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae => generated 1513 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:54.476406 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-ad0c6781-38b2-45b2-b327-c6b912bbdce0 req-4c2c1efb-9e26-407a-898a-52daeb6130be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69bbb844-4d56-4e75-ae50-9c35c9ce6f9e", "name": "network-vif-plugged", "status": "completed", "tag": "d926d5af-f867-44cd-8b60-abb0339ecf2a"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:52:54.513968 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-ad0c6781-38b2-45b2-b327-c6b912bbdce0 req-4c2c1efb-9e26-407a-898a-52daeb6130be service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:54.514427 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-ad0c6781-38b2-45b2-b327-c6b912bbdce0 req-4c2c1efb-9e26-407a-898a-52daeb6130be service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:54.568208 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-ad0c6781-38b2-45b2-b327-c6b912bbdce0 req-4c2c1efb-9e26-407a-898a-52daeb6130be service nova] Creating event network-vif-plugged:d926d5af-f867-44cd-8b60-abb0339ecf2a for instance 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e on n-h2-465891-3 Jul 18 02:52:54.588437 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-ad0c6781-38b2-45b2-b327-c6b912bbdce0 req-4c2c1efb-9e26-407a-898a-52daeb6130be service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129743 Jul 18 02:52:54.592073 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2526/5067] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:52:54.619841 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3388aea8-ae7d-483d-8185-785d74d42db4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:54.620914 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3388aea8-ae7d-483d-8185-785d74d42db4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: a8abc31e-bc67-4e33-b91b-39ec0dcb43b8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:54.636260 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3388aea8-ae7d-483d-8185-785d74d42db4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:54.641332 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3388aea8-ae7d-483d-8185-785d74d42db4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:54.642661 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3388aea8-ae7d-483d-8185-785d74d42db4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:54.643365 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3388aea8-ae7d-483d-8185-785d74d42db4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:55.118011 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-24ae67e5-8706-4a93-932f-28bfc03253e8 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:55.119380 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-24ae67e5-8706-4a93-932f-28bfc03253e8 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:55.174018 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-24ae67e5-8706-4a93-932f-28bfc03253e8 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:55.183794 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-24ae67e5-8706-4a93-932f-28bfc03253e8 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:55.187349 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-24ae67e5-8706-4a93-932f-28bfc03253e8 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:55.198850 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-24ae67e5-8706-4a93-932f-28bfc03253e8 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:55.328834 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3388aea8-ae7d-483d-8185-785d74d42db4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:55.341974 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3388aea8-ae7d-483d-8185-785d74d42db4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8" status: 200 len: 1362 microversion: 2.1 time: 0.745161 Jul 18 02:52:55.348817 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2527/5068] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:54 2022] GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 => generated 1362 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:55.362109 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fc360fb9-7005-4885-9749-32383102647d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:55.363163 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fc360fb9-7005-4885-9749-32383102647d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:55.384244 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fc360fb9-7005-4885-9749-32383102647d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:55.384962 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fc360fb9-7005-4885-9749-32383102647d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:55.386206 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fc360fb9-7005-4885-9749-32383102647d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:55.386854 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fc360fb9-7005-4885-9749-32383102647d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:55.408528 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:52:55.714291 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-24ae67e5-8706-4a93-932f-28bfc03253e8 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:55.716176 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fc360fb9-7005-4885-9749-32383102647d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:55.728287 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-24ae67e5-8706-4a93-932f-28bfc03253e8 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1683 microversion: 2.1 time: 1.406642 Jul 18 02:52:55.728702 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fc360fb9-7005-4885-9749-32383102647d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1360 microversion: 2.1 time: 0.378043 Jul 18 02:52:55.730266 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2528/5069] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:55 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1360 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:55.736423 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-2e4ba9a3-a297-4352-b235-b8aaad5a54c6 req-8773964e-5b13-4d86-8800-f81dc5050829 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b0f1b28-e409-4b2d-ad07-b85f03fd59ae", "name": "network-vif-deleted", "tag": "66fc5dc7-004d-47eb-9ee6-b02d78dec0b9"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:52:55.748115 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-2e4ba9a3-a297-4352-b235-b8aaad5a54c6 req-8773964e-5b13-4d86-8800-f81dc5050829 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:55.748891 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-2e4ba9a3-a297-4352-b235-b8aaad5a54c6 req-8773964e-5b13-4d86-8800-f81dc5050829 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:55.761692 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2542/5070] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:54 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1683 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:55.775946 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d79989bf-c4d9-4991-a9ea-527264314c41 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:55.779380 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d79989bf-c4d9-4991-a9ea-527264314c41 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:55.800308 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-2e4ba9a3-a297-4352-b235-b8aaad5a54c6 req-8773964e-5b13-4d86-8800-f81dc5050829 service nova] Creating event network-vif-deleted:66fc5dc7-004d-47eb-9ee6-b02d78dec0b9 for instance 4b0f1b28-e409-4b2d-ad07-b85f03fd59ae on n-h2-465891-3 Jul 18 02:52:55.805614 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d79989bf-c4d9-4991-a9ea-527264314c41 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:55.819357 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d79989bf-c4d9-4991-a9ea-527264314c41 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:55.825775 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-2e4ba9a3-a297-4352-b235-b8aaad5a54c6 req-8773964e-5b13-4d86-8800-f81dc5050829 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093940 Jul 18 02:52:55.826604 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d79989bf-c4d9-4991-a9ea-527264314c41 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:55.830494 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d79989bf-c4d9-4991-a9ea-527264314c41 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:55.835111 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2529/5071] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:52:55.860026 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1956d95c-ca04-468b-af72-bfd95119b5b5 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:55.878569 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1956d95c-ca04-468b-af72-bfd95119b5b5 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 4b0f1b28-e409-4b2d-ad07-b85f03fd59ae] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:55.913094 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1956d95c-ca04-468b-af72-bfd95119b5b5 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:55.920120 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1956d95c-ca04-468b-af72-bfd95119b5b5 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:55.921148 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1956d95c-ca04-468b-af72-bfd95119b5b5 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:55.921853 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1956d95c-ca04-468b-af72-bfd95119b5b5 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:56.050797 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1956d95c-ca04-468b-af72-bfd95119b5b5 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:56.051670 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1956d95c-ca04-468b-af72-bfd95119b5b5 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:56.052517 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-1956d95c-ca04-468b-af72-bfd95119b5b5 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lazy-loading 'fault' on Instance uuid 4b0f1b28-e409-4b2d-ad07-b85f03fd59ae {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:52:56.239340 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1956d95c-ca04-468b-af72-bfd95119b5b5 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949d2267438542afaa92a261f25acef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a114c5309447bb74cd37c180b749d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:56.256022 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1956d95c-ca04-468b-af72-bfd95119b5b5 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] 10.222.0.57 "GET /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae" status: 200 len: 1309 microversion: 2.1 time: 0.413620 Jul 18 02:52:56.266970 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2530/5072] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:55 2022] GET /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae => generated 1309 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:56.273909 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1a42bfb3-fe64-46cd-b835-9b47c37101e3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:52:56.281994 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1a42bfb3-fe64-46cd-b835-9b47c37101e3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:56.301503 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1a42bfb3-fe64-46cd-b835-9b47c37101e3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:56.302417 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1a42bfb3-fe64-46cd-b835-9b47c37101e3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:56.303569 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1a42bfb3-fe64-46cd-b835-9b47c37101e3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:56.304335 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1a42bfb3-fe64-46cd-b835-9b47c37101e3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:56.344913 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d79989bf-c4d9-4991-a9ea-527264314c41 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:56.401168 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d79989bf-c4d9-4991-a9ea-527264314c41 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1683 microversion: 2.1 time: 0.646600 Jul 18 02:52:56.424116 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2543/5073] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:55 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1683 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:56.455636 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3b77f4a7-d9f9-4478-9d80-c63051f57ad8 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:56.457841 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3b77f4a7-d9f9-4478-9d80-c63051f57ad8 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: a8abc31e-bc67-4e33-b91b-39ec0dcb43b8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:56.475859 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3b77f4a7-d9f9-4478-9d80-c63051f57ad8 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:56.481393 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3b77f4a7-d9f9-4478-9d80-c63051f57ad8 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:56.483001 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3b77f4a7-d9f9-4478-9d80-c63051f57ad8 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:56.484024 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3b77f4a7-d9f9-4478-9d80-c63051f57ad8 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:56.625515 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1a42bfb3-fe64-46cd-b835-9b47c37101e3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "POST /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3/action" status: 200 len: 32633 microversion: 2.1 time: 0.355910 Jul 18 02:52:56.626724 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2531/5074] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:52:56 2022] POST /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3/action => generated 32633 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:52:56.755783 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1dcda069-d0f2-4d03-843f-a927b3d375a2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:56.756508 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1dcda069-d0f2-4d03-843f-a927b3d375a2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:56.786608 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1dcda069-d0f2-4d03-843f-a927b3d375a2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:56.797663 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1dcda069-d0f2-4d03-843f-a927b3d375a2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:56.800151 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1dcda069-d0f2-4d03-843f-a927b3d375a2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:56.800854 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1dcda069-d0f2-4d03-843f-a927b3d375a2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:56.895293 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3b77f4a7-d9f9-4478-9d80-c63051f57ad8 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:56.909457 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3b77f4a7-d9f9-4478-9d80-c63051f57ad8 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8" status: 200 len: 1362 microversion: 2.1 time: 0.479734 Jul 18 02:52:56.910692 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2544/5075] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:56 2022] GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 => generated 1362 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:56.923116 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6da80bc9-9b51-4bcc-b7c1-763c20d3fffd tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:52:56.924152 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6da80bc9-9b51-4bcc-b7c1-763c20d3fffd tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:56.941051 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6da80bc9-9b51-4bcc-b7c1-763c20d3fffd tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:56.943285 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6da80bc9-9b51-4bcc-b7c1-763c20d3fffd tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:56.944626 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6da80bc9-9b51-4bcc-b7c1-763c20d3fffd tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:56.946658 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6da80bc9-9b51-4bcc-b7c1-763c20d3fffd tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:57.069519 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1dcda069-d0f2-4d03-843f-a927b3d375a2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:57.091071 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1dcda069-d0f2-4d03-843f-a927b3d375a2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1360 microversion: 2.1 time: 0.346638 Jul 18 02:52:57.092102 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2532/5076] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:56 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1360 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:57.226384 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6da80bc9-9b51-4bcc-b7c1-763c20d3fffd tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0c276c8027304f30acfb01fd942387da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bc71fc2ec14dee91b9cab8a1c2bd4d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:57.227048 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6da80bc9-9b51-4bcc-b7c1-763c20d3fffd tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] flavor_id is None. Assuming migration. {{(pid=119543) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 18 02:52:57.227591 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6da80bc9-9b51-4bcc-b7c1-763c20d3fffd tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119543) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 02:52:57.304874 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b6bdb734-3f33-4a27-a7be-606c322c39e0 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:57.306086 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b6bdb734-3f33-4a27-a7be-606c322c39e0 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] [instance: 4b0f1b28-e409-4b2d-ad07-b85f03fd59ae] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:57.327098 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6bdb734-3f33-4a27-a7be-606c322c39e0 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:57.327902 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6bdb734-3f33-4a27-a7be-606c322c39e0 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:57.331252 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6bdb734-3f33-4a27-a7be-606c322c39e0 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:57.331939 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6bdb734-3f33-4a27-a7be-606c322c39e0 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:57.395759 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-b6bdb734-3f33-4a27-a7be-606c322c39e0 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] HTTP exception thrown: Instance 4b0f1b28-e409-4b2d-ad07-b85f03fd59ae could not be found. Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b6bdb734-3f33-4a27-a7be-606c322c39e0 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Request method failure captured: Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae HTTP/1.1 Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MmWg6qwEIQeR5BclkRQ47ET0LK0nIo8C14Lk4Bmf2CenjgqTDEw3DwK_8ewGA-atuL-9Q_FIL6FRTXE8K4laBxYZoZErKRod8vH1w3nB7LpQU8h-BnHdYSt3UE_pSmFg5bCL_O-rsYrxeHrk5BWVz7V9hbVypM_LMShMK88i_GgLqw Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: ed4a114c5309447bb74cd37c180b749d Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-VolumesSnapshotTestJSON-273917156 Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ed4a114c5309447bb74cd37c180b749d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ed4a114c5309447bb74cd37c180b749d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ed4a114c5309447bb74cd37c180b749d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ed4a114c5309447bb74cd37c180b749d"}]}] Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-VolumesSnapshotTestJSON-273917156 Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: ed4a114c5309447bb74cd37c180b749d Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-273917156 Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-VolumesSnapshotTestJSON-273917156-project Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 949d2267438542afaa92a261f25acef7 Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-VolumesSnapshotTestJSON-273917156-project Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 4b0f1b28-e409-4b2d-ad07-b85f03fd59ae could not be found. Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '4b0f1b28-e409-4b2d-ad07-b85f03fd59ae'} Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b0f1b28-e409-4b2d-ad07-b85f03fd59ae could not be found. Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b0f1b28-e409-4b2d-ad07-b85f03fd59ae could not be found. Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:52:57.398311 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:52:57.403452 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:52:57.403452 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:52:57.403452 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:52:57.403452 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:52:57.403452 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:52:57.403452 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b0f1b28-e409-4b2d-ad07-b85f03fd59ae could not be found. Jul 18 02:52:57.403452 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:52:57.412617 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b6bdb734-3f33-4a27-a7be-606c322c39e0 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] Returning 404 to user: Instance 4b0f1b28-e409-4b2d-ad07-b85f03fd59ae could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:52:57.415625 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b6bdb734-3f33-4a27-a7be-606c322c39e0 tempest-VolumesSnapshotTestJSON-273917156 tempest-VolumesSnapshotTestJSON-273917156-project] 10.222.0.57 "GET /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae" status: 404 len: 111 microversion: 2.1 time: 0.115144 Jul 18 02:52:57.420092 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2533/5077] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:57 2022] GET /compute/v2.1/servers/4b0f1b28-e409-4b2d-ad07-b85f03fd59ae => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:52:57.442790 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e562ce9f-9c0d-418b-9152-a110fe2cfca8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:57.444754 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e562ce9f-9c0d-418b-9152-a110fe2cfca8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:57.475487 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e562ce9f-9c0d-418b-9152-a110fe2cfca8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:57.475951 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e562ce9f-9c0d-418b-9152-a110fe2cfca8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:57.476857 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e562ce9f-9c0d-418b-9152-a110fe2cfca8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:57.480098 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e562ce9f-9c0d-418b-9152-a110fe2cfca8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:58.624581 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e562ce9f-9c0d-418b-9152-a110fe2cfca8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:58.671149 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e562ce9f-9c0d-418b-9152-a110fe2cfca8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1683 microversion: 2.1 time: 1.243528 Jul 18 02:52:58.676943 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2534/5078] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:57 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1683 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:58.718541 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-217c0f3e-d8bb-44da-b08d-a0b41005a3af tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:58.719595 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-217c0f3e-d8bb-44da-b08d-a0b41005a3af tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: a8abc31e-bc67-4e33-b91b-39ec0dcb43b8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:58.760475 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-217c0f3e-d8bb-44da-b08d-a0b41005a3af tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:58.760949 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-217c0f3e-d8bb-44da-b08d-a0b41005a3af tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:58.761833 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-217c0f3e-d8bb-44da-b08d-a0b41005a3af tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:58.772463 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-217c0f3e-d8bb-44da-b08d-a0b41005a3af tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:58.981267 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6da80bc9-9b51-4bcc-b7c1-763c20d3fffd tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3/action" status: 202 len: 0 microversion: 2.1 time: 2.062802 Jul 18 02:52:58.984901 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2545/5079] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:52:56 2022] POST /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3/action => generated 0 bytes in 2073 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:52:59.008856 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cbfceace-a7f4-419a-87b0-29b022c36115 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:59.009747 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cbfceace-a7f4-419a-87b0-29b022c36115 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:59.067311 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cbfceace-a7f4-419a-87b0-29b022c36115 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:59.072577 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cbfceace-a7f4-419a-87b0-29b022c36115 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:59.073510 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cbfceace-a7f4-419a-87b0-29b022c36115 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:59.085377 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cbfceace-a7f4-419a-87b0-29b022c36115 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:59.247554 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cbfceace-a7f4-419a-87b0-29b022c36115 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:59.270709 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cbfceace-a7f4-419a-87b0-29b022c36115 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1360 microversion: 2.1 time: 0.283949 Jul 18 02:52:59.271676 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2546/5080] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:58 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1360 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:59.277353 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ea106bb6-931b-4e6f-a486-14f1d05c1a0a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:59.278173 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ea106bb6-931b-4e6f-a486-14f1d05c1a0a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:59.300935 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ea106bb6-931b-4e6f-a486-14f1d05c1a0a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:59.300935 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ea106bb6-931b-4e6f-a486-14f1d05c1a0a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:59.301615 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ea106bb6-931b-4e6f-a486-14f1d05c1a0a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:59.302119 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ea106bb6-931b-4e6f-a486-14f1d05c1a0a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:59.472744 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-217c0f3e-d8bb-44da-b08d-a0b41005a3af tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:59.490019 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-217c0f3e-d8bb-44da-b08d-a0b41005a3af tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8" status: 200 len: 1362 microversion: 2.1 time: 0.810876 Jul 18 02:52:59.500703 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2535/5081] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:58 2022] GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 => generated 1362 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:59.693337 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e7719779-bc99-4012-bb3b-c21937d81fa2 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:59.695318 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e7719779-bc99-4012-bb3b-c21937d81fa2 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:59.708603 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e7719779-bc99-4012-bb3b-c21937d81fa2 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:59.709518 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e7719779-bc99-4012-bb3b-c21937d81fa2 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:59.710683 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e7719779-bc99-4012-bb3b-c21937d81fa2 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:59.718419 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e7719779-bc99-4012-bb3b-c21937d81fa2 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:00.387162 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ea106bb6-931b-4e6f-a486-14f1d05c1a0a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:00.396309 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ea106bb6-931b-4e6f-a486-14f1d05c1a0a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1692 microversion: 2.1 time: 1.123364 Jul 18 02:53:00.403824 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2547/5082] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:59 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1692 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:00.409344 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a0b22e44-4d0b-4a49-aed1-21132d7995bc tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:00.430290 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a0b22e44-4d0b-4a49-aed1-21132d7995bc tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:00.453722 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a0b22e44-4d0b-4a49-aed1-21132d7995bc tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:00.462538 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a0b22e44-4d0b-4a49-aed1-21132d7995bc tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:00.463845 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a0b22e44-4d0b-4a49-aed1-21132d7995bc tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:00.464781 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a0b22e44-4d0b-4a49-aed1-21132d7995bc tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:00.519937 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e7719779-bc99-4012-bb3b-c21937d81fa2 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:00.529935 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e7719779-bc99-4012-bb3b-c21937d81fa2 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1683 microversion: 2.1 time: 0.840559 Jul 18 02:53:00.552998 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2536/5083] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:59 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1683 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:53:00.561289 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8bba3024-ae77-4d8d-b445-8031cd82981b tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:00.573850 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8bba3024-ae77-4d8d-b445-8031cd82981b tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: a8abc31e-bc67-4e33-b91b-39ec0dcb43b8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:00.605392 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8bba3024-ae77-4d8d-b445-8031cd82981b tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:00.608518 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8bba3024-ae77-4d8d-b445-8031cd82981b tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:00.609659 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8bba3024-ae77-4d8d-b445-8031cd82981b tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:00.618909 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8bba3024-ae77-4d8d-b445-8031cd82981b tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:00.741794 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a0b22e44-4d0b-4a49-aed1-21132d7995bc tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:00.752511 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a0b22e44-4d0b-4a49-aed1-21132d7995bc tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1360 microversion: 2.1 time: 0.346976 Jul 18 02:53:00.774924 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2548/5084] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:00 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1360 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:00.794602 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-f5b47a95-3f9b-441d-906d-f92021dd7629 req-eea79c25-0551-465e-9f14-8176be096994 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8abc31e-bc67-4e33-b91b-39ec0dcb43b8", "name": "network-vif-plugged", "status": "completed", "tag": "346afce5-8af0-43f5-af5f-0ef4ee5d398a"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:53:00.861219 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-f5b47a95-3f9b-441d-906d-f92021dd7629 req-eea79c25-0551-465e-9f14-8176be096994 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:00.864418 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-f5b47a95-3f9b-441d-906d-f92021dd7629 req-eea79c25-0551-465e-9f14-8176be096994 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:00.954282 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-f5b47a95-3f9b-441d-906d-f92021dd7629 req-eea79c25-0551-465e-9f14-8176be096994 service nova] Creating event network-vif-plugged:346afce5-8af0-43f5-af5f-0ef4ee5d398a for instance a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 on n-h2-465891-3 Jul 18 02:53:01.008869 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-f5b47a95-3f9b-441d-906d-f92021dd7629 req-eea79c25-0551-465e-9f14-8176be096994 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.218082 Jul 18 02:53:01.016345 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2549/5085] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:53:01.410400 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8bba3024-ae77-4d8d-b445-8031cd82981b tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:01.437379 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8bba3024-ae77-4d8d-b445-8031cd82981b tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8" status: 200 len: 1362 microversion: 2.1 time: 0.882686 Jul 18 02:53:01.450921 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b0580d43-9150-4c96-9050-ceea0a69dcbe tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:01.456723 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b0580d43-9150-4c96-9050-ceea0a69dcbe tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:01.462794 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2537/5086] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:00 2022] GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 => generated 1362 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:01.512533 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b0580d43-9150-4c96-9050-ceea0a69dcbe tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:01.514000 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b0580d43-9150-4c96-9050-ceea0a69dcbe tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:01.517363 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b0580d43-9150-4c96-9050-ceea0a69dcbe tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:01.524239 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b0580d43-9150-4c96-9050-ceea0a69dcbe tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:01.566774 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-07eee002-4572-420e-b055-082db7495dac tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:01.567480 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-07eee002-4572-420e-b055-082db7495dac tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:01.579966 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-07eee002-4572-420e-b055-082db7495dac tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:01.580515 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-07eee002-4572-420e-b055-082db7495dac tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:01.609812 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-07eee002-4572-420e-b055-082db7495dac tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:01.619391 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-07eee002-4572-420e-b055-082db7495dac tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:02.224773 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b0580d43-9150-4c96-9050-ceea0a69dcbe tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:02.254063 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b0580d43-9150-4c96-9050-ceea0a69dcbe tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1692 microversion: 2.1 time: 0.824150 Jul 18 02:53:02.254693 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2550/5087] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:01 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1692 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:53:02.278391 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-13d757f1-9fc4-4724-aed9-eb79a28e2b12 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:02.279029 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-13d757f1-9fc4-4724-aed9-eb79a28e2b12 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:02.341844 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-13d757f1-9fc4-4724-aed9-eb79a28e2b12 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:02.341844 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-13d757f1-9fc4-4724-aed9-eb79a28e2b12 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:02.341844 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-13d757f1-9fc4-4724-aed9-eb79a28e2b12 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:02.341844 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-13d757f1-9fc4-4724-aed9-eb79a28e2b12 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:02.431582 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-07eee002-4572-420e-b055-082db7495dac tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:02.468813 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-07eee002-4572-420e-b055-082db7495dac tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1683 microversion: 2.1 time: 0.907187 Jul 18 02:53:02.477778 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2538/5088] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:01 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1683 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:53:02.482089 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:53:02.505133 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8a675dfe-6717-46cb-b9c4-c216c09b6359 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:02.526691 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8a675dfe-6717-46cb-b9c4-c216c09b6359 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: a8abc31e-bc67-4e33-b91b-39ec0dcb43b8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:02.537757 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-13d757f1-9fc4-4724-aed9-eb79a28e2b12 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:02.540764 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-13d757f1-9fc4-4724-aed9-eb79a28e2b12 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:02.542445 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-13d757f1-9fc4-4724-aed9-eb79a28e2b12 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lazy-loading 'fault' on Instance uuid bf71e56d-5a67-439f-9781-6c0356dc8d6f {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:53:02.566608 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a675dfe-6717-46cb-b9c4-c216c09b6359 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:02.567538 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a675dfe-6717-46cb-b9c4-c216c09b6359 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:02.584257 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a675dfe-6717-46cb-b9c4-c216c09b6359 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:02.585914 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a675dfe-6717-46cb-b9c4-c216c09b6359 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:02.748908 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-13d757f1-9fc4-4724-aed9-eb79a28e2b12 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:02.783654 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-13d757f1-9fc4-4724-aed9-eb79a28e2b12 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 200 len: 1365 microversion: 2.1 time: 0.516337 Jul 18 02:53:02.784770 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2551/5089] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:02 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 1365 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:03.041366 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8a675dfe-6717-46cb-b9c4-c216c09b6359 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:03.052665 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8a675dfe-6717-46cb-b9c4-c216c09b6359 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8" status: 200 len: 1362 microversion: 2.1 time: 0.563645 Jul 18 02:53:03.075497 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2539/5090] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:02 2022] GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 => generated 1362 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:03.278606 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-63b8a77e-7905-4ae6-8bbd-91ec02468214 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:03.280549 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-63b8a77e-7905-4ae6-8bbd-91ec02468214 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:03.309715 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-63b8a77e-7905-4ae6-8bbd-91ec02468214 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:03.310293 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-63b8a77e-7905-4ae6-8bbd-91ec02468214 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:03.315002 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-63b8a77e-7905-4ae6-8bbd-91ec02468214 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:03.315821 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-63b8a77e-7905-4ae6-8bbd-91ec02468214 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:03.496139 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9ecfb229-5c78-4c82-bb77-6f40218bc990 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:03.497088 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9ecfb229-5c78-4c82-bb77-6f40218bc990 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:03.535863 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9ecfb229-5c78-4c82-bb77-6f40218bc990 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:03.536558 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9ecfb229-5c78-4c82-bb77-6f40218bc990 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:03.537947 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9ecfb229-5c78-4c82-bb77-6f40218bc990 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:03.566798 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9ecfb229-5c78-4c82-bb77-6f40218bc990 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:04.113748 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-63b8a77e-7905-4ae6-8bbd-91ec02468214 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:04.136596 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-63b8a77e-7905-4ae6-8bbd-91ec02468214 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1692 microversion: 2.1 time: 0.866302 Jul 18 02:53:04.139061 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2552/5091] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:03 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1692 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:04.157539 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8cbb9e17-c469-4e38-87e5-5d0e9f3ef17c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:04.158971 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8cbb9e17-c469-4e38-87e5-5d0e9f3ef17c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:04.188365 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8cbb9e17-c469-4e38-87e5-5d0e9f3ef17c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:04.189241 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8cbb9e17-c469-4e38-87e5-5d0e9f3ef17c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:04.204538 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8cbb9e17-c469-4e38-87e5-5d0e9f3ef17c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:04.205102 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8cbb9e17-c469-4e38-87e5-5d0e9f3ef17c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:04.246918 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-8cbb9e17-c469-4e38-87e5-5d0e9f3ef17c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] HTTP exception thrown: Instance bf71e56d-5a67-439f-9781-6c0356dc8d6f could not be found. Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8cbb9e17-c469-4e38-87e5-5d0e9f3ef17c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Request method failure captured: Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f HTTP/1.1 Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MliWHzVx10oBgzg24taGfvPF1POfFT53P2_RlSdFLebnrvIbeAs5qvjZ1EAd9Fni5RvXZYA8fjgna7ooKOtwOz_kbJVpuNazgX6TlGzOYOFYf5fy5vfDN_5wwJEwayQdbLz2BaqgZyDtVrhp2skZQbTuh-KNZeRA8bkIRl3oXepO1E Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 2b7654e273f6487ba83382da4f96056d Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-TestVolumeBootPattern-598001453 Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2b7654e273f6487ba83382da4f96056d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2b7654e273f6487ba83382da4f96056d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2b7654e273f6487ba83382da4f96056d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2b7654e273f6487ba83382da4f96056d"}]}] Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-TestVolumeBootPattern-598001453 Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 2b7654e273f6487ba83382da4f96056d Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-TestVolumeBootPattern-598001453 Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-TestVolumeBootPattern-598001453-project Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: d1afc1702f8045a396b98e5c24b124e7 Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-TestVolumeBootPattern-598001453-project Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance bf71e56d-5a67-439f-9781-6c0356dc8d6f could not be found. Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'bf71e56d-5a67-439f-9781-6c0356dc8d6f'} Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf71e56d-5a67-439f-9781-6c0356dc8d6f could not be found. Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf71e56d-5a67-439f-9781-6c0356dc8d6f could not be found. Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:53:04.248929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:53:04.256051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:53:04.256051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:53:04.256051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:53:04.256051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:53:04.256051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:53:04.256051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf71e56d-5a67-439f-9781-6c0356dc8d6f could not be found. Jul 18 02:53:04.256051 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:53:04.256051 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8cbb9e17-c469-4e38-87e5-5d0e9f3ef17c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Returning 404 to user: Instance bf71e56d-5a67-439f-9781-6c0356dc8d6f could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:53:04.265286 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8cbb9e17-c469-4e38-87e5-5d0e9f3ef17c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 404 len: 111 microversion: 2.1 time: 0.124205 Jul 18 02:53:04.274067 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2553/5092] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:04 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:53:04.282716 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8e6b3992-a2a0-444e-ba1f-d50b8be800ac tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:04.302651 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8e6b3992-a2a0-444e-ba1f-d50b8be800ac tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: a8abc31e-bc67-4e33-b91b-39ec0dcb43b8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:04.314908 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8e6b3992-a2a0-444e-ba1f-d50b8be800ac tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:04.315630 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8e6b3992-a2a0-444e-ba1f-d50b8be800ac tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:04.316648 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8e6b3992-a2a0-444e-ba1f-d50b8be800ac tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:04.317305 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8e6b3992-a2a0-444e-ba1f-d50b8be800ac tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:04.730497 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9ecfb229-5c78-4c82-bb77-6f40218bc990 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:04.739972 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9ecfb229-5c78-4c82-bb77-6f40218bc990 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1683 microversion: 2.1 time: 1.248565 Jul 18 02:53:04.754149 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2540/5093] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:03 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1683 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:53:04.965211 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8e6b3992-a2a0-444e-ba1f-d50b8be800ac tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:04.980572 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8e6b3992-a2a0-444e-ba1f-d50b8be800ac tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8" status: 200 len: 1548 microversion: 2.1 time: 0.704543 Jul 18 02:53:04.981041 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2554/5094] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:04 2022] GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 => generated 1548 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:04.997825 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ffa31dea-2f19-4fbc-adb3-c7dddb19ae7a tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:04.998697 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ffa31dea-2f19-4fbc-adb3-c7dddb19ae7a tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: a8abc31e-bc67-4e33-b91b-39ec0dcb43b8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:05.009538 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ffa31dea-2f19-4fbc-adb3-c7dddb19ae7a tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:05.010876 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ffa31dea-2f19-4fbc-adb3-c7dddb19ae7a tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:05.011950 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ffa31dea-2f19-4fbc-adb3-c7dddb19ae7a tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:05.012587 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ffa31dea-2f19-4fbc-adb3-c7dddb19ae7a tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:05.156623 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fa932e93-fa65-4788-9ecb-bd7e69f42b49 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:05.157262 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fa932e93-fa65-4788-9ecb-bd7e69f42b49 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:05.176337 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fa932e93-fa65-4788-9ecb-bd7e69f42b49 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:05.177485 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fa932e93-fa65-4788-9ecb-bd7e69f42b49 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:05.180277 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fa932e93-fa65-4788-9ecb-bd7e69f42b49 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:05.181413 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fa932e93-fa65-4788-9ecb-bd7e69f42b49 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:05.569963 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ffa31dea-2f19-4fbc-adb3-c7dddb19ae7a tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.575549 Jul 18 02:53:05.576757 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2541/5095] 10.222.0.57 () {58 vars in 1274 bytes} [Mon Jul 18 02:53:04 2022] GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8/os-interface => generated 285 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:53:05.763119 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-19a02f82-0ebd-4836-9b80-18612027bd16 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:05.763869 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-19a02f82-0ebd-4836-9b80-18612027bd16 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:05.804591 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-19a02f82-0ebd-4836-9b80-18612027bd16 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:05.804591 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-19a02f82-0ebd-4836-9b80-18612027bd16 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:05.804591 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-19a02f82-0ebd-4836-9b80-18612027bd16 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:05.804591 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-19a02f82-0ebd-4836-9b80-18612027bd16 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:07.499423 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fa932e93-fa65-4788-9ecb-bd7e69f42b49 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:07.529794 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fa932e93-fa65-4788-9ecb-bd7e69f42b49 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1692 microversion: 2.1 time: 2.376987 Jul 18 02:53:07.536427 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2555/5096] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:05 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1692 bytes in 2384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:07.640162 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-19a02f82-0ebd-4836-9b80-18612027bd16 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:07.656074 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-19a02f82-0ebd-4836-9b80-18612027bd16 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1683 microversion: 2.1 time: 1.898925 Jul 18 02:53:07.657009 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2542/5097] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:05 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1683 bytes in 1900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:08.556057 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-16953d36-a28b-4a83-a7c6-757b68133ae0 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:08.558603 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-16953d36-a28b-4a83-a7c6-757b68133ae0 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:08.606528 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-16953d36-a28b-4a83-a7c6-757b68133ae0 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:08.611270 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-16953d36-a28b-4a83-a7c6-757b68133ae0 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:08.614717 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-16953d36-a28b-4a83-a7c6-757b68133ae0 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:08.619857 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-16953d36-a28b-4a83-a7c6-757b68133ae0 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:08.677527 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-42cd50bc-12f8-42f7-a431-8a28333ac2b3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:08.680863 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-42cd50bc-12f8-42f7-a431-8a28333ac2b3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:08.683996 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:53:08.693520 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-42cd50bc-12f8-42f7-a431-8a28333ac2b3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:08.707824 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-42cd50bc-12f8-42f7-a431-8a28333ac2b3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:08.709202 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-42cd50bc-12f8-42f7-a431-8a28333ac2b3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:08.719394 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-42cd50bc-12f8-42f7-a431-8a28333ac2b3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:09.984390 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-16953d36-a28b-4a83-a7c6-757b68133ae0 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:10.032861 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-16953d36-a28b-4a83-a7c6-757b68133ae0 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1697 microversion: 2.1 time: 1.481959 Jul 18 02:53:10.033475 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2556/5098] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:08 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1697 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:10.065796 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-569fde11-cc06-4686-9e2c-aaf249571f9a req-6fe39bb9-f858-4717-bda6-407228766393 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8abc31e-bc67-4e33-b91b-39ec0dcb43b8", "tag": "346afce5-8af0-43f5-af5f-0ef4ee5d398a"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:53:10.074980 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-42cd50bc-12f8-42f7-a431-8a28333ac2b3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:10.107521 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-42cd50bc-12f8-42f7-a431-8a28333ac2b3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1683 microversion: 2.1 time: 1.435585 Jul 18 02:53:10.113393 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-569fde11-cc06-4686-9e2c-aaf249571f9a req-6fe39bb9-f858-4717-bda6-407228766393 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:10.113888 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-569fde11-cc06-4686-9e2c-aaf249571f9a req-6fe39bb9-f858-4717-bda6-407228766393 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:10.123934 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2543/5099] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:08 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1683 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:10.177217 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-569fde11-cc06-4686-9e2c-aaf249571f9a req-6fe39bb9-f858-4717-bda6-407228766393 service nova] Creating event network-changed:346afce5-8af0-43f5-af5f-0ef4ee5d398a for instance a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 on n-h2-465891-3 Jul 18 02:53:10.204321 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-569fde11-cc06-4686-9e2c-aaf249571f9a req-6fe39bb9-f858-4717-bda6-407228766393 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169479 Jul 18 02:53:10.213678 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2557/5100] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:53:11.066803 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1d79cad4-4c8f-4ed1-be6a-18d176929d64 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:11.067891 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1d79cad4-4c8f-4ed1-be6a-18d176929d64 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:11.130547 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1d79cad4-4c8f-4ed1-be6a-18d176929d64 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:11.133369 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1d79cad4-4c8f-4ed1-be6a-18d176929d64 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:11.136852 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1d79cad4-4c8f-4ed1-be6a-18d176929d64 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:11.138263 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1d79cad4-4c8f-4ed1-be6a-18d176929d64 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:11.144886 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-849335dd-4ba7-48e2-971d-81056d475d53 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:11.147020 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-849335dd-4ba7-48e2-971d-81056d475d53 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:11.180738 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-849335dd-4ba7-48e2-971d-81056d475d53 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:11.199490 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-849335dd-4ba7-48e2-971d-81056d475d53 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:11.200662 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-849335dd-4ba7-48e2-971d-81056d475d53 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:11.210067 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-849335dd-4ba7-48e2-971d-81056d475d53 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:11.948690 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1d79cad4-4c8f-4ed1-be6a-18d176929d64 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:12.020419 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1d79cad4-4c8f-4ed1-be6a-18d176929d64 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1697 microversion: 2.1 time: 0.946361 Jul 18 02:53:12.032168 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2544/5101] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:11 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1697 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:12.631212 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-849335dd-4ba7-48e2-971d-81056d475d53 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:12.670300 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-849335dd-4ba7-48e2-971d-81056d475d53 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1683 microversion: 2.1 time: 1.529192 Jul 18 02:53:12.687616 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2558/5102] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:11 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1683 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:13.051375 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-816ed9e4-b7d7-421b-b272-cd5910a10574 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:13.052237 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-816ed9e4-b7d7-421b-b272-cd5910a10574 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:13.083255 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-816ed9e4-b7d7-421b-b272-cd5910a10574 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:13.092414 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-816ed9e4-b7d7-421b-b272-cd5910a10574 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:13.096243 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-816ed9e4-b7d7-421b-b272-cd5910a10574 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:13.102209 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-816ed9e4-b7d7-421b-b272-cd5910a10574 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:13.689306 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-37cceb00-f7c4-40d2-a1e7-4beee33c37d5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:13.694880 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-37cceb00-f7c4-40d2-a1e7-4beee33c37d5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:13.703239 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=68 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:53:13.745594 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-37cceb00-f7c4-40d2-a1e7-4beee33c37d5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:13.746107 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-37cceb00-f7c4-40d2-a1e7-4beee33c37d5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:13.747117 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-37cceb00-f7c4-40d2-a1e7-4beee33c37d5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:13.747587 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-37cceb00-f7c4-40d2-a1e7-4beee33c37d5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:13.882727 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-816ed9e4-b7d7-421b-b272-cd5910a10574 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:13.910612 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-816ed9e4-b7d7-421b-b272-cd5910a10574 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1697 microversion: 2.1 time: 0.850764 Jul 18 02:53:13.923154 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2545/5103] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:13 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1697 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:14.231788 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-37cceb00-f7c4-40d2-a1e7-4beee33c37d5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:14.252214 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-37cceb00-f7c4-40d2-a1e7-4beee33c37d5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1683 microversion: 2.1 time: 0.566776 Jul 18 02:53:14.262128 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2559/5104] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:13 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1683 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:14.944929 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c04cf34c-3111-412b-8e00-a0608ac673f7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:14.946505 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c04cf34c-3111-412b-8e00-a0608ac673f7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:15.020472 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c04cf34c-3111-412b-8e00-a0608ac673f7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:15.026187 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c04cf34c-3111-412b-8e00-a0608ac673f7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:15.038738 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c04cf34c-3111-412b-8e00-a0608ac673f7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:15.039210 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c04cf34c-3111-412b-8e00-a0608ac673f7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:15.122088 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=100 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:53:15.270952 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a9cdeee6-6cb4-4c6e-ac8f-3ded880218e4 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:15.273609 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a9cdeee6-6cb4-4c6e-ac8f-3ded880218e4 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:15.294760 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9cdeee6-6cb4-4c6e-ac8f-3ded880218e4 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:15.295631 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9cdeee6-6cb4-4c6e-ac8f-3ded880218e4 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:15.297381 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9cdeee6-6cb4-4c6e-ac8f-3ded880218e4 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:15.298228 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9cdeee6-6cb4-4c6e-ac8f-3ded880218e4 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:15.801856 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c04cf34c-3111-412b-8e00-a0608ac673f7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:15.811860 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c04cf34c-3111-412b-8e00-a0608ac673f7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1697 microversion: 2.1 time: 0.874768 Jul 18 02:53:15.830509 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2546/5105] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:14 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1697 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:15.871128 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a9cdeee6-6cb4-4c6e-ac8f-3ded880218e4 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:15.893663 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a9cdeee6-6cb4-4c6e-ac8f-3ded880218e4 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1683 microversion: 2.1 time: 0.626627 Jul 18 02:53:15.894416 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2560/5106] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:15 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1683 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:53:16.831813 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b1dcdbf0-472e-4aa7-92a8-9ebba04dbc94 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:16.833378 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b1dcdbf0-472e-4aa7-92a8-9ebba04dbc94 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:16.845821 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b1dcdbf0-472e-4aa7-92a8-9ebba04dbc94 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:16.848353 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b1dcdbf0-472e-4aa7-92a8-9ebba04dbc94 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:16.850990 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b1dcdbf0-472e-4aa7-92a8-9ebba04dbc94 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:16.851699 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b1dcdbf0-472e-4aa7-92a8-9ebba04dbc94 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:16.915649 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5c401ac1-2899-4e9a-a3b8-725a40bc6d9b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:16.916491 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5c401ac1-2899-4e9a-a3b8-725a40bc6d9b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:16.937356 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5c401ac1-2899-4e9a-a3b8-725a40bc6d9b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:16.940960 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5c401ac1-2899-4e9a-a3b8-725a40bc6d9b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:16.947284 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5c401ac1-2899-4e9a-a3b8-725a40bc6d9b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:16.948498 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5c401ac1-2899-4e9a-a3b8-725a40bc6d9b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:17.062834 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b1dcdbf0-472e-4aa7-92a8-9ebba04dbc94 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:17.072189 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b1dcdbf0-472e-4aa7-92a8-9ebba04dbc94 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1697 microversion: 2.1 time: 0.244991 Jul 18 02:53:17.081129 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2547/5107] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:16 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1697 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:17.354858 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5c401ac1-2899-4e9a-a3b8-725a40bc6d9b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:17.364760 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5c401ac1-2899-4e9a-a3b8-725a40bc6d9b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1683 microversion: 2.1 time: 0.457199 Jul 18 02:53:17.366535 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2561/5108] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:16 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1683 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:53:18.095581 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-69f1b0b3-4b1d-4640-bb9f-6fd71f604c57 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:18.096806 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-69f1b0b3-4b1d-4640-bb9f-6fd71f604c57 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:18.108939 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69f1b0b3-4b1d-4640-bb9f-6fd71f604c57 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:18.109392 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69f1b0b3-4b1d-4640-bb9f-6fd71f604c57 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:18.110518 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69f1b0b3-4b1d-4640-bb9f-6fd71f604c57 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:18.111182 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69f1b0b3-4b1d-4640-bb9f-6fd71f604c57 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:18.346360 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bbc8adf6-bcd2-40eb-86c1-cdccb4f93798 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:18.346942 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bbc8adf6-bcd2-40eb-86c1-cdccb4f93798 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:18.389872 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bbc8adf6-bcd2-40eb-86c1-cdccb4f93798 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:18.390540 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bbc8adf6-bcd2-40eb-86c1-cdccb4f93798 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:18.391397 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bbc8adf6-bcd2-40eb-86c1-cdccb4f93798 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:18.394305 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bbc8adf6-bcd2-40eb-86c1-cdccb4f93798 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:18.480188 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bbc8adf6-bcd2-40eb-86c1-cdccb4f93798 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:53:18.823620 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bbc8adf6-bcd2-40eb-86c1-cdccb4f93798 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "DELETE /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799" status: 204 len: 0 microversion: 2.1 time: 0.484681 Jul 18 02:53:18.826645 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2562/5109] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:53:18 2022] DELETE /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:53:18.839431 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-079b9e0f-59fa-4fdf-9980-d525ebe4a60d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:18.842792 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-079b9e0f-59fa-4fdf-9980-d525ebe4a60d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:18.862201 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-079b9e0f-59fa-4fdf-9980-d525ebe4a60d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:18.863304 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-079b9e0f-59fa-4fdf-9980-d525ebe4a60d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:18.867584 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-079b9e0f-59fa-4fdf-9980-d525ebe4a60d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:18.870446 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-079b9e0f-59fa-4fdf-9980-d525ebe4a60d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:19.060618 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-69f1b0b3-4b1d-4640-bb9f-6fd71f604c57 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:19.090022 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-69f1b0b3-4b1d-4640-bb9f-6fd71f604c57 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1697 microversion: 2.1 time: 0.991297 Jul 18 02:53:19.106398 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2548/5110] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:18 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1697 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:19.113503 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-041f313e-79c0-4cbd-a103-c08bb832d42e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:19.116597 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-041f313e-79c0-4cbd-a103-c08bb832d42e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:19.125475 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-041f313e-79c0-4cbd-a103-c08bb832d42e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:19.126733 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-041f313e-79c0-4cbd-a103-c08bb832d42e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:19.127812 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-041f313e-79c0-4cbd-a103-c08bb832d42e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:19.128545 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-041f313e-79c0-4cbd-a103-c08bb832d42e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:19.769413 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-041f313e-79c0-4cbd-a103-c08bb832d42e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:19.778063 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-041f313e-79c0-4cbd-a103-c08bb832d42e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799" status: 200 len: 1411 microversion: 2.1 time: 0.668898 Jul 18 02:53:19.791896 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2549/5111] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:19 2022] GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799 => generated 1411 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:19.806234 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-079b9e0f-59fa-4fdf-9980-d525ebe4a60d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:19.821432 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-079b9e0f-59fa-4fdf-9980-d525ebe4a60d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1683 microversion: 2.1 time: 0.992504 Jul 18 02:53:19.822794 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2563/5112] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:18 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1683 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:20.115128 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-573a93c5-f06b-48f1-af60-c49ea60a8de6 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:20.116452 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-573a93c5-f06b-48f1-af60-c49ea60a8de6 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:20.146837 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-573a93c5-f06b-48f1-af60-c49ea60a8de6 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:20.159049 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-573a93c5-f06b-48f1-af60-c49ea60a8de6 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:20.161052 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-573a93c5-f06b-48f1-af60-c49ea60a8de6 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:20.162842 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-573a93c5-f06b-48f1-af60-c49ea60a8de6 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:20.818204 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e1fae6ce-4cd3-429f-91eb-e6f98471b260 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:20.821947 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e1fae6ce-4cd3-429f-91eb-e6f98471b260 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:20.873023 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e1fae6ce-4cd3-429f-91eb-e6f98471b260 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:20.887706 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e1fae6ce-4cd3-429f-91eb-e6f98471b260 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:20.895050 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e1fae6ce-4cd3-429f-91eb-e6f98471b260 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:20.908276 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e1fae6ce-4cd3-429f-91eb-e6f98471b260 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:22.119214 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-573a93c5-f06b-48f1-af60-c49ea60a8de6 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:22.128581 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-573a93c5-f06b-48f1-af60-c49ea60a8de6 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1697 microversion: 2.1 time: 2.020742 Jul 18 02:53:22.136931 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2550/5113] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:20 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1697 bytes in 2030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:22.149561 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e5c72124-52cf-452c-953e-edb4144f6080 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:22.167767 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e5c72124-52cf-452c-953e-edb4144f6080 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:22.208106 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e1fae6ce-4cd3-429f-91eb-e6f98471b260 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:22.211599 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e5c72124-52cf-452c-953e-edb4144f6080 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:22.215691 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e5c72124-52cf-452c-953e-edb4144f6080 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:22.215691 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e5c72124-52cf-452c-953e-edb4144f6080 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:22.216137 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e5c72124-52cf-452c-953e-edb4144f6080 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:22.265300 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e1fae6ce-4cd3-429f-91eb-e6f98471b260 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799" status: 200 len: 1411 microversion: 2.1 time: 1.460479 Jul 18 02:53:22.266884 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2564/5114] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:20 2022] GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799 => generated 1411 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:23.157185 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d1c9aae8-9bc0-4e1b-b338-e605eb32ca7b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:23.158430 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d1c9aae8-9bc0-4e1b-b338-e605eb32ca7b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:23.198515 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d1c9aae8-9bc0-4e1b-b338-e605eb32ca7b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:23.216422 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d1c9aae8-9bc0-4e1b-b338-e605eb32ca7b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:23.221023 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d1c9aae8-9bc0-4e1b-b338-e605eb32ca7b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:23.222317 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d1c9aae8-9bc0-4e1b-b338-e605eb32ca7b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:23.666396 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e5c72124-52cf-452c-953e-edb4144f6080 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:23.680349 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e5c72124-52cf-452c-953e-edb4144f6080 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1683 microversion: 2.1 time: 1.541785 Jul 18 02:53:23.687214 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2551/5115] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:22 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1683 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:23.705874 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d17e6d41-c657-4986-8209-88f8221573b1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:23.714469 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d17e6d41-c657-4986-8209-88f8221573b1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:23.736760 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d17e6d41-c657-4986-8209-88f8221573b1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:23.738476 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d17e6d41-c657-4986-8209-88f8221573b1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:23.746610 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d17e6d41-c657-4986-8209-88f8221573b1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:23.754710 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d17e6d41-c657-4986-8209-88f8221573b1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:24.747737 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d1c9aae8-9bc0-4e1b-b338-e605eb32ca7b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:24.779069 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d17e6d41-c657-4986-8209-88f8221573b1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:24.800891 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d17e6d41-c657-4986-8209-88f8221573b1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799" status: 200 len: 1411 microversion: 2.1 time: 1.105846 Jul 18 02:53:24.801507 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2552/5116] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:23 2022] GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799 => generated 1411 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:24.825466 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c957eb66-fb71-4bf0-b058-0967832ca2ad tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:24.826226 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c957eb66-fb71-4bf0-b058-0967832ca2ad tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:24.884478 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c957eb66-fb71-4bf0-b058-0967832ca2ad tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:24.885818 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c957eb66-fb71-4bf0-b058-0967832ca2ad tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:24.890139 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c957eb66-fb71-4bf0-b058-0967832ca2ad tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:24.891563 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c957eb66-fb71-4bf0-b058-0967832ca2ad tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:24.899233 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d1c9aae8-9bc0-4e1b-b338-e605eb32ca7b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1697 microversion: 2.1 time: 1.735118 Jul 18 02:53:24.910981 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2565/5117] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:23 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1697 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:53:25.056359 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-be606f76-f654-4950-97c7-9569a241740c req-f5843acb-a40a-47fe-9495-3c4b2a8a10f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "702e7ce4-6d2d-41a3-97f9-2403df247799", "name": "network-vif-deleted", "tag": "58fe3c54-fb57-4229-8be8-50d6596402ed"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:53:25.083034 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-be606f76-f654-4950-97c7-9569a241740c req-f5843acb-a40a-47fe-9495-3c4b2a8a10f9 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:25.084537 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-be606f76-f654-4950-97c7-9569a241740c req-f5843acb-a40a-47fe-9495-3c4b2a8a10f9 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:25.170104 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-be606f76-f654-4950-97c7-9569a241740c req-f5843acb-a40a-47fe-9495-3c4b2a8a10f9 service nova] Creating event network-vif-deleted:58fe3c54-fb57-4229-8be8-50d6596402ed for instance 702e7ce4-6d2d-41a3-97f9-2403df247799 on n-h1-465891-3 Jul 18 02:53:25.225785 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-be606f76-f654-4950-97c7-9569a241740c req-f5843acb-a40a-47fe-9495-3c4b2a8a10f9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174574 Jul 18 02:53:25.227646 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2566/5118] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:53:25.885927 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-832f59ac-3057-43cd-b37f-2d05aaa3a99a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:25.894341 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-832f59ac-3057-43cd-b37f-2d05aaa3a99a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:25.938479 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-832f59ac-3057-43cd-b37f-2d05aaa3a99a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:25.962595 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-832f59ac-3057-43cd-b37f-2d05aaa3a99a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:25.965363 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-832f59ac-3057-43cd-b37f-2d05aaa3a99a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:25.972672 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-832f59ac-3057-43cd-b37f-2d05aaa3a99a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:26.057517 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c957eb66-fb71-4bf0-b058-0967832ca2ad tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:26.112916 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c957eb66-fb71-4bf0-b058-0967832ca2ad tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1683 microversion: 2.1 time: 1.302280 Jul 18 02:53:26.136124 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2553/5119] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:24 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1683 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:26.169801 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9a4e62e0-85ce-4d10-9a59-e07f493426e0 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:26.191243 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9a4e62e0-85ce-4d10-9a59-e07f493426e0 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:26.229261 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9a4e62e0-85ce-4d10-9a59-e07f493426e0 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:26.230107 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9a4e62e0-85ce-4d10-9a59-e07f493426e0 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:26.249936 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9a4e62e0-85ce-4d10-9a59-e07f493426e0 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:26.260761 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9a4e62e0-85ce-4d10-9a59-e07f493426e0 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:26.740399 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-832f59ac-3057-43cd-b37f-2d05aaa3a99a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:26.757683 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-832f59ac-3057-43cd-b37f-2d05aaa3a99a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799" status: 200 len: 1202 microversion: 2.1 time: 0.889523 Jul 18 02:53:26.758856 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2567/5120] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:25 2022] GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799 => generated 1202 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:26.887211 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9a4e62e0-85ce-4d10-9a59-e07f493426e0 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:26.900430 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9a4e62e0-85ce-4d10-9a59-e07f493426e0 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1697 microversion: 2.1 time: 0.762350 Jul 18 02:53:26.901044 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2554/5121] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:26 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1697 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:27.185434 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9c0504a6-3eeb-47fc-a54a-258eff9a81e1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:27.188409 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9c0504a6-3eeb-47fc-a54a-258eff9a81e1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:27.210284 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9c0504a6-3eeb-47fc-a54a-258eff9a81e1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:27.218050 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9c0504a6-3eeb-47fc-a54a-258eff9a81e1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:27.222107 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9c0504a6-3eeb-47fc-a54a-258eff9a81e1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:27.230728 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9c0504a6-3eeb-47fc-a54a-258eff9a81e1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:27.330346 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:53:27.789606 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bb1d26ec-8fd6-4765-a61a-5c575fb252aa tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:27.791010 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bb1d26ec-8fd6-4765-a61a-5c575fb252aa tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:27.821927 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb1d26ec-8fd6-4765-a61a-5c575fb252aa tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:27.823107 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb1d26ec-8fd6-4765-a61a-5c575fb252aa tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:27.824374 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb1d26ec-8fd6-4765-a61a-5c575fb252aa tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:27.825265 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb1d26ec-8fd6-4765-a61a-5c575fb252aa tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:28.161019 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bb1d26ec-8fd6-4765-a61a-5c575fb252aa tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:28.179745 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bb1d26ec-8fd6-4765-a61a-5c575fb252aa tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799" status: 200 len: 1202 microversion: 2.1 time: 0.396085 Jul 18 02:53:28.180444 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2555/5122] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:27 2022] GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799 => generated 1202 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:28.204261 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5cb71df0-ad7f-438b-adef-8aff52d0c2de tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:28.211737 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5cb71df0-ad7f-438b-adef-8aff52d0c2de tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:28.261298 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5cb71df0-ad7f-438b-adef-8aff52d0c2de tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:28.262216 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5cb71df0-ad7f-438b-adef-8aff52d0c2de tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:28.272859 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5cb71df0-ad7f-438b-adef-8aff52d0c2de tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:28.273937 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5cb71df0-ad7f-438b-adef-8aff52d0c2de tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:28.705194 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9c0504a6-3eeb-47fc-a54a-258eff9a81e1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:28.743736 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9c0504a6-3eeb-47fc-a54a-258eff9a81e1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1683 microversion: 2.1 time: 1.562536 Jul 18 02:53:28.745214 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2568/5123] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:27 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1683 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:28.957363 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5cb71df0-ad7f-438b-adef-8aff52d0c2de tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:28.988031 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5cb71df0-ad7f-438b-adef-8aff52d0c2de tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1697 microversion: 2.1 time: 0.801235 Jul 18 02:53:28.990675 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2556/5124] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:28 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1697 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:29.220178 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dfaf5cdd-4a22-4f72-a598-55ce67d40606 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:29.222341 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-dfaf5cdd-4a22-4f72-a598-55ce67d40606 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:29.252278 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dfaf5cdd-4a22-4f72-a598-55ce67d40606 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:29.253794 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dfaf5cdd-4a22-4f72-a598-55ce67d40606 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:29.256730 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dfaf5cdd-4a22-4f72-a598-55ce67d40606 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:29.258426 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dfaf5cdd-4a22-4f72-a598-55ce67d40606 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:29.451283 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-dfaf5cdd-4a22-4f72-a598-55ce67d40606 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:29.477396 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-dfaf5cdd-4a22-4f72-a598-55ce67d40606 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799" status: 200 len: 1202 microversion: 2.1 time: 0.271793 Jul 18 02:53:29.485694 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2569/5125] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:29 2022] GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799 => generated 1202 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:29.764093 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-603c5041-a5f0-4cb6-8b0b-b4e2be4a1276 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:29.764947 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-603c5041-a5f0-4cb6-8b0b-b4e2be4a1276 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:29.781628 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-603c5041-a5f0-4cb6-8b0b-b4e2be4a1276 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:29.788328 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-603c5041-a5f0-4cb6-8b0b-b4e2be4a1276 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:29.789219 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-603c5041-a5f0-4cb6-8b0b-b4e2be4a1276 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:29.789670 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-603c5041-a5f0-4cb6-8b0b-b4e2be4a1276 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:30.021444 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7cc3a010-f02a-49b1-9519-da7440415b37 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:30.022724 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7cc3a010-f02a-49b1-9519-da7440415b37 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:30.039591 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7cc3a010-f02a-49b1-9519-da7440415b37 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:30.040074 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7cc3a010-f02a-49b1-9519-da7440415b37 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:30.040956 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7cc3a010-f02a-49b1-9519-da7440415b37 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:30.041435 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7cc3a010-f02a-49b1-9519-da7440415b37 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:31.364001 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7cc3a010-f02a-49b1-9519-da7440415b37 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:31.374165 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7cc3a010-f02a-49b1-9519-da7440415b37 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1696 microversion: 2.1 time: 1.361299 Jul 18 02:53:31.374790 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2570/5126] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:30 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1696 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:31.402287 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-518b4c5c-a782-4156-9f35-0e3d7962c185 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:31.404507 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-518b4c5c-a782-4156-9f35-0e3d7962c185 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:31.433280 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-518b4c5c-a782-4156-9f35-0e3d7962c185 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:31.436933 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-518b4c5c-a782-4156-9f35-0e3d7962c185 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:31.441685 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-518b4c5c-a782-4156-9f35-0e3d7962c185 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:31.445435 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-518b4c5c-a782-4156-9f35-0e3d7962c185 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:31.486406 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-603c5041-a5f0-4cb6-8b0b-b4e2be4a1276 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:31.546345 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-603c5041-a5f0-4cb6-8b0b-b4e2be4a1276 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1683 microversion: 2.1 time: 1.785545 Jul 18 02:53:31.584686 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2557/5127] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:29 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1683 bytes in 1825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:32.112575 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-518b4c5c-a782-4156-9f35-0e3d7962c185 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:32.141911 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-518b4c5c-a782-4156-9f35-0e3d7962c185 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799" status: 200 len: 1202 microversion: 2.1 time: 0.754165 Jul 18 02:53:32.159269 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2571/5128] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:31 2022] GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799 => generated 1202 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:32.418733 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-004c94e3-aaae-48c7-9559-df0af0d968cd tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:32.424221 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-004c94e3-aaae-48c7-9559-df0af0d968cd tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:32.485876 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-004c94e3-aaae-48c7-9559-df0af0d968cd tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:32.487517 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-004c94e3-aaae-48c7-9559-df0af0d968cd tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:32.499133 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-004c94e3-aaae-48c7-9559-df0af0d968cd tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:32.500480 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-004c94e3-aaae-48c7-9559-df0af0d968cd tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:32.584376 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-987425ab-a0ad-472f-9104-98b230502e02 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:32.590948 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-987425ab-a0ad-472f-9104-98b230502e02 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:32.640438 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-987425ab-a0ad-472f-9104-98b230502e02 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:32.644727 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-987425ab-a0ad-472f-9104-98b230502e02 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:32.662644 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-987425ab-a0ad-472f-9104-98b230502e02 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:32.663613 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-987425ab-a0ad-472f-9104-98b230502e02 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:33.709973 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-004c94e3-aaae-48c7-9559-df0af0d968cd tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:33.719897 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-004c94e3-aaae-48c7-9559-df0af0d968cd tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1696 microversion: 2.1 time: 1.310988 Jul 18 02:53:33.720504 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2558/5129] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:32 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1696 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:33.761762 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0ea915e2-02de-4e0f-b3bc-a723436a05db tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:33.767839 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0ea915e2-02de-4e0f-b3bc-a723436a05db tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:33.796343 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0ea915e2-02de-4e0f-b3bc-a723436a05db tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:33.806050 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0ea915e2-02de-4e0f-b3bc-a723436a05db tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:33.807309 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0ea915e2-02de-4e0f-b3bc-a723436a05db tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:33.816376 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0ea915e2-02de-4e0f-b3bc-a723436a05db tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:34.294373 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-987425ab-a0ad-472f-9104-98b230502e02 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:34.317123 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-987425ab-a0ad-472f-9104-98b230502e02 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1683 microversion: 2.1 time: 1.740783 Jul 18 02:53:34.327006 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2572/5130] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:32 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1683 bytes in 1750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:34.353608 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-5e3d9d3b-b959-4f2c-b8a0-6318e8908803 req-cb6959d2-133f-4bb0-852d-2eec2377f2e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e39afc-8fed-4b7d-92d3-171c7958f9a3", "name": "network-vif-unplugged", "status": "completed", "tag": "244acca8-8b4b-42ec-8102-3eaf458487ea"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:53:34.397490 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0ea915e2-02de-4e0f-b3bc-a723436a05db tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:34.420262 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0ea915e2-02de-4e0f-b3bc-a723436a05db tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799" status: 200 len: 1202 microversion: 2.1 time: 0.685373 Jul 18 02:53:34.423305 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-5e3d9d3b-b959-4f2c-b8a0-6318e8908803 req-cb6959d2-133f-4bb0-852d-2eec2377f2e0 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:34.423822 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2559/5131] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:33 2022] GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799 => generated 1202 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:34.453434 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-5e3d9d3b-b959-4f2c-b8a0-6318e8908803 req-cb6959d2-133f-4bb0-852d-2eec2377f2e0 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:34.544538 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-5e3d9d3b-b959-4f2c-b8a0-6318e8908803 req-cb6959d2-133f-4bb0-852d-2eec2377f2e0 service nova] Creating event network-vif-unplugged:244acca8-8b4b-42ec-8102-3eaf458487ea for instance c7e39afc-8fed-4b7d-92d3-171c7958f9a3 on n-h1-465891-3 Jul 18 02:53:34.579794 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [req-5e3d9d3b-b959-4f2c-b8a0-6318e8908803 req-cb6959d2-133f-4bb0-852d-2eec2377f2e0 service nova] Instance c7e39afc-8fed-4b7d-92d3-171c7958f9a3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3', 'n-h2-465891-3'} {{(pid=119543) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 02:53:34.700829 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-5e3d9d3b-b959-4f2c-b8a0-6318e8908803 req-cb6959d2-133f-4bb0-852d-2eec2377f2e0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.369206 Jul 18 02:53:34.703267 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2573/5132] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:53:34.761492 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3615eab0-cadb-4bf3-bc7b-e03c4b00e57a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:34.762855 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3615eab0-cadb-4bf3-bc7b-e03c4b00e57a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:34.788571 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3615eab0-cadb-4bf3-bc7b-e03c4b00e57a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:34.796876 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3615eab0-cadb-4bf3-bc7b-e03c4b00e57a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:34.810568 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3615eab0-cadb-4bf3-bc7b-e03c4b00e57a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:34.814691 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3615eab0-cadb-4bf3-bc7b-e03c4b00e57a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:35.343952 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c66f541f-d846-4da4-91bd-40b20b80389b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:35.344793 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c66f541f-d846-4da4-91bd-40b20b80389b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:35.372000 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c66f541f-d846-4da4-91bd-40b20b80389b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:35.378126 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c66f541f-d846-4da4-91bd-40b20b80389b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:35.379301 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c66f541f-d846-4da4-91bd-40b20b80389b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:35.381111 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c66f541f-d846-4da4-91bd-40b20b80389b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:36.262477 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3615eab0-cadb-4bf3-bc7b-e03c4b00e57a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:36.272096 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3615eab0-cadb-4bf3-bc7b-e03c4b00e57a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1696 microversion: 2.1 time: 1.538386 Jul 18 02:53:36.276600 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2560/5133] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:34 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1696 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:53:36.283465 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2c7698ba-73b7-49ec-a49c-5159735844c4 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:36.284092 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2c7698ba-73b7-49ec-a49c-5159735844c4 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:36.328725 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2c7698ba-73b7-49ec-a49c-5159735844c4 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:36.329101 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2c7698ba-73b7-49ec-a49c-5159735844c4 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:36.329937 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2c7698ba-73b7-49ec-a49c-5159735844c4 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:36.330380 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2c7698ba-73b7-49ec-a49c-5159735844c4 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:36.696850 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c66f541f-d846-4da4-91bd-40b20b80389b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:36.720802 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c66f541f-d846-4da4-91bd-40b20b80389b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1683 microversion: 2.1 time: 1.382257 Jul 18 02:53:36.721412 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2574/5134] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:35 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1683 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:53:36.725435 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2c7698ba-73b7-49ec-a49c-5159735844c4 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:36.746719 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2c7698ba-73b7-49ec-a49c-5159735844c4 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799" status: 200 len: 1202 microversion: 2.1 time: 0.468809 Jul 18 02:53:36.747697 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2561/5135] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:36 2022] GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799 => generated 1202 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:37.292398 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d0dd801d-c024-4c94-9ca2-abee6decd1fb tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:37.293487 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d0dd801d-c024-4c94-9ca2-abee6decd1fb tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:37.320551 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d0dd801d-c024-4c94-9ca2-abee6decd1fb tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:37.321451 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d0dd801d-c024-4c94-9ca2-abee6decd1fb tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:37.327846 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d0dd801d-c024-4c94-9ca2-abee6decd1fb tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:37.328625 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d0dd801d-c024-4c94-9ca2-abee6decd1fb tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:37.742046 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b20b0917-72c3-4fd8-b5b1-f244d323f449 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:37.742775 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b20b0917-72c3-4fd8-b5b1-f244d323f449 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:37.758708 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b20b0917-72c3-4fd8-b5b1-f244d323f449 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:37.759285 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b20b0917-72c3-4fd8-b5b1-f244d323f449 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:37.760434 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b20b0917-72c3-4fd8-b5b1-f244d323f449 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:37.760879 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b20b0917-72c3-4fd8-b5b1-f244d323f449 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:38.336567 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d0dd801d-c024-4c94-9ca2-abee6decd1fb tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:38.353205 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d0dd801d-c024-4c94-9ca2-abee6decd1fb tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1696 microversion: 2.1 time: 1.064778 Jul 18 02:53:38.359428 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2575/5136] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:37 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1696 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:38.365738 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3799fad8-ec0d-41a7-bf7e-07ac1ee2eb46 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:38.375133 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3799fad8-ec0d-41a7-bf7e-07ac1ee2eb46 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:38.391923 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3799fad8-ec0d-41a7-bf7e-07ac1ee2eb46 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:38.392782 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3799fad8-ec0d-41a7-bf7e-07ac1ee2eb46 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:38.394009 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3799fad8-ec0d-41a7-bf7e-07ac1ee2eb46 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:38.394730 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3799fad8-ec0d-41a7-bf7e-07ac1ee2eb46 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:38.505520 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3799fad8-ec0d-41a7-bf7e-07ac1ee2eb46 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:38.514699 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3799fad8-ec0d-41a7-bf7e-07ac1ee2eb46 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799" status: 200 len: 1202 microversion: 2.1 time: 0.153725 Jul 18 02:53:38.516207 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2576/5137] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:38 2022] GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799 => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:38.522880 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-eb006e49-9486-4238-bca7-9ff79bcbd721 req-d22dce5a-c08d-4493-b494-05ea0972969d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7e39afc-8fed-4b7d-92d3-171c7958f9a3", "tag": "244acca8-8b4b-42ec-8102-3eaf458487ea"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:53:38.533883 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-eb006e49-9486-4238-bca7-9ff79bcbd721 req-d22dce5a-c08d-4493-b494-05ea0972969d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:38.534823 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-eb006e49-9486-4238-bca7-9ff79bcbd721 req-d22dce5a-c08d-4493-b494-05ea0972969d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:38.558888 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-eb006e49-9486-4238-bca7-9ff79bcbd721 req-d22dce5a-c08d-4493-b494-05ea0972969d service nova] Creating event network-changed:244acca8-8b4b-42ec-8102-3eaf458487ea for instance c7e39afc-8fed-4b7d-92d3-171c7958f9a3 on n-h1-465891-3 Jul 18 02:53:38.578500 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b20b0917-72c3-4fd8-b5b1-f244d323f449 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:38.580112 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [req-eb006e49-9486-4238-bca7-9ff79bcbd721 req-d22dce5a-c08d-4493-b494-05ea0972969d service nova] Instance c7e39afc-8fed-4b7d-92d3-171c7958f9a3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3', 'n-h2-465891-3'} {{(pid=119543) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 02:53:38.588720 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b20b0917-72c3-4fd8-b5b1-f244d323f449 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 0.853381 Jul 18 02:53:38.593972 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2562/5138] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:37 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:53:38.669871 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-eb006e49-9486-4238-bca7-9ff79bcbd721 req-d22dce5a-c08d-4493-b494-05ea0972969d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151387 Jul 18 02:53:38.671737 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2577/5139] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:53:38.840379 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-22a835d3-0dcb-46a1-857a-f82b36d68317 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:38.840790 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-22a835d3-0dcb-46a1-857a-f82b36d68317 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:38.859699 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-22a835d3-0dcb-46a1-857a-f82b36d68317 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:38.860243 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-22a835d3-0dcb-46a1-857a-f82b36d68317 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:38.861143 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-22a835d3-0dcb-46a1-857a-f82b36d68317 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:38.861549 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-22a835d3-0dcb-46a1-857a-f82b36d68317 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:38.927211 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=100 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:53:39.377482 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a60075d9-a4e6-4557-9f27-a9507870f084 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:39.379875 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a60075d9-a4e6-4557-9f27-a9507870f084 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:39.408019 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a60075d9-a4e6-4557-9f27-a9507870f084 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:39.413170 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a60075d9-a4e6-4557-9f27-a9507870f084 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:39.414441 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a60075d9-a4e6-4557-9f27-a9507870f084 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:39.415141 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a60075d9-a4e6-4557-9f27-a9507870f084 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:39.415271 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-22a835d3-0dcb-46a1-857a-f82b36d68317 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:39.433663 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-22a835d3-0dcb-46a1-857a-f82b36d68317 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 0.594671 Jul 18 02:53:39.436644 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2563/5140] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:38 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:39.543349 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b186f4af-1091-4393-9455-4378bf4ac2d7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:39.544253 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b186f4af-1091-4393-9455-4378bf4ac2d7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:39.558315 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=42 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:53:39.560703 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b186f4af-1091-4393-9455-4378bf4ac2d7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:39.563234 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b186f4af-1091-4393-9455-4378bf4ac2d7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:39.566249 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b186f4af-1091-4393-9455-4378bf4ac2d7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:39.569824 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b186f4af-1091-4393-9455-4378bf4ac2d7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:40.120964 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b186f4af-1091-4393-9455-4378bf4ac2d7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:40.138832 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b186f4af-1091-4393-9455-4378bf4ac2d7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799" status: 200 len: 1202 microversion: 2.1 time: 0.599470 Jul 18 02:53:40.144273 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2564/5141] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:39 2022] GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799 => generated 1202 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:53:40.471160 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a60075d9-a4e6-4557-9f27-a9507870f084 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:40.492446 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a60075d9-a4e6-4557-9f27-a9507870f084 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1696 microversion: 2.1 time: 1.119624 Jul 18 02:53:40.502326 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2578/5142] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:39 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1696 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:40.634217 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-c0be6f8f-54d6-4c82-acb2-9e9f2f15f7b2 req-1e059e70-8155-49ae-aceb-0b2598078382 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69bbb844-4d56-4e75-ae50-9c35c9ce6f9e", "name": "network-vif-unplugged", "status": "completed", "tag": "d926d5af-f867-44cd-8b60-abb0339ecf2a"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:53:40.721470 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-c0be6f8f-54d6-4c82-acb2-9e9f2f15f7b2 req-1e059e70-8155-49ae-aceb-0b2598078382 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:40.726423 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-c0be6f8f-54d6-4c82-acb2-9e9f2f15f7b2 req-1e059e70-8155-49ae-aceb-0b2598078382 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:40.872230 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-c0be6f8f-54d6-4c82-acb2-9e9f2f15f7b2 req-1e059e70-8155-49ae-aceb-0b2598078382 service nova] Creating event network-vif-unplugged:d926d5af-f867-44cd-8b60-abb0339ecf2a for instance 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e on n-h2-465891-3 Jul 18 02:53:40.897319 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-c0be6f8f-54d6-4c82-acb2-9e9f2f15f7b2 req-1e059e70-8155-49ae-aceb-0b2598078382 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.274402 Jul 18 02:53:40.900441 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2565/5143] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:53:41.185684 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fe3386e2-713f-4224-a01e-53ced27f05f3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:41.191046 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fe3386e2-713f-4224-a01e-53ced27f05f3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:41.247259 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fe3386e2-713f-4224-a01e-53ced27f05f3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:41.248111 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fe3386e2-713f-4224-a01e-53ced27f05f3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:41.249616 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fe3386e2-713f-4224-a01e-53ced27f05f3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:41.258750 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fe3386e2-713f-4224-a01e-53ced27f05f3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:41.480317 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fe3386e2-713f-4224-a01e-53ced27f05f3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:41.515897 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-977ac43d-a843-4f4b-b901-07491eb24b4c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:41.516893 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-977ac43d-a843-4f4b-b901-07491eb24b4c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:41.524016 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fe3386e2-713f-4224-a01e-53ced27f05f3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799" status: 200 len: 1202 microversion: 2.1 time: 0.351308 Jul 18 02:53:41.547705 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2579/5144] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:41 2022] GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799 => generated 1202 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:41.550110 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-977ac43d-a843-4f4b-b901-07491eb24b4c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:41.550588 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-977ac43d-a843-4f4b-b901-07491eb24b4c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:41.557673 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-977ac43d-a843-4f4b-b901-07491eb24b4c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:41.559008 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-977ac43d-a843-4f4b-b901-07491eb24b4c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:41.841351 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c159c747-13b4-4384-8756-ffcdf226769d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:41.843480 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c159c747-13b4-4384-8756-ffcdf226769d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:41.862574 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c159c747-13b4-4384-8756-ffcdf226769d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:41.864828 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c159c747-13b4-4384-8756-ffcdf226769d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:41.884254 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c159c747-13b4-4384-8756-ffcdf226769d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:41.885524 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c159c747-13b4-4384-8756-ffcdf226769d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:42.160366 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-977ac43d-a843-4f4b-b901-07491eb24b4c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:42.192575 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-977ac43d-a843-4f4b-b901-07491eb24b4c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1694 microversion: 2.1 time: 0.680177 Jul 18 02:53:42.200552 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2566/5145] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:41 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1694 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:42.417108 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c159c747-13b4-4384-8756-ffcdf226769d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:42.429363 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c159c747-13b4-4384-8756-ffcdf226769d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 0.599361 Jul 18 02:53:42.436225 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2580/5146] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:41 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:42.463205 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4472a293-4122-4e7d-838b-bfcac899b3c5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:42.464362 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4472a293-4122-4e7d-838b-bfcac899b3c5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:42.478266 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4472a293-4122-4e7d-838b-bfcac899b3c5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:42.479134 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4472a293-4122-4e7d-838b-bfcac899b3c5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:42.482883 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4472a293-4122-4e7d-838b-bfcac899b3c5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:42.484281 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4472a293-4122-4e7d-838b-bfcac899b3c5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:42.569691 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-be75c97b-3dc4-41bb-abab-12cdce6f63c7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:42.574045 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-be75c97b-3dc4-41bb-abab-12cdce6f63c7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:42.596358 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-be75c97b-3dc4-41bb-abab-12cdce6f63c7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:42.599358 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-be75c97b-3dc4-41bb-abab-12cdce6f63c7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:42.601660 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-be75c97b-3dc4-41bb-abab-12cdce6f63c7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:42.604002 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-be75c97b-3dc4-41bb-abab-12cdce6f63c7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:42.766456 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-be75c97b-3dc4-41bb-abab-12cdce6f63c7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:42.791982 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-be75c97b-3dc4-41bb-abab-12cdce6f63c7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799" status: 200 len: 1202 microversion: 2.1 time: 0.235561 Jul 18 02:53:42.793003 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2581/5147] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:42 2022] GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799 => generated 1202 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:53:42.866441 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4472a293-4122-4e7d-838b-bfcac899b3c5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:42.876035 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4472a293-4122-4e7d-838b-bfcac899b3c5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 0.420382 Jul 18 02:53:42.880014 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2567/5148] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:42 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:42.922085 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-de2f2eea-a959-410d-aa12-8b4e705ccaba tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:42.923447 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-de2f2eea-a959-410d-aa12-8b4e705ccaba tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:42.951038 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-de2f2eea-a959-410d-aa12-8b4e705ccaba tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:42.951854 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-de2f2eea-a959-410d-aa12-8b4e705ccaba tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:42.954579 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-de2f2eea-a959-410d-aa12-8b4e705ccaba tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:42.955520 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-de2f2eea-a959-410d-aa12-8b4e705ccaba tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:43.227109 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-56b10293-9764-499a-a196-7bc42215a5c1 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:43.228056 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-56b10293-9764-499a-a196-7bc42215a5c1 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:43.241613 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-56b10293-9764-499a-a196-7bc42215a5c1 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:43.243144 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-56b10293-9764-499a-a196-7bc42215a5c1 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:43.249639 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-56b10293-9764-499a-a196-7bc42215a5c1 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:43.250453 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-56b10293-9764-499a-a196-7bc42215a5c1 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:45.363714 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-de2f2eea-a959-410d-aa12-8b4e705ccaba tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:45.389535 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-de2f2eea-a959-410d-aa12-8b4e705ccaba tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 2.489134 Jul 18 02:53:45.391744 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2582/5149] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:42 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 2493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:53:45.405798 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-08869153-4270-4a9d-b02e-58e69f6bf8e9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:45.414525 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-08869153-4270-4a9d-b02e-58e69f6bf8e9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:45.432956 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:53:45.436649 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-08869153-4270-4a9d-b02e-58e69f6bf8e9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:45.438020 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-08869153-4270-4a9d-b02e-58e69f6bf8e9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:45.440497 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-08869153-4270-4a9d-b02e-58e69f6bf8e9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:45.443116 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-08869153-4270-4a9d-b02e-58e69f6bf8e9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:45.490707 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-08869153-4270-4a9d-b02e-58e69f6bf8e9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] HTTP exception thrown: Instance 702e7ce4-6d2d-41a3-97f9-2403df247799 could not be found. Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-08869153-4270-4a9d-b02e-58e69f6bf8e9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Request method failure captured: Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799 HTTP/1.1 Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MliWHzVx10oBgzg24taGfvPF1POfFT53P2_RlSdFLebnrvIbeAs5qvjZ1EAd9Fni5RvXZYA8fjgna7ooKOtwOz_kbJVpuNazgX6TlGzOYOFYf5fy5vfDN_5wwJEwayQdbLz2BaqgZyDtVrhp2skZQbTuh-KNZeRA8bkIRl3oXepO1E Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 2b7654e273f6487ba83382da4f96056d Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-TestVolumeBootPattern-598001453 Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2b7654e273f6487ba83382da4f96056d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2b7654e273f6487ba83382da4f96056d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2b7654e273f6487ba83382da4f96056d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2b7654e273f6487ba83382da4f96056d"}]}] Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-TestVolumeBootPattern-598001453 Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 2b7654e273f6487ba83382da4f96056d Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-TestVolumeBootPattern-598001453 Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-TestVolumeBootPattern-598001453-project Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: d1afc1702f8045a396b98e5c24b124e7 Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-TestVolumeBootPattern-598001453-project Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 702e7ce4-6d2d-41a3-97f9-2403df247799 could not be found. Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '702e7ce4-6d2d-41a3-97f9-2403df247799'} Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 702e7ce4-6d2d-41a3-97f9-2403df247799 could not be found. Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 702e7ce4-6d2d-41a3-97f9-2403df247799 could not be found. Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:53:45.495609 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:53:45.501155 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:53:45.501155 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:53:45.501155 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:53:45.501155 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:53:45.501155 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:53:45.501155 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 702e7ce4-6d2d-41a3-97f9-2403df247799 could not be found. Jul 18 02:53:45.501155 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:53:45.543562 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-08869153-4270-4a9d-b02e-58e69f6bf8e9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Returning 404 to user: Instance 702e7ce4-6d2d-41a3-97f9-2403df247799 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:53:45.544500 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-08869153-4270-4a9d-b02e-58e69f6bf8e9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799" status: 404 len: 111 microversion: 2.1 time: 0.150732 Jul 18 02:53:45.545107 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2583/5150] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:45 2022] GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:53:45.572434 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f2a5efde-5194-4e03-b829-1d1e2619c7bd tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:45.578486 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f2a5efde-5194-4e03-b829-1d1e2619c7bd tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: a8abc31e-bc67-4e33-b91b-39ec0dcb43b8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:45.590099 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f2a5efde-5194-4e03-b829-1d1e2619c7bd tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:45.590574 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f2a5efde-5194-4e03-b829-1d1e2619c7bd tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:45.591398 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f2a5efde-5194-4e03-b829-1d1e2619c7bd tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:45.591848 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f2a5efde-5194-4e03-b829-1d1e2619c7bd tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:45.597179 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-56b10293-9764-499a-a196-7bc42215a5c1 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:45.620015 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-56b10293-9764-499a-a196-7bc42215a5c1 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1694 microversion: 2.1 time: 2.399476 Jul 18 02:53:45.642663 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2568/5151] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:43 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1694 bytes in 2422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:53:45.667378 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f2a5efde-5194-4e03-b829-1d1e2619c7bd tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8/ips" status: 200 len: 145 microversion: 2.1 time: 0.120170 Jul 18 02:53:45.669775 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4537526b-1b74-49c7-80c0-d72525e1a6bf tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:53:45.672872 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2584/5152] 10.222.0.57 () {58 vars in 1247 bytes} [Mon Jul 18 02:53:45 2022] GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8/ips => generated 145 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:53:45.678267 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4537526b-1b74-49c7-80c0-d72525e1a6bf tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:45.701418 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4537526b-1b74-49c7-80c0-d72525e1a6bf tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:45.704691 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4537526b-1b74-49c7-80c0-d72525e1a6bf tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:45.711595 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4537526b-1b74-49c7-80c0-d72525e1a6bf tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:45.712158 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4537526b-1b74-49c7-80c0-d72525e1a6bf tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:45.976935 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4537526b-1b74-49c7-80c0-d72525e1a6bf tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "POST /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e/action" status: 202 len: 0 microversion: 2.1 time: 0.332554 Jul 18 02:53:45.986344 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2569/5153] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:53:45 2022] POST /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:53:45.997173 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1654e044-a33a-475a-a567-a7362e18c534 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:45.998159 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1654e044-a33a-475a-a567-a7362e18c534 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:46.025059 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1654e044-a33a-475a-a567-a7362e18c534 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:46.027230 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1654e044-a33a-475a-a567-a7362e18c534 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:46.047339 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1654e044-a33a-475a-a567-a7362e18c534 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:46.049839 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1654e044-a33a-475a-a567-a7362e18c534 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:46.648020 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c27a7625-5a81-4468-bc9d-fd6662a4a2d1 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:46.648972 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c27a7625-5a81-4468-bc9d-fd6662a4a2d1 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:46.676709 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c27a7625-5a81-4468-bc9d-fd6662a4a2d1 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:46.681342 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c27a7625-5a81-4468-bc9d-fd6662a4a2d1 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:46.682656 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c27a7625-5a81-4468-bc9d-fd6662a4a2d1 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:46.690545 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c27a7625-5a81-4468-bc9d-fd6662a4a2d1 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:47.467073 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1654e044-a33a-475a-a567-a7362e18c534 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:47.480654 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1654e044-a33a-475a-a567-a7362e18c534 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1672 microversion: 2.1 time: 1.488656 Jul 18 02:53:47.509451 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2585/5154] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:45 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1672 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:47.701071 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c27a7625-5a81-4468-bc9d-fd6662a4a2d1 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:47.709659 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c27a7625-5a81-4468-bc9d-fd6662a4a2d1 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1691 microversion: 2.1 time: 1.066411 Jul 18 02:53:47.734273 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2570/5155] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:46 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1691 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:53:47.743107 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1b36ea49-e0af-4f60-bf81-716f2683a418 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:53:47.743778 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1b36ea49-e0af-4f60-bf81-716f2683a418 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:47.768166 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1b36ea49-e0af-4f60-bf81-716f2683a418 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:47.770576 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1b36ea49-e0af-4f60-bf81-716f2683a418 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:47.774161 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1b36ea49-e0af-4f60-bf81-716f2683a418 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:47.775686 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1b36ea49-e0af-4f60-bf81-716f2683a418 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:47.844736 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:53:48.126425 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1b36ea49-e0af-4f60-bf81-716f2683a418 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "POST /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3/action" status: 202 len: 0 microversion: 2.1 time: 0.389823 Jul 18 02:53:48.128187 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2586/5156] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:53:47 2022] POST /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3/action => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:53:48.137078 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7b6d7fbc-70ea-4d10-8ca2-2987f807615c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:48.138206 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7b6d7fbc-70ea-4d10-8ca2-2987f807615c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:48.151827 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7b6d7fbc-70ea-4d10-8ca2-2987f807615c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:48.158066 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7b6d7fbc-70ea-4d10-8ca2-2987f807615c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:48.162609 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7b6d7fbc-70ea-4d10-8ca2-2987f807615c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:48.165562 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7b6d7fbc-70ea-4d10-8ca2-2987f807615c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:48.524338 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6c06deca-1b10-4c4b-8c25-820f0116ce19 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:48.529125 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6c06deca-1b10-4c4b-8c25-820f0116ce19 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:48.587518 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6c06deca-1b10-4c4b-8c25-820f0116ce19 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:48.600296 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6c06deca-1b10-4c4b-8c25-820f0116ce19 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:48.602512 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6c06deca-1b10-4c4b-8c25-820f0116ce19 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:48.613525 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6c06deca-1b10-4c4b-8c25-820f0116ce19 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:49.779772 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7b6d7fbc-70ea-4d10-8ca2-2987f807615c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:49.797794 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6c06deca-1b10-4c4b-8c25-820f0116ce19 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:49.802436 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7b6d7fbc-70ea-4d10-8ca2-2987f807615c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1690 microversion: 2.1 time: 1.669455 Jul 18 02:53:49.821747 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2571/5157] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:48 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1690 bytes in 1676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:49.840932 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6c06deca-1b10-4c4b-8c25-820f0116ce19 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1672 microversion: 2.1 time: 1.329557 Jul 18 02:53:49.856546 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2587/5158] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:48 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1672 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:53:50.386137 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-5e15cc08-3614-415c-948a-241ce6d88dc9 req-46c2e84f-2839-47cb-b059-2c1ca864e66e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e39afc-8fed-4b7d-92d3-171c7958f9a3", "name": "network-vif-plugged", "status": "completed", "tag": "244acca8-8b4b-42ec-8102-3eaf458487ea"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:53:50.417765 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-5e15cc08-3614-415c-948a-241ce6d88dc9 req-46c2e84f-2839-47cb-b059-2c1ca864e66e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:50.420464 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-5e15cc08-3614-415c-948a-241ce6d88dc9 req-46c2e84f-2839-47cb-b059-2c1ca864e66e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:50.480594 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-5e15cc08-3614-415c-948a-241ce6d88dc9 req-46c2e84f-2839-47cb-b059-2c1ca864e66e service nova] Creating event network-vif-plugged:244acca8-8b4b-42ec-8102-3eaf458487ea for instance c7e39afc-8fed-4b7d-92d3-171c7958f9a3 on n-h1-465891-3 Jul 18 02:53:50.502996 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [req-5e15cc08-3614-415c-948a-241ce6d88dc9 req-46c2e84f-2839-47cb-b059-2c1ca864e66e service nova] Instance c7e39afc-8fed-4b7d-92d3-171c7958f9a3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3', 'n-h2-465891-3'} {{(pid=119544) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 02:53:50.539053 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-5e15cc08-3614-415c-948a-241ce6d88dc9 req-46c2e84f-2839-47cb-b059-2c1ca864e66e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161118 Jul 18 02:53:50.542837 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2572/5159] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:53:50.860909 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8ff1e9f6-2be1-43ce-913c-4d3b5cfe1023 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:50.865297 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8ff1e9f6-2be1-43ce-913c-4d3b5cfe1023 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:50.894960 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e79cddeb-59b1-482c-975a-0848fe51ae33 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:50.907442 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e79cddeb-59b1-482c-975a-0848fe51ae33 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:50.935040 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8ff1e9f6-2be1-43ce-913c-4d3b5cfe1023 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:50.935967 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8ff1e9f6-2be1-43ce-913c-4d3b5cfe1023 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:50.959522 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8ff1e9f6-2be1-43ce-913c-4d3b5cfe1023 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:50.962518 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8ff1e9f6-2be1-43ce-913c-4d3b5cfe1023 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:50.987252 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e79cddeb-59b1-482c-975a-0848fe51ae33 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:50.988753 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e79cddeb-59b1-482c-975a-0848fe51ae33 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:51.006363 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e79cddeb-59b1-482c-975a-0848fe51ae33 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:51.007003 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e79cddeb-59b1-482c-975a-0848fe51ae33 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:51.825598 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8ff1e9f6-2be1-43ce-913c-4d3b5cfe1023 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:51.840953 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8ff1e9f6-2be1-43ce-913c-4d3b5cfe1023 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1690 microversion: 2.1 time: 1.008177 Jul 18 02:53:51.852150 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2588/5160] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:50 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1690 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:51.858569 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-47873ca6-927c-4516-a9b2-5cc562da26cb tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f60f2951-408e-4cff-b330-06f02c74e9d7"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:53:51.860094 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-47873ca6-927c-4516-a9b2-5cc562da26cb tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: a8abc31e-bc67-4e33-b91b-39ec0dcb43b8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:51.868335 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-47873ca6-927c-4516-a9b2-5cc562da26cb tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:51.869577 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-47873ca6-927c-4516-a9b2-5cc562da26cb tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:51.870765 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-47873ca6-927c-4516-a9b2-5cc562da26cb tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:51.871416 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-47873ca6-927c-4516-a9b2-5cc562da26cb tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:52.182264 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e79cddeb-59b1-482c-975a-0848fe51ae33 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:52.208421 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e79cddeb-59b1-482c-975a-0848fe51ae33 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 1.315297 Jul 18 02:53:52.228931 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2573/5161] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:50 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:52.261249 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9ffd592b-6876-4e7b-864e-079d0ae12ed6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:53:52.270899 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9ffd592b-6876-4e7b-864e-079d0ae12ed6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:52.323314 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9ffd592b-6876-4e7b-864e-079d0ae12ed6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:52.323917 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9ffd592b-6876-4e7b-864e-079d0ae12ed6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:52.327786 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9ffd592b-6876-4e7b-864e-079d0ae12ed6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:52.328269 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9ffd592b-6876-4e7b-864e-079d0ae12ed6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:52.462011 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9ffd592b-6876-4e7b-864e-079d0ae12ed6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "POST /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e/action" status: 200 len: 322 microversion: 2.1 time: 0.210152 Jul 18 02:53:52.469453 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2574/5162] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:53:52 2022] POST /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e/action => generated 322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:53:52.477941 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-aff5711a-5870-4d63-9a89-358a09d2117c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:52.478662 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-aff5711a-5870-4d63-9a89-358a09d2117c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:52.502691 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aff5711a-5870-4d63-9a89-358a09d2117c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:52.507598 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aff5711a-5870-4d63-9a89-358a09d2117c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:52.512438 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aff5711a-5870-4d63-9a89-358a09d2117c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:52.513307 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aff5711a-5870-4d63-9a89-358a09d2117c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:52.703618 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-47873ca6-927c-4516-a9b2-5cc562da26cb tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "POST /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.849088 Jul 18 02:53:52.709481 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2589/5163] 10.222.0.57 () {60 vars in 1322 bytes} [Mon Jul 18 02:53:51 2022] POST /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8/os-volume_attachments => generated 194 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:53:52.789042 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f1bdb06d-fe3a-4f95-9a8f-abf29c0fd9fe tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:52.804223 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f1bdb06d-fe3a-4f95-9a8f-abf29c0fd9fe tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:52.870806 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f1bdb06d-fe3a-4f95-9a8f-abf29c0fd9fe tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:52.871790 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f1bdb06d-fe3a-4f95-9a8f-abf29c0fd9fe tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:52.886662 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f1bdb06d-fe3a-4f95-9a8f-abf29c0fd9fe tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:52.887641 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f1bdb06d-fe3a-4f95-9a8f-abf29c0fd9fe tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:52.947075 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-f1bdb06d-fe3a-4f95-9a8f-abf29c0fd9fe tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] HTTP exception thrown: Instance bf71e56d-5a67-439f-9781-6c0356dc8d6f could not be found. Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f1bdb06d-fe3a-4f95-9a8f-abf29c0fd9fe tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Request method failure captured: Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f HTTP/1.1 Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MliWHzVx10oBgzg24taGfvPF1POfFT53P2_RlSdFLebnrvIbeAs5qvjZ1EAd9Fni5RvXZYA8fjgna7ooKOtwOz_kbJVpuNazgX6TlGzOYOFYf5fy5vfDN_5wwJEwayQdbLz2BaqgZyDtVrhp2skZQbTuh-KNZeRA8bkIRl3oXepO1E Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 2b7654e273f6487ba83382da4f96056d Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-TestVolumeBootPattern-598001453 Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2b7654e273f6487ba83382da4f96056d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2b7654e273f6487ba83382da4f96056d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2b7654e273f6487ba83382da4f96056d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2b7654e273f6487ba83382da4f96056d"}]}] Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-TestVolumeBootPattern-598001453 Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 2b7654e273f6487ba83382da4f96056d Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-TestVolumeBootPattern-598001453 Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-TestVolumeBootPattern-598001453-project Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: d1afc1702f8045a396b98e5c24b124e7 Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-TestVolumeBootPattern-598001453-project Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance bf71e56d-5a67-439f-9781-6c0356dc8d6f could not be found. Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'bf71e56d-5a67-439f-9781-6c0356dc8d6f'} Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf71e56d-5a67-439f-9781-6c0356dc8d6f could not be found. Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:53:52.951923 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:53:52.962902 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf71e56d-5a67-439f-9781-6c0356dc8d6f could not be found. Jul 18 02:53:52.962902 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:53:52.962902 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:53:52.962902 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:53:52.962902 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:53:52.962902 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:53:52.962902 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:53:52.962902 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:53:52.962902 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:53:52.962902 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf71e56d-5a67-439f-9781-6c0356dc8d6f could not be found. Jul 18 02:53:52.962902 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:53:52.968298 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f1bdb06d-fe3a-4f95-9a8f-abf29c0fd9fe tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Returning 404 to user: Instance bf71e56d-5a67-439f-9781-6c0356dc8d6f could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:53:52.969974 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f1bdb06d-fe3a-4f95-9a8f-abf29c0fd9fe tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "DELETE /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 404 len: 111 microversion: 2.1 time: 0.235770 Jul 18 02:53:52.971853 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2590/5164] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:53:52 2022] DELETE /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 111 bytes in 262 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:53:52.984604 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-debc808c-0bdf-4552-9fb9-6c10bd9739fc tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:52.984910 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-aff5711a-5870-4d63-9a89-358a09d2117c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:52.986581 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-debc808c-0bdf-4552-9fb9-6c10bd9739fc tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:52.999988 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-debc808c-0bdf-4552-9fb9-6c10bd9739fc tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:53.001673 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-debc808c-0bdf-4552-9fb9-6c10bd9739fc tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:53.003858 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-debc808c-0bdf-4552-9fb9-6c10bd9739fc tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:53.005539 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-debc808c-0bdf-4552-9fb9-6c10bd9739fc tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:53.010486 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-aff5711a-5870-4d63-9a89-358a09d2117c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 0.534363 Jul 18 02:53:53.028747 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2575/5165] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:52 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:53.074444 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-de2ddaf8-7638-49f3-a46b-86e03bdc568c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:53.076945 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-de2ddaf8-7638-49f3-a46b-86e03bdc568c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: bf71e56d-5a67-439f-9781-6c0356dc8d6f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:53.107959 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-de2ddaf8-7638-49f3-a46b-86e03bdc568c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:53.108423 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-de2ddaf8-7638-49f3-a46b-86e03bdc568c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:53.115426 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-de2ddaf8-7638-49f3-a46b-86e03bdc568c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:53.125009 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-de2ddaf8-7638-49f3-a46b-86e03bdc568c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:53.193503 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-de2ddaf8-7638-49f3-a46b-86e03bdc568c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] HTTP exception thrown: Instance bf71e56d-5a67-439f-9781-6c0356dc8d6f could not be found. Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-de2ddaf8-7638-49f3-a46b-86e03bdc568c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Request method failure captured: Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f HTTP/1.1 Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MliWHzVx10oBgzg24taGfvPF1POfFT53P2_RlSdFLebnrvIbeAs5qvjZ1EAd9Fni5RvXZYA8fjgna7ooKOtwOz_kbJVpuNazgX6TlGzOYOFYf5fy5vfDN_5wwJEwayQdbLz2BaqgZyDtVrhp2skZQbTuh-KNZeRA8bkIRl3oXepO1E Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 2b7654e273f6487ba83382da4f96056d Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-TestVolumeBootPattern-598001453 Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2b7654e273f6487ba83382da4f96056d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2b7654e273f6487ba83382da4f96056d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2b7654e273f6487ba83382da4f96056d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2b7654e273f6487ba83382da4f96056d"}]}] Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-TestVolumeBootPattern-598001453 Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 2b7654e273f6487ba83382da4f96056d Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-TestVolumeBootPattern-598001453 Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-TestVolumeBootPattern-598001453-project Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: d1afc1702f8045a396b98e5c24b124e7 Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-TestVolumeBootPattern-598001453-project Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance bf71e56d-5a67-439f-9781-6c0356dc8d6f could not be found. Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'bf71e56d-5a67-439f-9781-6c0356dc8d6f'} Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf71e56d-5a67-439f-9781-6c0356dc8d6f could not be found. Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf71e56d-5a67-439f-9781-6c0356dc8d6f could not be found. Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:53:53.197857 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:53:53.213922 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:53:53.213922 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:53:53.213922 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:53:53.213922 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:53:53.213922 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:53:53.213922 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf71e56d-5a67-439f-9781-6c0356dc8d6f could not be found. Jul 18 02:53:53.213922 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:53:53.213922 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-de2ddaf8-7638-49f3-a46b-86e03bdc568c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Returning 404 to user: Instance bf71e56d-5a67-439f-9781-6c0356dc8d6f could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:53:53.217232 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-de2ddaf8-7638-49f3-a46b-86e03bdc568c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f" status: 404 len: 111 microversion: 2.1 time: 0.193138 Jul 18 02:53:53.218715 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2576/5166] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:53 2022] GET /compute/v2.1/servers/bf71e56d-5a67-439f-9781-6c0356dc8d6f => generated 111 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:53:53.234583 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bf8b6a49-b2e8-4198-af50-ea21212df9f8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:53.236238 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bf8b6a49-b2e8-4198-af50-ea21212df9f8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:53.250701 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bf8b6a49-b2e8-4198-af50-ea21212df9f8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:53.252369 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bf8b6a49-b2e8-4198-af50-ea21212df9f8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:53.254341 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bf8b6a49-b2e8-4198-af50-ea21212df9f8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:53.256144 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bf8b6a49-b2e8-4198-af50-ea21212df9f8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:53.900513 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-debc808c-0bdf-4552-9fb9-6c10bd9739fc tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:53.915039 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-debc808c-0bdf-4552-9fb9-6c10bd9739fc tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1690 microversion: 2.1 time: 0.934440 Jul 18 02:53:53.934996 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2591/5167] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:52 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1690 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:53.948140 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bf8b6a49-b2e8-4198-af50-ea21212df9f8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:53.974341 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bf8b6a49-b2e8-4198-af50-ea21212df9f8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 0.751356 Jul 18 02:53:53.979298 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2577/5168] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:53 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:54.003546 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9035eeb8-4dd7-4cfb-908b-4fed90091418 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:54.004534 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9035eeb8-4dd7-4cfb-908b-4fed90091418 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:54.021093 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9035eeb8-4dd7-4cfb-908b-4fed90091418 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:54.021911 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9035eeb8-4dd7-4cfb-908b-4fed90091418 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:54.022912 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9035eeb8-4dd7-4cfb-908b-4fed90091418 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:54.023570 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9035eeb8-4dd7-4cfb-908b-4fed90091418 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:54.279486 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6433b9ce-2aa2-4f27-a880-37f276b79469 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:54.280391 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6433b9ce-2aa2-4f27-a880-37f276b79469 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:54.290769 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6433b9ce-2aa2-4f27-a880-37f276b79469 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:54.292241 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6433b9ce-2aa2-4f27-a880-37f276b79469 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:54.300461 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6433b9ce-2aa2-4f27-a880-37f276b79469 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:54.301685 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6433b9ce-2aa2-4f27-a880-37f276b79469 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:54.341851 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-6433b9ce-2aa2-4f27-a880-37f276b79469 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] HTTP exception thrown: Instance 702e7ce4-6d2d-41a3-97f9-2403df247799 could not be found. Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6433b9ce-2aa2-4f27-a880-37f276b79469 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Request method failure captured: Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799 HTTP/1.1 Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MliWHzVx10oBgzg24taGfvPF1POfFT53P2_RlSdFLebnrvIbeAs5qvjZ1EAd9Fni5RvXZYA8fjgna7ooKOtwOz_kbJVpuNazgX6TlGzOYOFYf5fy5vfDN_5wwJEwayQdbLz2BaqgZyDtVrhp2skZQbTuh-KNZeRA8bkIRl3oXepO1E Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 2b7654e273f6487ba83382da4f96056d Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-TestVolumeBootPattern-598001453 Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2b7654e273f6487ba83382da4f96056d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2b7654e273f6487ba83382da4f96056d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2b7654e273f6487ba83382da4f96056d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2b7654e273f6487ba83382da4f96056d"}]}] Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-TestVolumeBootPattern-598001453 Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 2b7654e273f6487ba83382da4f96056d Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-TestVolumeBootPattern-598001453 Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-TestVolumeBootPattern-598001453-project Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: d1afc1702f8045a396b98e5c24b124e7 Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-TestVolumeBootPattern-598001453-project Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 702e7ce4-6d2d-41a3-97f9-2403df247799 could not be found. Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '702e7ce4-6d2d-41a3-97f9-2403df247799'} Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 702e7ce4-6d2d-41a3-97f9-2403df247799 could not be found. Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:53:54.344837 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:53:54.349974 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 702e7ce4-6d2d-41a3-97f9-2403df247799 could not be found. Jul 18 02:53:54.349974 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:53:54.349974 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:53:54.349974 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:53:54.349974 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:53:54.349974 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:53:54.349974 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:53:54.349974 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:53:54.349974 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:53:54.349974 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 702e7ce4-6d2d-41a3-97f9-2403df247799 could not be found. Jul 18 02:53:54.349974 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:53:54.349974 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6433b9ce-2aa2-4f27-a880-37f276b79469 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Returning 404 to user: Instance 702e7ce4-6d2d-41a3-97f9-2403df247799 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:53:54.351838 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6433b9ce-2aa2-4f27-a880-37f276b79469 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "DELETE /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799" status: 404 len: 111 microversion: 2.1 time: 0.076290 Jul 18 02:53:54.357582 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2578/5169] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:53:54 2022] DELETE /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:53:54.363743 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6687ece3-0e30-41dc-bba8-a3c1f01e8f5c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:54.374565 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6687ece3-0e30-41dc-bba8-a3c1f01e8f5c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 702e7ce4-6d2d-41a3-97f9-2403df247799] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:54.386157 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6687ece3-0e30-41dc-bba8-a3c1f01e8f5c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:54.398559 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6687ece3-0e30-41dc-bba8-a3c1f01e8f5c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:54.399777 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6687ece3-0e30-41dc-bba8-a3c1f01e8f5c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:54.400449 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6687ece3-0e30-41dc-bba8-a3c1f01e8f5c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:54.424302 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-6687ece3-0e30-41dc-bba8-a3c1f01e8f5c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] HTTP exception thrown: Instance 702e7ce4-6d2d-41a3-97f9-2403df247799 could not be found. Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6687ece3-0e30-41dc-bba8-a3c1f01e8f5c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Request method failure captured: Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799 HTTP/1.1 Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MliWHzVx10oBgzg24taGfvPF1POfFT53P2_RlSdFLebnrvIbeAs5qvjZ1EAd9Fni5RvXZYA8fjgna7ooKOtwOz_kbJVpuNazgX6TlGzOYOFYf5fy5vfDN_5wwJEwayQdbLz2BaqgZyDtVrhp2skZQbTuh-KNZeRA8bkIRl3oXepO1E Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 2b7654e273f6487ba83382da4f96056d Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-TestVolumeBootPattern-598001453 Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2b7654e273f6487ba83382da4f96056d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2b7654e273f6487ba83382da4f96056d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2b7654e273f6487ba83382da4f96056d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2b7654e273f6487ba83382da4f96056d"}]}] Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-TestVolumeBootPattern-598001453 Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 2b7654e273f6487ba83382da4f96056d Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-TestVolumeBootPattern-598001453 Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-TestVolumeBootPattern-598001453-project Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: d1afc1702f8045a396b98e5c24b124e7 Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-TestVolumeBootPattern-598001453-project Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 702e7ce4-6d2d-41a3-97f9-2403df247799 could not be found. Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '702e7ce4-6d2d-41a3-97f9-2403df247799'} Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 702e7ce4-6d2d-41a3-97f9-2403df247799 could not be found. Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 702e7ce4-6d2d-41a3-97f9-2403df247799 could not be found. Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:53:54.430493 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:53:54.443907 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:53:54.443907 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:53:54.443907 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:53:54.443907 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:53:54.443907 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:53:54.443907 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 702e7ce4-6d2d-41a3-97f9-2403df247799 could not be found. Jul 18 02:53:54.443907 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:53:54.443907 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6687ece3-0e30-41dc-bba8-a3c1f01e8f5c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Returning 404 to user: Instance 702e7ce4-6d2d-41a3-97f9-2403df247799 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:53:54.443907 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6687ece3-0e30-41dc-bba8-a3c1f01e8f5c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799" status: 404 len: 111 microversion: 2.1 time: 0.073180 Jul 18 02:53:54.443907 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2579/5170] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:54 2022] GET /compute/v2.1/servers/702e7ce4-6d2d-41a3-97f9-2403df247799 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:53:54.655188 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9035eeb8-4dd7-4cfb-908b-4fed90091418 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:54.682622 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9035eeb8-4dd7-4cfb-908b-4fed90091418 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 0.682151 Jul 18 02:53:54.700051 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2592/5171] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:53 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:54.730241 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0f23bb7a-ebc5-456c-a152-bab81e70d86f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:54.730872 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0f23bb7a-ebc5-456c-a152-bab81e70d86f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:54.757053 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f23bb7a-ebc5-456c-a152-bab81e70d86f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:54.757494 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f23bb7a-ebc5-456c-a152-bab81e70d86f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:54.758348 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f23bb7a-ebc5-456c-a152-bab81e70d86f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:54.758797 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f23bb7a-ebc5-456c-a152-bab81e70d86f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:54.798538 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4c186e0e-3b61-450d-8391-087325d5a955 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Action: 'create', calling method: .version_select at 0x7ff49bb7df70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-233278274", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEmvagKC/4OH4JWCIRSBcN3Ado5dQ5IfKuc3tJYs8oTG32aG3BvJiupUwG/0W6O2Hx0Dr59w0JnmZhTOZ6b8Uxf7mD4bub17tjp4bxTK9E+dhSHbpJvs2JYKB3/rmE0HQ=="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:53:54.975427 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-4c186e0e-3b61-450d-8391-087325d5a955 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Getting quotas for project 2b7654e273f6487ba83382da4f96056d. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:53:55.033606 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-4c186e0e-3b61-450d-8391-087325d5a955 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Getting quotas for user d1afc1702f8045a396b98e5c24b124e7 and project 2b7654e273f6487ba83382da4f96056d. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:53:55.187893 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4c186e0e-3b61-450d-8391-087325d5a955 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.393542 Jul 18 02:53:55.188435 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2593/5172] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 02:53:54 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:53:55.197804 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0116c265-8472-4fe7-b160-118aa177f80c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:55.197804 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0116c265-8472-4fe7-b160-118aa177f80c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:55.248311 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0116c265-8472-4fe7-b160-118aa177f80c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:55.251995 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0116c265-8472-4fe7-b160-118aa177f80c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:55.257605 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0116c265-8472-4fe7-b160-118aa177f80c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:55.259004 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0116c265-8472-4fe7-b160-118aa177f80c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:56.189998 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0f23bb7a-ebc5-456c-a152-bab81e70d86f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:56.246658 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0f23bb7a-ebc5-456c-a152-bab81e70d86f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 1.523620 Jul 18 02:53:56.256584 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2580/5173] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:54 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:56.587436 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d720faea-91fb-4e05-9782-bdeb84ba8102 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-883192465", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "a3f65d6b-f64d-469e-b970-581d249d8554"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:53:56.701559 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-d720faea-91fb-4e05-9782-bdeb84ba8102 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] validate_networks() for [('a3f65d6b-f64d-469e-b970-581d249d8554', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:53:57.291533 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0116c265-8472-4fe7-b160-118aa177f80c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:57.310592 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0116c265-8472-4fe7-b160-118aa177f80c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1690 microversion: 2.1 time: 2.110797 Jul 18 02:53:57.318948 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2594/5174] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:55 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1690 bytes in 2130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:57.328185 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-d747004f-3731-4760-a061-5e27e4214c3a req-ff3e9300-1ebd-4c98-a7dd-84fcc4b26318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e39afc-8fed-4b7d-92d3-171c7958f9a3", "name": "network-vif-unplugged", "status": "completed", "tag": "244acca8-8b4b-42ec-8102-3eaf458487ea"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:53:57.391811 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-d747004f-3731-4760-a061-5e27e4214c3a req-ff3e9300-1ebd-4c98-a7dd-84fcc4b26318 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:57.396204 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-d747004f-3731-4760-a061-5e27e4214c3a req-ff3e9300-1ebd-4c98-a7dd-84fcc4b26318 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:57.439801 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-d747004f-3731-4760-a061-5e27e4214c3a req-ff3e9300-1ebd-4c98-a7dd-84fcc4b26318 service nova] Creating event network-vif-unplugged:244acca8-8b4b-42ec-8102-3eaf458487ea for instance c7e39afc-8fed-4b7d-92d3-171c7958f9a3 on n-h2-465891-3 Jul 18 02:53:57.470690 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [req-d747004f-3731-4760-a061-5e27e4214c3a req-ff3e9300-1ebd-4c98-a7dd-84fcc4b26318 service nova] Instance c7e39afc-8fed-4b7d-92d3-171c7958f9a3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3', 'n-h2-465891-3'} {{(pid=119543) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 02:53:57.530310 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-d747004f-3731-4760-a061-5e27e4214c3a req-ff3e9300-1ebd-4c98-a7dd-84fcc4b26318 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.194561 Jul 18 02:53:57.531616 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2595/5175] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:53:58.338189 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cf114b85-bf94-487b-9571-bbe9d82992b2 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:58.339764 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cf114b85-bf94-487b-9571-bbe9d82992b2 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:58.347020 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cf114b85-bf94-487b-9571-bbe9d82992b2 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:58.350362 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cf114b85-bf94-487b-9571-bbe9d82992b2 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:58.351579 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cf114b85-bf94-487b-9571-bbe9d82992b2 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:58.353348 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cf114b85-bf94-487b-9571-bbe9d82992b2 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:58.575263 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-d720faea-91fb-4e05-9782-bdeb84ba8102 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:53:58.577755 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-d720faea-91fb-4e05-9782-bdeb84ba8102 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:53:58.579134 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-d720faea-91fb-4e05-9782-bdeb84ba8102 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:53:58.580173 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-d720faea-91fb-4e05-9782-bdeb84ba8102 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:53:58.581180 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-d720faea-91fb-4e05-9782-bdeb84ba8102 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:53:58.638273 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d720faea-91fb-4e05-9782-bdeb84ba8102 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:58.639666 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d720faea-91fb-4e05-9782-bdeb84ba8102 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:58.642813 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d720faea-91fb-4e05-9782-bdeb84ba8102 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:58.646524 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d720faea-91fb-4e05-9782-bdeb84ba8102 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:58.710380 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-d720faea-91fb-4e05-9782-bdeb84ba8102 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Getting quotas for project 2ed8b12429e9420bb83700e52701910b. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:53:58.730690 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-d720faea-91fb-4e05-9782-bdeb84ba8102 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Getting quotas for user 5436715af849460f87ff6b62dbd491a0 and project 2ed8b12429e9420bb83700e52701910b. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:53:58.773410 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d720faea-91fb-4e05-9782-bdeb84ba8102 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:53:58.776131 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d720faea-91fb-4e05-9782-bdeb84ba8102 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: da73354f-bc9c-4fb2-8de1-36de8f66ec97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:53:58.826432 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cf114b85-bf94-487b-9571-bbe9d82992b2 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:58.845595 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cf114b85-bf94-487b-9571-bbe9d82992b2 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1690 microversion: 2.1 time: 0.516593 Jul 18 02:53:58.862723 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2596/5176] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:58 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1690 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:58.943235 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d720faea-91fb-4e05-9782-bdeb84ba8102 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.404053 Jul 18 02:53:58.951506 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2581/5177] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:53:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:53:58.955751 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-11a8b46e-36c0-4bdf-8e87-a5f00cd193b5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:58.957063 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-11a8b46e-36c0-4bdf-8e87-a5f00cd193b5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: da73354f-bc9c-4fb2-8de1-36de8f66ec97] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:59.121483 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-11a8b46e-36c0-4bdf-8e87-a5f00cd193b5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:59.131993 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-11a8b46e-36c0-4bdf-8e87-a5f00cd193b5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97" status: 200 len: 1214 microversion: 2.1 time: 0.179878 Jul 18 02:53:59.132328 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2597/5178] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:58 2022] GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97 => generated 1214 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:53:59.870328 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-19090d26-aeb7-4e9a-ad62-0b8b49502f70 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:59.872079 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-19090d26-aeb7-4e9a-ad62-0b8b49502f70 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:59.894833 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-19090d26-aeb7-4e9a-ad62-0b8b49502f70 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:59.895405 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-19090d26-aeb7-4e9a-ad62-0b8b49502f70 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:59.896329 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-19090d26-aeb7-4e9a-ad62-0b8b49502f70 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:59.896792 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-19090d26-aeb7-4e9a-ad62-0b8b49502f70 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:00.152235 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1aeb95b4-2820-4731-80a4-92fdbd2feb24 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:00.153077 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1aeb95b4-2820-4731-80a4-92fdbd2feb24 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: da73354f-bc9c-4fb2-8de1-36de8f66ec97] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:00.216489 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1aeb95b4-2820-4731-80a4-92fdbd2feb24 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:00.217189 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1aeb95b4-2820-4731-80a4-92fdbd2feb24 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:00.225108 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1aeb95b4-2820-4731-80a4-92fdbd2feb24 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:00.228362 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1aeb95b4-2820-4731-80a4-92fdbd2feb24 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:00.875387 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1aeb95b4-2820-4731-80a4-92fdbd2feb24 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:00.903503 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1aeb95b4-2820-4731-80a4-92fdbd2feb24 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97" status: 200 len: 1210 microversion: 2.1 time: 0.753390 Jul 18 02:54:00.905539 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2598/5179] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:00 2022] GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97 => generated 1210 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:54:01.929830 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-19090d26-aeb7-4e9a-ad62-0b8b49502f70 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:01.944014 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:54:01.957222 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a57bc3cd-c067-4024-9eff-b577e5ef644e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:01.958784 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a57bc3cd-c067-4024-9eff-b577e5ef644e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: da73354f-bc9c-4fb2-8de1-36de8f66ec97] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:01.977791 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-19090d26-aeb7-4e9a-ad62-0b8b49502f70 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1690 microversion: 2.1 time: 2.111948 Jul 18 02:54:01.989809 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2582/5180] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:59 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1690 bytes in 2124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:54:02.017030 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a57bc3cd-c067-4024-9eff-b577e5ef644e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:02.017744 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a57bc3cd-c067-4024-9eff-b577e5ef644e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:02.023280 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a57bc3cd-c067-4024-9eff-b577e5ef644e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:02.024027 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a57bc3cd-c067-4024-9eff-b577e5ef644e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:02.575851 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a57bc3cd-c067-4024-9eff-b577e5ef644e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:02.627134 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-6122f77a-d8b5-4fdf-83cb-27247b0e3971 req-8295ba45-fc95-4b5b-b072-81e4014f7b67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7e39afc-8fed-4b7d-92d3-171c7958f9a3", "tag": "244acca8-8b4b-42ec-8102-3eaf458487ea"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:54:02.648146 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a57bc3cd-c067-4024-9eff-b577e5ef644e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97" status: 200 len: 1272 microversion: 2.1 time: 0.717294 Jul 18 02:54:02.649298 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2599/5181] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:01 2022] GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97 => generated 1272 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:54:02.692778 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-6122f77a-d8b5-4fdf-83cb-27247b0e3971 req-8295ba45-fc95-4b5b-b072-81e4014f7b67 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:02.693336 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-6122f77a-d8b5-4fdf-83cb-27247b0e3971 req-8295ba45-fc95-4b5b-b072-81e4014f7b67 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:02.765466 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-6122f77a-d8b5-4fdf-83cb-27247b0e3971 req-8295ba45-fc95-4b5b-b072-81e4014f7b67 service nova] Creating event network-changed:244acca8-8b4b-42ec-8102-3eaf458487ea for instance c7e39afc-8fed-4b7d-92d3-171c7958f9a3 on n-h2-465891-3 Jul 18 02:54:02.804870 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [req-6122f77a-d8b5-4fdf-83cb-27247b0e3971 req-8295ba45-fc95-4b5b-b072-81e4014f7b67 service nova] Instance c7e39afc-8fed-4b7d-92d3-171c7958f9a3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3', 'n-h2-465891-3'} {{(pid=119544) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 02:54:02.882592 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-6122f77a-d8b5-4fdf-83cb-27247b0e3971 req-8295ba45-fc95-4b5b-b072-81e4014f7b67 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.260258 Jul 18 02:54:02.884776 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2583/5182] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:54:03.027478 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6fc3204b-c4d3-4019-9613-211d09d03828 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:03.029770 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6fc3204b-c4d3-4019-9613-211d09d03828 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:03.080618 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6fc3204b-c4d3-4019-9613-211d09d03828 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:03.084297 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6fc3204b-c4d3-4019-9613-211d09d03828 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:03.092643 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6fc3204b-c4d3-4019-9613-211d09d03828 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:03.098369 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6fc3204b-c4d3-4019-9613-211d09d03828 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:03.689098 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c7502e9f-f827-417f-b673-88aaced9db26 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:03.705013 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c7502e9f-f827-417f-b673-88aaced9db26 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: da73354f-bc9c-4fb2-8de1-36de8f66ec97] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:03.756942 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c7502e9f-f827-417f-b673-88aaced9db26 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:03.761129 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c7502e9f-f827-417f-b673-88aaced9db26 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:03.773153 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c7502e9f-f827-417f-b673-88aaced9db26 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:03.773953 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c7502e9f-f827-417f-b673-88aaced9db26 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:04.098336 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c7502e9f-f827-417f-b673-88aaced9db26 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:04.126879 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c7502e9f-f827-417f-b673-88aaced9db26 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97" status: 200 len: 1272 microversion: 2.1 time: 0.452702 Jul 18 02:54:04.134690 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2584/5183] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:03 2022] GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97 => generated 1272 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:54:04.307172 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6fc3204b-c4d3-4019-9613-211d09d03828 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:04.319179 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6fc3204b-c4d3-4019-9613-211d09d03828 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1690 microversion: 2.1 time: 1.305752 Jul 18 02:54:04.338011 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2600/5184] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:03 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1690 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:54:05.156518 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0fe33a95-acc4-4252-9a5a-d5b16bf7e4fe tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:05.161247 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0fe33a95-acc4-4252-9a5a-d5b16bf7e4fe tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: da73354f-bc9c-4fb2-8de1-36de8f66ec97] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:05.207765 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0fe33a95-acc4-4252-9a5a-d5b16bf7e4fe tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:05.212054 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0fe33a95-acc4-4252-9a5a-d5b16bf7e4fe tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:05.214123 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0fe33a95-acc4-4252-9a5a-d5b16bf7e4fe tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:05.216688 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0fe33a95-acc4-4252-9a5a-d5b16bf7e4fe tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:05.345963 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a7078ef9-9996-4f26-9926-426f1cf5764a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:05.359689 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a7078ef9-9996-4f26-9926-426f1cf5764a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:05.392442 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a7078ef9-9996-4f26-9926-426f1cf5764a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:05.413071 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a7078ef9-9996-4f26-9926-426f1cf5764a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:05.432272 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a7078ef9-9996-4f26-9926-426f1cf5764a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:05.442970 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a7078ef9-9996-4f26-9926-426f1cf5764a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:05.648342 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0fe33a95-acc4-4252-9a5a-d5b16bf7e4fe tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:05.662397 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0fe33a95-acc4-4252-9a5a-d5b16bf7e4fe tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97" status: 200 len: 1272 microversion: 2.1 time: 0.513524 Jul 18 02:54:05.666235 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2585/5185] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:05 2022] GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97 => generated 1272 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:54:06.335476 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a7078ef9-9996-4f26-9926-426f1cf5764a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:06.392511 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a7078ef9-9996-4f26-9926-426f1cf5764a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1690 microversion: 2.1 time: 1.054183 Jul 18 02:54:06.407375 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2601/5186] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:05 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1690 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:54:06.683297 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-23caf67c-6740-49ad-900f-ac4fe2bc3e8e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:06.686983 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-23caf67c-6740-49ad-900f-ac4fe2bc3e8e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: da73354f-bc9c-4fb2-8de1-36de8f66ec97] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:06.707342 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-23caf67c-6740-49ad-900f-ac4fe2bc3e8e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:06.708387 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-23caf67c-6740-49ad-900f-ac4fe2bc3e8e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:06.709952 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-23caf67c-6740-49ad-900f-ac4fe2bc3e8e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:06.712458 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-23caf67c-6740-49ad-900f-ac4fe2bc3e8e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:07.436842 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-681e8674-6aba-40a0-932c-6bedb9ad3a45 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:07.443852 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-681e8674-6aba-40a0-932c-6bedb9ad3a45 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:07.475629 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-681e8674-6aba-40a0-932c-6bedb9ad3a45 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:07.476504 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-681e8674-6aba-40a0-932c-6bedb9ad3a45 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:07.483903 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-681e8674-6aba-40a0-932c-6bedb9ad3a45 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:07.484777 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-681e8674-6aba-40a0-932c-6bedb9ad3a45 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:07.932552 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-23caf67c-6740-49ad-900f-ac4fe2bc3e8e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:07.980252 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-23caf67c-6740-49ad-900f-ac4fe2bc3e8e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97" status: 200 len: 1314 microversion: 2.1 time: 1.298908 Jul 18 02:54:07.985913 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2586/5187] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:06 2022] GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97 => generated 1314 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:54:09.032402 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3e15bdc5-4f2e-4cb8-b525-4cb8e7718ad5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:09.064092 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3e15bdc5-4f2e-4cb8-b525-4cb8e7718ad5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: da73354f-bc9c-4fb2-8de1-36de8f66ec97] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:09.123217 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:54:09.128800 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:54:09.150511 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:54:09.172302 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3e15bdc5-4f2e-4cb8-b525-4cb8e7718ad5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:09.176617 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3e15bdc5-4f2e-4cb8-b525-4cb8e7718ad5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:09.180159 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3e15bdc5-4f2e-4cb8-b525-4cb8e7718ad5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:09.181656 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3e15bdc5-4f2e-4cb8-b525-4cb8e7718ad5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:09.562256 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-681e8674-6aba-40a0-932c-6bedb9ad3a45 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:09.568916 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:54:09.588009 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-681e8674-6aba-40a0-932c-6bedb9ad3a45 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1690 microversion: 2.1 time: 2.155923 Jul 18 02:54:09.589354 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2602/5188] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:07 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1690 bytes in 2158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:54:10.480850 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3e15bdc5-4f2e-4cb8-b525-4cb8e7718ad5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:10.496431 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3e15bdc5-4f2e-4cb8-b525-4cb8e7718ad5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97" status: 200 len: 1314 microversion: 2.1 time: 1.476106 Jul 18 02:54:10.497127 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2587/5189] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:09 2022] GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97 => generated 1314 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:54:10.508750 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-5ff81d59-62b3-44b1-a7bb-d8300b96d91e req-80c9a5ef-161a-497a-ae02-dbb1b1c4e634 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da73354f-bc9c-4fb2-8de1-36de8f66ec97", "tag": "8f1da331-b699-418e-9a99-5e9933732c52"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:54:10.595357 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-5ff81d59-62b3-44b1-a7bb-d8300b96d91e req-80c9a5ef-161a-497a-ae02-dbb1b1c4e634 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:10.596435 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-5ff81d59-62b3-44b1-a7bb-d8300b96d91e req-80c9a5ef-161a-497a-ae02-dbb1b1c4e634 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:10.624274 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-eae36c60-46d9-434e-aebf-337072dd6142 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:10.625289 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-eae36c60-46d9-434e-aebf-337072dd6142 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:10.659078 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-5ff81d59-62b3-44b1-a7bb-d8300b96d91e req-80c9a5ef-161a-497a-ae02-dbb1b1c4e634 service nova] Creating event network-changed:8f1da331-b699-418e-9a99-5e9933732c52 for instance da73354f-bc9c-4fb2-8de1-36de8f66ec97 on n-h1-465891-3 Jul 18 02:54:10.663082 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:54:10.676403 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eae36c60-46d9-434e-aebf-337072dd6142 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:10.679068 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eae36c60-46d9-434e-aebf-337072dd6142 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:10.684828 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eae36c60-46d9-434e-aebf-337072dd6142 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:10.688303 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-5ff81d59-62b3-44b1-a7bb-d8300b96d91e req-80c9a5ef-161a-497a-ae02-dbb1b1c4e634 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186813 Jul 18 02:54:10.692525 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eae36c60-46d9-434e-aebf-337072dd6142 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:10.693665 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2603/5190] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:54:11.526751 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ed00dfdf-33a1-4e54-813c-8fcd5aa6afab tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:11.535500 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ed00dfdf-33a1-4e54-813c-8fcd5aa6afab tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: da73354f-bc9c-4fb2-8de1-36de8f66ec97] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:11.558025 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ed00dfdf-33a1-4e54-813c-8fcd5aa6afab tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:11.563250 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ed00dfdf-33a1-4e54-813c-8fcd5aa6afab tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:11.569164 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ed00dfdf-33a1-4e54-813c-8fcd5aa6afab tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:11.572347 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ed00dfdf-33a1-4e54-813c-8fcd5aa6afab tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:11.636031 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-eae36c60-46d9-434e-aebf-337072dd6142 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:11.651294 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-eae36c60-46d9-434e-aebf-337072dd6142 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1683 microversion: 2.1 time: 1.034281 Jul 18 02:54:11.665843 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2588/5191] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:10 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1683 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:54:12.146251 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-72fb95b1-969a-4a82-a999-8b221ea13080 req-b9ccbf05-1f15-45f6-b64d-bab6a24239e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e39afc-8fed-4b7d-92d3-171c7958f9a3", "name": "network-vif-plugged", "status": "completed", "tag": "244acca8-8b4b-42ec-8102-3eaf458487ea"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:54:12.172993 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-72fb95b1-969a-4a82-a999-8b221ea13080 req-b9ccbf05-1f15-45f6-b64d-bab6a24239e7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:12.174990 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-72fb95b1-969a-4a82-a999-8b221ea13080 req-b9ccbf05-1f15-45f6-b64d-bab6a24239e7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:12.198379 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-72fb95b1-969a-4a82-a999-8b221ea13080 req-b9ccbf05-1f15-45f6-b64d-bab6a24239e7 service nova] Creating event network-vif-plugged:244acca8-8b4b-42ec-8102-3eaf458487ea for instance c7e39afc-8fed-4b7d-92d3-171c7958f9a3 on n-h2-465891-3 Jul 18 02:54:12.206917 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-72fb95b1-969a-4a82-a999-8b221ea13080 req-b9ccbf05-1f15-45f6-b64d-bab6a24239e7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066554 Jul 18 02:54:12.208172 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2589/5192] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:54:12.807227 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ed00dfdf-33a1-4e54-813c-8fcd5aa6afab tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:12.817114 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ed00dfdf-33a1-4e54-813c-8fcd5aa6afab tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97" status: 200 len: 1314 microversion: 2.1 time: 1.304893 Jul 18 02:54:12.818096 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2604/5193] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:11 2022] GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97 => generated 1314 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:54:13.841022 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ea8d97f2-5942-4700-b8fb-48edb3542f96 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:13.842214 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ea8d97f2-5942-4700-b8fb-48edb3542f96 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: da73354f-bc9c-4fb2-8de1-36de8f66ec97] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:13.864713 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea8d97f2-5942-4700-b8fb-48edb3542f96 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:13.865615 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea8d97f2-5942-4700-b8fb-48edb3542f96 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:13.873508 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea8d97f2-5942-4700-b8fb-48edb3542f96 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:13.874354 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea8d97f2-5942-4700-b8fb-48edb3542f96 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:14.273254 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ea8d97f2-5942-4700-b8fb-48edb3542f96 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:14.284941 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ea8d97f2-5942-4700-b8fb-48edb3542f96 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97" status: 200 len: 1314 microversion: 2.1 time: 0.450938 Jul 18 02:54:14.287300 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2590/5194] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:13 2022] GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97 => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:54:15.312433 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8423475d-1054-47d7-aa1d-0a0fab7b9bc1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:15.313217 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8423475d-1054-47d7-aa1d-0a0fab7b9bc1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: da73354f-bc9c-4fb2-8de1-36de8f66ec97] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:15.328871 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8423475d-1054-47d7-aa1d-0a0fab7b9bc1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:15.329342 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8423475d-1054-47d7-aa1d-0a0fab7b9bc1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:15.336378 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8423475d-1054-47d7-aa1d-0a0fab7b9bc1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:15.337126 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8423475d-1054-47d7-aa1d-0a0fab7b9bc1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:15.795018 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bd5bbfcc-142d-4ff5-aaa0-53feb49ec927 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:15.799949 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bd5bbfcc-142d-4ff5-aaa0-53feb49ec927 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: a8abc31e-bc67-4e33-b91b-39ec0dcb43b8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:15.833934 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bd5bbfcc-142d-4ff5-aaa0-53feb49ec927 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:15.835364 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bd5bbfcc-142d-4ff5-aaa0-53feb49ec927 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:15.837169 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bd5bbfcc-142d-4ff5-aaa0-53feb49ec927 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:15.840440 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bd5bbfcc-142d-4ff5-aaa0-53feb49ec927 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:15.987982 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bd5bbfcc-142d-4ff5-aaa0-53feb49ec927 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.198698 Jul 18 02:54:16.005371 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2591/5195] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:54:15 2022] GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8/os-volume_attachments => generated 197 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:54:16.015085 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-99ab6de1-8302-481d-b5ec-7c6a7e5288b1 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:16.015851 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-99ab6de1-8302-481d-b5ec-7c6a7e5288b1 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: a8abc31e-bc67-4e33-b91b-39ec0dcb43b8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:16.024073 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-99ab6de1-8302-481d-b5ec-7c6a7e5288b1 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:16.024531 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-99ab6de1-8302-481d-b5ec-7c6a7e5288b1 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:16.025344 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-99ab6de1-8302-481d-b5ec-7c6a7e5288b1 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:16.025805 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-99ab6de1-8302-481d-b5ec-7c6a7e5288b1 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:16.041178 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8423475d-1054-47d7-aa1d-0a0fab7b9bc1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:16.054181 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8423475d-1054-47d7-aa1d-0a0fab7b9bc1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97" status: 200 len: 1314 microversion: 2.1 time: 0.744722 Jul 18 02:54:16.058380 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2605/5196] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:15 2022] GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97 => generated 1314 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:54:16.077494 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-99ab6de1-8302-481d-b5ec-7c6a7e5288b1 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8/os-volume_attachments/f60f2951-408e-4cff-b330-06f02c74e9d7" status: 200 len: 194 microversion: 2.1 time: 0.066904 Jul 18 02:54:16.081068 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2592/5197] 10.222.0.57 () {58 vars in 1412 bytes} [Mon Jul 18 02:54:16 2022] GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8/os-volume_attachments/f60f2951-408e-4cff-b330-06f02c74e9d7 => generated 194 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:54:17.075992 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5517af0d-69ef-468d-8276-e47a86e67c6a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:17.077109 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5517af0d-69ef-468d-8276-e47a86e67c6a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: da73354f-bc9c-4fb2-8de1-36de8f66ec97] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:17.085078 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:54:17.101184 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5517af0d-69ef-468d-8276-e47a86e67c6a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:17.102604 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5517af0d-69ef-468d-8276-e47a86e67c6a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:17.112896 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5517af0d-69ef-468d-8276-e47a86e67c6a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:17.117643 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5517af0d-69ef-468d-8276-e47a86e67c6a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:17.597630 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5517af0d-69ef-468d-8276-e47a86e67c6a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:17.618457 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5517af0d-69ef-468d-8276-e47a86e67c6a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97" status: 200 len: 1314 microversion: 2.1 time: 0.546981 Jul 18 02:54:17.620307 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2606/5198] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:17 2022] GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97 => generated 1314 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:54:18.644340 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fd055aa7-a942-4088-bb54-136800142eab tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:18.659682 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fd055aa7-a942-4088-bb54-136800142eab tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: da73354f-bc9c-4fb2-8de1-36de8f66ec97] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:18.721610 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd055aa7-a942-4088-bb54-136800142eab tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:18.722465 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd055aa7-a942-4088-bb54-136800142eab tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:18.723712 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd055aa7-a942-4088-bb54-136800142eab tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:18.731792 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd055aa7-a942-4088-bb54-136800142eab tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:19.677912 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fd055aa7-a942-4088-bb54-136800142eab tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:19.694628 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fd055aa7-a942-4088-bb54-136800142eab tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97" status: 200 len: 1314 microversion: 2.1 time: 1.058918 Jul 18 02:54:19.707213 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2593/5199] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:18 2022] GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97 => generated 1314 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:54:20.293525 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2c51ce93-3fc7-45f2-89e8-7dc03e8a75f1 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e018eda5-6d0d-40d5-aa5b-f429a5f9c91f"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:54:20.295044 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2c51ce93-3fc7-45f2-89e8-7dc03e8a75f1 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: a8abc31e-bc67-4e33-b91b-39ec0dcb43b8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:20.325054 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2c51ce93-3fc7-45f2-89e8-7dc03e8a75f1 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:20.328145 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2c51ce93-3fc7-45f2-89e8-7dc03e8a75f1 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:20.329371 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2c51ce93-3fc7-45f2-89e8-7dc03e8a75f1 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:20.331829 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2c51ce93-3fc7-45f2-89e8-7dc03e8a75f1 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:20.360995 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-fd81a227-0857-4b4d-84ab-bc746d0e7674 req-3832197c-59ad-4d46-81b0-c0bffa80c154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da73354f-bc9c-4fb2-8de1-36de8f66ec97", "name": "network-vif-plugged", "status": "completed", "tag": "8f1da331-b699-418e-9a99-5e9933732c52"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:54:20.415049 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-fd81a227-0857-4b4d-84ab-bc746d0e7674 req-3832197c-59ad-4d46-81b0-c0bffa80c154 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:20.416846 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-fd81a227-0857-4b4d-84ab-bc746d0e7674 req-3832197c-59ad-4d46-81b0-c0bffa80c154 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:20.453780 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-fd81a227-0857-4b4d-84ab-bc746d0e7674 req-3832197c-59ad-4d46-81b0-c0bffa80c154 service nova] Creating event network-vif-plugged:8f1da331-b699-418e-9a99-5e9933732c52 for instance da73354f-bc9c-4fb2-8de1-36de8f66ec97 on n-h1-465891-3 Jul 18 02:54:20.470591 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-fd81a227-0857-4b4d-84ab-bc746d0e7674 req-3832197c-59ad-4d46-81b0-c0bffa80c154 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118441 Jul 18 02:54:20.473043 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2594/5200] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:54:20.723755 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e8e14317-3882-42dc-bbd2-d8a490e062df tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:20.724534 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e8e14317-3882-42dc-bbd2-d8a490e062df tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: da73354f-bc9c-4fb2-8de1-36de8f66ec97] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:20.744720 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e8e14317-3882-42dc-bbd2-d8a490e062df tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:20.745384 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e8e14317-3882-42dc-bbd2-d8a490e062df tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:20.749629 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e8e14317-3882-42dc-bbd2-d8a490e062df tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:20.751458 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e8e14317-3882-42dc-bbd2-d8a490e062df tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:21.370241 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2c51ce93-3fc7-45f2-89e8-7dc03e8a75f1 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "POST /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.079961 Jul 18 02:54:21.371028 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2607/5201] 10.222.0.57 () {60 vars in 1322 bytes} [Mon Jul 18 02:54:20 2022] POST /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8/os-volume_attachments => generated 194 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:54:21.857912 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e8e14317-3882-42dc-bbd2-d8a490e062df tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:21.899603 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e8e14317-3882-42dc-bbd2-d8a490e062df tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97" status: 200 len: 1314 microversion: 2.1 time: 1.182902 Jul 18 02:54:21.901836 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2595/5202] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:20 2022] GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97 => generated 1314 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:54:22.929843 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d65df3cf-0d13-4d21-b404-65261c6e2d3a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:22.931233 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d65df3cf-0d13-4d21-b404-65261c6e2d3a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: da73354f-bc9c-4fb2-8de1-36de8f66ec97] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:22.975880 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d65df3cf-0d13-4d21-b404-65261c6e2d3a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:22.976784 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d65df3cf-0d13-4d21-b404-65261c6e2d3a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:22.980986 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d65df3cf-0d13-4d21-b404-65261c6e2d3a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:22.987289 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d65df3cf-0d13-4d21-b404-65261c6e2d3a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:23.724267 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d65df3cf-0d13-4d21-b404-65261c6e2d3a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:23.748219 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d65df3cf-0d13-4d21-b404-65261c6e2d3a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97" status: 200 len: 1501 microversion: 2.1 time: 0.830448 Jul 18 02:54:23.750319 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2608/5203] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:22 2022] GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97 => generated 1501 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:54:23.768105 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ec746312-125a-4f06-84e7-92aa93618b3e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:54:23.792135 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ec746312-125a-4f06-84e7-92aa93618b3e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:23.792588 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ec746312-125a-4f06-84e7-92aa93618b3e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:23.871845 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ec746312-125a-4f06-84e7-92aa93618b3e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: da73354f-bc9c-4fb2-8de1-36de8f66ec97] Going to try to stop instance {{(pid=119544) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 02:54:24.032477 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ec746312-125a-4f06-84e7-92aa93618b3e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "POST /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97/action" status: 202 len: 0 microversion: 2.1 time: 0.265030 Jul 18 02:54:24.047120 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2596/5204] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:54:23 2022] POST /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:54:24.053559 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-46be14b2-da39-4d78-8f7e-d0c8bd34e82c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:24.055628 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-46be14b2-da39-4d78-8f7e-d0c8bd34e82c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: da73354f-bc9c-4fb2-8de1-36de8f66ec97] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:24.083334 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-46be14b2-da39-4d78-8f7e-d0c8bd34e82c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:24.084341 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-46be14b2-da39-4d78-8f7e-d0c8bd34e82c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:24.088958 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-46be14b2-da39-4d78-8f7e-d0c8bd34e82c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:24.090493 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-46be14b2-da39-4d78-8f7e-d0c8bd34e82c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:24.751706 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-46be14b2-da39-4d78-8f7e-d0c8bd34e82c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:24.770768 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-46be14b2-da39-4d78-8f7e-d0c8bd34e82c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97" status: 200 len: 1511 microversion: 2.1 time: 0.723683 Jul 18 02:54:24.780596 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2609/5205] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:24 2022] GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97 => generated 1511 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:54:25.801859 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8921e983-263c-40b5-84c8-88017f60aa4a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:25.811134 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8921e983-263c-40b5-84c8-88017f60aa4a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: da73354f-bc9c-4fb2-8de1-36de8f66ec97] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:25.847321 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8921e983-263c-40b5-84c8-88017f60aa4a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:25.850723 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8921e983-263c-40b5-84c8-88017f60aa4a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:25.855763 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8921e983-263c-40b5-84c8-88017f60aa4a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:25.863171 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8921e983-263c-40b5-84c8-88017f60aa4a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:26.626200 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8921e983-263c-40b5-84c8-88017f60aa4a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:26.669984 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8921e983-263c-40b5-84c8-88017f60aa4a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97" status: 200 len: 1511 microversion: 2.1 time: 0.876759 Jul 18 02:54:26.729784 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2597/5206] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:25 2022] GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97 => generated 1511 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:54:27.737218 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4ed9ecc8-749d-4009-ac45-edab57951677 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:27.739127 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4ed9ecc8-749d-4009-ac45-edab57951677 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: da73354f-bc9c-4fb2-8de1-36de8f66ec97] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:27.772474 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4ed9ecc8-749d-4009-ac45-edab57951677 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:27.773418 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4ed9ecc8-749d-4009-ac45-edab57951677 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:27.774842 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4ed9ecc8-749d-4009-ac45-edab57951677 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:27.777360 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4ed9ecc8-749d-4009-ac45-edab57951677 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:28.223858 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4ed9ecc8-749d-4009-ac45-edab57951677 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:28.269885 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4ed9ecc8-749d-4009-ac45-edab57951677 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97" status: 200 len: 1511 microversion: 2.1 time: 0.535699 Jul 18 02:54:28.291255 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2610/5207] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:27 2022] GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97 => generated 1511 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:54:29.318642 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-26fa3ab9-1f52-4c31-9c50-416085c04234 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:29.331019 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-26fa3ab9-1f52-4c31-9c50-416085c04234 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: da73354f-bc9c-4fb2-8de1-36de8f66ec97] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:29.374936 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26fa3ab9-1f52-4c31-9c50-416085c04234 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:29.380200 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26fa3ab9-1f52-4c31-9c50-416085c04234 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:29.384025 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26fa3ab9-1f52-4c31-9c50-416085c04234 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:29.390914 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26fa3ab9-1f52-4c31-9c50-416085c04234 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:30.327612 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-26fa3ab9-1f52-4c31-9c50-416085c04234 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:30.405131 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-26fa3ab9-1f52-4c31-9c50-416085c04234 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97" status: 200 len: 1511 microversion: 2.1 time: 1.103070 Jul 18 02:54:30.415137 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2598/5208] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:29 2022] GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97 => generated 1511 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:54:31.444165 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a57a4c49-0c90-451e-86e5-2915a5941a27 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:31.448579 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a57a4c49-0c90-451e-86e5-2915a5941a27 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: da73354f-bc9c-4fb2-8de1-36de8f66ec97] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:31.468103 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a57a4c49-0c90-451e-86e5-2915a5941a27 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:31.471833 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a57a4c49-0c90-451e-86e5-2915a5941a27 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:31.474462 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a57a4c49-0c90-451e-86e5-2915a5941a27 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:31.476144 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a57a4c49-0c90-451e-86e5-2915a5941a27 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:32.083346 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a57a4c49-0c90-451e-86e5-2915a5941a27 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:32.110361 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a57a4c49-0c90-451e-86e5-2915a5941a27 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97" status: 200 len: 1511 microversion: 2.1 time: 0.680381 Jul 18 02:54:32.112513 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2611/5209] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:31 2022] GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97 => generated 1511 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:54:32.151629 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 02:54:32.152764 n-d-465891-3 devstack@n-api.service[119544]: Mon Jul 18 02:54:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 02:54:33.137245 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-aa66319a-8f24-4163-8e68-f242a9afab91 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:33.145016 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-aa66319a-8f24-4163-8e68-f242a9afab91 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: da73354f-bc9c-4fb2-8de1-36de8f66ec97] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:33.183460 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aa66319a-8f24-4163-8e68-f242a9afab91 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:33.188333 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aa66319a-8f24-4163-8e68-f242a9afab91 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:33.193373 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aa66319a-8f24-4163-8e68-f242a9afab91 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:33.195420 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aa66319a-8f24-4163-8e68-f242a9afab91 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:33.299435 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:54:33.907235 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-aa66319a-8f24-4163-8e68-f242a9afab91 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:33.959496 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-aa66319a-8f24-4163-8e68-f242a9afab91 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97" status: 200 len: 1511 microversion: 2.1 time: 0.829302 Jul 18 02:54:33.978749 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2599/5210] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:33 2022] GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97 => generated 1511 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:54:34.763156 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f380f528-422c-4568-932c-e4d08702145e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:54:34.768829 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f380f528-422c-4568-932c-e4d08702145e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:34.802435 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f380f528-422c-4568-932c-e4d08702145e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:34.803282 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f380f528-422c-4568-932c-e4d08702145e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:34.804827 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f380f528-422c-4568-932c-e4d08702145e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:34.805637 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f380f528-422c-4568-932c-e4d08702145e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:34.985189 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f380f528-422c-4568-932c-e4d08702145e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "POST /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3/action" status: 200 len: 63085 microversion: 2.1 time: 0.229107 Jul 18 02:54:34.989226 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3d934c95-a73c-464d-8bef-70cc20537582 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:34.990516 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3d934c95-a73c-464d-8bef-70cc20537582 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: da73354f-bc9c-4fb2-8de1-36de8f66ec97] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:35.002575 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2612/5211] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:54:34 2022] POST /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3/action => generated 63085 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 02:54:35.004100 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3d934c95-a73c-464d-8bef-70cc20537582 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:35.004558 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3d934c95-a73c-464d-8bef-70cc20537582 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:35.008898 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3d934c95-a73c-464d-8bef-70cc20537582 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:35.011894 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3d934c95-a73c-464d-8bef-70cc20537582 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:36.508029 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3d934c95-a73c-464d-8bef-70cc20537582 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:36.524720 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3d934c95-a73c-464d-8bef-70cc20537582 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97" status: 200 len: 1511 microversion: 2.1 time: 1.538673 Jul 18 02:54:36.539542 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2600/5212] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:34 2022] GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97 => generated 1511 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:54:37.564811 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4f842d8a-35d8-455c-9582-29d58cd8088a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:37.568730 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4f842d8a-35d8-455c-9582-29d58cd8088a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: da73354f-bc9c-4fb2-8de1-36de8f66ec97] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:37.621267 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4f842d8a-35d8-455c-9582-29d58cd8088a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:37.625056 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4f842d8a-35d8-455c-9582-29d58cd8088a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:37.629385 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4f842d8a-35d8-455c-9582-29d58cd8088a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:37.630356 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4f842d8a-35d8-455c-9582-29d58cd8088a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:38.155909 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4f842d8a-35d8-455c-9582-29d58cd8088a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:38.171995 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4f842d8a-35d8-455c-9582-29d58cd8088a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97" status: 200 len: 1511 microversion: 2.1 time: 0.628667 Jul 18 02:54:38.196557 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2613/5213] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:37 2022] GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97 => generated 1511 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:54:39.226283 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-96be935a-79d1-40ff-b92d-1f1260e904ef tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:39.227022 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-96be935a-79d1-40ff-b92d-1f1260e904ef tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: da73354f-bc9c-4fb2-8de1-36de8f66ec97] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:39.287150 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-96be935a-79d1-40ff-b92d-1f1260e904ef tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:39.289342 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-96be935a-79d1-40ff-b92d-1f1260e904ef tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:39.291031 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-96be935a-79d1-40ff-b92d-1f1260e904ef tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:39.291996 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-96be935a-79d1-40ff-b92d-1f1260e904ef tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:39.978583 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-96be935a-79d1-40ff-b92d-1f1260e904ef tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:40.012959 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-96be935a-79d1-40ff-b92d-1f1260e904ef tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97" status: 200 len: 1511 microversion: 2.1 time: 0.811661 Jul 18 02:54:40.026277 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2601/5214] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:39 2022] GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97 => generated 1511 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:54:41.051249 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-20666e36-0447-4a17-8755-42b919494838 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:41.053393 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-20666e36-0447-4a17-8755-42b919494838 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: da73354f-bc9c-4fb2-8de1-36de8f66ec97] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:41.088416 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20666e36-0447-4a17-8755-42b919494838 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:41.091121 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20666e36-0447-4a17-8755-42b919494838 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:41.093831 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20666e36-0447-4a17-8755-42b919494838 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:41.096379 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20666e36-0447-4a17-8755-42b919494838 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:41.115228 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:54:41.946414 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-69cf2d01-8c49-4151-957d-0d16866017ad tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:41.948670 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-69cf2d01-8c49-4151-957d-0d16866017ad tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:41.973024 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=28 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:54:41.981329 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69cf2d01-8c49-4151-957d-0d16866017ad tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:41.983212 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69cf2d01-8c49-4151-957d-0d16866017ad tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:41.988401 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69cf2d01-8c49-4151-957d-0d16866017ad tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:41.994033 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69cf2d01-8c49-4151-957d-0d16866017ad tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:42.206872 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-20666e36-0447-4a17-8755-42b919494838 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:42.238430 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-20666e36-0447-4a17-8755-42b919494838 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97" status: 200 len: 1511 microversion: 2.1 time: 1.197526 Jul 18 02:54:42.254701 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2614/5215] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:41 2022] GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97 => generated 1511 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:54:42.529056 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-69cf2d01-8c49-4151-957d-0d16866017ad tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1834 microversion: 2.1 time: 1.271845 Jul 18 02:54:42.531101 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2602/5216] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:41 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1834 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:54:43.268721 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-827b67c5-ef22-4eed-b601-ce3894f99c4b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:43.269555 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-827b67c5-ef22-4eed-b601-ce3894f99c4b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: da73354f-bc9c-4fb2-8de1-36de8f66ec97] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:43.295820 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-827b67c5-ef22-4eed-b601-ce3894f99c4b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:43.297210 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-827b67c5-ef22-4eed-b601-ce3894f99c4b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:43.303731 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-827b67c5-ef22-4eed-b601-ce3894f99c4b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:43.307802 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-827b67c5-ef22-4eed-b601-ce3894f99c4b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:44.649766 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-827b67c5-ef22-4eed-b601-ce3894f99c4b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:44.707474 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-827b67c5-ef22-4eed-b601-ce3894f99c4b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97" status: 200 len: 1511 microversion: 2.1 time: 1.440351 Jul 18 02:54:44.716172 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2615/5217] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:43 2022] GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97 => generated 1511 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:54:45.358117 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a2c71814-2b63-4f34-aa93-f59cc2e75bcf tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:45.365022 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a2c71814-2b63-4f34-aa93-f59cc2e75bcf tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: a8abc31e-bc67-4e33-b91b-39ec0dcb43b8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:45.400325 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a2c71814-2b63-4f34-aa93-f59cc2e75bcf tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:45.400795 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a2c71814-2b63-4f34-aa93-f59cc2e75bcf tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:45.406141 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a2c71814-2b63-4f34-aa93-f59cc2e75bcf tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:45.409575 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a2c71814-2b63-4f34-aa93-f59cc2e75bcf tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:45.543252 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a2c71814-2b63-4f34-aa93-f59cc2e75bcf tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.190529 Jul 18 02:54:45.553241 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2603/5218] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:54:45 2022] GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8/os-volume_attachments => generated 371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:54:45.760121 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0ad36be6-72b8-4094-b7fd-361613bb0ef5 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:45.760637 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0ad36be6-72b8-4094-b7fd-361613bb0ef5 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: a8abc31e-bc67-4e33-b91b-39ec0dcb43b8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:45.764136 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-021b63ca-cbb9-4b2e-981b-1b3bc49ac616 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:45.764778 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-021b63ca-cbb9-4b2e-981b-1b3bc49ac616 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: da73354f-bc9c-4fb2-8de1-36de8f66ec97] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:45.787018 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0ad36be6-72b8-4094-b7fd-361613bb0ef5 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:45.789227 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0ad36be6-72b8-4094-b7fd-361613bb0ef5 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:45.799331 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0ad36be6-72b8-4094-b7fd-361613bb0ef5 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:45.801148 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-021b63ca-cbb9-4b2e-981b-1b3bc49ac616 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:45.802027 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0ad36be6-72b8-4094-b7fd-361613bb0ef5 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:45.802757 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-021b63ca-cbb9-4b2e-981b-1b3bc49ac616 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:45.806528 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-021b63ca-cbb9-4b2e-981b-1b3bc49ac616 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:45.807171 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-021b63ca-cbb9-4b2e-981b-1b3bc49ac616 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:45.916288 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0ad36be6-72b8-4094-b7fd-361613bb0ef5 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8/os-volume_attachments/f60f2951-408e-4cff-b330-06f02c74e9d7" status: 200 len: 194 microversion: 2.1 time: 0.161142 Jul 18 02:54:45.916940 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2604/5219] 10.222.0.57 () {58 vars in 1412 bytes} [Mon Jul 18 02:54:45 2022] GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8/os-volume_attachments/f60f2951-408e-4cff-b330-06f02c74e9d7 => generated 194 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:54:45.930334 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ff6538a6-fa3a-4e35-a25e-41c42fd56646 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:45.931189 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ff6538a6-fa3a-4e35-a25e-41c42fd56646 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: a8abc31e-bc67-4e33-b91b-39ec0dcb43b8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:45.947679 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ff6538a6-fa3a-4e35-a25e-41c42fd56646 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:45.948421 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ff6538a6-fa3a-4e35-a25e-41c42fd56646 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:45.949415 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ff6538a6-fa3a-4e35-a25e-41c42fd56646 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:45.950063 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ff6538a6-fa3a-4e35-a25e-41c42fd56646 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:46.242865 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-ff6538a6-fa3a-4e35-a25e-41c42fd56646 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lazy-loading 'services' on Instance uuid a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:54:46.448819 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-021b63ca-cbb9-4b2e-981b-1b3bc49ac616 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:46.457650 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-021b63ca-cbb9-4b2e-981b-1b3bc49ac616 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97" status: 200 len: 1511 microversion: 2.1 time: 0.717963 Jul 18 02:54:46.458285 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2616/5220] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:45 2022] GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97 => generated 1511 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:54:46.476898 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9e51a1db-3246-453c-bccf-2091a7701a2d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:46.483857 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9e51a1db-3246-453c-bccf-2091a7701a2d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:46.526808 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e51a1db-3246-453c-bccf-2091a7701a2d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:46.535479 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e51a1db-3246-453c-bccf-2091a7701a2d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:46.539649 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ff6538a6-fa3a-4e35-a25e-41c42fd56646 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8/os-volume_attachments/f60f2951-408e-4cff-b330-06f02c74e9d7" status: 202 len: 0 microversion: 2.1 time: 0.613319 Jul 18 02:54:46.541420 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e51a1db-3246-453c-bccf-2091a7701a2d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:46.543256 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e51a1db-3246-453c-bccf-2091a7701a2d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:46.556484 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2605/5221] 10.222.0.57 () {58 vars in 1415 bytes} [Mon Jul 18 02:54:45 2022] DELETE /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8/os-volume_attachments/f60f2951-408e-4cff-b330-06f02c74e9d7 => generated 0 bytes in 631 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:54:46.730070 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9e51a1db-3246-453c-bccf-2091a7701a2d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:54:46.754346 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-30089739-4ab0-468d-b364-9dc4e2bca83a req-b9e2f219-4734-4428-bd41-6f8e53c3200a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7e39afc-8fed-4b7d-92d3-171c7958f9a3", "tag": "244acca8-8b4b-42ec-8102-3eaf458487ea"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:54:46.787523 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-30089739-4ab0-468d-b364-9dc4e2bca83a req-b9e2f219-4734-4428-bd41-6f8e53c3200a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:46.787982 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-30089739-4ab0-468d-b364-9dc4e2bca83a req-b9e2f219-4734-4428-bd41-6f8e53c3200a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:46.832370 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-30089739-4ab0-468d-b364-9dc4e2bca83a req-b9e2f219-4734-4428-bd41-6f8e53c3200a service nova] Creating event network-changed:244acca8-8b4b-42ec-8102-3eaf458487ea for instance c7e39afc-8fed-4b7d-92d3-171c7958f9a3 on n-h2-465891-3 Jul 18 02:54:46.845389 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-30089739-4ab0-468d-b364-9dc4e2bca83a req-b9e2f219-4734-4428-bd41-6f8e53c3200a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.282260 Jul 18 02:54:46.851914 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2606/5222] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:54:47.103593 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9e51a1db-3246-453c-bccf-2091a7701a2d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 204 len: 0 microversion: 2.1 time: 0.632998 Jul 18 02:54:47.106118 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2617/5223] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:54:46 2022] DELETE /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:54:47.116048 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3a0c18bc-ec05-4e54-aad5-620e62581144 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:47.117021 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3a0c18bc-ec05-4e54-aad5-620e62581144 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:47.131076 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3a0c18bc-ec05-4e54-aad5-620e62581144 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:47.131956 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3a0c18bc-ec05-4e54-aad5-620e62581144 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:47.137349 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3a0c18bc-ec05-4e54-aad5-620e62581144 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:47.144051 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3a0c18bc-ec05-4e54-aad5-620e62581144 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:47.497659 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0a81dd37-07e7-4ad7-9e81-a8d90e5f65a1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:47.509072 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0a81dd37-07e7-4ad7-9e81-a8d90e5f65a1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: da73354f-bc9c-4fb2-8de1-36de8f66ec97] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:47.547110 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:54:47.551347 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0a81dd37-07e7-4ad7-9e81-a8d90e5f65a1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:47.552715 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0a81dd37-07e7-4ad7-9e81-a8d90e5f65a1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:47.555153 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0a81dd37-07e7-4ad7-9e81-a8d90e5f65a1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:47.562014 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0a81dd37-07e7-4ad7-9e81-a8d90e5f65a1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:47.990262 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3a0c18bc-ec05-4e54-aad5-620e62581144 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:48.032665 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3a0c18bc-ec05-4e54-aad5-620e62581144 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1689 microversion: 2.1 time: 0.920364 Jul 18 02:54:48.039630 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2607/5224] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:47 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1689 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:54:48.155427 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0a81dd37-07e7-4ad7-9e81-a8d90e5f65a1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:48.168182 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0a81dd37-07e7-4ad7-9e81-a8d90e5f65a1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97" status: 200 len: 1511 microversion: 2.1 time: 0.684232 Jul 18 02:54:48.181763 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2618/5225] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:47 2022] GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97 => generated 1511 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:54:49.076297 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-97199dc1-9f1e-40f0-b828-ad4a8fa44118 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:49.077442 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-97199dc1-9f1e-40f0-b828-ad4a8fa44118 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:49.112746 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-97199dc1-9f1e-40f0-b828-ad4a8fa44118 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:49.113934 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-97199dc1-9f1e-40f0-b828-ad4a8fa44118 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:49.117525 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-97199dc1-9f1e-40f0-b828-ad4a8fa44118 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:49.122850 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-97199dc1-9f1e-40f0-b828-ad4a8fa44118 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:49.212919 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f3b60926-23bf-40e4-889b-e4b8f8ff0933 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:49.227113 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f3b60926-23bf-40e4-889b-e4b8f8ff0933 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: da73354f-bc9c-4fb2-8de1-36de8f66ec97] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:49.289227 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f3b60926-23bf-40e4-889b-e4b8f8ff0933 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:49.296643 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f3b60926-23bf-40e4-889b-e4b8f8ff0933 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:49.299669 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f3b60926-23bf-40e4-889b-e4b8f8ff0933 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:49.305918 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f3b60926-23bf-40e4-889b-e4b8f8ff0933 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:51.767702 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-97199dc1-9f1e-40f0-b828-ad4a8fa44118 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:51.812303 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-97199dc1-9f1e-40f0-b828-ad4a8fa44118 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1689 microversion: 2.1 time: 2.741440 Jul 18 02:54:51.833362 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2608/5226] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:49 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1689 bytes in 2763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:54:52.056854 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f3b60926-23bf-40e4-889b-e4b8f8ff0933 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:52.082221 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f3b60926-23bf-40e4-889b-e4b8f8ff0933 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97" status: 200 len: 1511 microversion: 2.1 time: 2.881684 Jul 18 02:54:52.102328 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2619/5227] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:49 2022] GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97 => generated 1511 bytes in 2906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:54:52.483506 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-23ff0ed2-4bb5-451b-87bb-13aac4fd8194 req-cfcb7232-1d3b-4c7f-b948-04daf5de4f65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e39afc-8fed-4b7d-92d3-171c7958f9a3", "name": "network-vif-unplugged", "status": "completed", "tag": "244acca8-8b4b-42ec-8102-3eaf458487ea"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:54:52.502356 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-23ff0ed2-4bb5-451b-87bb-13aac4fd8194 req-cfcb7232-1d3b-4c7f-b948-04daf5de4f65 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:52.508551 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-23ff0ed2-4bb5-451b-87bb-13aac4fd8194 req-cfcb7232-1d3b-4c7f-b948-04daf5de4f65 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:52.586259 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-23ff0ed2-4bb5-451b-87bb-13aac4fd8194 req-cfcb7232-1d3b-4c7f-b948-04daf5de4f65 service nova] Creating event network-vif-unplugged:244acca8-8b4b-42ec-8102-3eaf458487ea for instance c7e39afc-8fed-4b7d-92d3-171c7958f9a3 on n-h2-465891-3 Jul 18 02:54:52.615999 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-23ff0ed2-4bb5-451b-87bb-13aac4fd8194 req-cfcb7232-1d3b-4c7f-b948-04daf5de4f65 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.144562 Jul 18 02:54:52.616631 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2609/5228] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 18 02:54:52.851296 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7e31f020-16e3-44c8-8f16-55755f9ea33a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:52.851957 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7e31f020-16e3-44c8-8f16-55755f9ea33a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:52.882341 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7e31f020-16e3-44c8-8f16-55755f9ea33a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:52.882813 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7e31f020-16e3-44c8-8f16-55755f9ea33a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:52.883644 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7e31f020-16e3-44c8-8f16-55755f9ea33a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:52.884113 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7e31f020-16e3-44c8-8f16-55755f9ea33a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:53.111609 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9d005b9e-9377-4387-9d30-f9dbc42bac47 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:53.112979 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9d005b9e-9377-4387-9d30-f9dbc42bac47 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: da73354f-bc9c-4fb2-8de1-36de8f66ec97] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:53.149737 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9d005b9e-9377-4387-9d30-f9dbc42bac47 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:53.150629 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9d005b9e-9377-4387-9d30-f9dbc42bac47 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:53.151664 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9d005b9e-9377-4387-9d30-f9dbc42bac47 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:53.152273 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9d005b9e-9377-4387-9d30-f9dbc42bac47 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:54.008170 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7e31f020-16e3-44c8-8f16-55755f9ea33a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:54.081137 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7e31f020-16e3-44c8-8f16-55755f9ea33a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1570 microversion: 2.1 time: 1.237324 Jul 18 02:54:54.090942 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2620/5229] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:52 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1570 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:54:54.251769 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9d005b9e-9377-4387-9d30-f9dbc42bac47 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:54.293415 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9d005b9e-9377-4387-9d30-f9dbc42bac47 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97" status: 200 len: 1488 microversion: 2.1 time: 1.188013 Jul 18 02:54:54.294502 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2610/5230] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:53 2022] GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97 => generated 1488 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:54:54.333034 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b9b8493b-d0af-4ea9-a8f5-2cc8ca42c34c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:54:54.348938 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b9b8493b-d0af-4ea9-a8f5-2cc8ca42c34c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:54.387211 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b9b8493b-d0af-4ea9-a8f5-2cc8ca42c34c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:54.397147 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b9b8493b-d0af-4ea9-a8f5-2cc8ca42c34c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:54.400217 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b9b8493b-d0af-4ea9-a8f5-2cc8ca42c34c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:54.402690 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b9b8493b-d0af-4ea9-a8f5-2cc8ca42c34c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:54.557665 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b9b8493b-d0af-4ea9-a8f5-2cc8ca42c34c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "POST /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e/action" status: 200 len: 152 microversion: 2.1 time: 0.232497 Jul 18 02:54:54.565791 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2621/5231] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:54:54 2022] POST /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e/action => generated 152 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:54:54.576035 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e1e46a18-404e-4ce1-b4f4-8082a742576f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:54.580380 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e1e46a18-404e-4ce1-b4f4-8082a742576f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:54.623783 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e1e46a18-404e-4ce1-b4f4-8082a742576f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:54.630785 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e1e46a18-404e-4ce1-b4f4-8082a742576f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:54.634971 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e1e46a18-404e-4ce1-b4f4-8082a742576f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:54.638554 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e1e46a18-404e-4ce1-b4f4-8082a742576f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:55.410606 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e1e46a18-404e-4ce1-b4f4-8082a742576f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:55.440058 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e1e46a18-404e-4ce1-b4f4-8082a742576f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 0.871948 Jul 18 02:54:55.455377 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2611/5232] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:54 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:54:55.464084 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-d5b0d5a1-640e-42a0-b868-84d90186527f req-e764c17a-4687-412a-8e24-e1b9280d1d7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e39afc-8fed-4b7d-92d3-171c7958f9a3", "name": "network-vif-deleted", "tag": "244acca8-8b4b-42ec-8102-3eaf458487ea"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:54:55.470570 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-55a62dd2-7403-47ff-a8c3-1c602665210e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:55.472206 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-55a62dd2-7403-47ff-a8c3-1c602665210e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:55.500203 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-55a62dd2-7403-47ff-a8c3-1c602665210e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:55.502051 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-55a62dd2-7403-47ff-a8c3-1c602665210e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:55.507381 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-d5b0d5a1-640e-42a0-b868-84d90186527f req-e764c17a-4687-412a-8e24-e1b9280d1d7a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:55.511628 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-d5b0d5a1-640e-42a0-b868-84d90186527f req-e764c17a-4687-412a-8e24-e1b9280d1d7a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:55.517960 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-55a62dd2-7403-47ff-a8c3-1c602665210e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:55.519650 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-55a62dd2-7403-47ff-a8c3-1c602665210e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:55.563194 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-d5b0d5a1-640e-42a0-b868-84d90186527f req-e764c17a-4687-412a-8e24-e1b9280d1d7a service nova] Creating event network-vif-deleted:244acca8-8b4b-42ec-8102-3eaf458487ea for instance c7e39afc-8fed-4b7d-92d3-171c7958f9a3 on n-h2-465891-3 Jul 18 02:54:55.576333 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-d5b0d5a1-640e-42a0-b868-84d90186527f req-e764c17a-4687-412a-8e24-e1b9280d1d7a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.554206 Jul 18 02:54:55.586062 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2622/5233] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:54:55.599609 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cf17b7f6-0e8d-4ddc-9555-3c80f3d0efab tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:55.601602 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cf17b7f6-0e8d-4ddc-9555-3c80f3d0efab tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:55.619141 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cf17b7f6-0e8d-4ddc-9555-3c80f3d0efab tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:55.620851 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cf17b7f6-0e8d-4ddc-9555-3c80f3d0efab tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:55.666673 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cf17b7f6-0e8d-4ddc-9555-3c80f3d0efab tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:55.668152 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cf17b7f6-0e8d-4ddc-9555-3c80f3d0efab tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.045s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:55.670282 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-55a62dd2-7403-47ff-a8c3-1c602665210e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:55.670762 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-55a62dd2-7403-47ff-a8c3-1c602665210e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:55.671244 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-55a62dd2-7403-47ff-a8c3-1c602665210e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lazy-loading 'fault' on Instance uuid c7e39afc-8fed-4b7d-92d3-171c7958f9a3 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:54:56.423608 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-55a62dd2-7403-47ff-a8c3-1c602665210e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:56.448443 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-55a62dd2-7403-47ff-a8c3-1c602665210e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 200 len: 1356 microversion: 2.1 time: 0.991254 Jul 18 02:54:56.449402 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2612/5234] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:55 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 1356 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:54:56.479091 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e78dc49f-ece5-416d-8167-52d0898b2122 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-31508750", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-233278274", "security_groups": [{"name": "tempest-secgroup-smoke-2032229349"}], "block_device_mapping_v2": [{"uuid": "9b6dd1b9-d28f-4445-b5bb-59a96ed6d423", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ba77f5bb-f255-444f-9bd1-1e3dbe42d430"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:54:56.647579 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cf17b7f6-0e8d-4ddc-9555-3c80f3d0efab tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:56.687982 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cf17b7f6-0e8d-4ddc-9555-3c80f3d0efab tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 1.098573 Jul 18 02:54:56.710251 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2623/5235] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:55 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:54:56.731779 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-16648493-ee56-4c5a-84ae-b79281cdc797 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:56.738017 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-16648493-ee56-4c5a-84ae-b79281cdc797 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:56.767274 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-16648493-ee56-4c5a-84ae-b79281cdc797 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:56.768431 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-16648493-ee56-4c5a-84ae-b79281cdc797 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:56.770262 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-16648493-ee56-4c5a-84ae-b79281cdc797 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:56.775262 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-16648493-ee56-4c5a-84ae-b79281cdc797 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:57.191967 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-e78dc49f-ece5-416d-8167-52d0898b2122 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] validate_networks() for [('ba77f5bb-f255-444f-9bd1-1e3dbe42d430', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:54:57.318155 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-16648493-ee56-4c5a-84ae-b79281cdc797 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:57.339798 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-16648493-ee56-4c5a-84ae-b79281cdc797 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 0.617022 Jul 18 02:54:57.343013 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2624/5236] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:56 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:54:57.371926 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dce99455-8146-41a6-b506-4e2d3fdf0cbc tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:57.372964 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-dce99455-8146-41a6-b506-4e2d3fdf0cbc tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:57.398841 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dce99455-8146-41a6-b506-4e2d3fdf0cbc tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:57.404123 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dce99455-8146-41a6-b506-4e2d3fdf0cbc tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:57.405217 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dce99455-8146-41a6-b506-4e2d3fdf0cbc tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:57.405673 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dce99455-8146-41a6-b506-4e2d3fdf0cbc tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:57.895771 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-dce99455-8146-41a6-b506-4e2d3fdf0cbc tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:57.910606 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-dce99455-8146-41a6-b506-4e2d3fdf0cbc tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 0.544748 Jul 18 02:54:57.911749 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2625/5237] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:57 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:54:57.919029 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-849f2cc3-aa8e-4d96-9ffb-5784eacd1363 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:57.920284 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-849f2cc3-aa8e-4d96-9ffb-5784eacd1363 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: c7e39afc-8fed-4b7d-92d3-171c7958f9a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:57.929355 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-849f2cc3-aa8e-4d96-9ffb-5784eacd1363 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:57.930224 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-849f2cc3-aa8e-4d96-9ffb-5784eacd1363 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:57.931502 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-849f2cc3-aa8e-4d96-9ffb-5784eacd1363 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:57.932329 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-849f2cc3-aa8e-4d96-9ffb-5784eacd1363 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:57.970605 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-849f2cc3-aa8e-4d96-9ffb-5784eacd1363 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] HTTP exception thrown: Instance c7e39afc-8fed-4b7d-92d3-171c7958f9a3 could not be found. Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-849f2cc3-aa8e-4d96-9ffb-5784eacd1363 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Request method failure captured: Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 HTTP/1.1 Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MnYuW4W0sup_YmXu0e6TfbM8UhRRyTVhU4O9V6AVf94vohRx4aPb83sBLBZeGqAob5OT52KfbhFJyFnUckm_AKJ129CUDEeh3rlnVQskw2FZl3adXOUNXwdv2KHTFmpLHnRTO3Qsn9Vcgn_cseZ_XT0zvfydkDjvO0Y6iKbO3M5yvk Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: fa240dfd375a45efb42fc04807acf847 Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1583539660 Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fa240dfd375a45efb42fc04807acf847"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fa240dfd375a45efb42fc04807acf847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fa240dfd375a45efb42fc04807acf847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fa240dfd375a45efb42fc04807acf847"}]}] Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1583539660 Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: fa240dfd375a45efb42fc04807acf847 Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1583539660 Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-TestNetworkAdvancedServerOps-1583539660-project Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 381a2ab772ff495cb85b89a85a267cfe Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1583539660-project Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance c7e39afc-8fed-4b7d-92d3-171c7958f9a3 could not be found. Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'c7e39afc-8fed-4b7d-92d3-171c7958f9a3'} Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7e39afc-8fed-4b7d-92d3-171c7958f9a3 could not be found. Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7e39afc-8fed-4b7d-92d3-171c7958f9a3 could not be found. Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:54:57.978883 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:54:57.984275 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:54:57.984275 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:54:57.984275 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:54:57.984275 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:54:57.984275 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:54:57.984275 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:54:57.984275 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7e39afc-8fed-4b7d-92d3-171c7958f9a3 could not be found. Jul 18 02:54:57.984275 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:54:57.990443 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-849f2cc3-aa8e-4d96-9ffb-5784eacd1363 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Returning 404 to user: Instance c7e39afc-8fed-4b7d-92d3-171c7958f9a3 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:54:57.992916 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-849f2cc3-aa8e-4d96-9ffb-5784eacd1363 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3" status: 404 len: 111 microversion: 2.1 time: 0.079355 Jul 18 02:54:58.002115 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2626/5238] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:57 2022] GET /compute/v2.1/servers/c7e39afc-8fed-4b7d-92d3-171c7958f9a3 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:54:58.166876 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ee627c13-cd9b-4891-bfc0-c5ae58f4cb09 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-47745367", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "a3f65d6b-f64d-469e-b970-581d249d8554"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:54:58.363736 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-ee627c13-cd9b-4891-bfc0-c5ae58f4cb09 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] validate_networks() for [('a3f65d6b-f64d-469e-b970-581d249d8554', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:54:58.777897 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-e78dc49f-ece5-416d-8167-52d0898b2122 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:54:58.778701 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-e78dc49f-ece5-416d-8167-52d0898b2122 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:54:58.779733 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-e78dc49f-ece5-416d-8167-52d0898b2122 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:54:58.780498 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-e78dc49f-ece5-416d-8167-52d0898b2122 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:54:58.781221 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-e78dc49f-ece5-416d-8167-52d0898b2122 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:54:58.803082 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e78dc49f-ece5-416d-8167-52d0898b2122 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:58.804068 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e78dc49f-ece5-416d-8167-52d0898b2122 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:58.805937 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e78dc49f-ece5-416d-8167-52d0898b2122 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:58.807973 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e78dc49f-ece5-416d-8167-52d0898b2122 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:58.864897 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-e78dc49f-ece5-416d-8167-52d0898b2122 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Getting quotas for project 2b7654e273f6487ba83382da4f96056d. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:54:58.883838 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-e78dc49f-ece5-416d-8167-52d0898b2122 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Getting quotas for user d1afc1702f8045a396b98e5c24b124e7 and project 2b7654e273f6487ba83382da4f96056d. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:54:59.000535 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e78dc49f-ece5-416d-8167-52d0898b2122 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:54:59.006907 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e78dc49f-ece5-416d-8167-52d0898b2122 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9b6dd1b9-d28f-4445-b5bb-59a96ed6d423',volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:54:59.326835 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e78dc49f-ece5-416d-8167-52d0898b2122 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.855923 Jul 18 02:54:59.343021 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2613/5239] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:54:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 2893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:54:59.354360 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-757d894c-4f18-428d-adbb-db3d220d7d0a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:59.355009 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-757d894c-4f18-428d-adbb-db3d220d7d0a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:59.539176 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-757d894c-4f18-428d-adbb-db3d220d7d0a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:59.548571 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-757d894c-4f18-428d-adbb-db3d220d7d0a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5" status: 200 len: 1092 microversion: 2.1 time: 0.203765 Jul 18 02:54:59.554077 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2614/5240] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:59 2022] GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 => generated 1092 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:00.225465 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-ee627c13-cd9b-4891-bfc0-c5ae58f4cb09 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:55:00.226680 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-ee627c13-cd9b-4891-bfc0-c5ae58f4cb09 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:55:00.227329 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-ee627c13-cd9b-4891-bfc0-c5ae58f4cb09 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:55:00.227907 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-ee627c13-cd9b-4891-bfc0-c5ae58f4cb09 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:55:00.228594 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-ee627c13-cd9b-4891-bfc0-c5ae58f4cb09 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:55:00.251631 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ee627c13-cd9b-4891-bfc0-c5ae58f4cb09 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:00.254742 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ee627c13-cd9b-4891-bfc0-c5ae58f4cb09 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:00.255902 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ee627c13-cd9b-4891-bfc0-c5ae58f4cb09 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:00.258398 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ee627c13-cd9b-4891-bfc0-c5ae58f4cb09 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:00.331537 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-ee627c13-cd9b-4891-bfc0-c5ae58f4cb09 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Getting quotas for project 2ed8b12429e9420bb83700e52701910b. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:55:00.352007 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-ee627c13-cd9b-4891-bfc0-c5ae58f4cb09 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Getting quotas for user 5436715af849460f87ff6b62dbd491a0 and project 2ed8b12429e9420bb83700e52701910b. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:55:00.387827 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ee627c13-cd9b-4891-bfc0-c5ae58f4cb09 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:55:00.396074 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ee627c13-cd9b-4891-bfc0-c5ae58f4cb09 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 9f08d81f-1881-47f2-834e-9d0a3ac31108] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:55:00.568650 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ee627c13-cd9b-4891-bfc0-c5ae58f4cb09 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.407399 Jul 18 02:55:00.570183 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2627/5241] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:54:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:55:00.577035 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-38a837f9-abd2-46de-8619-d8ab8742d09c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:00.578477 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-38a837f9-abd2-46de-8619-d8ab8742d09c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:00.587450 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-20327308-67ab-47e3-ac8f-1e983f37dd0d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:00.588380 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-20327308-67ab-47e3-ac8f-1e983f37dd0d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 9f08d81f-1881-47f2-834e-9d0a3ac31108] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:00.598877 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-38a837f9-abd2-46de-8619-d8ab8742d09c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:00.603722 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-38a837f9-abd2-46de-8619-d8ab8742d09c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:00.605356 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-38a837f9-abd2-46de-8619-d8ab8742d09c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:00.613592 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-38a837f9-abd2-46de-8619-d8ab8742d09c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:01.121504 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-38a837f9-abd2-46de-8619-d8ab8742d09c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:01.135807 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-38a837f9-abd2-46de-8619-d8ab8742d09c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5" status: 200 len: 1142 microversion: 2.1 time: 0.563297 Jul 18 02:55:01.151858 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2615/5242] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:00 2022] GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 => generated 1142 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:01.233291 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-20327308-67ab-47e3-ac8f-1e983f37dd0d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:01.250346 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-20327308-67ab-47e3-ac8f-1e983f37dd0d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108" status: 200 len: 1213 microversion: 2.1 time: 0.661370 Jul 18 02:55:01.258290 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2628/5243] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:00 2022] GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108 => generated 1213 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:01.869749 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5dbdafcb-dad7-4616-a383-58997a2683fd tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:01.870411 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5dbdafcb-dad7-4616-a383-58997a2683fd tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: a8abc31e-bc67-4e33-b91b-39ec0dcb43b8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:01.893860 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5dbdafcb-dad7-4616-a383-58997a2683fd tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:01.894337 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5dbdafcb-dad7-4616-a383-58997a2683fd tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:01.895163 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5dbdafcb-dad7-4616-a383-58997a2683fd tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:01.895604 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5dbdafcb-dad7-4616-a383-58997a2683fd tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:02.011286 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5dbdafcb-dad7-4616-a383-58997a2683fd tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8/os-volume_attachments/e018eda5-6d0d-40d5-aa5b-f429a5f9c91f" status: 200 len: 194 microversion: 2.1 time: 0.193624 Jul 18 02:55:02.022691 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2616/5244] 10.222.0.57 () {58 vars in 1412 bytes} [Mon Jul 18 02:55:01 2022] GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8/os-volume_attachments/e018eda5-6d0d-40d5-aa5b-f429a5f9c91f => generated 194 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:55:02.037909 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f9101386-fff9-49e5-9a26-5b8587fa93d7 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:02.042910 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f9101386-fff9-49e5-9a26-5b8587fa93d7 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: a8abc31e-bc67-4e33-b91b-39ec0dcb43b8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:02.151550 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f9101386-fff9-49e5-9a26-5b8587fa93d7 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:02.167539 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-31ee6966-679c-4e63-8464-5bd610794cf6 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:02.169285 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f9101386-fff9-49e5-9a26-5b8587fa93d7 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:02.180445 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-31ee6966-679c-4e63-8464-5bd610794cf6 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:02.185349 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f9101386-fff9-49e5-9a26-5b8587fa93d7 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:02.199896 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f9101386-fff9-49e5-9a26-5b8587fa93d7 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:02.261520 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-31ee6966-679c-4e63-8464-5bd610794cf6 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:02.262336 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-31ee6966-679c-4e63-8464-5bd610794cf6 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:02.287635 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-31ee6966-679c-4e63-8464-5bd610794cf6 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:02.288487 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-31ee6966-679c-4e63-8464-5bd610794cf6 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:02.576581 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-31ee6966-679c-4e63-8464-5bd610794cf6 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:02.580635 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:55:02.591461 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-31ee6966-679c-4e63-8464-5bd610794cf6 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5" status: 200 len: 1208 microversion: 2.1 time: 0.432425 Jul 18 02:55:02.602820 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2617/5245] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:02 2022] GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 => generated 1208 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:55:02.610636 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-216ebf70-f579-41e7-9ae9-9cf3b3d4ccbe tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:02.627709 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-216ebf70-f579-41e7-9ae9-9cf3b3d4ccbe tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 9f08d81f-1881-47f2-834e-9d0a3ac31108] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:02.648658 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-216ebf70-f579-41e7-9ae9-9cf3b3d4ccbe tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:02.649289 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-216ebf70-f579-41e7-9ae9-9cf3b3d4ccbe tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:02.650307 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-216ebf70-f579-41e7-9ae9-9cf3b3d4ccbe tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:02.650865 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-216ebf70-f579-41e7-9ae9-9cf3b3d4ccbe tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:02.876158 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-f9101386-fff9-49e5-9a26-5b8587fa93d7 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lazy-loading 'services' on Instance uuid a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:55:03.032606 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-216ebf70-f579-41e7-9ae9-9cf3b3d4ccbe tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:03.078737 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-216ebf70-f579-41e7-9ae9-9cf3b3d4ccbe tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108" status: 200 len: 1209 microversion: 2.1 time: 0.472001 Jul 18 02:55:03.082636 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2618/5246] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:02 2022] GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108 => generated 1209 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:03.112497 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f9101386-fff9-49e5-9a26-5b8587fa93d7 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8/os-volume_attachments/e018eda5-6d0d-40d5-aa5b-f429a5f9c91f" status: 202 len: 0 microversion: 2.1 time: 1.086738 Jul 18 02:55:03.113534 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2629/5247] 10.222.0.57 () {58 vars in 1415 bytes} [Mon Jul 18 02:55:02 2022] DELETE /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8/os-volume_attachments/e018eda5-6d0d-40d5-aa5b-f429a5f9c91f => generated 0 bytes in 1090 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:55:03.632448 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7470019f-81cd-4687-8e7c-29c537c56bd3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:03.633344 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7470019f-81cd-4687-8e7c-29c537c56bd3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:03.656537 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7470019f-81cd-4687-8e7c-29c537c56bd3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:03.660096 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7470019f-81cd-4687-8e7c-29c537c56bd3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:03.662315 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7470019f-81cd-4687-8e7c-29c537c56bd3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:03.664784 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7470019f-81cd-4687-8e7c-29c537c56bd3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:04.102866 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-993b2e84-5dca-43b2-beed-a936b2435658 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:04.103689 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-993b2e84-5dca-43b2-beed-a936b2435658 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 9f08d81f-1881-47f2-834e-9d0a3ac31108] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:04.120680 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-993b2e84-5dca-43b2-beed-a936b2435658 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:04.121290 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-993b2e84-5dca-43b2-beed-a936b2435658 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:04.125352 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-993b2e84-5dca-43b2-beed-a936b2435658 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:04.125868 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-993b2e84-5dca-43b2-beed-a936b2435658 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:04.618646 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-993b2e84-5dca-43b2-beed-a936b2435658 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:04.628039 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-993b2e84-5dca-43b2-beed-a936b2435658 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108" status: 200 len: 1271 microversion: 2.1 time: 0.530100 Jul 18 02:55:04.640322 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2630/5248] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:04 2022] GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108 => generated 1271 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:04.647542 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7470019f-81cd-4687-8e7c-29c537c56bd3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:04.664663 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7470019f-81cd-4687-8e7c-29c537c56bd3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5" status: 200 len: 1208 microversion: 2.1 time: 1.036544 Jul 18 02:55:04.665547 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2619/5249] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:03 2022] GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 => generated 1208 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:05.646571 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fcb3dccf-b97b-4b23-839a-2ce5a5bce37b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:05.647540 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fcb3dccf-b97b-4b23-839a-2ce5a5bce37b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 9f08d81f-1881-47f2-834e-9d0a3ac31108] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:05.667024 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fcb3dccf-b97b-4b23-839a-2ce5a5bce37b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:05.667399 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fcb3dccf-b97b-4b23-839a-2ce5a5bce37b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:05.668241 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fcb3dccf-b97b-4b23-839a-2ce5a5bce37b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:05.674584 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fcb3dccf-b97b-4b23-839a-2ce5a5bce37b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:05.698883 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-30e40a10-5dcf-4aae-8be1-b515c73f05a0 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:05.700459 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-30e40a10-5dcf-4aae-8be1-b515c73f05a0 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:05.713960 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-30e40a10-5dcf-4aae-8be1-b515c73f05a0 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:05.714743 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-30e40a10-5dcf-4aae-8be1-b515c73f05a0 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:05.719828 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-30e40a10-5dcf-4aae-8be1-b515c73f05a0 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:05.720905 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-30e40a10-5dcf-4aae-8be1-b515c73f05a0 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:05.861020 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-30e40a10-5dcf-4aae-8be1-b515c73f05a0 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:05.870167 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-30e40a10-5dcf-4aae-8be1-b515c73f05a0 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5" status: 200 len: 1208 microversion: 2.1 time: 0.175148 Jul 18 02:55:05.876442 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2620/5250] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:05 2022] GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 => generated 1208 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:55:05.922912 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fcb3dccf-b97b-4b23-839a-2ce5a5bce37b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:05.926783 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:55:05.936310 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fcb3dccf-b97b-4b23-839a-2ce5a5bce37b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108" status: 200 len: 1271 microversion: 2.1 time: 0.294353 Jul 18 02:55:05.942469 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2631/5251] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:05 2022] GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108 => generated 1271 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:06.908584 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d563dfcc-a677-4c3a-a57d-2efb036a94ea tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:06.909783 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d563dfcc-a677-4c3a-a57d-2efb036a94ea tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:06.917998 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d563dfcc-a677-4c3a-a57d-2efb036a94ea tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:06.918763 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d563dfcc-a677-4c3a-a57d-2efb036a94ea tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:06.919737 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d563dfcc-a677-4c3a-a57d-2efb036a94ea tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:06.920403 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d563dfcc-a677-4c3a-a57d-2efb036a94ea tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:07.403732 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7bc87670-30d5-4897-a6f2-486c578c9f89 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:07.404373 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7bc87670-30d5-4897-a6f2-486c578c9f89 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 9f08d81f-1881-47f2-834e-9d0a3ac31108] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:07.420218 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7bc87670-30d5-4897-a6f2-486c578c9f89 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:07.425586 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7bc87670-30d5-4897-a6f2-486c578c9f89 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:07.426761 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7bc87670-30d5-4897-a6f2-486c578c9f89 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:07.427413 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7bc87670-30d5-4897-a6f2-486c578c9f89 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:07.872874 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7bc87670-30d5-4897-a6f2-486c578c9f89 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:07.886083 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7bc87670-30d5-4897-a6f2-486c578c9f89 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108" status: 200 len: 1271 microversion: 2.1 time: 0.929619 Jul 18 02:55:07.893686 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2632/5252] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:06 2022] GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108 => generated 1271 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:08.001281 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d563dfcc-a677-4c3a-a57d-2efb036a94ea tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:08.012207 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d563dfcc-a677-4c3a-a57d-2efb036a94ea tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5" status: 200 len: 1276 microversion: 2.1 time: 1.108191 Jul 18 02:55:08.022917 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2621/5253] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:06 2022] GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 => generated 1276 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:08.919267 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b04b4a90-4548-4f8f-a9ef-36b6cea57506 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:08.920141 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b04b4a90-4548-4f8f-a9ef-36b6cea57506 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 9f08d81f-1881-47f2-834e-9d0a3ac31108] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:08.940618 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b04b4a90-4548-4f8f-a9ef-36b6cea57506 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:08.941994 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b04b4a90-4548-4f8f-a9ef-36b6cea57506 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:08.946772 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b04b4a90-4548-4f8f-a9ef-36b6cea57506 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:08.949080 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b04b4a90-4548-4f8f-a9ef-36b6cea57506 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:09.050878 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-93126e24-2598-44b5-99f4-81ad66a5d10c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:09.052409 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-93126e24-2598-44b5-99f4-81ad66a5d10c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:09.056573 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:55:09.065549 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-93126e24-2598-44b5-99f4-81ad66a5d10c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:09.070829 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-93126e24-2598-44b5-99f4-81ad66a5d10c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:09.072079 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-93126e24-2598-44b5-99f4-81ad66a5d10c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:09.072716 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-93126e24-2598-44b5-99f4-81ad66a5d10c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:09.547508 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=8 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:55:10.300597 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:55:10.390484 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-93126e24-2598-44b5-99f4-81ad66a5d10c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:10.402135 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-93126e24-2598-44b5-99f4-81ad66a5d10c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5" status: 200 len: 1276 microversion: 2.1 time: 1.354742 Jul 18 02:55:10.403973 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2622/5254] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:09 2022] GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 => generated 1276 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:55:10.440041 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b04b4a90-4548-4f8f-a9ef-36b6cea57506 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:10.454861 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b04b4a90-4548-4f8f-a9ef-36b6cea57506 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108" status: 200 len: 1313 microversion: 2.1 time: 1.537799 Jul 18 02:55:10.458490 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2633/5255] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:08 2022] GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108 => generated 1313 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:10.759202 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-f42833f9-824e-4b72-a676-7449516b7b04 req-c0141925-4ed2-4b7b-8ee2-b7cf955ba775 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bd0b1cf-40d7-4603-8746-bd306afd94f5", "tag": "7ff729a9-545c-47d5-9ffe-dd57240bf5cb"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:55:10.790128 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-f42833f9-824e-4b72-a676-7449516b7b04 req-c0141925-4ed2-4b7b-8ee2-b7cf955ba775 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:10.790941 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-f42833f9-824e-4b72-a676-7449516b7b04 req-c0141925-4ed2-4b7b-8ee2-b7cf955ba775 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:10.819106 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-f42833f9-824e-4b72-a676-7449516b7b04 req-c0141925-4ed2-4b7b-8ee2-b7cf955ba775 service nova] Creating event network-changed:7ff729a9-545c-47d5-9ffe-dd57240bf5cb for instance 6bd0b1cf-40d7-4603-8746-bd306afd94f5 on n-h1-465891-3 Jul 18 02:55:10.860140 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-f42833f9-824e-4b72-a676-7449516b7b04 req-c0141925-4ed2-4b7b-8ee2-b7cf955ba775 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109730 Jul 18 02:55:10.861297 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2623/5256] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:55:11.441470 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2050e8af-2b71-41c5-a150-b4f751cf3664 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:11.448172 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2050e8af-2b71-41c5-a150-b4f751cf3664 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:11.485911 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6db382bf-f244-4951-9cfa-70243555a9f3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:11.493411 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6db382bf-f244-4951-9cfa-70243555a9f3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 9f08d81f-1881-47f2-834e-9d0a3ac31108] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:11.498915 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=8 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:55:11.517748 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2050e8af-2b71-41c5-a150-b4f751cf3664 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:11.521799 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2050e8af-2b71-41c5-a150-b4f751cf3664 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:11.529467 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2050e8af-2b71-41c5-a150-b4f751cf3664 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:11.530455 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2050e8af-2b71-41c5-a150-b4f751cf3664 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:11.567197 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6db382bf-f244-4951-9cfa-70243555a9f3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:11.573765 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6db382bf-f244-4951-9cfa-70243555a9f3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:11.581099 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6db382bf-f244-4951-9cfa-70243555a9f3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:11.585366 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6db382bf-f244-4951-9cfa-70243555a9f3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:12.481862 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6db382bf-f244-4951-9cfa-70243555a9f3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:12.500002 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6db382bf-f244-4951-9cfa-70243555a9f3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108" status: 200 len: 1313 microversion: 2.1 time: 1.026714 Jul 18 02:55:12.519059 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2624/5257] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:11 2022] GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108 => generated 1313 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:13.085998 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2050e8af-2b71-41c5-a150-b4f751cf3664 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:13.104768 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2050e8af-2b71-41c5-a150-b4f751cf3664 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5" status: 200 len: 1276 microversion: 2.1 time: 1.681144 Jul 18 02:55:13.107164 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2634/5258] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:11 2022] GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 => generated 1276 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:13.536584 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6fcc3728-9733-4711-a09c-010e622e61dd tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:13.537892 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6fcc3728-9733-4711-a09c-010e622e61dd tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 9f08d81f-1881-47f2-834e-9d0a3ac31108] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:13.554748 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:55:13.557932 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6fcc3728-9733-4711-a09c-010e622e61dd tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:13.580114 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6fcc3728-9733-4711-a09c-010e622e61dd tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:13.581461 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6fcc3728-9733-4711-a09c-010e622e61dd tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:13.582126 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6fcc3728-9733-4711-a09c-010e622e61dd tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:13.971838 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6fcc3728-9733-4711-a09c-010e622e61dd tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:14.012327 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6fcc3728-9733-4711-a09c-010e622e61dd tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108" status: 200 len: 1313 microversion: 2.1 time: 0.480721 Jul 18 02:55:14.017999 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2625/5259] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:13 2022] GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108 => generated 1313 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:14.160465 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f32fc402-2284-448f-81b1-16765d45e30b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:14.165047 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f32fc402-2284-448f-81b1-16765d45e30b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:14.207953 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f32fc402-2284-448f-81b1-16765d45e30b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:14.210217 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f32fc402-2284-448f-81b1-16765d45e30b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:14.216436 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f32fc402-2284-448f-81b1-16765d45e30b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:14.218900 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f32fc402-2284-448f-81b1-16765d45e30b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:14.275121 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-5e71ced8-5453-40d9-807a-5bc6d30599db req-f10a23cb-4409-4425-90a5-7385c4c46805 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f08d81f-1881-47f2-834e-9d0a3ac31108", "tag": "67c0ab1b-2d45-48d8-9ff0-ef2953355592"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:55:14.327025 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-5e71ced8-5453-40d9-807a-5bc6d30599db req-f10a23cb-4409-4425-90a5-7385c4c46805 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:14.337261 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-5e71ced8-5453-40d9-807a-5bc6d30599db req-f10a23cb-4409-4425-90a5-7385c4c46805 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:14.403276 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-5e71ced8-5453-40d9-807a-5bc6d30599db req-f10a23cb-4409-4425-90a5-7385c4c46805 service nova] Creating event network-changed:67c0ab1b-2d45-48d8-9ff0-ef2953355592 for instance 9f08d81f-1881-47f2-834e-9d0a3ac31108 on n-h1-465891-3 Jul 18 02:55:14.430829 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-5e71ced8-5453-40d9-807a-5bc6d30599db req-f10a23cb-4409-4425-90a5-7385c4c46805 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166851 Jul 18 02:55:14.434341 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2626/5260] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:55:14.930200 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f32fc402-2284-448f-81b1-16765d45e30b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:14.974632 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f32fc402-2284-448f-81b1-16765d45e30b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5" status: 200 len: 1276 microversion: 2.1 time: 0.840671 Jul 18 02:55:14.986263 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2635/5261] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:14 2022] GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 => generated 1276 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:15.053055 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9a590d41-1d20-49ea-9d6b-6888e71252ec tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:15.054746 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9a590d41-1d20-49ea-9d6b-6888e71252ec tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 9f08d81f-1881-47f2-834e-9d0a3ac31108] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:15.074874 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9a590d41-1d20-49ea-9d6b-6888e71252ec tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:15.080863 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9a590d41-1d20-49ea-9d6b-6888e71252ec tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:15.088183 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9a590d41-1d20-49ea-9d6b-6888e71252ec tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:15.091374 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9a590d41-1d20-49ea-9d6b-6888e71252ec tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:15.346565 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1509da5b-b9d0-43f1-a0b1-262cc08e6616 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:15.353387 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1509da5b-b9d0-43f1-a0b1-262cc08e6616 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: a8abc31e-bc67-4e33-b91b-39ec0dcb43b8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:15.390667 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1509da5b-b9d0-43f1-a0b1-262cc08e6616 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:15.391606 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1509da5b-b9d0-43f1-a0b1-262cc08e6616 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:15.393072 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1509da5b-b9d0-43f1-a0b1-262cc08e6616 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:15.394228 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1509da5b-b9d0-43f1-a0b1-262cc08e6616 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:15.521849 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1509da5b-b9d0-43f1-a0b1-262cc08e6616 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.187894 Jul 18 02:55:15.524154 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2636/5262] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:55:15 2022] GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8/os-volume_attachments => generated 25 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:55:15.809186 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-86261344-0822-4363-aa4c-68f83d0719f8 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:15.812969 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-86261344-0822-4363-aa4c-68f83d0719f8 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: a8abc31e-bc67-4e33-b91b-39ec0dcb43b8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:15.824566 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-86261344-0822-4363-aa4c-68f83d0719f8 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:15.825758 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-86261344-0822-4363-aa4c-68f83d0719f8 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:15.827927 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-86261344-0822-4363-aa4c-68f83d0719f8 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:15.828911 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-86261344-0822-4363-aa4c-68f83d0719f8 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:15.895133 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-86261344-0822-4363-aa4c-68f83d0719f8 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.093461 Jul 18 02:55:15.904580 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2637/5263] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 02:55:15 2022] GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8/os-volume_attachments => generated 25 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:55:16.020471 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-48125605-e9c6-41d5-b535-4869c5cdcad3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:16.022161 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-48125605-e9c6-41d5-b535-4869c5cdcad3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:16.034968 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-48125605-e9c6-41d5-b535-4869c5cdcad3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:16.036252 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-48125605-e9c6-41d5-b535-4869c5cdcad3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:16.039511 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-48125605-e9c6-41d5-b535-4869c5cdcad3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:16.040803 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-48125605-e9c6-41d5-b535-4869c5cdcad3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:16.512077 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9a590d41-1d20-49ea-9d6b-6888e71252ec tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:16.560710 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9a590d41-1d20-49ea-9d6b-6888e71252ec tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108" status: 200 len: 1313 microversion: 2.1 time: 1.512014 Jul 18 02:55:16.565233 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2627/5264] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:15 2022] GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108 => generated 1313 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:55:16.596885 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b3699c05-28b8-4d3d-8c97-0afcfbaa5ca8 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:16.597824 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b3699c05-28b8-4d3d-8c97-0afcfbaa5ca8 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: a8abc31e-bc67-4e33-b91b-39ec0dcb43b8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:16.619116 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b3699c05-28b8-4d3d-8c97-0afcfbaa5ca8 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:16.620972 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b3699c05-28b8-4d3d-8c97-0afcfbaa5ca8 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:16.623735 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b3699c05-28b8-4d3d-8c97-0afcfbaa5ca8 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:16.626162 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b3699c05-28b8-4d3d-8c97-0afcfbaa5ca8 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:16.694714 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b3699c05-28b8-4d3d-8c97-0afcfbaa5ca8 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: a8abc31e-bc67-4e33-b91b-39ec0dcb43b8] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:55:16.920787 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-48125605-e9c6-41d5-b535-4869c5cdcad3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:16.955757 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-48125605-e9c6-41d5-b535-4869c5cdcad3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5" status: 200 len: 1276 microversion: 2.1 time: 0.948447 Jul 18 02:55:16.969842 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2638/5265] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:16 2022] GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 => generated 1276 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:16.979680 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5bf376e5-8093-4db9-aa63-f1dd107c3d30 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '.version_select at 0x7ff49b5bbe50>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:16.986260 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b3699c05-28b8-4d3d-8c97-0afcfbaa5ca8 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8" status: 204 len: 0 microversion: 2.1 time: 0.416220 Jul 18 02:55:16.993529 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2628/5266] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:55:16 2022] DELETE /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:55:17.025978 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-472bd667-71f3-417a-885a-7f16febef970 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:17.028452 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-472bd667-71f3-417a-885a-7f16febef970 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: a8abc31e-bc67-4e33-b91b-39ec0dcb43b8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:17.065409 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-472bd667-71f3-417a-885a-7f16febef970 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:17.068989 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-472bd667-71f3-417a-885a-7f16febef970 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:17.072734 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-472bd667-71f3-417a-885a-7f16febef970 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:17.074257 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5bf376e5-8093-4db9-aa63-f1dd107c3d30 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1293310360" status: 202 len: 0 microversion: 2.1 time: 0.109701 Jul 18 02:55:17.074979 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-472bd667-71f3-417a-885a-7f16febef970 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:17.080708 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2639/5267] 10.222.0.57 () {58 vars in 1283 bytes} [Mon Jul 18 02:55:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1293310360 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:55:17.176614 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ae916999-4ee4-4bd7-a104-6faebb555c14 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Action: 'create', calling method: .version_select at 0x7ff4a880b9d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-807021230", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVRrtohQx9w/Dh15sfWClE6Ftaow8clJmi1NxKtGfInMgPJR5Dstaj8JsPdPStgBxNRRlk52DVQcYMtcT5aHVv9gTIyGBApIrEFNg9EWiy0+kbh3siyv9ujS4S24vzCcw=="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:55:17.209913 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-ae916999-4ee4-4bd7-a104-6faebb555c14 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Getting quotas for project fa240dfd375a45efb42fc04807acf847. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:55:17.224568 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-ae916999-4ee4-4bd7-a104-6faebb555c14 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Getting quotas for user 381a2ab772ff495cb85b89a85a267cfe and project fa240dfd375a45efb42fc04807acf847. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:55:17.285333 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ae916999-4ee4-4bd7-a104-6faebb555c14 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.113306 Jul 18 02:55:17.292716 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2640/5268] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 02:55:17 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:55:17.426569 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-472bd667-71f3-417a-885a-7f16febef970 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:17.440153 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-472bd667-71f3-417a-885a-7f16febef970 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8" status: 200 len: 1672 microversion: 2.1 time: 0.443882 Jul 18 02:55:17.453751 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2629/5269] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:16 2022] GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 => generated 1672 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:17.599540 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-35ad93dd-b607-4638-996a-b5d35113e2de tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:17.603218 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-35ad93dd-b607-4638-996a-b5d35113e2de tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 9f08d81f-1881-47f2-834e-9d0a3ac31108] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:17.636722 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-35ad93dd-b607-4638-996a-b5d35113e2de tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:17.638151 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-35ad93dd-b607-4638-996a-b5d35113e2de tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:17.641419 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-35ad93dd-b607-4638-996a-b5d35113e2de tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:17.646592 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-35ad93dd-b607-4638-996a-b5d35113e2de tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:17.987523 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1b3e3b4f-4026-4cba-85a2-2e7a4444432c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:17.988126 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1b3e3b4f-4026-4cba-85a2-2e7a4444432c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:18.005824 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1b3e3b4f-4026-4cba-85a2-2e7a4444432c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:18.006418 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1b3e3b4f-4026-4cba-85a2-2e7a4444432c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:18.007283 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1b3e3b4f-4026-4cba-85a2-2e7a4444432c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:18.007725 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1b3e3b4f-4026-4cba-85a2-2e7a4444432c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:18.028008 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-35ad93dd-b607-4638-996a-b5d35113e2de tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:18.072274 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-35ad93dd-b607-4638-996a-b5d35113e2de tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108" status: 200 len: 1313 microversion: 2.1 time: 0.481037 Jul 18 02:55:18.073565 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2641/5270] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:17 2022] GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108 => generated 1313 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:18.217034 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1b3e3b4f-4026-4cba-85a2-2e7a4444432c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:18.230573 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1b3e3b4f-4026-4cba-85a2-2e7a4444432c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5" status: 200 len: 1276 microversion: 2.1 time: 0.247458 Jul 18 02:55:18.232913 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2630/5271] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:17 2022] GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 => generated 1276 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:18.479498 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-87d5d584-a39b-4020-8a75-479b97db824b tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:18.486288 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-87d5d584-a39b-4020-8a75-479b97db824b tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: a8abc31e-bc67-4e33-b91b-39ec0dcb43b8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:18.504155 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:55:18.538642 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-87d5d584-a39b-4020-8a75-479b97db824b tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:18.550665 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-87d5d584-a39b-4020-8a75-479b97db824b tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:18.555333 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-87d5d584-a39b-4020-8a75-479b97db824b tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:18.560822 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-87d5d584-a39b-4020-8a75-479b97db824b tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:19.111518 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1e1b0cda-599f-49de-a6de-bc3a2cabfdee tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:19.112407 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1e1b0cda-599f-49de-a6de-bc3a2cabfdee tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 9f08d81f-1881-47f2-834e-9d0a3ac31108] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:19.131065 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1e1b0cda-599f-49de-a6de-bc3a2cabfdee tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:19.132570 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1e1b0cda-599f-49de-a6de-bc3a2cabfdee tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:19.133538 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1e1b0cda-599f-49de-a6de-bc3a2cabfdee tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:19.136567 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1e1b0cda-599f-49de-a6de-bc3a2cabfdee tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:19.656354 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-87d5d584-a39b-4020-8a75-479b97db824b tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:19.672384 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-87d5d584-a39b-4020-8a75-479b97db824b tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8" status: 200 len: 1672 microversion: 2.1 time: 1.200866 Jul 18 02:55:19.673422 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2642/5272] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:18 2022] GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 => generated 1672 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:19.690704 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1a1a7c9c-1ada-4469-ac15-0726897957d3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:19.693061 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1a1a7c9c-1ada-4469-ac15-0726897957d3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:19.710444 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1a1a7c9c-1ada-4469-ac15-0726897957d3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:19.712066 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1a1a7c9c-1ada-4469-ac15-0726897957d3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:19.714905 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1a1a7c9c-1ada-4469-ac15-0726897957d3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:19.715429 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1a1a7c9c-1ada-4469-ac15-0726897957d3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:20.267593 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1e1b0cda-599f-49de-a6de-bc3a2cabfdee tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:20.310400 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1e1b0cda-599f-49de-a6de-bc3a2cabfdee tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108" status: 200 len: 1313 microversion: 2.1 time: 1.204532 Jul 18 02:55:20.314199 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2631/5273] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:19 2022] GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108 => generated 1313 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:20.524839 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1a1a7c9c-1ada-4469-ac15-0726897957d3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:20.551969 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1a1a7c9c-1ada-4469-ac15-0726897957d3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5" status: 200 len: 1276 microversion: 2.1 time: 0.876592 Jul 18 02:55:20.562213 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2643/5274] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:19 2022] GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 => generated 1276 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:20.711906 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-77e0fee8-7196-426f-9d8b-dad90d6fb8f1 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:20.716523 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-77e0fee8-7196-426f-9d8b-dad90d6fb8f1 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: a8abc31e-bc67-4e33-b91b-39ec0dcb43b8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:20.748346 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77e0fee8-7196-426f-9d8b-dad90d6fb8f1 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:20.750925 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77e0fee8-7196-426f-9d8b-dad90d6fb8f1 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:20.755170 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77e0fee8-7196-426f-9d8b-dad90d6fb8f1 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:20.756205 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77e0fee8-7196-426f-9d8b-dad90d6fb8f1 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:21.126751 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6d4a14fb-e82f-44bd-b1a0-f9115b36adee tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Action: 'create', calling method: .version_select at 0x7ff49b86d550>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-247054353", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqYrfNMiWZD4KHCFwJDW8LVDkJwRFfDBxUSeSZL/BEF0ZKAVAlHYHXduHWXehKebHuUaiehFZ1sLnUm29MRtZUahGyuj/MlV2DNdMDGRYCffh63TjDB2AVafidoToX/6w=="}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:55:21.206912 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-6d4a14fb-e82f-44bd-b1a0-f9115b36adee tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Getting quotas for project 0f043fa9beaa4ac6b209d67346479c57. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:55:21.246379 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-6d4a14fb-e82f-44bd-b1a0-f9115b36adee tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Getting quotas for user b6c7444bc0744533861c32353fa7f597 and project 0f043fa9beaa4ac6b209d67346479c57. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:55:21.354916 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6d4a14fb-e82f-44bd-b1a0-f9115b36adee tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 1.037485 Jul 18 02:55:21.370352 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2632/5275] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 02:55:20 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:55:21.393276 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5f63aea0-3f05-4d40-87db-1dd7f41e8eb0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:21.394592 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5f63aea0-3f05-4d40-87db-1dd7f41e8eb0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 9f08d81f-1881-47f2-834e-9d0a3ac31108] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:21.418016 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5f63aea0-3f05-4d40-87db-1dd7f41e8eb0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:21.422086 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5f63aea0-3f05-4d40-87db-1dd7f41e8eb0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:21.423883 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5f63aea0-3f05-4d40-87db-1dd7f41e8eb0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:21.426012 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5f63aea0-3f05-4d40-87db-1dd7f41e8eb0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:21.536546 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-77e0fee8-7196-426f-9d8b-dad90d6fb8f1 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:21.566139 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-77e0fee8-7196-426f-9d8b-dad90d6fb8f1 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8" status: 200 len: 1672 microversion: 2.1 time: 0.861712 Jul 18 02:55:21.576208 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2644/5276] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:20 2022] GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 => generated 1672 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:21.584997 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dd96ff78-476b-4b11-b294-b5d40a14cbd0 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:21.588139 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-dd96ff78-476b-4b11-b294-b5d40a14cbd0 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:21.600935 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dd96ff78-476b-4b11-b294-b5d40a14cbd0 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:21.602862 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dd96ff78-476b-4b11-b294-b5d40a14cbd0 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:21.605304 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dd96ff78-476b-4b11-b294-b5d40a14cbd0 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:21.607822 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dd96ff78-476b-4b11-b294-b5d40a14cbd0 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:22.416658 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-dd96ff78-476b-4b11-b294-b5d40a14cbd0 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:22.432238 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-dd96ff78-476b-4b11-b294-b5d40a14cbd0 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5" status: 200 len: 1276 microversion: 2.1 time: 0.851219 Jul 18 02:55:22.433056 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2645/5277] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:21 2022] GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 => generated 1276 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:22.442215 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5f63aea0-3f05-4d40-87db-1dd7f41e8eb0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:22.455483 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5f63aea0-3f05-4d40-87db-1dd7f41e8eb0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108" status: 200 len: 1313 microversion: 2.1 time: 1.082052 Jul 18 02:55:22.457584 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2633/5278] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:21 2022] GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108 => generated 1313 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:22.595849 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cbc9ca05-3d0b-4628-9cda-3a109cc3eea4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:22.596810 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cbc9ca05-3d0b-4628-9cda-3a109cc3eea4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: a8abc31e-bc67-4e33-b91b-39ec0dcb43b8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:22.611026 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cbc9ca05-3d0b-4628-9cda-3a109cc3eea4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:22.611772 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cbc9ca05-3d0b-4628-9cda-3a109cc3eea4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:22.612847 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cbc9ca05-3d0b-4628-9cda-3a109cc3eea4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:22.613498 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cbc9ca05-3d0b-4628-9cda-3a109cc3eea4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:22.978724 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cbc9ca05-3d0b-4628-9cda-3a109cc3eea4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8ea645f5364b8497d3e439a2d85e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acec37ba95432eb3ef9b5229167fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:22.994476 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cbc9ca05-3d0b-4628-9cda-3a109cc3eea4 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8" status: 200 len: 1606 microversion: 2.1 time: 0.397450 Jul 18 02:55:22.995858 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2646/5279] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:22 2022] GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 => generated 1606 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:23.466826 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-99f2912a-7f2d-4b08-b82b-8632f124ebaf req-eaf4bc9a-4d85-4485-9a6b-5de349d6d91d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8abc31e-bc67-4e33-b91b-39ec0dcb43b8", "name": "network-vif-deleted", "tag": "346afce5-8af0-43f5-af5f-0ef4ee5d398a"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:55:23.472319 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f01a6c67-c341-4823-bc45-695be22eb0e7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:23.474850 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f01a6c67-c341-4823-bc45-695be22eb0e7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:23.503060 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f01a6c67-c341-4823-bc45-695be22eb0e7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:23.512338 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f01a6c67-c341-4823-bc45-695be22eb0e7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:23.512798 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-99f2912a-7f2d-4b08-b82b-8632f124ebaf req-eaf4bc9a-4d85-4485-9a6b-5de349d6d91d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:23.514217 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-99f2912a-7f2d-4b08-b82b-8632f124ebaf req-eaf4bc9a-4d85-4485-9a6b-5de349d6d91d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:23.518807 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f01a6c67-c341-4823-bc45-695be22eb0e7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:23.519555 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f01a6c67-c341-4823-bc45-695be22eb0e7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:23.593569 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-99f2912a-7f2d-4b08-b82b-8632f124ebaf req-eaf4bc9a-4d85-4485-9a6b-5de349d6d91d service nova] Creating event network-vif-deleted:346afce5-8af0-43f5-af5f-0ef4ee5d398a for instance a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 on n-h2-465891-3 Jul 18 02:55:23.649877 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-99f2912a-7f2d-4b08-b82b-8632f124ebaf req-eaf4bc9a-4d85-4485-9a6b-5de349d6d91d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195246 Jul 18 02:55:23.653645 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2647/5280] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:55:23.672220 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-779b2072-e98c-4cbc-a082-02b2e812b11f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:23.675195 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-779b2072-e98c-4cbc-a082-02b2e812b11f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 9f08d81f-1881-47f2-834e-9d0a3ac31108] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:23.734588 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-779b2072-e98c-4cbc-a082-02b2e812b11f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:23.735267 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-779b2072-e98c-4cbc-a082-02b2e812b11f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:23.736378 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-779b2072-e98c-4cbc-a082-02b2e812b11f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:23.740666 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-779b2072-e98c-4cbc-a082-02b2e812b11f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:24.250026 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f01a6c67-c341-4823-bc45-695be22eb0e7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:24.266178 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f01a6c67-c341-4823-bc45-695be22eb0e7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5" status: 200 len: 1276 microversion: 2.1 time: 0.815225 Jul 18 02:55:24.270153 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2634/5281] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:23 2022] GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 => generated 1276 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:24.279028 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-bbcfc56f-e67d-4416-8220-678273038f95 req-2c75bbd2-e4e0-4cc0-85fe-148cf11b5acf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f08d81f-1881-47f2-834e-9d0a3ac31108", "name": "network-vif-plugged", "status": "completed", "tag": "67c0ab1b-2d45-48d8-9ff0-ef2953355592"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:55:24.305228 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-bbcfc56f-e67d-4416-8220-678273038f95 req-2c75bbd2-e4e0-4cc0-85fe-148cf11b5acf service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:24.311533 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-bbcfc56f-e67d-4416-8220-678273038f95 req-2c75bbd2-e4e0-4cc0-85fe-148cf11b5acf service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:24.317819 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:55:24.354643 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-bbcfc56f-e67d-4416-8220-678273038f95 req-2c75bbd2-e4e0-4cc0-85fe-148cf11b5acf service nova] Creating event network-vif-plugged:67c0ab1b-2d45-48d8-9ff0-ef2953355592 for instance 9f08d81f-1881-47f2-834e-9d0a3ac31108 on n-h1-465891-3 Jul 18 02:55:24.364906 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-bbcfc56f-e67d-4416-8220-678273038f95 req-2c75bbd2-e4e0-4cc0-85fe-148cf11b5acf service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093193 Jul 18 02:55:24.366780 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2635/5282] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:55:24.384903 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-71f66418-eb2f-4ba4-abeb-99cd97e7660c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:24.386913 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-71f66418-eb2f-4ba4-abeb-99cd97e7660c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: a8abc31e-bc67-4e33-b91b-39ec0dcb43b8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:24.395817 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-71f66418-eb2f-4ba4-abeb-99cd97e7660c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:24.398113 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-71f66418-eb2f-4ba4-abeb-99cd97e7660c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:24.399320 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-71f66418-eb2f-4ba4-abeb-99cd97e7660c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:24.400021 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-71f66418-eb2f-4ba4-abeb-99cd97e7660c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:24.430005 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-71f66418-eb2f-4ba4-abeb-99cd97e7660c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] HTTP exception thrown: Instance a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 could not be found. Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-71f66418-eb2f-4ba4-abeb-99cd97e7660c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Request method failure captured: Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 HTTP/1.1 Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1Mmzt2I9RlA6VEggBfRLShSXRaBuXjrVrPNlWO6AFdGcTHbVp2kQCiHz7Ex0iPFnQ6OMMIZinbDEVI1KOVeP4bskTlV5IxDPGX95DhpKc5DI9xePXSABpXDandv4aW8bK6yk3AXLmHawMw9CXg1Gm9JCYpdfA_nyr-OhgxOnBlhCDAk Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: e9acec37ba95432eb3ef9b5229167fe8 Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-AttachVolumeTestJSON-1393062758 Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e9acec37ba95432eb3ef9b5229167fe8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e9acec37ba95432eb3ef9b5229167fe8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e9acec37ba95432eb3ef9b5229167fe8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e9acec37ba95432eb3ef9b5229167fe8"}]}] Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-AttachVolumeTestJSON-1393062758 Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: e9acec37ba95432eb3ef9b5229167fe8 Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1393062758 Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-AttachVolumeTestJSON-1393062758-project Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: ba8ea645f5364b8497d3e439a2d85e54 Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-AttachVolumeTestJSON-1393062758-project Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 could not be found. Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'a8abc31e-bc67-4e33-b91b-39ec0dcb43b8'} Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 could not be found. Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 could not be found. Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:55:24.432914 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:55:24.437200 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:55:24.437200 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:55:24.437200 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:55:24.437200 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:55:24.437200 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:55:24.437200 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 could not be found. Jul 18 02:55:24.437200 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:55:24.441044 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-71f66418-eb2f-4ba4-abeb-99cd97e7660c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Returning 404 to user: Instance a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:55:24.443032 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-71f66418-eb2f-4ba4-abeb-99cd97e7660c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8" status: 404 len: 111 microversion: 2.1 time: 0.074649 Jul 18 02:55:24.444760 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2636/5283] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:24 2022] GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:55:24.457289 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-553a8e2b-6a57-4cf5-b195-2fdeba81f601 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '.version_select at 0x7ff4a85cc9d0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:24.493855 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-553a8e2b-6a57-4cf5-b195-2fdeba81f601 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1075332678" status: 202 len: 0 microversion: 2.1 time: 0.040973 Jul 18 02:55:24.506508 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2637/5284] 10.222.0.57 () {58 vars in 1220 bytes} [Mon Jul 18 02:55:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1075332678 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:55:24.528862 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-779b2072-e98c-4cbc-a082-02b2e812b11f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:24.541803 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-779b2072-e98c-4cbc-a082-02b2e812b11f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108" status: 200 len: 1313 microversion: 2.1 time: 0.883027 Jul 18 02:55:24.542824 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2648/5285] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:23 2022] GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108 => generated 1313 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:25.308259 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bbe873f7-d12d-41ea-abe3-0fea84b55f3d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:25.319017 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bbe873f7-d12d-41ea-abe3-0fea84b55f3d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:25.338138 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bbe873f7-d12d-41ea-abe3-0fea84b55f3d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:25.345369 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bbe873f7-d12d-41ea-abe3-0fea84b55f3d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:25.352230 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bbe873f7-d12d-41ea-abe3-0fea84b55f3d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:25.353349 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bbe873f7-d12d-41ea-abe3-0fea84b55f3d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:25.572792 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c99e235e-efac-4e8f-92f6-5e41efc54811 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:25.574488 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c99e235e-efac-4e8f-92f6-5e41efc54811 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 9f08d81f-1881-47f2-834e-9d0a3ac31108] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:25.602477 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c99e235e-efac-4e8f-92f6-5e41efc54811 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:25.618808 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c99e235e-efac-4e8f-92f6-5e41efc54811 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:25.622031 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c99e235e-efac-4e8f-92f6-5e41efc54811 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:25.622920 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c99e235e-efac-4e8f-92f6-5e41efc54811 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:26.076554 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c99e235e-efac-4e8f-92f6-5e41efc54811 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:26.084941 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bbe873f7-d12d-41ea-abe3-0fea84b55f3d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:26.095853 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c99e235e-efac-4e8f-92f6-5e41efc54811 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108" status: 200 len: 1313 microversion: 2.1 time: 0.530199 Jul 18 02:55:26.097441 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2649/5286] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:25 2022] GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108 => generated 1313 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:26.100856 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bbe873f7-d12d-41ea-abe3-0fea84b55f3d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5" status: 200 len: 1264 microversion: 2.1 time: 0.807195 Jul 18 02:55:26.112929 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2638/5287] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:25 2022] GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 => generated 1264 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:27.142074 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-36f187bc-e925-4b36-a961-eaa5bee53e50 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:27.151810 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-36f187bc-e925-4b36-a961-eaa5bee53e50 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:27.153840 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5572300c-3440-4e10-ba18-5d6c81d4ac74 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:27.161743 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5572300c-3440-4e10-ba18-5d6c81d4ac74 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 9f08d81f-1881-47f2-834e-9d0a3ac31108] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:27.179405 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-36f187bc-e925-4b36-a961-eaa5bee53e50 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:27.180554 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-36f187bc-e925-4b36-a961-eaa5bee53e50 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:27.182325 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-36f187bc-e925-4b36-a961-eaa5bee53e50 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:27.188017 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-36f187bc-e925-4b36-a961-eaa5bee53e50 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:27.188712 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5572300c-3440-4e10-ba18-5d6c81d4ac74 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:27.194432 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5572300c-3440-4e10-ba18-5d6c81d4ac74 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:27.196177 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5572300c-3440-4e10-ba18-5d6c81d4ac74 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:27.198092 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5572300c-3440-4e10-ba18-5d6c81d4ac74 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:27.245568 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=4 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:55:27.749865 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-36f187bc-e925-4b36-a961-eaa5bee53e50 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:27.771329 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-36f187bc-e925-4b36-a961-eaa5bee53e50 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5" status: 200 len: 1264 microversion: 2.1 time: 0.653792 Jul 18 02:55:27.773299 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2639/5288] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:27 2022] GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 => generated 1264 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:27.787458 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5572300c-3440-4e10-ba18-5d6c81d4ac74 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:27.804648 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5572300c-3440-4e10-ba18-5d6c81d4ac74 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108" status: 200 len: 1313 microversion: 2.1 time: 0.691061 Jul 18 02:55:27.806313 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2650/5289] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:27 2022] GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108 => generated 1313 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:28.798704 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b0ffe97e-6c14-4b77-9b90-b99b05169be3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:28.799520 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b0ffe97e-6c14-4b77-9b90-b99b05169be3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:28.815058 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b0ffe97e-6c14-4b77-9b90-b99b05169be3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:28.815427 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b0ffe97e-6c14-4b77-9b90-b99b05169be3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:28.816279 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b0ffe97e-6c14-4b77-9b90-b99b05169be3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:28.819396 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b0ffe97e-6c14-4b77-9b90-b99b05169be3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:28.851781 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e4a76cbd-bea0-4753-8098-c5be9d724390 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:28.855322 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e4a76cbd-bea0-4753-8098-c5be9d724390 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 9f08d81f-1881-47f2-834e-9d0a3ac31108] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:28.885897 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e4a76cbd-bea0-4753-8098-c5be9d724390 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:28.886789 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e4a76cbd-bea0-4753-8098-c5be9d724390 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:28.889641 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e4a76cbd-bea0-4753-8098-c5be9d724390 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:28.890651 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e4a76cbd-bea0-4753-8098-c5be9d724390 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:28.900341 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:55:29.370962 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e4a76cbd-bea0-4753-8098-c5be9d724390 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:29.382910 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e4a76cbd-bea0-4753-8098-c5be9d724390 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108" status: 200 len: 1501 microversion: 2.1 time: 0.554681 Jul 18 02:55:29.397664 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2651/5290] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:28 2022] GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108 => generated 1501 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:29.422589 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d842d74c-7090-4930-a7bd-f1921de3d9e2 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:55:29.425046 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d842d74c-7090-4930-a7bd-f1921de3d9e2 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 9f08d81f-1881-47f2-834e-9d0a3ac31108] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:29.439542 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d842d74c-7090-4930-a7bd-f1921de3d9e2 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:29.440690 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d842d74c-7090-4930-a7bd-f1921de3d9e2 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:29.445290 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d842d74c-7090-4930-a7bd-f1921de3d9e2 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:29.446239 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d842d74c-7090-4930-a7bd-f1921de3d9e2 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:29.450902 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b0ffe97e-6c14-4b77-9b90-b99b05169be3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:29.467116 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b0ffe97e-6c14-4b77-9b90-b99b05169be3 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5" status: 200 len: 1264 microversion: 2.1 time: 0.673352 Jul 18 02:55:29.470136 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2640/5291] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:28 2022] GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 => generated 1264 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:29.527606 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d842d74c-7090-4930-a7bd-f1921de3d9e2 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "POST /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108/action" status: 200 len: 14 microversion: 2.1 time: 0.112377 Jul 18 02:55:29.529242 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2652/5292] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:55:29 2022] POST /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 02:55:30.498189 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8505c8c8-4c03-4e60-b82d-f40536017b33 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:30.499615 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8505c8c8-4c03-4e60-b82d-f40536017b33 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:30.512398 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8505c8c8-4c03-4e60-b82d-f40536017b33 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:30.512862 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8505c8c8-4c03-4e60-b82d-f40536017b33 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:30.518207 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8505c8c8-4c03-4e60-b82d-f40536017b33 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:30.518780 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8505c8c8-4c03-4e60-b82d-f40536017b33 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:30.548728 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bb89cd02-b34e-474d-9d25-6b2b0ed292c1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:55:30.549949 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bb89cd02-b34e-474d-9d25-6b2b0ed292c1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 9f08d81f-1881-47f2-834e-9d0a3ac31108] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:30.585796 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bb89cd02-b34e-474d-9d25-6b2b0ed292c1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:30.586262 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bb89cd02-b34e-474d-9d25-6b2b0ed292c1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:30.598845 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bb89cd02-b34e-474d-9d25-6b2b0ed292c1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:30.599512 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bb89cd02-b34e-474d-9d25-6b2b0ed292c1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:31.134207 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bb89cd02-b34e-474d-9d25-6b2b0ed292c1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "POST /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108/action" status: 200 len: 14 microversion: 2.1 time: 0.594341 Jul 18 02:55:31.144541 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2653/5293] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:55:30 2022] POST /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108/action => generated 14 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:55:31.283778 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:55:31.639905 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8505c8c8-4c03-4e60-b82d-f40536017b33 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:31.683447 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8505c8c8-4c03-4e60-b82d-f40536017b33 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5" status: 200 len: 1264 microversion: 2.1 time: 1.188030 Jul 18 02:55:31.687486 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2641/5294] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:30 2022] GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 => generated 1264 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:32.178627 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-06897da4-775c-4eac-ae65-c4b8e959d619 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:55:32.184120 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-06897da4-775c-4eac-ae65-c4b8e959d619 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 9f08d81f-1881-47f2-834e-9d0a3ac31108] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:32.213631 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-06897da4-775c-4eac-ae65-c4b8e959d619 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:32.215262 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-06897da4-775c-4eac-ae65-c4b8e959d619 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:32.218473 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-06897da4-775c-4eac-ae65-c4b8e959d619 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:32.221853 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-06897da4-775c-4eac-ae65-c4b8e959d619 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:32.456739 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-06897da4-775c-4eac-ae65-c4b8e959d619 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "POST /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108/action" status: 200 len: 14 microversion: 2.1 time: 0.306777 Jul 18 02:55:32.461315 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2654/5295] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:55:32 2022] POST /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108/action => generated 14 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:55:32.729246 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a6c6baf4-b509-4646-b319-8f79c1b765a5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:32.745383 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a6c6baf4-b509-4646-b319-8f79c1b765a5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:32.829172 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a6c6baf4-b509-4646-b319-8f79c1b765a5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:32.832271 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a6c6baf4-b509-4646-b319-8f79c1b765a5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:32.834407 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a6c6baf4-b509-4646-b319-8f79c1b765a5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:32.836305 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a6c6baf4-b509-4646-b319-8f79c1b765a5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:33.482398 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-be5d60ca-7b43-4950-af9a-51e28a417023 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:55:33.485008 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-be5d60ca-7b43-4950-af9a-51e28a417023 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 9f08d81f-1881-47f2-834e-9d0a3ac31108] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:33.504549 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-be5d60ca-7b43-4950-af9a-51e28a417023 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:33.511145 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-be5d60ca-7b43-4950-af9a-51e28a417023 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:33.512401 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-be5d60ca-7b43-4950-af9a-51e28a417023 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:33.513103 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-be5d60ca-7b43-4950-af9a-51e28a417023 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:33.628549 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-be5d60ca-7b43-4950-af9a-51e28a417023 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "POST /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108/action" status: 200 len: 14 microversion: 2.1 time: 0.162353 Jul 18 02:55:33.630209 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2655/5296] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:55:33 2022] POST /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:55:34.232117 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a6c6baf4-b509-4646-b319-8f79c1b765a5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:34.243841 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a6c6baf4-b509-4646-b319-8f79c1b765a5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5" status: 200 len: 1264 microversion: 2.1 time: 1.530261 Jul 18 02:55:34.255522 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2642/5297] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:32 2022] GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 => generated 1264 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:55:34.642863 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e06a89c4-f8b5-4675-b2d0-42b0016cd606 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:55:34.644125 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e06a89c4-f8b5-4675-b2d0-42b0016cd606 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 9f08d81f-1881-47f2-834e-9d0a3ac31108] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:34.669032 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e06a89c4-f8b5-4675-b2d0-42b0016cd606 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:34.675094 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e06a89c4-f8b5-4675-b2d0-42b0016cd606 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:34.676900 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e06a89c4-f8b5-4675-b2d0-42b0016cd606 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:34.678418 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e06a89c4-f8b5-4675-b2d0-42b0016cd606 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:34.818366 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e06a89c4-f8b5-4675-b2d0-42b0016cd606 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "POST /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108/action" status: 200 len: 14 microversion: 2.1 time: 0.180554 Jul 18 02:55:34.819587 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2656/5298] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:55:34 2022] POST /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108/action => generated 14 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:55:35.274061 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a7437c8b-affd-47c8-b88d-f71044df7073 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:35.276027 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a7437c8b-affd-47c8-b88d-f71044df7073 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:35.303218 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a7437c8b-affd-47c8-b88d-f71044df7073 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:35.305853 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a7437c8b-affd-47c8-b88d-f71044df7073 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:35.308922 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a7437c8b-affd-47c8-b88d-f71044df7073 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:35.310699 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a7437c8b-affd-47c8-b88d-f71044df7073 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:35.833065 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4c08fbc0-d776-4bb9-b9e0-47adb77066c5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:55:35.834293 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4c08fbc0-d776-4bb9-b9e0-47adb77066c5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 9f08d81f-1881-47f2-834e-9d0a3ac31108] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:35.875287 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4c08fbc0-d776-4bb9-b9e0-47adb77066c5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:35.876020 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4c08fbc0-d776-4bb9-b9e0-47adb77066c5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:35.876930 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4c08fbc0-d776-4bb9-b9e0-47adb77066c5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:35.877397 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4c08fbc0-d776-4bb9-b9e0-47adb77066c5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:36.043788 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4c08fbc0-d776-4bb9-b9e0-47adb77066c5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "POST /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108/action" status: 200 len: 14 microversion: 2.1 time: 0.215190 Jul 18 02:55:36.044994 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2657/5299] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:55:35 2022] POST /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108/action => generated 14 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:55:37.059596 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c656215f-2c77-406b-8013-c8e1c0ec6db1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:55:37.061594 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c656215f-2c77-406b-8013-c8e1c0ec6db1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 9f08d81f-1881-47f2-834e-9d0a3ac31108] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:37.093918 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c656215f-2c77-406b-8013-c8e1c0ec6db1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:37.101138 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c656215f-2c77-406b-8013-c8e1c0ec6db1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:37.106951 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c656215f-2c77-406b-8013-c8e1c0ec6db1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:37.109525 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c656215f-2c77-406b-8013-c8e1c0ec6db1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:37.302191 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c656215f-2c77-406b-8013-c8e1c0ec6db1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "POST /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108/action" status: 200 len: 14 microversion: 2.1 time: 0.248062 Jul 18 02:55:37.305489 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2658/5300] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:55:37 2022] POST /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108/action => generated 14 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 02:55:38.063803 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a7437c8b-affd-47c8-b88d-f71044df7073 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:38.078384 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a7437c8b-affd-47c8-b88d-f71044df7073 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5" status: 200 len: 1264 microversion: 2.1 time: 2.810174 Jul 18 02:55:38.096923 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2643/5301] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:35 2022] GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 => generated 1264 bytes in 2829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:38.330390 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0fdaab5b-00ab-4f59-a64f-66538fa82801 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:55:38.348763 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0fdaab5b-00ab-4f59-a64f-66538fa82801 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 9f08d81f-1881-47f2-834e-9d0a3ac31108] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:38.447674 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0fdaab5b-00ab-4f59-a64f-66538fa82801 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:38.457006 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0fdaab5b-00ab-4f59-a64f-66538fa82801 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:38.459927 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0fdaab5b-00ab-4f59-a64f-66538fa82801 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:38.461065 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0fdaab5b-00ab-4f59-a64f-66538fa82801 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:38.728547 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0fdaab5b-00ab-4f59-a64f-66538fa82801 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "POST /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108/action" status: 200 len: 14 microversion: 2.1 time: 0.399115 Jul 18 02:55:38.734728 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2659/5302] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:55:38 2022] POST /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108/action => generated 14 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:55:39.110967 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f0e0ecb4-1da0-42ae-8747-4b6b0c3999c7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:39.117238 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f0e0ecb4-1da0-42ae-8747-4b6b0c3999c7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:39.153289 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f0e0ecb4-1da0-42ae-8747-4b6b0c3999c7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:39.153979 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f0e0ecb4-1da0-42ae-8747-4b6b0c3999c7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:39.156406 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f0e0ecb4-1da0-42ae-8747-4b6b0c3999c7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:39.163193 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f0e0ecb4-1da0-42ae-8747-4b6b0c3999c7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:39.746155 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-424794d8-f042-45af-8852-5142b1eb7dee tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:55:39.747333 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-424794d8-f042-45af-8852-5142b1eb7dee tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 9f08d81f-1881-47f2-834e-9d0a3ac31108] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:39.800532 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-424794d8-f042-45af-8852-5142b1eb7dee tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:39.801356 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-424794d8-f042-45af-8852-5142b1eb7dee tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:39.803048 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-424794d8-f042-45af-8852-5142b1eb7dee tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:39.803865 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-424794d8-f042-45af-8852-5142b1eb7dee tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:39.972730 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-424794d8-f042-45af-8852-5142b1eb7dee tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "POST /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108/action" status: 200 len: 14 microversion: 2.1 time: 0.231227 Jul 18 02:55:39.979121 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2660/5303] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:55:39 2022] POST /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108/action => generated 14 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 02:55:40.808868 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f0e0ecb4-1da0-42ae-8747-4b6b0c3999c7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:40.832515 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f0e0ecb4-1da0-42ae-8747-4b6b0c3999c7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5" status: 200 len: 1264 microversion: 2.1 time: 1.732072 Jul 18 02:55:40.838314 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2644/5304] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:39 2022] GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 => generated 1264 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:41.002707 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9863923f-1c97-45c1-9d94-58a167301800 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:55:41.013026 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9863923f-1c97-45c1-9d94-58a167301800 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 9f08d81f-1881-47f2-834e-9d0a3ac31108] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:41.054288 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9863923f-1c97-45c1-9d94-58a167301800 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:41.055302 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9863923f-1c97-45c1-9d94-58a167301800 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:41.057451 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9863923f-1c97-45c1-9d94-58a167301800 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:41.061235 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9863923f-1c97-45c1-9d94-58a167301800 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:41.243507 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9863923f-1c97-45c1-9d94-58a167301800 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "POST /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108/action" status: 200 len: 16393 microversion: 2.1 time: 0.257269 Jul 18 02:55:41.261473 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2661/5305] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:55:40 2022] POST /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108/action => generated 16393 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:55:41.275354 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-48d839de-7561-44dc-b5f0-e4cf896df69c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:41.276097 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-48d839de-7561-44dc-b5f0-e4cf896df69c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:41.295174 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-48d839de-7561-44dc-b5f0-e4cf896df69c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:41.296682 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-48d839de-7561-44dc-b5f0-e4cf896df69c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:41.297737 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-48d839de-7561-44dc-b5f0-e4cf896df69c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:41.298320 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-48d839de-7561-44dc-b5f0-e4cf896df69c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:41.876655 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b06c37e0-0458-407e-aa00-2d7c44a9d2ec tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:41.890349 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b06c37e0-0458-407e-aa00-2d7c44a9d2ec tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:41.927656 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b06c37e0-0458-407e-aa00-2d7c44a9d2ec tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:41.932419 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b06c37e0-0458-407e-aa00-2d7c44a9d2ec tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:41.937309 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b06c37e0-0458-407e-aa00-2d7c44a9d2ec tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:41.941329 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b06c37e0-0458-407e-aa00-2d7c44a9d2ec tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:42.792982 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-48d839de-7561-44dc-b5f0-e4cf896df69c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:42.827683 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-48d839de-7561-44dc-b5f0-e4cf896df69c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 1.553858 Jul 18 02:55:42.829466 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2645/5306] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:41 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:42.869783 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e9524a6b-b38b-4431-bbab-d49c2f79237e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:42.871022 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e9524a6b-b38b-4431-bbab-d49c2f79237e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:42.886809 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e9524a6b-b38b-4431-bbab-d49c2f79237e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:42.887658 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e9524a6b-b38b-4431-bbab-d49c2f79237e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:42.894921 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e9524a6b-b38b-4431-bbab-d49c2f79237e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:42.895780 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e9524a6b-b38b-4431-bbab-d49c2f79237e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:43.527581 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b06c37e0-0458-407e-aa00-2d7c44a9d2ec tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:43.581768 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b06c37e0-0458-407e-aa00-2d7c44a9d2ec tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5" status: 200 len: 1264 microversion: 2.1 time: 1.717345 Jul 18 02:55:43.628557 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2662/5307] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:41 2022] GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 => generated 1264 bytes in 1767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:43.669151 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d10752fc-c357-4564-a46b-118c7d6fb32b tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:43.670685 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d10752fc-c357-4564-a46b-118c7d6fb32b tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: a8abc31e-bc67-4e33-b91b-39ec0dcb43b8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:43.715226 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d10752fc-c357-4564-a46b-118c7d6fb32b tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:43.715226 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d10752fc-c357-4564-a46b-118c7d6fb32b tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:43.715226 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d10752fc-c357-4564-a46b-118c7d6fb32b tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:43.717641 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d10752fc-c357-4564-a46b-118c7d6fb32b tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:43.795417 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e9524a6b-b38b-4431-bbab-d49c2f79237e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:43.817729 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e9524a6b-b38b-4431-bbab-d49c2f79237e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 0.952034 Jul 18 02:55:43.830034 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2646/5308] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:42 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:55:43.833684 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-d10752fc-c357-4564-a46b-118c7d6fb32b tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] HTTP exception thrown: Instance a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 could not be found. Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d10752fc-c357-4564-a46b-118c7d6fb32b tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Request method failure captured: Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 HTTP/1.1 Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1Mmzt2I9RlA6VEggBfRLShSXRaBuXjrVrPNlWO6AFdGcTHbVp2kQCiHz7Ex0iPFnQ6OMMIZinbDEVI1KOVeP4bskTlV5IxDPGX95DhpKc5DI9xePXSABpXDandv4aW8bK6yk3AXLmHawMw9CXg1Gm9JCYpdfA_nyr-OhgxOnBlhCDAk Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: e9acec37ba95432eb3ef9b5229167fe8 Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-AttachVolumeTestJSON-1393062758 Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e9acec37ba95432eb3ef9b5229167fe8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e9acec37ba95432eb3ef9b5229167fe8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e9acec37ba95432eb3ef9b5229167fe8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e9acec37ba95432eb3ef9b5229167fe8"}]}] Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-AttachVolumeTestJSON-1393062758 Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: e9acec37ba95432eb3ef9b5229167fe8 Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1393062758 Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-AttachVolumeTestJSON-1393062758-project Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: ba8ea645f5364b8497d3e439a2d85e54 Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-AttachVolumeTestJSON-1393062758-project Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 could not be found. Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'a8abc31e-bc67-4e33-b91b-39ec0dcb43b8'} Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 could not be found. Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:55:43.839324 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:55:43.847930 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 could not be found. Jul 18 02:55:43.847930 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:55:43.847930 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:55:43.847930 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:55:43.847930 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:55:43.847930 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:55:43.847930 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:55:43.847930 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:55:43.847930 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:55:43.847930 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 could not be found. Jul 18 02:55:43.847930 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:55:43.852934 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3cbbbc3d-13cd-417e-a058-bff83e9dc7a3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:43.855478 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3cbbbc3d-13cd-417e-a058-bff83e9dc7a3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:43.862406 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d10752fc-c357-4564-a46b-118c7d6fb32b tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Returning 404 to user: Instance a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:55:43.864591 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d10752fc-c357-4564-a46b-118c7d6fb32b tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8" status: 404 len: 111 microversion: 2.1 time: 0.228921 Jul 18 02:55:43.873415 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2663/5309] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:55:43 2022] DELETE /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 => generated 111 bytes in 244 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:55:43.876032 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:55:43.881752 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3cbbbc3d-13cd-417e-a058-bff83e9dc7a3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:43.882198 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3cbbbc3d-13cd-417e-a058-bff83e9dc7a3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:43.887241 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3cbbbc3d-13cd-417e-a058-bff83e9dc7a3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:43.894430 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3cbbbc3d-13cd-417e-a058-bff83e9dc7a3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:43.897665 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f991cf1c-01a3-4165-9a67-4ff5a0df8052 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:43.899269 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f991cf1c-01a3-4165-9a67-4ff5a0df8052 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: a8abc31e-bc67-4e33-b91b-39ec0dcb43b8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:43.927485 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f991cf1c-01a3-4165-9a67-4ff5a0df8052 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:43.928305 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f991cf1c-01a3-4165-9a67-4ff5a0df8052 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:43.929865 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f991cf1c-01a3-4165-9a67-4ff5a0df8052 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:43.930749 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f991cf1c-01a3-4165-9a67-4ff5a0df8052 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:43.973060 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-f991cf1c-01a3-4165-9a67-4ff5a0df8052 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] HTTP exception thrown: Instance a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 could not be found. Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f991cf1c-01a3-4165-9a67-4ff5a0df8052 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Request method failure captured: Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 HTTP/1.1 Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1Mmzt2I9RlA6VEggBfRLShSXRaBuXjrVrPNlWO6AFdGcTHbVp2kQCiHz7Ex0iPFnQ6OMMIZinbDEVI1KOVeP4bskTlV5IxDPGX95DhpKc5DI9xePXSABpXDandv4aW8bK6yk3AXLmHawMw9CXg1Gm9JCYpdfA_nyr-OhgxOnBlhCDAk Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: e9acec37ba95432eb3ef9b5229167fe8 Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-AttachVolumeTestJSON-1393062758 Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e9acec37ba95432eb3ef9b5229167fe8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e9acec37ba95432eb3ef9b5229167fe8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e9acec37ba95432eb3ef9b5229167fe8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e9acec37ba95432eb3ef9b5229167fe8"}]}] Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-AttachVolumeTestJSON-1393062758 Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: e9acec37ba95432eb3ef9b5229167fe8 Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1393062758 Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-AttachVolumeTestJSON-1393062758-project Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: ba8ea645f5364b8497d3e439a2d85e54 Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-AttachVolumeTestJSON-1393062758-project Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 could not be found. Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'a8abc31e-bc67-4e33-b91b-39ec0dcb43b8'} Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 could not be found. Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 could not be found. Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:55:43.980372 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:55:43.984789 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:55:43.984789 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:55:43.984789 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:55:43.984789 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:55:43.984789 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:55:43.984789 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 could not be found. Jul 18 02:55:43.984789 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:55:43.984789 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f991cf1c-01a3-4165-9a67-4ff5a0df8052 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Returning 404 to user: Instance a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:55:43.990812 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f991cf1c-01a3-4165-9a67-4ff5a0df8052 tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8" status: 404 len: 111 microversion: 2.1 time: 0.108864 Jul 18 02:55:43.993720 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2664/5310] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:43 2022] GET /compute/v2.1/servers/a8abc31e-bc67-4e33-b91b-39ec0dcb43b8 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:55:44.128465 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1c3fbbe4-3da8-4275-80ce-fe05bbb403b1 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1639077855-access_point-1178926503", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "a0348379-05a9-4524-880f-e9cc4e709ce1"}], "key_name": "tempest-TestSecurityGroupsBasicOps-247054353", "security_groups": [{"name": "tempest-secgroup_access--1726002559"}, {"name": "tempest-secgroup_general--220262333"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:55:45.819002 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-1c3fbbe4-3da8-4275-80ce-fe05bbb403b1 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] validate_networks() for [('a0348379-05a9-4524-880f-e9cc4e709ce1', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:55:45.873069 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3cbbbc3d-13cd-417e-a058-bff83e9dc7a3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:45.889472 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3cbbbc3d-13cd-417e-a058-bff83e9dc7a3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 2.038056 Jul 18 02:55:45.893762 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2647/5311] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:43 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 2046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:55:45.914821 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fb01772c-0ba6-4b60-84b8-a35603648635 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:45.921446 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fb01772c-0ba6-4b60-84b8-a35603648635 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:45.953110 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fb01772c-0ba6-4b60-84b8-a35603648635 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:45.956053 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fb01772c-0ba6-4b60-84b8-a35603648635 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:45.956926 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fb01772c-0ba6-4b60-84b8-a35603648635 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:45.957377 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fb01772c-0ba6-4b60-84b8-a35603648635 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:46.411326 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fb01772c-0ba6-4b60-84b8-a35603648635 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:46.428214 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fb01772c-0ba6-4b60-84b8-a35603648635 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5" status: 200 len: 1264 microversion: 2.1 time: 0.531248 Jul 18 02:55:46.428673 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2648/5312] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:45 2022] GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 => generated 1264 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:47.048505 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-1c3fbbe4-3da8-4275-80ce-fe05bbb403b1 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:55:47.049582 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-1c3fbbe4-3da8-4275-80ce-fe05bbb403b1 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:55:47.050655 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-1c3fbbe4-3da8-4275-80ce-fe05bbb403b1 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:55:47.051300 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-1c3fbbe4-3da8-4275-80ce-fe05bbb403b1 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:55:47.051900 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-1c3fbbe4-3da8-4275-80ce-fe05bbb403b1 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:55:47.074714 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c3fbbe4-3da8-4275-80ce-fe05bbb403b1 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:47.075233 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c3fbbe4-3da8-4275-80ce-fe05bbb403b1 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:47.077338 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c3fbbe4-3da8-4275-80ce-fe05bbb403b1 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:47.078410 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c3fbbe4-3da8-4275-80ce-fe05bbb403b1 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:47.122142 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-a15c6a98-c6ad-41c3-80ea-5e69d5af5e8c req-e9a0af1e-8f7a-4596-bd9b-70def6c446a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bd0b1cf-40d7-4603-8746-bd306afd94f5", "name": "network-vif-plugged", "status": "completed", "tag": "7ff729a9-545c-47d5-9ffe-dd57240bf5cb"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:55:47.140271 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-1c3fbbe4-3da8-4275-80ce-fe05bbb403b1 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Getting quotas for project 0f043fa9beaa4ac6b209d67346479c57. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:55:47.150878 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-1c3fbbe4-3da8-4275-80ce-fe05bbb403b1 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Getting quotas for user b6c7444bc0744533861c32353fa7f597 and project 0f043fa9beaa4ac6b209d67346479c57. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:55:47.156386 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-a15c6a98-c6ad-41c3-80ea-5e69d5af5e8c req-e9a0af1e-8f7a-4596-bd9b-70def6c446a6 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:47.158356 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-a15c6a98-c6ad-41c3-80ea-5e69d5af5e8c req-e9a0af1e-8f7a-4596-bd9b-70def6c446a6 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:47.182281 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1c3fbbe4-3da8-4275-80ce-fe05bbb403b1 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:55:47.184833 n-d-465891-3 devstack@n-api.service[119543]: WARNING nova.utils [None req-1c3fbbe4-3da8-4275-80ce-fe05bbb403b1 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1639077855-access_point-1178926503 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1639077855-ac Jul 18 02:55:47.189527 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1c3fbbe4-3da8-4275-80ce-fe05bbb403b1 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: 6f05fde6-142f-4459-b468-06efd59ff42f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:55:47.192845 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-a15c6a98-c6ad-41c3-80ea-5e69d5af5e8c req-e9a0af1e-8f7a-4596-bd9b-70def6c446a6 service nova] Creating event network-vif-plugged:7ff729a9-545c-47d5-9ffe-dd57240bf5cb for instance 6bd0b1cf-40d7-4603-8746-bd306afd94f5 on n-h1-465891-3 Jul 18 02:55:47.219256 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-a15c6a98-c6ad-41c3-80ea-5e69d5af5e8c req-e9a0af1e-8f7a-4596-bd9b-70def6c446a6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.779650 Jul 18 02:55:47.225265 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2649/5313] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:55:47.256453 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f506f582-ee36-4ede-a719-193923fcb3fb tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:47.258963 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f506f582-ee36-4ede-a719-193923fcb3fb tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:47.284893 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f506f582-ee36-4ede-a719-193923fcb3fb tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:47.286137 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f506f582-ee36-4ede-a719-193923fcb3fb tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:47.287926 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f506f582-ee36-4ede-a719-193923fcb3fb tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:47.289049 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f506f582-ee36-4ede-a719-193923fcb3fb tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:47.296229 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1c3fbbe4-3da8-4275-80ce-fe05bbb403b1 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 3.178571 Jul 18 02:55:47.306117 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2665/5314] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:55:44 2022] POST /compute/v2.1/servers => generated 457 bytes in 3189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 02:55:47.319769 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0c510b14-c534-42c6-8cbc-94474826a097 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:47.320851 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0c510b14-c534-42c6-8cbc-94474826a097 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: 6f05fde6-142f-4459-b468-06efd59ff42f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:48.287990 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0c510b14-c534-42c6-8cbc-94474826a097 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7444bc0744533861c32353fa7f597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f043fa9beaa4ac6b209d67346479c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:48.328894 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0c510b14-c534-42c6-8cbc-94474826a097 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f" status: 200 len: 1294 microversion: 2.1 time: 1.021057 Jul 18 02:55:48.331643 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2666/5315] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:47 2022] GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f => generated 1294 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:48.379342 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-357c68d2-c7ed-4c55-af01-45deec7f1eea tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:48.380643 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-357c68d2-c7ed-4c55-af01-45deec7f1eea tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:48.412208 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-357c68d2-c7ed-4c55-af01-45deec7f1eea tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:48.412969 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-357c68d2-c7ed-4c55-af01-45deec7f1eea tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:48.414389 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-357c68d2-c7ed-4c55-af01-45deec7f1eea tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:48.415163 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-357c68d2-c7ed-4c55-af01-45deec7f1eea tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:49.084945 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f506f582-ee36-4ede-a719-193923fcb3fb tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:49.099944 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f506f582-ee36-4ede-a719-193923fcb3fb tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 1.864302 Jul 18 02:55:49.102343 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2650/5316] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:47 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 1876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:49.133728 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-54acd34c-31cf-4d4c-a384-8594169749aa tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:55:49.134319 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-54acd34c-31cf-4d4c-a384-8594169749aa tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:49.163792 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54acd34c-31cf-4d4c-a384-8594169749aa tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:49.168576 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54acd34c-31cf-4d4c-a384-8594169749aa tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:49.174093 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54acd34c-31cf-4d4c-a384-8594169749aa tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:49.175767 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54acd34c-31cf-4d4c-a384-8594169749aa tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:49.325264 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-54acd34c-31cf-4d4c-a384-8594169749aa tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Locking {{(pid=119544) lock /opt/stack/nova/nova/compute/api.py:4700}} Jul 18 02:55:49.363401 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-357c68d2-c7ed-4c55-af01-45deec7f1eea tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:49.384679 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-357c68d2-c7ed-4c55-af01-45deec7f1eea tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5" status: 200 len: 1264 microversion: 2.1 time: 1.047060 Jul 18 02:55:49.396061 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2667/5317] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:48 2022] GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 => generated 1264 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:49.409588 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3d79668d-2a8c-4289-b08d-5a53393b0c87 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:49.413527 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3d79668d-2a8c-4289-b08d-5a53393b0c87 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: 6f05fde6-142f-4459-b468-06efd59ff42f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:49.416142 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:55:49.439359 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3d79668d-2a8c-4289-b08d-5a53393b0c87 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:49.440909 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3d79668d-2a8c-4289-b08d-5a53393b0c87 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:49.443547 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3d79668d-2a8c-4289-b08d-5a53393b0c87 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:49.444965 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3d79668d-2a8c-4289-b08d-5a53393b0c87 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:49.462388 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-54acd34c-31cf-4d4c-a384-8594169749aa tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "POST /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e/action" status: 202 len: 0 microversion: 2.1 time: 0.330283 Jul 18 02:55:49.469818 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2651/5318] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:55:49 2022] POST /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:55:49.478850 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1361a053-167f-446d-a94d-89bee97059b3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:49.483666 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1361a053-167f-446d-a94d-89bee97059b3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:49.507899 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1361a053-167f-446d-a94d-89bee97059b3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:49.508350 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1361a053-167f-446d-a94d-89bee97059b3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:49.509157 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1361a053-167f-446d-a94d-89bee97059b3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:49.516135 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1361a053-167f-446d-a94d-89bee97059b3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:49.628439 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:55:49.870579 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3d79668d-2a8c-4289-b08d-5a53393b0c87 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7444bc0744533861c32353fa7f597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f043fa9beaa4ac6b209d67346479c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:49.914898 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3d79668d-2a8c-4289-b08d-5a53393b0c87 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f" status: 200 len: 1298 microversion: 2.1 time: 0.512397 Jul 18 02:55:49.916530 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2668/5319] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:49 2022] GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f => generated 1298 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:49.992269 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1361a053-167f-446d-a94d-89bee97059b3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:50.018066 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1361a053-167f-446d-a94d-89bee97059b3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 0.545833 Jul 18 02:55:50.025691 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2652/5320] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:49 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:55:50.086380 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4482b72a-b42c-4f44-aa70-2934dfe416c5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:55:50.117299 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4482b72a-b42c-4f44-aa70-2934dfe416c5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:50.119648 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4482b72a-b42c-4f44-aa70-2934dfe416c5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:50.348128 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-4482b72a-b42c-4f44-aa70-2934dfe416c5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] HTTP exception thrown: Instance 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e is locked Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4482b72a-b42c-4f44-aa70-2934dfe416c5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Request method failure captured: Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e/action HTTP/1.1 Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 15 Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MpeZE7B7ggvWbQc2KiBuopHOJluqoroptHlmwrPNlRr2pt2Zu9Zwj_7Rf-ScE247-3qWDi_Gg8bo3Zzw0u3dgabI_jJCHXJML47lEbY3Hw73qGCrAE6a4fhUVxpzDxEDfhuI00pvfMbi7vIE86eHDCb3ZROxEb6oUuXthyU9kKumbk Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 2ed8b12429e9420bb83700e52701910b Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServerActionsTestJSON-125209500 Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2ed8b12429e9420bb83700e52701910b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2ed8b12429e9420bb83700e52701910b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2ed8b12429e9420bb83700e52701910b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2ed8b12429e9420bb83700e52701910b"}]}] Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServerActionsTestJSON-125209500 Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 2ed8b12429e9420bb83700e52701910b Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServerActionsTestJSON-125209500 Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServerActionsTestJSON-125209500-project Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 5436715af849460f87ff6b62dbd491a0 Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServerActionsTestJSON-125209500-project Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: {"os-stop": {}} Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e is locked Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '69bbb844-4d56-4e75-ae50-9c35c9ce6f9e', 'body': {'os-stop': {}}} Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e is locked Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e is locked Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e is locked Jul 18 02:55:50.358325 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:55:50.364765 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4482b72a-b42c-4f44-aa70-2934dfe416c5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Returning 409 to user: Instance 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e is locked {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:55:50.367883 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4482b72a-b42c-4f44-aa70-2934dfe416c5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "POST /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e/action" status: 409 len: 107 microversion: 2.1 time: 0.311467 Jul 18 02:55:50.378262 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2669/5321] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:55:50 2022] POST /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e/action => generated 107 bytes in 325 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:55:50.386542 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-aa8018b0-9847-4dd2-9746-fab76954928c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:55:50.391011 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-aa8018b0-9847-4dd2-9746-fab76954928c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:50.422538 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aa8018b0-9847-4dd2-9746-fab76954928c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:50.427677 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aa8018b0-9847-4dd2-9746-fab76954928c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:50.431097 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3f3ca4d1-049c-4398-99a6-46924a2be2f0 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:50.431819 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aa8018b0-9847-4dd2-9746-fab76954928c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:50.432881 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aa8018b0-9847-4dd2-9746-fab76954928c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:50.436059 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3f3ca4d1-049c-4398-99a6-46924a2be2f0 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:50.473487 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3f3ca4d1-049c-4398-99a6-46924a2be2f0 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:50.475767 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3f3ca4d1-049c-4398-99a6-46924a2be2f0 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:50.481530 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3f3ca4d1-049c-4398-99a6-46924a2be2f0 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:50.483051 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3f3ca4d1-049c-4398-99a6-46924a2be2f0 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:50.604245 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-aa8018b0-9847-4dd2-9746-fab76954928c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Unlocking {{(pid=119544) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 18 02:55:50.778577 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-aa8018b0-9847-4dd2-9746-fab76954928c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "POST /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e/action" status: 202 len: 0 microversion: 2.1 time: 0.399893 Jul 18 02:55:50.780345 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2653/5322] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:55:50 2022] POST /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e/action => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:55:50.811887 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-15d9bf8f-cb93-499c-a4fb-3bbbd6a61987 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:55:50.842432 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-15d9bf8f-cb93-499c-a4fb-3bbbd6a61987 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:50.843770 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-15d9bf8f-cb93-499c-a4fb-3bbbd6a61987 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:51.001508 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-15d9bf8f-cb93-499c-a4fb-3bbbd6a61987 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Going to try to stop instance {{(pid=119544) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 02:55:51.212425 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-15d9bf8f-cb93-499c-a4fb-3bbbd6a61987 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "POST /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e/action" status: 202 len: 0 microversion: 2.1 time: 0.423309 Jul 18 02:55:51.223479 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2654/5323] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:55:50 2022] POST /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e/action => generated 0 bytes in 437 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:55:51.249167 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-787d7bd6-37e7-445b-9927-fbc6b4b772bc tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:51.251618 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-787d7bd6-37e7-445b-9927-fbc6b4b772bc tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: 6f05fde6-142f-4459-b468-06efd59ff42f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:51.278116 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-787d7bd6-37e7-445b-9927-fbc6b4b772bc tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:51.291411 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-787d7bd6-37e7-445b-9927-fbc6b4b772bc tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:51.297501 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-787d7bd6-37e7-445b-9927-fbc6b4b772bc tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:51.298747 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-787d7bd6-37e7-445b-9927-fbc6b4b772bc tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:51.903305 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-787d7bd6-37e7-445b-9927-fbc6b4b772bc tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7444bc0744533861c32353fa7f597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f043fa9beaa4ac6b209d67346479c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:51.955068 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-787d7bd6-37e7-445b-9927-fbc6b4b772bc tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f" status: 200 len: 1364 microversion: 2.1 time: 0.725454 Jul 18 02:55:51.962075 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2655/5324] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:51 2022] GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f => generated 1364 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:52.009119 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-28b6128b-b53b-4386-85df-00dfa4052a62 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:52.012966 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-28b6128b-b53b-4386-85df-00dfa4052a62 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:52.045538 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-28b6128b-b53b-4386-85df-00dfa4052a62 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:52.047964 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-28b6128b-b53b-4386-85df-00dfa4052a62 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:52.049037 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-28b6128b-b53b-4386-85df-00dfa4052a62 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:52.051450 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-28b6128b-b53b-4386-85df-00dfa4052a62 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:52.116775 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3f3ca4d1-049c-4398-99a6-46924a2be2f0 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:52.133288 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3f3ca4d1-049c-4398-99a6-46924a2be2f0 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5" status: 200 len: 1264 microversion: 2.1 time: 1.710519 Jul 18 02:55:52.141943 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2670/5325] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:50 2022] GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 => generated 1264 bytes in 1720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:52.615360 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f685eba4-4013-4f13-9225-0d63ab51656c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:52.615976 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f685eba4-4013-4f13-9225-0d63ab51656c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:52.628787 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f685eba4-4013-4f13-9225-0d63ab51656c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:52.629262 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f685eba4-4013-4f13-9225-0d63ab51656c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:52.630143 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f685eba4-4013-4f13-9225-0d63ab51656c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:52.630606 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f685eba4-4013-4f13-9225-0d63ab51656c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:52.680642 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-f685eba4-4013-4f13-9225-0d63ab51656c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] HTTP exception thrown: Instance 7a7139b7-9d69-45b0-a6bf-470376bdb9c5 could not be found. Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f685eba4-4013-4f13-9225-0d63ab51656c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Request method failure captured: Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 HTTP/1.1 Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1Mmzt2I9RlA6VEggBfRLShSXRaBuXjrVrPNlWO6AFdGcTHbVp2kQCiHz7Ex0iPFnQ6OMMIZinbDEVI1KOVeP4bskTlV5IxDPGX95DhpKc5DI9xePXSABpXDandv4aW8bK6yk3AXLmHawMw9CXg1Gm9JCYpdfA_nyr-OhgxOnBlhCDAk Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: e9acec37ba95432eb3ef9b5229167fe8 Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-AttachVolumeTestJSON-1393062758 Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e9acec37ba95432eb3ef9b5229167fe8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e9acec37ba95432eb3ef9b5229167fe8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e9acec37ba95432eb3ef9b5229167fe8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e9acec37ba95432eb3ef9b5229167fe8"}]}] Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-AttachVolumeTestJSON-1393062758 Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: e9acec37ba95432eb3ef9b5229167fe8 Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1393062758 Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-AttachVolumeTestJSON-1393062758-project Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: ba8ea645f5364b8497d3e439a2d85e54 Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-AttachVolumeTestJSON-1393062758-project Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 7a7139b7-9d69-45b0-a6bf-470376bdb9c5 could not be found. Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '7a7139b7-9d69-45b0-a6bf-470376bdb9c5'} Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a7139b7-9d69-45b0-a6bf-470376bdb9c5 could not be found. Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:55:52.682254 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:55:52.686386 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a7139b7-9d69-45b0-a6bf-470376bdb9c5 could not be found. Jul 18 02:55:52.686386 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:55:52.686386 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:55:52.686386 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:55:52.686386 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:55:52.686386 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:55:52.686386 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:55:52.686386 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:55:52.686386 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:55:52.686386 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a7139b7-9d69-45b0-a6bf-470376bdb9c5 could not be found. Jul 18 02:55:52.686386 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:55:52.686386 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f685eba4-4013-4f13-9225-0d63ab51656c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Returning 404 to user: Instance 7a7139b7-9d69-45b0-a6bf-470376bdb9c5 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:55:52.698786 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f685eba4-4013-4f13-9225-0d63ab51656c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 404 len: 111 microversion: 2.1 time: 0.084197 Jul 18 02:55:52.703269 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2671/5326] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:55:52 2022] DELETE /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:55:52.713798 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3e90ca89-8549-46ae-836b-98752762e33c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:52.714678 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3e90ca89-8549-46ae-836b-98752762e33c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] [instance: 7a7139b7-9d69-45b0-a6bf-470376bdb9c5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:52.731032 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3e90ca89-8549-46ae-836b-98752762e33c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:52.731516 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3e90ca89-8549-46ae-836b-98752762e33c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:52.733998 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3e90ca89-8549-46ae-836b-98752762e33c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:52.734511 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3e90ca89-8549-46ae-836b-98752762e33c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:52.784478 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-3e90ca89-8549-46ae-836b-98752762e33c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] HTTP exception thrown: Instance 7a7139b7-9d69-45b0-a6bf-470376bdb9c5 could not be found. Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3e90ca89-8549-46ae-836b-98752762e33c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Request method failure captured: Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 HTTP/1.1 Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1Mmzt2I9RlA6VEggBfRLShSXRaBuXjrVrPNlWO6AFdGcTHbVp2kQCiHz7Ex0iPFnQ6OMMIZinbDEVI1KOVeP4bskTlV5IxDPGX95DhpKc5DI9xePXSABpXDandv4aW8bK6yk3AXLmHawMw9CXg1Gm9JCYpdfA_nyr-OhgxOnBlhCDAk Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: e9acec37ba95432eb3ef9b5229167fe8 Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-AttachVolumeTestJSON-1393062758 Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e9acec37ba95432eb3ef9b5229167fe8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e9acec37ba95432eb3ef9b5229167fe8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e9acec37ba95432eb3ef9b5229167fe8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e9acec37ba95432eb3ef9b5229167fe8"}]}] Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-AttachVolumeTestJSON-1393062758 Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: e9acec37ba95432eb3ef9b5229167fe8 Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1393062758 Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-AttachVolumeTestJSON-1393062758-project Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: ba8ea645f5364b8497d3e439a2d85e54 Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-AttachVolumeTestJSON-1393062758-project Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 7a7139b7-9d69-45b0-a6bf-470376bdb9c5 could not be found. Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '7a7139b7-9d69-45b0-a6bf-470376bdb9c5'} Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a7139b7-9d69-45b0-a6bf-470376bdb9c5 could not be found. Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a7139b7-9d69-45b0-a6bf-470376bdb9c5 could not be found. Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:55:52.786135 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:55:52.802897 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:55:52.802897 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:55:52.802897 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:55:52.802897 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:55:52.802897 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:55:52.802897 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a7139b7-9d69-45b0-a6bf-470376bdb9c5 could not be found. Jul 18 02:55:52.802897 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:55:52.802897 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3e90ca89-8549-46ae-836b-98752762e33c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] Returning 404 to user: Instance 7a7139b7-9d69-45b0-a6bf-470376bdb9c5 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:55:52.802897 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3e90ca89-8549-46ae-836b-98752762e33c tempest-AttachVolumeTestJSON-1393062758 tempest-AttachVolumeTestJSON-1393062758-project] 10.222.0.57 "GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5" status: 404 len: 111 microversion: 2.1 time: 0.081788 Jul 18 02:55:52.802897 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2672/5327] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:52 2022] GET /compute/v2.1/servers/7a7139b7-9d69-45b0-a6bf-470376bdb9c5 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:55:52.915039 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-28b6128b-b53b-4386-85df-00dfa4052a62 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:52.928804 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-28b6128b-b53b-4386-85df-00dfa4052a62 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1680 microversion: 2.1 time: 0.964263 Jul 18 02:55:52.932034 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2656/5328] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:51 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1680 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:52.978734 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2e3af503-e2dc-4fd3-ac8b-20e6e0fb8286 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:52.979718 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2e3af503-e2dc-4fd3-ac8b-20e6e0fb8286 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: 6f05fde6-142f-4459-b468-06efd59ff42f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:53.000164 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2e3af503-e2dc-4fd3-ac8b-20e6e0fb8286 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:53.000896 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2e3af503-e2dc-4fd3-ac8b-20e6e0fb8286 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:53.002410 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2e3af503-e2dc-4fd3-ac8b-20e6e0fb8286 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:53.002870 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2e3af503-e2dc-4fd3-ac8b-20e6e0fb8286 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:53.179048 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-15e7f637-d384-46fe-9629-6152c9dfd41f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:53.180744 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-15e7f637-d384-46fe-9629-6152c9dfd41f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:53.226555 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-15e7f637-d384-46fe-9629-6152c9dfd41f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:53.227976 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-15e7f637-d384-46fe-9629-6152c9dfd41f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:53.241266 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-15e7f637-d384-46fe-9629-6152c9dfd41f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:53.242575 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-15e7f637-d384-46fe-9629-6152c9dfd41f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:53.343678 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2e3af503-e2dc-4fd3-ac8b-20e6e0fb8286 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7444bc0744533861c32353fa7f597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f043fa9beaa4ac6b209d67346479c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:53.393518 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2e3af503-e2dc-4fd3-ac8b-20e6e0fb8286 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f" status: 200 len: 1352 microversion: 2.1 time: 0.418698 Jul 18 02:55:53.410696 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2673/5329] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:52 2022] GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f => generated 1352 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:53.968546 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5db5f7e7-4dd7-4d3e-91d5-80dcfdf50147 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:53.971225 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5db5f7e7-4dd7-4d3e-91d5-80dcfdf50147 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:54.014275 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5db5f7e7-4dd7-4d3e-91d5-80dcfdf50147 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:54.015437 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5db5f7e7-4dd7-4d3e-91d5-80dcfdf50147 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:54.017086 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5db5f7e7-4dd7-4d3e-91d5-80dcfdf50147 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:54.026073 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5db5f7e7-4dd7-4d3e-91d5-80dcfdf50147 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:55.744163 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-15e7f637-d384-46fe-9629-6152c9dfd41f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:55.756861 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-15e7f637-d384-46fe-9629-6152c9dfd41f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5" status: 200 len: 1451 microversion: 2.1 time: 2.589134 Jul 18 02:55:55.773050 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2657/5330] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:53 2022] GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 => generated 1451 bytes in 2594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:55.788601 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-54ce4fb8-b93a-49cf-8f32-c51d67c66c53 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:55.792228 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-54ce4fb8-b93a-49cf-8f32-c51d67c66c53 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: 6f05fde6-142f-4459-b468-06efd59ff42f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:55.819329 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54ce4fb8-b93a-49cf-8f32-c51d67c66c53 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:55.822275 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54ce4fb8-b93a-49cf-8f32-c51d67c66c53 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:55.828302 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54ce4fb8-b93a-49cf-8f32-c51d67c66c53 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:55.828953 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54ce4fb8-b93a-49cf-8f32-c51d67c66c53 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:56.083782 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5db5f7e7-4dd7-4d3e-91d5-80dcfdf50147 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:56.125544 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5db5f7e7-4dd7-4d3e-91d5-80dcfdf50147 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1680 microversion: 2.1 time: 2.163835 Jul 18 02:55:56.131734 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2674/5331] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:53 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1680 bytes in 2173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:55:56.140887 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-094f8042-b056-497e-98a5-7aa32f19ca9c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:56.159417 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-094f8042-b056-497e-98a5-7aa32f19ca9c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:56.184649 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-094f8042-b056-497e-98a5-7aa32f19ca9c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:56.186707 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-094f8042-b056-497e-98a5-7aa32f19ca9c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:56.188737 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-094f8042-b056-497e-98a5-7aa32f19ca9c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:56.190131 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-094f8042-b056-497e-98a5-7aa32f19ca9c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:56.376740 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-54ce4fb8-b93a-49cf-8f32-c51d67c66c53 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7444bc0744533861c32353fa7f597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f043fa9beaa4ac6b209d67346479c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:56.393949 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-54ce4fb8-b93a-49cf-8f32-c51d67c66c53 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f" status: 200 len: 1352 microversion: 2.1 time: 0.610349 Jul 18 02:55:56.397974 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2658/5332] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:55 2022] GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f => generated 1352 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:57.100516 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:55:57.157528 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f2cfc7ae-b479-41a7-9961-bf4c7927a33d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:57.159102 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f2cfc7ae-b479-41a7-9961-bf4c7927a33d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:57.172179 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f2cfc7ae-b479-41a7-9961-bf4c7927a33d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:57.176788 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f2cfc7ae-b479-41a7-9961-bf4c7927a33d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:57.177830 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f2cfc7ae-b479-41a7-9961-bf4c7927a33d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:57.178565 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f2cfc7ae-b479-41a7-9961-bf4c7927a33d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:58.277343 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-094f8042-b056-497e-98a5-7aa32f19ca9c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:58.301951 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:55:58.319382 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-094f8042-b056-497e-98a5-7aa32f19ca9c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5" status: 200 len: 1451 microversion: 2.1 time: 2.182614 Jul 18 02:55:58.344876 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2675/5333] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:56 2022] GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 => generated 1451 bytes in 2212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:58.357897 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9ed5a79e-efe6-4516-a2e8-8848d852c425 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:58.362911 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9ed5a79e-efe6-4516-a2e8-8848d852c425 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: 6f05fde6-142f-4459-b468-06efd59ff42f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:58.367342 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=8 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:55:58.435695 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9ed5a79e-efe6-4516-a2e8-8848d852c425 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:58.444208 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9ed5a79e-efe6-4516-a2e8-8848d852c425 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:58.447627 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9ed5a79e-efe6-4516-a2e8-8848d852c425 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:58.450399 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9ed5a79e-efe6-4516-a2e8-8848d852c425 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:58.678508 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f2cfc7ae-b479-41a7-9961-bf4c7927a33d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:58.694503 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f2cfc7ae-b479-41a7-9961-bf4c7927a33d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1680 microversion: 2.1 time: 1.540790 Jul 18 02:55:58.699590 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2659/5334] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:57 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1680 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:58.711142 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7e74fd9f-ba6e-405f-9de6-00a0047b9497 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1777411455", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "b1dca075-956e-4153-a2fd-44271f2011e9"}], "key_name": "tempest-TestNetworkAdvancedServerOps-807021230", "security_groups": [{"name": "tempest-secgroup-smoke-1376377424"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:56:00.034182 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-7e74fd9f-ba6e-405f-9de6-00a0047b9497 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] validate_networks() for [('b1dca075-956e-4153-a2fd-44271f2011e9', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:56:00.143070 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9ed5a79e-efe6-4516-a2e8-8848d852c425 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7444bc0744533861c32353fa7f597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f043fa9beaa4ac6b209d67346479c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:00.152729 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9ed5a79e-efe6-4516-a2e8-8848d852c425 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f" status: 200 len: 1471 microversion: 2.1 time: 1.803641 Jul 18 02:56:00.159255 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2676/5335] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:58 2022] GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f => generated 1471 bytes in 1814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:56:00.164826 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-655de787-4f27-49ab-9cd8-309f4abbfba5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:00.165490 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-655de787-4f27-49ab-9cd8-309f4abbfba5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:00.191150 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-655de787-4f27-49ab-9cd8-309f4abbfba5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:00.191531 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-655de787-4f27-49ab-9cd8-309f4abbfba5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:00.192414 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-655de787-4f27-49ab-9cd8-309f4abbfba5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:00.192886 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-655de787-4f27-49ab-9cd8-309f4abbfba5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:00.886614 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-655de787-4f27-49ab-9cd8-309f4abbfba5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:00.896719 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-655de787-4f27-49ab-9cd8-309f4abbfba5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1680 microversion: 2.1 time: 0.735917 Jul 18 02:56:00.907933 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2677/5336] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:00 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1680 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:56:01.180632 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-192f7975-4f59-4e55-8ec6-90fb20cc8f1e tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:01.183332 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-192f7975-4f59-4e55-8ec6-90fb20cc8f1e tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: 6f05fde6-142f-4459-b468-06efd59ff42f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:01.197501 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-192f7975-4f59-4e55-8ec6-90fb20cc8f1e tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:01.200571 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-192f7975-4f59-4e55-8ec6-90fb20cc8f1e tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:01.203986 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-192f7975-4f59-4e55-8ec6-90fb20cc8f1e tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:01.205321 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-192f7975-4f59-4e55-8ec6-90fb20cc8f1e tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:02.538409 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-192f7975-4f59-4e55-8ec6-90fb20cc8f1e tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7444bc0744533861c32353fa7f597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f043fa9beaa4ac6b209d67346479c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:02.571260 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-192f7975-4f59-4e55-8ec6-90fb20cc8f1e tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f" status: 200 len: 1471 microversion: 2.1 time: 1.396978 Jul 18 02:56:02.573102 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2678/5337] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:01 2022] GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f => generated 1471 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:56:02.597849 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8060e459-7c50-45c5-84ce-3541ec0b275a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:02.601327 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8060e459-7c50-45c5-84ce-3541ec0b275a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:02.638803 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8060e459-7c50-45c5-84ce-3541ec0b275a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:02.640270 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8060e459-7c50-45c5-84ce-3541ec0b275a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:02.642422 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8060e459-7c50-45c5-84ce-3541ec0b275a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:02.644035 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8060e459-7c50-45c5-84ce-3541ec0b275a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:03.305881 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-7e74fd9f-ba6e-405f-9de6-00a0047b9497 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:56:03.307996 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-7e74fd9f-ba6e-405f-9de6-00a0047b9497 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:56:03.309561 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-7e74fd9f-ba6e-405f-9de6-00a0047b9497 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:56:03.311227 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-7e74fd9f-ba6e-405f-9de6-00a0047b9497 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:56:03.312569 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-7e74fd9f-ba6e-405f-9de6-00a0047b9497 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:56:03.344026 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7e74fd9f-ba6e-405f-9de6-00a0047b9497 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:03.345366 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7e74fd9f-ba6e-405f-9de6-00a0047b9497 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:03.347940 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7e74fd9f-ba6e-405f-9de6-00a0047b9497 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:03.349792 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7e74fd9f-ba6e-405f-9de6-00a0047b9497 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:03.402757 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-7e74fd9f-ba6e-405f-9de6-00a0047b9497 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Getting quotas for project fa240dfd375a45efb42fc04807acf847. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:56:03.428636 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-7e74fd9f-ba6e-405f-9de6-00a0047b9497 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Getting quotas for user 381a2ab772ff495cb85b89a85a267cfe and project fa240dfd375a45efb42fc04807acf847. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:56:03.472004 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7e74fd9f-ba6e-405f-9de6-00a0047b9497 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:56:03.478567 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7e74fd9f-ba6e-405f-9de6-00a0047b9497 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:56:03.659089 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7e74fd9f-ba6e-405f-9de6-00a0047b9497 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 4.958226 Jul 18 02:56:03.666945 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2660/5338] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:55:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 4967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:56:03.673243 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-12869dd9-b42f-4f07-8a60-57f975655c2f req-465f22cb-d47f-4a2e-ba56-6b4b677f0ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f05fde6-142f-4459-b468-06efd59ff42f", "tag": "68e4dfb6-2aee-4e43-85cc-21ddd9a68f3d"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:56:03.689292 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-12869dd9-b42f-4f07-8a60-57f975655c2f req-465f22cb-d47f-4a2e-ba56-6b4b677f0ed9 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:03.689665 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-12869dd9-b42f-4f07-8a60-57f975655c2f req-465f22cb-d47f-4a2e-ba56-6b4b677f0ed9 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:03.712411 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-12869dd9-b42f-4f07-8a60-57f975655c2f req-465f22cb-d47f-4a2e-ba56-6b4b677f0ed9 service nova] Creating event network-changed:68e4dfb6-2aee-4e43-85cc-21ddd9a68f3d for instance 6f05fde6-142f-4459-b468-06efd59ff42f on n-h2-465891-3 Jul 18 02:56:03.720030 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-12869dd9-b42f-4f07-8a60-57f975655c2f req-465f22cb-d47f-4a2e-ba56-6b4b677f0ed9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051541 Jul 18 02:56:03.721242 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2661/5339] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:56:03.727587 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1ceb7010-e407-447f-84e1-68e82563cfa3 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:03.728492 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1ceb7010-e407-447f-84e1-68e82563cfa3 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: 6f05fde6-142f-4459-b468-06efd59ff42f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:03.737483 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ceb7010-e407-447f-84e1-68e82563cfa3 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:03.738277 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ceb7010-e407-447f-84e1-68e82563cfa3 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:03.739120 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ceb7010-e407-447f-84e1-68e82563cfa3 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:03.739569 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ceb7010-e407-447f-84e1-68e82563cfa3 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:04.525073 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8060e459-7c50-45c5-84ce-3541ec0b275a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:04.576650 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8060e459-7c50-45c5-84ce-3541ec0b275a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1657 microversion: 2.1 time: 1.996030 Jul 18 02:56:04.578116 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2679/5340] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:02 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1657 bytes in 2004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:56:04.595081 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3951f6e8-5eff-48cb-abdc-364cb24afde1 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:04.614598 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3951f6e8-5eff-48cb-abdc-364cb24afde1 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:05.095657 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3951f6e8-5eff-48cb-abdc-364cb24afde1 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:05.138098 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3951f6e8-5eff-48cb-abdc-364cb24afde1 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d" status: 200 len: 1266 microversion: 2.1 time: 0.557448 Jul 18 02:56:05.142584 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2680/5341] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:04 2022] GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d => generated 1266 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:56:05.168440 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3ce5e6fa-9502-47c4-bb1e-efd697c1a804 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:56:05.223998 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3ce5e6fa-9502-47c4-bb1e-efd697c1a804 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:05.224854 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3ce5e6fa-9502-47c4-bb1e-efd697c1a804 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:05.295043 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1ceb7010-e407-447f-84e1-68e82563cfa3 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7444bc0744533861c32353fa7f597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f043fa9beaa4ac6b209d67346479c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:05.309006 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1ceb7010-e407-447f-84e1-68e82563cfa3 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f" status: 200 len: 1471 microversion: 2.1 time: 1.586236 Jul 18 02:56:05.314072 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2662/5342] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:03 2022] GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f => generated 1471 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:56:05.337255 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3ce5e6fa-9502-47c4-bb1e-efd697c1a804 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Going to try to start instance {{(pid=119543) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 02:56:05.515573 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3ce5e6fa-9502-47c4-bb1e-efd697c1a804 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "POST /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e/action" status: 202 len: 0 microversion: 2.1 time: 0.367642 Jul 18 02:56:05.520447 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2681/5343] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:56:05 2022] POST /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e/action => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:56:05.529177 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-71c20a60-2ab5-4133-bc1c-8bebefa00384 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:05.530168 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-71c20a60-2ab5-4133-bc1c-8bebefa00384 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:05.550096 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-71c20a60-2ab5-4133-bc1c-8bebefa00384 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:05.553066 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-71c20a60-2ab5-4133-bc1c-8bebefa00384 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:05.555190 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-71c20a60-2ab5-4133-bc1c-8bebefa00384 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:05.558547 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-71c20a60-2ab5-4133-bc1c-8bebefa00384 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:06.169865 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c83e5490-ce12-42ca-ab26-f04b5b75c3f5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:06.178722 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c83e5490-ce12-42ca-ab26-f04b5b75c3f5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:06.222959 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c83e5490-ce12-42ca-ab26-f04b5b75c3f5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:06.229356 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c83e5490-ce12-42ca-ab26-f04b5b75c3f5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:06.239210 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c83e5490-ce12-42ca-ab26-f04b5b75c3f5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:06.239698 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c83e5490-ce12-42ca-ab26-f04b5b75c3f5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:06.712582 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c83e5490-ce12-42ca-ab26-f04b5b75c3f5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:06.736900 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c83e5490-ce12-42ca-ab26-f04b5b75c3f5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d" status: 200 len: 1318 microversion: 2.1 time: 0.578669 Jul 18 02:56:06.737523 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2682/5344] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:06 2022] GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d => generated 1318 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:56:06.750292 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-75d19bac-9703-4b0c-b92f-ec3726828f4f tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:06.750292 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-75d19bac-9703-4b0c-b92f-ec3726828f4f tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: 6f05fde6-142f-4459-b468-06efd59ff42f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:06.771823 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-75d19bac-9703-4b0c-b92f-ec3726828f4f tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:06.772306 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-75d19bac-9703-4b0c-b92f-ec3726828f4f tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:06.773153 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-75d19bac-9703-4b0c-b92f-ec3726828f4f tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:06.773622 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-75d19bac-9703-4b0c-b92f-ec3726828f4f tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:06.999739 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-71c20a60-2ab5-4133-bc1c-8bebefa00384 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:07.010841 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-71c20a60-2ab5-4133-bc1c-8bebefa00384 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1666 microversion: 2.1 time: 1.485792 Jul 18 02:56:07.026939 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2663/5345] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:05 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1666 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:56:07.189960 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-ad5948ad-fd3b-4ed3-bf9a-a422490d6627 req-32f8ee3b-9c62-4749-9fa6-d516d046266b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bd0b1cf-40d7-4603-8746-bd306afd94f5", "tag": "7ff729a9-545c-47d5-9ffe-dd57240bf5cb"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:56:07.207418 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-ad5948ad-fd3b-4ed3-bf9a-a422490d6627 req-32f8ee3b-9c62-4749-9fa6-d516d046266b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:07.208190 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-ad5948ad-fd3b-4ed3-bf9a-a422490d6627 req-32f8ee3b-9c62-4749-9fa6-d516d046266b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:07.230950 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-ad5948ad-fd3b-4ed3-bf9a-a422490d6627 req-32f8ee3b-9c62-4749-9fa6-d516d046266b service nova] Creating event network-changed:7ff729a9-545c-47d5-9ffe-dd57240bf5cb for instance 6bd0b1cf-40d7-4603-8746-bd306afd94f5 on n-h1-465891-3 Jul 18 02:56:07.249875 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-ad5948ad-fd3b-4ed3-bf9a-a422490d6627 req-32f8ee3b-9c62-4749-9fa6-d516d046266b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065165 Jul 18 02:56:07.251180 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2664/5346] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:56:07.766791 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9565da09-042b-4858-bc68-7cd7bc100778 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:07.767538 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9565da09-042b-4858-bc68-7cd7bc100778 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:07.783720 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9565da09-042b-4858-bc68-7cd7bc100778 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:07.784184 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9565da09-042b-4858-bc68-7cd7bc100778 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:07.785024 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9565da09-042b-4858-bc68-7cd7bc100778 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:07.806212 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9565da09-042b-4858-bc68-7cd7bc100778 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:08.142016 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9565da09-042b-4858-bc68-7cd7bc100778 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:08.162555 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9565da09-042b-4858-bc68-7cd7bc100778 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d" status: 200 len: 1324 microversion: 2.1 time: 0.401322 Jul 18 02:56:08.165331 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2665/5347] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:07 2022] GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d => generated 1324 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:56:08.179383 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-de954ef3-15b1-49b8-9b4f-4cbd91f86f9e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:08.180723 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-de954ef3-15b1-49b8-9b4f-4cbd91f86f9e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:08.192919 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-de954ef3-15b1-49b8-9b4f-4cbd91f86f9e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:08.193742 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-de954ef3-15b1-49b8-9b4f-4cbd91f86f9e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:08.202405 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-de954ef3-15b1-49b8-9b4f-4cbd91f86f9e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:08.203058 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-de954ef3-15b1-49b8-9b4f-4cbd91f86f9e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:08.934259 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-de954ef3-15b1-49b8-9b4f-4cbd91f86f9e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:08.983556 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-de954ef3-15b1-49b8-9b4f-4cbd91f86f9e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1666 microversion: 2.1 time: 0.816579 Jul 18 02:56:08.984858 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2666/5348] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:08 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1666 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:56:09.116711 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-75d19bac-9703-4b0c-b92f-ec3726828f4f tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7444bc0744533861c32353fa7f597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f043fa9beaa4ac6b209d67346479c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:09.140389 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-75d19bac-9703-4b0c-b92f-ec3726828f4f tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f" status: 200 len: 1471 microversion: 2.1 time: 2.397453 Jul 18 02:56:09.141962 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2683/5349] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:06 2022] GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f => generated 1471 bytes in 2404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:56:09.186778 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a4b169a4-8a09-45e2-bf52-a49e25a98bc4 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:09.188039 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a4b169a4-8a09-45e2-bf52-a49e25a98bc4 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:09.208963 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a4b169a4-8a09-45e2-bf52-a49e25a98bc4 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:09.210049 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a4b169a4-8a09-45e2-bf52-a49e25a98bc4 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:09.211446 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a4b169a4-8a09-45e2-bf52-a49e25a98bc4 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:09.212365 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a4b169a4-8a09-45e2-bf52-a49e25a98bc4 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:09.244902 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:56:09.520290 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a4b169a4-8a09-45e2-bf52-a49e25a98bc4 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:09.555406 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a4b169a4-8a09-45e2-bf52-a49e25a98bc4 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d" status: 200 len: 1324 microversion: 2.1 time: 0.374564 Jul 18 02:56:09.557124 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2667/5350] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:09 2022] GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d => generated 1324 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:56:10.005123 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-35c22e19-4496-4d9b-bcc6-08caf9d906ef tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:10.005906 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-35c22e19-4496-4d9b-bcc6-08caf9d906ef tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:10.024585 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-35c22e19-4496-4d9b-bcc6-08caf9d906ef tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:10.027967 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-35c22e19-4496-4d9b-bcc6-08caf9d906ef tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:10.032086 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-35c22e19-4496-4d9b-bcc6-08caf9d906ef tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:10.033054 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-35c22e19-4496-4d9b-bcc6-08caf9d906ef tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:10.166048 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8d69dcbb-a07b-4ea2-9f35-1a49a918733d tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:10.166752 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8d69dcbb-a07b-4ea2-9f35-1a49a918733d tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: 6f05fde6-142f-4459-b468-06efd59ff42f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:10.179886 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8d69dcbb-a07b-4ea2-9f35-1a49a918733d tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:10.182222 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8d69dcbb-a07b-4ea2-9f35-1a49a918733d tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:10.188488 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8d69dcbb-a07b-4ea2-9f35-1a49a918733d tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:10.188488 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8d69dcbb-a07b-4ea2-9f35-1a49a918733d tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:11.404058 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-35c22e19-4496-4d9b-bcc6-08caf9d906ef tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:11.421084 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-35c22e19-4496-4d9b-bcc6-08caf9d906ef tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1666 microversion: 2.1 time: 1.420544 Jul 18 02:56:11.431722 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2684/5351] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:09 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1666 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:56:11.440888 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8bf65641-62db-42d4-9ec2-dd041aa91f53 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:11.441925 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8bf65641-62db-42d4-9ec2-dd041aa91f53 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:11.451990 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8bf65641-62db-42d4-9ec2-dd041aa91f53 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:11.452938 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8bf65641-62db-42d4-9ec2-dd041aa91f53 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:11.454468 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8bf65641-62db-42d4-9ec2-dd041aa91f53 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:11.455130 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8bf65641-62db-42d4-9ec2-dd041aa91f53 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:11.600613 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8d69dcbb-a07b-4ea2-9f35-1a49a918733d tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7444bc0744533861c32353fa7f597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f043fa9beaa4ac6b209d67346479c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:11.619406 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8d69dcbb-a07b-4ea2-9f35-1a49a918733d tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f" status: 200 len: 1471 microversion: 2.1 time: 1.456762 Jul 18 02:56:11.621142 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2668/5352] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:10 2022] GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f => generated 1471 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:56:11.788162 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8bf65641-62db-42d4-9ec2-dd041aa91f53 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:11.816776 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8bf65641-62db-42d4-9ec2-dd041aa91f53 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d" status: 200 len: 1324 microversion: 2.1 time: 0.382378 Jul 18 02:56:11.829897 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2685/5353] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:11 2022] GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d => generated 1324 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:56:12.446570 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-849c0572-1a62-4fd1-96c6-b8137e5736bd tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:12.451035 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-849c0572-1a62-4fd1-96c6-b8137e5736bd tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:12.476398 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-849c0572-1a62-4fd1-96c6-b8137e5736bd tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:12.478868 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-849c0572-1a62-4fd1-96c6-b8137e5736bd tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:12.480687 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-849c0572-1a62-4fd1-96c6-b8137e5736bd tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:12.481620 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-849c0572-1a62-4fd1-96c6-b8137e5736bd tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:12.652747 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-19289db2-ba40-4c21-9d89-900a96e48cdc tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:12.660865 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-19289db2-ba40-4c21-9d89-900a96e48cdc tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: 6f05fde6-142f-4459-b468-06efd59ff42f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:12.712227 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-19289db2-ba40-4c21-9d89-900a96e48cdc tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:12.713273 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-19289db2-ba40-4c21-9d89-900a96e48cdc tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:12.724275 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-19289db2-ba40-4c21-9d89-900a96e48cdc tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:12.725085 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-19289db2-ba40-4c21-9d89-900a96e48cdc tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:13.378067 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:56:13.456324 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:56:13.476261 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-849c0572-1a62-4fd1-96c6-b8137e5736bd tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:13.498018 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-849c0572-1a62-4fd1-96c6-b8137e5736bd tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1666 microversion: 2.1 time: 1.059983 Jul 18 02:56:13.501756 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2669/5354] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:12 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1666 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:56:13.505468 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6ec15aaa-f0ff-480e-8baf-c7b667e6a657 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:13.506483 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6ec15aaa-f0ff-480e-8baf-c7b667e6a657 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:13.517556 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6ec15aaa-f0ff-480e-8baf-c7b667e6a657 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:13.518355 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6ec15aaa-f0ff-480e-8baf-c7b667e6a657 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:13.520556 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6ec15aaa-f0ff-480e-8baf-c7b667e6a657 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:13.521000 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6ec15aaa-f0ff-480e-8baf-c7b667e6a657 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:13.593402 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-19289db2-ba40-4c21-9d89-900a96e48cdc tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7444bc0744533861c32353fa7f597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f043fa9beaa4ac6b209d67346479c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:13.629620 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-19289db2-ba40-4c21-9d89-900a96e48cdc tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f" status: 200 len: 1471 microversion: 2.1 time: 0.988443 Jul 18 02:56:13.635044 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2686/5355] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:12 2022] GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f => generated 1471 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:56:14.519988 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-72da468b-75d5-46ef-b052-ad941c21dbf6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:14.521008 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-72da468b-75d5-46ef-b052-ad941c21dbf6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:14.549431 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-72da468b-75d5-46ef-b052-ad941c21dbf6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:14.550116 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-72da468b-75d5-46ef-b052-ad941c21dbf6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:14.566787 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-72da468b-75d5-46ef-b052-ad941c21dbf6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:14.567864 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-72da468b-75d5-46ef-b052-ad941c21dbf6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:14.657735 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6ec15aaa-f0ff-480e-8baf-c7b667e6a657 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:14.686209 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6ec15aaa-f0ff-480e-8baf-c7b667e6a657 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d" status: 200 len: 1392 microversion: 2.1 time: 1.184727 Jul 18 02:56:14.687308 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2670/5356] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:13 2022] GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d => generated 1392 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:56:14.711290 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1915a118-fbca-4f0b-a3aa-fffb30a731d3 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:14.717418 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1915a118-fbca-4f0b-a3aa-fffb30a731d3 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: 6f05fde6-142f-4459-b468-06efd59ff42f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:14.729152 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:56:14.734111 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1915a118-fbca-4f0b-a3aa-fffb30a731d3 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:14.735534 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1915a118-fbca-4f0b-a3aa-fffb30a731d3 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:14.737296 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1915a118-fbca-4f0b-a3aa-fffb30a731d3 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:14.738635 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1915a118-fbca-4f0b-a3aa-fffb30a731d3 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:15.111111 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:56:15.456802 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-72da468b-75d5-46ef-b052-ad941c21dbf6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:15.475156 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-72da468b-75d5-46ef-b052-ad941c21dbf6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 0.962557 Jul 18 02:56:15.476175 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2687/5357] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:14 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:56:15.492824 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-f63d3505-fe83-4c99-adb4-1c78b110cd16 req-bff46bc2-167f-4911-9362-b6dea6a32a84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f05fde6-142f-4459-b468-06efd59ff42f", "name": "network-vif-plugged", "status": "completed", "tag": "68e4dfb6-2aee-4e43-85cc-21ddd9a68f3d"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:56:15.530123 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-f63d3505-fe83-4c99-adb4-1c78b110cd16 req-bff46bc2-167f-4911-9362-b6dea6a32a84 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:15.532210 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-f63d3505-fe83-4c99-adb4-1c78b110cd16 req-bff46bc2-167f-4911-9362-b6dea6a32a84 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:15.572357 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-f63d3505-fe83-4c99-adb4-1c78b110cd16 req-bff46bc2-167f-4911-9362-b6dea6a32a84 service nova] Creating event network-vif-plugged:68e4dfb6-2aee-4e43-85cc-21ddd9a68f3d for instance 6f05fde6-142f-4459-b468-06efd59ff42f on n-h2-465891-3 Jul 18 02:56:15.593334 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-f63d3505-fe83-4c99-adb4-1c78b110cd16 req-bff46bc2-167f-4911-9362-b6dea6a32a84 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112627 Jul 18 02:56:15.594300 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2688/5358] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:56:15.603350 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-129df7c2-c8f2-4dba-9340-6c668098d593 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:15.604220 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-129df7c2-c8f2-4dba-9340-6c668098d593 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:15.618060 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-129df7c2-c8f2-4dba-9340-6c668098d593 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:15.619574 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-129df7c2-c8f2-4dba-9340-6c668098d593 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:15.622944 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-129df7c2-c8f2-4dba-9340-6c668098d593 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:15.624288 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-129df7c2-c8f2-4dba-9340-6c668098d593 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:16.133183 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1915a118-fbca-4f0b-a3aa-fffb30a731d3 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7444bc0744533861c32353fa7f597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f043fa9beaa4ac6b209d67346479c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:16.147130 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1915a118-fbca-4f0b-a3aa-fffb30a731d3 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f" status: 200 len: 1471 microversion: 2.1 time: 1.445027 Jul 18 02:56:16.148355 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2671/5359] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:14 2022] GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f => generated 1471 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:56:16.154461 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-267ff7eb-1bcc-4fb3-b3db-944358202456 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:16.155458 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-267ff7eb-1bcc-4fb3-b3db-944358202456 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:16.163695 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-267ff7eb-1bcc-4fb3-b3db-944358202456 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:16.164739 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-267ff7eb-1bcc-4fb3-b3db-944358202456 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:16.167746 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-267ff7eb-1bcc-4fb3-b3db-944358202456 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:16.169675 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-267ff7eb-1bcc-4fb3-b3db-944358202456 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:16.643867 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-129df7c2-c8f2-4dba-9340-6c668098d593 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:16.658776 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-129df7c2-c8f2-4dba-9340-6c668098d593 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 1.061186 Jul 18 02:56:16.659467 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2689/5360] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:15 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:56:16.691303 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bae11ee9-8acc-4c09-a995-b41d44db9d93 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:56:16.694219 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bae11ee9-8acc-4c09-a995-b41d44db9d93 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:16.707273 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bae11ee9-8acc-4c09-a995-b41d44db9d93 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:16.708053 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bae11ee9-8acc-4c09-a995-b41d44db9d93 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:16.709201 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bae11ee9-8acc-4c09-a995-b41d44db9d93 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:16.709897 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bae11ee9-8acc-4c09-a995-b41d44db9d93 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:16.777423 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bae11ee9-8acc-4c09-a995-b41d44db9d93 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Unlocking {{(pid=119543) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 18 02:56:16.840384 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:56:16.854657 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bae11ee9-8acc-4c09-a995-b41d44db9d93 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "POST /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e/action" status: 202 len: 0 microversion: 2.1 time: 0.179018 Jul 18 02:56:16.855811 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2690/5361] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:56:16 2022] POST /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:56:16.872915 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2600c2ec-a185-48d7-9243-dd2bbf334ea5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:16.874183 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2600c2ec-a185-48d7-9243-dd2bbf334ea5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:16.881140 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2600c2ec-a185-48d7-9243-dd2bbf334ea5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:16.881653 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2600c2ec-a185-48d7-9243-dd2bbf334ea5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:16.882469 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2600c2ec-a185-48d7-9243-dd2bbf334ea5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:16.882924 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2600c2ec-a185-48d7-9243-dd2bbf334ea5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:16.978598 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-267ff7eb-1bcc-4fb3-b3db-944358202456 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:17.006848 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-267ff7eb-1bcc-4fb3-b3db-944358202456 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d" status: 200 len: 1392 microversion: 2.1 time: 0.856329 Jul 18 02:56:17.008256 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2672/5362] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:16 2022] GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d => generated 1392 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:56:17.172856 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9341f1c2-9952-4f58-b64f-c214b6fd61e3 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:17.175341 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9341f1c2-9952-4f58-b64f-c214b6fd61e3 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: 6f05fde6-142f-4459-b468-06efd59ff42f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:17.187737 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9341f1c2-9952-4f58-b64f-c214b6fd61e3 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:17.188896 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9341f1c2-9952-4f58-b64f-c214b6fd61e3 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:17.190665 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9341f1c2-9952-4f58-b64f-c214b6fd61e3 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:17.191468 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9341f1c2-9952-4f58-b64f-c214b6fd61e3 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:17.516535 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2600c2ec-a185-48d7-9243-dd2bbf334ea5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:17.540857 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2600c2ec-a185-48d7-9243-dd2bbf334ea5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 0.673729 Jul 18 02:56:17.543077 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2691/5363] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:16 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:56:17.914988 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9341f1c2-9952-4f58-b64f-c214b6fd61e3 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7444bc0744533861c32353fa7f597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f043fa9beaa4ac6b209d67346479c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:17.931305 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9341f1c2-9952-4f58-b64f-c214b6fd61e3 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f" status: 200 len: 1471 microversion: 2.1 time: 0.766740 Jul 18 02:56:17.932397 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2673/5364] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:17 2022] GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f => generated 1471 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:56:17.952803 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4c234e5f-863f-451b-b7f1-316bd15c0805 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:17.953859 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4c234e5f-863f-451b-b7f1-316bd15c0805 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:17.975255 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4c234e5f-863f-451b-b7f1-316bd15c0805 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:17.977435 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4c234e5f-863f-451b-b7f1-316bd15c0805 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:17.978652 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4c234e5f-863f-451b-b7f1-316bd15c0805 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:17.987733 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4c234e5f-863f-451b-b7f1-316bd15c0805 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:18.142574 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-50a0a657-dc62-48c5-ad5c-a79684e17695 tempest-VolumesGetTestJSON-1592132989 tempest-VolumesGetTestJSON-1592132989-project] Action: 'create', calling method: .version_select at 0x7ff4a8b3b700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-36294221", "metadata": {"Type": "work"}}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:56:18.722879 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4c234e5f-863f-451b-b7f1-316bd15c0805 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:18.751230 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4c234e5f-863f-451b-b7f1-316bd15c0805 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 0.811469 Jul 18 02:56:18.752600 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2674/5365] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:17 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:56:18.774410 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-01db1467-7b6c-46eb-be30-1337231e2801 req-052e05ac-183d-46d3-abe1-f11708b9bb8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fed1346a-e87d-4555-bb7b-7eb3612c010d", "tag": "99659616-8ddc-428e-98c5-bd637a4e96cb"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:56:18.858306 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-01db1467-7b6c-46eb-be30-1337231e2801 req-052e05ac-183d-46d3-abe1-f11708b9bb8c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:18.861619 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-01db1467-7b6c-46eb-be30-1337231e2801 req-052e05ac-183d-46d3-abe1-f11708b9bb8c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:18.896134 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-50a0a657-dc62-48c5-ad5c-a79684e17695 tempest-VolumesGetTestJSON-1592132989 tempest-VolumesGetTestJSON-1592132989-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 1.349562 Jul 18 02:56:18.898731 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2692/5366] 10.222.0.57 () {60 vars in 1155 bytes} [Mon Jul 18 02:56:17 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 1353 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 18 02:56:18.908632 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e4ab8be1-b9fb-4eb2-af55-549b55b47f5e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:18.909898 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e4ab8be1-b9fb-4eb2-af55-549b55b47f5e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:18.935160 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-01db1467-7b6c-46eb-be30-1337231e2801 req-052e05ac-183d-46d3-abe1-f11708b9bb8c service nova] Creating event network-changed:99659616-8ddc-428e-98c5-bd637a4e96cb for instance fed1346a-e87d-4555-bb7b-7eb3612c010d on n-h2-465891-3 Jul 18 02:56:18.942037 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e4ab8be1-b9fb-4eb2-af55-549b55b47f5e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:18.943338 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e4ab8be1-b9fb-4eb2-af55-549b55b47f5e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:18.944564 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e4ab8be1-b9fb-4eb2-af55-549b55b47f5e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:18.945348 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e4ab8be1-b9fb-4eb2-af55-549b55b47f5e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:18.972649 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-01db1467-7b6c-46eb-be30-1337231e2801 req-052e05ac-183d-46d3-abe1-f11708b9bb8c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.217946 Jul 18 02:56:18.974779 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2675/5367] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:56:18.998850 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-aad20ec4-0ff4-42ac-9a61-3bb18fa3953e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:19.000545 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-aad20ec4-0ff4-42ac-9a61-3bb18fa3953e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:19.033390 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aad20ec4-0ff4-42ac-9a61-3bb18fa3953e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:19.033956 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aad20ec4-0ff4-42ac-9a61-3bb18fa3953e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:19.034823 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aad20ec4-0ff4-42ac-9a61-3bb18fa3953e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:19.035288 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aad20ec4-0ff4-42ac-9a61-3bb18fa3953e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:19.933373 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e4ab8be1-b9fb-4eb2-af55-549b55b47f5e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:19.946728 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e4ab8be1-b9fb-4eb2-af55-549b55b47f5e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d" status: 200 len: 1392 microversion: 2.1 time: 1.046373 Jul 18 02:56:19.956274 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2693/5368] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:18 2022] GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d => generated 1392 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:56:19.967379 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9eacd70b-2022-4a9e-aba4-f7179913d560 tempest-VolumesGetTestJSON-1592132989 tempest-VolumesGetTestJSON-1592132989-project] Calling method '.version_select at 0x7ff4a8971550>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:20.031098 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-aad20ec4-0ff4-42ac-9a61-3bb18fa3953e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:20.078391 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-aad20ec4-0ff4-42ac-9a61-3bb18fa3953e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 1.100888 Jul 18 02:56:20.080891 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2676/5369] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:18 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:56:20.108765 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-add4fc3f-d2a8-4164-9452-4ed0fbddaa31 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:20.117990 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-add4fc3f-d2a8-4164-9452-4ed0fbddaa31 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: 6f05fde6-142f-4459-b468-06efd59ff42f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:20.128042 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-add4fc3f-d2a8-4164-9452-4ed0fbddaa31 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:20.128902 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-add4fc3f-d2a8-4164-9452-4ed0fbddaa31 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:20.130160 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-add4fc3f-d2a8-4164-9452-4ed0fbddaa31 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:20.130771 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-add4fc3f-d2a8-4164-9452-4ed0fbddaa31 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:20.146958 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9eacd70b-2022-4a9e-aba4-f7179913d560 tempest-VolumesGetTestJSON-1592132989 tempest-VolumesGetTestJSON-1592132989-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/229b1b68-3bb7-4f69-bec3-d51b53709c42" status: 200 len: 351 microversion: 2.1 time: 0.189476 Jul 18 02:56:20.147777 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2694/5370] 10.222.0.57 () {58 vars in 1244 bytes} [Mon Jul 18 02:56:19 2022] GET /compute/v2.1/os-volumes/229b1b68-3bb7-4f69-bec3-d51b53709c42 => generated 351 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:56:20.154806 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f875bc86-a565-4c01-b672-50165f71e27b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:56:20.155665 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f875bc86-a565-4c01-b672-50165f71e27b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:20.160418 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=52 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:56:20.181361 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f875bc86-a565-4c01-b672-50165f71e27b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:20.183608 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f875bc86-a565-4c01-b672-50165f71e27b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:20.185523 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f875bc86-a565-4c01-b672-50165f71e27b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:20.188620 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f875bc86-a565-4c01-b672-50165f71e27b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:20.313452 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f875bc86-a565-4c01-b672-50165f71e27b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "POST /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e/action" status: 202 len: 0 microversion: 2.1 time: 0.162879 Jul 18 02:56:20.320854 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2695/5371] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:56:20 2022] POST /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:56:20.330145 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-657cdebe-aa67-4982-a5ae-fb201b191de7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:20.331763 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-657cdebe-aa67-4982-a5ae-fb201b191de7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:20.339806 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-657cdebe-aa67-4982-a5ae-fb201b191de7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:20.340710 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-657cdebe-aa67-4982-a5ae-fb201b191de7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:20.341855 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-657cdebe-aa67-4982-a5ae-fb201b191de7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:20.342554 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-657cdebe-aa67-4982-a5ae-fb201b191de7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:21.003167 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-add4fc3f-d2a8-4164-9452-4ed0fbddaa31 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7444bc0744533861c32353fa7f597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f043fa9beaa4ac6b209d67346479c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:21.026990 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-add4fc3f-d2a8-4164-9452-4ed0fbddaa31 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f" status: 200 len: 1643 microversion: 2.1 time: 0.939647 Jul 18 02:56:21.030148 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2677/5372] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:20 2022] GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f => generated 1643 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:56:21.081077 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d9da305b-2431-4694-8ddc-7a67a55e091b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:21.088153 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d9da305b-2431-4694-8ddc-7a67a55e091b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:21.121372 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d9da305b-2431-4694-8ddc-7a67a55e091b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:21.121982 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d9da305b-2431-4694-8ddc-7a67a55e091b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:21.126664 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d9da305b-2431-4694-8ddc-7a67a55e091b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:21.127160 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d9da305b-2431-4694-8ddc-7a67a55e091b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:22.156283 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-657cdebe-aa67-4982-a5ae-fb201b191de7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:22.173983 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-657cdebe-aa67-4982-a5ae-fb201b191de7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1675 microversion: 2.1 time: 1.850422 Jul 18 02:56:22.174700 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2696/5373] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:20 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1675 bytes in 1853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:56:22.191011 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0fd2c95e-85f7-4848-9767-fd5a53c643e0 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:22.192401 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0fd2c95e-85f7-4848-9767-fd5a53c643e0 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: 6f05fde6-142f-4459-b468-06efd59ff42f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:22.206076 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0fd2c95e-85f7-4848-9767-fd5a53c643e0 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:22.206555 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0fd2c95e-85f7-4848-9767-fd5a53c643e0 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:22.207614 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0fd2c95e-85f7-4848-9767-fd5a53c643e0 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:22.208077 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0fd2c95e-85f7-4848-9767-fd5a53c643e0 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:23.361483 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d9da305b-2431-4694-8ddc-7a67a55e091b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:23.377042 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d9da305b-2431-4694-8ddc-7a67a55e091b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d" status: 200 len: 1392 microversion: 2.1 time: 2.325087 Jul 18 02:56:23.378040 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2678/5374] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:21 2022] GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d => generated 1392 bytes in 2344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:56:23.396636 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e3e2880f-b4c1-4db2-b802-0451f05177b8 tempest-VolumesGetTestJSON-1592132989 tempest-VolumesGetTestJSON-1592132989-project] Calling method '.version_select at 0x7ff49bdb4b80>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:23.566542 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e3e2880f-b4c1-4db2-b802-0451f05177b8 tempest-VolumesGetTestJSON-1592132989 tempest-VolumesGetTestJSON-1592132989-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/229b1b68-3bb7-4f69-bec3-d51b53709c42" status: 200 len: 352 microversion: 2.1 time: 0.185087 Jul 18 02:56:23.568110 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2679/5375] 10.222.0.57 () {58 vars in 1244 bytes} [Mon Jul 18 02:56:23 2022] GET /compute/v2.1/os-volumes/229b1b68-3bb7-4f69-bec3-d51b53709c42 => generated 352 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:56:23.593679 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-91ee8158-04f1-44b1-b5e9-0d234510e2f3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:23.599064 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-91ee8158-04f1-44b1-b5e9-0d234510e2f3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:23.626438 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0fd2c95e-85f7-4848-9767-fd5a53c643e0 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7444bc0744533861c32353fa7f597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f043fa9beaa4ac6b209d67346479c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:23.659958 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91ee8158-04f1-44b1-b5e9-0d234510e2f3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:23.663250 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91ee8158-04f1-44b1-b5e9-0d234510e2f3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:23.666650 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0fd2c95e-85f7-4848-9767-fd5a53c643e0 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f" status: 200 len: 1643 microversion: 2.1 time: 1.489480 Jul 18 02:56:23.668116 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91ee8158-04f1-44b1-b5e9-0d234510e2f3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:23.671969 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2697/5376] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:22 2022] GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f => generated 1643 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:56:23.673945 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91ee8158-04f1-44b1-b5e9-0d234510e2f3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:23.696093 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-51d745ad-4111-4f5b-ba2f-421c62d1d1b4 tempest-VolumesGetTestJSON-1592132989 tempest-VolumesGetTestJSON-1592132989-project] Calling method '.version_select at 0x7ff49bbf0d30>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:23.850854 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-51d745ad-4111-4f5b-ba2f-421c62d1d1b4 tempest-VolumesGetTestJSON-1592132989 tempest-VolumesGetTestJSON-1592132989-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/229b1b68-3bb7-4f69-bec3-d51b53709c42" status: 200 len: 352 microversion: 2.1 time: 0.176865 Jul 18 02:56:23.852058 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2698/5377] 10.222.0.57 () {58 vars in 1244 bytes} [Mon Jul 18 02:56:23 2022] GET /compute/v2.1/os-volumes/229b1b68-3bb7-4f69-bec3-d51b53709c42 => generated 352 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:56:23.858177 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6e8380b9-9613-412c-aa77-9805389aab08 tempest-TestSecurityGroupsBasicOps-1194795190 tempest-TestSecurityGroupsBasicOps-1194795190-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:23.858868 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6e8380b9-9613-412c-aa77-9805389aab08 tempest-TestSecurityGroupsBasicOps-1194795190 tempest-TestSecurityGroupsBasicOps-1194795190-project-admin] [instance: 6f05fde6-142f-4459-b468-06efd59ff42f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:23.908701 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e8380b9-9613-412c-aa77-9805389aab08 tempest-TestSecurityGroupsBasicOps-1194795190 tempest-TestSecurityGroupsBasicOps-1194795190-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:23.909599 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e8380b9-9613-412c-aa77-9805389aab08 tempest-TestSecurityGroupsBasicOps-1194795190 tempest-TestSecurityGroupsBasicOps-1194795190-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:23.911168 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e8380b9-9613-412c-aa77-9805389aab08 tempest-TestSecurityGroupsBasicOps-1194795190 tempest-TestSecurityGroupsBasicOps-1194795190-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:23.912018 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e8380b9-9613-412c-aa77-9805389aab08 tempest-TestSecurityGroupsBasicOps-1194795190 tempest-TestSecurityGroupsBasicOps-1194795190-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:24.566218 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-91ee8158-04f1-44b1-b5e9-0d234510e2f3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:24.629144 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-91ee8158-04f1-44b1-b5e9-0d234510e2f3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1655 microversion: 2.1 time: 1.057151 Jul 18 02:56:24.633822 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2680/5378] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:23 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1655 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:56:24.655566 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c748b585-2816-49bb-906f-a515d55b61c8 tempest-VolumesGetTestJSON-1592132989 tempest-VolumesGetTestJSON-1592132989-project] Calling method '.version_select at 0x7ff49b5d73a0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:24.841891 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c748b585-2816-49bb-906f-a515d55b61c8 tempest-VolumesGetTestJSON-1592132989 tempest-VolumesGetTestJSON-1592132989-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/229b1b68-3bb7-4f69-bec3-d51b53709c42" status: 202 len: 0 microversion: 2.1 time: 0.205484 Jul 18 02:56:24.842834 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2681/5379] 10.222.0.57 () {58 vars in 1247 bytes} [Mon Jul 18 02:56:24 2022] DELETE /compute/v2.1/os-volumes/229b1b68-3bb7-4f69-bec3-d51b53709c42 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:56:24.849572 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-06d509c4-3253-4024-a8fc-37806da0a51c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:24.850452 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-06d509c4-3253-4024-a8fc-37806da0a51c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:24.878914 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-06d509c4-3253-4024-a8fc-37806da0a51c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:24.879377 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-06d509c4-3253-4024-a8fc-37806da0a51c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:24.880491 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-06d509c4-3253-4024-a8fc-37806da0a51c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:24.881440 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-06d509c4-3253-4024-a8fc-37806da0a51c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:25.485007 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-06d509c4-3253-4024-a8fc-37806da0a51c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:25.507797 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-06d509c4-3253-4024-a8fc-37806da0a51c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d" status: 200 len: 1392 microversion: 2.1 time: 0.657003 Jul 18 02:56:25.509010 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2682/5380] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:24 2022] GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d => generated 1392 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:56:25.516470 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8d0f614b-1036-4136-a6b6-bb4d65346069 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:56:25.517633 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8d0f614b-1036-4136-a6b6-bb4d65346069 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:25.551468 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8d0f614b-1036-4136-a6b6-bb4d65346069 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:25.551898 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8d0f614b-1036-4136-a6b6-bb4d65346069 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:25.565228 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8d0f614b-1036-4136-a6b6-bb4d65346069 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:25.569978 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8d0f614b-1036-4136-a6b6-bb4d65346069 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:25.575611 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6e8380b9-9613-412c-aa77-9805389aab08 tempest-TestSecurityGroupsBasicOps-1194795190 tempest-TestSecurityGroupsBasicOps-1194795190-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f" status: 200 len: 1794 microversion: 2.1 time: 1.722393 Jul 18 02:56:25.587299 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2699/5381] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:23 2022] GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f => generated 1794 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:56:25.601190 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-399105b0-7bae-441a-a15c-645215ceab53 req-5d745f20-28da-4804-946e-00f0575c7e62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fed1346a-e87d-4555-bb7b-7eb3612c010d", "name": "network-vif-plugged", "status": "completed", "tag": "99659616-8ddc-428e-98c5-bd637a4e96cb"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:56:25.626550 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-399105b0-7bae-441a-a15c-645215ceab53 req-5d745f20-28da-4804-946e-00f0575c7e62 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:25.627329 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-399105b0-7bae-441a-a15c-645215ceab53 req-5d745f20-28da-4804-946e-00f0575c7e62 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:25.704698 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-399105b0-7bae-441a-a15c-645215ceab53 req-5d745f20-28da-4804-946e-00f0575c7e62 service nova] Creating event network-vif-plugged:99659616-8ddc-428e-98c5-bd637a4e96cb for instance fed1346a-e87d-4555-bb7b-7eb3612c010d on n-h2-465891-3 Jul 18 02:56:25.725894 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-399105b0-7bae-441a-a15c-645215ceab53 req-5d745f20-28da-4804-946e-00f0575c7e62 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134806 Jul 18 02:56:25.729189 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2700/5382] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:56:25.743569 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-47dc908b-7030-49a3-8dd5-f0fa10d926bc tempest-VolumesGetTestJSON-1592132989 tempest-VolumesGetTestJSON-1592132989-project] Calling method '.version_select at 0x7ff4a87c21f0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:25.801266 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8d0f614b-1036-4136-a6b6-bb4d65346069 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "POST /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e/action" status: 202 len: 0 microversion: 2.1 time: 0.290667 Jul 18 02:56:25.805016 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2683/5383] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:56:25 2022] POST /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:56:25.819619 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-65e362e3-715d-4ebb-ad0f-f9fad969f3a4 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:25.820980 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-65e362e3-715d-4ebb-ad0f-f9fad969f3a4 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:25.844749 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-47dc908b-7030-49a3-8dd5-f0fa10d926bc tempest-VolumesGetTestJSON-1592132989 tempest-VolumesGetTestJSON-1592132989-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/229b1b68-3bb7-4f69-bec3-d51b53709c42" status: 200 len: 351 microversion: 2.1 time: 0.107970 Jul 18 02:56:25.851585 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65e362e3-715d-4ebb-ad0f-f9fad969f3a4 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:25.854048 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2701/5384] 10.222.0.57 () {58 vars in 1244 bytes} [Mon Jul 18 02:56:25 2022] GET /compute/v2.1/os-volumes/229b1b68-3bb7-4f69-bec3-d51b53709c42 => generated 351 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:56:25.855057 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65e362e3-715d-4ebb-ad0f-f9fad969f3a4 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:25.856158 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65e362e3-715d-4ebb-ad0f-f9fad969f3a4 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:25.863034 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65e362e3-715d-4ebb-ad0f-f9fad969f3a4 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:26.366671 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-65e362e3-715d-4ebb-ad0f-f9fad969f3a4 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:26.398647 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-65e362e3-715d-4ebb-ad0f-f9fad969f3a4 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1662 microversion: 2.1 time: 0.588170 Jul 18 02:56:26.405517 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2684/5385] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:25 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1662 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:56:26.534560 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-78bbda88-070d-4de8-a283-7f7e1e1895dc tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:26.535414 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-78bbda88-070d-4de8-a283-7f7e1e1895dc tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:26.549859 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-78bbda88-070d-4de8-a283-7f7e1e1895dc tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:26.551908 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-78bbda88-070d-4de8-a283-7f7e1e1895dc tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:26.553242 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-78bbda88-070d-4de8-a283-7f7e1e1895dc tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:26.556251 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-78bbda88-070d-4de8-a283-7f7e1e1895dc tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:26.864092 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-56b13eb7-bb26-48b9-90b4-354b2958011d tempest-VolumesGetTestJSON-1592132989 tempest-VolumesGetTestJSON-1592132989-project] Calling method '.version_select at 0x7ff4a835a280>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:26.882901 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-78bbda88-070d-4de8-a283-7f7e1e1895dc tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:26.910102 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-78bbda88-070d-4de8-a283-7f7e1e1895dc tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d" status: 200 len: 1392 microversion: 2.1 time: 0.378325 Jul 18 02:56:26.911687 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2702/5386] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:26 2022] GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d => generated 1392 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:56:26.991801 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-56b13eb7-bb26-48b9-90b4-354b2958011d tempest-VolumesGetTestJSON-1592132989 tempest-VolumesGetTestJSON-1592132989-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/229b1b68-3bb7-4f69-bec3-d51b53709c42" status: 200 len: 351 microversion: 2.1 time: 0.136168 Jul 18 02:56:26.999257 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2685/5387] 10.222.0.57 () {58 vars in 1244 bytes} [Mon Jul 18 02:56:26 2022] GET /compute/v2.1/os-volumes/229b1b68-3bb7-4f69-bec3-d51b53709c42 => generated 351 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:56:27.415956 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-65336a1a-6574-4f55-b07a-c3f27278164d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:27.418066 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-65336a1a-6574-4f55-b07a-c3f27278164d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:27.432136 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-65336a1a-6574-4f55-b07a-c3f27278164d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:27.432656 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-65336a1a-6574-4f55-b07a-c3f27278164d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:27.433482 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-65336a1a-6574-4f55-b07a-c3f27278164d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:27.446254 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-65336a1a-6574-4f55-b07a-c3f27278164d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:27.836839 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-65336a1a-6574-4f55-b07a-c3f27278164d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:27.849926 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-65336a1a-6574-4f55-b07a-c3f27278164d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 0.437323 Jul 18 02:56:27.850571 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2703/5388] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:27 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:56:27.868665 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b17efdea-0ae5-4847-896d-85b56835d30c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:27.870019 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b17efdea-0ae5-4847-896d-85b56835d30c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:27.883469 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b17efdea-0ae5-4847-896d-85b56835d30c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:27.884290 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b17efdea-0ae5-4847-896d-85b56835d30c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:27.890380 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b17efdea-0ae5-4847-896d-85b56835d30c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:27.891162 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b17efdea-0ae5-4847-896d-85b56835d30c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:27.943170 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-71276e30-db0d-4bc1-8c3a-e556b40447ca tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:27.944748 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-71276e30-db0d-4bc1-8c3a-e556b40447ca tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:27.957163 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-71276e30-db0d-4bc1-8c3a-e556b40447ca tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:27.962197 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-71276e30-db0d-4bc1-8c3a-e556b40447ca tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:27.963513 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-71276e30-db0d-4bc1-8c3a-e556b40447ca tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:27.964192 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-71276e30-db0d-4bc1-8c3a-e556b40447ca tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:28.426418 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b17efdea-0ae5-4847-896d-85b56835d30c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:28.428312 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:56:28.444557 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b17efdea-0ae5-4847-896d-85b56835d30c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 0.580490 Jul 18 02:56:28.445181 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2686/5389] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:27 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:56:28.470354 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0a784a2a-2423-4c30-808e-f2380cd04a57 tempest-VolumesGetTestJSON-1592132989 tempest-VolumesGetTestJSON-1592132989-project] Calling method '.version_select at 0x7ff49bdb4670>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:28.563924 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0a784a2a-2423-4c30-808e-f2380cd04a57 tempest-VolumesGetTestJSON-1592132989 tempest-VolumesGetTestJSON-1592132989-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/229b1b68-3bb7-4f69-bec3-d51b53709c42" status: 200 len: 351 microversion: 2.1 time: 0.104154 Jul 18 02:56:28.564517 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2687/5390] 10.222.0.57 () {58 vars in 1244 bytes} [Mon Jul 18 02:56:28 2022] GET /compute/v2.1/os-volumes/229b1b68-3bb7-4f69-bec3-d51b53709c42 => generated 351 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:56:28.577120 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2db453b3-9d97-47e2-9c2b-abaa62b973b6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:28.578039 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2db453b3-9d97-47e2-9c2b-abaa62b973b6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:28.595348 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2db453b3-9d97-47e2-9c2b-abaa62b973b6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:28.601261 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2db453b3-9d97-47e2-9c2b-abaa62b973b6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:28.602383 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2db453b3-9d97-47e2-9c2b-abaa62b973b6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:28.607015 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2db453b3-9d97-47e2-9c2b-abaa62b973b6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:29.074906 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-71276e30-db0d-4bc1-8c3a-e556b40447ca tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:29.094663 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-71276e30-db0d-4bc1-8c3a-e556b40447ca tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d" status: 200 len: 1562 microversion: 2.1 time: 1.153422 Jul 18 02:56:29.095341 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2704/5391] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:27 2022] GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d => generated 1562 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:56:29.158805 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fb462390-da95-4f97-8824-9a56f8d116bc tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:29.159472 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fb462390-da95-4f97-8824-9a56f8d116bc tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:29.191999 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fb462390-da95-4f97-8824-9a56f8d116bc tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:29.192467 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fb462390-da95-4f97-8824-9a56f8d116bc tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:29.206730 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fb462390-da95-4f97-8824-9a56f8d116bc tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:29.208228 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fb462390-da95-4f97-8824-9a56f8d116bc tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:29.321933 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2db453b3-9d97-47e2-9c2b-abaa62b973b6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:29.332104 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2db453b3-9d97-47e2-9c2b-abaa62b973b6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 0.760468 Jul 18 02:56:29.332716 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2688/5392] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:28 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:56:29.372387 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3eaa00fe-3c79-406b-8d1e-4a09f9634a4c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:29.373253 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3eaa00fe-3c79-406b-8d1e-4a09f9634a4c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:29.400160 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3eaa00fe-3c79-406b-8d1e-4a09f9634a4c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:29.400654 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3eaa00fe-3c79-406b-8d1e-4a09f9634a4c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:29.405778 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3eaa00fe-3c79-406b-8d1e-4a09f9634a4c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:29.406367 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3eaa00fe-3c79-406b-8d1e-4a09f9634a4c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:29.858513 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fb462390-da95-4f97-8824-9a56f8d116bc tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:29.925175 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fb462390-da95-4f97-8824-9a56f8d116bc tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d" status: 200 len: 1562 microversion: 2.1 time: 0.780155 Jul 18 02:56:29.938230 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2705/5393] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:29 2022] GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d => generated 1562 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:56:29.966071 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f297f837-fa19-454c-979e-c9d020349b63 tempest-VolumesGetTestJSON-1592132989 tempest-VolumesGetTestJSON-1592132989-project] Calling method '.version_select at 0x7ff4a87a6280>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:30.080496 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-f297f837-fa19-454c-979e-c9d020349b63 tempest-VolumesGetTestJSON-1592132989 tempest-VolumesGetTestJSON-1592132989-project] HTTP exception thrown: Volume 229b1b68-3bb7-4f69-bec3-d51b53709c42 could not be found. Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f297f837-fa19-454c-979e-c9d020349b63 tempest-VolumesGetTestJSON-1592132989 tempest-VolumesGetTestJSON-1592132989-project] Request method failure captured: Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/os-volumes/229b1b68-3bb7-4f69-bec3-d51b53709c42 HTTP/1.1 Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MvR4CpFFwuv77LWYFBFodSLAdID1O4Kwp0h4lt2Ur770zKDFK1_TM7RjVzyLpFgrqmf6j0I9Hq9oEgUPlnMlokbQKY63yPH7p1ZFayKyrRlDE1DY1Me3GkbI1dpNZ_9yz2EeYZTF8sC4oA9NAM2RbPQsM_czStX-uEU11GaqqomlgY Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 92670a6d0d0444aa80e81767f52fdb0a Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-VolumesGetTestJSON-1592132989 Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_92670a6d0d0444aa80e81767f52fdb0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/92670a6d0d0444aa80e81767f52fdb0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/92670a6d0d0444aa80e81767f52fdb0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/92670a6d0d0444aa80e81767f52fdb0a"}]}] Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-VolumesGetTestJSON-1592132989 Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 92670a6d0d0444aa80e81767f52fdb0a Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-VolumesGetTestJSON-1592132989 Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-VolumesGetTestJSON-1592132989-project Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 50de1fe300d24b3aa30fc8463d31e61e Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-VolumesGetTestJSON-1592132989-project Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: method: Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: exception: Volume 229b1b68-3bb7-4f69-bec3-d51b53709c42 could not be found. Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '229b1b68-3bb7-4f69-bec3-d51b53709c42'} Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 229b1b68-3bb7-4f69-bec3-d51b53709c42 could not be found. (HTTP 404) (Request-ID: req-b5b355d0-bf64-4f87-ae95-e4299c1e4704) Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 02:56:30.092407 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:56:30.099374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:56:30.099374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 02:56:30.099374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 02:56:30.099374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 02:56:30.099374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 02:56:30.099374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 02:56:30.099374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 02:56:30.099374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 02:56:30.099374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 02:56:30.099374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:56:30.099374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:56:30.099374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:56:30.099374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:56:30.099374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 229b1b68-3bb7-4f69-bec3-d51b53709c42 could not be found. Jul 18 02:56:30.099374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:56:30.099374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:56:30.099374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:56:30.099374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:56:30.099374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:56:30.099374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:56:30.099374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:56:30.099374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:56:30.099374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:56:30.099374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:56:30.099374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:56:30.099374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:56:30.099374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 02:56:30.099374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:56:30.099374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 229b1b68-3bb7-4f69-bec3-d51b53709c42 could not be found. Jul 18 02:56:30.099374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:56:30.099374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:56:30.099374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:56:30.099374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:56:30.099374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:56:30.099374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:56:30.099374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:56:30.099374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:56:30.099374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 229b1b68-3bb7-4f69-bec3-d51b53709c42 could not be found. Jul 18 02:56:30.099374 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:56:30.108189 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f297f837-fa19-454c-979e-c9d020349b63 tempest-VolumesGetTestJSON-1592132989 tempest-VolumesGetTestJSON-1592132989-project] Returning 404 to user: Volume 229b1b68-3bb7-4f69-bec3-d51b53709c42 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:56:30.108189 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f297f837-fa19-454c-979e-c9d020349b63 tempest-VolumesGetTestJSON-1592132989 tempest-VolumesGetTestJSON-1592132989-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/229b1b68-3bb7-4f69-bec3-d51b53709c42" status: 404 len: 109 microversion: 2.1 time: 0.159473 Jul 18 02:56:30.108189 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2706/5394] 10.222.0.57 () {58 vars in 1244 bytes} [Mon Jul 18 02:56:29 2022] GET /compute/v2.1/os-volumes/229b1b68-3bb7-4f69-bec3-d51b53709c42 => generated 109 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:56:30.141830 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3eaa00fe-3c79-406b-8d1e-4a09f9634a4c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:30.154568 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3eaa00fe-3c79-406b-8d1e-4a09f9634a4c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 0.803621 Jul 18 02:56:30.155538 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2689/5395] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:29 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:56:30.172379 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fd50f66b-a48d-47c5-9491-4b92d7931a00 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:30.173105 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fd50f66b-a48d-47c5-9491-4b92d7931a00 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:30.189658 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fd50f66b-a48d-47c5-9491-4b92d7931a00 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:30.190244 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fd50f66b-a48d-47c5-9491-4b92d7931a00 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:30.191125 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fd50f66b-a48d-47c5-9491-4b92d7931a00 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:30.191597 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fd50f66b-a48d-47c5-9491-4b92d7931a00 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:31.476495 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fd50f66b-a48d-47c5-9491-4b92d7931a00 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:31.497530 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fd50f66b-a48d-47c5-9491-4b92d7931a00 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 1.323833 Jul 18 02:56:31.499076 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2707/5396] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:30 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:56:31.515861 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-01d859c0-56a2-40d3-a437-4e734c123c7b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:31.516488 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-01d859c0-56a2-40d3-a437-4e734c123c7b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:31.524816 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-01d859c0-56a2-40d3-a437-4e734c123c7b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:31.525541 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-01d859c0-56a2-40d3-a437-4e734c123c7b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:31.526586 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-01d859c0-56a2-40d3-a437-4e734c123c7b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:31.527204 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-01d859c0-56a2-40d3-a437-4e734c123c7b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:32.246291 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-01d859c0-56a2-40d3-a437-4e734c123c7b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:32.259116 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-01d859c0-56a2-40d3-a437-4e734c123c7b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 0.748003 Jul 18 02:56:32.259810 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2690/5397] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:31 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:56:32.677563 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-76254c3a-499e-4211-bf2d-856a8ef9c840 req-9d72e30c-8d42-4934-8cac-258db467937c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f05fde6-142f-4459-b468-06efd59ff42f", "tag": "68e4dfb6-2aee-4e43-85cc-21ddd9a68f3d"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:56:32.703775 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-76254c3a-499e-4211-bf2d-856a8ef9c840 req-9d72e30c-8d42-4934-8cac-258db467937c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:32.705110 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-76254c3a-499e-4211-bf2d-856a8ef9c840 req-9d72e30c-8d42-4934-8cac-258db467937c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:32.764285 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-76254c3a-499e-4211-bf2d-856a8ef9c840 req-9d72e30c-8d42-4934-8cac-258db467937c service nova] Creating event network-changed:68e4dfb6-2aee-4e43-85cc-21ddd9a68f3d for instance 6f05fde6-142f-4459-b468-06efd59ff42f on n-h2-465891-3 Jul 18 02:56:32.781848 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-76254c3a-499e-4211-bf2d-856a8ef9c840 req-9d72e30c-8d42-4934-8cac-258db467937c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108619 Jul 18 02:56:32.793923 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2708/5398] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:56:36.330969 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1ee1df5b-4185-4c17-9b26-3490db90208b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:36.331807 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1ee1df5b-4185-4c17-9b26-3490db90208b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:36.342192 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-de295065-ff70-45ac-85bd-e830a0fe1171 req-eeaa93e8-2044-4c7d-94e9-5d3b6a73f531 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fed1346a-e87d-4555-bb7b-7eb3612c010d", "tag": "99659616-8ddc-428e-98c5-bd637a4e96cb"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:56:36.358949 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ee1df5b-4185-4c17-9b26-3490db90208b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:36.368011 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ee1df5b-4185-4c17-9b26-3490db90208b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:36.369010 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ee1df5b-4185-4c17-9b26-3490db90208b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:36.369477 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ee1df5b-4185-4c17-9b26-3490db90208b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:36.376707 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-de295065-ff70-45ac-85bd-e830a0fe1171 req-eeaa93e8-2044-4c7d-94e9-5d3b6a73f531 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:36.377220 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-de295065-ff70-45ac-85bd-e830a0fe1171 req-eeaa93e8-2044-4c7d-94e9-5d3b6a73f531 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:36.408924 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-de295065-ff70-45ac-85bd-e830a0fe1171 req-eeaa93e8-2044-4c7d-94e9-5d3b6a73f531 service nova] Creating event network-changed:99659616-8ddc-428e-98c5-bd637a4e96cb for instance fed1346a-e87d-4555-bb7b-7eb3612c010d on n-h2-465891-3 Jul 18 02:56:36.416406 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-de295065-ff70-45ac-85bd-e830a0fe1171 req-eeaa93e8-2044-4c7d-94e9-5d3b6a73f531 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080667 Jul 18 02:56:36.417621 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2709/5399] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:56:37.201122 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1ee1df5b-4185-4c17-9b26-3490db90208b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:37.226749 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1ee1df5b-4185-4c17-9b26-3490db90208b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d" status: 200 len: 1562 microversion: 2.1 time: 0.895605 Jul 18 02:56:37.228352 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2691/5400] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:36 2022] GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d => generated 1562 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:56:52.256278 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5edda7d9-c9b0-4c90-92c4-0da49baf3c6b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:56:52.262967 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5edda7d9-c9b0-4c90-92c4-0da49baf3c6b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:52.296166 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=23 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:56:52.300109 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=76,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:56:52.304021 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5edda7d9-c9b0-4c90-92c4-0da49baf3c6b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:52.314898 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5edda7d9-c9b0-4c90-92c4-0da49baf3c6b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:52.316844 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5edda7d9-c9b0-4c90-92c4-0da49baf3c6b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:52.317932 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5edda7d9-c9b0-4c90-92c4-0da49baf3c6b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:52.623611 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5edda7d9-c9b0-4c90-92c4-0da49baf3c6b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "POST /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e/action" status: 202 len: 0 microversion: 2.1 time: 0.375435 Jul 18 02:56:52.626052 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2710/5401] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:56:52 2022] POST /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e/action => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:56:52.635838 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-06514b1e-98ce-4ef9-8853-c6433e1e0c7b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:52.637358 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-06514b1e-98ce-4ef9-8853-c6433e1e0c7b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:52.652413 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=33 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:56:52.653400 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=25 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:56:52.655330 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-06514b1e-98ce-4ef9-8853-c6433e1e0c7b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:52.655984 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-06514b1e-98ce-4ef9-8853-c6433e1e0c7b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:52.657002 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-06514b1e-98ce-4ef9-8853-c6433e1e0c7b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:52.657477 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-06514b1e-98ce-4ef9-8853-c6433e1e0c7b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:53.124970 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-06514b1e-98ce-4ef9-8853-c6433e1e0c7b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:53.140169 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-06514b1e-98ce-4ef9-8853-c6433e1e0c7b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1672 microversion: 2.1 time: 0.507389 Jul 18 02:56:53.141941 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2692/5402] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:52 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1672 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:56:54.174041 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a9f1bb9c-d093-4c45-984d-71b30e2a7bd7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:54.175421 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a9f1bb9c-d093-4c45-984d-71b30e2a7bd7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:54.183286 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9f1bb9c-d093-4c45-984d-71b30e2a7bd7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:54.184704 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9f1bb9c-d093-4c45-984d-71b30e2a7bd7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:54.186237 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9f1bb9c-d093-4c45-984d-71b30e2a7bd7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:54.188809 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9f1bb9c-d093-4c45-984d-71b30e2a7bd7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:54.600422 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a9f1bb9c-d093-4c45-984d-71b30e2a7bd7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:54.651013 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a9f1bb9c-d093-4c45-984d-71b30e2a7bd7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1672 microversion: 2.1 time: 0.463846 Jul 18 02:56:54.653231 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2711/5403] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:54 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1672 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:56:55.703575 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e1d2f860-1401-45d1-bd67-72606d72b71c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:55.705044 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e1d2f860-1401-45d1-bd67-72606d72b71c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:55.764358 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e1d2f860-1401-45d1-bd67-72606d72b71c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:55.764774 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e1d2f860-1401-45d1-bd67-72606d72b71c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:55.766502 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e1d2f860-1401-45d1-bd67-72606d72b71c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:55.783626 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e1d2f860-1401-45d1-bd67-72606d72b71c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:56.089055 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5d7248e6-c4df-4600-9443-157a27db7d36 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:56:56.096132 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5d7248e6-c4df-4600-9443-157a27db7d36 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:56.119394 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5d7248e6-c4df-4600-9443-157a27db7d36 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:56.121590 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5d7248e6-c4df-4600-9443-157a27db7d36 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:56.123627 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5d7248e6-c4df-4600-9443-157a27db7d36 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:56.124734 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5d7248e6-c4df-4600-9443-157a27db7d36 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:56.233345 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5d7248e6-c4df-4600-9443-157a27db7d36 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "POST /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d/action" status: 200 len: 24561 microversion: 2.1 time: 0.150626 Jul 18 02:56:56.236462 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2712/5404] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:56:56 2022] POST /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d/action => generated 24561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:56:56.359074 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e1d2f860-1401-45d1-bd67-72606d72b71c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:56.367853 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e1d2f860-1401-45d1-bd67-72606d72b71c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 0.691072 Jul 18 02:56:56.381104 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2693/5405] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:55 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:07.167570 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3812b678-383a-4f3d-ac28-45aa64580fc6 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:07.170876 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3812b678-383a-4f3d-ac28-45aa64580fc6 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:07.190533 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:57:07.191738 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:57:07.194165 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3812b678-383a-4f3d-ac28-45aa64580fc6 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:07.194936 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3812b678-383a-4f3d-ac28-45aa64580fc6 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:07.196043 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3812b678-383a-4f3d-ac28-45aa64580fc6 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:07.196952 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3812b678-383a-4f3d-ac28-45aa64580fc6 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:08.272525 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3812b678-383a-4f3d-ac28-45aa64580fc6 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:08.311448 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3812b678-383a-4f3d-ac28-45aa64580fc6 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d" status: 200 len: 1680 microversion: 2.1 time: 1.159575 Jul 18 02:57:08.313061 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2713/5406] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:07 2022] GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d => generated 1680 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:08.777217 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6f2ee00b-b7c0-4436-a42a-723e7a70a9c5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:57:08.784122 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6f2ee00b-b7c0-4436-a42a-723e7a70a9c5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:08.828712 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:57:08.833858 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=12 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:57:08.851010 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6f2ee00b-b7c0-4436-a42a-723e7a70a9c5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:08.861464 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6f2ee00b-b7c0-4436-a42a-723e7a70a9c5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:08.863290 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6f2ee00b-b7c0-4436-a42a-723e7a70a9c5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:08.866054 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6f2ee00b-b7c0-4436-a42a-723e7a70a9c5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:09.077770 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6f2ee00b-b7c0-4436-a42a-723e7a70a9c5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "POST /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d/action" status: 200 len: 32624 microversion: 2.1 time: 0.308627 Jul 18 02:57:09.079935 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2694/5407] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:57:08 2022] POST /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d/action => generated 32624 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:57:09.252147 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-86257e0a-2915-4758-af2c-c0879842237d tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:09.273825 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-86257e0a-2915-4758-af2c-c0879842237d tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:09.360851 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-86257e0a-2915-4758-af2c-c0879842237d tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:09.361967 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-86257e0a-2915-4758-af2c-c0879842237d tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:09.367264 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-86257e0a-2915-4758-af2c-c0879842237d tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:09.371487 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-86257e0a-2915-4758-af2c-c0879842237d tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:10.050063 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-86257e0a-2915-4758-af2c-c0879842237d tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d" status: 200 len: 1831 microversion: 2.1 time: 0.822764 Jul 18 02:57:10.054581 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2714/5408] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:09 2022] GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d => generated 1831 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:10.086356 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4cc49d77-1dfb-48d9-9ae8-8955cd0a9e3b tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:57:10.087798 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4cc49d77-1dfb-48d9-9ae8-8955cd0a9e3b tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:10.097301 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4cc49d77-1dfb-48d9-9ae8-8955cd0a9e3b tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:10.098153 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4cc49d77-1dfb-48d9-9ae8-8955cd0a9e3b tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:10.103209 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4cc49d77-1dfb-48d9-9ae8-8955cd0a9e3b tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:10.103979 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4cc49d77-1dfb-48d9-9ae8-8955cd0a9e3b tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:10.144553 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-4cc49d77-1dfb-48d9-9ae8-8955cd0a9e3b tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Lazy-loading 'flavor' on Instance uuid fed1346a-e87d-4555-bb7b-7eb3612c010d {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:57:10.172267 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4cc49d77-1dfb-48d9-9ae8-8955cd0a9e3b tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] Going to try to live migrate instance to another host {{(pid=119544) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 18 02:57:10.552181 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3d143178-88cb-4c04-a9e1-28365834d835 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1962284660", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "7da516d4-3cf7-465c-9ad8-ed9231a81bc6"}], "key_name": "tempest-TestSecurityGroupsBasicOps-247054353", "security_groups": []}, "os:scheduler_hints": {"different_host": ["6f05fde6-142f-4459-b468-06efd59ff42f"]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:57:10.703304 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-3d143178-88cb-4c04-a9e1-28365834d835 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] validate_networks() for [('7da516d4-3cf7-465c-9ad8-ed9231a81bc6', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:57:12.078074 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-3d143178-88cb-4c04-a9e1-28365834d835 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:57:12.080245 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-3d143178-88cb-4c04-a9e1-28365834d835 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:57:12.081497 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-3d143178-88cb-4c04-a9e1-28365834d835 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:57:12.082756 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-3d143178-88cb-4c04-a9e1-28365834d835 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:57:12.085222 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-3d143178-88cb-4c04-a9e1-28365834d835 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:57:12.136440 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3d143178-88cb-4c04-a9e1-28365834d835 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:12.137740 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3d143178-88cb-4c04-a9e1-28365834d835 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:12.139646 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3d143178-88cb-4c04-a9e1-28365834d835 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:12.141901 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3d143178-88cb-4c04-a9e1-28365834d835 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:12.194555 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-3d143178-88cb-4c04-a9e1-28365834d835 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Getting quotas for project 0f043fa9beaa4ac6b209d67346479c57. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:57:12.221911 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-3d143178-88cb-4c04-a9e1-28365834d835 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Getting quotas for user b6c7444bc0744533861c32353fa7f597 and project 0f043fa9beaa4ac6b209d67346479c57. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:57:12.289262 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3d143178-88cb-4c04-a9e1-28365834d835 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:57:12.304961 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3d143178-88cb-4c04-a9e1-28365834d835 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: bf110ac4-8f35-4aa0-8b76-20ff6c36117d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:57:12.588865 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3d143178-88cb-4c04-a9e1-28365834d835 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 2.035005 Jul 18 02:57:12.595900 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2715/5409] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:57:10 2022] POST /compute/v2.1/servers => generated 361 bytes in 2046 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 02:57:12.609308 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-443daab2-8ec9-4bd7-80ab-ddf273416b02 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:12.639956 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-443daab2-8ec9-4bd7-80ab-ddf273416b02 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: bf110ac4-8f35-4aa0-8b76-20ff6c36117d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:12.821131 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-443daab2-8ec9-4bd7-80ab-ddf273416b02 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7444bc0744533861c32353fa7f597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f043fa9beaa4ac6b209d67346479c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:12.841032 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-443daab2-8ec9-4bd7-80ab-ddf273416b02 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "GET /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d" status: 200 len: 1241 microversion: 2.1 time: 0.239856 Jul 18 02:57:12.842190 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2716/5410] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:12 2022] GET /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d => generated 1241 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:13.868018 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5f274acd-83de-4ad7-ac6b-c078a24c5fa8 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:13.886445 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5f274acd-83de-4ad7-ac6b-c078a24c5fa8 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: bf110ac4-8f35-4aa0-8b76-20ff6c36117d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:14.029816 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5f274acd-83de-4ad7-ac6b-c078a24c5fa8 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7444bc0744533861c32353fa7f597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f043fa9beaa4ac6b209d67346479c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:14.038877 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5f274acd-83de-4ad7-ac6b-c078a24c5fa8 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "GET /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d" status: 200 len: 1241 microversion: 2.1 time: 0.184170 Jul 18 02:57:14.070119 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2717/5411] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:13 2022] GET /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d => generated 1241 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:15.076510 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-231b5d90-bc08-4f2c-be25-aae0c331e45e tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:15.078158 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-231b5d90-bc08-4f2c-be25-aae0c331e45e tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: bf110ac4-8f35-4aa0-8b76-20ff6c36117d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:15.095356 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-231b5d90-bc08-4f2c-be25-aae0c331e45e tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:15.097837 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-231b5d90-bc08-4f2c-be25-aae0c331e45e tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:15.101674 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-231b5d90-bc08-4f2c-be25-aae0c331e45e tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:15.102340 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-231b5d90-bc08-4f2c-be25-aae0c331e45e tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:15.375730 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-231b5d90-bc08-4f2c-be25-aae0c331e45e tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7444bc0744533861c32353fa7f597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f043fa9beaa4ac6b209d67346479c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:15.392919 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-231b5d90-bc08-4f2c-be25-aae0c331e45e tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "GET /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d" status: 200 len: 1293 microversion: 2.1 time: 0.321820 Jul 18 02:57:15.394072 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2718/5412] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:15 2022] GET /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d => generated 1293 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:57:16.180112 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4cc49d77-1dfb-48d9-9ae8-8955cd0a9e3b tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d/action" status: 202 len: 0 microversion: 2.1 time: 6.100047 Jul 18 02:57:16.187973 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2695/5413] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:57:10 2022] POST /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d/action => generated 0 bytes in 6102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:57:16.193174 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-01fafccd-e341-4c0a-8d1c-5b18153faa26 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:16.194034 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-01fafccd-e341-4c0a-8d1c-5b18153faa26 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:16.214857 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-01fafccd-e341-4c0a-8d1c-5b18153faa26 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:16.216159 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-01fafccd-e341-4c0a-8d1c-5b18153faa26 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:16.225497 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-01fafccd-e341-4c0a-8d1c-5b18153faa26 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:16.227436 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-01fafccd-e341-4c0a-8d1c-5b18153faa26 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:16.432324 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4f3b5c85-42cf-44a7-ab5d-2a2581ae3215 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:16.434067 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4f3b5c85-42cf-44a7-ab5d-2a2581ae3215 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: bf110ac4-8f35-4aa0-8b76-20ff6c36117d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:16.505279 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4f3b5c85-42cf-44a7-ab5d-2a2581ae3215 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:16.506101 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4f3b5c85-42cf-44a7-ab5d-2a2581ae3215 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:16.515901 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4f3b5c85-42cf-44a7-ab5d-2a2581ae3215 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:16.516336 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4f3b5c85-42cf-44a7-ab5d-2a2581ae3215 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:17.254408 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4f3b5c85-42cf-44a7-ab5d-2a2581ae3215 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7444bc0744533861c32353fa7f597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f043fa9beaa4ac6b209d67346479c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:17.274046 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4f3b5c85-42cf-44a7-ab5d-2a2581ae3215 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "GET /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d" status: 200 len: 1299 microversion: 2.1 time: 0.849441 Jul 18 02:57:17.279750 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2696/5414] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:16 2022] GET /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d => generated 1299 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:17.756785 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-01fafccd-e341-4c0a-8d1c-5b18153faa26 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:17.810703 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-01fafccd-e341-4c0a-8d1c-5b18153faa26 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d" status: 200 len: 1690 microversion: 2.1 time: 1.612204 Jul 18 02:57:17.826424 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2719/5415] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:16 2022] GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d => generated 1690 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:18.314111 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c2bbdcca-de72-4eda-80d6-fdd92227638e tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:18.316167 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c2bbdcca-de72-4eda-80d6-fdd92227638e tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: bf110ac4-8f35-4aa0-8b76-20ff6c36117d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:18.342548 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c2bbdcca-de72-4eda-80d6-fdd92227638e tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:18.346207 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c2bbdcca-de72-4eda-80d6-fdd92227638e tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:18.351579 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c2bbdcca-de72-4eda-80d6-fdd92227638e tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:18.352506 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c2bbdcca-de72-4eda-80d6-fdd92227638e tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:18.671763 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c2bbdcca-de72-4eda-80d6-fdd92227638e tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7444bc0744533861c32353fa7f597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f043fa9beaa4ac6b209d67346479c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:18.705431 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c2bbdcca-de72-4eda-80d6-fdd92227638e tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "GET /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d" status: 200 len: 1299 microversion: 2.1 time: 0.403761 Jul 18 02:57:18.707379 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2697/5416] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:18 2022] GET /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d => generated 1299 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:18.849095 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4a4db11d-f404-49a7-8c6c-009a2b05335b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:18.850424 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4a4db11d-f404-49a7-8c6c-009a2b05335b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:18.867518 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4a4db11d-f404-49a7-8c6c-009a2b05335b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:18.868350 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4a4db11d-f404-49a7-8c6c-009a2b05335b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:18.869458 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4a4db11d-f404-49a7-8c6c-009a2b05335b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:18.872786 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4a4db11d-f404-49a7-8c6c-009a2b05335b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:19.728985 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6bff48c5-8eef-4d97-b0a7-c68dfb0fa567 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:19.731163 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6bff48c5-8eef-4d97-b0a7-c68dfb0fa567 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: bf110ac4-8f35-4aa0-8b76-20ff6c36117d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:19.762201 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6bff48c5-8eef-4d97-b0a7-c68dfb0fa567 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:19.763010 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6bff48c5-8eef-4d97-b0a7-c68dfb0fa567 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:19.764374 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6bff48c5-8eef-4d97-b0a7-c68dfb0fa567 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:19.765175 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6bff48c5-8eef-4d97-b0a7-c68dfb0fa567 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:20.019884 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6bff48c5-8eef-4d97-b0a7-c68dfb0fa567 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7444bc0744533861c32353fa7f597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f043fa9beaa4ac6b209d67346479c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:20.029078 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6bff48c5-8eef-4d97-b0a7-c68dfb0fa567 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "GET /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d" status: 200 len: 1299 microversion: 2.1 time: 0.307758 Jul 18 02:57:20.034498 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2698/5417] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:19 2022] GET /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d => generated 1299 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:20.154102 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4a4db11d-f404-49a7-8c6c-009a2b05335b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:20.163604 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4a4db11d-f404-49a7-8c6c-009a2b05335b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d" status: 200 len: 1690 microversion: 2.1 time: 1.318461 Jul 18 02:57:20.176519 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2720/5418] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:18 2022] GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d => generated 1690 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:21.054905 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-01263340-98cc-4c68-a6de-2f2cf4ad3072 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:21.056138 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-01263340-98cc-4c68-a6de-2f2cf4ad3072 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: bf110ac4-8f35-4aa0-8b76-20ff6c36117d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:21.081979 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-01263340-98cc-4c68-a6de-2f2cf4ad3072 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:21.082808 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-01263340-98cc-4c68-a6de-2f2cf4ad3072 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:21.087963 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-01263340-98cc-4c68-a6de-2f2cf4ad3072 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:21.088707 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-01263340-98cc-4c68-a6de-2f2cf4ad3072 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:21.233167 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a0e64b6c-9f2d-4bdf-9c76-1fa185a708e3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:21.234604 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a0e64b6c-9f2d-4bdf-9c76-1fa185a708e3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:21.268167 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a0e64b6c-9f2d-4bdf-9c76-1fa185a708e3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:21.269222 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a0e64b6c-9f2d-4bdf-9c76-1fa185a708e3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:21.270206 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a0e64b6c-9f2d-4bdf-9c76-1fa185a708e3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:21.270894 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a0e64b6c-9f2d-4bdf-9c76-1fa185a708e3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:21.578116 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-01263340-98cc-4c68-a6de-2f2cf4ad3072 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7444bc0744533861c32353fa7f597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f043fa9beaa4ac6b209d67346479c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:21.616591 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-01263340-98cc-4c68-a6de-2f2cf4ad3072 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "GET /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d" status: 200 len: 1299 microversion: 2.1 time: 0.564231 Jul 18 02:57:21.619395 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2699/5419] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:21 2022] GET /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d => generated 1299 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:21.645555 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-0863abd6-dcc9-4b7d-8798-212b017bc490 req-24c6fdb7-1388-4f23-bba6-f076fe584828 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fed1346a-e87d-4555-bb7b-7eb3612c010d", "name": "network-vif-unplugged", "status": "completed", "tag": "99659616-8ddc-428e-98c5-bd637a4e96cb"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:57:21.694710 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-0863abd6-dcc9-4b7d-8798-212b017bc490 req-24c6fdb7-1388-4f23-bba6-f076fe584828 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:21.701555 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-0863abd6-dcc9-4b7d-8798-212b017bc490 req-24c6fdb7-1388-4f23-bba6-f076fe584828 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:21.790539 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-0863abd6-dcc9-4b7d-8798-212b017bc490 req-24c6fdb7-1388-4f23-bba6-f076fe584828 service nova] Creating event network-vif-unplugged:99659616-8ddc-428e-98c5-bd637a4e96cb for instance fed1346a-e87d-4555-bb7b-7eb3612c010d on n-h2-465891-3 Jul 18 02:57:21.809683 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-0863abd6-dcc9-4b7d-8798-212b017bc490 req-24c6fdb7-1388-4f23-bba6-f076fe584828 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.185637 Jul 18 02:57:21.815832 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2700/5420] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:57:21.929893 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-afc61b83-f04b-46d7-96f6-b96eca5da8d4 req-d972fb8b-bcd7-4256-b138-b90ab08cfb5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf110ac4-8f35-4aa0-8b76-20ff6c36117d", "tag": "630934ae-7a74-40fe-a1b9-608c9919ef10"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:57:21.953337 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-afc61b83-f04b-46d7-96f6-b96eca5da8d4 req-d972fb8b-bcd7-4256-b138-b90ab08cfb5f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:21.954102 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-afc61b83-f04b-46d7-96f6-b96eca5da8d4 req-d972fb8b-bcd7-4256-b138-b90ab08cfb5f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:21.978442 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-afc61b83-f04b-46d7-96f6-b96eca5da8d4 req-d972fb8b-bcd7-4256-b138-b90ab08cfb5f service nova] Creating event network-changed:630934ae-7a74-40fe-a1b9-608c9919ef10 for instance bf110ac4-8f35-4aa0-8b76-20ff6c36117d on n-h1-465891-3 Jul 18 02:57:22.014447 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-afc61b83-f04b-46d7-96f6-b96eca5da8d4 req-d972fb8b-bcd7-4256-b138-b90ab08cfb5f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090578 Jul 18 02:57:22.015084 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2701/5421] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:57:22.164586 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:57:22.479130 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a0e64b6c-9f2d-4bdf-9c76-1fa185a708e3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:22.492667 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a0e64b6c-9f2d-4bdf-9c76-1fa185a708e3 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d" status: 200 len: 1690 microversion: 2.1 time: 1.282259 Jul 18 02:57:22.494752 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2721/5422] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:21 2022] GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d => generated 1690 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:22.640866 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-560e4669-0f50-439b-b561-e7f9c014af02 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:22.641556 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-560e4669-0f50-439b-b561-e7f9c014af02 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: bf110ac4-8f35-4aa0-8b76-20ff6c36117d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:22.676629 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-560e4669-0f50-439b-b561-e7f9c014af02 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:22.679533 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-560e4669-0f50-439b-b561-e7f9c014af02 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:22.684232 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-560e4669-0f50-439b-b561-e7f9c014af02 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:22.686401 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-560e4669-0f50-439b-b561-e7f9c014af02 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:23.295853 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-560e4669-0f50-439b-b561-e7f9c014af02 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7444bc0744533861c32353fa7f597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f043fa9beaa4ac6b209d67346479c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:23.311587 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-560e4669-0f50-439b-b561-e7f9c014af02 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "GET /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d" status: 200 len: 1299 microversion: 2.1 time: 0.678376 Jul 18 02:57:23.326752 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2702/5423] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:22 2022] GET /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d => generated 1299 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:23.531873 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fbc7688d-c36d-4c35-98f8-1ed706acae54 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:23.532987 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fbc7688d-c36d-4c35-98f8-1ed706acae54 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:23.562686 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fbc7688d-c36d-4c35-98f8-1ed706acae54 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:23.565416 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fbc7688d-c36d-4c35-98f8-1ed706acae54 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:23.566881 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fbc7688d-c36d-4c35-98f8-1ed706acae54 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:23.571948 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fbc7688d-c36d-4c35-98f8-1ed706acae54 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:24.034577 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=10 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:57:24.284291 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fbc7688d-c36d-4c35-98f8-1ed706acae54 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:24.322471 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fbc7688d-c36d-4c35-98f8-1ed706acae54 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d" status: 200 len: 1690 microversion: 2.1 time: 0.798925 Jul 18 02:57:24.326411 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2722/5424] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:23 2022] GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d => generated 1690 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:57:24.352834 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-72dc668e-6246-4933-a872-90333477063c tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:24.360028 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-72dc668e-6246-4933-a872-90333477063c tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: bf110ac4-8f35-4aa0-8b76-20ff6c36117d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:24.397246 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-72dc668e-6246-4933-a872-90333477063c tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:24.403211 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-72dc668e-6246-4933-a872-90333477063c tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:24.405682 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-72dc668e-6246-4933-a872-90333477063c tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:24.407783 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-72dc668e-6246-4933-a872-90333477063c tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:25.059189 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-72dc668e-6246-4933-a872-90333477063c tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7444bc0744533861c32353fa7f597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f043fa9beaa4ac6b209d67346479c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:25.065445 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-fb38e41b-2f63-4fa4-9afa-d0404f4b01ae req-e2c2f71a-68f7-44bf-be96-aa0693f45cbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fed1346a-e87d-4555-bb7b-7eb3612c010d", "tag": "99659616-8ddc-428e-98c5-bd637a4e96cb"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:57:25.077138 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-72dc668e-6246-4933-a872-90333477063c tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "GET /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d" status: 200 len: 1299 microversion: 2.1 time: 0.740589 Jul 18 02:57:25.078338 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2703/5425] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:24 2022] GET /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d => generated 1299 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:25.101041 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-fb38e41b-2f63-4fa4-9afa-d0404f4b01ae req-e2c2f71a-68f7-44bf-be96-aa0693f45cbe service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:25.101544 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-fb38e41b-2f63-4fa4-9afa-d0404f4b01ae req-e2c2f71a-68f7-44bf-be96-aa0693f45cbe service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:25.144880 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-fb38e41b-2f63-4fa4-9afa-d0404f4b01ae req-e2c2f71a-68f7-44bf-be96-aa0693f45cbe service nova] Creating event network-changed:99659616-8ddc-428e-98c5-bd637a4e96cb for instance fed1346a-e87d-4555-bb7b-7eb3612c010d on n-h2-465891-3 Jul 18 02:57:25.163947 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-fb38e41b-2f63-4fa4-9afa-d0404f4b01ae req-e2c2f71a-68f7-44bf-be96-aa0693f45cbe service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118992 Jul 18 02:57:25.170993 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2723/5426] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:57:25.373871 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3664b6b1-f37f-4fc7-9027-c7c7152a63aa tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:25.378327 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3664b6b1-f37f-4fc7-9027-c7c7152a63aa tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:25.406638 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3664b6b1-f37f-4fc7-9027-c7c7152a63aa tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:25.407402 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3664b6b1-f37f-4fc7-9027-c7c7152a63aa tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:25.408801 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3664b6b1-f37f-4fc7-9027-c7c7152a63aa tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:25.409584 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3664b6b1-f37f-4fc7-9027-c7c7152a63aa tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:25.963020 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3664b6b1-f37f-4fc7-9027-c7c7152a63aa tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:25.975334 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3664b6b1-f37f-4fc7-9027-c7c7152a63aa tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d" status: 200 len: 1690 microversion: 2.1 time: 0.615606 Jul 18 02:57:25.975968 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2704/5427] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:25 2022] GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d => generated 1690 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:57:26.107263 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b703e51c-8ed4-499d-9055-8266505a72f1 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:26.108407 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b703e51c-8ed4-499d-9055-8266505a72f1 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: bf110ac4-8f35-4aa0-8b76-20ff6c36117d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:26.124654 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b703e51c-8ed4-499d-9055-8266505a72f1 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:26.127086 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b703e51c-8ed4-499d-9055-8266505a72f1 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:26.129025 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b703e51c-8ed4-499d-9055-8266505a72f1 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:26.130173 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b703e51c-8ed4-499d-9055-8266505a72f1 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:26.622881 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b703e51c-8ed4-499d-9055-8266505a72f1 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7444bc0744533861c32353fa7f597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f043fa9beaa4ac6b209d67346479c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:26.691037 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b703e51c-8ed4-499d-9055-8266505a72f1 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "GET /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d" status: 200 len: 1299 microversion: 2.1 time: 0.584659 Jul 18 02:57:26.695491 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2724/5428] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:26 2022] GET /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d => generated 1299 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:27.014662 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-25b7ab79-6e52-4861-b0c2-3ab76b14dbcf tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:27.016850 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-25b7ab79-6e52-4861-b0c2-3ab76b14dbcf tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:27.038448 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25b7ab79-6e52-4861-b0c2-3ab76b14dbcf tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:27.041117 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25b7ab79-6e52-4861-b0c2-3ab76b14dbcf tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:27.044656 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25b7ab79-6e52-4861-b0c2-3ab76b14dbcf tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:27.047915 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25b7ab79-6e52-4861-b0c2-3ab76b14dbcf tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:27.593153 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-25b7ab79-6e52-4861-b0c2-3ab76b14dbcf tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:27.601255 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-25b7ab79-6e52-4861-b0c2-3ab76b14dbcf tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d" status: 200 len: 1690 microversion: 2.1 time: 0.597876 Jul 18 02:57:27.614902 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2705/5429] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:27 2022] GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d => generated 1690 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:27.722052 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b66d61a6-ec2c-46e4-bfaf-547d656980ce tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:27.722788 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b66d61a6-ec2c-46e4-bfaf-547d656980ce tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: bf110ac4-8f35-4aa0-8b76-20ff6c36117d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:27.738599 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b66d61a6-ec2c-46e4-bfaf-547d656980ce tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:27.739084 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b66d61a6-ec2c-46e4-bfaf-547d656980ce tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:27.749003 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b66d61a6-ec2c-46e4-bfaf-547d656980ce tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:27.749494 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b66d61a6-ec2c-46e4-bfaf-547d656980ce tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:27.881844 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b66d61a6-ec2c-46e4-bfaf-547d656980ce tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7444bc0744533861c32353fa7f597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f043fa9beaa4ac6b209d67346479c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:27.899209 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b66d61a6-ec2c-46e4-bfaf-547d656980ce tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "GET /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d" status: 200 len: 1299 microversion: 2.1 time: 0.179666 Jul 18 02:57:27.906493 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2725/5430] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:27 2022] GET /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d => generated 1299 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:28.335268 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-64d9b3ac-982b-4246-b1e9-c648819d7a9a req-1b98523b-7cc6-47f7-b841-c9501b47c285 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf110ac4-8f35-4aa0-8b76-20ff6c36117d", "name": "network-vif-plugged", "status": "completed", "tag": "630934ae-7a74-40fe-a1b9-608c9919ef10"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:57:28.357039 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-64d9b3ac-982b-4246-b1e9-c648819d7a9a req-1b98523b-7cc6-47f7-b841-c9501b47c285 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:28.357883 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-64d9b3ac-982b-4246-b1e9-c648819d7a9a req-1b98523b-7cc6-47f7-b841-c9501b47c285 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:28.387542 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-64d9b3ac-982b-4246-b1e9-c648819d7a9a req-1b98523b-7cc6-47f7-b841-c9501b47c285 service nova] Creating event network-vif-plugged:630934ae-7a74-40fe-a1b9-608c9919ef10 for instance bf110ac4-8f35-4aa0-8b76-20ff6c36117d on n-h1-465891-3 Jul 18 02:57:28.400177 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-64d9b3ac-982b-4246-b1e9-c648819d7a9a req-1b98523b-7cc6-47f7-b841-c9501b47c285 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068433 Jul 18 02:57:28.402164 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2706/5431] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:57:28.623300 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3f63c90d-befa-4c8d-bd87-3d5e20737b71 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:28.624619 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3f63c90d-befa-4c8d-bd87-3d5e20737b71 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:28.632200 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3f63c90d-befa-4c8d-bd87-3d5e20737b71 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:28.633088 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3f63c90d-befa-4c8d-bd87-3d5e20737b71 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:28.634277 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3f63c90d-befa-4c8d-bd87-3d5e20737b71 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:28.635004 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3f63c90d-befa-4c8d-bd87-3d5e20737b71 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:28.930392 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2320cd3f-d166-4f17-8c55-79d39a74e663 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:28.931263 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2320cd3f-d166-4f17-8c55-79d39a74e663 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: bf110ac4-8f35-4aa0-8b76-20ff6c36117d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:28.947170 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2320cd3f-d166-4f17-8c55-79d39a74e663 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:28.948909 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2320cd3f-d166-4f17-8c55-79d39a74e663 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:28.952711 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2320cd3f-d166-4f17-8c55-79d39a74e663 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:28.953483 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2320cd3f-d166-4f17-8c55-79d39a74e663 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:28.962723 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3f63c90d-befa-4c8d-bd87-3d5e20737b71 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:28.978218 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3f63c90d-befa-4c8d-bd87-3d5e20737b71 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d" status: 200 len: 1690 microversion: 2.1 time: 0.360952 Jul 18 02:57:28.994520 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2726/5432] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:28 2022] GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d => generated 1690 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:29.183162 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cb4ad0da-8226-4b53-9711-00f2388ec4b4 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:29.184113 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cb4ad0da-8226-4b53-9711-00f2388ec4b4 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:29.201402 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cb4ad0da-8226-4b53-9711-00f2388ec4b4 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:29.202185 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cb4ad0da-8226-4b53-9711-00f2388ec4b4 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:29.203185 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cb4ad0da-8226-4b53-9711-00f2388ec4b4 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:29.203816 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cb4ad0da-8226-4b53-9711-00f2388ec4b4 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:29.386626 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2320cd3f-d166-4f17-8c55-79d39a74e663 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7444bc0744533861c32353fa7f597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f043fa9beaa4ac6b209d67346479c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:29.395835 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2320cd3f-d166-4f17-8c55-79d39a74e663 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "GET /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d" status: 200 len: 1299 microversion: 2.1 time: 0.470330 Jul 18 02:57:29.396978 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2707/5433] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:28 2022] GET /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d => generated 1299 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:57:29.567868 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cb4ad0da-8226-4b53-9711-00f2388ec4b4 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:29.576529 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cb4ad0da-8226-4b53-9711-00f2388ec4b4 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 0.399970 Jul 18 02:57:29.586247 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2727/5434] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:29 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:57:29.600735 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-480c3fcc-d06f-451e-a0be-af48a046ce2a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:29.601369 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-480c3fcc-d06f-451e-a0be-af48a046ce2a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:29.612703 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-480c3fcc-d06f-451e-a0be-af48a046ce2a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:29.614094 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-480c3fcc-d06f-451e-a0be-af48a046ce2a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:29.615088 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-480c3fcc-d06f-451e-a0be-af48a046ce2a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:29.615695 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-480c3fcc-d06f-451e-a0be-af48a046ce2a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:30.005398 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5fc20d46-83e8-48a7-9619-8df152070d1c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:30.008038 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5fc20d46-83e8-48a7-9619-8df152070d1c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:30.024466 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5fc20d46-83e8-48a7-9619-8df152070d1c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:30.026128 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5fc20d46-83e8-48a7-9619-8df152070d1c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:30.028655 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5fc20d46-83e8-48a7-9619-8df152070d1c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:30.029811 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5fc20d46-83e8-48a7-9619-8df152070d1c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:30.058880 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-480c3fcc-d06f-451e-a0be-af48a046ce2a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:30.086448 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-480c3fcc-d06f-451e-a0be-af48a046ce2a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 0.489327 Jul 18 02:57:30.096689 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2708/5435] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:29 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:30.111395 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-63521120-0749-4085-8c92-2bdb38a36107 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:30.114384 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-63521120-0749-4085-8c92-2bdb38a36107 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:30.132012 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-63521120-0749-4085-8c92-2bdb38a36107 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:30.134749 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-63521120-0749-4085-8c92-2bdb38a36107 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:30.138635 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-63521120-0749-4085-8c92-2bdb38a36107 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:30.143580 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-63521120-0749-4085-8c92-2bdb38a36107 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:30.539339 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5fc20d46-83e8-48a7-9619-8df152070d1c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:30.554203 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5fc20d46-83e8-48a7-9619-8df152070d1c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d" status: 200 len: 1690 microversion: 2.1 time: 0.559403 Jul 18 02:57:30.565605 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2728/5436] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:29 2022] GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d => generated 1690 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:30.570481 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a3b54c37-dd9e-47da-bd5a-4f068c8828e9 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:30.571659 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a3b54c37-dd9e-47da-bd5a-4f068c8828e9 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: bf110ac4-8f35-4aa0-8b76-20ff6c36117d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:30.579435 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a3b54c37-dd9e-47da-bd5a-4f068c8828e9 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:30.580214 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a3b54c37-dd9e-47da-bd5a-4f068c8828e9 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:30.581289 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a3b54c37-dd9e-47da-bd5a-4f068c8828e9 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:30.581959 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a3b54c37-dd9e-47da-bd5a-4f068c8828e9 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:30.679363 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a3b54c37-dd9e-47da-bd5a-4f068c8828e9 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7444bc0744533861c32353fa7f597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f043fa9beaa4ac6b209d67346479c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:30.693138 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a3b54c37-dd9e-47da-bd5a-4f068c8828e9 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "GET /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d" status: 200 len: 1472 microversion: 2.1 time: 0.126681 Jul 18 02:57:30.695730 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2729/5437] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:30 2022] GET /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d => generated 1472 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:30.700620 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-63521120-0749-4085-8c92-2bdb38a36107 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:30.719488 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f717b979-71cb-4eb8-868b-7873bfb7cb07 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:30.720295 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-63521120-0749-4085-8c92-2bdb38a36107 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 0.615848 Jul 18 02:57:30.721209 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f717b979-71cb-4eb8-868b-7873bfb7cb07 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: bf110ac4-8f35-4aa0-8b76-20ff6c36117d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:30.734866 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f717b979-71cb-4eb8-868b-7873bfb7cb07 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:30.736803 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f717b979-71cb-4eb8-868b-7873bfb7cb07 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:30.738931 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2709/5438] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:30 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:30.741094 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f717b979-71cb-4eb8-868b-7873bfb7cb07 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:30.742929 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f717b979-71cb-4eb8-868b-7873bfb7cb07 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:30.750681 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0e689c7f-b6be-44ad-8049-539478a6a470 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:30.752087 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0e689c7f-b6be-44ad-8049-539478a6a470 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:30.770942 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0e689c7f-b6be-44ad-8049-539478a6a470 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:30.772162 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0e689c7f-b6be-44ad-8049-539478a6a470 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:30.777030 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0e689c7f-b6be-44ad-8049-539478a6a470 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:30.781429 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0e689c7f-b6be-44ad-8049-539478a6a470 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:31.099722 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f717b979-71cb-4eb8-868b-7873bfb7cb07 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7444bc0744533861c32353fa7f597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f043fa9beaa4ac6b209d67346479c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:31.120844 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f717b979-71cb-4eb8-868b-7873bfb7cb07 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "GET /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d" status: 200 len: 1472 microversion: 2.1 time: 0.411844 Jul 18 02:57:31.121449 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2730/5439] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:30 2022] GET /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d => generated 1472 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:57:31.139319 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ed48bd1a-32a7-4796-b872-034aaf9b8a9e tempest-TestSecurityGroupsBasicOps-1194795190 tempest-TestSecurityGroupsBasicOps-1194795190-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:31.140239 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ed48bd1a-32a7-4796-b872-034aaf9b8a9e tempest-TestSecurityGroupsBasicOps-1194795190 tempest-TestSecurityGroupsBasicOps-1194795190-project-admin] [instance: bf110ac4-8f35-4aa0-8b76-20ff6c36117d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:31.148821 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ed48bd1a-32a7-4796-b872-034aaf9b8a9e tempest-TestSecurityGroupsBasicOps-1194795190 tempest-TestSecurityGroupsBasicOps-1194795190-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:31.149519 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ed48bd1a-32a7-4796-b872-034aaf9b8a9e tempest-TestSecurityGroupsBasicOps-1194795190 tempest-TestSecurityGroupsBasicOps-1194795190-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:31.151039 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ed48bd1a-32a7-4796-b872-034aaf9b8a9e tempest-TestSecurityGroupsBasicOps-1194795190 tempest-TestSecurityGroupsBasicOps-1194795190-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:31.151691 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ed48bd1a-32a7-4796-b872-034aaf9b8a9e tempest-TestSecurityGroupsBasicOps-1194795190 tempest-TestSecurityGroupsBasicOps-1194795190-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:31.238688 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0e689c7f-b6be-44ad-8049-539478a6a470 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:31.258071 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0e689c7f-b6be-44ad-8049-539478a6a470 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 0.506810 Jul 18 02:57:31.258810 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2710/5440] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:30 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:31.369081 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ed48bd1a-32a7-4796-b872-034aaf9b8a9e tempest-TestSecurityGroupsBasicOps-1194795190 tempest-TestSecurityGroupsBasicOps-1194795190-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d" status: 200 len: 1623 microversion: 2.1 time: 0.225581 Jul 18 02:57:31.370921 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2731/5441] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:31 2022] GET /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d => generated 1623 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:31.389089 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a76847f5-6b52-486c-9a31-c10c477b0c95 tempest-TestSecurityGroupsBasicOps-1194795190 tempest-TestSecurityGroupsBasicOps-1194795190-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:31.401821 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a76847f5-6b52-486c-9a31-c10c477b0c95 tempest-TestSecurityGroupsBasicOps-1194795190 tempest-TestSecurityGroupsBasicOps-1194795190-project-admin] [instance: 6f05fde6-142f-4459-b468-06efd59ff42f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:31.432486 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-890876d4-3a19-4dd5-875d-e9d7a6b20ff5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1813011233", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "a3f65d6b-f64d-469e-b970-581d249d8554"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:57:31.445181 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a76847f5-6b52-486c-9a31-c10c477b0c95 tempest-TestSecurityGroupsBasicOps-1194795190 tempest-TestSecurityGroupsBasicOps-1194795190-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:31.446267 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a76847f5-6b52-486c-9a31-c10c477b0c95 tempest-TestSecurityGroupsBasicOps-1194795190 tempest-TestSecurityGroupsBasicOps-1194795190-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:31.448146 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a76847f5-6b52-486c-9a31-c10c477b0c95 tempest-TestSecurityGroupsBasicOps-1194795190 tempest-TestSecurityGroupsBasicOps-1194795190-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:31.449237 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a76847f5-6b52-486c-9a31-c10c477b0c95 tempest-TestSecurityGroupsBasicOps-1194795190 tempest-TestSecurityGroupsBasicOps-1194795190-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:31.468941 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:57:31.586316 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-890876d4-3a19-4dd5-875d-e9d7a6b20ff5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] validate_networks() for [('a3f65d6b-f64d-469e-b970-581d249d8554', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:57:32.160848 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a76847f5-6b52-486c-9a31-c10c477b0c95 tempest-TestSecurityGroupsBasicOps-1194795190 tempest-TestSecurityGroupsBasicOps-1194795190-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f" status: 200 len: 1913 microversion: 2.1 time: 0.778203 Jul 18 02:57:32.170015 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2711/5442] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:31 2022] GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f => generated 1913 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:57:32.199735 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3834b5c2-cada-4250-9b0d-dfe8de3bfbba tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:32.202480 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3834b5c2-cada-4250-9b0d-dfe8de3bfbba tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:32.213089 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3834b5c2-cada-4250-9b0d-dfe8de3bfbba tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:32.214788 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3834b5c2-cada-4250-9b0d-dfe8de3bfbba tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:32.215826 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3834b5c2-cada-4250-9b0d-dfe8de3bfbba tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:32.216741 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3834b5c2-cada-4250-9b0d-dfe8de3bfbba tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:33.233253 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3834b5c2-cada-4250-9b0d-dfe8de3bfbba tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:33.257028 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3834b5c2-cada-4250-9b0d-dfe8de3bfbba tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d" status: 200 len: 1690 microversion: 2.1 time: 1.081460 Jul 18 02:57:33.266106 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2712/5443] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:32 2022] GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d => generated 1690 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:33.282807 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e74e194f-d965-46fe-a068-37de8ea55a89 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:33.287163 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e74e194f-d965-46fe-a068-37de8ea55a89 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: bf110ac4-8f35-4aa0-8b76-20ff6c36117d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:33.291435 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-890876d4-3a19-4dd5-875d-e9d7a6b20ff5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:57:33.292536 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-890876d4-3a19-4dd5-875d-e9d7a6b20ff5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:57:33.292949 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-890876d4-3a19-4dd5-875d-e9d7a6b20ff5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:57:33.293372 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-890876d4-3a19-4dd5-875d-e9d7a6b20ff5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:57:33.293821 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-890876d4-3a19-4dd5-875d-e9d7a6b20ff5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:57:33.304097 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e74e194f-d965-46fe-a068-37de8ea55a89 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:33.304907 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e74e194f-d965-46fe-a068-37de8ea55a89 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:33.306198 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e74e194f-d965-46fe-a068-37de8ea55a89 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:33.306839 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e74e194f-d965-46fe-a068-37de8ea55a89 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:33.344980 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-890876d4-3a19-4dd5-875d-e9d7a6b20ff5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:33.346566 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-890876d4-3a19-4dd5-875d-e9d7a6b20ff5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:33.348518 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-890876d4-3a19-4dd5-875d-e9d7a6b20ff5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:33.349653 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-890876d4-3a19-4dd5-875d-e9d7a6b20ff5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:33.376137 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-890876d4-3a19-4dd5-875d-e9d7a6b20ff5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Getting quotas for project 2ed8b12429e9420bb83700e52701910b. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:57:33.383693 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e74e194f-d965-46fe-a068-37de8ea55a89 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: bf110ac4-8f35-4aa0-8b76-20ff6c36117d] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:57:33.388829 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-890876d4-3a19-4dd5-875d-e9d7a6b20ff5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Getting quotas for user 5436715af849460f87ff6b62dbd491a0 and project 2ed8b12429e9420bb83700e52701910b. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:57:33.407501 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-890876d4-3a19-4dd5-875d-e9d7a6b20ff5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:57:33.411258 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-890876d4-3a19-4dd5-875d-e9d7a6b20ff5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 48651886-4cc5-4dee-97b4-53502b1045af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:57:33.567842 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-890876d4-3a19-4dd5-875d-e9d7a6b20ff5 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.112048 Jul 18 02:57:33.580387 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2732/5444] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:57:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:57:33.586724 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-febc8381-6e04-44a0-82a3-f3fefc29e823 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:33.587635 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-febc8381-6e04-44a0-82a3-f3fefc29e823 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 48651886-4cc5-4dee-97b4-53502b1045af] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:33.626297 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e74e194f-d965-46fe-a068-37de8ea55a89 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "DELETE /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d" status: 204 len: 0 microversion: 2.1 time: 0.358408 Jul 18 02:57:33.626997 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2713/5445] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:57:33 2022] DELETE /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:57:33.649587 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d2120228-fe17-42c2-8e58-64aeb8f5de0d tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:33.650964 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d2120228-fe17-42c2-8e58-64aeb8f5de0d tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: bf110ac4-8f35-4aa0-8b76-20ff6c36117d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:33.665881 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d2120228-fe17-42c2-8e58-64aeb8f5de0d tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:33.666783 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d2120228-fe17-42c2-8e58-64aeb8f5de0d tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:33.668077 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d2120228-fe17-42c2-8e58-64aeb8f5de0d tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:33.668846 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d2120228-fe17-42c2-8e58-64aeb8f5de0d tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:33.783289 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-febc8381-6e04-44a0-82a3-f3fefc29e823 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:33.826709 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-febc8381-6e04-44a0-82a3-f3fefc29e823 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/48651886-4cc5-4dee-97b4-53502b1045af" status: 200 len: 1215 microversion: 2.1 time: 0.244853 Jul 18 02:57:33.827747 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2733/5446] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:33 2022] GET /compute/v2.1/servers/48651886-4cc5-4dee-97b4-53502b1045af => generated 1215 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:33.902480 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d2120228-fe17-42c2-8e58-64aeb8f5de0d tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7444bc0744533861c32353fa7f597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f043fa9beaa4ac6b209d67346479c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:33.912808 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d2120228-fe17-42c2-8e58-64aeb8f5de0d tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "GET /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d" status: 200 len: 1478 microversion: 2.1 time: 0.279045 Jul 18 02:57:33.919294 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2714/5447] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:33 2022] GET /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d => generated 1478 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:34.308907 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-60f00dfc-5ddd-4276-8a7a-37fa2a5af295 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:34.309909 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-60f00dfc-5ddd-4276-8a7a-37fa2a5af295 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:34.322634 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60f00dfc-5ddd-4276-8a7a-37fa2a5af295 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:34.325440 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60f00dfc-5ddd-4276-8a7a-37fa2a5af295 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:34.326637 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60f00dfc-5ddd-4276-8a7a-37fa2a5af295 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:34.327109 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60f00dfc-5ddd-4276-8a7a-37fa2a5af295 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:34.406156 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:57:34.853635 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cd296a96-ec24-467e-ac60-4815cad792c7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:34.856992 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cd296a96-ec24-467e-ac60-4815cad792c7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 48651886-4cc5-4dee-97b4-53502b1045af] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:34.877463 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cd296a96-ec24-467e-ac60-4815cad792c7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:34.884101 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cd296a96-ec24-467e-ac60-4815cad792c7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:34.885367 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cd296a96-ec24-467e-ac60-4815cad792c7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:34.888369 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cd296a96-ec24-467e-ac60-4815cad792c7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:34.976575 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-60f00dfc-5ddd-4276-8a7a-37fa2a5af295 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:35.022231 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-60f00dfc-5ddd-4276-8a7a-37fa2a5af295 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d" status: 200 len: 1690 microversion: 2.1 time: 0.715477 Jul 18 02:57:35.028706 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2734/5448] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:34 2022] GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d => generated 1690 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:35.049633 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d9bfc8db-9294-488c-af18-01aab7e6251c tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:35.067153 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d9bfc8db-9294-488c-af18-01aab7e6251c tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: bf110ac4-8f35-4aa0-8b76-20ff6c36117d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:35.127018 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d9bfc8db-9294-488c-af18-01aab7e6251c tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:35.128095 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d9bfc8db-9294-488c-af18-01aab7e6251c tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:35.129661 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d9bfc8db-9294-488c-af18-01aab7e6251c tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:35.139419 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d9bfc8db-9294-488c-af18-01aab7e6251c tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:35.364949 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-cd296a96-ec24-467e-ac60-4815cad792c7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:35.383934 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cd296a96-ec24-467e-ac60-4815cad792c7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/48651886-4cc5-4dee-97b4-53502b1045af" status: 200 len: 1219 microversion: 2.1 time: 0.530018 Jul 18 02:57:35.389691 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2715/5449] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:34 2022] GET /compute/v2.1/servers/48651886-4cc5-4dee-97b4-53502b1045af => generated 1219 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:35.683653 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d9bfc8db-9294-488c-af18-01aab7e6251c tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7444bc0744533861c32353fa7f597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f043fa9beaa4ac6b209d67346479c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:35.724281 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d9bfc8db-9294-488c-af18-01aab7e6251c tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "GET /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d" status: 200 len: 1478 microversion: 2.1 time: 0.693527 Jul 18 02:57:35.725776 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2735/5450] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:35 2022] GET /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d => generated 1478 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:36.053768 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-426596d0-6a75-4e3b-bc2b-79214ba4cb05 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:36.055110 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-426596d0-6a75-4e3b-bc2b-79214ba4cb05 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:36.069973 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-426596d0-6a75-4e3b-bc2b-79214ba4cb05 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:36.074542 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-426596d0-6a75-4e3b-bc2b-79214ba4cb05 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:36.075759 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-426596d0-6a75-4e3b-bc2b-79214ba4cb05 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:36.079369 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-426596d0-6a75-4e3b-bc2b-79214ba4cb05 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:36.415427 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cc0c827a-8c3b-400e-b16b-f865bea01c6b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:36.416340 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cc0c827a-8c3b-400e-b16b-f865bea01c6b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 48651886-4cc5-4dee-97b4-53502b1045af] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:36.439934 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cc0c827a-8c3b-400e-b16b-f865bea01c6b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:36.441688 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cc0c827a-8c3b-400e-b16b-f865bea01c6b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:36.445048 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cc0c827a-8c3b-400e-b16b-f865bea01c6b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:36.446368 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cc0c827a-8c3b-400e-b16b-f865bea01c6b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:36.751619 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cc0c827a-8c3b-400e-b16b-f865bea01c6b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:36.789055 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cc0c827a-8c3b-400e-b16b-f865bea01c6b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/48651886-4cc5-4dee-97b4-53502b1045af" status: 200 len: 1273 microversion: 2.1 time: 0.362785 Jul 18 02:57:36.792459 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2736/5451] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:36 2022] GET /compute/v2.1/servers/48651886-4cc5-4dee-97b4-53502b1045af => generated 1273 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:57:36.827658 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-1d4558b8-d2fd-4252-aa17-baf37d92e5fc req-1e12359f-b8e7-4283-9831-1236cf84359e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fed1346a-e87d-4555-bb7b-7eb3612c010d", "name": "network-vif-unplugged", "status": "completed", "tag": "99659616-8ddc-428e-98c5-bd637a4e96cb"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:57:36.874316 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-1d4558b8-d2fd-4252-aa17-baf37d92e5fc req-1e12359f-b8e7-4283-9831-1236cf84359e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:36.876719 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-1d4558b8-d2fd-4252-aa17-baf37d92e5fc req-1e12359f-b8e7-4283-9831-1236cf84359e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:36.896679 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-426596d0-6a75-4e3b-bc2b-79214ba4cb05 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:36.914956 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-426596d0-6a75-4e3b-bc2b-79214ba4cb05 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d" status: 200 len: 1690 microversion: 2.1 time: 0.865496 Jul 18 02:57:36.917149 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-1d4558b8-d2fd-4252-aa17-baf37d92e5fc req-1e12359f-b8e7-4283-9831-1236cf84359e service nova] Creating event network-vif-unplugged:99659616-8ddc-428e-98c5-bd637a4e96cb for instance fed1346a-e87d-4555-bb7b-7eb3612c010d on n-h2-465891-3 Jul 18 02:57:36.918989 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2716/5452] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:36 2022] GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d => generated 1690 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:57:36.932031 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6bfddc3b-6b87-4912-a810-e639705bb53d tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:36.934148 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6bfddc3b-6b87-4912-a810-e639705bb53d tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: bf110ac4-8f35-4aa0-8b76-20ff6c36117d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:36.939226 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-1d4558b8-d2fd-4252-aa17-baf37d92e5fc req-1e12359f-b8e7-4283-9831-1236cf84359e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.124473 Jul 18 02:57:36.940562 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2737/5453] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:57:36.948295 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6bfddc3b-6b87-4912-a810-e639705bb53d tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:36.949800 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6bfddc3b-6b87-4912-a810-e639705bb53d tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:36.950973 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6bfddc3b-6b87-4912-a810-e639705bb53d tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:36.953415 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6bfddc3b-6b87-4912-a810-e639705bb53d tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:37.234035 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6bfddc3b-6b87-4912-a810-e639705bb53d tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7444bc0744533861c32353fa7f597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f043fa9beaa4ac6b209d67346479c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:37.254986 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6bfddc3b-6b87-4912-a810-e639705bb53d tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "GET /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d" status: 200 len: 1478 microversion: 2.1 time: 0.334270 Jul 18 02:57:37.256268 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2717/5454] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:36 2022] GET /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d => generated 1478 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:37.821361 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ed8394b9-cc11-401e-b56b-33af7ca155bf tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:37.822423 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ed8394b9-cc11-401e-b56b-33af7ca155bf tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 48651886-4cc5-4dee-97b4-53502b1045af] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:37.842872 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:57:37.844993 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ed8394b9-cc11-401e-b56b-33af7ca155bf tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:37.845476 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ed8394b9-cc11-401e-b56b-33af7ca155bf tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:37.850704 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ed8394b9-cc11-401e-b56b-33af7ca155bf tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:37.851866 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ed8394b9-cc11-401e-b56b-33af7ca155bf tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:37.944753 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f11390a5-b1b4-42ec-b84a-37f62014ad1f tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:37.945487 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f11390a5-b1b4-42ec-b84a-37f62014ad1f tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:37.961006 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f11390a5-b1b4-42ec-b84a-37f62014ad1f tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:37.961632 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f11390a5-b1b4-42ec-b84a-37f62014ad1f tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:37.963003 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f11390a5-b1b4-42ec-b84a-37f62014ad1f tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:37.964279 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f11390a5-b1b4-42ec-b84a-37f62014ad1f tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:38.344578 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ed8394b9-cc11-401e-b56b-33af7ca155bf tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:38.379470 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ed8394b9-cc11-401e-b56b-33af7ca155bf tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/48651886-4cc5-4dee-97b4-53502b1045af" status: 200 len: 1273 microversion: 2.1 time: 0.559881 Jul 18 02:57:38.388423 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2738/5455] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:37 2022] GET /compute/v2.1/servers/48651886-4cc5-4dee-97b4-53502b1045af => generated 1273 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:38.394751 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d082aec8-2100-4041-a154-a936e4cecb9e tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:38.395722 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d082aec8-2100-4041-a154-a936e4cecb9e tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: bf110ac4-8f35-4aa0-8b76-20ff6c36117d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:38.406488 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d082aec8-2100-4041-a154-a936e4cecb9e tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:38.406963 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d082aec8-2100-4041-a154-a936e4cecb9e tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:38.408340 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d082aec8-2100-4041-a154-a936e4cecb9e tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:38.408805 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d082aec8-2100-4041-a154-a936e4cecb9e tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:38.893938 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d082aec8-2100-4041-a154-a936e4cecb9e tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7444bc0744533861c32353fa7f597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f043fa9beaa4ac6b209d67346479c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:38.907616 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d082aec8-2100-4041-a154-a936e4cecb9e tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "GET /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d" status: 200 len: 1478 microversion: 2.1 time: 0.516630 Jul 18 02:57:38.908637 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2739/5456] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:38 2022] GET /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d => generated 1478 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:38.986412 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-1ae2c097-6b04-4e6b-85a1-61e515f789de req-d677ad41-c3d4-4f35-a93c-a811b14df520 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf110ac4-8f35-4aa0-8b76-20ff6c36117d", "name": "network-vif-deleted", "tag": "630934ae-7a74-40fe-a1b9-608c9919ef10"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:57:39.022958 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f11390a5-b1b4-42ec-b84a-37f62014ad1f tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:39.045062 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-1ae2c097-6b04-4e6b-85a1-61e515f789de req-d677ad41-c3d4-4f35-a93c-a811b14df520 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:39.050180 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f11390a5-b1b4-42ec-b84a-37f62014ad1f tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d" status: 200 len: 1690 microversion: 2.1 time: 1.108418 Jul 18 02:57:39.052878 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2718/5457] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:37 2022] GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d => generated 1690 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:57:39.053908 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-1ae2c097-6b04-4e6b-85a1-61e515f789de req-d677ad41-c3d4-4f35-a93c-a811b14df520 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:39.092232 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-1ae2c097-6b04-4e6b-85a1-61e515f789de req-d677ad41-c3d4-4f35-a93c-a811b14df520 service nova] Creating event network-vif-deleted:630934ae-7a74-40fe-a1b9-608c9919ef10 for instance bf110ac4-8f35-4aa0-8b76-20ff6c36117d on n-h1-465891-3 Jul 18 02:57:39.120338 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-1ae2c097-6b04-4e6b-85a1-61e515f789de req-d677ad41-c3d4-4f35-a93c-a811b14df520 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140405 Jul 18 02:57:39.123851 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2740/5458] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:57:39.407808 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-128e9a4c-5221-476a-8fc0-01a67ff3635b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:39.410131 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-128e9a4c-5221-476a-8fc0-01a67ff3635b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 48651886-4cc5-4dee-97b4-53502b1045af] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:39.418282 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:57:39.464626 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-128e9a4c-5221-476a-8fc0-01a67ff3635b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:39.465414 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-128e9a4c-5221-476a-8fc0-01a67ff3635b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:39.466477 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-128e9a4c-5221-476a-8fc0-01a67ff3635b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:39.466947 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-128e9a4c-5221-476a-8fc0-01a67ff3635b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:39.706348 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-128e9a4c-5221-476a-8fc0-01a67ff3635b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:39.716923 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-128e9a4c-5221-476a-8fc0-01a67ff3635b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/48651886-4cc5-4dee-97b4-53502b1045af" status: 200 len: 1273 microversion: 2.1 time: 0.321694 Jul 18 02:57:39.720209 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2719/5459] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:39 2022] GET /compute/v2.1/servers/48651886-4cc5-4dee-97b4-53502b1045af => generated 1273 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:39.928970 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ee8df853-dca1-434b-b13a-6164d2b04ac8 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:39.930639 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ee8df853-dca1-434b-b13a-6164d2b04ac8 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: bf110ac4-8f35-4aa0-8b76-20ff6c36117d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:39.938497 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ee8df853-dca1-434b-b13a-6164d2b04ac8 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:39.939425 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ee8df853-dca1-434b-b13a-6164d2b04ac8 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:39.940602 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ee8df853-dca1-434b-b13a-6164d2b04ac8 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:39.941341 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ee8df853-dca1-434b-b13a-6164d2b04ac8 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:39.958650 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-ee8df853-dca1-434b-b13a-6164d2b04ac8 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] HTTP exception thrown: Instance bf110ac4-8f35-4aa0-8b76-20ff6c36117d could not be found. Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ee8df853-dca1-434b-b13a-6164d2b04ac8 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Request method failure captured: Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d HTTP/1.1 Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MuT-QP9r5hqrr8SkJ3od_6Hpsewj2p1q6CERFwdy-D8XzF--1P3yweBKgv3dC36fuVGssLjSiDJiZWNyue6P8TT27OFHObbklqyO0L-grvF-L3zadVzngu-BxhcSeWP-9k4r5DoAGJKVjz7E6871XyNnCt8j-izQLnrCCvyL7za9KI Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 0f043fa9beaa4ac6b209d67346479c57 Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1639077855 Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0f043fa9beaa4ac6b209d67346479c57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0f043fa9beaa4ac6b209d67346479c57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0f043fa9beaa4ac6b209d67346479c57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0f043fa9beaa4ac6b209d67346479c57"}]}] Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1639077855 Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 0f043fa9beaa4ac6b209d67346479c57 Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1639077855 Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-TestSecurityGroupsBasicOps-1639077855-project Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: b6c7444bc0744533861c32353fa7f597 Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1639077855-project Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance bf110ac4-8f35-4aa0-8b76-20ff6c36117d could not be found. Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'bf110ac4-8f35-4aa0-8b76-20ff6c36117d'} Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf110ac4-8f35-4aa0-8b76-20ff6c36117d could not be found. Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf110ac4-8f35-4aa0-8b76-20ff6c36117d could not be found. Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:57:39.960836 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:57:39.965310 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:57:39.965310 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:57:39.965310 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:57:39.965310 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:57:39.965310 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:57:39.965310 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf110ac4-8f35-4aa0-8b76-20ff6c36117d could not be found. Jul 18 02:57:39.965310 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:57:39.967378 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ee8df853-dca1-434b-b13a-6164d2b04ac8 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Returning 404 to user: Instance bf110ac4-8f35-4aa0-8b76-20ff6c36117d could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:57:39.968504 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ee8df853-dca1-434b-b13a-6164d2b04ac8 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "GET /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d" status: 404 len: 111 microversion: 2.1 time: 0.045498 Jul 18 02:57:39.972878 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2741/5460] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:39 2022] GET /compute/v2.1/servers/bf110ac4-8f35-4aa0-8b76-20ff6c36117d => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:57:40.078632 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8a19953a-36c7-4790-9985-c1df5e1bf1b5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:40.080073 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8a19953a-36c7-4790-9985-c1df5e1bf1b5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:40.088005 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a19953a-36c7-4790-9985-c1df5e1bf1b5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:40.089259 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a19953a-36c7-4790-9985-c1df5e1bf1b5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:40.090483 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a19953a-36c7-4790-9985-c1df5e1bf1b5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:40.091116 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a19953a-36c7-4790-9985-c1df5e1bf1b5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:40.741692 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9059ce58-b4d5-496f-93f2-29843f2f2626 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:40.743908 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9059ce58-b4d5-496f-93f2-29843f2f2626 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 48651886-4cc5-4dee-97b4-53502b1045af] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:40.767935 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9059ce58-b4d5-496f-93f2-29843f2f2626 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:40.768867 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9059ce58-b4d5-496f-93f2-29843f2f2626 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:40.772554 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9059ce58-b4d5-496f-93f2-29843f2f2626 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:40.773563 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9059ce58-b4d5-496f-93f2-29843f2f2626 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:41.684193 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8a19953a-36c7-4790-9985-c1df5e1bf1b5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:41.701548 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8a19953a-36c7-4790-9985-c1df5e1bf1b5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d" status: 200 len: 1690 microversion: 2.1 time: 1.630585 Jul 18 02:57:41.704694 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2720/5461] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:40 2022] GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d => generated 1690 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:57:42.019105 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9059ce58-b4d5-496f-93f2-29843f2f2626 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:42.031124 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9059ce58-b4d5-496f-93f2-29843f2f2626 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/48651886-4cc5-4dee-97b4-53502b1045af" status: 200 len: 1315 microversion: 2.1 time: 1.295630 Jul 18 02:57:42.032698 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2742/5462] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:40 2022] GET /compute/v2.1/servers/48651886-4cc5-4dee-97b4-53502b1045af => generated 1315 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:57:42.736156 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-25103729-e8e9-4bbf-8171-6b309ec6eb13 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:42.737544 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-25103729-e8e9-4bbf-8171-6b309ec6eb13 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:42.761531 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25103729-e8e9-4bbf-8171-6b309ec6eb13 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:42.762777 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25103729-e8e9-4bbf-8171-6b309ec6eb13 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:42.764405 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25103729-e8e9-4bbf-8171-6b309ec6eb13 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:42.765115 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-25103729-e8e9-4bbf-8171-6b309ec6eb13 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:43.064940 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-18ee6803-4644-481b-8cb4-7ff0867e2a86 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:43.065732 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-18ee6803-4644-481b-8cb4-7ff0867e2a86 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 48651886-4cc5-4dee-97b4-53502b1045af] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:43.079721 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-18ee6803-4644-481b-8cb4-7ff0867e2a86 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:43.081449 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-18ee6803-4644-481b-8cb4-7ff0867e2a86 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:43.084952 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-18ee6803-4644-481b-8cb4-7ff0867e2a86 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:43.088999 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-18ee6803-4644-481b-8cb4-7ff0867e2a86 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:43.365920 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:57:43.579894 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-25103729-e8e9-4bbf-8171-6b309ec6eb13 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:43.596617 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-25103729-e8e9-4bbf-8171-6b309ec6eb13 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d" status: 200 len: 1680 microversion: 2.1 time: 0.865234 Jul 18 02:57:43.603503 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2721/5463] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:42 2022] GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d => generated 1680 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:43.626700 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-aeec3c5a-e131-43d0-8df8-5079c7beec3e tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:43.627650 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-aeec3c5a-e131-43d0-8df8-5079c7beec3e tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:43.640551 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aeec3c5a-e131-43d0-8df8-5079c7beec3e tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:43.641341 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aeec3c5a-e131-43d0-8df8-5079c7beec3e tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:43.643726 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aeec3c5a-e131-43d0-8df8-5079c7beec3e tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:43.644515 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aeec3c5a-e131-43d0-8df8-5079c7beec3e tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:43.811456 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=8 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:57:44.082275 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-18ee6803-4644-481b-8cb4-7ff0867e2a86 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:44.130814 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-18ee6803-4644-481b-8cb4-7ff0867e2a86 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/48651886-4cc5-4dee-97b4-53502b1045af" status: 200 len: 1315 microversion: 2.1 time: 1.071792 Jul 18 02:57:44.138338 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2743/5464] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:43 2022] GET /compute/v2.1/servers/48651886-4cc5-4dee-97b4-53502b1045af => generated 1315 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:57:44.264290 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-aeec3c5a-e131-43d0-8df8-5079c7beec3e tempest-TestNetworkAdvancedServerOps-937237149 tempest-TestNetworkAdvancedServerOps-937237149-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d" status: 200 len: 1831 microversion: 2.1 time: 0.638185 Jul 18 02:57:44.287516 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2722/5465] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:43 2022] GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d => generated 1831 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:57:44.299515 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a9c0027b-b3eb-429d-92f3-9fbf95f3f3a9 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:44.301089 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a9c0027b-b3eb-429d-92f3-9fbf95f3f3a9 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:44.309925 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9c0027b-b3eb-429d-92f3-9fbf95f3f3a9 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:44.311224 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9c0027b-b3eb-429d-92f3-9fbf95f3f3a9 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:44.312809 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9c0027b-b3eb-429d-92f3-9fbf95f3f3a9 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:44.315671 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9c0027b-b3eb-429d-92f3-9fbf95f3f3a9 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:44.596463 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-1ee713d0-a8f4-4612-84c7-4bc42bbc064a req-27dd48bc-01ff-4362-9686-50263b7e13a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48651886-4cc5-4dee-97b4-53502b1045af", "tag": "e1309925-70d7-4a8a-967d-ec03dd2490ef"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:57:44.657381 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-1ee713d0-a8f4-4612-84c7-4bc42bbc064a req-27dd48bc-01ff-4362-9686-50263b7e13a8 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:44.659278 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-1ee713d0-a8f4-4612-84c7-4bc42bbc064a req-27dd48bc-01ff-4362-9686-50263b7e13a8 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:44.727128 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-1ee713d0-a8f4-4612-84c7-4bc42bbc064a req-27dd48bc-01ff-4362-9686-50263b7e13a8 service nova] Creating event network-changed:e1309925-70d7-4a8a-967d-ec03dd2490ef for instance 48651886-4cc5-4dee-97b4-53502b1045af on n-h2-465891-3 Jul 18 02:57:44.738480 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-1ee713d0-a8f4-4612-84c7-4bc42bbc064a req-27dd48bc-01ff-4362-9686-50263b7e13a8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158178 Jul 18 02:57:44.740447 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2723/5466] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:57:44.816727 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a9c0027b-b3eb-429d-92f3-9fbf95f3f3a9 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:44.833191 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a9c0027b-b3eb-429d-92f3-9fbf95f3f3a9 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d" status: 200 len: 1680 microversion: 2.1 time: 0.537475 Jul 18 02:57:44.833938 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2744/5467] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:44 2022] GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d => generated 1680 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:45.041260 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a39d2258-de59-4467-bdbe-10d5fd2ab288 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:57:45.047371 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a39d2258-de59-4467-bdbe-10d5fd2ab288 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:45.076898 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a39d2258-de59-4467-bdbe-10d5fd2ab288 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:45.080100 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a39d2258-de59-4467-bdbe-10d5fd2ab288 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:45.082426 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a39d2258-de59-4467-bdbe-10d5fd2ab288 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:45.083571 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a39d2258-de59-4467-bdbe-10d5fd2ab288 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:45.175506 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1f2b184d-edc1-48c1-9d17-5373051cc0f7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:45.184303 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1f2b184d-edc1-48c1-9d17-5373051cc0f7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 48651886-4cc5-4dee-97b4-53502b1045af] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:45.238862 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a39d2258-de59-4467-bdbe-10d5fd2ab288 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "POST /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d/action" status: 200 len: 38596 microversion: 2.1 time: 0.210148 Jul 18 02:57:45.248961 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1f2b184d-edc1-48c1-9d17-5373051cc0f7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:45.251548 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2724/5468] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:57:45 2022] POST /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d/action => generated 38596 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:57:45.251976 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1f2b184d-edc1-48c1-9d17-5373051cc0f7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:45.253523 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1f2b184d-edc1-48c1-9d17-5373051cc0f7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:45.269817 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1f2b184d-edc1-48c1-9d17-5373051cc0f7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:45.960558 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1f2b184d-edc1-48c1-9d17-5373051cc0f7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:45.984186 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1f2b184d-edc1-48c1-9d17-5373051cc0f7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/48651886-4cc5-4dee-97b4-53502b1045af" status: 200 len: 1315 microversion: 2.1 time: 0.825766 Jul 18 02:57:45.994349 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2745/5469] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:45 2022] GET /compute/v2.1/servers/48651886-4cc5-4dee-97b4-53502b1045af => generated 1315 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:57:47.028463 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-78eab346-daf0-4383-9a41-72753941359c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:47.030259 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-78eab346-daf0-4383-9a41-72753941359c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 48651886-4cc5-4dee-97b4-53502b1045af] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:47.052569 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-78eab346-daf0-4383-9a41-72753941359c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:47.061439 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-78eab346-daf0-4383-9a41-72753941359c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:47.064174 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-78eab346-daf0-4383-9a41-72753941359c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:47.067324 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-78eab346-daf0-4383-9a41-72753941359c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:47.858946 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-78eab346-daf0-4383-9a41-72753941359c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:47.882775 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-78eab346-daf0-4383-9a41-72753941359c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/48651886-4cc5-4dee-97b4-53502b1045af" status: 200 len: 1315 microversion: 2.1 time: 0.860509 Jul 18 02:57:47.886730 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2725/5470] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:47 2022] GET /compute/v2.1/servers/48651886-4cc5-4dee-97b4-53502b1045af => generated 1315 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:48.912055 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d710a08d-416c-4c7a-9767-980583d5a17c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:48.913469 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d710a08d-416c-4c7a-9767-980583d5a17c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 48651886-4cc5-4dee-97b4-53502b1045af] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:48.921680 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d710a08d-416c-4c7a-9767-980583d5a17c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:48.922625 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d710a08d-416c-4c7a-9767-980583d5a17c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:48.923701 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d710a08d-416c-4c7a-9767-980583d5a17c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:48.924405 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d710a08d-416c-4c7a-9767-980583d5a17c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:49.416622 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9270bb83-b378-4d0a-bbf8-d615f5e4e443 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:49.417755 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9270bb83-b378-4d0a-bbf8-d615f5e4e443 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:49.436498 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9270bb83-b378-4d0a-bbf8-d615f5e4e443 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:49.437405 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9270bb83-b378-4d0a-bbf8-d615f5e4e443 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:49.438917 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9270bb83-b378-4d0a-bbf8-d615f5e4e443 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:49.439848 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9270bb83-b378-4d0a-bbf8-d615f5e4e443 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:49.500500 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9270bb83-b378-4d0a-bbf8-d615f5e4e443 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:57:49.536055 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:57:49.693458 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9270bb83-b378-4d0a-bbf8-d615f5e4e443 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "DELETE /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d" status: 204 len: 0 microversion: 2.1 time: 0.280116 Jul 18 02:57:49.695266 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2726/5471] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:57:49 2022] DELETE /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:57:49.704106 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-0d16b00c-1be1-42aa-ab8a-2f0b3a6240a8 req-2e6e26c8-5375-4d09-a662-bc7e1b108bfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fed1346a-e87d-4555-bb7b-7eb3612c010d", "tag": "99659616-8ddc-428e-98c5-bd637a4e96cb"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:57:49.719036 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-0d16b00c-1be1-42aa-ab8a-2f0b3a6240a8 req-2e6e26c8-5375-4d09-a662-bc7e1b108bfe service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:49.719618 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-0d16b00c-1be1-42aa-ab8a-2f0b3a6240a8 req-2e6e26c8-5375-4d09-a662-bc7e1b108bfe service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:49.746021 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-0d16b00c-1be1-42aa-ab8a-2f0b3a6240a8 req-2e6e26c8-5375-4d09-a662-bc7e1b108bfe service nova] Creating event network-changed:99659616-8ddc-428e-98c5-bd637a4e96cb for instance fed1346a-e87d-4555-bb7b-7eb3612c010d on n-h1-465891-3 Jul 18 02:57:49.751955 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-0d16b00c-1be1-42aa-ab8a-2f0b3a6240a8 req-2e6e26c8-5375-4d09-a662-bc7e1b108bfe service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054888 Jul 18 02:57:49.756804 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2727/5472] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:57:49.766970 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2086f6e1-929a-4b92-87e1-308ada8badaf tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:49.768850 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2086f6e1-929a-4b92-87e1-308ada8badaf tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:49.782486 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2086f6e1-929a-4b92-87e1-308ada8badaf tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:49.783001 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2086f6e1-929a-4b92-87e1-308ada8badaf tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:49.784029 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2086f6e1-929a-4b92-87e1-308ada8badaf tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:49.784634 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2086f6e1-929a-4b92-87e1-308ada8badaf tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:49.816950 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d710a08d-416c-4c7a-9767-980583d5a17c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:49.830195 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d710a08d-416c-4c7a-9767-980583d5a17c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/48651886-4cc5-4dee-97b4-53502b1045af" status: 200 len: 1315 microversion: 2.1 time: 0.922408 Jul 18 02:57:49.837388 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2746/5473] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:48 2022] GET /compute/v2.1/servers/48651886-4cc5-4dee-97b4-53502b1045af => generated 1315 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:50.721380 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2086f6e1-929a-4b92-87e1-308ada8badaf tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:50.747602 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2086f6e1-929a-4b92-87e1-308ada8badaf tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d" status: 200 len: 1686 microversion: 2.1 time: 0.988767 Jul 18 02:57:50.755389 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2728/5474] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:49 2022] GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d => generated 1686 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:50.866173 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-19ae80bd-8f15-4755-8816-fe956a051fcc tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:50.867489 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-19ae80bd-8f15-4755-8816-fe956a051fcc tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 48651886-4cc5-4dee-97b4-53502b1045af] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:50.911917 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-19ae80bd-8f15-4755-8816-fe956a051fcc tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:50.912733 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-19ae80bd-8f15-4755-8816-fe956a051fcc tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:50.914006 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-19ae80bd-8f15-4755-8816-fe956a051fcc tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:50.914777 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-19ae80bd-8f15-4755-8816-fe956a051fcc tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:51.795478 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9309c93d-1848-4bed-8b37-21c1b9b7c40d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:51.797739 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9309c93d-1848-4bed-8b37-21c1b9b7c40d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:51.817571 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9309c93d-1848-4bed-8b37-21c1b9b7c40d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:51.818827 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9309c93d-1848-4bed-8b37-21c1b9b7c40d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:51.820515 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9309c93d-1848-4bed-8b37-21c1b9b7c40d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:51.821787 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9309c93d-1848-4bed-8b37-21c1b9b7c40d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:51.927928 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9309c93d-1848-4bed-8b37-21c1b9b7c40d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:51.930022 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9309c93d-1848-4bed-8b37-21c1b9b7c40d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:51.931085 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-9309c93d-1848-4bed-8b37-21c1b9b7c40d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lazy-loading 'fault' on Instance uuid fed1346a-e87d-4555-bb7b-7eb3612c010d {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:57:52.169157 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 02:57:52.169479 n-d-465891-3 devstack@n-api.service[119544]: Mon Jul 18 02:57:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d (ip 10.222.0.57) !!! Jul 18 02:57:52.445410 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9309c93d-1848-4bed-8b37-21c1b9b7c40d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:52.455988 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9309c93d-1848-4bed-8b37-21c1b9b7c40d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d" status: 200 len: 1356 microversion: 2.1 time: 0.676560 Jul 18 02:57:52.456957 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2729/5475] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:51 2022] GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d => generated 1356 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:52.465270 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-32455033-0386-4d88-8181-0a38d1194301 req-fa9c47a1-53fe-4953-b426-a28a9c8059ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fed1346a-e87d-4555-bb7b-7eb3612c010d", "name": "network-vif-deleted", "tag": "99659616-8ddc-428e-98c5-bd637a4e96cb"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:57:52.487150 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-32455033-0386-4d88-8181-0a38d1194301 req-fa9c47a1-53fe-4953-b426-a28a9c8059ad service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:52.491825 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-32455033-0386-4d88-8181-0a38d1194301 req-fa9c47a1-53fe-4953-b426-a28a9c8059ad service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:52.541155 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-32455033-0386-4d88-8181-0a38d1194301 req-fa9c47a1-53fe-4953-b426-a28a9c8059ad service nova] Creating event network-vif-deleted:99659616-8ddc-428e-98c5-bd637a4e96cb for instance fed1346a-e87d-4555-bb7b-7eb3612c010d on n-h1-465891-3 Jul 18 02:57:52.559551 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-32455033-0386-4d88-8181-0a38d1194301 req-fa9c47a1-53fe-4953-b426-a28a9c8059ad service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100650 Jul 18 02:57:52.561195 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2730/5476] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:57:52.605551 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-19ae80bd-8f15-4755-8816-fe956a051fcc tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:52.625772 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-19ae80bd-8f15-4755-8816-fe956a051fcc tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/48651886-4cc5-4dee-97b4-53502b1045af" status: 200 len: 1315 microversion: 2.1 time: 1.769699 Jul 18 02:57:52.627099 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2747/5477] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:50 2022] GET /compute/v2.1/servers/48651886-4cc5-4dee-97b4-53502b1045af => generated 1315 bytes in 1772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:53.168932 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-fe4f2a74-206c-49c1-9b15-79caac7dce34 req-208091fc-e899-4dbb-aae0-fd0480e04650 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48651886-4cc5-4dee-97b4-53502b1045af", "name": "network-vif-plugged", "status": "completed", "tag": "e1309925-70d7-4a8a-967d-ec03dd2490ef"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:57:53.186940 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-fe4f2a74-206c-49c1-9b15-79caac7dce34 req-208091fc-e899-4dbb-aae0-fd0480e04650 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:53.187377 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-fe4f2a74-206c-49c1-9b15-79caac7dce34 req-208091fc-e899-4dbb-aae0-fd0480e04650 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:53.217317 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-fe4f2a74-206c-49c1-9b15-79caac7dce34 req-208091fc-e899-4dbb-aae0-fd0480e04650 service nova] Creating event network-vif-plugged:e1309925-70d7-4a8a-967d-ec03dd2490ef for instance 48651886-4cc5-4dee-97b4-53502b1045af on n-h2-465891-3 Jul 18 02:57:53.227636 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-fe4f2a74-206c-49c1-9b15-79caac7dce34 req-208091fc-e899-4dbb-aae0-fd0480e04650 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064600 Jul 18 02:57:53.232761 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2731/5478] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:57:53.489255 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-959b1255-83a6-47fd-854c-97c7588d82d5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:53.504054 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-959b1255-83a6-47fd-854c-97c7588d82d5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: fed1346a-e87d-4555-bb7b-7eb3612c010d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:53.540680 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-959b1255-83a6-47fd-854c-97c7588d82d5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:53.542983 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-959b1255-83a6-47fd-854c-97c7588d82d5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:53.548264 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-959b1255-83a6-47fd-854c-97c7588d82d5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:53.549424 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-959b1255-83a6-47fd-854c-97c7588d82d5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:53.611000 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-959b1255-83a6-47fd-854c-97c7588d82d5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] HTTP exception thrown: Instance fed1346a-e87d-4555-bb7b-7eb3612c010d could not be found. Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-959b1255-83a6-47fd-854c-97c7588d82d5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Request method failure captured: Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d HTTP/1.1 Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MnYuW4W0sup_YmXu0e6TfbM8UhRRyTVhU4O9V6AVf94vohRx4aPb83sBLBZeGqAob5OT52KfbhFJyFnUckm_AKJ129CUDEeh3rlnVQskw2FZl3adXOUNXwdv2KHTFmpLHnRTO3Qsn9Vcgn_cseZ_XT0zvfydkDjvO0Y6iKbO3M5yvk Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: fa240dfd375a45efb42fc04807acf847 Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1583539660 Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fa240dfd375a45efb42fc04807acf847"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fa240dfd375a45efb42fc04807acf847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fa240dfd375a45efb42fc04807acf847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fa240dfd375a45efb42fc04807acf847"}]}] Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1583539660 Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: fa240dfd375a45efb42fc04807acf847 Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1583539660 Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-TestNetworkAdvancedServerOps-1583539660-project Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 381a2ab772ff495cb85b89a85a267cfe Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1583539660-project Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance fed1346a-e87d-4555-bb7b-7eb3612c010d could not be found. Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'fed1346a-e87d-4555-bb7b-7eb3612c010d'} Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fed1346a-e87d-4555-bb7b-7eb3612c010d could not be found. Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fed1346a-e87d-4555-bb7b-7eb3612c010d could not be found. Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:57:53.623579 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:57:53.640405 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:57:53.640405 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:57:53.640405 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:57:53.640405 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:57:53.640405 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:57:53.640405 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:57:53.640405 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fed1346a-e87d-4555-bb7b-7eb3612c010d could not be found. Jul 18 02:57:53.640405 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:57:53.640405 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-959b1255-83a6-47fd-854c-97c7588d82d5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Returning 404 to user: Instance fed1346a-e87d-4555-bb7b-7eb3612c010d could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:57:53.646555 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-959b1255-83a6-47fd-854c-97c7588d82d5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d" status: 404 len: 111 microversion: 2.1 time: 0.164375 Jul 18 02:57:53.648149 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2748/5479] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:53 2022] GET /compute/v2.1/servers/fed1346a-e87d-4555-bb7b-7eb3612c010d => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:57:53.683086 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d717f90d-cde6-4963-9c7e-ee6d843e7e77 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:53.684816 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d717f90d-cde6-4963-9c7e-ee6d843e7e77 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 48651886-4cc5-4dee-97b4-53502b1045af] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:53.717735 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d717f90d-cde6-4963-9c7e-ee6d843e7e77 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:53.720112 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d717f90d-cde6-4963-9c7e-ee6d843e7e77 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:53.725772 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d717f90d-cde6-4963-9c7e-ee6d843e7e77 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:53.727007 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d717f90d-cde6-4963-9c7e-ee6d843e7e77 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:54.281461 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1215ce61-c4c2-48a6-817f-d43bbba20c40 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:54.282343 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1215ce61-c4c2-48a6-817f-d43bbba20c40 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:54.296623 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1215ce61-c4c2-48a6-817f-d43bbba20c40 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:54.297234 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1215ce61-c4c2-48a6-817f-d43bbba20c40 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:54.298180 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1215ce61-c4c2-48a6-817f-d43bbba20c40 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:54.298749 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1215ce61-c4c2-48a6-817f-d43bbba20c40 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:54.351172 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1215ce61-c4c2-48a6-817f-d43bbba20c40 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:57:54.386936 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d717f90d-cde6-4963-9c7e-ee6d843e7e77 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:54.407709 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d717f90d-cde6-4963-9c7e-ee6d843e7e77 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/48651886-4cc5-4dee-97b4-53502b1045af" status: 200 len: 1315 microversion: 2.1 time: 0.746564 Jul 18 02:57:54.409893 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2749/5480] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:53 2022] GET /compute/v2.1/servers/48651886-4cc5-4dee-97b4-53502b1045af => generated 1315 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:57:54.508598 n-d-465891-3 devstack@n-api.service[119543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 02:57:54.508861 n-d-465891-3 devstack@n-api.service[119543]: Mon Jul 18 02:57:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 02:57:54.519229 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1215ce61-c4c2-48a6-817f-d43bbba20c40 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "DELETE /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5" status: 204 len: 0 microversion: 2.1 time: 1.003580 Jul 18 02:57:54.520962 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2732/5481] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:57:53 2022] DELETE /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 => generated 0 bytes in 1008 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:57:54.530966 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-448ae9cc-e118-484e-83b4-f0b826373e92 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:54.532646 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-448ae9cc-e118-484e-83b4-f0b826373e92 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:54.546028 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-448ae9cc-e118-484e-83b4-f0b826373e92 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:54.546791 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-448ae9cc-e118-484e-83b4-f0b826373e92 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:54.547838 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-448ae9cc-e118-484e-83b4-f0b826373e92 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:54.548476 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-448ae9cc-e118-484e-83b4-f0b826373e92 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:55.044886 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-448ae9cc-e118-484e-83b4-f0b826373e92 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:55.059032 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-448ae9cc-e118-484e-83b4-f0b826373e92 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5" status: 200 len: 1576 microversion: 2.1 time: 0.533030 Jul 18 02:57:55.075043 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2750/5482] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:54 2022] GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 => generated 1576 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:55.428845 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ea00686c-b415-4529-9909-882ad323959d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:55.429800 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ea00686c-b415-4529-9909-882ad323959d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 48651886-4cc5-4dee-97b4-53502b1045af] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:55.450955 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea00686c-b415-4529-9909-882ad323959d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:55.451549 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea00686c-b415-4529-9909-882ad323959d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:55.452452 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea00686c-b415-4529-9909-882ad323959d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:55.453243 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea00686c-b415-4529-9909-882ad323959d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:55.930381 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ea00686c-b415-4529-9909-882ad323959d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:55.940491 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ea00686c-b415-4529-9909-882ad323959d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/48651886-4cc5-4dee-97b4-53502b1045af" status: 200 len: 1503 microversion: 2.1 time: 0.515914 Jul 18 02:57:55.952872 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2733/5483] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:55 2022] GET /compute/v2.1/servers/48651886-4cc5-4dee-97b4-53502b1045af => generated 1503 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:57:55.961588 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2b7a6e3c-6e73-48de-b530-6ea5f7d7ad24 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:57:55.962461 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2b7a6e3c-6e73-48de-b530-6ea5f7d7ad24 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 48651886-4cc5-4dee-97b4-53502b1045af] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:55.973414 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b7a6e3c-6e73-48de-b530-6ea5f7d7ad24 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:55.974321 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b7a6e3c-6e73-48de-b530-6ea5f7d7ad24 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:55.975407 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b7a6e3c-6e73-48de-b530-6ea5f7d7ad24 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:55.976114 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b7a6e3c-6e73-48de-b530-6ea5f7d7ad24 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:56.092767 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0f510f74-ece9-4c4b-9c0c-968578432ac5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:56.094584 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0f510f74-ece9-4c4b-9c0c-968578432ac5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:56.148673 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f510f74-ece9-4c4b-9c0c-968578432ac5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:56.160923 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f510f74-ece9-4c4b-9c0c-968578432ac5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:56.163731 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f510f74-ece9-4c4b-9c0c-968578432ac5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:56.164933 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f510f74-ece9-4c4b-9c0c-968578432ac5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:56.994078 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.network.security_group_api [None req-2b7a6e3c-6e73-48de-b530-6ea5f7d7ad24 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Removing security group 0ef0b9f8-d878-4d9f-b002-ed80eb9c4ed5 from port e1309925-70d7-4a8a-967d-ec03dd2490ef Jul 18 02:57:57.114755 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0f510f74-ece9-4c4b-9c0c-968578432ac5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:57.123138 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0f510f74-ece9-4c4b-9c0c-968578432ac5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5" status: 200 len: 1576 microversion: 2.1 time: 1.040109 Jul 18 02:57:57.138185 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2734/5484] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:56 2022] GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 => generated 1576 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:57:57.143367 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9150bdd4-8f22-4ac8-8d97-7a05524b3010 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:57.143873 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9150bdd4-8f22-4ac8-8d97-7a05524b3010 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: 6f05fde6-142f-4459-b468-06efd59ff42f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:57.155925 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9150bdd4-8f22-4ac8-8d97-7a05524b3010 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:57.156385 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9150bdd4-8f22-4ac8-8d97-7a05524b3010 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:57.157213 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9150bdd4-8f22-4ac8-8d97-7a05524b3010 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:57.157672 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9150bdd4-8f22-4ac8-8d97-7a05524b3010 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:57.218585 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9150bdd4-8f22-4ac8-8d97-7a05524b3010 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: 6f05fde6-142f-4459-b468-06efd59ff42f] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:57:57.551292 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9150bdd4-8f22-4ac8-8d97-7a05524b3010 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "DELETE /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f" status: 204 len: 0 microversion: 2.1 time: 0.411661 Jul 18 02:57:57.552253 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2735/5485] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:57:57 2022] DELETE /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:57:57.558642 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-ec70b3a9-fe0a-44c4-bbf8-aad907c41137 req-77ce551d-1865-4cfe-89c9-bf2432082173 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f05fde6-142f-4459-b468-06efd59ff42f", "tag": "68e4dfb6-2aee-4e43-85cc-21ddd9a68f3d"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:57:57.581367 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-ec70b3a9-fe0a-44c4-bbf8-aad907c41137 req-77ce551d-1865-4cfe-89c9-bf2432082173 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:57.582175 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-ec70b3a9-fe0a-44c4-bbf8-aad907c41137 req-77ce551d-1865-4cfe-89c9-bf2432082173 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:57.612703 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-ec70b3a9-fe0a-44c4-bbf8-aad907c41137 req-77ce551d-1865-4cfe-89c9-bf2432082173 service nova] Creating event network-changed:68e4dfb6-2aee-4e43-85cc-21ddd9a68f3d for instance 6f05fde6-142f-4459-b468-06efd59ff42f on n-h2-465891-3 Jul 18 02:57:57.630656 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-ec70b3a9-fe0a-44c4-bbf8-aad907c41137 req-77ce551d-1865-4cfe-89c9-bf2432082173 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076705 Jul 18 02:57:57.631286 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2736/5486] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:57:57.642724 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-57f7b122-29c8-41bb-a2f0-1acce3d9c3c8 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:57.643481 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-57f7b122-29c8-41bb-a2f0-1acce3d9c3c8 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: 6f05fde6-142f-4459-b468-06efd59ff42f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:57.661894 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-57f7b122-29c8-41bb-a2f0-1acce3d9c3c8 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:57.662372 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-57f7b122-29c8-41bb-a2f0-1acce3d9c3c8 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:57.663196 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-57f7b122-29c8-41bb-a2f0-1acce3d9c3c8 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:57.663642 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-57f7b122-29c8-41bb-a2f0-1acce3d9c3c8 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:58.452698 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-57f7b122-29c8-41bb-a2f0-1acce3d9c3c8 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7444bc0744533861c32353fa7f597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f043fa9beaa4ac6b209d67346479c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:58.499934 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-57f7b122-29c8-41bb-a2f0-1acce3d9c3c8 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f" status: 200 len: 1768 microversion: 2.1 time: 0.861795 Jul 18 02:57:58.501742 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2737/5487] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:57 2022] GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f => generated 1768 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:58.513487 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5db4287a-163e-4ac2-b16d-d4f96399cdfa tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:58.514291 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5db4287a-163e-4ac2-b16d-d4f96399cdfa tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:58.531902 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5db4287a-163e-4ac2-b16d-d4f96399cdfa tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:58.532761 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5db4287a-163e-4ac2-b16d-d4f96399cdfa tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:58.534001 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5db4287a-163e-4ac2-b16d-d4f96399cdfa tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:58.535829 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5db4287a-163e-4ac2-b16d-d4f96399cdfa tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:59.574474 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2b7a6e3c-6e73-48de-b530-6ea5f7d7ad24 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "POST /compute/v2.1/servers/48651886-4cc5-4dee-97b4-53502b1045af/action" status: 202 len: 0 microversion: 2.1 time: 3.620336 Jul 18 02:57:59.575618 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2751/5488] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:57:55 2022] POST /compute/v2.1/servers/48651886-4cc5-4dee-97b4-53502b1045af/action => generated 0 bytes in 3622 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:57:59.582012 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c840c60f-12ca-4027-8433-abcf937cfdaf tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:59.582773 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c840c60f-12ca-4027-8433-abcf937cfdaf tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: 6f05fde6-142f-4459-b468-06efd59ff42f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:59.600009 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c840c60f-12ca-4027-8433-abcf937cfdaf tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:59.602300 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c840c60f-12ca-4027-8433-abcf937cfdaf tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:59.604693 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c840c60f-12ca-4027-8433-abcf937cfdaf tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:59.610264 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c840c60f-12ca-4027-8433-abcf937cfdaf tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:59.686240 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5db4287a-163e-4ac2-b16d-d4f96399cdfa tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:59.696878 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5db4287a-163e-4ac2-b16d-d4f96399cdfa tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5" status: 200 len: 1576 microversion: 2.1 time: 1.193880 Jul 18 02:57:59.706974 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2738/5489] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:58 2022] GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 => generated 1576 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:59.708621 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5e3fc553-b4c3-4e94-9978-5d2a32ed84fe tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:59.709312 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5e3fc553-b4c3-4e94-9978-5d2a32ed84fe tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 48651886-4cc5-4dee-97b4-53502b1045af] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:59.717354 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5e3fc553-b4c3-4e94-9978-5d2a32ed84fe tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:59.717836 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5e3fc553-b4c3-4e94-9978-5d2a32ed84fe tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:59.718669 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5e3fc553-b4c3-4e94-9978-5d2a32ed84fe tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:59.719116 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5e3fc553-b4c3-4e94-9978-5d2a32ed84fe tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:00.830055 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5e3fc553-b4c3-4e94-9978-5d2a32ed84fe tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:00.840027 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5e3fc553-b4c3-4e94-9978-5d2a32ed84fe tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/48651886-4cc5-4dee-97b4-53502b1045af" status: 200 len: 1461 microversion: 2.1 time: 1.138946 Jul 18 02:58:00.855228 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2739/5490] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:59 2022] GET /compute/v2.1/servers/48651886-4cc5-4dee-97b4-53502b1045af => generated 1461 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:00.860375 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-89007586-0284-4b00-b910-617abc0852ce req-f778837f-7201-4710-a3c3-a37f1c99ebba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48651886-4cc5-4dee-97b4-53502b1045af", "tag": "e1309925-70d7-4a8a-967d-ec03dd2490ef"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:58:00.878362 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-89007586-0284-4b00-b910-617abc0852ce req-f778837f-7201-4710-a3c3-a37f1c99ebba service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:00.878834 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-89007586-0284-4b00-b910-617abc0852ce req-f778837f-7201-4710-a3c3-a37f1c99ebba service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:00.892832 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-89007586-0284-4b00-b910-617abc0852ce req-f778837f-7201-4710-a3c3-a37f1c99ebba service nova] Creating event network-changed:e1309925-70d7-4a8a-967d-ec03dd2490ef for instance 48651886-4cc5-4dee-97b4-53502b1045af on n-h2-465891-3 Jul 18 02:58:00.904189 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-89007586-0284-4b00-b910-617abc0852ce req-f778837f-7201-4710-a3c3-a37f1c99ebba service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042729 Jul 18 02:58:00.904884 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2740/5491] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:58:00.914069 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6dc3ef63-c360-48a9-992c-b648c0d17fd4 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:00.915232 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6dc3ef63-c360-48a9-992c-b648c0d17fd4 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:00.924963 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6dc3ef63-c360-48a9-992c-b648c0d17fd4 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:00.926229 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6dc3ef63-c360-48a9-992c-b648c0d17fd4 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:00.927494 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6dc3ef63-c360-48a9-992c-b648c0d17fd4 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:00.928018 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6dc3ef63-c360-48a9-992c-b648c0d17fd4 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:01.250522 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6dc3ef63-c360-48a9-992c-b648c0d17fd4 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:01.256631 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:58:01.269624 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6dc3ef63-c360-48a9-992c-b648c0d17fd4 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5" status: 200 len: 1508 microversion: 2.1 time: 0.363178 Jul 18 02:58:01.272158 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2741/5492] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:00 2022] GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 => generated 1508 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:01.279531 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-df78157a-23d3-4bda-adeb-ade9d2f7def2 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:01.280539 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-df78157a-23d3-4bda-adeb-ade9d2f7def2 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:01.290579 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-df78157a-23d3-4bda-adeb-ade9d2f7def2 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:01.293900 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-df78157a-23d3-4bda-adeb-ade9d2f7def2 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:01.295219 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-df78157a-23d3-4bda-adeb-ade9d2f7def2 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:01.296397 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-df78157a-23d3-4bda-adeb-ade9d2f7def2 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:01.577110 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c840c60f-12ca-4027-8433-abcf937cfdaf tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7444bc0744533861c32353fa7f597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f043fa9beaa4ac6b209d67346479c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:01.594181 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c840c60f-12ca-4027-8433-abcf937cfdaf tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f" status: 200 len: 1768 microversion: 2.1 time: 2.017204 Jul 18 02:58:01.612476 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2752/5493] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:59 2022] GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f => generated 1768 bytes in 2036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:02.294804 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-149a56f2-d0e5-43b4-91f4-e4b5f015f31d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:02.295894 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-149a56f2-d0e5-43b4-91f4-e4b5f015f31d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:02.308643 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-149a56f2-d0e5-43b4-91f4-e4b5f015f31d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:02.314194 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-149a56f2-d0e5-43b4-91f4-e4b5f015f31d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:02.315804 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-149a56f2-d0e5-43b4-91f4-e4b5f015f31d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:02.324079 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-149a56f2-d0e5-43b4-91f4-e4b5f015f31d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:02.533210 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-df78157a-23d3-4bda-adeb-ade9d2f7def2 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:02.547121 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-df78157a-23d3-4bda-adeb-ade9d2f7def2 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 1.272815 Jul 18 02:58:02.548003 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2742/5494] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:01 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:02.570406 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0accf939-c1da-4a40-9496-013a7412ed70 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:02.571272 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0accf939-c1da-4a40-9496-013a7412ed70 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:02.593624 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0accf939-c1da-4a40-9496-013a7412ed70 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:02.594113 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0accf939-c1da-4a40-9496-013a7412ed70 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:02.594931 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0accf939-c1da-4a40-9496-013a7412ed70 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:02.595372 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0accf939-c1da-4a40-9496-013a7412ed70 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:02.876645 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-149a56f2-d0e5-43b4-91f4-e4b5f015f31d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:02.893279 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-149a56f2-d0e5-43b4-91f4-e4b5f015f31d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5" status: 200 len: 1223 microversion: 2.1 time: 0.605906 Jul 18 02:58:02.896471 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2753/5495] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:02 2022] GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 => generated 1223 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:58:02.918766 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1612b48a-60c0-46f6-ac4b-eac89c0ebd25 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:02.922766 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1612b48a-60c0-46f6-ac4b-eac89c0ebd25 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: 6f05fde6-142f-4459-b468-06efd59ff42f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:02.943182 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1612b48a-60c0-46f6-ac4b-eac89c0ebd25 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:02.947991 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1612b48a-60c0-46f6-ac4b-eac89c0ebd25 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:02.949124 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1612b48a-60c0-46f6-ac4b-eac89c0ebd25 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:02.949813 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1612b48a-60c0-46f6-ac4b-eac89c0ebd25 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:03.002072 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:58:03.374482 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1612b48a-60c0-46f6-ac4b-eac89c0ebd25 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7444bc0744533861c32353fa7f597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f043fa9beaa4ac6b209d67346479c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:03.401938 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1612b48a-60c0-46f6-ac4b-eac89c0ebd25 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f" status: 200 len: 1530 microversion: 2.1 time: 0.502062 Jul 18 02:58:03.415789 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2754/5496] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:02 2022] GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f => generated 1530 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:03.432892 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-ecbd986c-ef58-4bfa-aa84-6862c34a6ff2 req-d6df7c73-a71f-4576-b226-ad439c901578 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bd0b1cf-40d7-4603-8746-bd306afd94f5", "name": "network-vif-deleted", "tag": "7ff729a9-545c-47d5-9ffe-dd57240bf5cb"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:58:03.476535 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-ecbd986c-ef58-4bfa-aa84-6862c34a6ff2 req-d6df7c73-a71f-4576-b226-ad439c901578 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:03.477519 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-ecbd986c-ef58-4bfa-aa84-6862c34a6ff2 req-d6df7c73-a71f-4576-b226-ad439c901578 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:03.501461 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-ecbd986c-ef58-4bfa-aa84-6862c34a6ff2 req-d6df7c73-a71f-4576-b226-ad439c901578 service nova] Creating event network-vif-deleted:7ff729a9-545c-47d5-9ffe-dd57240bf5cb for instance 6bd0b1cf-40d7-4603-8746-bd306afd94f5 on n-h1-465891-3 Jul 18 02:58:03.510008 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-ecbd986c-ef58-4bfa-aa84-6862c34a6ff2 req-d6df7c73-a71f-4576-b226-ad439c901578 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092232 Jul 18 02:58:03.514818 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2755/5497] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:58:03.921724 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-48478f98-306f-4f30-8314-b0badb19b28d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:03.923057 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-48478f98-306f-4f30-8314-b0badb19b28d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:03.960819 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-48478f98-306f-4f30-8314-b0badb19b28d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:03.964424 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-48478f98-306f-4f30-8314-b0badb19b28d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:03.966571 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-48478f98-306f-4f30-8314-b0badb19b28d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:03.967224 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-48478f98-306f-4f30-8314-b0badb19b28d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:04.038146 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0accf939-c1da-4a40-9496-013a7412ed70 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:04.059580 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0accf939-c1da-4a40-9496-013a7412ed70 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 1.488350 Jul 18 02:58:04.064405 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2743/5498] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:02 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:04.093920 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b47f8298-8de2-478d-a0ea-8f1dbc33e588 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:04.094553 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b47f8298-8de2-478d-a0ea-8f1dbc33e588 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:04.121751 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b47f8298-8de2-478d-a0ea-8f1dbc33e588 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:04.122238 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b47f8298-8de2-478d-a0ea-8f1dbc33e588 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:04.130839 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b47f8298-8de2-478d-a0ea-8f1dbc33e588 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:04.131691 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b47f8298-8de2-478d-a0ea-8f1dbc33e588 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:04.453020 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-48478f98-306f-4f30-8314-b0badb19b28d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:04.471798 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-48478f98-306f-4f30-8314-b0badb19b28d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5" status: 200 len: 1223 microversion: 2.1 time: 0.553761 Jul 18 02:58:04.486025 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2756/5499] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:03 2022] GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 => generated 1223 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:58:04.492193 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-91378693-f7cd-47fd-94c1-31f2e189cd1c tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:04.492193 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-91378693-f7cd-47fd-94c1-31f2e189cd1c tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: 6f05fde6-142f-4459-b468-06efd59ff42f] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:04.512231 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-91378693-f7cd-47fd-94c1-31f2e189cd1c tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:04.513091 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-91378693-f7cd-47fd-94c1-31f2e189cd1c tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:04.518276 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-91378693-f7cd-47fd-94c1-31f2e189cd1c tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:04.519227 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-91378693-f7cd-47fd-94c1-31f2e189cd1c tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:04.682851 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-91378693-f7cd-47fd-94c1-31f2e189cd1c tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:04.684160 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-91378693-f7cd-47fd-94c1-31f2e189cd1c tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:04.685773 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-91378693-f7cd-47fd-94c1-31f2e189cd1c tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lazy-loading 'fault' on Instance uuid 6f05fde6-142f-4459-b468-06efd59ff42f {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:58:05.008115 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-91378693-f7cd-47fd-94c1-31f2e189cd1c tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7444bc0744533861c32353fa7f597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f043fa9beaa4ac6b209d67346479c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:05.039350 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-91378693-f7cd-47fd-94c1-31f2e189cd1c tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f" status: 200 len: 1384 microversion: 2.1 time: 0.558557 Jul 18 02:58:05.041109 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2757/5500] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:04 2022] GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f => generated 1384 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:05.155437 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b47f8298-8de2-478d-a0ea-8f1dbc33e588 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:05.174711 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b47f8298-8de2-478d-a0ea-8f1dbc33e588 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 1.086111 Jul 18 02:58:05.175573 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2744/5501] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:04 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:05.218362 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-788aa4c5-2c11-4ee0-9ace-f97f951f10dd tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:05.230764 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-788aa4c5-2c11-4ee0-9ace-f97f951f10dd tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:05.259182 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-788aa4c5-2c11-4ee0-9ace-f97f951f10dd tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:05.263730 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-788aa4c5-2c11-4ee0-9ace-f97f951f10dd tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:05.267369 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-788aa4c5-2c11-4ee0-9ace-f97f951f10dd tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:05.271395 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-788aa4c5-2c11-4ee0-9ace-f97f951f10dd tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:05.501438 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-82215bb3-1b4b-4f06-acea-0c9ce7a688c7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:05.502283 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-82215bb3-1b4b-4f06-acea-0c9ce7a688c7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:05.519329 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-82215bb3-1b4b-4f06-acea-0c9ce7a688c7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:05.520046 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-82215bb3-1b4b-4f06-acea-0c9ce7a688c7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:05.521012 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-82215bb3-1b4b-4f06-acea-0c9ce7a688c7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:05.521628 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-82215bb3-1b4b-4f06-acea-0c9ce7a688c7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:06.105855 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-82215bb3-1b4b-4f06-acea-0c9ce7a688c7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:06.120813 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-82215bb3-1b4b-4f06-acea-0c9ce7a688c7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5" status: 200 len: 1223 microversion: 2.1 time: 0.624027 Jul 18 02:58:06.121863 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2745/5502] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:05 2022] GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 => generated 1223 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:58:06.137733 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-16239177-b016-43ee-a3ec-7b484d9b8dfb req-8439e909-561c-40ed-a349-fce361bf0a83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f05fde6-142f-4459-b468-06efd59ff42f", "name": "network-vif-deleted", "tag": "68e4dfb6-2aee-4e43-85cc-21ddd9a68f3d"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:58:06.156998 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-16239177-b016-43ee-a3ec-7b484d9b8dfb req-8439e909-561c-40ed-a349-fce361bf0a83 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:06.158300 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-16239177-b016-43ee-a3ec-7b484d9b8dfb req-8439e909-561c-40ed-a349-fce361bf0a83 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:06.182522 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-16239177-b016-43ee-a3ec-7b484d9b8dfb req-8439e909-561c-40ed-a349-fce361bf0a83 service nova] Creating event network-vif-deleted:68e4dfb6-2aee-4e43-85cc-21ddd9a68f3d for instance 6f05fde6-142f-4459-b468-06efd59ff42f on n-h2-465891-3 Jul 18 02:58:06.200024 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-16239177-b016-43ee-a3ec-7b484d9b8dfb req-8439e909-561c-40ed-a349-fce361bf0a83 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076643 Jul 18 02:58:06.201311 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2746/5503] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:58:06.206998 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e122d800-159a-4a57-b36d-16df0beea1c4 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:06.218561 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e122d800-159a-4a57-b36d-16df0beea1c4 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] [instance: 6f05fde6-142f-4459-b468-06efd59ff42f] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:06.232931 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e122d800-159a-4a57-b36d-16df0beea1c4 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:06.233845 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e122d800-159a-4a57-b36d-16df0beea1c4 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:06.234938 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e122d800-159a-4a57-b36d-16df0beea1c4 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:06.235623 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e122d800-159a-4a57-b36d-16df0beea1c4 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:06.270373 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-e122d800-159a-4a57-b36d-16df0beea1c4 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] HTTP exception thrown: Instance 6f05fde6-142f-4459-b468-06efd59ff42f could not be found. Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e122d800-159a-4a57-b36d-16df0beea1c4 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Request method failure captured: Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f HTTP/1.1 Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MuT-QP9r5hqrr8SkJ3od_6Hpsewj2p1q6CERFwdy-D8XzF--1P3yweBKgv3dC36fuVGssLjSiDJiZWNyue6P8TT27OFHObbklqyO0L-grvF-L3zadVzngu-BxhcSeWP-9k4r5DoAGJKVjz7E6871XyNnCt8j-izQLnrCCvyL7za9KI Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 0f043fa9beaa4ac6b209d67346479c57 Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1639077855 Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0f043fa9beaa4ac6b209d67346479c57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0f043fa9beaa4ac6b209d67346479c57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0f043fa9beaa4ac6b209d67346479c57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0f043fa9beaa4ac6b209d67346479c57"}]}] Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1639077855 Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 0f043fa9beaa4ac6b209d67346479c57 Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1639077855 Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-TestSecurityGroupsBasicOps-1639077855-project Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: b6c7444bc0744533861c32353fa7f597 Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1639077855-project Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 6f05fde6-142f-4459-b468-06efd59ff42f could not be found. Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '6f05fde6-142f-4459-b468-06efd59ff42f'} Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f05fde6-142f-4459-b468-06efd59ff42f could not be found. Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f05fde6-142f-4459-b468-06efd59ff42f could not be found. Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:58:06.272464 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:58:06.276371 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:58:06.276371 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:58:06.276371 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:58:06.276371 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:58:06.276371 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:58:06.276371 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f05fde6-142f-4459-b468-06efd59ff42f could not be found. Jul 18 02:58:06.276371 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 02:58:06.282760 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e122d800-159a-4a57-b36d-16df0beea1c4 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Returning 404 to user: Instance 6f05fde6-142f-4459-b468-06efd59ff42f could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:58:06.284082 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e122d800-159a-4a57-b36d-16df0beea1c4 tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f" status: 404 len: 111 microversion: 2.1 time: 0.081310 Jul 18 02:58:06.286416 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2747/5504] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:06 2022] GET /compute/v2.1/servers/6f05fde6-142f-4459-b468-06efd59ff42f => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:58:06.663957 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-788aa4c5-2c11-4ee0-9ace-f97f951f10dd tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:06.694912 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-788aa4c5-2c11-4ee0-9ace-f97f951f10dd tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 1.495404 Jul 18 02:58:06.696082 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2758/5505] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:05 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:06.982862 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-088e9fbd-d4f2-4b98-9cac-2658254f1e56 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1663698292", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "a3f65d6b-f64d-469e-b970-581d249d8554"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:58:07.106318 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-088e9fbd-d4f2-4b98-9cac-2658254f1e56 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] validate_networks() for [('a3f65d6b-f64d-469e-b970-581d249d8554', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:58:07.147941 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-64983005-1eb4-4c3d-a9b6-d2d8e3cfa14c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:07.148885 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-64983005-1eb4-4c3d-a9b6-d2d8e3cfa14c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:07.167292 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-64983005-1eb4-4c3d-a9b6-d2d8e3cfa14c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:07.168243 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-64983005-1eb4-4c3d-a9b6-d2d8e3cfa14c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:07.169266 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-64983005-1eb4-4c3d-a9b6-d2d8e3cfa14c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:07.169969 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-64983005-1eb4-4c3d-a9b6-d2d8e3cfa14c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:07.800600 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-64983005-1eb4-4c3d-a9b6-d2d8e3cfa14c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:07.813308 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-64983005-1eb4-4c3d-a9b6-d2d8e3cfa14c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5" status: 200 len: 1223 microversion: 2.1 time: 0.669383 Jul 18 02:58:07.815338 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2759/5506] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:07 2022] GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 => generated 1223 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:58:08.832994 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-caffc067-3a1a-4e98-8566-6d85503df590 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:08.834672 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-caffc067-3a1a-4e98-8566-6d85503df590 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:08.838240 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=46 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:58:08.858314 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-caffc067-3a1a-4e98-8566-6d85503df590 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:08.861514 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-caffc067-3a1a-4e98-8566-6d85503df590 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:08.862728 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-caffc067-3a1a-4e98-8566-6d85503df590 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:08.870875 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-caffc067-3a1a-4e98-8566-6d85503df590 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:09.455467 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-caffc067-3a1a-4e98-8566-6d85503df590 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:09.472196 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-caffc067-3a1a-4e98-8566-6d85503df590 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5" status: 200 len: 1223 microversion: 2.1 time: 0.643341 Jul 18 02:58:09.489375 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2760/5507] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:08 2022] GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 => generated 1223 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:10.214930 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-088e9fbd-d4f2-4b98-9cac-2658254f1e56 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:58:10.215442 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-088e9fbd-d4f2-4b98-9cac-2658254f1e56 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:58:10.215815 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-088e9fbd-d4f2-4b98-9cac-2658254f1e56 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:58:10.216394 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-088e9fbd-d4f2-4b98-9cac-2658254f1e56 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:58:10.216992 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-088e9fbd-d4f2-4b98-9cac-2658254f1e56 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:58:10.222260 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:58:10.259492 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-088e9fbd-d4f2-4b98-9cac-2658254f1e56 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:10.263225 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-088e9fbd-d4f2-4b98-9cac-2658254f1e56 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:10.264455 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-088e9fbd-d4f2-4b98-9cac-2658254f1e56 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:10.270120 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-088e9fbd-d4f2-4b98-9cac-2658254f1e56 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:10.315129 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-088e9fbd-d4f2-4b98-9cac-2658254f1e56 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Getting quotas for project 2ed8b12429e9420bb83700e52701910b. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:58:10.339043 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-088e9fbd-d4f2-4b98-9cac-2658254f1e56 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Getting quotas for user 5436715af849460f87ff6b62dbd491a0 and project 2ed8b12429e9420bb83700e52701910b. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:58:10.361848 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-088e9fbd-d4f2-4b98-9cac-2658254f1e56 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:58:10.364233 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-088e9fbd-d4f2-4b98-9cac-2658254f1e56 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:58:10.500221 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-15e3d923-8704-40fc-9e82-13eeaa8092ed tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:10.501606 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-15e3d923-8704-40fc-9e82-13eeaa8092ed tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:10.527512 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-15e3d923-8704-40fc-9e82-13eeaa8092ed tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:10.530887 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-088e9fbd-d4f2-4b98-9cac-2658254f1e56 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.553499 Jul 18 02:58:10.532449 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-15e3d923-8704-40fc-9e82-13eeaa8092ed tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:10.533614 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-15e3d923-8704-40fc-9e82-13eeaa8092ed tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:10.534289 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-15e3d923-8704-40fc-9e82-13eeaa8092ed tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:10.535216 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2748/5508] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:58:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 3559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:58:10.569226 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a4d9f5b6-473d-4390-a154-8b1afebcdd4f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:10.570359 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a4d9f5b6-473d-4390-a154-8b1afebcdd4f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:11.346737 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-15e3d923-8704-40fc-9e82-13eeaa8092ed tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:11.358622 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-15e3d923-8704-40fc-9e82-13eeaa8092ed tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5" status: 200 len: 1223 microversion: 2.1 time: 0.865396 Jul 18 02:58:11.364855 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2761/5509] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:10 2022] GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 => generated 1223 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:11.388065 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0b8e01cf-51ef-4354-9db9-35a9ed26ce52 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '.version_select at 0x7ff4adcb68b0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:11.401086 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a4d9f5b6-473d-4390-a154-8b1afebcdd4f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:11.418673 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a4d9f5b6-473d-4390-a154-8b1afebcdd4f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3" status: 200 len: 1215 microversion: 2.1 time: 0.867446 Jul 18 02:58:11.422070 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2749/5510] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:10 2022] GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 => generated 1215 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:11.481569 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0b8e01cf-51ef-4354-9db9-35a9ed26ce52 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-807021230" status: 202 len: 0 microversion: 2.1 time: 0.105589 Jul 18 02:58:11.483151 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2762/5511] 10.222.0.57 () {58 vars in 1280 bytes} [Mon Jul 18 02:58:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-807021230 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:58:11.514959 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8a50a75f-39b1-4a17-9113-42cd89a31835 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Action: 'create', calling method: .version_select at 0x7ff49b7fb280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1658491502", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnXXeSgS+DqzF8p5833G4/BuoOfzVDA72X7bnKXiqZgJyHqnDEmmdeLERjnhT/0rIl9C8u6USFEaDB3E9lv9jbDLveQC3bh/fhh2DAdeOYDy+2akNxdsjAE3SsgqLWBcQ=="}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:58:11.577602 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-8a50a75f-39b1-4a17-9113-42cd89a31835 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Getting quotas for project fa240dfd375a45efb42fc04807acf847. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:58:11.595686 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-8a50a75f-39b1-4a17-9113-42cd89a31835 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Getting quotas for user 381a2ab772ff495cb85b89a85a267cfe and project fa240dfd375a45efb42fc04807acf847. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:58:11.668203 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8a50a75f-39b1-4a17-9113-42cd89a31835 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.159726 Jul 18 02:58:11.678566 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2750/5512] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 02:58:11 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:58:12.391314 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-afe29b97-29b7-4fa6-a244-d8a0b23b49fc tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:12.398973 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-afe29b97-29b7-4fa6-a244-d8a0b23b49fc tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:12.424987 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-afe29b97-29b7-4fa6-a244-d8a0b23b49fc tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:12.425518 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-afe29b97-29b7-4fa6-a244-d8a0b23b49fc tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:12.426437 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-afe29b97-29b7-4fa6-a244-d8a0b23b49fc tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:12.426901 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-afe29b97-29b7-4fa6-a244-d8a0b23b49fc tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:12.444774 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-13aad2d7-4a3f-496c-bc31-a86705d8a078 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:12.445594 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-13aad2d7-4a3f-496c-bc31-a86705d8a078 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:12.471323 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-13aad2d7-4a3f-496c-bc31-a86705d8a078 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:12.471835 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-13aad2d7-4a3f-496c-bc31-a86705d8a078 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:12.486828 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-13aad2d7-4a3f-496c-bc31-a86705d8a078 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:12.487300 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-13aad2d7-4a3f-496c-bc31-a86705d8a078 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:12.999249 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-13aad2d7-4a3f-496c-bc31-a86705d8a078 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:13.018664 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-13aad2d7-4a3f-496c-bc31-a86705d8a078 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3" status: 200 len: 1267 microversion: 2.1 time: 0.579543 Jul 18 02:58:13.024510 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-afe29b97-29b7-4fa6-a244-d8a0b23b49fc tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:13.025001 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2751/5513] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:12 2022] GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 => generated 1267 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:13.052341 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-afe29b97-29b7-4fa6-a244-d8a0b23b49fc tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5" status: 200 len: 1223 microversion: 2.1 time: 0.669276 Jul 18 02:58:13.063037 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2763/5514] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:12 2022] GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 => generated 1223 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:14.054195 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a5d20ffb-de00-4d91-a1d6-d362fdd803e6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:14.056259 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a5d20ffb-de00-4d91-a1d6-d362fdd803e6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:14.072827 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c5ab2002-80d6-4e8d-bd5d-878fc27df31e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:14.074463 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c5ab2002-80d6-4e8d-bd5d-878fc27df31e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:14.081467 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a5d20ffb-de00-4d91-a1d6-d362fdd803e6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:14.084620 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a5d20ffb-de00-4d91-a1d6-d362fdd803e6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:14.089105 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a5d20ffb-de00-4d91-a1d6-d362fdd803e6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:14.091580 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c5ab2002-80d6-4e8d-bd5d-878fc27df31e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:14.092387 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a5d20ffb-de00-4d91-a1d6-d362fdd803e6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:14.094542 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c5ab2002-80d6-4e8d-bd5d-878fc27df31e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:14.098918 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c5ab2002-80d6-4e8d-bd5d-878fc27df31e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:14.099774 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c5ab2002-80d6-4e8d-bd5d-878fc27df31e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:14.144281 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-c5ab2002-80d6-4e8d-bd5d-878fc27df31e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] HTTP exception thrown: Instance 6bd0b1cf-40d7-4603-8746-bd306afd94f5 could not be found. Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c5ab2002-80d6-4e8d-bd5d-878fc27df31e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Request method failure captured: Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 HTTP/1.1 Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MliWHzVx10oBgzg24taGfvPF1POfFT53P2_RlSdFLebnrvIbeAs5qvjZ1EAd9Fni5RvXZYA8fjgna7ooKOtwOz_kbJVpuNazgX6TlGzOYOFYf5fy5vfDN_5wwJEwayQdbLz2BaqgZyDtVrhp2skZQbTuh-KNZeRA8bkIRl3oXepO1E Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 2b7654e273f6487ba83382da4f96056d Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-TestVolumeBootPattern-598001453 Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2b7654e273f6487ba83382da4f96056d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2b7654e273f6487ba83382da4f96056d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2b7654e273f6487ba83382da4f96056d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2b7654e273f6487ba83382da4f96056d"}]}] Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-TestVolumeBootPattern-598001453 Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 2b7654e273f6487ba83382da4f96056d Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-TestVolumeBootPattern-598001453 Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-TestVolumeBootPattern-598001453-project Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: d1afc1702f8045a396b98e5c24b124e7 Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-TestVolumeBootPattern-598001453-project Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 6bd0b1cf-40d7-4603-8746-bd306afd94f5 could not be found. Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '6bd0b1cf-40d7-4603-8746-bd306afd94f5'} Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bd0b1cf-40d7-4603-8746-bd306afd94f5 could not be found. Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bd0b1cf-40d7-4603-8746-bd306afd94f5 could not be found. Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:58:14.146155 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:58:14.160234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:58:14.160234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:58:14.160234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:58:14.160234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:58:14.160234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:58:14.160234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bd0b1cf-40d7-4603-8746-bd306afd94f5 could not be found. Jul 18 02:58:14.160234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:58:14.160234 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c5ab2002-80d6-4e8d-bd5d-878fc27df31e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Returning 404 to user: Instance 6bd0b1cf-40d7-4603-8746-bd306afd94f5 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:58:14.160234 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c5ab2002-80d6-4e8d-bd5d-878fc27df31e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5" status: 404 len: 111 microversion: 2.1 time: 0.085527 Jul 18 02:58:14.167532 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2764/5515] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:14 2022] GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:58:14.301678 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3511f03a-a15b-444f-bc54-bd31ab266398 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-734633886", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-233278274", "security_groups": [{"name": "tempest-secgroup-smoke-2032229349"}], "block_device_mapping_v2": [{"uuid": "9b6dd1b9-d28f-4445-b5bb-59a96ed6d423", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ba77f5bb-f255-444f-9bd1-1e3dbe42d430"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:58:14.685733 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a5d20ffb-de00-4d91-a1d6-d362fdd803e6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:14.706307 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a5d20ffb-de00-4d91-a1d6-d362fdd803e6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3" status: 200 len: 1273 microversion: 2.1 time: 0.657973 Jul 18 02:58:14.708442 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2752/5516] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:14 2022] GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 => generated 1273 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:58:14.905841 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-3511f03a-a15b-444f-bc54-bd31ab266398 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] validate_networks() for [('ba77f5bb-f255-444f-9bd1-1e3dbe42d430', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:58:15.738168 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1e9a7c45-1a08-4717-a8b3-e48c873ec49a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:15.739050 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1e9a7c45-1a08-4717-a8b3-e48c873ec49a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:15.751786 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1e9a7c45-1a08-4717-a8b3-e48c873ec49a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:15.752251 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1e9a7c45-1a08-4717-a8b3-e48c873ec49a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:15.754802 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1e9a7c45-1a08-4717-a8b3-e48c873ec49a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:15.755325 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1e9a7c45-1a08-4717-a8b3-e48c873ec49a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:15.927721 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1e9a7c45-1a08-4717-a8b3-e48c873ec49a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:15.942479 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1e9a7c45-1a08-4717-a8b3-e48c873ec49a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3" status: 200 len: 1273 microversion: 2.1 time: 0.209021 Jul 18 02:58:15.943410 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2753/5517] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:15 2022] GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 => generated 1273 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:58:16.965180 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-88e7e221-b1e0-44c0-b53d-e929dd3cd9a1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:16.971036 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-88e7e221-b1e0-44c0-b53d-e929dd3cd9a1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:16.999144 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-88e7e221-b1e0-44c0-b53d-e929dd3cd9a1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:17.000266 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-88e7e221-b1e0-44c0-b53d-e929dd3cd9a1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:17.001863 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-88e7e221-b1e0-44c0-b53d-e929dd3cd9a1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:17.002820 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-88e7e221-b1e0-44c0-b53d-e929dd3cd9a1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:17.483199 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-3511f03a-a15b-444f-bc54-bd31ab266398 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:58:17.484049 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-3511f03a-a15b-444f-bc54-bd31ab266398 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:58:17.484377 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-3511f03a-a15b-444f-bc54-bd31ab266398 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:58:17.484807 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-3511f03a-a15b-444f-bc54-bd31ab266398 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:58:17.485382 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-3511f03a-a15b-444f-bc54-bd31ab266398 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:58:17.532166 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3511f03a-a15b-444f-bc54-bd31ab266398 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:17.535701 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3511f03a-a15b-444f-bc54-bd31ab266398 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:17.536998 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3511f03a-a15b-444f-bc54-bd31ab266398 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:17.539064 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3511f03a-a15b-444f-bc54-bd31ab266398 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:17.637348 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-3511f03a-a15b-444f-bc54-bd31ab266398 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Getting quotas for project 2b7654e273f6487ba83382da4f96056d. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:58:17.657052 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-3511f03a-a15b-444f-bc54-bd31ab266398 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Getting quotas for user d1afc1702f8045a396b98e5c24b124e7 and project 2b7654e273f6487ba83382da4f96056d. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:58:17.819793 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3511f03a-a15b-444f-bc54-bd31ab266398 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:58:17.823829 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3511f03a-a15b-444f-bc54-bd31ab266398 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 0b51bfed-afd2-4629-8b36-b466661de551] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9b6dd1b9-d28f-4445-b5bb-59a96ed6d423',volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:58:18.178834 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3511f03a-a15b-444f-bc54-bd31ab266398 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.884630 Jul 18 02:58:18.179995 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2765/5518] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:58:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 3887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 02:58:18.190540 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f155d3f5-1198-44e9-9776-5c2abb59abca tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:18.191581 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f155d3f5-1198-44e9-9776-5c2abb59abca tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 0b51bfed-afd2-4629-8b36-b466661de551] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:18.442871 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-88e7e221-b1e0-44c0-b53d-e929dd3cd9a1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:18.498018 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-88e7e221-b1e0-44c0-b53d-e929dd3cd9a1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3" status: 200 len: 1315 microversion: 2.1 time: 1.527357 Jul 18 02:58:18.520012 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2754/5519] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:16 2022] GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 => generated 1315 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:18.585244 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f155d3f5-1198-44e9-9776-5c2abb59abca tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:18.614735 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f155d3f5-1198-44e9-9776-5c2abb59abca tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551" status: 200 len: 1093 microversion: 2.1 time: 0.427186 Jul 18 02:58:18.617589 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2766/5520] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:18 2022] GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551 => generated 1093 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:58:19.524590 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5dd61635-3f9b-4a7e-b42e-4c3d80447a54 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:19.526989 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5dd61635-3f9b-4a7e-b42e-4c3d80447a54 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:19.573855 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5dd61635-3f9b-4a7e-b42e-4c3d80447a54 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:19.580756 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5dd61635-3f9b-4a7e-b42e-4c3d80447a54 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:19.587548 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5dd61635-3f9b-4a7e-b42e-4c3d80447a54 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:19.589425 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5dd61635-3f9b-4a7e-b42e-4c3d80447a54 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:19.652391 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c4311104-d3d0-41c8-b9d6-8bd53b5ce07e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:19.661040 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c4311104-d3d0-41c8-b9d6-8bd53b5ce07e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 0b51bfed-afd2-4629-8b36-b466661de551] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:19.704168 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c4311104-d3d0-41c8-b9d6-8bd53b5ce07e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:19.704427 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c4311104-d3d0-41c8-b9d6-8bd53b5ce07e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:19.717479 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c4311104-d3d0-41c8-b9d6-8bd53b5ce07e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:19.725272 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c4311104-d3d0-41c8-b9d6-8bd53b5ce07e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:20.027776 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c4311104-d3d0-41c8-b9d6-8bd53b5ce07e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:20.060144 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c4311104-d3d0-41c8-b9d6-8bd53b5ce07e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551" status: 200 len: 1191 microversion: 2.1 time: 0.412071 Jul 18 02:58:20.077919 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2767/5521] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:19 2022] GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551 => generated 1191 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:20.221718 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5dd61635-3f9b-4a7e-b42e-4c3d80447a54 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:20.248322 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5dd61635-3f9b-4a7e-b42e-4c3d80447a54 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3" status: 200 len: 1315 microversion: 2.1 time: 0.731881 Jul 18 02:58:20.256219 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2755/5522] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:19 2022] GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 => generated 1315 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:21.092647 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6406c4bd-543e-4026-a7bd-0887bb5929cd tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:21.093905 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6406c4bd-543e-4026-a7bd-0887bb5929cd tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 0b51bfed-afd2-4629-8b36-b466661de551] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:21.110846 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6406c4bd-543e-4026-a7bd-0887bb5929cd tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:21.111959 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6406c4bd-543e-4026-a7bd-0887bb5929cd tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:21.113034 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6406c4bd-543e-4026-a7bd-0887bb5929cd tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:21.113715 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6406c4bd-543e-4026-a7bd-0887bb5929cd tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:21.274283 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d18688fa-b5c0-4c82-b3dd-a2cbdbd99535 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:21.275108 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d18688fa-b5c0-4c82-b3dd-a2cbdbd99535 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:21.277685 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:58:21.288335 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d18688fa-b5c0-4c82-b3dd-a2cbdbd99535 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:21.295623 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d18688fa-b5c0-4c82-b3dd-a2cbdbd99535 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:21.296904 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d18688fa-b5c0-4c82-b3dd-a2cbdbd99535 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:21.297601 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d18688fa-b5c0-4c82-b3dd-a2cbdbd99535 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:21.520176 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6406c4bd-543e-4026-a7bd-0887bb5929cd tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:21.532315 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6406c4bd-543e-4026-a7bd-0887bb5929cd tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551" status: 200 len: 1209 microversion: 2.1 time: 0.444331 Jul 18 02:58:21.536352 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2768/5523] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:21 2022] GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551 => generated 1209 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:21.608225 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=12 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:58:21.875937 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-20fe472f-97a0-471c-b6c8-4532aa6a06fa req-04edc1f3-4965-463c-ae99-9b9e43a9b181 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20c7c630-5739-487b-97c9-463a8de621a3", "tag": "51e95f27-927b-4956-b785-097434c3f4c0"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:58:21.914551 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-20fe472f-97a0-471c-b6c8-4532aa6a06fa req-04edc1f3-4965-463c-ae99-9b9e43a9b181 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:21.924674 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-20fe472f-97a0-471c-b6c8-4532aa6a06fa req-04edc1f3-4965-463c-ae99-9b9e43a9b181 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:21.987213 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-20fe472f-97a0-471c-b6c8-4532aa6a06fa req-04edc1f3-4965-463c-ae99-9b9e43a9b181 service nova] Creating event network-changed:51e95f27-927b-4956-b785-097434c3f4c0 for instance 20c7c630-5739-487b-97c9-463a8de621a3 on n-h1-465891-3 Jul 18 02:58:22.001753 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-20fe472f-97a0-471c-b6c8-4532aa6a06fa req-04edc1f3-4965-463c-ae99-9b9e43a9b181 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131691 Jul 18 02:58:22.011989 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2769/5524] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:58:22.498264 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d18688fa-b5c0-4c82-b3dd-a2cbdbd99535 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:22.515916 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d18688fa-b5c0-4c82-b3dd-a2cbdbd99535 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3" status: 200 len: 1315 microversion: 2.1 time: 1.245937 Jul 18 02:58:22.528696 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2756/5525] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:21 2022] GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 => generated 1315 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:22.585215 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-aca71870-5b70-4b84-958f-71dcc798c326 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:22.591435 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-aca71870-5b70-4b84-958f-71dcc798c326 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 0b51bfed-afd2-4629-8b36-b466661de551] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:22.640565 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aca71870-5b70-4b84-958f-71dcc798c326 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:22.642606 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aca71870-5b70-4b84-958f-71dcc798c326 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:22.644410 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aca71870-5b70-4b84-958f-71dcc798c326 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:22.650852 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aca71870-5b70-4b84-958f-71dcc798c326 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:22.894738 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-aca71870-5b70-4b84-958f-71dcc798c326 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:22.924907 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-aca71870-5b70-4b84-958f-71dcc798c326 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551" status: 200 len: 1209 microversion: 2.1 time: 0.362955 Jul 18 02:58:22.948832 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2770/5526] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:22 2022] GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551 => generated 1209 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:23.537027 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3e91fd16-ad70-4cf3-9cf6-e33d8ec0e844 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:23.537791 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3e91fd16-ad70-4cf3-9cf6-e33d8ec0e844 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:23.551769 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3e91fd16-ad70-4cf3-9cf6-e33d8ec0e844 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:23.554900 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3e91fd16-ad70-4cf3-9cf6-e33d8ec0e844 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:23.556542 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3e91fd16-ad70-4cf3-9cf6-e33d8ec0e844 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:23.557584 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3e91fd16-ad70-4cf3-9cf6-e33d8ec0e844 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:23.970764 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-06dc8499-1a3b-44b2-8e37-fa8596db37d1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:23.974427 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-06dc8499-1a3b-44b2-8e37-fa8596db37d1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 0b51bfed-afd2-4629-8b36-b466661de551] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:24.000462 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-06dc8499-1a3b-44b2-8e37-fa8596db37d1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:24.003779 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-06dc8499-1a3b-44b2-8e37-fa8596db37d1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:24.007801 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-06dc8499-1a3b-44b2-8e37-fa8596db37d1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:24.011956 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-06dc8499-1a3b-44b2-8e37-fa8596db37d1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:24.275175 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3e91fd16-ad70-4cf3-9cf6-e33d8ec0e844 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:24.297598 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3e91fd16-ad70-4cf3-9cf6-e33d8ec0e844 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3" status: 200 len: 1315 microversion: 2.1 time: 0.763602 Jul 18 02:58:24.298483 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2757/5527] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:23 2022] GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 => generated 1315 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:25.349525 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a7daee71-f96a-4f7d-8185-34bc8b0456cc tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:25.352659 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a7daee71-f96a-4f7d-8185-34bc8b0456cc tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:25.394742 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a7daee71-f96a-4f7d-8185-34bc8b0456cc tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:25.401651 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a7daee71-f96a-4f7d-8185-34bc8b0456cc tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:25.403146 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a7daee71-f96a-4f7d-8185-34bc8b0456cc tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:25.404080 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a7daee71-f96a-4f7d-8185-34bc8b0456cc tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:25.630280 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-06dc8499-1a3b-44b2-8e37-fa8596db37d1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:25.642561 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-06dc8499-1a3b-44b2-8e37-fa8596db37d1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551" status: 200 len: 1277 microversion: 2.1 time: 1.684350 Jul 18 02:58:25.643166 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2771/5528] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:23 2022] GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551 => generated 1277 bytes in 1686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:58:26.511505 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a7daee71-f96a-4f7d-8185-34bc8b0456cc tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:26.546032 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a7daee71-f96a-4f7d-8185-34bc8b0456cc tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3" status: 200 len: 1315 microversion: 2.1 time: 1.212617 Jul 18 02:58:26.558682 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2758/5529] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:25 2022] GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 => generated 1315 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:26.662654 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5f9ba8a2-288b-4e7e-8a16-14b391b9697a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:26.663571 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5f9ba8a2-288b-4e7e-8a16-14b391b9697a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 0b51bfed-afd2-4629-8b36-b466661de551] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:26.709318 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5f9ba8a2-288b-4e7e-8a16-14b391b9697a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:26.709318 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5f9ba8a2-288b-4e7e-8a16-14b391b9697a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:26.717872 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5f9ba8a2-288b-4e7e-8a16-14b391b9697a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:26.720040 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5f9ba8a2-288b-4e7e-8a16-14b391b9697a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:27.579919 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f04f99fb-7c5e-4379-a644-53570126e61a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:27.585887 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f04f99fb-7c5e-4379-a644-53570126e61a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:27.587095 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:58:27.627922 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f04f99fb-7c5e-4379-a644-53570126e61a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:27.637138 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f04f99fb-7c5e-4379-a644-53570126e61a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:27.639236 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f04f99fb-7c5e-4379-a644-53570126e61a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:27.651541 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f04f99fb-7c5e-4379-a644-53570126e61a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:28.610380 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=8 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:58:29.609926 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f04f99fb-7c5e-4379-a644-53570126e61a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:29.641147 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f04f99fb-7c5e-4379-a644-53570126e61a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3" status: 200 len: 1315 microversion: 2.1 time: 2.069405 Jul 18 02:58:29.650759 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2759/5530] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:27 2022] GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 => generated 1315 bytes in 2079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:29.651098 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5f9ba8a2-288b-4e7e-8a16-14b391b9697a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:29.670784 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5f9ba8a2-288b-4e7e-8a16-14b391b9697a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551" status: 200 len: 1277 microversion: 2.1 time: 3.012032 Jul 18 02:58:29.672176 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-475fc850-4806-4b0e-8c0a-17d711d095ae tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] Calling method '.version_select at 0x7ff49b6db9d0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:29.675153 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2772/5531] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:26 2022] GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551 => generated 1277 bytes in 3019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:29.783161 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-475fc850-4806-4b0e-8c0a-17d711d095ae tempest-TestSecurityGroupsBasicOps-1639077855 tempest-TestSecurityGroupsBasicOps-1639077855-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-247054353" status: 202 len: 0 microversion: 2.1 time: 0.130702 Jul 18 02:58:29.783781 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2760/5532] 10.222.0.57 () {58 vars in 1274 bytes} [Mon Jul 18 02:58:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-247054353 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:58:30.663273 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a2b8f235-7580-408d-a796-630f1742f3f0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:30.665063 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a2b8f235-7580-408d-a796-630f1742f3f0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:30.683067 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a2b8f235-7580-408d-a796-630f1742f3f0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:30.683900 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a2b8f235-7580-408d-a796-630f1742f3f0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:30.687934 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a2b8f235-7580-408d-a796-630f1742f3f0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:30.689959 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a2b8f235-7580-408d-a796-630f1742f3f0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:30.698302 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cfbd04cb-9c07-47b0-acf8-ca8d4cf4cd1e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:30.716110 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cfbd04cb-9c07-47b0-acf8-ca8d4cf4cd1e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 0b51bfed-afd2-4629-8b36-b466661de551] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:30.784813 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cfbd04cb-9c07-47b0-acf8-ca8d4cf4cd1e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:30.791912 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cfbd04cb-9c07-47b0-acf8-ca8d4cf4cd1e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:30.802273 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cfbd04cb-9c07-47b0-acf8-ca8d4cf4cd1e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:30.807305 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cfbd04cb-9c07-47b0-acf8-ca8d4cf4cd1e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:32.219168 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a2b8f235-7580-408d-a796-630f1742f3f0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:32.242253 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a2b8f235-7580-408d-a796-630f1742f3f0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3" status: 200 len: 1315 microversion: 2.1 time: 1.584323 Jul 18 02:58:32.269246 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2773/5533] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:30 2022] GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 => generated 1315 bytes in 1613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:58:32.592893 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-cfbd04cb-9c07-47b0-acf8-ca8d4cf4cd1e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:32.609578 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=89 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:58:32.631154 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cfbd04cb-9c07-47b0-acf8-ca8d4cf4cd1e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551" status: 200 len: 1277 microversion: 2.1 time: 1.935459 Jul 18 02:58:32.646562 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2761/5534] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:30 2022] GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551 => generated 1277 bytes in 1957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:58:33.291643 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-544a7890-1a5b-479e-bbd6-60d7651a4747 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:33.292619 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-544a7890-1a5b-479e-bbd6-60d7651a4747 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:33.323700 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-544a7890-1a5b-479e-bbd6-60d7651a4747 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:33.328104 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-544a7890-1a5b-479e-bbd6-60d7651a4747 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:33.332328 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-544a7890-1a5b-479e-bbd6-60d7651a4747 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:33.335192 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-544a7890-1a5b-479e-bbd6-60d7651a4747 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:33.357444 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-b60a14e8-c99b-42e2-aeac-5774b8bc30e1 req-3e9ee630-1a6c-4b63-9a05-a2d5d2a2e021 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b51bfed-afd2-4629-8b36-b466661de551", "tag": "b6a9c561-dec2-426c-be72-ed96ce7f50e9"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:58:33.375330 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=93 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:58:33.397150 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-b60a14e8-c99b-42e2-aeac-5774b8bc30e1 req-3e9ee630-1a6c-4b63-9a05-a2d5d2a2e021 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:33.404527 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-b60a14e8-c99b-42e2-aeac-5774b8bc30e1 req-3e9ee630-1a6c-4b63-9a05-a2d5d2a2e021 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:33.485287 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-b60a14e8-c99b-42e2-aeac-5774b8bc30e1 req-3e9ee630-1a6c-4b63-9a05-a2d5d2a2e021 service nova] Creating event network-changed:b6a9c561-dec2-426c-be72-ed96ce7f50e9 for instance 0b51bfed-afd2-4629-8b36-b466661de551 on n-h2-465891-3 Jul 18 02:58:33.547610 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-b60a14e8-c99b-42e2-aeac-5774b8bc30e1 req-3e9ee630-1a6c-4b63-9a05-a2d5d2a2e021 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189865 Jul 18 02:58:33.554628 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2762/5535] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:58:33.678935 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-96469407-29c8-4424-9c53-261b0db62a18 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:33.680213 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-96469407-29c8-4424-9c53-261b0db62a18 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 0b51bfed-afd2-4629-8b36-b466661de551] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:33.775934 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-96469407-29c8-4424-9c53-261b0db62a18 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:33.781838 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-96469407-29c8-4424-9c53-261b0db62a18 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:33.786513 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-96469407-29c8-4424-9c53-261b0db62a18 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:33.791869 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-96469407-29c8-4424-9c53-261b0db62a18 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:35.671774 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-544a7890-1a5b-479e-bbd6-60d7651a4747 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:35.694645 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-544a7890-1a5b-479e-bbd6-60d7651a4747 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3" status: 200 len: 1315 microversion: 2.1 time: 2.406630 Jul 18 02:58:35.724045 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2774/5536] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:33 2022] GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 => generated 1315 bytes in 2438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:35.951333 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-96469407-29c8-4424-9c53-261b0db62a18 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:35.998645 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-96469407-29c8-4424-9c53-261b0db62a18 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551" status: 200 len: 1277 microversion: 2.1 time: 2.324764 Jul 18 02:58:35.998645 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2763/5537] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:33 2022] GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551 => generated 1277 bytes in 2332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:36.166827 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-c75554ff-0acb-428e-bf49-017b0e97879c req-5e708753-4cf3-49b9-afe3-0cbe0fdc9d4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20c7c630-5739-487b-97c9-463a8de621a3", "name": "network-vif-plugged", "status": "completed", "tag": "51e95f27-927b-4956-b785-097434c3f4c0"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:58:36.190473 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-c75554ff-0acb-428e-bf49-017b0e97879c req-5e708753-4cf3-49b9-afe3-0cbe0fdc9d4d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:36.192190 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-c75554ff-0acb-428e-bf49-017b0e97879c req-5e708753-4cf3-49b9-afe3-0cbe0fdc9d4d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:36.235957 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-c75554ff-0acb-428e-bf49-017b0e97879c req-5e708753-4cf3-49b9-afe3-0cbe0fdc9d4d service nova] Creating event network-vif-plugged:51e95f27-927b-4956-b785-097434c3f4c0 for instance 20c7c630-5739-487b-97c9-463a8de621a3 on n-h1-465891-3 Jul 18 02:58:36.251306 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-c75554ff-0acb-428e-bf49-017b0e97879c req-5e708753-4cf3-49b9-afe3-0cbe0fdc9d4d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090078 Jul 18 02:58:36.252985 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2775/5538] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:58:36.714635 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0f332ec8-5c00-412e-b8bb-46c7edf17b78 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:36.715625 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0f332ec8-5c00-412e-b8bb-46c7edf17b78 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:36.740313 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f332ec8-5c00-412e-b8bb-46c7edf17b78 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:36.740781 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f332ec8-5c00-412e-b8bb-46c7edf17b78 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:36.746058 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f332ec8-5c00-412e-b8bb-46c7edf17b78 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:36.747169 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f332ec8-5c00-412e-b8bb-46c7edf17b78 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:37.029113 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fa3e9859-a5dd-4c54-81d3-3d2173ec0046 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:37.030239 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fa3e9859-a5dd-4c54-81d3-3d2173ec0046 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 0b51bfed-afd2-4629-8b36-b466661de551] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:37.096994 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fa3e9859-a5dd-4c54-81d3-3d2173ec0046 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:37.098946 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fa3e9859-a5dd-4c54-81d3-3d2173ec0046 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:37.102494 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fa3e9859-a5dd-4c54-81d3-3d2173ec0046 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:37.106982 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fa3e9859-a5dd-4c54-81d3-3d2173ec0046 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:37.515795 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0f332ec8-5c00-412e-b8bb-46c7edf17b78 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:37.525722 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0f332ec8-5c00-412e-b8bb-46c7edf17b78 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3" status: 200 len: 1315 microversion: 2.1 time: 0.816119 Jul 18 02:58:37.542140 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2764/5539] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:36 2022] GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 => generated 1315 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:38.205765 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fa3e9859-a5dd-4c54-81d3-3d2173ec0046 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:38.222406 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fa3e9859-a5dd-4c54-81d3-3d2173ec0046 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551" status: 200 len: 1265 microversion: 2.1 time: 1.212817 Jul 18 02:58:38.227316 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2776/5540] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:37 2022] GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551 => generated 1265 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:38.548573 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1ad71014-c6ab-4a26-bdb2-fbf4fdeaa13f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:38.549182 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1ad71014-c6ab-4a26-bdb2-fbf4fdeaa13f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:38.567515 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ad71014-c6ab-4a26-bdb2-fbf4fdeaa13f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:38.573999 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ad71014-c6ab-4a26-bdb2-fbf4fdeaa13f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:38.574930 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ad71014-c6ab-4a26-bdb2-fbf4fdeaa13f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:38.575387 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ad71014-c6ab-4a26-bdb2-fbf4fdeaa13f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:39.257115 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3e380e26-7833-477a-8654-40c02e4ea31a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:39.258693 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3e380e26-7833-477a-8654-40c02e4ea31a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 0b51bfed-afd2-4629-8b36-b466661de551] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:39.270675 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:58:39.284204 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3e380e26-7833-477a-8654-40c02e4ea31a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:39.288969 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3e380e26-7833-477a-8654-40c02e4ea31a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:39.290259 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3e380e26-7833-477a-8654-40c02e4ea31a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:39.301239 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3e380e26-7833-477a-8654-40c02e4ea31a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:39.612689 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1ad71014-c6ab-4a26-bdb2-fbf4fdeaa13f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:39.699396 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1ad71014-c6ab-4a26-bdb2-fbf4fdeaa13f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3" status: 200 len: 1315 microversion: 2.1 time: 1.149042 Jul 18 02:58:39.700489 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2765/5541] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:38 2022] GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 => generated 1315 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:39.894033 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3e380e26-7833-477a-8654-40c02e4ea31a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:39.943861 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3e380e26-7833-477a-8654-40c02e4ea31a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551" status: 200 len: 1265 microversion: 2.1 time: 0.692039 Jul 18 02:58:39.957741 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2777/5542] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:39 2022] GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551 => generated 1265 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:40.726092 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7fccb5f5-f042-4af2-9b2a-4b74315bf5b3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:40.727409 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7fccb5f5-f042-4af2-9b2a-4b74315bf5b3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:40.743988 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:58:40.794234 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7fccb5f5-f042-4af2-9b2a-4b74315bf5b3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:40.796773 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7fccb5f5-f042-4af2-9b2a-4b74315bf5b3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:40.799312 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7fccb5f5-f042-4af2-9b2a-4b74315bf5b3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:40.799773 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7fccb5f5-f042-4af2-9b2a-4b74315bf5b3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:40.982282 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c82f9977-a7fc-4482-98ab-f78548a33024 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:40.983712 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c82f9977-a7fc-4482-98ab-f78548a33024 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 0b51bfed-afd2-4629-8b36-b466661de551] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:41.002746 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c82f9977-a7fc-4482-98ab-f78548a33024 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:41.010623 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c82f9977-a7fc-4482-98ab-f78548a33024 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:41.014222 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c82f9977-a7fc-4482-98ab-f78548a33024 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:41.016087 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c82f9977-a7fc-4482-98ab-f78548a33024 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:41.695612 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7fccb5f5-f042-4af2-9b2a-4b74315bf5b3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:41.738872 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7fccb5f5-f042-4af2-9b2a-4b74315bf5b3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3" status: 200 len: 1502 microversion: 2.1 time: 1.017584 Jul 18 02:58:41.752311 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2766/5543] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:40 2022] GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 => generated 1502 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:41.772488 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c82f9977-a7fc-4482-98ab-f78548a33024 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:41.776226 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-972ac614-effa-4a12-9240-5ef3d39eb3bd tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-652847139", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "be759969-8d73-4c75-9851-917f7fd872dc"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1658491502", "security_groups": [{"name": "tempest-secgroup-smoke-356027657"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:58:41.783319 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c82f9977-a7fc-4482-98ab-f78548a33024 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551" status: 200 len: 1265 microversion: 2.1 time: 0.806193 Jul 18 02:58:41.792535 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2778/5544] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:40 2022] GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551 => generated 1265 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:41.798040 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-658ec35c-9526-4cfe-915b-d49380e094c0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:58:41.798594 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-658ec35c-9526-4cfe-915b-d49380e094c0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:41.823892 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-658ec35c-9526-4cfe-915b-d49380e094c0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:41.824402 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-658ec35c-9526-4cfe-915b-d49380e094c0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:41.825224 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-658ec35c-9526-4cfe-915b-d49380e094c0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:41.825679 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-658ec35c-9526-4cfe-915b-d49380e094c0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:41.973874 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-658ec35c-9526-4cfe-915b-d49380e094c0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "POST /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3/action" status: 202 len: 0 microversion: 2.1 time: 0.179359 Jul 18 02:58:42.018574 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2779/5545] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:58:41 2022] POST /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:58:42.054430 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-269ef0e8-8bcf-45a2-9fe0-13a3df5f4ac6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:42.059176 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-269ef0e8-8bcf-45a2-9fe0-13a3df5f4ac6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:42.095542 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-269ef0e8-8bcf-45a2-9fe0-13a3df5f4ac6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:42.100123 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-269ef0e8-8bcf-45a2-9fe0-13a3df5f4ac6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:42.106468 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-269ef0e8-8bcf-45a2-9fe0-13a3df5f4ac6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:42.107374 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-269ef0e8-8bcf-45a2-9fe0-13a3df5f4ac6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:42.270094 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-972ac614-effa-4a12-9240-5ef3d39eb3bd tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] validate_networks() for [('be759969-8d73-4c75-9851-917f7fd872dc', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:58:42.625687 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-269ef0e8-8bcf-45a2-9fe0-13a3df5f4ac6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:42.654517 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-269ef0e8-8bcf-45a2-9fe0-13a3df5f4ac6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3" status: 200 len: 1507 microversion: 2.1 time: 0.627050 Jul 18 02:58:42.670835 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2780/5546] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:42 2022] GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 => generated 1507 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:42.827881 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-55170a83-9831-45b3-983e-8d07d651a852 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:42.829030 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-55170a83-9831-45b3-983e-8d07d651a852 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 0b51bfed-afd2-4629-8b36-b466661de551] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:42.837905 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-55170a83-9831-45b3-983e-8d07d651a852 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:42.839550 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-55170a83-9831-45b3-983e-8d07d651a852 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:42.840590 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-55170a83-9831-45b3-983e-8d07d651a852 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:42.841460 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-55170a83-9831-45b3-983e-8d07d651a852 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:43.466257 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-55170a83-9831-45b3-983e-8d07d651a852 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:43.483190 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-55170a83-9831-45b3-983e-8d07d651a852 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551" status: 200 len: 1265 microversion: 2.1 time: 0.658625 Jul 18 02:58:43.484620 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2781/5547] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:42 2022] GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551 => generated 1265 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:43.694647 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-148ac29a-a77c-4bcf-b16c-cdb0528b8bb0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:43.695435 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-148ac29a-a77c-4bcf-b16c-cdb0528b8bb0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:43.715554 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-148ac29a-a77c-4bcf-b16c-cdb0528b8bb0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:43.717676 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-148ac29a-a77c-4bcf-b16c-cdb0528b8bb0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:43.721085 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-148ac29a-a77c-4bcf-b16c-cdb0528b8bb0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:43.724360 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-148ac29a-a77c-4bcf-b16c-cdb0528b8bb0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:43.812487 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-972ac614-effa-4a12-9240-5ef3d39eb3bd tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:58:43.815046 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-972ac614-effa-4a12-9240-5ef3d39eb3bd tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:58:43.817508 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-972ac614-effa-4a12-9240-5ef3d39eb3bd tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:58:43.819058 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-972ac614-effa-4a12-9240-5ef3d39eb3bd tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:58:43.820233 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-972ac614-effa-4a12-9240-5ef3d39eb3bd tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:58:43.874945 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-972ac614-effa-4a12-9240-5ef3d39eb3bd tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:43.879015 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-972ac614-effa-4a12-9240-5ef3d39eb3bd tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:43.899359 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-972ac614-effa-4a12-9240-5ef3d39eb3bd tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:43.902341 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-972ac614-effa-4a12-9240-5ef3d39eb3bd tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:44.087005 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-972ac614-effa-4a12-9240-5ef3d39eb3bd tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Getting quotas for project fa240dfd375a45efb42fc04807acf847. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:58:44.123714 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-972ac614-effa-4a12-9240-5ef3d39eb3bd tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Getting quotas for user 381a2ab772ff495cb85b89a85a267cfe and project fa240dfd375a45efb42fc04807acf847. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:58:44.177197 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-148ac29a-a77c-4bcf-b16c-cdb0528b8bb0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:44.192958 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-148ac29a-a77c-4bcf-b16c-cdb0528b8bb0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3" status: 200 len: 1487 microversion: 2.1 time: 0.509074 Jul 18 02:58:44.208031 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2782/5548] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:43 2022] GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 => generated 1487 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:44.226990 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8bfc4724-f69e-4ff1-b795-0e05b277394f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:58:44.228318 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8bfc4724-f69e-4ff1-b795-0e05b277394f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:44.242226 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8bfc4724-f69e-4ff1-b795-0e05b277394f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:44.244719 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8bfc4724-f69e-4ff1-b795-0e05b277394f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:44.247581 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8bfc4724-f69e-4ff1-b795-0e05b277394f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:44.247774 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-972ac614-effa-4a12-9240-5ef3d39eb3bd tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:58:44.250888 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8bfc4724-f69e-4ff1-b795-0e05b277394f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:44.275558 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-972ac614-effa-4a12-9240-5ef3d39eb3bd tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:58:44.307847 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-8bfc4724-f69e-4ff1-b795-0e05b277394f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lazy-loading 'flavor' on Instance uuid 20c7c630-5739-487b-97c9-463a8de621a3 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:58:44.429968 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-972ac614-effa-4a12-9240-5ef3d39eb3bd tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.665759 Jul 18 02:58:44.434454 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2767/5549] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:58:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 2681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:58:44.468428 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a5ff8098-f41e-44f1-9af5-3aadc6b726b5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:44.468428 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a5ff8098-f41e-44f1-9af5-3aadc6b726b5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:44.992038 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a5ff8098-f41e-44f1-9af5-3aadc6b726b5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:45.022798 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a5ff8098-f41e-44f1-9af5-3aadc6b726b5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518" status: 200 len: 1266 microversion: 2.1 time: 0.578415 Jul 18 02:58:45.038400 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2768/5550] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:44 2022] GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518 => generated 1266 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:58:45.057302 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3a6a513a-972a-4f48-86ba-d78c853ec9ba tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:45.063033 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3a6a513a-972a-4f48-86ba-d78c853ec9ba tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 0b51bfed-afd2-4629-8b36-b466661de551] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:45.108124 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3a6a513a-972a-4f48-86ba-d78c853ec9ba tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:45.108592 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3a6a513a-972a-4f48-86ba-d78c853ec9ba tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:45.109412 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3a6a513a-972a-4f48-86ba-d78c853ec9ba tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:45.110002 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3a6a513a-972a-4f48-86ba-d78c853ec9ba tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:45.115952 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8bfc4724-f69e-4ff1-b795-0e05b277394f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "POST /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3/action" status: 202 len: 0 microversion: 2.1 time: 0.906430 Jul 18 02:58:45.122592 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2783/5551] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:58:44 2022] POST /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3/action => generated 0 bytes in 914 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:58:45.143452 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-88412b36-2dae-436b-93fd-4b7eb69f32f7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:45.144224 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-88412b36-2dae-436b-93fd-4b7eb69f32f7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:45.177365 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-88412b36-2dae-436b-93fd-4b7eb69f32f7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:45.177943 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-88412b36-2dae-436b-93fd-4b7eb69f32f7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:45.178881 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-88412b36-2dae-436b-93fd-4b7eb69f32f7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:45.180520 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-88412b36-2dae-436b-93fd-4b7eb69f32f7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:45.703112 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-88412b36-2dae-436b-93fd-4b7eb69f32f7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:45.717217 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-88412b36-2dae-436b-93fd-4b7eb69f32f7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3" status: 200 len: 1493 microversion: 2.1 time: 0.593156 Jul 18 02:58:45.718449 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2784/5552] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:45 2022] GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 => generated 1493 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:45.792974 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3a6a513a-972a-4f48-86ba-d78c853ec9ba tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:45.807287 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3a6a513a-972a-4f48-86ba-d78c853ec9ba tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551" status: 200 len: 1265 microversion: 2.1 time: 0.766822 Jul 18 02:58:45.808254 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2769/5553] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:45 2022] GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551 => generated 1265 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:46.068213 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a7a39176-d3ff-4074-ab4b-fb18e2926071 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:46.069903 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a7a39176-d3ff-4074-ab4b-fb18e2926071 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:46.093617 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a7a39176-d3ff-4074-ab4b-fb18e2926071 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:46.097966 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a7a39176-d3ff-4074-ab4b-fb18e2926071 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:46.102472 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a7a39176-d3ff-4074-ab4b-fb18e2926071 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:46.103131 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a7a39176-d3ff-4074-ab4b-fb18e2926071 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:46.247064 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a7a39176-d3ff-4074-ab4b-fb18e2926071 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:46.259989 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a7a39176-d3ff-4074-ab4b-fb18e2926071 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518" status: 200 len: 1262 microversion: 2.1 time: 0.203923 Jul 18 02:58:46.272409 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2785/5554] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:46 2022] GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518 => generated 1262 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:46.749024 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-900337b4-32d5-43f8-bc2b-bacb523e8ddb tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:46.758369 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-900337b4-32d5-43f8-bc2b-bacb523e8ddb tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:46.788390 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-900337b4-32d5-43f8-bc2b-bacb523e8ddb tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:46.789203 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-900337b4-32d5-43f8-bc2b-bacb523e8ddb tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:46.814035 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-900337b4-32d5-43f8-bc2b-bacb523e8ddb tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:46.819144 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-900337b4-32d5-43f8-bc2b-bacb523e8ddb tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:46.832770 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ea80da78-941d-45c8-ba5b-5eadaf272616 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:46.834049 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ea80da78-941d-45c8-ba5b-5eadaf272616 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 0b51bfed-afd2-4629-8b36-b466661de551] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:46.887901 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ea80da78-941d-45c8-ba5b-5eadaf272616 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:46.893438 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ea80da78-941d-45c8-ba5b-5eadaf272616 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:46.895438 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ea80da78-941d-45c8-ba5b-5eadaf272616 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:46.903930 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ea80da78-941d-45c8-ba5b-5eadaf272616 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:47.797977 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ea80da78-941d-45c8-ba5b-5eadaf272616 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:47.810986 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ea80da78-941d-45c8-ba5b-5eadaf272616 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551" status: 200 len: 1265 microversion: 2.1 time: 0.987713 Jul 18 02:58:47.830492 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2786/5555] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:46 2022] GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551 => generated 1265 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:47.842174 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8773db47-ad42-4906-8297-ae87f7699dc4 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:47.843424 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8773db47-ad42-4906-8297-ae87f7699dc4 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:47.863143 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8773db47-ad42-4906-8297-ae87f7699dc4 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:47.865187 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8773db47-ad42-4906-8297-ae87f7699dc4 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:47.870752 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8773db47-ad42-4906-8297-ae87f7699dc4 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:47.871636 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8773db47-ad42-4906-8297-ae87f7699dc4 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:47.915316 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-900337b4-32d5-43f8-bc2b-bacb523e8ddb tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:47.937267 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-900337b4-32d5-43f8-bc2b-bacb523e8ddb tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3" status: 200 len: 1514 microversion: 2.1 time: 1.193727 Jul 18 02:58:47.940087 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2770/5556] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:46 2022] GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 => generated 1514 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:48.002388 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8773db47-ad42-4906-8297-ae87f7699dc4 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:48.014098 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8773db47-ad42-4906-8297-ae87f7699dc4 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518" status: 200 len: 1324 microversion: 2.1 time: 0.181665 Jul 18 02:58:48.025420 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2787/5557] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:47 2022] GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518 => generated 1324 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:48.836847 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0508ac63-bf02-4b8f-b0c4-415c1c652a4f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:48.838400 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0508ac63-bf02-4b8f-b0c4-415c1c652a4f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 0b51bfed-afd2-4629-8b36-b466661de551] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:48.858613 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0508ac63-bf02-4b8f-b0c4-415c1c652a4f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:48.859583 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0508ac63-bf02-4b8f-b0c4-415c1c652a4f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:48.860791 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0508ac63-bf02-4b8f-b0c4-415c1c652a4f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:48.862238 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0508ac63-bf02-4b8f-b0c4-415c1c652a4f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:48.972227 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-89307930-c000-48bf-b1ea-7531c7b33c79 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:48.972908 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-89307930-c000-48bf-b1ea-7531c7b33c79 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:49.001431 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-89307930-c000-48bf-b1ea-7531c7b33c79 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:49.005691 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-89307930-c000-48bf-b1ea-7531c7b33c79 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:49.007331 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-89307930-c000-48bf-b1ea-7531c7b33c79 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:49.010714 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-89307930-c000-48bf-b1ea-7531c7b33c79 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:49.088825 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:58:49.353416 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0508ac63-bf02-4b8f-b0c4-415c1c652a4f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:49.367482 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0508ac63-bf02-4b8f-b0c4-415c1c652a4f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551" status: 200 len: 1265 microversion: 2.1 time: 0.535207 Jul 18 02:58:49.368125 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2771/5558] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:48 2022] GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551 => generated 1265 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:58:49.392374 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-dda7b682-0852-4ab4-a870-c8d1ca2c9f1c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:49.403509 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-dda7b682-0852-4ab4-a870-c8d1ca2c9f1c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:49.455461 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dda7b682-0852-4ab4-a870-c8d1ca2c9f1c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:49.459846 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dda7b682-0852-4ab4-a870-c8d1ca2c9f1c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:49.464297 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dda7b682-0852-4ab4-a870-c8d1ca2c9f1c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:49.468900 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dda7b682-0852-4ab4-a870-c8d1ca2c9f1c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:49.577078 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-89307930-c000-48bf-b1ea-7531c7b33c79 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:49.605045 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-89307930-c000-48bf-b1ea-7531c7b33c79 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3" status: 200 len: 1514 microversion: 2.1 time: 0.636894 Jul 18 02:58:49.606034 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2788/5559] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:48 2022] GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 => generated 1514 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:49.684148 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-dda7b682-0852-4ab4-a870-c8d1ca2c9f1c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:49.701184 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-dda7b682-0852-4ab4-a870-c8d1ca2c9f1c tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518" status: 200 len: 1324 microversion: 2.1 time: 0.331299 Jul 18 02:58:49.704051 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2772/5560] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:49 2022] GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518 => generated 1324 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:50.404200 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a475d60c-e309-4a11-b22a-ff1696768152 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:50.405103 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a475d60c-e309-4a11-b22a-ff1696768152 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 0b51bfed-afd2-4629-8b36-b466661de551] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:50.442524 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a475d60c-e309-4a11-b22a-ff1696768152 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:50.444527 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a475d60c-e309-4a11-b22a-ff1696768152 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:50.450297 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a475d60c-e309-4a11-b22a-ff1696768152 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:50.451061 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a475d60c-e309-4a11-b22a-ff1696768152 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:50.624905 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8432d49b-5cdd-42cc-ad66-924c922e39a3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:50.625726 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8432d49b-5cdd-42cc-ad66-924c922e39a3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:50.643528 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8432d49b-5cdd-42cc-ad66-924c922e39a3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:50.644480 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8432d49b-5cdd-42cc-ad66-924c922e39a3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:50.648399 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8432d49b-5cdd-42cc-ad66-924c922e39a3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:50.649052 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8432d49b-5cdd-42cc-ad66-924c922e39a3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:51.160293 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a475d60c-e309-4a11-b22a-ff1696768152 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:51.195156 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a475d60c-e309-4a11-b22a-ff1696768152 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551" status: 200 len: 1265 microversion: 2.1 time: 0.801336 Jul 18 02:58:51.208436 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2789/5561] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:50 2022] GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551 => generated 1265 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:58:51.235822 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-627ceeed-3e45-48f8-865a-eaed9809b5dc tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:51.239869 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-627ceeed-3e45-48f8-865a-eaed9809b5dc tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:51.256364 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8432d49b-5cdd-42cc-ad66-924c922e39a3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:51.271447 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8432d49b-5cdd-42cc-ad66-924c922e39a3 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3" status: 200 len: 1514 microversion: 2.1 time: 0.651006 Jul 18 02:58:51.273113 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-627ceeed-3e45-48f8-865a-eaed9809b5dc tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:51.292866 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-627ceeed-3e45-48f8-865a-eaed9809b5dc tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:51.292866 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-627ceeed-3e45-48f8-865a-eaed9809b5dc tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:51.292866 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-627ceeed-3e45-48f8-865a-eaed9809b5dc tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:51.293468 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2773/5562] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:50 2022] GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 => generated 1514 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:58:51.895289 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-627ceeed-3e45-48f8-865a-eaed9809b5dc tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:51.907108 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-627ceeed-3e45-48f8-865a-eaed9809b5dc tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518" status: 200 len: 1391 microversion: 2.1 time: 0.695923 Jul 18 02:58:51.921263 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2790/5563] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:51 2022] GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518 => generated 1391 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:52.215718 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5093bbef-92e6-4273-8ea5-8c7b2605ce36 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:52.216355 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5093bbef-92e6-4273-8ea5-8c7b2605ce36 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 0b51bfed-afd2-4629-8b36-b466661de551] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:52.231961 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5093bbef-92e6-4273-8ea5-8c7b2605ce36 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:52.233288 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5093bbef-92e6-4273-8ea5-8c7b2605ce36 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:52.234773 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5093bbef-92e6-4273-8ea5-8c7b2605ce36 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:52.237093 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5093bbef-92e6-4273-8ea5-8c7b2605ce36 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:52.311485 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-56e173eb-1786-4f21-9833-11d1a36f29a2 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:52.322158 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-56e173eb-1786-4f21-9833-11d1a36f29a2 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:52.380189 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56e173eb-1786-4f21-9833-11d1a36f29a2 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:52.385634 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56e173eb-1786-4f21-9833-11d1a36f29a2 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:52.392931 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56e173eb-1786-4f21-9833-11d1a36f29a2 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:52.395945 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56e173eb-1786-4f21-9833-11d1a36f29a2 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:52.576462 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5093bbef-92e6-4273-8ea5-8c7b2605ce36 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:52.599854 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5093bbef-92e6-4273-8ea5-8c7b2605ce36 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551" status: 200 len: 1265 microversion: 2.1 time: 0.388975 Jul 18 02:58:52.627040 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2774/5564] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:52 2022] GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551 => generated 1265 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:52.939306 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ac8ddd0d-c67b-402f-949a-fa7b550a2164 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:52.940773 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ac8ddd0d-c67b-402f-949a-fa7b550a2164 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:52.973424 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ac8ddd0d-c67b-402f-949a-fa7b550a2164 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:52.981608 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ac8ddd0d-c67b-402f-949a-fa7b550a2164 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:52.983157 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ac8ddd0d-c67b-402f-949a-fa7b550a2164 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:52.990587 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ac8ddd0d-c67b-402f-949a-fa7b550a2164 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:53.107310 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-56e173eb-1786-4f21-9833-11d1a36f29a2 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:53.153904 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-56e173eb-1786-4f21-9833-11d1a36f29a2 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3" status: 200 len: 1509 microversion: 2.1 time: 0.855418 Jul 18 02:58:53.161359 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2791/5565] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:52 2022] GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 => generated 1509 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:53.472286 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ac8ddd0d-c67b-402f-949a-fa7b550a2164 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:53.492204 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ac8ddd0d-c67b-402f-949a-fa7b550a2164 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518" status: 200 len: 1391 microversion: 2.1 time: 0.567102 Jul 18 02:58:53.508721 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2775/5566] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:52 2022] GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518 => generated 1391 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:58:53.659942 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9e9d050a-36c3-4183-9a87-8da0e7360d06 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:53.661154 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9e9d050a-36c3-4183-9a87-8da0e7360d06 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 0b51bfed-afd2-4629-8b36-b466661de551] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:53.693150 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e9d050a-36c3-4183-9a87-8da0e7360d06 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:53.693620 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e9d050a-36c3-4183-9a87-8da0e7360d06 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:53.694515 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e9d050a-36c3-4183-9a87-8da0e7360d06 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:53.698503 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e9d050a-36c3-4183-9a87-8da0e7360d06 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:53.994292 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9e9d050a-36c3-4183-9a87-8da0e7360d06 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:54.008611 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9e9d050a-36c3-4183-9a87-8da0e7360d06 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551" status: 200 len: 1265 microversion: 2.1 time: 0.355787 Jul 18 02:58:54.010499 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2792/5567] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:53 2022] GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551 => generated 1265 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:54.186213 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-04f18f65-64ca-47d5-be0b-2136e0b938f8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:54.187168 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-04f18f65-64ca-47d5-be0b-2136e0b938f8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:54.202784 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:58:54.211304 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-04f18f65-64ca-47d5-be0b-2136e0b938f8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:54.214058 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-04f18f65-64ca-47d5-be0b-2136e0b938f8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:54.222017 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-04f18f65-64ca-47d5-be0b-2136e0b938f8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:54.225330 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-04f18f65-64ca-47d5-be0b-2136e0b938f8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:54.520160 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d5b2b33c-e45d-4642-8dcc-edc115dd814e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:54.521673 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d5b2b33c-e45d-4642-8dcc-edc115dd814e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:54.533589 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5b2b33c-e45d-4642-8dcc-edc115dd814e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:54.539668 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5b2b33c-e45d-4642-8dcc-edc115dd814e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:54.541599 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5b2b33c-e45d-4642-8dcc-edc115dd814e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:54.542384 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5b2b33c-e45d-4642-8dcc-edc115dd814e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:54.818281 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-04f18f65-64ca-47d5-be0b-2136e0b938f8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:54.856784 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-04f18f65-64ca-47d5-be0b-2136e0b938f8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3" status: 200 len: 1509 microversion: 2.1 time: 0.679779 Jul 18 02:58:54.858806 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2776/5568] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:54 2022] GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 => generated 1509 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:55.045262 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-afaae188-afc3-4239-aaf7-a89c7c0c638f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:55.052414 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-afaae188-afc3-4239-aaf7-a89c7c0c638f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 0b51bfed-afd2-4629-8b36-b466661de551] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:55.125215 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=8 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:58:55.161171 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-afaae188-afc3-4239-aaf7-a89c7c0c638f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:55.162315 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-afaae188-afc3-4239-aaf7-a89c7c0c638f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:55.174452 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-afaae188-afc3-4239-aaf7-a89c7c0c638f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:55.175316 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-afaae188-afc3-4239-aaf7-a89c7c0c638f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:55.195799 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d5b2b33c-e45d-4642-8dcc-edc115dd814e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:55.217272 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d5b2b33c-e45d-4642-8dcc-edc115dd814e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518" status: 200 len: 1391 microversion: 2.1 time: 0.702271 Jul 18 02:58:55.218640 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2793/5569] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:54 2022] GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518 => generated 1391 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:55.224708 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-52702c75-6126-42c5-924d-891e83c0a62c req-0583e295-ac68-4f32-9a2e-ef51f7a38200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20c7c630-5739-487b-97c9-463a8de621a3", "name": "network-vif-plugged", "status": "completed", "tag": "51e95f27-927b-4956-b785-097434c3f4c0"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:58:55.251370 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-52702c75-6126-42c5-924d-891e83c0a62c req-0583e295-ac68-4f32-9a2e-ef51f7a38200 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:55.255998 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-52702c75-6126-42c5-924d-891e83c0a62c req-0583e295-ac68-4f32-9a2e-ef51f7a38200 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:55.288344 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-52702c75-6126-42c5-924d-891e83c0a62c req-0583e295-ac68-4f32-9a2e-ef51f7a38200 service nova] Creating event network-vif-plugged:51e95f27-927b-4956-b785-097434c3f4c0 for instance 20c7c630-5739-487b-97c9-463a8de621a3 on n-h1-465891-3 Jul 18 02:58:55.298073 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-52702c75-6126-42c5-924d-891e83c0a62c req-0583e295-ac68-4f32-9a2e-ef51f7a38200 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077860 Jul 18 02:58:55.299407 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2794/5570] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:58:55.670870 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-afaae188-afc3-4239-aaf7-a89c7c0c638f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:55.688371 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-afaae188-afc3-4239-aaf7-a89c7c0c638f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551" status: 200 len: 1265 microversion: 2.1 time: 0.656423 Jul 18 02:58:55.694827 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2777/5571] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:55 2022] GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551 => generated 1265 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:55.759297 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dacc4b77-2b0f-4167-a6bf-10974ff7b574 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1190902178", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "13c3d6fc-1a15-4890-9d41-5509e7052f17"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:58:55.894927 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d965d1f9-22ca-45d5-8f22-43592e9309cb tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:55.895742 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d965d1f9-22ca-45d5-8f22-43592e9309cb tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:55.919162 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-dacc4b77-2b0f-4167-a6bf-10974ff7b574 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] validate_networks() for [('13c3d6fc-1a15-4890-9d41-5509e7052f17', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:58:55.933355 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d965d1f9-22ca-45d5-8f22-43592e9309cb tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:55.934164 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d965d1f9-22ca-45d5-8f22-43592e9309cb tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:55.935218 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d965d1f9-22ca-45d5-8f22-43592e9309cb tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:55.936147 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d965d1f9-22ca-45d5-8f22-43592e9309cb tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:57.398278 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d965d1f9-22ca-45d5-8f22-43592e9309cb tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:57.425342 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d965d1f9-22ca-45d5-8f22-43592e9309cb tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3" status: 200 len: 1509 microversion: 2.1 time: 1.533647 Jul 18 02:58:57.456012 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2778/5572] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:55 2022] GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 => generated 1509 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:58:57.467206 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-91c8c6aa-1088-4b34-8143-66079cab0ecf tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:57.470140 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-91c8c6aa-1088-4b34-8143-66079cab0ecf tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:57.483771 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91c8c6aa-1088-4b34-8143-66079cab0ecf tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:57.486385 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91c8c6aa-1088-4b34-8143-66079cab0ecf tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:57.489635 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91c8c6aa-1088-4b34-8143-66079cab0ecf tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:57.490766 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91c8c6aa-1088-4b34-8143-66079cab0ecf tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:57.994178 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-dacc4b77-2b0f-4167-a6bf-10974ff7b574 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:58:57.996042 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-dacc4b77-2b0f-4167-a6bf-10974ff7b574 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:58:57.997453 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-dacc4b77-2b0f-4167-a6bf-10974ff7b574 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:58:57.998394 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-dacc4b77-2b0f-4167-a6bf-10974ff7b574 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:58:57.999772 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-dacc4b77-2b0f-4167-a6bf-10974ff7b574 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:58:58.013600 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dacc4b77-2b0f-4167-a6bf-10974ff7b574 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:58.014421 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dacc4b77-2b0f-4167-a6bf-10974ff7b574 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:58.015706 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dacc4b77-2b0f-4167-a6bf-10974ff7b574 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:58.016440 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dacc4b77-2b0f-4167-a6bf-10974ff7b574 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:58.044228 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-dacc4b77-2b0f-4167-a6bf-10974ff7b574 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Getting quotas for project 6ee75032bd62467399758fce3f8e11b2. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:58:58.051393 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-dacc4b77-2b0f-4167-a6bf-10974ff7b574 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Getting quotas for user 10bf3f42f3f5470c85398703180f9527 and project 6ee75032bd62467399758fce3f8e11b2. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:58:58.108386 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-dacc4b77-2b0f-4167-a6bf-10974ff7b574 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:58:58.117362 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-dacc4b77-2b0f-4167-a6bf-10974ff7b574 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] [instance: bf9d4886-031b-414a-aac0-4e4d9d200709] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:58:58.263244 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-dacc4b77-2b0f-4167-a6bf-10974ff7b574 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.894984 Jul 18 02:58:58.266792 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2795/5573] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:58:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 02:58:58.287311 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-673ed80e-2624-420f-a33d-acccc4dabfc5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:58.291663 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-673ed80e-2624-420f-a33d-acccc4dabfc5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 0b51bfed-afd2-4629-8b36-b466661de551] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:58.312962 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-673ed80e-2624-420f-a33d-acccc4dabfc5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:58.317568 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-673ed80e-2624-420f-a33d-acccc4dabfc5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:58.318887 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-673ed80e-2624-420f-a33d-acccc4dabfc5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:58.319868 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-673ed80e-2624-420f-a33d-acccc4dabfc5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:58.900222 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-91c8c6aa-1088-4b34-8143-66079cab0ecf tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:58.919501 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-91c8c6aa-1088-4b34-8143-66079cab0ecf tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518" status: 200 len: 1391 microversion: 2.1 time: 1.454162 Jul 18 02:58:58.933751 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-673ed80e-2624-420f-a33d-acccc4dabfc5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:58.934105 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2779/5574] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:57 2022] GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518 => generated 1391 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:58.934105 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-2fbbcfab-a75e-4269-956e-e83bbcf85dd2 req-bf6e4b88-e230-43ce-a59d-4ab3971372e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b51bfed-afd2-4629-8b36-b466661de551", "name": "network-vif-plugged", "status": "completed", "tag": "b6a9c561-dec2-426c-be72-ed96ce7f50e9"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:58:58.941967 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-673ed80e-2624-420f-a33d-acccc4dabfc5 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551" status: 200 len: 1265 microversion: 2.1 time: 0.667296 Jul 18 02:58:58.952206 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2796/5575] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:58 2022] GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551 => generated 1265 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:58.954735 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-2fbbcfab-a75e-4269-956e-e83bbcf85dd2 req-bf6e4b88-e230-43ce-a59d-4ab3971372e5 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:58.955189 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-2fbbcfab-a75e-4269-956e-e83bbcf85dd2 req-bf6e4b88-e230-43ce-a59d-4ab3971372e5 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:58.968891 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-8a64b8eb-19c8-47e6-aa44-b937ee8bb0f4 req-c4d77f60-5fdb-4875-a57c-b3b5ca4f5487 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f94423aa-e701-4f83-a4ce-8d5a90325518", "tag": "17631478-219a-40dd-94fe-c981bae41eae"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:58:58.978614 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-2fbbcfab-a75e-4269-956e-e83bbcf85dd2 req-bf6e4b88-e230-43ce-a59d-4ab3971372e5 service nova] Creating event network-vif-plugged:b6a9c561-dec2-426c-be72-ed96ce7f50e9 for instance 0b51bfed-afd2-4629-8b36-b466661de551 on n-h2-465891-3 Jul 18 02:58:58.988405 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-2fbbcfab-a75e-4269-956e-e83bbcf85dd2 req-bf6e4b88-e230-43ce-a59d-4ab3971372e5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063970 Jul 18 02:58:58.989402 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2780/5576] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:58:59.004847 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-514ee501-fba7-4f37-8948-77c6080d598b tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:59.006736 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-8a64b8eb-19c8-47e6-aa44-b937ee8bb0f4 req-c4d77f60-5fdb-4875-a57c-b3b5ca4f5487 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:59.007261 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-8a64b8eb-19c8-47e6-aa44-b937ee8bb0f4 req-c4d77f60-5fdb-4875-a57c-b3b5ca4f5487 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:59.007831 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-514ee501-fba7-4f37-8948-77c6080d598b tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] [instance: bf9d4886-031b-414a-aac0-4e4d9d200709] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:59.038080 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-8a64b8eb-19c8-47e6-aa44-b937ee8bb0f4 req-c4d77f60-5fdb-4875-a57c-b3b5ca4f5487 service nova] Creating event network-changed:17631478-219a-40dd-94fe-c981bae41eae for instance f94423aa-e701-4f83-a4ce-8d5a90325518 on n-h1-465891-3 Jul 18 02:58:59.073440 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-8a64b8eb-19c8-47e6-aa44-b937ee8bb0f4 req-c4d77f60-5fdb-4875-a57c-b3b5ca4f5487 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119108 Jul 18 02:58:59.079840 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2797/5577] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:58:59.099180 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-85e5631d-c1c6-4914-946d-3e1e9f56148e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:59.100080 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-85e5631d-c1c6-4914-946d-3e1e9f56148e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:59.116165 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85e5631d-c1c6-4914-946d-3e1e9f56148e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:59.120913 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85e5631d-c1c6-4914-946d-3e1e9f56148e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:59.122226 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85e5631d-c1c6-4914-946d-3e1e9f56148e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:59.122935 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85e5631d-c1c6-4914-946d-3e1e9f56148e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:59.169547 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-514ee501-fba7-4f37-8948-77c6080d598b tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bf3f42f3f5470c85398703180f9527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee75032bd62467399758fce3f8e11b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:59.211985 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-514ee501-fba7-4f37-8948-77c6080d598b tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] 10.222.0.57 "GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709" status: 200 len: 1215 microversion: 2.1 time: 0.221093 Jul 18 02:58:59.231514 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2781/5578] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:58 2022] GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709 => generated 1215 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:59.757434 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-85e5631d-c1c6-4914-946d-3e1e9f56148e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:59.770414 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-85e5631d-c1c6-4914-946d-3e1e9f56148e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3" status: 200 len: 1509 microversion: 2.1 time: 0.689028 Jul 18 02:58:59.782154 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2798/5579] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:59 2022] GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 => generated 1509 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:59.954667 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5d25131b-fcbf-44ba-8a8e-889448bad41e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:59.955520 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5d25131b-fcbf-44ba-8a8e-889448bad41e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:59.971205 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-08ec3c7e-35da-450a-891e-3e5f73a2c137 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:59.975790 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5d25131b-fcbf-44ba-8a8e-889448bad41e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:59.977180 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5d25131b-fcbf-44ba-8a8e-889448bad41e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:59.980611 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5d25131b-fcbf-44ba-8a8e-889448bad41e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:59.980821 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-08ec3c7e-35da-450a-891e-3e5f73a2c137 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 0b51bfed-afd2-4629-8b36-b466661de551] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:59.982714 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5d25131b-fcbf-44ba-8a8e-889448bad41e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:00.004194 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=100 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:59:00.043285 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-08ec3c7e-35da-450a-891e-3e5f73a2c137 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:00.045356 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-08ec3c7e-35da-450a-891e-3e5f73a2c137 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:00.047187 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-08ec3c7e-35da-450a-891e-3e5f73a2c137 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:00.054363 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-08ec3c7e-35da-450a-891e-3e5f73a2c137 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:00.288453 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5d25131b-fcbf-44ba-8a8e-889448bad41e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:00.316226 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5d25131b-fcbf-44ba-8a8e-889448bad41e tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518" status: 200 len: 1391 microversion: 2.1 time: 0.365966 Jul 18 02:59:00.342853 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2782/5580] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:59 2022] GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518 => generated 1391 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:00.364022 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-24bf3096-08e8-44d1-a96b-aefb3709a938 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:00.367952 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-24bf3096-08e8-44d1-a96b-aefb3709a938 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] [instance: bf9d4886-031b-414a-aac0-4e4d9d200709] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:00.420186 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-24bf3096-08e8-44d1-a96b-aefb3709a938 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:00.420968 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-24bf3096-08e8-44d1-a96b-aefb3709a938 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:00.427913 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-24bf3096-08e8-44d1-a96b-aefb3709a938 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:00.431968 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-24bf3096-08e8-44d1-a96b-aefb3709a938 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:00.543955 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-08ec3c7e-35da-450a-891e-3e5f73a2c137 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:00.570887 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-08ec3c7e-35da-450a-891e-3e5f73a2c137 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551" status: 200 len: 1265 microversion: 2.1 time: 0.612493 Jul 18 02:59:00.575835 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2799/5581] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:59 2022] GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551 => generated 1265 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:59:00.719417 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-24bf3096-08e8-44d1-a96b-aefb3709a938 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bf3f42f3f5470c85398703180f9527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee75032bd62467399758fce3f8e11b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:00.742907 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-24bf3096-08e8-44d1-a96b-aefb3709a938 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] 10.222.0.57 "GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709" status: 200 len: 1267 microversion: 2.1 time: 0.398491 Jul 18 02:59:00.749458 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2783/5582] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:00 2022] GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709 => generated 1267 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:00.805174 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-750c87b0-7f77-4dbc-a6ae-c30654f8091e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:00.807007 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-750c87b0-7f77-4dbc-a6ae-c30654f8091e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:00.844841 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-750c87b0-7f77-4dbc-a6ae-c30654f8091e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:00.858825 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-750c87b0-7f77-4dbc-a6ae-c30654f8091e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:00.859821 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-750c87b0-7f77-4dbc-a6ae-c30654f8091e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:00.863042 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-750c87b0-7f77-4dbc-a6ae-c30654f8091e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:01.386010 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-af254937-4324-4d25-a326-2c9e47f23de7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:01.396654 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-af254937-4324-4d25-a326-2c9e47f23de7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:01.437097 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-af254937-4324-4d25-a326-2c9e47f23de7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:01.445559 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-af254937-4324-4d25-a326-2c9e47f23de7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:01.448385 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-af254937-4324-4d25-a326-2c9e47f23de7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:01.455670 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-af254937-4324-4d25-a326-2c9e47f23de7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:02.647937 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-af254937-4324-4d25-a326-2c9e47f23de7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:02.690239 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-af254937-4324-4d25-a326-2c9e47f23de7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518" status: 200 len: 1391 microversion: 2.1 time: 1.343759 Jul 18 02:59:02.708789 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2784/5583] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:01 2022] GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518 => generated 1391 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:02.717606 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9004e5f5-169e-4456-9e05-4a7ddade3eb7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:02.738731 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9004e5f5-169e-4456-9e05-4a7ddade3eb7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 0b51bfed-afd2-4629-8b36-b466661de551] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:02.760894 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9004e5f5-169e-4456-9e05-4a7ddade3eb7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:02.768659 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9004e5f5-169e-4456-9e05-4a7ddade3eb7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:02.769989 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9004e5f5-169e-4456-9e05-4a7ddade3eb7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:02.772511 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9004e5f5-169e-4456-9e05-4a7ddade3eb7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:03.110426 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-750c87b0-7f77-4dbc-a6ae-c30654f8091e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:03.120760 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-750c87b0-7f77-4dbc-a6ae-c30654f8091e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3" status: 200 len: 1509 microversion: 2.1 time: 2.321179 Jul 18 02:59:03.121379 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2800/5584] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:00 2022] GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 => generated 1509 bytes in 2323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:59:03.136814 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-79902833-c007-496b-8a70-587ecd279e47 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:03.144275 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-79902833-c007-496b-8a70-587ecd279e47 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] [instance: bf9d4886-031b-414a-aac0-4e4d9d200709] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:03.159695 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-79902833-c007-496b-8a70-587ecd279e47 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:03.163842 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-79902833-c007-496b-8a70-587ecd279e47 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:03.164930 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-79902833-c007-496b-8a70-587ecd279e47 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:03.168437 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-79902833-c007-496b-8a70-587ecd279e47 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:03.929976 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-79902833-c007-496b-8a70-587ecd279e47 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bf3f42f3f5470c85398703180f9527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee75032bd62467399758fce3f8e11b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:03.944506 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-79902833-c007-496b-8a70-587ecd279e47 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] 10.222.0.57 "GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709" status: 200 len: 1273 microversion: 2.1 time: 0.812706 Jul 18 02:59:03.959510 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2801/5585] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:03 2022] GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709 => generated 1273 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:03.966300 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2653fa78-34d4-4680-82d3-b0d9a2c362fa tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:03.970737 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2653fa78-34d4-4680-82d3-b0d9a2c362fa tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:03.995455 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2653fa78-34d4-4680-82d3-b0d9a2c362fa tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:03.998441 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2653fa78-34d4-4680-82d3-b0d9a2c362fa tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:04.001604 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2653fa78-34d4-4680-82d3-b0d9a2c362fa tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:04.013222 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2653fa78-34d4-4680-82d3-b0d9a2c362fa tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:04.719085 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9004e5f5-169e-4456-9e05-4a7ddade3eb7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:04.737009 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9004e5f5-169e-4456-9e05-4a7ddade3eb7 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551" status: 200 len: 1452 microversion: 2.1 time: 2.024715 Jul 18 02:59:04.738503 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2785/5586] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:02 2022] GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551 => generated 1452 bytes in 2029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:04.755717 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f3c36b03-13e4-43f3-9e3d-dc7ce440573d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:04.757368 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f3c36b03-13e4-43f3-9e3d-dc7ce440573d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:04.789431 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f3c36b03-13e4-43f3-9e3d-dc7ce440573d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:04.791931 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f3c36b03-13e4-43f3-9e3d-dc7ce440573d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:04.800290 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f3c36b03-13e4-43f3-9e3d-dc7ce440573d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:04.801471 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f3c36b03-13e4-43f3-9e3d-dc7ce440573d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:05.201148 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2653fa78-34d4-4680-82d3-b0d9a2c362fa tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:05.211878 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2653fa78-34d4-4680-82d3-b0d9a2c362fa tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518" status: 200 len: 1391 microversion: 2.1 time: 1.249547 Jul 18 02:59:05.213753 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2802/5587] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:03 2022] GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518 => generated 1391 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:05.224669 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-105ad0ff-2217-4296-b083-4d6993217bec tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:05.229399 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-105ad0ff-2217-4296-b083-4d6993217bec tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 0b51bfed-afd2-4629-8b36-b466661de551] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:05.265134 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-105ad0ff-2217-4296-b083-4d6993217bec tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:05.266126 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-105ad0ff-2217-4296-b083-4d6993217bec tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:05.267522 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-105ad0ff-2217-4296-b083-4d6993217bec tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:05.268430 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-105ad0ff-2217-4296-b083-4d6993217bec tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:05.348537 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f3c36b03-13e4-43f3-9e3d-dc7ce440573d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:05.407065 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f3c36b03-13e4-43f3-9e3d-dc7ce440573d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3" status: 200 len: 1509 microversion: 2.1 time: 0.664178 Jul 18 02:59:05.412983 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2786/5588] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:04 2022] GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 => generated 1509 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:05.444511 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-eef6009f-18cb-4454-842d-c14cf686c887 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:05.453430 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-eef6009f-18cb-4454-842d-c14cf686c887 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] [instance: bf9d4886-031b-414a-aac0-4e4d9d200709] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:05.483252 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eef6009f-18cb-4454-842d-c14cf686c887 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:05.487361 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eef6009f-18cb-4454-842d-c14cf686c887 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:05.502021 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eef6009f-18cb-4454-842d-c14cf686c887 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:05.502871 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eef6009f-18cb-4454-842d-c14cf686c887 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:06.401217 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-105ad0ff-2217-4296-b083-4d6993217bec tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:06.414269 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-105ad0ff-2217-4296-b083-4d6993217bec tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551" status: 200 len: 1452 microversion: 2.1 time: 1.198790 Jul 18 02:59:06.418528 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2803/5589] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:05 2022] GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551 => generated 1452 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:06.431804 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ff65ce51-ce58-458a-bba3-20d178f2e385 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:06.432941 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ff65ce51-ce58-458a-bba3-20d178f2e385 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:06.448515 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ff65ce51-ce58-458a-bba3-20d178f2e385 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:06.450468 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ff65ce51-ce58-458a-bba3-20d178f2e385 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:06.454891 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ff65ce51-ce58-458a-bba3-20d178f2e385 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:06.455785 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ff65ce51-ce58-458a-bba3-20d178f2e385 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:06.529797 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-eef6009f-18cb-4454-842d-c14cf686c887 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bf3f42f3f5470c85398703180f9527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee75032bd62467399758fce3f8e11b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:06.539364 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-eef6009f-18cb-4454-842d-c14cf686c887 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] 10.222.0.57 "GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709" status: 200 len: 1315 microversion: 2.1 time: 1.124839 Jul 18 02:59:06.539981 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2787/5590] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:05 2022] GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709 => generated 1315 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:06.557040 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b5a601f3-2c05-43c1-a919-5ce4cd4bc9d7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:06.570733 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b5a601f3-2c05-43c1-a919-5ce4cd4bc9d7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:06.608815 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b5a601f3-2c05-43c1-a919-5ce4cd4bc9d7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:06.619147 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b5a601f3-2c05-43c1-a919-5ce4cd4bc9d7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:06.623075 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b5a601f3-2c05-43c1-a919-5ce4cd4bc9d7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:06.626683 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b5a601f3-2c05-43c1-a919-5ce4cd4bc9d7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:07.567494 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b5a601f3-2c05-43c1-a919-5ce4cd4bc9d7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:07.580503 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ff65ce51-ce58-458a-bba3-20d178f2e385 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:07.586442 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b5a601f3-2c05-43c1-a919-5ce4cd4bc9d7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3" status: 200 len: 1509 microversion: 2.1 time: 1.041042 Jul 18 02:59:07.594118 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2788/5591] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:06 2022] GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 => generated 1509 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:07.607327 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-468250d0-856f-4257-a01c-9c9c127a630e tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:07.614459 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-468250d0-856f-4257-a01c-9c9c127a630e tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] [instance: bf9d4886-031b-414a-aac0-4e4d9d200709] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:07.640194 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ff65ce51-ce58-458a-bba3-20d178f2e385 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518" status: 200 len: 1391 microversion: 2.1 time: 1.219430 Jul 18 02:59:07.641290 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2804/5592] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:06 2022] GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518 => generated 1391 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:07.652813 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-468250d0-856f-4257-a01c-9c9c127a630e tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:07.653739 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-468250d0-856f-4257-a01c-9c9c127a630e tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:07.655126 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-468250d0-856f-4257-a01c-9c9c127a630e tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:07.655883 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-468250d0-856f-4257-a01c-9c9c127a630e tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:08.096293 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-468250d0-856f-4257-a01c-9c9c127a630e tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bf3f42f3f5470c85398703180f9527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee75032bd62467399758fce3f8e11b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:08.163123 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-468250d0-856f-4257-a01c-9c9c127a630e tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] 10.222.0.57 "GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709" status: 200 len: 1315 microversion: 2.1 time: 0.562027 Jul 18 02:59:08.171378 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2789/5593] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:07 2022] GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709 => generated 1315 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:08.443389 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-27da3796-525a-4c25-a503-6a62ffb75922 req-ff13f26e-9237-485d-b462-206fd942d148 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf9d4886-031b-414a-aac0-4e4d9d200709", "tag": "b476e3d9-5371-42fa-9f11-c7642038728f"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:59:08.512533 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:59:08.515053 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:59:08.573410 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-27da3796-525a-4c25-a503-6a62ffb75922 req-ff13f26e-9237-485d-b462-206fd942d148 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:08.574676 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-27da3796-525a-4c25-a503-6a62ffb75922 req-ff13f26e-9237-485d-b462-206fd942d148 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.045s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:08.630643 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-041326d0-c964-48ba-ae36-a80fb6a7b905 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:08.632798 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-041326d0-c964-48ba-ae36-a80fb6a7b905 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:08.656436 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-27da3796-525a-4c25-a503-6a62ffb75922 req-ff13f26e-9237-485d-b462-206fd942d148 service nova] Creating event network-changed:b476e3d9-5371-42fa-9f11-c7642038728f for instance bf9d4886-031b-414a-aac0-4e4d9d200709 on n-h2-465891-3 Jul 18 02:59:08.685907 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-041326d0-c964-48ba-ae36-a80fb6a7b905 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:08.694301 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-27da3796-525a-4c25-a503-6a62ffb75922 req-ff13f26e-9237-485d-b462-206fd942d148 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.255908 Jul 18 02:59:08.695815 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2805/5594] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:59:08.704498 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-041326d0-c964-48ba-ae36-a80fb6a7b905 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:08.704791 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-041326d0-c964-48ba-ae36-a80fb6a7b905 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:08.705083 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-041326d0-c964-48ba-ae36-a80fb6a7b905 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:08.707478 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-52ae08ed-36ac-4347-9481-11bfbd61a9d5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:08.708892 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-52ae08ed-36ac-4347-9481-11bfbd61a9d5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:08.728865 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-52ae08ed-36ac-4347-9481-11bfbd61a9d5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:08.730139 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-52ae08ed-36ac-4347-9481-11bfbd61a9d5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:08.732245 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-52ae08ed-36ac-4347-9481-11bfbd61a9d5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:08.733232 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-52ae08ed-36ac-4347-9481-11bfbd61a9d5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:09.211971 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:59:09.492306 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-52ae08ed-36ac-4347-9481-11bfbd61a9d5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:09.548460 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-52ae08ed-36ac-4347-9481-11bfbd61a9d5 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518" status: 200 len: 1391 microversion: 2.1 time: 0.839357 Jul 18 02:59:09.552803 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2806/5595] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:08 2022] GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518 => generated 1391 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:09.576014 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-041326d0-c964-48ba-ae36-a80fb6a7b905 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:09.590207 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-041326d0-c964-48ba-ae36-a80fb6a7b905 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3" status: 200 len: 1509 microversion: 2.1 time: 0.968639 Jul 18 02:59:09.593232 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e0c0c65c-1338-49c1-a067-617cc221e17e tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:09.594273 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2790/5596] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:08 2022] GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 => generated 1509 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:09.595984 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e0c0c65c-1338-49c1-a067-617cc221e17e tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] [instance: bf9d4886-031b-414a-aac0-4e4d9d200709] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:09.604131 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:59:09.607517 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e0c0c65c-1338-49c1-a067-617cc221e17e tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:09.609269 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e0c0c65c-1338-49c1-a067-617cc221e17e tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:09.610533 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e0c0c65c-1338-49c1-a067-617cc221e17e tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:09.611352 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e0c0c65c-1338-49c1-a067-617cc221e17e tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:10.266613 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-3093ad9c-b36d-4192-9795-03af37518c78 req-c7409737-d7c2-420f-a26d-dea286fd148d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f94423aa-e701-4f83-a4ce-8d5a90325518", "name": "network-vif-plugged", "status": "completed", "tag": "17631478-219a-40dd-94fe-c981bae41eae"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:59:10.329055 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-3093ad9c-b36d-4192-9795-03af37518c78 req-c7409737-d7c2-420f-a26d-dea286fd148d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:10.335070 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-3093ad9c-b36d-4192-9795-03af37518c78 req-c7409737-d7c2-420f-a26d-dea286fd148d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:10.387518 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-3093ad9c-b36d-4192-9795-03af37518c78 req-c7409737-d7c2-420f-a26d-dea286fd148d service nova] Creating event network-vif-plugged:17631478-219a-40dd-94fe-c981bae41eae for instance f94423aa-e701-4f83-a4ce-8d5a90325518 on n-h1-465891-3 Jul 18 02:59:10.421841 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-3093ad9c-b36d-4192-9795-03af37518c78 req-c7409737-d7c2-420f-a26d-dea286fd148d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167554 Jul 18 02:59:10.428789 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2791/5597] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:59:10.584319 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0e3fbbf3-89e5-4fad-b8cc-b0c5f7618138 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:10.585078 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0e3fbbf3-89e5-4fad-b8cc-b0c5f7618138 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:10.593071 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0e3fbbf3-89e5-4fad-b8cc-b0c5f7618138 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:10.593528 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0e3fbbf3-89e5-4fad-b8cc-b0c5f7618138 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:10.594350 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0e3fbbf3-89e5-4fad-b8cc-b0c5f7618138 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:10.594789 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0e3fbbf3-89e5-4fad-b8cc-b0c5f7618138 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:10.661006 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e0c0c65c-1338-49c1-a067-617cc221e17e tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bf3f42f3f5470c85398703180f9527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee75032bd62467399758fce3f8e11b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:10.737792 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:59:10.804605 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e0c0c65c-1338-49c1-a067-617cc221e17e tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] 10.222.0.57 "GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709" status: 200 len: 1315 microversion: 2.1 time: 1.202860 Jul 18 02:59:10.807096 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2807/5598] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:09 2022] GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709 => generated 1315 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:10.836406 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3e3238b9-1cb7-4e85-95f5-9eeadc1113ed tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:10.849199 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3e3238b9-1cb7-4e85-95f5-9eeadc1113ed tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:10.870147 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3e3238b9-1cb7-4e85-95f5-9eeadc1113ed tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:10.870599 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3e3238b9-1cb7-4e85-95f5-9eeadc1113ed tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:10.871621 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3e3238b9-1cb7-4e85-95f5-9eeadc1113ed tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:10.874087 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3e3238b9-1cb7-4e85-95f5-9eeadc1113ed tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:11.158191 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0e3fbbf3-89e5-4fad-b8cc-b0c5f7618138 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:11.171579 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0e3fbbf3-89e5-4fad-b8cc-b0c5f7618138 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518" status: 200 len: 1391 microversion: 2.1 time: 0.597607 Jul 18 02:59:11.172761 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2792/5599] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:10 2022] GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518 => generated 1391 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:11.209045 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3e3238b9-1cb7-4e85-95f5-9eeadc1113ed tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:11.230631 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3e3238b9-1cb7-4e85-95f5-9eeadc1113ed tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3" status: 200 len: 1509 microversion: 2.1 time: 0.416861 Jul 18 02:59:11.231816 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2808/5600] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:10 2022] GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 => generated 1509 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:11.841429 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0ae9bcc1-5fe3-4a25-9f7a-9dcf1338f45e tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:11.843476 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0ae9bcc1-5fe3-4a25-9f7a-9dcf1338f45e tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] [instance: bf9d4886-031b-414a-aac0-4e4d9d200709] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:11.871305 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:59:11.878382 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0ae9bcc1-5fe3-4a25-9f7a-9dcf1338f45e tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:11.880734 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0ae9bcc1-5fe3-4a25-9f7a-9dcf1338f45e tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:11.883409 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0ae9bcc1-5fe3-4a25-9f7a-9dcf1338f45e tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:11.884233 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0ae9bcc1-5fe3-4a25-9f7a-9dcf1338f45e tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:12.200893 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cbe59f58-6c12-405c-90d7-d275ff07b105 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:12.202383 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cbe59f58-6c12-405c-90d7-d275ff07b105 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:12.220345 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cbe59f58-6c12-405c-90d7-d275ff07b105 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:12.221279 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cbe59f58-6c12-405c-90d7-d275ff07b105 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:12.222477 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cbe59f58-6c12-405c-90d7-d275ff07b105 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:12.223687 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cbe59f58-6c12-405c-90d7-d275ff07b105 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:13.256442 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0ae9bcc1-5fe3-4a25-9f7a-9dcf1338f45e tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bf3f42f3f5470c85398703180f9527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee75032bd62467399758fce3f8e11b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:13.271418 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0ae9bcc1-5fe3-4a25-9f7a-9dcf1338f45e tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] 10.222.0.57 "GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709" status: 200 len: 1315 microversion: 2.1 time: 1.437351 Jul 18 02:59:13.276871 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2793/5601] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:11 2022] GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709 => generated 1315 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:13.282206 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b56844a0-ac26-4cff-8bf9-61ae5ffcd78c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:13.285966 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b56844a0-ac26-4cff-8bf9-61ae5ffcd78c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:13.297246 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cbe59f58-6c12-405c-90d7-d275ff07b105 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:13.304963 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b56844a0-ac26-4cff-8bf9-61ae5ffcd78c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:13.328052 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b56844a0-ac26-4cff-8bf9-61ae5ffcd78c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:13.329194 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b56844a0-ac26-4cff-8bf9-61ae5ffcd78c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:13.329880 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b56844a0-ac26-4cff-8bf9-61ae5ffcd78c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:13.334981 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cbe59f58-6c12-405c-90d7-d275ff07b105 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518" status: 200 len: 1391 microversion: 2.1 time: 1.135254 Jul 18 02:59:13.347183 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2809/5602] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:12 2022] GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518 => generated 1391 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:14.306494 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-89be2bf1-4017-44a4-9e47-bdbf98223c72 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:14.308781 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-89be2bf1-4017-44a4-9e47-bdbf98223c72 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] [instance: bf9d4886-031b-414a-aac0-4e4d9d200709] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:14.312381 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b56844a0-ac26-4cff-8bf9-61ae5ffcd78c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:14.334337 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-89be2bf1-4017-44a4-9e47-bdbf98223c72 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:14.345643 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-89be2bf1-4017-44a4-9e47-bdbf98223c72 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:14.347051 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b56844a0-ac26-4cff-8bf9-61ae5ffcd78c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3" status: 200 len: 1509 microversion: 2.1 time: 1.068306 Jul 18 02:59:14.347807 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-89be2bf1-4017-44a4-9e47-bdbf98223c72 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:14.348145 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2794/5603] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:13 2022] GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 => generated 1509 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:14.350481 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-89be2bf1-4017-44a4-9e47-bdbf98223c72 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:14.388480 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ecee68d9-4c24-4075-b4a3-2e9eb5ae4715 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:14.392196 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ecee68d9-4c24-4075-b4a3-2e9eb5ae4715 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:14.424870 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ecee68d9-4c24-4075-b4a3-2e9eb5ae4715 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:14.427284 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ecee68d9-4c24-4075-b4a3-2e9eb5ae4715 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:14.433436 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ecee68d9-4c24-4075-b4a3-2e9eb5ae4715 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:14.435019 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ecee68d9-4c24-4075-b4a3-2e9eb5ae4715 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:15.393728 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-89be2bf1-4017-44a4-9e47-bdbf98223c72 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bf3f42f3f5470c85398703180f9527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee75032bd62467399758fce3f8e11b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:15.409350 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ecee68d9-4c24-4075-b4a3-2e9eb5ae4715 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:15.428592 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ecee68d9-4c24-4075-b4a3-2e9eb5ae4715 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518" status: 200 len: 1561 microversion: 2.1 time: 1.067461 Jul 18 02:59:15.429204 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2795/5604] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:14 2022] GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518 => generated 1561 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:15.430215 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-89be2bf1-4017-44a4-9e47-bdbf98223c72 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] 10.222.0.57 "GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709" status: 200 len: 1315 microversion: 2.1 time: 1.127679 Jul 18 02:59:15.435048 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-531d02c8-1a80-4b13-b4b6-44272b25c030 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:15.435664 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-531d02c8-1a80-4b13-b4b6-44272b25c030 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:15.437766 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2810/5605] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:14 2022] GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709 => generated 1315 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:59:15.457161 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-531d02c8-1a80-4b13-b4b6-44272b25c030 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:15.457962 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-531d02c8-1a80-4b13-b4b6-44272b25c030 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:15.458978 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-531d02c8-1a80-4b13-b4b6-44272b25c030 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:15.459607 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-531d02c8-1a80-4b13-b4b6-44272b25c030 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:15.462630 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e61c29db-c21a-4fc9-bfba-7b700c8e4a42 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:15.468471 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e61c29db-c21a-4fc9-bfba-7b700c8e4a42 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:15.495005 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e61c29db-c21a-4fc9-bfba-7b700c8e4a42 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:15.496703 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e61c29db-c21a-4fc9-bfba-7b700c8e4a42 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:15.499767 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e61c29db-c21a-4fc9-bfba-7b700c8e4a42 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:15.500294 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e61c29db-c21a-4fc9-bfba-7b700c8e4a42 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:16.286493 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-531d02c8-1a80-4b13-b4b6-44272b25c030 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:16.308240 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e61c29db-c21a-4fc9-bfba-7b700c8e4a42 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:16.322155 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-531d02c8-1a80-4b13-b4b6-44272b25c030 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3" status: 200 len: 1509 microversion: 2.1 time: 0.891004 Jul 18 02:59:16.326774 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2796/5606] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:15 2022] GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 => generated 1509 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:16.332369 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e61c29db-c21a-4fc9-bfba-7b700c8e4a42 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518" status: 200 len: 1561 microversion: 2.1 time: 0.877608 Jul 18 02:59:16.337959 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-44446970-bed2-4a10-9e5b-c5ec88aa51e2 req-d6e1d7d3-d18d-4649-bf5d-50c1353eed02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf9d4886-031b-414a-aac0-4e4d9d200709", "name": "network-vif-plugged", "status": "completed", "tag": "b476e3d9-5371-42fa-9f11-c7642038728f"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:59:16.341872 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2811/5607] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:15 2022] GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518 => generated 1561 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:16.381520 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-44446970-bed2-4a10-9e5b-c5ec88aa51e2 req-d6e1d7d3-d18d-4649-bf5d-50c1353eed02 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:16.382381 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-44446970-bed2-4a10-9e5b-c5ec88aa51e2 req-d6e1d7d3-d18d-4649-bf5d-50c1353eed02 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:16.419097 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-44446970-bed2-4a10-9e5b-c5ec88aa51e2 req-d6e1d7d3-d18d-4649-bf5d-50c1353eed02 service nova] Creating event network-vif-plugged:b476e3d9-5371-42fa-9f11-c7642038728f for instance bf9d4886-031b-414a-aac0-4e4d9d200709 on n-h2-465891-3 Jul 18 02:59:16.432029 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-44446970-bed2-4a10-9e5b-c5ec88aa51e2 req-d6e1d7d3-d18d-4649-bf5d-50c1353eed02 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097988 Jul 18 02:59:16.465756 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7a57a085-d988-4619-8ce4-e1e51896a55c tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:16.468981 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7a57a085-d988-4619-8ce4-e1e51896a55c tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] [instance: bf9d4886-031b-414a-aac0-4e4d9d200709] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:16.472567 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2797/5608] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:59:16.535941 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7a57a085-d988-4619-8ce4-e1e51896a55c tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:16.536724 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7a57a085-d988-4619-8ce4-e1e51896a55c tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:16.537911 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7a57a085-d988-4619-8ce4-e1e51896a55c tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:16.538496 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7a57a085-d988-4619-8ce4-e1e51896a55c tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:16.965374 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-7487ce68-c00a-4819-840e-cd0ee6d19bc7 req-103a2700-4e09-41cd-ac2d-9784eaa6e6db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b51bfed-afd2-4629-8b36-b466661de551", "tag": "b6a9c561-dec2-426c-be72-ed96ce7f50e9"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:59:16.998411 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-7487ce68-c00a-4819-840e-cd0ee6d19bc7 req-103a2700-4e09-41cd-ac2d-9784eaa6e6db service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:16.999083 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-7487ce68-c00a-4819-840e-cd0ee6d19bc7 req-103a2700-4e09-41cd-ac2d-9784eaa6e6db service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:17.028363 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-7487ce68-c00a-4819-840e-cd0ee6d19bc7 req-103a2700-4e09-41cd-ac2d-9784eaa6e6db service nova] Creating event network-changed:b6a9c561-dec2-426c-be72-ed96ce7f50e9 for instance 0b51bfed-afd2-4629-8b36-b466661de551 on n-h2-465891-3 Jul 18 02:59:17.042450 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-7487ce68-c00a-4819-840e-cd0ee6d19bc7 req-103a2700-4e09-41cd-ac2d-9784eaa6e6db service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082531 Jul 18 02:59:17.044712 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2798/5609] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:59:17.176213 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7a57a085-d988-4619-8ce4-e1e51896a55c tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bf3f42f3f5470c85398703180f9527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee75032bd62467399758fce3f8e11b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:17.207084 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7a57a085-d988-4619-8ce4-e1e51896a55c tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] 10.222.0.57 "GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709" status: 200 len: 1315 microversion: 2.1 time: 0.756064 Jul 18 02:59:17.220463 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2812/5610] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:16 2022] GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709 => generated 1315 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:17.366954 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b8a723db-5a60-4f55-9847-5caafc296ad1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:17.368217 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b8a723db-5a60-4f55-9847-5caafc296ad1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:17.384523 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b8a723db-5a60-4f55-9847-5caafc296ad1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:17.386485 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b8a723db-5a60-4f55-9847-5caafc296ad1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:17.390643 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b8a723db-5a60-4f55-9847-5caafc296ad1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:17.392789 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b8a723db-5a60-4f55-9847-5caafc296ad1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:18.235882 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-759bcdfb-0cd3-4a3f-81f5-1d50552b8c9b tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:18.243230 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-759bcdfb-0cd3-4a3f-81f5-1d50552b8c9b tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] [instance: bf9d4886-031b-414a-aac0-4e4d9d200709] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:18.342891 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-759bcdfb-0cd3-4a3f-81f5-1d50552b8c9b tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:18.344634 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-759bcdfb-0cd3-4a3f-81f5-1d50552b8c9b tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:18.355734 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-759bcdfb-0cd3-4a3f-81f5-1d50552b8c9b tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:18.356436 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-759bcdfb-0cd3-4a3f-81f5-1d50552b8c9b tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:18.847167 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b8a723db-5a60-4f55-9847-5caafc296ad1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:18.863762 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b8a723db-5a60-4f55-9847-5caafc296ad1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3" status: 200 len: 1509 microversion: 2.1 time: 1.502841 Jul 18 02:59:18.865765 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2799/5611] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:17 2022] GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 => generated 1509 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:59:19.391357 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-759bcdfb-0cd3-4a3f-81f5-1d50552b8c9b tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bf3f42f3f5470c85398703180f9527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee75032bd62467399758fce3f8e11b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:19.419867 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-759bcdfb-0cd3-4a3f-81f5-1d50552b8c9b tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] 10.222.0.57 "GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709" status: 200 len: 1315 microversion: 2.1 time: 1.192964 Jul 18 02:59:19.422158 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2813/5612] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:18 2022] GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709 => generated 1315 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:59:19.891235 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-093271c6-94a9-48c0-9625-e5f608390148 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:19.892645 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-093271c6-94a9-48c0-9625-e5f608390148 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:19.930422 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-093271c6-94a9-48c0-9625-e5f608390148 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:19.936230 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-093271c6-94a9-48c0-9625-e5f608390148 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:19.938300 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-093271c6-94a9-48c0-9625-e5f608390148 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:19.939472 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-093271c6-94a9-48c0-9625-e5f608390148 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:20.438020 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2edf4423-8477-47a8-a843-8d907ac5ee39 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:20.439736 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2edf4423-8477-47a8-a843-8d907ac5ee39 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] [instance: bf9d4886-031b-414a-aac0-4e4d9d200709] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:20.457918 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2edf4423-8477-47a8-a843-8d907ac5ee39 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:20.460397 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2edf4423-8477-47a8-a843-8d907ac5ee39 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:20.466889 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2edf4423-8477-47a8-a843-8d907ac5ee39 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:20.470501 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2edf4423-8477-47a8-a843-8d907ac5ee39 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:20.530200 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-093271c6-94a9-48c0-9625-e5f608390148 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:20.568047 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-093271c6-94a9-48c0-9625-e5f608390148 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3" status: 200 len: 1509 microversion: 2.1 time: 0.680912 Jul 18 02:59:20.574055 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2800/5613] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:19 2022] GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 => generated 1509 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:59:21.183544 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2edf4423-8477-47a8-a843-8d907ac5ee39 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bf3f42f3f5470c85398703180f9527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee75032bd62467399758fce3f8e11b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:21.225645 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2edf4423-8477-47a8-a843-8d907ac5ee39 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] 10.222.0.57 "GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709" status: 200 len: 1502 microversion: 2.1 time: 0.791414 Jul 18 02:59:21.246063 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2814/5614] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:20 2022] GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709 => generated 1502 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:59:21.263752 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ec6354ee-9292-4055-a482-3a23a1885354 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:21.264926 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ec6354ee-9292-4055-a482-3a23a1885354 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] [instance: bf9d4886-031b-414a-aac0-4e4d9d200709] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:21.302226 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ec6354ee-9292-4055-a482-3a23a1885354 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:21.303414 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ec6354ee-9292-4055-a482-3a23a1885354 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:21.320749 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ec6354ee-9292-4055-a482-3a23a1885354 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:21.325172 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ec6354ee-9292-4055-a482-3a23a1885354 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:21.347723 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=100 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:59:21.605209 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e9053492-ddd7-401c-8f66-9998060fc0da tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:21.608061 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e9053492-ddd7-401c-8f66-9998060fc0da tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:21.651589 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e9053492-ddd7-401c-8f66-9998060fc0da tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:21.653413 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e9053492-ddd7-401c-8f66-9998060fc0da tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:21.664258 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e9053492-ddd7-401c-8f66-9998060fc0da tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:21.667740 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e9053492-ddd7-401c-8f66-9998060fc0da tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:21.768991 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ec6354ee-9292-4055-a482-3a23a1885354 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bf3f42f3f5470c85398703180f9527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee75032bd62467399758fce3f8e11b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:21.805022 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ec6354ee-9292-4055-a482-3a23a1885354 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] 10.222.0.57 "GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709" status: 200 len: 1502 microversion: 2.1 time: 0.549335 Jul 18 02:59:21.809094 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2801/5615] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:21 2022] GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709 => generated 1502 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:21.840421 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a0be82d9-c741-42d8-a4fc-4082c614ea8e tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:59:21.840926 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a0be82d9-c741-42d8-a4fc-4082c614ea8e tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] [instance: bf9d4886-031b-414a-aac0-4e4d9d200709] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:21.857343 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a0be82d9-c741-42d8-a4fc-4082c614ea8e tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:21.860144 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a0be82d9-c741-42d8-a4fc-4082c614ea8e tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:21.865802 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a0be82d9-c741-42d8-a4fc-4082c614ea8e tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:21.867042 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a0be82d9-c741-42d8-a4fc-4082c614ea8e tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:21.919315 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-a0be82d9-c741-42d8-a4fc-4082c614ea8e tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lazy-loading 'flavor' on Instance uuid bf9d4886-031b-414a-aac0-4e4d9d200709 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:59:22.162575 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a0be82d9-c741-42d8-a4fc-4082c614ea8e tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] 10.222.0.57 "POST /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709/action" status: 202 len: 0 microversion: 2.1 time: 0.327675 Jul 18 02:59:22.168467 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2802/5616] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:59:21 2022] POST /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:59:22.202389 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-51dd40de-c64a-41dd-a0c5-b3f5140110df tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:22.205023 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e9053492-ddd7-401c-8f66-9998060fc0da tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:22.207593 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-51dd40de-c64a-41dd-a0c5-b3f5140110df tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] [instance: bf9d4886-031b-414a-aac0-4e4d9d200709] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:22.225742 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-51dd40de-c64a-41dd-a0c5-b3f5140110df tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:22.231365 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-51dd40de-c64a-41dd-a0c5-b3f5140110df tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:22.234458 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-51dd40de-c64a-41dd-a0c5-b3f5140110df tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:22.234655 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-51dd40de-c64a-41dd-a0c5-b3f5140110df tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:22.245437 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e9053492-ddd7-401c-8f66-9998060fc0da tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3" status: 200 len: 1509 microversion: 2.1 time: 0.642377 Jul 18 02:59:22.250683 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2815/5617] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:21 2022] GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 => generated 1509 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:22.577490 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-51dd40de-c64a-41dd-a0c5-b3f5140110df tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bf3f42f3f5470c85398703180f9527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee75032bd62467399758fce3f8e11b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:22.592154 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-51dd40de-c64a-41dd-a0c5-b3f5140110df tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] 10.222.0.57 "GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709" status: 200 len: 1510 microversion: 2.1 time: 0.406913 Jul 18 02:59:22.603901 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2803/5618] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:22 2022] GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709 => generated 1510 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:23.279721 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-caeacedb-2b4d-4912-9a3b-fcab7645e76e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:23.280503 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-caeacedb-2b4d-4912-9a3b-fcab7645e76e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:23.297558 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-caeacedb-2b4d-4912-9a3b-fcab7645e76e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:23.298216 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-caeacedb-2b4d-4912-9a3b-fcab7645e76e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:23.299157 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-caeacedb-2b4d-4912-9a3b-fcab7645e76e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:23.299721 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-caeacedb-2b4d-4912-9a3b-fcab7645e76e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:23.619454 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e8d3ff28-3273-4174-9088-472d5446b49d tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:23.620936 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e8d3ff28-3273-4174-9088-472d5446b49d tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] [instance: bf9d4886-031b-414a-aac0-4e4d9d200709] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:23.670483 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e8d3ff28-3273-4174-9088-472d5446b49d tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:23.671348 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e8d3ff28-3273-4174-9088-472d5446b49d tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:23.672829 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e8d3ff28-3273-4174-9088-472d5446b49d tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:23.680360 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e8d3ff28-3273-4174-9088-472d5446b49d tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:23.693346 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-caeacedb-2b4d-4912-9a3b-fcab7645e76e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:23.714741 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-caeacedb-2b4d-4912-9a3b-fcab7645e76e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3" status: 200 len: 1509 microversion: 2.1 time: 0.440718 Jul 18 02:59:23.726321 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2816/5619] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:23 2022] GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 => generated 1509 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:24.272857 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-99fccce9-038d-40fb-bddf-67d45ebc3b12 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:24.281962 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-99fccce9-038d-40fb-bddf-67d45ebc3b12 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:24.302391 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e8d3ff28-3273-4174-9088-472d5446b49d tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bf3f42f3f5470c85398703180f9527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee75032bd62467399758fce3f8e11b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:24.329485 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-99fccce9-038d-40fb-bddf-67d45ebc3b12 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:24.330934 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-99fccce9-038d-40fb-bddf-67d45ebc3b12 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:24.347892 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-99fccce9-038d-40fb-bddf-67d45ebc3b12 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:24.349462 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-99fccce9-038d-40fb-bddf-67d45ebc3b12 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:24.352218 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e8d3ff28-3273-4174-9088-472d5446b49d tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] 10.222.0.57 "GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709" status: 200 len: 1493 microversion: 2.1 time: 0.742651 Jul 18 02:59:24.361931 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2804/5620] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:23 2022] GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709 => generated 1493 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:24.385049 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-b301d393-09cb-49b8-b9f5-1c46c1123aea req-293a980e-37e1-436e-9132-05201f37ff5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f94423aa-e701-4f83-a4ce-8d5a90325518", "tag": "17631478-219a-40dd-94fe-c981bae41eae"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:59:24.431222 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-b301d393-09cb-49b8-b9f5-1c46c1123aea req-293a980e-37e1-436e-9132-05201f37ff5a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:24.431740 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-b301d393-09cb-49b8-b9f5-1c46c1123aea req-293a980e-37e1-436e-9132-05201f37ff5a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:24.475126 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-b301d393-09cb-49b8-b9f5-1c46c1123aea req-293a980e-37e1-436e-9132-05201f37ff5a service nova] Creating event network-changed:17631478-219a-40dd-94fe-c981bae41eae for instance f94423aa-e701-4f83-a4ce-8d5a90325518 on n-h1-465891-3 Jul 18 02:59:24.490926 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-b301d393-09cb-49b8-b9f5-1c46c1123aea req-293a980e-37e1-436e-9132-05201f37ff5a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127854 Jul 18 02:59:24.492799 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2805/5621] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:59:24.503668 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2ffdabf1-94a9-48c8-b642-ca7133f79dfa tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:59:24.506561 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2ffdabf1-94a9-48c8-b642-ca7133f79dfa tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] [instance: bf9d4886-031b-414a-aac0-4e4d9d200709] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:24.528900 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ffdabf1-94a9-48c8-b642-ca7133f79dfa tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:24.533444 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ffdabf1-94a9-48c8-b642-ca7133f79dfa tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:24.537821 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ffdabf1-94a9-48c8-b642-ca7133f79dfa tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:24.547212 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ffdabf1-94a9-48c8-b642-ca7133f79dfa tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:24.833020 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-99fccce9-038d-40fb-bddf-67d45ebc3b12 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:24.875449 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-99fccce9-038d-40fb-bddf-67d45ebc3b12 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518" status: 200 len: 1561 microversion: 2.1 time: 0.611777 Jul 18 02:59:24.885674 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2817/5622] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:24 2022] GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518 => generated 1561 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:24.945727 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-409002b5-c236-4e6b-91bb-e7f106f4cbae tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:24.956453 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-409002b5-c236-4e6b-91bb-e7f106f4cbae tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:24.959874 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2ffdabf1-94a9-48c8-b642-ca7133f79dfa tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] 10.222.0.57 "POST /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709/action" status: 202 len: 0 microversion: 2.1 time: 0.463251 Jul 18 02:59:24.967010 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2806/5623] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:59:24 2022] POST /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709/action => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:59:24.982023 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-409002b5-c236-4e6b-91bb-e7f106f4cbae tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:24.982678 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-409002b5-c236-4e6b-91bb-e7f106f4cbae tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:25.000017 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-409002b5-c236-4e6b-91bb-e7f106f4cbae tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:25.000535 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-605bb937-da47-40fb-a39d-de7c75f0d400 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:25.000783 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-409002b5-c236-4e6b-91bb-e7f106f4cbae tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:25.001282 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-605bb937-da47-40fb-a39d-de7c75f0d400 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] [instance: bf9d4886-031b-414a-aac0-4e4d9d200709] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:25.046451 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-605bb937-da47-40fb-a39d-de7c75f0d400 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:25.046917 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-605bb937-da47-40fb-a39d-de7c75f0d400 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:25.047754 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-605bb937-da47-40fb-a39d-de7c75f0d400 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:25.048405 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-605bb937-da47-40fb-a39d-de7c75f0d400 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:27.445035 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-409002b5-c236-4e6b-91bb-e7f106f4cbae tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:27.484776 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-409002b5-c236-4e6b-91bb-e7f106f4cbae tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3" status: 200 len: 1509 microversion: 2.1 time: 2.563328 Jul 18 02:59:27.486409 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2818/5624] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:24 2022] GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 => generated 1509 bytes in 2576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:27.569044 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-605bb937-da47-40fb-a39d-de7c75f0d400 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bf3f42f3f5470c85398703180f9527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee75032bd62467399758fce3f8e11b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:27.580585 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-605bb937-da47-40fb-a39d-de7c75f0d400 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] 10.222.0.57 "GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709" status: 200 len: 1499 microversion: 2.1 time: 2.588531 Jul 18 02:59:27.581192 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2807/5625] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:24 2022] GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709 => generated 1499 bytes in 2590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:28.525054 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ee8f8771-f024-408b-9420-6b1a30a607dd tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:28.532972 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ee8f8771-f024-408b-9420-6b1a30a607dd tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:28.573833 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ee8f8771-f024-408b-9420-6b1a30a607dd tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:28.574624 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ee8f8771-f024-408b-9420-6b1a30a607dd tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:28.576091 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ee8f8771-f024-408b-9420-6b1a30a607dd tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:28.576899 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ee8f8771-f024-408b-9420-6b1a30a607dd tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:28.603438 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-afb7e60d-a6b9-4607-80b8-9655bd906154 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:28.604583 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-afb7e60d-a6b9-4607-80b8-9655bd906154 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] [instance: bf9d4886-031b-414a-aac0-4e4d9d200709] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:28.662607 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-afb7e60d-a6b9-4607-80b8-9655bd906154 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:28.667826 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-afb7e60d-a6b9-4607-80b8-9655bd906154 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:28.668726 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-afb7e60d-a6b9-4607-80b8-9655bd906154 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:28.669341 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-afb7e60d-a6b9-4607-80b8-9655bd906154 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:29.294987 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-afb7e60d-a6b9-4607-80b8-9655bd906154 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bf3f42f3f5470c85398703180f9527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee75032bd62467399758fce3f8e11b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:29.316080 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-afb7e60d-a6b9-4607-80b8-9655bd906154 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] 10.222.0.57 "GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709" status: 200 len: 1499 microversion: 2.1 time: 0.718184 Jul 18 02:59:29.326418 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2808/5626] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:28 2022] GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709 => generated 1499 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:59:29.403468 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ee8f8771-f024-408b-9420-6b1a30a607dd tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:29.420661 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ee8f8771-f024-408b-9420-6b1a30a607dd tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3" status: 200 len: 1506 microversion: 2.1 time: 0.903312 Jul 18 02:59:29.422277 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2819/5627] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:28 2022] GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 => generated 1506 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:59:30.221376 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-437104af-855b-4517-8037-a874751e9946 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-731894561", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "6fd2ecaf-75a9-4d78-8487-2ca1637a728d"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:59:30.338697 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-437104af-855b-4517-8037-a874751e9946 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] validate_networks() for [('6fd2ecaf-75a9-4d78-8487-2ca1637a728d', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:59:30.346885 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-623dbe9e-081c-4fc4-8ac1-55dd6bbca30d tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:30.347674 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-623dbe9e-081c-4fc4-8ac1-55dd6bbca30d tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] [instance: bf9d4886-031b-414a-aac0-4e4d9d200709] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:30.358599 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-623dbe9e-081c-4fc4-8ac1-55dd6bbca30d tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:30.359076 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-623dbe9e-081c-4fc4-8ac1-55dd6bbca30d tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:30.359975 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-623dbe9e-081c-4fc4-8ac1-55dd6bbca30d tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:30.360395 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-623dbe9e-081c-4fc4-8ac1-55dd6bbca30d tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:30.763631 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-623dbe9e-081c-4fc4-8ac1-55dd6bbca30d tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bf3f42f3f5470c85398703180f9527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee75032bd62467399758fce3f8e11b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:30.777692 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-623dbe9e-081c-4fc4-8ac1-55dd6bbca30d tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] 10.222.0.57 "GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709" status: 200 len: 1502 microversion: 2.1 time: 0.438105 Jul 18 02:59:30.779377 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2820/5628] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:30 2022] GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709 => generated 1502 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:59:30.798323 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2711e808-75f1-48cb-8f1f-a6cb16d236d0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:30.799385 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2711e808-75f1-48cb-8f1f-a6cb16d236d0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:30.810857 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2711e808-75f1-48cb-8f1f-a6cb16d236d0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:30.811655 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2711e808-75f1-48cb-8f1f-a6cb16d236d0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:30.812542 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2711e808-75f1-48cb-8f1f-a6cb16d236d0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:30.813127 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2711e808-75f1-48cb-8f1f-a6cb16d236d0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:31.280039 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2711e808-75f1-48cb-8f1f-a6cb16d236d0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:31.292216 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2711e808-75f1-48cb-8f1f-a6cb16d236d0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3" status: 200 len: 1506 microversion: 2.1 time: 0.497433 Jul 18 02:59:31.294133 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2821/5629] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:30 2022] GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 => generated 1506 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:31.300519 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-77160b6b-f34e-41df-93ab-fdd00c4c1600 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:59:31.301404 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-77160b6b-f34e-41df-93ab-fdd00c4c1600 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] [instance: bf9d4886-031b-414a-aac0-4e4d9d200709] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:31.311713 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77160b6b-f34e-41df-93ab-fdd00c4c1600 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:31.312203 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77160b6b-f34e-41df-93ab-fdd00c4c1600 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:31.313387 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77160b6b-f34e-41df-93ab-fdd00c4c1600 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:31.314061 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77160b6b-f34e-41df-93ab-fdd00c4c1600 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:31.340216 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-77160b6b-f34e-41df-93ab-fdd00c4c1600 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lazy-loading 'flavor' on Instance uuid bf9d4886-031b-414a-aac0-4e4d9d200709 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:59:31.341298 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-437104af-855b-4517-8037-a874751e9946 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:59:31.342128 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-437104af-855b-4517-8037-a874751e9946 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:59:31.344195 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-437104af-855b-4517-8037-a874751e9946 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:59:31.344661 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-437104af-855b-4517-8037-a874751e9946 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:59:31.345338 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-437104af-855b-4517-8037-a874751e9946 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:59:31.363205 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-437104af-855b-4517-8037-a874751e9946 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:31.364899 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-437104af-855b-4517-8037-a874751e9946 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:31.366698 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-437104af-855b-4517-8037-a874751e9946 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:31.368564 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-437104af-855b-4517-8037-a874751e9946 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:31.398213 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-437104af-855b-4517-8037-a874751e9946 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Getting quotas for project 5555f4f3291040b7ae2fed82ca9df793. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:59:31.405421 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-437104af-855b-4517-8037-a874751e9946 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Getting quotas for user 1b9dddc0cfa946d78f06ab7db1f11929 and project 5555f4f3291040b7ae2fed82ca9df793. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:59:31.422614 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-437104af-855b-4517-8037-a874751e9946 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:59:31.425492 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-437104af-855b-4517-8037-a874751e9946 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] [instance: 22fc38b2-8b4c-48cb-b47e-986650123898] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:59:31.428267 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:59:31.452919 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-77160b6b-f34e-41df-93ab-fdd00c4c1600 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] 10.222.0.57 "POST /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709/action" status: 202 len: 0 microversion: 2.1 time: 0.157201 Jul 18 02:59:31.453493 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2822/5630] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:59:31 2022] POST /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:59:31.472957 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0c77d0e3-83c4-4a5e-aef7-474c637b5206 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:31.474211 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0c77d0e3-83c4-4a5e-aef7-474c637b5206 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] [instance: bf9d4886-031b-414a-aac0-4e4d9d200709] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:31.483779 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c77d0e3-83c4-4a5e-aef7-474c637b5206 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:31.484392 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c77d0e3-83c4-4a5e-aef7-474c637b5206 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:31.485085 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c77d0e3-83c4-4a5e-aef7-474c637b5206 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:31.485537 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c77d0e3-83c4-4a5e-aef7-474c637b5206 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:31.576489 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-437104af-855b-4517-8037-a874751e9946 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.359554 Jul 18 02:59:31.578161 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2809/5631] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:59:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1362 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:59:31.597874 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f13f3af5-9b99-4908-bc06-6f9152b8863c tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:31.601797 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f13f3af5-9b99-4908-bc06-6f9152b8863c tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] [instance: 22fc38b2-8b4c-48cb-b47e-986650123898] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:31.728022 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f13f3af5-9b99-4908-bc06-6f9152b8863c tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dddc0cfa946d78f06ab7db1f11929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5555f4f3291040b7ae2fed82ca9df793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:31.753802 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f13f3af5-9b99-4908-bc06-6f9152b8863c tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] 10.222.0.57 "GET /compute/v2.1/servers/22fc38b2-8b4c-48cb-b47e-986650123898" status: 200 len: 1213 microversion: 2.1 time: 0.166956 Jul 18 02:59:31.759661 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2810/5632] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:31 2022] GET /compute/v2.1/servers/22fc38b2-8b4c-48cb-b47e-986650123898 => generated 1213 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:31.977016 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0c77d0e3-83c4-4a5e-aef7-474c637b5206 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bf3f42f3f5470c85398703180f9527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee75032bd62467399758fce3f8e11b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:31.991177 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0c77d0e3-83c4-4a5e-aef7-474c637b5206 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] 10.222.0.57 "GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709" status: 200 len: 1510 microversion: 2.1 time: 0.532746 Jul 18 02:59:31.996059 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2823/5633] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:31 2022] GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709 => generated 1510 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:32.315674 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-61561f9f-16b2-49fd-bbe5-8912455e32b8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:32.316750 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-61561f9f-16b2-49fd-bbe5-8912455e32b8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:32.350970 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-61561f9f-16b2-49fd-bbe5-8912455e32b8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:32.351793 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-61561f9f-16b2-49fd-bbe5-8912455e32b8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:32.361924 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-61561f9f-16b2-49fd-bbe5-8912455e32b8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:32.378904 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-61561f9f-16b2-49fd-bbe5-8912455e32b8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:32.736770 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-e76c01be-f851-4658-bcb1-4bc9a686f206 req-b1e7eb7f-9306-4654-a6c3-e6936cf3214d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20c7c630-5739-487b-97c9-463a8de621a3", "name": "network-vif-unplugged", "status": "completed", "tag": "51e95f27-927b-4956-b785-097434c3f4c0"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:59:32.778836 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-e76c01be-f851-4658-bcb1-4bc9a686f206 req-b1e7eb7f-9306-4654-a6c3-e6936cf3214d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:32.779421 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-e76c01be-f851-4658-bcb1-4bc9a686f206 req-b1e7eb7f-9306-4654-a6c3-e6936cf3214d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:32.834557 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-e76c01be-f851-4658-bcb1-4bc9a686f206 req-b1e7eb7f-9306-4654-a6c3-e6936cf3214d service nova] Creating event network-vif-unplugged:51e95f27-927b-4956-b785-097434c3f4c0 for instance 20c7c630-5739-487b-97c9-463a8de621a3 on n-h1-465891-3 Jul 18 02:59:32.849382 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-61561f9f-16b2-49fd-bbe5-8912455e32b8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:32.849921 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-e76c01be-f851-4658-bcb1-4bc9a686f206 req-b1e7eb7f-9306-4654-a6c3-e6936cf3214d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115774 Jul 18 02:59:32.850810 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2824/5634] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:59:32.865390 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-61561f9f-16b2-49fd-bbe5-8912455e32b8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3" status: 200 len: 1509 microversion: 2.1 time: 0.557623 Jul 18 02:59:32.867941 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2811/5635] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:32 2022] GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 => generated 1509 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:32.874079 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f1d215cf-a236-46f1-b13f-4bfd4f29a83c tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:32.875809 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f1d215cf-a236-46f1-b13f-4bfd4f29a83c tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] [instance: 22fc38b2-8b4c-48cb-b47e-986650123898] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:32.895294 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f1d215cf-a236-46f1-b13f-4bfd4f29a83c tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:32.896461 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f1d215cf-a236-46f1-b13f-4bfd4f29a83c tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:32.898060 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bc625ddf-1ee5-4956-a613-5a235665b731 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:32.898885 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f1d215cf-a236-46f1-b13f-4bfd4f29a83c tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:32.899750 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bc625ddf-1ee5-4956-a613-5a235665b731 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:32.901320 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f1d215cf-a236-46f1-b13f-4bfd4f29a83c tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:32.928173 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bc625ddf-1ee5-4956-a613-5a235665b731 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:32.933276 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bc625ddf-1ee5-4956-a613-5a235665b731 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:32.934374 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bc625ddf-1ee5-4956-a613-5a235665b731 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:32.934945 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bc625ddf-1ee5-4956-a613-5a235665b731 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:33.146327 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f1d215cf-a236-46f1-b13f-4bfd4f29a83c tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dddc0cfa946d78f06ab7db1f11929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5555f4f3291040b7ae2fed82ca9df793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:33.159791 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f1d215cf-a236-46f1-b13f-4bfd4f29a83c tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] 10.222.0.57 "GET /compute/v2.1/servers/22fc38b2-8b4c-48cb-b47e-986650123898" status: 200 len: 1217 microversion: 2.1 time: 0.305731 Jul 18 02:59:33.182656 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2825/5636] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:32 2022] GET /compute/v2.1/servers/22fc38b2-8b4c-48cb-b47e-986650123898 => generated 1217 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:33.198775 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-173bf8a2-24de-4aa3-a874-44091044b51d tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:33.199787 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-173bf8a2-24de-4aa3-a874-44091044b51d tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] [instance: bf9d4886-031b-414a-aac0-4e4d9d200709] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:33.219179 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-173bf8a2-24de-4aa3-a874-44091044b51d tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:33.221094 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-173bf8a2-24de-4aa3-a874-44091044b51d tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:33.222446 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-173bf8a2-24de-4aa3-a874-44091044b51d tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:33.223260 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-173bf8a2-24de-4aa3-a874-44091044b51d tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:33.558868 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-173bf8a2-24de-4aa3-a874-44091044b51d tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bf3f42f3f5470c85398703180f9527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee75032bd62467399758fce3f8e11b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:33.572872 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-173bf8a2-24de-4aa3-a874-44091044b51d tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] 10.222.0.57 "GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709" status: 200 len: 1493 microversion: 2.1 time: 0.388529 Jul 18 02:59:33.573486 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2826/5637] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:33 2022] GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709 => generated 1493 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:33.586987 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bc625ddf-1ee5-4956-a613-5a235665b731 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:33.595587 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-edae1496-35a6-4826-ba8e-fe7896c12cb3 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:59:33.596738 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-edae1496-35a6-4826-ba8e-fe7896c12cb3 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] [instance: bf9d4886-031b-414a-aac0-4e4d9d200709] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:33.609772 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bc625ddf-1ee5-4956-a613-5a235665b731 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 0.720641 Jul 18 02:59:33.620224 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-edae1496-35a6-4826-ba8e-fe7896c12cb3 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:33.628610 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2812/5638] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:32 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:59:33.629671 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-edae1496-35a6-4826-ba8e-fe7896c12cb3 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:33.630738 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-edae1496-35a6-4826-ba8e-fe7896c12cb3 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:33.631387 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-edae1496-35a6-4826-ba8e-fe7896c12cb3 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:33.655153 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e74e3c34-647b-4d6b-9ee1-6d30d2f75cd4 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:33.655777 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e74e3c34-647b-4d6b-9ee1-6d30d2f75cd4 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:33.686665 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e74e3c34-647b-4d6b-9ee1-6d30d2f75cd4 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:33.688938 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e74e3c34-647b-4d6b-9ee1-6d30d2f75cd4 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:33.692490 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e74e3c34-647b-4d6b-9ee1-6d30d2f75cd4 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:33.698176 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e74e3c34-647b-4d6b-9ee1-6d30d2f75cd4 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:33.955851 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-edae1496-35a6-4826-ba8e-fe7896c12cb3 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] 10.222.0.57 "POST /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709/action" status: 202 len: 0 microversion: 2.1 time: 0.368623 Jul 18 02:59:33.960508 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2827/5639] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:59:33 2022] POST /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709/action => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:59:33.980761 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0759c32e-f094-4f46-805f-cfb661f2b8a7 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:33.987565 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0759c32e-f094-4f46-805f-cfb661f2b8a7 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] [instance: bf9d4886-031b-414a-aac0-4e4d9d200709] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:34.018590 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0759c32e-f094-4f46-805f-cfb661f2b8a7 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:34.022201 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0759c32e-f094-4f46-805f-cfb661f2b8a7 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:34.028371 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0759c32e-f094-4f46-805f-cfb661f2b8a7 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:34.031058 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0759c32e-f094-4f46-805f-cfb661f2b8a7 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:34.309062 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e74e3c34-647b-4d6b-9ee1-6d30d2f75cd4 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:34.321648 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e74e3c34-647b-4d6b-9ee1-6d30d2f75cd4 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 0.668913 Jul 18 02:59:34.323205 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2813/5640] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:33 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:34.328528 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8a99ec42-eec7-4d05-90fe-ade3c52cbb9a tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:34.329499 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8a99ec42-eec7-4d05-90fe-ade3c52cbb9a tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] [instance: 22fc38b2-8b4c-48cb-b47e-986650123898] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:34.338715 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a99ec42-eec7-4d05-90fe-ade3c52cbb9a tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:34.339591 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a99ec42-eec7-4d05-90fe-ade3c52cbb9a tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:34.340641 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a99ec42-eec7-4d05-90fe-ade3c52cbb9a tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:34.341453 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a99ec42-eec7-4d05-90fe-ade3c52cbb9a tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:34.496665 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8a99ec42-eec7-4d05-90fe-ade3c52cbb9a tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dddc0cfa946d78f06ab7db1f11929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5555f4f3291040b7ae2fed82ca9df793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:34.504909 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8a99ec42-eec7-4d05-90fe-ade3c52cbb9a tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] 10.222.0.57 "GET /compute/v2.1/servers/22fc38b2-8b4c-48cb-b47e-986650123898" status: 200 len: 1271 microversion: 2.1 time: 0.180213 Jul 18 02:59:34.509933 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2814/5641] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:34 2022] GET /compute/v2.1/servers/22fc38b2-8b4c-48cb-b47e-986650123898 => generated 1271 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:34.539581 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d42d129c-2289-4acb-95f6-ff6b9f682e17 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:34.541157 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d42d129c-2289-4acb-95f6-ff6b9f682e17 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:34.549088 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d42d129c-2289-4acb-95f6-ff6b9f682e17 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:34.556789 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d42d129c-2289-4acb-95f6-ff6b9f682e17 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:34.558265 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d42d129c-2289-4acb-95f6-ff6b9f682e17 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:34.559288 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d42d129c-2289-4acb-95f6-ff6b9f682e17 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:34.692692 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0759c32e-f094-4f46-805f-cfb661f2b8a7 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bf3f42f3f5470c85398703180f9527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee75032bd62467399758fce3f8e11b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:34.704167 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0759c32e-f094-4f46-805f-cfb661f2b8a7 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] 10.222.0.57 "GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709" status: 200 len: 1499 microversion: 2.1 time: 0.737519 Jul 18 02:59:34.712656 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2828/5642] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:33 2022] GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709 => generated 1499 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:59:34.979362 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d42d129c-2289-4acb-95f6-ff6b9f682e17 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:34.994483 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d42d129c-2289-4acb-95f6-ff6b9f682e17 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 0.472648 Jul 18 02:59:34.995179 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2815/5643] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:34 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:35.012450 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8709e3a6-fdd9-440c-8057-998ec784793f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:35.013196 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8709e3a6-fdd9-440c-8057-998ec784793f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:35.041929 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8709e3a6-fdd9-440c-8057-998ec784793f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:35.044139 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8709e3a6-fdd9-440c-8057-998ec784793f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:35.049743 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8709e3a6-fdd9-440c-8057-998ec784793f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:35.052509 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8709e3a6-fdd9-440c-8057-998ec784793f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:35.535872 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d428d7e6-ab0b-4e2c-8332-b6b702288110 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:35.537837 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d428d7e6-ab0b-4e2c-8332-b6b702288110 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] [instance: 22fc38b2-8b4c-48cb-b47e-986650123898] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:35.573414 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d428d7e6-ab0b-4e2c-8332-b6b702288110 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:35.575152 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d428d7e6-ab0b-4e2c-8332-b6b702288110 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:35.578275 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d428d7e6-ab0b-4e2c-8332-b6b702288110 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:35.579741 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d428d7e6-ab0b-4e2c-8332-b6b702288110 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:35.864580 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d428d7e6-ab0b-4e2c-8332-b6b702288110 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dddc0cfa946d78f06ab7db1f11929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5555f4f3291040b7ae2fed82ca9df793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:35.884177 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d428d7e6-ab0b-4e2c-8332-b6b702288110 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] 10.222.0.57 "GET /compute/v2.1/servers/22fc38b2-8b4c-48cb-b47e-986650123898" status: 200 len: 1271 microversion: 2.1 time: 0.357388 Jul 18 02:59:35.897408 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2816/5644] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:35 2022] GET /compute/v2.1/servers/22fc38b2-8b4c-48cb-b47e-986650123898 => generated 1271 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:35.903493 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-66f543d8-4da1-4502-ad04-37942bae9136 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:35.908603 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-66f543d8-4da1-4502-ad04-37942bae9136 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] [instance: bf9d4886-031b-414a-aac0-4e4d9d200709] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:35.923328 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-66f543d8-4da1-4502-ad04-37942bae9136 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:35.928394 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-66f543d8-4da1-4502-ad04-37942bae9136 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:35.929607 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-66f543d8-4da1-4502-ad04-37942bae9136 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:35.930280 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-66f543d8-4da1-4502-ad04-37942bae9136 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:35.964046 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:59:36.389988 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8709e3a6-fdd9-440c-8057-998ec784793f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:36.410636 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8709e3a6-fdd9-440c-8057-998ec784793f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 1.402225 Jul 18 02:59:36.432043 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2829/5645] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:35 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:36.454226 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cab749c8-d338-4b0f-892c-5fa1949e1cc1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:59:36.472924 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cab749c8-d338-4b0f-892c-5fa1949e1cc1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:36.474378 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cab749c8-d338-4b0f-892c-5fa1949e1cc1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:36.539891 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cab749c8-d338-4b0f-892c-5fa1949e1cc1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Going to try to stop instance {{(pid=119543) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 02:59:36.639591 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-66f543d8-4da1-4502-ad04-37942bae9136 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bf3f42f3f5470c85398703180f9527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee75032bd62467399758fce3f8e11b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:36.672859 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cab749c8-d338-4b0f-892c-5fa1949e1cc1 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "POST /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e/action" status: 202 len: 0 microversion: 2.1 time: 0.229938 Jul 18 02:59:36.675228 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2830/5646] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:59:36 2022] POST /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:59:36.693935 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-66f543d8-4da1-4502-ad04-37942bae9136 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] 10.222.0.57 "GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709" status: 200 len: 1499 microversion: 2.1 time: 0.793088 Jul 18 02:59:36.703591 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2817/5647] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:35 2022] GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709 => generated 1499 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:36.711219 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9e8b36b7-acc1-4a84-844e-72750b137cdf tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:36.714332 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9e8b36b7-acc1-4a84-844e-72750b137cdf tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:36.731984 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e8b36b7-acc1-4a84-844e-72750b137cdf tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:36.732874 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e8b36b7-acc1-4a84-844e-72750b137cdf tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:36.734546 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e8b36b7-acc1-4a84-844e-72750b137cdf tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:36.735357 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e8b36b7-acc1-4a84-844e-72750b137cdf tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:36.917330 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b2538ef6-3619-465d-ac9f-4a00483011bc tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:36.919684 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b2538ef6-3619-465d-ac9f-4a00483011bc tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] [instance: 22fc38b2-8b4c-48cb-b47e-986650123898] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:36.933906 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b2538ef6-3619-465d-ac9f-4a00483011bc tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:36.935175 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b2538ef6-3619-465d-ac9f-4a00483011bc tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:36.937414 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b2538ef6-3619-465d-ac9f-4a00483011bc tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:36.938595 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b2538ef6-3619-465d-ac9f-4a00483011bc tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:37.076023 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9e8b36b7-acc1-4a84-844e-72750b137cdf tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:37.095050 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9e8b36b7-acc1-4a84-844e-72750b137cdf tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1680 microversion: 2.1 time: 0.405323 Jul 18 02:59:37.097276 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b2538ef6-3619-465d-ac9f-4a00483011bc tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dddc0cfa946d78f06ab7db1f11929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5555f4f3291040b7ae2fed82ca9df793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:37.108118 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b2538ef6-3619-465d-ac9f-4a00483011bc tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] 10.222.0.57 "GET /compute/v2.1/servers/22fc38b2-8b4c-48cb-b47e-986650123898" status: 200 len: 1271 microversion: 2.1 time: 0.197536 Jul 18 02:59:37.109813 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2818/5648] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:36 2022] GET /compute/v2.1/servers/22fc38b2-8b4c-48cb-b47e-986650123898 => generated 1271 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:59:37.114730 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2831/5649] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:36 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1680 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:37.718548 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e85b1f5a-019f-4342-b3cb-e4005fe30108 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:37.720571 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e85b1f5a-019f-4342-b3cb-e4005fe30108 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] [instance: bf9d4886-031b-414a-aac0-4e4d9d200709] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:37.735056 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e85b1f5a-019f-4342-b3cb-e4005fe30108 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:37.735605 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e85b1f5a-019f-4342-b3cb-e4005fe30108 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:37.736795 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e85b1f5a-019f-4342-b3cb-e4005fe30108 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:37.737780 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e85b1f5a-019f-4342-b3cb-e4005fe30108 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:38.079474 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e85b1f5a-019f-4342-b3cb-e4005fe30108 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bf3f42f3f5470c85398703180f9527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee75032bd62467399758fce3f8e11b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:38.096624 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e85b1f5a-019f-4342-b3cb-e4005fe30108 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] 10.222.0.57 "GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709" status: 200 len: 1502 microversion: 2.1 time: 0.382510 Jul 18 02:59:38.098591 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2819/5650] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:37 2022] GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709 => generated 1502 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:38.123556 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c4b4b23b-a74d-491e-ab86-2d2993db505d tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:38.129234 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-983989f6-9870-44e1-a93e-467e5e6ba33e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:38.130203 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-983989f6-9870-44e1-a93e-467e5e6ba33e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:38.134443 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c4b4b23b-a74d-491e-ab86-2d2993db505d tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] [instance: bf9d4886-031b-414a-aac0-4e4d9d200709] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:38.139113 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-983989f6-9870-44e1-a93e-467e5e6ba33e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:38.139571 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-983989f6-9870-44e1-a93e-467e5e6ba33e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:38.140624 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-983989f6-9870-44e1-a93e-467e5e6ba33e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:38.141293 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-983989f6-9870-44e1-a93e-467e5e6ba33e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:38.149082 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c4b4b23b-a74d-491e-ab86-2d2993db505d tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:38.151056 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c4b4b23b-a74d-491e-ab86-2d2993db505d tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:38.152538 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c4b4b23b-a74d-491e-ab86-2d2993db505d tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:38.153494 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c4b4b23b-a74d-491e-ab86-2d2993db505d tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:38.211866 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c4b4b23b-a74d-491e-ab86-2d2993db505d tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] [instance: bf9d4886-031b-414a-aac0-4e4d9d200709] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:59:38.386530 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c4b4b23b-a74d-491e-ab86-2d2993db505d tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] 10.222.0.57 "DELETE /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709" status: 204 len: 0 microversion: 2.1 time: 0.265700 Jul 18 02:59:38.391864 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2832/5651] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:59:38 2022] DELETE /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:59:38.419083 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e1440b50-84d3-4247-87d9-1a9ddbd10347 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:38.420967 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e1440b50-84d3-4247-87d9-1a9ddbd10347 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] [instance: 22fc38b2-8b4c-48cb-b47e-986650123898] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:38.434707 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e1440b50-84d3-4247-87d9-1a9ddbd10347 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:38.435656 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e1440b50-84d3-4247-87d9-1a9ddbd10347 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:38.437236 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e1440b50-84d3-4247-87d9-1a9ddbd10347 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:38.437767 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e1440b50-84d3-4247-87d9-1a9ddbd10347 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:38.701510 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-983989f6-9870-44e1-a93e-467e5e6ba33e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:38.715297 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-983989f6-9870-44e1-a93e-467e5e6ba33e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1680 microversion: 2.1 time: 0.589873 Jul 18 02:59:38.716552 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2820/5652] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:38 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1680 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:38.721973 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-66238f62-d2c1-4f03-8bf9-c241b98c5a45 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:38.723370 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-66238f62-d2c1-4f03-8bf9-c241b98c5a45 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] [instance: bf9d4886-031b-414a-aac0-4e4d9d200709] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:38.733778 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-66238f62-d2c1-4f03-8bf9-c241b98c5a45 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:38.734506 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-66238f62-d2c1-4f03-8bf9-c241b98c5a45 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:38.735577 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-66238f62-d2c1-4f03-8bf9-c241b98c5a45 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:38.736206 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-66238f62-d2c1-4f03-8bf9-c241b98c5a45 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:38.917212 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e1440b50-84d3-4247-87d9-1a9ddbd10347 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dddc0cfa946d78f06ab7db1f11929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5555f4f3291040b7ae2fed82ca9df793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:38.971781 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e1440b50-84d3-4247-87d9-1a9ddbd10347 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] 10.222.0.57 "GET /compute/v2.1/servers/22fc38b2-8b4c-48cb-b47e-986650123898" status: 200 len: 1313 microversion: 2.1 time: 0.555235 Jul 18 02:59:38.982594 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2833/5653] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:38 2022] GET /compute/v2.1/servers/22fc38b2-8b4c-48cb-b47e-986650123898 => generated 1313 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:39.076357 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-66238f62-d2c1-4f03-8bf9-c241b98c5a45 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bf3f42f3f5470c85398703180f9527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee75032bd62467399758fce3f8e11b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:39.118923 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-66238f62-d2c1-4f03-8bf9-c241b98c5a45 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] 10.222.0.57 "GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709" status: 200 len: 1508 microversion: 2.1 time: 0.398695 Jul 18 02:59:39.122202 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2821/5654] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:38 2022] GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709 => generated 1508 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:39.136186 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-ed697a30-ba5d-408d-8f62-90628f2e9ed2 req-02f4ffcf-36fa-44f8-ab91-f42217b97182 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22fc38b2-8b4c-48cb-b47e-986650123898", "tag": "644612af-e7f9-4766-b8f8-dede60d34d62"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:59:39.156546 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-ed697a30-ba5d-408d-8f62-90628f2e9ed2 req-02f4ffcf-36fa-44f8-ab91-f42217b97182 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:39.157163 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-ed697a30-ba5d-408d-8f62-90628f2e9ed2 req-02f4ffcf-36fa-44f8-ab91-f42217b97182 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:39.182075 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-ed697a30-ba5d-408d-8f62-90628f2e9ed2 req-02f4ffcf-36fa-44f8-ab91-f42217b97182 service nova] Creating event network-changed:644612af-e7f9-4766-b8f8-dede60d34d62 for instance 22fc38b2-8b4c-48cb-b47e-986650123898 on n-h2-465891-3 Jul 18 02:59:39.187992 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-ed697a30-ba5d-408d-8f62-90628f2e9ed2 req-02f4ffcf-36fa-44f8-ab91-f42217b97182 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067596 Jul 18 02:59:39.192128 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2834/5655] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:59:39.750232 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e5bb903f-bebe-4385-ab1e-f9f66dee3eba tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:39.751336 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e5bb903f-bebe-4385-ab1e-f9f66dee3eba tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:39.765196 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e5bb903f-bebe-4385-ab1e-f9f66dee3eba tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:39.766322 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e5bb903f-bebe-4385-ab1e-f9f66dee3eba tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:39.768301 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e5bb903f-bebe-4385-ab1e-f9f66dee3eba tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:39.768784 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e5bb903f-bebe-4385-ab1e-f9f66dee3eba tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:39.999212 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-984debaf-dafb-4ca6-a172-09ac9ed8bd98 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:39.999953 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-984debaf-dafb-4ca6-a172-09ac9ed8bd98 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] [instance: 22fc38b2-8b4c-48cb-b47e-986650123898] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:40.002383 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:59:40.009216 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-984debaf-dafb-4ca6-a172-09ac9ed8bd98 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:40.010220 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-984debaf-dafb-4ca6-a172-09ac9ed8bd98 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:40.011251 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-984debaf-dafb-4ca6-a172-09ac9ed8bd98 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:40.011886 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-984debaf-dafb-4ca6-a172-09ac9ed8bd98 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:40.035664 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e5bb903f-bebe-4385-ab1e-f9f66dee3eba tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:40.053043 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e5bb903f-bebe-4385-ab1e-f9f66dee3eba tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1680 microversion: 2.1 time: 0.308493 Jul 18 02:59:40.055538 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2822/5656] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:39 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1680 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:40.144532 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-448b90d7-c2c1-4435-9e75-137932068950 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:40.146063 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-448b90d7-c2c1-4435-9e75-137932068950 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] [instance: bf9d4886-031b-414a-aac0-4e4d9d200709] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:40.190521 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-448b90d7-c2c1-4435-9e75-137932068950 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:40.193052 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-448b90d7-c2c1-4435-9e75-137932068950 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:40.196707 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-448b90d7-c2c1-4435-9e75-137932068950 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:40.198240 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-448b90d7-c2c1-4435-9e75-137932068950 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:40.578505 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-984debaf-dafb-4ca6-a172-09ac9ed8bd98 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dddc0cfa946d78f06ab7db1f11929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5555f4f3291040b7ae2fed82ca9df793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:40.588974 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-984debaf-dafb-4ca6-a172-09ac9ed8bd98 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] 10.222.0.57 "GET /compute/v2.1/servers/22fc38b2-8b4c-48cb-b47e-986650123898" status: 200 len: 1313 microversion: 2.1 time: 0.593202 Jul 18 02:59:40.590153 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2835/5657] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:39 2022] GET /compute/v2.1/servers/22fc38b2-8b4c-48cb-b47e-986650123898 => generated 1313 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:40.772618 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-448b90d7-c2c1-4435-9e75-137932068950 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bf3f42f3f5470c85398703180f9527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee75032bd62467399758fce3f8e11b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:40.784408 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-448b90d7-c2c1-4435-9e75-137932068950 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] 10.222.0.57 "GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709" status: 200 len: 1508 microversion: 2.1 time: 0.646958 Jul 18 02:59:40.785802 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2823/5658] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:40 2022] GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709 => generated 1508 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:41.072529 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1a222456-c7d2-4cc2-9b7f-53faca891a15 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:41.073259 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1a222456-c7d2-4cc2-9b7f-53faca891a15 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:41.093315 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1a222456-c7d2-4cc2-9b7f-53faca891a15 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:41.099799 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1a222456-c7d2-4cc2-9b7f-53faca891a15 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:41.101156 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1a222456-c7d2-4cc2-9b7f-53faca891a15 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:41.101633 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1a222456-c7d2-4cc2-9b7f-53faca891a15 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:41.607311 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cf2f701a-31bd-4808-bdbe-a9eb744e69c0 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:41.608964 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cf2f701a-31bd-4808-bdbe-a9eb744e69c0 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] [instance: 22fc38b2-8b4c-48cb-b47e-986650123898] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:41.611182 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:59:41.619742 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cf2f701a-31bd-4808-bdbe-a9eb744e69c0 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:41.620287 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cf2f701a-31bd-4808-bdbe-a9eb744e69c0 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:41.621187 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cf2f701a-31bd-4808-bdbe-a9eb744e69c0 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:41.621730 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cf2f701a-31bd-4808-bdbe-a9eb744e69c0 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:41.914841 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=8 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:59:42.224625 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1a222456-c7d2-4cc2-9b7f-53faca891a15 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:42.247887 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1a222456-c7d2-4cc2-9b7f-53faca891a15 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1680 microversion: 2.1 time: 1.179204 Jul 18 02:59:42.248967 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2836/5659] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:41 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1680 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:42.280040 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5bab088d-e689-491f-97e5-805da8477652 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:42.284888 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5bab088d-e689-491f-97e5-805da8477652 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] [instance: bf9d4886-031b-414a-aac0-4e4d9d200709] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:42.308561 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5bab088d-e689-491f-97e5-805da8477652 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:42.310356 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5bab088d-e689-491f-97e5-805da8477652 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:42.313748 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5bab088d-e689-491f-97e5-805da8477652 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:42.316973 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5bab088d-e689-491f-97e5-805da8477652 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:42.351514 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=93,nova_cell1:UPDATE=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:59:42.571040 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-cf2f701a-31bd-4808-bdbe-a9eb744e69c0 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dddc0cfa946d78f06ab7db1f11929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5555f4f3291040b7ae2fed82ca9df793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:42.585805 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cf2f701a-31bd-4808-bdbe-a9eb744e69c0 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] 10.222.0.57 "GET /compute/v2.1/servers/22fc38b2-8b4c-48cb-b47e-986650123898" status: 200 len: 1313 microversion: 2.1 time: 0.983193 Jul 18 02:59:42.587300 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2824/5660] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:41 2022] GET /compute/v2.1/servers/22fc38b2-8b4c-48cb-b47e-986650123898 => generated 1313 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:42.789625 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-47e55fd6-3f2c-46c0-99fd-6eec6c9ac462 req-d0030561-b175-41ed-8ee7-935e7481e1d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf9d4886-031b-414a-aac0-4e4d9d200709", "name": "network-vif-deleted", "tag": "b476e3d9-5371-42fa-9f11-c7642038728f"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:59:42.796929 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:59:42.822050 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-47e55fd6-3f2c-46c0-99fd-6eec6c9ac462 req-d0030561-b175-41ed-8ee7-935e7481e1d7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:42.825752 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-47e55fd6-3f2c-46c0-99fd-6eec6c9ac462 req-d0030561-b175-41ed-8ee7-935e7481e1d7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:42.873454 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-47e55fd6-3f2c-46c0-99fd-6eec6c9ac462 req-d0030561-b175-41ed-8ee7-935e7481e1d7 service nova] Creating event network-vif-deleted:b476e3d9-5371-42fa-9f11-c7642038728f for instance bf9d4886-031b-414a-aac0-4e4d9d200709 on n-h2-465891-3 Jul 18 02:59:42.887520 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-47e55fd6-3f2c-46c0-99fd-6eec6c9ac462 req-d0030561-b175-41ed-8ee7-935e7481e1d7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101584 Jul 18 02:59:42.894752 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2825/5661] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:59:42.957987 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5bab088d-e689-491f-97e5-805da8477652 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bf3f42f3f5470c85398703180f9527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee75032bd62467399758fce3f8e11b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:42.969514 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5bab088d-e689-491f-97e5-805da8477652 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] 10.222.0.57 "GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709" status: 200 len: 1508 microversion: 2.1 time: 0.707764 Jul 18 02:59:42.970755 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2837/5662] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:42 2022] GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709 => generated 1508 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:43.286182 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-eda0b887-4a26-413b-8394-2c7ad01984eb tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:43.288499 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-eda0b887-4a26-413b-8394-2c7ad01984eb tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:43.303138 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eda0b887-4a26-413b-8394-2c7ad01984eb tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:43.303787 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eda0b887-4a26-413b-8394-2c7ad01984eb tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:43.307047 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eda0b887-4a26-413b-8394-2c7ad01984eb tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:43.308610 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eda0b887-4a26-413b-8394-2c7ad01984eb tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:43.525135 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-eda0b887-4a26-413b-8394-2c7ad01984eb tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:43.556638 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-eda0b887-4a26-413b-8394-2c7ad01984eb tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1680 microversion: 2.1 time: 0.277203 Jul 18 02:59:43.559507 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2826/5663] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:43 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1680 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:43.610147 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e6b15ab6-681d-47e7-864e-5232d3ab1822 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:43.611833 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e6b15ab6-681d-47e7-864e-5232d3ab1822 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] [instance: 22fc38b2-8b4c-48cb-b47e-986650123898] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:43.623816 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e6b15ab6-681d-47e7-864e-5232d3ab1822 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:43.624908 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e6b15ab6-681d-47e7-864e-5232d3ab1822 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:43.626162 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e6b15ab6-681d-47e7-864e-5232d3ab1822 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:43.626890 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e6b15ab6-681d-47e7-864e-5232d3ab1822 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:43.860144 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e6b15ab6-681d-47e7-864e-5232d3ab1822 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dddc0cfa946d78f06ab7db1f11929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5555f4f3291040b7ae2fed82ca9df793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:43.870474 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e6b15ab6-681d-47e7-864e-5232d3ab1822 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] 10.222.0.57 "GET /compute/v2.1/servers/22fc38b2-8b4c-48cb-b47e-986650123898" status: 200 len: 1313 microversion: 2.1 time: 0.264736 Jul 18 02:59:43.871800 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2838/5664] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:43 2022] GET /compute/v2.1/servers/22fc38b2-8b4c-48cb-b47e-986650123898 => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:59:43.996423 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d7251947-d1d5-41c7-9576-1663a7c1e280 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:43.998009 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d7251947-d1d5-41c7-9576-1663a7c1e280 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] [instance: bf9d4886-031b-414a-aac0-4e4d9d200709] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:44.016424 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d7251947-d1d5-41c7-9576-1663a7c1e280 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:44.017364 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d7251947-d1d5-41c7-9576-1663a7c1e280 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:44.018977 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d7251947-d1d5-41c7-9576-1663a7c1e280 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:44.019744 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d7251947-d1d5-41c7-9576-1663a7c1e280 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:44.094630 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d7251947-d1d5-41c7-9576-1663a7c1e280 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:44.095266 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d7251947-d1d5-41c7-9576-1663a7c1e280 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:44.095929 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-d7251947-d1d5-41c7-9576-1663a7c1e280 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lazy-loading 'fault' on Instance uuid bf9d4886-031b-414a-aac0-4e4d9d200709 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:59:44.169263 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d7251947-d1d5-41c7-9576-1663a7c1e280 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bf3f42f3f5470c85398703180f9527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee75032bd62467399758fce3f8e11b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:44.182662 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d7251947-d1d5-41c7-9576-1663a7c1e280 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] 10.222.0.57 "GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709" status: 200 len: 1305 microversion: 2.1 time: 0.196770 Jul 18 02:59:44.183772 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2827/5665] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:43 2022] GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709 => generated 1305 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:44.580628 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-343d8030-2811-4d1f-bf07-0356bf8f5cfa tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:44.581653 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-343d8030-2811-4d1f-bf07-0356bf8f5cfa tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:44.589901 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-343d8030-2811-4d1f-bf07-0356bf8f5cfa tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:44.590540 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-343d8030-2811-4d1f-bf07-0356bf8f5cfa tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:44.591646 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-343d8030-2811-4d1f-bf07-0356bf8f5cfa tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:44.592422 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-343d8030-2811-4d1f-bf07-0356bf8f5cfa tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:44.903868 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-343d8030-2811-4d1f-bf07-0356bf8f5cfa tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:44.908072 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6b938e32-1601-436c-aab1-6b5f1f8ba516 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:44.911656 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6b938e32-1601-436c-aab1-6b5f1f8ba516 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] [instance: 22fc38b2-8b4c-48cb-b47e-986650123898] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:44.917495 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-343d8030-2811-4d1f-bf07-0356bf8f5cfa tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1680 microversion: 2.1 time: 0.340844 Jul 18 02:59:44.921173 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2839/5666] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:44 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1680 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:59:44.932789 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b938e32-1601-436c-aab1-6b5f1f8ba516 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:44.934776 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b938e32-1601-436c-aab1-6b5f1f8ba516 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:44.940308 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b938e32-1601-436c-aab1-6b5f1f8ba516 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:44.940788 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b938e32-1601-436c-aab1-6b5f1f8ba516 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:45.140311 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6b938e32-1601-436c-aab1-6b5f1f8ba516 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dddc0cfa946d78f06ab7db1f11929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5555f4f3291040b7ae2fed82ca9df793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:45.158130 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6b938e32-1601-436c-aab1-6b5f1f8ba516 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] 10.222.0.57 "GET /compute/v2.1/servers/22fc38b2-8b4c-48cb-b47e-986650123898" status: 200 len: 1313 microversion: 2.1 time: 0.259896 Jul 18 02:59:45.160224 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2828/5667] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:44 2022] GET /compute/v2.1/servers/22fc38b2-8b4c-48cb-b47e-986650123898 => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:59:45.209367 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2faf9dcf-4878-4ca2-b00e-7bc44b88af83 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:45.210472 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2faf9dcf-4878-4ca2-b00e-7bc44b88af83 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] [instance: bf9d4886-031b-414a-aac0-4e4d9d200709] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:45.219170 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2faf9dcf-4878-4ca2-b00e-7bc44b88af83 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:45.220265 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2faf9dcf-4878-4ca2-b00e-7bc44b88af83 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:45.221348 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2faf9dcf-4878-4ca2-b00e-7bc44b88af83 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:45.222103 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2faf9dcf-4878-4ca2-b00e-7bc44b88af83 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:45.238888 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-2faf9dcf-4878-4ca2-b00e-7bc44b88af83 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] HTTP exception thrown: Instance bf9d4886-031b-414a-aac0-4e4d9d200709 could not be found. Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2faf9dcf-4878-4ca2-b00e-7bc44b88af83 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Request method failure captured: Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709 HTTP/1.1 Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MxoopIz3Bw8x-hrMkWrNr19i4T1nZPqRPrCgBu-S0eQQmvniOoPOZ7kgBwqqpSQznCsmUP66VounCsnYG5hD6ZdosftZ2bCklxwVr-ehMKQ8giw-LEE9cOgUV4mdd9_EAi72LgbPtYgAcj4InEj6sfYzn2BUu2l9QGL9OJWzzzkKb4 Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 6ee75032bd62467399758fce3f8e11b2 Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-TestServerAdvancedOps-1559893907 Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6ee75032bd62467399758fce3f8e11b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6ee75032bd62467399758fce3f8e11b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6ee75032bd62467399758fce3f8e11b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6ee75032bd62467399758fce3f8e11b2"}]}] Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-TestServerAdvancedOps-1559893907 Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 6ee75032bd62467399758fce3f8e11b2 Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-TestServerAdvancedOps-1559893907 Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-TestServerAdvancedOps-1559893907-project Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 10bf3f42f3f5470c85398703180f9527 Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-TestServerAdvancedOps-1559893907-project Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance bf9d4886-031b-414a-aac0-4e4d9d200709 could not be found. Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'bf9d4886-031b-414a-aac0-4e4d9d200709'} Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf9d4886-031b-414a-aac0-4e4d9d200709 could not be found. Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf9d4886-031b-414a-aac0-4e4d9d200709 could not be found. Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:59:45.241201 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:59:45.245384 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:59:45.245384 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:59:45.245384 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:59:45.245384 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:59:45.245384 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:59:45.245384 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf9d4886-031b-414a-aac0-4e4d9d200709 could not be found. Jul 18 02:59:45.245384 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:59:45.247434 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2faf9dcf-4878-4ca2-b00e-7bc44b88af83 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] Returning 404 to user: Instance bf9d4886-031b-414a-aac0-4e4d9d200709 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:59:45.249573 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2faf9dcf-4878-4ca2-b00e-7bc44b88af83 tempest-TestServerAdvancedOps-1559893907 tempest-TestServerAdvancedOps-1559893907-project] 10.222.0.57 "GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709" status: 404 len: 111 microversion: 2.1 time: 0.044570 Jul 18 02:59:45.250827 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2840/5668] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:45 2022] GET /compute/v2.1/servers/bf9d4886-031b-414a-aac0-4e4d9d200709 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:59:45.953081 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-817ae1e8-c03b-4d8d-9e3f-c282b00a22a7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:45.955429 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-817ae1e8-c03b-4d8d-9e3f-c282b00a22a7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:45.969658 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-817ae1e8-c03b-4d8d-9e3f-c282b00a22a7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:45.970835 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-817ae1e8-c03b-4d8d-9e3f-c282b00a22a7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:45.973094 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-817ae1e8-c03b-4d8d-9e3f-c282b00a22a7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:45.974288 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-817ae1e8-c03b-4d8d-9e3f-c282b00a22a7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:46.185401 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5b545df1-32b9-4222-983e-c809d5f5c3c3 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:46.186280 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5b545df1-32b9-4222-983e-c809d5f5c3c3 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] [instance: 22fc38b2-8b4c-48cb-b47e-986650123898] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:46.201139 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5b545df1-32b9-4222-983e-c809d5f5c3c3 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:46.204666 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5b545df1-32b9-4222-983e-c809d5f5c3c3 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:46.207097 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5b545df1-32b9-4222-983e-c809d5f5c3c3 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:46.207830 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5b545df1-32b9-4222-983e-c809d5f5c3c3 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:46.260531 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-817ae1e8-c03b-4d8d-9e3f-c282b00a22a7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:46.275955 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-817ae1e8-c03b-4d8d-9e3f-c282b00a22a7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1680 microversion: 2.1 time: 0.332582 Jul 18 02:59:46.278611 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2829/5669] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:45 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1680 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:46.468771 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5b545df1-32b9-4222-983e-c809d5f5c3c3 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dddc0cfa946d78f06ab7db1f11929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5555f4f3291040b7ae2fed82ca9df793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:46.481995 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5b545df1-32b9-4222-983e-c809d5f5c3c3 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] 10.222.0.57 "GET /compute/v2.1/servers/22fc38b2-8b4c-48cb-b47e-986650123898" status: 200 len: 1313 microversion: 2.1 time: 0.300986 Jul 18 02:59:46.482825 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2841/5670] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:46 2022] GET /compute/v2.1/servers/22fc38b2-8b4c-48cb-b47e-986650123898 => generated 1313 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:59:47.308657 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-73c25f47-7ae1-44bf-85b4-e1c3a6c59f2e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:47.309803 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-73c25f47-7ae1-44bf-85b4-e1c3a6c59f2e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:47.343043 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-73c25f47-7ae1-44bf-85b4-e1c3a6c59f2e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:47.343916 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-73c25f47-7ae1-44bf-85b4-e1c3a6c59f2e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:47.349314 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-73c25f47-7ae1-44bf-85b4-e1c3a6c59f2e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:47.350179 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-73c25f47-7ae1-44bf-85b4-e1c3a6c59f2e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:47.508086 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cb2002ae-5925-44c4-b7d4-2444851ce372 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:47.510190 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cb2002ae-5925-44c4-b7d4-2444851ce372 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] [instance: 22fc38b2-8b4c-48cb-b47e-986650123898] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:47.524274 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cb2002ae-5925-44c4-b7d4-2444851ce372 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:47.525039 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cb2002ae-5925-44c4-b7d4-2444851ce372 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:47.526167 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cb2002ae-5925-44c4-b7d4-2444851ce372 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:47.530573 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cb2002ae-5925-44c4-b7d4-2444851ce372 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:48.083504 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-73c25f47-7ae1-44bf-85b4-e1c3a6c59f2e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:48.101410 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-73c25f47-7ae1-44bf-85b4-e1c3a6c59f2e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1657 microversion: 2.1 time: 0.801315 Jul 18 02:59:48.108095 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2830/5671] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:47 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1657 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:48.115263 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-9bff7f4c-64c6-46e3-a0eb-54f93f0ad299 req-b852b647-2da8-4ad0-b5ad-7774fab91c8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22fc38b2-8b4c-48cb-b47e-986650123898", "name": "network-vif-plugged", "status": "completed", "tag": "644612af-e7f9-4766-b8f8-dede60d34d62"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:59:48.161947 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-9bff7f4c-64c6-46e3-a0eb-54f93f0ad299 req-b852b647-2da8-4ad0-b5ad-7774fab91c8d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:48.162928 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-9bff7f4c-64c6-46e3-a0eb-54f93f0ad299 req-b852b647-2da8-4ad0-b5ad-7774fab91c8d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:48.197890 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cb2002ae-5925-44c4-b7d4-2444851ce372 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dddc0cfa946d78f06ab7db1f11929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5555f4f3291040b7ae2fed82ca9df793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:48.204758 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-9bff7f4c-64c6-46e3-a0eb-54f93f0ad299 req-b852b647-2da8-4ad0-b5ad-7774fab91c8d service nova] Creating event network-vif-plugged:644612af-e7f9-4766-b8f8-dede60d34d62 for instance 22fc38b2-8b4c-48cb-b47e-986650123898 on n-h2-465891-3 Jul 18 02:59:48.207254 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cb2002ae-5925-44c4-b7d4-2444851ce372 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] 10.222.0.57 "GET /compute/v2.1/servers/22fc38b2-8b4c-48cb-b47e-986650123898" status: 200 len: 1313 microversion: 2.1 time: 0.703371 Jul 18 02:59:48.217752 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2842/5672] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:47 2022] GET /compute/v2.1/servers/22fc38b2-8b4c-48cb-b47e-986650123898 => generated 1313 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:48.217752 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d47a6010-19ec-4a57-9aba-a1658768e20d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:59:48.234752 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d47a6010-19ec-4a57-9aba-a1658768e20d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:48.234752 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d47a6010-19ec-4a57-9aba-a1658768e20d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:48.242160 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-9bff7f4c-64c6-46e3-a0eb-54f93f0ad299 req-b852b647-2da8-4ad0-b5ad-7774fab91c8d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131105 Jul 18 02:59:48.244605 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2831/5673] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:59:48.264856 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d47a6010-19ec-4a57-9aba-a1658768e20d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Going to try to start instance {{(pid=119543) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 02:59:48.361235 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d47a6010-19ec-4a57-9aba-a1658768e20d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "POST /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e/action" status: 202 len: 0 microversion: 2.1 time: 0.151146 Jul 18 02:59:48.361802 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2843/5674] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:59:48 2022] POST /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:59:48.376636 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-56e743af-beaa-4348-874a-f48285f06dc6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:48.379864 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-56e743af-beaa-4348-874a-f48285f06dc6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:48.407322 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-56e743af-beaa-4348-874a-f48285f06dc6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:48.408062 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-56e743af-beaa-4348-874a-f48285f06dc6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:48.409062 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-56e743af-beaa-4348-874a-f48285f06dc6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:48.411038 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-56e743af-beaa-4348-874a-f48285f06dc6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:49.186727 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-56e743af-beaa-4348-874a-f48285f06dc6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:49.217567 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-56e743af-beaa-4348-874a-f48285f06dc6 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1666 microversion: 2.1 time: 0.845991 Jul 18 02:59:49.220386 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2832/5675] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:48 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1666 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:49.259210 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f83f1444-db8d-4c53-a690-5fbd11aabf63 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:49.262398 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f83f1444-db8d-4c53-a690-5fbd11aabf63 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] [instance: 22fc38b2-8b4c-48cb-b47e-986650123898] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:49.280606 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f83f1444-db8d-4c53-a690-5fbd11aabf63 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:49.281821 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f83f1444-db8d-4c53-a690-5fbd11aabf63 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:49.283376 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f83f1444-db8d-4c53-a690-5fbd11aabf63 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:49.284157 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f83f1444-db8d-4c53-a690-5fbd11aabf63 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:49.599077 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f83f1444-db8d-4c53-a690-5fbd11aabf63 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dddc0cfa946d78f06ab7db1f11929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5555f4f3291040b7ae2fed82ca9df793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:49.612192 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f83f1444-db8d-4c53-a690-5fbd11aabf63 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] 10.222.0.57 "GET /compute/v2.1/servers/22fc38b2-8b4c-48cb-b47e-986650123898" status: 200 len: 1313 microversion: 2.1 time: 0.370724 Jul 18 02:59:49.613496 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2844/5676] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:49 2022] GET /compute/v2.1/servers/22fc38b2-8b4c-48cb-b47e-986650123898 => generated 1313 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:50.255510 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c070ff68-642a-4c84-8f84-5cc23b487238 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:50.257535 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c070ff68-642a-4c84-8f84-5cc23b487238 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:50.277442 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c070ff68-642a-4c84-8f84-5cc23b487238 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:50.280451 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c070ff68-642a-4c84-8f84-5cc23b487238 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:50.284447 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c070ff68-642a-4c84-8f84-5cc23b487238 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:50.285075 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c070ff68-642a-4c84-8f84-5cc23b487238 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:50.642918 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ac1f9a1d-4130-4d40-bff7-7a6f2081f652 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:50.644752 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ac1f9a1d-4130-4d40-bff7-7a6f2081f652 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] [instance: 22fc38b2-8b4c-48cb-b47e-986650123898] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:50.668822 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ac1f9a1d-4130-4d40-bff7-7a6f2081f652 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:50.673482 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ac1f9a1d-4130-4d40-bff7-7a6f2081f652 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:50.686647 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ac1f9a1d-4130-4d40-bff7-7a6f2081f652 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:50.689695 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ac1f9a1d-4130-4d40-bff7-7a6f2081f652 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:50.738041 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c070ff68-642a-4c84-8f84-5cc23b487238 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:50.761140 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c070ff68-642a-4c84-8f84-5cc23b487238 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1666 microversion: 2.1 time: 0.520222 Jul 18 02:59:50.772800 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2833/5677] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:50 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1666 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:50.937899 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b0e16903-a40f-4434-bfea-aa0efc5fa48b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:59:50.939571 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b0e16903-a40f-4434-bfea-aa0efc5fa48b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:50.950220 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b0e16903-a40f-4434-bfea-aa0efc5fa48b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:50.951220 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b0e16903-a40f-4434-bfea-aa0efc5fa48b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:50.952415 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b0e16903-a40f-4434-bfea-aa0efc5fa48b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:50.953005 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b0e16903-a40f-4434-bfea-aa0efc5fa48b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:51.002588 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ac1f9a1d-4130-4d40-bff7-7a6f2081f652 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dddc0cfa946d78f06ab7db1f11929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5555f4f3291040b7ae2fed82ca9df793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:51.014594 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ac1f9a1d-4130-4d40-bff7-7a6f2081f652 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] 10.222.0.57 "GET /compute/v2.1/servers/22fc38b2-8b4c-48cb-b47e-986650123898" status: 200 len: 1497 microversion: 2.1 time: 0.380990 Jul 18 02:59:51.015334 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2845/5678] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:50 2022] GET /compute/v2.1/servers/22fc38b2-8b4c-48cb-b47e-986650123898 => generated 1497 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:51.034971 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b0e16903-a40f-4434-bfea-aa0efc5fa48b tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "POST /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518/action" status: 200 len: 24573 microversion: 2.1 time: 0.101587 Jul 18 02:59:51.036218 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2834/5679] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:59:50 2022] POST /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518/action => generated 24573 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:59:51.781750 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-12e76181-3ca8-4894-b104-dc0687aa3a51 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:51.796186 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-12e76181-3ca8-4894-b104-dc0687aa3a51 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:51.809944 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7d1eb215-6b20-4e04-9fe0-6f21471b53b4 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:51.810829 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7d1eb215-6b20-4e04-9fe0-6f21471b53b4 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] [instance: 22fc38b2-8b4c-48cb-b47e-986650123898] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:51.819198 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7d1eb215-6b20-4e04-9fe0-6f21471b53b4 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:51.820004 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7d1eb215-6b20-4e04-9fe0-6f21471b53b4 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:51.821797 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7d1eb215-6b20-4e04-9fe0-6f21471b53b4 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:51.823051 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7d1eb215-6b20-4e04-9fe0-6f21471b53b4 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:51.834487 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-12e76181-3ca8-4894-b104-dc0687aa3a51 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:51.835302 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-12e76181-3ca8-4894-b104-dc0687aa3a51 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:51.837325 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-12e76181-3ca8-4894-b104-dc0687aa3a51 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:51.838389 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-12e76181-3ca8-4894-b104-dc0687aa3a51 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:51.844175 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=100 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:59:51.858209 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7d1eb215-6b20-4e04-9fe0-6f21471b53b4 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] [instance: 22fc38b2-8b4c-48cb-b47e-986650123898] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:59:51.978501 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7d1eb215-6b20-4e04-9fe0-6f21471b53b4 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] 10.222.0.57 "DELETE /compute/v2.1/servers/22fc38b2-8b4c-48cb-b47e-986650123898" status: 204 len: 0 microversion: 2.1 time: 0.172818 Jul 18 02:59:51.979487 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2835/5680] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:59:51 2022] DELETE /compute/v2.1/servers/22fc38b2-8b4c-48cb-b47e-986650123898 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:59:51.991324 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0c299d65-32ca-4617-ae49-cfe3062f1d9c tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:51.992220 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0c299d65-32ca-4617-ae49-cfe3062f1d9c tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] [instance: 22fc38b2-8b4c-48cb-b47e-986650123898] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:52.002419 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c299d65-32ca-4617-ae49-cfe3062f1d9c tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:52.003275 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c299d65-32ca-4617-ae49-cfe3062f1d9c tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:52.004949 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c299d65-32ca-4617-ae49-cfe3062f1d9c tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:52.005633 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c299d65-32ca-4617-ae49-cfe3062f1d9c tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:52.222709 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-12e76181-3ca8-4894-b104-dc0687aa3a51 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:52.239215 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-12e76181-3ca8-4894-b104-dc0687aa3a51 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 0.463161 Jul 18 02:59:52.241028 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2846/5681] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:51 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:52.271813 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-44a1f2a0-fc0d-43b2-83e2-9bbb1ef27675 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:52.273587 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-44a1f2a0-fc0d-43b2-83e2-9bbb1ef27675 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:52.284504 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-44a1f2a0-fc0d-43b2-83e2-9bbb1ef27675 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:52.284959 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-44a1f2a0-fc0d-43b2-83e2-9bbb1ef27675 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:52.286340 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-44a1f2a0-fc0d-43b2-83e2-9bbb1ef27675 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:52.287122 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-44a1f2a0-fc0d-43b2-83e2-9bbb1ef27675 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:52.318851 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0c299d65-32ca-4617-ae49-cfe3062f1d9c tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dddc0cfa946d78f06ab7db1f11929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5555f4f3291040b7ae2fed82ca9df793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:52.339539 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0c299d65-32ca-4617-ae49-cfe3062f1d9c tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] 10.222.0.57 "GET /compute/v2.1/servers/22fc38b2-8b4c-48cb-b47e-986650123898" status: 200 len: 1503 microversion: 2.1 time: 0.352785 Jul 18 02:59:52.354408 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2836/5682] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:51 2022] GET /compute/v2.1/servers/22fc38b2-8b4c-48cb-b47e-986650123898 => generated 1503 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:52.516779 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-44a1f2a0-fc0d-43b2-83e2-9bbb1ef27675 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:52.529761 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-44a1f2a0-fc0d-43b2-83e2-9bbb1ef27675 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 0.265596 Jul 18 02:59:52.530374 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2847/5683] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:52 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:52.558895 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a428ce0a-cfe6-497d-aa11-fbb26b5571bf tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:52.561937 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a428ce0a-cfe6-497d-aa11-fbb26b5571bf tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:52.571271 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a428ce0a-cfe6-497d-aa11-fbb26b5571bf tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:52.572077 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a428ce0a-cfe6-497d-aa11-fbb26b5571bf tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:52.572975 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a428ce0a-cfe6-497d-aa11-fbb26b5571bf tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:52.573470 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a428ce0a-cfe6-497d-aa11-fbb26b5571bf tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:52.791745 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a428ce0a-cfe6-497d-aa11-fbb26b5571bf tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:52.804435 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a428ce0a-cfe6-497d-aa11-fbb26b5571bf tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 0.252912 Jul 18 02:59:52.805891 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2837/5684] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:52 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:52.838891 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-21256223-3f1f-4ae4-bfab-dc383090b12f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:52.841488 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-21256223-3f1f-4ae4-bfab-dc383090b12f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:52.864168 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-21256223-3f1f-4ae4-bfab-dc383090b12f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:52.864168 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-21256223-3f1f-4ae4-bfab-dc383090b12f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:52.864602 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-21256223-3f1f-4ae4-bfab-dc383090b12f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:52.870008 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-21256223-3f1f-4ae4-bfab-dc383090b12f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:53.134697 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-21256223-3f1f-4ae4-bfab-dc383090b12f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:53.147642 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-21256223-3f1f-4ae4-bfab-dc383090b12f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 0.317635 Jul 18 02:59:53.156828 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2848/5685] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:52 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:53.175511 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-efd10aa2-7add-4368-a60f-ec08236a235e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:53.176301 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-efd10aa2-7add-4368-a60f-ec08236a235e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:53.188506 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-efd10aa2-7add-4368-a60f-ec08236a235e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:53.190900 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-efd10aa2-7add-4368-a60f-ec08236a235e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:53.190900 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-efd10aa2-7add-4368-a60f-ec08236a235e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:53.190900 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-efd10aa2-7add-4368-a60f-ec08236a235e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:53.370656 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3ac8c043-25cf-4147-851e-fca5f9167934 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:53.372008 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3ac8c043-25cf-4147-851e-fca5f9167934 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] [instance: 22fc38b2-8b4c-48cb-b47e-986650123898] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:53.385374 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3ac8c043-25cf-4147-851e-fca5f9167934 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:53.386215 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3ac8c043-25cf-4147-851e-fca5f9167934 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:53.387611 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3ac8c043-25cf-4147-851e-fca5f9167934 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:53.388778 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3ac8c043-25cf-4147-851e-fca5f9167934 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:53.692589 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-efd10aa2-7add-4368-a60f-ec08236a235e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:53.719554 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-efd10aa2-7add-4368-a60f-ec08236a235e tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 0.548146 Jul 18 02:59:53.721576 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2838/5686] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:53 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:53.744252 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c27dbe25-1f7c-423a-ac8a-6fc229947668 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:59:53.745938 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c27dbe25-1f7c-423a-ac8a-6fc229947668 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:53.762877 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c27dbe25-1f7c-423a-ac8a-6fc229947668 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:53.764258 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c27dbe25-1f7c-423a-ac8a-6fc229947668 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:53.766497 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c27dbe25-1f7c-423a-ac8a-6fc229947668 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:53.767368 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c27dbe25-1f7c-423a-ac8a-6fc229947668 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:53.834277 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-c27dbe25-1f7c-423a-ac8a-6fc229947668 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lazy-loading 'flavor' on Instance uuid 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:59:53.854288 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3ac8c043-25cf-4147-851e-fca5f9167934 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dddc0cfa946d78f06ab7db1f11929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5555f4f3291040b7ae2fed82ca9df793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:53.902221 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3ac8c043-25cf-4147-851e-fca5f9167934 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] 10.222.0.57 "GET /compute/v2.1/servers/22fc38b2-8b4c-48cb-b47e-986650123898" status: 200 len: 1503 microversion: 2.1 time: 0.539127 Jul 18 02:59:53.920666 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2849/5687] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:53 2022] GET /compute/v2.1/servers/22fc38b2-8b4c-48cb-b47e-986650123898 => generated 1503 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:53.952359 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c27dbe25-1f7c-423a-ac8a-6fc229947668 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "POST /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e/action" status: 202 len: 0 microversion: 2.1 time: 0.218446 Jul 18 02:59:53.953732 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2839/5688] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:59:53 2022] POST /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:59:53.969502 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d5fe8191-6053-48de-8f6c-5afd6d9e6f67 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:53.974724 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d5fe8191-6053-48de-8f6c-5afd6d9e6f67 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:53.991528 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5fe8191-6053-48de-8f6c-5afd6d9e6f67 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:53.992012 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5fe8191-6053-48de-8f6c-5afd6d9e6f67 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:53.993027 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5fe8191-6053-48de-8f6c-5afd6d9e6f67 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:53.993794 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5fe8191-6053-48de-8f6c-5afd6d9e6f67 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:54.318976 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d5fe8191-6053-48de-8f6c-5afd6d9e6f67 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:54.332380 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d5fe8191-6053-48de-8f6c-5afd6d9e6f67 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1678 microversion: 2.1 time: 0.374268 Jul 18 02:59:54.333859 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2850/5689] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:53 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1678 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:54.472208 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-612e2e3f-9b17-46d4-89e3-9d23ac7a8e3d req-78772436-baac-45ae-a7da-312813282e93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22fc38b2-8b4c-48cb-b47e-986650123898", "name": "network-vif-deleted", "tag": "644612af-e7f9-4766-b8f8-dede60d34d62"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:59:54.503676 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-612e2e3f-9b17-46d4-89e3-9d23ac7a8e3d req-78772436-baac-45ae-a7da-312813282e93 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:54.505022 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-612e2e3f-9b17-46d4-89e3-9d23ac7a8e3d req-78772436-baac-45ae-a7da-312813282e93 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:54.568129 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-612e2e3f-9b17-46d4-89e3-9d23ac7a8e3d req-78772436-baac-45ae-a7da-312813282e93 service nova] Creating event network-vif-deleted:644612af-e7f9-4766-b8f8-dede60d34d62 for instance 22fc38b2-8b4c-48cb-b47e-986650123898 on n-h2-465891-3 Jul 18 02:59:54.577636 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-612e2e3f-9b17-46d4-89e3-9d23ac7a8e3d req-78772436-baac-45ae-a7da-312813282e93 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111705 Jul 18 02:59:54.578608 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2840/5690] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 02:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:59:54.927549 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bc2abe68-7a4c-43e3-875d-0f440e80c313 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:54.929241 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bc2abe68-7a4c-43e3-875d-0f440e80c313 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] [instance: 22fc38b2-8b4c-48cb-b47e-986650123898] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:54.939447 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bc2abe68-7a4c-43e3-875d-0f440e80c313 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:54.939992 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bc2abe68-7a4c-43e3-875d-0f440e80c313 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:54.940851 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bc2abe68-7a4c-43e3-875d-0f440e80c313 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:54.941372 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bc2abe68-7a4c-43e3-875d-0f440e80c313 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:54.982748 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bc2abe68-7a4c-43e3-875d-0f440e80c313 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:54.983089 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bc2abe68-7a4c-43e3-875d-0f440e80c313 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:54.983573 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-bc2abe68-7a4c-43e3-875d-0f440e80c313 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lazy-loading 'fault' on Instance uuid 22fc38b2-8b4c-48cb-b47e-986650123898 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:59:55.116807 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bc2abe68-7a4c-43e3-875d-0f440e80c313 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dddc0cfa946d78f06ab7db1f11929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5555f4f3291040b7ae2fed82ca9df793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:55.130446 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bc2abe68-7a4c-43e3-875d-0f440e80c313 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] 10.222.0.57 "GET /compute/v2.1/servers/22fc38b2-8b4c-48cb-b47e-986650123898" status: 200 len: 1303 microversion: 2.1 time: 0.206885 Jul 18 02:59:55.131221 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2851/5691] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:54 2022] GET /compute/v2.1/servers/22fc38b2-8b4c-48cb-b47e-986650123898 => generated 1303 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:55.351886 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b41a6501-2e81-4b95-8ff4-3248505b0759 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:55.353342 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b41a6501-2e81-4b95-8ff4-3248505b0759 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:55.363263 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b41a6501-2e81-4b95-8ff4-3248505b0759 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:55.363988 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b41a6501-2e81-4b95-8ff4-3248505b0759 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:55.365173 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b41a6501-2e81-4b95-8ff4-3248505b0759 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:55.365846 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b41a6501-2e81-4b95-8ff4-3248505b0759 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:55.608298 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b41a6501-2e81-4b95-8ff4-3248505b0759 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:55.629530 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b41a6501-2e81-4b95-8ff4-3248505b0759 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1661 microversion: 2.1 time: 0.281360 Jul 18 02:59:55.632052 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2841/5692] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:55 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1661 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:59:55.681750 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d438abe7-1208-405c-a05e-b5a83ab40866 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:59:55.684571 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d438abe7-1208-405c-a05e-b5a83ab40866 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:55.698299 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d438abe7-1208-405c-a05e-b5a83ab40866 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:55.699738 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d438abe7-1208-405c-a05e-b5a83ab40866 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:55.701408 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d438abe7-1208-405c-a05e-b5a83ab40866 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:55.704014 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d438abe7-1208-405c-a05e-b5a83ab40866 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:55.798308 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:59:55.848647 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d438abe7-1208-405c-a05e-b5a83ab40866 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "POST /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e/action" status: 202 len: 0 microversion: 2.1 time: 0.177235 Jul 18 02:59:55.853077 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2852/5693] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 02:59:55 2022] POST /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:59:55.862133 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5b01ba8d-7801-4e94-96ee-ce95ed05ebce tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:55.863522 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5b01ba8d-7801-4e94-96ee-ce95ed05ebce tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:55.894082 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5b01ba8d-7801-4e94-96ee-ce95ed05ebce tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:55.894771 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5b01ba8d-7801-4e94-96ee-ce95ed05ebce tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:55.895938 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5b01ba8d-7801-4e94-96ee-ce95ed05ebce tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:55.896584 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5b01ba8d-7801-4e94-96ee-ce95ed05ebce tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:56.160606 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dc89fabe-ceee-4fb1-b7d2-fbc2904788d0 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:56.161995 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-dc89fabe-ceee-4fb1-b7d2-fbc2904788d0 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] [instance: 22fc38b2-8b4c-48cb-b47e-986650123898] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:56.175998 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dc89fabe-ceee-4fb1-b7d2-fbc2904788d0 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:56.176568 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dc89fabe-ceee-4fb1-b7d2-fbc2904788d0 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:56.177825 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dc89fabe-ceee-4fb1-b7d2-fbc2904788d0 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:56.178712 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dc89fabe-ceee-4fb1-b7d2-fbc2904788d0 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:56.226598 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-dc89fabe-ceee-4fb1-b7d2-fbc2904788d0 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] HTTP exception thrown: Instance 22fc38b2-8b4c-48cb-b47e-986650123898 could not be found. Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dc89fabe-ceee-4fb1-b7d2-fbc2904788d0 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Request method failure captured: Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/22fc38b2-8b4c-48cb-b47e-986650123898 HTTP/1.1 Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MyOSleaCejTAFDeOYvPCIx2zUSVrO3TH6KLCDYGk3WOM3D2760VniZgWNnKVzRfpV29LD1uVcoXEU1B1mthR0guILtTOmYq90sx0H_J2WnN60oBCFw-UgoZaXkVDNbH2ZmA2J9qWMYyBfYAhyx4W3Y4aXWSG74Uu6RYWsavswCSGC8 Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 5555f4f3291040b7ae2fed82ca9df793 Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-VolumesActionsTest-1346663539 Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5555f4f3291040b7ae2fed82ca9df793"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5555f4f3291040b7ae2fed82ca9df793"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5555f4f3291040b7ae2fed82ca9df793"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5555f4f3291040b7ae2fed82ca9df793"}]}] Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-VolumesActionsTest-1346663539 Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 5555f4f3291040b7ae2fed82ca9df793 Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-VolumesActionsTest-1346663539 Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-VolumesActionsTest-1346663539-project Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 1b9dddc0cfa946d78f06ab7db1f11929 Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-VolumesActionsTest-1346663539-project Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 22fc38b2-8b4c-48cb-b47e-986650123898 could not be found. Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '22fc38b2-8b4c-48cb-b47e-986650123898'} Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22fc38b2-8b4c-48cb-b47e-986650123898 could not be found. Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22fc38b2-8b4c-48cb-b47e-986650123898 could not be found. Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:59:56.229799 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:59:56.234772 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:59:56.234772 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:59:56.234772 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:59:56.234772 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:59:56.234772 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:59:56.234772 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22fc38b2-8b4c-48cb-b47e-986650123898 could not be found. Jul 18 02:59:56.234772 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 02:59:56.235329 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dc89fabe-ceee-4fb1-b7d2-fbc2904788d0 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Returning 404 to user: Instance 22fc38b2-8b4c-48cb-b47e-986650123898 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:59:56.237990 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-dc89fabe-ceee-4fb1-b7d2-fbc2904788d0 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] 10.222.0.57 "GET /compute/v2.1/servers/22fc38b2-8b4c-48cb-b47e-986650123898" status: 404 len: 111 microversion: 2.1 time: 0.090356 Jul 18 02:59:56.237990 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2853/5694] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:56 2022] GET /compute/v2.1/servers/22fc38b2-8b4c-48cb-b47e-986650123898 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:59:56.280702 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5b01ba8d-7801-4e94-96ee-ce95ed05ebce tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:56.309475 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5b01ba8d-7801-4e94-96ee-ce95ed05ebce tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1667 microversion: 2.1 time: 0.454572 Jul 18 02:59:56.310986 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2842/5695] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:55 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1667 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:59:56.511240 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e382436b-502e-4895-94fc-8ceb43bbf0a2 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1501068589", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "6fd2ecaf-75a9-4d78-8487-2ca1637a728d"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:59:56.673421 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-e382436b-502e-4895-94fc-8ceb43bbf0a2 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] validate_networks() for [('6fd2ecaf-75a9-4d78-8487-2ca1637a728d', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:59:57.348353 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9e63acca-8e11-444d-b038-772df929e1c8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:57.349508 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9e63acca-8e11-444d-b038-772df929e1c8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:57.375790 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9e63acca-8e11-444d-b038-772df929e1c8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:57.377570 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9e63acca-8e11-444d-b038-772df929e1c8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:57.382307 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9e63acca-8e11-444d-b038-772df929e1c8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:57.386311 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9e63acca-8e11-444d-b038-772df929e1c8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:58.062219 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9e63acca-8e11-444d-b038-772df929e1c8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:58.078068 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9e63acca-8e11-444d-b038-772df929e1c8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1667 microversion: 2.1 time: 0.736984 Jul 18 02:59:58.079129 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2843/5696] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:57 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1667 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:58.142344 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-e382436b-502e-4895-94fc-8ceb43bbf0a2 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:59:58.143559 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-e382436b-502e-4895-94fc-8ceb43bbf0a2 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:59:58.145170 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-e382436b-502e-4895-94fc-8ceb43bbf0a2 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:59:58.146723 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-e382436b-502e-4895-94fc-8ceb43bbf0a2 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:59:58.147818 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-e382436b-502e-4895-94fc-8ceb43bbf0a2 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:59:58.178429 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e382436b-502e-4895-94fc-8ceb43bbf0a2 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:58.179872 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e382436b-502e-4895-94fc-8ceb43bbf0a2 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:58.181780 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e382436b-502e-4895-94fc-8ceb43bbf0a2 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:58.186677 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e382436b-502e-4895-94fc-8ceb43bbf0a2 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:58.220797 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-e382436b-502e-4895-94fc-8ceb43bbf0a2 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Getting quotas for project 5555f4f3291040b7ae2fed82ca9df793. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:59:58.230346 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-e382436b-502e-4895-94fc-8ceb43bbf0a2 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Getting quotas for user 1b9dddc0cfa946d78f06ab7db1f11929 and project 5555f4f3291040b7ae2fed82ca9df793. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:59:58.254417 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e382436b-502e-4895-94fc-8ceb43bbf0a2 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:59:58.257679 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e382436b-502e-4895-94fc-8ceb43bbf0a2 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] [instance: c9cb90ab-3e8b-4950-ba73-0fe68d737603] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:59:58.332272 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e382436b-502e-4895-94fc-8ceb43bbf0a2 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.832751 Jul 18 02:59:58.333800 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2854/5697] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 02:59:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 02:59:58.353547 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d7638701-4c26-430c-a975-4e4d1e156111 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:58.354530 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d7638701-4c26-430c-a975-4e4d1e156111 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] [instance: c9cb90ab-3e8b-4950-ba73-0fe68d737603] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:58.470848 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d7638701-4c26-430c-a975-4e4d1e156111 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dddc0cfa946d78f06ab7db1f11929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5555f4f3291040b7ae2fed82ca9df793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:58.504067 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d7638701-4c26-430c-a975-4e4d1e156111 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] 10.222.0.57 "GET /compute/v2.1/servers/c9cb90ab-3e8b-4950-ba73-0fe68d737603" status: 200 len: 1214 microversion: 2.1 time: 0.162570 Jul 18 02:59:58.519708 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2844/5698] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:58 2022] GET /compute/v2.1/servers/c9cb90ab-3e8b-4950-ba73-0fe68d737603 => generated 1214 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:59.112271 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-58a41238-157c-4d97-8ddc-ee9cfe27ca8b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:59.113347 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-58a41238-157c-4d97-8ddc-ee9cfe27ca8b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:59.123473 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-58a41238-157c-4d97-8ddc-ee9cfe27ca8b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:59.124198 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-58a41238-157c-4d97-8ddc-ee9cfe27ca8b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:59.125422 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-58a41238-157c-4d97-8ddc-ee9cfe27ca8b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:59.126161 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-58a41238-157c-4d97-8ddc-ee9cfe27ca8b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:59.340207 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-58a41238-157c-4d97-8ddc-ee9cfe27ca8b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:59.349919 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-58a41238-157c-4d97-8ddc-ee9cfe27ca8b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 0.242058 Jul 18 02:59:59.351096 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2855/5699] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:59 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:59.374539 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b3890e35-0a75-468f-bca1-9375f33653ff tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:59.376170 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b3890e35-0a75-468f-bca1-9375f33653ff tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:59.386746 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b3890e35-0a75-468f-bca1-9375f33653ff tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:59.387648 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b3890e35-0a75-468f-bca1-9375f33653ff tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:59.388752 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b3890e35-0a75-468f-bca1-9375f33653ff tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:59.389653 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b3890e35-0a75-468f-bca1-9375f33653ff tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:59.544980 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d6c2abad-9db9-417d-9436-9cf67dc59c62 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:59.546974 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d6c2abad-9db9-417d-9436-9cf67dc59c62 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] [instance: c9cb90ab-3e8b-4950-ba73-0fe68d737603] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:59.560871 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d6c2abad-9db9-417d-9436-9cf67dc59c62 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:59.562211 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d6c2abad-9db9-417d-9436-9cf67dc59c62 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:59.564507 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d6c2abad-9db9-417d-9436-9cf67dc59c62 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:59.566068 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d6c2abad-9db9-417d-9436-9cf67dc59c62 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:59.648121 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b3890e35-0a75-468f-bca1-9375f33653ff tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:59.659616 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b3890e35-0a75-468f-bca1-9375f33653ff tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1670 microversion: 2.1 time: 0.289151 Jul 18 02:59:59.660302 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2845/5700] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:59 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1670 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:59:59.689273 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-979b3cc6-d47e-4683-a0f9-f37e534e80f0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:59.690600 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-979b3cc6-d47e-4683-a0f9-f37e534e80f0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:59.704260 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-979b3cc6-d47e-4683-a0f9-f37e534e80f0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:59.707694 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-979b3cc6-d47e-4683-a0f9-f37e534e80f0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:59.709524 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-979b3cc6-d47e-4683-a0f9-f37e534e80f0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:59.712834 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-979b3cc6-d47e-4683-a0f9-f37e534e80f0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:59.736664 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d6c2abad-9db9-417d-9436-9cf67dc59c62 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dddc0cfa946d78f06ab7db1f11929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5555f4f3291040b7ae2fed82ca9df793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:59.779680 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d6c2abad-9db9-417d-9436-9cf67dc59c62 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] 10.222.0.57 "GET /compute/v2.1/servers/c9cb90ab-3e8b-4950-ba73-0fe68d737603" status: 200 len: 1266 microversion: 2.1 time: 0.250932 Jul 18 02:59:59.781246 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2856/5701] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:59 2022] GET /compute/v2.1/servers/c9cb90ab-3e8b-4950-ba73-0fe68d737603 => generated 1266 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:59.819792 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-979b3cc6-d47e-4683-a0f9-f37e534e80f0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:59:59.835113 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.compute.api [None req-979b3cc6-d47e-4683-a0f9-f37e534e80f0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Working on deleting snapshot bfd9bd2c-0a14-4df4-9906-0b130a0c6a82 from shelved instance... Jul 18 03:00:00.801728 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a34515ec-7ae3-4bdd-9d04-57addef648c2 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:00.807091 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a34515ec-7ae3-4bdd-9d04-57addef648c2 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] [instance: c9cb90ab-3e8b-4950-ba73-0fe68d737603] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:00.824751 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a34515ec-7ae3-4bdd-9d04-57addef648c2 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:00.825300 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a34515ec-7ae3-4bdd-9d04-57addef648c2 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:00.826186 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a34515ec-7ae3-4bdd-9d04-57addef648c2 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:00.826696 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a34515ec-7ae3-4bdd-9d04-57addef648c2 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:00.939472 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a34515ec-7ae3-4bdd-9d04-57addef648c2 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dddc0cfa946d78f06ab7db1f11929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5555f4f3291040b7ae2fed82ca9df793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:00.964702 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a34515ec-7ae3-4bdd-9d04-57addef648c2 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] 10.222.0.57 "GET /compute/v2.1/servers/c9cb90ab-3e8b-4950-ba73-0fe68d737603" status: 200 len: 1272 microversion: 2.1 time: 0.167981 Jul 18 03:00:00.966116 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2857/5702] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:00 2022] GET /compute/v2.1/servers/c9cb90ab-3e8b-4950-ba73-0fe68d737603 => generated 1272 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:01.606995 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-979b3cc6-d47e-4683-a0f9-f37e534e80f0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Doing local delete in cell 2a4b42c4-bf71-4fae-804a-3632602c55fa(cell1) {{(pid=119544) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 18 03:00:01.608710 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-979b3cc6-d47e-4683-a0f9-f37e534e80f0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:01.609167 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-979b3cc6-d47e-4683-a0f9-f37e534e80f0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:01.609596 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.compute.api [None req-979b3cc6-d47e-4683-a0f9-f37e534e80f0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 18 03:00:01.614012 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-979b3cc6-d47e-4683-a0f9-f37e534e80f0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] deallocate_for_instance() {{(pid=119544) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 18 03:00:02.005260 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-702ac0ca-229e-416b-a6ed-03b129c86c40 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:02.007570 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-702ac0ca-229e-416b-a6ed-03b129c86c40 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] [instance: c9cb90ab-3e8b-4950-ba73-0fe68d737603] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:02.026998 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-702ac0ca-229e-416b-a6ed-03b129c86c40 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:02.027915 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-702ac0ca-229e-416b-a6ed-03b129c86c40 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:02.029668 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-702ac0ca-229e-416b-a6ed-03b129c86c40 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:02.031972 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-702ac0ca-229e-416b-a6ed-03b129c86c40 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:02.431514 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-702ac0ca-229e-416b-a6ed-03b129c86c40 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dddc0cfa946d78f06ab7db1f11929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5555f4f3291040b7ae2fed82ca9df793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:02.487682 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-702ac0ca-229e-416b-a6ed-03b129c86c40 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] 10.222.0.57 "GET /compute/v2.1/servers/c9cb90ab-3e8b-4950-ba73-0fe68d737603" status: 200 len: 1314 microversion: 2.1 time: 0.489275 Jul 18 03:00:02.499050 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2858/5703] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:01 2022] GET /compute/v2.1/servers/c9cb90ab-3e8b-4950-ba73-0fe68d737603 => generated 1314 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:02.743288 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-979b3cc6-d47e-4683-a0f9-f37e534e80f0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Updating instance_info_cache with network_info: [] {{(pid=119544) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 18 03:00:03.113602 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-fb5d60d3-67e9-4c40-9a94-b767a39c742f req-4a5fb219-4a5b-4c1c-880c-d934a4cf8c78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20c7c630-5739-487b-97c9-463a8de621a3", "name": "network-vif-deleted", "tag": "51e95f27-927b-4956-b785-097434c3f4c0"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:00:03.191746 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-fb5d60d3-67e9-4c40-9a94-b767a39c742f req-4a5fb219-4a5b-4c1c-880c-d934a4cf8c78 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:03.192665 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-fb5d60d3-67e9-4c40-9a94-b767a39c742f req-4a5fb219-4a5b-4c1c-880c-d934a4cf8c78 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:03.225539 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.compute.server_external_events [req-fb5d60d3-67e9-4c40-9a94-b767a39c742f req-4a5fb219-4a5b-4c1c-880c-d934a4cf8c78 service nova] Unable to find a host for instance 20c7c630-5739-487b-97c9-463a8de621a3. Dropping event network-vif-deleted {{(pid=119543) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 18 03:00:03.227599 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-fb5d60d3-67e9-4c40-9a94-b767a39c742f req-4a5fb219-4a5b-4c1c-880c-d934a4cf8c78 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.503155 Jul 18 03:00:03.230037 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2859/5704] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 507 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 18 03:00:03.340959 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=8,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:00:03.447989 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-2260535d-e536-42fe-b4e2-574e85d181ee req-b6e36517-1467-43db-8855-12a1de323639 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9cb90ab-3e8b-4950-ba73-0fe68d737603", "tag": "2c0a91fe-fbb7-4b29-b828-c90bcac0188b"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:00:03.458612 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-2260535d-e536-42fe-b4e2-574e85d181ee req-b6e36517-1467-43db-8855-12a1de323639 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:03.460844 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-2260535d-e536-42fe-b4e2-574e85d181ee req-b6e36517-1467-43db-8855-12a1de323639 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:03.481798 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-2260535d-e536-42fe-b4e2-574e85d181ee req-b6e36517-1467-43db-8855-12a1de323639 service nova] Creating event network-changed:2c0a91fe-fbb7-4b29-b828-c90bcac0188b for instance c9cb90ab-3e8b-4950-ba73-0fe68d737603 on n-h1-465891-3 Jul 18 03:00:03.489243 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-2260535d-e536-42fe-b4e2-574e85d181ee req-b6e36517-1467-43db-8855-12a1de323639 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.256213 Jul 18 03:00:03.490664 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2860/5705] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:00:03.518418 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ff3e35c4-a041-405f-a5d0-ca89892bef39 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:03.519378 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ff3e35c4-a041-405f-a5d0-ca89892bef39 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] [instance: c9cb90ab-3e8b-4950-ba73-0fe68d737603] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:03.528633 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ff3e35c4-a041-405f-a5d0-ca89892bef39 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:03.529599 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ff3e35c4-a041-405f-a5d0-ca89892bef39 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:03.530936 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ff3e35c4-a041-405f-a5d0-ca89892bef39 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:03.531697 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ff3e35c4-a041-405f-a5d0-ca89892bef39 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:03.590096 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-979b3cc6-d47e-4683-a0f9-f37e534e80f0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "DELETE /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3" status: 204 len: 0 microversion: 2.1 time: 3.905231 Jul 18 03:00:03.594440 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2846/5706] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 02:59:59 2022] DELETE /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 => generated 0 bytes in 3907 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 03:00:03.600044 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-335da241-2515-4eaa-b88a-aa99465ff63b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:03.600964 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-335da241-2515-4eaa-b88a-aa99465ff63b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 20c7c630-5739-487b-97c9-463a8de621a3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:03.610108 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-335da241-2515-4eaa-b88a-aa99465ff63b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:03.610936 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-335da241-2515-4eaa-b88a-aa99465ff63b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:03.612120 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-335da241-2515-4eaa-b88a-aa99465ff63b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:03.614122 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-335da241-2515-4eaa-b88a-aa99465ff63b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:03.635794 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-335da241-2515-4eaa-b88a-aa99465ff63b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] HTTP exception thrown: Instance 20c7c630-5739-487b-97c9-463a8de621a3 could not be found. Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-335da241-2515-4eaa-b88a-aa99465ff63b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Request method failure captured: Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 HTTP/1.1 Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MpeZE7B7ggvWbQc2KiBuopHOJluqoroptHlmwrPNlRr2pt2Zu9Zwj_7Rf-ScE247-3qWDi_Gg8bo3Zzw0u3dgabI_jJCHXJML47lEbY3Hw73qGCrAE6a4fhUVxpzDxEDfhuI00pvfMbi7vIE86eHDCb3ZROxEb6oUuXthyU9kKumbk Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 2ed8b12429e9420bb83700e52701910b Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServerActionsTestJSON-125209500 Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2ed8b12429e9420bb83700e52701910b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2ed8b12429e9420bb83700e52701910b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2ed8b12429e9420bb83700e52701910b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2ed8b12429e9420bb83700e52701910b"}]}] Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServerActionsTestJSON-125209500 Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 2ed8b12429e9420bb83700e52701910b Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServerActionsTestJSON-125209500 Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServerActionsTestJSON-125209500-project Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 5436715af849460f87ff6b62dbd491a0 Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServerActionsTestJSON-125209500-project Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 20c7c630-5739-487b-97c9-463a8de621a3 could not be found. Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '20c7c630-5739-487b-97c9-463a8de621a3'} Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20c7c630-5739-487b-97c9-463a8de621a3 could not be found. Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20c7c630-5739-487b-97c9-463a8de621a3 could not be found. Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:00:03.638177 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:00:03.642913 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:00:03.642913 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:00:03.642913 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:00:03.642913 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:00:03.642913 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:00:03.642913 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20c7c630-5739-487b-97c9-463a8de621a3 could not be found. Jul 18 03:00:03.642913 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:00:03.644697 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-335da241-2515-4eaa-b88a-aa99465ff63b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Returning 404 to user: Instance 20c7c630-5739-487b-97c9-463a8de621a3 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:00:03.645800 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-335da241-2515-4eaa-b88a-aa99465ff63b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3" status: 404 len: 111 microversion: 2.1 time: 0.050011 Jul 18 03:00:03.646589 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2847/5707] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:03 2022] GET /compute/v2.1/servers/20c7c630-5739-487b-97c9-463a8de621a3 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:00:03.656266 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fd435a17-f94b-4d2e-abeb-489eeb8274fa tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:03.657119 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fd435a17-f94b-4d2e-abeb-489eeb8274fa tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 48651886-4cc5-4dee-97b4-53502b1045af] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:03.664419 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd435a17-f94b-4d2e-abeb-489eeb8274fa tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:03.665332 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd435a17-f94b-4d2e-abeb-489eeb8274fa tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:03.666558 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd435a17-f94b-4d2e-abeb-489eeb8274fa tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:03.667257 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd435a17-f94b-4d2e-abeb-489eeb8274fa tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:03.705852 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fd435a17-f94b-4d2e-abeb-489eeb8274fa tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 48651886-4cc5-4dee-97b4-53502b1045af] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:00:03.830982 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fd435a17-f94b-4d2e-abeb-489eeb8274fa tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "DELETE /compute/v2.1/servers/48651886-4cc5-4dee-97b4-53502b1045af" status: 204 len: 0 microversion: 2.1 time: 0.178888 Jul 18 03:00:03.831653 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2848/5708] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:00:03 2022] DELETE /compute/v2.1/servers/48651886-4cc5-4dee-97b4-53502b1045af => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 03:00:03.842369 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7abeed26-c4d4-4067-a4cf-72ac5fc5d774 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:03.843430 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7abeed26-c4d4-4067-a4cf-72ac5fc5d774 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 48651886-4cc5-4dee-97b4-53502b1045af] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:03.851779 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7abeed26-c4d4-4067-a4cf-72ac5fc5d774 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:03.852660 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7abeed26-c4d4-4067-a4cf-72ac5fc5d774 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:03.853587 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7abeed26-c4d4-4067-a4cf-72ac5fc5d774 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:03.854138 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7abeed26-c4d4-4067-a4cf-72ac5fc5d774 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:03.955396 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ff3e35c4-a041-405f-a5d0-ca89892bef39 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dddc0cfa946d78f06ab7db1f11929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5555f4f3291040b7ae2fed82ca9df793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:03.965882 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ff3e35c4-a041-405f-a5d0-ca89892bef39 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] 10.222.0.57 "GET /compute/v2.1/servers/c9cb90ab-3e8b-4950-ba73-0fe68d737603" status: 200 len: 1314 microversion: 2.1 time: 0.453539 Jul 18 03:00:03.966910 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2861/5709] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:03 2022] GET /compute/v2.1/servers/c9cb90ab-3e8b-4950-ba73-0fe68d737603 => generated 1314 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:00:04.035590 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7abeed26-c4d4-4067-a4cf-72ac5fc5d774 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:04.047236 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7abeed26-c4d4-4067-a4cf-72ac5fc5d774 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/48651886-4cc5-4dee-97b4-53502b1045af" status: 200 len: 1467 microversion: 2.1 time: 0.210297 Jul 18 03:00:04.058778 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2849/5710] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:03 2022] GET /compute/v2.1/servers/48651886-4cc5-4dee-97b4-53502b1045af => generated 1467 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:00:04.999138 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c091aa99-8168-4319-9ed2-a74164e9a345 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:05.005233 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c091aa99-8168-4319-9ed2-a74164e9a345 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] [instance: c9cb90ab-3e8b-4950-ba73-0fe68d737603] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:05.013723 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c091aa99-8168-4319-9ed2-a74164e9a345 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:05.014254 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c091aa99-8168-4319-9ed2-a74164e9a345 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:05.015278 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c091aa99-8168-4319-9ed2-a74164e9a345 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:05.015734 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c091aa99-8168-4319-9ed2-a74164e9a345 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:05.066184 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c83e5582-b55f-4f96-a8f0-c12f319c4172 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:05.066804 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c83e5582-b55f-4f96-a8f0-c12f319c4172 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 48651886-4cc5-4dee-97b4-53502b1045af] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:05.081637 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c83e5582-b55f-4f96-a8f0-c12f319c4172 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:05.082574 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c83e5582-b55f-4f96-a8f0-c12f319c4172 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:05.084599 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c83e5582-b55f-4f96-a8f0-c12f319c4172 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:05.085371 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c83e5582-b55f-4f96-a8f0-c12f319c4172 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:05.297800 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c83e5582-b55f-4f96-a8f0-c12f319c4172 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:05.306729 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c83e5582-b55f-4f96-a8f0-c12f319c4172 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/48651886-4cc5-4dee-97b4-53502b1045af" status: 200 len: 1467 microversion: 2.1 time: 0.245066 Jul 18 03:00:05.307722 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2850/5711] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:05 2022] GET /compute/v2.1/servers/48651886-4cc5-4dee-97b4-53502b1045af => generated 1467 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:00:05.367387 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c091aa99-8168-4319-9ed2-a74164e9a345 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dddc0cfa946d78f06ab7db1f11929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5555f4f3291040b7ae2fed82ca9df793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:05.377333 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c091aa99-8168-4319-9ed2-a74164e9a345 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] 10.222.0.57 "GET /compute/v2.1/servers/c9cb90ab-3e8b-4950-ba73-0fe68d737603" status: 200 len: 1314 microversion: 2.1 time: 0.387394 Jul 18 03:00:05.378320 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2862/5712] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:04 2022] GET /compute/v2.1/servers/c9cb90ab-3e8b-4950-ba73-0fe68d737603 => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:05.948202 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-84bc02d7-734f-4e73-a150-9f80ff38bdaa req-605efa03-7c66-4733-884e-85b0e2c8a3d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48651886-4cc5-4dee-97b4-53502b1045af", "name": "network-vif-deleted", "tag": "e1309925-70d7-4a8a-967d-ec03dd2490ef"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:00:05.974762 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-84bc02d7-734f-4e73-a150-9f80ff38bdaa req-605efa03-7c66-4733-884e-85b0e2c8a3d6 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:05.976079 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-84bc02d7-734f-4e73-a150-9f80ff38bdaa req-605efa03-7c66-4733-884e-85b0e2c8a3d6 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:05.997640 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-84bc02d7-734f-4e73-a150-9f80ff38bdaa req-605efa03-7c66-4733-884e-85b0e2c8a3d6 service nova] Creating event network-vif-deleted:e1309925-70d7-4a8a-967d-ec03dd2490ef for instance 48651886-4cc5-4dee-97b4-53502b1045af on n-h2-465891-3 Jul 18 03:00:06.003889 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-84bc02d7-734f-4e73-a150-9f80ff38bdaa req-605efa03-7c66-4733-884e-85b0e2c8a3d6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064027 Jul 18 03:00:06.005498 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2851/5713] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:00:06.328178 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b7bb25a0-e47e-4812-adfe-1f307ccc2990 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:06.329095 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b7bb25a0-e47e-4812-adfe-1f307ccc2990 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 48651886-4cc5-4dee-97b4-53502b1045af] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:06.337917 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b7bb25a0-e47e-4812-adfe-1f307ccc2990 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:06.339125 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b7bb25a0-e47e-4812-adfe-1f307ccc2990 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:06.339424 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b7bb25a0-e47e-4812-adfe-1f307ccc2990 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:06.339653 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b7bb25a0-e47e-4812-adfe-1f307ccc2990 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:06.400838 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b7bb25a0-e47e-4812-adfe-1f307ccc2990 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:06.401968 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b7bb25a0-e47e-4812-adfe-1f307ccc2990 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:06.402679 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-b7bb25a0-e47e-4812-adfe-1f307ccc2990 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lazy-loading 'fault' on Instance uuid 48651886-4cc5-4dee-97b4-53502b1045af {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:00:06.407457 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4f179d1f-193d-4e4f-919a-960d5d687685 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:06.408707 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4f179d1f-193d-4e4f-919a-960d5d687685 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] [instance: c9cb90ab-3e8b-4950-ba73-0fe68d737603] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:06.437462 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4f179d1f-193d-4e4f-919a-960d5d687685 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:06.439990 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4f179d1f-193d-4e4f-919a-960d5d687685 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:06.441549 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4f179d1f-193d-4e4f-919a-960d5d687685 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:06.442335 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4f179d1f-193d-4e4f-919a-960d5d687685 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:06.501121 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b7bb25a0-e47e-4812-adfe-1f307ccc2990 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:06.518722 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b7bb25a0-e47e-4812-adfe-1f307ccc2990 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/48651886-4cc5-4dee-97b4-53502b1045af" status: 200 len: 1305 microversion: 2.1 time: 0.194084 Jul 18 03:00:06.520782 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2863/5714] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:06 2022] GET /compute/v2.1/servers/48651886-4cc5-4dee-97b4-53502b1045af => generated 1305 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:00:06.886568 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4f179d1f-193d-4e4f-919a-960d5d687685 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dddc0cfa946d78f06ab7db1f11929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5555f4f3291040b7ae2fed82ca9df793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:06.897356 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4f179d1f-193d-4e4f-919a-960d5d687685 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] 10.222.0.57 "GET /compute/v2.1/servers/c9cb90ab-3e8b-4950-ba73-0fe68d737603" status: 200 len: 1314 microversion: 2.1 time: 0.501958 Jul 18 03:00:06.899658 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2852/5715] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:06 2022] GET /compute/v2.1/servers/c9cb90ab-3e8b-4950-ba73-0fe68d737603 => generated 1314 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:07.546026 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-465edba2-7887-4dfc-99af-d49957e3b38a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:07.547515 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-465edba2-7887-4dfc-99af-d49957e3b38a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 48651886-4cc5-4dee-97b4-53502b1045af] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:07.558460 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-465edba2-7887-4dfc-99af-d49957e3b38a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:07.559329 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-465edba2-7887-4dfc-99af-d49957e3b38a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:07.560386 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-465edba2-7887-4dfc-99af-d49957e3b38a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:07.561158 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-465edba2-7887-4dfc-99af-d49957e3b38a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:07.590340 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-465edba2-7887-4dfc-99af-d49957e3b38a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] HTTP exception thrown: Instance 48651886-4cc5-4dee-97b4-53502b1045af could not be found. Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-465edba2-7887-4dfc-99af-d49957e3b38a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Request method failure captured: Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/48651886-4cc5-4dee-97b4-53502b1045af HTTP/1.1 Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MpeZE7B7ggvWbQc2KiBuopHOJluqoroptHlmwrPNlRr2pt2Zu9Zwj_7Rf-ScE247-3qWDi_Gg8bo3Zzw0u3dgabI_jJCHXJML47lEbY3Hw73qGCrAE6a4fhUVxpzDxEDfhuI00pvfMbi7vIE86eHDCb3ZROxEb6oUuXthyU9kKumbk Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 2ed8b12429e9420bb83700e52701910b Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServerActionsTestJSON-125209500 Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2ed8b12429e9420bb83700e52701910b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2ed8b12429e9420bb83700e52701910b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2ed8b12429e9420bb83700e52701910b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2ed8b12429e9420bb83700e52701910b"}]}] Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServerActionsTestJSON-125209500 Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 2ed8b12429e9420bb83700e52701910b Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServerActionsTestJSON-125209500 Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServerActionsTestJSON-125209500-project Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 5436715af849460f87ff6b62dbd491a0 Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServerActionsTestJSON-125209500-project Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 48651886-4cc5-4dee-97b4-53502b1045af could not be found. Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '48651886-4cc5-4dee-97b4-53502b1045af'} Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48651886-4cc5-4dee-97b4-53502b1045af could not be found. Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48651886-4cc5-4dee-97b4-53502b1045af could not be found. Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:00:07.594160 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:00:07.604032 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:00:07.604032 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:00:07.604032 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:00:07.604032 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:00:07.604032 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:00:07.604032 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48651886-4cc5-4dee-97b4-53502b1045af could not be found. Jul 18 03:00:07.604032 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:00:07.604032 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-465edba2-7887-4dfc-99af-d49957e3b38a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Returning 404 to user: Instance 48651886-4cc5-4dee-97b4-53502b1045af could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:00:07.604032 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-465edba2-7887-4dfc-99af-d49957e3b38a tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/48651886-4cc5-4dee-97b4-53502b1045af" status: 404 len: 111 microversion: 2.1 time: 0.056438 Jul 18 03:00:07.604032 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2864/5716] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:07 2022] GET /compute/v2.1/servers/48651886-4cc5-4dee-97b4-53502b1045af => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 03:00:07.608508 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fd04bca1-011d-43b4-9142-206464cc331c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:07.609335 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fd04bca1-011d-43b4-9142-206464cc331c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 9f08d81f-1881-47f2-834e-9d0a3ac31108] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:07.620085 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd04bca1-011d-43b4-9142-206464cc331c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:07.620526 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd04bca1-011d-43b4-9142-206464cc331c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:07.621515 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd04bca1-011d-43b4-9142-206464cc331c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:07.621978 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fd04bca1-011d-43b4-9142-206464cc331c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:07.659969 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fd04bca1-011d-43b4-9142-206464cc331c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 9f08d81f-1881-47f2-834e-9d0a3ac31108] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:00:07.784853 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fd04bca1-011d-43b4-9142-206464cc331c tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108" status: 204 len: 0 microversion: 2.1 time: 0.180348 Jul 18 03:00:07.786535 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2853/5717] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:00:07 2022] DELETE /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 03:00:07.923476 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cc8760c1-a54d-4f09-a9ae-fd81ed9f2422 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:07.925420 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cc8760c1-a54d-4f09-a9ae-fd81ed9f2422 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] [instance: c9cb90ab-3e8b-4950-ba73-0fe68d737603] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:07.941639 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cc8760c1-a54d-4f09-a9ae-fd81ed9f2422 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:07.942834 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cc8760c1-a54d-4f09-a9ae-fd81ed9f2422 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:07.944177 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cc8760c1-a54d-4f09-a9ae-fd81ed9f2422 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:07.944814 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cc8760c1-a54d-4f09-a9ae-fd81ed9f2422 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:08.109669 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b2ae2ff5-4a51-4462-bf94-cb48d9e4645f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:08.115386 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b2ae2ff5-4a51-4462-bf94-cb48d9e4645f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 9f08d81f-1881-47f2-834e-9d0a3ac31108] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:08.145738 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b2ae2ff5-4a51-4462-bf94-cb48d9e4645f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:08.148548 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b2ae2ff5-4a51-4462-bf94-cb48d9e4645f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:08.150372 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-cc8760c1-a54d-4f09-a9ae-fd81ed9f2422 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dddc0cfa946d78f06ab7db1f11929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5555f4f3291040b7ae2fed82ca9df793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:08.156937 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b2ae2ff5-4a51-4462-bf94-cb48d9e4645f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:08.158197 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b2ae2ff5-4a51-4462-bf94-cb48d9e4645f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:08.160598 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cc8760c1-a54d-4f09-a9ae-fd81ed9f2422 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] 10.222.0.57 "GET /compute/v2.1/servers/c9cb90ab-3e8b-4950-ba73-0fe68d737603" status: 200 len: 1314 microversion: 2.1 time: 0.247460 Jul 18 03:00:08.178585 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2854/5718] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:07 2022] GET /compute/v2.1/servers/c9cb90ab-3e8b-4950-ba73-0fe68d737603 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:08.224786 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:00:08.240852 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:00:08.495218 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b2ae2ff5-4a51-4462-bf94-cb48d9e4645f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:08.526590 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b2ae2ff5-4a51-4462-bf94-cb48d9e4645f tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108" status: 200 len: 1507 microversion: 2.1 time: 0.729211 Jul 18 03:00:08.528050 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2865/5719] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:07 2022] GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108 => generated 1507 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:00:09.188215 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e665635b-c562-4ecd-9b54-df40f9150ade tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:09.188850 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e665635b-c562-4ecd-9b54-df40f9150ade tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] [instance: c9cb90ab-3e8b-4950-ba73-0fe68d737603] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:09.191048 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:00:09.199327 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e665635b-c562-4ecd-9b54-df40f9150ade tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:09.200095 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e665635b-c562-4ecd-9b54-df40f9150ade tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:09.201385 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e665635b-c562-4ecd-9b54-df40f9150ade tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:09.201981 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e665635b-c562-4ecd-9b54-df40f9150ade tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:09.405342 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e665635b-c562-4ecd-9b54-df40f9150ade tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dddc0cfa946d78f06ab7db1f11929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5555f4f3291040b7ae2fed82ca9df793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:09.415237 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e665635b-c562-4ecd-9b54-df40f9150ade tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] 10.222.0.57 "GET /compute/v2.1/servers/c9cb90ab-3e8b-4950-ba73-0fe68d737603" status: 200 len: 1314 microversion: 2.1 time: 0.231256 Jul 18 03:00:09.416001 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2855/5720] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:09 2022] GET /compute/v2.1/servers/c9cb90ab-3e8b-4950-ba73-0fe68d737603 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:09.553855 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-88b86937-435c-42df-a5bf-4e711e7d1847 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:09.554567 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-88b86937-435c-42df-a5bf-4e711e7d1847 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 9f08d81f-1881-47f2-834e-9d0a3ac31108] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:09.564046 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-88b86937-435c-42df-a5bf-4e711e7d1847 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:09.564517 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-88b86937-435c-42df-a5bf-4e711e7d1847 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:09.565339 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-88b86937-435c-42df-a5bf-4e711e7d1847 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:09.565832 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-88b86937-435c-42df-a5bf-4e711e7d1847 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:09.767745 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-88b86937-435c-42df-a5bf-4e711e7d1847 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:09.807442 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-88b86937-435c-42df-a5bf-4e711e7d1847 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108" status: 200 len: 1507 microversion: 2.1 time: 0.255379 Jul 18 03:00:09.813428 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2866/5721] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:09 2022] GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108 => generated 1507 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:10.201634 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-0f86b61f-cd91-47ce-b8a7-cba729eec3dd req-c17602ec-c779-4e47-855c-c1c54e6bd824 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9cb90ab-3e8b-4950-ba73-0fe68d737603", "name": "network-vif-plugged", "status": "completed", "tag": "2c0a91fe-fbb7-4b29-b828-c90bcac0188b"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:00:10.224527 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-0f86b61f-cd91-47ce-b8a7-cba729eec3dd req-c17602ec-c779-4e47-855c-c1c54e6bd824 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:10.230444 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-0f86b61f-cd91-47ce-b8a7-cba729eec3dd req-c17602ec-c779-4e47-855c-c1c54e6bd824 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:10.257422 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-0f86b61f-cd91-47ce-b8a7-cba729eec3dd req-c17602ec-c779-4e47-855c-c1c54e6bd824 service nova] Creating event network-vif-plugged:2c0a91fe-fbb7-4b29-b828-c90bcac0188b for instance c9cb90ab-3e8b-4950-ba73-0fe68d737603 on n-h1-465891-3 Jul 18 03:00:10.265282 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-0f86b61f-cd91-47ce-b8a7-cba729eec3dd req-c17602ec-c779-4e47-855c-c1c54e6bd824 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074251 Jul 18 03:00:10.270299 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2856/5722] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:00:10.445134 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-df9aeb63-78b9-4ebc-b9ef-443f6351f3ad tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:10.448486 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-df9aeb63-78b9-4ebc-b9ef-443f6351f3ad tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] [instance: c9cb90ab-3e8b-4950-ba73-0fe68d737603] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:10.501852 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:00:10.510093 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-df9aeb63-78b9-4ebc-b9ef-443f6351f3ad tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:10.513285 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-df9aeb63-78b9-4ebc-b9ef-443f6351f3ad tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:10.517056 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-df9aeb63-78b9-4ebc-b9ef-443f6351f3ad tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:10.520672 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-df9aeb63-78b9-4ebc-b9ef-443f6351f3ad tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:10.610895 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-61e3ceaa-1319-4f52-a198-77fe9e5e0142 req-f9d6bc30-fa80-435b-ba95-097a2124991d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f08d81f-1881-47f2-834e-9d0a3ac31108", "name": "network-vif-deleted", "tag": "67c0ab1b-2d45-48d8-9ff0-ef2953355592"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:00:10.642995 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-61e3ceaa-1319-4f52-a198-77fe9e5e0142 req-f9d6bc30-fa80-435b-ba95-097a2124991d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:10.644875 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-61e3ceaa-1319-4f52-a198-77fe9e5e0142 req-f9d6bc30-fa80-435b-ba95-097a2124991d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:10.665567 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-61e3ceaa-1319-4f52-a198-77fe9e5e0142 req-f9d6bc30-fa80-435b-ba95-097a2124991d service nova] Creating event network-vif-deleted:67c0ab1b-2d45-48d8-9ff0-ef2953355592 for instance 9f08d81f-1881-47f2-834e-9d0a3ac31108 on n-h1-465891-3 Jul 18 03:00:10.673932 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-61e3ceaa-1319-4f52-a198-77fe9e5e0142 req-f9d6bc30-fa80-435b-ba95-097a2124991d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068273 Jul 18 03:00:10.682297 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2857/5723] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:00:10.837745 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8e2b29e8-5527-4735-aee5-404646aa1563 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:10.838710 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8e2b29e8-5527-4735-aee5-404646aa1563 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 9f08d81f-1881-47f2-834e-9d0a3ac31108] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:10.871012 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8e2b29e8-5527-4735-aee5-404646aa1563 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:10.871518 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8e2b29e8-5527-4735-aee5-404646aa1563 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:10.872519 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8e2b29e8-5527-4735-aee5-404646aa1563 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:10.872919 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8e2b29e8-5527-4735-aee5-404646aa1563 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:10.885424 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-df9aeb63-78b9-4ebc-b9ef-443f6351f3ad tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dddc0cfa946d78f06ab7db1f11929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5555f4f3291040b7ae2fed82ca9df793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:10.907669 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-df9aeb63-78b9-4ebc-b9ef-443f6351f3ad tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] 10.222.0.57 "GET /compute/v2.1/servers/c9cb90ab-3e8b-4950-ba73-0fe68d737603" status: 200 len: 1314 microversion: 2.1 time: 0.475537 Jul 18 03:00:10.911732 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2867/5724] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:10 2022] GET /compute/v2.1/servers/c9cb90ab-3e8b-4950-ba73-0fe68d737603 => generated 1314 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:10.926173 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8e2b29e8-5527-4735-aee5-404646aa1563 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:10.926711 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8e2b29e8-5527-4735-aee5-404646aa1563 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:10.927195 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-8e2b29e8-5527-4735-aee5-404646aa1563 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lazy-loading 'fault' on Instance uuid 9f08d81f-1881-47f2-834e-9d0a3ac31108 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:00:11.001958 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8e2b29e8-5527-4735-aee5-404646aa1563 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:11.013278 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8e2b29e8-5527-4735-aee5-404646aa1563 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108" status: 200 len: 1303 microversion: 2.1 time: 0.181455 Jul 18 03:00:11.013983 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2858/5725] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:10 2022] GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108 => generated 1303 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:00:11.127648 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-68507119-d113-430e-ab57-6be3a2436c09 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Action: 'create', calling method: .version_select at 0x7ff49b639dc0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-733178941", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8WWk9fSokPombLHcGn6tTybqLFpOK+z7C3stG/UhnTjQhPfhrlJ2+zV0n2ZYsghzdwft/agP9K3tnsy/h+951COwlQWU8MfY8/typtknvFRIwUw+UvA+YsWzIAx1sMYQ=="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:00:11.172956 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-68507119-d113-430e-ab57-6be3a2436c09 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Getting quotas for project 07627ceb27f2492fbb741a241edb2c5c. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:00:11.194772 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-68507119-d113-430e-ab57-6be3a2436c09 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Getting quotas for user 88ef01d5252344a2bc2d36e13324a6b0 and project 07627ceb27f2492fbb741a241edb2c5c. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:00:11.252159 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-68507119-d113-430e-ab57-6be3a2436c09 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.136586 Jul 18 03:00:11.253288 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2868/5726] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 03:00:11 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:00:11.930937 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ba198285-a94b-461f-ad45-b135fe8c32fd tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:11.932465 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ba198285-a94b-461f-ad45-b135fe8c32fd tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] [instance: c9cb90ab-3e8b-4950-ba73-0fe68d737603] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:11.936643 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:00:11.945045 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba198285-a94b-461f-ad45-b135fe8c32fd tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:11.945836 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba198285-a94b-461f-ad45-b135fe8c32fd tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:11.946853 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba198285-a94b-461f-ad45-b135fe8c32fd tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:11.947295 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba198285-a94b-461f-ad45-b135fe8c32fd tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:12.058410 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-edab775e-00a5-4a5e-99de-d2049e65fed7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:12.074405 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-edab775e-00a5-4a5e-99de-d2049e65fed7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 9f08d81f-1881-47f2-834e-9d0a3ac31108] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:12.100041 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-edab775e-00a5-4a5e-99de-d2049e65fed7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:12.101025 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-edab775e-00a5-4a5e-99de-d2049e65fed7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:12.101410 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-edab775e-00a5-4a5e-99de-d2049e65fed7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:12.103520 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-edab775e-00a5-4a5e-99de-d2049e65fed7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:12.181489 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-edab775e-00a5-4a5e-99de-d2049e65fed7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:12.182161 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-edab775e-00a5-4a5e-99de-d2049e65fed7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:12.183205 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-edab775e-00a5-4a5e-99de-d2049e65fed7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lazy-loading 'fault' on Instance uuid 9f08d81f-1881-47f2-834e-9d0a3ac31108 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:00:12.317653 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-edab775e-00a5-4a5e-99de-d2049e65fed7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:12.334166 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-edab775e-00a5-4a5e-99de-d2049e65fed7 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108" status: 200 len: 1303 microversion: 2.1 time: 0.305530 Jul 18 03:00:12.336016 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2869/5727] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:12 2022] GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108 => generated 1303 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:12.396473 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ba198285-a94b-461f-ad45-b135fe8c32fd tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dddc0cfa946d78f06ab7db1f11929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5555f4f3291040b7ae2fed82ca9df793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:12.414121 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=13,nova_cell1:DELETE=2,nova_cell1:INSERT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:00:12.443859 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ba198285-a94b-461f-ad45-b135fe8c32fd tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] 10.222.0.57 "GET /compute/v2.1/servers/c9cb90ab-3e8b-4950-ba73-0fe68d737603" status: 200 len: 1314 microversion: 2.1 time: 0.518948 Jul 18 03:00:12.445024 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2859/5728] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:11 2022] GET /compute/v2.1/servers/c9cb90ab-3e8b-4950-ba73-0fe68d737603 => generated 1314 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:13.153954 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8d269526-ee70-459b-afed-2a805b0e9872 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1755779076", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "4ed9eb85-734d-498e-befe-f8a10ab4374a", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-733178941", "security_groups": [{"name": "tempest-secgroup-smoke-593213788"}], "networks": [{"uuid": "563f9249-c94f-4290-9ff7-66987e3b0233"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:00:13.299800 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-8d269526-ee70-459b-afed-2a805b0e9872 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] validate_networks() for [('563f9249-c94f-4290-9ff7-66987e3b0233', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:00:13.371029 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-73ae8491-b830-49bc-958e-0aa1f97e1a0d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:13.372096 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-73ae8491-b830-49bc-958e-0aa1f97e1a0d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 9f08d81f-1881-47f2-834e-9d0a3ac31108] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:13.404182 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-73ae8491-b830-49bc-958e-0aa1f97e1a0d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:13.405024 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-73ae8491-b830-49bc-958e-0aa1f97e1a0d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:13.406594 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-73ae8491-b830-49bc-958e-0aa1f97e1a0d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:13.407402 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-73ae8491-b830-49bc-958e-0aa1f97e1a0d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:13.472429 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-73ae8491-b830-49bc-958e-0aa1f97e1a0d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] HTTP exception thrown: Instance 9f08d81f-1881-47f2-834e-9d0a3ac31108 could not be found. Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-73ae8491-b830-49bc-958e-0aa1f97e1a0d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Request method failure captured: Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108 HTTP/1.1 Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MpeZE7B7ggvWbQc2KiBuopHOJluqoroptHlmwrPNlRr2pt2Zu9Zwj_7Rf-ScE247-3qWDi_Gg8bo3Zzw0u3dgabI_jJCHXJML47lEbY3Hw73qGCrAE6a4fhUVxpzDxEDfhuI00pvfMbi7vIE86eHDCb3ZROxEb6oUuXthyU9kKumbk Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 2ed8b12429e9420bb83700e52701910b Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServerActionsTestJSON-125209500 Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2ed8b12429e9420bb83700e52701910b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2ed8b12429e9420bb83700e52701910b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2ed8b12429e9420bb83700e52701910b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2ed8b12429e9420bb83700e52701910b"}]}] Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServerActionsTestJSON-125209500 Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 2ed8b12429e9420bb83700e52701910b Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServerActionsTestJSON-125209500 Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServerActionsTestJSON-125209500-project Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 5436715af849460f87ff6b62dbd491a0 Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServerActionsTestJSON-125209500-project Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 9f08d81f-1881-47f2-834e-9d0a3ac31108 could not be found. Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '9f08d81f-1881-47f2-834e-9d0a3ac31108'} Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f08d81f-1881-47f2-834e-9d0a3ac31108 could not be found. Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f08d81f-1881-47f2-834e-9d0a3ac31108 could not be found. Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:00:13.483722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:00:13.487616 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:00:13.487616 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:00:13.487616 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:00:13.487616 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:00:13.487616 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:00:13.487616 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f08d81f-1881-47f2-834e-9d0a3ac31108 could not be found. Jul 18 03:00:13.487616 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:00:13.490622 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-73ae8491-b830-49bc-958e-0aa1f97e1a0d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Returning 404 to user: Instance 9f08d81f-1881-47f2-834e-9d0a3ac31108 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:00:13.491922 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-73ae8491-b830-49bc-958e-0aa1f97e1a0d tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108" status: 404 len: 111 microversion: 2.1 time: 0.129307 Jul 18 03:00:13.493842 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2860/5729] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:13 2022] GET /compute/v2.1/servers/9f08d81f-1881-47f2-834e-9d0a3ac31108 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:00:13.499276 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-456abf2e-7324-4b9e-b5a5-1aa2cec31ed8 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:13.500973 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-456abf2e-7324-4b9e-b5a5-1aa2cec31ed8 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] [instance: c9cb90ab-3e8b-4950-ba73-0fe68d737603] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:13.508862 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-456abf2e-7324-4b9e-b5a5-1aa2cec31ed8 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:13.510334 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-456abf2e-7324-4b9e-b5a5-1aa2cec31ed8 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:13.511521 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-456abf2e-7324-4b9e-b5a5-1aa2cec31ed8 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:13.512217 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-456abf2e-7324-4b9e-b5a5-1aa2cec31ed8 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:13.917193 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-456abf2e-7324-4b9e-b5a5-1aa2cec31ed8 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dddc0cfa946d78f06ab7db1f11929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5555f4f3291040b7ae2fed82ca9df793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:13.941511 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-456abf2e-7324-4b9e-b5a5-1aa2cec31ed8 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] 10.222.0.57 "GET /compute/v2.1/servers/c9cb90ab-3e8b-4950-ba73-0fe68d737603" status: 200 len: 1499 microversion: 2.1 time: 0.445597 Jul 18 03:00:13.943681 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2861/5730] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:13 2022] GET /compute/v2.1/servers/c9cb90ab-3e8b-4950-ba73-0fe68d737603 => generated 1499 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:13.956873 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-12fb466c-4a22-48aa-a197-41bc7017aedf tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:13.962048 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-12fb466c-4a22-48aa-a197-41bc7017aedf tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: da73354f-bc9c-4fb2-8de1-36de8f66ec97] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:13.980572 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-12fb466c-4a22-48aa-a197-41bc7017aedf tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:13.982955 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-12fb466c-4a22-48aa-a197-41bc7017aedf tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:13.984501 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-12fb466c-4a22-48aa-a197-41bc7017aedf tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:13.985594 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-12fb466c-4a22-48aa-a197-41bc7017aedf tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:14.051740 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-12fb466c-4a22-48aa-a197-41bc7017aedf tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: da73354f-bc9c-4fb2-8de1-36de8f66ec97] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:00:14.138471 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-8d269526-ee70-459b-afed-2a805b0e9872 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:00:14.138959 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-8d269526-ee70-459b-afed-2a805b0e9872 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:00:14.139523 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-8d269526-ee70-459b-afed-2a805b0e9872 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:00:14.140096 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-8d269526-ee70-459b-afed-2a805b0e9872 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:00:14.140572 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-8d269526-ee70-459b-afed-2a805b0e9872 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:00:14.157219 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8d269526-ee70-459b-afed-2a805b0e9872 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:14.158431 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8d269526-ee70-459b-afed-2a805b0e9872 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:14.159633 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8d269526-ee70-459b-afed-2a805b0e9872 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:14.160321 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8d269526-ee70-459b-afed-2a805b0e9872 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:14.186093 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-8d269526-ee70-459b-afed-2a805b0e9872 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Getting quotas for project 07627ceb27f2492fbb741a241edb2c5c. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:00:14.199269 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-8d269526-ee70-459b-afed-2a805b0e9872 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Getting quotas for user 88ef01d5252344a2bc2d36e13324a6b0 and project 07627ceb27f2492fbb741a241edb2c5c. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:00:14.271896 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-12fb466c-4a22-48aa-a197-41bc7017aedf tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "DELETE /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97" status: 204 len: 0 microversion: 2.1 time: 0.324071 Jul 18 03:00:14.272645 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2862/5731] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:00:13 2022] DELETE /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:00:14.288810 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9cadf758-a217-4d18-865e-784b8285368b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:14.290253 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9cadf758-a217-4d18-865e-784b8285368b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: da73354f-bc9c-4fb2-8de1-36de8f66ec97] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:14.309649 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8d269526-ee70-459b-afed-2a805b0e9872 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:00:14.313322 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9cadf758-a217-4d18-865e-784b8285368b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:14.313527 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8d269526-ee70-459b-afed-2a805b0e9872 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] [instance: e3f6cb59-1116-43f4-86e4-c97c597f8dfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4ed9eb85-734d-498e-befe-f8a10ab4374a',volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:00:14.314320 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9cadf758-a217-4d18-865e-784b8285368b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:14.316048 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9cadf758-a217-4d18-865e-784b8285368b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:14.316986 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9cadf758-a217-4d18-865e-784b8285368b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:14.534550 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9cadf758-a217-4d18-865e-784b8285368b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:14.542902 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8d269526-ee70-459b-afed-2a805b0e9872 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.390140 Jul 18 03:00:14.543905 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2870/5732] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:00:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 1395 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 03:00:14.555392 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9cadf758-a217-4d18-865e-784b8285368b tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97" status: 200 len: 1494 microversion: 2.1 time: 0.276342 Jul 18 03:00:14.557421 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2863/5733] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:14 2022] GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97 => generated 1494 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:14.560229 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c2b3abb0-25bb-4cc9-91bb-1c71ac76ea49 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:14.561113 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c2b3abb0-25bb-4cc9-91bb-1c71ac76ea49 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] [instance: e3f6cb59-1116-43f4-86e4-c97c597f8dfd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:14.684027 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c2b3abb0-25bb-4cc9-91bb-1c71ac76ea49 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ef01d5252344a2bc2d36e13324a6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07627ceb27f2492fbb741a241edb2c5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:14.713352 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c2b3abb0-25bb-4cc9-91bb-1c71ac76ea49 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] 10.222.0.57 "GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd" status: 200 len: 1098 microversion: 2.1 time: 0.161722 Jul 18 03:00:14.724299 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2871/5734] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:14 2022] GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd => generated 1098 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:14.819385 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5fe9f686-d6c1-449a-a279-856fe406da22 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:14.819899 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5fe9f686-d6c1-449a-a279-856fe406da22 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] [instance: c9cb90ab-3e8b-4950-ba73-0fe68d737603] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:14.827524 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5fe9f686-d6c1-449a-a279-856fe406da22 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:14.828132 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5fe9f686-d6c1-449a-a279-856fe406da22 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:14.829552 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5fe9f686-d6c1-449a-a279-856fe406da22 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:14.830216 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5fe9f686-d6c1-449a-a279-856fe406da22 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:14.868060 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5fe9f686-d6c1-449a-a279-856fe406da22 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] [instance: c9cb90ab-3e8b-4950-ba73-0fe68d737603] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:00:14.981306 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5fe9f686-d6c1-449a-a279-856fe406da22 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c9cb90ab-3e8b-4950-ba73-0fe68d737603" status: 204 len: 0 microversion: 2.1 time: 0.166972 Jul 18 03:00:14.983367 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2864/5735] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:00:14 2022] DELETE /compute/v2.1/servers/c9cb90ab-3e8b-4950-ba73-0fe68d737603 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:00:14.992166 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-91a5ebf6-920f-4628-8710-05efb8f56f2f tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:14.993989 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-91a5ebf6-920f-4628-8710-05efb8f56f2f tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] [instance: c9cb90ab-3e8b-4950-ba73-0fe68d737603] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:15.024627 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-91a5ebf6-920f-4628-8710-05efb8f56f2f tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:15.028594 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-91a5ebf6-920f-4628-8710-05efb8f56f2f tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:15.030160 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-91a5ebf6-920f-4628-8710-05efb8f56f2f tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:15.030959 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-91a5ebf6-920f-4628-8710-05efb8f56f2f tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:15.314652 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-91a5ebf6-920f-4628-8710-05efb8f56f2f tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dddc0cfa946d78f06ab7db1f11929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5555f4f3291040b7ae2fed82ca9df793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:15.342885 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-91a5ebf6-920f-4628-8710-05efb8f56f2f tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] 10.222.0.57 "GET /compute/v2.1/servers/c9cb90ab-3e8b-4950-ba73-0fe68d737603" status: 200 len: 1505 microversion: 2.1 time: 0.354318 Jul 18 03:00:15.344615 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2872/5736] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:14 2022] GET /compute/v2.1/servers/c9cb90ab-3e8b-4950-ba73-0fe68d737603 => generated 1505 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:15.575122 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c41a55a7-bf07-4929-8f5b-9886480d8011 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:15.575509 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c41a55a7-bf07-4929-8f5b-9886480d8011 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: da73354f-bc9c-4fb2-8de1-36de8f66ec97] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:15.596702 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c41a55a7-bf07-4929-8f5b-9886480d8011 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:15.597178 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c41a55a7-bf07-4929-8f5b-9886480d8011 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:15.598077 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c41a55a7-bf07-4929-8f5b-9886480d8011 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:15.598531 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c41a55a7-bf07-4929-8f5b-9886480d8011 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:15.736607 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d490e5a7-8935-49ad-9306-d6f235d097af tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:15.737933 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d490e5a7-8935-49ad-9306-d6f235d097af tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] [instance: e3f6cb59-1116-43f4-86e4-c97c597f8dfd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:15.768279 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c41a55a7-bf07-4929-8f5b-9886480d8011 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:15.768495 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d490e5a7-8935-49ad-9306-d6f235d097af tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:15.769113 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d490e5a7-8935-49ad-9306-d6f235d097af tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:15.777510 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d490e5a7-8935-49ad-9306-d6f235d097af tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:15.780122 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c41a55a7-bf07-4929-8f5b-9886480d8011 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97" status: 200 len: 1452 microversion: 2.1 time: 0.210407 Jul 18 03:00:15.780578 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d490e5a7-8935-49ad-9306-d6f235d097af tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:15.780763 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2865/5737] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:15 2022] GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97 => generated 1452 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:15.798499 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-6fdc8607-e763-43ef-a9e1-4e1e0b0fa03a req-87620ff6-528d-4fab-9033-ef1aa470115d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da73354f-bc9c-4fb2-8de1-36de8f66ec97", "name": "network-vif-deleted", "tag": "8f1da331-b699-418e-9a99-5e9933732c52"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:00:15.798499 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-6fdc8607-e763-43ef-a9e1-4e1e0b0fa03a req-87620ff6-528d-4fab-9033-ef1aa470115d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:15.798499 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-6fdc8607-e763-43ef-a9e1-4e1e0b0fa03a req-87620ff6-528d-4fab-9033-ef1aa470115d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:15.824002 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-6fdc8607-e763-43ef-a9e1-4e1e0b0fa03a req-87620ff6-528d-4fab-9033-ef1aa470115d service nova] Creating event network-vif-deleted:8f1da331-b699-418e-9a99-5e9933732c52 for instance da73354f-bc9c-4fb2-8de1-36de8f66ec97 on n-h1-465891-3 Jul 18 03:00:15.829741 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-6fdc8607-e763-43ef-a9e1-4e1e0b0fa03a req-87620ff6-528d-4fab-9033-ef1aa470115d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047651 Jul 18 03:00:15.830739 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2866/5738] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:00:15.915841 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d490e5a7-8935-49ad-9306-d6f235d097af tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ef01d5252344a2bc2d36e13324a6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07627ceb27f2492fbb741a241edb2c5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:15.924092 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d490e5a7-8935-49ad-9306-d6f235d097af tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] 10.222.0.57 "GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd" status: 200 len: 1196 microversion: 2.1 time: 0.196021 Jul 18 03:00:15.924704 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2873/5739] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:15 2022] GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd => generated 1196 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:16.363959 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-54853296-9c7f-422e-9324-3daaaba8c613 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:16.364679 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-54853296-9c7f-422e-9324-3daaaba8c613 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] [instance: c9cb90ab-3e8b-4950-ba73-0fe68d737603] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:16.372895 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54853296-9c7f-422e-9324-3daaaba8c613 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:16.373350 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54853296-9c7f-422e-9324-3daaaba8c613 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:16.374208 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54853296-9c7f-422e-9324-3daaaba8c613 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:16.374768 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54853296-9c7f-422e-9324-3daaaba8c613 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:16.734579 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-54853296-9c7f-422e-9324-3daaaba8c613 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dddc0cfa946d78f06ab7db1f11929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5555f4f3291040b7ae2fed82ca9df793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:16.750685 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-54853296-9c7f-422e-9324-3daaaba8c613 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] 10.222.0.57 "GET /compute/v2.1/servers/c9cb90ab-3e8b-4950-ba73-0fe68d737603" status: 200 len: 1505 microversion: 2.1 time: 0.390873 Jul 18 03:00:16.751958 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2867/5740] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:16 2022] GET /compute/v2.1/servers/c9cb90ab-3e8b-4950-ba73-0fe68d737603 => generated 1505 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:16.814682 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9991e865-1e89-4218-82e9-d68a5e3c0cda tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:16.817929 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9991e865-1e89-4218-82e9-d68a5e3c0cda tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: da73354f-bc9c-4fb2-8de1-36de8f66ec97] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:16.846395 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9991e865-1e89-4218-82e9-d68a5e3c0cda tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:16.847624 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9991e865-1e89-4218-82e9-d68a5e3c0cda tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:16.850088 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9991e865-1e89-4218-82e9-d68a5e3c0cda tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:16.851381 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9991e865-1e89-4218-82e9-d68a5e3c0cda tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:16.864185 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:00:16.949646 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a80834a1-08b5-4cda-a6ea-370f054dae46 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:16.950850 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a80834a1-08b5-4cda-a6ea-370f054dae46 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] [instance: e3f6cb59-1116-43f4-86e4-c97c597f8dfd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:16.965129 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9991e865-1e89-4218-82e9-d68a5e3c0cda tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:16.965687 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9991e865-1e89-4218-82e9-d68a5e3c0cda tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:16.966203 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-9991e865-1e89-4218-82e9-d68a5e3c0cda tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lazy-loading 'fault' on Instance uuid da73354f-bc9c-4fb2-8de1-36de8f66ec97 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:00:16.986291 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a80834a1-08b5-4cda-a6ea-370f054dae46 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:16.987244 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a80834a1-08b5-4cda-a6ea-370f054dae46 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:16.988956 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a80834a1-08b5-4cda-a6ea-370f054dae46 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:16.997017 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a80834a1-08b5-4cda-a6ea-370f054dae46 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:17.079067 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9991e865-1e89-4218-82e9-d68a5e3c0cda tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:17.099912 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9991e865-1e89-4218-82e9-d68a5e3c0cda tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97" status: 200 len: 1304 microversion: 2.1 time: 0.296523 Jul 18 03:00:17.102344 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2874/5741] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:16 2022] GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97 => generated 1304 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:17.263398 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a80834a1-08b5-4cda-a6ea-370f054dae46 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ef01d5252344a2bc2d36e13324a6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07627ceb27f2492fbb741a241edb2c5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:17.301042 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a80834a1-08b5-4cda-a6ea-370f054dae46 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] 10.222.0.57 "GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd" status: 200 len: 1214 microversion: 2.1 time: 0.359817 Jul 18 03:00:17.302639 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2868/5742] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:16 2022] GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd => generated 1214 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:17.771250 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e8f1ca76-4d57-4577-9c29-bfc5a12f4cbc tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:17.772063 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e8f1ca76-4d57-4577-9c29-bfc5a12f4cbc tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] [instance: c9cb90ab-3e8b-4950-ba73-0fe68d737603] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:17.783233 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e8f1ca76-4d57-4577-9c29-bfc5a12f4cbc tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:17.783869 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e8f1ca76-4d57-4577-9c29-bfc5a12f4cbc tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:17.786030 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e8f1ca76-4d57-4577-9c29-bfc5a12f4cbc tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:17.786632 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e8f1ca76-4d57-4577-9c29-bfc5a12f4cbc tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:17.885786 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-78e50791-ee27-4bc0-80d0-819f9cb9c6e1 req-baa746ea-8910-4179-b373-8210978e4bef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9cb90ab-3e8b-4950-ba73-0fe68d737603", "name": "network-vif-deleted", "tag": "2c0a91fe-fbb7-4b29-b828-c90bcac0188b"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:00:17.901659 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-78e50791-ee27-4bc0-80d0-819f9cb9c6e1 req-baa746ea-8910-4179-b373-8210978e4bef service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:17.903142 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-78e50791-ee27-4bc0-80d0-819f9cb9c6e1 req-baa746ea-8910-4179-b373-8210978e4bef service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:17.951624 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e8f1ca76-4d57-4577-9c29-bfc5a12f4cbc tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dddc0cfa946d78f06ab7db1f11929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5555f4f3291040b7ae2fed82ca9df793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:17.957354 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-78e50791-ee27-4bc0-80d0-819f9cb9c6e1 req-baa746ea-8910-4179-b373-8210978e4bef service nova] Creating event network-vif-deleted:2c0a91fe-fbb7-4b29-b828-c90bcac0188b for instance c9cb90ab-3e8b-4950-ba73-0fe68d737603 on n-h1-465891-3 Jul 18 03:00:17.965325 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e8f1ca76-4d57-4577-9c29-bfc5a12f4cbc tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] 10.222.0.57 "GET /compute/v2.1/servers/c9cb90ab-3e8b-4950-ba73-0fe68d737603" status: 200 len: 1463 microversion: 2.1 time: 0.199213 Jul 18 03:00:17.966699 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2875/5743] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:17 2022] GET /compute/v2.1/servers/c9cb90ab-3e8b-4950-ba73-0fe68d737603 => generated 1463 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:17.987614 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-78e50791-ee27-4bc0-80d0-819f9cb9c6e1 req-baa746ea-8910-4179-b373-8210978e4bef service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104781 Jul 18 03:00:17.990816 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2869/5744] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:00:18.132982 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0ba7adfb-2026-4726-9e8e-f57fae5647ed tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:18.135236 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0ba7adfb-2026-4726-9e8e-f57fae5647ed tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: da73354f-bc9c-4fb2-8de1-36de8f66ec97] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:18.152899 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0ba7adfb-2026-4726-9e8e-f57fae5647ed tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:18.153874 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0ba7adfb-2026-4726-9e8e-f57fae5647ed tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:18.158835 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0ba7adfb-2026-4726-9e8e-f57fae5647ed tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:18.159839 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0ba7adfb-2026-4726-9e8e-f57fae5647ed tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:18.182515 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-0ba7adfb-2026-4726-9e8e-f57fae5647ed tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] HTTP exception thrown: Instance da73354f-bc9c-4fb2-8de1-36de8f66ec97 could not be found. Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0ba7adfb-2026-4726-9e8e-f57fae5647ed tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Request method failure captured: Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97 HTTP/1.1 Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MpeZE7B7ggvWbQc2KiBuopHOJluqoroptHlmwrPNlRr2pt2Zu9Zwj_7Rf-ScE247-3qWDi_Gg8bo3Zzw0u3dgabI_jJCHXJML47lEbY3Hw73qGCrAE6a4fhUVxpzDxEDfhuI00pvfMbi7vIE86eHDCb3ZROxEb6oUuXthyU9kKumbk Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 2ed8b12429e9420bb83700e52701910b Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServerActionsTestJSON-125209500 Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2ed8b12429e9420bb83700e52701910b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2ed8b12429e9420bb83700e52701910b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2ed8b12429e9420bb83700e52701910b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2ed8b12429e9420bb83700e52701910b"}]}] Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServerActionsTestJSON-125209500 Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 2ed8b12429e9420bb83700e52701910b Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServerActionsTestJSON-125209500 Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServerActionsTestJSON-125209500-project Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 5436715af849460f87ff6b62dbd491a0 Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServerActionsTestJSON-125209500-project Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance da73354f-bc9c-4fb2-8de1-36de8f66ec97 could not be found. Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'da73354f-bc9c-4fb2-8de1-36de8f66ec97'} Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da73354f-bc9c-4fb2-8de1-36de8f66ec97 could not be found. Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da73354f-bc9c-4fb2-8de1-36de8f66ec97 could not be found. Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:00:18.184605 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:00:18.189504 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:00:18.189504 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:00:18.189504 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:00:18.189504 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:00:18.189504 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:00:18.189504 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da73354f-bc9c-4fb2-8de1-36de8f66ec97 could not be found. Jul 18 03:00:18.189504 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:00:18.191579 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0ba7adfb-2026-4726-9e8e-f57fae5647ed tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Returning 404 to user: Instance da73354f-bc9c-4fb2-8de1-36de8f66ec97 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:00:18.192848 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0ba7adfb-2026-4726-9e8e-f57fae5647ed tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97" status: 404 len: 111 microversion: 2.1 time: 0.065561 Jul 18 03:00:18.197806 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2876/5745] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:18 2022] GET /compute/v2.1/servers/da73354f-bc9c-4fb2-8de1-36de8f66ec97 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 03:00:18.205324 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d31f137f-6a1d-4d91-94d7-b27f26b54a28 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:18.206884 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d31f137f-6a1d-4d91-94d7-b27f26b54a28 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:18.215699 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d31f137f-6a1d-4d91-94d7-b27f26b54a28 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:18.216454 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d31f137f-6a1d-4d91-94d7-b27f26b54a28 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:18.217823 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d31f137f-6a1d-4d91-94d7-b27f26b54a28 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:18.218678 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d31f137f-6a1d-4d91-94d7-b27f26b54a28 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:18.265077 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d31f137f-6a1d-4d91-94d7-b27f26b54a28 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:00:18.325294 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-18224bce-b234-4605-95a8-d7bb006ba174 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:18.326120 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-18224bce-b234-4605-95a8-d7bb006ba174 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] [instance: e3f6cb59-1116-43f4-86e4-c97c597f8dfd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:18.338343 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-18224bce-b234-4605-95a8-d7bb006ba174 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:18.338884 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-18224bce-b234-4605-95a8-d7bb006ba174 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:18.339741 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-18224bce-b234-4605-95a8-d7bb006ba174 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:18.340194 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-18224bce-b234-4605-95a8-d7bb006ba174 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:18.446196 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d31f137f-6a1d-4d91-94d7-b27f26b54a28 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "DELETE /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 204 len: 0 microversion: 2.1 time: 0.246241 Jul 18 03:00:18.450252 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2870/5746] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:00:18 2022] DELETE /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 03:00:18.457267 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-258f551b-d6de-4256-a750-6e01e636a5af tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:18.458379 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-258f551b-d6de-4256-a750-6e01e636a5af tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:18.469085 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-258f551b-d6de-4256-a750-6e01e636a5af tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:18.470982 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-258f551b-d6de-4256-a750-6e01e636a5af tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:18.472848 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-258f551b-d6de-4256-a750-6e01e636a5af tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:18.473534 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-258f551b-d6de-4256-a750-6e01e636a5af tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:18.738793 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-18224bce-b234-4605-95a8-d7bb006ba174 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ef01d5252344a2bc2d36e13324a6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07627ceb27f2492fbb741a241edb2c5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:18.758931 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-18224bce-b234-4605-95a8-d7bb006ba174 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] 10.222.0.57 "GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd" status: 200 len: 1281 microversion: 2.1 time: 0.436349 Jul 18 03:00:18.760588 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2877/5747] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:18 2022] GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd => generated 1281 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:00:18.859580 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-258f551b-d6de-4256-a750-6e01e636a5af tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:18.872240 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-258f551b-d6de-4256-a750-6e01e636a5af tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1676 microversion: 2.1 time: 0.419577 Jul 18 03:00:18.879943 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2871/5748] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:18 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1676 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:18.989272 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a18f731d-fa73-4158-be57-f31cf5751ab6 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:18.990388 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a18f731d-fa73-4158-be57-f31cf5751ab6 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] [instance: c9cb90ab-3e8b-4950-ba73-0fe68d737603] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:19.012955 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a18f731d-fa73-4158-be57-f31cf5751ab6 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:19.013779 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a18f731d-fa73-4158-be57-f31cf5751ab6 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:19.015207 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a18f731d-fa73-4158-be57-f31cf5751ab6 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:19.015973 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a18f731d-fa73-4158-be57-f31cf5751ab6 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:19.055317 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-a18f731d-fa73-4158-be57-f31cf5751ab6 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] HTTP exception thrown: Instance c9cb90ab-3e8b-4950-ba73-0fe68d737603 could not be found. Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a18f731d-fa73-4158-be57-f31cf5751ab6 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Request method failure captured: Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/c9cb90ab-3e8b-4950-ba73-0fe68d737603 HTTP/1.1 Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MyOSleaCejTAFDeOYvPCIx2zUSVrO3TH6KLCDYGk3WOM3D2760VniZgWNnKVzRfpV29LD1uVcoXEU1B1mthR0guILtTOmYq90sx0H_J2WnN60oBCFw-UgoZaXkVDNbH2ZmA2J9qWMYyBfYAhyx4W3Y4aXWSG74Uu6RYWsavswCSGC8 Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 5555f4f3291040b7ae2fed82ca9df793 Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-VolumesActionsTest-1346663539 Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5555f4f3291040b7ae2fed82ca9df793"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5555f4f3291040b7ae2fed82ca9df793"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5555f4f3291040b7ae2fed82ca9df793"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5555f4f3291040b7ae2fed82ca9df793"}]}] Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-VolumesActionsTest-1346663539 Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 5555f4f3291040b7ae2fed82ca9df793 Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-VolumesActionsTest-1346663539 Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-VolumesActionsTest-1346663539-project Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 1b9dddc0cfa946d78f06ab7db1f11929 Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-VolumesActionsTest-1346663539-project Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance c9cb90ab-3e8b-4950-ba73-0fe68d737603 could not be found. Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'c9cb90ab-3e8b-4950-ba73-0fe68d737603'} Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9cb90ab-3e8b-4950-ba73-0fe68d737603 could not be found. Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9cb90ab-3e8b-4950-ba73-0fe68d737603 could not be found. Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:00:19.060998 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:00:19.069063 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:00:19.069063 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:00:19.069063 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:00:19.069063 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:00:19.069063 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:00:19.069063 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9cb90ab-3e8b-4950-ba73-0fe68d737603 could not be found. Jul 18 03:00:19.069063 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:00:19.075874 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a18f731d-fa73-4158-be57-f31cf5751ab6 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] Returning 404 to user: Instance c9cb90ab-3e8b-4950-ba73-0fe68d737603 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:00:19.079852 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a18f731d-fa73-4158-be57-f31cf5751ab6 tempest-VolumesActionsTest-1346663539 tempest-VolumesActionsTest-1346663539-project] 10.222.0.57 "GET /compute/v2.1/servers/c9cb90ab-3e8b-4950-ba73-0fe68d737603" status: 404 len: 111 microversion: 2.1 time: 0.099759 Jul 18 03:00:19.083988 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2878/5749] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:18 2022] GET /compute/v2.1/servers/c9cb90ab-3e8b-4950-ba73-0fe68d737603 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:00:19.798747 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6e98cfee-b7aa-4360-977c-eda0160c866f tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:19.800199 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6e98cfee-b7aa-4360-977c-eda0160c866f tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] [instance: e3f6cb59-1116-43f4-86e4-c97c597f8dfd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:19.818568 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6e98cfee-b7aa-4360-977c-eda0160c866f tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:19.821596 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6e98cfee-b7aa-4360-977c-eda0160c866f tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:19.825230 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6e98cfee-b7aa-4360-977c-eda0160c866f tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:19.826572 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6e98cfee-b7aa-4360-977c-eda0160c866f tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:19.911646 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-84bdf83a-dc0c-438c-b824-b912afe12fc0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:19.917168 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-84bdf83a-dc0c-438c-b824-b912afe12fc0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:19.940105 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-84bdf83a-dc0c-438c-b824-b912afe12fc0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:19.944603 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-84bdf83a-dc0c-438c-b824-b912afe12fc0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:19.947739 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-84bdf83a-dc0c-438c-b824-b912afe12fc0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:19.950447 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-84bdf83a-dc0c-438c-b824-b912afe12fc0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:21.104087 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6e98cfee-b7aa-4360-977c-eda0160c866f tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ef01d5252344a2bc2d36e13324a6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07627ceb27f2492fbb741a241edb2c5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:21.132046 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6e98cfee-b7aa-4360-977c-eda0160c866f tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] 10.222.0.57 "GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd" status: 200 len: 1281 microversion: 2.1 time: 1.345279 Jul 18 03:00:21.154834 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2872/5750] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:19 2022] GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd => generated 1281 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:21.175815 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-33d507d1-d9a7-417b-95a6-d76ba1775191 req-7f5ba981-def2-4c03-ac31-22d0843bde4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3f6cb59-1116-43f4-86e4-c97c597f8dfd", "tag": "74113a7b-30c1-4349-9bdd-e20b4d47ab9f"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:00:21.226211 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-33d507d1-d9a7-417b-95a6-d76ba1775191 req-7f5ba981-def2-4c03-ac31-22d0843bde4d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:21.226578 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-33d507d1-d9a7-417b-95a6-d76ba1775191 req-7f5ba981-def2-4c03-ac31-22d0843bde4d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:21.315530 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-33d507d1-d9a7-417b-95a6-d76ba1775191 req-7f5ba981-def2-4c03-ac31-22d0843bde4d service nova] Creating event network-changed:74113a7b-30c1-4349-9bdd-e20b4d47ab9f for instance e3f6cb59-1116-43f4-86e4-c97c597f8dfd on n-h2-465891-3 Jul 18 03:00:21.323379 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-84bdf83a-dc0c-438c-b824-b912afe12fc0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:21.330542 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-33d507d1-d9a7-417b-95a6-d76ba1775191 req-7f5ba981-def2-4c03-ac31-22d0843bde4d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171716 Jul 18 03:00:21.332107 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2873/5751] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:00:21.344185 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-84bdf83a-dc0c-438c-b824-b912afe12fc0 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1676 microversion: 2.1 time: 1.441304 Jul 18 03:00:21.347189 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2879/5752] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:19 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1676 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:22.176523 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4e3cc3b8-06f1-4456-9f9f-3e5384eb8f0d tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:22.183999 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4e3cc3b8-06f1-4456-9f9f-3e5384eb8f0d tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] [instance: e3f6cb59-1116-43f4-86e4-c97c597f8dfd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:22.206329 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e3cc3b8-06f1-4456-9f9f-3e5384eb8f0d tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:22.214688 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e3cc3b8-06f1-4456-9f9f-3e5384eb8f0d tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:22.216601 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e3cc3b8-06f1-4456-9f9f-3e5384eb8f0d tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:22.217643 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e3cc3b8-06f1-4456-9f9f-3e5384eb8f0d tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:22.311920 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:00:22.377663 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-75034578-d178-465f-bc80-956e7b4c56d8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:22.380038 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-75034578-d178-465f-bc80-956e7b4c56d8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:22.397651 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-75034578-d178-465f-bc80-956e7b4c56d8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:22.400173 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-75034578-d178-465f-bc80-956e7b4c56d8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:22.402155 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-75034578-d178-465f-bc80-956e7b4c56d8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:22.403372 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-75034578-d178-465f-bc80-956e7b4c56d8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:22.724625 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-75034578-d178-465f-bc80-956e7b4c56d8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:22.735947 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-75034578-d178-465f-bc80-956e7b4c56d8 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1608 microversion: 2.1 time: 0.367893 Jul 18 03:00:22.737367 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2880/5753] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:22 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1608 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:00:23.119196 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4e3cc3b8-06f1-4456-9f9f-3e5384eb8f0d tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ef01d5252344a2bc2d36e13324a6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07627ceb27f2492fbb741a241edb2c5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:23.134627 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4e3cc3b8-06f1-4456-9f9f-3e5384eb8f0d tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] 10.222.0.57 "GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd" status: 200 len: 1281 microversion: 2.1 time: 0.963476 Jul 18 03:00:23.135307 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2874/5754] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:22 2022] GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd => generated 1281 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:23.627892 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-235708e4-5385-4fd7-941e-f89c0323f8e9 req-75fc6abe-9968-4b98-87b9-fcb178108c51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69bbb844-4d56-4e75-ae50-9c35c9ce6f9e", "name": "network-vif-deleted", "tag": "d926d5af-f867-44cd-8b60-abb0339ecf2a"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:00:23.696604 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-235708e4-5385-4fd7-941e-f89c0323f8e9 req-75fc6abe-9968-4b98-87b9-fcb178108c51 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:23.697101 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-235708e4-5385-4fd7-941e-f89c0323f8e9 req-75fc6abe-9968-4b98-87b9-fcb178108c51 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:23.716245 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-235708e4-5385-4fd7-941e-f89c0323f8e9 req-75fc6abe-9968-4b98-87b9-fcb178108c51 service nova] Creating event network-vif-deleted:d926d5af-f867-44cd-8b60-abb0339ecf2a for instance 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e on n-h2-465891-3 Jul 18 03:00:23.723427 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-235708e4-5385-4fd7-941e-f89c0323f8e9 req-75fc6abe-9968-4b98-87b9-fcb178108c51 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104125 Jul 18 03:00:23.724921 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2881/5755] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:00:23.761685 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bbe75fc9-5631-4d6d-84c8-023cb3d5ec96 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:23.776749 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bbe75fc9-5631-4d6d-84c8-023cb3d5ec96 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:23.843195 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bbe75fc9-5631-4d6d-84c8-023cb3d5ec96 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:23.844405 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bbe75fc9-5631-4d6d-84c8-023cb3d5ec96 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:23.846260 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bbe75fc9-5631-4d6d-84c8-023cb3d5ec96 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:23.853583 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bbe75fc9-5631-4d6d-84c8-023cb3d5ec96 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:24.060844 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bbe75fc9-5631-4d6d-84c8-023cb3d5ec96 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:24.075061 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bbe75fc9-5631-4d6d-84c8-023cb3d5ec96 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:24.076793 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-bbe75fc9-5631-4d6d-84c8-023cb3d5ec96 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lazy-loading 'fault' on Instance uuid 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:00:24.156727 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-132f9c01-391d-4cb4-9981-dda554b3e2df tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:24.159112 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-132f9c01-391d-4cb4-9981-dda554b3e2df tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] [instance: e3f6cb59-1116-43f4-86e4-c97c597f8dfd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:24.191040 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:00:24.209472 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-132f9c01-391d-4cb4-9981-dda554b3e2df tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:24.211074 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-132f9c01-391d-4cb4-9981-dda554b3e2df tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:24.215675 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-132f9c01-391d-4cb4-9981-dda554b3e2df tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:24.216805 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-132f9c01-391d-4cb4-9981-dda554b3e2df tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:24.263575 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bbe75fc9-5631-4d6d-84c8-023cb3d5ec96 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5436715af849460f87ff6b62dbd491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b12429e9420bb83700e52701910b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:24.291905 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bbe75fc9-5631-4d6d-84c8-023cb3d5ec96 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 200 len: 1328 microversion: 2.1 time: 0.539705 Jul 18 03:00:24.292538 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2875/5756] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:23 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 1328 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:24.694010 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=12 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:00:24.742362 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-132f9c01-391d-4cb4-9981-dda554b3e2df tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ef01d5252344a2bc2d36e13324a6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07627ceb27f2492fbb741a241edb2c5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:24.767327 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-132f9c01-391d-4cb4-9981-dda554b3e2df tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] 10.222.0.57 "GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd" status: 200 len: 1281 microversion: 2.1 time: 0.618018 Jul 18 03:00:24.786354 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2882/5757] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:24 2022] GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd => generated 1281 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:25.331143 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-26a3f1d0-025b-4a4b-8feb-9d62cece5380 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:25.336652 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-26a3f1d0-025b-4a4b-8feb-9d62cece5380 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] [instance: 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:25.408667 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26a3f1d0-025b-4a4b-8feb-9d62cece5380 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:25.414154 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26a3f1d0-025b-4a4b-8feb-9d62cece5380 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:25.426189 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26a3f1d0-025b-4a4b-8feb-9d62cece5380 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:25.427576 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26a3f1d0-025b-4a4b-8feb-9d62cece5380 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:25.497732 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-26a3f1d0-025b-4a4b-8feb-9d62cece5380 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] HTTP exception thrown: Instance 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e could not be found. Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-26a3f1d0-025b-4a4b-8feb-9d62cece5380 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Request method failure captured: Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e HTTP/1.1 Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MpeZE7B7ggvWbQc2KiBuopHOJluqoroptHlmwrPNlRr2pt2Zu9Zwj_7Rf-ScE247-3qWDi_Gg8bo3Zzw0u3dgabI_jJCHXJML47lEbY3Hw73qGCrAE6a4fhUVxpzDxEDfhuI00pvfMbi7vIE86eHDCb3ZROxEb6oUuXthyU9kKumbk Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 2ed8b12429e9420bb83700e52701910b Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServerActionsTestJSON-125209500 Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2ed8b12429e9420bb83700e52701910b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2ed8b12429e9420bb83700e52701910b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2ed8b12429e9420bb83700e52701910b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2ed8b12429e9420bb83700e52701910b"}]}] Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServerActionsTestJSON-125209500 Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 2ed8b12429e9420bb83700e52701910b Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServerActionsTestJSON-125209500 Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServerActionsTestJSON-125209500-project Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 5436715af849460f87ff6b62dbd491a0 Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServerActionsTestJSON-125209500-project Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e could not be found. Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '69bbb844-4d56-4e75-ae50-9c35c9ce6f9e'} Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e could not be found. Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e could not be found. Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:00:25.508648 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:00:25.517487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:00:25.517487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:00:25.517487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:00:25.517487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:00:25.517487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:00:25.517487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e could not be found. Jul 18 03:00:25.517487 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:00:25.521250 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-26a3f1d0-025b-4a4b-8feb-9d62cece5380 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Returning 404 to user: Instance 69bbb844-4d56-4e75-ae50-9c35c9ce6f9e could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:00:25.523324 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-26a3f1d0-025b-4a4b-8feb-9d62cece5380 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e" status: 404 len: 111 microversion: 2.1 time: 0.214844 Jul 18 03:00:25.524647 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2876/5758] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:25 2022] GET /compute/v2.1/servers/69bbb844-4d56-4e75-ae50-9c35c9ce6f9e => generated 111 bytes in 218 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:00:25.538168 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-94228091-44d0-44a8-a96c-ea799ce9fa36 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] Calling method '.version_select at 0x7ff49ba0eb80>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:25.613224 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-94228091-44d0-44a8-a96c-ea799ce9fa36 tempest-ServerActionsTestJSON-125209500 tempest-ServerActionsTestJSON-125209500-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-438126568" status: 202 len: 0 microversion: 2.1 time: 0.081483 Jul 18 03:00:25.625154 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2883/5759] 10.222.0.57 () {58 vars in 1217 bytes} [Mon Jul 18 03:00:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-438126568 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 03:00:25.795124 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bcef0b6e-339e-4696-9465-dc39a1490971 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:25.796038 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bcef0b6e-339e-4696-9465-dc39a1490971 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] [instance: e3f6cb59-1116-43f4-86e4-c97c597f8dfd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:25.816042 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bcef0b6e-339e-4696-9465-dc39a1490971 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:25.820218 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bcef0b6e-339e-4696-9465-dc39a1490971 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:25.822229 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bcef0b6e-339e-4696-9465-dc39a1490971 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:25.822948 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bcef0b6e-339e-4696-9465-dc39a1490971 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:26.334773 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bcef0b6e-339e-4696-9465-dc39a1490971 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ef01d5252344a2bc2d36e13324a6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07627ceb27f2492fbb741a241edb2c5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:26.347375 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bcef0b6e-339e-4696-9465-dc39a1490971 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] 10.222.0.57 "GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd" status: 200 len: 1269 microversion: 2.1 time: 0.557958 Jul 18 03:00:26.347985 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2877/5760] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:25 2022] GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd => generated 1269 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:27.372891 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fda27045-cfe7-4bf2-829a-dc5cc6ee52cb tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:27.377492 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fda27045-cfe7-4bf2-829a-dc5cc6ee52cb tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] [instance: e3f6cb59-1116-43f4-86e4-c97c597f8dfd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:27.410134 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fda27045-cfe7-4bf2-829a-dc5cc6ee52cb tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:27.411356 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fda27045-cfe7-4bf2-829a-dc5cc6ee52cb tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:27.414057 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fda27045-cfe7-4bf2-829a-dc5cc6ee52cb tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:27.415473 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fda27045-cfe7-4bf2-829a-dc5cc6ee52cb tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:27.798075 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fda27045-cfe7-4bf2-829a-dc5cc6ee52cb tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ef01d5252344a2bc2d36e13324a6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07627ceb27f2492fbb741a241edb2c5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:27.815010 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fda27045-cfe7-4bf2-829a-dc5cc6ee52cb tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] 10.222.0.57 "GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd" status: 200 len: 1269 microversion: 2.1 time: 0.452957 Jul 18 03:00:27.815646 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2884/5761] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:27 2022] GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd => generated 1269 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:28.852095 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0a74f097-6289-4d3b-9989-5acc2975bf69 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:28.854780 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0a74f097-6289-4d3b-9989-5acc2975bf69 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] [instance: e3f6cb59-1116-43f4-86e4-c97c597f8dfd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:28.868548 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a74f097-6289-4d3b-9989-5acc2975bf69 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:28.869830 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a74f097-6289-4d3b-9989-5acc2975bf69 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:28.871655 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a74f097-6289-4d3b-9989-5acc2975bf69 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:28.873172 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a74f097-6289-4d3b-9989-5acc2975bf69 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:29.333340 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0a74f097-6289-4d3b-9989-5acc2975bf69 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ef01d5252344a2bc2d36e13324a6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07627ceb27f2492fbb741a241edb2c5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:29.359323 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0a74f097-6289-4d3b-9989-5acc2975bf69 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] 10.222.0.57 "GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd" status: 200 len: 1269 microversion: 2.1 time: 0.515090 Jul 18 03:00:29.364277 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2878/5762] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:28 2022] GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd => generated 1269 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:30.148982 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b0d7ff6c-f206-4959-9f5c-f3b579a4e929 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:00:30.152845 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b0d7ff6c-f206-4959-9f5c-f3b579a4e929 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:30.167543 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b0d7ff6c-f206-4959-9f5c-f3b579a4e929 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:30.168352 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b0d7ff6c-f206-4959-9f5c-f3b579a4e929 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:30.169390 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b0d7ff6c-f206-4959-9f5c-f3b579a4e929 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:30.170285 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b0d7ff6c-f206-4959-9f5c-f3b579a4e929 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:30.384286 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d48e3ee4-ed10-45ea-b3e2-8b993666c057 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:30.385435 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d48e3ee4-ed10-45ea-b3e2-8b993666c057 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] [instance: e3f6cb59-1116-43f4-86e4-c97c597f8dfd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:30.405820 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-b0d7ff6c-f206-4959-9f5c-f3b579a4e929 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:00:30.406984 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-b0d7ff6c-f206-4959-9f5c-f3b579a4e929 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:00:30.408031 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-b0d7ff6c-f206-4959-9f5c-f3b579a4e929 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:00:30.408948 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-b0d7ff6c-f206-4959-9f5c-f3b579a4e929 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:00:30.411143 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-b0d7ff6c-f206-4959-9f5c-f3b579a4e929 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:00:30.420193 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d48e3ee4-ed10-45ea-b3e2-8b993666c057 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:30.420959 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d48e3ee4-ed10-45ea-b3e2-8b993666c057 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:30.440656 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d48e3ee4-ed10-45ea-b3e2-8b993666c057 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:30.444085 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d48e3ee4-ed10-45ea-b3e2-8b993666c057 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:30.636720 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b0d7ff6c-f206-4959-9f5c-f3b579a4e929 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:30.661215 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b0d7ff6c-f206-4959-9f5c-f3b579a4e929 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:30.661692 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b0d7ff6c-f206-4959-9f5c-f3b579a4e929 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:30.662556 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b0d7ff6c-f206-4959-9f5c-f3b579a4e929 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:30.674796 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b0d7ff6c-f206-4959-9f5c-f3b579a4e929 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:30.810865 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b0d7ff6c-f206-4959-9f5c-f3b579a4e929 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "POST /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518/action" status: 202 len: 1135 microversion: 2.1 time: 0.669501 Jul 18 03:00:30.826347 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2885/5763] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:00:30 2022] POST /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518/action => generated 1135 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 18 03:00:30.863446 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1d2fdfe1-3162-405d-8725-6194970bd25f tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:30.879141 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1d2fdfe1-3162-405d-8725-6194970bd25f tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:30.896574 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1d2fdfe1-3162-405d-8725-6194970bd25f tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:30.897255 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1d2fdfe1-3162-405d-8725-6194970bd25f tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:30.900776 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1d2fdfe1-3162-405d-8725-6194970bd25f tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:30.908269 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1d2fdfe1-3162-405d-8725-6194970bd25f tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:31.138532 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d48e3ee4-ed10-45ea-b3e2-8b993666c057 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ef01d5252344a2bc2d36e13324a6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07627ceb27f2492fbb741a241edb2c5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:31.166220 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d48e3ee4-ed10-45ea-b3e2-8b993666c057 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] 10.222.0.57 "GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd" status: 200 len: 1269 microversion: 2.1 time: 0.788670 Jul 18 03:00:31.176273 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2879/5764] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:30 2022] GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd => generated 1269 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:00:31.944908 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1d2fdfe1-3162-405d-8725-6194970bd25f tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:31.964364 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1d2fdfe1-3162-405d-8725-6194970bd25f tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518" status: 200 len: 1689 microversion: 2.1 time: 1.124902 Jul 18 03:00:31.966084 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2886/5765] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:30 2022] GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518 => generated 1689 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:32.185495 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-48030733-1b0b-4f92-927f-e41ac42d0ee7 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:32.186963 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-48030733-1b0b-4f92-927f-e41ac42d0ee7 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] [instance: e3f6cb59-1116-43f4-86e4-c97c597f8dfd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:32.203545 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-48030733-1b0b-4f92-927f-e41ac42d0ee7 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:32.204341 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-48030733-1b0b-4f92-927f-e41ac42d0ee7 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:32.205375 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-48030733-1b0b-4f92-927f-e41ac42d0ee7 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:32.208036 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-48030733-1b0b-4f92-927f-e41ac42d0ee7 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:32.607095 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-48030733-1b0b-4f92-927f-e41ac42d0ee7 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ef01d5252344a2bc2d36e13324a6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07627ceb27f2492fbb741a241edb2c5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:32.634535 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-48030733-1b0b-4f92-927f-e41ac42d0ee7 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] 10.222.0.57 "GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd" status: 200 len: 1269 microversion: 2.1 time: 0.452393 Jul 18 03:00:32.636073 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2880/5766] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:32 2022] GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd => generated 1269 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:00:33.006331 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-446b2884-8061-4456-ba02-5f619e664c5d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:33.006331 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-446b2884-8061-4456-ba02-5f619e664c5d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:33.069835 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-446b2884-8061-4456-ba02-5f619e664c5d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:33.078428 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-446b2884-8061-4456-ba02-5f619e664c5d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:33.090977 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-446b2884-8061-4456-ba02-5f619e664c5d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:33.092014 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-446b2884-8061-4456-ba02-5f619e664c5d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:33.672347 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d991144d-f787-43f2-89dd-9d974e674182 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:33.673178 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d991144d-f787-43f2-89dd-9d974e674182 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] [instance: e3f6cb59-1116-43f4-86e4-c97c597f8dfd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:33.741985 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d991144d-f787-43f2-89dd-9d974e674182 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:33.760021 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d991144d-f787-43f2-89dd-9d974e674182 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:33.774737 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d991144d-f787-43f2-89dd-9d974e674182 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:33.792983 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d991144d-f787-43f2-89dd-9d974e674182 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:33.884317 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-446b2884-8061-4456-ba02-5f619e664c5d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:33.925675 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-446b2884-8061-4456-ba02-5f619e664c5d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518" status: 200 len: 1689 microversion: 2.1 time: 0.929070 Jul 18 03:00:33.959504 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2887/5767] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:32 2022] GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518 => generated 1689 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:34.412109 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d991144d-f787-43f2-89dd-9d974e674182 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ef01d5252344a2bc2d36e13324a6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07627ceb27f2492fbb741a241edb2c5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:34.456471 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d991144d-f787-43f2-89dd-9d974e674182 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] 10.222.0.57 "GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd" status: 200 len: 1269 microversion: 2.1 time: 0.787763 Jul 18 03:00:34.469767 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2881/5768] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:33 2022] GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd => generated 1269 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:34.981657 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5ce03c0d-ba64-42d7-b1a4-efd5eb523751 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:34.984005 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5ce03c0d-ba64-42d7-b1a4-efd5eb523751 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:34.996136 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5ce03c0d-ba64-42d7-b1a4-efd5eb523751 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:34.997140 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5ce03c0d-ba64-42d7-b1a4-efd5eb523751 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:34.998444 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5ce03c0d-ba64-42d7-b1a4-efd5eb523751 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:34.999096 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5ce03c0d-ba64-42d7-b1a4-efd5eb523751 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:35.415720 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5ce03c0d-ba64-42d7-b1a4-efd5eb523751 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:35.433432 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5ce03c0d-ba64-42d7-b1a4-efd5eb523751 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518" status: 200 len: 1689 microversion: 2.1 time: 0.472529 Jul 18 03:00:35.445763 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2888/5769] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:34 2022] GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518 => generated 1689 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:00:35.495758 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-74bfd40d-b8b4-4d41-b44d-2c4d95fc9f61 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:35.497167 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-74bfd40d-b8b4-4d41-b44d-2c4d95fc9f61 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] [instance: e3f6cb59-1116-43f4-86e4-c97c597f8dfd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:35.514289 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74bfd40d-b8b4-4d41-b44d-2c4d95fc9f61 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:35.519292 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74bfd40d-b8b4-4d41-b44d-2c4d95fc9f61 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:35.523513 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74bfd40d-b8b4-4d41-b44d-2c4d95fc9f61 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:35.530408 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74bfd40d-b8b4-4d41-b44d-2c4d95fc9f61 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:35.879073 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-74bfd40d-b8b4-4d41-b44d-2c4d95fc9f61 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ef01d5252344a2bc2d36e13324a6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07627ceb27f2492fbb741a241edb2c5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:35.890740 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-74bfd40d-b8b4-4d41-b44d-2c4d95fc9f61 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] 10.222.0.57 "GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd" status: 200 len: 1269 microversion: 2.1 time: 0.399625 Jul 18 03:00:35.902043 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2882/5770] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:35 2022] GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd => generated 1269 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:36.465411 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6d2f5372-5179-41d2-ba94-26475c7c7f3d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:36.466942 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6d2f5372-5179-41d2-ba94-26475c7c7f3d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:36.495844 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6d2f5372-5179-41d2-ba94-26475c7c7f3d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:36.496723 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6d2f5372-5179-41d2-ba94-26475c7c7f3d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:36.498238 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6d2f5372-5179-41d2-ba94-26475c7c7f3d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:36.507607 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6d2f5372-5179-41d2-ba94-26475c7c7f3d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:36.909742 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-828a3701-99e1-49f4-b652-09e4f0fb59e9 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:36.910396 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-828a3701-99e1-49f4-b652-09e4f0fb59e9 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] [instance: e3f6cb59-1116-43f4-86e4-c97c597f8dfd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:36.929612 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-828a3701-99e1-49f4-b652-09e4f0fb59e9 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:36.930687 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-828a3701-99e1-49f4-b652-09e4f0fb59e9 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:36.931507 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-828a3701-99e1-49f4-b652-09e4f0fb59e9 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:36.931955 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-828a3701-99e1-49f4-b652-09e4f0fb59e9 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:37.133292 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6d2f5372-5179-41d2-ba94-26475c7c7f3d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:37.142954 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6d2f5372-5179-41d2-ba94-26475c7c7f3d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518" status: 200 len: 1689 microversion: 2.1 time: 0.688170 Jul 18 03:00:37.154377 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2889/5771] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:36 2022] GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518 => generated 1689 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:37.434427 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-828a3701-99e1-49f4-b652-09e4f0fb59e9 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ef01d5252344a2bc2d36e13324a6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07627ceb27f2492fbb741a241edb2c5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:37.482251 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-828a3701-99e1-49f4-b652-09e4f0fb59e9 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] 10.222.0.57 "GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd" status: 200 len: 1269 microversion: 2.1 time: 0.572471 Jul 18 03:00:37.483333 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2883/5772] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:36 2022] GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd => generated 1269 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:37.766387 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-0b973dae-a132-4797-beee-6feebaec2743 req-7a1bdd0c-2d6a-47b9-b926-dba7962d941e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3f6cb59-1116-43f4-86e4-c97c597f8dfd", "name": "network-vif-plugged", "status": "completed", "tag": "74113a7b-30c1-4349-9bdd-e20b4d47ab9f"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:00:37.788537 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-0b973dae-a132-4797-beee-6feebaec2743 req-7a1bdd0c-2d6a-47b9-b926-dba7962d941e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:37.788909 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-0b973dae-a132-4797-beee-6feebaec2743 req-7a1bdd0c-2d6a-47b9-b926-dba7962d941e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:37.826192 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-0b973dae-a132-4797-beee-6feebaec2743 req-7a1bdd0c-2d6a-47b9-b926-dba7962d941e service nova] Creating event network-vif-plugged:74113a7b-30c1-4349-9bdd-e20b4d47ab9f for instance e3f6cb59-1116-43f4-86e4-c97c597f8dfd on n-h2-465891-3 Jul 18 03:00:37.846832 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-0b973dae-a132-4797-beee-6feebaec2743 req-7a1bdd0c-2d6a-47b9-b926-dba7962d941e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089572 Jul 18 03:00:37.847236 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2890/5773] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:00:38.175843 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fb5e6466-1d5d-416c-880a-792ff43c05bd tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:38.177020 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fb5e6466-1d5d-416c-880a-792ff43c05bd tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:38.202880 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fb5e6466-1d5d-416c-880a-792ff43c05bd tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:38.203734 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fb5e6466-1d5d-416c-880a-792ff43c05bd tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:38.205236 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fb5e6466-1d5d-416c-880a-792ff43c05bd tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:38.206040 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fb5e6466-1d5d-416c-880a-792ff43c05bd tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:38.510309 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3f2f0178-3cf0-463b-8cd4-22f226844e31 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:38.512723 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3f2f0178-3cf0-463b-8cd4-22f226844e31 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] [instance: e3f6cb59-1116-43f4-86e4-c97c597f8dfd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:38.528077 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3f2f0178-3cf0-463b-8cd4-22f226844e31 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:38.528925 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3f2f0178-3cf0-463b-8cd4-22f226844e31 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:38.530650 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3f2f0178-3cf0-463b-8cd4-22f226844e31 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:38.532544 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3f2f0178-3cf0-463b-8cd4-22f226844e31 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:38.549585 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fb5e6466-1d5d-416c-880a-792ff43c05bd tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:38.560453 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fb5e6466-1d5d-416c-880a-792ff43c05bd tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518" status: 200 len: 1689 microversion: 2.1 time: 0.392358 Jul 18 03:00:38.561756 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2884/5774] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:38 2022] GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518 => generated 1689 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:38.973521 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3f2f0178-3cf0-463b-8cd4-22f226844e31 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ef01d5252344a2bc2d36e13324a6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07627ceb27f2492fbb741a241edb2c5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:38.990064 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3f2f0178-3cf0-463b-8cd4-22f226844e31 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] 10.222.0.57 "GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd" status: 200 len: 1269 microversion: 2.1 time: 0.492076 Jul 18 03:00:38.990692 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2891/5775] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:38 2022] GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd => generated 1269 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:39.581750 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-af0bdbc6-a7b6-4c1e-b194-7776364d64f7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:39.582402 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-af0bdbc6-a7b6-4c1e-b194-7776364d64f7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:39.597753 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-af0bdbc6-a7b6-4c1e-b194-7776364d64f7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:39.598522 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-af0bdbc6-a7b6-4c1e-b194-7776364d64f7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:39.599513 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-af0bdbc6-a7b6-4c1e-b194-7776364d64f7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:39.604613 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-af0bdbc6-a7b6-4c1e-b194-7776364d64f7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:39.958596 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-af0bdbc6-a7b6-4c1e-b194-7776364d64f7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:39.967803 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-af0bdbc6-a7b6-4c1e-b194-7776364d64f7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518" status: 200 len: 1689 microversion: 2.1 time: 0.391430 Jul 18 03:00:39.971097 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2885/5776] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:39 2022] GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518 => generated 1689 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:40.022551 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e93a2c96-df4b-4504-9e3e-3825587246ac tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:40.024082 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e93a2c96-df4b-4504-9e3e-3825587246ac tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] [instance: e3f6cb59-1116-43f4-86e4-c97c597f8dfd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:40.033251 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e93a2c96-df4b-4504-9e3e-3825587246ac tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:40.034046 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e93a2c96-df4b-4504-9e3e-3825587246ac tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:40.035351 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e93a2c96-df4b-4504-9e3e-3825587246ac tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:40.036325 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e93a2c96-df4b-4504-9e3e-3825587246ac tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:40.043194 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:00:40.335079 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e93a2c96-df4b-4504-9e3e-3825587246ac tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ef01d5252344a2bc2d36e13324a6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07627ceb27f2492fbb741a241edb2c5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:40.347379 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e93a2c96-df4b-4504-9e3e-3825587246ac tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] 10.222.0.57 "GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd" status: 200 len: 1459 microversion: 2.1 time: 0.330816 Jul 18 03:00:40.348485 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2892/5777] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:40 2022] GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd => generated 1459 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:40.381862 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a351f9a6-a9e6-4a18-8c3d-e435bb156061 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:40.383651 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a351f9a6-a9e6-4a18-8c3d-e435bb156061 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] [instance: e3f6cb59-1116-43f4-86e4-c97c597f8dfd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:40.412366 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a351f9a6-a9e6-4a18-8c3d-e435bb156061 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:40.416699 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a351f9a6-a9e6-4a18-8c3d-e435bb156061 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:40.421157 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a351f9a6-a9e6-4a18-8c3d-e435bb156061 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:40.425812 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a351f9a6-a9e6-4a18-8c3d-e435bb156061 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:40.709262 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a351f9a6-a9e6-4a18-8c3d-e435bb156061 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ef01d5252344a2bc2d36e13324a6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07627ceb27f2492fbb741a241edb2c5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:40.722818 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a351f9a6-a9e6-4a18-8c3d-e435bb156061 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] 10.222.0.57 "GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd" status: 200 len: 1459 microversion: 2.1 time: 0.350134 Jul 18 03:00:40.726150 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2886/5778] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:40 2022] GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd => generated 1459 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:40.988081 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-384c0c72-e0d5-40a6-be19-40c1cc46aa83 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:40.989442 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-384c0c72-e0d5-40a6-be19-40c1cc46aa83 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:41.005487 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:00:41.014777 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-384c0c72-e0d5-40a6-be19-40c1cc46aa83 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:41.016170 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-384c0c72-e0d5-40a6-be19-40c1cc46aa83 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:41.020139 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-384c0c72-e0d5-40a6-be19-40c1cc46aa83 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:41.024807 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-384c0c72-e0d5-40a6-be19-40c1cc46aa83 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:41.793254 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-384c0c72-e0d5-40a6-be19-40c1cc46aa83 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:41.848629 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-384c0c72-e0d5-40a6-be19-40c1cc46aa83 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518" status: 200 len: 1689 microversion: 2.1 time: 0.861219 Jul 18 03:00:41.868749 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2893/5779] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:40 2022] GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518 => generated 1689 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:42.881417 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4a819755-ba98-4cab-8bde-888013cf2712 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:42.885760 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4a819755-ba98-4cab-8bde-888013cf2712 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:42.906436 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:00:42.923802 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4a819755-ba98-4cab-8bde-888013cf2712 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:42.925802 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4a819755-ba98-4cab-8bde-888013cf2712 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:42.938692 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4a819755-ba98-4cab-8bde-888013cf2712 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:42.940163 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4a819755-ba98-4cab-8bde-888013cf2712 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:43.450945 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4a819755-ba98-4cab-8bde-888013cf2712 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:43.450945 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4a819755-ba98-4cab-8bde-888013cf2712 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518" status: 200 len: 1689 microversion: 2.1 time: 0.544076 Jul 18 03:00:43.450945 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2887/5780] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:42 2022] GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518 => generated 1689 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:44.468850 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5a697996-426a-4dc4-9a4e-2609df90e930 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:44.469682 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5a697996-426a-4dc4-9a4e-2609df90e930 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:44.488248 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5a697996-426a-4dc4-9a4e-2609df90e930 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:44.497059 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5a697996-426a-4dc4-9a4e-2609df90e930 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:44.498093 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5a697996-426a-4dc4-9a4e-2609df90e930 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:44.498758 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5a697996-426a-4dc4-9a4e-2609df90e930 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:45.420071 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5a697996-426a-4dc4-9a4e-2609df90e930 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:45.448794 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5a697996-426a-4dc4-9a4e-2609df90e930 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518" status: 200 len: 1689 microversion: 2.1 time: 0.974185 Jul 18 03:00:45.464588 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2894/5781] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:44 2022] GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518 => generated 1689 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:00:46.471884 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-62c3989b-59aa-4236-830f-af5c0385ddda tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:46.472488 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-62c3989b-59aa-4236-830f-af5c0385ddda tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:46.485474 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-62c3989b-59aa-4236-830f-af5c0385ddda tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:46.489473 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-62c3989b-59aa-4236-830f-af5c0385ddda tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:46.494321 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-62c3989b-59aa-4236-830f-af5c0385ddda tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:46.495053 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-62c3989b-59aa-4236-830f-af5c0385ddda tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:47.113219 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-62c3989b-59aa-4236-830f-af5c0385ddda tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:47.158460 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-62c3989b-59aa-4236-830f-af5c0385ddda tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518" status: 200 len: 1689 microversion: 2.1 time: 0.673170 Jul 18 03:00:47.162632 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2888/5782] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:46 2022] GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518 => generated 1689 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:47.327224 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-e8083fab-229b-40d6-abfc-08d8d9fe5a36 req-d642d06b-1c35-40b0-b9fd-2330cc14e8f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3f6cb59-1116-43f4-86e4-c97c597f8dfd", "tag": "74113a7b-30c1-4349-9bdd-e20b4d47ab9f"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:00:47.349562 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-e8083fab-229b-40d6-abfc-08d8d9fe5a36 req-d642d06b-1c35-40b0-b9fd-2330cc14e8f9 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:47.357918 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-e8083fab-229b-40d6-abfc-08d8d9fe5a36 req-d642d06b-1c35-40b0-b9fd-2330cc14e8f9 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:47.390867 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-e8083fab-229b-40d6-abfc-08d8d9fe5a36 req-d642d06b-1c35-40b0-b9fd-2330cc14e8f9 service nova] Creating event network-changed:74113a7b-30c1-4349-9bdd-e20b4d47ab9f for instance e3f6cb59-1116-43f4-86e4-c97c597f8dfd on n-h2-465891-3 Jul 18 03:00:47.407099 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-e8083fab-229b-40d6-abfc-08d8d9fe5a36 req-d642d06b-1c35-40b0-b9fd-2330cc14e8f9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083845 Jul 18 03:00:47.415946 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2895/5783] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:00:48.180529 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a7254516-3934-48c3-991f-96f674490837 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:48.181362 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a7254516-3934-48c3-991f-96f674490837 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:48.212220 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a7254516-3934-48c3-991f-96f674490837 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:48.213119 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a7254516-3934-48c3-991f-96f674490837 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:48.214353 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a7254516-3934-48c3-991f-96f674490837 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:48.215034 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a7254516-3934-48c3-991f-96f674490837 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:49.125401 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a7254516-3934-48c3-991f-96f674490837 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:49.134670 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a7254516-3934-48c3-991f-96f674490837 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518" status: 200 len: 1707 microversion: 2.1 time: 0.959813 Jul 18 03:00:49.154165 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2889/5784] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:48 2022] GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518 => generated 1707 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:50.158159 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-611d6231-86fa-4a8d-b75e-3641f033ca4d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:50.159322 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-611d6231-86fa-4a8d-b75e-3641f033ca4d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:50.192955 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-611d6231-86fa-4a8d-b75e-3641f033ca4d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:50.193498 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-611d6231-86fa-4a8d-b75e-3641f033ca4d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:50.194459 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-611d6231-86fa-4a8d-b75e-3641f033ca4d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:50.199780 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-611d6231-86fa-4a8d-b75e-3641f033ca4d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:51.288953 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-c14a17a7-f3aa-49cd-876f-1c924c47f4b9 req-164f9a12-0440-497e-857b-50f96c598133 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3f6cb59-1116-43f4-86e4-c97c597f8dfd", "tag": "74113a7b-30c1-4349-9bdd-e20b4d47ab9f"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:00:51.329437 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-c14a17a7-f3aa-49cd-876f-1c924c47f4b9 req-164f9a12-0440-497e-857b-50f96c598133 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:51.329925 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-c14a17a7-f3aa-49cd-876f-1c924c47f4b9 req-164f9a12-0440-497e-857b-50f96c598133 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:51.383805 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-c14a17a7-f3aa-49cd-876f-1c924c47f4b9 req-164f9a12-0440-497e-857b-50f96c598133 service nova] Creating event network-changed:74113a7b-30c1-4349-9bdd-e20b4d47ab9f for instance e3f6cb59-1116-43f4-86e4-c97c597f8dfd on n-h2-465891-3 Jul 18 03:00:51.408129 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-c14a17a7-f3aa-49cd-876f-1c924c47f4b9 req-164f9a12-0440-497e-857b-50f96c598133 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129349 Jul 18 03:00:51.412833 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2890/5785] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:00:51.840446 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-611d6231-86fa-4a8d-b75e-3641f033ca4d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:51.916899 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-611d6231-86fa-4a8d-b75e-3641f033ca4d tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518" status: 200 len: 1695 microversion: 2.1 time: 1.758101 Jul 18 03:00:51.921844 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2896/5786] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:50 2022] GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518 => generated 1695 bytes in 1769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:00:52.958898 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ea5532b4-5f16-49c7-a592-c5c92ac182f7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:52.960275 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ea5532b4-5f16-49c7-a592-c5c92ac182f7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:53.032575 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea5532b4-5f16-49c7-a592-c5c92ac182f7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:53.033067 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea5532b4-5f16-49c7-a592-c5c92ac182f7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:53.065152 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea5532b4-5f16-49c7-a592-c5c92ac182f7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:53.066151 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea5532b4-5f16-49c7-a592-c5c92ac182f7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:53.132585 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=96 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:00:53.957415 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-10ed72b2-3844-4463-b659-44f692c5a23a req-8fa5238f-a443-48e8-ba61-d60dbafc9f67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f94423aa-e701-4f83-a4ce-8d5a90325518", "name": "network-vif-unplugged", "status": "completed", "tag": "17631478-219a-40dd-94fe-c981bae41eae"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:00:54.058804 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-10ed72b2-3844-4463-b659-44f692c5a23a req-8fa5238f-a443-48e8-ba61-d60dbafc9f67 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:54.059908 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-10ed72b2-3844-4463-b659-44f692c5a23a req-8fa5238f-a443-48e8-ba61-d60dbafc9f67 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:54.130174 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-10ed72b2-3844-4463-b659-44f692c5a23a req-8fa5238f-a443-48e8-ba61-d60dbafc9f67 service nova] Creating event network-vif-unplugged:17631478-219a-40dd-94fe-c981bae41eae for instance f94423aa-e701-4f83-a4ce-8d5a90325518 on n-h1-465891-3 Jul 18 03:00:54.162112 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-10ed72b2-3844-4463-b659-44f692c5a23a req-8fa5238f-a443-48e8-ba61-d60dbafc9f67 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 1.169187 Jul 18 03:00:54.165872 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2897/5787] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:00:54.196748 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-03c6ede8-e852-4119-af4d-9f4043c37a7e req-e7baf8fc-e221-446c-9805-e5bbc2f2857e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3f6cb59-1116-43f4-86e4-c97c597f8dfd", "tag": "74113a7b-30c1-4349-9bdd-e20b4d47ab9f"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:00:54.247395 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-03c6ede8-e852-4119-af4d-9f4043c37a7e req-e7baf8fc-e221-446c-9805-e5bbc2f2857e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:54.250615 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-03c6ede8-e852-4119-af4d-9f4043c37a7e req-e7baf8fc-e221-446c-9805-e5bbc2f2857e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:54.337219 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-03c6ede8-e852-4119-af4d-9f4043c37a7e req-e7baf8fc-e221-446c-9805-e5bbc2f2857e service nova] Creating event network-changed:74113a7b-30c1-4349-9bdd-e20b4d47ab9f for instance e3f6cb59-1116-43f4-86e4-c97c597f8dfd on n-h2-465891-3 Jul 18 03:00:54.368410 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-03c6ede8-e852-4119-af4d-9f4043c37a7e req-e7baf8fc-e221-446c-9805-e5bbc2f2857e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.198573 Jul 18 03:00:54.369619 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2898/5788] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:00:54.729470 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ea5532b4-5f16-49c7-a592-c5c92ac182f7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:54.759764 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ea5532b4-5f16-49c7-a592-c5c92ac182f7 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518" status: 200 len: 1695 microversion: 2.1 time: 1.818266 Jul 18 03:00:54.760997 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2891/5789] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:52 2022] GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518 => generated 1695 bytes in 1827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:55.799205 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-620e350b-fcdf-4c0d-a6e8-61a5fbc1f697 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:55.800655 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-620e350b-fcdf-4c0d-a6e8-61a5fbc1f697 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:55.835685 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-620e350b-fcdf-4c0d-a6e8-61a5fbc1f697 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:55.837463 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-620e350b-fcdf-4c0d-a6e8-61a5fbc1f697 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:55.838777 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-620e350b-fcdf-4c0d-a6e8-61a5fbc1f697 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:55.839651 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-620e350b-fcdf-4c0d-a6e8-61a5fbc1f697 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:57.101045 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-d9876425-856d-4bae-b8c8-5d82b321fae0 req-66b4bdd8-2530-4d90-ae2e-98746cca586f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f94423aa-e701-4f83-a4ce-8d5a90325518", "name": "network-vif-plugged", "status": "completed", "tag": "17631478-219a-40dd-94fe-c981bae41eae"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:00:57.186370 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-d9876425-856d-4bae-b8c8-5d82b321fae0 req-66b4bdd8-2530-4d90-ae2e-98746cca586f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:57.187001 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-d9876425-856d-4bae-b8c8-5d82b321fae0 req-66b4bdd8-2530-4d90-ae2e-98746cca586f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:57.267523 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-d9876425-856d-4bae-b8c8-5d82b321fae0 req-66b4bdd8-2530-4d90-ae2e-98746cca586f service nova] Creating event network-vif-plugged:17631478-219a-40dd-94fe-c981bae41eae for instance f94423aa-e701-4f83-a4ce-8d5a90325518 on n-h1-465891-3 Jul 18 03:00:57.290938 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-d9876425-856d-4bae-b8c8-5d82b321fae0 req-66b4bdd8-2530-4d90-ae2e-98746cca586f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.201406 Jul 18 03:00:57.303420 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2892/5790] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:00:58.276479 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-620e350b-fcdf-4c0d-a6e8-61a5fbc1f697 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:58.318405 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-620e350b-fcdf-4c0d-a6e8-61a5fbc1f697 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518" status: 200 len: 1680 microversion: 2.1 time: 2.522956 Jul 18 03:00:58.326547 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2899/5791] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:55 2022] GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518 => generated 1680 bytes in 2542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:00.444284 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3e08438d-e6dc-4c3c-aec3-2071ef3daafc tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1378240437", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "1cb524ed-3e8e-4c02-afab-240ae190dc3c"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:01:00.676476 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-3e08438d-e6dc-4c3c-aec3-2071ef3daafc tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] validate_networks() for [('1cb524ed-3e8e-4c02-afab-240ae190dc3c', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:01:02.124450 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-3e08438d-e6dc-4c3c-aec3-2071ef3daafc tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:01:02.125604 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-3e08438d-e6dc-4c3c-aec3-2071ef3daafc tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:01:02.126147 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-3e08438d-e6dc-4c3c-aec3-2071ef3daafc tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:01:02.126570 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-3e08438d-e6dc-4c3c-aec3-2071ef3daafc tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:01:02.126989 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-3e08438d-e6dc-4c3c-aec3-2071ef3daafc tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:01:02.145076 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3e08438d-e6dc-4c3c-aec3-2071ef3daafc tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:02.147806 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3e08438d-e6dc-4c3c-aec3-2071ef3daafc tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:02.150844 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3e08438d-e6dc-4c3c-aec3-2071ef3daafc tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:02.154428 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3e08438d-e6dc-4c3c-aec3-2071ef3daafc tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:02.222708 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-3e08438d-e6dc-4c3c-aec3-2071ef3daafc tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Getting quotas for project 93e31db8505b48f9bfdb5e3eff203e49. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:01:02.253849 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-3e08438d-e6dc-4c3c-aec3-2071ef3daafc tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Getting quotas for user 5461a8d21e82477f98946e1558d74e8a and project 93e31db8505b48f9bfdb5e3eff203e49. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:01:02.304268 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3e08438d-e6dc-4c3c-aec3-2071ef3daafc tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:01:02.307839 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3e08438d-e6dc-4c3c-aec3-2071ef3daafc tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] [instance: d3446df8-3752-4830-8f3b-8acd01556864] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:01:02.464823 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3e08438d-e6dc-4c3c-aec3-2071ef3daafc tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.530883 Jul 18 03:01:02.476444 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8010a96d-7f28-4486-8a94-2d2b46edbcd8 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:02.478607 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8010a96d-7f28-4486-8a94-2d2b46edbcd8 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] [instance: d3446df8-3752-4830-8f3b-8acd01556864] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:02.483480 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2893/5792] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:00:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:01:02.622380 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8010a96d-7f28-4486-8a94-2d2b46edbcd8 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461a8d21e82477f98946e1558d74e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e31db8505b48f9bfdb5e3eff203e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:02.653942 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8010a96d-7f28-4486-8a94-2d2b46edbcd8 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] 10.222.0.57 "GET /compute/v2.1/servers/d3446df8-3752-4830-8f3b-8acd01556864" status: 200 len: 1225 microversion: 2.1 time: 0.180782 Jul 18 03:01:02.682418 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2900/5793] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:02 2022] GET /compute/v2.1/servers/d3446df8-3752-4830-8f3b-8acd01556864 => generated 1225 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:03.685325 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8cf509f8-023c-4826-b0e7-f74cdade871c tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:03.693631 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8cf509f8-023c-4826-b0e7-f74cdade871c tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] [instance: d3446df8-3752-4830-8f3b-8acd01556864] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:03.903312 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8cf509f8-023c-4826-b0e7-f74cdade871c tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461a8d21e82477f98946e1558d74e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e31db8505b48f9bfdb5e3eff203e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:03.913564 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8cf509f8-023c-4826-b0e7-f74cdade871c tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] 10.222.0.57 "GET /compute/v2.1/servers/d3446df8-3752-4830-8f3b-8acd01556864" status: 200 len: 1225 microversion: 2.1 time: 0.237236 Jul 18 03:01:03.922188 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2894/5794] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:03 2022] GET /compute/v2.1/servers/d3446df8-3752-4830-8f3b-8acd01556864 => generated 1225 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:04.946608 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a8c8ba27-62c9-4d58-a5dc-b677d6ec71ca tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:04.954023 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a8c8ba27-62c9-4d58-a5dc-b677d6ec71ca tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] [instance: d3446df8-3752-4830-8f3b-8acd01556864] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:04.995025 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a8c8ba27-62c9-4d58-a5dc-b677d6ec71ca tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:04.999236 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a8c8ba27-62c9-4d58-a5dc-b677d6ec71ca tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:05.004362 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a8c8ba27-62c9-4d58-a5dc-b677d6ec71ca tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:05.009440 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a8c8ba27-62c9-4d58-a5dc-b677d6ec71ca tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:05.284500 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a8c8ba27-62c9-4d58-a5dc-b677d6ec71ca tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461a8d21e82477f98946e1558d74e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e31db8505b48f9bfdb5e3eff203e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:05.309390 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a8c8ba27-62c9-4d58-a5dc-b677d6ec71ca tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] 10.222.0.57 "GET /compute/v2.1/servers/d3446df8-3752-4830-8f3b-8acd01556864" status: 200 len: 1221 microversion: 2.1 time: 0.372037 Jul 18 03:01:05.311560 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2901/5795] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:04 2022] GET /compute/v2.1/servers/d3446df8-3752-4830-8f3b-8acd01556864 => generated 1221 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:06.334388 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9acde862-4467-442f-80b8-29b038d71c17 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:06.337345 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9acde862-4467-442f-80b8-29b038d71c17 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] [instance: d3446df8-3752-4830-8f3b-8acd01556864] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:06.356536 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9acde862-4467-442f-80b8-29b038d71c17 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:06.363824 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9acde862-4467-442f-80b8-29b038d71c17 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:06.371975 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9acde862-4467-442f-80b8-29b038d71c17 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:06.374370 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9acde862-4467-442f-80b8-29b038d71c17 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:06.573932 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9acde862-4467-442f-80b8-29b038d71c17 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461a8d21e82477f98946e1558d74e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e31db8505b48f9bfdb5e3eff203e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:06.584680 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9acde862-4467-442f-80b8-29b038d71c17 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] 10.222.0.57 "GET /compute/v2.1/servers/d3446df8-3752-4830-8f3b-8acd01556864" status: 200 len: 1283 microversion: 2.1 time: 0.257984 Jul 18 03:01:06.585860 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2895/5796] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:06 2022] GET /compute/v2.1/servers/d3446df8-3752-4830-8f3b-8acd01556864 => generated 1283 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:01:07.619638 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a6bc3592-0767-4d1d-a3b9-e4459dca2fa0 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:07.621317 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a6bc3592-0767-4d1d-a3b9-e4459dca2fa0 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] [instance: d3446df8-3752-4830-8f3b-8acd01556864] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:07.659017 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a6bc3592-0767-4d1d-a3b9-e4459dca2fa0 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:07.662971 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a6bc3592-0767-4d1d-a3b9-e4459dca2fa0 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:07.667894 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a6bc3592-0767-4d1d-a3b9-e4459dca2fa0 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:07.671238 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a6bc3592-0767-4d1d-a3b9-e4459dca2fa0 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:08.214070 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a6bc3592-0767-4d1d-a3b9-e4459dca2fa0 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461a8d21e82477f98946e1558d74e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e31db8505b48f9bfdb5e3eff203e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:08.239257 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a6bc3592-0767-4d1d-a3b9-e4459dca2fa0 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] 10.222.0.57 "GET /compute/v2.1/servers/d3446df8-3752-4830-8f3b-8acd01556864" status: 200 len: 1325 microversion: 2.1 time: 0.626337 Jul 18 03:01:08.244393 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2902/5797] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:07 2022] GET /compute/v2.1/servers/d3446df8-3752-4830-8f3b-8acd01556864 => generated 1325 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:01:09.276492 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8a61a0b8-da12-48c4-93c7-30af8739ab52 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:09.277379 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8a61a0b8-da12-48c4-93c7-30af8739ab52 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] [instance: d3446df8-3752-4830-8f3b-8acd01556864] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:09.294911 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a61a0b8-da12-48c4-93c7-30af8739ab52 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:09.298100 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a61a0b8-da12-48c4-93c7-30af8739ab52 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:09.299141 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a61a0b8-da12-48c4-93c7-30af8739ab52 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:09.299603 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a61a0b8-da12-48c4-93c7-30af8739ab52 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:09.921961 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8a61a0b8-da12-48c4-93c7-30af8739ab52 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461a8d21e82477f98946e1558d74e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e31db8505b48f9bfdb5e3eff203e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:09.939331 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8a61a0b8-da12-48c4-93c7-30af8739ab52 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] 10.222.0.57 "GET /compute/v2.1/servers/d3446df8-3752-4830-8f3b-8acd01556864" status: 200 len: 1325 microversion: 2.1 time: 0.668956 Jul 18 03:01:09.943647 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2896/5798] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:09 2022] GET /compute/v2.1/servers/d3446df8-3752-4830-8f3b-8acd01556864 => generated 1325 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:10.342139 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-19017d57-8c6a-4196-963f-e04fef0436e2 req-5bbde7f1-2236-49b3-8403-fdeac60156c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3446df8-3752-4830-8f3b-8acd01556864", "tag": "2098d0e6-5dc7-4d7d-8421-8f32a3c59069"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:01:10.374759 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-19017d57-8c6a-4196-963f-e04fef0436e2 req-5bbde7f1-2236-49b3-8403-fdeac60156c6 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:10.376183 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-19017d57-8c6a-4196-963f-e04fef0436e2 req-5bbde7f1-2236-49b3-8403-fdeac60156c6 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:10.400125 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=48 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:01:10.421750 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-19017d57-8c6a-4196-963f-e04fef0436e2 req-5bbde7f1-2236-49b3-8403-fdeac60156c6 service nova] Creating event network-changed:2098d0e6-5dc7-4d7d-8421-8f32a3c59069 for instance d3446df8-3752-4830-8f3b-8acd01556864 on n-h1-465891-3 Jul 18 03:01:10.434201 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-19017d57-8c6a-4196-963f-e04fef0436e2 req-5bbde7f1-2236-49b3-8403-fdeac60156c6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107824 Jul 18 03:01:10.437580 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2903/5799] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:01:10.978829 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-eef3fdc7-ba89-4e0b-8b63-17db52570d2a tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:10.980253 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-eef3fdc7-ba89-4e0b-8b63-17db52570d2a tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] [instance: d3446df8-3752-4830-8f3b-8acd01556864] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:11.008874 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eef3fdc7-ba89-4e0b-8b63-17db52570d2a tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:11.009343 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eef3fdc7-ba89-4e0b-8b63-17db52570d2a tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:11.014757 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eef3fdc7-ba89-4e0b-8b63-17db52570d2a tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:11.016142 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eef3fdc7-ba89-4e0b-8b63-17db52570d2a tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:11.548129 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-eef3fdc7-ba89-4e0b-8b63-17db52570d2a tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461a8d21e82477f98946e1558d74e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e31db8505b48f9bfdb5e3eff203e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:11.577220 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-eef3fdc7-ba89-4e0b-8b63-17db52570d2a tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] 10.222.0.57 "GET /compute/v2.1/servers/d3446df8-3752-4830-8f3b-8acd01556864" status: 200 len: 1325 microversion: 2.1 time: 0.603866 Jul 18 03:01:11.579417 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2897/5800] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:10 2022] GET /compute/v2.1/servers/d3446df8-3752-4830-8f3b-8acd01556864 => generated 1325 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:12.607831 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-33251443-3758-43b4-9468-19a0e461f3f1 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:12.608701 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-33251443-3758-43b4-9468-19a0e461f3f1 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] [instance: d3446df8-3752-4830-8f3b-8acd01556864] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:12.626945 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=24 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:01:12.629579 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-33251443-3758-43b4-9468-19a0e461f3f1 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:12.631246 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-33251443-3758-43b4-9468-19a0e461f3f1 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:12.635569 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-33251443-3758-43b4-9468-19a0e461f3f1 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:12.636835 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-33251443-3758-43b4-9468-19a0e461f3f1 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:12.729464 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:01:13.049951 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-33251443-3758-43b4-9468-19a0e461f3f1 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461a8d21e82477f98946e1558d74e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e31db8505b48f9bfdb5e3eff203e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:13.075736 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-33251443-3758-43b4-9468-19a0e461f3f1 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] 10.222.0.57 "GET /compute/v2.1/servers/d3446df8-3752-4830-8f3b-8acd01556864" status: 200 len: 1325 microversion: 2.1 time: 0.473630 Jul 18 03:01:13.090587 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2904/5801] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:12 2022] GET /compute/v2.1/servers/d3446df8-3752-4830-8f3b-8acd01556864 => generated 1325 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:14.109928 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5e1f7026-a526-421b-ace1-eecf7532f529 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:14.111312 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5e1f7026-a526-421b-ace1-eecf7532f529 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] [instance: d3446df8-3752-4830-8f3b-8acd01556864] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:14.133551 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:01:14.134884 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=8 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:01:14.137252 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:01:14.153093 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5e1f7026-a526-421b-ace1-eecf7532f529 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:14.154162 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5e1f7026-a526-421b-ace1-eecf7532f529 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:14.155418 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5e1f7026-a526-421b-ace1-eecf7532f529 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:14.156236 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5e1f7026-a526-421b-ace1-eecf7532f529 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:14.884784 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5e1f7026-a526-421b-ace1-eecf7532f529 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461a8d21e82477f98946e1558d74e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e31db8505b48f9bfdb5e3eff203e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:14.905369 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5e1f7026-a526-421b-ace1-eecf7532f529 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] 10.222.0.57 "GET /compute/v2.1/servers/d3446df8-3752-4830-8f3b-8acd01556864" status: 200 len: 1325 microversion: 2.1 time: 0.799798 Jul 18 03:01:14.913120 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2898/5802] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:14 2022] GET /compute/v2.1/servers/d3446df8-3752-4830-8f3b-8acd01556864 => generated 1325 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:15.943863 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-61cbf2be-78db-4a67-a2ae-d7acc8a6d59e tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:15.944969 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-61cbf2be-78db-4a67-a2ae-d7acc8a6d59e tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] [instance: d3446df8-3752-4830-8f3b-8acd01556864] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:15.979860 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-61cbf2be-78db-4a67-a2ae-d7acc8a6d59e tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:15.980423 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-61cbf2be-78db-4a67-a2ae-d7acc8a6d59e tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:15.984487 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-61cbf2be-78db-4a67-a2ae-d7acc8a6d59e tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:15.989290 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-61cbf2be-78db-4a67-a2ae-d7acc8a6d59e tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:16.363582 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-61cbf2be-78db-4a67-a2ae-d7acc8a6d59e tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461a8d21e82477f98946e1558d74e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e31db8505b48f9bfdb5e3eff203e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:16.376958 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-61cbf2be-78db-4a67-a2ae-d7acc8a6d59e tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] 10.222.0.57 "GET /compute/v2.1/servers/d3446df8-3752-4830-8f3b-8acd01556864" status: 200 len: 1325 microversion: 2.1 time: 0.439893 Jul 18 03:01:16.387781 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2905/5803] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:15 2022] GET /compute/v2.1/servers/d3446df8-3752-4830-8f3b-8acd01556864 => generated 1325 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:16.944418 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-17aae5e8-1de7-4325-b03f-d4203fb6bb68 req-8b50b0d7-3f31-41eb-a99e-4e6b2f47f7b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3446df8-3752-4830-8f3b-8acd01556864", "name": "network-vif-plugged", "status": "completed", "tag": "2098d0e6-5dc7-4d7d-8421-8f32a3c59069"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:01:16.993545 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-17aae5e8-1de7-4325-b03f-d4203fb6bb68 req-8b50b0d7-3f31-41eb-a99e-4e6b2f47f7b8 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:16.994354 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-17aae5e8-1de7-4325-b03f-d4203fb6bb68 req-8b50b0d7-3f31-41eb-a99e-4e6b2f47f7b8 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:17.024348 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-17aae5e8-1de7-4325-b03f-d4203fb6bb68 req-8b50b0d7-3f31-41eb-a99e-4e6b2f47f7b8 service nova] Creating event network-vif-plugged:2098d0e6-5dc7-4d7d-8421-8f32a3c59069 for instance d3446df8-3752-4830-8f3b-8acd01556864 on n-h1-465891-3 Jul 18 03:01:17.038787 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-17aae5e8-1de7-4325-b03f-d4203fb6bb68 req-8b50b0d7-3f31-41eb-a99e-4e6b2f47f7b8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105419 Jul 18 03:01:17.042699 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2899/5804] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:01:17.405670 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1c71be1a-e6f0-4853-9521-21b7c844eda7 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:17.407985 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1c71be1a-e6f0-4853-9521-21b7c844eda7 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] [instance: d3446df8-3752-4830-8f3b-8acd01556864] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:17.441746 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c71be1a-e6f0-4853-9521-21b7c844eda7 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:17.442525 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c71be1a-e6f0-4853-9521-21b7c844eda7 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:17.443946 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c71be1a-e6f0-4853-9521-21b7c844eda7 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:17.444696 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c71be1a-e6f0-4853-9521-21b7c844eda7 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:17.809312 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1c71be1a-e6f0-4853-9521-21b7c844eda7 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461a8d21e82477f98946e1558d74e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e31db8505b48f9bfdb5e3eff203e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:17.855115 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1c71be1a-e6f0-4853-9521-21b7c844eda7 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] 10.222.0.57 "GET /compute/v2.1/servers/d3446df8-3752-4830-8f3b-8acd01556864" status: 200 len: 1325 microversion: 2.1 time: 0.458471 Jul 18 03:01:17.856696 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2906/5805] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:17 2022] GET /compute/v2.1/servers/d3446df8-3752-4830-8f3b-8acd01556864 => generated 1325 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:18.876244 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e341d219-26d0-4f3a-9564-d636e7b0f3b1 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:18.877080 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e341d219-26d0-4f3a-9564-d636e7b0f3b1 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] [instance: d3446df8-3752-4830-8f3b-8acd01556864] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:18.892318 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e341d219-26d0-4f3a-9564-d636e7b0f3b1 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:18.894714 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e341d219-26d0-4f3a-9564-d636e7b0f3b1 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:18.896287 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e341d219-26d0-4f3a-9564-d636e7b0f3b1 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:18.896871 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e341d219-26d0-4f3a-9564-d636e7b0f3b1 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:19.208222 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e341d219-26d0-4f3a-9564-d636e7b0f3b1 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461a8d21e82477f98946e1558d74e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e31db8505b48f9bfdb5e3eff203e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:19.221976 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e341d219-26d0-4f3a-9564-d636e7b0f3b1 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] 10.222.0.57 "GET /compute/v2.1/servers/d3446df8-3752-4830-8f3b-8acd01556864" status: 200 len: 1522 microversion: 2.1 time: 0.351176 Jul 18 03:01:19.234138 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2900/5806] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:18 2022] GET /compute/v2.1/servers/d3446df8-3752-4830-8f3b-8acd01556864 => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:19.245371 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-42d70fe8-65a6-4ebf-a18e-a6e2591ab3ac tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:19.246257 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-42d70fe8-65a6-4ebf-a18e-a6e2591ab3ac tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] [instance: d3446df8-3752-4830-8f3b-8acd01556864] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:19.254887 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-42d70fe8-65a6-4ebf-a18e-a6e2591ab3ac tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:19.255641 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-42d70fe8-65a6-4ebf-a18e-a6e2591ab3ac tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:19.256730 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-42d70fe8-65a6-4ebf-a18e-a6e2591ab3ac tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:19.257363 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-42d70fe8-65a6-4ebf-a18e-a6e2591ab3ac tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:19.297403 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-42d70fe8-65a6-4ebf-a18e-a6e2591ab3ac tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] HTTP exception thrown: Instance is not a member of specified network Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-42d70fe8-65a6-4ebf-a18e-a6e2591ab3ac tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Request method failure captured: Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/d3446df8-3752-4830-8f3b-8acd01556864/ips/invalid HTTP/1.1 Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MzrKTjJ64Hvt8_k39d6NMQVbWDD5Wvf2vLo75vtKlLJ1wZ_chfNRe39aRZCmZZFaEinUEdl4XlBIS-0r_SHXmVQBW0PkbmdEivrpzXvj4pzhYg16-_flSgAXCMzUO4lkyCwsePMSuinP_r8DaJhLM4wiC8Ql1VBApyfNEgl_D5vLZ0 Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 93e31db8505b48f9bfdb5e3eff203e49 Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-821880565 Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_93e31db8505b48f9bfdb5e3eff203e49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/93e31db8505b48f9bfdb5e3eff203e49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/93e31db8505b48f9bfdb5e3eff203e49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/93e31db8505b48f9bfdb5e3eff203e49"}]}] Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-821880565 Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 93e31db8505b48f9bfdb5e3eff203e49 Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-821880565 Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServerAddressesNegativeTestJSON-821880565-project Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 5461a8d21e82477f98946e1558d74e8a Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-821880565-project Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance is not a member of specified network Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'server_id': 'd3446df8-3752-4830-8f3b-8acd01556864', 'id': 'invalid'} Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Jul 18 03:01:19.309292 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:01:19.314973 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-42d70fe8-65a6-4ebf-a18e-a6e2591ab3ac tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Returning 404 to user: Instance is not a member of specified network {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:01:19.314973 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-42d70fe8-65a6-4ebf-a18e-a6e2591ab3ac tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] 10.222.0.57 "GET /compute/v2.1/servers/d3446df8-3752-4830-8f3b-8acd01556864/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.073577 Jul 18 03:01:19.314973 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2907/5807] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 03:01:19 2022] GET /compute/v2.1/servers/d3446df8-3752-4830-8f3b-8acd01556864/ips/invalid => generated 91 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 18 03:01:19.329633 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f125dfdb-048a-4610-b496-70aa8726d21a tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:19.331344 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f125dfdb-048a-4610-b496-70aa8726d21a tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Failed to fetch instance by id 999 {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 18 03:01:19.332319 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-f125dfdb-048a-4610-b496-70aa8726d21a tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] HTTP exception thrown: Instance 999 could not be found. Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f125dfdb-048a-4610-b496-70aa8726d21a tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Request method failure captured: Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MzrKTjJ64Hvt8_k39d6NMQVbWDD5Wvf2vLo75vtKlLJ1wZ_chfNRe39aRZCmZZFaEinUEdl4XlBIS-0r_SHXmVQBW0PkbmdEivrpzXvj4pzhYg16-_flSgAXCMzUO4lkyCwsePMSuinP_r8DaJhLM4wiC8Ql1VBApyfNEgl_D5vLZ0 Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 93e31db8505b48f9bfdb5e3eff203e49 Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-821880565 Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_93e31db8505b48f9bfdb5e3eff203e49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/93e31db8505b48f9bfdb5e3eff203e49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/93e31db8505b48f9bfdb5e3eff203e49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/93e31db8505b48f9bfdb5e3eff203e49"}]}] Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-821880565 Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 93e31db8505b48f9bfdb5e3eff203e49 Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-821880565 Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServerAddressesNegativeTestJSON-821880565-project Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 5461a8d21e82477f98946e1558d74e8a Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-821880565-project Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 999 could not be found. Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'server_id': '999'} Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 18 03:01:19.335720 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:01:19.347989 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f125dfdb-048a-4610-b496-70aa8726d21a tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Returning 404 to user: Instance 999 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:01:19.350327 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f125dfdb-048a-4610-b496-70aa8726d21a tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] 10.222.0.57 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.028224 Jul 18 03:01:19.350980 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2901/5808] 10.222.0.57 () {58 vars in 1148 bytes} [Mon Jul 18 03:01:19 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 03:01:19.362832 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-097600aa-23b3-40fa-8b19-f6a46d6f0bc8 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:19.363421 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-097600aa-23b3-40fa-8b19-f6a46d6f0bc8 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] [instance: d3446df8-3752-4830-8f3b-8acd01556864] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:19.373862 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-097600aa-23b3-40fa-8b19-f6a46d6f0bc8 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:19.377835 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-097600aa-23b3-40fa-8b19-f6a46d6f0bc8 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:19.380414 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-097600aa-23b3-40fa-8b19-f6a46d6f0bc8 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:19.380742 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-097600aa-23b3-40fa-8b19-f6a46d6f0bc8 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:19.432565 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-097600aa-23b3-40fa-8b19-f6a46d6f0bc8 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] [instance: d3446df8-3752-4830-8f3b-8acd01556864] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:01:19.633946 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-097600aa-23b3-40fa-8b19-f6a46d6f0bc8 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d3446df8-3752-4830-8f3b-8acd01556864" status: 204 len: 0 microversion: 2.1 time: 0.270063 Jul 18 03:01:19.633946 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2908/5809] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:01:19 2022] DELETE /compute/v2.1/servers/d3446df8-3752-4830-8f3b-8acd01556864 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:01:19.647042 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3203ad09-bdf2-4891-93b5-eb25e15fb4c2 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:19.649264 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3203ad09-bdf2-4891-93b5-eb25e15fb4c2 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] [instance: d3446df8-3752-4830-8f3b-8acd01556864] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:19.668365 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3203ad09-bdf2-4891-93b5-eb25e15fb4c2 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:19.670027 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3203ad09-bdf2-4891-93b5-eb25e15fb4c2 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:19.671916 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3203ad09-bdf2-4891-93b5-eb25e15fb4c2 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:19.672977 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3203ad09-bdf2-4891-93b5-eb25e15fb4c2 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:20.091428 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3203ad09-bdf2-4891-93b5-eb25e15fb4c2 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461a8d21e82477f98946e1558d74e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e31db8505b48f9bfdb5e3eff203e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:20.134500 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3203ad09-bdf2-4891-93b5-eb25e15fb4c2 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] 10.222.0.57 "GET /compute/v2.1/servers/d3446df8-3752-4830-8f3b-8acd01556864" status: 200 len: 1528 microversion: 2.1 time: 0.493268 Jul 18 03:01:20.135511 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2902/5810] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:19 2022] GET /compute/v2.1/servers/d3446df8-3752-4830-8f3b-8acd01556864 => generated 1528 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:21.163440 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-521a3749-640f-4fd6-94e0-32b4d9dd4776 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:21.169859 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-521a3749-640f-4fd6-94e0-32b4d9dd4776 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] [instance: d3446df8-3752-4830-8f3b-8acd01556864] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:21.199728 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-521a3749-640f-4fd6-94e0-32b4d9dd4776 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:21.200685 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-521a3749-640f-4fd6-94e0-32b4d9dd4776 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:21.201810 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-521a3749-640f-4fd6-94e0-32b4d9dd4776 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:21.202548 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-521a3749-640f-4fd6-94e0-32b4d9dd4776 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:21.619376 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-521a3749-640f-4fd6-94e0-32b4d9dd4776 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461a8d21e82477f98946e1558d74e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e31db8505b48f9bfdb5e3eff203e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:21.630247 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-521a3749-640f-4fd6-94e0-32b4d9dd4776 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] 10.222.0.57 "GET /compute/v2.1/servers/d3446df8-3752-4830-8f3b-8acd01556864" status: 200 len: 1528 microversion: 2.1 time: 0.477602 Jul 18 03:01:21.638488 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2909/5811] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:21 2022] GET /compute/v2.1/servers/d3446df8-3752-4830-8f3b-8acd01556864 => generated 1528 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:22.196433 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-faad5ebc-893a-4556-ba69-ede407fe27e8 req-8108b327-e8f8-455c-8c45-c8d8e15b349d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3446df8-3752-4830-8f3b-8acd01556864", "name": "network-vif-deleted", "tag": "2098d0e6-5dc7-4d7d-8421-8f32a3c59069"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:01:22.210034 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-faad5ebc-893a-4556-ba69-ede407fe27e8 req-8108b327-e8f8-455c-8c45-c8d8e15b349d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:22.212107 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-faad5ebc-893a-4556-ba69-ede407fe27e8 req-8108b327-e8f8-455c-8c45-c8d8e15b349d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:22.231663 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-faad5ebc-893a-4556-ba69-ede407fe27e8 req-8108b327-e8f8-455c-8c45-c8d8e15b349d service nova] Creating event network-vif-deleted:2098d0e6-5dc7-4d7d-8421-8f32a3c59069 for instance d3446df8-3752-4830-8f3b-8acd01556864 on n-h1-465891-3 Jul 18 03:01:22.241848 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-faad5ebc-893a-4556-ba69-ede407fe27e8 req-8108b327-e8f8-455c-8c45-c8d8e15b349d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050773 Jul 18 03:01:22.243906 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2903/5812] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:01:22.665745 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-77cbf6b9-6394-48c0-a605-6eba318eb4d3 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:22.671136 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d9085288-b3a7-4c72-bdc2-a6fba96b4e1f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-304505033", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-233278274", "security_groups": [{"name": "tempest-secgroup-smoke-2032229349"}], "block_device_mapping_v2": [{"uuid": "6214934c-229c-40ce-9a17-f13a741b68a9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ba77f5bb-f255-444f-9bd1-1e3dbe42d430"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:01:22.686245 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-77cbf6b9-6394-48c0-a605-6eba318eb4d3 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] [instance: d3446df8-3752-4830-8f3b-8acd01556864] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:22.709589 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77cbf6b9-6394-48c0-a605-6eba318eb4d3 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:22.712118 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77cbf6b9-6394-48c0-a605-6eba318eb4d3 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:22.716931 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77cbf6b9-6394-48c0-a605-6eba318eb4d3 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:22.718792 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77cbf6b9-6394-48c0-a605-6eba318eb4d3 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:22.829084 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77cbf6b9-6394-48c0-a605-6eba318eb4d3 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:22.830272 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77cbf6b9-6394-48c0-a605-6eba318eb4d3 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:22.831297 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-77cbf6b9-6394-48c0-a605-6eba318eb4d3 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lazy-loading 'fault' on Instance uuid d3446df8-3752-4830-8f3b-8acd01556864 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:01:22.962099 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-77cbf6b9-6394-48c0-a605-6eba318eb4d3 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461a8d21e82477f98946e1558d74e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e31db8505b48f9bfdb5e3eff203e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:22.978104 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-77cbf6b9-6394-48c0-a605-6eba318eb4d3 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] 10.222.0.57 "GET /compute/v2.1/servers/d3446df8-3752-4830-8f3b-8acd01556864" status: 200 len: 1315 microversion: 2.1 time: 0.323845 Jul 18 03:01:23.002938 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2910/5813] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:22 2022] GET /compute/v2.1/servers/d3446df8-3752-4830-8f3b-8acd01556864 => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:23.035523 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-d9085288-b3a7-4c72-bdc2-a6fba96b4e1f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] validate_networks() for [('ba77f5bb-f255-444f-9bd1-1e3dbe42d430', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:01:23.619663 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-d9085288-b3a7-4c72-bdc2-a6fba96b4e1f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:01:23.621468 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-d9085288-b3a7-4c72-bdc2-a6fba96b4e1f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:01:23.622471 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-d9085288-b3a7-4c72-bdc2-a6fba96b4e1f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:01:23.623216 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-d9085288-b3a7-4c72-bdc2-a6fba96b4e1f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:01:23.623961 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-d9085288-b3a7-4c72-bdc2-a6fba96b4e1f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:01:23.640204 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d9085288-b3a7-4c72-bdc2-a6fba96b4e1f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:23.640976 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d9085288-b3a7-4c72-bdc2-a6fba96b4e1f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:23.642362 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d9085288-b3a7-4c72-bdc2-a6fba96b4e1f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:23.643175 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d9085288-b3a7-4c72-bdc2-a6fba96b4e1f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:23.657024 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=50 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:01:23.678011 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-d9085288-b3a7-4c72-bdc2-a6fba96b4e1f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Getting quotas for project 2b7654e273f6487ba83382da4f96056d. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:01:23.685455 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-d9085288-b3a7-4c72-bdc2-a6fba96b4e1f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Getting quotas for user d1afc1702f8045a396b98e5c24b124e7 and project 2b7654e273f6487ba83382da4f96056d. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:01:23.769037 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d9085288-b3a7-4c72-bdc2-a6fba96b4e1f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:01:23.774031 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d9085288-b3a7-4c72-bdc2-a6fba96b4e1f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6214934c-229c-40ce-9a17-f13a741b68a9',volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:01:23.975709 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d9085288-b3a7-4c72-bdc2-a6fba96b4e1f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.309601 Jul 18 03:01:23.976566 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2904/5814] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:01:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 1312 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:01:23.987938 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1340d8d0-601a-4729-8203-6a5e56faaca4 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:23.988715 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1340d8d0-601a-4729-8203-6a5e56faaca4 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:24.011576 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-003037dd-bdb0-4c6a-8dd0-b31b4213fb63 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:24.016995 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-003037dd-bdb0-4c6a-8dd0-b31b4213fb63 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] [instance: d3446df8-3752-4830-8f3b-8acd01556864] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:24.031848 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-003037dd-bdb0-4c6a-8dd0-b31b4213fb63 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:24.042029 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-003037dd-bdb0-4c6a-8dd0-b31b4213fb63 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:24.043311 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-003037dd-bdb0-4c6a-8dd0-b31b4213fb63 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:24.043847 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-003037dd-bdb0-4c6a-8dd0-b31b4213fb63 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:24.052900 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1340d8d0-601a-4729-8203-6a5e56faaca4 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:24.062210 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1340d8d0-601a-4729-8203-6a5e56faaca4 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e" status: 200 len: 1093 microversion: 2.1 time: 0.078386 Jul 18 03:01:24.072513 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2911/5815] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:23 2022] GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e => generated 1093 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:24.079978 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-003037dd-bdb0-4c6a-8dd0-b31b4213fb63 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] HTTP exception thrown: Instance d3446df8-3752-4830-8f3b-8acd01556864 could not be found. Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-003037dd-bdb0-4c6a-8dd0-b31b4213fb63 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Request method failure captured: Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/d3446df8-3752-4830-8f3b-8acd01556864 HTTP/1.1 Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MzrKTjJ64Hvt8_k39d6NMQVbWDD5Wvf2vLo75vtKlLJ1wZ_chfNRe39aRZCmZZFaEinUEdl4XlBIS-0r_SHXmVQBW0PkbmdEivrpzXvj4pzhYg16-_flSgAXCMzUO4lkyCwsePMSuinP_r8DaJhLM4wiC8Ql1VBApyfNEgl_D5vLZ0 Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 93e31db8505b48f9bfdb5e3eff203e49 Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-821880565 Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_93e31db8505b48f9bfdb5e3eff203e49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/93e31db8505b48f9bfdb5e3eff203e49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/93e31db8505b48f9bfdb5e3eff203e49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/93e31db8505b48f9bfdb5e3eff203e49"}]}] Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-821880565 Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 93e31db8505b48f9bfdb5e3eff203e49 Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-821880565 Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServerAddressesNegativeTestJSON-821880565-project Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 5461a8d21e82477f98946e1558d74e8a Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-821880565-project Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance d3446df8-3752-4830-8f3b-8acd01556864 could not be found. Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'd3446df8-3752-4830-8f3b-8acd01556864'} Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3446df8-3752-4830-8f3b-8acd01556864 could not be found. Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3446df8-3752-4830-8f3b-8acd01556864 could not be found. Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:01:24.082588 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:01:24.089954 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:01:24.089954 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:01:24.089954 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:01:24.089954 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:01:24.089954 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:01:24.089954 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:01:24.089954 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3446df8-3752-4830-8f3b-8acd01556864 could not be found. Jul 18 03:01:24.089954 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:01:24.089954 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-003037dd-bdb0-4c6a-8dd0-b31b4213fb63 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] Returning 404 to user: Instance d3446df8-3752-4830-8f3b-8acd01556864 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:01:24.089954 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-003037dd-bdb0-4c6a-8dd0-b31b4213fb63 tempest-ServerAddressesNegativeTestJSON-821880565 tempest-ServerAddressesNegativeTestJSON-821880565-project] 10.222.0.57 "GET /compute/v2.1/servers/d3446df8-3752-4830-8f3b-8acd01556864" status: 404 len: 111 microversion: 2.1 time: 0.077246 Jul 18 03:01:24.089954 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2905/5816] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:24 2022] GET /compute/v2.1/servers/d3446df8-3752-4830-8f3b-8acd01556864 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 03:01:25.082450 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-639ee47f-4551-4682-a13d-46ba82a9ae9c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:25.084779 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-639ee47f-4551-4682-a13d-46ba82a9ae9c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:25.103067 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-639ee47f-4551-4682-a13d-46ba82a9ae9c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:25.103878 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-639ee47f-4551-4682-a13d-46ba82a9ae9c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:25.105528 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-639ee47f-4551-4682-a13d-46ba82a9ae9c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:25.106859 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-639ee47f-4551-4682-a13d-46ba82a9ae9c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:25.221788 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-639ee47f-4551-4682-a13d-46ba82a9ae9c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:25.238619 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-639ee47f-4551-4682-a13d-46ba82a9ae9c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e" status: 200 len: 1191 microversion: 2.1 time: 0.161225 Jul 18 03:01:25.241025 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2912/5817] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:25 2022] GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e => generated 1191 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:26.270946 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f6fb7eb3-98e8-459c-b963-dbbed649ff47 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:26.278540 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f6fb7eb3-98e8-459c-b963-dbbed649ff47 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:26.294798 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f6fb7eb3-98e8-459c-b963-dbbed649ff47 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:26.296292 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f6fb7eb3-98e8-459c-b963-dbbed649ff47 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:26.297950 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f6fb7eb3-98e8-459c-b963-dbbed649ff47 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:26.298863 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f6fb7eb3-98e8-459c-b963-dbbed649ff47 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:26.563591 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f6fb7eb3-98e8-459c-b963-dbbed649ff47 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:26.591241 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f6fb7eb3-98e8-459c-b963-dbbed649ff47 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e" status: 200 len: 1209 microversion: 2.1 time: 0.316670 Jul 18 03:01:26.603097 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2906/5818] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:26 2022] GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e => generated 1209 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:27.614876 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bf5da6fe-1b99-4861-a26a-7a8bb0503297 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:27.623212 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bf5da6fe-1b99-4861-a26a-7a8bb0503297 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:27.644612 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bf5da6fe-1b99-4861-a26a-7a8bb0503297 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:27.649446 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bf5da6fe-1b99-4861-a26a-7a8bb0503297 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:27.662558 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bf5da6fe-1b99-4861-a26a-7a8bb0503297 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:27.663816 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bf5da6fe-1b99-4861-a26a-7a8bb0503297 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:27.928089 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bf5da6fe-1b99-4861-a26a-7a8bb0503297 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:27.958589 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bf5da6fe-1b99-4861-a26a-7a8bb0503297 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e" status: 200 len: 1209 microversion: 2.1 time: 0.350794 Jul 18 03:01:27.963165 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2913/5819] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:27 2022] GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e => generated 1209 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:28.992847 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2d4210ac-250a-43c5-b665-aefeec77782c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:28.997133 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2d4210ac-250a-43c5-b665-aefeec77782c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:29.015321 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2d4210ac-250a-43c5-b665-aefeec77782c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:29.015919 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2d4210ac-250a-43c5-b665-aefeec77782c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:29.016862 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2d4210ac-250a-43c5-b665-aefeec77782c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:29.017398 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2d4210ac-250a-43c5-b665-aefeec77782c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:29.073342 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-46edeb4c-c274-4781-99db-2573124aa75a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:01:29.076259 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-46edeb4c-c274-4781-99db-2573124aa75a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:29.117073 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-46edeb4c-c274-4781-99db-2573124aa75a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:29.119956 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-46edeb4c-c274-4781-99db-2573124aa75a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:29.122579 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-46edeb4c-c274-4781-99db-2573124aa75a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:29.123810 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-46edeb4c-c274-4781-99db-2573124aa75a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:29.299158 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-46edeb4c-c274-4781-99db-2573124aa75a tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "POST /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518/action" status: 200 len: 24566 microversion: 2.1 time: 0.235943 Jul 18 03:01:29.300940 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2914/5820] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:01:29 2022] POST /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518/action => generated 24566 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 03:01:29.896601 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2d4210ac-250a-43c5-b665-aefeec77782c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:29.919327 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2d4210ac-250a-43c5-b665-aefeec77782c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e" status: 200 len: 1277 microversion: 2.1 time: 0.935479 Jul 18 03:01:29.920197 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2907/5821] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:28 2022] GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e => generated 1277 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:30.959462 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3830bc23-1480-4c7c-84f3-eeea93873d23 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:30.961104 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3830bc23-1480-4c7c-84f3-eeea93873d23 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:30.983695 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3830bc23-1480-4c7c-84f3-eeea93873d23 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:30.986227 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3830bc23-1480-4c7c-84f3-eeea93873d23 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:30.988878 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3830bc23-1480-4c7c-84f3-eeea93873d23 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:30.992082 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3830bc23-1480-4c7c-84f3-eeea93873d23 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:31.316025 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-8a5a2832-cb9a-4c87-877d-925164c6a126 req-fd7ae1de-ef59-40ad-b4c0-c2be0c6205b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ecffdfb-225e-4bda-95e7-606ec4f5cb4e", "tag": "db3e621e-c1d9-4896-bda5-23d0f92165e3"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:01:31.377200 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-8a5a2832-cb9a-4c87-877d-925164c6a126 req-fd7ae1de-ef59-40ad-b4c0-c2be0c6205b8 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:31.377944 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-8a5a2832-cb9a-4c87-877d-925164c6a126 req-fd7ae1de-ef59-40ad-b4c0-c2be0c6205b8 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:31.432452 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-8a5a2832-cb9a-4c87-877d-925164c6a126 req-fd7ae1de-ef59-40ad-b4c0-c2be0c6205b8 service nova] Creating event network-changed:db3e621e-c1d9-4896-bda5-23d0f92165e3 for instance 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e on n-h2-465891-3 Jul 18 03:01:31.449299 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-8a5a2832-cb9a-4c87-877d-925164c6a126 req-fd7ae1de-ef59-40ad-b4c0-c2be0c6205b8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140453 Jul 18 03:01:31.466709 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2908/5822] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:01:32.250878 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3830bc23-1480-4c7c-84f3-eeea93873d23 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:32.311145 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3830bc23-1480-4c7c-84f3-eeea93873d23 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e" status: 200 len: 1277 microversion: 2.1 time: 1.360401 Jul 18 03:01:32.332401 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2915/5823] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:30 2022] GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e => generated 1277 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:33.343082 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b9cfc7ae-1aa7-4ab4-9633-0f0230141955 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:33.344024 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b9cfc7ae-1aa7-4ab4-9633-0f0230141955 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:33.375911 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b9cfc7ae-1aa7-4ab4-9633-0f0230141955 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:33.376629 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b9cfc7ae-1aa7-4ab4-9633-0f0230141955 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:33.383786 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b9cfc7ae-1aa7-4ab4-9633-0f0230141955 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:33.392826 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b9cfc7ae-1aa7-4ab4-9633-0f0230141955 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:33.457123 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9f7c8a1a-84e6-40e6-8b44-06d5324afce2 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:33.457772 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9f7c8a1a-84e6-40e6-8b44-06d5324afce2 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] [instance: e3f6cb59-1116-43f4-86e4-c97c597f8dfd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:33.490362 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9f7c8a1a-84e6-40e6-8b44-06d5324afce2 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:33.491425 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9f7c8a1a-84e6-40e6-8b44-06d5324afce2 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:33.493383 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9f7c8a1a-84e6-40e6-8b44-06d5324afce2 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:33.494578 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9f7c8a1a-84e6-40e6-8b44-06d5324afce2 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:33.594556 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9f7c8a1a-84e6-40e6-8b44-06d5324afce2 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] [instance: e3f6cb59-1116-43f4-86e4-c97c597f8dfd] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:01:33.656944 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:01:33.695101 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:01:33.804153 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9f7c8a1a-84e6-40e6-8b44-06d5324afce2 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] 10.222.0.57 "DELETE /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd" status: 204 len: 0 microversion: 2.1 time: 0.351576 Jul 18 03:01:33.806149 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2916/5824] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:01:33 2022] DELETE /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 03:01:33.813412 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-27f69aca-1567-4463-adfa-3d832ad8647c req-d6f0b742-ba11-4be5-b337-52b81382a47d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3f6cb59-1116-43f4-86e4-c97c597f8dfd", "tag": "74113a7b-30c1-4349-9bdd-e20b4d47ab9f"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:01:33.836918 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-27f69aca-1567-4463-adfa-3d832ad8647c req-d6f0b742-ba11-4be5-b337-52b81382a47d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:33.840224 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-27f69aca-1567-4463-adfa-3d832ad8647c req-d6f0b742-ba11-4be5-b337-52b81382a47d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:33.871547 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-27f69aca-1567-4463-adfa-3d832ad8647c req-d6f0b742-ba11-4be5-b337-52b81382a47d service nova] Creating event network-changed:74113a7b-30c1-4349-9bdd-e20b4d47ab9f for instance e3f6cb59-1116-43f4-86e4-c97c597f8dfd on n-h2-465891-3 Jul 18 03:01:33.882208 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-27f69aca-1567-4463-adfa-3d832ad8647c req-d6f0b742-ba11-4be5-b337-52b81382a47d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074137 Jul 18 03:01:33.889310 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2917/5825] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:01:33.896223 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a87d4335-d224-4669-8e96-44e6c85b0869 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:33.897790 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a87d4335-d224-4669-8e96-44e6c85b0869 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] [instance: e3f6cb59-1116-43f4-86e4-c97c597f8dfd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:33.907089 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a87d4335-d224-4669-8e96-44e6c85b0869 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:33.908035 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a87d4335-d224-4669-8e96-44e6c85b0869 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:33.909455 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a87d4335-d224-4669-8e96-44e6c85b0869 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:33.910264 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a87d4335-d224-4669-8e96-44e6c85b0869 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:34.058328 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:01:34.785461 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a87d4335-d224-4669-8e96-44e6c85b0869 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ef01d5252344a2bc2d36e13324a6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07627ceb27f2492fbb741a241edb2c5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:34.804568 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a87d4335-d224-4669-8e96-44e6c85b0869 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] 10.222.0.57 "GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd" status: 200 len: 1584 microversion: 2.1 time: 0.913400 Jul 18 03:01:34.808273 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2918/5826] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:33 2022] GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd => generated 1584 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:34.825207 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b9cfc7ae-1aa7-4ab4-9633-0f0230141955 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:34.835583 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b9cfc7ae-1aa7-4ab4-9633-0f0230141955 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e" status: 200 len: 1277 microversion: 2.1 time: 1.499868 Jul 18 03:01:34.847944 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2909/5827] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:33 2022] GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e => generated 1277 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:01:35.839342 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-226a11e5-39b7-4edf-a202-8a2ab23016b2 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:35.840171 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-226a11e5-39b7-4edf-a202-8a2ab23016b2 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] [instance: e3f6cb59-1116-43f4-86e4-c97c597f8dfd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:35.866282 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-226a11e5-39b7-4edf-a202-8a2ab23016b2 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:35.866282 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-226a11e5-39b7-4edf-a202-8a2ab23016b2 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:35.866282 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-226a11e5-39b7-4edf-a202-8a2ab23016b2 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:35.866282 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-226a11e5-39b7-4edf-a202-8a2ab23016b2 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:35.872332 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-736a58fd-9683-47aa-af43-b238c5222f1c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:35.873078 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-736a58fd-9683-47aa-af43-b238c5222f1c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:35.887796 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-736a58fd-9683-47aa-af43-b238c5222f1c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:35.888248 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-736a58fd-9683-47aa-af43-b238c5222f1c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:35.889053 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-736a58fd-9683-47aa-af43-b238c5222f1c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:35.889493 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-736a58fd-9683-47aa-af43-b238c5222f1c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:35.995245 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:01:36.879916 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-226a11e5-39b7-4edf-a202-8a2ab23016b2 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ef01d5252344a2bc2d36e13324a6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07627ceb27f2492fbb741a241edb2c5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:36.915686 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-226a11e5-39b7-4edf-a202-8a2ab23016b2 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] 10.222.0.57 "GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd" status: 200 len: 1584 microversion: 2.1 time: 1.079671 Jul 18 03:01:36.920897 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2919/5828] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:35 2022] GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd => generated 1584 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:01:37.308379 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-736a58fd-9683-47aa-af43-b238c5222f1c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:37.338003 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-736a58fd-9683-47aa-af43-b238c5222f1c tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e" status: 200 len: 1277 microversion: 2.1 time: 1.466229 Jul 18 03:01:37.355708 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2910/5829] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:35 2022] GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e => generated 1277 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:37.843541 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-fc132c7b-dc48-43cb-aeaa-09260af21025 req-560a8c3b-a207-496b-9546-7c05a5578bb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3f6cb59-1116-43f4-86e4-c97c597f8dfd", "name": "network-vif-deleted", "tag": "74113a7b-30c1-4349-9bdd-e20b4d47ab9f"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:01:37.855465 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-fc132c7b-dc48-43cb-aeaa-09260af21025 req-560a8c3b-a207-496b-9546-7c05a5578bb2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:37.857007 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-fc132c7b-dc48-43cb-aeaa-09260af21025 req-560a8c3b-a207-496b-9546-7c05a5578bb2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:37.901213 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-fc132c7b-dc48-43cb-aeaa-09260af21025 req-560a8c3b-a207-496b-9546-7c05a5578bb2 service nova] Creating event network-vif-deleted:74113a7b-30c1-4349-9bdd-e20b4d47ab9f for instance e3f6cb59-1116-43f4-86e4-c97c597f8dfd on n-h2-465891-3 Jul 18 03:01:37.911902 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-fc132c7b-dc48-43cb-aeaa-09260af21025 req-560a8c3b-a207-496b-9546-7c05a5578bb2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073207 Jul 18 03:01:37.913189 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2920/5830] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:01:37.952126 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b6679bfc-99d3-487e-9563-1438a585a278 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:37.953218 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b6679bfc-99d3-487e-9563-1438a585a278 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] [instance: e3f6cb59-1116-43f4-86e4-c97c597f8dfd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:37.962759 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6679bfc-99d3-487e-9563-1438a585a278 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:37.963731 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6679bfc-99d3-487e-9563-1438a585a278 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:37.965162 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6679bfc-99d3-487e-9563-1438a585a278 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:37.965880 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6679bfc-99d3-487e-9563-1438a585a278 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:38.171602 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b6679bfc-99d3-487e-9563-1438a585a278 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ef01d5252344a2bc2d36e13324a6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07627ceb27f2492fbb741a241edb2c5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:38.181782 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b6679bfc-99d3-487e-9563-1438a585a278 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] 10.222.0.57 "GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd" status: 200 len: 1229 microversion: 2.1 time: 0.235900 Jul 18 03:01:38.188903 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2911/5831] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:37 2022] GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd => generated 1229 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:38.374520 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-63780455-98e3-4ae2-b768-c471e66a948b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:38.381803 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-63780455-98e3-4ae2-b768-c471e66a948b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:38.415332 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-63780455-98e3-4ae2-b768-c471e66a948b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:38.416171 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-63780455-98e3-4ae2-b768-c471e66a948b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:38.418069 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-63780455-98e3-4ae2-b768-c471e66a948b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:38.419200 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-63780455-98e3-4ae2-b768-c471e66a948b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:38.915890 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-63780455-98e3-4ae2-b768-c471e66a948b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:38.927185 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-63780455-98e3-4ae2-b768-c471e66a948b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e" status: 200 len: 1265 microversion: 2.1 time: 0.560786 Jul 18 03:01:38.927966 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2921/5832] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:38 2022] GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e => generated 1265 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:39.220118 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-eb5d047a-64be-4ed0-a985-2ecf80d0e2b4 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:39.221401 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-eb5d047a-64be-4ed0-a985-2ecf80d0e2b4 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] [instance: e3f6cb59-1116-43f4-86e4-c97c597f8dfd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:39.236544 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eb5d047a-64be-4ed0-a985-2ecf80d0e2b4 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:39.237852 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eb5d047a-64be-4ed0-a985-2ecf80d0e2b4 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:39.242464 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eb5d047a-64be-4ed0-a985-2ecf80d0e2b4 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:39.244162 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eb5d047a-64be-4ed0-a985-2ecf80d0e2b4 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:39.434216 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-eb5d047a-64be-4ed0-a985-2ecf80d0e2b4 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ef01d5252344a2bc2d36e13324a6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07627ceb27f2492fbb741a241edb2c5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:39.444851 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-eb5d047a-64be-4ed0-a985-2ecf80d0e2b4 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] 10.222.0.57 "GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd" status: 200 len: 1398 microversion: 2.1 time: 0.232972 Jul 18 03:01:39.446772 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2912/5833] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:39 2022] GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd => generated 1398 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:39.951142 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-91103f01-4378-4f67-a193-c3429f1f7c6b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:39.953613 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-91103f01-4378-4f67-a193-c3429f1f7c6b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:39.968823 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-91103f01-4378-4f67-a193-c3429f1f7c6b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:39.969980 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-91103f01-4378-4f67-a193-c3429f1f7c6b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:39.975397 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-91103f01-4378-4f67-a193-c3429f1f7c6b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:39.976705 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-91103f01-4378-4f67-a193-c3429f1f7c6b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:40.471396 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e63a4bd5-4f13-432e-9f0c-c0950ecccf9d tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:40.473310 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e63a4bd5-4f13-432e-9f0c-c0950ecccf9d tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] [instance: e3f6cb59-1116-43f4-86e4-c97c597f8dfd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:40.498913 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-91103f01-4378-4f67-a193-c3429f1f7c6b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:40.502525 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e63a4bd5-4f13-432e-9f0c-c0950ecccf9d tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:40.509469 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e63a4bd5-4f13-432e-9f0c-c0950ecccf9d tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:40.511456 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e63a4bd5-4f13-432e-9f0c-c0950ecccf9d tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:40.513597 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-91103f01-4378-4f67-a193-c3429f1f7c6b tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e" status: 200 len: 1265 microversion: 2.1 time: 0.569554 Jul 18 03:01:40.514143 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e63a4bd5-4f13-432e-9f0c-c0950ecccf9d tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:40.514309 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2922/5834] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:39 2022] GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e => generated 1265 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:40.690000 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e63a4bd5-4f13-432e-9f0c-c0950ecccf9d tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ef01d5252344a2bc2d36e13324a6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07627ceb27f2492fbb741a241edb2c5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:40.714813 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e63a4bd5-4f13-432e-9f0c-c0950ecccf9d tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] 10.222.0.57 "GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd" status: 200 len: 1398 microversion: 2.1 time: 0.253717 Jul 18 03:01:40.717451 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2913/5835] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:40 2022] GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd => generated 1398 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:41.544210 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2b927dc9-4aa0-4c8b-a6a9-4d11fa66d9b0 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:41.545768 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2b927dc9-4aa0-4c8b-a6a9-4d11fa66d9b0 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:41.564638 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b927dc9-4aa0-4c8b-a6a9-4d11fa66d9b0 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:41.566213 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b927dc9-4aa0-4c8b-a6a9-4d11fa66d9b0 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:41.567960 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b927dc9-4aa0-4c8b-a6a9-4d11fa66d9b0 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:41.570005 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b927dc9-4aa0-4c8b-a6a9-4d11fa66d9b0 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:41.734313 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-af1625f4-7c6a-4182-9116-ba65ee415ce0 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:41.735750 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-af1625f4-7c6a-4182-9116-ba65ee415ce0 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] [instance: e3f6cb59-1116-43f4-86e4-c97c597f8dfd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:41.749304 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-af1625f4-7c6a-4182-9116-ba65ee415ce0 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:41.753436 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-af1625f4-7c6a-4182-9116-ba65ee415ce0 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:41.761923 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-af1625f4-7c6a-4182-9116-ba65ee415ce0 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:41.764399 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-af1625f4-7c6a-4182-9116-ba65ee415ce0 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:41.969350 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-af1625f4-7c6a-4182-9116-ba65ee415ce0 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ef01d5252344a2bc2d36e13324a6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07627ceb27f2492fbb741a241edb2c5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:41.997535 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-af1625f4-7c6a-4182-9116-ba65ee415ce0 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] 10.222.0.57 "GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd" status: 200 len: 1398 microversion: 2.1 time: 0.267248 Jul 18 03:01:42.001032 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2914/5836] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:41 2022] GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd => generated 1398 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:01:42.138912 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2b927dc9-4aa0-4c8b-a6a9-4d11fa66d9b0 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:42.178390 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2b927dc9-4aa0-4c8b-a6a9-4d11fa66d9b0 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e" status: 200 len: 1265 microversion: 2.1 time: 0.637833 Jul 18 03:01:42.181873 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2923/5837] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:41 2022] GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e => generated 1265 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:43.025569 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ea84618e-210b-4576-b99d-f17252c5006e tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:43.026403 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ea84618e-210b-4576-b99d-f17252c5006e tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] [instance: e3f6cb59-1116-43f4-86e4-c97c597f8dfd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:43.043286 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea84618e-210b-4576-b99d-f17252c5006e tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:43.043906 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea84618e-210b-4576-b99d-f17252c5006e tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:43.044834 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea84618e-210b-4576-b99d-f17252c5006e tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:43.045385 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea84618e-210b-4576-b99d-f17252c5006e tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:43.155123 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ea84618e-210b-4576-b99d-f17252c5006e tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ef01d5252344a2bc2d36e13324a6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07627ceb27f2492fbb741a241edb2c5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:43.171921 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ea84618e-210b-4576-b99d-f17252c5006e tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] 10.222.0.57 "GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd" status: 200 len: 1398 microversion: 2.1 time: 0.150056 Jul 18 03:01:43.173805 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2915/5838] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:43 2022] GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd => generated 1398 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:01:43.196875 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-735969f1-f725-4a69-8e1e-5ec5758122c2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:43.197512 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-735969f1-f725-4a69-8e1e-5ec5758122c2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:43.200953 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:01:43.218432 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-735969f1-f725-4a69-8e1e-5ec5758122c2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:43.219498 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-735969f1-f725-4a69-8e1e-5ec5758122c2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:43.220514 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-735969f1-f725-4a69-8e1e-5ec5758122c2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:43.221029 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-735969f1-f725-4a69-8e1e-5ec5758122c2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:44.088222 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-735969f1-f725-4a69-8e1e-5ec5758122c2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:44.103745 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-735969f1-f725-4a69-8e1e-5ec5758122c2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e" status: 200 len: 1265 microversion: 2.1 time: 0.910829 Jul 18 03:01:44.105839 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2924/5839] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:43 2022] GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e => generated 1265 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:44.193352 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e1008fdc-18ad-47b0-9992-b5240cdf6d85 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:44.194349 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e1008fdc-18ad-47b0-9992-b5240cdf6d85 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] [instance: e3f6cb59-1116-43f4-86e4-c97c597f8dfd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:44.220665 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e1008fdc-18ad-47b0-9992-b5240cdf6d85 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:44.222072 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e1008fdc-18ad-47b0-9992-b5240cdf6d85 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:44.223404 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e1008fdc-18ad-47b0-9992-b5240cdf6d85 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:44.224301 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e1008fdc-18ad-47b0-9992-b5240cdf6d85 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:44.402187 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e1008fdc-18ad-47b0-9992-b5240cdf6d85 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ef01d5252344a2bc2d36e13324a6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07627ceb27f2492fbb741a241edb2c5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:44.411619 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e1008fdc-18ad-47b0-9992-b5240cdf6d85 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] 10.222.0.57 "GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd" status: 200 len: 1398 microversion: 2.1 time: 0.223185 Jul 18 03:01:44.417245 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2916/5840] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:44 2022] GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd => generated 1398 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:45.136296 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-71980c47-5c7e-4129-9a5d-f80fe5122ded tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:45.137169 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-71980c47-5c7e-4129-9a5d-f80fe5122ded tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:45.155991 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-71980c47-5c7e-4129-9a5d-f80fe5122ded tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:45.156705 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-71980c47-5c7e-4129-9a5d-f80fe5122ded tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:45.157760 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-71980c47-5c7e-4129-9a5d-f80fe5122ded tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:45.158322 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-71980c47-5c7e-4129-9a5d-f80fe5122ded tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:45.445145 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8d887ae1-8885-405a-a88f-7fecf6dad779 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:45.446700 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8d887ae1-8885-405a-a88f-7fecf6dad779 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] [instance: e3f6cb59-1116-43f4-86e4-c97c597f8dfd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:45.458895 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:01:45.461837 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-71980c47-5c7e-4129-9a5d-f80fe5122ded tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:45.474399 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8d887ae1-8885-405a-a88f-7fecf6dad779 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:45.474855 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8d887ae1-8885-405a-a88f-7fecf6dad779 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:45.475664 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8d887ae1-8885-405a-a88f-7fecf6dad779 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:45.476103 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8d887ae1-8885-405a-a88f-7fecf6dad779 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:45.480408 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-71980c47-5c7e-4129-9a5d-f80fe5122ded tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e" status: 200 len: 1265 microversion: 2.1 time: 0.348366 Jul 18 03:01:45.481255 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2925/5841] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:45 2022] GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e => generated 1265 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:45.635440 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8d887ae1-8885-405a-a88f-7fecf6dad779 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ef01d5252344a2bc2d36e13324a6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07627ceb27f2492fbb741a241edb2c5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:45.648312 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8d887ae1-8885-405a-a88f-7fecf6dad779 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] 10.222.0.57 "GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd" status: 200 len: 1398 microversion: 2.1 time: 0.207138 Jul 18 03:01:45.649100 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2917/5842] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:45 2022] GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd => generated 1398 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:01:46.514142 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ce9efed4-4cd3-436e-bfe3-12946bc597b6 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:46.514790 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ce9efed4-4cd3-436e-bfe3-12946bc597b6 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:46.530361 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ce9efed4-4cd3-436e-bfe3-12946bc597b6 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:46.531969 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ce9efed4-4cd3-436e-bfe3-12946bc597b6 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:46.537289 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ce9efed4-4cd3-436e-bfe3-12946bc597b6 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:46.538212 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ce9efed4-4cd3-436e-bfe3-12946bc597b6 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:46.678574 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-eef788f9-6843-483b-a704-c596d77fe840 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:46.683160 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-eef788f9-6843-483b-a704-c596d77fe840 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] [instance: e3f6cb59-1116-43f4-86e4-c97c597f8dfd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:46.724471 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eef788f9-6843-483b-a704-c596d77fe840 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:46.742456 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eef788f9-6843-483b-a704-c596d77fe840 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:46.744775 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eef788f9-6843-483b-a704-c596d77fe840 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:46.745729 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eef788f9-6843-483b-a704-c596d77fe840 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:46.799426 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-eef788f9-6843-483b-a704-c596d77fe840 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] HTTP exception thrown: Instance e3f6cb59-1116-43f4-86e4-c97c597f8dfd could not be found. Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-eef788f9-6843-483b-a704-c596d77fe840 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Request method failure captured: Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd HTTP/1.1 Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MuuhH7X-jn6-mvypOWuEyC5WEDuk3se1Hh5wD6JkG--6ICJi7zp-yo1RLMvbAQWzdqT66wh-bpna9wVB_2hOBmENaJMbtHPEppuC7B81N64Oiv_Mzhv_tgIZqFdKdlSrRYrcMMQh0B2brXyfy51_XblFdn0nQhEVoGverBleOLYkhM Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 07627ceb27f2492fbb741a241edb2c5c Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-TestVolumeBackupRestore-1181238914 Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_07627ceb27f2492fbb741a241edb2c5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/07627ceb27f2492fbb741a241edb2c5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/07627ceb27f2492fbb741a241edb2c5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/07627ceb27f2492fbb741a241edb2c5c"}]}] Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-TestVolumeBackupRestore-1181238914 Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 07627ceb27f2492fbb741a241edb2c5c Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1181238914 Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-TestVolumeBackupRestore-1181238914-project Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 88ef01d5252344a2bc2d36e13324a6b0 Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-TestVolumeBackupRestore-1181238914-project Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance e3f6cb59-1116-43f4-86e4-c97c597f8dfd could not be found. Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'e3f6cb59-1116-43f4-86e4-c97c597f8dfd'} Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3f6cb59-1116-43f4-86e4-c97c597f8dfd could not be found. Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3f6cb59-1116-43f4-86e4-c97c597f8dfd could not be found. Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:01:46.822195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:01:46.826593 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:01:46.826593 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:01:46.826593 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:01:46.826593 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:01:46.826593 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:01:46.826593 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3f6cb59-1116-43f4-86e4-c97c597f8dfd could not be found. Jul 18 03:01:46.826593 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:01:46.826593 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-eef788f9-6843-483b-a704-c596d77fe840 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Returning 404 to user: Instance e3f6cb59-1116-43f4-86e4-c97c597f8dfd could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:01:46.828151 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-eef788f9-6843-483b-a704-c596d77fe840 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] 10.222.0.57 "GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd" status: 404 len: 111 microversion: 2.1 time: 0.153725 Jul 18 03:01:46.836675 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2918/5843] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:46 2022] GET /compute/v2.1/servers/e3f6cb59-1116-43f4-86e4-c97c597f8dfd => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:01:47.026863 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ce9efed4-4cd3-436e-bfe3-12946bc597b6 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:47.058220 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ce9efed4-4cd3-436e-bfe3-12946bc597b6 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e" status: 200 len: 1265 microversion: 2.1 time: 0.548383 Jul 18 03:01:47.059320 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2926/5844] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:46 2022] GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e => generated 1265 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:47.317967 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3846e03c-68e7-463e-888e-6a8e460ef0f5 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] Calling method '.version_select at 0x7ff4a84e40d0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:47.388795 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3846e03c-68e7-463e-888e-6a8e460ef0f5 tempest-TestVolumeBackupRestore-1181238914 tempest-TestVolumeBackupRestore-1181238914-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-733178941" status: 202 len: 0 microversion: 2.1 time: 0.082165 Jul 18 03:01:47.390040 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2919/5845] 10.222.0.57 () {58 vars in 1265 bytes} [Mon Jul 18 03:01:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-733178941 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:01:48.085376 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ec61f4bb-3ed9-4a59-819d-0e6537f743d9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:48.086693 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ec61f4bb-3ed9-4a59-819d-0e6537f743d9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:48.107433 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ec61f4bb-3ed9-4a59-819d-0e6537f743d9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:48.108301 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ec61f4bb-3ed9-4a59-819d-0e6537f743d9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:48.124093 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ec61f4bb-3ed9-4a59-819d-0e6537f743d9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:48.125206 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ec61f4bb-3ed9-4a59-819d-0e6537f743d9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:48.681932 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ec61f4bb-3ed9-4a59-819d-0e6537f743d9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:48.702648 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ec61f4bb-3ed9-4a59-819d-0e6537f743d9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e" status: 200 len: 1265 microversion: 2.1 time: 0.621057 Jul 18 03:01:48.704821 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2927/5846] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:48 2022] GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e => generated 1265 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:49.333061 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-12452df0-cb04-4878-8b33-3a877d330ec0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-773180205", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "c540b69b-e7cc-4fa1-8fc6-67859b3d0823"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:01:49.738407 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2aba249b-af18-4f10-979d-3cafd72ac9a2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:49.739449 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2aba249b-af18-4f10-979d-3cafd72ac9a2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:49.790215 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2aba249b-af18-4f10-979d-3cafd72ac9a2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:49.791871 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2aba249b-af18-4f10-979d-3cafd72ac9a2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:49.795793 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2aba249b-af18-4f10-979d-3cafd72ac9a2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:49.796764 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2aba249b-af18-4f10-979d-3cafd72ac9a2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:50.256601 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2aba249b-af18-4f10-979d-3cafd72ac9a2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:50.268675 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2aba249b-af18-4f10-979d-3cafd72ac9a2 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e" status: 200 len: 1265 microversion: 2.1 time: 0.537880 Jul 18 03:01:50.274996 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2928/5847] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:49 2022] GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e => generated 1265 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:01:50.293750 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-db5e1275-9512-4838-be45-3b90b7f80bfd req-b528b51d-acb9-4f7f-a72c-f715d1dd01f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ecffdfb-225e-4bda-95e7-606ec4f5cb4e", "name": "network-vif-plugged", "status": "completed", "tag": "db3e621e-c1d9-4896-bda5-23d0f92165e3"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:01:50.309187 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-db5e1275-9512-4838-be45-3b90b7f80bfd req-b528b51d-acb9-4f7f-a72c-f715d1dd01f4 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:50.309822 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-db5e1275-9512-4838-be45-3b90b7f80bfd req-b528b51d-acb9-4f7f-a72c-f715d1dd01f4 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:50.367486 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-db5e1275-9512-4838-be45-3b90b7f80bfd req-b528b51d-acb9-4f7f-a72c-f715d1dd01f4 service nova] Creating event network-vif-plugged:db3e621e-c1d9-4896-bda5-23d0f92165e3 for instance 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e on n-h2-465891-3 Jul 18 03:01:50.384228 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-db5e1275-9512-4838-be45-3b90b7f80bfd req-b528b51d-acb9-4f7f-a72c-f715d1dd01f4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107528 Jul 18 03:01:50.385886 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2929/5848] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:01:51.304090 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-67937a0a-1a54-4d87-bcc7-e37329054586 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:51.307513 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-67937a0a-1a54-4d87-bcc7-e37329054586 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:51.319041 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-67937a0a-1a54-4d87-bcc7-e37329054586 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:51.319838 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-67937a0a-1a54-4d87-bcc7-e37329054586 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:51.326888 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-67937a0a-1a54-4d87-bcc7-e37329054586 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:51.328943 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-67937a0a-1a54-4d87-bcc7-e37329054586 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:51.776910 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-67937a0a-1a54-4d87-bcc7-e37329054586 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:51.787830 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-67937a0a-1a54-4d87-bcc7-e37329054586 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e" status: 200 len: 1265 microversion: 2.1 time: 0.488980 Jul 18 03:01:51.804099 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2930/5849] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:51 2022] GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e => generated 1265 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:52.822415 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-939bb3e9-cab4-442e-8045-7113aa3e9f3e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:52.824072 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-939bb3e9-cab4-442e-8045-7113aa3e9f3e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:52.835530 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-939bb3e9-cab4-442e-8045-7113aa3e9f3e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:52.845976 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-939bb3e9-cab4-442e-8045-7113aa3e9f3e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:52.847590 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-939bb3e9-cab4-442e-8045-7113aa3e9f3e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:52.848233 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-939bb3e9-cab4-442e-8045-7113aa3e9f3e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:53.246062 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-939bb3e9-cab4-442e-8045-7113aa3e9f3e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:53.273068 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-939bb3e9-cab4-442e-8045-7113aa3e9f3e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e" status: 200 len: 1452 microversion: 2.1 time: 0.455980 Jul 18 03:01:53.274224 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2931/5850] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:52 2022] GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e => generated 1452 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:01:53.293019 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e0047635-a769-466a-80a8-f8033d1317a6 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:53.293656 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e0047635-a769-466a-80a8-f8033d1317a6 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:53.315225 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e0047635-a769-466a-80a8-f8033d1317a6 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:53.315704 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e0047635-a769-466a-80a8-f8033d1317a6 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:53.317061 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e0047635-a769-466a-80a8-f8033d1317a6 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:53.318086 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e0047635-a769-466a-80a8-f8033d1317a6 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:53.784478 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e0047635-a769-466a-80a8-f8033d1317a6 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:53.811800 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e0047635-a769-466a-80a8-f8033d1317a6 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e" status: 200 len: 1452 microversion: 2.1 time: 0.523472 Jul 18 03:01:53.814034 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2932/5851] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:53 2022] GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e => generated 1452 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:54.080974 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-12452df0-cb04-4878-8b33-3a877d330ec0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] validate_networks() for [('c540b69b-e7cc-4fa1-8fc6-67859b3d0823', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:01:55.256140 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-12452df0-cb04-4878-8b33-3a877d330ec0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:01:55.257232 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-12452df0-cb04-4878-8b33-3a877d330ec0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:01:55.257232 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-12452df0-cb04-4878-8b33-3a877d330ec0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:01:55.257596 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-12452df0-cb04-4878-8b33-3a877d330ec0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:01:55.258289 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-12452df0-cb04-4878-8b33-3a877d330ec0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:01:55.292813 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-12452df0-cb04-4878-8b33-3a877d330ec0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:55.293505 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-12452df0-cb04-4878-8b33-3a877d330ec0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:55.294872 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-12452df0-cb04-4878-8b33-3a877d330ec0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:55.295538 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-12452df0-cb04-4878-8b33-3a877d330ec0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:55.329862 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=74 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:01:55.360629 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-12452df0-cb04-4878-8b33-3a877d330ec0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Getting quotas for project 3a83c4dedef341a0bb50fa4c119d3035. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:01:55.374183 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-12452df0-cb04-4878-8b33-3a877d330ec0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Getting quotas for user 785ff643c00746939bb0fecd775ce920 and project 3a83c4dedef341a0bb50fa4c119d3035. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:01:55.427175 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-12452df0-cb04-4878-8b33-3a877d330ec0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:01:55.436416 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-12452df0-cb04-4878-8b33-3a877d330ec0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: ec729ac5-b620-4d07-bba8-9f098936d929] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:01:55.547963 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-12452df0-cb04-4878-8b33-3a877d330ec0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.607308 Jul 18 03:01:55.549173 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2920/5852] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:01:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 6610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:01:55.576731 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-876a939e-c18c-4006-98d5-b56e34fc951a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:55.576731 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-876a939e-c18c-4006-98d5-b56e34fc951a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: ec729ac5-b620-4d07-bba8-9f098936d929] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:55.729601 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-876a939e-c18c-4006-98d5-b56e34fc951a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:55.757497 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-876a939e-c18c-4006-98d5-b56e34fc951a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/ec729ac5-b620-4d07-bba8-9f098936d929" status: 200 len: 1192 microversion: 2.1 time: 0.201408 Jul 18 03:01:55.762046 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2933/5853] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:55 2022] GET /compute/v2.1/servers/ec729ac5-b620-4d07-bba8-9f098936d929 => generated 1192 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:56.783977 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-502cb3b4-fd37-425c-b41e-3958a9ff1586 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:56.786373 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-502cb3b4-fd37-425c-b41e-3958a9ff1586 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: ec729ac5-b620-4d07-bba8-9f098936d929] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:56.919245 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-502cb3b4-fd37-425c-b41e-3958a9ff1586 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:56.933969 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-502cb3b4-fd37-425c-b41e-3958a9ff1586 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/ec729ac5-b620-4d07-bba8-9f098936d929" status: 200 len: 1192 microversion: 2.1 time: 0.158946 Jul 18 03:01:56.935816 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2921/5854] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:56 2022] GET /compute/v2.1/servers/ec729ac5-b620-4d07-bba8-9f098936d929 => generated 1192 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:57.965312 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2052fc71-9860-44a3-ae3e-eb8ba6fb7786 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:57.966243 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2052fc71-9860-44a3-ae3e-eb8ba6fb7786 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: ec729ac5-b620-4d07-bba8-9f098936d929] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:57.990241 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2052fc71-9860-44a3-ae3e-eb8ba6fb7786 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:57.994416 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2052fc71-9860-44a3-ae3e-eb8ba6fb7786 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:57.995513 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2052fc71-9860-44a3-ae3e-eb8ba6fb7786 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:57.996098 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2052fc71-9860-44a3-ae3e-eb8ba6fb7786 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:58.104900 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2052fc71-9860-44a3-ae3e-eb8ba6fb7786 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:58.114376 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2052fc71-9860-44a3-ae3e-eb8ba6fb7786 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/ec729ac5-b620-4d07-bba8-9f098936d929" status: 200 len: 1244 microversion: 2.1 time: 0.153474 Jul 18 03:01:58.118037 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2934/5855] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:57 2022] GET /compute/v2.1/servers/ec729ac5-b620-4d07-bba8-9f098936d929 => generated 1244 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:59.153042 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7abae213-4bf6-4178-8096-136c65fda4ca tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:59.158351 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7abae213-4bf6-4178-8096-136c65fda4ca tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: ec729ac5-b620-4d07-bba8-9f098936d929] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:59.198344 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7abae213-4bf6-4178-8096-136c65fda4ca tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:59.199092 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7abae213-4bf6-4178-8096-136c65fda4ca tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:59.203961 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7abae213-4bf6-4178-8096-136c65fda4ca tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:59.207783 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7abae213-4bf6-4178-8096-136c65fda4ca tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:59.582556 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7abae213-4bf6-4178-8096-136c65fda4ca tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:59.620183 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7abae213-4bf6-4178-8096-136c65fda4ca tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/ec729ac5-b620-4d07-bba8-9f098936d929" status: 200 len: 1250 microversion: 2.1 time: 0.479025 Jul 18 03:01:59.640080 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2922/5856] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:59 2022] GET /compute/v2.1/servers/ec729ac5-b620-4d07-bba8-9f098936d929 => generated 1250 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:00.068355 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-938db0cf-fa85-49c5-bde6-024a6a6011fd req-0ad24bc0-e2ea-4519-a993-41526c34f563 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ecffdfb-225e-4bda-95e7-606ec4f5cb4e", "tag": "db3e621e-c1d9-4896-bda5-23d0f92165e3"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:02:00.137041 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-938db0cf-fa85-49c5-bde6-024a6a6011fd req-0ad24bc0-e2ea-4519-a993-41526c34f563 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:00.137855 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-938db0cf-fa85-49c5-bde6-024a6a6011fd req-0ad24bc0-e2ea-4519-a993-41526c34f563 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:00.202086 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-938db0cf-fa85-49c5-bde6-024a6a6011fd req-0ad24bc0-e2ea-4519-a993-41526c34f563 service nova] Creating event network-changed:db3e621e-c1d9-4896-bda5-23d0f92165e3 for instance 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e on n-h2-465891-3 Jul 18 03:02:00.229201 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-938db0cf-fa85-49c5-bde6-024a6a6011fd req-0ad24bc0-e2ea-4519-a993-41526c34f563 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168322 Jul 18 03:02:00.230427 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2935/5857] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:02:00.657512 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-66fcd4f0-0bab-463f-ba62-9a9b8ecff9c0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:00.658408 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-66fcd4f0-0bab-463f-ba62-9a9b8ecff9c0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: ec729ac5-b620-4d07-bba8-9f098936d929] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:00.681901 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-66fcd4f0-0bab-463f-ba62-9a9b8ecff9c0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:00.682978 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-66fcd4f0-0bab-463f-ba62-9a9b8ecff9c0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:00.684659 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-66fcd4f0-0bab-463f-ba62-9a9b8ecff9c0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:00.685448 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-66fcd4f0-0bab-463f-ba62-9a9b8ecff9c0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:00.976215 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-66fcd4f0-0bab-463f-ba62-9a9b8ecff9c0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:01.023272 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-66fcd4f0-0bab-463f-ba62-9a9b8ecff9c0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/ec729ac5-b620-4d07-bba8-9f098936d929" status: 200 len: 1250 microversion: 2.1 time: 0.369811 Jul 18 03:02:01.031631 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2923/5858] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:00 2022] GET /compute/v2.1/servers/ec729ac5-b620-4d07-bba8-9f098936d929 => generated 1250 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:02.053236 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d3312b53-b3e8-4077-8dd8-feb6e1a0a653 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:02.056197 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d3312b53-b3e8-4077-8dd8-feb6e1a0a653 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: ec729ac5-b620-4d07-bba8-9f098936d929] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:02.068067 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d3312b53-b3e8-4077-8dd8-feb6e1a0a653 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:02.069027 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d3312b53-b3e8-4077-8dd8-feb6e1a0a653 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:02.071952 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d3312b53-b3e8-4077-8dd8-feb6e1a0a653 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:02.073449 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d3312b53-b3e8-4077-8dd8-feb6e1a0a653 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:02.547816 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d3312b53-b3e8-4077-8dd8-feb6e1a0a653 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:02.567725 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d3312b53-b3e8-4077-8dd8-feb6e1a0a653 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/ec729ac5-b620-4d07-bba8-9f098936d929" status: 200 len: 1250 microversion: 2.1 time: 0.510091 Jul 18 03:02:02.581577 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2936/5859] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:02 2022] GET /compute/v2.1/servers/ec729ac5-b620-4d07-bba8-9f098936d929 => generated 1250 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:02:03.589945 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6a20736f-d4b8-4d00-b4ba-03d26f7f0532 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:03.591328 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6a20736f-d4b8-4d00-b4ba-03d26f7f0532 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: ec729ac5-b620-4d07-bba8-9f098936d929] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:03.613385 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6a20736f-d4b8-4d00-b4ba-03d26f7f0532 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:03.613880 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6a20736f-d4b8-4d00-b4ba-03d26f7f0532 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:03.614705 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6a20736f-d4b8-4d00-b4ba-03d26f7f0532 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:03.615138 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6a20736f-d4b8-4d00-b4ba-03d26f7f0532 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:04.518864 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6a20736f-d4b8-4d00-b4ba-03d26f7f0532 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:04.563521 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6a20736f-d4b8-4d00-b4ba-03d26f7f0532 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/ec729ac5-b620-4d07-bba8-9f098936d929" status: 200 len: 1292 microversion: 2.1 time: 0.977566 Jul 18 03:02:04.569451 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2924/5860] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:03 2022] GET /compute/v2.1/servers/ec729ac5-b620-4d07-bba8-9f098936d929 => generated 1292 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:05.298884 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-67f604d4-3425-4954-8de8-44ec1eea9321 req-8a0986cc-c183-4540-b2b9-83e1f5ee344c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec729ac5-b620-4d07-bba8-9f098936d929", "tag": "3023158c-714c-4be3-9417-129f2f0b3be4"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:02:05.314461 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-67f604d4-3425-4954-8de8-44ec1eea9321 req-8a0986cc-c183-4540-b2b9-83e1f5ee344c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:05.315455 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-67f604d4-3425-4954-8de8-44ec1eea9321 req-8a0986cc-c183-4540-b2b9-83e1f5ee344c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:05.358734 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-67f604d4-3425-4954-8de8-44ec1eea9321 req-8a0986cc-c183-4540-b2b9-83e1f5ee344c service nova] Creating event network-changed:3023158c-714c-4be3-9417-129f2f0b3be4 for instance ec729ac5-b620-4d07-bba8-9f098936d929 on n-h1-465891-3 Jul 18 03:02:05.373887 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-67f604d4-3425-4954-8de8-44ec1eea9321 req-8a0986cc-c183-4540-b2b9-83e1f5ee344c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078334 Jul 18 03:02:05.375556 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2937/5861] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:02:05.609518 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8e56d5ea-9bcd-46b2-b100-33947cbb62b3 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:05.609518 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8e56d5ea-9bcd-46b2-b100-33947cbb62b3 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: ec729ac5-b620-4d07-bba8-9f098936d929] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:05.634691 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:02:05.642974 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8e56d5ea-9bcd-46b2-b100-33947cbb62b3 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:05.643510 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8e56d5ea-9bcd-46b2-b100-33947cbb62b3 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:05.644943 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8e56d5ea-9bcd-46b2-b100-33947cbb62b3 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:05.645750 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8e56d5ea-9bcd-46b2-b100-33947cbb62b3 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:06.161239 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8e56d5ea-9bcd-46b2-b100-33947cbb62b3 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:06.185777 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8e56d5ea-9bcd-46b2-b100-33947cbb62b3 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/ec729ac5-b620-4d07-bba8-9f098936d929" status: 200 len: 1292 microversion: 2.1 time: 0.589558 Jul 18 03:02:06.188063 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2925/5862] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:05 2022] GET /compute/v2.1/servers/ec729ac5-b620-4d07-bba8-9f098936d929 => generated 1292 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:07.211816 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b5a5fef3-4725-4064-aa75-5967f7e9482e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:07.213600 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b5a5fef3-4725-4064-aa75-5967f7e9482e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: ec729ac5-b620-4d07-bba8-9f098936d929] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:07.228989 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:02:07.255438 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b5a5fef3-4725-4064-aa75-5967f7e9482e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:07.256286 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b5a5fef3-4725-4064-aa75-5967f7e9482e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:07.258173 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b5a5fef3-4725-4064-aa75-5967f7e9482e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:07.259271 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b5a5fef3-4725-4064-aa75-5967f7e9482e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:07.268344 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=92 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:02:07.595984 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b5a5fef3-4725-4064-aa75-5967f7e9482e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:07.606455 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b5a5fef3-4725-4064-aa75-5967f7e9482e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/ec729ac5-b620-4d07-bba8-9f098936d929" status: 200 len: 1292 microversion: 2.1 time: 0.403722 Jul 18 03:02:07.617770 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2938/5863] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:07 2022] GET /compute/v2.1/servers/ec729ac5-b620-4d07-bba8-9f098936d929 => generated 1292 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:08.640361 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c97d6b96-c043-46c4-9bbe-077b6c21b12a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:08.647503 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c97d6b96-c043-46c4-9bbe-077b6c21b12a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: ec729ac5-b620-4d07-bba8-9f098936d929] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:08.665395 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=8 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:02:08.677948 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c97d6b96-c043-46c4-9bbe-077b6c21b12a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:08.682907 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c97d6b96-c043-46c4-9bbe-077b6c21b12a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:08.688125 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c97d6b96-c043-46c4-9bbe-077b6c21b12a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:08.689683 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c97d6b96-c043-46c4-9bbe-077b6c21b12a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:09.248343 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c97d6b96-c043-46c4-9bbe-077b6c21b12a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:09.271391 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c97d6b96-c043-46c4-9bbe-077b6c21b12a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/ec729ac5-b620-4d07-bba8-9f098936d929" status: 200 len: 1292 microversion: 2.1 time: 0.640405 Jul 18 03:02:09.272476 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2926/5864] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:08 2022] GET /compute/v2.1/servers/ec729ac5-b620-4d07-bba8-9f098936d929 => generated 1292 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:10.291900 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-57bbfc1a-580c-46e4-8833-7669b73dc329 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:10.293253 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-57bbfc1a-580c-46e4-8833-7669b73dc329 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: ec729ac5-b620-4d07-bba8-9f098936d929] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:10.307358 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-57bbfc1a-580c-46e4-8833-7669b73dc329 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:10.312268 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-57bbfc1a-580c-46e4-8833-7669b73dc329 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:10.313570 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-57bbfc1a-580c-46e4-8833-7669b73dc329 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:10.314255 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-57bbfc1a-580c-46e4-8833-7669b73dc329 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:10.335329 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-89689909-8c46-4e67-ac9e-e8949e1c5de8 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:10.335329 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-89689909-8c46-4e67-ac9e-e8949e1c5de8 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:10.359896 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-89689909-8c46-4e67-ac9e-e8949e1c5de8 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:10.360431 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-89689909-8c46-4e67-ac9e-e8949e1c5de8 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:10.361207 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-89689909-8c46-4e67-ac9e-e8949e1c5de8 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:10.361729 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-89689909-8c46-4e67-ac9e-e8949e1c5de8 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:10.410783 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-89689909-8c46-4e67-ac9e-e8949e1c5de8 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:02:10.594988 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-89689909-8c46-4e67-ac9e-e8949e1c5de8 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518" status: 204 len: 0 microversion: 2.1 time: 0.266730 Jul 18 03:02:10.595655 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2927/5865] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:02:10 2022] DELETE /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 03:02:10.606625 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-e6275ea7-2682-4736-9aa6-3ba968ef0c15 req-917e05ef-6ec2-4d52-9240-4e6eb72d2bbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f94423aa-e701-4f83-a4ce-8d5a90325518", "tag": "17631478-219a-40dd-94fe-c981bae41eae"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:02:10.630376 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-e6275ea7-2682-4736-9aa6-3ba968ef0c15 req-917e05ef-6ec2-4d52-9240-4e6eb72d2bbc service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:10.630769 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-e6275ea7-2682-4736-9aa6-3ba968ef0c15 req-917e05ef-6ec2-4d52-9240-4e6eb72d2bbc service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:10.658087 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-e6275ea7-2682-4736-9aa6-3ba968ef0c15 req-917e05ef-6ec2-4d52-9240-4e6eb72d2bbc service nova] Creating event network-changed:17631478-219a-40dd-94fe-c981bae41eae for instance f94423aa-e701-4f83-a4ce-8d5a90325518 on n-h1-465891-3 Jul 18 03:02:10.681354 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-e6275ea7-2682-4736-9aa6-3ba968ef0c15 req-917e05ef-6ec2-4d52-9240-4e6eb72d2bbc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084006 Jul 18 03:02:10.681932 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2928/5866] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:02:10.699505 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0fb9f768-a095-49b1-a82b-887b83a66812 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:10.700383 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0fb9f768-a095-49b1-a82b-887b83a66812 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:10.715464 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0fb9f768-a095-49b1-a82b-887b83a66812 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:10.715944 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0fb9f768-a095-49b1-a82b-887b83a66812 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:10.720702 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0fb9f768-a095-49b1-a82b-887b83a66812 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:10.722352 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0fb9f768-a095-49b1-a82b-887b83a66812 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:10.875401 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-57bbfc1a-580c-46e4-8833-7669b73dc329 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:10.883966 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-57bbfc1a-580c-46e4-8833-7669b73dc329 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/ec729ac5-b620-4d07-bba8-9f098936d929" status: 200 len: 1292 microversion: 2.1 time: 0.597082 Jul 18 03:02:10.905755 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2939/5867] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:10 2022] GET /compute/v2.1/servers/ec729ac5-b620-4d07-bba8-9f098936d929 => generated 1292 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:11.195377 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0fb9f768-a095-49b1-a82b-887b83a66812 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:11.233298 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0fb9f768-a095-49b1-a82b-887b83a66812 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518" status: 200 len: 1686 microversion: 2.1 time: 0.544300 Jul 18 03:02:11.234494 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2929/5868] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:10 2022] GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518 => generated 1686 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:11.941351 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-62eac78d-e7fe-4d10-9399-80005d1ce81b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:11.956072 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-62eac78d-e7fe-4d10-9399-80005d1ce81b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: ec729ac5-b620-4d07-bba8-9f098936d929] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:12.012838 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-62eac78d-e7fe-4d10-9399-80005d1ce81b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:12.013965 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-62eac78d-e7fe-4d10-9399-80005d1ce81b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:12.015781 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-62eac78d-e7fe-4d10-9399-80005d1ce81b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:12.016614 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-62eac78d-e7fe-4d10-9399-80005d1ce81b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:12.268318 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-dee78786-b981-44c0-8aef-59a35e2325c0 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:12.271046 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-dee78786-b981-44c0-8aef-59a35e2325c0 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:12.303193 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dee78786-b981-44c0-8aef-59a35e2325c0 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:12.309387 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dee78786-b981-44c0-8aef-59a35e2325c0 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:12.311180 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dee78786-b981-44c0-8aef-59a35e2325c0 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:12.312130 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dee78786-b981-44c0-8aef-59a35e2325c0 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:13.464768 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-62eac78d-e7fe-4d10-9399-80005d1ce81b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:13.500235 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-62eac78d-e7fe-4d10-9399-80005d1ce81b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/ec729ac5-b620-4d07-bba8-9f098936d929" status: 200 len: 1292 microversion: 2.1 time: 1.561643 Jul 18 03:02:13.501578 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2940/5869] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:11 2022] GET /compute/v2.1/servers/ec729ac5-b620-4d07-bba8-9f098936d929 => generated 1292 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:13.597452 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-dee78786-b981-44c0-8aef-59a35e2325c0 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:13.630409 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-dee78786-b981-44c0-8aef-59a35e2325c0 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518" status: 200 len: 1686 microversion: 2.1 time: 1.370217 Jul 18 03:02:13.636041 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2930/5870] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:12 2022] GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518 => generated 1686 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:13.671777 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-66444f25-31ef-48d9-86a4-e3f3200a9560 req-388cee03-afe6-4328-80bf-f9a90d0fd49f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f94423aa-e701-4f83-a4ce-8d5a90325518", "name": "network-vif-deleted", "tag": "17631478-219a-40dd-94fe-c981bae41eae"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:02:13.678821 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=36 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:02:13.759639 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-66444f25-31ef-48d9-86a4-e3f3200a9560 req-388cee03-afe6-4328-80bf-f9a90d0fd49f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:13.759639 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-66444f25-31ef-48d9-86a4-e3f3200a9560 req-388cee03-afe6-4328-80bf-f9a90d0fd49f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:13.788805 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-66444f25-31ef-48d9-86a4-e3f3200a9560 req-388cee03-afe6-4328-80bf-f9a90d0fd49f service nova] Creating event network-vif-deleted:17631478-219a-40dd-94fe-c981bae41eae for instance f94423aa-e701-4f83-a4ce-8d5a90325518 on n-h1-465891-3 Jul 18 03:02:13.818224 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-66444f25-31ef-48d9-86a4-e3f3200a9560 req-388cee03-afe6-4328-80bf-f9a90d0fd49f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149504 Jul 18 03:02:13.825011 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2941/5871] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:02:13.909508 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-82ef2c4b-99e7-4b27-86f9-070f4edf2744 req-5aac074f-9e0d-49a2-8103-15d8da02626f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec729ac5-b620-4d07-bba8-9f098936d929", "name": "network-vif-plugged", "status": "completed", "tag": "3023158c-714c-4be3-9417-129f2f0b3be4"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:02:13.950829 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-82ef2c4b-99e7-4b27-86f9-070f4edf2744 req-5aac074f-9e0d-49a2-8103-15d8da02626f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:13.955475 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-82ef2c4b-99e7-4b27-86f9-070f4edf2744 req-5aac074f-9e0d-49a2-8103-15d8da02626f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:14.014141 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-82ef2c4b-99e7-4b27-86f9-070f4edf2744 req-5aac074f-9e0d-49a2-8103-15d8da02626f service nova] Creating event network-vif-plugged:3023158c-714c-4be3-9417-129f2f0b3be4 for instance ec729ac5-b620-4d07-bba8-9f098936d929 on n-h1-465891-3 Jul 18 03:02:14.071671 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-82ef2c4b-99e7-4b27-86f9-070f4edf2744 req-5aac074f-9e0d-49a2-8103-15d8da02626f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159567 Jul 18 03:02:14.076564 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2931/5872] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:02:14.529086 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f406cf0c-5687-4344-a216-0da796363c1d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:14.530623 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f406cf0c-5687-4344-a216-0da796363c1d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: ec729ac5-b620-4d07-bba8-9f098936d929] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:14.546818 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f406cf0c-5687-4344-a216-0da796363c1d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:14.547582 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f406cf0c-5687-4344-a216-0da796363c1d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:14.548611 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f406cf0c-5687-4344-a216-0da796363c1d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:14.549253 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f406cf0c-5687-4344-a216-0da796363c1d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:14.670517 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-27efa16d-e377-473a-8697-7240d0bb77b1 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:14.671692 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-27efa16d-e377-473a-8697-7240d0bb77b1 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:14.681037 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-27efa16d-e377-473a-8697-7240d0bb77b1 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:14.682129 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-27efa16d-e377-473a-8697-7240d0bb77b1 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:14.683290 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-27efa16d-e377-473a-8697-7240d0bb77b1 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:14.684645 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-27efa16d-e377-473a-8697-7240d0bb77b1 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:14.738284 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-27efa16d-e377-473a-8697-7240d0bb77b1 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:14.739017 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-27efa16d-e377-473a-8697-7240d0bb77b1 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:14.739666 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-27efa16d-e377-473a-8697-7240d0bb77b1 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lazy-loading 'fault' on Instance uuid f94423aa-e701-4f83-a4ce-8d5a90325518 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:02:14.892724 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-27efa16d-e377-473a-8697-7240d0bb77b1 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381a2ab772ff495cb85b89a85a267cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa240dfd375a45efb42fc04807acf847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:14.934453 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-27efa16d-e377-473a-8697-7240d0bb77b1 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518" status: 200 len: 1356 microversion: 2.1 time: 0.268106 Jul 18 03:02:14.937728 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2932/5873] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:14 2022] GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518 => generated 1356 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:02:15.111994 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f406cf0c-5687-4344-a216-0da796363c1d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:15.124609 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f406cf0c-5687-4344-a216-0da796363c1d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/ec729ac5-b620-4d07-bba8-9f098936d929" status: 200 len: 1292 microversion: 2.1 time: 0.599666 Jul 18 03:02:15.125479 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2942/5874] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:14 2022] GET /compute/v2.1/servers/ec729ac5-b620-4d07-bba8-9f098936d929 => generated 1292 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:15.975639 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-105f9880-e223-4198-92ed-5fb9d3bc0932 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:15.983828 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-105f9880-e223-4198-92ed-5fb9d3bc0932 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] [instance: f94423aa-e701-4f83-a4ce-8d5a90325518] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:16.004069 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:02:16.027353 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-105f9880-e223-4198-92ed-5fb9d3bc0932 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:16.031389 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-105f9880-e223-4198-92ed-5fb9d3bc0932 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:16.037557 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-105f9880-e223-4198-92ed-5fb9d3bc0932 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:16.042403 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-105f9880-e223-4198-92ed-5fb9d3bc0932 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:16.099393 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-105f9880-e223-4198-92ed-5fb9d3bc0932 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] HTTP exception thrown: Instance f94423aa-e701-4f83-a4ce-8d5a90325518 could not be found. Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-105f9880-e223-4198-92ed-5fb9d3bc0932 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Request method failure captured: Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518 HTTP/1.1 Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MnYuW4W0sup_YmXu0e6TfbM8UhRRyTVhU4O9V6AVf94vohRx4aPb83sBLBZeGqAob5OT52KfbhFJyFnUckm_AKJ129CUDEeh3rlnVQskw2FZl3adXOUNXwdv2KHTFmpLHnRTO3Qsn9Vcgn_cseZ_XT0zvfydkDjvO0Y6iKbO3M5yvk Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: fa240dfd375a45efb42fc04807acf847 Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1583539660 Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fa240dfd375a45efb42fc04807acf847"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fa240dfd375a45efb42fc04807acf847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fa240dfd375a45efb42fc04807acf847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fa240dfd375a45efb42fc04807acf847"}]}] Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1583539660 Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: fa240dfd375a45efb42fc04807acf847 Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1583539660 Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-TestNetworkAdvancedServerOps-1583539660-project Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 381a2ab772ff495cb85b89a85a267cfe Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1583539660-project Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance f94423aa-e701-4f83-a4ce-8d5a90325518 could not be found. Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'f94423aa-e701-4f83-a4ce-8d5a90325518'} Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f94423aa-e701-4f83-a4ce-8d5a90325518 could not be found. Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f94423aa-e701-4f83-a4ce-8d5a90325518 could not be found. Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:02:16.109409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:02:16.114646 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:02:16.114646 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:02:16.114646 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:02:16.114646 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:02:16.114646 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:02:16.114646 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:02:16.114646 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f94423aa-e701-4f83-a4ce-8d5a90325518 could not be found. Jul 18 03:02:16.114646 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:02:16.125347 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-105f9880-e223-4198-92ed-5fb9d3bc0932 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Returning 404 to user: Instance f94423aa-e701-4f83-a4ce-8d5a90325518 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:02:16.126880 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-105f9880-e223-4198-92ed-5fb9d3bc0932 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518" status: 404 len: 111 microversion: 2.1 time: 0.162319 Jul 18 03:02:16.128301 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2933/5875] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:15 2022] GET /compute/v2.1/servers/f94423aa-e701-4f83-a4ce-8d5a90325518 => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:02:16.158562 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2e591f5d-5cd3-4531-8553-761e33ce09d2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:16.161916 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2e591f5d-5cd3-4531-8553-761e33ce09d2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: ec729ac5-b620-4d07-bba8-9f098936d929] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:16.193888 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2e591f5d-5cd3-4531-8553-761e33ce09d2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:16.194866 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2e591f5d-5cd3-4531-8553-761e33ce09d2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:16.197371 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2e591f5d-5cd3-4531-8553-761e33ce09d2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:16.199330 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2e591f5d-5cd3-4531-8553-761e33ce09d2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:16.924095 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2e591f5d-5cd3-4531-8553-761e33ce09d2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:16.943334 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2e591f5d-5cd3-4531-8553-761e33ce09d2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/ec729ac5-b620-4d07-bba8-9f098936d929" status: 200 len: 1473 microversion: 2.1 time: 0.802396 Jul 18 03:02:16.946609 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2943/5876] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:16 2022] GET /compute/v2.1/servers/ec729ac5-b620-4d07-bba8-9f098936d929 => generated 1473 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:17.120712 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d3c8b29b-bb38-4720-b1bf-777c6353f906 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1451421118", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:02:17.316408 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-d3c8b29b-bb38-4720-b1bf-777c6353f906 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] validate_networks() for [('c540b69b-e7cc-4fa1-8fc6-67859b3d0823', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:02:19.210594 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-d3c8b29b-bb38-4720-b1bf-777c6353f906 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:02:19.212135 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-d3c8b29b-bb38-4720-b1bf-777c6353f906 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:02:19.212135 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-d3c8b29b-bb38-4720-b1bf-777c6353f906 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:02:19.212806 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-d3c8b29b-bb38-4720-b1bf-777c6353f906 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:02:19.213301 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-d3c8b29b-bb38-4720-b1bf-777c6353f906 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:02:19.239562 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d3c8b29b-bb38-4720-b1bf-777c6353f906 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:19.246489 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d3c8b29b-bb38-4720-b1bf-777c6353f906 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:19.248039 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d3c8b29b-bb38-4720-b1bf-777c6353f906 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:19.248666 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d3c8b29b-bb38-4720-b1bf-777c6353f906 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:19.302243 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-d3c8b29b-bb38-4720-b1bf-777c6353f906 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Getting quotas for project 3a83c4dedef341a0bb50fa4c119d3035. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:02:19.323631 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-d3c8b29b-bb38-4720-b1bf-777c6353f906 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Getting quotas for user 785ff643c00746939bb0fecd775ce920 and project 3a83c4dedef341a0bb50fa4c119d3035. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:02:19.355377 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d3c8b29b-bb38-4720-b1bf-777c6353f906 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:02:19.359978 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d3c8b29b-bb38-4720-b1bf-777c6353f906 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 9084b83a-605e-4c30-9224-3944a6db007d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:02:19.571656 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d3c8b29b-bb38-4720-b1bf-777c6353f906 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.499306 Jul 18 03:02:19.572341 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2934/5877] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:02:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:02:19.591229 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-41432d98-50e8-4e5e-9900-b67e298a48fc tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:19.593878 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-41432d98-50e8-4e5e-9900-b67e298a48fc tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 9084b83a-605e-4c30-9224-3944a6db007d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:19.689135 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-41432d98-50e8-4e5e-9900-b67e298a48fc tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 9084b83a-605e-4c30-9224-3944a6db007d] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:02:20.728349 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.scheduler.client.report [None req-41432d98-50e8-4e5e-9900-b67e298a48fc tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Deleted allocations for instance 9084b83a-605e-4c30-9224-3944a6db007d Jul 18 03:02:20.763895 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.compute.api [None req-41432d98-50e8-4e5e-9900-b67e298a48fc tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 9084b83a-605e-4c30-9224-3944a6db007d] Instance Mapping does not exist while attempting local delete cleanup. Jul 18 03:02:20.766522 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-41432d98-50e8-4e5e-9900-b67e298a48fc tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9084b83a-605e-4c30-9224-3944a6db007d" status: 204 len: 0 microversion: 2.1 time: 1.181938 Jul 18 03:02:20.779935 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2944/5878] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:02:19 2022] DELETE /compute/v2.1/servers/9084b83a-605e-4c30-9224-3944a6db007d => generated 0 bytes in 1194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:02:20.802175 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0c37cfe0-d6b9-4100-a940-d6ac0d784421 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:20.811259 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0c37cfe0-d6b9-4100-a940-d6ac0d784421 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 9084b83a-605e-4c30-9224-3944a6db007d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:20.843944 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-0c37cfe0-d6b9-4100-a940-d6ac0d784421 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] HTTP exception thrown: Instance 9084b83a-605e-4c30-9224-3944a6db007d could not be found. Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0c37cfe0-d6b9-4100-a940-d6ac0d784421 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Request method failure captured: Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/9084b83a-605e-4c30-9224-3944a6db007d HTTP/1.1 Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M0c--VxkhAcA4gIHXxijKFI-k8Bpror72Hk1qb235rYnfDmQTByX9LOOCSekEaTY-qK46fTc9MDDZBpaIS7PRARBL52HY7fvnzNvoh5YO0XpJvHbsKLywLFoe1R8EGrLF6lPIQIdQdkEzZxbEDXhePA7F15YYp44S7QRWnysLrh4M4 Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3a83c4dedef341a0bb50fa4c119d3035"}]}] Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersTestJSON-1250523732 Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersTestJSON-1250523732-project Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 785ff643c00746939bb0fecd775ce920 Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersTestJSON-1250523732-project Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 9084b83a-605e-4c30-9224-3944a6db007d could not be found. Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '9084b83a-605e-4c30-9224-3944a6db007d'} Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9084b83a-605e-4c30-9224-3944a6db007d could not be found. Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9084b83a-605e-4c30-9224-3944a6db007d could not be found. Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:02:20.859931 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:02:20.870455 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:02:20.870455 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:02:20.870455 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9084b83a-605e-4c30-9224-3944a6db007d could not be found. Jul 18 03:02:20.870455 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:02:20.874783 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0c37cfe0-d6b9-4100-a940-d6ac0d784421 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Returning 404 to user: Instance 9084b83a-605e-4c30-9224-3944a6db007d could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:02:20.879745 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0c37cfe0-d6b9-4100-a940-d6ac0d784421 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/9084b83a-605e-4c30-9224-3944a6db007d" status: 404 len: 111 microversion: 2.1 time: 0.096598 Jul 18 03:02:20.885023 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2935/5879] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:20 2022] GET /compute/v2.1/servers/9084b83a-605e-4c30-9224-3944a6db007d => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:02:21.059422 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-afc69a68-d715-4478-a520-7cabff88e73d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1037193189", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "c540b69b-e7cc-4fa1-8fc6-67859b3d0823"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:02:21.361581 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-afc69a68-d715-4478-a520-7cabff88e73d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] validate_networks() for [('c540b69b-e7cc-4fa1-8fc6-67859b3d0823', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:02:22.967840 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-afc69a68-d715-4478-a520-7cabff88e73d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:02:22.969974 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-afc69a68-d715-4478-a520-7cabff88e73d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:02:22.971368 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-afc69a68-d715-4478-a520-7cabff88e73d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:02:22.972656 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-afc69a68-d715-4478-a520-7cabff88e73d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:02:22.973732 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-afc69a68-d715-4478-a520-7cabff88e73d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:02:23.022122 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-afc69a68-d715-4478-a520-7cabff88e73d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:23.023152 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-afc69a68-d715-4478-a520-7cabff88e73d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:23.028895 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-afc69a68-d715-4478-a520-7cabff88e73d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:23.042990 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-afc69a68-d715-4478-a520-7cabff88e73d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:23.127631 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-afc69a68-d715-4478-a520-7cabff88e73d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Getting quotas for project 3a83c4dedef341a0bb50fa4c119d3035. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:02:23.155166 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-afc69a68-d715-4478-a520-7cabff88e73d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Getting quotas for user 785ff643c00746939bb0fecd775ce920 and project 3a83c4dedef341a0bb50fa4c119d3035. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:02:23.216591 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-afc69a68-d715-4478-a520-7cabff88e73d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:02:23.235240 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-afc69a68-d715-4478-a520-7cabff88e73d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: af6f7e23-115f-4853-934d-e53508a8b01d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:02:23.353521 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-afc69a68-d715-4478-a520-7cabff88e73d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.301796 Jul 18 03:02:23.363721 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2945/5880] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:02:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2315 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:02:23.383263 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-aeab1d9d-91e4-46d3-8ded-4bcc2ba3a456 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:23.399329 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-aeab1d9d-91e4-46d3-8ded-4bcc2ba3a456 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: af6f7e23-115f-4853-934d-e53508a8b01d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:23.792782 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-aeab1d9d-91e4-46d3-8ded-4bcc2ba3a456 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:23.816577 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-aeab1d9d-91e4-46d3-8ded-4bcc2ba3a456 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d" status: 200 len: 1221 microversion: 2.1 time: 0.452310 Jul 18 03:02:23.821353 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2936/5881] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:23 2022] GET /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d => generated 1221 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:24.858765 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-238e45a3-3bad-4208-b713-18d5a6a08d6f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:24.866556 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-238e45a3-3bad-4208-b713-18d5a6a08d6f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: af6f7e23-115f-4853-934d-e53508a8b01d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:25.062682 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-238e45a3-3bad-4208-b713-18d5a6a08d6f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:25.075366 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-238e45a3-3bad-4208-b713-18d5a6a08d6f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d" status: 200 len: 1221 microversion: 2.1 time: 0.227919 Jul 18 03:02:25.078831 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2946/5882] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:24 2022] GET /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d => generated 1221 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:26.108087 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a047d663-db9b-4dab-8b20-366ea50b9639 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:26.110987 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a047d663-db9b-4dab-8b20-366ea50b9639 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: af6f7e23-115f-4853-934d-e53508a8b01d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:26.163973 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a047d663-db9b-4dab-8b20-366ea50b9639 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:26.168280 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a047d663-db9b-4dab-8b20-366ea50b9639 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:26.177830 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a047d663-db9b-4dab-8b20-366ea50b9639 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:26.182879 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a047d663-db9b-4dab-8b20-366ea50b9639 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:26.201450 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:02:26.465037 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a047d663-db9b-4dab-8b20-366ea50b9639 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:26.506659 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a047d663-db9b-4dab-8b20-366ea50b9639 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d" status: 200 len: 1273 microversion: 2.1 time: 0.408463 Jul 18 03:02:26.507775 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2937/5883] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:26 2022] GET /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d => generated 1273 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:26.926663 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4b8067dd-1e5b-45d1-8ca5-9794b56b9780 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] Calling method '.version_select at 0x7ff4984ecca0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:26.971784 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4b8067dd-1e5b-45d1-8ca5-9794b56b9780 tempest-TestNetworkAdvancedServerOps-1583539660 tempest-TestNetworkAdvancedServerOps-1583539660-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1658491502" status: 202 len: 0 microversion: 2.1 time: 0.052446 Jul 18 03:02:26.991357 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2947/5884] 10.222.0.57 () {58 vars in 1283 bytes} [Mon Jul 18 03:02:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1658491502 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:02:27.534983 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f4a90162-bc9e-4fe7-9f5e-46fa28dc113d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:27.537519 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f4a90162-bc9e-4fe7-9f5e-46fa28dc113d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: af6f7e23-115f-4853-934d-e53508a8b01d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:27.566929 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f4a90162-bc9e-4fe7-9f5e-46fa28dc113d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:27.569171 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f4a90162-bc9e-4fe7-9f5e-46fa28dc113d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:27.570199 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f4a90162-bc9e-4fe7-9f5e-46fa28dc113d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:27.571195 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f4a90162-bc9e-4fe7-9f5e-46fa28dc113d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:27.821910 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f4a90162-bc9e-4fe7-9f5e-46fa28dc113d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:27.840095 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f4a90162-bc9e-4fe7-9f5e-46fa28dc113d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d" status: 200 len: 1279 microversion: 2.1 time: 0.316973 Jul 18 03:02:27.865472 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2938/5885] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:27 2022] GET /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d => generated 1279 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:28.875384 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e4105bdf-7e97-4939-93bd-a740e35bdf52 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:28.877121 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e4105bdf-7e97-4939-93bd-a740e35bdf52 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: af6f7e23-115f-4853-934d-e53508a8b01d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:28.903697 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e4105bdf-7e97-4939-93bd-a740e35bdf52 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:28.904422 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e4105bdf-7e97-4939-93bd-a740e35bdf52 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:28.911459 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e4105bdf-7e97-4939-93bd-a740e35bdf52 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:28.912709 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e4105bdf-7e97-4939-93bd-a740e35bdf52 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:29.189443 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e4105bdf-7e97-4939-93bd-a740e35bdf52 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:29.214902 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e4105bdf-7e97-4939-93bd-a740e35bdf52 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d" status: 200 len: 1321 microversion: 2.1 time: 0.345234 Jul 18 03:02:29.216315 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2948/5886] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:28 2022] GET /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d => generated 1321 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:29.982106 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-bd06eb22-8cd4-4b73-a1a1-e006ea582d0c req-1cc14e2c-beca-4b48-b7bc-33340378a40a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af6f7e23-115f-4853-934d-e53508a8b01d", "tag": "5a379db2-8504-4c99-838c-89cfe8d393f8"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:02:30.006487 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:02:30.021915 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-bd06eb22-8cd4-4b73-a1a1-e006ea582d0c req-1cc14e2c-beca-4b48-b7bc-33340378a40a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:30.022621 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-bd06eb22-8cd4-4b73-a1a1-e006ea582d0c req-1cc14e2c-beca-4b48-b7bc-33340378a40a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:30.040972 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-bd06eb22-8cd4-4b73-a1a1-e006ea582d0c req-1cc14e2c-beca-4b48-b7bc-33340378a40a service nova] Creating event network-changed:5a379db2-8504-4c99-838c-89cfe8d393f8 for instance af6f7e23-115f-4853-934d-e53508a8b01d on n-h2-465891-3 Jul 18 03:02:30.050921 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-bd06eb22-8cd4-4b73-a1a1-e006ea582d0c req-1cc14e2c-beca-4b48-b7bc-33340378a40a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076299 Jul 18 03:02:30.052417 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2939/5887] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:02:30.249181 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-97ecc37b-a068-4d09-9fa4-62c025febb58 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:30.251184 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-97ecc37b-a068-4d09-9fa4-62c025febb58 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: af6f7e23-115f-4853-934d-e53508a8b01d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:30.265941 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-97ecc37b-a068-4d09-9fa4-62c025febb58 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:30.271567 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-97ecc37b-a068-4d09-9fa4-62c025febb58 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:30.272907 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-97ecc37b-a068-4d09-9fa4-62c025febb58 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:30.275415 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-97ecc37b-a068-4d09-9fa4-62c025febb58 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:30.625446 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-97ecc37b-a068-4d09-9fa4-62c025febb58 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:30.643811 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-97ecc37b-a068-4d09-9fa4-62c025febb58 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d" status: 200 len: 1321 microversion: 2.1 time: 0.398636 Jul 18 03:02:30.650248 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2949/5888] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:30 2022] GET /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d => generated 1321 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:31.671366 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-61a74871-e779-48b1-ae5e-3cda6c564d3d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:31.672230 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-61a74871-e779-48b1-ae5e-3cda6c564d3d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: af6f7e23-115f-4853-934d-e53508a8b01d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:31.691366 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-61a74871-e779-48b1-ae5e-3cda6c564d3d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:31.693005 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-61a74871-e779-48b1-ae5e-3cda6c564d3d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:31.694163 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-61a74871-e779-48b1-ae5e-3cda6c564d3d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:31.694776 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-61a74871-e779-48b1-ae5e-3cda6c564d3d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:32.223741 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-61a74871-e779-48b1-ae5e-3cda6c564d3d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:32.235858 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-61a74871-e779-48b1-ae5e-3cda6c564d3d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d" status: 200 len: 1321 microversion: 2.1 time: 0.568627 Jul 18 03:02:32.237756 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2940/5889] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:31 2022] GET /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d => generated 1321 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:33.256373 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f66d47ff-a32a-408e-8271-b662f81f6e61 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:33.259907 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f66d47ff-a32a-408e-8271-b662f81f6e61 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: af6f7e23-115f-4853-934d-e53508a8b01d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:33.265988 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:02:33.284352 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f66d47ff-a32a-408e-8271-b662f81f6e61 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:33.285141 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f66d47ff-a32a-408e-8271-b662f81f6e61 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:33.307603 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f66d47ff-a32a-408e-8271-b662f81f6e61 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:33.309817 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f66d47ff-a32a-408e-8271-b662f81f6e61 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:34.379130 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f66d47ff-a32a-408e-8271-b662f81f6e61 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:34.411206 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f66d47ff-a32a-408e-8271-b662f81f6e61 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d" status: 200 len: 1321 microversion: 2.1 time: 1.161826 Jul 18 03:02:34.422227 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2950/5890] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:33 2022] GET /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d => generated 1321 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:02:35.433413 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1fdba7ea-3811-48af-ab3a-e4c8b09230bd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:35.434056 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1fdba7ea-3811-48af-ab3a-e4c8b09230bd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: af6f7e23-115f-4853-934d-e53508a8b01d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:35.455688 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=8 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:02:35.467553 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1fdba7ea-3811-48af-ab3a-e4c8b09230bd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:35.468373 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1fdba7ea-3811-48af-ab3a-e4c8b09230bd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:35.470561 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1fdba7ea-3811-48af-ab3a-e4c8b09230bd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:35.471010 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1fdba7ea-3811-48af-ab3a-e4c8b09230bd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:35.918490 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1fdba7ea-3811-48af-ab3a-e4c8b09230bd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:35.930618 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1fdba7ea-3811-48af-ab3a-e4c8b09230bd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d" status: 200 len: 1321 microversion: 2.1 time: 0.501265 Jul 18 03:02:35.942158 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2941/5891] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:35 2022] GET /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d => generated 1321 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:36.950416 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-34c5aaa6-130c-4e0f-8825-4782e9c76513 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:36.952325 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-34c5aaa6-130c-4e0f-8825-4782e9c76513 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: af6f7e23-115f-4853-934d-e53508a8b01d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:36.955166 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=10 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:02:36.972769 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-34c5aaa6-130c-4e0f-8825-4782e9c76513 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:36.973540 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-34c5aaa6-130c-4e0f-8825-4782e9c76513 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:36.974642 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-34c5aaa6-130c-4e0f-8825-4782e9c76513 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:36.975100 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-34c5aaa6-130c-4e0f-8825-4782e9c76513 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:36.994200 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-003b752d-4604-4866-92ed-d90c2eacef9b req-1689f9df-62f2-48c7-a77e-6c1a140bf6da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af6f7e23-115f-4853-934d-e53508a8b01d", "name": "network-vif-plugged", "status": "completed", "tag": "5a379db2-8504-4c99-838c-89cfe8d393f8"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:02:37.015850 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-003b752d-4604-4866-92ed-d90c2eacef9b req-1689f9df-62f2-48c7-a77e-6c1a140bf6da service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:37.018303 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-003b752d-4604-4866-92ed-d90c2eacef9b req-1689f9df-62f2-48c7-a77e-6c1a140bf6da service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:37.063184 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-003b752d-4604-4866-92ed-d90c2eacef9b req-1689f9df-62f2-48c7-a77e-6c1a140bf6da service nova] Creating event network-vif-plugged:5a379db2-8504-4c99-838c-89cfe8d393f8 for instance af6f7e23-115f-4853-934d-e53508a8b01d on n-h2-465891-3 Jul 18 03:02:37.075251 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-003b752d-4604-4866-92ed-d90c2eacef9b req-1689f9df-62f2-48c7-a77e-6c1a140bf6da service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087137 Jul 18 03:02:37.080210 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2942/5892] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:02:37.714547 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-34c5aaa6-130c-4e0f-8825-4782e9c76513 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:37.717248 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=56 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:02:37.735928 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-34c5aaa6-130c-4e0f-8825-4782e9c76513 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d" status: 200 len: 1321 microversion: 2.1 time: 0.790292 Jul 18 03:02:37.738157 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2951/5893] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:36 2022] GET /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d => generated 1321 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:38.765636 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e6b5d091-0cf3-414a-8732-226e36f1ab89 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:38.767192 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e6b5d091-0cf3-414a-8732-226e36f1ab89 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: af6f7e23-115f-4853-934d-e53508a8b01d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:38.785472 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e6b5d091-0cf3-414a-8732-226e36f1ab89 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:38.786088 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e6b5d091-0cf3-414a-8732-226e36f1ab89 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:38.787124 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e6b5d091-0cf3-414a-8732-226e36f1ab89 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:38.787679 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e6b5d091-0cf3-414a-8732-226e36f1ab89 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:39.404965 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e6b5d091-0cf3-414a-8732-226e36f1ab89 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:39.421508 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e6b5d091-0cf3-414a-8732-226e36f1ab89 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d" status: 200 len: 1321 microversion: 2.1 time: 0.660408 Jul 18 03:02:39.423768 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2943/5894] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:38 2022] GET /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d => generated 1321 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:40.452524 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e2e7106a-7f11-4f27-ac29-2d7b56ee47c2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:40.455058 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e2e7106a-7f11-4f27-ac29-2d7b56ee47c2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: af6f7e23-115f-4853-934d-e53508a8b01d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:40.494600 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e2e7106a-7f11-4f27-ac29-2d7b56ee47c2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:40.496533 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e2e7106a-7f11-4f27-ac29-2d7b56ee47c2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:40.499082 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e2e7106a-7f11-4f27-ac29-2d7b56ee47c2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:40.505106 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e2e7106a-7f11-4f27-ac29-2d7b56ee47c2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:41.420838 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e2e7106a-7f11-4f27-ac29-2d7b56ee47c2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:41.455884 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e2e7106a-7f11-4f27-ac29-2d7b56ee47c2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d" status: 200 len: 1502 microversion: 2.1 time: 1.004811 Jul 18 03:02:41.460149 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2952/5895] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:40 2022] GET /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d => generated 1502 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:02:41.479024 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-192b6855-998f-4468-8a03-a1c2796ccc1c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:41.479850 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-192b6855-998f-4468-8a03-a1c2796ccc1c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: af6f7e23-115f-4853-934d-e53508a8b01d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:41.506903 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-192b6855-998f-4468-8a03-a1c2796ccc1c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:41.507482 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-192b6855-998f-4468-8a03-a1c2796ccc1c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:41.511796 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-192b6855-998f-4468-8a03-a1c2796ccc1c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:41.512753 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-192b6855-998f-4468-8a03-a1c2796ccc1c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:41.785851 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-192b6855-998f-4468-8a03-a1c2796ccc1c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:41.797891 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-192b6855-998f-4468-8a03-a1c2796ccc1c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d" status: 200 len: 1502 microversion: 2.1 time: 0.324820 Jul 18 03:02:41.798716 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2944/5896] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:41 2022] GET /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d => generated 1502 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:02:41.831581 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7acbd9b5-4b74-4e62-8f74-c77d18e6b10a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:41.832491 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7acbd9b5-4b74-4e62-8f74-c77d18e6b10a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: af6f7e23-115f-4853-934d-e53508a8b01d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:41.852910 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7acbd9b5-4b74-4e62-8f74-c77d18e6b10a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:41.854231 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7acbd9b5-4b74-4e62-8f74-c77d18e6b10a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:41.857526 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7acbd9b5-4b74-4e62-8f74-c77d18e6b10a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:41.858779 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7acbd9b5-4b74-4e62-8f74-c77d18e6b10a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:41.921983 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7acbd9b5-4b74-4e62-8f74-c77d18e6b10a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: af6f7e23-115f-4853-934d-e53508a8b01d] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:02:42.125855 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7acbd9b5-4b74-4e62-8f74-c77d18e6b10a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "DELETE /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d" status: 204 len: 0 microversion: 2.1 time: 0.296687 Jul 18 03:02:42.131899 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2953/5897] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:02:41 2022] DELETE /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 03:02:42.137351 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7563c0a0-65c2-4878-9352-6068459a7efb tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:42.138397 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7563c0a0-65c2-4878-9352-6068459a7efb tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: af6f7e23-115f-4853-934d-e53508a8b01d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:42.153450 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7563c0a0-65c2-4878-9352-6068459a7efb tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:42.154158 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7563c0a0-65c2-4878-9352-6068459a7efb tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:42.155663 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7563c0a0-65c2-4878-9352-6068459a7efb tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:42.156120 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7563c0a0-65c2-4878-9352-6068459a7efb tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:42.480323 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7563c0a0-65c2-4878-9352-6068459a7efb tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:42.493052 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7563c0a0-65c2-4878-9352-6068459a7efb tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d" status: 200 len: 1508 microversion: 2.1 time: 0.359524 Jul 18 03:02:42.494933 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2945/5898] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:42 2022] GET /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d => generated 1508 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:02:43.530445 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9cb3bc4a-c042-4234-ac37-7dc037cf3521 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:43.536560 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9cb3bc4a-c042-4234-ac37-7dc037cf3521 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: af6f7e23-115f-4853-934d-e53508a8b01d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:43.590653 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9cb3bc4a-c042-4234-ac37-7dc037cf3521 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:43.597485 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9cb3bc4a-c042-4234-ac37-7dc037cf3521 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:43.605888 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9cb3bc4a-c042-4234-ac37-7dc037cf3521 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:43.607099 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9cb3bc4a-c042-4234-ac37-7dc037cf3521 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:44.157164 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9cb3bc4a-c042-4234-ac37-7dc037cf3521 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:44.211493 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9cb3bc4a-c042-4234-ac37-7dc037cf3521 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d" status: 200 len: 1508 microversion: 2.1 time: 0.691774 Jul 18 03:02:44.228765 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2954/5899] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:43 2022] GET /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d => generated 1508 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:02:45.092962 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-cc8bd2d5-82a7-477e-b082-fa0b3afaf37a req-cec64a68-3740-43ed-a0c8-520f7a9cfc65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af6f7e23-115f-4853-934d-e53508a8b01d", "name": "network-vif-deleted", "tag": "5a379db2-8504-4c99-838c-89cfe8d393f8"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:02:45.129998 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-cc8bd2d5-82a7-477e-b082-fa0b3afaf37a req-cec64a68-3740-43ed-a0c8-520f7a9cfc65 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:45.130628 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-cc8bd2d5-82a7-477e-b082-fa0b3afaf37a req-cec64a68-3740-43ed-a0c8-520f7a9cfc65 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:45.168383 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-cc8bd2d5-82a7-477e-b082-fa0b3afaf37a req-cec64a68-3740-43ed-a0c8-520f7a9cfc65 service nova] Creating event network-vif-deleted:5a379db2-8504-4c99-838c-89cfe8d393f8 for instance af6f7e23-115f-4853-934d-e53508a8b01d on n-h2-465891-3 Jul 18 03:02:45.184087 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-cc8bd2d5-82a7-477e-b082-fa0b3afaf37a req-cec64a68-3740-43ed-a0c8-520f7a9cfc65 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095293 Jul 18 03:02:45.185321 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2946/5900] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:02:45.261055 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-316eba6f-f117-42f3-bcc5-7e7a2147fc77 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:45.262407 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-316eba6f-f117-42f3-bcc5-7e7a2147fc77 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: af6f7e23-115f-4853-934d-e53508a8b01d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:45.266645 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:02:45.278321 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-316eba6f-f117-42f3-bcc5-7e7a2147fc77 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:45.279088 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-316eba6f-f117-42f3-bcc5-7e7a2147fc77 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:45.280082 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-316eba6f-f117-42f3-bcc5-7e7a2147fc77 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:45.280714 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-316eba6f-f117-42f3-bcc5-7e7a2147fc77 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:45.405412 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-316eba6f-f117-42f3-bcc5-7e7a2147fc77 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:45.405962 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-316eba6f-f117-42f3-bcc5-7e7a2147fc77 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:45.406625 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-316eba6f-f117-42f3-bcc5-7e7a2147fc77 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lazy-loading 'fault' on Instance uuid af6f7e23-115f-4853-934d-e53508a8b01d {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:02:45.511566 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-316eba6f-f117-42f3-bcc5-7e7a2147fc77 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:45.520453 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-316eba6f-f117-42f3-bcc5-7e7a2147fc77 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d" status: 200 len: 1311 microversion: 2.1 time: 0.263208 Jul 18 03:02:45.521136 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2955/5901] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:45 2022] GET /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d => generated 1311 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:02:46.555016 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5a77f571-9b61-4d92-91c2-107ad17f0e07 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:46.555853 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5a77f571-9b61-4d92-91c2-107ad17f0e07 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: af6f7e23-115f-4853-934d-e53508a8b01d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:46.570123 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5a77f571-9b61-4d92-91c2-107ad17f0e07 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:46.578084 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5a77f571-9b61-4d92-91c2-107ad17f0e07 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:46.579192 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5a77f571-9b61-4d92-91c2-107ad17f0e07 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:46.579721 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5a77f571-9b61-4d92-91c2-107ad17f0e07 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:46.612025 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-5a77f571-9b61-4d92-91c2-107ad17f0e07 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] HTTP exception thrown: Instance af6f7e23-115f-4853-934d-e53508a8b01d could not be found. Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5a77f571-9b61-4d92-91c2-107ad17f0e07 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Request method failure captured: Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d HTTP/1.1 Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M0c--VxkhAcA4gIHXxijKFI-k8Bpror72Hk1qb235rYnfDmQTByX9LOOCSekEaTY-qK46fTc9MDDZBpaIS7PRARBL52HY7fvnzNvoh5YO0XpJvHbsKLywLFoe1R8EGrLF6lPIQIdQdkEzZxbEDXhePA7F15YYp44S7QRWnysLrh4M4 Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3a83c4dedef341a0bb50fa4c119d3035"}]}] Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersTestJSON-1250523732 Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersTestJSON-1250523732-project Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 785ff643c00746939bb0fecd775ce920 Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersTestJSON-1250523732-project Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance af6f7e23-115f-4853-934d-e53508a8b01d could not be found. Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'af6f7e23-115f-4853-934d-e53508a8b01d'} Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af6f7e23-115f-4853-934d-e53508a8b01d could not be found. Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af6f7e23-115f-4853-934d-e53508a8b01d could not be found. Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:02:46.619924 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:02:46.625152 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:02:46.625152 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:02:46.625152 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:02:46.625152 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:02:46.625152 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af6f7e23-115f-4853-934d-e53508a8b01d could not be found. Jul 18 03:02:46.625152 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:02:46.626825 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5a77f571-9b61-4d92-91c2-107ad17f0e07 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Returning 404 to user: Instance af6f7e23-115f-4853-934d-e53508a8b01d could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:02:46.627986 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5a77f571-9b61-4d92-91c2-107ad17f0e07 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d" status: 404 len: 111 microversion: 2.1 time: 0.079684 Jul 18 03:02:46.629325 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2947/5902] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:46 2022] GET /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:02:46.649621 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-321bad84-def6-4a01-99b7-c7dfc2c96399 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Action: 'create', calling method: .version_select at 0x7ff49b6b38b0>, body: {"keypair": {"name": "tempest-key-55748382", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFoiCFexJugxQmOXyQ2pB3dmD/RYR7KRskUlQ9B7s1rDBbpOrAvexTgeBzOHk8QQKy8magbV48wBX3lpaMY77Ioe6VFEEGWNlFUhFUJun+sxZ8uEgGKO60XZ1x0/hboLKg=="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:02:46.679496 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-321bad84-def6-4a01-99b7-c7dfc2c96399 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Getting quotas for project 3a83c4dedef341a0bb50fa4c119d3035. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:02:46.693528 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-321bad84-def6-4a01-99b7-c7dfc2c96399 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Getting quotas for user 785ff643c00746939bb0fecd775ce920 and project 3a83c4dedef341a0bb50fa4c119d3035. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:02:46.771823 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-321bad84-def6-4a01-99b7-c7dfc2c96399 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 380 microversion: 2.1 time: 0.124860 Jul 18 03:02:46.777916 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2956/5903] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 03:02:46 2022] POST /compute/v2.1/os-keypairs => generated 380 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:02:46.793144 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0fdf8343-6f82-4e4d-a3d8-b91ade33c456 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '.version_select at 0x7ff4a826c1f0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:46.797270 n-d-465891-3 devstack@n-api.service[119544]: WARNING oslo_db.sqlalchemy.utils [None req-0fdf8343-6f82-4e4d-a3d8-b91ade33c456 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 18 03:02:46.812864 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0fdf8343-6f82-4e4d-a3d8-b91ade33c456 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/os-keypairs" status: 200 len: 349 microversion: 2.1 time: 0.025538 Jul 18 03:02:46.814193 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2948/5904] 10.222.0.57 () {58 vars in 1136 bytes} [Mon Jul 18 03:02:46 2022] GET /compute/v2.1/os-keypairs => generated 349 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:02:47.176071 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-af62d31c-43a3-459f-bdf8-a4fc11badc9e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-826598952", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "key_name": "tempest-key-55748382", "networks": [{"uuid": "c540b69b-e7cc-4fa1-8fc6-67859b3d0823"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:02:47.406844 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-af62d31c-43a3-459f-bdf8-a4fc11badc9e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] validate_networks() for [('c540b69b-e7cc-4fa1-8fc6-67859b3d0823', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:02:48.699605 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-af62d31c-43a3-459f-bdf8-a4fc11badc9e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:02:48.700205 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-af62d31c-43a3-459f-bdf8-a4fc11badc9e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:02:48.700684 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-af62d31c-43a3-459f-bdf8-a4fc11badc9e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:02:48.701335 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-af62d31c-43a3-459f-bdf8-a4fc11badc9e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:02:48.701834 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-af62d31c-43a3-459f-bdf8-a4fc11badc9e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:02:48.716857 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-af62d31c-43a3-459f-bdf8-a4fc11badc9e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:48.717343 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-af62d31c-43a3-459f-bdf8-a4fc11badc9e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:48.718230 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-af62d31c-43a3-459f-bdf8-a4fc11badc9e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:48.718776 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-af62d31c-43a3-459f-bdf8-a4fc11badc9e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:48.784454 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-af62d31c-43a3-459f-bdf8-a4fc11badc9e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Getting quotas for project 3a83c4dedef341a0bb50fa4c119d3035. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:02:48.807916 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-af62d31c-43a3-459f-bdf8-a4fc11badc9e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Getting quotas for user 785ff643c00746939bb0fecd775ce920 and project 3a83c4dedef341a0bb50fa4c119d3035. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:02:48.833624 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-af62d31c-43a3-459f-bdf8-a4fc11badc9e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:02:48.837545 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-af62d31c-43a3-459f-bdf8-a4fc11badc9e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: d65bfa08-ae5d-422b-a045-71d045b06e44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:02:48.958128 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-af62d31c-43a3-459f-bdf8-a4fc11badc9e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.793979 Jul 18 03:02:48.962537 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2957/5905] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:02:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 03:02:48.976191 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-754cdad9-4162-4b24-a7b8-dd4e60a0e8f1 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:48.976853 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-754cdad9-4162-4b24-a7b8-dd4e60a0e8f1 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: d65bfa08-ae5d-422b-a045-71d045b06e44] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:48.982865 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:02:49.228788 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-754cdad9-4162-4b24-a7b8-dd4e60a0e8f1 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:49.250077 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-754cdad9-4162-4b24-a7b8-dd4e60a0e8f1 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44" status: 200 len: 1226 microversion: 2.1 time: 0.277692 Jul 18 03:02:49.259856 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2949/5906] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:48 2022] GET /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44 => generated 1226 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:02:50.284970 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-74ec5216-1755-4262-bee3-23019760411b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:50.286339 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-74ec5216-1755-4262-bee3-23019760411b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: d65bfa08-ae5d-422b-a045-71d045b06e44] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:50.643105 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-74ec5216-1755-4262-bee3-23019760411b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:50.690145 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-74ec5216-1755-4262-bee3-23019760411b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44" status: 200 len: 1226 microversion: 2.1 time: 0.408859 Jul 18 03:02:50.697503 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2958/5907] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:50 2022] GET /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44 => generated 1226 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:51.729406 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5b1d93a9-3fa5-4948-a544-a8f877d8b6e0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:51.736048 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5b1d93a9-3fa5-4948-a544-a8f877d8b6e0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: d65bfa08-ae5d-422b-a045-71d045b06e44] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:51.787166 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5b1d93a9-3fa5-4948-a544-a8f877d8b6e0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:51.787949 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5b1d93a9-3fa5-4948-a544-a8f877d8b6e0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:51.795645 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5b1d93a9-3fa5-4948-a544-a8f877d8b6e0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:51.796981 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5b1d93a9-3fa5-4948-a544-a8f877d8b6e0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:52.103657 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5b1d93a9-3fa5-4948-a544-a8f877d8b6e0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:52.161063 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5b1d93a9-3fa5-4948-a544-a8f877d8b6e0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44" status: 200 len: 1296 microversion: 2.1 time: 0.442225 Jul 18 03:02:52.167052 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2950/5908] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:51 2022] GET /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44 => generated 1296 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:53.205675 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-99492ea1-9f2e-4d59-b726-9de238420f58 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:53.206913 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-99492ea1-9f2e-4d59-b726-9de238420f58 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: d65bfa08-ae5d-422b-a045-71d045b06e44] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:53.270312 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-99492ea1-9f2e-4d59-b726-9de238420f58 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:53.283020 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-99492ea1-9f2e-4d59-b726-9de238420f58 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:53.302706 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-99492ea1-9f2e-4d59-b726-9de238420f58 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:53.305204 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-99492ea1-9f2e-4d59-b726-9de238420f58 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:53.577411 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-99492ea1-9f2e-4d59-b726-9de238420f58 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:53.592401 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-99492ea1-9f2e-4d59-b726-9de238420f58 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44" status: 200 len: 1284 microversion: 2.1 time: 0.400787 Jul 18 03:02:53.597394 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2959/5909] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:53 2022] GET /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44 => generated 1284 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:54.626288 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4b267791-8294-43de-8cd2-45a462c3dfe5 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:54.631309 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4b267791-8294-43de-8cd2-45a462c3dfe5 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: d65bfa08-ae5d-422b-a045-71d045b06e44] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:54.691727 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4b267791-8294-43de-8cd2-45a462c3dfe5 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:54.693177 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4b267791-8294-43de-8cd2-45a462c3dfe5 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:54.694540 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4b267791-8294-43de-8cd2-45a462c3dfe5 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:54.695067 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4b267791-8294-43de-8cd2-45a462c3dfe5 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:55.809989 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4b267791-8294-43de-8cd2-45a462c3dfe5 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:55.821549 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4b267791-8294-43de-8cd2-45a462c3dfe5 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44" status: 200 len: 1326 microversion: 2.1 time: 1.208127 Jul 18 03:02:55.823481 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2951/5910] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:54 2022] GET /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44 => generated 1326 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:56.599717 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-16731f23-8555-4a34-8d76-d4368b9ccd89 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:56.624575 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 03:02:56.624575 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 03:02:56.626717 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-16731f23-8555-4a34-8d76-d4368b9ccd89 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:56.627339 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-16731f23-8555-4a34-8d76-d4368b9ccd89 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:56.628477 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-16731f23-8555-4a34-8d76-d4368b9ccd89 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:56.630015 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-16731f23-8555-4a34-8d76-d4368b9ccd89 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:56.648216 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-ad5ba575-e740-4e95-9858-0671791c56a5 req-90416e38-ed83-42f2-8b68-692d268bad70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d65bfa08-ae5d-422b-a045-71d045b06e44", "tag": "9a5fcc98-45b5-4f0f-a9ee-a1fdf080a16f"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:02:56.670840 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-ad5ba575-e740-4e95-9858-0671791c56a5 req-90416e38-ed83-42f2-8b68-692d268bad70 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:56.671760 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-ad5ba575-e740-4e95-9858-0671791c56a5 req-90416e38-ed83-42f2-8b68-692d268bad70 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:56.697624 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-16731f23-8555-4a34-8d76-d4368b9ccd89 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] 10.222.0.57 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.834179 Jul 18 03:02:56.698933 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2960/5911] 10.222.0.57 () {58 vars in 1184 bytes} [Mon Jul 18 03:02:55 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:02:56.721638 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=62 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:02:56.774726 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-ad5ba575-e740-4e95-9858-0671791c56a5 req-90416e38-ed83-42f2-8b68-692d268bad70 service nova] Creating event network-changed:9a5fcc98-45b5-4f0f-a9ee-a1fdf080a16f for instance d65bfa08-ae5d-422b-a045-71d045b06e44 on n-h1-465891-3 Jul 18 03:02:56.798288 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-ad5ba575-e740-4e95-9858-0671791c56a5 req-90416e38-ed83-42f2-8b68-692d268bad70 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157027 Jul 18 03:02:56.804283 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2952/5912] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:02:56.850245 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6dbb648e-268d-4f55-b636-47321c8fb1ff tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:56.851136 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6dbb648e-268d-4f55-b636-47321c8fb1ff tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: d65bfa08-ae5d-422b-a045-71d045b06e44] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:56.866414 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6dbb648e-268d-4f55-b636-47321c8fb1ff tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:56.874003 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6dbb648e-268d-4f55-b636-47321c8fb1ff tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:56.875458 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6dbb648e-268d-4f55-b636-47321c8fb1ff tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:56.877111 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6dbb648e-268d-4f55-b636-47321c8fb1ff tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:56.995908 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f82fe8ed-992f-48ec-820b-a96e01d0086e tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1951330920", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "availability_zone": "nova:n-h1-465891-3", "networks": [{"uuid": "6ef8e91d-6b49-4cb2-9e70-9559a2c1e601"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:02:57.153465 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-f82fe8ed-992f-48ec-820b-a96e01d0086e tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] validate_networks() for [('6ef8e91d-6b49-4cb2-9e70-9559a2c1e601', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:02:57.839416 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6dbb648e-268d-4f55-b636-47321c8fb1ff tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:57.870764 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6dbb648e-268d-4f55-b636-47321c8fb1ff tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44" status: 200 len: 1326 microversion: 2.1 time: 1.024962 Jul 18 03:02:57.871898 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2961/5913] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:56 2022] GET /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44 => generated 1326 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:58.892472 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f7211f55-8daf-458c-b0a5-d26578d797f8 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:58.895318 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f7211f55-8daf-458c-b0a5-d26578d797f8 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: d65bfa08-ae5d-422b-a045-71d045b06e44] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:58.909734 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f7211f55-8daf-458c-b0a5-d26578d797f8 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:58.911133 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f7211f55-8daf-458c-b0a5-d26578d797f8 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:58.913802 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f7211f55-8daf-458c-b0a5-d26578d797f8 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:58.916590 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f7211f55-8daf-458c-b0a5-d26578d797f8 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:59.240515 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:02:59.512882 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f7211f55-8daf-458c-b0a5-d26578d797f8 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:59.526728 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f7211f55-8daf-458c-b0a5-d26578d797f8 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44" status: 200 len: 1326 microversion: 2.1 time: 0.637264 Jul 18 03:02:59.528287 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2962/5914] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:58 2022] GET /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44 => generated 1326 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:59.643018 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-f82fe8ed-992f-48ec-820b-a96e01d0086e tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:02:59.643809 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-f82fe8ed-992f-48ec-820b-a96e01d0086e tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:02:59.644836 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-f82fe8ed-992f-48ec-820b-a96e01d0086e tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:02:59.645592 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-f82fe8ed-992f-48ec-820b-a96e01d0086e tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:02:59.659968 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-f82fe8ed-992f-48ec-820b-a96e01d0086e tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:02:59.715417 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f82fe8ed-992f-48ec-820b-a96e01d0086e tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:59.716834 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f82fe8ed-992f-48ec-820b-a96e01d0086e tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:59.723520 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f82fe8ed-992f-48ec-820b-a96e01d0086e tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:59.726080 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f82fe8ed-992f-48ec-820b-a96e01d0086e tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:59.775368 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-f82fe8ed-992f-48ec-820b-a96e01d0086e tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Getting quotas for project 91218185fc774f2bb420f8cbf8dead9e. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:02:59.782473 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-f82fe8ed-992f-48ec-820b-a96e01d0086e tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Getting quotas for user e3abc7c13a81413caf400dd4fd3fa649 and project 91218185fc774f2bb420f8cbf8dead9e. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:02:59.800845 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f82fe8ed-992f-48ec-820b-a96e01d0086e tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:02:59.803750 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f82fe8ed-992f-48ec-820b-a96e01d0086e tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: ff755b33-da10-4e1a-9734-309196902bbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:02:59.889336 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f82fe8ed-992f-48ec-820b-a96e01d0086e tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.899806 Jul 18 03:02:59.896734 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2953/5915] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:02:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:02:59.917572 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4d118388-8e4d-441c-854a-f81cfd6b28ff tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:59.941292 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4d118388-8e4d-441c-854a-f81cfd6b28ff tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: ff755b33-da10-4e1a-9734-309196902bbf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:00.096887 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4d118388-8e4d-441c-854a-f81cfd6b28ff tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/ff755b33-da10-4e1a-9734-309196902bbf" status: 200 len: 1329 microversion: 2.1 time: 0.195023 Jul 18 03:03:00.098237 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2963/5916] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:59 2022] GET /compute/v2.1/servers/ff755b33-da10-4e1a-9734-309196902bbf => generated 1329 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:00.557012 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6c74923a-ce46-496b-942d-678fa2a55431 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:00.566497 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6c74923a-ce46-496b-942d-678fa2a55431 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: d65bfa08-ae5d-422b-a045-71d045b06e44] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:00.590606 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6c74923a-ce46-496b-942d-678fa2a55431 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:00.591554 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6c74923a-ce46-496b-942d-678fa2a55431 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:00.593116 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6c74923a-ce46-496b-942d-678fa2a55431 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:00.594120 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6c74923a-ce46-496b-942d-678fa2a55431 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:00.991620 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6c74923a-ce46-496b-942d-678fa2a55431 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:01.011279 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6c74923a-ce46-496b-942d-678fa2a55431 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44" status: 200 len: 1326 microversion: 2.1 time: 0.463377 Jul 18 03:03:01.013615 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2954/5917] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:00 2022] GET /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44 => generated 1326 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:03:01.128488 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c5bebe62-dd0d-4013-bf08-1bf1543e359f tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:01.132216 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c5bebe62-dd0d-4013-bf08-1bf1543e359f tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: ff755b33-da10-4e1a-9734-309196902bbf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:01.159113 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c5bebe62-dd0d-4013-bf08-1bf1543e359f tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:01.160678 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c5bebe62-dd0d-4013-bf08-1bf1543e359f tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:01.162569 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c5bebe62-dd0d-4013-bf08-1bf1543e359f tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:01.163739 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c5bebe62-dd0d-4013-bf08-1bf1543e359f tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:01.326669 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c5bebe62-dd0d-4013-bf08-1bf1543e359f tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/ff755b33-da10-4e1a-9734-309196902bbf" status: 200 len: 1346 microversion: 2.1 time: 0.209438 Jul 18 03:03:01.327287 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2964/5918] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:01 2022] GET /compute/v2.1/servers/ff755b33-da10-4e1a-9734-309196902bbf => generated 1346 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:02.044845 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1c07266a-5c85-41f6-bcd7-ad1150544f0e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:02.047177 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1c07266a-5c85-41f6-bcd7-ad1150544f0e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: d65bfa08-ae5d-422b-a045-71d045b06e44] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:02.093775 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1c07266a-5c85-41f6-bcd7-ad1150544f0e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:02.093926 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1c07266a-5c85-41f6-bcd7-ad1150544f0e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:02.110153 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1c07266a-5c85-41f6-bcd7-ad1150544f0e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:02.123496 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1c07266a-5c85-41f6-bcd7-ad1150544f0e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:02.344872 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b14a46ff-39b0-4441-9f87-1525bda57fa0 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:02.345568 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b14a46ff-39b0-4441-9f87-1525bda57fa0 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: ff755b33-da10-4e1a-9734-309196902bbf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:02.366479 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b14a46ff-39b0-4441-9f87-1525bda57fa0 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:02.367060 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b14a46ff-39b0-4441-9f87-1525bda57fa0 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:02.368752 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b14a46ff-39b0-4441-9f87-1525bda57fa0 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:02.369335 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b14a46ff-39b0-4441-9f87-1525bda57fa0 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:02.511032 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b14a46ff-39b0-4441-9f87-1525bda57fa0 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/ff755b33-da10-4e1a-9734-309196902bbf" status: 200 len: 1422 microversion: 2.1 time: 0.170076 Jul 18 03:03:02.514934 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2965/5919] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:02 2022] GET /compute/v2.1/servers/ff755b33-da10-4e1a-9734-309196902bbf => generated 1422 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:02.522868 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1c07266a-5c85-41f6-bcd7-ad1150544f0e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:02.543593 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1c07266a-5c85-41f6-bcd7-ad1150544f0e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44" status: 200 len: 1326 microversion: 2.1 time: 0.504776 Jul 18 03:03:02.557790 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2955/5920] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:02 2022] GET /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44 => generated 1326 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:03.540548 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f3043c84-b6d5-4ef7-adce-05ebdb980308 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:03.544513 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f3043c84-b6d5-4ef7-adce-05ebdb980308 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: ff755b33-da10-4e1a-9734-309196902bbf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:03.569916 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ae628dda-1326-4775-88e9-7cdafccc6147 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:03.572322 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ae628dda-1326-4775-88e9-7cdafccc6147 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: d65bfa08-ae5d-422b-a045-71d045b06e44] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:03.586916 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ae628dda-1326-4775-88e9-7cdafccc6147 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:03.587964 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ae628dda-1326-4775-88e9-7cdafccc6147 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:03.590633 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ae628dda-1326-4775-88e9-7cdafccc6147 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:03.591315 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ae628dda-1326-4775-88e9-7cdafccc6147 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:03.598234 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f3043c84-b6d5-4ef7-adce-05ebdb980308 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:03.599477 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f3043c84-b6d5-4ef7-adce-05ebdb980308 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:03.601213 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f3043c84-b6d5-4ef7-adce-05ebdb980308 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:03.602803 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f3043c84-b6d5-4ef7-adce-05ebdb980308 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:04.210350 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ae628dda-1326-4775-88e9-7cdafccc6147 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:04.234263 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ae628dda-1326-4775-88e9-7cdafccc6147 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44" status: 200 len: 1326 microversion: 2.1 time: 0.661628 Jul 18 03:03:04.241576 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2956/5921] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:03 2022] GET /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44 => generated 1326 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:04.364368 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f3043c84-b6d5-4ef7-adce-05ebdb980308 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/ff755b33-da10-4e1a-9734-309196902bbf" status: 200 len: 1464 microversion: 2.1 time: 0.833307 Jul 18 03:03:04.379368 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2966/5922] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:03 2022] GET /compute/v2.1/servers/ff755b33-da10-4e1a-9734-309196902bbf => generated 1464 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:04.528466 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-fac8ba98-4eed-479f-91d4-91158a667ccd req-bec089f6-5f48-4132-bd17-f44c584c72f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff755b33-da10-4e1a-9734-309196902bbf", "tag": "1d21bff2-3efe-40b5-b253-5556053a613d"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:03:04.567393 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-fac8ba98-4eed-479f-91d4-91158a667ccd req-bec089f6-5f48-4132-bd17-f44c584c72f5 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:04.568117 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-fac8ba98-4eed-479f-91d4-91158a667ccd req-bec089f6-5f48-4132-bd17-f44c584c72f5 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:04.609022 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-fac8ba98-4eed-479f-91d4-91158a667ccd req-bec089f6-5f48-4132-bd17-f44c584c72f5 service nova] Creating event network-changed:1d21bff2-3efe-40b5-b253-5556053a613d for instance ff755b33-da10-4e1a-9734-309196902bbf on n-h1-465891-3 Jul 18 03:03:04.620150 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-fac8ba98-4eed-479f-91d4-91158a667ccd req-bec089f6-5f48-4132-bd17-f44c584c72f5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096738 Jul 18 03:03:04.623718 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2957/5923] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:03:05.272300 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f90a831b-eb40-4f31-88f4-cc3a6104da62 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:05.273748 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f90a831b-eb40-4f31-88f4-cc3a6104da62 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: d65bfa08-ae5d-422b-a045-71d045b06e44] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:05.310627 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f90a831b-eb40-4f31-88f4-cc3a6104da62 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:05.313035 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f90a831b-eb40-4f31-88f4-cc3a6104da62 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:05.317822 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f90a831b-eb40-4f31-88f4-cc3a6104da62 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:05.319773 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f90a831b-eb40-4f31-88f4-cc3a6104da62 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:05.383886 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-04a0ae7e-7c07-446b-bdf8-d20a8149ed7b tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:05.384584 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-04a0ae7e-7c07-446b-bdf8-d20a8149ed7b tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: ff755b33-da10-4e1a-9734-309196902bbf] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:05.395374 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-04a0ae7e-7c07-446b-bdf8-d20a8149ed7b tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:05.402575 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-04a0ae7e-7c07-446b-bdf8-d20a8149ed7b tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:05.403807 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-04a0ae7e-7c07-446b-bdf8-d20a8149ed7b tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:05.404457 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-04a0ae7e-7c07-446b-bdf8-d20a8149ed7b tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:06.016256 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f90a831b-eb40-4f31-88f4-cc3a6104da62 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:06.028149 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-04a0ae7e-7c07-446b-bdf8-d20a8149ed7b tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/ff755b33-da10-4e1a-9734-309196902bbf" status: 200 len: 1464 microversion: 2.1 time: 0.648996 Jul 18 03:03:06.028793 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2958/5924] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:05 2022] GET /compute/v2.1/servers/ff755b33-da10-4e1a-9734-309196902bbf => generated 1464 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:03:06.033585 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f90a831b-eb40-4f31-88f4-cc3a6104da62 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44" status: 200 len: 1326 microversion: 2.1 time: 0.766060 Jul 18 03:03:06.034889 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2967/5925] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:05 2022] GET /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44 => generated 1326 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:06.461489 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-ccfad126-f6a6-4e26-b4c8-e83227a4f995 req-82f7f575-2bb8-4da1-bff8-6cb9ce9901b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d65bfa08-ae5d-422b-a045-71d045b06e44", "name": "network-vif-plugged", "status": "completed", "tag": "9a5fcc98-45b5-4f0f-a9ee-a1fdf080a16f"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:03:06.474943 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-ccfad126-f6a6-4e26-b4c8-e83227a4f995 req-82f7f575-2bb8-4da1-bff8-6cb9ce9901b1 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:06.475806 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-ccfad126-f6a6-4e26-b4c8-e83227a4f995 req-82f7f575-2bb8-4da1-bff8-6cb9ce9901b1 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:06.550742 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-ccfad126-f6a6-4e26-b4c8-e83227a4f995 req-82f7f575-2bb8-4da1-bff8-6cb9ce9901b1 service nova] Creating event network-vif-plugged:9a5fcc98-45b5-4f0f-a9ee-a1fdf080a16f for instance d65bfa08-ae5d-422b-a045-71d045b06e44 on n-h1-465891-3 Jul 18 03:03:06.566719 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-ccfad126-f6a6-4e26-b4c8-e83227a4f995 req-82f7f575-2bb8-4da1-bff8-6cb9ce9901b1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120929 Jul 18 03:03:06.568032 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2959/5926] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:03:07.052320 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c2c546c0-921d-4b76-bd32-68c91ffa4649 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:07.053585 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8af3d4df-88e9-4580-a376-8d01b256cf14 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:07.055106 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8af3d4df-88e9-4580-a376-8d01b256cf14 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: d65bfa08-ae5d-422b-a045-71d045b06e44] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:07.058823 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c2c546c0-921d-4b76-bd32-68c91ffa4649 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: ff755b33-da10-4e1a-9734-309196902bbf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:07.070879 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8af3d4df-88e9-4580-a376-8d01b256cf14 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:07.071743 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8af3d4df-88e9-4580-a376-8d01b256cf14 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:07.072847 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8af3d4df-88e9-4580-a376-8d01b256cf14 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:07.080358 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8af3d4df-88e9-4580-a376-8d01b256cf14 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:07.081811 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=4 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:03:07.086778 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c2c546c0-921d-4b76-bd32-68c91ffa4649 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:07.088035 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c2c546c0-921d-4b76-bd32-68c91ffa4649 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:07.092147 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c2c546c0-921d-4b76-bd32-68c91ffa4649 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:07.096183 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c2c546c0-921d-4b76-bd32-68c91ffa4649 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:07.449588 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8af3d4df-88e9-4580-a376-8d01b256cf14 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:07.462226 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8af3d4df-88e9-4580-a376-8d01b256cf14 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44" status: 200 len: 1326 microversion: 2.1 time: 0.409649 Jul 18 03:03:07.463232 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2960/5927] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:07 2022] GET /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44 => generated 1326 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:07.468574 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c2c546c0-921d-4b76-bd32-68c91ffa4649 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/ff755b33-da10-4e1a-9734-309196902bbf" status: 200 len: 1464 microversion: 2.1 time: 0.424947 Jul 18 03:03:07.470040 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2968/5928] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:07 2022] GET /compute/v2.1/servers/ff755b33-da10-4e1a-9734-309196902bbf => generated 1464 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:08.488459 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d6ae4300-1889-4450-83bc-ff8b4860a454 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:08.489817 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d6ae4300-1889-4450-83bc-ff8b4860a454 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: d65bfa08-ae5d-422b-a045-71d045b06e44] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:08.490855 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6e8a374f-78f2-4542-a522-9326e564db23 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:08.491728 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6e8a374f-78f2-4542-a522-9326e564db23 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: ff755b33-da10-4e1a-9734-309196902bbf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:08.502493 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d6ae4300-1889-4450-83bc-ff8b4860a454 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:08.503262 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d6ae4300-1889-4450-83bc-ff8b4860a454 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:08.506986 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d6ae4300-1889-4450-83bc-ff8b4860a454 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:08.509042 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d6ae4300-1889-4450-83bc-ff8b4860a454 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:08.523204 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e8a374f-78f2-4542-a522-9326e564db23 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:08.524124 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e8a374f-78f2-4542-a522-9326e564db23 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:08.525767 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e8a374f-78f2-4542-a522-9326e564db23 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:08.526478 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e8a374f-78f2-4542-a522-9326e564db23 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:08.601540 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:03:08.933599 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d6ae4300-1889-4450-83bc-ff8b4860a454 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:08.948671 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d6ae4300-1889-4450-83bc-ff8b4860a454 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44" status: 200 len: 1326 microversion: 2.1 time: 0.469728 Jul 18 03:03:08.958619 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2961/5929] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:08 2022] GET /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44 => generated 1326 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:08.963087 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6e8a374f-78f2-4542-a522-9326e564db23 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/ff755b33-da10-4e1a-9734-309196902bbf" status: 200 len: 1464 microversion: 2.1 time: 0.479534 Jul 18 03:03:08.964014 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2969/5930] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:08 2022] GET /compute/v2.1/servers/ff755b33-da10-4e1a-9734-309196902bbf => generated 1464 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:09.979862 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-004b9068-9554-48d2-a364-2d4df2adf1dd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:09.981936 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-004b9068-9554-48d2-a364-2d4df2adf1dd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: d65bfa08-ae5d-422b-a045-71d045b06e44] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:09.982990 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cbddaea5-c88e-46ca-ad7a-e5aca67f7d7d tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:09.983720 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cbddaea5-c88e-46ca-ad7a-e5aca67f7d7d tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: ff755b33-da10-4e1a-9734-309196902bbf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:09.995576 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:03:09.997148 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:03:10.001554 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-004b9068-9554-48d2-a364-2d4df2adf1dd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:10.003697 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-004b9068-9554-48d2-a364-2d4df2adf1dd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:10.011326 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cbddaea5-c88e-46ca-ad7a-e5aca67f7d7d tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:10.012129 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cbddaea5-c88e-46ca-ad7a-e5aca67f7d7d tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:10.013485 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cbddaea5-c88e-46ca-ad7a-e5aca67f7d7d tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:10.014589 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-004b9068-9554-48d2-a364-2d4df2adf1dd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:10.015809 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cbddaea5-c88e-46ca-ad7a-e5aca67f7d7d tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:10.016071 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-004b9068-9554-48d2-a364-2d4df2adf1dd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:10.105123 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=14 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:03:10.374765 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-004b9068-9554-48d2-a364-2d4df2adf1dd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:10.378894 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cbddaea5-c88e-46ca-ad7a-e5aca67f7d7d tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/ff755b33-da10-4e1a-9734-309196902bbf" status: 200 len: 1464 microversion: 2.1 time: 0.400350 Jul 18 03:03:10.390225 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2970/5931] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:09 2022] GET /compute/v2.1/servers/ff755b33-da10-4e1a-9734-309196902bbf => generated 1464 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:03:10.395531 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a9293108-2e6b-48d9-b93f-1f6c446cb501 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Action: 'create', calling method: .version_select at 0x7ff4add7ca60>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-390070385", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBC4J2OFZcD6t8YBkMTB4nzVyFvDrnQO7BwwLwFmcfXamtm6iCP3ADrcB4w8ig2AbUSkAL4OInFilvxPOkgk/2IZl3xJ++cJwErmNvxxv3qMBlPpcihUN+/Ln8Gw8oHVOg=="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:03:10.406349 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-004b9068-9554-48d2-a364-2d4df2adf1dd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44" status: 200 len: 1506 microversion: 2.1 time: 0.442858 Jul 18 03:03:10.410976 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2962/5932] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:09 2022] GET /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44 => generated 1506 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:10.428173 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-eaf8bf0c-fad2-4221-a7af-1023e3478c27 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:10.428582 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-a9293108-2e6b-48d9-b93f-1f6c446cb501 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Getting quotas for project 1d2ff16c129544f6a876a3371c1d02a6. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:03:10.429432 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-eaf8bf0c-fad2-4221-a7af-1023e3478c27 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: d65bfa08-ae5d-422b-a045-71d045b06e44] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:10.438105 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eaf8bf0c-fad2-4221-a7af-1023e3478c27 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:10.438930 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eaf8bf0c-fad2-4221-a7af-1023e3478c27 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:10.439968 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eaf8bf0c-fad2-4221-a7af-1023e3478c27 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:10.440617 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eaf8bf0c-fad2-4221-a7af-1023e3478c27 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:10.452271 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-a9293108-2e6b-48d9-b93f-1f6c446cb501 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Getting quotas for user 33388b46f7fb4c419ac0856245ad382f and project 1d2ff16c129544f6a876a3371c1d02a6. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:03:10.533209 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a9293108-2e6b-48d9-b93f-1f6c446cb501 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.139459 Jul 18 03:03:10.535321 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2971/5933] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 03:03:10 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:03:10.641421 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-eaf8bf0c-fad2-4221-a7af-1023e3478c27 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:10.651331 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-eaf8bf0c-fad2-4221-a7af-1023e3478c27 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44" status: 200 len: 1506 microversion: 2.1 time: 0.227777 Jul 18 03:03:10.652509 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2963/5934] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:10 2022] GET /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44 => generated 1506 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:03:10.688334 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-408732fb-d608-4be2-88c2-856850f0cf09 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:10.694435 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-408732fb-d608-4be2-88c2-856850f0cf09 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: d65bfa08-ae5d-422b-a045-71d045b06e44] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:10.708643 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-408732fb-d608-4be2-88c2-856850f0cf09 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:10.709628 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-408732fb-d608-4be2-88c2-856850f0cf09 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:10.710875 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-408732fb-d608-4be2-88c2-856850f0cf09 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:10.712035 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-408732fb-d608-4be2-88c2-856850f0cf09 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:10.790667 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-408732fb-d608-4be2-88c2-856850f0cf09 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: d65bfa08-ae5d-422b-a045-71d045b06e44] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:03:11.013635 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-408732fb-d608-4be2-88c2-856850f0cf09 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44" status: 204 len: 0 microversion: 2.1 time: 0.347133 Jul 18 03:03:11.015570 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2972/5935] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:03:10 2022] DELETE /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:03:11.030225 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ea910e39-b757-4be7-a844-7cc6bea1edd0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:11.031582 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ea910e39-b757-4be7-a844-7cc6bea1edd0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: d65bfa08-ae5d-422b-a045-71d045b06e44] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:11.053091 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea910e39-b757-4be7-a844-7cc6bea1edd0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:11.053554 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea910e39-b757-4be7-a844-7cc6bea1edd0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:11.055213 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea910e39-b757-4be7-a844-7cc6bea1edd0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:11.055870 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea910e39-b757-4be7-a844-7cc6bea1edd0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:11.397665 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e125cb50-3f77-4937-9335-f0c6ff8a86ba tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:11.399117 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e125cb50-3f77-4937-9335-f0c6ff8a86ba tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: ff755b33-da10-4e1a-9734-309196902bbf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:11.412429 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e125cb50-3f77-4937-9335-f0c6ff8a86ba tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:11.413260 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e125cb50-3f77-4937-9335-f0c6ff8a86ba tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:11.421498 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e125cb50-3f77-4937-9335-f0c6ff8a86ba tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:11.422819 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e125cb50-3f77-4937-9335-f0c6ff8a86ba tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:11.949349 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ea910e39-b757-4be7-a844-7cc6bea1edd0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:11.975538 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ea910e39-b757-4be7-a844-7cc6bea1edd0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44" status: 200 len: 1512 microversion: 2.1 time: 0.950059 Jul 18 03:03:11.977829 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2964/5936] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:11 2022] GET /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44 => generated 1512 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:12.124893 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e125cb50-3f77-4937-9335-f0c6ff8a86ba tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/ff755b33-da10-4e1a-9734-309196902bbf" status: 200 len: 1464 microversion: 2.1 time: 0.731360 Jul 18 03:03:12.126002 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2973/5937] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:11 2022] GET /compute/v2.1/servers/ff755b33-da10-4e1a-9734-309196902bbf => generated 1464 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:12.312674 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f05bdf75-d9dc-4c98-bc60-82288cdba1c4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1040958369", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "27989835-3800-4ed4-a56f-fb8cd4aec991"}], "key_name": "tempest-TestNetworkBasicOps-390070385", "security_groups": [{"name": "tempest-secgroup-smoke-1378089766"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:03:12.473303 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-f05bdf75-d9dc-4c98-bc60-82288cdba1c4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] validate_networks() for [('27989835-3800-4ed4-a56f-fb8cd4aec991', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:03:13.006030 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-db3a3656-9e0e-4ef6-ae2d-9537e2eb8969 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:13.006948 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-db3a3656-9e0e-4ef6-ae2d-9537e2eb8969 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: d65bfa08-ae5d-422b-a045-71d045b06e44] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:13.042510 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-db3a3656-9e0e-4ef6-ae2d-9537e2eb8969 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:13.061429 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-db3a3656-9e0e-4ef6-ae2d-9537e2eb8969 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:13.062629 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-db3a3656-9e0e-4ef6-ae2d-9537e2eb8969 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:13.065052 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-db3a3656-9e0e-4ef6-ae2d-9537e2eb8969 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:13.413897 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-db3a3656-9e0e-4ef6-ae2d-9537e2eb8969 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:13.417037 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-f05bdf75-d9dc-4c98-bc60-82288cdba1c4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:03:13.417644 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-f05bdf75-d9dc-4c98-bc60-82288cdba1c4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:03:13.420216 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-f05bdf75-d9dc-4c98-bc60-82288cdba1c4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:03:13.422348 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-f05bdf75-d9dc-4c98-bc60-82288cdba1c4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:03:13.424029 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-f05bdf75-d9dc-4c98-bc60-82288cdba1c4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:03:13.434818 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-db3a3656-9e0e-4ef6-ae2d-9537e2eb8969 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44" status: 200 len: 1512 microversion: 2.1 time: 0.433589 Jul 18 03:03:13.436135 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2974/5938] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:12 2022] GET /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44 => generated 1512 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:13.449804 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f05bdf75-d9dc-4c98-bc60-82288cdba1c4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:13.450818 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f05bdf75-d9dc-4c98-bc60-82288cdba1c4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:13.452888 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f05bdf75-d9dc-4c98-bc60-82288cdba1c4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:13.453078 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-014d7ff7-9188-4874-ba75-03b5e680ce82 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:13.453970 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f05bdf75-d9dc-4c98-bc60-82288cdba1c4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:13.466555 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-014d7ff7-9188-4874-ba75-03b5e680ce82 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: ff755b33-da10-4e1a-9734-309196902bbf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:13.473471 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-014d7ff7-9188-4874-ba75-03b5e680ce82 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:13.474117 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-014d7ff7-9188-4874-ba75-03b5e680ce82 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:13.475237 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-014d7ff7-9188-4874-ba75-03b5e680ce82 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:13.475937 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-014d7ff7-9188-4874-ba75-03b5e680ce82 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:13.480721 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-f05bdf75-d9dc-4c98-bc60-82288cdba1c4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Getting quotas for project 1d2ff16c129544f6a876a3371c1d02a6. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:03:13.488276 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-f05bdf75-d9dc-4c98-bc60-82288cdba1c4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Getting quotas for user 33388b46f7fb4c419ac0856245ad382f and project 1d2ff16c129544f6a876a3371c1d02a6. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:03:13.533877 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f05bdf75-d9dc-4c98-bc60-82288cdba1c4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:03:13.541452 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f05bdf75-d9dc-4c98-bc60-82288cdba1c4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: e4c72b14-0ad7-453f-9718-3ed2f911c889] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:03:13.829744 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-014d7ff7-9188-4874-ba75-03b5e680ce82 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/ff755b33-da10-4e1a-9734-309196902bbf" status: 200 len: 1464 microversion: 2.1 time: 0.391805 Jul 18 03:03:13.849631 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2975/5939] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:13 2022] GET /compute/v2.1/servers/ff755b33-da10-4e1a-9734-309196902bbf => generated 1464 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:13.859980 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f05bdf75-d9dc-4c98-bc60-82288cdba1c4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.556475 Jul 18 03:03:13.879396 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-57a03b7e-289f-45ad-bd1a-bdd0071371cb req-7e9778ee-6e85-4072-b422-434ef4eb7941 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d65bfa08-ae5d-422b-a045-71d045b06e44", "name": "network-vif-deleted", "tag": "9a5fcc98-45b5-4f0f-a9ee-a1fdf080a16f"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:03:13.881186 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2965/5940] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:03:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 1579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:03:13.902775 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-30f76f0f-dd5d-49ac-813a-d7aaa4d74de6 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:13.904169 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-30f76f0f-dd5d-49ac-813a-d7aaa4d74de6 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: e4c72b14-0ad7-453f-9718-3ed2f911c889] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:13.917479 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-57a03b7e-289f-45ad-bd1a-bdd0071371cb req-7e9778ee-6e85-4072-b422-434ef4eb7941 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:13.918188 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-57a03b7e-289f-45ad-bd1a-bdd0071371cb req-7e9778ee-6e85-4072-b422-434ef4eb7941 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:13.957091 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-57a03b7e-289f-45ad-bd1a-bdd0071371cb req-7e9778ee-6e85-4072-b422-434ef4eb7941 service nova] Creating event network-vif-deleted:9a5fcc98-45b5-4f0f-a9ee-a1fdf080a16f for instance d65bfa08-ae5d-422b-a045-71d045b06e44 on n-h1-465891-3 Jul 18 03:03:13.983530 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-57a03b7e-289f-45ad-bd1a-bdd0071371cb req-7e9778ee-6e85-4072-b422-434ef4eb7941 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131514 Jul 18 03:03:13.984670 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2976/5941] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:03:14.063633 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-30f76f0f-dd5d-49ac-813a-d7aaa4d74de6 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:14.079823 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-30f76f0f-dd5d-49ac-813a-d7aaa4d74de6 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/e4c72b14-0ad7-453f-9718-3ed2f911c889" status: 200 len: 1248 microversion: 2.1 time: 0.196534 Jul 18 03:03:14.081133 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2966/5942] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:13 2022] GET /compute/v2.1/servers/e4c72b14-0ad7-453f-9718-3ed2f911c889 => generated 1248 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:14.454624 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2716d14b-2d44-40a6-91b5-f90fd112ebad tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:14.456052 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2716d14b-2d44-40a6-91b5-f90fd112ebad tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: d65bfa08-ae5d-422b-a045-71d045b06e44] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:14.473583 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2716d14b-2d44-40a6-91b5-f90fd112ebad tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:14.474379 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2716d14b-2d44-40a6-91b5-f90fd112ebad tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:14.480501 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-c9ff0024-a021-4bda-8caf-c6f3048b854b req-0fe907da-c371-47fd-b2d6-b12f1833ff5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff755b33-da10-4e1a-9734-309196902bbf", "name": "network-vif-plugged", "status": "completed", "tag": "1d21bff2-3efe-40b5-b253-5556053a613d"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:03:14.489049 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2716d14b-2d44-40a6-91b5-f90fd112ebad tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:14.491952 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2716d14b-2d44-40a6-91b5-f90fd112ebad tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:14.516241 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-c9ff0024-a021-4bda-8caf-c6f3048b854b req-0fe907da-c371-47fd-b2d6-b12f1833ff5d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:14.518741 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-c9ff0024-a021-4bda-8caf-c6f3048b854b req-0fe907da-c371-47fd-b2d6-b12f1833ff5d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:14.560045 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-c9ff0024-a021-4bda-8caf-c6f3048b854b req-0fe907da-c371-47fd-b2d6-b12f1833ff5d service nova] Creating event network-vif-plugged:1d21bff2-3efe-40b5-b253-5556053a613d for instance ff755b33-da10-4e1a-9734-309196902bbf on n-h1-465891-3 Jul 18 03:03:14.577062 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-c9ff0024-a021-4bda-8caf-c6f3048b854b req-0fe907da-c371-47fd-b2d6-b12f1833ff5d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100692 Jul 18 03:03:14.591644 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2967/5943] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:03:14.613956 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2716d14b-2d44-40a6-91b5-f90fd112ebad tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:14.616294 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2716d14b-2d44-40a6-91b5-f90fd112ebad tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:14.617953 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-2716d14b-2d44-40a6-91b5-f90fd112ebad tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lazy-loading 'fault' on Instance uuid d65bfa08-ae5d-422b-a045-71d045b06e44 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:03:14.680686 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2716d14b-2d44-40a6-91b5-f90fd112ebad tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:14.692517 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2716d14b-2d44-40a6-91b5-f90fd112ebad tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44" status: 200 len: 1316 microversion: 2.1 time: 0.243095 Jul 18 03:03:14.706025 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2977/5944] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:14 2022] GET /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44 => generated 1316 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:14.859130 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bba525b8-d763-4a7e-a286-0df002b4fc65 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:14.860008 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bba525b8-d763-4a7e-a286-0df002b4fc65 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: ff755b33-da10-4e1a-9734-309196902bbf] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:14.877598 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bba525b8-d763-4a7e-a286-0df002b4fc65 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:14.878177 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bba525b8-d763-4a7e-a286-0df002b4fc65 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:14.879072 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bba525b8-d763-4a7e-a286-0df002b4fc65 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:14.880360 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bba525b8-d763-4a7e-a286-0df002b4fc65 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:15.133571 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-94d8d82e-5bac-42b1-a4d2-2f32af39724f tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:15.138625 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-94d8d82e-5bac-42b1-a4d2-2f32af39724f tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: e4c72b14-0ad7-453f-9718-3ed2f911c889] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:15.151488 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-94d8d82e-5bac-42b1-a4d2-2f32af39724f tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:15.154987 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-94d8d82e-5bac-42b1-a4d2-2f32af39724f tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:15.156813 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-94d8d82e-5bac-42b1-a4d2-2f32af39724f tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:15.157555 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-94d8d82e-5bac-42b1-a4d2-2f32af39724f tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:15.217947 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bba525b8-d763-4a7e-a286-0df002b4fc65 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/ff755b33-da10-4e1a-9734-309196902bbf" status: 200 len: 1464 microversion: 2.1 time: 0.364431 Jul 18 03:03:15.219836 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2968/5945] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:14 2022] GET /compute/v2.1/servers/ff755b33-da10-4e1a-9734-309196902bbf => generated 1464 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:15.284922 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-94d8d82e-5bac-42b1-a4d2-2f32af39724f tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:15.322974 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-94d8d82e-5bac-42b1-a4d2-2f32af39724f tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/e4c72b14-0ad7-453f-9718-3ed2f911c889" status: 200 len: 1244 microversion: 2.1 time: 0.209210 Jul 18 03:03:15.323955 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2978/5946] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:15 2022] GET /compute/v2.1/servers/e4c72b14-0ad7-453f-9718-3ed2f911c889 => generated 1244 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:15.718440 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-72689bdc-0d4b-4b8f-ae1a-b3d3d59da5a8 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:15.734309 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-72689bdc-0d4b-4b8f-ae1a-b3d3d59da5a8 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: d65bfa08-ae5d-422b-a045-71d045b06e44] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:15.777575 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-72689bdc-0d4b-4b8f-ae1a-b3d3d59da5a8 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:15.778099 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-72689bdc-0d4b-4b8f-ae1a-b3d3d59da5a8 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:15.778910 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-72689bdc-0d4b-4b8f-ae1a-b3d3d59da5a8 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:15.779366 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-72689bdc-0d4b-4b8f-ae1a-b3d3d59da5a8 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:15.866069 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-72689bdc-0d4b-4b8f-ae1a-b3d3d59da5a8 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] HTTP exception thrown: Instance d65bfa08-ae5d-422b-a045-71d045b06e44 could not be found. Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-72689bdc-0d4b-4b8f-ae1a-b3d3d59da5a8 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Request method failure captured: Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44 HTTP/1.1 Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M0c--VxkhAcA4gIHXxijKFI-k8Bpror72Hk1qb235rYnfDmQTByX9LOOCSekEaTY-qK46fTc9MDDZBpaIS7PRARBL52HY7fvnzNvoh5YO0XpJvHbsKLywLFoe1R8EGrLF6lPIQIdQdkEzZxbEDXhePA7F15YYp44S7QRWnysLrh4M4 Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3a83c4dedef341a0bb50fa4c119d3035"}]}] Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersTestJSON-1250523732 Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersTestJSON-1250523732-project Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 785ff643c00746939bb0fecd775ce920 Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersTestJSON-1250523732-project Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance d65bfa08-ae5d-422b-a045-71d045b06e44 could not be found. Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'd65bfa08-ae5d-422b-a045-71d045b06e44'} Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d65bfa08-ae5d-422b-a045-71d045b06e44 could not be found. Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d65bfa08-ae5d-422b-a045-71d045b06e44 could not be found. Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:03:15.871777 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:03:15.882484 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:03:15.882484 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:03:15.882484 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:03:15.882484 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:03:15.882484 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d65bfa08-ae5d-422b-a045-71d045b06e44 could not be found. Jul 18 03:03:15.882484 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:03:15.894253 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-72689bdc-0d4b-4b8f-ae1a-b3d3d59da5a8 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Returning 404 to user: Instance d65bfa08-ae5d-422b-a045-71d045b06e44 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:03:15.894253 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-72689bdc-0d4b-4b8f-ae1a-b3d3d59da5a8 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44" status: 404 len: 111 microversion: 2.1 time: 0.176921 Jul 18 03:03:15.894253 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2969/5947] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:15 2022] GET /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44 => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:03:15.898633 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-73313d22-b925-40b8-8367-8aa9959b0bd5 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '.version_select at 0x7ff4984e4d30>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:15.906778 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:03:15.943862 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-73313d22-b925-40b8-8367-8aa9959b0bd5 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-key-55748382" status: 202 len: 0 microversion: 2.1 time: 0.048838 Jul 18 03:03:15.947407 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2979/5948] 10.222.0.57 () {58 vars in 1202 bytes} [Mon Jul 18 03:03:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-55748382 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:03:16.224401 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-098d9dd7-3be6-4fe9-a34f-f87c2ea860ea tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-126490508", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "c540b69b-e7cc-4fa1-8fc6-67859b3d0823"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:03:16.239962 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-051aa917-6d46-4fb3-a73a-821e4362c04a tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:16.241220 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-051aa917-6d46-4fb3-a73a-821e4362c04a tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: ff755b33-da10-4e1a-9734-309196902bbf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:16.255280 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-051aa917-6d46-4fb3-a73a-821e4362c04a tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:16.256365 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-051aa917-6d46-4fb3-a73a-821e4362c04a tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:16.257993 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-051aa917-6d46-4fb3-a73a-821e4362c04a tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:16.258653 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-051aa917-6d46-4fb3-a73a-821e4362c04a tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:16.355453 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-098d9dd7-3be6-4fe9-a34f-f87c2ea860ea tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] validate_networks() for [('c540b69b-e7cc-4fa1-8fc6-67859b3d0823', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:03:16.600049 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-051aa917-6d46-4fb3-a73a-821e4362c04a tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/ff755b33-da10-4e1a-9734-309196902bbf" status: 200 len: 1464 microversion: 2.1 time: 0.366487 Jul 18 03:03:16.611145 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2980/5949] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:16 2022] GET /compute/v2.1/servers/ff755b33-da10-4e1a-9734-309196902bbf => generated 1464 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:03:16.621678 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8980ef27-ca77-4849-a339-d7549ec92e7b tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:16.623264 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8980ef27-ca77-4849-a339-d7549ec92e7b tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: e4c72b14-0ad7-453f-9718-3ed2f911c889] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:16.636866 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8980ef27-ca77-4849-a339-d7549ec92e7b tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:16.638086 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8980ef27-ca77-4849-a339-d7549ec92e7b tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:16.639688 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8980ef27-ca77-4849-a339-d7549ec92e7b tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:16.640615 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8980ef27-ca77-4849-a339-d7549ec92e7b tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:16.856550 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8980ef27-ca77-4849-a339-d7549ec92e7b tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:16.865484 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8980ef27-ca77-4849-a339-d7549ec92e7b tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/e4c72b14-0ad7-453f-9718-3ed2f911c889" status: 200 len: 1306 microversion: 2.1 time: 0.261158 Jul 18 03:03:16.866384 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2981/5950] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:16 2022] GET /compute/v2.1/servers/e4c72b14-0ad7-453f-9718-3ed2f911c889 => generated 1306 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:17.434563 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-098d9dd7-3be6-4fe9-a34f-f87c2ea860ea tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:03:17.438582 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-098d9dd7-3be6-4fe9-a34f-f87c2ea860ea tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:03:17.445727 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-098d9dd7-3be6-4fe9-a34f-f87c2ea860ea tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:03:17.447515 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-098d9dd7-3be6-4fe9-a34f-f87c2ea860ea tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:03:17.448287 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-098d9dd7-3be6-4fe9-a34f-f87c2ea860ea tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:03:17.462171 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-098d9dd7-3be6-4fe9-a34f-f87c2ea860ea tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:17.462802 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-098d9dd7-3be6-4fe9-a34f-f87c2ea860ea tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:17.463961 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-098d9dd7-3be6-4fe9-a34f-f87c2ea860ea tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:17.465271 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-098d9dd7-3be6-4fe9-a34f-f87c2ea860ea tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:17.498942 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-098d9dd7-3be6-4fe9-a34f-f87c2ea860ea tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Getting quotas for project 3a83c4dedef341a0bb50fa4c119d3035. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:03:17.510693 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-098d9dd7-3be6-4fe9-a34f-f87c2ea860ea tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Getting quotas for user 785ff643c00746939bb0fecd775ce920 and project 3a83c4dedef341a0bb50fa4c119d3035. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:03:17.532306 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-098d9dd7-3be6-4fe9-a34f-f87c2ea860ea tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:03:17.536459 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-098d9dd7-3be6-4fe9-a34f-f87c2ea860ea tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 8cc40222-82fc-4d28-bce8-e754679126ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:03:17.630025 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-098d9dd7-3be6-4fe9-a34f-f87c2ea860ea tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.409657 Jul 18 03:03:17.630659 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0ab454cb-5432-4fa3-8745-44edf3e74f67 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:17.632480 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2970/5951] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:03:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1412 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:03:17.643986 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0ab454cb-5432-4fa3-8745-44edf3e74f67 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: ff755b33-da10-4e1a-9734-309196902bbf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:17.656388 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-efc1ff02-532d-4416-a610-422ce9ac35dd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:17.659441 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-efc1ff02-532d-4416-a610-422ce9ac35dd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 8cc40222-82fc-4d28-bce8-e754679126ab] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:17.702998 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0ab454cb-5432-4fa3-8745-44edf3e74f67 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:17.707368 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0ab454cb-5432-4fa3-8745-44edf3e74f67 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:17.712480 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0ab454cb-5432-4fa3-8745-44edf3e74f67 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:17.715280 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0ab454cb-5432-4fa3-8745-44edf3e74f67 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:17.911872 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-efc1ff02-532d-4416-a610-422ce9ac35dd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:17.935770 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-efc1ff02-532d-4416-a610-422ce9ac35dd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/8cc40222-82fc-4d28-bce8-e754679126ab" status: 200 len: 1208 microversion: 2.1 time: 0.279914 Jul 18 03:03:17.944349 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2971/5952] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:17 2022] GET /compute/v2.1/servers/8cc40222-82fc-4d28-bce8-e754679126ab => generated 1208 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:17.968216 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c0242624-c1db-4854-bb07-f68b2d983cc5 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:17.972843 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c0242624-c1db-4854-bb07-f68b2d983cc5 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: e4c72b14-0ad7-453f-9718-3ed2f911c889] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:17.993164 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c0242624-c1db-4854-bb07-f68b2d983cc5 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:17.994525 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c0242624-c1db-4854-bb07-f68b2d983cc5 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:17.998242 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c0242624-c1db-4854-bb07-f68b2d983cc5 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:18.000564 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c0242624-c1db-4854-bb07-f68b2d983cc5 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:18.213769 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0ab454cb-5432-4fa3-8745-44edf3e74f67 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/ff755b33-da10-4e1a-9734-309196902bbf" status: 200 len: 1649 microversion: 2.1 time: 0.598021 Jul 18 03:03:18.215901 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2982/5953] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:17 2022] GET /compute/v2.1/servers/ff755b33-da10-4e1a-9734-309196902bbf => generated 1649 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:18.233654 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-aa53e7ba-dc8d-4022-b9be-970f12c21d51 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:18.234508 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-aa53e7ba-dc8d-4022-b9be-970f12c21d51 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: ff755b33-da10-4e1a-9734-309196902bbf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:18.243613 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aa53e7ba-dc8d-4022-b9be-970f12c21d51 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:18.244478 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aa53e7ba-dc8d-4022-b9be-970f12c21d51 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:18.245358 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aa53e7ba-dc8d-4022-b9be-970f12c21d51 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:18.246134 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aa53e7ba-dc8d-4022-b9be-970f12c21d51 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:18.431443 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c0242624-c1db-4854-bb07-f68b2d983cc5 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:18.441796 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c0242624-c1db-4854-bb07-f68b2d983cc5 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/e4c72b14-0ad7-453f-9718-3ed2f911c889" status: 200 len: 1374 microversion: 2.1 time: 0.494049 Jul 18 03:03:18.442833 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2972/5954] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:17 2022] GET /compute/v2.1/servers/e4c72b14-0ad7-453f-9718-3ed2f911c889 => generated 1374 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:18.566092 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-aa53e7ba-dc8d-4022-b9be-970f12c21d51 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/ff755b33-da10-4e1a-9734-309196902bbf" status: 200 len: 1649 microversion: 2.1 time: 0.337398 Jul 18 03:03:18.567852 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2983/5955] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:18 2022] GET /compute/v2.1/servers/ff755b33-da10-4e1a-9734-309196902bbf => generated 1649 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:03:18.583964 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fff1637a-c574-469a-b49d-13659dd10b61 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:18.584594 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fff1637a-c574-469a-b49d-13659dd10b61 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: ff755b33-da10-4e1a-9734-309196902bbf] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:18.599898 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:03:18.604628 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fff1637a-c574-469a-b49d-13659dd10b61 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:18.605763 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fff1637a-c574-469a-b49d-13659dd10b61 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:18.607081 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fff1637a-c574-469a-b49d-13659dd10b61 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:18.607703 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fff1637a-c574-469a-b49d-13659dd10b61 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:18.888064 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fff1637a-c574-469a-b49d-13659dd10b61 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/ff755b33-da10-4e1a-9734-309196902bbf" status: 200 len: 1649 microversion: 2.1 time: 0.307811 Jul 18 03:03:18.889539 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2973/5956] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:18 2022] GET /compute/v2.1/servers/ff755b33-da10-4e1a-9734-309196902bbf => generated 1649 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:18.966403 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7440c723-2395-418d-ba3f-a850bcd8be26 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:18.967263 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7440c723-2395-418d-ba3f-a850bcd8be26 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 8cc40222-82fc-4d28-bce8-e754679126ab] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:18.989506 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7440c723-2395-418d-ba3f-a850bcd8be26 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:18.990818 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7440c723-2395-418d-ba3f-a850bcd8be26 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:18.992739 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7440c723-2395-418d-ba3f-a850bcd8be26 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:18.994175 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7440c723-2395-418d-ba3f-a850bcd8be26 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:19.137932 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-35218f98-a272-4298-9dfe-36fbd409a96b tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-759827651", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "availability_zone": "nova:n-h2-465891-3", "networks": [{"uuid": "6ef8e91d-6b49-4cb2-9e70-9559a2c1e601"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:03:19.166934 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7440c723-2395-418d-ba3f-a850bcd8be26 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:19.200946 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7440c723-2395-418d-ba3f-a850bcd8be26 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/8cc40222-82fc-4d28-bce8-e754679126ab" status: 200 len: 1260 microversion: 2.1 time: 0.245030 Jul 18 03:03:19.201567 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2984/5957] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:18 2022] GET /compute/v2.1/servers/8cc40222-82fc-4d28-bce8-e754679126ab => generated 1260 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:03:19.319867 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-35218f98-a272-4298-9dfe-36fbd409a96b tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] validate_networks() for [('6ef8e91d-6b49-4cb2-9e70-9559a2c1e601', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:03:19.459627 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-33a72b57-b518-4d7a-991f-b5812e9390db tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:19.461473 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-33a72b57-b518-4d7a-991f-b5812e9390db tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: e4c72b14-0ad7-453f-9718-3ed2f911c889] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:19.472306 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-33a72b57-b518-4d7a-991f-b5812e9390db tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:19.473267 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-33a72b57-b518-4d7a-991f-b5812e9390db tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:19.473878 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-33a72b57-b518-4d7a-991f-b5812e9390db tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:19.474389 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-33a72b57-b518-4d7a-991f-b5812e9390db tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:19.875920 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-33a72b57-b518-4d7a-991f-b5812e9390db tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:19.893755 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-33a72b57-b518-4d7a-991f-b5812e9390db tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/e4c72b14-0ad7-453f-9718-3ed2f911c889" status: 200 len: 1374 microversion: 2.1 time: 0.437143 Jul 18 03:03:19.894837 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2985/5958] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:19 2022] GET /compute/v2.1/servers/e4c72b14-0ad7-453f-9718-3ed2f911c889 => generated 1374 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:03:19.905468 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-010e3230-7ba8-4b32-8fce-46310c70e1af req-5cd3b0dc-2d7e-4ce5-bc7f-885e47ac2b60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4c72b14-0ad7-453f-9718-3ed2f911c889", "tag": "9beb4cc4-0dde-4552-9926-2ff902db0fff"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:03:19.917373 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-010e3230-7ba8-4b32-8fce-46310c70e1af req-5cd3b0dc-2d7e-4ce5-bc7f-885e47ac2b60 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:19.918146 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-010e3230-7ba8-4b32-8fce-46310c70e1af req-5cd3b0dc-2d7e-4ce5-bc7f-885e47ac2b60 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:19.936760 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-010e3230-7ba8-4b32-8fce-46310c70e1af req-5cd3b0dc-2d7e-4ce5-bc7f-885e47ac2b60 service nova] Creating event network-changed:9beb4cc4-0dde-4552-9926-2ff902db0fff for instance e4c72b14-0ad7-453f-9718-3ed2f911c889 on n-h2-465891-3 Jul 18 03:03:19.942270 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-010e3230-7ba8-4b32-8fce-46310c70e1af req-5cd3b0dc-2d7e-4ce5-bc7f-885e47ac2b60 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040587 Jul 18 03:03:19.942915 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2986/5959] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:03:20.232418 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6998d303-fdd1-458e-bcf6-099ce62f5163 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:20.234281 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6998d303-fdd1-458e-bcf6-099ce62f5163 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 8cc40222-82fc-4d28-bce8-e754679126ab] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:20.235094 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-35218f98-a272-4298-9dfe-36fbd409a96b tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:03:20.235880 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-35218f98-a272-4298-9dfe-36fbd409a96b tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:03:20.236010 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-35218f98-a272-4298-9dfe-36fbd409a96b tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:03:20.236407 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-35218f98-a272-4298-9dfe-36fbd409a96b tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:03:20.236829 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-35218f98-a272-4298-9dfe-36fbd409a96b tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:03:20.249131 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-35218f98-a272-4298-9dfe-36fbd409a96b tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:20.249920 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-35218f98-a272-4298-9dfe-36fbd409a96b tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:20.251169 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-35218f98-a272-4298-9dfe-36fbd409a96b tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:20.251389 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6998d303-fdd1-458e-bcf6-099ce62f5163 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:20.251869 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6998d303-fdd1-458e-bcf6-099ce62f5163 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:20.252281 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-35218f98-a272-4298-9dfe-36fbd409a96b tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:20.252691 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6998d303-fdd1-458e-bcf6-099ce62f5163 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:20.253149 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6998d303-fdd1-458e-bcf6-099ce62f5163 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:20.277952 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:03:20.283869 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-35218f98-a272-4298-9dfe-36fbd409a96b tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Getting quotas for project 91218185fc774f2bb420f8cbf8dead9e. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:03:20.292401 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-35218f98-a272-4298-9dfe-36fbd409a96b tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Getting quotas for user e3abc7c13a81413caf400dd4fd3fa649 and project 91218185fc774f2bb420f8cbf8dead9e. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:03:20.308453 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-35218f98-a272-4298-9dfe-36fbd409a96b tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:03:20.311962 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-35218f98-a272-4298-9dfe-36fbd409a96b tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: f28d5987-cd8f-4c3f-8b39-09935eabf733] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:03:20.387648 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-35218f98-a272-4298-9dfe-36fbd409a96b tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.258348 Jul 18 03:03:20.388790 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2974/5960] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:03:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:03:20.417268 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-917322ea-4ffe-4e5b-8967-e017e9e2f55d tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:20.422882 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-917322ea-4ffe-4e5b-8967-e017e9e2f55d tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: f28d5987-cd8f-4c3f-8b39-09935eabf733] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:20.464502 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6998d303-fdd1-458e-bcf6-099ce62f5163 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:20.491952 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=4 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:03:20.505949 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6998d303-fdd1-458e-bcf6-099ce62f5163 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/8cc40222-82fc-4d28-bce8-e754679126ab" status: 200 len: 1266 microversion: 2.1 time: 0.279897 Jul 18 03:03:20.508489 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2987/5961] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:20 2022] GET /compute/v2.1/servers/8cc40222-82fc-4d28-bce8-e754679126ab => generated 1266 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:20.546007 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-917322ea-4ffe-4e5b-8967-e017e9e2f55d tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/f28d5987-cd8f-4c3f-8b39-09935eabf733" status: 200 len: 1328 microversion: 2.1 time: 0.135646 Jul 18 03:03:20.547477 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2975/5962] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:20 2022] GET /compute/v2.1/servers/f28d5987-cd8f-4c3f-8b39-09935eabf733 => generated 1328 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:20.914672 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c302c8cb-02dd-4dae-b40e-6b1de3479d15 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:20.915547 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c302c8cb-02dd-4dae-b40e-6b1de3479d15 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: e4c72b14-0ad7-453f-9718-3ed2f911c889] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:20.933623 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c302c8cb-02dd-4dae-b40e-6b1de3479d15 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:20.936766 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c302c8cb-02dd-4dae-b40e-6b1de3479d15 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:20.937876 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c302c8cb-02dd-4dae-b40e-6b1de3479d15 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:20.942173 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c302c8cb-02dd-4dae-b40e-6b1de3479d15 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:21.269786 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c302c8cb-02dd-4dae-b40e-6b1de3479d15 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:21.279468 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c302c8cb-02dd-4dae-b40e-6b1de3479d15 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/e4c72b14-0ad7-453f-9718-3ed2f911c889" status: 200 len: 1374 microversion: 2.1 time: 0.370313 Jul 18 03:03:21.280172 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2988/5963] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:20 2022] GET /compute/v2.1/servers/e4c72b14-0ad7-453f-9718-3ed2f911c889 => generated 1374 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:21.530995 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-65c3b963-ca52-4da1-9cf6-262eb2302f39 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:21.533124 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-65c3b963-ca52-4da1-9cf6-262eb2302f39 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 8cc40222-82fc-4d28-bce8-e754679126ab] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:21.571794 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65c3b963-ca52-4da1-9cf6-262eb2302f39 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:21.572659 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65c3b963-ca52-4da1-9cf6-262eb2302f39 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:21.575065 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65c3b963-ca52-4da1-9cf6-262eb2302f39 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:21.575912 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65c3b963-ca52-4da1-9cf6-262eb2302f39 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:21.618066 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ffd1de2a-77db-4856-ae8b-00e970d8f0a4 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:21.630925 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ffd1de2a-77db-4856-ae8b-00e970d8f0a4 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: f28d5987-cd8f-4c3f-8b39-09935eabf733] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:21.707326 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ffd1de2a-77db-4856-ae8b-00e970d8f0a4 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:21.708237 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ffd1de2a-77db-4856-ae8b-00e970d8f0a4 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:21.725024 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ffd1de2a-77db-4856-ae8b-00e970d8f0a4 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:21.729599 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ffd1de2a-77db-4856-ae8b-00e970d8f0a4 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:22.216220 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ffd1de2a-77db-4856-ae8b-00e970d8f0a4 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/f28d5987-cd8f-4c3f-8b39-09935eabf733" status: 200 len: 1345 microversion: 2.1 time: 0.646181 Jul 18 03:03:22.220190 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2989/5964] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:21 2022] GET /compute/v2.1/servers/f28d5987-cd8f-4c3f-8b39-09935eabf733 => generated 1345 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:22.239634 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-cd7d8f4c-8edd-4467-9e7b-36e494ffbae3 req-82df0db1-9d8e-4b05-a0fc-f04e72610a13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cc40222-82fc-4d28-bce8-e754679126ab", "tag": "6f0f9200-3b3c-4b65-947c-4f79711b8387"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:03:22.261023 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-cd7d8f4c-8edd-4467-9e7b-36e494ffbae3 req-82df0db1-9d8e-4b05-a0fc-f04e72610a13 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:22.265291 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-cd7d8f4c-8edd-4467-9e7b-36e494ffbae3 req-82df0db1-9d8e-4b05-a0fc-f04e72610a13 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:22.296159 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-cd7d8f4c-8edd-4467-9e7b-36e494ffbae3 req-82df0db1-9d8e-4b05-a0fc-f04e72610a13 service nova] Creating event network-changed:6f0f9200-3b3c-4b65-947c-4f79711b8387 for instance 8cc40222-82fc-4d28-bce8-e754679126ab on n-h1-465891-3 Jul 18 03:03:22.308698 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-cd7d8f4c-8edd-4467-9e7b-36e494ffbae3 req-82df0db1-9d8e-4b05-a0fc-f04e72610a13 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086141 Jul 18 03:03:22.310013 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2990/5965] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:03:22.316875 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ada73143-2499-4c1b-9e6f-0af029af0548 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:22.318083 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ada73143-2499-4c1b-9e6f-0af029af0548 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: e4c72b14-0ad7-453f-9718-3ed2f911c889] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:22.327511 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ada73143-2499-4c1b-9e6f-0af029af0548 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:22.328319 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ada73143-2499-4c1b-9e6f-0af029af0548 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:22.329383 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ada73143-2499-4c1b-9e6f-0af029af0548 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:22.330092 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ada73143-2499-4c1b-9e6f-0af029af0548 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:22.498650 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-65c3b963-ca52-4da1-9cf6-262eb2302f39 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:22.516419 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-65c3b963-ca52-4da1-9cf6-262eb2302f39 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/8cc40222-82fc-4d28-bce8-e754679126ab" status: 200 len: 1308 microversion: 2.1 time: 0.992743 Jul 18 03:03:22.518186 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2976/5966] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:21 2022] GET /compute/v2.1/servers/8cc40222-82fc-4d28-bce8-e754679126ab => generated 1308 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:22.772474 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ada73143-2499-4c1b-9e6f-0af029af0548 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:22.801153 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ada73143-2499-4c1b-9e6f-0af029af0548 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/e4c72b14-0ad7-453f-9718-3ed2f911c889" status: 200 len: 1374 microversion: 2.1 time: 0.489147 Jul 18 03:03:22.814368 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2991/5967] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:22 2022] GET /compute/v2.1/servers/e4c72b14-0ad7-453f-9718-3ed2f911c889 => generated 1374 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:23.240781 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f7909216-340e-4f72-ac57-6eb8c0899c2d tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:23.241476 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f7909216-340e-4f72-ac57-6eb8c0899c2d tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: f28d5987-cd8f-4c3f-8b39-09935eabf733] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:23.251803 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f7909216-340e-4f72-ac57-6eb8c0899c2d tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:23.252438 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f7909216-340e-4f72-ac57-6eb8c0899c2d tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:23.253495 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f7909216-340e-4f72-ac57-6eb8c0899c2d tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:23.254342 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f7909216-340e-4f72-ac57-6eb8c0899c2d tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:23.369820 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=100 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:03:23.378645 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f7909216-340e-4f72-ac57-6eb8c0899c2d tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/f28d5987-cd8f-4c3f-8b39-09935eabf733" status: 200 len: 1421 microversion: 2.1 time: 0.143171 Jul 18 03:03:23.379959 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2977/5968] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:23 2022] GET /compute/v2.1/servers/f28d5987-cd8f-4c3f-8b39-09935eabf733 => generated 1421 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:23.536386 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a143f413-6847-486c-86ff-ff742686bc11 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:23.537142 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a143f413-6847-486c-86ff-ff742686bc11 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 8cc40222-82fc-4d28-bce8-e754679126ab] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:23.545510 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a143f413-6847-486c-86ff-ff742686bc11 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:23.546543 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a143f413-6847-486c-86ff-ff742686bc11 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:23.547809 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a143f413-6847-486c-86ff-ff742686bc11 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:23.548538 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a143f413-6847-486c-86ff-ff742686bc11 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:23.830299 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f91e8f64-4ce5-4505-84e8-1dbdda786561 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:23.830934 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f91e8f64-4ce5-4505-84e8-1dbdda786561 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: e4c72b14-0ad7-453f-9718-3ed2f911c889] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:23.838688 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f91e8f64-4ce5-4505-84e8-1dbdda786561 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:23.839468 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f91e8f64-4ce5-4505-84e8-1dbdda786561 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:23.840507 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f91e8f64-4ce5-4505-84e8-1dbdda786561 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:23.840957 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f91e8f64-4ce5-4505-84e8-1dbdda786561 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:24.319389 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a143f413-6847-486c-86ff-ff742686bc11 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:24.331708 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a143f413-6847-486c-86ff-ff742686bc11 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/8cc40222-82fc-4d28-bce8-e754679126ab" status: 200 len: 1308 microversion: 2.1 time: 0.801076 Jul 18 03:03:24.332774 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2992/5969] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:23 2022] GET /compute/v2.1/servers/8cc40222-82fc-4d28-bce8-e754679126ab => generated 1308 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:03:24.337988 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f91e8f64-4ce5-4505-84e8-1dbdda786561 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:24.358532 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f91e8f64-4ce5-4505-84e8-1dbdda786561 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/e4c72b14-0ad7-453f-9718-3ed2f911c889" status: 200 len: 1374 microversion: 2.1 time: 0.531969 Jul 18 03:03:24.360590 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2978/5970] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:23 2022] GET /compute/v2.1/servers/e4c72b14-0ad7-453f-9718-3ed2f911c889 => generated 1374 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:03:24.401019 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c4fc09e9-bea2-4dfa-ad8d-26d55706763a tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:24.401658 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c4fc09e9-bea2-4dfa-ad8d-26d55706763a tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: f28d5987-cd8f-4c3f-8b39-09935eabf733] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:24.411543 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c4fc09e9-bea2-4dfa-ad8d-26d55706763a tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:24.412005 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c4fc09e9-bea2-4dfa-ad8d-26d55706763a tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:24.412812 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c4fc09e9-bea2-4dfa-ad8d-26d55706763a tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:24.413270 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c4fc09e9-bea2-4dfa-ad8d-26d55706763a tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:24.667245 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c4fc09e9-bea2-4dfa-ad8d-26d55706763a tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/f28d5987-cd8f-4c3f-8b39-09935eabf733" status: 200 len: 1463 microversion: 2.1 time: 0.269688 Jul 18 03:03:24.669070 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2993/5971] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:24 2022] GET /compute/v2.1/servers/f28d5987-cd8f-4c3f-8b39-09935eabf733 => generated 1463 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:25.359284 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d586162e-95e4-45b5-aeec-c745e4159ad5 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:25.360547 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d586162e-95e4-45b5-aeec-c745e4159ad5 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 8cc40222-82fc-4d28-bce8-e754679126ab] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:25.372786 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d586162e-95e4-45b5-aeec-c745e4159ad5 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:25.373780 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d586162e-95e4-45b5-aeec-c745e4159ad5 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:25.375145 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d586162e-95e4-45b5-aeec-c745e4159ad5 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:25.375998 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d586162e-95e4-45b5-aeec-c745e4159ad5 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:25.383382 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-54ad1ff4-36dc-4c95-892b-b75a3234f84b tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:25.387489 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-54ad1ff4-36dc-4c95-892b-b75a3234f84b tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: e4c72b14-0ad7-453f-9718-3ed2f911c889] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:25.410707 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-54ad1ff4-36dc-4c95-892b-b75a3234f84b tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:25.411550 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-54ad1ff4-36dc-4c95-892b-b75a3234f84b tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:25.412981 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-54ad1ff4-36dc-4c95-892b-b75a3234f84b tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:25.413856 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-54ad1ff4-36dc-4c95-892b-b75a3234f84b tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:26.009573 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-54ad1ff4-36dc-4c95-892b-b75a3234f84b tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:26.024511 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-54ad1ff4-36dc-4c95-892b-b75a3234f84b tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/e4c72b14-0ad7-453f-9718-3ed2f911c889" status: 200 len: 1374 microversion: 2.1 time: 0.648458 Jul 18 03:03:26.035254 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2994/5972] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:25 2022] GET /compute/v2.1/servers/e4c72b14-0ad7-453f-9718-3ed2f911c889 => generated 1374 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:26.040635 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0914fe99-83ea-4621-a0ac-9013e8483b97 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:26.041428 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0914fe99-83ea-4621-a0ac-9013e8483b97 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: f28d5987-cd8f-4c3f-8b39-09935eabf733] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:26.048377 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0914fe99-83ea-4621-a0ac-9013e8483b97 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:26.048968 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0914fe99-83ea-4621-a0ac-9013e8483b97 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:26.049888 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0914fe99-83ea-4621-a0ac-9013e8483b97 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:26.050412 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0914fe99-83ea-4621-a0ac-9013e8483b97 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:26.087673 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d586162e-95e4-45b5-aeec-c745e4159ad5 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:26.096691 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d586162e-95e4-45b5-aeec-c745e4159ad5 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/8cc40222-82fc-4d28-bce8-e754679126ab" status: 200 len: 1308 microversion: 2.1 time: 0.741289 Jul 18 03:03:26.097501 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2979/5973] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:25 2022] GET /compute/v2.1/servers/8cc40222-82fc-4d28-bce8-e754679126ab => generated 1308 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:26.287468 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0914fe99-83ea-4621-a0ac-9013e8483b97 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/f28d5987-cd8f-4c3f-8b39-09935eabf733" status: 200 len: 1463 microversion: 2.1 time: 0.250656 Jul 18 03:03:26.288561 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2995/5974] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:26 2022] GET /compute/v2.1/servers/f28d5987-cd8f-4c3f-8b39-09935eabf733 => generated 1463 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:26.356864 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-9dcc334d-8f1e-4491-a75b-b01897765cf4 req-f6d9aa9e-56d3-4774-a41c-f388a7536b0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f28d5987-cd8f-4c3f-8b39-09935eabf733", "tag": "aaa41736-0dfa-4997-9d66-31c8242bc514"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:03:26.386294 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-9dcc334d-8f1e-4491-a75b-b01897765cf4 req-f6d9aa9e-56d3-4774-a41c-f388a7536b0f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:26.390115 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-9dcc334d-8f1e-4491-a75b-b01897765cf4 req-f6d9aa9e-56d3-4774-a41c-f388a7536b0f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:26.409318 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-9dcc334d-8f1e-4491-a75b-b01897765cf4 req-f6d9aa9e-56d3-4774-a41c-f388a7536b0f service nova] Creating event network-changed:aaa41736-0dfa-4997-9d66-31c8242bc514 for instance f28d5987-cd8f-4c3f-8b39-09935eabf733 on n-h2-465891-3 Jul 18 03:03:26.416019 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-9dcc334d-8f1e-4491-a75b-b01897765cf4 req-f6d9aa9e-56d3-4774-a41c-f388a7536b0f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064684 Jul 18 03:03:26.417262 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2980/5975] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:03:26.687342 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-5f227522-2fa8-487e-9807-ce158bb5bd44 req-c98f7ecd-da4c-4199-9985-fcb231bd3fbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4c72b14-0ad7-453f-9718-3ed2f911c889", "name": "network-vif-plugged", "status": "completed", "tag": "9beb4cc4-0dde-4552-9926-2ff902db0fff"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:03:26.693897 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-5f227522-2fa8-487e-9807-ce158bb5bd44 req-c98f7ecd-da4c-4199-9985-fcb231bd3fbf service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:26.694605 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-5f227522-2fa8-487e-9807-ce158bb5bd44 req-c98f7ecd-da4c-4199-9985-fcb231bd3fbf service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:26.709858 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-5f227522-2fa8-487e-9807-ce158bb5bd44 req-c98f7ecd-da4c-4199-9985-fcb231bd3fbf service nova] Creating event network-vif-plugged:9beb4cc4-0dde-4552-9926-2ff902db0fff for instance e4c72b14-0ad7-453f-9718-3ed2f911c889 on n-h2-465891-3 Jul 18 03:03:26.716703 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-5f227522-2fa8-487e-9807-ce158bb5bd44 req-c98f7ecd-da4c-4199-9985-fcb231bd3fbf service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037178 Jul 18 03:03:26.718320 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2996/5976] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:03:27.049453 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-23f7f7ae-64c2-469e-9130-094463b11673 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:27.050709 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-23f7f7ae-64c2-469e-9130-094463b11673 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: e4c72b14-0ad7-453f-9718-3ed2f911c889] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:27.062157 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-23f7f7ae-64c2-469e-9130-094463b11673 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:27.062808 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-23f7f7ae-64c2-469e-9130-094463b11673 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:27.064183 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-23f7f7ae-64c2-469e-9130-094463b11673 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:27.064980 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-23f7f7ae-64c2-469e-9130-094463b11673 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:27.120769 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9dc7bcff-b5d4-4d6e-8bb9-1318eab880c2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:27.121955 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9dc7bcff-b5d4-4d6e-8bb9-1318eab880c2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 8cc40222-82fc-4d28-bce8-e754679126ab] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:27.133874 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9dc7bcff-b5d4-4d6e-8bb9-1318eab880c2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:27.134604 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9dc7bcff-b5d4-4d6e-8bb9-1318eab880c2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:27.136131 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9dc7bcff-b5d4-4d6e-8bb9-1318eab880c2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:27.136920 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9dc7bcff-b5d4-4d6e-8bb9-1318eab880c2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:27.338752 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-23f7f7ae-64c2-469e-9130-094463b11673 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:27.347809 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-23f7f7ae-64c2-469e-9130-094463b11673 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/e4c72b14-0ad7-453f-9718-3ed2f911c889" status: 200 len: 1374 microversion: 2.1 time: 0.309588 Jul 18 03:03:27.348651 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2981/5977] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:27 2022] GET /compute/v2.1/servers/e4c72b14-0ad7-453f-9718-3ed2f911c889 => generated 1374 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:27.354418 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7718ade2-60b6-4411-9992-20a2a19440bd tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:27.355261 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7718ade2-60b6-4411-9992-20a2a19440bd tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: f28d5987-cd8f-4c3f-8b39-09935eabf733] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:27.363494 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7718ade2-60b6-4411-9992-20a2a19440bd tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:27.364010 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7718ade2-60b6-4411-9992-20a2a19440bd tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:27.364808 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7718ade2-60b6-4411-9992-20a2a19440bd tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:27.365252 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7718ade2-60b6-4411-9992-20a2a19440bd tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:27.515594 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9dc7bcff-b5d4-4d6e-8bb9-1318eab880c2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:27.529564 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9dc7bcff-b5d4-4d6e-8bb9-1318eab880c2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/8cc40222-82fc-4d28-bce8-e754679126ab" status: 200 len: 1308 microversion: 2.1 time: 0.417014 Jul 18 03:03:27.530728 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2997/5978] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:27 2022] GET /compute/v2.1/servers/8cc40222-82fc-4d28-bce8-e754679126ab => generated 1308 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:27.570719 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7718ade2-60b6-4411-9992-20a2a19440bd tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/f28d5987-cd8f-4c3f-8b39-09935eabf733" status: 200 len: 1463 microversion: 2.1 time: 0.220750 Jul 18 03:03:27.582101 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2982/5979] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:27 2022] GET /compute/v2.1/servers/f28d5987-cd8f-4c3f-8b39-09935eabf733 => generated 1463 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:28.375773 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fac5b4d6-4413-4230-94b4-37b293dd4e3b tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:28.376367 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fac5b4d6-4413-4230-94b4-37b293dd4e3b tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: e4c72b14-0ad7-453f-9718-3ed2f911c889] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:28.386520 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fac5b4d6-4413-4230-94b4-37b293dd4e3b tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:28.387664 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fac5b4d6-4413-4230-94b4-37b293dd4e3b tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:28.388637 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fac5b4d6-4413-4230-94b4-37b293dd4e3b tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:28.389153 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fac5b4d6-4413-4230-94b4-37b293dd4e3b tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:28.551205 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7e2908de-25a4-4b69-8a38-8b675d6786e7 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:28.552463 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7e2908de-25a4-4b69-8a38-8b675d6786e7 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 8cc40222-82fc-4d28-bce8-e754679126ab] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:28.559419 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fac5b4d6-4413-4230-94b4-37b293dd4e3b tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:28.567128 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7e2908de-25a4-4b69-8a38-8b675d6786e7 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:28.567940 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7e2908de-25a4-4b69-8a38-8b675d6786e7 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:28.568378 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fac5b4d6-4413-4230-94b4-37b293dd4e3b tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/e4c72b14-0ad7-453f-9718-3ed2f911c889" status: 200 len: 1374 microversion: 2.1 time: 0.196478 Jul 18 03:03:28.569087 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2998/5980] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:28 2022] GET /compute/v2.1/servers/e4c72b14-0ad7-453f-9718-3ed2f911c889 => generated 1374 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:03:28.569388 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7e2908de-25a4-4b69-8a38-8b675d6786e7 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:28.570226 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7e2908de-25a4-4b69-8a38-8b675d6786e7 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:28.588456 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e7b69cf6-1f4f-44e6-af63-3e1aa7a3a39b tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:28.589237 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e7b69cf6-1f4f-44e6-af63-3e1aa7a3a39b tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: f28d5987-cd8f-4c3f-8b39-09935eabf733] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:28.595660 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e7b69cf6-1f4f-44e6-af63-3e1aa7a3a39b tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:28.596127 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e7b69cf6-1f4f-44e6-af63-3e1aa7a3a39b tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:28.597107 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e7b69cf6-1f4f-44e6-af63-3e1aa7a3a39b tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:28.597569 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e7b69cf6-1f4f-44e6-af63-3e1aa7a3a39b tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:28.969241 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7e2908de-25a4-4b69-8a38-8b675d6786e7 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:28.990014 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e7b69cf6-1f4f-44e6-af63-3e1aa7a3a39b tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/f28d5987-cd8f-4c3f-8b39-09935eabf733" status: 200 len: 1463 microversion: 2.1 time: 0.406092 Jul 18 03:03:28.990633 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 2999/5981] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:28 2022] GET /compute/v2.1/servers/f28d5987-cd8f-4c3f-8b39-09935eabf733 => generated 1463 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:03:28.994093 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7e2908de-25a4-4b69-8a38-8b675d6786e7 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/8cc40222-82fc-4d28-bce8-e754679126ab" status: 200 len: 1308 microversion: 2.1 time: 0.449936 Jul 18 03:03:28.994701 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2983/5982] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:28 2022] GET /compute/v2.1/servers/8cc40222-82fc-4d28-bce8-e754679126ab => generated 1308 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:29.587899 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-56bd149b-2771-445f-8687-dae8dde8ed78 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:29.588391 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-56bd149b-2771-445f-8687-dae8dde8ed78 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: e4c72b14-0ad7-453f-9718-3ed2f911c889] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:29.598027 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56bd149b-2771-445f-8687-dae8dde8ed78 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:29.598831 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56bd149b-2771-445f-8687-dae8dde8ed78 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:29.599935 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56bd149b-2771-445f-8687-dae8dde8ed78 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:29.600687 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56bd149b-2771-445f-8687-dae8dde8ed78 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:29.746501 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-c55728a9-d083-4ad2-b4a8-1041a4330234 req-81428e31-affa-47aa-ad8a-17700b79d965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cc40222-82fc-4d28-bce8-e754679126ab", "name": "network-vif-plugged", "status": "completed", "tag": "6f0f9200-3b3c-4b65-947c-4f79711b8387"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:03:29.775702 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-c55728a9-d083-4ad2-b4a8-1041a4330234 req-81428e31-affa-47aa-ad8a-17700b79d965 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:29.776161 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-c55728a9-d083-4ad2-b4a8-1041a4330234 req-81428e31-affa-47aa-ad8a-17700b79d965 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:29.802798 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-c55728a9-d083-4ad2-b4a8-1041a4330234 req-81428e31-affa-47aa-ad8a-17700b79d965 service nova] Creating event network-vif-plugged:6f0f9200-3b3c-4b65-947c-4f79711b8387 for instance 8cc40222-82fc-4d28-bce8-e754679126ab on n-h1-465891-3 Jul 18 03:03:29.815301 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-c55728a9-d083-4ad2-b4a8-1041a4330234 req-81428e31-affa-47aa-ad8a-17700b79d965 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073147 Jul 18 03:03:29.815946 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2984/5983] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:03:29.954925 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-56bd149b-2771-445f-8687-dae8dde8ed78 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:29.967928 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-56bd149b-2771-445f-8687-dae8dde8ed78 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/e4c72b14-0ad7-453f-9718-3ed2f911c889" status: 200 len: 1545 microversion: 2.1 time: 0.384775 Jul 18 03:03:29.979327 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3000/5984] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:29 2022] GET /compute/v2.1/servers/e4c72b14-0ad7-453f-9718-3ed2f911c889 => generated 1545 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:29.997102 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-26c7e2e0-af32-4ea0-a3bd-5152df33e49a tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:29.998068 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-26c7e2e0-af32-4ea0-a3bd-5152df33e49a tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: e4c72b14-0ad7-453f-9718-3ed2f911c889] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:30.007180 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26c7e2e0-af32-4ea0-a3bd-5152df33e49a tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:30.009313 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26c7e2e0-af32-4ea0-a3bd-5152df33e49a tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:30.009507 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cf9bfef0-06e0-4260-88b8-eafa9ea207ba tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:30.010366 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cf9bfef0-06e0-4260-88b8-eafa9ea207ba tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: f28d5987-cd8f-4c3f-8b39-09935eabf733] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:30.010874 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26c7e2e0-af32-4ea0-a3bd-5152df33e49a tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:30.011555 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-26c7e2e0-af32-4ea0-a3bd-5152df33e49a tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:30.020464 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cf9bfef0-06e0-4260-88b8-eafa9ea207ba tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:30.020937 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cf9bfef0-06e0-4260-88b8-eafa9ea207ba tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:30.021761 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cf9bfef0-06e0-4260-88b8-eafa9ea207ba tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:30.022223 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cf9bfef0-06e0-4260-88b8-eafa9ea207ba tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:30.263085 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:03:30.353655 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-26c7e2e0-af32-4ea0-a3bd-5152df33e49a tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:30.368227 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-26c7e2e0-af32-4ea0-a3bd-5152df33e49a tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/e4c72b14-0ad7-453f-9718-3ed2f911c889" status: 200 len: 1545 microversion: 2.1 time: 0.376040 Jul 18 03:03:30.369912 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2985/5985] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:29 2022] GET /compute/v2.1/servers/e4c72b14-0ad7-453f-9718-3ed2f911c889 => generated 1545 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:30.375192 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2d7770fd-ed8d-466a-936d-35d62dae9b87 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:30.376200 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2d7770fd-ed8d-466a-936d-35d62dae9b87 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 8cc40222-82fc-4d28-bce8-e754679126ab] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:30.385866 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2d7770fd-ed8d-466a-936d-35d62dae9b87 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:30.386575 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2d7770fd-ed8d-466a-936d-35d62dae9b87 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:30.387544 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2d7770fd-ed8d-466a-936d-35d62dae9b87 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:30.388502 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2d7770fd-ed8d-466a-936d-35d62dae9b87 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:30.388697 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cf9bfef0-06e0-4260-88b8-eafa9ea207ba tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/f28d5987-cd8f-4c3f-8b39-09935eabf733" status: 200 len: 1463 microversion: 2.1 time: 0.383869 Jul 18 03:03:30.390297 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3001/5986] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:30 2022] GET /compute/v2.1/servers/f28d5987-cd8f-4c3f-8b39-09935eabf733 => generated 1463 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:30.550522 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=24 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:03:30.658449 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2d7770fd-ed8d-466a-936d-35d62dae9b87 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:30.666983 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2d7770fd-ed8d-466a-936d-35d62dae9b87 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/8cc40222-82fc-4d28-bce8-e754679126ab" status: 200 len: 1308 microversion: 2.1 time: 0.295575 Jul 18 03:03:30.668277 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2986/5987] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:30 2022] GET /compute/v2.1/servers/8cc40222-82fc-4d28-bce8-e754679126ab => generated 1308 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:31.413750 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-33f9d74f-9019-4eb9-9f41-fecd05eab16d tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:31.414589 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-33f9d74f-9019-4eb9-9f41-fecd05eab16d tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: f28d5987-cd8f-4c3f-8b39-09935eabf733] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:31.422517 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-33f9d74f-9019-4eb9-9f41-fecd05eab16d tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:31.422984 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-33f9d74f-9019-4eb9-9f41-fecd05eab16d tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:31.423798 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-33f9d74f-9019-4eb9-9f41-fecd05eab16d tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:31.424251 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-33f9d74f-9019-4eb9-9f41-fecd05eab16d tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:31.619309 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-33f9d74f-9019-4eb9-9f41-fecd05eab16d tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/f28d5987-cd8f-4c3f-8b39-09935eabf733" status: 200 len: 1463 microversion: 2.1 time: 0.208571 Jul 18 03:03:31.621225 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3002/5988] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:31 2022] GET /compute/v2.1/servers/f28d5987-cd8f-4c3f-8b39-09935eabf733 => generated 1463 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:31.684845 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d12b18bb-da2f-4c91-ba11-ebdca4b8bdcd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:31.685927 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d12b18bb-da2f-4c91-ba11-ebdca4b8bdcd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 8cc40222-82fc-4d28-bce8-e754679126ab] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:31.692823 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d12b18bb-da2f-4c91-ba11-ebdca4b8bdcd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:31.693563 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d12b18bb-da2f-4c91-ba11-ebdca4b8bdcd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:31.694647 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d12b18bb-da2f-4c91-ba11-ebdca4b8bdcd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:31.696282 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d12b18bb-da2f-4c91-ba11-ebdca4b8bdcd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:31.908315 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d12b18bb-da2f-4c91-ba11-ebdca4b8bdcd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:31.923856 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d12b18bb-da2f-4c91-ba11-ebdca4b8bdcd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/8cc40222-82fc-4d28-bce8-e754679126ab" status: 200 len: 1489 microversion: 2.1 time: 0.243320 Jul 18 03:03:31.931640 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2987/5989] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:31 2022] GET /compute/v2.1/servers/8cc40222-82fc-4d28-bce8-e754679126ab => generated 1489 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:32.156081 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-60cdca81-7c75-4875-b74a-3197dabd7e8e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-126490508", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "c540b69b-e7cc-4fa1-8fc6-67859b3d0823"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:03:32.219553 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-60cdca81-7c75-4875-b74a-3197dabd7e8e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] validate_networks() for [('c540b69b-e7cc-4fa1-8fc6-67859b3d0823', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:03:32.638540 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-eec5b39f-86bc-4ffd-9218-0bfd0168a1f7 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:32.639154 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-eec5b39f-86bc-4ffd-9218-0bfd0168a1f7 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: f28d5987-cd8f-4c3f-8b39-09935eabf733] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:32.651909 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eec5b39f-86bc-4ffd-9218-0bfd0168a1f7 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:32.652363 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eec5b39f-86bc-4ffd-9218-0bfd0168a1f7 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:32.653174 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eec5b39f-86bc-4ffd-9218-0bfd0168a1f7 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:32.653798 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eec5b39f-86bc-4ffd-9218-0bfd0168a1f7 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:32.749359 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-60cdca81-7c75-4875-b74a-3197dabd7e8e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:03:32.750145 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-60cdca81-7c75-4875-b74a-3197dabd7e8e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:03:32.750651 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-60cdca81-7c75-4875-b74a-3197dabd7e8e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:03:32.751085 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-60cdca81-7c75-4875-b74a-3197dabd7e8e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:03:32.751514 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-60cdca81-7c75-4875-b74a-3197dabd7e8e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:03:32.773457 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60cdca81-7c75-4875-b74a-3197dabd7e8e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:32.774251 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60cdca81-7c75-4875-b74a-3197dabd7e8e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:32.775662 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60cdca81-7c75-4875-b74a-3197dabd7e8e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:32.776510 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60cdca81-7c75-4875-b74a-3197dabd7e8e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:32.801151 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-60cdca81-7c75-4875-b74a-3197dabd7e8e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Getting quotas for project 3a83c4dedef341a0bb50fa4c119d3035. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:03:32.810934 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-60cdca81-7c75-4875-b74a-3197dabd7e8e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Getting quotas for user 785ff643c00746939bb0fecd775ce920 and project 3a83c4dedef341a0bb50fa4c119d3035. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:03:32.830197 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-60cdca81-7c75-4875-b74a-3197dabd7e8e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:03:32.833532 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-60cdca81-7c75-4875-b74a-3197dabd7e8e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 854b9c4e-a7a6-401c-afff-8670379eea51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:03:32.917033 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-60cdca81-7c75-4875-b74a-3197dabd7e8e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.765183 Jul 18 03:03:32.921669 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3003/5990] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:03:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:03:32.929339 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-46027691-5074-4429-aaf8-0a18a295c31f req-d540f415-9ea6-4cf4-b514-f6ecdff7d432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f28d5987-cd8f-4c3f-8b39-09935eabf733", "name": "network-vif-plugged", "status": "completed", "tag": "aaa41736-0dfa-4997-9d66-31c8242bc514"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:03:32.953845 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-eec5b39f-86bc-4ffd-9218-0bfd0168a1f7 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/f28d5987-cd8f-4c3f-8b39-09935eabf733" status: 200 len: 1463 microversion: 2.1 time: 0.317504 Jul 18 03:03:32.960168 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-46027691-5074-4429-aaf8-0a18a295c31f req-d540f415-9ea6-4cf4-b514-f6ecdff7d432 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:32.960504 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-46027691-5074-4429-aaf8-0a18a295c31f req-d540f415-9ea6-4cf4-b514-f6ecdff7d432 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:32.977837 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2988/5991] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:32 2022] GET /compute/v2.1/servers/f28d5987-cd8f-4c3f-8b39-09935eabf733 => generated 1463 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:03:32.999448 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f152d81d-5d25-470d-9421-a91cc72d3c4b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:33.002507 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f152d81d-5d25-470d-9421-a91cc72d3c4b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 854b9c4e-a7a6-401c-afff-8670379eea51] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:33.018958 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-46027691-5074-4429-aaf8-0a18a295c31f req-d540f415-9ea6-4cf4-b514-f6ecdff7d432 service nova] Creating event network-vif-plugged:aaa41736-0dfa-4997-9d66-31c8242bc514 for instance f28d5987-cd8f-4c3f-8b39-09935eabf733 on n-h2-465891-3 Jul 18 03:03:33.034345 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-46027691-5074-4429-aaf8-0a18a295c31f req-d540f415-9ea6-4cf4-b514-f6ecdff7d432 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105289 Jul 18 03:03:33.035477 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3004/5992] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:03:33.146498 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f152d81d-5d25-470d-9421-a91cc72d3c4b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:33.159398 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f152d81d-5d25-470d-9421-a91cc72d3c4b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51" status: 200 len: 1208 microversion: 2.1 time: 0.179400 Jul 18 03:03:33.160005 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2989/5993] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:32 2022] GET /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51 => generated 1208 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:33.848343 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-2794a6f1-e24e-40a6-a09b-5e84f50fdee7 req-72bfceed-aae0-4a99-a672-c3c8adf15c3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4c72b14-0ad7-453f-9718-3ed2f911c889", "tag": "9beb4cc4-0dde-4552-9926-2ff902db0fff"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:03:33.887793 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-2794a6f1-e24e-40a6-a09b-5e84f50fdee7 req-72bfceed-aae0-4a99-a672-c3c8adf15c3c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:33.890836 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-2794a6f1-e24e-40a6-a09b-5e84f50fdee7 req-72bfceed-aae0-4a99-a672-c3c8adf15c3c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:33.907617 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-2794a6f1-e24e-40a6-a09b-5e84f50fdee7 req-72bfceed-aae0-4a99-a672-c3c8adf15c3c service nova] Creating event network-changed:9beb4cc4-0dde-4552-9926-2ff902db0fff for instance e4c72b14-0ad7-453f-9718-3ed2f911c889 on n-h2-465891-3 Jul 18 03:03:33.924347 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-2794a6f1-e24e-40a6-a09b-5e84f50fdee7 req-72bfceed-aae0-4a99-a672-c3c8adf15c3c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084687 Jul 18 03:03:33.926772 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3005/5994] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:03:33.979173 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ded764fb-9cb1-4037-9d83-25319d216731 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:33.981963 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ded764fb-9cb1-4037-9d83-25319d216731 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: f28d5987-cd8f-4c3f-8b39-09935eabf733] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:34.013270 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ded764fb-9cb1-4037-9d83-25319d216731 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:34.014113 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ded764fb-9cb1-4037-9d83-25319d216731 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:34.021846 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ded764fb-9cb1-4037-9d83-25319d216731 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:34.022750 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ded764fb-9cb1-4037-9d83-25319d216731 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:34.193793 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cc98a528-4c51-4aea-80fa-222bbcf3ca44 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:34.194904 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cc98a528-4c51-4aea-80fa-222bbcf3ca44 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 854b9c4e-a7a6-401c-afff-8670379eea51] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:34.214762 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cc98a528-4c51-4aea-80fa-222bbcf3ca44 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:34.217229 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cc98a528-4c51-4aea-80fa-222bbcf3ca44 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:34.220524 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cc98a528-4c51-4aea-80fa-222bbcf3ca44 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:34.221328 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cc98a528-4c51-4aea-80fa-222bbcf3ca44 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:34.552789 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cc98a528-4c51-4aea-80fa-222bbcf3ca44 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:34.588165 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cc98a528-4c51-4aea-80fa-222bbcf3ca44 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51" status: 200 len: 1204 microversion: 2.1 time: 0.399748 Jul 18 03:03:34.594997 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3006/5995] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:34 2022] GET /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51 => generated 1204 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:03:34.871035 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ded764fb-9cb1-4037-9d83-25319d216731 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/f28d5987-cd8f-4c3f-8b39-09935eabf733" status: 200 len: 1463 microversion: 2.1 time: 0.896175 Jul 18 03:03:34.874291 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2990/5996] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:33 2022] GET /compute/v2.1/servers/f28d5987-cd8f-4c3f-8b39-09935eabf733 => generated 1463 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:03:35.613521 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-836dae46-4ea3-4de9-9b68-96c2ab44c556 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:35.615674 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-836dae46-4ea3-4de9-9b68-96c2ab44c556 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 854b9c4e-a7a6-401c-afff-8670379eea51] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:35.641216 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-836dae46-4ea3-4de9-9b68-96c2ab44c556 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:35.641742 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-836dae46-4ea3-4de9-9b68-96c2ab44c556 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:35.644371 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-836dae46-4ea3-4de9-9b68-96c2ab44c556 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:35.645110 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-836dae46-4ea3-4de9-9b68-96c2ab44c556 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:35.650971 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:03:35.896326 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ce894262-7d99-46aa-bb38-9b1bb10c1fe1 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:35.897355 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ce894262-7d99-46aa-bb38-9b1bb10c1fe1 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: f28d5987-cd8f-4c3f-8b39-09935eabf733] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:35.905379 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ce894262-7d99-46aa-bb38-9b1bb10c1fe1 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:35.905897 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ce894262-7d99-46aa-bb38-9b1bb10c1fe1 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:35.906721 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ce894262-7d99-46aa-bb38-9b1bb10c1fe1 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:35.907164 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ce894262-7d99-46aa-bb38-9b1bb10c1fe1 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:35.986487 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-836dae46-4ea3-4de9-9b68-96c2ab44c556 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:35.996523 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-836dae46-4ea3-4de9-9b68-96c2ab44c556 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51" status: 200 len: 1266 microversion: 2.1 time: 0.386935 Jul 18 03:03:36.008868 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3007/5997] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:35 2022] GET /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51 => generated 1266 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:36.191918 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ce894262-7d99-46aa-bb38-9b1bb10c1fe1 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/f28d5987-cd8f-4c3f-8b39-09935eabf733" status: 200 len: 1647 microversion: 2.1 time: 0.303560 Jul 18 03:03:36.193080 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2991/5998] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:35 2022] GET /compute/v2.1/servers/f28d5987-cd8f-4c3f-8b39-09935eabf733 => generated 1647 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:03:36.214345 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0f61c6ea-34a7-478d-b0eb-c2fc967ef632 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:36.214989 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0f61c6ea-34a7-478d-b0eb-c2fc967ef632 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: f28d5987-cd8f-4c3f-8b39-09935eabf733] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:36.235915 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0f61c6ea-34a7-478d-b0eb-c2fc967ef632 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:36.238041 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0f61c6ea-34a7-478d-b0eb-c2fc967ef632 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:36.239500 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0f61c6ea-34a7-478d-b0eb-c2fc967ef632 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:36.240281 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0f61c6ea-34a7-478d-b0eb-c2fc967ef632 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:36.495436 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0f61c6ea-34a7-478d-b0eb-c2fc967ef632 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/f28d5987-cd8f-4c3f-8b39-09935eabf733" status: 200 len: 1647 microversion: 2.1 time: 0.286356 Jul 18 03:03:36.497099 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3008/5999] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:36 2022] GET /compute/v2.1/servers/f28d5987-cd8f-4c3f-8b39-09935eabf733 => generated 1647 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:36.520715 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e9fc617e-eef8-4a7e-83a2-079eb8bf0c55 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:36.521629 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e9fc617e-eef8-4a7e-83a2-079eb8bf0c55 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: f28d5987-cd8f-4c3f-8b39-09935eabf733] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:36.529092 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e9fc617e-eef8-4a7e-83a2-079eb8bf0c55 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:36.529816 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e9fc617e-eef8-4a7e-83a2-079eb8bf0c55 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:36.530781 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e9fc617e-eef8-4a7e-83a2-079eb8bf0c55 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:36.531400 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e9fc617e-eef8-4a7e-83a2-079eb8bf0c55 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:36.770661 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e9fc617e-eef8-4a7e-83a2-079eb8bf0c55 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/f28d5987-cd8f-4c3f-8b39-09935eabf733" status: 200 len: 1647 microversion: 2.1 time: 0.253249 Jul 18 03:03:36.772196 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2992/6000] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:36 2022] GET /compute/v2.1/servers/f28d5987-cd8f-4c3f-8b39-09935eabf733 => generated 1647 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:03:36.793201 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-55d61ca9-cc2a-4bb8-9c64-315e381c8735 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:36.794193 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-55d61ca9-cc2a-4bb8-9c64-315e381c8735 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: f28d5987-cd8f-4c3f-8b39-09935eabf733] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:36.808534 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-55d61ca9-cc2a-4bb8-9c64-315e381c8735 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:36.809346 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-55d61ca9-cc2a-4bb8-9c64-315e381c8735 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:36.812736 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-55d61ca9-cc2a-4bb8-9c64-315e381c8735 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:36.812736 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-55d61ca9-cc2a-4bb8-9c64-315e381c8735 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:36.870657 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-55d61ca9-cc2a-4bb8-9c64-315e381c8735 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: f28d5987-cd8f-4c3f-8b39-09935eabf733] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:03:37.019401 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ecc02750-fc47-4d5e-ae9e-0c019adc1222 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:37.021642 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ecc02750-fc47-4d5e-ae9e-0c019adc1222 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 854b9c4e-a7a6-401c-afff-8670379eea51] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:37.034756 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ecc02750-fc47-4d5e-ae9e-0c019adc1222 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:37.036103 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ecc02750-fc47-4d5e-ae9e-0c019adc1222 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:37.037971 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ecc02750-fc47-4d5e-ae9e-0c019adc1222 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:37.039714 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ecc02750-fc47-4d5e-ae9e-0c019adc1222 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:37.134108 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-55d61ca9-cc2a-4bb8-9c64-315e381c8735 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] 10.222.0.57 "DELETE /compute/v2.1/servers/f28d5987-cd8f-4c3f-8b39-09935eabf733" status: 204 len: 0 microversion: 2.1 time: 0.348093 Jul 18 03:03:37.138809 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3009/6001] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:03:36 2022] DELETE /compute/v2.1/servers/f28d5987-cd8f-4c3f-8b39-09935eabf733 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:03:37.149345 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f10b1b20-20fa-4904-af0f-f12bb8d344e4 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:37.151604 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f10b1b20-20fa-4904-af0f-f12bb8d344e4 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: f28d5987-cd8f-4c3f-8b39-09935eabf733] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:37.174801 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f10b1b20-20fa-4904-af0f-f12bb8d344e4 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:37.175412 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f10b1b20-20fa-4904-af0f-f12bb8d344e4 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:37.176697 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f10b1b20-20fa-4904-af0f-f12bb8d344e4 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:37.183323 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f10b1b20-20fa-4904-af0f-f12bb8d344e4 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:37.432474 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ecc02750-fc47-4d5e-ae9e-0c019adc1222 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:37.446517 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ecc02750-fc47-4d5e-ae9e-0c019adc1222 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51" status: 200 len: 1308 microversion: 2.1 time: 0.432788 Jul 18 03:03:37.449482 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2993/6002] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:37 2022] GET /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51 => generated 1308 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:37.539876 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f10b1b20-20fa-4904-af0f-f12bb8d344e4 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/f28d5987-cd8f-4c3f-8b39-09935eabf733" status: 200 len: 1653 microversion: 2.1 time: 0.398617 Jul 18 03:03:37.541503 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3010/6003] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:37 2022] GET /compute/v2.1/servers/f28d5987-cd8f-4c3f-8b39-09935eabf733 => generated 1653 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:38.471454 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b8f4b6b4-012d-440a-9890-558c1953ac96 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:38.473581 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b8f4b6b4-012d-440a-9890-558c1953ac96 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 854b9c4e-a7a6-401c-afff-8670379eea51] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:38.492681 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b8f4b6b4-012d-440a-9890-558c1953ac96 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:38.493882 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b8f4b6b4-012d-440a-9890-558c1953ac96 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:38.496766 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b8f4b6b4-012d-440a-9890-558c1953ac96 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:38.498375 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b8f4b6b4-012d-440a-9890-558c1953ac96 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:38.568518 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8947aa97-a510-448c-ac53-435f13c49730 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:38.569888 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8947aa97-a510-448c-ac53-435f13c49730 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: f28d5987-cd8f-4c3f-8b39-09935eabf733] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:38.583022 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8947aa97-a510-448c-ac53-435f13c49730 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:38.598080 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8947aa97-a510-448c-ac53-435f13c49730 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:38.599135 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8947aa97-a510-448c-ac53-435f13c49730 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:38.599609 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8947aa97-a510-448c-ac53-435f13c49730 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:39.071314 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b8f4b6b4-012d-440a-9890-558c1953ac96 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:39.080646 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b8f4b6b4-012d-440a-9890-558c1953ac96 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51" status: 200 len: 1308 microversion: 2.1 time: 0.617380 Jul 18 03:03:39.082463 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2994/6004] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:38 2022] GET /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51 => generated 1308 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:39.129672 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8947aa97-a510-448c-ac53-435f13c49730 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/f28d5987-cd8f-4c3f-8b39-09935eabf733" status: 200 len: 1653 microversion: 2.1 time: 0.565899 Jul 18 03:03:39.130934 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3011/6005] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:38 2022] GET /compute/v2.1/servers/f28d5987-cd8f-4c3f-8b39-09935eabf733 => generated 1653 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:39.386615 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-11a0f5bd-d13f-49d3-b25a-e190dca1b6ff req-839e5ee2-f926-473b-b80e-c66aeb3ca74a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "854b9c4e-a7a6-401c-afff-8670379eea51", "tag": "75ce3446-93dc-404e-8d32-46f7a3b3be61"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:03:39.406033 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-11a0f5bd-d13f-49d3-b25a-e190dca1b6ff req-839e5ee2-f926-473b-b80e-c66aeb3ca74a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:39.407184 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-11a0f5bd-d13f-49d3-b25a-e190dca1b6ff req-839e5ee2-f926-473b-b80e-c66aeb3ca74a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:39.422387 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-11a0f5bd-d13f-49d3-b25a-e190dca1b6ff req-839e5ee2-f926-473b-b80e-c66aeb3ca74a service nova] Creating event network-changed:75ce3446-93dc-404e-8d32-46f7a3b3be61 for instance 854b9c4e-a7a6-401c-afff-8670379eea51 on n-h1-465891-3 Jul 18 03:03:39.431606 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-11a0f5bd-d13f-49d3-b25a-e190dca1b6ff req-839e5ee2-f926-473b-b80e-c66aeb3ca74a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046715 Jul 18 03:03:39.433554 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2995/6006] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:03:39.972081 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-68316759-0c73-4911-805d-e2f3da0ada20 req-aedf561d-d1e7-4a85-9a90-d5a4a840426f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f28d5987-cd8f-4c3f-8b39-09935eabf733", "name": "network-vif-deleted", "tag": "aaa41736-0dfa-4997-9d66-31c8242bc514"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:03:40.003105 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-68316759-0c73-4911-805d-e2f3da0ada20 req-aedf561d-d1e7-4a85-9a90-d5a4a840426f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:40.008748 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-68316759-0c73-4911-805d-e2f3da0ada20 req-aedf561d-d1e7-4a85-9a90-d5a4a840426f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:40.039951 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-68316759-0c73-4911-805d-e2f3da0ada20 req-aedf561d-d1e7-4a85-9a90-d5a4a840426f service nova] Creating event network-vif-deleted:aaa41736-0dfa-4997-9d66-31c8242bc514 for instance f28d5987-cd8f-4c3f-8b39-09935eabf733 on n-h2-465891-3 Jul 18 03:03:40.046149 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-68316759-0c73-4911-805d-e2f3da0ada20 req-aedf561d-d1e7-4a85-9a90-d5a4a840426f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079185 Jul 18 03:03:40.049869 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3012/6007] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:03:40.112738 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-741d4d09-0a0b-4563-b5c9-ba978c091f48 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:40.116074 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-741d4d09-0a0b-4563-b5c9-ba978c091f48 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 854b9c4e-a7a6-401c-afff-8670379eea51] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:40.137136 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-741d4d09-0a0b-4563-b5c9-ba978c091f48 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:40.140144 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-741d4d09-0a0b-4563-b5c9-ba978c091f48 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:40.143048 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-741d4d09-0a0b-4563-b5c9-ba978c091f48 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:40.144807 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-741d4d09-0a0b-4563-b5c9-ba978c091f48 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:40.155151 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d999e5c2-d21b-40cc-b5d2-bf3547704191 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:40.155896 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d999e5c2-d21b-40cc-b5d2-bf3547704191 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: f28d5987-cd8f-4c3f-8b39-09935eabf733] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:40.163802 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d999e5c2-d21b-40cc-b5d2-bf3547704191 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:40.165362 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d999e5c2-d21b-40cc-b5d2-bf3547704191 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:40.166507 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d999e5c2-d21b-40cc-b5d2-bf3547704191 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:40.167159 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d999e5c2-d21b-40cc-b5d2-bf3547704191 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:40.540772 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d999e5c2-d21b-40cc-b5d2-bf3547704191 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/f28d5987-cd8f-4c3f-8b39-09935eabf733" status: 200 len: 1448 microversion: 2.1 time: 0.391925 Jul 18 03:03:40.546242 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3013/6008] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:40 2022] GET /compute/v2.1/servers/f28d5987-cd8f-4c3f-8b39-09935eabf733 => generated 1448 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:03:40.667140 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-741d4d09-0a0b-4563-b5c9-ba978c091f48 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:40.687893 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-741d4d09-0a0b-4563-b5c9-ba978c091f48 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51" status: 200 len: 1308 microversion: 2.1 time: 0.589749 Jul 18 03:03:40.688541 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2996/6009] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:40 2022] GET /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51 => generated 1308 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:40.921593 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-70956925-feeb-4737-b6c5-6f39d0502932 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:40.923360 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-70956925-feeb-4737-b6c5-6f39d0502932 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:40.958088 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-70956925-feeb-4737-b6c5-6f39d0502932 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:40.959558 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-70956925-feeb-4737-b6c5-6f39d0502932 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:40.963382 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-70956925-feeb-4737-b6c5-6f39d0502932 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:40.977081 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-70956925-feeb-4737-b6c5-6f39d0502932 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:41.020500 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-70956925-feeb-4737-b6c5-6f39d0502932 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:03:41.166614 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-70956925-feeb-4737-b6c5-6f39d0502932 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e" status: 204 len: 0 microversion: 2.1 time: 0.255100 Jul 18 03:03:41.167500 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3014/6010] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:03:40 2022] DELETE /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:03:41.178389 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-90cb513f-e659-495a-a011-6a5d50335751 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:41.181171 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-90cb513f-e659-495a-a011-6a5d50335751 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:41.190961 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-90cb513f-e659-495a-a011-6a5d50335751 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:41.192472 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-90cb513f-e659-495a-a011-6a5d50335751 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:41.193567 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-90cb513f-e659-495a-a011-6a5d50335751 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:41.194277 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-90cb513f-e659-495a-a011-6a5d50335751 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:41.217276 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=100 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:03:41.430839 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-90cb513f-e659-495a-a011-6a5d50335751 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:41.441888 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-90cb513f-e659-495a-a011-6a5d50335751 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e" status: 200 len: 1577 microversion: 2.1 time: 0.268859 Jul 18 03:03:41.443253 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2997/6011] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:41 2022] GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e => generated 1577 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:41.588456 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-52464b33-5d8a-45f5-8366-8b54435b936b tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:41.596190 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-52464b33-5d8a-45f5-8366-8b54435b936b tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: f28d5987-cd8f-4c3f-8b39-09935eabf733] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:41.615660 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:03:41.622514 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-52464b33-5d8a-45f5-8366-8b54435b936b tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:41.624171 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-52464b33-5d8a-45f5-8366-8b54435b936b tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:41.627302 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-52464b33-5d8a-45f5-8366-8b54435b936b tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:41.629224 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-52464b33-5d8a-45f5-8366-8b54435b936b tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:41.666526 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-52464b33-5d8a-45f5-8366-8b54435b936b tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] HTTP exception thrown: Instance f28d5987-cd8f-4c3f-8b39-09935eabf733 could not be found. Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-52464b33-5d8a-45f5-8366-8b54435b936b tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Request method failure captured: Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/f28d5987-cd8f-4c3f-8b39-09935eabf733 HTTP/1.1 Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1M1fkflfZPZFznSZ2kohtLsFUAMmThk6EPzuoWTYQ3iP-VGXzXP0ZD3FIPyNSTzHXwEOG3iknaZJMVsqaIMSUsw0X6CypYvnRobC6Qvf3R3RpdcuzvxcDpZgc1CRNbJe95GJuBexqr1z017pj6dkBJrIpAqpekBRukbUqusiWk-dRMg Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 91218185fc774f2bb420f8cbf8dead9e Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-TestServerMultinode-1381280515 Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,admin,reader Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,admin,reader Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_91218185fc774f2bb420f8cbf8dead9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/91218185fc774f2bb420f8cbf8dead9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/91218185fc774f2bb420f8cbf8dead9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/91218185fc774f2bb420f8cbf8dead9e"}]}] Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-TestServerMultinode-1381280515 Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 91218185fc774f2bb420f8cbf8dead9e Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-TestServerMultinode-1381280515 Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-TestServerMultinode-1381280515-project-admin Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: e3abc7c13a81413caf400dd4fd3fa649 Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-TestServerMultinode-1381280515-project-admin Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance f28d5987-cd8f-4c3f-8b39-09935eabf733 could not be found. Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'f28d5987-cd8f-4c3f-8b39-09935eabf733'} Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f28d5987-cd8f-4c3f-8b39-09935eabf733 could not be found. Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f28d5987-cd8f-4c3f-8b39-09935eabf733 could not be found. Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:03:41.671851 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:03:41.680244 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:03:41.680244 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:03:41.680244 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:03:41.680244 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:03:41.680244 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:03:41.680244 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f28d5987-cd8f-4c3f-8b39-09935eabf733 could not be found. Jul 18 03:03:41.680244 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:03:41.685438 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-52464b33-5d8a-45f5-8366-8b54435b936b tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Returning 404 to user: Instance f28d5987-cd8f-4c3f-8b39-09935eabf733 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:03:41.687609 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-52464b33-5d8a-45f5-8366-8b54435b936b tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/f28d5987-cd8f-4c3f-8b39-09935eabf733" status: 404 len: 111 microversion: 2.1 time: 0.128284 Jul 18 03:03:41.706460 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d0b104a1-b86f-4167-9f35-2993c5856590 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:41.707089 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d0b104a1-b86f-4167-9f35-2993c5856590 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 854b9c4e-a7a6-401c-afff-8670379eea51] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:41.714444 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3015/6012] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:41 2022] GET /compute/v2.1/servers/f28d5987-cd8f-4c3f-8b39-09935eabf733 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:03:41.724187 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d0b104a1-b86f-4167-9f35-2993c5856590 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:41.729680 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d0b104a1-b86f-4167-9f35-2993c5856590 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:41.731685 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d0b104a1-b86f-4167-9f35-2993c5856590 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:41.732706 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d0b104a1-b86f-4167-9f35-2993c5856590 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:41.738183 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4483f26f-3a71-4e51-a7b9-ee8c27d4dbe0 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:41.747293 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4483f26f-3a71-4e51-a7b9-ee8c27d4dbe0 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: ff755b33-da10-4e1a-9734-309196902bbf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:41.766090 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4483f26f-3a71-4e51-a7b9-ee8c27d4dbe0 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:41.767352 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4483f26f-3a71-4e51-a7b9-ee8c27d4dbe0 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:41.770388 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4483f26f-3a71-4e51-a7b9-ee8c27d4dbe0 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:41.788491 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4483f26f-3a71-4e51-a7b9-ee8c27d4dbe0 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:41.824097 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4483f26f-3a71-4e51-a7b9-ee8c27d4dbe0 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: ff755b33-da10-4e1a-9734-309196902bbf] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:03:42.045247 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4483f26f-3a71-4e51-a7b9-ee8c27d4dbe0 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] 10.222.0.57 "DELETE /compute/v2.1/servers/ff755b33-da10-4e1a-9734-309196902bbf" status: 204 len: 0 microversion: 2.1 time: 0.319002 Jul 18 03:03:42.053572 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3016/6013] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:03:41 2022] DELETE /compute/v2.1/servers/ff755b33-da10-4e1a-9734-309196902bbf => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:03:42.068921 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b3f66317-cd49-4763-a1f1-47cc79ecc2b6 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:42.071240 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b3f66317-cd49-4763-a1f1-47cc79ecc2b6 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: ff755b33-da10-4e1a-9734-309196902bbf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:42.084746 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b3f66317-cd49-4763-a1f1-47cc79ecc2b6 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:42.087806 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b3f66317-cd49-4763-a1f1-47cc79ecc2b6 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:42.089607 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b3f66317-cd49-4763-a1f1-47cc79ecc2b6 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:42.090964 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b3f66317-cd49-4763-a1f1-47cc79ecc2b6 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:42.110843 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d0b104a1-b86f-4167-9f35-2993c5856590 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:42.137023 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d0b104a1-b86f-4167-9f35-2993c5856590 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51" status: 200 len: 1308 microversion: 2.1 time: 0.434787 Jul 18 03:03:42.139380 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2998/6014] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:41 2022] GET /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51 => generated 1308 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:03:42.150013 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-5bc38390-447a-4ba7-8b0f-a57ee57c01b4 req-f0fabfab-c514-4888-9d17-cffd274b0740 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ecffdfb-225e-4bda-95e7-606ec4f5cb4e", "tag": "db3e621e-c1d9-4896-bda5-23d0f92165e3"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:03:42.166042 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-5bc38390-447a-4ba7-8b0f-a57ee57c01b4 req-f0fabfab-c514-4888-9d17-cffd274b0740 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:42.167170 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-5bc38390-447a-4ba7-8b0f-a57ee57c01b4 req-f0fabfab-c514-4888-9d17-cffd274b0740 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:42.211616 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-5bc38390-447a-4ba7-8b0f-a57ee57c01b4 req-f0fabfab-c514-4888-9d17-cffd274b0740 service nova] Creating event network-changed:db3e621e-c1d9-4896-bda5-23d0f92165e3 for instance 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e on n-h2-465891-3 Jul 18 03:03:42.222624 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-5bc38390-447a-4ba7-8b0f-a57ee57c01b4 req-f0fabfab-c514-4888-9d17-cffd274b0740 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080754 Jul 18 03:03:42.224364 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 2999/6015] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:03:42.392210 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b3f66317-cd49-4763-a1f1-47cc79ecc2b6 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/ff755b33-da10-4e1a-9734-309196902bbf" status: 200 len: 1655 microversion: 2.1 time: 0.334355 Jul 18 03:03:42.395571 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3017/6016] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:42 2022] GET /compute/v2.1/servers/ff755b33-da10-4e1a-9734-309196902bbf => generated 1655 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:42.475234 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8beace7a-d0c3-4e71-8399-707f2cfe5422 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:42.477227 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8beace7a-d0c3-4e71-8399-707f2cfe5422 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:42.491300 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8beace7a-d0c3-4e71-8399-707f2cfe5422 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:42.492760 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8beace7a-d0c3-4e71-8399-707f2cfe5422 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:42.494782 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8beace7a-d0c3-4e71-8399-707f2cfe5422 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:42.496569 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8beace7a-d0c3-4e71-8399-707f2cfe5422 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:42.896541 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8beace7a-d0c3-4e71-8399-707f2cfe5422 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:42.910852 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8beace7a-d0c3-4e71-8399-707f2cfe5422 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e" status: 200 len: 1577 microversion: 2.1 time: 0.452727 Jul 18 03:03:42.919024 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3000/6017] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:42 2022] GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e => generated 1577 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:43.161664 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2ed223db-731c-4cae-98d1-68be1d6e178b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:43.163013 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2ed223db-731c-4cae-98d1-68be1d6e178b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 854b9c4e-a7a6-401c-afff-8670379eea51] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:43.178349 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:03:43.188814 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:03:43.216188 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2ed223db-731c-4cae-98d1-68be1d6e178b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:43.217157 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2ed223db-731c-4cae-98d1-68be1d6e178b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:43.218057 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2ed223db-731c-4cae-98d1-68be1d6e178b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:43.219138 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2ed223db-731c-4cae-98d1-68be1d6e178b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:43.425069 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c8edf765-ce95-4b7f-b313-e30151f58548 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:43.426900 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c8edf765-ce95-4b7f-b313-e30151f58548 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: ff755b33-da10-4e1a-9734-309196902bbf] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:43.429358 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:03:43.455056 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c8edf765-ce95-4b7f-b313-e30151f58548 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:43.455525 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c8edf765-ce95-4b7f-b313-e30151f58548 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:43.461823 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c8edf765-ce95-4b7f-b313-e30151f58548 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:43.462042 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c8edf765-ce95-4b7f-b313-e30151f58548 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:43.807454 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2ed223db-731c-4cae-98d1-68be1d6e178b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:43.819514 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2ed223db-731c-4cae-98d1-68be1d6e178b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51" status: 200 len: 1308 microversion: 2.1 time: 0.665930 Jul 18 03:03:43.828213 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3018/6018] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:43 2022] GET /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51 => generated 1308 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:43.936934 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-845130b2-b8b0-4152-98ae-e1025a4851e6 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:43.937566 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-845130b2-b8b0-4152-98ae-e1025a4851e6 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:43.959530 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c8edf765-ce95-4b7f-b313-e30151f58548 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/ff755b33-da10-4e1a-9734-309196902bbf" status: 200 len: 1655 microversion: 2.1 time: 0.539654 Jul 18 03:03:43.973195 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3001/6019] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:43 2022] GET /compute/v2.1/servers/ff755b33-da10-4e1a-9734-309196902bbf => generated 1655 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:43.978640 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-845130b2-b8b0-4152-98ae-e1025a4851e6 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:43.979744 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-845130b2-b8b0-4152-98ae-e1025a4851e6 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:43.980873 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-845130b2-b8b0-4152-98ae-e1025a4851e6 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:43.983786 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-845130b2-b8b0-4152-98ae-e1025a4851e6 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:44.368889 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-845130b2-b8b0-4152-98ae-e1025a4851e6 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:44.380057 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-845130b2-b8b0-4152-98ae-e1025a4851e6 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e" status: 200 len: 1577 microversion: 2.1 time: 0.447052 Jul 18 03:03:44.380945 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3019/6020] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:43 2022] GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e => generated 1577 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:44.672624 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-548137fd-f937-4b76-a4b0-38df97900c95 req-912791c5-062c-4191-87d4-1afa8b84b249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ecffdfb-225e-4bda-95e7-606ec4f5cb4e", "name": "network-vif-deleted", "tag": "db3e621e-c1d9-4896-bda5-23d0f92165e3"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:03:44.712657 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-548137fd-f937-4b76-a4b0-38df97900c95 req-912791c5-062c-4191-87d4-1afa8b84b249 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:44.714558 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-548137fd-f937-4b76-a4b0-38df97900c95 req-912791c5-062c-4191-87d4-1afa8b84b249 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:44.803798 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-548137fd-f937-4b76-a4b0-38df97900c95 req-912791c5-062c-4191-87d4-1afa8b84b249 service nova] Creating event network-vif-deleted:db3e621e-c1d9-4896-bda5-23d0f92165e3 for instance 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e on n-h2-465891-3 Jul 18 03:03:44.832262 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-548137fd-f937-4b76-a4b0-38df97900c95 req-912791c5-062c-4191-87d4-1afa8b84b249 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165413 Jul 18 03:03:44.838696 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3002/6021] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:03:44.843311 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ae22f8af-6b99-4a5a-bb4c-52c0a5909812 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:44.849506 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ae22f8af-6b99-4a5a-bb4c-52c0a5909812 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 854b9c4e-a7a6-401c-afff-8670379eea51] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:44.884235 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ae22f8af-6b99-4a5a-bb4c-52c0a5909812 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:44.887817 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ae22f8af-6b99-4a5a-bb4c-52c0a5909812 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:44.891651 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ae22f8af-6b99-4a5a-bb4c-52c0a5909812 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:44.892698 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ae22f8af-6b99-4a5a-bb4c-52c0a5909812 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:44.906594 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:03:44.986794 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3d49e92e-3b6d-40d6-86ff-d62661a54e33 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:44.989418 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3d49e92e-3b6d-40d6-86ff-d62661a54e33 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: ff755b33-da10-4e1a-9734-309196902bbf] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:45.068775 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3d49e92e-3b6d-40d6-86ff-d62661a54e33 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:45.072296 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3d49e92e-3b6d-40d6-86ff-d62661a54e33 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:45.077982 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3d49e92e-3b6d-40d6-86ff-d62661a54e33 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:45.080923 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3d49e92e-3b6d-40d6-86ff-d62661a54e33 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:45.963872 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ae22f8af-6b99-4a5a-bb4c-52c0a5909812 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:45.980002 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ae22f8af-6b99-4a5a-bb4c-52c0a5909812 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51" status: 200 len: 1308 microversion: 2.1 time: 1.145712 Jul 18 03:03:45.980933 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3020/6022] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:44 2022] GET /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51 => generated 1308 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:45.993199 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1360d01a-739a-44c3-8503-6407dd9c3d3e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:45.994540 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1360d01a-739a-44c3-8503-6407dd9c3d3e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:46.013088 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1360d01a-739a-44c3-8503-6407dd9c3d3e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:46.013924 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1360d01a-739a-44c3-8503-6407dd9c3d3e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:46.015079 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1360d01a-739a-44c3-8503-6407dd9c3d3e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:46.017979 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1360d01a-739a-44c3-8503-6407dd9c3d3e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:46.132652 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1360d01a-739a-44c3-8503-6407dd9c3d3e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:46.149197 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1360d01a-739a-44c3-8503-6407dd9c3d3e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e" status: 200 len: 1224 microversion: 2.1 time: 0.165519 Jul 18 03:03:46.154103 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3021/6023] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:45 2022] GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e => generated 1224 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:46.271205 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3d49e92e-3b6d-40d6-86ff-d62661a54e33 tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/ff755b33-da10-4e1a-9734-309196902bbf" status: 200 len: 1655 microversion: 2.1 time: 1.295874 Jul 18 03:03:46.273235 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3003/6024] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:44 2022] GET /compute/v2.1/servers/ff755b33-da10-4e1a-9734-309196902bbf => generated 1655 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:46.900395 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-b8d3143c-7297-4f74-8a72-71dce297791b req-7b750348-b0a4-4023-be5d-ef6254d4be77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff755b33-da10-4e1a-9734-309196902bbf", "name": "network-vif-deleted", "tag": "1d21bff2-3efe-40b5-b253-5556053a613d"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:03:46.917047 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-b8d3143c-7297-4f74-8a72-71dce297791b req-7b750348-b0a4-4023-be5d-ef6254d4be77 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:46.917983 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-b8d3143c-7297-4f74-8a72-71dce297791b req-7b750348-b0a4-4023-be5d-ef6254d4be77 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:46.947922 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-b8d3143c-7297-4f74-8a72-71dce297791b req-7b750348-b0a4-4023-be5d-ef6254d4be77 service nova] Creating event network-vif-deleted:1d21bff2-3efe-40b5-b253-5556053a613d for instance ff755b33-da10-4e1a-9734-309196902bbf on n-h1-465891-3 Jul 18 03:03:46.957448 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-b8d3143c-7297-4f74-8a72-71dce297791b req-7b750348-b0a4-4023-be5d-ef6254d4be77 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068259 Jul 18 03:03:46.963955 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3022/6025] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:03:47.016204 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6470ccdd-33eb-4b96-a3ee-b22387498065 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:47.017901 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6470ccdd-33eb-4b96-a3ee-b22387498065 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 854b9c4e-a7a6-401c-afff-8670379eea51] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:47.033016 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6470ccdd-33eb-4b96-a3ee-b22387498065 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:47.035917 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6470ccdd-33eb-4b96-a3ee-b22387498065 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:47.037949 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6470ccdd-33eb-4b96-a3ee-b22387498065 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:47.039350 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6470ccdd-33eb-4b96-a3ee-b22387498065 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:47.092316 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-f548f543-1998-4e64-8ff4-9d4c727550af req-90d5e9ec-059e-4b29-9a43-f2dc4c89b6d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "854b9c4e-a7a6-401c-afff-8670379eea51", "name": "network-vif-plugged", "status": "completed", "tag": "75ce3446-93dc-404e-8d32-46f7a3b3be61"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:03:47.104180 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-f548f543-1998-4e64-8ff4-9d4c727550af req-90d5e9ec-059e-4b29-9a43-f2dc4c89b6d7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:47.104946 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-f548f543-1998-4e64-8ff4-9d4c727550af req-90d5e9ec-059e-4b29-9a43-f2dc4c89b6d7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:47.118943 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-f548f543-1998-4e64-8ff4-9d4c727550af req-90d5e9ec-059e-4b29-9a43-f2dc4c89b6d7 service nova] Creating event network-vif-plugged:75ce3446-93dc-404e-8d32-46f7a3b3be61 for instance 854b9c4e-a7a6-401c-afff-8670379eea51 on n-h1-465891-3 Jul 18 03:03:47.125605 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-f548f543-1998-4e64-8ff4-9d4c727550af req-90d5e9ec-059e-4b29-9a43-f2dc4c89b6d7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037634 Jul 18 03:03:47.126759 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3023/6026] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:03:47.192093 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-08a95c41-cb49-48ab-9bee-4428261b722a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:47.194359 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-08a95c41-cb49-48ab-9bee-4428261b722a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:47.204794 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-08a95c41-cb49-48ab-9bee-4428261b722a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:47.205936 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-08a95c41-cb49-48ab-9bee-4428261b722a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:47.208050 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-08a95c41-cb49-48ab-9bee-4428261b722a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:47.209272 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-08a95c41-cb49-48ab-9bee-4428261b722a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:47.446158 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-08a95c41-cb49-48ab-9bee-4428261b722a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:47.465877 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-08a95c41-cb49-48ab-9bee-4428261b722a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e" status: 200 len: 1224 microversion: 2.1 time: 0.282256 Jul 18 03:03:47.470926 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3024/6027] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:47 2022] GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e => generated 1224 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:47.493192 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-352c64a7-fd2b-411f-a31d-1b769c587d0a tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:47.495799 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-352c64a7-fd2b-411f-a31d-1b769c587d0a tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] [instance: ff755b33-da10-4e1a-9734-309196902bbf] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:47.507006 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-352c64a7-fd2b-411f-a31d-1b769c587d0a tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:47.508384 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-352c64a7-fd2b-411f-a31d-1b769c587d0a tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:47.509401 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-352c64a7-fd2b-411f-a31d-1b769c587d0a tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:47.524132 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-352c64a7-fd2b-411f-a31d-1b769c587d0a tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:47.564284 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-352c64a7-fd2b-411f-a31d-1b769c587d0a tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] HTTP exception thrown: Instance ff755b33-da10-4e1a-9734-309196902bbf could not be found. Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-352c64a7-fd2b-411f-a31d-1b769c587d0a tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Request method failure captured: Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/ff755b33-da10-4e1a-9734-309196902bbf HTTP/1.1 Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1M1fkflfZPZFznSZ2kohtLsFUAMmThk6EPzuoWTYQ3iP-VGXzXP0ZD3FIPyNSTzHXwEOG3iknaZJMVsqaIMSUsw0X6CypYvnRobC6Qvf3R3RpdcuzvxcDpZgc1CRNbJe95GJuBexqr1z017pj6dkBJrIpAqpekBRukbUqusiWk-dRMg Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 91218185fc774f2bb420f8cbf8dead9e Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-TestServerMultinode-1381280515 Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,admin,reader Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,admin,reader Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_91218185fc774f2bb420f8cbf8dead9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/91218185fc774f2bb420f8cbf8dead9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/91218185fc774f2bb420f8cbf8dead9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/91218185fc774f2bb420f8cbf8dead9e"}]}] Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-TestServerMultinode-1381280515 Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 91218185fc774f2bb420f8cbf8dead9e Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-TestServerMultinode-1381280515 Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-TestServerMultinode-1381280515-project-admin Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: e3abc7c13a81413caf400dd4fd3fa649 Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-TestServerMultinode-1381280515-project-admin Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance ff755b33-da10-4e1a-9734-309196902bbf could not be found. Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'ff755b33-da10-4e1a-9734-309196902bbf'} Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff755b33-da10-4e1a-9734-309196902bbf could not be found. Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff755b33-da10-4e1a-9734-309196902bbf could not be found. Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:03:47.567935 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:03:47.573548 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:03:47.573548 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:03:47.573548 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:03:47.573548 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:03:47.573548 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:03:47.573548 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff755b33-da10-4e1a-9734-309196902bbf could not be found. Jul 18 03:03:47.573548 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:03:47.575559 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-352c64a7-fd2b-411f-a31d-1b769c587d0a tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] Returning 404 to user: Instance ff755b33-da10-4e1a-9734-309196902bbf could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:03:47.577904 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-352c64a7-fd2b-411f-a31d-1b769c587d0a tempest-TestServerMultinode-1381280515 tempest-TestServerMultinode-1381280515-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/ff755b33-da10-4e1a-9734-309196902bbf" status: 404 len: 111 microversion: 2.1 time: 0.104992 Jul 18 03:03:47.579283 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3025/6028] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:47 2022] GET /compute/v2.1/servers/ff755b33-da10-4e1a-9734-309196902bbf => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:03:47.668206 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6470ccdd-33eb-4b96-a3ee-b22387498065 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:47.678383 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6470ccdd-33eb-4b96-a3ee-b22387498065 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51" status: 200 len: 1308 microversion: 2.1 time: 0.669730 Jul 18 03:03:47.690174 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3004/6029] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:47 2022] GET /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51 => generated 1308 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:48.493608 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2be7ab2f-7a9a-46df-8474-fc0562bc7f1e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:48.494938 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2be7ab2f-7a9a-46df-8474-fc0562bc7f1e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:48.506838 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2be7ab2f-7a9a-46df-8474-fc0562bc7f1e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:48.506838 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2be7ab2f-7a9a-46df-8474-fc0562bc7f1e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:48.507238 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2be7ab2f-7a9a-46df-8474-fc0562bc7f1e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:48.507437 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2be7ab2f-7a9a-46df-8474-fc0562bc7f1e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:48.713932 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6c07ece1-f856-4413-80c0-659b294caefe tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:48.715303 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6c07ece1-f856-4413-80c0-659b294caefe tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 854b9c4e-a7a6-401c-afff-8670379eea51] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:48.718790 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:03:48.746112 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6c07ece1-f856-4413-80c0-659b294caefe tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:48.746945 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6c07ece1-f856-4413-80c0-659b294caefe tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:48.747988 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6c07ece1-f856-4413-80c0-659b294caefe tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:48.748625 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6c07ece1-f856-4413-80c0-659b294caefe tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:48.787923 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2be7ab2f-7a9a-46df-8474-fc0562bc7f1e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:48.803568 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2be7ab2f-7a9a-46df-8474-fc0562bc7f1e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e" status: 200 len: 1224 microversion: 2.1 time: 0.319617 Jul 18 03:03:48.806245 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3026/6030] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:48 2022] GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e => generated 1224 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:49.154430 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6c07ece1-f856-4413-80c0-659b294caefe tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:49.166248 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6c07ece1-f856-4413-80c0-659b294caefe tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51" status: 200 len: 1308 microversion: 2.1 time: 0.457300 Jul 18 03:03:49.168461 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3005/6031] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:48 2022] GET /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51 => generated 1308 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:49.833761 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4866e048-8e71-4318-afad-5b26c172d69f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:49.836061 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4866e048-8e71-4318-afad-5b26c172d69f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:49.890675 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4866e048-8e71-4318-afad-5b26c172d69f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:49.891580 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4866e048-8e71-4318-afad-5b26c172d69f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:49.898030 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4866e048-8e71-4318-afad-5b26c172d69f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:49.899274 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4866e048-8e71-4318-afad-5b26c172d69f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:50.104741 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4866e048-8e71-4318-afad-5b26c172d69f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:50.126587 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4866e048-8e71-4318-afad-5b26c172d69f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e" status: 200 len: 1224 microversion: 2.1 time: 0.306519 Jul 18 03:03:50.139761 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3027/6032] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:49 2022] GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e => generated 1224 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:50.203425 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fca09932-d428-4011-b618-23bf798e07da tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:50.204184 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fca09932-d428-4011-b618-23bf798e07da tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 854b9c4e-a7a6-401c-afff-8670379eea51] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:50.218615 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fca09932-d428-4011-b618-23bf798e07da tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:50.219701 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fca09932-d428-4011-b618-23bf798e07da tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:50.229300 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fca09932-d428-4011-b618-23bf798e07da tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:50.230550 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fca09932-d428-4011-b618-23bf798e07da tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:50.791801 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fca09932-d428-4011-b618-23bf798e07da tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:50.841732 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fca09932-d428-4011-b618-23bf798e07da tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51" status: 200 len: 1488 microversion: 2.1 time: 0.638223 Jul 18 03:03:50.867496 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3006/6033] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:50 2022] GET /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51 => generated 1488 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:50.874793 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-56190fba-28e4-4000-8f16-002438d446b4 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:50.890086 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-56190fba-28e4-4000-8f16-002438d446b4 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 8cc40222-82fc-4d28-bce8-e754679126ab] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:50.933333 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56190fba-28e4-4000-8f16-002438d446b4 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:50.934335 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56190fba-28e4-4000-8f16-002438d446b4 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:50.935580 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56190fba-28e4-4000-8f16-002438d446b4 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:50.936567 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56190fba-28e4-4000-8f16-002438d446b4 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:51.165207 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-95515e52-032a-4bd1-a284-665698d0bfca tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:51.166745 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-95515e52-032a-4bd1-a284-665698d0bfca tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:51.181822 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-95515e52-032a-4bd1-a284-665698d0bfca tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:51.187116 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-95515e52-032a-4bd1-a284-665698d0bfca tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:51.188301 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-95515e52-032a-4bd1-a284-665698d0bfca tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:51.188948 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-95515e52-032a-4bd1-a284-665698d0bfca tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:52.381121 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-95515e52-032a-4bd1-a284-665698d0bfca tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:52.383998 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-56190fba-28e4-4000-8f16-002438d446b4 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:52.401119 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-56190fba-28e4-4000-8f16-002438d446b4 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/8cc40222-82fc-4d28-bce8-e754679126ab" status: 200 len: 1489 microversion: 2.1 time: 1.536761 Jul 18 03:03:52.401803 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3028/6034] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:50 2022] GET /compute/v2.1/servers/8cc40222-82fc-4d28-bce8-e754679126ab => generated 1489 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:52.436538 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9cbca336-ef64-407d-b8d9-ad021a7e785e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:52.438634 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9cbca336-ef64-407d-b8d9-ad021a7e785e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 854b9c4e-a7a6-401c-afff-8670379eea51] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:52.440352 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-95515e52-032a-4bd1-a284-665698d0bfca tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e" status: 200 len: 1224 microversion: 2.1 time: 1.283451 Jul 18 03:03:52.446418 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3007/6035] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:51 2022] GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e => generated 1224 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:52.466516 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9cbca336-ef64-407d-b8d9-ad021a7e785e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:52.466990 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9cbca336-ef64-407d-b8d9-ad021a7e785e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:52.473858 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9cbca336-ef64-407d-b8d9-ad021a7e785e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:52.474502 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9cbca336-ef64-407d-b8d9-ad021a7e785e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:53.140801 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9cbca336-ef64-407d-b8d9-ad021a7e785e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:53.183373 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9cbca336-ef64-407d-b8d9-ad021a7e785e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51" status: 200 len: 1488 microversion: 2.1 time: 0.757529 Jul 18 03:03:53.185234 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3029/6036] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:52 2022] GET /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51 => generated 1488 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:03:53.216566 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e2476fc7-1055-4259-a764-0dea1398c3cd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:53.217834 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e2476fc7-1055-4259-a764-0dea1398c3cd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 854b9c4e-a7a6-401c-afff-8670379eea51] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:53.251609 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e2476fc7-1055-4259-a764-0dea1398c3cd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:53.252707 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e2476fc7-1055-4259-a764-0dea1398c3cd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:53.259151 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e2476fc7-1055-4259-a764-0dea1398c3cd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:53.263821 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e2476fc7-1055-4259-a764-0dea1398c3cd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:53.419585 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e2476fc7-1055-4259-a764-0dea1398c3cd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 854b9c4e-a7a6-401c-afff-8670379eea51] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:03:53.482976 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fd0c9543-b378-4083-a110-3a3a19f84c47 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:53.488381 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fd0c9543-b378-4083-a110-3a3a19f84c47 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:53.546438 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fd0c9543-b378-4083-a110-3a3a19f84c47 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:53.548315 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fd0c9543-b378-4083-a110-3a3a19f84c47 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:53.555493 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fd0c9543-b378-4083-a110-3a3a19f84c47 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:53.563719 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fd0c9543-b378-4083-a110-3a3a19f84c47 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:53.826733 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e2476fc7-1055-4259-a764-0dea1398c3cd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "DELETE /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51" status: 204 len: 0 microversion: 2.1 time: 0.626347 Jul 18 03:03:53.829290 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3008/6037] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:03:53 2022] DELETE /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:03:53.846852 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b5dd2323-ba1f-4b17-b341-562f3ddb274a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:53.850172 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b5dd2323-ba1f-4b17-b341-562f3ddb274a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 854b9c4e-a7a6-401c-afff-8670379eea51] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:53.878100 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b5dd2323-ba1f-4b17-b341-562f3ddb274a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:53.879450 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b5dd2323-ba1f-4b17-b341-562f3ddb274a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:53.881264 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b5dd2323-ba1f-4b17-b341-562f3ddb274a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:53.882591 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b5dd2323-ba1f-4b17-b341-562f3ddb274a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:54.028771 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fd0c9543-b378-4083-a110-3a3a19f84c47 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:54.047803 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fd0c9543-b378-4083-a110-3a3a19f84c47 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e" status: 200 len: 1224 microversion: 2.1 time: 0.572963 Jul 18 03:03:54.066130 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3030/6038] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:53 2022] GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e => generated 1224 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:54.480675 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b5dd2323-ba1f-4b17-b341-562f3ddb274a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:54.502573 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b5dd2323-ba1f-4b17-b341-562f3ddb274a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51" status: 200 len: 1494 microversion: 2.1 time: 0.666752 Jul 18 03:03:54.518736 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3009/6039] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:53 2022] GET /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51 => generated 1494 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:55.069741 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-18d30bf8-4cb4-4a3c-a9be-7f2f56352b7d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:55.071046 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-18d30bf8-4cb4-4a3c-a9be-7f2f56352b7d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:55.095259 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-18d30bf8-4cb4-4a3c-a9be-7f2f56352b7d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:55.095730 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-18d30bf8-4cb4-4a3c-a9be-7f2f56352b7d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:55.097046 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-18d30bf8-4cb4-4a3c-a9be-7f2f56352b7d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:55.097883 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-18d30bf8-4cb4-4a3c-a9be-7f2f56352b7d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:55.181170 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-18d30bf8-4cb4-4a3c-a9be-7f2f56352b7d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:55.181663 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-18d30bf8-4cb4-4a3c-a9be-7f2f56352b7d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:55.182369 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-18d30bf8-4cb4-4a3c-a9be-7f2f56352b7d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lazy-loading 'fault' on Instance uuid 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:03:55.339676 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-18d30bf8-4cb4-4a3c-a9be-7f2f56352b7d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:55.355747 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-18d30bf8-4cb4-4a3c-a9be-7f2f56352b7d tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e" status: 200 len: 1183 microversion: 2.1 time: 0.293660 Jul 18 03:03:55.356723 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3031/6040] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:55 2022] GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e => generated 1183 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:55.527995 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cd695300-3e17-4847-bc4e-abd21b9b0fac tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:55.530081 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cd695300-3e17-4847-bc4e-abd21b9b0fac tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 854b9c4e-a7a6-401c-afff-8670379eea51] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:55.566764 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cd695300-3e17-4847-bc4e-abd21b9b0fac tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:55.570609 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cd695300-3e17-4847-bc4e-abd21b9b0fac tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:55.574165 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cd695300-3e17-4847-bc4e-abd21b9b0fac tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:55.575115 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cd695300-3e17-4847-bc4e-abd21b9b0fac tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:56.131494 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-cd695300-3e17-4847-bc4e-abd21b9b0fac tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:56.163852 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cd695300-3e17-4847-bc4e-abd21b9b0fac tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51" status: 200 len: 1494 microversion: 2.1 time: 0.644250 Jul 18 03:03:56.167746 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3010/6041] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:55 2022] GET /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51 => generated 1494 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:56.374655 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dab51672-110b-4e55-8db4-797cd1e50543 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:56.375218 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-dab51672-110b-4e55-8db4-797cd1e50543 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:56.390544 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dab51672-110b-4e55-8db4-797cd1e50543 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:56.391435 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dab51672-110b-4e55-8db4-797cd1e50543 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:56.392948 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dab51672-110b-4e55-8db4-797cd1e50543 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:56.393853 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dab51672-110b-4e55-8db4-797cd1e50543 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:56.428133 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-dab51672-110b-4e55-8db4-797cd1e50543 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] HTTP exception thrown: Instance 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e could not be found. Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dab51672-110b-4e55-8db4-797cd1e50543 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Request method failure captured: Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e HTTP/1.1 Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MliWHzVx10oBgzg24taGfvPF1POfFT53P2_RlSdFLebnrvIbeAs5qvjZ1EAd9Fni5RvXZYA8fjgna7ooKOtwOz_kbJVpuNazgX6TlGzOYOFYf5fy5vfDN_5wwJEwayQdbLz2BaqgZyDtVrhp2skZQbTuh-KNZeRA8bkIRl3oXepO1E Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 2b7654e273f6487ba83382da4f96056d Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-TestVolumeBootPattern-598001453 Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2b7654e273f6487ba83382da4f96056d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2b7654e273f6487ba83382da4f96056d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2b7654e273f6487ba83382da4f96056d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2b7654e273f6487ba83382da4f96056d"}]}] Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-TestVolumeBootPattern-598001453 Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 2b7654e273f6487ba83382da4f96056d Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-TestVolumeBootPattern-598001453 Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-TestVolumeBootPattern-598001453-project Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: d1afc1702f8045a396b98e5c24b124e7 Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-TestVolumeBootPattern-598001453-project Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e could not be found. Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '3ecffdfb-225e-4bda-95e7-606ec4f5cb4e'} Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e could not be found. Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e could not be found. Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:03:56.433660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:03:56.442862 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:03:56.442862 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:03:56.442862 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:03:56.442862 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:03:56.442862 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:03:56.442862 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e could not be found. Jul 18 03:03:56.442862 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:03:56.447483 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dab51672-110b-4e55-8db4-797cd1e50543 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Returning 404 to user: Instance 3ecffdfb-225e-4bda-95e7-606ec4f5cb4e could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:03:56.449471 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-dab51672-110b-4e55-8db4-797cd1e50543 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e" status: 404 len: 111 microversion: 2.1 time: 0.080042 Jul 18 03:03:56.451329 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3032/6042] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:56 2022] GET /compute/v2.1/servers/3ecffdfb-225e-4bda-95e7-606ec4f5cb4e => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:03:56.575615 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-82d7d4f9-a8b7-4c55-ab52-1780fc59138c tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:03:56.576602 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-82d7d4f9-a8b7-4c55-ab52-1780fc59138c tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: e4c72b14-0ad7-453f-9718-3ed2f911c889] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:56.593611 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-82d7d4f9-a8b7-4c55-ab52-1780fc59138c tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:56.594124 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-82d7d4f9-a8b7-4c55-ab52-1780fc59138c tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:56.594950 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-82d7d4f9-a8b7-4c55-ab52-1780fc59138c tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:56.595393 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-82d7d4f9-a8b7-4c55-ab52-1780fc59138c tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:56.664485 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-82d7d4f9-a8b7-4c55-ab52-1780fc59138c tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "POST /compute/v2.1/servers/e4c72b14-0ad7-453f-9718-3ed2f911c889/action" status: 200 len: 24571 microversion: 2.1 time: 0.093350 Jul 18 03:03:56.665870 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3011/6043] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:03:56 2022] POST /compute/v2.1/servers/e4c72b14-0ad7-453f-9718-3ed2f911c889/action => generated 24571 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 03:03:57.009843 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-563caf71-57dd-4c29-98c4-e86b18846475 req-de6d82c0-5dc3-4af9-b5f4-4f23f6ba0182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "854b9c4e-a7a6-401c-afff-8670379eea51", "name": "network-vif-deleted", "tag": "75ce3446-93dc-404e-8d32-46f7a3b3be61"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:03:57.031679 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-563caf71-57dd-4c29-98c4-e86b18846475 req-de6d82c0-5dc3-4af9-b5f4-4f23f6ba0182 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:57.033644 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-563caf71-57dd-4c29-98c4-e86b18846475 req-de6d82c0-5dc3-4af9-b5f4-4f23f6ba0182 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:57.071316 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-563caf71-57dd-4c29-98c4-e86b18846475 req-de6d82c0-5dc3-4af9-b5f4-4f23f6ba0182 service nova] Creating event network-vif-deleted:75ce3446-93dc-404e-8d32-46f7a3b3be61 for instance 854b9c4e-a7a6-401c-afff-8670379eea51 on n-h1-465891-3 Jul 18 03:03:57.120704 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-563caf71-57dd-4c29-98c4-e86b18846475 req-de6d82c0-5dc3-4af9-b5f4-4f23f6ba0182 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120262 Jul 18 03:03:57.128183 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3033/6044] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:03:57.200387 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d58d3946-b58a-497c-8533-7cb9daa1fb46 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:57.211779 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d58d3946-b58a-497c-8533-7cb9daa1fb46 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 854b9c4e-a7a6-401c-afff-8670379eea51] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:57.241822 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d58d3946-b58a-497c-8533-7cb9daa1fb46 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:57.245363 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d58d3946-b58a-497c-8533-7cb9daa1fb46 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:57.255059 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d58d3946-b58a-497c-8533-7cb9daa1fb46 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:57.256014 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d58d3946-b58a-497c-8533-7cb9daa1fb46 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:57.364720 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d58d3946-b58a-497c-8533-7cb9daa1fb46 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:57.365593 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d58d3946-b58a-497c-8533-7cb9daa1fb46 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:57.366748 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-d58d3946-b58a-497c-8533-7cb9daa1fb46 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lazy-loading 'fault' on Instance uuid 854b9c4e-a7a6-401c-afff-8670379eea51 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:03:57.514162 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d58d3946-b58a-497c-8533-7cb9daa1fb46 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:57.536997 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d58d3946-b58a-497c-8533-7cb9daa1fb46 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51" status: 200 len: 1298 microversion: 2.1 time: 0.354264 Jul 18 03:03:57.538976 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3034/6045] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:57 2022] GET /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51 => generated 1298 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:57.720900 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6c7b5763-6134-4015-8fa0-2332898863e9 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Action: 'create', calling method: .version_select at 0x7ff4a831ddc0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1290381689", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrhqeQms+AeH5QHSFz276RRlvj8h5ry0Tb2nbZDwdGKp4f+yEajE3ox64XzBPNl7yVr85ik0IsxgX3bZCti0Z+1yI79SQ1TxCf8lXyGgrXvWYf+kMJ1vS9LH4C43j89hA=="}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:03:57.766100 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-6c7b5763-6134-4015-8fa0-2332898863e9 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Getting quotas for project 18601269ae5c48409ca994cb7d410213. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:03:57.797730 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-6c7b5763-6134-4015-8fa0-2332898863e9 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Getting quotas for user b292cd0f2ac2413babe9e9aa482d0c0b and project 18601269ae5c48409ca994cb7d410213. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:03:57.860699 n-d-465891-3 devstack@n-api.service[119544]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6c7b5763-6134-4015-8fa0-2332898863e9 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] [9b614394-4ee4-4928-af3b-503f636175bf] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 03:03:58.563967 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-31251085-c993-4443-893e-b79f06123925 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:58.564823 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-31251085-c993-4443-893e-b79f06123925 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 854b9c4e-a7a6-401c-afff-8670379eea51] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:58.576513 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-31251085-c993-4443-893e-b79f06123925 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:58.577305 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-31251085-c993-4443-893e-b79f06123925 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:58.578372 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-31251085-c993-4443-893e-b79f06123925 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:58.579044 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-31251085-c993-4443-893e-b79f06123925 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:58.597080 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-31251085-c993-4443-893e-b79f06123925 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] HTTP exception thrown: Instance 854b9c4e-a7a6-401c-afff-8670379eea51 could not be found. Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-31251085-c993-4443-893e-b79f06123925 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Request method failure captured: Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51 HTTP/1.1 Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1M0c--VxkhAcA4gIHXxijKFI-k8Bpror72Hk1qb235rYnfDmQTByX9LOOCSekEaTY-qK46fTc9MDDZBpaIS7PRARBL52HY7fvnzNvoh5YO0XpJvHbsKLywLFoe1R8EGrLF6lPIQIdQdkEzZxbEDXhePA7F15YYp44S7QRWnysLrh4M4 Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3a83c4dedef341a0bb50fa4c119d3035"}]}] Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersTestJSON-1250523732 Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersTestJSON-1250523732-project Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 785ff643c00746939bb0fecd775ce920 Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersTestJSON-1250523732-project Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 854b9c4e-a7a6-401c-afff-8670379eea51 could not be found. Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '854b9c4e-a7a6-401c-afff-8670379eea51'} Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 854b9c4e-a7a6-401c-afff-8670379eea51 could not be found. Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 854b9c4e-a7a6-401c-afff-8670379eea51 could not be found. Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:03:58.599237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:03:58.604602 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:03:58.604602 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:03:58.604602 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:03:58.604602 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:03:58.604602 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 854b9c4e-a7a6-401c-afff-8670379eea51 could not be found. Jul 18 03:03:58.604602 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:03:58.606487 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-31251085-c993-4443-893e-b79f06123925 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Returning 404 to user: Instance 854b9c4e-a7a6-401c-afff-8670379eea51 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:03:58.607429 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-31251085-c993-4443-893e-b79f06123925 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51" status: 404 len: 111 microversion: 2.1 time: 0.055361 Jul 18 03:03:58.611688 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3035/6046] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:58 2022] GET /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:03:58.617917 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-80aef965-a9db-4631-9410-69019cf66c68 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:58.618438 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-80aef965-a9db-4631-9410-69019cf66c68 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 8cc40222-82fc-4d28-bce8-e754679126ab] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:58.625928 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-80aef965-a9db-4631-9410-69019cf66c68 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:58.626585 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-80aef965-a9db-4631-9410-69019cf66c68 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:58.627431 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-80aef965-a9db-4631-9410-69019cf66c68 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:58.627891 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-80aef965-a9db-4631-9410-69019cf66c68 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:58.706270 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-80aef965-a9db-4631-9410-69019cf66c68 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 8cc40222-82fc-4d28-bce8-e754679126ab] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:03:58.871233 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [None req-6c7b5763-6134-4015-8fa0-2332898863e9 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] [9b614394-4ee4-4928-af3b-503f636175bf] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 45374. Jul 18 03:03:58.903095 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6c7b5763-6134-4015-8fa0-2332898863e9 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.820080 Jul 18 03:03:58.911409 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3012/6047] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 03:03:57 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1829 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:03:58.951157 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-80aef965-a9db-4631-9410-69019cf66c68 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8cc40222-82fc-4d28-bce8-e754679126ab" status: 204 len: 0 microversion: 2.1 time: 0.337392 Jul 18 03:03:58.956858 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3036/6048] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:03:58 2022] DELETE /compute/v2.1/servers/8cc40222-82fc-4d28-bce8-e754679126ab => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:03:58.966885 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5b00d851-ce26-4318-b27f-844e4e84b44b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:58.972813 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5b00d851-ce26-4318-b27f-844e4e84b44b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 8cc40222-82fc-4d28-bce8-e754679126ab] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:59.010426 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5b00d851-ce26-4318-b27f-844e4e84b44b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:59.030090 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5b00d851-ce26-4318-b27f-844e4e84b44b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:59.031720 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5b00d851-ce26-4318-b27f-844e4e84b44b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:59.033783 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5b00d851-ce26-4318-b27f-844e4e84b44b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:59.525864 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5b00d851-ce26-4318-b27f-844e4e84b44b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:59.544720 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5b00d851-ce26-4318-b27f-844e4e84b44b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/8cc40222-82fc-4d28-bce8-e754679126ab" status: 200 len: 1495 microversion: 2.1 time: 0.584777 Jul 18 03:03:59.559083 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3013/6049] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:58 2022] GET /compute/v2.1/servers/8cc40222-82fc-4d28-bce8-e754679126ab => generated 1495 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:00.581480 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d373a524-16f9-471d-8039-4d948920af7a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:00.584031 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d373a524-16f9-471d-8039-4d948920af7a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 8cc40222-82fc-4d28-bce8-e754679126ab] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:00.609902 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d373a524-16f9-471d-8039-4d948920af7a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:00.615502 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d373a524-16f9-471d-8039-4d948920af7a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:00.623118 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d373a524-16f9-471d-8039-4d948920af7a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:00.625753 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d373a524-16f9-471d-8039-4d948920af7a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:01.197358 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d373a524-16f9-471d-8039-4d948920af7a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:01.216269 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d373a524-16f9-471d-8039-4d948920af7a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/8cc40222-82fc-4d28-bce8-e754679126ab" status: 200 len: 1495 microversion: 2.1 time: 0.654258 Jul 18 03:04:01.217590 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3037/6050] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:00 2022] GET /compute/v2.1/servers/8cc40222-82fc-4d28-bce8-e754679126ab => generated 1495 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:04:02.250577 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f26cd86f-ccd1-4812-9a7a-2c30cab361c9 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:02.251217 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f26cd86f-ccd1-4812-9a7a-2c30cab361c9 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 8cc40222-82fc-4d28-bce8-e754679126ab] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:02.284128 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-a2bd147b-5efa-4ef5-9271-dfe706654b06 req-25bac618-e8c3-42f7-bbb9-7c63b1ecc74b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cc40222-82fc-4d28-bce8-e754679126ab", "name": "network-vif-deleted", "tag": "6f0f9200-3b3c-4b65-947c-4f79711b8387"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:04:02.314956 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f26cd86f-ccd1-4812-9a7a-2c30cab361c9 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:02.316145 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f26cd86f-ccd1-4812-9a7a-2c30cab361c9 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:02.317462 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f26cd86f-ccd1-4812-9a7a-2c30cab361c9 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:02.318307 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-a2bd147b-5efa-4ef5-9271-dfe706654b06 req-25bac618-e8c3-42f7-bbb9-7c63b1ecc74b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:02.320039 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f26cd86f-ccd1-4812-9a7a-2c30cab361c9 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:02.321101 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-a2bd147b-5efa-4ef5-9271-dfe706654b06 req-25bac618-e8c3-42f7-bbb9-7c63b1ecc74b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:02.346977 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-a2bd147b-5efa-4ef5-9271-dfe706654b06 req-25bac618-e8c3-42f7-bbb9-7c63b1ecc74b service nova] Creating event network-vif-deleted:6f0f9200-3b3c-4b65-947c-4f79711b8387 for instance 8cc40222-82fc-4d28-bce8-e754679126ab on n-h1-465891-3 Jul 18 03:04:02.365753 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-a2bd147b-5efa-4ef5-9271-dfe706654b06 req-25bac618-e8c3-42f7-bbb9-7c63b1ecc74b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085337 Jul 18 03:04:02.367259 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3038/6051] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:04:02.530703 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f26cd86f-ccd1-4812-9a7a-2c30cab361c9 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:02.552209 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f26cd86f-ccd1-4812-9a7a-2c30cab361c9 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/8cc40222-82fc-4d28-bce8-e754679126ab" status: 200 len: 1453 microversion: 2.1 time: 0.320858 Jul 18 03:04:02.554627 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3014/6052] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:02 2022] GET /compute/v2.1/servers/8cc40222-82fc-4d28-bce8-e754679126ab => generated 1453 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:02.602253 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b5c366bb-b2e4-43e7-9ded-c27ecca8c291 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1310728847", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1290381689", "security_groups": [{"name": "tempest-secgroup-smoke-235698976"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "5b6977b3-426e-4528-89e7-302650963044"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:04:02.838069 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-b5c366bb-b2e4-43e7-9ded-c27ecca8c291 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] validate_networks() for [('5b6977b3-426e-4528-89e7-302650963044', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:04:03.592658 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-05155076-10b5-4cfd-a12c-59153067027b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:03.594145 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-05155076-10b5-4cfd-a12c-59153067027b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 8cc40222-82fc-4d28-bce8-e754679126ab] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:03.636550 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-05155076-10b5-4cfd-a12c-59153067027b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:03.637396 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-05155076-10b5-4cfd-a12c-59153067027b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:03.639636 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-05155076-10b5-4cfd-a12c-59153067027b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:03.641624 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-05155076-10b5-4cfd-a12c-59153067027b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:03.663504 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:04:03.686849 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-05155076-10b5-4cfd-a12c-59153067027b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] HTTP exception thrown: Instance 8cc40222-82fc-4d28-bce8-e754679126ab could not be found. Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-05155076-10b5-4cfd-a12c-59153067027b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Request method failure captured: Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/8cc40222-82fc-4d28-bce8-e754679126ab HTTP/1.1 Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M0c--VxkhAcA4gIHXxijKFI-k8Bpror72Hk1qb235rYnfDmQTByX9LOOCSekEaTY-qK46fTc9MDDZBpaIS7PRARBL52HY7fvnzNvoh5YO0XpJvHbsKLywLFoe1R8EGrLF6lPIQIdQdkEzZxbEDXhePA7F15YYp44S7QRWnysLrh4M4 Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3a83c4dedef341a0bb50fa4c119d3035"}]}] Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersTestJSON-1250523732 Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersTestJSON-1250523732-project Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 785ff643c00746939bb0fecd775ce920 Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersTestJSON-1250523732-project Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 8cc40222-82fc-4d28-bce8-e754679126ab could not be found. Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '8cc40222-82fc-4d28-bce8-e754679126ab'} Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cc40222-82fc-4d28-bce8-e754679126ab could not be found. Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cc40222-82fc-4d28-bce8-e754679126ab could not be found. Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:04:03.692615 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:04:03.701241 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:04:03.701241 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:04:03.701241 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:04:03.701241 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:04:03.701241 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cc40222-82fc-4d28-bce8-e754679126ab could not be found. Jul 18 03:04:03.701241 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:04:03.703778 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-05155076-10b5-4cfd-a12c-59153067027b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Returning 404 to user: Instance 8cc40222-82fc-4d28-bce8-e754679126ab could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:04:03.705998 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-05155076-10b5-4cfd-a12c-59153067027b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/8cc40222-82fc-4d28-bce8-e754679126ab" status: 404 len: 111 microversion: 2.1 time: 0.136925 Jul 18 03:04:03.708285 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3015/6053] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:03 2022] GET /compute/v2.1/servers/8cc40222-82fc-4d28-bce8-e754679126ab => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 03:04:03.910245 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1fa05ec5-3782-4dc5-883e-cabfc502a7f2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-796186918", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "c540b69b-e7cc-4fa1-8fc6-67859b3d0823"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:04:03.992085 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-1fa05ec5-3782-4dc5-883e-cabfc502a7f2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] validate_networks() for [('c540b69b-e7cc-4fa1-8fc6-67859b3d0823', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:04:04.134603 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-b5c366bb-b2e4-43e7-9ded-c27ecca8c291 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Getting quotas for project 18601269ae5c48409ca994cb7d410213. Resources: dict_keys(['metadata_items']) {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:04:04.165047 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-b5c366bb-b2e4-43e7-9ded-c27ecca8c291 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Getting quotas for user b292cd0f2ac2413babe9e9aa482d0c0b and project 18601269ae5c48409ca994cb7d410213. Resources: dict_keys(['metadata_items']) {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:04:04.210315 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-b5c366bb-b2e4-43e7-9ded-c27ecca8c291 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:04:04.223452 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-b5c366bb-b2e4-43e7-9ded-c27ecca8c291 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:04:04.227740 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-b5c366bb-b2e4-43e7-9ded-c27ecca8c291 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:04:04.227740 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-b5c366bb-b2e4-43e7-9ded-c27ecca8c291 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:04:04.227740 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-b5c366bb-b2e4-43e7-9ded-c27ecca8c291 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:04:04.267971 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b5c366bb-b2e4-43e7-9ded-c27ecca8c291 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:04.268696 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b5c366bb-b2e4-43e7-9ded-c27ecca8c291 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:04.270300 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b5c366bb-b2e4-43e7-9ded-c27ecca8c291 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:04.271090 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b5c366bb-b2e4-43e7-9ded-c27ecca8c291 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:04.302228 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:04:04.354615 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-b5c366bb-b2e4-43e7-9ded-c27ecca8c291 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Getting quotas for project 18601269ae5c48409ca994cb7d410213. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:04:04.365423 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-b5c366bb-b2e4-43e7-9ded-c27ecca8c291 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Getting quotas for user b292cd0f2ac2413babe9e9aa482d0c0b and project 18601269ae5c48409ca994cb7d410213. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:04:04.402721 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b5c366bb-b2e4-43e7-9ded-c27ecca8c291 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:04:04.405683 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b5c366bb-b2e4-43e7-9ded-c27ecca8c291 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] [instance: 9df430a2-54be-4e36-ad3f-5d3f0455e798] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:04:04.533176 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b5c366bb-b2e4-43e7-9ded-c27ecca8c291 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.936542 Jul 18 03:04:04.535387 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3039/6054] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:04:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 1940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 03:04:04.551740 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ff1256b1-0dfb-44b9-9e9a-d22158881362 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:04.563619 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ff1256b1-0dfb-44b9-9e9a-d22158881362 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] [instance: 9df430a2-54be-4e36-ad3f-5d3f0455e798] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:05.158010 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ff1256b1-0dfb-44b9-9e9a-d22158881362 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b292cd0f2ac2413babe9e9aa482d0c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18601269ae5c48409ca994cb7d410213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:05.169247 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ff1256b1-0dfb-44b9-9e9a-d22158881362 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] 10.222.0.57 "GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798" status: 200 len: 1303 microversion: 2.1 time: 0.626589 Jul 18 03:04:05.170701 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3040/6055] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:04 2022] GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798 => generated 1303 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:05.284839 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-1fa05ec5-3782-4dc5-883e-cabfc502a7f2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:04:05.285450 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-1fa05ec5-3782-4dc5-883e-cabfc502a7f2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:04:05.285747 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-1fa05ec5-3782-4dc5-883e-cabfc502a7f2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:04:05.286172 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-1fa05ec5-3782-4dc5-883e-cabfc502a7f2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:04:05.286591 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-1fa05ec5-3782-4dc5-883e-cabfc502a7f2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:04:05.298544 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1fa05ec5-3782-4dc5-883e-cabfc502a7f2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:05.299326 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1fa05ec5-3782-4dc5-883e-cabfc502a7f2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:05.300154 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1fa05ec5-3782-4dc5-883e-cabfc502a7f2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:05.300794 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1fa05ec5-3782-4dc5-883e-cabfc502a7f2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:05.325312 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-1fa05ec5-3782-4dc5-883e-cabfc502a7f2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Getting quotas for project 3a83c4dedef341a0bb50fa4c119d3035. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:04:05.344189 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-1fa05ec5-3782-4dc5-883e-cabfc502a7f2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Getting quotas for user 785ff643c00746939bb0fecd775ce920 and project 3a83c4dedef341a0bb50fa4c119d3035. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:04:05.372957 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1fa05ec5-3782-4dc5-883e-cabfc502a7f2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:04:05.380189 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1fa05ec5-3782-4dc5-883e-cabfc502a7f2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 62137bb4-7cff-4963-9636-51c09061f10d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:04:05.456894 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1fa05ec5-3782-4dc5-883e-cabfc502a7f2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.552095 Jul 18 03:04:05.457566 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3016/6056] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:04:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 03:04:05.469101 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7b40c047-c504-4516-b7c8-e1ddfc02b651 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:05.470143 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7b40c047-c504-4516-b7c8-e1ddfc02b651 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 62137bb4-7cff-4963-9636-51c09061f10d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:05.571944 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7b40c047-c504-4516-b7c8-e1ddfc02b651 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:05.585264 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7b40c047-c504-4516-b7c8-e1ddfc02b651 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d" status: 200 len: 1208 microversion: 2.1 time: 0.120245 Jul 18 03:04:05.586925 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3041/6057] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:05 2022] GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d => generated 1208 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:06.188880 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0a46dd0c-85ad-42a1-9d80-37e71ca90e4d tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:06.190063 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0a46dd0c-85ad-42a1-9d80-37e71ca90e4d tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] [instance: 9df430a2-54be-4e36-ad3f-5d3f0455e798] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:06.209007 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a46dd0c-85ad-42a1-9d80-37e71ca90e4d tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:06.211213 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a46dd0c-85ad-42a1-9d80-37e71ca90e4d tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:06.212375 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a46dd0c-85ad-42a1-9d80-37e71ca90e4d tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:06.214459 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a46dd0c-85ad-42a1-9d80-37e71ca90e4d tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:06.357187 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0a46dd0c-85ad-42a1-9d80-37e71ca90e4d tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b292cd0f2ac2413babe9e9aa482d0c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18601269ae5c48409ca994cb7d410213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:06.375485 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0a46dd0c-85ad-42a1-9d80-37e71ca90e4d tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] 10.222.0.57 "GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798" status: 200 len: 1373 microversion: 2.1 time: 0.192432 Jul 18 03:04:06.377248 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3017/6058] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:06 2022] GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798 => generated 1373 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:06.604338 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-331b9947-688c-4b7c-9c42-999685a1dc0d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:06.604991 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-331b9947-688c-4b7c-9c42-999685a1dc0d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 62137bb4-7cff-4963-9636-51c09061f10d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:06.615136 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-331b9947-688c-4b7c-9c42-999685a1dc0d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:06.615893 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-331b9947-688c-4b7c-9c42-999685a1dc0d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:06.618243 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-331b9947-688c-4b7c-9c42-999685a1dc0d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:06.619083 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-331b9947-688c-4b7c-9c42-999685a1dc0d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:06.796351 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-331b9947-688c-4b7c-9c42-999685a1dc0d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:06.807513 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-331b9947-688c-4b7c-9c42-999685a1dc0d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d" status: 200 len: 1260 microversion: 2.1 time: 0.207875 Jul 18 03:04:06.808119 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3042/6059] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:06 2022] GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d => generated 1260 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:07.401046 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ea8cb4a9-6588-4f76-88e5-43a3dfaedae7 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:07.402195 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ea8cb4a9-6588-4f76-88e5-43a3dfaedae7 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] [instance: 9df430a2-54be-4e36-ad3f-5d3f0455e798] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:07.412699 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea8cb4a9-6588-4f76-88e5-43a3dfaedae7 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:07.413248 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea8cb4a9-6588-4f76-88e5-43a3dfaedae7 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:07.414640 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea8cb4a9-6588-4f76-88e5-43a3dfaedae7 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:07.415219 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea8cb4a9-6588-4f76-88e5-43a3dfaedae7 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:07.556538 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ea8cb4a9-6588-4f76-88e5-43a3dfaedae7 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b292cd0f2ac2413babe9e9aa482d0c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18601269ae5c48409ca994cb7d410213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:07.575746 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ea8cb4a9-6588-4f76-88e5-43a3dfaedae7 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] 10.222.0.57 "GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798" status: 200 len: 1361 microversion: 2.1 time: 0.181309 Jul 18 03:04:07.576724 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3018/6060] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:07 2022] GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798 => generated 1361 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:07.826575 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f8af7ee0-be38-4e5f-a74f-26bc0c46fc87 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:07.827514 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f8af7ee0-be38-4e5f-a74f-26bc0c46fc87 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 62137bb4-7cff-4963-9636-51c09061f10d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:07.831269 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:04:07.842018 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f8af7ee0-be38-4e5f-a74f-26bc0c46fc87 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:07.842362 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f8af7ee0-be38-4e5f-a74f-26bc0c46fc87 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:07.843386 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f8af7ee0-be38-4e5f-a74f-26bc0c46fc87 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:07.844438 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f8af7ee0-be38-4e5f-a74f-26bc0c46fc87 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:07.958591 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f8af7ee0-be38-4e5f-a74f-26bc0c46fc87 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:07.967399 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f8af7ee0-be38-4e5f-a74f-26bc0c46fc87 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d" status: 200 len: 1266 microversion: 2.1 time: 0.144930 Jul 18 03:04:07.968004 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3043/6061] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:07 2022] GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:08.089047 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-641dfc3d-8889-4259-8101-3fe68268eca8 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:08.091659 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-641dfc3d-8889-4259-8101-3fe68268eca8 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 0b51bfed-afd2-4629-8b36-b466661de551] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:08.101414 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-641dfc3d-8889-4259-8101-3fe68268eca8 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:08.102489 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-641dfc3d-8889-4259-8101-3fe68268eca8 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:08.103651 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-641dfc3d-8889-4259-8101-3fe68268eca8 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:08.104249 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-641dfc3d-8889-4259-8101-3fe68268eca8 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:08.112987 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-ddb38835-a142-4c32-be3d-83a77995e9c3 req-a27fffdd-d683-451b-bba9-7bbe70d55b06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b51bfed-afd2-4629-8b36-b466661de551", "tag": "b6a9c561-dec2-426c-be72-ed96ce7f50e9"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:04:08.124263 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-ddb38835-a142-4c32-be3d-83a77995e9c3 req-a27fffdd-d683-451b-bba9-7bbe70d55b06 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:08.124724 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-ddb38835-a142-4c32-be3d-83a77995e9c3 req-a27fffdd-d683-451b-bba9-7bbe70d55b06 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:08.157178 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-641dfc3d-8889-4259-8101-3fe68268eca8 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 0b51bfed-afd2-4629-8b36-b466661de551] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:04:08.165191 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-ddb38835-a142-4c32-be3d-83a77995e9c3 req-a27fffdd-d683-451b-bba9-7bbe70d55b06 service nova] Creating event network-changed:b6a9c561-dec2-426c-be72-ed96ce7f50e9 for instance 0b51bfed-afd2-4629-8b36-b466661de551 on n-h2-465891-3 Jul 18 03:04:08.181680 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-ddb38835-a142-4c32-be3d-83a77995e9c3 req-a27fffdd-d683-451b-bba9-7bbe70d55b06 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071954 Jul 18 03:04:08.186838 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3044/6062] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:04:08.352895 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-641dfc3d-8889-4259-8101-3fe68268eca8 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "DELETE /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551" status: 204 len: 0 microversion: 2.1 time: 0.268368 Jul 18 03:04:08.353627 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3019/6063] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:04:08 2022] DELETE /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:04:08.365476 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2a7f90ac-9462-4a35-9184-c78fac8fd70f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:08.366244 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2a7f90ac-9462-4a35-9184-c78fac8fd70f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 0b51bfed-afd2-4629-8b36-b466661de551] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:08.375657 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2a7f90ac-9462-4a35-9184-c78fac8fd70f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:08.376224 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2a7f90ac-9462-4a35-9184-c78fac8fd70f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:08.377494 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2a7f90ac-9462-4a35-9184-c78fac8fd70f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:08.378224 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2a7f90ac-9462-4a35-9184-c78fac8fd70f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:08.612053 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-46223e3e-31e2-4a3d-b1c0-1b1da9041dbb tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:08.612873 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-46223e3e-31e2-4a3d-b1c0-1b1da9041dbb tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] [instance: 9df430a2-54be-4e36-ad3f-5d3f0455e798] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:08.624346 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-46223e3e-31e2-4a3d-b1c0-1b1da9041dbb tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:08.625874 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-46223e3e-31e2-4a3d-b1c0-1b1da9041dbb tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:08.628427 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-46223e3e-31e2-4a3d-b1c0-1b1da9041dbb tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:08.629251 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-46223e3e-31e2-4a3d-b1c0-1b1da9041dbb tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:09.040018 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2a7f90ac-9462-4a35-9184-c78fac8fd70f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:09.058372 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2a7f90ac-9462-4a35-9184-c78fac8fd70f tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551" status: 200 len: 1577 microversion: 2.1 time: 0.697671 Jul 18 03:04:09.078567 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3045/6064] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:08 2022] GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551 => generated 1577 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:09.083739 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6c6c3472-7984-42d2-be6f-eae1f0212378 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:09.084511 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6c6c3472-7984-42d2-be6f-eae1f0212378 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 62137bb4-7cff-4963-9636-51c09061f10d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:09.096107 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6c6c3472-7984-42d2-be6f-eae1f0212378 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:09.097176 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6c6c3472-7984-42d2-be6f-eae1f0212378 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:09.098510 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6c6c3472-7984-42d2-be6f-eae1f0212378 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:09.099144 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6c6c3472-7984-42d2-be6f-eae1f0212378 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:09.229819 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-46223e3e-31e2-4a3d-b1c0-1b1da9041dbb tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b292cd0f2ac2413babe9e9aa482d0c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18601269ae5c48409ca994cb7d410213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:09.238793 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-46223e3e-31e2-4a3d-b1c0-1b1da9041dbb tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] 10.222.0.57 "GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798" status: 200 len: 1428 microversion: 2.1 time: 0.637147 Jul 18 03:04:09.239815 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3020/6065] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:08 2022] GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798 => generated 1428 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:09.293894 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6c6c3472-7984-42d2-be6f-eae1f0212378 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:09.307402 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6c6c3472-7984-42d2-be6f-eae1f0212378 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d" status: 200 len: 1266 microversion: 2.1 time: 0.246516 Jul 18 03:04:09.308759 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3046/6066] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:09 2022] GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:10.088854 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ff07080f-fed7-45ad-a034-fc0b195bd036 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:10.090853 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ff07080f-fed7-45ad-a034-fc0b195bd036 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 0b51bfed-afd2-4629-8b36-b466661de551] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:10.101416 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ff07080f-fed7-45ad-a034-fc0b195bd036 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:10.102941 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ff07080f-fed7-45ad-a034-fc0b195bd036 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:10.104210 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ff07080f-fed7-45ad-a034-fc0b195bd036 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:10.104744 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ff07080f-fed7-45ad-a034-fc0b195bd036 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:10.256941 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dfdb493d-b8ac-4529-9c78-4b60c7d83618 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:10.258068 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-dfdb493d-b8ac-4529-9c78-4b60c7d83618 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] [instance: 9df430a2-54be-4e36-ad3f-5d3f0455e798] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:10.268347 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dfdb493d-b8ac-4529-9c78-4b60c7d83618 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:10.269023 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dfdb493d-b8ac-4529-9c78-4b60c7d83618 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:10.269985 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dfdb493d-b8ac-4529-9c78-4b60c7d83618 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:10.270749 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dfdb493d-b8ac-4529-9c78-4b60c7d83618 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:10.739919 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ff07080f-fed7-45ad-a034-fc0b195bd036 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:10.758763 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ff07080f-fed7-45ad-a034-fc0b195bd036 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551" status: 200 len: 1577 microversion: 2.1 time: 0.675981 Jul 18 03:04:10.760006 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3021/6067] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:10 2022] GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551 => generated 1577 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:10.779790 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-76135997-3a8b-44ea-955b-c80c7405bff0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:10.780861 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-76135997-3a8b-44ea-955b-c80c7405bff0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 62137bb4-7cff-4963-9636-51c09061f10d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:10.796462 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-76135997-3a8b-44ea-955b-c80c7405bff0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:10.797292 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-76135997-3a8b-44ea-955b-c80c7405bff0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:10.799220 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-76135997-3a8b-44ea-955b-c80c7405bff0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:10.800316 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-76135997-3a8b-44ea-955b-c80c7405bff0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:10.883406 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-dfdb493d-b8ac-4529-9c78-4b60c7d83618 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b292cd0f2ac2413babe9e9aa482d0c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18601269ae5c48409ca994cb7d410213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:10.912591 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-dfdb493d-b8ac-4529-9c78-4b60c7d83618 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] 10.222.0.57 "GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798" status: 200 len: 1428 microversion: 2.1 time: 0.659265 Jul 18 03:04:10.913764 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3047/6068] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:10 2022] GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798 => generated 1428 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:04:11.459879 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-164a74ec-cea7-42a9-bf38-cb7f42e78683 req-cf430690-33d5-4992-b1fc-081d29a0c724 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b51bfed-afd2-4629-8b36-b466661de551", "name": "network-vif-deleted", "tag": "b6a9c561-dec2-426c-be72-ed96ce7f50e9"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:04:11.475995 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-164a74ec-cea7-42a9-bf38-cb7f42e78683 req-cf430690-33d5-4992-b1fc-081d29a0c724 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:11.477258 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-164a74ec-cea7-42a9-bf38-cb7f42e78683 req-cf430690-33d5-4992-b1fc-081d29a0c724 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:11.496412 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-164a74ec-cea7-42a9-bf38-cb7f42e78683 req-cf430690-33d5-4992-b1fc-081d29a0c724 service nova] Creating event network-vif-deleted:b6a9c561-dec2-426c-be72-ed96ce7f50e9 for instance 0b51bfed-afd2-4629-8b36-b466661de551 on n-h2-465891-3 Jul 18 03:04:11.503658 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-164a74ec-cea7-42a9-bf38-cb7f42e78683 req-cf430690-33d5-4992-b1fc-081d29a0c724 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046741 Jul 18 03:04:11.505423 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3048/6069] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:04:11.632116 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-76135997-3a8b-44ea-955b-c80c7405bff0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:11.642361 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-76135997-3a8b-44ea-955b-c80c7405bff0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d" status: 200 len: 1308 microversion: 2.1 time: 0.868786 Jul 18 03:04:11.642981 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3022/6070] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:10 2022] GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d => generated 1308 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:11.786166 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8b742650-ce53-432a-81b2-2a4019110b56 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:11.788046 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8b742650-ce53-432a-81b2-2a4019110b56 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 0b51bfed-afd2-4629-8b36-b466661de551] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:11.804525 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8b742650-ce53-432a-81b2-2a4019110b56 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:11.807474 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8b742650-ce53-432a-81b2-2a4019110b56 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:11.812873 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8b742650-ce53-432a-81b2-2a4019110b56 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:11.813518 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8b742650-ce53-432a-81b2-2a4019110b56 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:11.938819 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f41222c8-648e-463e-9091-885eb5726560 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:11.939742 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f41222c8-648e-463e-9091-885eb5726560 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] [instance: 9df430a2-54be-4e36-ad3f-5d3f0455e798] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:11.953412 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f41222c8-648e-463e-9091-885eb5726560 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:11.954338 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f41222c8-648e-463e-9091-885eb5726560 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:11.955491 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f41222c8-648e-463e-9091-885eb5726560 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:11.955915 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f41222c8-648e-463e-9091-885eb5726560 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:12.052603 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8b742650-ce53-432a-81b2-2a4019110b56 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:12.082729 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8b742650-ce53-432a-81b2-2a4019110b56 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551" status: 200 len: 1224 microversion: 2.1 time: 0.305099 Jul 18 03:04:12.083833 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3049/6071] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:11 2022] GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551 => generated 1224 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:04:12.484445 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f41222c8-648e-463e-9091-885eb5726560 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b292cd0f2ac2413babe9e9aa482d0c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18601269ae5c48409ca994cb7d410213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:12.555856 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f41222c8-648e-463e-9091-885eb5726560 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] 10.222.0.57 "GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798" status: 200 len: 1428 microversion: 2.1 time: 0.612620 Jul 18 03:04:12.560363 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3023/6072] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:11 2022] GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798 => generated 1428 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:04:12.667917 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fee135cb-3432-400f-9375-e5f5336e5399 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:12.668558 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fee135cb-3432-400f-9375-e5f5336e5399 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 62137bb4-7cff-4963-9636-51c09061f10d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:12.692636 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fee135cb-3432-400f-9375-e5f5336e5399 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:12.693137 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fee135cb-3432-400f-9375-e5f5336e5399 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:12.694683 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fee135cb-3432-400f-9375-e5f5336e5399 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:12.696233 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fee135cb-3432-400f-9375-e5f5336e5399 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:12.780927 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2d3ac3e9-8375-4523-a644-b31f143282ed tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Action: 'create', calling method: .version_select at 0x7ff4a88743a0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-169904324", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGoCW/vyPw3Yi7AERk3zxheFM9bk6DkOJgmP/RS8asAsMmnu+8huPHjR0qZotOAwzMPP2VnxtWcKnPoCVqHXvjsrGN3nTBbtSpWRODEEhSeTPhqtIKkIH5OEK6VyRcDvPQ=="}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:04:12.814161 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-2d3ac3e9-8375-4523-a644-b31f143282ed tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Getting quotas for project 1d2ff16c129544f6a876a3371c1d02a6. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:04:12.834036 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-2d3ac3e9-8375-4523-a644-b31f143282ed tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Getting quotas for user 33388b46f7fb4c419ac0856245ad382f and project 1d2ff16c129544f6a876a3371c1d02a6. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:04:12.901985 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2d3ac3e9-8375-4523-a644-b31f143282ed tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.125347 Jul 18 03:04:12.902920 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3024/6073] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 03:04:12 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:04:13.118592 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-63f5a805-7c1f-4954-9d8e-fce6006bb068 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:13.119808 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-63f5a805-7c1f-4954-9d8e-fce6006bb068 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 0b51bfed-afd2-4629-8b36-b466661de551] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:13.145768 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-63f5a805-7c1f-4954-9d8e-fce6006bb068 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:13.146546 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-63f5a805-7c1f-4954-9d8e-fce6006bb068 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:13.147516 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-63f5a805-7c1f-4954-9d8e-fce6006bb068 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:13.148092 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-63f5a805-7c1f-4954-9d8e-fce6006bb068 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:13.150084 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fee135cb-3432-400f-9375-e5f5336e5399 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:13.158156 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fee135cb-3432-400f-9375-e5f5336e5399 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d" status: 200 len: 1308 microversion: 2.1 time: 0.494827 Jul 18 03:04:13.158780 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3050/6074] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:12 2022] GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d => generated 1308 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:13.317665 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-63f5a805-7c1f-4954-9d8e-fce6006bb068 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:13.334314 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-63f5a805-7c1f-4954-9d8e-fce6006bb068 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551" status: 200 len: 1224 microversion: 2.1 time: 0.224435 Jul 18 03:04:13.335513 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3025/6075] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:13 2022] GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551 => generated 1224 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:04:13.558177 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-d3d91dbd-c2f3-4f7d-8bc0-c7d1052d87b0 req-6b99b9ef-5dfe-47f7-82c8-54cea37495b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9df430a2-54be-4e36-ad3f-5d3f0455e798", "tag": "e9714ca5-cc91-49c7-95b3-7065a9d51897"}, {"name": "network-changed", "server_uuid": "62137bb4-7cff-4963-9636-51c09061f10d", "tag": "b0fdebec-48da-4526-881d-e6fb6db965c4"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:04:13.584979 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-d3d91dbd-c2f3-4f7d-8bc0-c7d1052d87b0 req-6b99b9ef-5dfe-47f7-82c8-54cea37495b3 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:13.586471 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f2fa0054-bcad-4275-a43d-70b84190aed3 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:13.587299 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-d3d91dbd-c2f3-4f7d-8bc0-c7d1052d87b0 req-6b99b9ef-5dfe-47f7-82c8-54cea37495b3 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:13.587545 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f2fa0054-bcad-4275-a43d-70b84190aed3 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] [instance: 9df430a2-54be-4e36-ad3f-5d3f0455e798] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:13.599038 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f2fa0054-bcad-4275-a43d-70b84190aed3 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:13.600843 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f2fa0054-bcad-4275-a43d-70b84190aed3 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:13.605488 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f2fa0054-bcad-4275-a43d-70b84190aed3 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:13.606251 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f2fa0054-bcad-4275-a43d-70b84190aed3 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:13.624737 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-d3d91dbd-c2f3-4f7d-8bc0-c7d1052d87b0 req-6b99b9ef-5dfe-47f7-82c8-54cea37495b3 service nova] Creating event network-changed:e9714ca5-cc91-49c7-95b3-7065a9d51897 for instance 9df430a2-54be-4e36-ad3f-5d3f0455e798 on n-h1-465891-3 Jul 18 03:04:13.625353 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-d3d91dbd-c2f3-4f7d-8bc0-c7d1052d87b0 req-6b99b9ef-5dfe-47f7-82c8-54cea37495b3 service nova] Creating event network-changed:b0fdebec-48da-4526-881d-e6fb6db965c4 for instance 62137bb4-7cff-4963-9636-51c09061f10d on n-h2-465891-3 Jul 18 03:04:13.646431 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-d3d91dbd-c2f3-4f7d-8bc0-c7d1052d87b0 req-6b99b9ef-5dfe-47f7-82c8-54cea37495b3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.093803 Jul 18 03:04:13.647072 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3051/6076] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:04:14.113867 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f2fa0054-bcad-4275-a43d-70b84190aed3 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b292cd0f2ac2413babe9e9aa482d0c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18601269ae5c48409ca994cb7d410213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:14.135037 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f2fa0054-bcad-4275-a43d-70b84190aed3 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] 10.222.0.57 "GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798" status: 200 len: 1428 microversion: 2.1 time: 0.550267 Jul 18 03:04:14.136803 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3026/6077] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:13 2022] GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798 => generated 1428 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:04:14.184039 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bac34413-48a7-46a3-ba03-741e954e9ecb tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:14.184880 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bac34413-48a7-46a3-ba03-741e954e9ecb tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 62137bb4-7cff-4963-9636-51c09061f10d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:14.199469 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bac34413-48a7-46a3-ba03-741e954e9ecb tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:14.200021 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bac34413-48a7-46a3-ba03-741e954e9ecb tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:14.200857 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bac34413-48a7-46a3-ba03-741e954e9ecb tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:14.201357 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bac34413-48a7-46a3-ba03-741e954e9ecb tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:14.306366 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:04:14.355178 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-226878c1-e5bb-4410-a6d7-0b3f7b94e231 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:14.356318 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-226878c1-e5bb-4410-a6d7-0b3f7b94e231 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 0b51bfed-afd2-4629-8b36-b466661de551] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:14.370857 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-226878c1-e5bb-4410-a6d7-0b3f7b94e231 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:14.376308 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-226878c1-e5bb-4410-a6d7-0b3f7b94e231 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:14.379387 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-226878c1-e5bb-4410-a6d7-0b3f7b94e231 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:14.380159 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-226878c1-e5bb-4410-a6d7-0b3f7b94e231 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:14.598017 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-226878c1-e5bb-4410-a6d7-0b3f7b94e231 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:14.608492 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-226878c1-e5bb-4410-a6d7-0b3f7b94e231 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551" status: 200 len: 1224 microversion: 2.1 time: 0.260074 Jul 18 03:04:14.609193 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3027/6078] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:14 2022] GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551 => generated 1224 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:14.693661 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bac34413-48a7-46a3-ba03-741e954e9ecb tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:14.710418 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bac34413-48a7-46a3-ba03-741e954e9ecb tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d" status: 200 len: 1308 microversion: 2.1 time: 0.530618 Jul 18 03:04:14.711733 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3052/6079] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:14 2022] GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d => generated 1308 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:15.158258 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f0152393-12c1-4f1b-ab88-43214ed3d0a3 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:15.159322 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f0152393-12c1-4f1b-ab88-43214ed3d0a3 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] [instance: 9df430a2-54be-4e36-ad3f-5d3f0455e798] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:15.172383 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f0152393-12c1-4f1b-ab88-43214ed3d0a3 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:15.173159 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f0152393-12c1-4f1b-ab88-43214ed3d0a3 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:15.177945 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f0152393-12c1-4f1b-ab88-43214ed3d0a3 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:15.178922 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f0152393-12c1-4f1b-ab88-43214ed3d0a3 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:15.254519 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8ef268a2-f9a7-4b8e-bf1d-68bedbb76940 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1649945441", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "680d4558-cc83-435b-b8ef-ce2e3dd2221a"}], "key_name": "tempest-TestNetworkBasicOps-169904324", "security_groups": [{"name": "tempest-secgroup-smoke-606140869"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:04:15.309428 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:04:15.537328 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f0152393-12c1-4f1b-ab88-43214ed3d0a3 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b292cd0f2ac2413babe9e9aa482d0c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18601269ae5c48409ca994cb7d410213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:15.565253 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f0152393-12c1-4f1b-ab88-43214ed3d0a3 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] 10.222.0.57 "GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798" status: 200 len: 1428 microversion: 2.1 time: 0.414718 Jul 18 03:04:15.566259 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3028/6080] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:15 2022] GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798 => generated 1428 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:15.583965 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=14 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:04:15.589489 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-8ef268a2-f9a7-4b8e-bf1d-68bedbb76940 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] validate_networks() for [('680d4558-cc83-435b-b8ef-ce2e3dd2221a', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:04:15.632752 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4259f529-b36f-4fd7-84ff-857c162b7f69 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:15.634070 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4259f529-b36f-4fd7-84ff-857c162b7f69 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 0b51bfed-afd2-4629-8b36-b466661de551] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:15.644328 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4259f529-b36f-4fd7-84ff-857c162b7f69 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:15.645430 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4259f529-b36f-4fd7-84ff-857c162b7f69 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:15.647694 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4259f529-b36f-4fd7-84ff-857c162b7f69 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:15.649142 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4259f529-b36f-4fd7-84ff-857c162b7f69 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:15.838138 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4259f529-b36f-4fd7-84ff-857c162b7f69 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:15.860329 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4259f529-b36f-4fd7-84ff-857c162b7f69 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551" status: 200 len: 1224 microversion: 2.1 time: 0.231939 Jul 18 03:04:15.860920 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3029/6081] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:15 2022] GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551 => generated 1224 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:15.874804 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d0540d8c-b8ea-48e1-a3b6-bd7021fd5d44 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:15.875852 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d0540d8c-b8ea-48e1-a3b6-bd7021fd5d44 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 62137bb4-7cff-4963-9636-51c09061f10d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:15.883698 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d0540d8c-b8ea-48e1-a3b6-bd7021fd5d44 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:15.884813 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d0540d8c-b8ea-48e1-a3b6-bd7021fd5d44 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:15.885939 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d0540d8c-b8ea-48e1-a3b6-bd7021fd5d44 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:15.886999 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d0540d8c-b8ea-48e1-a3b6-bd7021fd5d44 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:16.676357 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d0540d8c-b8ea-48e1-a3b6-bd7021fd5d44 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:16.720271 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d0540d8c-b8ea-48e1-a3b6-bd7021fd5d44 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d" status: 200 len: 1308 microversion: 2.1 time: 0.857838 Jul 18 03:04:16.721623 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3030/6082] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:15 2022] GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d => generated 1308 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:16.730016 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-24744b12-9119-44c1-b66a-c66d970caaf1 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:16.732029 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-24744b12-9119-44c1-b66a-c66d970caaf1 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] [instance: 9df430a2-54be-4e36-ad3f-5d3f0455e798] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:16.741481 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-24744b12-9119-44c1-b66a-c66d970caaf1 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:16.742107 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-24744b12-9119-44c1-b66a-c66d970caaf1 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:16.743302 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-24744b12-9119-44c1-b66a-c66d970caaf1 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:16.745093 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-24744b12-9119-44c1-b66a-c66d970caaf1 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:17.144426 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-8ef268a2-f9a7-4b8e-bf1d-68bedbb76940 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:04:17.145290 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-8ef268a2-f9a7-4b8e-bf1d-68bedbb76940 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:04:17.146160 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-8ef268a2-f9a7-4b8e-bf1d-68bedbb76940 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:04:17.149499 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-8ef268a2-f9a7-4b8e-bf1d-68bedbb76940 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:04:17.150286 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-8ef268a2-f9a7-4b8e-bf1d-68bedbb76940 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:04:17.165944 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8ef268a2-f9a7-4b8e-bf1d-68bedbb76940 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:17.166403 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8ef268a2-f9a7-4b8e-bf1d-68bedbb76940 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:17.167446 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8ef268a2-f9a7-4b8e-bf1d-68bedbb76940 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:17.168436 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8ef268a2-f9a7-4b8e-bf1d-68bedbb76940 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:17.182203 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-24744b12-9119-44c1-b66a-c66d970caaf1 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b292cd0f2ac2413babe9e9aa482d0c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18601269ae5c48409ca994cb7d410213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:17.191181 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-24744b12-9119-44c1-b66a-c66d970caaf1 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] 10.222.0.57 "GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798" status: 200 len: 1428 microversion: 2.1 time: 0.466643 Jul 18 03:04:17.192211 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3031/6083] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:16 2022] GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798 => generated 1428 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:17.198127 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e8905486-d37f-401b-a80a-4302b3605605 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:17.199133 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e8905486-d37f-401b-a80a-4302b3605605 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 0b51bfed-afd2-4629-8b36-b466661de551] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:17.201429 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=5 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:04:17.207680 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-8ef268a2-f9a7-4b8e-bf1d-68bedbb76940 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Getting quotas for project 1d2ff16c129544f6a876a3371c1d02a6. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:04:17.210538 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e8905486-d37f-401b-a80a-4302b3605605 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:17.212157 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e8905486-d37f-401b-a80a-4302b3605605 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:17.213666 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e8905486-d37f-401b-a80a-4302b3605605 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:17.214422 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e8905486-d37f-401b-a80a-4302b3605605 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:17.223020 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-8ef268a2-f9a7-4b8e-bf1d-68bedbb76940 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Getting quotas for user 33388b46f7fb4c419ac0856245ad382f and project 1d2ff16c129544f6a876a3371c1d02a6. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:04:17.242324 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:04:17.266787 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8ef268a2-f9a7-4b8e-bf1d-68bedbb76940 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:04:17.271097 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8ef268a2-f9a7-4b8e-bf1d-68bedbb76940 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: 76c4b356-512b-4868-9c97-4006c9b36b97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:04:17.331239 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e8905486-d37f-401b-a80a-4302b3605605 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:17.357635 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e8905486-d37f-401b-a80a-4302b3605605 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551" status: 200 len: 1224 microversion: 2.1 time: 0.159644 Jul 18 03:04:17.365186 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3032/6084] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:17 2022] GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551 => generated 1224 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:17.365739 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8ef268a2-f9a7-4b8e-bf1d-68bedbb76940 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.115530 Jul 18 03:04:17.367032 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3053/6085] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:04:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 2118 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:04:17.379829 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-55cbbc33-56f6-4a40-b5de-b184d9571c39 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:17.380773 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-55cbbc33-56f6-4a40-b5de-b184d9571c39 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: 76c4b356-512b-4868-9c97-4006c9b36b97] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:17.479467 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-55cbbc33-56f6-4a40-b5de-b184d9571c39 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:17.497395 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-55cbbc33-56f6-4a40-b5de-b184d9571c39 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/76c4b356-512b-4868-9c97-4006c9b36b97" status: 200 len: 1248 microversion: 2.1 time: 0.121946 Jul 18 03:04:17.498454 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3033/6086] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:17 2022] GET /compute/v2.1/servers/76c4b356-512b-4868-9c97-4006c9b36b97 => generated 1248 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:17.740254 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f87e5187-a6aa-46f8-8d04-b261b92486c2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:17.741390 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f87e5187-a6aa-46f8-8d04-b261b92486c2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 62137bb4-7cff-4963-9636-51c09061f10d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:17.753214 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f87e5187-a6aa-46f8-8d04-b261b92486c2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:17.753761 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f87e5187-a6aa-46f8-8d04-b261b92486c2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:17.754940 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f87e5187-a6aa-46f8-8d04-b261b92486c2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:17.755521 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f87e5187-a6aa-46f8-8d04-b261b92486c2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:17.988887 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f87e5187-a6aa-46f8-8d04-b261b92486c2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:18.001234 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f87e5187-a6aa-46f8-8d04-b261b92486c2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d" status: 200 len: 1308 microversion: 2.1 time: 0.266353 Jul 18 03:04:18.001965 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3054/6087] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:17 2022] GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d => generated 1308 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:04:18.214558 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-08c8b110-422c-49d7-862b-e5189bfab6ef tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:18.215910 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-08c8b110-422c-49d7-862b-e5189bfab6ef tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] [instance: 9df430a2-54be-4e36-ad3f-5d3f0455e798] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:18.224470 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-08c8b110-422c-49d7-862b-e5189bfab6ef tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:18.224920 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-08c8b110-422c-49d7-862b-e5189bfab6ef tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:18.225991 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-08c8b110-422c-49d7-862b-e5189bfab6ef tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:18.226450 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-08c8b110-422c-49d7-862b-e5189bfab6ef tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:18.385680 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-704b35df-0d51-4a7a-baa9-a57b5cbe80c1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:18.387363 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-704b35df-0d51-4a7a-baa9-a57b5cbe80c1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 0b51bfed-afd2-4629-8b36-b466661de551] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:18.395263 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-704b35df-0d51-4a7a-baa9-a57b5cbe80c1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:18.395819 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-704b35df-0d51-4a7a-baa9-a57b5cbe80c1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:18.397073 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-704b35df-0d51-4a7a-baa9-a57b5cbe80c1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:18.397818 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-704b35df-0d51-4a7a-baa9-a57b5cbe80c1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:18.445015 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-704b35df-0d51-4a7a-baa9-a57b5cbe80c1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:18.447168 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-704b35df-0d51-4a7a-baa9-a57b5cbe80c1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:18.449093 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-704b35df-0d51-4a7a-baa9-a57b5cbe80c1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lazy-loading 'fault' on Instance uuid 0b51bfed-afd2-4629-8b36-b466661de551 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:04:18.455936 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-08c8b110-422c-49d7-862b-e5189bfab6ef tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b292cd0f2ac2413babe9e9aa482d0c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18601269ae5c48409ca994cb7d410213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:18.480399 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-08c8b110-422c-49d7-862b-e5189bfab6ef tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] 10.222.0.57 "GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798" status: 200 len: 1428 microversion: 2.1 time: 0.267434 Jul 18 03:04:18.483979 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3034/6088] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:18 2022] GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798 => generated 1428 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:18.521240 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-704b35df-0d51-4a7a-baa9-a57b5cbe80c1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1afc1702f8045a396b98e5c24b124e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7654e273f6487ba83382da4f96056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:18.533946 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a9e7ac8d-44a3-4656-ac65-b8cd2051c8ed tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:18.534902 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a9e7ac8d-44a3-4656-ac65-b8cd2051c8ed tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: 76c4b356-512b-4868-9c97-4006c9b36b97] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:18.542955 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a9e7ac8d-44a3-4656-ac65-b8cd2051c8ed tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:18.543404 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-704b35df-0d51-4a7a-baa9-a57b5cbe80c1 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551" status: 200 len: 1183 microversion: 2.1 time: 0.162679 Jul 18 03:04:18.543530 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a9e7ac8d-44a3-4656-ac65-b8cd2051c8ed tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:18.544211 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a9e7ac8d-44a3-4656-ac65-b8cd2051c8ed tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:18.544660 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a9e7ac8d-44a3-4656-ac65-b8cd2051c8ed tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:18.550564 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3055/6089] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:18 2022] GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551 => generated 1183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:18.631982 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a9e7ac8d-44a3-4656-ac65-b8cd2051c8ed tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:18.651670 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a9e7ac8d-44a3-4656-ac65-b8cd2051c8ed tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/76c4b356-512b-4868-9c97-4006c9b36b97" status: 200 len: 1300 microversion: 2.1 time: 0.137024 Jul 18 03:04:18.653194 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3035/6090] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:18 2022] GET /compute/v2.1/servers/76c4b356-512b-4868-9c97-4006c9b36b97 => generated 1300 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:04:19.020005 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-77f2ea29-0604-4a14-aa3e-3af8f88dab62 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:19.020937 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-77f2ea29-0604-4a14-aa3e-3af8f88dab62 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 62137bb4-7cff-4963-9636-51c09061f10d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:19.029064 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77f2ea29-0604-4a14-aa3e-3af8f88dab62 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:19.029522 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77f2ea29-0604-4a14-aa3e-3af8f88dab62 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:19.030553 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77f2ea29-0604-4a14-aa3e-3af8f88dab62 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:19.031175 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77f2ea29-0604-4a14-aa3e-3af8f88dab62 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:19.248338 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-77f2ea29-0604-4a14-aa3e-3af8f88dab62 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:19.257354 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-77f2ea29-0604-4a14-aa3e-3af8f88dab62 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d" status: 200 len: 1308 microversion: 2.1 time: 0.241175 Jul 18 03:04:19.259448 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3056/6091] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:19 2022] GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d => generated 1308 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:04:19.513770 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e2f4b25e-0d23-4d39-a7e7-e6901ceb6d20 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:19.514889 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e2f4b25e-0d23-4d39-a7e7-e6901ceb6d20 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] [instance: 9df430a2-54be-4e36-ad3f-5d3f0455e798] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:19.527853 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e2f4b25e-0d23-4d39-a7e7-e6901ceb6d20 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:19.528566 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e2f4b25e-0d23-4d39-a7e7-e6901ceb6d20 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:19.529825 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e2f4b25e-0d23-4d39-a7e7-e6901ceb6d20 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:19.530724 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e2f4b25e-0d23-4d39-a7e7-e6901ceb6d20 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:19.567841 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f9dc6121-8e87-47c5-a661-63ded3f18e61 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:19.568971 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f9dc6121-8e87-47c5-a661-63ded3f18e61 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 0b51bfed-afd2-4629-8b36-b466661de551] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:19.588763 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f9dc6121-8e87-47c5-a661-63ded3f18e61 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:19.589584 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f9dc6121-8e87-47c5-a661-63ded3f18e61 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:19.591300 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f9dc6121-8e87-47c5-a661-63ded3f18e61 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:19.591971 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f9dc6121-8e87-47c5-a661-63ded3f18e61 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:19.611231 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-f9dc6121-8e87-47c5-a661-63ded3f18e61 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] HTTP exception thrown: Instance 0b51bfed-afd2-4629-8b36-b466661de551 could not be found. Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f9dc6121-8e87-47c5-a661-63ded3f18e61 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Request method failure captured: Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551 HTTP/1.1 Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MliWHzVx10oBgzg24taGfvPF1POfFT53P2_RlSdFLebnrvIbeAs5qvjZ1EAd9Fni5RvXZYA8fjgna7ooKOtwOz_kbJVpuNazgX6TlGzOYOFYf5fy5vfDN_5wwJEwayQdbLz2BaqgZyDtVrhp2skZQbTuh-KNZeRA8bkIRl3oXepO1E Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 2b7654e273f6487ba83382da4f96056d Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-TestVolumeBootPattern-598001453 Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2b7654e273f6487ba83382da4f96056d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2b7654e273f6487ba83382da4f96056d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2b7654e273f6487ba83382da4f96056d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2b7654e273f6487ba83382da4f96056d"}]}] Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-TestVolumeBootPattern-598001453 Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 2b7654e273f6487ba83382da4f96056d Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-TestVolumeBootPattern-598001453 Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-TestVolumeBootPattern-598001453-project Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: d1afc1702f8045a396b98e5c24b124e7 Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-TestVolumeBootPattern-598001453-project Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 0b51bfed-afd2-4629-8b36-b466661de551 could not be found. Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '0b51bfed-afd2-4629-8b36-b466661de551'} Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b51bfed-afd2-4629-8b36-b466661de551 could not be found. Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b51bfed-afd2-4629-8b36-b466661de551 could not be found. Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:04:19.613220 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:04:19.619736 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:04:19.619736 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:04:19.619736 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:04:19.619736 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:04:19.619736 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:04:19.619736 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b51bfed-afd2-4629-8b36-b466661de551 could not be found. Jul 18 03:04:19.619736 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:04:19.621880 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f9dc6121-8e87-47c5-a661-63ded3f18e61 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Returning 404 to user: Instance 0b51bfed-afd2-4629-8b36-b466661de551 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:04:19.623401 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f9dc6121-8e87-47c5-a661-63ded3f18e61 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551" status: 404 len: 111 microversion: 2.1 time: 0.061770 Jul 18 03:04:19.627621 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3057/6092] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:19 2022] GET /compute/v2.1/servers/0b51bfed-afd2-4629-8b36-b466661de551 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:04:19.672846 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-97c47179-e7fe-4926-acc8-b46ea355f0f4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:19.673875 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-97c47179-e7fe-4926-acc8-b46ea355f0f4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: 76c4b356-512b-4868-9c97-4006c9b36b97] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:19.683456 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-97c47179-e7fe-4926-acc8-b46ea355f0f4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:19.683921 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-97c47179-e7fe-4926-acc8-b46ea355f0f4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:19.684973 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-97c47179-e7fe-4926-acc8-b46ea355f0f4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:19.685427 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-97c47179-e7fe-4926-acc8-b46ea355f0f4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:19.804085 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-97c47179-e7fe-4926-acc8-b46ea355f0f4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:19.816668 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-97c47179-e7fe-4926-acc8-b46ea355f0f4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/76c4b356-512b-4868-9c97-4006c9b36b97" status: 200 len: 1306 microversion: 2.1 time: 0.148754 Jul 18 03:04:19.821916 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3058/6093] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:19 2022] GET /compute/v2.1/servers/76c4b356-512b-4868-9c97-4006c9b36b97 => generated 1306 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:04:19.838085 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e2f4b25e-0d23-4d39-a7e7-e6901ceb6d20 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b292cd0f2ac2413babe9e9aa482d0c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18601269ae5c48409ca994cb7d410213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:19.848868 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e2f4b25e-0d23-4d39-a7e7-e6901ceb6d20 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] 10.222.0.57 "GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798" status: 200 len: 1428 microversion: 2.1 time: 0.343223 Jul 18 03:04:19.849970 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3036/6094] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:19 2022] GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798 => generated 1428 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:04:20.185087 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a051a6c4-ff6b-488e-a400-65f99279ccc9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:20.185939 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a051a6c4-ff6b-488e-a400-65f99279ccc9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:20.195262 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a051a6c4-ff6b-488e-a400-65f99279ccc9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:20.195941 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a051a6c4-ff6b-488e-a400-65f99279ccc9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:20.196820 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a051a6c4-ff6b-488e-a400-65f99279ccc9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:20.197330 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a051a6c4-ff6b-488e-a400-65f99279ccc9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:20.216348 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-a051a6c4-ff6b-488e-a400-65f99279ccc9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] HTTP exception thrown: Instance 6bd0b1cf-40d7-4603-8746-bd306afd94f5 could not be found. Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a051a6c4-ff6b-488e-a400-65f99279ccc9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Request method failure captured: Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 HTTP/1.1 Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1MliWHzVx10oBgzg24taGfvPF1POfFT53P2_RlSdFLebnrvIbeAs5qvjZ1EAd9Fni5RvXZYA8fjgna7ooKOtwOz_kbJVpuNazgX6TlGzOYOFYf5fy5vfDN_5wwJEwayQdbLz2BaqgZyDtVrhp2skZQbTuh-KNZeRA8bkIRl3oXepO1E Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 2b7654e273f6487ba83382da4f96056d Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-TestVolumeBootPattern-598001453 Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2b7654e273f6487ba83382da4f96056d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2b7654e273f6487ba83382da4f96056d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2b7654e273f6487ba83382da4f96056d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2b7654e273f6487ba83382da4f96056d"}]}] Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-TestVolumeBootPattern-598001453 Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 2b7654e273f6487ba83382da4f96056d Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-TestVolumeBootPattern-598001453 Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-TestVolumeBootPattern-598001453-project Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: d1afc1702f8045a396b98e5c24b124e7 Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-TestVolumeBootPattern-598001453-project Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 6bd0b1cf-40d7-4603-8746-bd306afd94f5 could not be found. Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '6bd0b1cf-40d7-4603-8746-bd306afd94f5'} Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bd0b1cf-40d7-4603-8746-bd306afd94f5 could not be found. Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:04:20.219046 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:04:20.223843 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bd0b1cf-40d7-4603-8746-bd306afd94f5 could not be found. Jul 18 03:04:20.223843 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:04:20.223843 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:04:20.223843 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:04:20.223843 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:04:20.223843 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:04:20.223843 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:04:20.223843 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:04:20.223843 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:04:20.223843 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bd0b1cf-40d7-4603-8746-bd306afd94f5 could not be found. Jul 18 03:04:20.223843 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:04:20.223843 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a051a6c4-ff6b-488e-a400-65f99279ccc9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Returning 404 to user: Instance 6bd0b1cf-40d7-4603-8746-bd306afd94f5 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:04:20.223843 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a051a6c4-ff6b-488e-a400-65f99279ccc9 tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "DELETE /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5" status: 404 len: 111 microversion: 2.1 time: 0.038882 Jul 18 03:04:20.223843 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3059/6095] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:04:20 2022] DELETE /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:04:20.231451 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b797d631-457b-495d-8410-3ef843ee1b4e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:20.232069 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b797d631-457b-495d-8410-3ef843ee1b4e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] [instance: 6bd0b1cf-40d7-4603-8746-bd306afd94f5] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:20.239061 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b797d631-457b-495d-8410-3ef843ee1b4e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:20.239611 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b797d631-457b-495d-8410-3ef843ee1b4e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:20.240286 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b797d631-457b-495d-8410-3ef843ee1b4e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:20.241032 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b797d631-457b-495d-8410-3ef843ee1b4e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:20.257413 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-b797d631-457b-495d-8410-3ef843ee1b4e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] HTTP exception thrown: Instance 6bd0b1cf-40d7-4603-8746-bd306afd94f5 could not be found. Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b797d631-457b-495d-8410-3ef843ee1b4e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Request method failure captured: Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 HTTP/1.1 Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1MliWHzVx10oBgzg24taGfvPF1POfFT53P2_RlSdFLebnrvIbeAs5qvjZ1EAd9Fni5RvXZYA8fjgna7ooKOtwOz_kbJVpuNazgX6TlGzOYOFYf5fy5vfDN_5wwJEwayQdbLz2BaqgZyDtVrhp2skZQbTuh-KNZeRA8bkIRl3oXepO1E Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 2b7654e273f6487ba83382da4f96056d Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-TestVolumeBootPattern-598001453 Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2b7654e273f6487ba83382da4f96056d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2b7654e273f6487ba83382da4f96056d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2b7654e273f6487ba83382da4f96056d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2b7654e273f6487ba83382da4f96056d"}]}] Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-TestVolumeBootPattern-598001453 Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 2b7654e273f6487ba83382da4f96056d Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-TestVolumeBootPattern-598001453 Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-TestVolumeBootPattern-598001453-project Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: d1afc1702f8045a396b98e5c24b124e7 Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-TestVolumeBootPattern-598001453-project Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 6bd0b1cf-40d7-4603-8746-bd306afd94f5 could not be found. Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '6bd0b1cf-40d7-4603-8746-bd306afd94f5'} Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bd0b1cf-40d7-4603-8746-bd306afd94f5 could not be found. Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bd0b1cf-40d7-4603-8746-bd306afd94f5 could not be found. Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:04:20.259731 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:04:20.265033 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:04:20.265033 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:04:20.265033 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:04:20.265033 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:04:20.265033 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:04:20.265033 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bd0b1cf-40d7-4603-8746-bd306afd94f5 could not be found. Jul 18 03:04:20.265033 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:04:20.265033 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b797d631-457b-495d-8410-3ef843ee1b4e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Returning 404 to user: Instance 6bd0b1cf-40d7-4603-8746-bd306afd94f5 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:04:20.265033 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b797d631-457b-495d-8410-3ef843ee1b4e tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5" status: 404 len: 111 microversion: 2.1 time: 0.034520 Jul 18 03:04:20.265033 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3037/6096] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:20 2022] GET /compute/v2.1/servers/6bd0b1cf-40d7-4603-8746-bd306afd94f5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:04:20.278590 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c31f8f33-9f06-45d0-9ab0-9e8a80235721 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:20.279398 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c31f8f33-9f06-45d0-9ab0-9e8a80235721 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 62137bb4-7cff-4963-9636-51c09061f10d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:20.294007 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c31f8f33-9f06-45d0-9ab0-9e8a80235721 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:20.294784 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c31f8f33-9f06-45d0-9ab0-9e8a80235721 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:20.295716 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c31f8f33-9f06-45d0-9ab0-9e8a80235721 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:20.296288 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c31f8f33-9f06-45d0-9ab0-9e8a80235721 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:20.605746 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c31f8f33-9f06-45d0-9ab0-9e8a80235721 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:20.615436 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c31f8f33-9f06-45d0-9ab0-9e8a80235721 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d" status: 200 len: 1308 microversion: 2.1 time: 0.343419 Jul 18 03:04:20.616765 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3060/6097] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:20 2022] GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d => generated 1308 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:20.639522 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-9a625c05-ddd1-4934-907b-d989a35f9a6e req-420c192e-07c4-45e3-aa91-e98a33121543 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9df430a2-54be-4e36-ad3f-5d3f0455e798", "name": "network-vif-plugged", "status": "completed", "tag": "e9714ca5-cc91-49c7-95b3-7065a9d51897"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:04:20.652738 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-9a625c05-ddd1-4934-907b-d989a35f9a6e req-420c192e-07c4-45e3-aa91-e98a33121543 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:20.653610 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-9a625c05-ddd1-4934-907b-d989a35f9a6e req-420c192e-07c4-45e3-aa91-e98a33121543 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:20.674358 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-9a625c05-ddd1-4934-907b-d989a35f9a6e req-420c192e-07c4-45e3-aa91-e98a33121543 service nova] Creating event network-vif-plugged:e9714ca5-cc91-49c7-95b3-7065a9d51897 for instance 9df430a2-54be-4e36-ad3f-5d3f0455e798 on n-h1-465891-3 Jul 18 03:04:20.680438 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-9a625c05-ddd1-4934-907b-d989a35f9a6e req-420c192e-07c4-45e3-aa91-e98a33121543 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044639 Jul 18 03:04:20.682028 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3038/6098] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:04:20.836760 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fbdac2b1-bd22-4fd1-b959-9de34d1ba8b8 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:20.837529 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fbdac2b1-bd22-4fd1-b959-9de34d1ba8b8 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: 76c4b356-512b-4868-9c97-4006c9b36b97] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:20.845466 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fbdac2b1-bd22-4fd1-b959-9de34d1ba8b8 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:20.846857 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fbdac2b1-bd22-4fd1-b959-9de34d1ba8b8 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:20.849993 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fbdac2b1-bd22-4fd1-b959-9de34d1ba8b8 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:20.851976 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fbdac2b1-bd22-4fd1-b959-9de34d1ba8b8 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:20.869168 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f00bec29-ada8-487f-968e-90449ffdf225 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:20.870240 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f00bec29-ada8-487f-968e-90449ffdf225 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] [instance: 9df430a2-54be-4e36-ad3f-5d3f0455e798] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:20.886277 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f00bec29-ada8-487f-968e-90449ffdf225 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:20.890222 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f00bec29-ada8-487f-968e-90449ffdf225 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:20.891343 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f00bec29-ada8-487f-968e-90449ffdf225 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:20.891969 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f00bec29-ada8-487f-968e-90449ffdf225 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:21.484980 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fbdac2b1-bd22-4fd1-b959-9de34d1ba8b8 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:21.493611 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fbdac2b1-bd22-4fd1-b959-9de34d1ba8b8 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/76c4b356-512b-4868-9c97-4006c9b36b97" status: 200 len: 1373 microversion: 2.1 time: 0.660763 Jul 18 03:04:21.503124 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3061/6099] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:20 2022] GET /compute/v2.1/servers/76c4b356-512b-4868-9c97-4006c9b36b97 => generated 1373 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:21.575789 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-021abe6d-8fb0-4ab3-ac63-35097d2d68f6 req-95b0049d-da15-44b3-bba8-c13028669229 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76c4b356-512b-4868-9c97-4006c9b36b97", "tag": "a925e325-efe2-41ed-bb29-0b99d456f9d4"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:04:21.577324 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f00bec29-ada8-487f-968e-90449ffdf225 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b292cd0f2ac2413babe9e9aa482d0c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18601269ae5c48409ca994cb7d410213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:21.587293 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-021abe6d-8fb0-4ab3-ac63-35097d2d68f6 req-95b0049d-da15-44b3-bba8-c13028669229 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:21.588074 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-021abe6d-8fb0-4ab3-ac63-35097d2d68f6 req-95b0049d-da15-44b3-bba8-c13028669229 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:21.591452 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f00bec29-ada8-487f-968e-90449ffdf225 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] 10.222.0.57 "GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798" status: 200 len: 1428 microversion: 2.1 time: 0.728189 Jul 18 03:04:21.591672 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:04:21.602424 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3039/6100] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:20 2022] GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798 => generated 1428 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:21.607772 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-021abe6d-8fb0-4ab3-ac63-35097d2d68f6 req-95b0049d-da15-44b3-bba8-c13028669229 service nova] Creating event network-changed:a925e325-efe2-41ed-bb29-0b99d456f9d4 for instance 76c4b356-512b-4868-9c97-4006c9b36b97 on n-h1-465891-3 Jul 18 03:04:21.614116 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-021abe6d-8fb0-4ab3-ac63-35097d2d68f6 req-95b0049d-da15-44b3-bba8-c13028669229 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041575 Jul 18 03:04:21.615088 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3062/6101] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:04:21.634363 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b3671948-8e41-4173-920e-414671dd4764 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:21.635456 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b3671948-8e41-4173-920e-414671dd4764 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 62137bb4-7cff-4963-9636-51c09061f10d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:21.642092 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b3671948-8e41-4173-920e-414671dd4764 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:21.642769 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b3671948-8e41-4173-920e-414671dd4764 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:21.643316 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b3671948-8e41-4173-920e-414671dd4764 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:21.643757 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b3671948-8e41-4173-920e-414671dd4764 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:21.855065 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b3671948-8e41-4173-920e-414671dd4764 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:21.865502 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b3671948-8e41-4173-920e-414671dd4764 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d" status: 200 len: 1308 microversion: 2.1 time: 0.235381 Jul 18 03:04:21.866493 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3040/6102] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:21 2022] GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d => generated 1308 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:22.517604 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b2b24a39-382a-4ea6-bd20-46646b55d7c4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:22.518766 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b2b24a39-382a-4ea6-bd20-46646b55d7c4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: 76c4b356-512b-4868-9c97-4006c9b36b97] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:22.530856 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b2b24a39-382a-4ea6-bd20-46646b55d7c4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:22.531771 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b2b24a39-382a-4ea6-bd20-46646b55d7c4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:22.533172 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b2b24a39-382a-4ea6-bd20-46646b55d7c4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:22.533878 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b2b24a39-382a-4ea6-bd20-46646b55d7c4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:22.609748 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-de188847-a2af-4bf2-9f81-51e22d476665 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:22.610449 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-de188847-a2af-4bf2-9f81-51e22d476665 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] [instance: 9df430a2-54be-4e36-ad3f-5d3f0455e798] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:22.617582 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-de188847-a2af-4bf2-9f81-51e22d476665 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:22.618162 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-de188847-a2af-4bf2-9f81-51e22d476665 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:22.619095 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-de188847-a2af-4bf2-9f81-51e22d476665 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:22.619767 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-de188847-a2af-4bf2-9f81-51e22d476665 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:22.863469 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b2b24a39-382a-4ea6-bd20-46646b55d7c4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:22.873617 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b2b24a39-382a-4ea6-bd20-46646b55d7c4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/76c4b356-512b-4868-9c97-4006c9b36b97" status: 200 len: 1373 microversion: 2.1 time: 0.365892 Jul 18 03:04:22.875767 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3063/6103] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:22 2022] GET /compute/v2.1/servers/76c4b356-512b-4868-9c97-4006c9b36b97 => generated 1373 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:22.877821 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-de188847-a2af-4bf2-9f81-51e22d476665 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b292cd0f2ac2413babe9e9aa482d0c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18601269ae5c48409ca994cb7d410213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:22.881522 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-f1d7e030-4108-4796-a586-7595bc1a997a req-029c8df0-0bfd-4982-b40c-cb3315745773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62137bb4-7cff-4963-9636-51c09061f10d", "name": "network-vif-plugged", "status": "completed", "tag": "b0fdebec-48da-4526-881d-e6fb6db965c4"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:04:22.891780 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-f1d7e030-4108-4796-a586-7595bc1a997a req-029c8df0-0bfd-4982-b40c-cb3315745773 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:22.892421 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-f1d7e030-4108-4796-a586-7595bc1a997a req-029c8df0-0bfd-4982-b40c-cb3315745773 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:22.893467 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-de188847-a2af-4bf2-9f81-51e22d476665 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] 10.222.0.57 "GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798" status: 200 len: 1608 microversion: 2.1 time: 0.288538 Jul 18 03:04:22.894708 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3041/6104] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:22 2022] GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798 => generated 1608 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:22.906399 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-f1d7e030-4108-4796-a586-7595bc1a997a req-029c8df0-0bfd-4982-b40c-cb3315745773 service nova] Creating event network-vif-plugged:b0fdebec-48da-4526-881d-e6fb6db965c4 for instance 62137bb4-7cff-4963-9636-51c09061f10d on n-h2-465891-3 Jul 18 03:04:22.906881 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-edee574f-9a5f-447d-9fc8-2e6d5eca0857 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:22.907477 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-edee574f-9a5f-447d-9fc8-2e6d5eca0857 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 62137bb4-7cff-4963-9636-51c09061f10d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:22.912390 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-f1d7e030-4108-4796-a586-7595bc1a997a req-029c8df0-0bfd-4982-b40c-cb3315745773 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035248 Jul 18 03:04:22.913510 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3064/6105] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:04:22.914058 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-edee574f-9a5f-447d-9fc8-2e6d5eca0857 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:22.914980 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-edee574f-9a5f-447d-9fc8-2e6d5eca0857 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:22.916432 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-edee574f-9a5f-447d-9fc8-2e6d5eca0857 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:22.917226 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-edee574f-9a5f-447d-9fc8-2e6d5eca0857 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:22.920810 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-39c21902-5431-47ca-a2e8-4da185497d01 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:22.921737 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-39c21902-5431-47ca-a2e8-4da185497d01 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] [instance: 9df430a2-54be-4e36-ad3f-5d3f0455e798] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:22.947829 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-39c21902-5431-47ca-a2e8-4da185497d01 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:22.947829 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-39c21902-5431-47ca-a2e8-4da185497d01 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:22.947829 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-39c21902-5431-47ca-a2e8-4da185497d01 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:22.947829 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-39c21902-5431-47ca-a2e8-4da185497d01 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:23.331992 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-edee574f-9a5f-447d-9fc8-2e6d5eca0857 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:23.337891 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-39c21902-5431-47ca-a2e8-4da185497d01 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b292cd0f2ac2413babe9e9aa482d0c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18601269ae5c48409ca994cb7d410213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:23.347754 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-edee574f-9a5f-447d-9fc8-2e6d5eca0857 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d" status: 200 len: 1308 microversion: 2.1 time: 0.450862 Jul 18 03:04:23.348575 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3042/6106] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:22 2022] GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d => generated 1308 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:23.361985 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-39c21902-5431-47ca-a2e8-4da185497d01 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] 10.222.0.57 "GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798" status: 200 len: 1608 microversion: 2.1 time: 0.446621 Jul 18 03:04:23.362588 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3065/6107] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:22 2022] GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798 => generated 1608 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:23.381134 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f1ec2b37-1e2d-40fa-b3ce-6d58e9fae90b tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:23.381134 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f1ec2b37-1e2d-40fa-b3ce-6d58e9fae90b tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] [instance: 9df430a2-54be-4e36-ad3f-5d3f0455e798] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:23.387042 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f1ec2b37-1e2d-40fa-b3ce-6d58e9fae90b tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:23.387042 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f1ec2b37-1e2d-40fa-b3ce-6d58e9fae90b tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:23.388083 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f1ec2b37-1e2d-40fa-b3ce-6d58e9fae90b tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:23.388748 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f1ec2b37-1e2d-40fa-b3ce-6d58e9fae90b tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:23.533273 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f1ec2b37-1e2d-40fa-b3ce-6d58e9fae90b tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b292cd0f2ac2413babe9e9aa482d0c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18601269ae5c48409ca994cb7d410213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:23.543728 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f1ec2b37-1e2d-40fa-b3ce-6d58e9fae90b tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] 10.222.0.57 "GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798" status: 200 len: 1608 microversion: 2.1 time: 0.166990 Jul 18 03:04:23.543728 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3043/6108] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:23 2022] GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798 => generated 1608 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:23.892405 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6382f769-04a5-4a3f-a4ac-a1c190166dee tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:23.893012 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6382f769-04a5-4a3f-a4ac-a1c190166dee tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: 76c4b356-512b-4868-9c97-4006c9b36b97] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:23.900901 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6382f769-04a5-4a3f-a4ac-a1c190166dee tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:23.901366 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6382f769-04a5-4a3f-a4ac-a1c190166dee tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:23.902248 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6382f769-04a5-4a3f-a4ac-a1c190166dee tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:23.902701 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6382f769-04a5-4a3f-a4ac-a1c190166dee tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:24.061302 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6382f769-04a5-4a3f-a4ac-a1c190166dee tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:24.069859 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6382f769-04a5-4a3f-a4ac-a1c190166dee tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/76c4b356-512b-4868-9c97-4006c9b36b97" status: 200 len: 1373 microversion: 2.1 time: 0.181195 Jul 18 03:04:24.071046 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3066/6109] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:23 2022] GET /compute/v2.1/servers/76c4b356-512b-4868-9c97-4006c9b36b97 => generated 1373 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:24.365208 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8b1dabdf-267d-43e7-bfcd-844da1c86147 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:24.366076 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8b1dabdf-267d-43e7-bfcd-844da1c86147 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 62137bb4-7cff-4963-9636-51c09061f10d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:24.374770 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8b1dabdf-267d-43e7-bfcd-844da1c86147 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:24.375305 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8b1dabdf-267d-43e7-bfcd-844da1c86147 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:24.376235 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8b1dabdf-267d-43e7-bfcd-844da1c86147 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:24.376676 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8b1dabdf-267d-43e7-bfcd-844da1c86147 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:24.576118 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8b1dabdf-267d-43e7-bfcd-844da1c86147 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:24.584883 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8b1dabdf-267d-43e7-bfcd-844da1c86147 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d" status: 200 len: 1308 microversion: 2.1 time: 0.223707 Jul 18 03:04:24.586705 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3044/6110] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:24 2022] GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d => generated 1308 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:24.887363 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8246d6bd-e13f-4b12-8a07-393f735f2f2a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] Calling method '.version_select at 0x7ff49b6d1dc0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:24.916088 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8246d6bd-e13f-4b12-8a07-393f735f2f2a tempest-TestVolumeBootPattern-598001453 tempest-TestVolumeBootPattern-598001453-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-233278274" status: 202 len: 0 microversion: 2.1 time: 0.034758 Jul 18 03:04:24.920077 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3067/6111] 10.222.0.57 () {58 vars in 1259 bytes} [Mon Jul 18 03:04:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-233278274 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:04:25.088556 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-492355a5-0aba-4bf0-9a37-2f976d61ec03 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:25.089656 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-492355a5-0aba-4bf0-9a37-2f976d61ec03 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: 76c4b356-512b-4868-9c97-4006c9b36b97] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:25.096007 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-492355a5-0aba-4bf0-9a37-2f976d61ec03 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:25.096465 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-492355a5-0aba-4bf0-9a37-2f976d61ec03 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:25.097478 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-492355a5-0aba-4bf0-9a37-2f976d61ec03 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:25.098121 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-492355a5-0aba-4bf0-9a37-2f976d61ec03 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:25.548616 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-492355a5-0aba-4bf0-9a37-2f976d61ec03 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:25.565999 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-492355a5-0aba-4bf0-9a37-2f976d61ec03 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/76c4b356-512b-4868-9c97-4006c9b36b97" status: 200 len: 1373 microversion: 2.1 time: 0.482168 Jul 18 03:04:25.567242 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3045/6112] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:25 2022] GET /compute/v2.1/servers/76c4b356-512b-4868-9c97-4006c9b36b97 => generated 1373 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:25.595455 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-ac1d4b52-8526-4ea5-9613-4b39723c0808 req-409e0c94-1c5a-4d42-b3be-0876c6e524c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9df430a2-54be-4e36-ad3f-5d3f0455e798", "tag": "e9714ca5-cc91-49c7-95b3-7065a9d51897"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:04:25.605319 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-69c35d51-2a6e-4e50-85af-bdb25e275847 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:25.606326 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-69c35d51-2a6e-4e50-85af-bdb25e275847 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 62137bb4-7cff-4963-9636-51c09061f10d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:25.613567 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-ac1d4b52-8526-4ea5-9613-4b39723c0808 req-409e0c94-1c5a-4d42-b3be-0876c6e524c0 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:25.613942 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69c35d51-2a6e-4e50-85af-bdb25e275847 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:25.614545 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69c35d51-2a6e-4e50-85af-bdb25e275847 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:25.615297 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-ac1d4b52-8526-4ea5-9613-4b39723c0808 req-409e0c94-1c5a-4d42-b3be-0876c6e524c0 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:25.615521 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69c35d51-2a6e-4e50-85af-bdb25e275847 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:25.615950 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69c35d51-2a6e-4e50-85af-bdb25e275847 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:25.638256 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-ac1d4b52-8526-4ea5-9613-4b39723c0808 req-409e0c94-1c5a-4d42-b3be-0876c6e524c0 service nova] Creating event network-changed:e9714ca5-cc91-49c7-95b3-7065a9d51897 for instance 9df430a2-54be-4e36-ad3f-5d3f0455e798 on n-h1-465891-3 Jul 18 03:04:25.647755 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-ac1d4b52-8526-4ea5-9613-4b39723c0808 req-409e0c94-1c5a-4d42-b3be-0876c6e524c0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058901 Jul 18 03:04:25.649840 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3068/6113] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:04:26.265513 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-69c35d51-2a6e-4e50-85af-bdb25e275847 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:26.285003 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-69c35d51-2a6e-4e50-85af-bdb25e275847 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d" status: 200 len: 1488 microversion: 2.1 time: 0.685208 Jul 18 03:04:26.286256 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3046/6114] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:25 2022] GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d => generated 1488 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:26.314179 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5faaa38c-cce9-41ab-8da5-b8df1353b5ae tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:04:26.315775 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5faaa38c-cce9-41ab-8da5-b8df1353b5ae tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 62137bb4-7cff-4963-9636-51c09061f10d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:26.324309 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5faaa38c-cce9-41ab-8da5-b8df1353b5ae tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:26.324936 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5faaa38c-cce9-41ab-8da5-b8df1353b5ae tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:26.325914 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5faaa38c-cce9-41ab-8da5-b8df1353b5ae tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:26.326488 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5faaa38c-cce9-41ab-8da5-b8df1353b5ae tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:26.455809 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5faaa38c-cce9-41ab-8da5-b8df1353b5ae tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "PUT /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d" status: 200 len: 1083 microversion: 2.1 time: 0.147017 Jul 18 03:04:26.456925 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3069/6115] 10.222.0.57 () {60 vars in 1255 bytes} [Mon Jul 18 03:04:26 2022] PUT /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d => generated 1083 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:26.477434 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e2a02dbf-5b5b-4b82-8ea8-10aa19486eb6 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:26.479181 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e2a02dbf-5b5b-4b82-8ea8-10aa19486eb6 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 62137bb4-7cff-4963-9636-51c09061f10d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:26.492449 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e2a02dbf-5b5b-4b82-8ea8-10aa19486eb6 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:26.493783 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e2a02dbf-5b5b-4b82-8ea8-10aa19486eb6 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:26.495899 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e2a02dbf-5b5b-4b82-8ea8-10aa19486eb6 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:26.496964 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e2a02dbf-5b5b-4b82-8ea8-10aa19486eb6 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:26.584691 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bde47c67-de21-455e-85a6-074557a50f97 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:26.585618 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bde47c67-de21-455e-85a6-074557a50f97 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: 76c4b356-512b-4868-9c97-4006c9b36b97] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:26.592911 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bde47c67-de21-455e-85a6-074557a50f97 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:26.594072 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bde47c67-de21-455e-85a6-074557a50f97 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:26.594902 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bde47c67-de21-455e-85a6-074557a50f97 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:26.595365 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bde47c67-de21-455e-85a6-074557a50f97 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:26.996697 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e2a02dbf-5b5b-4b82-8ea8-10aa19486eb6 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:27.008814 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e2a02dbf-5b5b-4b82-8ea8-10aa19486eb6 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d" status: 200 len: 1509 microversion: 2.1 time: 0.538862 Jul 18 03:04:27.010084 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3047/6116] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:26 2022] GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d => generated 1509 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:04:27.033580 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d2aa9295-4644-4dc5-a5ff-d759c71d3b16 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:27.034406 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d2aa9295-4644-4dc5-a5ff-d759c71d3b16 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 62137bb4-7cff-4963-9636-51c09061f10d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:27.047361 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d2aa9295-4644-4dc5-a5ff-d759c71d3b16 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:27.047928 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d2aa9295-4644-4dc5-a5ff-d759c71d3b16 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:27.048976 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d2aa9295-4644-4dc5-a5ff-d759c71d3b16 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:27.050601 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d2aa9295-4644-4dc5-a5ff-d759c71d3b16 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:27.082556 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bde47c67-de21-455e-85a6-074557a50f97 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:27.093360 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bde47c67-de21-455e-85a6-074557a50f97 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/76c4b356-512b-4868-9c97-4006c9b36b97" status: 200 len: 1373 microversion: 2.1 time: 0.512522 Jul 18 03:04:27.104134 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3070/6117] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:26 2022] GET /compute/v2.1/servers/76c4b356-512b-4868-9c97-4006c9b36b97 => generated 1373 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:04:27.380012 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d2aa9295-4644-4dc5-a5ff-d759c71d3b16 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:27.391399 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d2aa9295-4644-4dc5-a5ff-d759c71d3b16 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d" status: 200 len: 1509 microversion: 2.1 time: 0.361850 Jul 18 03:04:27.392129 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3048/6118] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:27 2022] GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d => generated 1509 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:04:27.407842 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a967be89-c5a8-4d2c-8344-96ae291e7df1 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:27.408461 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a967be89-c5a8-4d2c-8344-96ae291e7df1 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 62137bb4-7cff-4963-9636-51c09061f10d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:27.410741 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:04:27.411440 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:04:27.419926 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a967be89-c5a8-4d2c-8344-96ae291e7df1 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:27.420397 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a967be89-c5a8-4d2c-8344-96ae291e7df1 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:27.421249 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a967be89-c5a8-4d2c-8344-96ae291e7df1 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:27.421728 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a967be89-c5a8-4d2c-8344-96ae291e7df1 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:27.453800 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a967be89-c5a8-4d2c-8344-96ae291e7df1 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 62137bb4-7cff-4963-9636-51c09061f10d] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:04:27.565889 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a967be89-c5a8-4d2c-8344-96ae291e7df1 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "DELETE /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d" status: 204 len: 0 microversion: 2.1 time: 0.161611 Jul 18 03:04:27.566803 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3071/6119] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:04:27 2022] DELETE /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:04:27.578577 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6b48b48c-5248-4a8d-b930-2ff504f251ef tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:27.579613 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6b48b48c-5248-4a8d-b930-2ff504f251ef tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 62137bb4-7cff-4963-9636-51c09061f10d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:27.584692 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=16 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:04:27.592570 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b48b48c-5248-4a8d-b930-2ff504f251ef tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:27.592882 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b48b48c-5248-4a8d-b930-2ff504f251ef tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:27.593674 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b48b48c-5248-4a8d-b930-2ff504f251ef tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:27.594134 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b48b48c-5248-4a8d-b930-2ff504f251ef tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:27.830494 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6b48b48c-5248-4a8d-b930-2ff504f251ef tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:27.843133 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6b48b48c-5248-4a8d-b930-2ff504f251ef tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d" status: 200 len: 1515 microversion: 2.1 time: 0.270347 Jul 18 03:04:27.843859 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3049/6120] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:27 2022] GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d => generated 1515 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:28.111534 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7f9caa1d-e230-4282-afb0-0b39e4f10708 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:28.112160 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7f9caa1d-e230-4282-afb0-0b39e4f10708 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: 76c4b356-512b-4868-9c97-4006c9b36b97] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:28.118496 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7f9caa1d-e230-4282-afb0-0b39e4f10708 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:28.118979 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7f9caa1d-e230-4282-afb0-0b39e4f10708 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:28.119776 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7f9caa1d-e230-4282-afb0-0b39e4f10708 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:28.120222 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7f9caa1d-e230-4282-afb0-0b39e4f10708 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:28.354937 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7f9caa1d-e230-4282-afb0-0b39e4f10708 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:28.362831 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7f9caa1d-e230-4282-afb0-0b39e4f10708 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/76c4b356-512b-4868-9c97-4006c9b36b97" status: 200 len: 1373 microversion: 2.1 time: 0.255412 Jul 18 03:04:28.363384 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3072/6121] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:28 2022] GET /compute/v2.1/servers/76c4b356-512b-4868-9c97-4006c9b36b97 => generated 1373 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:28.860466 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d65e7172-7ef1-45f4-b146-413b5e27e05d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:28.861089 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d65e7172-7ef1-45f4-b146-413b5e27e05d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 62137bb4-7cff-4963-9636-51c09061f10d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:28.869971 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d65e7172-7ef1-45f4-b146-413b5e27e05d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:28.870463 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d65e7172-7ef1-45f4-b146-413b5e27e05d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:28.871706 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d65e7172-7ef1-45f4-b146-413b5e27e05d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:28.872321 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d65e7172-7ef1-45f4-b146-413b5e27e05d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:29.259279 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d65e7172-7ef1-45f4-b146-413b5e27e05d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:29.272288 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d65e7172-7ef1-45f4-b146-413b5e27e05d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d" status: 200 len: 1515 microversion: 2.1 time: 0.415660 Jul 18 03:04:29.273228 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3050/6122] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:28 2022] GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d => generated 1515 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:29.380526 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b6dbf0a4-b724-4da9-a585-390071a6663f tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:29.381152 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b6dbf0a4-b724-4da9-a585-390071a6663f tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: 76c4b356-512b-4868-9c97-4006c9b36b97] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:29.403001 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b6dbf0a4-b724-4da9-a585-390071a6663f tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:29.403471 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b6dbf0a4-b724-4da9-a585-390071a6663f tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:29.404271 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b6dbf0a4-b724-4da9-a585-390071a6663f tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:29.404721 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b6dbf0a4-b724-4da9-a585-390071a6663f tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:29.863310 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b6dbf0a4-b724-4da9-a585-390071a6663f tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:29.872058 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b6dbf0a4-b724-4da9-a585-390071a6663f tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/76c4b356-512b-4868-9c97-4006c9b36b97" status: 200 len: 1373 microversion: 2.1 time: 0.495361 Jul 18 03:04:29.872711 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3073/6123] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:29 2022] GET /compute/v2.1/servers/76c4b356-512b-4868-9c97-4006c9b36b97 => generated 1373 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:30.290327 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6314fbda-22a8-4882-bc4a-20fbf8e5c96c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:30.291517 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6314fbda-22a8-4882-bc4a-20fbf8e5c96c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 62137bb4-7cff-4963-9636-51c09061f10d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:30.299802 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6314fbda-22a8-4882-bc4a-20fbf8e5c96c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:30.300446 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6314fbda-22a8-4882-bc4a-20fbf8e5c96c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:30.301615 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6314fbda-22a8-4882-bc4a-20fbf8e5c96c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:30.302303 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6314fbda-22a8-4882-bc4a-20fbf8e5c96c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:30.328744 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=100 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:04:30.502997 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6314fbda-22a8-4882-bc4a-20fbf8e5c96c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:30.507480 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-7cf3b8f8-cf2c-4500-a65a-6cacb74b0835 req-3b8763ab-9ddd-42c6-a84d-b7ac315f3e87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62137bb4-7cff-4963-9636-51c09061f10d", "name": "network-vif-deleted", "tag": "b0fdebec-48da-4526-881d-e6fb6db965c4"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:04:30.513325 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6314fbda-22a8-4882-bc4a-20fbf8e5c96c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d" status: 200 len: 1473 microversion: 2.1 time: 0.227650 Jul 18 03:04:30.514087 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3051/6124] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:30 2022] GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d => generated 1473 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:30.533406 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-7cf3b8f8-cf2c-4500-a65a-6cacb74b0835 req-3b8763ab-9ddd-42c6-a84d-b7ac315f3e87 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:30.534176 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-7cf3b8f8-cf2c-4500-a65a-6cacb74b0835 req-3b8763ab-9ddd-42c6-a84d-b7ac315f3e87 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:30.555489 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-7cf3b8f8-cf2c-4500-a65a-6cacb74b0835 req-3b8763ab-9ddd-42c6-a84d-b7ac315f3e87 service nova] Creating event network-vif-deleted:b0fdebec-48da-4526-881d-e6fb6db965c4 for instance 62137bb4-7cff-4963-9636-51c09061f10d on n-h2-465891-3 Jul 18 03:04:30.563502 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-7cf3b8f8-cf2c-4500-a65a-6cacb74b0835 req-3b8763ab-9ddd-42c6-a84d-b7ac315f3e87 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063337 Jul 18 03:04:30.564625 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3074/6125] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:04:30.848349 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-14d3e7c9-11e2-42f4-9948-0819f1063721 req-60dfcf54-cb5e-4d80-9530-cc68e92a5404 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76c4b356-512b-4868-9c97-4006c9b36b97", "name": "network-vif-plugged", "status": "completed", "tag": "a925e325-efe2-41ed-bb29-0b99d456f9d4"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:04:30.857667 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-14d3e7c9-11e2-42f4-9948-0819f1063721 req-60dfcf54-cb5e-4d80-9530-cc68e92a5404 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:30.858455 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-14d3e7c9-11e2-42f4-9948-0819f1063721 req-60dfcf54-cb5e-4d80-9530-cc68e92a5404 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:30.872347 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-14d3e7c9-11e2-42f4-9948-0819f1063721 req-60dfcf54-cb5e-4d80-9530-cc68e92a5404 service nova] Creating event network-vif-plugged:a925e325-efe2-41ed-bb29-0b99d456f9d4 for instance 76c4b356-512b-4868-9c97-4006c9b36b97 on n-h1-465891-3 Jul 18 03:04:30.879542 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-14d3e7c9-11e2-42f4-9948-0819f1063721 req-60dfcf54-cb5e-4d80-9530-cc68e92a5404 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034983 Jul 18 03:04:30.880778 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3052/6126] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:04:30.891421 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-68e5d88d-5d80-4052-a9db-23923635f0ed tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:30.892406 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-68e5d88d-5d80-4052-a9db-23923635f0ed tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: 76c4b356-512b-4868-9c97-4006c9b36b97] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:30.901395 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-68e5d88d-5d80-4052-a9db-23923635f0ed tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:30.902102 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-68e5d88d-5d80-4052-a9db-23923635f0ed tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:30.903115 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-68e5d88d-5d80-4052-a9db-23923635f0ed tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:30.903770 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-68e5d88d-5d80-4052-a9db-23923635f0ed tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:31.189885 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-68e5d88d-5d80-4052-a9db-23923635f0ed tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:31.201766 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-68e5d88d-5d80-4052-a9db-23923635f0ed tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/76c4b356-512b-4868-9c97-4006c9b36b97" status: 200 len: 1373 microversion: 2.1 time: 0.314375 Jul 18 03:04:31.202699 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3075/6127] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:30 2022] GET /compute/v2.1/servers/76c4b356-512b-4868-9c97-4006c9b36b97 => generated 1373 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:04:31.532447 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-78ddef7e-e386-4db7-965f-65a730e22761 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:31.533150 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-78ddef7e-e386-4db7-965f-65a730e22761 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 62137bb4-7cff-4963-9636-51c09061f10d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:31.540576 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-78ddef7e-e386-4db7-965f-65a730e22761 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:31.541310 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-78ddef7e-e386-4db7-965f-65a730e22761 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:31.542431 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-78ddef7e-e386-4db7-965f-65a730e22761 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:31.543093 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-78ddef7e-e386-4db7-965f-65a730e22761 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:31.565846 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-78ddef7e-e386-4db7-965f-65a730e22761 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] HTTP exception thrown: Instance 62137bb4-7cff-4963-9636-51c09061f10d could not be found. Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-78ddef7e-e386-4db7-965f-65a730e22761 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Request method failure captured: Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d HTTP/1.1 Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M0c--VxkhAcA4gIHXxijKFI-k8Bpror72Hk1qb235rYnfDmQTByX9LOOCSekEaTY-qK46fTc9MDDZBpaIS7PRARBL52HY7fvnzNvoh5YO0XpJvHbsKLywLFoe1R8EGrLF6lPIQIdQdkEzZxbEDXhePA7F15YYp44S7QRWnysLrh4M4 Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3a83c4dedef341a0bb50fa4c119d3035"}]}] Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersTestJSON-1250523732 Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersTestJSON-1250523732-project Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 785ff643c00746939bb0fecd775ce920 Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersTestJSON-1250523732-project Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 62137bb4-7cff-4963-9636-51c09061f10d could not be found. Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '62137bb4-7cff-4963-9636-51c09061f10d'} Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62137bb4-7cff-4963-9636-51c09061f10d could not be found. Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62137bb4-7cff-4963-9636-51c09061f10d could not be found. Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:04:31.567608 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:04:31.572447 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:04:31.572447 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:04:31.572447 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:04:31.572447 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:04:31.572447 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62137bb4-7cff-4963-9636-51c09061f10d could not be found. Jul 18 03:04:31.572447 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:04:31.572447 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-78ddef7e-e386-4db7-965f-65a730e22761 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Returning 404 to user: Instance 62137bb4-7cff-4963-9636-51c09061f10d could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:04:31.572447 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-78ddef7e-e386-4db7-965f-65a730e22761 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d" status: 404 len: 111 microversion: 2.1 time: 0.041705 Jul 18 03:04:31.572447 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3053/6128] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:31 2022] GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:04:31.693481 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-94eb2804-9f1f-48fd-8523-9e40a07fff8f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1775119296", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "c540b69b-e7cc-4fa1-8fc6-67859b3d0823"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:04:31.761188 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-94eb2804-9f1f-48fd-8523-9e40a07fff8f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] validate_networks() for [('c540b69b-e7cc-4fa1-8fc6-67859b3d0823', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:04:32.221825 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b4b93731-8d0f-46f2-8118-41ebcd227bf1 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:32.222465 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b4b93731-8d0f-46f2-8118-41ebcd227bf1 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: 76c4b356-512b-4868-9c97-4006c9b36b97] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:32.230241 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b4b93731-8d0f-46f2-8118-41ebcd227bf1 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:32.230708 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b4b93731-8d0f-46f2-8118-41ebcd227bf1 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:32.231511 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b4b93731-8d0f-46f2-8118-41ebcd227bf1 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:32.231955 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b4b93731-8d0f-46f2-8118-41ebcd227bf1 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:32.621167 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b4b93731-8d0f-46f2-8118-41ebcd227bf1 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:32.628695 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b4b93731-8d0f-46f2-8118-41ebcd227bf1 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/76c4b356-512b-4868-9c97-4006c9b36b97" status: 200 len: 1373 microversion: 2.1 time: 0.410894 Jul 18 03:04:32.629315 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3054/6129] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:32 2022] GET /compute/v2.1/servers/76c4b356-512b-4868-9c97-4006c9b36b97 => generated 1373 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:04:32.840078 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-94eb2804-9f1f-48fd-8523-9e40a07fff8f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:04:32.840658 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-94eb2804-9f1f-48fd-8523-9e40a07fff8f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:04:32.841002 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-94eb2804-9f1f-48fd-8523-9e40a07fff8f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:04:32.841618 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-94eb2804-9f1f-48fd-8523-9e40a07fff8f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:04:32.842089 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-94eb2804-9f1f-48fd-8523-9e40a07fff8f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:04:32.856747 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-94eb2804-9f1f-48fd-8523-9e40a07fff8f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:32.857207 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-94eb2804-9f1f-48fd-8523-9e40a07fff8f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:32.858066 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-94eb2804-9f1f-48fd-8523-9e40a07fff8f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:32.858863 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-94eb2804-9f1f-48fd-8523-9e40a07fff8f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:32.878115 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-94eb2804-9f1f-48fd-8523-9e40a07fff8f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Getting quotas for project 3a83c4dedef341a0bb50fa4c119d3035. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:04:32.884592 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-94eb2804-9f1f-48fd-8523-9e40a07fff8f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Getting quotas for user 785ff643c00746939bb0fecd775ce920 and project 3a83c4dedef341a0bb50fa4c119d3035. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:04:32.887404 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:04:32.902538 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-94eb2804-9f1f-48fd-8523-9e40a07fff8f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:04:32.904914 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-94eb2804-9f1f-48fd-8523-9e40a07fff8f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:04:32.956824 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-94eb2804-9f1f-48fd-8523-9e40a07fff8f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.267199 Jul 18 03:04:32.957597 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3076/6130] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:04:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1269 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:04:32.968311 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9b9a7bfc-a0ca-422e-baa1-0b2498d61472 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:32.968940 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9b9a7bfc-a0ca-422e-baa1-0b2498d61472 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:33.055761 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9b9a7bfc-a0ca-422e-baa1-0b2498d61472 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:33.066804 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9b9a7bfc-a0ca-422e-baa1-0b2498d61472 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1209 microversion: 2.1 time: 0.102216 Jul 18 03:04:33.069040 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3055/6131] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:32 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1209 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:33.655850 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-afc898b3-82a4-4e29-9509-a3ed4396eabc tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:33.657687 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-afc898b3-82a4-4e29-9509-a3ed4396eabc tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: 76c4b356-512b-4868-9c97-4006c9b36b97] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:33.676010 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-afc898b3-82a4-4e29-9509-a3ed4396eabc tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:33.678435 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-afc898b3-82a4-4e29-9509-a3ed4396eabc tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:33.681967 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-afc898b3-82a4-4e29-9509-a3ed4396eabc tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:33.683165 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-afc898b3-82a4-4e29-9509-a3ed4396eabc tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:34.002842 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-afc898b3-82a4-4e29-9509-a3ed4396eabc tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:34.012478 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-afc898b3-82a4-4e29-9509-a3ed4396eabc tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/76c4b356-512b-4868-9c97-4006c9b36b97" status: 200 len: 1546 microversion: 2.1 time: 0.367591 Jul 18 03:04:34.013546 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3077/6132] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:33 2022] GET /compute/v2.1/servers/76c4b356-512b-4868-9c97-4006c9b36b97 => generated 1546 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:34.030512 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bab8a6f4-4f6d-4a95-9751-df89fdce6ce4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:34.031302 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bab8a6f4-4f6d-4a95-9751-df89fdce6ce4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: 76c4b356-512b-4868-9c97-4006c9b36b97] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:34.040836 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bab8a6f4-4f6d-4a95-9751-df89fdce6ce4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:34.041450 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bab8a6f4-4f6d-4a95-9751-df89fdce6ce4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:34.042407 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bab8a6f4-4f6d-4a95-9751-df89fdce6ce4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:34.042951 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bab8a6f4-4f6d-4a95-9751-df89fdce6ce4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:34.090270 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0ae8f209-0141-42e2-9078-7cbd6a78270c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:34.091232 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0ae8f209-0141-42e2-9078-7cbd6a78270c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:34.099589 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0ae8f209-0141-42e2-9078-7cbd6a78270c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:34.100405 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0ae8f209-0141-42e2-9078-7cbd6a78270c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:34.101452 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0ae8f209-0141-42e2-9078-7cbd6a78270c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:34.102492 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0ae8f209-0141-42e2-9078-7cbd6a78270c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:34.263816 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0ae8f209-0141-42e2-9078-7cbd6a78270c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:34.272437 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0ae8f209-0141-42e2-9078-7cbd6a78270c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1261 microversion: 2.1 time: 0.189710 Jul 18 03:04:34.273033 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3078/6133] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:34 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1261 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:04:34.455165 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bab8a6f4-4f6d-4a95-9751-df89fdce6ce4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:34.468014 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bab8a6f4-4f6d-4a95-9751-df89fdce6ce4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/76c4b356-512b-4868-9c97-4006c9b36b97" status: 200 len: 1546 microversion: 2.1 time: 0.441274 Jul 18 03:04:34.479724 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3056/6134] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:34 2022] GET /compute/v2.1/servers/76c4b356-512b-4868-9c97-4006c9b36b97 => generated 1546 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:04:35.300598 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6aec2cee-c1f9-4452-9314-bafbc70be72e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:35.303921 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6aec2cee-c1f9-4452-9314-bafbc70be72e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:35.313478 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6aec2cee-c1f9-4452-9314-bafbc70be72e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:35.322869 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6aec2cee-c1f9-4452-9314-bafbc70be72e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:35.323873 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6aec2cee-c1f9-4452-9314-bafbc70be72e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:35.324430 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6aec2cee-c1f9-4452-9314-bafbc70be72e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:35.657091 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6aec2cee-c1f9-4452-9314-bafbc70be72e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:35.677667 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6aec2cee-c1f9-4452-9314-bafbc70be72e tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1309 microversion: 2.1 time: 0.389896 Jul 18 03:04:35.678325 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3079/6135] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:35 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1309 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:36.699354 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-65343a22-9469-4ef3-9af4-4aa5518619de tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:36.700181 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-65343a22-9469-4ef3-9af4-4aa5518619de tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:36.714461 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65343a22-9469-4ef3-9af4-4aa5518619de tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:36.715506 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65343a22-9469-4ef3-9af4-4aa5518619de tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:36.716554 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65343a22-9469-4ef3-9af4-4aa5518619de tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:36.717388 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65343a22-9469-4ef3-9af4-4aa5518619de tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:37.111890 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-65343a22-9469-4ef3-9af4-4aa5518619de tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:37.125514 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-65343a22-9469-4ef3-9af4-4aa5518619de tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1309 microversion: 2.1 time: 0.432624 Jul 18 03:04:37.127588 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3057/6136] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:36 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1309 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:04:37.399939 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-7342a2fe-661d-4d89-8e4e-7c160b88c232 req-002ee48b-3722-4f8c-a036-66bdcdce5ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b85f7c0-8e95-4f8b-9e99-4d43f6497d00", "tag": "a1862342-3719-45b3-a991-001de625640e"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:04:37.425200 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-7342a2fe-661d-4d89-8e4e-7c160b88c232 req-002ee48b-3722-4f8c-a036-66bdcdce5ff2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:37.425490 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-7342a2fe-661d-4d89-8e4e-7c160b88c232 req-002ee48b-3722-4f8c-a036-66bdcdce5ff2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:37.460273 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-7342a2fe-661d-4d89-8e4e-7c160b88c232 req-002ee48b-3722-4f8c-a036-66bdcdce5ff2 service nova] Creating event network-changed:a1862342-3719-45b3-a991-001de625640e for instance 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 on n-h2-465891-3 Jul 18 03:04:37.470134 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-7342a2fe-661d-4d89-8e4e-7c160b88c232 req-002ee48b-3722-4f8c-a036-66bdcdce5ff2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074956 Jul 18 03:04:37.474538 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3080/6137] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:04:38.147776 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2eac161e-12fc-47fb-a017-15ac3eca1a1a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:38.149396 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2eac161e-12fc-47fb-a017-15ac3eca1a1a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:38.158397 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2eac161e-12fc-47fb-a017-15ac3eca1a1a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:38.158921 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2eac161e-12fc-47fb-a017-15ac3eca1a1a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:38.160022 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2eac161e-12fc-47fb-a017-15ac3eca1a1a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:38.168459 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2eac161e-12fc-47fb-a017-15ac3eca1a1a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:38.417086 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2eac161e-12fc-47fb-a017-15ac3eca1a1a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:38.425814 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2eac161e-12fc-47fb-a017-15ac3eca1a1a tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1309 microversion: 2.1 time: 0.283438 Jul 18 03:04:38.426538 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3058/6138] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:38 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1309 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:39.448911 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7b6cf80f-2b84-47d0-b24c-481ba909d5c4 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:39.453091 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7b6cf80f-2b84-47d0-b24c-481ba909d5c4 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:39.464826 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7b6cf80f-2b84-47d0-b24c-481ba909d5c4 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:39.465945 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7b6cf80f-2b84-47d0-b24c-481ba909d5c4 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:39.467728 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7b6cf80f-2b84-47d0-b24c-481ba909d5c4 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:39.471230 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7b6cf80f-2b84-47d0-b24c-481ba909d5c4 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:39.501480 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:04:39.767349 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7b6cf80f-2b84-47d0-b24c-481ba909d5c4 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:39.782062 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7b6cf80f-2b84-47d0-b24c-481ba909d5c4 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1309 microversion: 2.1 time: 0.342273 Jul 18 03:04:39.784370 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3081/6139] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:39 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1309 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:40.800527 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-79ded135-550e-4fc2-af7a-4a36c5106740 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:40.801157 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-79ded135-550e-4fc2-af7a-4a36c5106740 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:40.813347 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-79ded135-550e-4fc2-af7a-4a36c5106740 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:40.814158 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-79ded135-550e-4fc2-af7a-4a36c5106740 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:40.815093 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-79ded135-550e-4fc2-af7a-4a36c5106740 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:40.815486 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-79ded135-550e-4fc2-af7a-4a36c5106740 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:40.995265 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-79ded135-550e-4fc2-af7a-4a36c5106740 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:41.003540 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-79ded135-550e-4fc2-af7a-4a36c5106740 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1309 microversion: 2.1 time: 0.206939 Jul 18 03:04:41.004135 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3059/6140] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:40 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1309 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:42.021864 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4a6af0db-6e2c-46ab-96d3-c9d5c3cf9d39 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:42.022429 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4a6af0db-6e2c-46ab-96d3-c9d5c3cf9d39 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:42.029975 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4a6af0db-6e2c-46ab-96d3-c9d5c3cf9d39 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:42.030443 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4a6af0db-6e2c-46ab-96d3-c9d5c3cf9d39 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:42.031242 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4a6af0db-6e2c-46ab-96d3-c9d5c3cf9d39 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:42.031693 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4a6af0db-6e2c-46ab-96d3-c9d5c3cf9d39 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:42.174927 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4a6af0db-6e2c-46ab-96d3-c9d5c3cf9d39 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:42.183383 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4a6af0db-6e2c-46ab-96d3-c9d5c3cf9d39 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1309 microversion: 2.1 time: 0.165818 Jul 18 03:04:42.183982 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3082/6141] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:42 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1309 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:42.920366 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-9411dc5d-2138-4ba2-9626-ba0c939a59bd req-705c3474-b74b-438e-873f-a4e6364b8f4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b85f7c0-8e95-4f8b-9e99-4d43f6497d00", "name": "network-vif-plugged", "status": "completed", "tag": "a1862342-3719-45b3-a991-001de625640e"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:04:42.929624 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-9411dc5d-2138-4ba2-9626-ba0c939a59bd req-705c3474-b74b-438e-873f-a4e6364b8f4f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:42.930718 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-9411dc5d-2138-4ba2-9626-ba0c939a59bd req-705c3474-b74b-438e-873f-a4e6364b8f4f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:42.942284 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-9411dc5d-2138-4ba2-9626-ba0c939a59bd req-705c3474-b74b-438e-873f-a4e6364b8f4f service nova] Creating event network-vif-plugged:a1862342-3719-45b3-a991-001de625640e for instance 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 on n-h2-465891-3 Jul 18 03:04:42.948181 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-9411dc5d-2138-4ba2-9626-ba0c939a59bd req-705c3474-b74b-438e-873f-a4e6364b8f4f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031278 Jul 18 03:04:42.948854 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3060/6142] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:04:43.201259 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-141d816e-f4ff-4cad-aedf-fe33ab995937 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:43.201847 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-141d816e-f4ff-4cad-aedf-fe33ab995937 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:43.203763 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:04:43.204457 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:04:43.213128 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-141d816e-f4ff-4cad-aedf-fe33ab995937 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:43.213601 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-141d816e-f4ff-4cad-aedf-fe33ab995937 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:43.214429 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-141d816e-f4ff-4cad-aedf-fe33ab995937 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:43.214890 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-141d816e-f4ff-4cad-aedf-fe33ab995937 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:43.364729 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-141d816e-f4ff-4cad-aedf-fe33ab995937 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:43.378799 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-141d816e-f4ff-4cad-aedf-fe33ab995937 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1309 microversion: 2.1 time: 0.181473 Jul 18 03:04:43.379624 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3083/6143] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:43 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1309 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:44.393478 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:04:44.400262 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-740fb576-00ee-4a65-bd83-fd0540cb0d27 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:44.401006 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-740fb576-00ee-4a65-bd83-fd0540cb0d27 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:44.408628 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-740fb576-00ee-4a65-bd83-fd0540cb0d27 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:44.409078 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-740fb576-00ee-4a65-bd83-fd0540cb0d27 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:44.409921 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-740fb576-00ee-4a65-bd83-fd0540cb0d27 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:44.410357 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-740fb576-00ee-4a65-bd83-fd0540cb0d27 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:44.543983 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-740fb576-00ee-4a65-bd83-fd0540cb0d27 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:44.551685 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-740fb576-00ee-4a65-bd83-fd0540cb0d27 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1489 microversion: 2.1 time: 0.159109 Jul 18 03:04:44.552273 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3061/6144] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:44 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1489 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:44.569737 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ca83a796-6341-48f2-8bf0-0624601ff3a4 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1161611955"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:04:44.571861 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ca83a796-6341-48f2-8bf0-0624601ff3a4 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:44.579157 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ca83a796-6341-48f2-8bf0-0624601ff3a4 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:44.579633 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ca83a796-6341-48f2-8bf0-0624601ff3a4 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:44.580452 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ca83a796-6341-48f2-8bf0-0624601ff3a4 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:44.580903 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ca83a796-6341-48f2-8bf0-0624601ff3a4 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:44.647904 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ca83a796-6341-48f2-8bf0-0624601ff3a4 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "PUT /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1074 microversion: 2.1 time: 0.082492 Jul 18 03:04:44.648464 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3084/6145] 10.222.0.57 () {60 vars in 1255 bytes} [Mon Jul 18 03:04:44 2022] PUT /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1074 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:44.662350 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3f185761-ec6a-40a7-b30b-adbaf03564db tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:44.662989 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3f185761-ec6a-40a7-b30b-adbaf03564db tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:44.669785 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3f185761-ec6a-40a7-b30b-adbaf03564db tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:44.670237 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3f185761-ec6a-40a7-b30b-adbaf03564db tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:44.671026 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3f185761-ec6a-40a7-b30b-adbaf03564db tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:44.671465 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3f185761-ec6a-40a7-b30b-adbaf03564db tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:44.808202 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3f185761-ec6a-40a7-b30b-adbaf03564db tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:44.816033 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3f185761-ec6a-40a7-b30b-adbaf03564db tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1500 microversion: 2.1 time: 0.157591 Jul 18 03:04:44.816627 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3062/6146] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:44 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1500 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:44.832008 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2249c47e-df59-4de3-9fa6-fb00886d543b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:44.832637 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2249c47e-df59-4de3-9fa6-fb00886d543b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:44.839532 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2249c47e-df59-4de3-9fa6-fb00886d543b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:44.839995 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2249c47e-df59-4de3-9fa6-fb00886d543b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:44.840791 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2249c47e-df59-4de3-9fa6-fb00886d543b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:44.841242 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2249c47e-df59-4de3-9fa6-fb00886d543b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:44.981385 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2249c47e-df59-4de3-9fa6-fb00886d543b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:44.993111 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2249c47e-df59-4de3-9fa6-fb00886d543b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1500 microversion: 2.1 time: 0.161127 Jul 18 03:04:44.993111 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3085/6147] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:44 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1500 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:45.006735 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-10c16e57-c858-48d8-85cc-bb430c3fbe3b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:04:45.013222 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-10c16e57-c858-48d8-85cc-bb430c3fbe3b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:45.013814 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-10c16e57-c858-48d8-85cc-bb430c3fbe3b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:45.037493 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-10c16e57-c858-48d8-85cc-bb430c3fbe3b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Going to try to stop instance {{(pid=119544) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 03:04:45.082374 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-10c16e57-c858-48d8-85cc-bb430c3fbe3b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "POST /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00/action" status: 202 len: 0 microversion: 2.1 time: 0.079348 Jul 18 03:04:45.083063 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3063/6148] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:04:45 2022] POST /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:04:45.093612 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0bcd98fd-4666-4bef-b732-80c8f6f34908 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:45.094422 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0bcd98fd-4666-4bef-b732-80c8f6f34908 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:45.100999 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0bcd98fd-4666-4bef-b732-80c8f6f34908 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:45.101495 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0bcd98fd-4666-4bef-b732-80c8f6f34908 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:45.102984 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0bcd98fd-4666-4bef-b732-80c8f6f34908 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:45.103389 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0bcd98fd-4666-4bef-b732-80c8f6f34908 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:45.248793 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0bcd98fd-4666-4bef-b732-80c8f6f34908 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:45.256511 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0bcd98fd-4666-4bef-b732-80c8f6f34908 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1510 microversion: 2.1 time: 0.167669 Jul 18 03:04:45.257089 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3086/6149] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:45 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:04:46.275417 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-27bbf7c6-d3c0-4064-af5a-a783dfb85f93 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:46.276125 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-27bbf7c6-d3c0-4064-af5a-a783dfb85f93 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:46.282939 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-27bbf7c6-d3c0-4064-af5a-a783dfb85f93 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:46.283300 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-27bbf7c6-d3c0-4064-af5a-a783dfb85f93 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:46.284085 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-27bbf7c6-d3c0-4064-af5a-a783dfb85f93 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:46.284520 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-27bbf7c6-d3c0-4064-af5a-a783dfb85f93 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:46.468839 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-27bbf7c6-d3c0-4064-af5a-a783dfb85f93 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:46.477371 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-27bbf7c6-d3c0-4064-af5a-a783dfb85f93 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1510 microversion: 2.1 time: 0.206673 Jul 18 03:04:46.478761 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3064/6150] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:46 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1510 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:47.497487 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-acafe9f9-bdcb-4fc9-a65d-28a661a5c599 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:47.498245 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-acafe9f9-bdcb-4fc9-a65d-28a661a5c599 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:47.505357 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-acafe9f9-bdcb-4fc9-a65d-28a661a5c599 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:47.505851 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-acafe9f9-bdcb-4fc9-a65d-28a661a5c599 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:47.506645 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-acafe9f9-bdcb-4fc9-a65d-28a661a5c599 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:47.507090 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-acafe9f9-bdcb-4fc9-a65d-28a661a5c599 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:47.668041 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-acafe9f9-bdcb-4fc9-a65d-28a661a5c599 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:47.676040 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-acafe9f9-bdcb-4fc9-a65d-28a661a5c599 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1510 microversion: 2.1 time: 0.183569 Jul 18 03:04:47.676643 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3087/6151] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:47 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1510 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:48.694366 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-91aa4242-8958-4207-9302-2f85b49e217c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:48.695018 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-91aa4242-8958-4207-9302-2f85b49e217c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:48.698770 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=70 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:04:48.704772 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91aa4242-8958-4207-9302-2f85b49e217c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:48.705224 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91aa4242-8958-4207-9302-2f85b49e217c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:48.706047 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91aa4242-8958-4207-9302-2f85b49e217c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:48.706488 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91aa4242-8958-4207-9302-2f85b49e217c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:48.860220 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-91aa4242-8958-4207-9302-2f85b49e217c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:48.868497 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-91aa4242-8958-4207-9302-2f85b49e217c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1510 microversion: 2.1 time: 0.178077 Jul 18 03:04:48.869171 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3065/6152] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:48 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1510 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:04:49.887199 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-14b2901c-6581-412b-8d14-16f84691856c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:49.887977 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-14b2901c-6581-412b-8d14-16f84691856c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:49.895718 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14b2901c-6581-412b-8d14-16f84691856c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:49.896181 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14b2901c-6581-412b-8d14-16f84691856c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:49.897026 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14b2901c-6581-412b-8d14-16f84691856c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:49.897480 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14b2901c-6581-412b-8d14-16f84691856c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:50.043774 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-14b2901c-6581-412b-8d14-16f84691856c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:50.051674 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-14b2901c-6581-412b-8d14-16f84691856c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1510 microversion: 2.1 time: 0.169054 Jul 18 03:04:50.052276 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3088/6153] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:49 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1510 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:51.069765 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a409552d-1428-4957-98a6-9b8189c7bc44 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:51.070536 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a409552d-1428-4957-98a6-9b8189c7bc44 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:51.078877 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a409552d-1428-4957-98a6-9b8189c7bc44 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:51.079329 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a409552d-1428-4957-98a6-9b8189c7bc44 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:51.081751 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a409552d-1428-4957-98a6-9b8189c7bc44 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:51.081751 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a409552d-1428-4957-98a6-9b8189c7bc44 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:51.239914 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a409552d-1428-4957-98a6-9b8189c7bc44 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:51.250587 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a409552d-1428-4957-98a6-9b8189c7bc44 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1510 microversion: 2.1 time: 0.184882 Jul 18 03:04:51.251184 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3066/6154] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:51 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1510 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:52.270058 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d2f9cb01-2b9d-4b44-b8ba-85e882169b98 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:52.270700 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d2f9cb01-2b9d-4b44-b8ba-85e882169b98 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:52.278794 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d2f9cb01-2b9d-4b44-b8ba-85e882169b98 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:52.279255 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d2f9cb01-2b9d-4b44-b8ba-85e882169b98 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:52.280069 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d2f9cb01-2b9d-4b44-b8ba-85e882169b98 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:52.280524 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d2f9cb01-2b9d-4b44-b8ba-85e882169b98 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:52.446718 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d2f9cb01-2b9d-4b44-b8ba-85e882169b98 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:52.455208 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d2f9cb01-2b9d-4b44-b8ba-85e882169b98 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1510 microversion: 2.1 time: 0.189377 Jul 18 03:04:52.456110 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3089/6155] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:52 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1510 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:53.472819 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3b397af0-68a9-4466-8cd3-cf0d8d463370 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:53.473431 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3b397af0-68a9-4466-8cd3-cf0d8d463370 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:53.480715 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b397af0-68a9-4466-8cd3-cf0d8d463370 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:53.481181 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b397af0-68a9-4466-8cd3-cf0d8d463370 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:53.481962 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b397af0-68a9-4466-8cd3-cf0d8d463370 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:53.482399 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b397af0-68a9-4466-8cd3-cf0d8d463370 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:53.614790 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3b397af0-68a9-4466-8cd3-cf0d8d463370 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:53.623164 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3b397af0-68a9-4466-8cd3-cf0d8d463370 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1510 microversion: 2.1 time: 0.154314 Jul 18 03:04:53.623683 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3067/6156] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:53 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:04:54.640171 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-658217d2-0f34-4fb3-b5a0-0a714942b127 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:54.640814 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-658217d2-0f34-4fb3-b5a0-0a714942b127 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:54.648050 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-658217d2-0f34-4fb3-b5a0-0a714942b127 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:54.648517 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-658217d2-0f34-4fb3-b5a0-0a714942b127 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:54.649330 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-658217d2-0f34-4fb3-b5a0-0a714942b127 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:54.650338 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-658217d2-0f34-4fb3-b5a0-0a714942b127 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:54.788072 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-658217d2-0f34-4fb3-b5a0-0a714942b127 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:54.796062 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-658217d2-0f34-4fb3-b5a0-0a714942b127 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1510 microversion: 2.1 time: 0.159833 Jul 18 03:04:54.796643 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3090/6157] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:54 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:55.813327 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-311cc942-2a25-46dd-a8be-7b444f31de76 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:55.813955 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-311cc942-2a25-46dd-a8be-7b444f31de76 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:55.820969 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-311cc942-2a25-46dd-a8be-7b444f31de76 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:55.821417 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-311cc942-2a25-46dd-a8be-7b444f31de76 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:55.822259 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-311cc942-2a25-46dd-a8be-7b444f31de76 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:55.822868 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-311cc942-2a25-46dd-a8be-7b444f31de76 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:55.954150 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-311cc942-2a25-46dd-a8be-7b444f31de76 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:55.961624 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-311cc942-2a25-46dd-a8be-7b444f31de76 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1510 microversion: 2.1 time: 0.152297 Jul 18 03:04:55.962304 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3068/6158] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:55 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:56.979905 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7fbb9f80-4134-423c-b4e3-addb73f3d892 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:56.980542 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7fbb9f80-4134-423c-b4e3-addb73f3d892 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:56.987285 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7fbb9f80-4134-423c-b4e3-addb73f3d892 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:56.987753 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7fbb9f80-4134-423c-b4e3-addb73f3d892 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:56.988529 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7fbb9f80-4134-423c-b4e3-addb73f3d892 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:56.988974 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7fbb9f80-4134-423c-b4e3-addb73f3d892 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:57.121460 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7fbb9f80-4134-423c-b4e3-addb73f3d892 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:57.129323 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7fbb9f80-4134-423c-b4e3-addb73f3d892 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1510 microversion: 2.1 time: 0.154025 Jul 18 03:04:57.129935 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3091/6159] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:56 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:58.147276 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-71d811ee-a7ab-49c1-9a37-ae7034507b23 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:58.147877 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-71d811ee-a7ab-49c1-9a37-ae7034507b23 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:58.155759 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-71d811ee-a7ab-49c1-9a37-ae7034507b23 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:58.156210 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-71d811ee-a7ab-49c1-9a37-ae7034507b23 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:58.156972 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-71d811ee-a7ab-49c1-9a37-ae7034507b23 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:58.157404 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-71d811ee-a7ab-49c1-9a37-ae7034507b23 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:58.294685 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-71d811ee-a7ab-49c1-9a37-ae7034507b23 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:58.302508 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-71d811ee-a7ab-49c1-9a37-ae7034507b23 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1510 microversion: 2.1 time: 0.159114 Jul 18 03:04:58.303150 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3069/6160] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:58 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:59.320713 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6c93ef5e-5097-4e61-a414-eab80a537bfa tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:59.321335 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6c93ef5e-5097-4e61-a414-eab80a537bfa tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:59.329919 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6c93ef5e-5097-4e61-a414-eab80a537bfa tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:59.330378 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6c93ef5e-5097-4e61-a414-eab80a537bfa tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:59.331173 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6c93ef5e-5097-4e61-a414-eab80a537bfa tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:59.331617 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6c93ef5e-5097-4e61-a414-eab80a537bfa tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:59.466541 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6c93ef5e-5097-4e61-a414-eab80a537bfa tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:59.474406 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6c93ef5e-5097-4e61-a414-eab80a537bfa tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1510 microversion: 2.1 time: 0.158010 Jul 18 03:04:59.474982 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3092/6161] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:59 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:00.491236 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fa9c1912-488e-44d6-83bf-d76ff2e18d41 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:00.491872 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fa9c1912-488e-44d6-83bf-d76ff2e18d41 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:00.499674 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fa9c1912-488e-44d6-83bf-d76ff2e18d41 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:00.500115 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fa9c1912-488e-44d6-83bf-d76ff2e18d41 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:00.500878 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fa9c1912-488e-44d6-83bf-d76ff2e18d41 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:00.501307 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fa9c1912-488e-44d6-83bf-d76ff2e18d41 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:00.505355 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:05:00.641378 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fa9c1912-488e-44d6-83bf-d76ff2e18d41 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:00.649071 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fa9c1912-488e-44d6-83bf-d76ff2e18d41 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1510 microversion: 2.1 time: 0.161691 Jul 18 03:05:00.649656 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3070/6162] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:00 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:01.667025 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f1d41448-5921-4660-b4a4-1ad7721677d0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:01.667604 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f1d41448-5921-4660-b4a4-1ad7721677d0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:01.674831 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f1d41448-5921-4660-b4a4-1ad7721677d0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:01.677125 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f1d41448-5921-4660-b4a4-1ad7721677d0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:01.678021 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f1d41448-5921-4660-b4a4-1ad7721677d0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:01.678481 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f1d41448-5921-4660-b4a4-1ad7721677d0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:01.829001 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f1d41448-5921-4660-b4a4-1ad7721677d0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:01.837433 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f1d41448-5921-4660-b4a4-1ad7721677d0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1510 microversion: 2.1 time: 0.174387 Jul 18 03:05:01.838278 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3093/6163] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:01 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1510 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:02.855127 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d0d95508-c055-4f3b-99d5-4252fa3f6427 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:02.855758 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d0d95508-c055-4f3b-99d5-4252fa3f6427 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:02.862730 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d0d95508-c055-4f3b-99d5-4252fa3f6427 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:02.863175 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d0d95508-c055-4f3b-99d5-4252fa3f6427 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:02.863929 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d0d95508-c055-4f3b-99d5-4252fa3f6427 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:02.864360 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d0d95508-c055-4f3b-99d5-4252fa3f6427 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:02.997385 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d0d95508-c055-4f3b-99d5-4252fa3f6427 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:03.004983 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d0d95508-c055-4f3b-99d5-4252fa3f6427 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1510 microversion: 2.1 time: 0.154285 Jul 18 03:05:03.005565 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3071/6164] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:02 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:04.022488 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8ec267f6-f9d9-49a2-b864-6fd7fd015789 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:04.023090 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8ec267f6-f9d9-49a2-b864-6fd7fd015789 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:04.026491 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:05:04.032355 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8ec267f6-f9d9-49a2-b864-6fd7fd015789 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:04.032813 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8ec267f6-f9d9-49a2-b864-6fd7fd015789 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:04.033593 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8ec267f6-f9d9-49a2-b864-6fd7fd015789 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:04.034073 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8ec267f6-f9d9-49a2-b864-6fd7fd015789 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:04.169919 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8ec267f6-f9d9-49a2-b864-6fd7fd015789 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:04.177381 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8ec267f6-f9d9-49a2-b864-6fd7fd015789 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1510 microversion: 2.1 time: 0.158842 Jul 18 03:05:04.177994 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3094/6165] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:04 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:05.195898 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-62567eb3-57fe-40c3-9803-2ccb3d633bb0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:05.196858 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-62567eb3-57fe-40c3-9803-2ccb3d633bb0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:05.205102 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-62567eb3-57fe-40c3-9803-2ccb3d633bb0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:05.205549 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-62567eb3-57fe-40c3-9803-2ccb3d633bb0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:05.206337 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-62567eb3-57fe-40c3-9803-2ccb3d633bb0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:05.206772 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-62567eb3-57fe-40c3-9803-2ccb3d633bb0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:05.339552 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-62567eb3-57fe-40c3-9803-2ccb3d633bb0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:05.347163 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-62567eb3-57fe-40c3-9803-2ccb3d633bb0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1510 microversion: 2.1 time: 0.156335 Jul 18 03:05:05.347733 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3072/6166] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:05 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:06.365742 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a3bfd323-efe1-48d7-a004-ecfbd71d8d24 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:06.366504 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a3bfd323-efe1-48d7-a004-ecfbd71d8d24 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:06.374341 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a3bfd323-efe1-48d7-a004-ecfbd71d8d24 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:06.374952 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a3bfd323-efe1-48d7-a004-ecfbd71d8d24 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:06.375739 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a3bfd323-efe1-48d7-a004-ecfbd71d8d24 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:06.376187 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a3bfd323-efe1-48d7-a004-ecfbd71d8d24 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:06.516382 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a3bfd323-efe1-48d7-a004-ecfbd71d8d24 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:06.523947 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a3bfd323-efe1-48d7-a004-ecfbd71d8d24 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1510 microversion: 2.1 time: 0.162336 Jul 18 03:05:06.524550 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3095/6167] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:06 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:07.541137 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-00ff7498-e195-4151-9bf1-7087e3e1ee0b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:07.541883 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-00ff7498-e195-4151-9bf1-7087e3e1ee0b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:07.548593 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-00ff7498-e195-4151-9bf1-7087e3e1ee0b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:07.549040 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-00ff7498-e195-4151-9bf1-7087e3e1ee0b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:07.553435 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-00ff7498-e195-4151-9bf1-7087e3e1ee0b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:07.553435 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-00ff7498-e195-4151-9bf1-7087e3e1ee0b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:07.686662 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-00ff7498-e195-4151-9bf1-7087e3e1ee0b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:07.698147 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-00ff7498-e195-4151-9bf1-7087e3e1ee0b tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1510 microversion: 2.1 time: 0.160372 Jul 18 03:05:07.698840 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3073/6168] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:07 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:08.716648 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c62f47c7-2aa1-407d-8d14-153155e0490f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:08.717388 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c62f47c7-2aa1-407d-8d14-153155e0490f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:08.726575 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c62f47c7-2aa1-407d-8d14-153155e0490f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:08.727069 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c62f47c7-2aa1-407d-8d14-153155e0490f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:08.728025 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c62f47c7-2aa1-407d-8d14-153155e0490f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:08.728481 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c62f47c7-2aa1-407d-8d14-153155e0490f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:08.864743 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c62f47c7-2aa1-407d-8d14-153155e0490f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:08.873201 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c62f47c7-2aa1-407d-8d14-153155e0490f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1510 microversion: 2.1 time: 0.161416 Jul 18 03:05:08.873794 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3096/6169] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:08 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:09.890813 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4fcdf03d-261d-4666-b979-a74f89b1ed9d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:09.891424 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4fcdf03d-261d-4666-b979-a74f89b1ed9d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:09.898424 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4fcdf03d-261d-4666-b979-a74f89b1ed9d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:09.898867 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4fcdf03d-261d-4666-b979-a74f89b1ed9d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:09.899617 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4fcdf03d-261d-4666-b979-a74f89b1ed9d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:09.900049 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4fcdf03d-261d-4666-b979-a74f89b1ed9d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:10.032225 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4fcdf03d-261d-4666-b979-a74f89b1ed9d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:10.039826 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4fcdf03d-261d-4666-b979-a74f89b1ed9d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1510 microversion: 2.1 time: 0.153504 Jul 18 03:05:10.040410 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3074/6170] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:09 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:11.057485 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b593093b-26e6-4731-a800-bdf4143941dd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:11.058197 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b593093b-26e6-4731-a800-bdf4143941dd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:11.066519 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b593093b-26e6-4731-a800-bdf4143941dd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:11.066748 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b593093b-26e6-4731-a800-bdf4143941dd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:11.067581 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b593093b-26e6-4731-a800-bdf4143941dd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:11.067829 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b593093b-26e6-4731-a800-bdf4143941dd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:11.072365 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:05:11.600649 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b593093b-26e6-4731-a800-bdf4143941dd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:11.609102 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b593093b-26e6-4731-a800-bdf4143941dd tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1510 microversion: 2.1 time: 0.555485 Jul 18 03:05:11.609936 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3097/6171] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:11 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1510 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:12.585198 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-22b9eeab-5e6b-440d-a30c-b192febd5c80 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:12.585721 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-22b9eeab-5e6b-440d-a30c-b192febd5c80 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: 76c4b356-512b-4868-9c97-4006c9b36b97] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:12.593069 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-22b9eeab-5e6b-440d-a30c-b192febd5c80 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:12.593518 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-22b9eeab-5e6b-440d-a30c-b192febd5c80 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:12.594593 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-22b9eeab-5e6b-440d-a30c-b192febd5c80 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:12.594950 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-22b9eeab-5e6b-440d-a30c-b192febd5c80 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:12.622037 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-22b9eeab-5e6b-440d-a30c-b192febd5c80 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: 76c4b356-512b-4868-9c97-4006c9b36b97] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:05:12.626492 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-223f5ab6-966c-499f-af85-18173febd3c1 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:12.627445 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-223f5ab6-966c-499f-af85-18173febd3c1 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:12.635410 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-223f5ab6-966c-499f-af85-18173febd3c1 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:12.635953 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-223f5ab6-966c-499f-af85-18173febd3c1 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:12.637384 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-223f5ab6-966c-499f-af85-18173febd3c1 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:12.637883 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-223f5ab6-966c-499f-af85-18173febd3c1 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:12.711988 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-22b9eeab-5e6b-440d-a30c-b192febd5c80 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "DELETE /compute/v2.1/servers/76c4b356-512b-4868-9c97-4006c9b36b97" status: 204 len: 0 microversion: 2.1 time: 0.130208 Jul 18 03:05:12.718345 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3075/6172] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:05:12 2022] DELETE /compute/v2.1/servers/76c4b356-512b-4868-9c97-4006c9b36b97 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:05:12.725920 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-117a88ea-91a7-4867-be9b-646da4f81ac2 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:12.726896 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-117a88ea-91a7-4867-be9b-646da4f81ac2 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: 76c4b356-512b-4868-9c97-4006c9b36b97] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:12.735892 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-117a88ea-91a7-4867-be9b-646da4f81ac2 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:12.736356 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-117a88ea-91a7-4867-be9b-646da4f81ac2 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:12.737731 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-117a88ea-91a7-4867-be9b-646da4f81ac2 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:12.737731 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-117a88ea-91a7-4867-be9b-646da4f81ac2 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:12.838557 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-223f5ab6-966c-499f-af85-18173febd3c1 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:12.847823 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-223f5ab6-966c-499f-af85-18173febd3c1 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1510 microversion: 2.1 time: 0.225637 Jul 18 03:05:12.848755 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3098/6173] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:12 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1510 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:12.900421 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-117a88ea-91a7-4867-be9b-646da4f81ac2 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:12.908317 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-117a88ea-91a7-4867-be9b-646da4f81ac2 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/76c4b356-512b-4868-9c97-4006c9b36b97" status: 200 len: 1552 microversion: 2.1 time: 0.187363 Jul 18 03:05:12.908918 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3076/6174] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:12 2022] GET /compute/v2.1/servers/76c4b356-512b-4868-9c97-4006c9b36b97 => generated 1552 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:13.865094 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-92278e68-85a9-4d46-97f2-39dd4efc359d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:13.865740 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-92278e68-85a9-4d46-97f2-39dd4efc359d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:13.873081 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-92278e68-85a9-4d46-97f2-39dd4efc359d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:13.873545 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-92278e68-85a9-4d46-97f2-39dd4efc359d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:13.874365 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-92278e68-85a9-4d46-97f2-39dd4efc359d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:13.874818 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-92278e68-85a9-4d46-97f2-39dd4efc359d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:13.926531 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5383de29-93b1-4189-9eda-a131a7732f28 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:13.927135 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5383de29-93b1-4189-9eda-a131a7732f28 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: 76c4b356-512b-4868-9c97-4006c9b36b97] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:13.934282 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5383de29-93b1-4189-9eda-a131a7732f28 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:13.934671 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5383de29-93b1-4189-9eda-a131a7732f28 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:13.935455 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5383de29-93b1-4189-9eda-a131a7732f28 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:13.935894 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5383de29-93b1-4189-9eda-a131a7732f28 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:14.050288 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-92278e68-85a9-4d46-97f2-39dd4efc359d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:14.058385 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-92278e68-85a9-4d46-97f2-39dd4efc359d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1510 microversion: 2.1 time: 0.197168 Jul 18 03:05:14.058996 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3099/6175] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:13 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1510 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:14.101455 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5383de29-93b1-4189-9eda-a131a7732f28 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:14.110214 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5383de29-93b1-4189-9eda-a131a7732f28 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/76c4b356-512b-4868-9c97-4006c9b36b97" status: 200 len: 1552 microversion: 2.1 time: 0.187485 Jul 18 03:05:14.110797 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3077/6176] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:13 2022] GET /compute/v2.1/servers/76c4b356-512b-4868-9c97-4006c9b36b97 => generated 1552 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:05:15.076151 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-765aacab-4803-4797-9aac-f6a76b3d75b6 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:15.076868 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-765aacab-4803-4797-9aac-f6a76b3d75b6 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:15.083912 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-765aacab-4803-4797-9aac-f6a76b3d75b6 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:15.084433 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-765aacab-4803-4797-9aac-f6a76b3d75b6 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:15.085344 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-765aacab-4803-4797-9aac-f6a76b3d75b6 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:15.085995 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-765aacab-4803-4797-9aac-f6a76b3d75b6 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:15.125479 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-255b0fb5-a71e-4138-b7e3-1aaf12382833 req-08bbcf3e-19ee-4d9b-97b4-97752855ce61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76c4b356-512b-4868-9c97-4006c9b36b97", "name": "network-vif-deleted", "tag": "a925e325-efe2-41ed-bb29-0b99d456f9d4"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:05:15.134239 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-255b0fb5-a71e-4138-b7e3-1aaf12382833 req-08bbcf3e-19ee-4d9b-97b4-97752855ce61 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:15.134625 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-255b0fb5-a71e-4138-b7e3-1aaf12382833 req-08bbcf3e-19ee-4d9b-97b4-97752855ce61 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:15.146696 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-255b0fb5-a71e-4138-b7e3-1aaf12382833 req-08bbcf3e-19ee-4d9b-97b4-97752855ce61 service nova] Creating event network-vif-deleted:a925e325-efe2-41ed-bb29-0b99d456f9d4 for instance 76c4b356-512b-4868-9c97-4006c9b36b97 on n-h1-465891-3 Jul 18 03:05:15.151747 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-255b0fb5-a71e-4138-b7e3-1aaf12382833 req-08bbcf3e-19ee-4d9b-97b4-97752855ce61 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.233912 Jul 18 03:05:15.152650 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3100/6177] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:05:15.157681 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-db059d47-d090-4ac8-81be-fd7cfb85a320 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:15.158428 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-db059d47-d090-4ac8-81be-fd7cfb85a320 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: 76c4b356-512b-4868-9c97-4006c9b36b97] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:15.164733 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-db059d47-d090-4ac8-81be-fd7cfb85a320 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:15.165206 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-db059d47-d090-4ac8-81be-fd7cfb85a320 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:15.166042 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-db059d47-d090-4ac8-81be-fd7cfb85a320 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:15.166494 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-db059d47-d090-4ac8-81be-fd7cfb85a320 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:15.201445 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-db059d47-d090-4ac8-81be-fd7cfb85a320 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:15.201938 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-db059d47-d090-4ac8-81be-fd7cfb85a320 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:15.202441 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-db059d47-d090-4ac8-81be-fd7cfb85a320 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lazy-loading 'fault' on Instance uuid 76c4b356-512b-4868-9c97-4006c9b36b97 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:05:15.226916 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-765aacab-4803-4797-9aac-f6a76b3d75b6 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:15.235493 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-765aacab-4803-4797-9aac-f6a76b3d75b6 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1510 microversion: 2.1 time: 0.163974 Jul 18 03:05:15.236350 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3078/6178] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:15 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:05:15.262833 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-db059d47-d090-4ac8-81be-fd7cfb85a320 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:15.270910 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-db059d47-d090-4ac8-81be-fd7cfb85a320 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/76c4b356-512b-4868-9c97-4006c9b36b97" status: 200 len: 1338 microversion: 2.1 time: 0.117238 Jul 18 03:05:15.271579 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3101/6179] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:15 2022] GET /compute/v2.1/servers/76c4b356-512b-4868-9c97-4006c9b36b97 => generated 1338 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:16.253295 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e05ca098-5c97-472b-9002-09452082e59f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:16.253946 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e05ca098-5c97-472b-9002-09452082e59f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:16.260874 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e05ca098-5c97-472b-9002-09452082e59f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:16.262011 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e05ca098-5c97-472b-9002-09452082e59f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:16.262718 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e05ca098-5c97-472b-9002-09452082e59f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:16.263165 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e05ca098-5c97-472b-9002-09452082e59f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:16.288572 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-191c71a0-aded-40f7-9304-3da0f91b0704 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:16.289207 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-191c71a0-aded-40f7-9304-3da0f91b0704 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: 76c4b356-512b-4868-9c97-4006c9b36b97] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:16.296974 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-191c71a0-aded-40f7-9304-3da0f91b0704 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:16.297443 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-191c71a0-aded-40f7-9304-3da0f91b0704 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:16.298344 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-191c71a0-aded-40f7-9304-3da0f91b0704 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:16.298800 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-191c71a0-aded-40f7-9304-3da0f91b0704 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:16.315950 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-191c71a0-aded-40f7-9304-3da0f91b0704 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] HTTP exception thrown: Instance 76c4b356-512b-4868-9c97-4006c9b36b97 could not be found. Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-191c71a0-aded-40f7-9304-3da0f91b0704 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Request method failure captured: Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/76c4b356-512b-4868-9c97-4006c9b36b97 HTTP/1.1 Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1M1fjxj2SWFoXW6Sb-0swIReqepB-2vZ8Rt0XBLXBRPz7xlUYKfNEu4m9Blh-cNBZR00jPQoO_lhqOHSne0eODxj2N7SOK9zjyQSeA0pKNgRsdckEpj2vSnWXuSELduvIk90pn84XzmSfUb_5axS-AdrG1LFffRoINHmpfwzIz7M6cw Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 1d2ff16c129544f6a876a3371c1d02a6 Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-TestNetworkBasicOps-1916468681 Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1d2ff16c129544f6a876a3371c1d02a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1d2ff16c129544f6a876a3371c1d02a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1d2ff16c129544f6a876a3371c1d02a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1d2ff16c129544f6a876a3371c1d02a6"}]}] Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-TestNetworkBasicOps-1916468681 Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 1d2ff16c129544f6a876a3371c1d02a6 Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-TestNetworkBasicOps-1916468681 Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-TestNetworkBasicOps-1916468681-project Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 33388b46f7fb4c419ac0856245ad382f Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-TestNetworkBasicOps-1916468681-project Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 76c4b356-512b-4868-9c97-4006c9b36b97 could not be found. Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '76c4b356-512b-4868-9c97-4006c9b36b97'} Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76c4b356-512b-4868-9c97-4006c9b36b97 could not be found. Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76c4b356-512b-4868-9c97-4006c9b36b97 could not be found. Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:05:16.317630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:16.327693 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:16.327693 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:05:16.327693 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:05:16.327693 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:05:16.327693 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:05:16.327693 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76c4b356-512b-4868-9c97-4006c9b36b97 could not be found. Jul 18 03:05:16.327693 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:16.327693 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-191c71a0-aded-40f7-9304-3da0f91b0704 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Returning 404 to user: Instance 76c4b356-512b-4868-9c97-4006c9b36b97 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:05:16.327693 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-191c71a0-aded-40f7-9304-3da0f91b0704 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/76c4b356-512b-4868-9c97-4006c9b36b97" status: 404 len: 111 microversion: 2.1 time: 0.034593 Jul 18 03:05:16.327693 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3102/6180] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:16 2022] GET /compute/v2.1/servers/76c4b356-512b-4868-9c97-4006c9b36b97 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 03:05:16.407125 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e05ca098-5c97-472b-9002-09452082e59f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:16.415169 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e05ca098-5c97-472b-9002-09452082e59f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1487 microversion: 2.1 time: 0.165721 Jul 18 03:05:16.415972 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3079/6181] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:16 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1487 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:16.432453 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0f4ea536-455c-480f-a800-8d172c8095b3 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1508455323"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:05:16.435017 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0f4ea536-455c-480f-a800-8d172c8095b3 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:16.441672 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0f4ea536-455c-480f-a800-8d172c8095b3 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:16.442182 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0f4ea536-455c-480f-a800-8d172c8095b3 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:16.442993 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0f4ea536-455c-480f-a800-8d172c8095b3 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:16.443451 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0f4ea536-455c-480f-a800-8d172c8095b3 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:16.520047 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ae13fd32-b271-4f88-a0bd-128d56b53c5b tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '.version_select at 0x7ff4a835aee0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:16.533884 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0f4ea536-455c-480f-a800-8d172c8095b3 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "PUT /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1060 microversion: 2.1 time: 0.105331 Jul 18 03:05:16.534928 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3103/6182] 10.222.0.57 () {60 vars in 1255 bytes} [Mon Jul 18 03:05:16 2022] PUT /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1060 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:16.547119 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ae13fd32-b271-4f88-a0bd-128d56b53c5b tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-169904324" status: 202 len: 0 microversion: 2.1 time: 0.031410 Jul 18 03:05:16.547718 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3080/6183] 10.222.0.57 () {58 vars in 1253 bytes} [Mon Jul 18 03:05:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-169904324 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:05:16.552616 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-647e2fb7-54e0-4af9-91a4-a4383bbff491 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:16.553271 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-647e2fb7-54e0-4af9-91a4-a4383bbff491 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:16.561971 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-647e2fb7-54e0-4af9-91a4-a4383bbff491 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:16.562438 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-647e2fb7-54e0-4af9-91a4-a4383bbff491 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:16.563505 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-647e2fb7-54e0-4af9-91a4-a4383bbff491 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:16.564132 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-647e2fb7-54e0-4af9-91a4-a4383bbff491 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:16.705093 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-647e2fb7-54e0-4af9-91a4-a4383bbff491 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:16.713140 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-647e2fb7-54e0-4af9-91a4-a4383bbff491 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1487 microversion: 2.1 time: 0.164992 Jul 18 03:05:16.713736 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3104/6184] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:16 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1487 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:05:16.729352 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d48b638a-d3ad-415a-a001-4d38da81126c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:16.730129 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d48b638a-d3ad-415a-a001-4d38da81126c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:16.737630 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d48b638a-d3ad-415a-a001-4d38da81126c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:16.738358 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d48b638a-d3ad-415a-a001-4d38da81126c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:16.739419 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d48b638a-d3ad-415a-a001-4d38da81126c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:16.739916 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d48b638a-d3ad-415a-a001-4d38da81126c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:16.895260 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d48b638a-d3ad-415a-a001-4d38da81126c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:16.907012 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d48b638a-d3ad-415a-a001-4d38da81126c tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1487 microversion: 2.1 time: 0.181583 Jul 18 03:05:16.907795 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3081/6185] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:16 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1487 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:05:16.923649 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-293d77c8-3e13-491a-9ac8-108613aa3858 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:16.924156 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-293d77c8-3e13-491a-9ac8-108613aa3858 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:16.931254 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-293d77c8-3e13-491a-9ac8-108613aa3858 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:16.932181 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-293d77c8-3e13-491a-9ac8-108613aa3858 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:16.932999 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-293d77c8-3e13-491a-9ac8-108613aa3858 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:16.933830 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-293d77c8-3e13-491a-9ac8-108613aa3858 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:16.965156 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-293d77c8-3e13-491a-9ac8-108613aa3858 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:05:17.065374 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-293d77c8-3e13-491a-9ac8-108613aa3858 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "DELETE /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 204 len: 0 microversion: 2.1 time: 0.145287 Jul 18 03:05:17.071290 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3105/6186] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:05:16 2022] DELETE /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:05:17.080090 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ede9e72e-da71-4934-b965-1ede8c50c176 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:17.080759 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ede9e72e-da71-4934-b965-1ede8c50c176 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:17.088158 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ede9e72e-da71-4934-b965-1ede8c50c176 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:17.090505 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ede9e72e-da71-4934-b965-1ede8c50c176 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:17.092365 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ede9e72e-da71-4934-b965-1ede8c50c176 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:17.093072 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ede9e72e-da71-4934-b965-1ede8c50c176 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:17.274350 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ede9e72e-da71-4934-b965-1ede8c50c176 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:17.284072 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ede9e72e-da71-4934-b965-1ede8c50c176 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1493 microversion: 2.1 time: 0.207829 Jul 18 03:05:17.285058 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3082/6187] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:17 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1493 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:05:18.301846 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4ef18bd6-d7f8-46e0-9125-fd3ccc5b34e8 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:18.303174 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4ef18bd6-d7f8-46e0-9125-fd3ccc5b34e8 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:18.310354 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4ef18bd6-d7f8-46e0-9125-fd3ccc5b34e8 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:18.310824 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4ef18bd6-d7f8-46e0-9125-fd3ccc5b34e8 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:18.311631 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4ef18bd6-d7f8-46e0-9125-fd3ccc5b34e8 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:18.312087 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4ef18bd6-d7f8-46e0-9125-fd3ccc5b34e8 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:18.323215 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ec3c8ecf-3d93-4900-ad2a-60b51b969492 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:18.324371 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ec3c8ecf-3d93-4900-ad2a-60b51b969492 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: e4c72b14-0ad7-453f-9718-3ed2f911c889] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:18.331564 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ec3c8ecf-3d93-4900-ad2a-60b51b969492 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:18.332334 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ec3c8ecf-3d93-4900-ad2a-60b51b969492 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:18.333191 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ec3c8ecf-3d93-4900-ad2a-60b51b969492 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:18.333847 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ec3c8ecf-3d93-4900-ad2a-60b51b969492 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:18.362776 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ec3c8ecf-3d93-4900-ad2a-60b51b969492 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: e4c72b14-0ad7-453f-9718-3ed2f911c889] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:05:18.452066 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ec3c8ecf-3d93-4900-ad2a-60b51b969492 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "DELETE /compute/v2.1/servers/e4c72b14-0ad7-453f-9718-3ed2f911c889" status: 204 len: 0 microversion: 2.1 time: 0.132491 Jul 18 03:05:18.453210 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3083/6188] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:05:18 2022] DELETE /compute/v2.1/servers/e4c72b14-0ad7-453f-9718-3ed2f911c889 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:05:18.459101 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-4ef057d1-dfd8-49d8-b2ff-d8bfd40cb55c req-68c13a7f-cac1-4b41-8f70-1fadbc06b294 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4c72b14-0ad7-453f-9718-3ed2f911c889", "tag": "9beb4cc4-0dde-4552-9926-2ff902db0fff"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:05:18.468032 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-4ef057d1-dfd8-49d8-b2ff-d8bfd40cb55c req-68c13a7f-cac1-4b41-8f70-1fadbc06b294 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:18.468606 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-4ef057d1-dfd8-49d8-b2ff-d8bfd40cb55c req-68c13a7f-cac1-4b41-8f70-1fadbc06b294 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:18.479520 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4ef18bd6-d7f8-46e0-9125-fd3ccc5b34e8 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:18.481956 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-4ef057d1-dfd8-49d8-b2ff-d8bfd40cb55c req-68c13a7f-cac1-4b41-8f70-1fadbc06b294 service nova] Creating event network-changed:9beb4cc4-0dde-4552-9926-2ff902db0fff for instance e4c72b14-0ad7-453f-9718-3ed2f911c889 on n-h2-465891-3 Jul 18 03:05:18.487070 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-4ef057d1-dfd8-49d8-b2ff-d8bfd40cb55c req-68c13a7f-cac1-4b41-8f70-1fadbc06b294 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031987 Jul 18 03:05:18.487608 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4ef18bd6-d7f8-46e0-9125-fd3ccc5b34e8 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1493 microversion: 2.1 time: 0.190032 Jul 18 03:05:18.488191 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3084/6189] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:05:18.489281 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3106/6190] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:18 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1493 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:18.493763 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-56b6492d-ef2c-42ac-baf0-d54cec28e66d tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:18.494506 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-56b6492d-ef2c-42ac-baf0-d54cec28e66d tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: e4c72b14-0ad7-453f-9718-3ed2f911c889] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:18.501873 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-56b6492d-ef2c-42ac-baf0-d54cec28e66d tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:18.502412 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-56b6492d-ef2c-42ac-baf0-d54cec28e66d tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:18.503270 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-56b6492d-ef2c-42ac-baf0-d54cec28e66d tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:18.503771 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-56b6492d-ef2c-42ac-baf0-d54cec28e66d tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:18.507141 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:05:18.649956 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-56b6492d-ef2c-42ac-baf0-d54cec28e66d tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:18.658421 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-56b6492d-ef2c-42ac-baf0-d54cec28e66d tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/e4c72b14-0ad7-453f-9718-3ed2f911c889" status: 200 len: 1669 microversion: 2.1 time: 0.169015 Jul 18 03:05:18.659006 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3085/6191] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:18 2022] GET /compute/v2.1/servers/e4c72b14-0ad7-453f-9718-3ed2f911c889 => generated 1669 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:19.505957 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-26ac59bb-aa5a-4944-873f-5b60dc38bbd0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:19.506595 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-26ac59bb-aa5a-4944-873f-5b60dc38bbd0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:19.514661 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-26ac59bb-aa5a-4944-873f-5b60dc38bbd0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:19.515159 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-26ac59bb-aa5a-4944-873f-5b60dc38bbd0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:19.515956 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-26ac59bb-aa5a-4944-873f-5b60dc38bbd0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:19.516410 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-26ac59bb-aa5a-4944-873f-5b60dc38bbd0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:19.645796 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-26ac59bb-aa5a-4944-873f-5b60dc38bbd0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:19.653430 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-26ac59bb-aa5a-4944-873f-5b60dc38bbd0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1493 microversion: 2.1 time: 0.151412 Jul 18 03:05:19.654050 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3107/6192] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:19 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1493 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:19.675064 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4dda1846-3b15-4779-ae61-0d45d74ee00e tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:19.675681 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4dda1846-3b15-4779-ae61-0d45d74ee00e tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: e4c72b14-0ad7-453f-9718-3ed2f911c889] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:19.678378 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:05:19.684654 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4dda1846-3b15-4779-ae61-0d45d74ee00e tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:19.685099 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4dda1846-3b15-4779-ae61-0d45d74ee00e tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:19.685896 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4dda1846-3b15-4779-ae61-0d45d74ee00e tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:19.686333 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4dda1846-3b15-4779-ae61-0d45d74ee00e tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:19.949561 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4dda1846-3b15-4779-ae61-0d45d74ee00e tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:19.957954 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4dda1846-3b15-4779-ae61-0d45d74ee00e tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/e4c72b14-0ad7-453f-9718-3ed2f911c889" status: 200 len: 1669 microversion: 2.1 time: 0.286635 Jul 18 03:05:19.958640 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3086/6193] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:19 2022] GET /compute/v2.1/servers/e4c72b14-0ad7-453f-9718-3ed2f911c889 => generated 1669 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:20.671055 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3ab57462-c333-4e27-b9d3-413cc3693fc9 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:20.671710 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3ab57462-c333-4e27-b9d3-413cc3693fc9 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:20.678815 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3ab57462-c333-4e27-b9d3-413cc3693fc9 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:20.679280 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3ab57462-c333-4e27-b9d3-413cc3693fc9 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:20.680074 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3ab57462-c333-4e27-b9d3-413cc3693fc9 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:20.680531 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3ab57462-c333-4e27-b9d3-413cc3693fc9 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:20.975301 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6daa43ae-cc20-46af-a253-e1b9fac0cc6c tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:20.975896 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6daa43ae-cc20-46af-a253-e1b9fac0cc6c tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: e4c72b14-0ad7-453f-9718-3ed2f911c889] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:20.984062 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6daa43ae-cc20-46af-a253-e1b9fac0cc6c tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:20.984604 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6daa43ae-cc20-46af-a253-e1b9fac0cc6c tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:20.985455 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6daa43ae-cc20-46af-a253-e1b9fac0cc6c tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:20.986188 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6daa43ae-cc20-46af-a253-e1b9fac0cc6c tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:21.130267 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3ab57462-c333-4e27-b9d3-413cc3693fc9 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:21.137961 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3ab57462-c333-4e27-b9d3-413cc3693fc9 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1493 microversion: 2.1 time: 0.471282 Jul 18 03:05:21.138557 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3108/6194] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:20 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1493 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:21.143724 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-9106b9dd-5a68-4e80-8ba7-8c0606400090 req-9b80bc2b-7780-4399-9adb-438a65042bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4c72b14-0ad7-453f-9718-3ed2f911c889", "name": "network-vif-unplugged", "status": "completed", "tag": "9beb4cc4-0dde-4552-9926-2ff902db0fff"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:05:21.153548 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-9106b9dd-5a68-4e80-8ba7-8c0606400090 req-9b80bc2b-7780-4399-9adb-438a65042bd4 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:21.154111 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-9106b9dd-5a68-4e80-8ba7-8c0606400090 req-9b80bc2b-7780-4399-9adb-438a65042bd4 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:21.166845 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-9106b9dd-5a68-4e80-8ba7-8c0606400090 req-9b80bc2b-7780-4399-9adb-438a65042bd4 service nova] Creating event network-vif-unplugged:9beb4cc4-0dde-4552-9926-2ff902db0fff for instance e4c72b14-0ad7-453f-9718-3ed2f911c889 on n-h2-465891-3 Jul 18 03:05:21.173183 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-9106b9dd-5a68-4e80-8ba7-8c0606400090 req-9b80bc2b-7780-4399-9adb-438a65042bd4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032838 Jul 18 03:05:21.173818 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3109/6195] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:05:21.380475 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6daa43ae-cc20-46af-a253-e1b9fac0cc6c tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:21.392467 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6daa43ae-cc20-46af-a253-e1b9fac0cc6c tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/e4c72b14-0ad7-453f-9718-3ed2f911c889" status: 200 len: 1669 microversion: 2.1 time: 0.420783 Jul 18 03:05:21.393271 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3087/6196] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:20 2022] GET /compute/v2.1/servers/e4c72b14-0ad7-453f-9718-3ed2f911c889 => generated 1669 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:05:21.430586 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-88e6b9b4-0e72-49a2-9622-43a28ece40b9 req-d392f58d-7964-4388-9e29-70ee663aded8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b85f7c0-8e95-4f8b-9e99-4d43f6497d00", "name": "network-vif-deleted", "tag": "a1862342-3719-45b3-a991-001de625640e"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:05:21.446858 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-88e6b9b4-0e72-49a2-9622-43a28ece40b9 req-d392f58d-7964-4388-9e29-70ee663aded8 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:21.447779 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-88e6b9b4-0e72-49a2-9622-43a28ece40b9 req-d392f58d-7964-4388-9e29-70ee663aded8 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:21.462413 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-88e6b9b4-0e72-49a2-9622-43a28ece40b9 req-d392f58d-7964-4388-9e29-70ee663aded8 service nova] Creating event network-vif-deleted:a1862342-3719-45b3-a991-001de625640e for instance 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 on n-h2-465891-3 Jul 18 03:05:21.472210 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-88e6b9b4-0e72-49a2-9622-43a28ece40b9 req-d392f58d-7964-4388-9e29-70ee663aded8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049640 Jul 18 03:05:21.473495 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3110/6197] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:05:22.159618 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b7c44c2f-acce-4bb3-b70f-a8db2fca8cb7 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:22.160476 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b7c44c2f-acce-4bb3-b70f-a8db2fca8cb7 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:22.166880 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b7c44c2f-acce-4bb3-b70f-a8db2fca8cb7 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:22.167331 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b7c44c2f-acce-4bb3-b70f-a8db2fca8cb7 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:22.168458 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b7c44c2f-acce-4bb3-b70f-a8db2fca8cb7 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:22.168902 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b7c44c2f-acce-4bb3-b70f-a8db2fca8cb7 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:22.208452 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b7c44c2f-acce-4bb3-b70f-a8db2fca8cb7 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:22.208905 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b7c44c2f-acce-4bb3-b70f-a8db2fca8cb7 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:22.209577 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-b7c44c2f-acce-4bb3-b70f-a8db2fca8cb7 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lazy-loading 'fault' on Instance uuid 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:05:22.265118 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b7c44c2f-acce-4bb3-b70f-a8db2fca8cb7 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:22.272658 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b7c44c2f-acce-4bb3-b70f-a8db2fca8cb7 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 200 len: 1310 microversion: 2.1 time: 0.120416 Jul 18 03:05:22.273736 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3088/6198] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:22 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 1310 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:22.412117 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d7dc7b90-21e9-4453-b10a-4844e00d78e4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:22.412734 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d7dc7b90-21e9-4453-b10a-4844e00d78e4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: e4c72b14-0ad7-453f-9718-3ed2f911c889] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:22.420764 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d7dc7b90-21e9-4453-b10a-4844e00d78e4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:22.421383 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d7dc7b90-21e9-4453-b10a-4844e00d78e4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:22.422208 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d7dc7b90-21e9-4453-b10a-4844e00d78e4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:22.422658 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d7dc7b90-21e9-4453-b10a-4844e00d78e4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:22.437027 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-d7dc7b90-21e9-4453-b10a-4844e00d78e4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] HTTP exception thrown: Instance e4c72b14-0ad7-453f-9718-3ed2f911c889 could not be found. Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d7dc7b90-21e9-4453-b10a-4844e00d78e4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Request method failure captured: Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/e4c72b14-0ad7-453f-9718-3ed2f911c889 HTTP/1.1 Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1M1fjxj2SWFoXW6Sb-0swIReqepB-2vZ8Rt0XBLXBRPz7xlUYKfNEu4m9Blh-cNBZR00jPQoO_lhqOHSne0eODxj2N7SOK9zjyQSeA0pKNgRsdckEpj2vSnWXuSELduvIk90pn84XzmSfUb_5axS-AdrG1LFffRoINHmpfwzIz7M6cw Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 1d2ff16c129544f6a876a3371c1d02a6 Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-TestNetworkBasicOps-1916468681 Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1d2ff16c129544f6a876a3371c1d02a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1d2ff16c129544f6a876a3371c1d02a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1d2ff16c129544f6a876a3371c1d02a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1d2ff16c129544f6a876a3371c1d02a6"}]}] Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-TestNetworkBasicOps-1916468681 Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 1d2ff16c129544f6a876a3371c1d02a6 Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-TestNetworkBasicOps-1916468681 Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-TestNetworkBasicOps-1916468681-project Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 33388b46f7fb4c419ac0856245ad382f Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-TestNetworkBasicOps-1916468681-project Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance e4c72b14-0ad7-453f-9718-3ed2f911c889 could not be found. Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'e4c72b14-0ad7-453f-9718-3ed2f911c889'} Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4c72b14-0ad7-453f-9718-3ed2f911c889 could not be found. Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4c72b14-0ad7-453f-9718-3ed2f911c889 could not be found. Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:05:22.438702 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:22.444023 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:22.444023 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:05:22.444023 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:05:22.444023 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:05:22.444023 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:05:22.444023 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4c72b14-0ad7-453f-9718-3ed2f911c889 could not be found. Jul 18 03:05:22.444023 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:22.444023 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d7dc7b90-21e9-4453-b10a-4844e00d78e4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Returning 404 to user: Instance e4c72b14-0ad7-453f-9718-3ed2f911c889 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:05:22.444023 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d7dc7b90-21e9-4453-b10a-4844e00d78e4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/e4c72b14-0ad7-453f-9718-3ed2f911c889" status: 404 len: 111 microversion: 2.1 time: 0.032397 Jul 18 03:05:22.444023 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3111/6199] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:22 2022] GET /compute/v2.1/servers/e4c72b14-0ad7-453f-9718-3ed2f911c889 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:05:22.606031 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-64b331a3-2569-4539-b9c1-38b3aa74bbe9 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '.version_select at 0x7ff49bfaec10>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:22.626453 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-64b331a3-2569-4539-b9c1-38b3aa74bbe9 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-390070385" status: 202 len: 0 microversion: 2.1 time: 0.024477 Jul 18 03:05:22.627114 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3089/6200] 10.222.0.57 () {58 vars in 1253 bytes} [Mon Jul 18 03:05:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-390070385 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:05:23.291937 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8dc5b8a3-222e-408e-8bc7-b61d79b794e0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:23.292507 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8dc5b8a3-222e-408e-8bc7-b61d79b794e0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:23.299626 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8dc5b8a3-222e-408e-8bc7-b61d79b794e0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:23.300088 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8dc5b8a3-222e-408e-8bc7-b61d79b794e0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:23.300889 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8dc5b8a3-222e-408e-8bc7-b61d79b794e0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:23.301874 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8dc5b8a3-222e-408e-8bc7-b61d79b794e0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:23.316173 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-8dc5b8a3-222e-408e-8bc7-b61d79b794e0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] HTTP exception thrown: Instance 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 could not be found. Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8dc5b8a3-222e-408e-8bc7-b61d79b794e0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Request method failure captured: Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 HTTP/1.1 Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1M0c--VxkhAcA4gIHXxijKFI-k8Bpror72Hk1qb235rYnfDmQTByX9LOOCSekEaTY-qK46fTc9MDDZBpaIS7PRARBL52HY7fvnzNvoh5YO0XpJvHbsKLywLFoe1R8EGrLF6lPIQIdQdkEzZxbEDXhePA7F15YYp44S7QRWnysLrh4M4 Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3a83c4dedef341a0bb50fa4c119d3035"}]}] Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersTestJSON-1250523732-project Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 785ff643c00746939bb0fecd775ce920 Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersTestJSON-1250523732-project Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 could not be found. Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '6b85f7c0-8e95-4f8b-9e99-4d43f6497d00'} Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 could not be found. Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 could not be found. Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.317944 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.327289 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:05:23.327289 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:05:23.327289 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:05:23.327289 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:05:23.327289 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 could not be found. Jul 18 03:05:23.327289 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.327289 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8dc5b8a3-222e-408e-8bc7-b61d79b794e0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Returning 404 to user: Instance 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:05:23.327289 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8dc5b8a3-222e-408e-8bc7-b61d79b794e0 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 404 len: 111 microversion: 2.1 time: 0.031517 Jul 18 03:05:23.327289 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3112/6201] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:23 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:05:23.338340 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-56c802d3-ede0-47bb-bb3e-f3fde6fd0cdb tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:23.339087 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-56c802d3-ede0-47bb-bb3e-f3fde6fd0cdb tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:23.346201 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-56c802d3-ede0-47bb-bb3e-f3fde6fd0cdb tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:23.346643 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-56c802d3-ede0-47bb-bb3e-f3fde6fd0cdb tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:23.347403 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-56c802d3-ede0-47bb-bb3e-f3fde6fd0cdb tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:23.347834 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-56c802d3-ede0-47bb-bb3e-f3fde6fd0cdb tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:23.362308 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-56c802d3-ede0-47bb-bb3e-f3fde6fd0cdb tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] HTTP exception thrown: Instance 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 could not be found. Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-56c802d3-ede0-47bb-bb3e-f3fde6fd0cdb tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Request method failure captured: Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 HTTP/1.1 Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M0c--VxkhAcA4gIHXxijKFI-k8Bpror72Hk1qb235rYnfDmQTByX9LOOCSekEaTY-qK46fTc9MDDZBpaIS7PRARBL52HY7fvnzNvoh5YO0XpJvHbsKLywLFoe1R8EGrLF6lPIQIdQdkEzZxbEDXhePA7F15YYp44S7QRWnysLrh4M4 Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3a83c4dedef341a0bb50fa4c119d3035"}]}] Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersTestJSON-1250523732-project Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 785ff643c00746939bb0fecd775ce920 Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersTestJSON-1250523732-project Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 could not be found. Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '6b85f7c0-8e95-4f8b-9e99-4d43f6497d00'} Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 could not be found. Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:05:23.363997 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 could not be found. Jul 18 03:05:23.369189 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.369189 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:05:23.369189 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.369189 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.369189 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:05:23.369189 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:05:23.369189 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:05:23.369189 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:05:23.369189 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 could not be found. Jul 18 03:05:23.369189 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.369189 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-56c802d3-ede0-47bb-bb3e-f3fde6fd0cdb tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Returning 404 to user: Instance 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:05:23.369189 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-56c802d3-ede0-47bb-bb3e-f3fde6fd0cdb tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "DELETE /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 404 len: 111 microversion: 2.1 time: 0.032036 Jul 18 03:05:23.369189 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3090/6202] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:05:23 2022] DELETE /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 03:05:23.379113 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1330aa39-37fd-425a-94e9-587b916ae5c5 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:23.379756 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1330aa39-37fd-425a-94e9-587b916ae5c5 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:23.386170 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1330aa39-37fd-425a-94e9-587b916ae5c5 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:23.386692 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1330aa39-37fd-425a-94e9-587b916ae5c5 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:23.387483 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1330aa39-37fd-425a-94e9-587b916ae5c5 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:23.387936 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1330aa39-37fd-425a-94e9-587b916ae5c5 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:23.402822 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-1330aa39-37fd-425a-94e9-587b916ae5c5 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] HTTP exception thrown: Instance 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 could not be found. Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1330aa39-37fd-425a-94e9-587b916ae5c5 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Request method failure captured: Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 HTTP/1.1 Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1M0c--VxkhAcA4gIHXxijKFI-k8Bpror72Hk1qb235rYnfDmQTByX9LOOCSekEaTY-qK46fTc9MDDZBpaIS7PRARBL52HY7fvnzNvoh5YO0XpJvHbsKLywLFoe1R8EGrLF6lPIQIdQdkEzZxbEDXhePA7F15YYp44S7QRWnysLrh4M4 Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3a83c4dedef341a0bb50fa4c119d3035"}]}] Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersTestJSON-1250523732-project Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 785ff643c00746939bb0fecd775ce920 Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersTestJSON-1250523732-project Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 could not be found. Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '6b85f7c0-8e95-4f8b-9e99-4d43f6497d00'} Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 could not be found. Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 could not be found. Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.405268 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.410188 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:05:23.410188 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:05:23.410188 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:05:23.410188 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:05:23.410188 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 could not be found. Jul 18 03:05:23.410188 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.410188 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1330aa39-37fd-425a-94e9-587b916ae5c5 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Returning 404 to user: Instance 6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:05:23.410188 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1330aa39-37fd-425a-94e9-587b916ae5c5 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00" status: 404 len: 111 microversion: 2.1 time: 0.031610 Jul 18 03:05:23.410188 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3113/6203] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:23 2022] GET /compute/v2.1/servers/6b85f7c0-8e95-4f8b-9e99-4d43f6497d00 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:05:23.417039 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c22394ed-f76c-4502-98f7-a7cd788a3b22 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:23.418294 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c22394ed-f76c-4502-98f7-a7cd788a3b22 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 62137bb4-7cff-4963-9636-51c09061f10d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:23.426412 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c22394ed-f76c-4502-98f7-a7cd788a3b22 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:23.426872 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c22394ed-f76c-4502-98f7-a7cd788a3b22 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:23.427660 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c22394ed-f76c-4502-98f7-a7cd788a3b22 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:23.428102 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c22394ed-f76c-4502-98f7-a7cd788a3b22 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:23.445160 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-c22394ed-f76c-4502-98f7-a7cd788a3b22 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] HTTP exception thrown: Instance 62137bb4-7cff-4963-9636-51c09061f10d could not be found. Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c22394ed-f76c-4502-98f7-a7cd788a3b22 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Request method failure captured: Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d HTTP/1.1 Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M0c--VxkhAcA4gIHXxijKFI-k8Bpror72Hk1qb235rYnfDmQTByX9LOOCSekEaTY-qK46fTc9MDDZBpaIS7PRARBL52HY7fvnzNvoh5YO0XpJvHbsKLywLFoe1R8EGrLF6lPIQIdQdkEzZxbEDXhePA7F15YYp44S7QRWnysLrh4M4 Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3a83c4dedef341a0bb50fa4c119d3035"}]}] Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersTestJSON-1250523732-project Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 785ff643c00746939bb0fecd775ce920 Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersTestJSON-1250523732-project Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 62137bb4-7cff-4963-9636-51c09061f10d could not be found. Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '62137bb4-7cff-4963-9636-51c09061f10d'} Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62137bb4-7cff-4963-9636-51c09061f10d could not be found. Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:05:23.446775 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62137bb4-7cff-4963-9636-51c09061f10d could not be found. Jul 18 03:05:23.452105 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.452105 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:05:23.452105 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.452105 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.452105 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:05:23.452105 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:05:23.452105 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:05:23.452105 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:05:23.452105 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62137bb4-7cff-4963-9636-51c09061f10d could not be found. Jul 18 03:05:23.452105 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.452105 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c22394ed-f76c-4502-98f7-a7cd788a3b22 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Returning 404 to user: Instance 62137bb4-7cff-4963-9636-51c09061f10d could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:05:23.452105 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c22394ed-f76c-4502-98f7-a7cd788a3b22 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "DELETE /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d" status: 404 len: 111 microversion: 2.1 time: 0.035171 Jul 18 03:05:23.452105 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3091/6204] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:05:23 2022] DELETE /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:05:23.457822 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5d776d48-7723-4ec6-81cf-4314ab072e96 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:23.458457 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5d776d48-7723-4ec6-81cf-4314ab072e96 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 62137bb4-7cff-4963-9636-51c09061f10d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:23.466853 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5d776d48-7723-4ec6-81cf-4314ab072e96 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:23.467323 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5d776d48-7723-4ec6-81cf-4314ab072e96 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:23.468127 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5d776d48-7723-4ec6-81cf-4314ab072e96 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:23.468587 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5d776d48-7723-4ec6-81cf-4314ab072e96 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:23.483854 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-5d776d48-7723-4ec6-81cf-4314ab072e96 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] HTTP exception thrown: Instance 62137bb4-7cff-4963-9636-51c09061f10d could not be found. Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5d776d48-7723-4ec6-81cf-4314ab072e96 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Request method failure captured: Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d HTTP/1.1 Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1M0c--VxkhAcA4gIHXxijKFI-k8Bpror72Hk1qb235rYnfDmQTByX9LOOCSekEaTY-qK46fTc9MDDZBpaIS7PRARBL52HY7fvnzNvoh5YO0XpJvHbsKLywLFoe1R8EGrLF6lPIQIdQdkEzZxbEDXhePA7F15YYp44S7QRWnysLrh4M4 Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3a83c4dedef341a0bb50fa4c119d3035"}]}] Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersTestJSON-1250523732-project Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 785ff643c00746939bb0fecd775ce920 Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersTestJSON-1250523732-project Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 62137bb4-7cff-4963-9636-51c09061f10d could not be found. Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '62137bb4-7cff-4963-9636-51c09061f10d'} Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62137bb4-7cff-4963-9636-51c09061f10d could not be found. Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62137bb4-7cff-4963-9636-51c09061f10d could not be found. Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.485422 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.491823 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:05:23.491823 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:05:23.491823 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:05:23.491823 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:05:23.491823 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62137bb4-7cff-4963-9636-51c09061f10d could not be found. Jul 18 03:05:23.491823 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.491823 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5d776d48-7723-4ec6-81cf-4314ab072e96 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Returning 404 to user: Instance 62137bb4-7cff-4963-9636-51c09061f10d could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:05:23.491823 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5d776d48-7723-4ec6-81cf-4314ab072e96 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d" status: 404 len: 111 microversion: 2.1 time: 0.033087 Jul 18 03:05:23.491823 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3114/6205] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:23 2022] GET /compute/v2.1/servers/62137bb4-7cff-4963-9636-51c09061f10d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:05:23.496797 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6fa527d2-6968-45ac-ae93-fcbf1f84fed9 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:23.497843 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6fa527d2-6968-45ac-ae93-fcbf1f84fed9 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 854b9c4e-a7a6-401c-afff-8670379eea51] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:23.502035 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-1223a46b-c2d3-4f94-81eb-f5ac80d99458 req-575ba47f-d4e8-42b0-84f0-8ade5553b848 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4c72b14-0ad7-453f-9718-3ed2f911c889", "name": "network-vif-deleted", "tag": "9beb4cc4-0dde-4552-9926-2ff902db0fff"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:05:23.504631 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6fa527d2-6968-45ac-ae93-fcbf1f84fed9 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:23.505283 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6fa527d2-6968-45ac-ae93-fcbf1f84fed9 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:23.506197 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6fa527d2-6968-45ac-ae93-fcbf1f84fed9 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:23.506703 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6fa527d2-6968-45ac-ae93-fcbf1f84fed9 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:23.512100 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-1223a46b-c2d3-4f94-81eb-f5ac80d99458 req-575ba47f-d4e8-42b0-84f0-8ade5553b848 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:23.512100 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-1223a46b-c2d3-4f94-81eb-f5ac80d99458 req-575ba47f-d4e8-42b0-84f0-8ade5553b848 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:23.523107 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-6fa527d2-6968-45ac-ae93-fcbf1f84fed9 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] HTTP exception thrown: Instance 854b9c4e-a7a6-401c-afff-8670379eea51 could not be found. Jul 18 03:05:23.524042 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-1223a46b-c2d3-4f94-81eb-f5ac80d99458 req-575ba47f-d4e8-42b0-84f0-8ade5553b848 service nova] Creating event network-vif-deleted:9beb4cc4-0dde-4552-9926-2ff902db0fff for instance e4c72b14-0ad7-453f-9718-3ed2f911c889 on n-h2-465891-3 Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6fa527d2-6968-45ac-ae93-fcbf1f84fed9 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Request method failure captured: Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51 HTTP/1.1 Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M0c--VxkhAcA4gIHXxijKFI-k8Bpror72Hk1qb235rYnfDmQTByX9LOOCSekEaTY-qK46fTc9MDDZBpaIS7PRARBL52HY7fvnzNvoh5YO0XpJvHbsKLywLFoe1R8EGrLF6lPIQIdQdkEzZxbEDXhePA7F15YYp44S7QRWnysLrh4M4 Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3a83c4dedef341a0bb50fa4c119d3035"}]}] Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersTestJSON-1250523732-project Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 785ff643c00746939bb0fecd775ce920 Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersTestJSON-1250523732-project Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 854b9c4e-a7a6-401c-afff-8670379eea51 could not be found. Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '854b9c4e-a7a6-401c-afff-8670379eea51'} Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 854b9c4e-a7a6-401c-afff-8670379eea51 could not be found. Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:05:23.524794 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 854b9c4e-a7a6-401c-afff-8670379eea51 could not be found. Jul 18 03:05:23.533085 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.533085 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:05:23.533085 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.533085 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.533085 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:05:23.533085 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:05:23.533085 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:05:23.533085 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:05:23.533085 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 854b9c4e-a7a6-401c-afff-8670379eea51 could not be found. Jul 18 03:05:23.533085 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.533085 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6fa527d2-6968-45ac-ae93-fcbf1f84fed9 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Returning 404 to user: Instance 854b9c4e-a7a6-401c-afff-8670379eea51 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:05:23.533085 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6fa527d2-6968-45ac-ae93-fcbf1f84fed9 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "DELETE /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51" status: 404 len: 111 microversion: 2.1 time: 0.034107 Jul 18 03:05:23.533085 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3092/6206] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:05:23 2022] DELETE /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:05:23.538323 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-1223a46b-c2d3-4f94-81eb-f5ac80d99458 req-575ba47f-d4e8-42b0-84f0-8ade5553b848 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035396 Jul 18 03:05:23.538323 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3115/6207] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:05:23.538847 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c86cea3b-c764-43c4-bb1e-64a3562eb51d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:23.539500 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c86cea3b-c764-43c4-bb1e-64a3562eb51d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 854b9c4e-a7a6-401c-afff-8670379eea51] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:23.550432 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c86cea3b-c764-43c4-bb1e-64a3562eb51d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:23.552553 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c86cea3b-c764-43c4-bb1e-64a3562eb51d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:23.553551 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c86cea3b-c764-43c4-bb1e-64a3562eb51d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:23.554026 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c86cea3b-c764-43c4-bb1e-64a3562eb51d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:23.569136 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-c86cea3b-c764-43c4-bb1e-64a3562eb51d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] HTTP exception thrown: Instance 854b9c4e-a7a6-401c-afff-8670379eea51 could not be found. Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c86cea3b-c764-43c4-bb1e-64a3562eb51d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Request method failure captured: Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51 HTTP/1.1 Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M0c--VxkhAcA4gIHXxijKFI-k8Bpror72Hk1qb235rYnfDmQTByX9LOOCSekEaTY-qK46fTc9MDDZBpaIS7PRARBL52HY7fvnzNvoh5YO0XpJvHbsKLywLFoe1R8EGrLF6lPIQIdQdkEzZxbEDXhePA7F15YYp44S7QRWnysLrh4M4 Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3a83c4dedef341a0bb50fa4c119d3035"}]}] Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersTestJSON-1250523732-project Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 785ff643c00746939bb0fecd775ce920 Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersTestJSON-1250523732-project Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 854b9c4e-a7a6-401c-afff-8670379eea51 could not be found. Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '854b9c4e-a7a6-401c-afff-8670379eea51'} Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 854b9c4e-a7a6-401c-afff-8670379eea51 could not be found. Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 854b9c4e-a7a6-401c-afff-8670379eea51 could not be found. Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.570575 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.577262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:05:23.577262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:05:23.577262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:05:23.577262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:05:23.577262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 854b9c4e-a7a6-401c-afff-8670379eea51 could not be found. Jul 18 03:05:23.577262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.577262 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c86cea3b-c764-43c4-bb1e-64a3562eb51d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Returning 404 to user: Instance 854b9c4e-a7a6-401c-afff-8670379eea51 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:05:23.577262 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c86cea3b-c764-43c4-bb1e-64a3562eb51d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51" status: 404 len: 111 microversion: 2.1 time: 0.039175 Jul 18 03:05:23.581822 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3093/6208] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:23 2022] GET /compute/v2.1/servers/854b9c4e-a7a6-401c-afff-8670379eea51 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:05:23.582832 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f20f5ef8-cd75-47e6-8ff3-2eb097ec7ba3 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:23.583331 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f20f5ef8-cd75-47e6-8ff3-2eb097ec7ba3 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 8cc40222-82fc-4d28-bce8-e754679126ab] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:23.590680 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f20f5ef8-cd75-47e6-8ff3-2eb097ec7ba3 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:23.591151 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f20f5ef8-cd75-47e6-8ff3-2eb097ec7ba3 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:23.592362 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f20f5ef8-cd75-47e6-8ff3-2eb097ec7ba3 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:23.592480 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f20f5ef8-cd75-47e6-8ff3-2eb097ec7ba3 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:23.607044 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-f20f5ef8-cd75-47e6-8ff3-2eb097ec7ba3 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] HTTP exception thrown: Instance 8cc40222-82fc-4d28-bce8-e754679126ab could not be found. Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f20f5ef8-cd75-47e6-8ff3-2eb097ec7ba3 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Request method failure captured: Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/servers/8cc40222-82fc-4d28-bce8-e754679126ab HTTP/1.1 Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1M0c--VxkhAcA4gIHXxijKFI-k8Bpror72Hk1qb235rYnfDmQTByX9LOOCSekEaTY-qK46fTc9MDDZBpaIS7PRARBL52HY7fvnzNvoh5YO0XpJvHbsKLywLFoe1R8EGrLF6lPIQIdQdkEzZxbEDXhePA7F15YYp44S7QRWnysLrh4M4 Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3a83c4dedef341a0bb50fa4c119d3035"}]}] Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersTestJSON-1250523732-project Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 785ff643c00746939bb0fecd775ce920 Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersTestJSON-1250523732-project Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 8cc40222-82fc-4d28-bce8-e754679126ab could not be found. Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '8cc40222-82fc-4d28-bce8-e754679126ab'} Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cc40222-82fc-4d28-bce8-e754679126ab could not be found. Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:05:23.608770 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cc40222-82fc-4d28-bce8-e754679126ab could not be found. Jul 18 03:05:23.614254 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.614254 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:05:23.614254 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.614254 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.614254 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:05:23.614254 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:05:23.614254 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:05:23.614254 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:05:23.614254 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cc40222-82fc-4d28-bce8-e754679126ab could not be found. Jul 18 03:05:23.614254 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.614254 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f20f5ef8-cd75-47e6-8ff3-2eb097ec7ba3 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Returning 404 to user: Instance 8cc40222-82fc-4d28-bce8-e754679126ab could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:05:23.614254 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f20f5ef8-cd75-47e6-8ff3-2eb097ec7ba3 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8cc40222-82fc-4d28-bce8-e754679126ab" status: 404 len: 111 microversion: 2.1 time: 0.031854 Jul 18 03:05:23.614254 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3116/6209] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:05:23 2022] DELETE /compute/v2.1/servers/8cc40222-82fc-4d28-bce8-e754679126ab => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:05:23.618781 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-75bc2c97-7b31-4f39-baa5-63ed4fef8588 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:23.619430 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-75bc2c97-7b31-4f39-baa5-63ed4fef8588 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 8cc40222-82fc-4d28-bce8-e754679126ab] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:23.627391 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-75bc2c97-7b31-4f39-baa5-63ed4fef8588 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:23.628397 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-75bc2c97-7b31-4f39-baa5-63ed4fef8588 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:23.629180 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-75bc2c97-7b31-4f39-baa5-63ed4fef8588 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:23.629614 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-75bc2c97-7b31-4f39-baa5-63ed4fef8588 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:23.644737 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-75bc2c97-7b31-4f39-baa5-63ed4fef8588 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] HTTP exception thrown: Instance 8cc40222-82fc-4d28-bce8-e754679126ab could not be found. Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-75bc2c97-7b31-4f39-baa5-63ed4fef8588 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Request method failure captured: Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/8cc40222-82fc-4d28-bce8-e754679126ab HTTP/1.1 Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M0c--VxkhAcA4gIHXxijKFI-k8Bpror72Hk1qb235rYnfDmQTByX9LOOCSekEaTY-qK46fTc9MDDZBpaIS7PRARBL52HY7fvnzNvoh5YO0XpJvHbsKLywLFoe1R8EGrLF6lPIQIdQdkEzZxbEDXhePA7F15YYp44S7QRWnysLrh4M4 Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3a83c4dedef341a0bb50fa4c119d3035"}]}] Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersTestJSON-1250523732-project Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 785ff643c00746939bb0fecd775ce920 Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersTestJSON-1250523732-project Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 8cc40222-82fc-4d28-bce8-e754679126ab could not be found. Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '8cc40222-82fc-4d28-bce8-e754679126ab'} Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cc40222-82fc-4d28-bce8-e754679126ab could not be found. Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cc40222-82fc-4d28-bce8-e754679126ab could not be found. Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.646333 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.651571 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:05:23.651571 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:05:23.651571 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:05:23.651571 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:05:23.651571 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cc40222-82fc-4d28-bce8-e754679126ab could not be found. Jul 18 03:05:23.651571 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.651571 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-75bc2c97-7b31-4f39-baa5-63ed4fef8588 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Returning 404 to user: Instance 8cc40222-82fc-4d28-bce8-e754679126ab could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:05:23.651571 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-75bc2c97-7b31-4f39-baa5-63ed4fef8588 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/8cc40222-82fc-4d28-bce8-e754679126ab" status: 404 len: 111 microversion: 2.1 time: 0.033439 Jul 18 03:05:23.651571 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3094/6210] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:23 2022] GET /compute/v2.1/servers/8cc40222-82fc-4d28-bce8-e754679126ab => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 03:05:23.658033 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4c6e8520-466f-4604-a487-7cc147050c29 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:23.658676 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4c6e8520-466f-4604-a487-7cc147050c29 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: d65bfa08-ae5d-422b-a045-71d045b06e44] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:23.665233 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4c6e8520-466f-4604-a487-7cc147050c29 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:23.665820 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4c6e8520-466f-4604-a487-7cc147050c29 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:23.666689 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4c6e8520-466f-4604-a487-7cc147050c29 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:23.667233 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4c6e8520-466f-4604-a487-7cc147050c29 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:23.682471 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-4c6e8520-466f-4604-a487-7cc147050c29 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] HTTP exception thrown: Instance d65bfa08-ae5d-422b-a045-71d045b06e44 could not be found. Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4c6e8520-466f-4604-a487-7cc147050c29 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Request method failure captured: Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44 HTTP/1.1 Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1M0c--VxkhAcA4gIHXxijKFI-k8Bpror72Hk1qb235rYnfDmQTByX9LOOCSekEaTY-qK46fTc9MDDZBpaIS7PRARBL52HY7fvnzNvoh5YO0XpJvHbsKLywLFoe1R8EGrLF6lPIQIdQdkEzZxbEDXhePA7F15YYp44S7QRWnysLrh4M4 Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3a83c4dedef341a0bb50fa4c119d3035"}]}] Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersTestJSON-1250523732-project Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 785ff643c00746939bb0fecd775ce920 Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersTestJSON-1250523732-project Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance d65bfa08-ae5d-422b-a045-71d045b06e44 could not be found. Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'd65bfa08-ae5d-422b-a045-71d045b06e44'} Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d65bfa08-ae5d-422b-a045-71d045b06e44 could not be found. Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:05:23.685125 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d65bfa08-ae5d-422b-a045-71d045b06e44 could not be found. Jul 18 03:05:23.690200 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.690200 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:05:23.690200 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.690200 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.690200 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:05:23.690200 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:05:23.690200 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:05:23.690200 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:05:23.690200 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d65bfa08-ae5d-422b-a045-71d045b06e44 could not be found. Jul 18 03:05:23.690200 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.690200 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4c6e8520-466f-4604-a487-7cc147050c29 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Returning 404 to user: Instance d65bfa08-ae5d-422b-a045-71d045b06e44 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:05:23.690200 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4c6e8520-466f-4604-a487-7cc147050c29 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44" status: 404 len: 111 microversion: 2.1 time: 0.032888 Jul 18 03:05:23.691452 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3117/6211] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:05:23 2022] DELETE /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:05:23.695449 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a2af0e7d-f59a-403f-8782-ee01454c529d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:23.696059 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a2af0e7d-f59a-403f-8782-ee01454c529d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: d65bfa08-ae5d-422b-a045-71d045b06e44] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:23.703232 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a2af0e7d-f59a-403f-8782-ee01454c529d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:23.703682 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a2af0e7d-f59a-403f-8782-ee01454c529d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:23.704632 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a2af0e7d-f59a-403f-8782-ee01454c529d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:23.705249 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a2af0e7d-f59a-403f-8782-ee01454c529d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:23.721243 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-a2af0e7d-f59a-403f-8782-ee01454c529d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] HTTP exception thrown: Instance d65bfa08-ae5d-422b-a045-71d045b06e44 could not be found. Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a2af0e7d-f59a-403f-8782-ee01454c529d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Request method failure captured: Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44 HTTP/1.1 Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M0c--VxkhAcA4gIHXxijKFI-k8Bpror72Hk1qb235rYnfDmQTByX9LOOCSekEaTY-qK46fTc9MDDZBpaIS7PRARBL52HY7fvnzNvoh5YO0XpJvHbsKLywLFoe1R8EGrLF6lPIQIdQdkEzZxbEDXhePA7F15YYp44S7QRWnysLrh4M4 Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3a83c4dedef341a0bb50fa4c119d3035"}]}] Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersTestJSON-1250523732-project Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 785ff643c00746939bb0fecd775ce920 Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersTestJSON-1250523732-project Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance d65bfa08-ae5d-422b-a045-71d045b06e44 could not be found. Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'd65bfa08-ae5d-422b-a045-71d045b06e44'} Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d65bfa08-ae5d-422b-a045-71d045b06e44 could not be found. Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d65bfa08-ae5d-422b-a045-71d045b06e44 could not be found. Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.722822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.729428 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:05:23.729428 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:05:23.729428 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:05:23.729428 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:05:23.729428 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d65bfa08-ae5d-422b-a045-71d045b06e44 could not be found. Jul 18 03:05:23.729428 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.729428 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a2af0e7d-f59a-403f-8782-ee01454c529d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Returning 404 to user: Instance d65bfa08-ae5d-422b-a045-71d045b06e44 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:05:23.729428 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a2af0e7d-f59a-403f-8782-ee01454c529d tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44" status: 404 len: 111 microversion: 2.1 time: 0.032855 Jul 18 03:05:23.729428 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3095/6212] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:23 2022] GET /compute/v2.1/servers/d65bfa08-ae5d-422b-a045-71d045b06e44 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:05:23.733652 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b103ed5a-9bf5-45ee-8a85-d89870da87c2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:23.734190 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b103ed5a-9bf5-45ee-8a85-d89870da87c2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: af6f7e23-115f-4853-934d-e53508a8b01d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:23.740742 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b103ed5a-9bf5-45ee-8a85-d89870da87c2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:23.741208 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b103ed5a-9bf5-45ee-8a85-d89870da87c2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:23.742032 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b103ed5a-9bf5-45ee-8a85-d89870da87c2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:23.742483 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b103ed5a-9bf5-45ee-8a85-d89870da87c2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:23.759627 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-b103ed5a-9bf5-45ee-8a85-d89870da87c2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] HTTP exception thrown: Instance af6f7e23-115f-4853-934d-e53508a8b01d could not be found. Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b103ed5a-9bf5-45ee-8a85-d89870da87c2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Request method failure captured: Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d HTTP/1.1 Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1M0c--VxkhAcA4gIHXxijKFI-k8Bpror72Hk1qb235rYnfDmQTByX9LOOCSekEaTY-qK46fTc9MDDZBpaIS7PRARBL52HY7fvnzNvoh5YO0XpJvHbsKLywLFoe1R8EGrLF6lPIQIdQdkEzZxbEDXhePA7F15YYp44S7QRWnysLrh4M4 Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3a83c4dedef341a0bb50fa4c119d3035"}]}] Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersTestJSON-1250523732-project Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 785ff643c00746939bb0fecd775ce920 Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersTestJSON-1250523732-project Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance af6f7e23-115f-4853-934d-e53508a8b01d could not be found. Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'af6f7e23-115f-4853-934d-e53508a8b01d'} Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af6f7e23-115f-4853-934d-e53508a8b01d could not be found. Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:05:23.761237 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af6f7e23-115f-4853-934d-e53508a8b01d could not be found. Jul 18 03:05:23.767304 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.767304 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:05:23.767304 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.767304 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.767304 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:05:23.767304 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:05:23.767304 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:05:23.767304 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:05:23.767304 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af6f7e23-115f-4853-934d-e53508a8b01d could not be found. Jul 18 03:05:23.767304 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.767304 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b103ed5a-9bf5-45ee-8a85-d89870da87c2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Returning 404 to user: Instance af6f7e23-115f-4853-934d-e53508a8b01d could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:05:23.767304 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b103ed5a-9bf5-45ee-8a85-d89870da87c2 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "DELETE /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d" status: 404 len: 111 microversion: 2.1 time: 0.034082 Jul 18 03:05:23.771839 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3118/6213] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:05:23 2022] DELETE /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:05:23.772045 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6fe6bf96-583f-405c-9bec-27d0a9638b5f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:23.772508 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6fe6bf96-583f-405c-9bec-27d0a9638b5f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: af6f7e23-115f-4853-934d-e53508a8b01d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:23.779421 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6fe6bf96-583f-405c-9bec-27d0a9638b5f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:23.779877 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6fe6bf96-583f-405c-9bec-27d0a9638b5f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:23.780655 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6fe6bf96-583f-405c-9bec-27d0a9638b5f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:23.781292 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6fe6bf96-583f-405c-9bec-27d0a9638b5f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:23.797285 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-6fe6bf96-583f-405c-9bec-27d0a9638b5f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] HTTP exception thrown: Instance af6f7e23-115f-4853-934d-e53508a8b01d could not be found. Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6fe6bf96-583f-405c-9bec-27d0a9638b5f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Request method failure captured: Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d HTTP/1.1 Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M0c--VxkhAcA4gIHXxijKFI-k8Bpror72Hk1qb235rYnfDmQTByX9LOOCSekEaTY-qK46fTc9MDDZBpaIS7PRARBL52HY7fvnzNvoh5YO0XpJvHbsKLywLFoe1R8EGrLF6lPIQIdQdkEzZxbEDXhePA7F15YYp44S7QRWnysLrh4M4 Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3a83c4dedef341a0bb50fa4c119d3035"}]}] Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersTestJSON-1250523732-project Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 785ff643c00746939bb0fecd775ce920 Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersTestJSON-1250523732-project Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance af6f7e23-115f-4853-934d-e53508a8b01d could not be found. Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'af6f7e23-115f-4853-934d-e53508a8b01d'} Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af6f7e23-115f-4853-934d-e53508a8b01d could not be found. Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af6f7e23-115f-4853-934d-e53508a8b01d could not be found. Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.798943 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.804246 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:05:23.804246 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:05:23.804246 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:05:23.804246 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:05:23.804246 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af6f7e23-115f-4853-934d-e53508a8b01d could not be found. Jul 18 03:05:23.804246 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.804246 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6fe6bf96-583f-405c-9bec-27d0a9638b5f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Returning 404 to user: Instance af6f7e23-115f-4853-934d-e53508a8b01d could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:05:23.804246 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6fe6bf96-583f-405c-9bec-27d0a9638b5f tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d" status: 404 len: 111 microversion: 2.1 time: 0.032345 Jul 18 03:05:23.804246 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3096/6214] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:23 2022] GET /compute/v2.1/servers/af6f7e23-115f-4853-934d-e53508a8b01d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:05:23.811237 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b0c7a5cb-5f27-44f3-a0fe-be7cdbce1bdf tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:23.811749 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b0c7a5cb-5f27-44f3-a0fe-be7cdbce1bdf tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 9084b83a-605e-4c30-9224-3944a6db007d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:23.817465 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-b0c7a5cb-5f27-44f3-a0fe-be7cdbce1bdf tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] HTTP exception thrown: Instance 9084b83a-605e-4c30-9224-3944a6db007d could not be found. Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b0c7a5cb-5f27-44f3-a0fe-be7cdbce1bdf tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Request method failure captured: Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/servers/9084b83a-605e-4c30-9224-3944a6db007d HTTP/1.1 Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1M0c--VxkhAcA4gIHXxijKFI-k8Bpror72Hk1qb235rYnfDmQTByX9LOOCSekEaTY-qK46fTc9MDDZBpaIS7PRARBL52HY7fvnzNvoh5YO0XpJvHbsKLywLFoe1R8EGrLF6lPIQIdQdkEzZxbEDXhePA7F15YYp44S7QRWnysLrh4M4 Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3a83c4dedef341a0bb50fa4c119d3035"}]}] Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersTestJSON-1250523732-project Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 785ff643c00746939bb0fecd775ce920 Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersTestJSON-1250523732-project Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 9084b83a-605e-4c30-9224-3944a6db007d could not be found. Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '9084b83a-605e-4c30-9224-3944a6db007d'} Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9084b83a-605e-4c30-9224-3944a6db007d could not be found. Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9084b83a-605e-4c30-9224-3944a6db007d could not be found. Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:05:23.819027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.824962 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.824962 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:05:23.824962 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:05:23.824962 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:05:23.824962 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:05:23.824962 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9084b83a-605e-4c30-9224-3944a6db007d could not be found. Jul 18 03:05:23.824962 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.824962 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b0c7a5cb-5f27-44f3-a0fe-be7cdbce1bdf tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Returning 404 to user: Instance 9084b83a-605e-4c30-9224-3944a6db007d could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:05:23.824962 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b0c7a5cb-5f27-44f3-a0fe-be7cdbce1bdf tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9084b83a-605e-4c30-9224-3944a6db007d" status: 404 len: 111 microversion: 2.1 time: 0.013697 Jul 18 03:05:23.824962 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3119/6215] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:05:23 2022] DELETE /compute/v2.1/servers/9084b83a-605e-4c30-9224-3944a6db007d => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:05:23.829798 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a16d52c8-9f0d-42db-aad8-ec198b0db777 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:23.830417 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a16d52c8-9f0d-42db-aad8-ec198b0db777 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: 9084b83a-605e-4c30-9224-3944a6db007d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:23.836031 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-a16d52c8-9f0d-42db-aad8-ec198b0db777 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] HTTP exception thrown: Instance 9084b83a-605e-4c30-9224-3944a6db007d could not be found. Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a16d52c8-9f0d-42db-aad8-ec198b0db777 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Request method failure captured: Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/9084b83a-605e-4c30-9224-3944a6db007d HTTP/1.1 Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M0c--VxkhAcA4gIHXxijKFI-k8Bpror72Hk1qb235rYnfDmQTByX9LOOCSekEaTY-qK46fTc9MDDZBpaIS7PRARBL52HY7fvnzNvoh5YO0XpJvHbsKLywLFoe1R8EGrLF6lPIQIdQdkEzZxbEDXhePA7F15YYp44S7QRWnysLrh4M4 Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3a83c4dedef341a0bb50fa4c119d3035"}]}] Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersTestJSON-1250523732-project Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 785ff643c00746939bb0fecd775ce920 Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersTestJSON-1250523732-project Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 9084b83a-605e-4c30-9224-3944a6db007d could not be found. Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '9084b83a-605e-4c30-9224-3944a6db007d'} Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9084b83a-605e-4c30-9224-3944a6db007d could not be found. Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9084b83a-605e-4c30-9224-3944a6db007d could not be found. Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:05:23.837518 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:05:23.843447 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:05:23.843447 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:05:23.843447 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9084b83a-605e-4c30-9224-3944a6db007d could not be found. Jul 18 03:05:23.843447 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:23.843447 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a16d52c8-9f0d-42db-aad8-ec198b0db777 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Returning 404 to user: Instance 9084b83a-605e-4c30-9224-3944a6db007d could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:05:23.843447 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a16d52c8-9f0d-42db-aad8-ec198b0db777 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/9084b83a-605e-4c30-9224-3944a6db007d" status: 404 len: 111 microversion: 2.1 time: 0.013365 Jul 18 03:05:23.843447 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3097/6216] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:23 2022] GET /compute/v2.1/servers/9084b83a-605e-4c30-9224-3944a6db007d => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:05:23.848433 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-05191366-27de-441a-aabb-2fc5976e52b3 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:23.848941 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-05191366-27de-441a-aabb-2fc5976e52b3 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: ec729ac5-b620-4d07-bba8-9f098936d929] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:23.856597 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-05191366-27de-441a-aabb-2fc5976e52b3 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:23.857028 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-05191366-27de-441a-aabb-2fc5976e52b3 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:23.857838 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-05191366-27de-441a-aabb-2fc5976e52b3 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:23.858290 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-05191366-27de-441a-aabb-2fc5976e52b3 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:23.861104 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:05:23.889893 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-05191366-27de-441a-aabb-2fc5976e52b3 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: ec729ac5-b620-4d07-bba8-9f098936d929] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:05:23.979291 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-05191366-27de-441a-aabb-2fc5976e52b3 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ec729ac5-b620-4d07-bba8-9f098936d929" status: 204 len: 0 microversion: 2.1 time: 0.134319 Jul 18 03:05:23.980035 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3120/6217] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:05:23 2022] DELETE /compute/v2.1/servers/ec729ac5-b620-4d07-bba8-9f098936d929 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 03:05:23.989007 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-21a27178-f5d6-4b40-8bb2-71dc1d2b1521 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:23.989639 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-21a27178-f5d6-4b40-8bb2-71dc1d2b1521 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: ec729ac5-b620-4d07-bba8-9f098936d929] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:23.997379 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-21a27178-f5d6-4b40-8bb2-71dc1d2b1521 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:23.998119 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-21a27178-f5d6-4b40-8bb2-71dc1d2b1521 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:23.998895 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-21a27178-f5d6-4b40-8bb2-71dc1d2b1521 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:23.999325 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-21a27178-f5d6-4b40-8bb2-71dc1d2b1521 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:24.320448 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-21a27178-f5d6-4b40-8bb2-71dc1d2b1521 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:24.328918 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-21a27178-f5d6-4b40-8bb2-71dc1d2b1521 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/ec729ac5-b620-4d07-bba8-9f098936d929" status: 200 len: 1479 microversion: 2.1 time: 0.343908 Jul 18 03:05:24.329498 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3098/6218] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:23 2022] GET /compute/v2.1/servers/ec729ac5-b620-4d07-bba8-9f098936d929 => generated 1479 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:25.347774 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e80c3e91-159f-48a4-a59d-5fbaa7376035 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:25.348568 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e80c3e91-159f-48a4-a59d-5fbaa7376035 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: ec729ac5-b620-4d07-bba8-9f098936d929] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:25.356375 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e80c3e91-159f-48a4-a59d-5fbaa7376035 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:25.356987 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e80c3e91-159f-48a4-a59d-5fbaa7376035 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:25.357876 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e80c3e91-159f-48a4-a59d-5fbaa7376035 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:25.358394 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e80c3e91-159f-48a4-a59d-5fbaa7376035 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:25.499866 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e80c3e91-159f-48a4-a59d-5fbaa7376035 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:25.508114 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e80c3e91-159f-48a4-a59d-5fbaa7376035 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/ec729ac5-b620-4d07-bba8-9f098936d929" status: 200 len: 1479 microversion: 2.1 time: 0.164950 Jul 18 03:05:25.518444 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3121/6219] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:25 2022] GET /compute/v2.1/servers/ec729ac5-b620-4d07-bba8-9f098936d929 => generated 1479 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:05:26.364200 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-306e4b2e-760f-4322-bc86-6319d7aa0319 req-6ee90862-f209-409b-9318-e9b7adaaf133 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec729ac5-b620-4d07-bba8-9f098936d929", "name": "network-vif-deleted", "tag": "3023158c-714c-4be3-9417-129f2f0b3be4"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:05:26.377758 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-306e4b2e-760f-4322-bc86-6319d7aa0319 req-6ee90862-f209-409b-9318-e9b7adaaf133 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:26.378523 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-306e4b2e-760f-4322-bc86-6319d7aa0319 req-6ee90862-f209-409b-9318-e9b7adaaf133 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:26.392553 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-306e4b2e-760f-4322-bc86-6319d7aa0319 req-6ee90862-f209-409b-9318-e9b7adaaf133 service nova] Creating event network-vif-deleted:3023158c-714c-4be3-9417-129f2f0b3be4 for instance ec729ac5-b620-4d07-bba8-9f098936d929 on n-h1-465891-3 Jul 18 03:05:26.399980 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-306e4b2e-760f-4322-bc86-6319d7aa0319 req-6ee90862-f209-409b-9318-e9b7adaaf133 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039575 Jul 18 03:05:26.401573 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3099/6220] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:05:26.526254 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4c193dbb-eda6-41b2-8c1f-c0aefeeb45a5 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:26.526994 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4c193dbb-eda6-41b2-8c1f-c0aefeeb45a5 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: ec729ac5-b620-4d07-bba8-9f098936d929] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:26.536596 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4c193dbb-eda6-41b2-8c1f-c0aefeeb45a5 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:26.537974 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4c193dbb-eda6-41b2-8c1f-c0aefeeb45a5 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:26.549182 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4c193dbb-eda6-41b2-8c1f-c0aefeeb45a5 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:26.549668 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4c193dbb-eda6-41b2-8c1f-c0aefeeb45a5 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:26.594457 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4c193dbb-eda6-41b2-8c1f-c0aefeeb45a5 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:26.594928 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4c193dbb-eda6-41b2-8c1f-c0aefeeb45a5 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:26.595385 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-4c193dbb-eda6-41b2-8c1f-c0aefeeb45a5 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lazy-loading 'fault' on Instance uuid ec729ac5-b620-4d07-bba8-9f098936d929 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:05:26.651441 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4c193dbb-eda6-41b2-8c1f-c0aefeeb45a5 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785ff643c00746939bb0fecd775ce920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83c4dedef341a0bb50fa4c119d3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:26.659710 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4c193dbb-eda6-41b2-8c1f-c0aefeeb45a5 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/ec729ac5-b620-4d07-bba8-9f098936d929" status: 200 len: 1282 microversion: 2.1 time: 0.138986 Jul 18 03:05:26.660407 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3122/6221] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:26 2022] GET /compute/v2.1/servers/ec729ac5-b620-4d07-bba8-9f098936d929 => generated 1282 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:27.679836 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d1f3094c-bdf3-46db-88a2-b39a3a93ec00 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:27.680446 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d1f3094c-bdf3-46db-88a2-b39a3a93ec00 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] [instance: ec729ac5-b620-4d07-bba8-9f098936d929] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:27.686990 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d1f3094c-bdf3-46db-88a2-b39a3a93ec00 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:27.687430 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d1f3094c-bdf3-46db-88a2-b39a3a93ec00 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:27.688596 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d1f3094c-bdf3-46db-88a2-b39a3a93ec00 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:27.688829 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d1f3094c-bdf3-46db-88a2-b39a3a93ec00 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:27.703736 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-d1f3094c-bdf3-46db-88a2-b39a3a93ec00 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] HTTP exception thrown: Instance ec729ac5-b620-4d07-bba8-9f098936d929 could not be found. Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d1f3094c-bdf3-46db-88a2-b39a3a93ec00 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Request method failure captured: Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/ec729ac5-b620-4d07-bba8-9f098936d929 HTTP/1.1 Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M0c--VxkhAcA4gIHXxijKFI-k8Bpror72Hk1qb235rYnfDmQTByX9LOOCSekEaTY-qK46fTc9MDDZBpaIS7PRARBL52HY7fvnzNvoh5YO0XpJvHbsKLywLFoe1R8EGrLF6lPIQIdQdkEzZxbEDXhePA7F15YYp44S7QRWnysLrh4M4 Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3a83c4dedef341a0bb50fa4c119d3035"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3a83c4dedef341a0bb50fa4c119d3035"}]}] Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersTestJSON-1250523732 Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 3a83c4dedef341a0bb50fa4c119d3035 Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersTestJSON-1250523732 Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersTestJSON-1250523732-project Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 785ff643c00746939bb0fecd775ce920 Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersTestJSON-1250523732-project Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance ec729ac5-b620-4d07-bba8-9f098936d929 could not be found. Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'ec729ac5-b620-4d07-bba8-9f098936d929'} Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec729ac5-b620-4d07-bba8-9f098936d929 could not be found. Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec729ac5-b620-4d07-bba8-9f098936d929 could not be found. Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:27.705401 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:05:27.711485 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:05:27.711485 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:05:27.711485 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:05:27.711485 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:05:27.711485 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec729ac5-b620-4d07-bba8-9f098936d929 could not be found. Jul 18 03:05:27.711485 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:05:27.711485 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d1f3094c-bdf3-46db-88a2-b39a3a93ec00 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] Returning 404 to user: Instance ec729ac5-b620-4d07-bba8-9f098936d929 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:05:27.711485 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d1f3094c-bdf3-46db-88a2-b39a3a93ec00 tempest-ServersTestJSON-1250523732 tempest-ServersTestJSON-1250523732-project] 10.222.0.57 "GET /compute/v2.1/servers/ec729ac5-b620-4d07-bba8-9f098936d929" status: 404 len: 111 microversion: 2.1 time: 0.032332 Jul 18 03:05:27.711485 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3100/6222] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:27 2022] GET /compute/v2.1/servers/ec729ac5-b620-4d07-bba8-9f098936d929 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:05:32.849323 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8cb893f5-5634-4197-abe1-568d109a51eb tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Action: 'create', calling method: .version_select at 0x7ff4add4f160>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-676539992", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJM1GR2LIXj0yJBTSrHB7xYykJ5XQg6Rngo5LQBI+PSilICHRC03M4/sawISPT1F2QFX6qQXt2fFpf7oLOaKnB3fcBD4Kn3SErtbo3aFsH1hDWB0fnsF+FkF79JGCwE0Tw=="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:05:32.866205 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-8cb893f5-5634-4197-abe1-568d109a51eb tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Getting quotas for project 1d2ff16c129544f6a876a3371c1d02a6. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:05:32.871735 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-8cb893f5-5634-4197-abe1-568d109a51eb tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Getting quotas for user 33388b46f7fb4c419ac0856245ad382f and project 1d2ff16c129544f6a876a3371c1d02a6. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:05:32.900027 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8cb893f5-5634-4197-abe1-568d109a51eb tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.054626 Jul 18 03:05:32.900653 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3123/6223] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 03:05:32 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:05:34.641081 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-65d2d565-97e2-4294-99e6-71f90ab6e9a3 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1676164489", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": "none"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:05:34.716299 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-65d2d565-97e2-4294-99e6-71f90ab6e9a3 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:05:34.716847 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-65d2d565-97e2-4294-99e6-71f90ab6e9a3 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:05:34.717323 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-65d2d565-97e2-4294-99e6-71f90ab6e9a3 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:05:34.717751 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-65d2d565-97e2-4294-99e6-71f90ab6e9a3 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:05:34.718172 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-65d2d565-97e2-4294-99e6-71f90ab6e9a3 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:05:34.728464 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65d2d565-97e2-4294-99e6-71f90ab6e9a3 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:34.729087 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65d2d565-97e2-4294-99e6-71f90ab6e9a3 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:34.729954 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65d2d565-97e2-4294-99e6-71f90ab6e9a3 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:34.730433 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65d2d565-97e2-4294-99e6-71f90ab6e9a3 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:34.758981 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-12c75412-2c6a-49d8-9c29-723c80e84680 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1921485276", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "4c69920a-3fed-4c15-b47d-4379829513c5"}], "key_name": "tempest-TestNetworkBasicOps-676539992", "security_groups": [{"name": "tempest-secgroup-smoke-42178402"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:05:34.764103 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-65d2d565-97e2-4294-99e6-71f90ab6e9a3 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Getting quotas for project 1ffd542dc7eb46b39a2134cacd11eb3f. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:05:34.768601 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:05:34.769304 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-65d2d565-97e2-4294-99e6-71f90ab6e9a3 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Getting quotas for user 38cc981f17284cfb9ce66ebbeeab6381 and project 1ffd542dc7eb46b39a2134cacd11eb3f. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:05:34.785173 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-65d2d565-97e2-4294-99e6-71f90ab6e9a3 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:05:34.787374 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-65d2d565-97e2-4294-99e6-71f90ab6e9a3 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] [instance: 9ff61889-89f4-4463-afbe-f995037a29dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:05:34.839838 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-65d2d565-97e2-4294-99e6-71f90ab6e9a3 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.442587 Jul 18 03:05:34.840739 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3101/6224] 10.222.0.57 () {62 vars in 1187 bytes} [Mon Jul 18 03:05:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 445 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 03:05:34.850507 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6d7ee85f-cfe9-460f-bfe7-1f19942b3ad3 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:34.851311 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6d7ee85f-cfe9-460f-bfe7-1f19942b3ad3 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] [instance: 9ff61889-89f4-4463-afbe-f995037a29dc] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:34.930525 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6d7ee85f-cfe9-460f-bfe7-1f19942b3ad3 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:34.939370 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6d7ee85f-cfe9-460f-bfe7-1f19942b3ad3 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:34.941291 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6d7ee85f-cfe9-460f-bfe7-1f19942b3ad3 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:34.941874 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-12c75412-2c6a-49d8-9c29-723c80e84680 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] validate_networks() for [('4c69920a-3fed-4c15-b47d-4379829513c5', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:05:34.942967 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6d7ee85f-cfe9-460f-bfe7-1f19942b3ad3 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc" status: 200 len: 1278 microversion: 2.57 time: 0.096389 Jul 18 03:05:34.958783 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3102/6225] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 03:05:34 2022] GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc => generated 1278 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 03:05:35.409570 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-12c75412-2c6a-49d8-9c29-723c80e84680 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:05:35.410476 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-12c75412-2c6a-49d8-9c29-723c80e84680 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:05:35.411789 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-12c75412-2c6a-49d8-9c29-723c80e84680 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:05:35.413357 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-12c75412-2c6a-49d8-9c29-723c80e84680 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:05:35.413964 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-12c75412-2c6a-49d8-9c29-723c80e84680 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:05:35.427896 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-12c75412-2c6a-49d8-9c29-723c80e84680 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:35.428364 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-12c75412-2c6a-49d8-9c29-723c80e84680 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:35.429331 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-12c75412-2c6a-49d8-9c29-723c80e84680 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:35.429834 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-12c75412-2c6a-49d8-9c29-723c80e84680 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:35.458948 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-12c75412-2c6a-49d8-9c29-723c80e84680 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Getting quotas for project 1d2ff16c129544f6a876a3371c1d02a6. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:05:35.468793 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-12c75412-2c6a-49d8-9c29-723c80e84680 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Getting quotas for user 33388b46f7fb4c419ac0856245ad382f and project 1d2ff16c129544f6a876a3371c1d02a6. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:05:35.485056 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-12c75412-2c6a-49d8-9c29-723c80e84680 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:05:35.487841 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-12c75412-2c6a-49d8-9c29-723c80e84680 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: 428669f8-ae42-4320-b8b7-8d79c51a67ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:05:35.556443 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-12c75412-2c6a-49d8-9c29-723c80e84680 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.801376 Jul 18 03:05:35.557751 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3124/6226] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:05:34 2022] POST /compute/v2.1/servers => generated 404 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:05:35.568586 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ca42baaf-b372-47f3-b29f-4453344247a3 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:35.569514 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ca42baaf-b372-47f3-b29f-4453344247a3 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: 428669f8-ae42-4320-b8b7-8d79c51a67ac] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:35.666607 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ca42baaf-b372-47f3-b29f-4453344247a3 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:35.674965 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ca42baaf-b372-47f3-b29f-4453344247a3 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/428669f8-ae42-4320-b8b7-8d79c51a67ac" status: 200 len: 1248 microversion: 2.1 time: 0.110485 Jul 18 03:05:35.678119 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3103/6227] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:35 2022] GET /compute/v2.1/servers/428669f8-ae42-4320-b8b7-8d79c51a67ac => generated 1248 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:35.975337 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6a16eb7d-3981-48d6-ba86-5cf7bb0751ae tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:35.978295 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6a16eb7d-3981-48d6-ba86-5cf7bb0751ae tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] [instance: 9ff61889-89f4-4463-afbe-f995037a29dc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:35.987026 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a16eb7d-3981-48d6-ba86-5cf7bb0751ae tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:35.987026 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a16eb7d-3981-48d6-ba86-5cf7bb0751ae tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:35.988303 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a16eb7d-3981-48d6-ba86-5cf7bb0751ae tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:35.988748 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a16eb7d-3981-48d6-ba86-5cf7bb0751ae tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:36.087064 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6a16eb7d-3981-48d6-ba86-5cf7bb0751ae tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:36.103373 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6a16eb7d-3981-48d6-ba86-5cf7bb0751ae tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:36.106688 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6a16eb7d-3981-48d6-ba86-5cf7bb0751ae tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:36.108942 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6a16eb7d-3981-48d6-ba86-5cf7bb0751ae tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc" status: 200 len: 1330 microversion: 2.57 time: 0.144818 Jul 18 03:05:36.113734 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3125/6228] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 03:05:35 2022] GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc => generated 1330 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 03:05:36.693850 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5ab64a2e-acce-4ecd-b6c2-f5d7daa14c09 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:36.694680 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5ab64a2e-acce-4ecd-b6c2-f5d7daa14c09 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: 428669f8-ae42-4320-b8b7-8d79c51a67ac] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:36.701095 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ab64a2e-acce-4ecd-b6c2-f5d7daa14c09 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:36.701904 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ab64a2e-acce-4ecd-b6c2-f5d7daa14c09 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:36.702933 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ab64a2e-acce-4ecd-b6c2-f5d7daa14c09 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:36.703581 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ab64a2e-acce-4ecd-b6c2-f5d7daa14c09 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:36.781590 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5ab64a2e-acce-4ecd-b6c2-f5d7daa14c09 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:36.789905 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5ab64a2e-acce-4ecd-b6c2-f5d7daa14c09 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/428669f8-ae42-4320-b8b7-8d79c51a67ac" status: 200 len: 1308 microversion: 2.1 time: 0.100897 Jul 18 03:05:36.793208 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3104/6229] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:36 2022] GET /compute/v2.1/servers/428669f8-ae42-4320-b8b7-8d79c51a67ac => generated 1308 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:37.129243 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-347f93d9-6ec7-49c0-b4af-e784271cff13 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:37.129976 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-347f93d9-6ec7-49c0-b4af-e784271cff13 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] [instance: 9ff61889-89f4-4463-afbe-f995037a29dc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:37.137481 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-347f93d9-6ec7-49c0-b4af-e784271cff13 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:37.138449 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-347f93d9-6ec7-49c0-b4af-e784271cff13 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:37.140097 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-347f93d9-6ec7-49c0-b4af-e784271cff13 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:37.141116 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-347f93d9-6ec7-49c0-b4af-e784271cff13 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:37.227703 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-347f93d9-6ec7-49c0-b4af-e784271cff13 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:37.237805 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-347f93d9-6ec7-49c0-b4af-e784271cff13 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:37.239331 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-347f93d9-6ec7-49c0-b4af-e784271cff13 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:37.240527 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-347f93d9-6ec7-49c0-b4af-e784271cff13 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc" status: 200 len: 1336 microversion: 2.57 time: 0.115366 Jul 18 03:05:37.241100 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3126/6230] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 03:05:37 2022] GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc => generated 1336 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 03:05:37.806976 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-58742f02-c71e-401f-9c4a-b3209912c60a tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:37.807632 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-58742f02-c71e-401f-9c4a-b3209912c60a tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: 428669f8-ae42-4320-b8b7-8d79c51a67ac] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:37.815769 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-58742f02-c71e-401f-9c4a-b3209912c60a tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:37.816217 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-58742f02-c71e-401f-9c4a-b3209912c60a tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:37.816988 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-58742f02-c71e-401f-9c4a-b3209912c60a tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:37.817425 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-58742f02-c71e-401f-9c4a-b3209912c60a tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:38.010522 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-58742f02-c71e-401f-9c4a-b3209912c60a tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:38.019486 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-58742f02-c71e-401f-9c4a-b3209912c60a tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/428669f8-ae42-4320-b8b7-8d79c51a67ac" status: 200 len: 1372 microversion: 2.1 time: 0.216600 Jul 18 03:05:38.020093 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3105/6231] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:37 2022] GET /compute/v2.1/servers/428669f8-ae42-4320-b8b7-8d79c51a67ac => generated 1372 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:38.261017 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c893fe09-2837-4147-aade-48356efff85b tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:38.261646 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c893fe09-2837-4147-aade-48356efff85b tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] [instance: 9ff61889-89f4-4463-afbe-f995037a29dc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:38.268954 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c893fe09-2837-4147-aade-48356efff85b tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:38.269562 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c893fe09-2837-4147-aade-48356efff85b tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:38.270428 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c893fe09-2837-4147-aade-48356efff85b tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:38.270951 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c893fe09-2837-4147-aade-48356efff85b tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:38.303118 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-6d26333e-3027-4fb2-954d-f098bca44861 req-380c6742-0ae3-4253-886a-bc151655a8fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "428669f8-ae42-4320-b8b7-8d79c51a67ac", "tag": "6e0694c6-64d7-4519-9df3-63d7745badb5"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:05:38.316776 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-6d26333e-3027-4fb2-954d-f098bca44861 req-380c6742-0ae3-4253-886a-bc151655a8fb service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:38.317131 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-6d26333e-3027-4fb2-954d-f098bca44861 req-380c6742-0ae3-4253-886a-bc151655a8fb service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:38.332337 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-6d26333e-3027-4fb2-954d-f098bca44861 req-380c6742-0ae3-4253-886a-bc151655a8fb service nova] Creating event network-changed:6e0694c6-64d7-4519-9df3-63d7745badb5 for instance 428669f8-ae42-4320-b8b7-8d79c51a67ac on n-h1-465891-3 Jul 18 03:05:38.351896 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-6d26333e-3027-4fb2-954d-f098bca44861 req-380c6742-0ae3-4253-886a-bc151655a8fb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052439 Jul 18 03:05:38.352957 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3106/6232] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:05:38.377657 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c893fe09-2837-4147-aade-48356efff85b tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:38.412188 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c893fe09-2837-4147-aade-48356efff85b tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:38.418954 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c893fe09-2837-4147-aade-48356efff85b tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:38.420797 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c893fe09-2837-4147-aade-48356efff85b tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc" status: 200 len: 1336 microversion: 2.57 time: 0.164153 Jul 18 03:05:38.422608 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3127/6233] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 03:05:38 2022] GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc => generated 1336 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 03:05:39.038424 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2ce21af8-b7ef-43c0-8ad8-9ffbc3ff482e tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:39.039273 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2ce21af8-b7ef-43c0-8ad8-9ffbc3ff482e tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: 428669f8-ae42-4320-b8b7-8d79c51a67ac] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:39.048247 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ce21af8-b7ef-43c0-8ad8-9ffbc3ff482e tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:39.048695 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ce21af8-b7ef-43c0-8ad8-9ffbc3ff482e tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:39.049480 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ce21af8-b7ef-43c0-8ad8-9ffbc3ff482e tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:39.049956 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ce21af8-b7ef-43c0-8ad8-9ffbc3ff482e tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:39.215206 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2ce21af8-b7ef-43c0-8ad8-9ffbc3ff482e tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:39.223605 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2ce21af8-b7ef-43c0-8ad8-9ffbc3ff482e tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/428669f8-ae42-4320-b8b7-8d79c51a67ac" status: 200 len: 1372 microversion: 2.1 time: 0.189516 Jul 18 03:05:39.224207 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3107/6234] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:39 2022] GET /compute/v2.1/servers/428669f8-ae42-4320-b8b7-8d79c51a67ac => generated 1372 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:39.442099 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-77bfd9fb-6580-4b99-a2c4-405e79a0b79e tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:39.442774 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-77bfd9fb-6580-4b99-a2c4-405e79a0b79e tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] [instance: 9ff61889-89f4-4463-afbe-f995037a29dc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:39.450413 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77bfd9fb-6580-4b99-a2c4-405e79a0b79e tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:39.450872 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77bfd9fb-6580-4b99-a2c4-405e79a0b79e tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:39.451676 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77bfd9fb-6580-4b99-a2c4-405e79a0b79e tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:39.452125 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77bfd9fb-6580-4b99-a2c4-405e79a0b79e tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:39.526331 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-77bfd9fb-6580-4b99-a2c4-405e79a0b79e tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:39.534863 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-77bfd9fb-6580-4b99-a2c4-405e79a0b79e tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:39.536368 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-77bfd9fb-6580-4b99-a2c4-405e79a0b79e tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:39.537549 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-77bfd9fb-6580-4b99-a2c4-405e79a0b79e tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc" status: 200 len: 1357 microversion: 2.57 time: 0.100709 Jul 18 03:05:39.538146 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3128/6235] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 03:05:39 2022] GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc => generated 1357 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 03:05:39.556439 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-98397e48-4217-4f0e-a49c-06598792c536 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:05:39.558039 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-98397e48-4217-4f0e-a49c-06598792c536 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] [instance: 9ff61889-89f4-4463-afbe-f995037a29dc] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:39.564823 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-98397e48-4217-4f0e-a49c-06598792c536 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:39.565270 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-98397e48-4217-4f0e-a49c-06598792c536 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:39.566057 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-98397e48-4217-4f0e-a49c-06598792c536 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:39.566488 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-98397e48-4217-4f0e-a49c-06598792c536 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:39.644773 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-98397e48-4217-4f0e-a49c-06598792c536 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:05:39.645196 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-98397e48-4217-4f0e-a49c-06598792c536 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:05:39.645668 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-98397e48-4217-4f0e-a49c-06598792c536 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:05:39.646103 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-98397e48-4217-4f0e-a49c-06598792c536 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:05:39.646570 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-98397e48-4217-4f0e-a49c-06598792c536 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:05:39.706686 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-98397e48-4217-4f0e-a49c-06598792c536 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] [instance: 9ff61889-89f4-4463-afbe-f995037a29dc] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:39.712916 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-98397e48-4217-4f0e-a49c-06598792c536 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:39.713369 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-98397e48-4217-4f0e-a49c-06598792c536 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:39.714208 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-98397e48-4217-4f0e-a49c-06598792c536 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:39.715181 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-98397e48-4217-4f0e-a49c-06598792c536 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:39.747843 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-98397e48-4217-4f0e-a49c-06598792c536 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] 10.222.0.57 "POST /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc/action" status: 202 len: 1138 microversion: 2.57 time: 0.195436 Jul 18 03:05:39.748771 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3108/6236] 10.222.0.57 () {62 vars in 1319 bytes} [Mon Jul 18 03:05:39 2022] POST /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc/action => generated 1138 bytes in 197 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 18 03:05:39.764271 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8d5bff74-6bc3-4bdf-a876-27aa18af55be tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:39.764892 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8d5bff74-6bc3-4bdf-a876-27aa18af55be tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] [instance: 9ff61889-89f4-4463-afbe-f995037a29dc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:39.771675 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8d5bff74-6bc3-4bdf-a876-27aa18af55be tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:39.772130 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8d5bff74-6bc3-4bdf-a876-27aa18af55be tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:39.772922 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8d5bff74-6bc3-4bdf-a876-27aa18af55be tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:39.773371 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8d5bff74-6bc3-4bdf-a876-27aa18af55be tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:39.841046 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8d5bff74-6bc3-4bdf-a876-27aa18af55be tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:39.849522 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8d5bff74-6bc3-4bdf-a876-27aa18af55be tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:39.851215 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8d5bff74-6bc3-4bdf-a876-27aa18af55be tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:39.852607 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8d5bff74-6bc3-4bdf-a876-27aa18af55be tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc" status: 200 len: 1366 microversion: 2.57 time: 0.092204 Jul 18 03:05:39.853005 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3129/6237] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 03:05:39 2022] GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc => generated 1366 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 03:05:40.240789 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-321e3e19-b72e-43f3-9785-e7adf558a3d4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:40.241431 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-321e3e19-b72e-43f3-9785-e7adf558a3d4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: 428669f8-ae42-4320-b8b7-8d79c51a67ac] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:40.249756 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-321e3e19-b72e-43f3-9785-e7adf558a3d4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:40.250251 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-321e3e19-b72e-43f3-9785-e7adf558a3d4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:40.251021 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-321e3e19-b72e-43f3-9785-e7adf558a3d4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:40.251454 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-321e3e19-b72e-43f3-9785-e7adf558a3d4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:40.390405 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-321e3e19-b72e-43f3-9785-e7adf558a3d4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:40.397784 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-321e3e19-b72e-43f3-9785-e7adf558a3d4 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/428669f8-ae42-4320-b8b7-8d79c51a67ac" status: 200 len: 1372 microversion: 2.1 time: 0.160895 Jul 18 03:05:40.398352 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3109/6238] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:40 2022] GET /compute/v2.1/servers/428669f8-ae42-4320-b8b7-8d79c51a67ac => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:40.872333 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dbdf3e9a-40a8-4fd2-9894-916c896e6e5d tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:40.873326 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-dbdf3e9a-40a8-4fd2-9894-916c896e6e5d tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] [instance: 9ff61889-89f4-4463-afbe-f995037a29dc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:40.881240 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dbdf3e9a-40a8-4fd2-9894-916c896e6e5d tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:40.881873 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dbdf3e9a-40a8-4fd2-9894-916c896e6e5d tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:40.882708 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dbdf3e9a-40a8-4fd2-9894-916c896e6e5d tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:40.883297 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dbdf3e9a-40a8-4fd2-9894-916c896e6e5d tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:40.950190 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-dbdf3e9a-40a8-4fd2-9894-916c896e6e5d tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:40.959656 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-dbdf3e9a-40a8-4fd2-9894-916c896e6e5d tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:40.960958 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-dbdf3e9a-40a8-4fd2-9894-916c896e6e5d tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:40.962211 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-dbdf3e9a-40a8-4fd2-9894-916c896e6e5d tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc" status: 200 len: 1366 microversion: 2.57 time: 0.094605 Jul 18 03:05:40.962790 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3130/6239] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 03:05:40 2022] GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc => generated 1366 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 03:05:41.416231 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-898700f9-c151-4442-a3b3-2b93fab846c8 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:41.416937 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-898700f9-c151-4442-a3b3-2b93fab846c8 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: 428669f8-ae42-4320-b8b7-8d79c51a67ac] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:41.425669 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-898700f9-c151-4442-a3b3-2b93fab846c8 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:41.426147 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-898700f9-c151-4442-a3b3-2b93fab846c8 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:41.426920 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-898700f9-c151-4442-a3b3-2b93fab846c8 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:41.427349 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-898700f9-c151-4442-a3b3-2b93fab846c8 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:41.591358 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-898700f9-c151-4442-a3b3-2b93fab846c8 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:41.593729 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:05:41.600910 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-898700f9-c151-4442-a3b3-2b93fab846c8 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/428669f8-ae42-4320-b8b7-8d79c51a67ac" status: 200 len: 1372 microversion: 2.1 time: 0.189306 Jul 18 03:05:41.601508 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3110/6240] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:41 2022] GET /compute/v2.1/servers/428669f8-ae42-4320-b8b7-8d79c51a67ac => generated 1372 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:41.984399 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-00af9430-526a-4596-85ab-6f5a2d1c625c tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:41.986319 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-00af9430-526a-4596-85ab-6f5a2d1c625c tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] [instance: 9ff61889-89f4-4463-afbe-f995037a29dc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:41.992564 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-00af9430-526a-4596-85ab-6f5a2d1c625c tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:41.993166 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-00af9430-526a-4596-85ab-6f5a2d1c625c tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:41.994226 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-00af9430-526a-4596-85ab-6f5a2d1c625c tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:41.994685 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-00af9430-526a-4596-85ab-6f5a2d1c625c tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:42.064000 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-00af9430-526a-4596-85ab-6f5a2d1c625c tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:42.073139 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-00af9430-526a-4596-85ab-6f5a2d1c625c tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:42.074721 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-00af9430-526a-4596-85ab-6f5a2d1c625c tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:42.075930 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-00af9430-526a-4596-85ab-6f5a2d1c625c tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc" status: 200 len: 1366 microversion: 2.57 time: 0.097897 Jul 18 03:05:42.076516 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3131/6241] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 03:05:41 2022] GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc => generated 1366 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 03:05:42.618695 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-429c2383-9015-42dd-8728-6b203950ee13 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:42.619423 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-429c2383-9015-42dd-8728-6b203950ee13 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: 428669f8-ae42-4320-b8b7-8d79c51a67ac] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:42.627922 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-429c2383-9015-42dd-8728-6b203950ee13 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:42.628371 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-429c2383-9015-42dd-8728-6b203950ee13 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:42.629149 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-429c2383-9015-42dd-8728-6b203950ee13 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:42.629595 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-429c2383-9015-42dd-8728-6b203950ee13 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:43.055944 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-429c2383-9015-42dd-8728-6b203950ee13 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:43.073987 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-429c2383-9015-42dd-8728-6b203950ee13 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/428669f8-ae42-4320-b8b7-8d79c51a67ac" status: 200 len: 1372 microversion: 2.1 time: 0.459476 Jul 18 03:05:43.074782 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3111/6242] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:42 2022] GET /compute/v2.1/servers/428669f8-ae42-4320-b8b7-8d79c51a67ac => generated 1372 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:43.095945 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5d1a82bb-a6e3-47f3-9e6d-0e857073eb07 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:43.097366 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5d1a82bb-a6e3-47f3-9e6d-0e857073eb07 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] [instance: 9ff61889-89f4-4463-afbe-f995037a29dc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:43.103869 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5d1a82bb-a6e3-47f3-9e6d-0e857073eb07 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:43.104369 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5d1a82bb-a6e3-47f3-9e6d-0e857073eb07 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:43.105800 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5d1a82bb-a6e3-47f3-9e6d-0e857073eb07 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:43.106304 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5d1a82bb-a6e3-47f3-9e6d-0e857073eb07 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:43.133106 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6d5ad70d-62fe-493c-9983-8a1968921ab4 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:43.133621 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6d5ad70d-62fe-493c-9983-8a1968921ab4 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] [instance: 9df430a2-54be-4e36-ad3f-5d3f0455e798] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:43.140609 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6d5ad70d-62fe-493c-9983-8a1968921ab4 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:43.141062 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6d5ad70d-62fe-493c-9983-8a1968921ab4 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:43.141902 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6d5ad70d-62fe-493c-9983-8a1968921ab4 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:43.142797 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6d5ad70d-62fe-493c-9983-8a1968921ab4 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:43.171322 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6d5ad70d-62fe-493c-9983-8a1968921ab4 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] 10.222.0.57 "GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.042886 Jul 18 03:05:43.173880 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3112/6243] 10.222.0.57 () {58 vars in 1292 bytes} [Mon Jul 18 03:05:43 2022] GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798/os-server-password => generated 116 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:05:43.178757 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5d1a82bb-a6e3-47f3-9e6d-0e857073eb07 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:43.187425 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5d1a82bb-a6e3-47f3-9e6d-0e857073eb07 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:43.189691 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5d1a82bb-a6e3-47f3-9e6d-0e857073eb07 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:43.190454 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5d1a82bb-a6e3-47f3-9e6d-0e857073eb07 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc" status: 200 len: 1366 microversion: 2.57 time: 0.099607 Jul 18 03:05:43.191014 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3132/6244] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 03:05:43 2022] GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc => generated 1366 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 03:05:44.091215 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f57d39c2-f648-4d10-9d26-12ab6ef76fce tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:44.091832 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f57d39c2-f648-4d10-9d26-12ab6ef76fce tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: 428669f8-ae42-4320-b8b7-8d79c51a67ac] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:44.101030 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f57d39c2-f648-4d10-9d26-12ab6ef76fce tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:44.101477 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f57d39c2-f648-4d10-9d26-12ab6ef76fce tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:44.102279 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f57d39c2-f648-4d10-9d26-12ab6ef76fce tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:44.102715 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f57d39c2-f648-4d10-9d26-12ab6ef76fce tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:44.210359 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2458ca91-4a19-420c-a0bc-dd29f0d3065c tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:44.211070 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2458ca91-4a19-420c-a0bc-dd29f0d3065c tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] [instance: 9ff61889-89f4-4463-afbe-f995037a29dc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:44.219451 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2458ca91-4a19-420c-a0bc-dd29f0d3065c tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:44.219920 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2458ca91-4a19-420c-a0bc-dd29f0d3065c tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:44.220740 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2458ca91-4a19-420c-a0bc-dd29f0d3065c tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:44.221199 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2458ca91-4a19-420c-a0bc-dd29f0d3065c tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:44.241146 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f57d39c2-f648-4d10-9d26-12ab6ef76fce tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:44.249738 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f57d39c2-f648-4d10-9d26-12ab6ef76fce tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/428669f8-ae42-4320-b8b7-8d79c51a67ac" status: 200 len: 1372 microversion: 2.1 time: 0.162750 Jul 18 03:05:44.250847 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3113/6245] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:44 2022] GET /compute/v2.1/servers/428669f8-ae42-4320-b8b7-8d79c51a67ac => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:44.299540 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2458ca91-4a19-420c-a0bc-dd29f0d3065c tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:44.309959 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2458ca91-4a19-420c-a0bc-dd29f0d3065c tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:44.311472 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2458ca91-4a19-420c-a0bc-dd29f0d3065c tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:44.312674 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2458ca91-4a19-420c-a0bc-dd29f0d3065c tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc" status: 200 len: 1366 microversion: 2.57 time: 0.106475 Jul 18 03:05:44.313237 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3133/6246] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 03:05:44 2022] GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc => generated 1366 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 03:05:45.150198 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-4d6db8eb-9983-4ad0-a3ed-0cf70a23a83d req-88fe047f-40a1-475e-ae9e-1d9736cc0e70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "428669f8-ae42-4320-b8b7-8d79c51a67ac", "name": "network-vif-plugged", "status": "completed", "tag": "6e0694c6-64d7-4519-9df3-63d7745badb5"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:05:45.153874 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:05:45.160960 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-4d6db8eb-9983-4ad0-a3ed-0cf70a23a83d req-88fe047f-40a1-475e-ae9e-1d9736cc0e70 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:45.161438 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-4d6db8eb-9983-4ad0-a3ed-0cf70a23a83d req-88fe047f-40a1-475e-ae9e-1d9736cc0e70 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:45.174229 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-4d6db8eb-9983-4ad0-a3ed-0cf70a23a83d req-88fe047f-40a1-475e-ae9e-1d9736cc0e70 service nova] Creating event network-vif-plugged:6e0694c6-64d7-4519-9df3-63d7745badb5 for instance 428669f8-ae42-4320-b8b7-8d79c51a67ac on n-h1-465891-3 Jul 18 03:05:45.179618 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-4d6db8eb-9983-4ad0-a3ed-0cf70a23a83d req-88fe047f-40a1-475e-ae9e-1d9736cc0e70 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033162 Jul 18 03:05:45.180228 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3114/6247] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:05:45.267035 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6cdb5e1a-37d1-4f0e-972e-21a7ad7c41b7 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:45.267655 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6cdb5e1a-37d1-4f0e-972e-21a7ad7c41b7 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: 428669f8-ae42-4320-b8b7-8d79c51a67ac] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:45.275073 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6cdb5e1a-37d1-4f0e-972e-21a7ad7c41b7 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:45.275536 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6cdb5e1a-37d1-4f0e-972e-21a7ad7c41b7 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:45.276331 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6cdb5e1a-37d1-4f0e-972e-21a7ad7c41b7 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:45.276787 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6cdb5e1a-37d1-4f0e-972e-21a7ad7c41b7 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:45.332946 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-81276cb1-378a-4a5c-8692-5723c8cd3f89 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:45.333652 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-81276cb1-378a-4a5c-8692-5723c8cd3f89 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] [instance: 9ff61889-89f4-4463-afbe-f995037a29dc] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:45.341016 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-81276cb1-378a-4a5c-8692-5723c8cd3f89 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:45.341465 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-81276cb1-378a-4a5c-8692-5723c8cd3f89 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:45.342277 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-81276cb1-378a-4a5c-8692-5723c8cd3f89 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:45.342726 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-81276cb1-378a-4a5c-8692-5723c8cd3f89 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:45.445172 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:05:45.450253 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-81276cb1-378a-4a5c-8692-5723c8cd3f89 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:45.458592 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-81276cb1-378a-4a5c-8692-5723c8cd3f89 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:45.460269 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-81276cb1-378a-4a5c-8692-5723c8cd3f89 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:45.461841 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-81276cb1-378a-4a5c-8692-5723c8cd3f89 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc" status: 200 len: 1366 microversion: 2.57 time: 0.133179 Jul 18 03:05:45.462411 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3115/6248] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 03:05:45 2022] GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc => generated 1366 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 03:05:45.478190 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=10 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:05:45.482232 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6cdb5e1a-37d1-4f0e-972e-21a7ad7c41b7 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:45.490025 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6cdb5e1a-37d1-4f0e-972e-21a7ad7c41b7 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/428669f8-ae42-4320-b8b7-8d79c51a67ac" status: 200 len: 1372 microversion: 2.1 time: 0.227003 Jul 18 03:05:45.491404 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3134/6249] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:45 2022] GET /compute/v2.1/servers/428669f8-ae42-4320-b8b7-8d79c51a67ac => generated 1372 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:46.480684 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b303b6f5-5036-4184-87d0-0f59bbd0be48 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:46.481289 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b303b6f5-5036-4184-87d0-0f59bbd0be48 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] [instance: 9ff61889-89f4-4463-afbe-f995037a29dc] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:46.483387 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=10 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:05:46.489914 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b303b6f5-5036-4184-87d0-0f59bbd0be48 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:46.490364 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b303b6f5-5036-4184-87d0-0f59bbd0be48 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:46.491130 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b303b6f5-5036-4184-87d0-0f59bbd0be48 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:46.491563 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b303b6f5-5036-4184-87d0-0f59bbd0be48 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:46.507271 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f78cfd1e-cd32-4372-803e-9d5e02ce2791 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:46.507905 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f78cfd1e-cd32-4372-803e-9d5e02ce2791 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: 428669f8-ae42-4320-b8b7-8d79c51a67ac] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:46.516230 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f78cfd1e-cd32-4372-803e-9d5e02ce2791 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:46.516702 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f78cfd1e-cd32-4372-803e-9d5e02ce2791 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:46.517496 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f78cfd1e-cd32-4372-803e-9d5e02ce2791 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:46.517979 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f78cfd1e-cd32-4372-803e-9d5e02ce2791 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:46.562011 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b303b6f5-5036-4184-87d0-0f59bbd0be48 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:46.570351 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b303b6f5-5036-4184-87d0-0f59bbd0be48 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:46.571814 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b303b6f5-5036-4184-87d0-0f59bbd0be48 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:46.573006 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b303b6f5-5036-4184-87d0-0f59bbd0be48 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc" status: 200 len: 1366 microversion: 2.57 time: 0.096418 Jul 18 03:05:46.573573 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3116/6250] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 03:05:46 2022] GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc => generated 1366 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 03:05:46.664754 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f78cfd1e-cd32-4372-803e-9d5e02ce2791 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:46.672631 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f78cfd1e-cd32-4372-803e-9d5e02ce2791 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/428669f8-ae42-4320-b8b7-8d79c51a67ac" status: 200 len: 1372 microversion: 2.1 time: 0.169296 Jul 18 03:05:46.673212 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3135/6251] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:46 2022] GET /compute/v2.1/servers/428669f8-ae42-4320-b8b7-8d79c51a67ac => generated 1372 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:05:47.593334 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1d9932e7-4847-4738-8488-96fcb170c36c tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:47.593949 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1d9932e7-4847-4738-8488-96fcb170c36c tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] [instance: 9ff61889-89f4-4463-afbe-f995037a29dc] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:47.600861 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1d9932e7-4847-4738-8488-96fcb170c36c tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:47.601306 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1d9932e7-4847-4738-8488-96fcb170c36c tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:47.602095 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1d9932e7-4847-4738-8488-96fcb170c36c tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:47.602527 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1d9932e7-4847-4738-8488-96fcb170c36c tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:47.666536 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1d9932e7-4847-4738-8488-96fcb170c36c tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:47.675110 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1d9932e7-4847-4738-8488-96fcb170c36c tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:47.676608 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1d9932e7-4847-4738-8488-96fcb170c36c tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:47.677805 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1d9932e7-4847-4738-8488-96fcb170c36c tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc" status: 200 len: 1366 microversion: 2.57 time: 0.089019 Jul 18 03:05:47.678389 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3117/6252] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 03:05:47 2022] GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc => generated 1366 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 03:05:47.689519 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-565227df-3ffb-4cd4-9b36-979582da63cf tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:47.690378 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-565227df-3ffb-4cd4-9b36-979582da63cf tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: 428669f8-ae42-4320-b8b7-8d79c51a67ac] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:47.697144 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-565227df-3ffb-4cd4-9b36-979582da63cf tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:47.697607 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-565227df-3ffb-4cd4-9b36-979582da63cf tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:47.698426 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-565227df-3ffb-4cd4-9b36-979582da63cf tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:47.698906 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-565227df-3ffb-4cd4-9b36-979582da63cf tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:47.713775 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:05:47.833556 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-565227df-3ffb-4cd4-9b36-979582da63cf tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:47.841268 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-565227df-3ffb-4cd4-9b36-979582da63cf tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/428669f8-ae42-4320-b8b7-8d79c51a67ac" status: 200 len: 1544 microversion: 2.1 time: 0.155671 Jul 18 03:05:47.841873 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3136/6253] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:47 2022] GET /compute/v2.1/servers/428669f8-ae42-4320-b8b7-8d79c51a67ac => generated 1544 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:47.857731 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-927cbde3-383f-48ff-bf95-1a20dab54218 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:47.858349 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-927cbde3-383f-48ff-bf95-1a20dab54218 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: 428669f8-ae42-4320-b8b7-8d79c51a67ac] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:47.864531 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-927cbde3-383f-48ff-bf95-1a20dab54218 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:47.864984 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-927cbde3-383f-48ff-bf95-1a20dab54218 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:47.865781 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-927cbde3-383f-48ff-bf95-1a20dab54218 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:47.866220 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-927cbde3-383f-48ff-bf95-1a20dab54218 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:48.003364 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-927cbde3-383f-48ff-bf95-1a20dab54218 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:48.010813 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-927cbde3-383f-48ff-bf95-1a20dab54218 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/428669f8-ae42-4320-b8b7-8d79c51a67ac" status: 200 len: 1544 microversion: 2.1 time: 0.157498 Jul 18 03:05:48.011386 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3118/6254] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:47 2022] GET /compute/v2.1/servers/428669f8-ae42-4320-b8b7-8d79c51a67ac => generated 1544 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:48.696989 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-68fa2541-6288-4293-b558-e483e7985beb tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:48.697630 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-68fa2541-6288-4293-b558-e483e7985beb tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] [instance: 9ff61889-89f4-4463-afbe-f995037a29dc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:48.705337 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-68fa2541-6288-4293-b558-e483e7985beb tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:48.705835 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-68fa2541-6288-4293-b558-e483e7985beb tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:48.706638 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-68fa2541-6288-4293-b558-e483e7985beb tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:48.707089 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-68fa2541-6288-4293-b558-e483e7985beb tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:48.776561 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-68fa2541-6288-4293-b558-e483e7985beb tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:48.787089 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-68fa2541-6288-4293-b558-e483e7985beb tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:48.788617 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-68fa2541-6288-4293-b558-e483e7985beb tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:48.790223 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-68fa2541-6288-4293-b558-e483e7985beb tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc" status: 200 len: 1366 microversion: 2.57 time: 0.097146 Jul 18 03:05:48.791083 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3137/6255] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 03:05:48 2022] GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc => generated 1366 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 03:05:49.810959 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-aa9958ea-1f9c-4d27-a071-9052b0452c22 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:49.812557 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-aa9958ea-1f9c-4d27-a071-9052b0452c22 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] [instance: 9ff61889-89f4-4463-afbe-f995037a29dc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:49.820279 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aa9958ea-1f9c-4d27-a071-9052b0452c22 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:49.820759 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aa9958ea-1f9c-4d27-a071-9052b0452c22 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:49.821593 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aa9958ea-1f9c-4d27-a071-9052b0452c22 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:49.822279 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aa9958ea-1f9c-4d27-a071-9052b0452c22 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:49.861142 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-e10bddb3-5f21-4377-bd7d-e1f195b55170 req-2bd25680-936d-4459-8b6a-6e3e3d009163 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "428669f8-ae42-4320-b8b7-8d79c51a67ac", "tag": "6e0694c6-64d7-4519-9df3-63d7745badb5"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:05:49.864859 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:05:49.871309 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-e10bddb3-5f21-4377-bd7d-e1f195b55170 req-2bd25680-936d-4459-8b6a-6e3e3d009163 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:49.872102 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-e10bddb3-5f21-4377-bd7d-e1f195b55170 req-2bd25680-936d-4459-8b6a-6e3e3d009163 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:49.887327 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-e10bddb3-5f21-4377-bd7d-e1f195b55170 req-2bd25680-936d-4459-8b6a-6e3e3d009163 service nova] Creating event network-changed:6e0694c6-64d7-4519-9df3-63d7745badb5 for instance 428669f8-ae42-4320-b8b7-8d79c51a67ac on n-h1-465891-3 Jul 18 03:05:49.893181 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-e10bddb3-5f21-4377-bd7d-e1f195b55170 req-2bd25680-936d-4459-8b6a-6e3e3d009163 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.201480 Jul 18 03:05:49.894559 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3119/6256] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:05:49.987922 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-aa9958ea-1f9c-4d27-a071-9052b0452c22 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:49.997991 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-aa9958ea-1f9c-4d27-a071-9052b0452c22 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:49.999828 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-aa9958ea-1f9c-4d27-a071-9052b0452c22 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:50.001024 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-aa9958ea-1f9c-4d27-a071-9052b0452c22 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc" status: 200 len: 1366 microversion: 2.57 time: 0.194168 Jul 18 03:05:50.001600 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3138/6257] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 03:05:49 2022] GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 03:05:51.021361 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-abf64180-9205-49ac-ad3f-e7c5b6f8b8a8 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:51.022125 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-abf64180-9205-49ac-ad3f-e7c5b6f8b8a8 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] [instance: 9ff61889-89f4-4463-afbe-f995037a29dc] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:51.029996 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-abf64180-9205-49ac-ad3f-e7c5b6f8b8a8 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:51.030445 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-abf64180-9205-49ac-ad3f-e7c5b6f8b8a8 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:51.031206 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-abf64180-9205-49ac-ad3f-e7c5b6f8b8a8 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:51.031641 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-abf64180-9205-49ac-ad3f-e7c5b6f8b8a8 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:51.138063 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-abf64180-9205-49ac-ad3f-e7c5b6f8b8a8 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:51.146227 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-abf64180-9205-49ac-ad3f-e7c5b6f8b8a8 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:51.147746 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-abf64180-9205-49ac-ad3f-e7c5b6f8b8a8 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:51.148915 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-abf64180-9205-49ac-ad3f-e7c5b6f8b8a8 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc" status: 200 len: 1366 microversion: 2.57 time: 0.132256 Jul 18 03:05:51.149487 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3120/6258] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 03:05:51 2022] GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc => generated 1366 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 03:05:52.169380 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dd3df9e8-ca7f-4b40-89b9-5d5c0cfbaa8f tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:52.170030 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-dd3df9e8-ca7f-4b40-89b9-5d5c0cfbaa8f tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] [instance: 9ff61889-89f4-4463-afbe-f995037a29dc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:52.177108 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dd3df9e8-ca7f-4b40-89b9-5d5c0cfbaa8f tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:52.177562 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dd3df9e8-ca7f-4b40-89b9-5d5c0cfbaa8f tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:52.178370 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dd3df9e8-ca7f-4b40-89b9-5d5c0cfbaa8f tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:52.178819 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dd3df9e8-ca7f-4b40-89b9-5d5c0cfbaa8f tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:52.245990 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-dd3df9e8-ca7f-4b40-89b9-5d5c0cfbaa8f tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:52.254303 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-dd3df9e8-ca7f-4b40-89b9-5d5c0cfbaa8f tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:52.255813 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-dd3df9e8-ca7f-4b40-89b9-5d5c0cfbaa8f tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:52.256995 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-dd3df9e8-ca7f-4b40-89b9-5d5c0cfbaa8f tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc" status: 200 len: 1366 microversion: 2.57 time: 0.091841 Jul 18 03:05:52.257557 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3139/6259] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 03:05:52 2022] GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc => generated 1366 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 03:05:53.276286 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c63d8e5c-9ec7-4445-b005-c87748c6fc64 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:53.276902 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c63d8e5c-9ec7-4445-b005-c87748c6fc64 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] [instance: 9ff61889-89f4-4463-afbe-f995037a29dc] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:53.284973 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c63d8e5c-9ec7-4445-b005-c87748c6fc64 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:53.285427 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c63d8e5c-9ec7-4445-b005-c87748c6fc64 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:53.286241 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c63d8e5c-9ec7-4445-b005-c87748c6fc64 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:53.286683 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c63d8e5c-9ec7-4445-b005-c87748c6fc64 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:53.355491 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c63d8e5c-9ec7-4445-b005-c87748c6fc64 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:53.364400 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c63d8e5c-9ec7-4445-b005-c87748c6fc64 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:53.365960 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c63d8e5c-9ec7-4445-b005-c87748c6fc64 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:53.367367 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c63d8e5c-9ec7-4445-b005-c87748c6fc64 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc" status: 200 len: 1366 microversion: 2.57 time: 0.095071 Jul 18 03:05:53.367952 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3121/6260] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 03:05:53 2022] GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc => generated 1366 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 03:05:54.388783 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fdb6914d-0ebb-420c-8f03-de239641ac0a tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:54.389528 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fdb6914d-0ebb-420c-8f03-de239641ac0a tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] [instance: 9ff61889-89f4-4463-afbe-f995037a29dc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:54.397334 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fdb6914d-0ebb-420c-8f03-de239641ac0a tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:54.397823 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fdb6914d-0ebb-420c-8f03-de239641ac0a tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:54.398618 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fdb6914d-0ebb-420c-8f03-de239641ac0a tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:54.399082 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fdb6914d-0ebb-420c-8f03-de239641ac0a tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:54.466815 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fdb6914d-0ebb-420c-8f03-de239641ac0a tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:54.475546 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fdb6914d-0ebb-420c-8f03-de239641ac0a tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:54.477068 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fdb6914d-0ebb-420c-8f03-de239641ac0a tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:54.478292 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fdb6914d-0ebb-420c-8f03-de239641ac0a tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc" status: 200 len: 1366 microversion: 2.57 time: 0.094429 Jul 18 03:05:54.478865 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3140/6261] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 03:05:54 2022] GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc => generated 1366 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 03:05:55.496491 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b2e50044-5791-41e3-aef1-ca7196403f28 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:55.497135 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b2e50044-5791-41e3-aef1-ca7196403f28 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] [instance: 9ff61889-89f4-4463-afbe-f995037a29dc] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:55.504537 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b2e50044-5791-41e3-aef1-ca7196403f28 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:55.504979 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b2e50044-5791-41e3-aef1-ca7196403f28 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:55.505750 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b2e50044-5791-41e3-aef1-ca7196403f28 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:55.506179 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b2e50044-5791-41e3-aef1-ca7196403f28 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:55.576593 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b2e50044-5791-41e3-aef1-ca7196403f28 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:55.590590 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b2e50044-5791-41e3-aef1-ca7196403f28 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:55.592721 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b2e50044-5791-41e3-aef1-ca7196403f28 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:55.593964 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b2e50044-5791-41e3-aef1-ca7196403f28 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc" status: 200 len: 1366 microversion: 2.57 time: 0.101471 Jul 18 03:05:55.594540 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3122/6262] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 03:05:55 2022] GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc => generated 1366 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 03:05:56.613032 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-51f3ccdd-c5ce-450c-b248-8ef2778ccf1f tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:56.613652 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-51f3ccdd-c5ce-450c-b248-8ef2778ccf1f tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] [instance: 9ff61889-89f4-4463-afbe-f995037a29dc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:56.620472 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-51f3ccdd-c5ce-450c-b248-8ef2778ccf1f tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:56.620955 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-51f3ccdd-c5ce-450c-b248-8ef2778ccf1f tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:56.621820 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-51f3ccdd-c5ce-450c-b248-8ef2778ccf1f tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:56.622365 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-51f3ccdd-c5ce-450c-b248-8ef2778ccf1f tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:56.691211 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-51f3ccdd-c5ce-450c-b248-8ef2778ccf1f tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:56.699429 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-51f3ccdd-c5ce-450c-b248-8ef2778ccf1f tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:56.701621 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-51f3ccdd-c5ce-450c-b248-8ef2778ccf1f tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:56.702848 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-51f3ccdd-c5ce-450c-b248-8ef2778ccf1f tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc" status: 200 len: 1366 microversion: 2.57 time: 0.093767 Jul 18 03:05:56.703415 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3141/6263] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 03:05:56 2022] GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc => generated 1366 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 03:05:57.722073 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5c4b9780-6c9c-473c-93bb-b3f380e9232d tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:57.722690 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5c4b9780-6c9c-473c-93bb-b3f380e9232d tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] [instance: 9ff61889-89f4-4463-afbe-f995037a29dc] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:57.729730 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5c4b9780-6c9c-473c-93bb-b3f380e9232d tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:57.730195 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5c4b9780-6c9c-473c-93bb-b3f380e9232d tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:57.730961 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5c4b9780-6c9c-473c-93bb-b3f380e9232d tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:57.732216 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5c4b9780-6c9c-473c-93bb-b3f380e9232d tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:57.799165 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5c4b9780-6c9c-473c-93bb-b3f380e9232d tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:57.807488 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5c4b9780-6c9c-473c-93bb-b3f380e9232d tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:57.809018 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5c4b9780-6c9c-473c-93bb-b3f380e9232d tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:57.811103 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5c4b9780-6c9c-473c-93bb-b3f380e9232d tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc" status: 200 len: 1366 microversion: 2.57 time: 0.092538 Jul 18 03:05:57.811688 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3123/6264] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 03:05:57 2022] GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc => generated 1366 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 03:05:58.830670 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2ca0e04e-4ae6-4f94-b936-fd4f6a18ae27 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:58.831323 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2ca0e04e-4ae6-4f94-b936-fd4f6a18ae27 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] [instance: 9ff61889-89f4-4463-afbe-f995037a29dc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:58.838333 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2ca0e04e-4ae6-4f94-b936-fd4f6a18ae27 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:58.838798 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2ca0e04e-4ae6-4f94-b936-fd4f6a18ae27 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:58.839579 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2ca0e04e-4ae6-4f94-b936-fd4f6a18ae27 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:58.840029 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2ca0e04e-4ae6-4f94-b936-fd4f6a18ae27 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:58.904907 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2ca0e04e-4ae6-4f94-b936-fd4f6a18ae27 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:58.913085 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2ca0e04e-4ae6-4f94-b936-fd4f6a18ae27 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:58.914705 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2ca0e04e-4ae6-4f94-b936-fd4f6a18ae27 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:58.915926 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2ca0e04e-4ae6-4f94-b936-fd4f6a18ae27 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc" status: 200 len: 1366 microversion: 2.57 time: 0.089284 Jul 18 03:05:58.916505 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3142/6265] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 03:05:58 2022] GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc => generated 1366 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 03:05:59.935647 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-60d5086c-cfeb-406b-80a8-a5a5f1d10335 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:59.936249 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-60d5086c-cfeb-406b-80a8-a5a5f1d10335 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] [instance: 9ff61889-89f4-4463-afbe-f995037a29dc] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:59.943606 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-60d5086c-cfeb-406b-80a8-a5a5f1d10335 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:59.944049 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-60d5086c-cfeb-406b-80a8-a5a5f1d10335 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:59.944820 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-60d5086c-cfeb-406b-80a8-a5a5f1d10335 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:59.945253 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-60d5086c-cfeb-406b-80a8-a5a5f1d10335 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:00.102788 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-60d5086c-cfeb-406b-80a8-a5a5f1d10335 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:00.111065 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-60d5086c-cfeb-406b-80a8-a5a5f1d10335 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:00.112552 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-60d5086c-cfeb-406b-80a8-a5a5f1d10335 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:00.113741 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-60d5086c-cfeb-406b-80a8-a5a5f1d10335 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc" status: 200 len: 1366 microversion: 2.57 time: 0.183146 Jul 18 03:06:00.114299 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3124/6266] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 03:05:59 2022] GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 03:06:01.132967 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8f6a0642-05ae-4a8c-b230-5ec26ef07bf6 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:01.133534 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8f6a0642-05ae-4a8c-b230-5ec26ef07bf6 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] [instance: 9ff61889-89f4-4463-afbe-f995037a29dc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:01.141677 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8f6a0642-05ae-4a8c-b230-5ec26ef07bf6 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:01.142183 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8f6a0642-05ae-4a8c-b230-5ec26ef07bf6 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:01.142996 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8f6a0642-05ae-4a8c-b230-5ec26ef07bf6 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:01.143455 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8f6a0642-05ae-4a8c-b230-5ec26ef07bf6 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:01.299449 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8f6a0642-05ae-4a8c-b230-5ec26ef07bf6 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:01.309807 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8f6a0642-05ae-4a8c-b230-5ec26ef07bf6 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:01.311351 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8f6a0642-05ae-4a8c-b230-5ec26ef07bf6 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:01.312554 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8f6a0642-05ae-4a8c-b230-5ec26ef07bf6 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc" status: 200 len: 1366 microversion: 2.57 time: 0.183813 Jul 18 03:06:01.313129 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3143/6267] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 03:06:01 2022] GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 03:06:02.331878 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4597a056-4acb-427b-947f-0d081e6eb3f8 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:02.332511 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4597a056-4acb-427b-947f-0d081e6eb3f8 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] [instance: 9ff61889-89f4-4463-afbe-f995037a29dc] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:02.348101 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4597a056-4acb-427b-947f-0d081e6eb3f8 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:02.348520 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4597a056-4acb-427b-947f-0d081e6eb3f8 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:02.349287 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4597a056-4acb-427b-947f-0d081e6eb3f8 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:02.349737 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4597a056-4acb-427b-947f-0d081e6eb3f8 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:02.415457 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4597a056-4acb-427b-947f-0d081e6eb3f8 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:02.424621 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4597a056-4acb-427b-947f-0d081e6eb3f8 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:02.426229 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4597a056-4acb-427b-947f-0d081e6eb3f8 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:02.427351 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4597a056-4acb-427b-947f-0d081e6eb3f8 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc" status: 200 len: 1366 microversion: 2.57 time: 0.099490 Jul 18 03:06:02.427911 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3125/6268] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 03:06:02 2022] GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc => generated 1366 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 03:06:03.446329 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-012778ea-13ec-463e-9765-beb7cf7208ec tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:03.446932 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-012778ea-13ec-463e-9765-beb7cf7208ec tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] [instance: 9ff61889-89f4-4463-afbe-f995037a29dc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:03.454604 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-012778ea-13ec-463e-9765-beb7cf7208ec tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:03.455072 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-012778ea-13ec-463e-9765-beb7cf7208ec tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:03.455872 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-012778ea-13ec-463e-9765-beb7cf7208ec tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:03.456325 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-012778ea-13ec-463e-9765-beb7cf7208ec tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:03.521286 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-012778ea-13ec-463e-9765-beb7cf7208ec tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:03.530550 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-012778ea-13ec-463e-9765-beb7cf7208ec tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:03.531987 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-012778ea-13ec-463e-9765-beb7cf7208ec tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:03.533196 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-012778ea-13ec-463e-9765-beb7cf7208ec tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc" status: 200 len: 1366 microversion: 2.57 time: 0.090960 Jul 18 03:06:03.533791 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3144/6269] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 03:06:03 2022] GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc => generated 1366 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 03:06:04.552113 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ca40cfc4-4220-4d6d-ab56-05e2ac2f5652 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:04.552894 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ca40cfc4-4220-4d6d-ab56-05e2ac2f5652 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] [instance: 9ff61889-89f4-4463-afbe-f995037a29dc] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:04.561195 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ca40cfc4-4220-4d6d-ab56-05e2ac2f5652 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:04.561645 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ca40cfc4-4220-4d6d-ab56-05e2ac2f5652 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:04.562452 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ca40cfc4-4220-4d6d-ab56-05e2ac2f5652 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:04.562892 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ca40cfc4-4220-4d6d-ab56-05e2ac2f5652 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:04.631750 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ca40cfc4-4220-4d6d-ab56-05e2ac2f5652 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:04.640763 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ca40cfc4-4220-4d6d-ab56-05e2ac2f5652 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:04.642300 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ca40cfc4-4220-4d6d-ab56-05e2ac2f5652 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:04.643467 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ca40cfc4-4220-4d6d-ab56-05e2ac2f5652 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc" status: 200 len: 1366 microversion: 2.57 time: 0.095351 Jul 18 03:06:04.644036 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3126/6270] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 03:06:04 2022] GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc => generated 1366 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 03:06:05.662567 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0ef8b99e-617a-48cf-ba20-ff826c3ea6c7 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:05.663143 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0ef8b99e-617a-48cf-ba20-ff826c3ea6c7 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] [instance: 9ff61889-89f4-4463-afbe-f995037a29dc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:05.665996 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:06:05.672422 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0ef8b99e-617a-48cf-ba20-ff826c3ea6c7 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:05.672886 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0ef8b99e-617a-48cf-ba20-ff826c3ea6c7 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:05.673720 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0ef8b99e-617a-48cf-ba20-ff826c3ea6c7 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:05.674252 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0ef8b99e-617a-48cf-ba20-ff826c3ea6c7 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:05.748090 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0ef8b99e-617a-48cf-ba20-ff826c3ea6c7 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:05.758381 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0ef8b99e-617a-48cf-ba20-ff826c3ea6c7 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:05.759905 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0ef8b99e-617a-48cf-ba20-ff826c3ea6c7 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:05.761116 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0ef8b99e-617a-48cf-ba20-ff826c3ea6c7 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc" status: 200 len: 1366 microversion: 2.57 time: 0.103490 Jul 18 03:06:05.761682 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3145/6271] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 03:06:05 2022] GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc => generated 1366 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 03:06:06.780862 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f0787b28-0fcd-448f-ba9f-dd0dbc31427b tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:06.781467 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f0787b28-0fcd-448f-ba9f-dd0dbc31427b tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] [instance: 9ff61889-89f4-4463-afbe-f995037a29dc] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:06.788462 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f0787b28-0fcd-448f-ba9f-dd0dbc31427b tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:06.788913 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f0787b28-0fcd-448f-ba9f-dd0dbc31427b tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:06.789682 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f0787b28-0fcd-448f-ba9f-dd0dbc31427b tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:06.790142 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f0787b28-0fcd-448f-ba9f-dd0dbc31427b tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:06.854461 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f0787b28-0fcd-448f-ba9f-dd0dbc31427b tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:06.863180 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f0787b28-0fcd-448f-ba9f-dd0dbc31427b tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:06.864681 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f0787b28-0fcd-448f-ba9f-dd0dbc31427b tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:06.865892 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f0787b28-0fcd-448f-ba9f-dd0dbc31427b tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc" status: 200 len: 1366 microversion: 2.57 time: 0.089782 Jul 18 03:06:06.866453 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3127/6272] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 03:06:06 2022] GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc => generated 1366 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 03:06:07.884906 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b3bd8129-40a6-40e2-82a0-27a8d8730944 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:07.885515 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b3bd8129-40a6-40e2-82a0-27a8d8730944 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] [instance: 9ff61889-89f4-4463-afbe-f995037a29dc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:07.894003 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b3bd8129-40a6-40e2-82a0-27a8d8730944 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:07.894465 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b3bd8129-40a6-40e2-82a0-27a8d8730944 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:07.895250 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b3bd8129-40a6-40e2-82a0-27a8d8730944 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:07.895700 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b3bd8129-40a6-40e2-82a0-27a8d8730944 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:07.965416 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b3bd8129-40a6-40e2-82a0-27a8d8730944 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:07.974222 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b3bd8129-40a6-40e2-82a0-27a8d8730944 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:07.975753 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b3bd8129-40a6-40e2-82a0-27a8d8730944 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:07.976976 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b3bd8129-40a6-40e2-82a0-27a8d8730944 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc" status: 200 len: 1372 microversion: 2.57 time: 0.096137 Jul 18 03:06:07.977559 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3146/6273] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 03:06:07 2022] GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 03:06:08.997762 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-64fe1396-7872-4bb5-99b2-89816463c09e tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:08.998653 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-64fe1396-7872-4bb5-99b2-89816463c09e tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] [instance: 9ff61889-89f4-4463-afbe-f995037a29dc] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:09.005807 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-64fe1396-7872-4bb5-99b2-89816463c09e tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:09.006261 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-64fe1396-7872-4bb5-99b2-89816463c09e tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:09.007031 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-64fe1396-7872-4bb5-99b2-89816463c09e tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:09.007467 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-64fe1396-7872-4bb5-99b2-89816463c09e tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:09.074796 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-64fe1396-7872-4bb5-99b2-89816463c09e tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:09.083510 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-64fe1396-7872-4bb5-99b2-89816463c09e tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:09.084949 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-64fe1396-7872-4bb5-99b2-89816463c09e tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:09.086161 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-64fe1396-7872-4bb5-99b2-89816463c09e tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc" status: 200 len: 1372 microversion: 2.57 time: 0.092434 Jul 18 03:06:09.086739 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3128/6274] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 03:06:08 2022] GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 03:06:10.105993 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-910e8f68-9b86-483f-bbe3-8cc2babc2c70 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:10.106751 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-910e8f68-9b86-483f-bbe3-8cc2babc2c70 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] [instance: 9ff61889-89f4-4463-afbe-f995037a29dc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:10.115060 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-910e8f68-9b86-483f-bbe3-8cc2babc2c70 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:10.115520 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-910e8f68-9b86-483f-bbe3-8cc2babc2c70 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:10.116311 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-910e8f68-9b86-483f-bbe3-8cc2babc2c70 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:10.117325 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-910e8f68-9b86-483f-bbe3-8cc2babc2c70 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:10.189980 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-910e8f68-9b86-483f-bbe3-8cc2babc2c70 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:10.199482 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-910e8f68-9b86-483f-bbe3-8cc2babc2c70 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:10.201637 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-910e8f68-9b86-483f-bbe3-8cc2babc2c70 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:10.202828 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-910e8f68-9b86-483f-bbe3-8cc2babc2c70 tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc" status: 200 len: 1357 microversion: 2.57 time: 0.100832 Jul 18 03:06:10.203406 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3147/6275] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 03:06:10 2022] GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc => generated 1357 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 03:06:10.225538 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5b162a2c-1058-4749-b05a-5e82d75fd5fb tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:10.226158 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5b162a2c-1058-4749-b05a-5e82d75fd5fb tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] [instance: 9ff61889-89f4-4463-afbe-f995037a29dc] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:10.233877 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5b162a2c-1058-4749-b05a-5e82d75fd5fb tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:10.234323 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5b162a2c-1058-4749-b05a-5e82d75fd5fb tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:10.235124 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5b162a2c-1058-4749-b05a-5e82d75fd5fb tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:10.235555 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5b162a2c-1058-4749-b05a-5e82d75fd5fb tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:10.238384 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=100 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:06:10.264172 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5b162a2c-1058-4749-b05a-5e82d75fd5fb tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] [instance: 9ff61889-89f4-4463-afbe-f995037a29dc] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:06:10.344786 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5b162a2c-1058-4749-b05a-5e82d75fd5fb tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc" status: 204 len: 0 microversion: 2.57 time: 0.122760 Jul 18 03:06:10.345393 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3129/6276] 10.222.0.57 () {60 vars in 1279 bytes} [Mon Jul 18 03:06:10 2022] DELETE /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 03:06:10.355196 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2b6d6b3c-ca8b-4ffc-b287-07709cabd8cc tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:10.355833 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2b6d6b3c-ca8b-4ffc-b287-07709cabd8cc tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] [instance: 9ff61889-89f4-4463-afbe-f995037a29dc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:10.362759 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b6d6b3c-ca8b-4ffc-b287-07709cabd8cc tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:10.363140 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b6d6b3c-ca8b-4ffc-b287-07709cabd8cc tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:10.363939 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b6d6b3c-ca8b-4ffc-b287-07709cabd8cc tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:10.364395 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2b6d6b3c-ca8b-4ffc-b287-07709cabd8cc tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:10.451466 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2b6d6b3c-ca8b-4ffc-b287-07709cabd8cc tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:10.459878 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2b6d6b3c-ca8b-4ffc-b287-07709cabd8cc tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:10.461416 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2b6d6b3c-ca8b-4ffc-b287-07709cabd8cc tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:10.462628 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2b6d6b3c-ca8b-4ffc-b287-07709cabd8cc tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc" status: 200 len: 1363 microversion: 2.57 time: 0.112395 Jul 18 03:06:10.463205 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3148/6277] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 03:06:10 2022] GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc => generated 1363 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 03:06:11.482391 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-87265285-51ab-4ca5-b9bd-3c87fb64f07c tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:11.483091 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-87265285-51ab-4ca5-b9bd-3c87fb64f07c tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] [instance: 9ff61889-89f4-4463-afbe-f995037a29dc] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:11.489977 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-87265285-51ab-4ca5-b9bd-3c87fb64f07c tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:11.490413 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-87265285-51ab-4ca5-b9bd-3c87fb64f07c tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:11.491167 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-87265285-51ab-4ca5-b9bd-3c87fb64f07c tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:11.491599 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-87265285-51ab-4ca5-b9bd-3c87fb64f07c tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:11.557510 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-87265285-51ab-4ca5-b9bd-3c87fb64f07c tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:11.567132 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-87265285-51ab-4ca5-b9bd-3c87fb64f07c tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:11.568647 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-87265285-51ab-4ca5-b9bd-3c87fb64f07c tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38cc981f17284cfb9ce66ebbeeab6381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd542dc7eb46b39a2134cacd11eb3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:11.569843 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-87265285-51ab-4ca5-b9bd-3c87fb64f07c tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc" status: 200 len: 1363 microversion: 2.57 time: 0.092067 Jul 18 03:06:11.570411 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3130/6278] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 03:06:11 2022] GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc => generated 1363 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 03:06:12.588545 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9d4d4d5f-07de-4480-bdce-a8c56b55b31e tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:12.589182 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9d4d4d5f-07de-4480-bdce-a8c56b55b31e tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] [instance: 9ff61889-89f4-4463-afbe-f995037a29dc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:12.596763 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9d4d4d5f-07de-4480-bdce-a8c56b55b31e tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:12.597223 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9d4d4d5f-07de-4480-bdce-a8c56b55b31e tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:12.598041 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9d4d4d5f-07de-4480-bdce-a8c56b55b31e tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:12.598496 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9d4d4d5f-07de-4480-bdce-a8c56b55b31e tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:12.612851 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-9d4d4d5f-07de-4480-bdce-a8c56b55b31e tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] HTTP exception thrown: Instance 9ff61889-89f4-4463-afbe-f995037a29dc could not be found. Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9d4d4d5f-07de-4480-bdce-a8c56b55b31e tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Request method failure captured: Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc HTTP/1.1 Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1M3-adz8gzk7qbzDyv9yPSD26YGIt1-eFGe_-N7WxVf8lfUpq1ZN1VeUiEibsmBKqACVJ92ZMxx-5g4QFmmu6WCiF3o2p3tT3dIVgKqf08LQH6eiaBdj4prMI-Ia2RpaUVeiEsaYl-itMK3vzM_-wi1O9lL-wr5In_DX-fEPcF_HCWI Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: X-Openstack-Nova-Api-Version: 2.57 Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 1ffd542dc7eb46b39a2134cacd11eb3f Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServerShowV257Test-2055710727 Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1ffd542dc7eb46b39a2134cacd11eb3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1ffd542dc7eb46b39a2134cacd11eb3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1ffd542dc7eb46b39a2134cacd11eb3f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1ffd542dc7eb46b39a2134cacd11eb3f"}]}] Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServerShowV257Test-2055710727 Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 1ffd542dc7eb46b39a2134cacd11eb3f Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServerShowV257Test-2055710727 Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServerShowV257Test-2055710727-project Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 38cc981f17284cfb9ce66ebbeeab6381 Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServerShowV257Test-2055710727-project Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 9ff61889-89f4-4463-afbe-f995037a29dc could not be found. Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '9ff61889-89f4-4463-afbe-f995037a29dc'} Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ff61889-89f4-4463-afbe-f995037a29dc could not be found. Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ff61889-89f4-4463-afbe-f995037a29dc could not be found. Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:12.614561 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:12.620618 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:12.620618 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:12.620618 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:12.620618 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:06:12.620618 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:06:12.620618 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ff61889-89f4-4463-afbe-f995037a29dc could not be found. Jul 18 03:06:12.620618 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:12.620618 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9d4d4d5f-07de-4480-bdce-a8c56b55b31e tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] Returning 404 to user: Instance 9ff61889-89f4-4463-afbe-f995037a29dc could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:06:12.620618 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9d4d4d5f-07de-4480-bdce-a8c56b55b31e tempest-ServerShowV257Test-2055710727 tempest-ServerShowV257Test-2055710727-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc" status: 404 len: 111 microversion: 2.57 time: 0.031475 Jul 18 03:06:12.620618 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3149/6279] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 03:06:12 2022] GET /compute/v2.1/servers/9ff61889-89f4-4463-afbe-f995037a29dc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 03:06:18.586046 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bf44bf96-94b4-4739-b95b-e81faf95bf38 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1317386721", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "3a5db53b-d9ed-49e3-80b6-81d1af92080a"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:06:18.642047 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-bf44bf96-94b4-4739-b95b-e81faf95bf38 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] validate_networks() for [('3a5db53b-d9ed-49e3-80b6-81d1af92080a', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:06:19.307601 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-bf44bf96-94b4-4739-b95b-e81faf95bf38 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:06:19.308051 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-bf44bf96-94b4-4739-b95b-e81faf95bf38 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:06:19.308523 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-bf44bf96-94b4-4739-b95b-e81faf95bf38 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:06:19.309478 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-bf44bf96-94b4-4739-b95b-e81faf95bf38 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:06:19.310268 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-bf44bf96-94b4-4739-b95b-e81faf95bf38 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:06:19.320258 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bf44bf96-94b4-4739-b95b-e81faf95bf38 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:19.320709 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bf44bf96-94b4-4739-b95b-e81faf95bf38 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:19.321562 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bf44bf96-94b4-4739-b95b-e81faf95bf38 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:19.321980 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bf44bf96-94b4-4739-b95b-e81faf95bf38 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:19.339692 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-bf44bf96-94b4-4739-b95b-e81faf95bf38 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Getting quotas for project 1e79ebd986e14dab8eb215d3a956f67d. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:06:19.346950 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-bf44bf96-94b4-4739-b95b-e81faf95bf38 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Getting quotas for user 290e0074b3c74da2acc07f86338760ac and project 1e79ebd986e14dab8eb215d3a956f67d. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:06:19.361713 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bf44bf96-94b4-4739-b95b-e81faf95bf38 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:06:19.364083 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bf44bf96-94b4-4739-b95b-e81faf95bf38 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:06:19.411677 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bf44bf96-94b4-4739-b95b-e81faf95bf38 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.944044 Jul 18 03:06:19.416728 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3131/6280] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:06:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:06:19.422806 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0b7aa989-dab0-41e6-88b5-50c923f9e0e8 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:19.423508 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0b7aa989-dab0-41e6-88b5-50c923f9e0e8 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:19.500607 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0b7aa989-dab0-41e6-88b5-50c923f9e0e8 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:19.509102 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0b7aa989-dab0-41e6-88b5-50c923f9e0e8 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1217 microversion: 2.1 time: 0.090644 Jul 18 03:06:19.520352 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3150/6281] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:19 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:20.529181 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a664ae95-a8c3-49b2-823b-7aa0a562bf97 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:20.529929 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a664ae95-a8c3-49b2-823b-7aa0a562bf97 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:20.538800 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a664ae95-a8c3-49b2-823b-7aa0a562bf97 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:20.539697 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a664ae95-a8c3-49b2-823b-7aa0a562bf97 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:20.540994 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a664ae95-a8c3-49b2-823b-7aa0a562bf97 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:20.541776 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a664ae95-a8c3-49b2-823b-7aa0a562bf97 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:20.649325 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a664ae95-a8c3-49b2-823b-7aa0a562bf97 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:20.657309 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a664ae95-a8c3-49b2-823b-7aa0a562bf97 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1277 microversion: 2.1 time: 0.133849 Jul 18 03:06:20.658176 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3132/6282] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:20 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1277 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:21.675853 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ecabc4c7-3bf9-4eb6-9c20-be42aa35f7f2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:21.677343 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ecabc4c7-3bf9-4eb6-9c20-be42aa35f7f2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:21.690462 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ecabc4c7-3bf9-4eb6-9c20-be42aa35f7f2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:21.692037 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ecabc4c7-3bf9-4eb6-9c20-be42aa35f7f2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:21.693213 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ecabc4c7-3bf9-4eb6-9c20-be42aa35f7f2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:21.693898 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ecabc4c7-3bf9-4eb6-9c20-be42aa35f7f2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:21.700071 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=78 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:06:21.957531 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ecabc4c7-3bf9-4eb6-9c20-be42aa35f7f2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:21.969515 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ecabc4c7-3bf9-4eb6-9c20-be42aa35f7f2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1317 microversion: 2.1 time: 0.298488 Jul 18 03:06:21.970540 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3151/6283] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:21 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1317 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:22.044475 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-366e17c0-6c79-4e6f-9930-d619b851136b tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:06:22.046466 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-366e17c0-6c79-4e6f-9930-d619b851136b tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: 428669f8-ae42-4320-b8b7-8d79c51a67ac] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:22.056058 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:06:22.066406 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-366e17c0-6c79-4e6f-9930-d619b851136b tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:22.067166 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-366e17c0-6c79-4e6f-9930-d619b851136b tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:22.068519 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-366e17c0-6c79-4e6f-9930-d619b851136b tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:22.069153 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-366e17c0-6c79-4e6f-9930-d619b851136b tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:22.145793 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-366e17c0-6c79-4e6f-9930-d619b851136b tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "POST /compute/v2.1/servers/428669f8-ae42-4320-b8b7-8d79c51a67ac/action" status: 200 len: 24571 microversion: 2.1 time: 0.105497 Jul 18 03:06:22.153366 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3133/6284] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:06:22 2022] POST /compute/v2.1/servers/428669f8-ae42-4320-b8b7-8d79c51a67ac/action => generated 24571 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 03:06:22.432299 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-93d4ef11-4949-4152-9977-ae7e1d2ee9ec req-7ee78a5c-6423-4924-b164-5e8657d17cac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63632c37-5811-4473-a763-d8856e28e041", "tag": "4fccf55a-5892-41d7-b49b-4098586ab81b"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:06:22.444042 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-93d4ef11-4949-4152-9977-ae7e1d2ee9ec req-7ee78a5c-6423-4924-b164-5e8657d17cac service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:22.445029 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-93d4ef11-4949-4152-9977-ae7e1d2ee9ec req-7ee78a5c-6423-4924-b164-5e8657d17cac service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:22.462499 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-93d4ef11-4949-4152-9977-ae7e1d2ee9ec req-7ee78a5c-6423-4924-b164-5e8657d17cac service nova] Creating event network-changed:4fccf55a-5892-41d7-b49b-4098586ab81b for instance 63632c37-5811-4473-a763-d8856e28e041 on n-h2-465891-3 Jul 18 03:06:22.468635 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-93d4ef11-4949-4152-9977-ae7e1d2ee9ec req-7ee78a5c-6423-4924-b164-5e8657d17cac service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117914 Jul 18 03:06:22.469560 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3152/6285] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:06:22.987598 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-17a64271-c76c-45ab-acad-724200dde02c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:22.988332 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-17a64271-c76c-45ab-acad-724200dde02c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:22.995619 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-17a64271-c76c-45ab-acad-724200dde02c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:22.996071 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-17a64271-c76c-45ab-acad-724200dde02c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:22.997479 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-17a64271-c76c-45ab-acad-724200dde02c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:22.998170 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-17a64271-c76c-45ab-acad-724200dde02c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:23.138793 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-17a64271-c76c-45ab-acad-724200dde02c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:23.147038 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-17a64271-c76c-45ab-acad-724200dde02c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1317 microversion: 2.1 time: 0.163640 Jul 18 03:06:23.147616 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3134/6286] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:22 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:24.166180 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8a913fde-8e70-4210-838c-f78426c48cdd tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:24.167035 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8a913fde-8e70-4210-838c-f78426c48cdd tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:24.174242 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8a913fde-8e70-4210-838c-f78426c48cdd tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:24.174710 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8a913fde-8e70-4210-838c-f78426c48cdd tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:24.175556 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8a913fde-8e70-4210-838c-f78426c48cdd tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:24.176008 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8a913fde-8e70-4210-838c-f78426c48cdd tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:24.363242 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8a913fde-8e70-4210-838c-f78426c48cdd tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:24.370756 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8a913fde-8e70-4210-838c-f78426c48cdd tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1317 microversion: 2.1 time: 0.210017 Jul 18 03:06:24.371465 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3153/6287] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:24 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:25.387744 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3a13b635-e4ae-4e52-baae-38ffff763dcf tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:25.388464 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3a13b635-e4ae-4e52-baae-38ffff763dcf tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:25.396803 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3a13b635-e4ae-4e52-baae-38ffff763dcf tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:25.397265 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3a13b635-e4ae-4e52-baae-38ffff763dcf tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:25.398079 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3a13b635-e4ae-4e52-baae-38ffff763dcf tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:25.398521 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3a13b635-e4ae-4e52-baae-38ffff763dcf tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:25.536858 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3a13b635-e4ae-4e52-baae-38ffff763dcf tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:25.545204 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3a13b635-e4ae-4e52-baae-38ffff763dcf tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1317 microversion: 2.1 time: 0.161565 Jul 18 03:06:25.545808 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3135/6288] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:25 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:26.562918 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7cc2a671-1174-4990-a6f1-04c2bd1bb140 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:26.563545 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7cc2a671-1174-4990-a6f1-04c2bd1bb140 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:26.570423 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7cc2a671-1174-4990-a6f1-04c2bd1bb140 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:26.570880 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7cc2a671-1174-4990-a6f1-04c2bd1bb140 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:26.571652 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7cc2a671-1174-4990-a6f1-04c2bd1bb140 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:26.572101 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7cc2a671-1174-4990-a6f1-04c2bd1bb140 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:26.708410 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7cc2a671-1174-4990-a6f1-04c2bd1bb140 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:26.715935 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7cc2a671-1174-4990-a6f1-04c2bd1bb140 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1317 microversion: 2.1 time: 0.157445 Jul 18 03:06:26.716505 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3154/6289] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:26 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:27.564021 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-32e1df55-5665-41f6-90cd-12cc55842f59 req-ad74be40-56d1-42d3-9e68-3ece921143ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63632c37-5811-4473-a763-d8856e28e041", "name": "network-vif-plugged", "status": "completed", "tag": "4fccf55a-5892-41d7-b49b-4098586ab81b"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:06:27.574366 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-32e1df55-5665-41f6-90cd-12cc55842f59 req-ad74be40-56d1-42d3-9e68-3ece921143ea service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:27.574809 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-32e1df55-5665-41f6-90cd-12cc55842f59 req-ad74be40-56d1-42d3-9e68-3ece921143ea service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:27.586289 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-32e1df55-5665-41f6-90cd-12cc55842f59 req-ad74be40-56d1-42d3-9e68-3ece921143ea service nova] Creating event network-vif-plugged:4fccf55a-5892-41d7-b49b-4098586ab81b for instance 63632c37-5811-4473-a763-d8856e28e041 on n-h2-465891-3 Jul 18 03:06:27.592282 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-32e1df55-5665-41f6-90cd-12cc55842f59 req-ad74be40-56d1-42d3-9e68-3ece921143ea service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113297 Jul 18 03:06:27.592874 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3136/6290] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:06:27.732688 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b4966f97-3a15-4f4e-8e6f-ca767464e8a6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:27.733293 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b4966f97-3a15-4f4e-8e6f-ca767464e8a6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:27.740915 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b4966f97-3a15-4f4e-8e6f-ca767464e8a6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:27.741384 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b4966f97-3a15-4f4e-8e6f-ca767464e8a6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:27.742198 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b4966f97-3a15-4f4e-8e6f-ca767464e8a6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:27.742654 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b4966f97-3a15-4f4e-8e6f-ca767464e8a6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:27.874553 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b4966f97-3a15-4f4e-8e6f-ca767464e8a6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:27.883005 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b4966f97-3a15-4f4e-8e6f-ca767464e8a6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1317 microversion: 2.1 time: 0.154226 Jul 18 03:06:27.883934 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3155/6291] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:27 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:28.903229 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b3396fa2-ab5a-495e-b71a-4fd478beaf63 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:28.903925 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b3396fa2-ab5a-495e-b71a-4fd478beaf63 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:28.910273 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b3396fa2-ab5a-495e-b71a-4fd478beaf63 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:28.910715 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b3396fa2-ab5a-495e-b71a-4fd478beaf63 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:28.911475 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b3396fa2-ab5a-495e-b71a-4fd478beaf63 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:28.911907 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b3396fa2-ab5a-495e-b71a-4fd478beaf63 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:29.047101 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b3396fa2-ab5a-495e-b71a-4fd478beaf63 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:29.054868 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b3396fa2-ab5a-495e-b71a-4fd478beaf63 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1317 microversion: 2.1 time: 0.157162 Jul 18 03:06:29.055440 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3137/6292] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:28 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:30.071297 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-adcfd83e-d7e6-41ab-9df4-9e3b174b10b4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:30.071917 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-adcfd83e-d7e6-41ab-9df4-9e3b174b10b4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:30.074865 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:06:30.080530 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-adcfd83e-d7e6-41ab-9df4-9e3b174b10b4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:30.080986 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-adcfd83e-d7e6-41ab-9df4-9e3b174b10b4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:30.081791 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-adcfd83e-d7e6-41ab-9df4-9e3b174b10b4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:30.082243 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-adcfd83e-d7e6-41ab-9df4-9e3b174b10b4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:30.221985 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-adcfd83e-d7e6-41ab-9df4-9e3b174b10b4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:30.229498 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-adcfd83e-d7e6-41ab-9df4-9e3b174b10b4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.162139 Jul 18 03:06:30.230111 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3156/6293] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:30 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:30.283807 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cee9a625-f8da-40ca-81ea-de7e35fa4656 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-825185397", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "3a5db53b-d9ed-49e3-80b6-81d1af92080a"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:06:30.290533 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:06:30.291204 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:06:30.340978 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-cee9a625-f8da-40ca-81ea-de7e35fa4656 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] validate_networks() for [('3a5db53b-d9ed-49e3-80b6-81d1af92080a', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:06:30.789490 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-cee9a625-f8da-40ca-81ea-de7e35fa4656 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:06:30.789956 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-cee9a625-f8da-40ca-81ea-de7e35fa4656 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:06:30.790425 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-cee9a625-f8da-40ca-81ea-de7e35fa4656 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:06:30.790997 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-cee9a625-f8da-40ca-81ea-de7e35fa4656 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:06:30.791427 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-cee9a625-f8da-40ca-81ea-de7e35fa4656 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:06:30.802538 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cee9a625-f8da-40ca-81ea-de7e35fa4656 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:30.802985 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cee9a625-f8da-40ca-81ea-de7e35fa4656 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:30.803774 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cee9a625-f8da-40ca-81ea-de7e35fa4656 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:30.804207 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cee9a625-f8da-40ca-81ea-de7e35fa4656 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:30.822309 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-cee9a625-f8da-40ca-81ea-de7e35fa4656 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Getting quotas for project 1e79ebd986e14dab8eb215d3a956f67d. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:06:30.828115 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-cee9a625-f8da-40ca-81ea-de7e35fa4656 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Getting quotas for user 290e0074b3c74da2acc07f86338760ac and project 1e79ebd986e14dab8eb215d3a956f67d. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:06:30.841006 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cee9a625-f8da-40ca-81ea-de7e35fa4656 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:06:30.843305 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cee9a625-f8da-40ca-81ea-de7e35fa4656 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 2a565242-f018-4078-a74c-18c3b8823c51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:06:30.890008 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cee9a625-f8da-40ca-81ea-de7e35fa4656 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.609941 Jul 18 03:06:30.890676 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3138/6294] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:06:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:06:30.900560 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-733a214e-a90c-4813-a5a6-9458ee9021fe tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:30.901204 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-733a214e-a90c-4813-a5a6-9458ee9021fe tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 2a565242-f018-4078-a74c-18c3b8823c51] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:30.962834 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-733a214e-a90c-4813-a5a6-9458ee9021fe tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:30.970256 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-733a214e-a90c-4813-a5a6-9458ee9021fe tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/2a565242-f018-4078-a74c-18c3b8823c51" status: 200 len: 1216 microversion: 2.1 time: 0.073430 Jul 18 03:06:30.970870 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3157/6295] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:30 2022] GET /compute/v2.1/servers/2a565242-f018-4078-a74c-18c3b8823c51 => generated 1216 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:31.988762 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c75d90f1-1749-4e7d-98be-3103a907d98d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:31.989404 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c75d90f1-1749-4e7d-98be-3103a907d98d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 2a565242-f018-4078-a74c-18c3b8823c51] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:31.998054 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c75d90f1-1749-4e7d-98be-3103a907d98d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:31.998523 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c75d90f1-1749-4e7d-98be-3103a907d98d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:31.999325 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c75d90f1-1749-4e7d-98be-3103a907d98d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:31.999771 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c75d90f1-1749-4e7d-98be-3103a907d98d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:32.075278 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c75d90f1-1749-4e7d-98be-3103a907d98d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:32.082997 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c75d90f1-1749-4e7d-98be-3103a907d98d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/2a565242-f018-4078-a74c-18c3b8823c51" status: 200 len: 1274 microversion: 2.1 time: 0.099042 Jul 18 03:06:32.083598 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3139/6296] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:31 2022] GET /compute/v2.1/servers/2a565242-f018-4078-a74c-18c3b8823c51 => generated 1274 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:33.115500 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4f3fe1cc-eef6-473d-9b51-ee64d60716e2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:33.118027 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4f3fe1cc-eef6-473d-9b51-ee64d60716e2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 2a565242-f018-4078-a74c-18c3b8823c51] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:33.143455 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4f3fe1cc-eef6-473d-9b51-ee64d60716e2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:33.143931 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4f3fe1cc-eef6-473d-9b51-ee64d60716e2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:33.144728 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4f3fe1cc-eef6-473d-9b51-ee64d60716e2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:33.145347 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4f3fe1cc-eef6-473d-9b51-ee64d60716e2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:33.570214 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4f3fe1cc-eef6-473d-9b51-ee64d60716e2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:33.579256 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4f3fe1cc-eef6-473d-9b51-ee64d60716e2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/2a565242-f018-4078-a74c-18c3b8823c51" status: 200 len: 1316 microversion: 2.1 time: 0.481160 Jul 18 03:06:33.579939 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3158/6297] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:33 2022] GET /compute/v2.1/servers/2a565242-f018-4078-a74c-18c3b8823c51 => generated 1316 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:34.066601 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-96c1ffa5-b497-4500-8e57-7cc3d3cb9905 req-27d7edab-6440-4eb1-8cbd-7326c90a9220 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a565242-f018-4078-a74c-18c3b8823c51", "tag": "1e18a512-68dc-4129-b501-0e172ed04046"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:06:34.082930 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-96c1ffa5-b497-4500-8e57-7cc3d3cb9905 req-27d7edab-6440-4eb1-8cbd-7326c90a9220 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:34.083539 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-96c1ffa5-b497-4500-8e57-7cc3d3cb9905 req-27d7edab-6440-4eb1-8cbd-7326c90a9220 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:34.097180 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-96c1ffa5-b497-4500-8e57-7cc3d3cb9905 req-27d7edab-6440-4eb1-8cbd-7326c90a9220 service nova] Creating event network-changed:1e18a512-68dc-4129-b501-0e172ed04046 for instance 2a565242-f018-4078-a74c-18c3b8823c51 on n-h2-465891-3 Jul 18 03:06:34.103025 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-96c1ffa5-b497-4500-8e57-7cc3d3cb9905 req-27d7edab-6440-4eb1-8cbd-7326c90a9220 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040643 Jul 18 03:06:34.104316 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3140/6298] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:06:34.597295 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-13450a91-5b6b-4521-87c9-61f2e9e7ce23 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:34.597981 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-13450a91-5b6b-4521-87c9-61f2e9e7ce23 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 2a565242-f018-4078-a74c-18c3b8823c51] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:34.605298 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-13450a91-5b6b-4521-87c9-61f2e9e7ce23 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:34.605906 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-13450a91-5b6b-4521-87c9-61f2e9e7ce23 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:34.606906 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-13450a91-5b6b-4521-87c9-61f2e9e7ce23 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:34.607439 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-13450a91-5b6b-4521-87c9-61f2e9e7ce23 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:35.023250 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-13450a91-5b6b-4521-87c9-61f2e9e7ce23 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:35.032333 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-13450a91-5b6b-4521-87c9-61f2e9e7ce23 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/2a565242-f018-4078-a74c-18c3b8823c51" status: 200 len: 1316 microversion: 2.1 time: 0.438909 Jul 18 03:06:35.033008 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3159/6299] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:34 2022] GET /compute/v2.1/servers/2a565242-f018-4078-a74c-18c3b8823c51 => generated 1316 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:36.049115 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7a600cdb-0a62-4480-bfa8-b99047e82235 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:36.049958 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7a600cdb-0a62-4480-bfa8-b99047e82235 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 2a565242-f018-4078-a74c-18c3b8823c51] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:36.059840 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7a600cdb-0a62-4480-bfa8-b99047e82235 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:36.059840 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7a600cdb-0a62-4480-bfa8-b99047e82235 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:36.059840 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7a600cdb-0a62-4480-bfa8-b99047e82235 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:36.059840 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7a600cdb-0a62-4480-bfa8-b99047e82235 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:36.276040 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7a600cdb-0a62-4480-bfa8-b99047e82235 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:36.284910 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7a600cdb-0a62-4480-bfa8-b99047e82235 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/2a565242-f018-4078-a74c-18c3b8823c51" status: 200 len: 1316 microversion: 2.1 time: 0.240003 Jul 18 03:06:36.285526 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3141/6300] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:36 2022] GET /compute/v2.1/servers/2a565242-f018-4078-a74c-18c3b8823c51 => generated 1316 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:37.303055 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f7020a57-afc1-4c81-a31a-d95c6e8645d1 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:37.303816 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f7020a57-afc1-4c81-a31a-d95c6e8645d1 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 2a565242-f018-4078-a74c-18c3b8823c51] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:37.307156 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=34 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:06:37.312477 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f7020a57-afc1-4c81-a31a-d95c6e8645d1 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:37.312939 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f7020a57-afc1-4c81-a31a-d95c6e8645d1 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:37.313752 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f7020a57-afc1-4c81-a31a-d95c6e8645d1 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:37.314203 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f7020a57-afc1-4c81-a31a-d95c6e8645d1 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:37.487976 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f7020a57-afc1-4c81-a31a-d95c6e8645d1 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:37.495830 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f7020a57-afc1-4c81-a31a-d95c6e8645d1 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/2a565242-f018-4078-a74c-18c3b8823c51" status: 200 len: 1316 microversion: 2.1 time: 0.196533 Jul 18 03:06:37.496431 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3160/6301] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:37 2022] GET /compute/v2.1/servers/2a565242-f018-4078-a74c-18c3b8823c51 => generated 1316 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:38.513371 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c79d2662-f472-44de-b359-0e63c8fdbc7e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:38.514123 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c79d2662-f472-44de-b359-0e63c8fdbc7e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 2a565242-f018-4078-a74c-18c3b8823c51] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:38.521311 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c79d2662-f472-44de-b359-0e63c8fdbc7e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:38.521784 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c79d2662-f472-44de-b359-0e63c8fdbc7e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:38.522596 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c79d2662-f472-44de-b359-0e63c8fdbc7e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:38.523024 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c79d2662-f472-44de-b359-0e63c8fdbc7e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:38.673191 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c79d2662-f472-44de-b359-0e63c8fdbc7e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:38.684184 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c79d2662-f472-44de-b359-0e63c8fdbc7e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/2a565242-f018-4078-a74c-18c3b8823c51" status: 200 len: 1316 microversion: 2.1 time: 0.174564 Jul 18 03:06:38.685206 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3142/6302] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:38 2022] GET /compute/v2.1/servers/2a565242-f018-4078-a74c-18c3b8823c51 => generated 1316 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:39.505351 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-1ce77668-b0d5-42e4-80bf-19fc02ebad0a req-d60ce022-360b-4b06-8c9d-56e01af75fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a565242-f018-4078-a74c-18c3b8823c51", "name": "network-vif-plugged", "status": "completed", "tag": "1e18a512-68dc-4129-b501-0e172ed04046"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:06:39.516129 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-1ce77668-b0d5-42e4-80bf-19fc02ebad0a req-d60ce022-360b-4b06-8c9d-56e01af75fe2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:39.516732 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-1ce77668-b0d5-42e4-80bf-19fc02ebad0a req-d60ce022-360b-4b06-8c9d-56e01af75fe2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:39.529868 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-1ce77668-b0d5-42e4-80bf-19fc02ebad0a req-d60ce022-360b-4b06-8c9d-56e01af75fe2 service nova] Creating event network-vif-plugged:1e18a512-68dc-4129-b501-0e172ed04046 for instance 2a565242-f018-4078-a74c-18c3b8823c51 on n-h2-465891-3 Jul 18 03:06:39.534897 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-1ce77668-b0d5-42e4-80bf-19fc02ebad0a req-d60ce022-360b-4b06-8c9d-56e01af75fe2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033336 Jul 18 03:06:39.535595 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3161/6303] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:06:39.702029 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-82c47373-ea6f-40cf-84f7-343ee90502d9 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:39.702643 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-82c47373-ea6f-40cf-84f7-343ee90502d9 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 2a565242-f018-4078-a74c-18c3b8823c51] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:39.709682 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-82c47373-ea6f-40cf-84f7-343ee90502d9 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:39.710164 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-82c47373-ea6f-40cf-84f7-343ee90502d9 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:39.710935 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-82c47373-ea6f-40cf-84f7-343ee90502d9 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:39.711372 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-82c47373-ea6f-40cf-84f7-343ee90502d9 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:39.846618 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-82c47373-ea6f-40cf-84f7-343ee90502d9 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:39.854591 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-82c47373-ea6f-40cf-84f7-343ee90502d9 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/2a565242-f018-4078-a74c-18c3b8823c51" status: 200 len: 1316 microversion: 2.1 time: 0.156714 Jul 18 03:06:39.855324 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3143/6304] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:39 2022] GET /compute/v2.1/servers/2a565242-f018-4078-a74c-18c3b8823c51 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:40.874422 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-caaab40d-087f-416f-830a-3ed08d29d168 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:40.875170 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-caaab40d-087f-416f-830a-3ed08d29d168 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 2a565242-f018-4078-a74c-18c3b8823c51] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:40.881954 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-caaab40d-087f-416f-830a-3ed08d29d168 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:40.882423 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-caaab40d-087f-416f-830a-3ed08d29d168 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:40.883225 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-caaab40d-087f-416f-830a-3ed08d29d168 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:40.883682 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-caaab40d-087f-416f-830a-3ed08d29d168 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:40.972133 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:06:41.026598 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-caaab40d-087f-416f-830a-3ed08d29d168 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:41.034548 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-caaab40d-087f-416f-830a-3ed08d29d168 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/2a565242-f018-4078-a74c-18c3b8823c51" status: 200 len: 1505 microversion: 2.1 time: 0.166258 Jul 18 03:06:41.035129 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3162/6305] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:40 2022] GET /compute/v2.1/servers/2a565242-f018-4078-a74c-18c3b8823c51 => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:41.050658 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-effd9e86-6836-49b6-88ef-53f332e0f4cb tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:41.051238 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-effd9e86-6836-49b6-88ef-53f332e0f4cb tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 2a565242-f018-4078-a74c-18c3b8823c51] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:41.054111 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:06:41.054982 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:06:41.061930 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-effd9e86-6836-49b6-88ef-53f332e0f4cb tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:41.062382 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-effd9e86-6836-49b6-88ef-53f332e0f4cb tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:41.063159 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-effd9e86-6836-49b6-88ef-53f332e0f4cb tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:41.063596 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-effd9e86-6836-49b6-88ef-53f332e0f4cb tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:41.066372 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:06:41.093897 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-effd9e86-6836-49b6-88ef-53f332e0f4cb tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 2a565242-f018-4078-a74c-18c3b8823c51] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:06:41.175877 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-effd9e86-6836-49b6-88ef-53f332e0f4cb tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2a565242-f018-4078-a74c-18c3b8823c51" status: 204 len: 0 microversion: 2.1 time: 0.128757 Jul 18 03:06:41.176517 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3144/6306] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:06:41 2022] DELETE /compute/v2.1/servers/2a565242-f018-4078-a74c-18c3b8823c51 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 03:06:41.186440 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a773dd2a-db7d-4e8e-8337-c030d80642c6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:41.187066 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a773dd2a-db7d-4e8e-8337-c030d80642c6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 2a565242-f018-4078-a74c-18c3b8823c51] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:41.193259 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a773dd2a-db7d-4e8e-8337-c030d80642c6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:41.193760 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a773dd2a-db7d-4e8e-8337-c030d80642c6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:41.194529 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a773dd2a-db7d-4e8e-8337-c030d80642c6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:41.194979 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a773dd2a-db7d-4e8e-8337-c030d80642c6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:41.332973 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a773dd2a-db7d-4e8e-8337-c030d80642c6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:41.341524 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a773dd2a-db7d-4e8e-8337-c030d80642c6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/2a565242-f018-4078-a74c-18c3b8823c51" status: 200 len: 1511 microversion: 2.1 time: 0.160451 Jul 18 03:06:41.342147 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3163/6307] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:41 2022] GET /compute/v2.1/servers/2a565242-f018-4078-a74c-18c3b8823c51 => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:42.360228 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-dc747dde-5914-4792-833e-60027c129cd8 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:42.360971 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-dc747dde-5914-4792-833e-60027c129cd8 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 2a565242-f018-4078-a74c-18c3b8823c51] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:42.368320 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dc747dde-5914-4792-833e-60027c129cd8 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:42.368781 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dc747dde-5914-4792-833e-60027c129cd8 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:42.369570 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dc747dde-5914-4792-833e-60027c129cd8 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:42.370053 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dc747dde-5914-4792-833e-60027c129cd8 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:42.505384 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-dc747dde-5914-4792-833e-60027c129cd8 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:42.513810 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-dc747dde-5914-4792-833e-60027c129cd8 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/2a565242-f018-4078-a74c-18c3b8823c51" status: 200 len: 1511 microversion: 2.1 time: 0.158684 Jul 18 03:06:42.514711 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3145/6308] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:42 2022] GET /compute/v2.1/servers/2a565242-f018-4078-a74c-18c3b8823c51 => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:43.052495 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-348807ee-8649-4204-8ef4-81e162c14648 req-826ea2f2-7085-41b5-b26a-8f0535306790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a565242-f018-4078-a74c-18c3b8823c51", "name": "network-vif-deleted", "tag": "1e18a512-68dc-4129-b501-0e172ed04046"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:06:43.066963 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-348807ee-8649-4204-8ef4-81e162c14648 req-826ea2f2-7085-41b5-b26a-8f0535306790 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:43.078488 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-348807ee-8649-4204-8ef4-81e162c14648 req-826ea2f2-7085-41b5-b26a-8f0535306790 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:43.093492 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-348807ee-8649-4204-8ef4-81e162c14648 req-826ea2f2-7085-41b5-b26a-8f0535306790 service nova] Creating event network-vif-deleted:1e18a512-68dc-4129-b501-0e172ed04046 for instance 2a565242-f018-4078-a74c-18c3b8823c51 on n-h2-465891-3 Jul 18 03:06:43.098492 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-348807ee-8649-4204-8ef4-81e162c14648 req-826ea2f2-7085-41b5-b26a-8f0535306790 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049626 Jul 18 03:06:43.103676 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3164/6309] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:06:43.532562 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d5ba5e98-2dc1-4cc3-a48e-0a4ef89f564c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:43.533174 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d5ba5e98-2dc1-4cc3-a48e-0a4ef89f564c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 2a565242-f018-4078-a74c-18c3b8823c51] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:43.540257 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d5ba5e98-2dc1-4cc3-a48e-0a4ef89f564c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:43.540714 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d5ba5e98-2dc1-4cc3-a48e-0a4ef89f564c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:43.541555 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d5ba5e98-2dc1-4cc3-a48e-0a4ef89f564c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:43.542028 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d5ba5e98-2dc1-4cc3-a48e-0a4ef89f564c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:43.557477 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-d5ba5e98-2dc1-4cc3-a48e-0a4ef89f564c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] HTTP exception thrown: Instance 2a565242-f018-4078-a74c-18c3b8823c51 could not be found. Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d5ba5e98-2dc1-4cc3-a48e-0a4ef89f564c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/2a565242-f018-4078-a74c-18c3b8823c51 HTTP/1.1 Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 2a565242-f018-4078-a74c-18c3b8823c51 could not be found. Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '2a565242-f018-4078-a74c-18c3b8823c51'} Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a565242-f018-4078-a74c-18c3b8823c51 could not be found. Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a565242-f018-4078-a74c-18c3b8823c51 could not be found. Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:43.559942 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:43.566564 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:43.566564 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:43.566564 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:43.566564 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:06:43.566564 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:06:43.566564 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a565242-f018-4078-a74c-18c3b8823c51 could not be found. Jul 18 03:06:43.566564 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:43.566564 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d5ba5e98-2dc1-4cc3-a48e-0a4ef89f564c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 404 to user: Instance 2a565242-f018-4078-a74c-18c3b8823c51 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:06:43.566564 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d5ba5e98-2dc1-4cc3-a48e-0a4ef89f564c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/2a565242-f018-4078-a74c-18c3b8823c51" status: 404 len: 111 microversion: 2.1 time: 0.035992 Jul 18 03:06:43.566564 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3146/6310] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:43 2022] GET /compute/v2.1/servers/2a565242-f018-4078-a74c-18c3b8823c51 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:06:43.575602 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-77be53a4-61db-438d-9fdb-b375cafbdf6e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:43.576325 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-77be53a4-61db-438d-9fdb-b375cafbdf6e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:43.582949 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77be53a4-61db-438d-9fdb-b375cafbdf6e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:43.583413 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77be53a4-61db-438d-9fdb-b375cafbdf6e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:43.584266 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77be53a4-61db-438d-9fdb-b375cafbdf6e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:43.584679 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77be53a4-61db-438d-9fdb-b375cafbdf6e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:43.718473 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-77be53a4-61db-438d-9fdb-b375cafbdf6e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:43.726051 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-77be53a4-61db-438d-9fdb-b375cafbdf6e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.154776 Jul 18 03:06:43.726627 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3165/6311] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:43 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:43.788794 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-69ae3dd4-0877-4ebd-b3f4-e95c8319318c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "3a5db53b-d9ed-49e3-80b6-81d1af92080a"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-69ae3dd4-0877-4ebd-b3f4-e95c8319318c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 163 Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: {"server": {"name": 12345, "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "3a5db53b-d9ed-49e3-80b6-81d1af92080a"}]}} Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '3bb0a19f-5b69-48ee-a771-8fd416f92f36', 'flavorRef': '452', 'networks': [{'uuid': '3a5db53b-d9ed-49e3-80b6-81d1af92080a'}]}}} Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise error Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 12345 Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 03:06:43.791791 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 03:06:43.799866 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 03:06:43.799866 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 18 03:06:43.799866 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:43.799866 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:43.799866 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:43.799866 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:43.799866 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:43.799866 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:43.799866 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 03:06:43.799866 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 03:06:43.799866 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 18 03:06:43.799866 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:43.799866 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-69ae3dd4-0877-4ebd-b3f4-e95c8319318c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:06:43.799866 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-69ae3dd4-0877-4ebd-b3f4-e95c8319318c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.009167 Jul 18 03:06:43.799866 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3147/6312] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:06:43 2022] POST /compute/v2.1/servers => generated 127 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 03:06:43.803188 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f9d54c2a-c938-444f-8da3-a8c6d7ab5e48 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:43.803845 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f9d54c2a-c938-444f-8da3-a8c6d7ab5e48 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:43.811209 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f9d54c2a-c938-444f-8da3-a8c6d7ab5e48 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:43.811672 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f9d54c2a-c938-444f-8da3-a8c6d7ab5e48 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:43.812464 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f9d54c2a-c938-444f-8da3-a8c6d7ab5e48 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:43.812914 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f9d54c2a-c938-444f-8da3-a8c6d7ab5e48 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:43.952693 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f9d54c2a-c938-444f-8da3-a8c6d7ab5e48 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:43.960195 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f9d54c2a-c938-444f-8da3-a8c6d7ab5e48 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.161130 Jul 18 03:06:43.960768 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3166/6313] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:43 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:43.977636 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-60f4db16-fb44-4ad6-ba8d-3e8c8bff321c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:43.978270 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-60f4db16-fb44-4ad6-ba8d-3e8c8bff321c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:43.986745 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-60f4db16-fb44-4ad6-ba8d-3e8c8bff321c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:43.987306 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-60f4db16-fb44-4ad6-ba8d-3e8c8bff321c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:43.988099 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-60f4db16-fb44-4ad6-ba8d-3e8c8bff321c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:43.988540 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-60f4db16-fb44-4ad6-ba8d-3e8c8bff321c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:44.123152 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-60f4db16-fb44-4ad6-ba8d-3e8c8bff321c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:44.130886 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-60f4db16-fb44-4ad6-ba8d-3e8c8bff321c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.157132 Jul 18 03:06:44.131454 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3148/6314] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:43 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:45.625628 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-35eb3227-e6a5-446a-bcf5-35cbdc1f85b6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1894580820", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "bcf2a991-f989-4a8c-af80-c8616b01c002", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "3a5db53b-d9ed-49e3-80b6-81d1af92080a"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:06:45.687181 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-35eb3227-e6a5-446a-bcf5-35cbdc1f85b6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] HTTP exception thrown: Block Device bcf2a991-f989-4a8c-af80-c8616b01c002 is not bootable. Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-35eb3227-e6a5-446a-bcf5-35cbdc1f85b6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 358 Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1894580820", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "bcf2a991-f989-4a8c-af80-c8616b01c002", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "3a5db53b-d9ed-49e3-80b6-81d1af92080a"}]}} Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: exception: Block Device bcf2a991-f989-4a8c-af80-c8616b01c002 is not bootable. Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1894580820', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'bcf2a991-f989-4a8c-af80-c8616b01c002'}], 'networks': [{'uuid': '3a5db53b-d9ed-49e3-80b6-81d1af92080a'}]}}} Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1622, in _create_instance Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device bcf2a991-f989-4a8c-af80-c8616b01c002 is not bootable. Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:06:45.702304 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:06:45.707590 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:06:45.707590 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:06:45.707590 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:06:45.707590 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 18 03:06:45.707590 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 18 03:06:45.707590 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 18 03:06:45.707590 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device bcf2a991-f989-4a8c-af80-c8616b01c002 is not bootable. Jul 18 03:06:45.707590 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:45.707590 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:45.707590 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:45.707590 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:45.707590 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:45.707590 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:45.707590 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:06:45.707590 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:06:45.707590 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device bcf2a991-f989-4a8c-af80-c8616b01c002 is not bootable. Jul 18 03:06:45.707590 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:45.707590 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-35eb3227-e6a5-446a-bcf5-35cbdc1f85b6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 400 to user: Block Device bcf2a991-f989-4a8c-af80-c8616b01c002 is not bootable. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:06:45.707590 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-35eb3227-e6a5-446a-bcf5-35cbdc1f85b6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.083369 Jul 18 03:06:45.707590 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3167/6315] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:06:45 2022] POST /compute/v2.1/servers => generated 110 bytes in 85 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 03:06:45.715883 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4200b47c-0bb3-4c1c-b81c-e3552990d4f4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:45.716497 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4200b47c-0bb3-4c1c-b81c-e3552990d4f4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:45.723835 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4200b47c-0bb3-4c1c-b81c-e3552990d4f4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:45.724285 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4200b47c-0bb3-4c1c-b81c-e3552990d4f4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:45.725062 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4200b47c-0bb3-4c1c-b81c-e3552990d4f4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:45.725494 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4200b47c-0bb3-4c1c-b81c-e3552990d4f4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:45.885142 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4200b47c-0bb3-4c1c-b81c-e3552990d4f4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:45.894856 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4200b47c-0bb3-4c1c-b81c-e3552990d4f4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.183463 Jul 18 03:06:45.895507 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3149/6316] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:45 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:45.914894 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ebd363a2-72a3-48ca-b754-92e499cd6236 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:45.915542 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ebd363a2-72a3-48ca-b754-92e499cd6236 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:45.922873 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ebd363a2-72a3-48ca-b754-92e499cd6236 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:45.923341 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ebd363a2-72a3-48ca-b754-92e499cd6236 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:45.924158 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ebd363a2-72a3-48ca-b754-92e499cd6236 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:45.924615 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ebd363a2-72a3-48ca-b754-92e499cd6236 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:46.070001 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ebd363a2-72a3-48ca-b754-92e499cd6236 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:46.079420 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ebd363a2-72a3-48ca-b754-92e499cd6236 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.169765 Jul 18 03:06:46.079931 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3168/6317] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:45 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:47.500194 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d6777f68-74d6-4d69-8f58-4ec6e5217273 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1077465873", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "destination_type": "local"}, {"source_type": "volume", "uuid": "c8b6622a-433b-47b1-913f-52236c6338cb", "destination_type": "invalid"}], "networks": [{"uuid": "3a5db53b-d9ed-49e3-80b6-81d1af92080a"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d6777f68-74d6-4d69-8f58-4ec6e5217273 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 495 Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1077465873", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "destination_type": "local"}, {"source_type": "volume", "uuid": "c8b6622a-433b-47b1-913f-52236c6338cb", "destination_type": "invalid"}], "networks": [{"uuid": "3a5db53b-d9ed-49e3-80b6-81d1af92080a"}]}} Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1077465873', 'imageRef': '3bb0a19f-5b69-48ee-a771-8fd416f92f36', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '3bb0a19f-5b69-48ee-a771-8fd416f92f36', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'c8b6622a-433b-47b1-913f-52236c6338cb', 'destination_type': 'invalid'}], 'networks': [{'uuid': '3a5db53b-d9ed-49e3-80b6-81d1af92080a'}]}}} Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise error Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'invalid' Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:06:47.503154 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:06:47.508069 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:06:47.508069 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:06:47.508069 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 03:06:47.508069 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 03:06:47.508069 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 03:06:47.508069 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 03:06:47.508069 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 03:06:47.508069 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 03:06:47.508069 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 18 03:06:47.508069 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:47.508069 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:47.508069 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:47.508069 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:47.508069 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:47.508069 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:47.508069 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 03:06:47.508069 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 03:06:47.508069 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 18 03:06:47.508069 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:47.508069 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d6777f68-74d6-4d69-8f58-4ec6e5217273 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:06:47.508069 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d6777f68-74d6-4d69-8f58-4ec6e5217273 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.009583 Jul 18 03:06:47.508069 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3150/6318] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:06:47 2022] POST /compute/v2.1/servers => generated 155 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 03:06:47.514151 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7c128f8d-e984-4eec-99f7-81232b8dab5b tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:47.514784 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7c128f8d-e984-4eec-99f7-81232b8dab5b tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:47.521910 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7c128f8d-e984-4eec-99f7-81232b8dab5b tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:47.522399 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7c128f8d-e984-4eec-99f7-81232b8dab5b tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:47.523187 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7c128f8d-e984-4eec-99f7-81232b8dab5b tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:47.523631 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7c128f8d-e984-4eec-99f7-81232b8dab5b tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:47.679121 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7c128f8d-e984-4eec-99f7-81232b8dab5b tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:47.687300 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7c128f8d-e984-4eec-99f7-81232b8dab5b tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.177511 Jul 18 03:06:47.687894 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3169/6319] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:47 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:47.705787 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-288b7cda-fc4e-4845-a249-ee54d2eede2d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:47.706397 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-288b7cda-fc4e-4845-a249-ee54d2eede2d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:47.713297 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-288b7cda-fc4e-4845-a249-ee54d2eede2d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:47.714296 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-288b7cda-fc4e-4845-a249-ee54d2eede2d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:47.715073 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-288b7cda-fc4e-4845-a249-ee54d2eede2d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:47.715510 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-288b7cda-fc4e-4845-a249-ee54d2eede2d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:47.848933 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-288b7cda-fc4e-4845-a249-ee54d2eede2d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:47.856873 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-288b7cda-fc4e-4845-a249-ee54d2eede2d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.155753 Jul 18 03:06:47.857462 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3151/6320] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:47 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:47.913674 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-67395c73-9200-4b96-925a-c425cf0303e2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1160305571", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "3a5db53b-d9ed-49e3-80b6-81d1af92080a"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-67395c73-9200-4b96-925a-c425cf0303e2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 492 Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1160305571", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "3a5db53b-d9ed-49e3-80b6-81d1af92080a"}]}} Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1160305571', 'imageRef': '3bb0a19f-5b69-48ee-a771-8fd416f92f36', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '3a5db53b-d9ed-49e3-80b6-81d1af92080a'}]}}} Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise error Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Jul 18 03:06:47.916319 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Jul 18 03:06:47.921302 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:47.921302 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:47.921302 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:47.921302 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:47.921302 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:47.921302 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:47.921302 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:06:47.921302 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:06:47.921302 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:06:47.921302 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:06:47.921302 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:06:47.921302 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:06:47.921302 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 03:06:47.921302 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 03:06:47.921302 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 03:06:47.921302 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 03:06:47.921302 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 03:06:47.921302 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 03:06:47.921302 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 18 03:06:47.921302 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:47.921302 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:47.921302 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:47.921302 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:47.921302 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:47.921302 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:47.921302 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 03:06:47.921302 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 03:06:47.921302 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 18 03:06:47.921302 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:47.921302 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-67395c73-9200-4b96-925a-c425cf0303e2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:06:47.921302 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-67395c73-9200-4b96-925a-c425cf0303e2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.008551 Jul 18 03:06:47.921302 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3170/6321] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:06:47 2022] POST /compute/v2.1/servers => generated 624 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 03:06:47.926825 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ea724b24-61d1-4e26-89fa-4dd86f27e495 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:47.927444 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ea724b24-61d1-4e26-89fa-4dd86f27e495 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:47.934793 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea724b24-61d1-4e26-89fa-4dd86f27e495 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:47.935246 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea724b24-61d1-4e26-89fa-4dd86f27e495 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:47.936024 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea724b24-61d1-4e26-89fa-4dd86f27e495 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:47.936461 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea724b24-61d1-4e26-89fa-4dd86f27e495 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:48.075640 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ea724b24-61d1-4e26-89fa-4dd86f27e495 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:48.083590 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ea724b24-61d1-4e26-89fa-4dd86f27e495 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.160497 Jul 18 03:06:48.084199 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3152/6322] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:47 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:48.102207 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bac26194-7e2a-4705-a1ff-34076fc7f679 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:48.102828 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bac26194-7e2a-4705-a1ff-34076fc7f679 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:48.110514 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bac26194-7e2a-4705-a1ff-34076fc7f679 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:48.110973 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bac26194-7e2a-4705-a1ff-34076fc7f679 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:48.111750 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bac26194-7e2a-4705-a1ff-34076fc7f679 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:48.112199 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bac26194-7e2a-4705-a1ff-34076fc7f679 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:48.259178 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bac26194-7e2a-4705-a1ff-34076fc7f679 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:48.267372 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bac26194-7e2a-4705-a1ff-34076fc7f679 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.169087 Jul 18 03:06:48.268034 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3171/6323] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:48 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:48.324093 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b51f378c-79a6-4cee-9a49-12353e82c13b tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "3a5db53b-d9ed-49e3-80b6-81d1af92080a"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b51f378c-79a6-4cee-9a49-12353e82c13b tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 416 Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "3a5db53b-d9ed-49e3-80b6-81d1af92080a"}]}} Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '3bb0a19f-5b69-48ee-a771-8fd416f92f36', 'flavorRef': '452', 'networks': [{'uuid': '3a5db53b-d9ed-49e3-80b6-81d1af92080a'}]}}} Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise error Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:48.326437 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:48.331800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:48.331800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:48.331800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:48.331800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:06:48.331800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:06:48.331800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:06:48.331800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:06:48.331800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:06:48.331800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:06:48.331800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 03:06:48.331800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 03:06:48.331800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 03:06:48.331800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 03:06:48.331800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 03:06:48.331800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 03:06:48.331800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 03:06:48.331800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:48.331800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:48.331800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:48.331800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:48.331800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:48.331800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:48.331800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 03:06:48.331800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 03:06:48.331800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 03:06:48.331800 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:48.331800 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b51f378c-79a6-4cee-9a49-12353e82c13b tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:06:48.331800 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b51f378c-79a6-4cee-9a49-12353e82c13b tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.008472 Jul 18 03:06:48.331800 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3153/6324] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:06:48 2022] POST /compute/v2.1/servers => generated 619 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 03:06:48.337580 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-96314afb-22aa-4c14-8edb-509451ef97c3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:48.338248 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-96314afb-22aa-4c14-8edb-509451ef97c3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:48.344736 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-96314afb-22aa-4c14-8edb-509451ef97c3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:48.345201 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-96314afb-22aa-4c14-8edb-509451ef97c3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:48.346043 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-96314afb-22aa-4c14-8edb-509451ef97c3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:48.346497 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-96314afb-22aa-4c14-8edb-509451ef97c3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:48.478660 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-96314afb-22aa-4c14-8edb-509451ef97c3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:48.481293 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=100 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:06:48.487953 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-96314afb-22aa-4c14-8edb-509451ef97c3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.154181 Jul 18 03:06:48.488545 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3172/6325] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:48 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:48.506164 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-58c4c581-e55f-4158-8a00-38784948f558 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:48.506770 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-58c4c581-e55f-4158-8a00-38784948f558 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:48.514657 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-58c4c581-e55f-4158-8a00-38784948f558 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:48.515122 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-58c4c581-e55f-4158-8a00-38784948f558 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:48.515871 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-58c4c581-e55f-4158-8a00-38784948f558 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:48.516309 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-58c4c581-e55f-4158-8a00-38784948f558 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:48.651970 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-58c4c581-e55f-4158-8a00-38784948f558 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:48.659593 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-58c4c581-e55f-4158-8a00-38784948f558 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.157200 Jul 18 03:06:48.660178 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3154/6326] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:48 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:48.716236 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f368eb98-a6d3-447a-bbd7-d9376211a715 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1681210800", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": -1, "networks": [{"uuid": "3a5db53b-d9ed-49e3-80b6-81d1af92080a"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:06:48.728074 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-f368eb98-a6d3-447a-bbd7-d9376211a715 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] HTTP exception thrown: Flavor -1 could not be found. Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f368eb98-a6d3-447a-bbd7-d9376211a715 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 206 Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1681210800", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": -1, "networks": [{"uuid": "3a5db53b-d9ed-49e3-80b6-81d1af92080a"}]}} Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: exception: Flavor -1 could not be found. Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1681210800', 'imageRef': '3bb0a19f-5b69-48ee-a771-8fd416f92f36', 'flavorRef': -1, 'networks': [{'uuid': '3a5db53b-d9ed-49e3-80b6-81d1af92080a'}]}}} Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:06:48.740385 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:06:48.747764 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:06:48.747764 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:06:48.747764 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:06:48.747764 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:06:48.747764 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 18 03:06:48.747764 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 18 03:06:48.747764 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 18 03:06:48.747764 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Jul 18 03:06:48.747764 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:48.747764 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:48.747764 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:48.747764 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:48.747764 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:48.747764 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:48.747764 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:06:48.747764 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:06:48.747764 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Jul 18 03:06:48.747764 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:48.747764 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f368eb98-a6d3-447a-bbd7-d9376211a715 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:06:48.747764 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f368eb98-a6d3-447a-bbd7-d9376211a715 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.030047 Jul 18 03:06:48.747764 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3173/6327] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:06:48 2022] POST /compute/v2.1/servers => generated 73 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 18 03:06:48.752978 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2df3e60b-099e-4be5-82c9-80b20569de64 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:48.753797 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2df3e60b-099e-4be5-82c9-80b20569de64 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:48.761016 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2df3e60b-099e-4be5-82c9-80b20569de64 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:48.761469 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2df3e60b-099e-4be5-82c9-80b20569de64 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:48.762273 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2df3e60b-099e-4be5-82c9-80b20569de64 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:48.762713 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2df3e60b-099e-4be5-82c9-80b20569de64 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:48.901485 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2df3e60b-099e-4be5-82c9-80b20569de64 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:48.909722 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2df3e60b-099e-4be5-82c9-80b20569de64 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.160474 Jul 18 03:06:48.910318 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3155/6328] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:48 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:06:48.927676 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-514053c0-308c-46ac-87d9-8cec3e4f2816 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:48.928326 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-514053c0-308c-46ac-87d9-8cec3e4f2816 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:48.936641 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-514053c0-308c-46ac-87d9-8cec3e4f2816 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:48.937106 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-514053c0-308c-46ac-87d9-8cec3e4f2816 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:48.938003 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-514053c0-308c-46ac-87d9-8cec3e4f2816 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:48.938456 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-514053c0-308c-46ac-87d9-8cec3e4f2816 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:49.078035 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-514053c0-308c-46ac-87d9-8cec3e4f2816 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:49.086033 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-514053c0-308c-46ac-87d9-8cec3e4f2816 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.162182 Jul 18 03:06:49.086625 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3174/6329] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:48 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:49.142186 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0a7721fc-9229-4e77-985e-3f34b269a305 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1907261965", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "3a5db53b-d9ed-49e3-80b6-81d1af92080a"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0a7721fc-9229-4e77-985e-3f34b269a305 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 173 Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1907261965", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "3a5db53b-d9ed-49e3-80b6-81d1af92080a"}]}} Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1907261965', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '3a5db53b-d9ed-49e3-80b6-81d1af92080a'}]}}} Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise error Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi -1 Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 03:06:49.144875 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 03:06:49.150622 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 03:06:49.150622 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 03:06:49.150622 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 18 03:06:49.150622 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:49.150622 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:49.150622 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:49.150622 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:49.150622 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:49.150622 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:49.150622 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 03:06:49.150622 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 03:06:49.150622 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 18 03:06:49.150622 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:49.150622 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0a7721fc-9229-4e77-985e-3f34b269a305 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:06:49.150622 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0a7721fc-9229-4e77-985e-3f34b269a305 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.008217 Jul 18 03:06:49.150622 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3156/6330] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:06:49 2022] POST /compute/v2.1/servers => generated 145 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 03:06:49.155726 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-36c92c19-d19c-4e2c-b755-9e7c7607d331 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:49.156368 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-36c92c19-d19c-4e2c-b755-9e7c7607d331 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:49.163235 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-36c92c19-d19c-4e2c-b755-9e7c7607d331 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:49.163703 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-36c92c19-d19c-4e2c-b755-9e7c7607d331 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:49.164525 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-36c92c19-d19c-4e2c-b755-9e7c7607d331 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:49.164985 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-36c92c19-d19c-4e2c-b755-9e7c7607d331 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:49.314419 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-36c92c19-d19c-4e2c-b755-9e7c7607d331 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:49.322269 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-36c92c19-d19c-4e2c-b755-9e7c7607d331 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.170730 Jul 18 03:06:49.322865 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3175/6331] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:49 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:49.341394 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-20d99c70-78d0-4ea2-b4ea-e1314f12e687 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:49.342040 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-20d99c70-78d0-4ea2-b4ea-e1314f12e687 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:49.349131 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-20d99c70-78d0-4ea2-b4ea-e1314f12e687 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:49.349588 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-20d99c70-78d0-4ea2-b4ea-e1314f12e687 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:49.350397 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-20d99c70-78d0-4ea2-b4ea-e1314f12e687 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:49.350840 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-20d99c70-78d0-4ea2-b4ea-e1314f12e687 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:49.491273 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-20d99c70-78d0-4ea2-b4ea-e1314f12e687 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:49.501454 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-20d99c70-78d0-4ea2-b4ea-e1314f12e687 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.164438 Jul 18 03:06:49.501895 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3157/6332] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:49 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:49.557451 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-998e7439-7397-4bdc-b345-2d649314604e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1502756785", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:06:49.561960 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-998e7439-7397-4bdc-b345-2d649314604e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-998e7439-7397-4bdc-b345-2d649314604e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 216 Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1502756785", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1502756785', 'imageRef': '3bb0a19f-5b69-48ee-a771-8fd416f92f36', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._validate_network_id( Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:49.563516 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:49.568722 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:49.568722 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:49.568722 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:49.568722 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:06:49.568722 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:06:49.568722 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 18 03:06:49.568722 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:49.568722 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-998e7439-7397-4bdc-b345-2d649314604e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:06:49.568722 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-998e7439-7397-4bdc-b345-2d649314604e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.011687 Jul 18 03:06:49.569587 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3176/6333] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:06:49 2022] POST /compute/v2.1/servers => generated 123 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 03:06:49.574821 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c481fca4-a049-44ea-9341-80d4620fbb5f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:49.575508 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c481fca4-a049-44ea-9341-80d4620fbb5f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:49.582213 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c481fca4-a049-44ea-9341-80d4620fbb5f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:49.582664 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c481fca4-a049-44ea-9341-80d4620fbb5f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:49.583446 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c481fca4-a049-44ea-9341-80d4620fbb5f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:49.583901 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c481fca4-a049-44ea-9341-80d4620fbb5f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:49.733871 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c481fca4-a049-44ea-9341-80d4620fbb5f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:49.742489 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c481fca4-a049-44ea-9341-80d4620fbb5f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.171976 Jul 18 03:06:49.743106 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3158/6334] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:49 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:49.762414 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-89510d94-0b9f-4a8d-b9f0-c7ed19a2329f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:49.763045 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-89510d94-0b9f-4a8d-b9f0-c7ed19a2329f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:49.770730 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-89510d94-0b9f-4a8d-b9f0-c7ed19a2329f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:49.771201 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-89510d94-0b9f-4a8d-b9f0-c7ed19a2329f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:49.772007 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-89510d94-0b9f-4a8d-b9f0-c7ed19a2329f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:49.772458 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-89510d94-0b9f-4a8d-b9f0-c7ed19a2329f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:49.912755 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-89510d94-0b9f-4a8d-b9f0-c7ed19a2329f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:49.921324 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-89510d94-0b9f-4a8d-b9f0-c7ed19a2329f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.163709 Jul 18 03:06:49.921938 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3177/6335] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:49 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:49.977003 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d30bd3f8-6d78-4207-8874-5c87d8fc90ee tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1645615038", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "key_name": "tempest-key-2008829373", "networks": [{"uuid": "3a5db53b-d9ed-49e3-80b6-81d1af92080a"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:06:50.035350 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-d30bd3f8-6d78-4207-8874-5c87d8fc90ee tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] validate_networks() for [('3a5db53b-d9ed-49e3-80b6-81d1af92080a', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:06:50.224431 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-d30bd3f8-6d78-4207-8874-5c87d8fc90ee tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] HTTP exception thrown: Invalid key_name provided. Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d30bd3f8-6d78-4207-8874-5c87d8fc90ee tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 247 Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1645615038", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "key_name": "tempest-key-2008829373", "networks": [{"uuid": "3a5db53b-d9ed-49e3-80b6-81d1af92080a"}]}} Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: exception: Invalid key_name provided. Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1645615038', 'imageRef': '3bb0a19f-5b69-48ee-a771-8fd416f92f36', 'flavorRef': '452', 'key_name': 'tempest-key-2008829373', 'networks': [{'uuid': '3a5db53b-d9ed-49e3-80b6-81d1af92080a'}]}}} Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1075, in _validate_and_build_base_options Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-2008829373 not found for user 290e0074b3c74da2acc07f86338760ac Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:50.226601 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:50.232195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:50.232195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:06:50.232195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:06:50.232195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:06:50.232195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:06:50.232195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:06:50.232195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:06:50.232195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:06:50.232195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:06:50.232195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:06:50.232195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:06:50.232195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 18 03:06:50.232195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Jul 18 03:06:50.232195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 18 03:06:50.232195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Jul 18 03:06:50.232195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:50.232195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:50.232195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:50.232195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:50.232195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:50.232195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:50.232195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:06:50.232195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:06:50.232195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Jul 18 03:06:50.232195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:50.232195 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d30bd3f8-6d78-4207-8874-5c87d8fc90ee tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 400 to user: Invalid key_name provided. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:06:50.232195 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d30bd3f8-6d78-4207-8874-5c87d8fc90ee tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.255241 Jul 18 03:06:50.232195 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3159/6336] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:06:49 2022] POST /compute/v2.1/servers => generated 70 bytes in 257 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 18 03:06:50.238102 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-35d0863c-7fd1-409e-bf07-464a3c51f012 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:50.238739 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-35d0863c-7fd1-409e-bf07-464a3c51f012 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:50.246083 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-35d0863c-7fd1-409e-bf07-464a3c51f012 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:50.246554 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-35d0863c-7fd1-409e-bf07-464a3c51f012 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:50.247633 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-35d0863c-7fd1-409e-bf07-464a3c51f012 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:50.248077 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-35d0863c-7fd1-409e-bf07-464a3c51f012 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:50.382481 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-35d0863c-7fd1-409e-bf07-464a3c51f012 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:50.390630 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-35d0863c-7fd1-409e-bf07-464a3c51f012 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.156348 Jul 18 03:06:50.391230 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3178/6337] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:50 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:50.408756 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5f6e3df9-8f9f-41f2-a7b5-c19ab0939ce1 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:50.409374 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5f6e3df9-8f9f-41f2-a7b5-c19ab0939ce1 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:50.415770 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5f6e3df9-8f9f-41f2-a7b5-c19ab0939ce1 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:50.416230 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5f6e3df9-8f9f-41f2-a7b5-c19ab0939ce1 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:50.418260 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5f6e3df9-8f9f-41f2-a7b5-c19ab0939ce1 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:50.418711 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5f6e3df9-8f9f-41f2-a7b5-c19ab0939ce1 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:50.557311 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5f6e3df9-8f9f-41f2-a7b5-c19ab0939ce1 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:50.565124 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5f6e3df9-8f9f-41f2-a7b5-c19ab0939ce1 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.160239 Jul 18 03:06:50.565711 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3160/6338] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:50 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:50.624772 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-72f859f1-b64b-4ed8-b0b3-06371ba3c2c8 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-894731213", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "3a5db53b-d9ed-49e3-80b6-81d1af92080a"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:06:50.715806 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.security_group_api [None req-72f859f1-b64b-4ed8-b0b3-06371ba3c2c8 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Neutron security group does_not_exist not found {{(pid=119543) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Jul 18 03:06:50.716455 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-72f859f1-b64b-4ed8-b0b3-06371ba3c2c8 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-72f859f1-b64b-4ed8-b0b3-06371ba3c2c8 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 257 Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-894731213", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "3a5db53b-d9ed-49e3-80b6-81d1af92080a"}]}} Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: exception: Unable to find security_group with name or id 'does_not_exist' Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-894731213', 'imageRef': '3bb0a19f-5b69-48ee-a771-8fd416f92f36', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '3a5db53b-d9ed-49e3-80b6-81d1af92080a'}]}}} Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Jul 18 03:06:50.755595 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1060, in _validate_and_build_base_options Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 507, in _check_requested_secgroups Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:50.765013 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-72f859f1-b64b-4ed8-b0b3-06371ba3c2c8 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:06:50.773960 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-72f859f1-b64b-4ed8-b0b3-06371ba3c2c8 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.137212 Jul 18 03:06:50.773960 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3179/6339] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:06:50 2022] POST /compute/v2.1/servers => generated 106 bytes in 138 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 03:06:50.774313 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1cb15400-1ed2-4713-a96a-06be5475283d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:50.774313 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1cb15400-1ed2-4713-a96a-06be5475283d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:50.779620 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1cb15400-1ed2-4713-a96a-06be5475283d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:50.780069 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1cb15400-1ed2-4713-a96a-06be5475283d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:50.780836 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1cb15400-1ed2-4713-a96a-06be5475283d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:50.781272 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1cb15400-1ed2-4713-a96a-06be5475283d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:50.922054 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1cb15400-1ed2-4713-a96a-06be5475283d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:50.931838 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1cb15400-1ed2-4713-a96a-06be5475283d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.168337 Jul 18 03:06:50.933841 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3161/6340] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:50 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:50.954469 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8381b520-eeeb-4916-9200-8c91cc56a7b4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:50.955124 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8381b520-eeeb-4916-9200-8c91cc56a7b4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:50.961776 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8381b520-eeeb-4916-9200-8c91cc56a7b4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:50.962253 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8381b520-eeeb-4916-9200-8c91cc56a7b4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:50.963108 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8381b520-eeeb-4916-9200-8c91cc56a7b4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:50.963605 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8381b520-eeeb-4916-9200-8c91cc56a7b4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:51.381875 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8381b520-eeeb-4916-9200-8c91cc56a7b4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:51.391059 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8381b520-eeeb-4916-9200-8c91cc56a7b4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.444432 Jul 18 03:06:51.391651 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3180/6341] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:50 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:51.412635 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c9e6fbce-3755-43c4-ad36-1e3ec8cf21e5 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:51.413169 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c9e6fbce-3755-43c4-ad36-1e3ec8cf21e5 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: c4dc9ab7-6cfe-46ba-b200-303fc7448ada] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:51.420912 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-c9e6fbce-3755-43c4-ad36-1e3ec8cf21e5 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] HTTP exception thrown: Instance c4dc9ab7-6cfe-46ba-b200-303fc7448ada could not be found. Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c9e6fbce-3755-43c4-ad36-1e3ec8cf21e5 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/servers/c4dc9ab7-6cfe-46ba-b200-303fc7448ada HTTP/1.1 Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance c4dc9ab7-6cfe-46ba-b200-303fc7448ada could not be found. Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'c4dc9ab7-6cfe-46ba-b200-303fc7448ada'} Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4dc9ab7-6cfe-46ba-b200-303fc7448ada could not be found. Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4dc9ab7-6cfe-46ba-b200-303fc7448ada could not be found. Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:51.422550 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:51.427227 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:51.427227 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:51.427227 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:51.427227 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:06:51.427227 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:06:51.427227 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4dc9ab7-6cfe-46ba-b200-303fc7448ada could not be found. Jul 18 03:06:51.427227 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:51.427227 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c9e6fbce-3755-43c4-ad36-1e3ec8cf21e5 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 404 to user: Instance c4dc9ab7-6cfe-46ba-b200-303fc7448ada could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:06:51.427227 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c9e6fbce-3755-43c4-ad36-1e3ec8cf21e5 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c4dc9ab7-6cfe-46ba-b200-303fc7448ada" status: 404 len: 111 microversion: 2.1 time: 0.018468 Jul 18 03:06:51.427227 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3162/6342] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:06:51 2022] DELETE /compute/v2.1/servers/c4dc9ab7-6cfe-46ba-b200-303fc7448ada => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:06:51.440739 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f097e526-52ee-441f-bbbd-cb12eebc8a5c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:51.441920 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f097e526-52ee-441f-bbbd-cb12eebc8a5c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:51.453559 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f097e526-52ee-441f-bbbd-cb12eebc8a5c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:51.455202 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f097e526-52ee-441f-bbbd-cb12eebc8a5c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:51.455930 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f097e526-52ee-441f-bbbd-cb12eebc8a5c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:51.456586 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f097e526-52ee-441f-bbbd-cb12eebc8a5c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:51.629930 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f097e526-52ee-441f-bbbd-cb12eebc8a5c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:51.639840 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f097e526-52ee-441f-bbbd-cb12eebc8a5c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.208338 Jul 18 03:06:51.640448 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3181/6343] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:51 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:06:51.658428 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-14228d69-cb67-4de0-9ccc-5735aaddd258 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:51.659352 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-14228d69-cb67-4de0-9ccc-5735aaddd258 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:51.667994 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-14228d69-cb67-4de0-9ccc-5735aaddd258 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:51.668445 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-14228d69-cb67-4de0-9ccc-5735aaddd258 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:51.669412 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-14228d69-cb67-4de0-9ccc-5735aaddd258 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:51.669880 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-14228d69-cb67-4de0-9ccc-5735aaddd258 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:51.810914 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-14228d69-cb67-4de0-9ccc-5735aaddd258 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:51.818686 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-14228d69-cb67-4de0-9ccc-5735aaddd258 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.164829 Jul 18 03:06:51.819279 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3163/6344] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:51 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:51.835644 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-09096496-ae05-4c2d-94b5-091f1699c98c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:51.836264 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-09096496-ae05-4c2d-94b5-091f1699c98c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Failed to fetch instance by id 9223372036854775808 {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 18 03:06:51.836647 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-09096496-ae05-4c2d-94b5-091f1699c98c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-09096496-ae05-4c2d-94b5-091f1699c98c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 9223372036854775808 could not be found. Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '9223372036854775808'} Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:51.838175 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:51.844636 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:51.844636 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:06:51.844636 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:06:51.844636 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Jul 18 03:06:51.844636 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:51.844636 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-09096496-ae05-4c2d-94b5-091f1699c98c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:06:51.844636 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-09096496-ae05-4c2d-94b5-091f1699c98c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.008173 Jul 18 03:06:51.844636 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3182/6345] 10.222.0.57 () {58 vars in 1187 bytes} [Mon Jul 18 03:06:51 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 9 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 03:06:51.849026 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8de6d5d3-e4bf-4d44-ac31-00feadcd7985 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:51.849642 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8de6d5d3-e4bf-4d44-ac31-00feadcd7985 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:51.857278 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8de6d5d3-e4bf-4d44-ac31-00feadcd7985 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:51.857802 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8de6d5d3-e4bf-4d44-ac31-00feadcd7985 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:51.858702 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8de6d5d3-e4bf-4d44-ac31-00feadcd7985 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:51.859145 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8de6d5d3-e4bf-4d44-ac31-00feadcd7985 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:51.995103 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8de6d5d3-e4bf-4d44-ac31-00feadcd7985 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:52.003329 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8de6d5d3-e4bf-4d44-ac31-00feadcd7985 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.158381 Jul 18 03:06:52.003925 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3164/6346] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:51 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:52.022050 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2ccd41ff-5d4e-43dc-82d4-2cd729b0727e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:52.022682 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2ccd41ff-5d4e-43dc-82d4-2cd729b0727e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:52.030995 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2ccd41ff-5d4e-43dc-82d4-2cd729b0727e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:52.031461 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2ccd41ff-5d4e-43dc-82d4-2cd729b0727e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:52.032256 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2ccd41ff-5d4e-43dc-82d4-2cd729b0727e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:52.032715 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2ccd41ff-5d4e-43dc-82d4-2cd729b0727e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:52.171257 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2ccd41ff-5d4e-43dc-82d4-2cd729b0727e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:52.179505 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2ccd41ff-5d4e-43dc-82d4-2cd729b0727e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.162071 Jul 18 03:06:52.180107 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3183/6347] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:52 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:52.197324 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1e8ba585-61be-4eab-a87a-7067b4caf27d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:52.197727 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1e8ba585-61be-4eab-a87a-7067b4caf27d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Failed to fetch instance by id -1 {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 18 03:06:52.198931 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-1e8ba585-61be-4eab-a87a-7067b4caf27d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] HTTP exception thrown: Instance -1 could not be found. Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1e8ba585-61be-4eab-a87a-7067b4caf27d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance -1 could not be found. Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '-1'} Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:52.200688 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:52.207466 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:06:52.207466 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:06:52.207466 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Jul 18 03:06:52.207466 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:52.207466 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1e8ba585-61be-4eab-a87a-7067b4caf27d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 404 to user: Instance -1 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:06:52.207466 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1e8ba585-61be-4eab-a87a-7067b4caf27d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.009832 Jul 18 03:06:52.207466 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3165/6348] 10.222.0.57 () {58 vars in 1136 bytes} [Mon Jul 18 03:06:52 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 18 03:06:52.214066 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-174c0c4b-7d21-46c4-b9d0-d3070635ea2a tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:52.214716 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-174c0c4b-7d21-46c4-b9d0-d3070635ea2a tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:52.221361 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-174c0c4b-7d21-46c4-b9d0-d3070635ea2a tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:52.221923 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-174c0c4b-7d21-46c4-b9d0-d3070635ea2a tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:52.222738 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-174c0c4b-7d21-46c4-b9d0-d3070635ea2a tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:52.223199 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-174c0c4b-7d21-46c4-b9d0-d3070635ea2a tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:52.369212 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-174c0c4b-7d21-46c4-b9d0-d3070635ea2a tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:52.378657 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-174c0c4b-7d21-46c4-b9d0-d3070635ea2a tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.168610 Jul 18 03:06:52.379259 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3184/6349] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:52 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:06:52.397500 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b398fb15-9556-4c3f-927a-293f837e3b13 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:52.398144 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b398fb15-9556-4c3f-927a-293f837e3b13 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:52.400125 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:06:52.408219 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b398fb15-9556-4c3f-927a-293f837e3b13 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:52.408692 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b398fb15-9556-4c3f-927a-293f837e3b13 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:52.409467 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b398fb15-9556-4c3f-927a-293f837e3b13 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:52.409955 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b398fb15-9556-4c3f-927a-293f837e3b13 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:52.556315 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b398fb15-9556-4c3f-927a-293f837e3b13 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:52.559553 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:06:52.566991 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b398fb15-9556-4c3f-927a-293f837e3b13 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.173275 Jul 18 03:06:52.567577 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3166/6350] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:52 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:52.584105 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-59015a2b-e919-4bad-a0ed-579aab34d65e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:06:52.584668 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-59015a2b-e919-4bad-a0ed-579aab34d65e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 4f9f0347-6983-4b15-83f3-164e9a3aefa6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:52.591051 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-59015a2b-e919-4bad-a0ed-579aab34d65e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] HTTP exception thrown: Instance 4f9f0347-6983-4b15-83f3-164e9a3aefa6 could not be found. Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-59015a2b-e919-4bad-a0ed-579aab34d65e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/servers/4f9f0347-6983-4b15-83f3-164e9a3aefa6/action HTTP/1.1 Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 19 Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: {"forceDelete": {}} Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 4f9f0347-6983-4b15-83f3-164e9a3aefa6 could not be found. Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '4f9f0347-6983-4b15-83f3-164e9a3aefa6', 'body': {'forceDelete': {}}} Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f9f0347-6983-4b15-83f3-164e9a3aefa6 could not be found. Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f9f0347-6983-4b15-83f3-164e9a3aefa6 could not be found. Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:52.596577 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:52.602495 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:06:52.602495 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:06:52.602495 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f9f0347-6983-4b15-83f3-164e9a3aefa6 could not be found. Jul 18 03:06:52.602495 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:52.602495 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-59015a2b-e919-4bad-a0ed-579aab34d65e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 404 to user: Instance 4f9f0347-6983-4b15-83f3-164e9a3aefa6 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:06:52.602495 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-59015a2b-e919-4bad-a0ed-579aab34d65e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "POST /compute/v2.1/servers/4f9f0347-6983-4b15-83f3-164e9a3aefa6/action" status: 404 len: 111 microversion: 2.1 time: 0.017932 Jul 18 03:06:52.602495 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3185/6351] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:06:52 2022] POST /compute/v2.1/servers/4f9f0347-6983-4b15-83f3-164e9a3aefa6/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:06:52.608314 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4e5112df-1fae-4dad-bdb1-c3f5c9705806 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:52.608943 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4e5112df-1fae-4dad-bdb1-c3f5c9705806 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:52.616441 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e5112df-1fae-4dad-bdb1-c3f5c9705806 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:52.616987 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e5112df-1fae-4dad-bdb1-c3f5c9705806 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:52.617878 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e5112df-1fae-4dad-bdb1-c3f5c9705806 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:52.618325 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e5112df-1fae-4dad-bdb1-c3f5c9705806 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:52.721477 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-85c3bc91-d371-477a-b74f-376a12e619ca tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:06:52.722529 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-85c3bc91-d371-477a-b74f-376a12e619ca tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: 428669f8-ae42-4320-b8b7-8d79c51a67ac] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:52.730586 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85c3bc91-d371-477a-b74f-376a12e619ca tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:52.731058 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85c3bc91-d371-477a-b74f-376a12e619ca tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:52.731875 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85c3bc91-d371-477a-b74f-376a12e619ca tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:52.732323 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85c3bc91-d371-477a-b74f-376a12e619ca tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:52.775648 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4e5112df-1fae-4dad-bdb1-c3f5c9705806 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:52.784839 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4e5112df-1fae-4dad-bdb1-c3f5c9705806 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.181683 Jul 18 03:06:52.785420 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3167/6352] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:52 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:52.802361 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-85c3bc91-d371-477a-b74f-376a12e619ca tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "POST /compute/v2.1/servers/428669f8-ae42-4320-b8b7-8d79c51a67ac/action" status: 200 len: 32631 microversion: 2.1 time: 0.084910 Jul 18 03:06:52.802775 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bff228b4-c3e6-43fe-a31c-4cb45038df5f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:52.803271 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3186/6353] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:06:52 2022] POST /compute/v2.1/servers/428669f8-ae42-4320-b8b7-8d79c51a67ac/action => generated 32631 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 03:06:52.803458 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bff228b4-c3e6-43fe-a31c-4cb45038df5f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:52.810070 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bff228b4-c3e6-43fe-a31c-4cb45038df5f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:52.810514 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bff228b4-c3e6-43fe-a31c-4cb45038df5f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:52.811282 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bff228b4-c3e6-43fe-a31c-4cb45038df5f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:52.811885 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bff228b4-c3e6-43fe-a31c-4cb45038df5f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:52.952078 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bff228b4-c3e6-43fe-a31c-4cb45038df5f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:52.960336 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bff228b4-c3e6-43fe-a31c-4cb45038df5f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.161414 Jul 18 03:06:52.960918 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3168/6354] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:52 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:52.978466 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-efa4893f-7592-409c-8f9b-a554ba4cf155 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:06:52.980103 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-efa4893f-7592-409c-8f9b-a554ba4cf155 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 694cd1cb-4eb1-46d7-9278-3e5e023f92f6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:52.986637 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-efa4893f-7592-409c-8f9b-a554ba4cf155 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] HTTP exception thrown: Instance 694cd1cb-4eb1-46d7-9278-3e5e023f92f6 could not be found. Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-efa4893f-7592-409c-8f9b-a554ba4cf155 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/servers/694cd1cb-4eb1-46d7-9278-3e5e023f92f6/action HTTP/1.1 Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 39 Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: {"os-getConsoleOutput": {"length": 10}} Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 694cd1cb-4eb1-46d7-9278-3e5e023f92f6 could not be found. Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '694cd1cb-4eb1-46d7-9278-3e5e023f92f6', 'body': {'os-getConsoleOutput': {'length': 10}}} Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 694cd1cb-4eb1-46d7-9278-3e5e023f92f6 could not be found. Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 694cd1cb-4eb1-46d7-9278-3e5e023f92f6 could not be found. Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:52.990934 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:52.997164 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:52.997164 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:52.997164 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:06:52.997164 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:06:52.997164 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 694cd1cb-4eb1-46d7-9278-3e5e023f92f6 could not be found. Jul 18 03:06:52.997164 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:52.997164 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-efa4893f-7592-409c-8f9b-a554ba4cf155 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 404 to user: Instance 694cd1cb-4eb1-46d7-9278-3e5e023f92f6 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:06:52.997164 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-efa4893f-7592-409c-8f9b-a554ba4cf155 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "POST /compute/v2.1/servers/694cd1cb-4eb1-46d7-9278-3e5e023f92f6/action" status: 404 len: 111 microversion: 2.1 time: 0.018450 Jul 18 03:06:52.997164 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3187/6355] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:06:52 2022] POST /compute/v2.1/servers/694cd1cb-4eb1-46d7-9278-3e5e023f92f6/action => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:06:53.002588 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7a1551fc-3f5d-46f1-bd3d-1560a7b023c5 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:53.003323 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7a1551fc-3f5d-46f1-bd3d-1560a7b023c5 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:53.009771 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7a1551fc-3f5d-46f1-bd3d-1560a7b023c5 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:53.010264 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7a1551fc-3f5d-46f1-bd3d-1560a7b023c5 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:53.011387 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7a1551fc-3f5d-46f1-bd3d-1560a7b023c5 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:53.011844 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7a1551fc-3f5d-46f1-bd3d-1560a7b023c5 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:53.243536 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7a1551fc-3f5d-46f1-bd3d-1560a7b023c5 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:53.251826 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7a1551fc-3f5d-46f1-bd3d-1560a7b023c5 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.253098 Jul 18 03:06:53.252420 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3169/6356] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:52 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:53.270041 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fa81b152-9d14-4850-9d49-439212e4c5e8 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:53.270787 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fa81b152-9d14-4850-9d49-439212e4c5e8 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:53.279894 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fa81b152-9d14-4850-9d49-439212e4c5e8 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:53.280355 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fa81b152-9d14-4850-9d49-439212e4c5e8 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:53.281186 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fa81b152-9d14-4850-9d49-439212e4c5e8 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:53.281635 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fa81b152-9d14-4850-9d49-439212e4c5e8 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:53.491444 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fa81b152-9d14-4850-9d49-439212e4c5e8 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:53.500343 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fa81b152-9d14-4850-9d49-439212e4c5e8 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.234195 Jul 18 03:06:53.500948 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3188/6357] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:53 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:53.518563 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1e9d58f3-b1c2-4064-9559-2a4185e4bd01 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:53.519390 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1e9d58f3-b1c2-4064-9559-2a4185e4bd01 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: fe2b59a9-083a-49ec-a4a8-cfa313789ef1] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:53.525665 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-1e9d58f3-b1c2-4064-9559-2a4185e4bd01 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] HTTP exception thrown: Instance fe2b59a9-083a-49ec-a4a8-cfa313789ef1 could not be found. Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1e9d58f3-b1c2-4064-9559-2a4185e4bd01 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/fe2b59a9-083a-49ec-a4a8-cfa313789ef1 HTTP/1.1 Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance fe2b59a9-083a-49ec-a4a8-cfa313789ef1 could not be found. Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'fe2b59a9-083a-49ec-a4a8-cfa313789ef1'} Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe2b59a9-083a-49ec-a4a8-cfa313789ef1 could not be found. Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe2b59a9-083a-49ec-a4a8-cfa313789ef1 could not be found. Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:53.527868 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:53.533266 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:53.533266 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:06:53.533266 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:06:53.533266 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe2b59a9-083a-49ec-a4a8-cfa313789ef1 could not be found. Jul 18 03:06:53.533266 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:53.533266 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1e9d58f3-b1c2-4064-9559-2a4185e4bd01 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 404 to user: Instance fe2b59a9-083a-49ec-a4a8-cfa313789ef1 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:06:53.533266 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1e9d58f3-b1c2-4064-9559-2a4185e4bd01 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/fe2b59a9-083a-49ec-a4a8-cfa313789ef1" status: 404 len: 111 microversion: 2.1 time: 0.015301 Jul 18 03:06:53.533266 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3170/6358] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:53 2022] GET /compute/v2.1/servers/fe2b59a9-083a-49ec-a4a8-cfa313789ef1 => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 03:06:53.540239 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-628f7e4d-edec-46f0-b26d-a8aa6bf908d0 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:53.540878 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-628f7e4d-edec-46f0-b26d-a8aa6bf908d0 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:53.549260 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-628f7e4d-edec-46f0-b26d-a8aa6bf908d0 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:53.549751 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-628f7e4d-edec-46f0-b26d-a8aa6bf908d0 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:53.550587 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-628f7e4d-edec-46f0-b26d-a8aa6bf908d0 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:53.551040 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-628f7e4d-edec-46f0-b26d-a8aa6bf908d0 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:53.802738 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-628f7e4d-edec-46f0-b26d-a8aa6bf908d0 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:53.811609 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-628f7e4d-edec-46f0-b26d-a8aa6bf908d0 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.275957 Jul 18 03:06:53.812296 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3189/6359] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:53 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:53.830677 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5edbbd41-3254-4c67-b2fb-159dc13b8c95 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:53.831287 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5edbbd41-3254-4c67-b2fb-159dc13b8c95 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:53.838478 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5edbbd41-3254-4c67-b2fb-159dc13b8c95 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:53.838927 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5edbbd41-3254-4c67-b2fb-159dc13b8c95 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:53.839705 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5edbbd41-3254-4c67-b2fb-159dc13b8c95 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:53.840138 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5edbbd41-3254-4c67-b2fb-159dc13b8c95 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:54.049598 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5edbbd41-3254-4c67-b2fb-159dc13b8c95 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:54.058446 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5edbbd41-3254-4c67-b2fb-159dc13b8c95 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.232550 Jul 18 03:06:54.059037 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3171/6360] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:53 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:54.117301 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1836b0eb-a984-4508-a116-c087ea176454 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1307142077", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "3a5db53b-d9ed-49e3-80b6-81d1af92080a"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1836b0eb-a984-4508-a116-c087ea176454 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 238 Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1307142077", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "3a5db53b-d9ed-49e3-80b6-81d1af92080a"}]}} Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1307142077', 'imageRef': '3bb0a19f-5b69-48ee-a771-8fd416f92f36', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '3a5db53b-d9ed-49e3-80b6-81d1af92080a'}]}}} Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise error Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 03:06:54.120828 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 03:06:54.126336 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 03:06:54.126336 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 03:06:54.126336 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 18 03:06:54.126336 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:54.126336 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:54.126336 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:54.126336 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:54.126336 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:54.126336 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:54.126336 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 03:06:54.126336 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 03:06:54.126336 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 18 03:06:54.126336 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:54.126336 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1836b0eb-a984-4508-a116-c087ea176454 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:06:54.126336 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1836b0eb-a984-4508-a116-c087ea176454 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.010606 Jul 18 03:06:54.126336 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3190/6361] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:06:54 2022] POST /compute/v2.1/servers => generated 139 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 03:06:54.134140 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-74f02764-1096-42d7-a533-7ab73732aabc tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:54.134758 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-74f02764-1096-42d7-a533-7ab73732aabc tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:54.140842 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74f02764-1096-42d7-a533-7ab73732aabc tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:54.141290 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74f02764-1096-42d7-a533-7ab73732aabc tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:54.142170 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74f02764-1096-42d7-a533-7ab73732aabc tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:54.142543 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74f02764-1096-42d7-a533-7ab73732aabc tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:54.245467 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9ab71428-0d7d-4fee-8197-ef9caae6eaa0 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:54.246047 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9ab71428-0d7d-4fee-8197-ef9caae6eaa0 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: 428669f8-ae42-4320-b8b7-8d79c51a67ac] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:54.253746 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9ab71428-0d7d-4fee-8197-ef9caae6eaa0 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:54.254233 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9ab71428-0d7d-4fee-8197-ef9caae6eaa0 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:54.255589 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9ab71428-0d7d-4fee-8197-ef9caae6eaa0 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:54.256236 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9ab71428-0d7d-4fee-8197-ef9caae6eaa0 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:54.285945 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9ab71428-0d7d-4fee-8197-ef9caae6eaa0 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: 428669f8-ae42-4320-b8b7-8d79c51a67ac] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:06:54.359896 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-74f02764-1096-42d7-a533-7ab73732aabc tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:54.380905 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-74f02764-1096-42d7-a533-7ab73732aabc tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.247308 Jul 18 03:06:54.383992 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3172/6362] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:54 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:54.391732 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9ab71428-0d7d-4fee-8197-ef9caae6eaa0 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "DELETE /compute/v2.1/servers/428669f8-ae42-4320-b8b7-8d79c51a67ac" status: 204 len: 0 microversion: 2.1 time: 0.150413 Jul 18 03:06:54.392528 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3191/6363] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:06:54 2022] DELETE /compute/v2.1/servers/428669f8-ae42-4320-b8b7-8d79c51a67ac => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 03:06:54.393893 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-695ea11e-ec6d-4c31-928f-5f1897a35785 req-b02fac36-d37e-4531-a368-c4c32cf924bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "428669f8-ae42-4320-b8b7-8d79c51a67ac", "tag": "6e0694c6-64d7-4519-9df3-63d7745badb5"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:06:54.404902 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-622a3a5d-3ec5-4f04-9161-39c69e0625bc tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:54.405635 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-622a3a5d-3ec5-4f04-9161-39c69e0625bc tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:54.410824 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-695ea11e-ec6d-4c31-928f-5f1897a35785 req-b02fac36-d37e-4531-a368-c4c32cf924bb service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:54.411632 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-695ea11e-ec6d-4c31-928f-5f1897a35785 req-b02fac36-d37e-4531-a368-c4c32cf924bb service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:54.411877 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-622a3a5d-3ec5-4f04-9161-39c69e0625bc tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:54.412342 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-622a3a5d-3ec5-4f04-9161-39c69e0625bc tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:54.413130 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-622a3a5d-3ec5-4f04-9161-39c69e0625bc tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:54.413576 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-622a3a5d-3ec5-4f04-9161-39c69e0625bc tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:54.434906 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-695ea11e-ec6d-4c31-928f-5f1897a35785 req-b02fac36-d37e-4531-a368-c4c32cf924bb service nova] Creating event network-changed:6e0694c6-64d7-4519-9df3-63d7745badb5 for instance 428669f8-ae42-4320-b8b7-8d79c51a67ac on n-h1-465891-3 Jul 18 03:06:54.443558 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-695ea11e-ec6d-4c31-928f-5f1897a35785 req-b02fac36-d37e-4531-a368-c4c32cf924bb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057019 Jul 18 03:06:54.444646 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3173/6364] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:06:54.454334 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d1155f6a-f9fb-4451-8491-0dcc18beb264 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:54.455919 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d1155f6a-f9fb-4451-8491-0dcc18beb264 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: 428669f8-ae42-4320-b8b7-8d79c51a67ac] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:54.468157 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d1155f6a-f9fb-4451-8491-0dcc18beb264 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:54.469462 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d1155f6a-f9fb-4451-8491-0dcc18beb264 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:54.471142 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d1155f6a-f9fb-4451-8491-0dcc18beb264 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:54.472132 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d1155f6a-f9fb-4451-8491-0dcc18beb264 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:54.613660 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-622a3a5d-3ec5-4f04-9161-39c69e0625bc tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:54.624808 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-622a3a5d-3ec5-4f04-9161-39c69e0625bc tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.227587 Jul 18 03:06:54.625817 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3192/6365] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:54 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:54.678466 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d1155f6a-f9fb-4451-8491-0dcc18beb264 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:54.683823 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c02f41ad-a456-4644-b018-d88134adb53a tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-221199750", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "3a5db53b-d9ed-49e3-80b6-81d1af92080a"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:06:54.688762 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d1155f6a-f9fb-4451-8491-0dcc18beb264 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/428669f8-ae42-4320-b8b7-8d79c51a67ac" status: 200 len: 1667 microversion: 2.1 time: 0.242080 Jul 18 03:06:54.689379 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3174/6366] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:54 2022] GET /compute/v2.1/servers/428669f8-ae42-4320-b8b7-8d79c51a67ac => generated 1667 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c02f41ad-a456-4644-b018-d88134adb53a tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 234 Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-221199750", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "3a5db53b-d9ed-49e3-80b6-81d1af92080a"}]}} Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-221199750', 'imageRef': '3bb0a19f-5b69-48ee-a771-8fd416f92f36', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '3a5db53b-d9ed-49e3-80b6-81d1af92080a'}]}}} Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = func(instance) Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/_format.py", line 210, in is_ipv6 Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return socket.inet_pton(socket.AF_INET6, instance) Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi OSError: illegal IP address string passed to inet_pton Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise error Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi 'notvalid' Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:06:54.690996 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:06:54.695684 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:06:54.695684 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:06:54.695684 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:06:54.695684 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:06:54.695684 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 03:06:54.695684 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 03:06:54.695684 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 03:06:54.695684 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 03:06:54.695684 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 03:06:54.695684 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 03:06:54.695684 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 18 03:06:54.695684 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:54.695684 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:54.695684 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:54.695684 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:54.695684 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:54.695684 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:54.695684 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 03:06:54.695684 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 03:06:54.695684 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 18 03:06:54.695684 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:54.695684 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c02f41ad-a456-4644-b018-d88134adb53a tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:06:54.695684 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c02f41ad-a456-4644-b018-d88134adb53a tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.012756 Jul 18 03:06:54.697425 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3193/6367] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:06:54 2022] POST /compute/v2.1/servers => generated 133 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 18 03:06:54.704013 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4144a9fa-d0d6-4f63-9adc-8bad6349240e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:54.704633 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4144a9fa-d0d6-4f63-9adc-8bad6349240e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:54.715379 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4144a9fa-d0d6-4f63-9adc-8bad6349240e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:54.716041 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4144a9fa-d0d6-4f63-9adc-8bad6349240e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:54.717020 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4144a9fa-d0d6-4f63-9adc-8bad6349240e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:54.717604 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4144a9fa-d0d6-4f63-9adc-8bad6349240e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:54.891627 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4144a9fa-d0d6-4f63-9adc-8bad6349240e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:54.899330 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4144a9fa-d0d6-4f63-9adc-8bad6349240e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.199250 Jul 18 03:06:54.899918 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3175/6368] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:54 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:54.919526 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-58c4fb53-8acc-436c-b88f-065a866c5003 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:54.920171 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-58c4fb53-8acc-436c-b88f-065a866c5003 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:54.927151 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-58c4fb53-8acc-436c-b88f-065a866c5003 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:54.927622 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-58c4fb53-8acc-436c-b88f-065a866c5003 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:54.928422 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-58c4fb53-8acc-436c-b88f-065a866c5003 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:54.928876 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-58c4fb53-8acc-436c-b88f-065a866c5003 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:55.079249 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-58c4fb53-8acc-436c-b88f-065a866c5003 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:55.087300 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-58c4fb53-8acc-436c-b88f-065a866c5003 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.173192 Jul 18 03:06:55.087889 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3194/6369] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:54 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:55.103976 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-67334be9-0324-4b3f-95ef-a73e8796958d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:06:55.104586 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-67334be9-0324-4b3f-95ef-a73e8796958d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 8a7a7e08-5c9a-4039-9991-95a9c7317641] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:55.110721 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-67334be9-0324-4b3f-95ef-a73e8796958d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] HTTP exception thrown: Instance 8a7a7e08-5c9a-4039-9991-95a9c7317641 could not be found. Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-67334be9-0324-4b3f-95ef-a73e8796958d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers/8a7a7e08-5c9a-4039-9991-95a9c7317641/action HTTP/1.1 Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 13 Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: {"pause": {}} Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 8a7a7e08-5c9a-4039-9991-95a9c7317641 could not be found. Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '8a7a7e08-5c9a-4039-9991-95a9c7317641', 'body': {'pause': {}}} Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a7a7e08-5c9a-4039-9991-95a9c7317641 could not be found. Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a7a7e08-5c9a-4039-9991-95a9c7317641 could not be found. Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:55.119230 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:55.126099 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:06:55.126099 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:06:55.126099 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a7a7e08-5c9a-4039-9991-95a9c7317641 could not be found. Jul 18 03:06:55.126099 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:55.126099 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-67334be9-0324-4b3f-95ef-a73e8796958d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 404 to user: Instance 8a7a7e08-5c9a-4039-9991-95a9c7317641 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:06:55.126099 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-67334be9-0324-4b3f-95ef-a73e8796958d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "POST /compute/v2.1/servers/8a7a7e08-5c9a-4039-9991-95a9c7317641/action" status: 404 len: 111 microversion: 2.1 time: 0.023921 Jul 18 03:06:55.126099 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3176/6370] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:06:55 2022] POST /compute/v2.1/servers/8a7a7e08-5c9a-4039-9991-95a9c7317641/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:06:55.133468 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4c3334bd-9e95-42c1-bd53-d5d69e6f4455 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:55.134380 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4c3334bd-9e95-42c1-bd53-d5d69e6f4455 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:55.141545 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4c3334bd-9e95-42c1-bd53-d5d69e6f4455 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:55.142135 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4c3334bd-9e95-42c1-bd53-d5d69e6f4455 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:55.143124 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4c3334bd-9e95-42c1-bd53-d5d69e6f4455 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:55.143525 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4c3334bd-9e95-42c1-bd53-d5d69e6f4455 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:55.288745 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4c3334bd-9e95-42c1-bd53-d5d69e6f4455 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:55.298645 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4c3334bd-9e95-42c1-bd53-d5d69e6f4455 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.167649 Jul 18 03:06:55.298645 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3195/6371] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:55 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:06:55.315021 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-80f17ccf-b4fd-4445-9ee3-1272b49fec84 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:55.315641 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-80f17ccf-b4fd-4445-9ee3-1272b49fec84 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:55.323062 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-80f17ccf-b4fd-4445-9ee3-1272b49fec84 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:55.323533 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-80f17ccf-b4fd-4445-9ee3-1272b49fec84 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:55.324293 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-80f17ccf-b4fd-4445-9ee3-1272b49fec84 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:55.324732 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-80f17ccf-b4fd-4445-9ee3-1272b49fec84 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:55.460267 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-80f17ccf-b4fd-4445-9ee3-1272b49fec84 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:55.468963 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-80f17ccf-b4fd-4445-9ee3-1272b49fec84 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.157785 Jul 18 03:06:55.469542 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3177/6372] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:55 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:06:55.486579 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-73cf3b67-1273-4ba6-a67e-01d7e12f0eed tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:06:55.487164 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-73cf3b67-1273-4ba6-a67e-01d7e12f0eed tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:55.493973 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-73cf3b67-1273-4ba6-a67e-01d7e12f0eed tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:55.494509 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-73cf3b67-1273-4ba6-a67e-01d7e12f0eed tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:55.495924 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-73cf3b67-1273-4ba6-a67e-01d7e12f0eed tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:55.496615 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-73cf3b67-1273-4ba6-a67e-01d7e12f0eed tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:55.499547 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:06:55.569461 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-73cf3b67-1273-4ba6-a67e-01d7e12f0eed tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "POST /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041/action" status: 202 len: 0 microversion: 2.1 time: 0.086476 Jul 18 03:06:55.570155 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3196/6373] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:06:55 2022] POST /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:06:55.579129 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cb7d9de0-4d9f-477d-8ec4-b0c0e03f8497 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:55.579631 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cb7d9de0-4d9f-477d-8ec4-b0c0e03f8497 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:55.587492 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cb7d9de0-4d9f-477d-8ec4-b0c0e03f8497 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:55.588434 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cb7d9de0-4d9f-477d-8ec4-b0c0e03f8497 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:55.589470 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cb7d9de0-4d9f-477d-8ec4-b0c0e03f8497 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:55.590027 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cb7d9de0-4d9f-477d-8ec4-b0c0e03f8497 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:55.716180 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-43b661a9-e729-4a75-9f54-cde3dbaf260f tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:55.717980 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-43b661a9-e729-4a75-9f54-cde3dbaf260f tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: 428669f8-ae42-4320-b8b7-8d79c51a67ac] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:55.726568 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-43b661a9-e729-4a75-9f54-cde3dbaf260f tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:55.727306 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-43b661a9-e729-4a75-9f54-cde3dbaf260f tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:55.728207 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-43b661a9-e729-4a75-9f54-cde3dbaf260f tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:55.729285 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-43b661a9-e729-4a75-9f54-cde3dbaf260f tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:55.933518 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-cb7d9de0-4d9f-477d-8ec4-b0c0e03f8497 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:55.941594 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cb7d9de0-4d9f-477d-8ec4-b0c0e03f8497 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1511 microversion: 2.1 time: 0.366549 Jul 18 03:06:55.942224 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3178/6374] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:55 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1511 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:55.967655 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-43b661a9-e729-4a75-9f54-cde3dbaf260f tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:55.975283 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-43b661a9-e729-4a75-9f54-cde3dbaf260f tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/428669f8-ae42-4320-b8b7-8d79c51a67ac" status: 200 len: 1667 microversion: 2.1 time: 0.269244 Jul 18 03:06:55.975854 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3197/6375] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:55 2022] GET /compute/v2.1/servers/428669f8-ae42-4320-b8b7-8d79c51a67ac => generated 1667 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:06:56.788643 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-4cb1a282-4906-443c-b803-bfd9c564c37b req-13e7ee14-c568-46e5-9ac0-a3e6846ced40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "428669f8-ae42-4320-b8b7-8d79c51a67ac", "name": "network-vif-deleted", "tag": "6e0694c6-64d7-4519-9df3-63d7745badb5"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:06:56.797062 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-4cb1a282-4906-443c-b803-bfd9c564c37b req-13e7ee14-c568-46e5-9ac0-a3e6846ced40 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:56.797511 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-4cb1a282-4906-443c-b803-bfd9c564c37b req-13e7ee14-c568-46e5-9ac0-a3e6846ced40 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:56.810177 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-4cb1a282-4906-443c-b803-bfd9c564c37b req-13e7ee14-c568-46e5-9ac0-a3e6846ced40 service nova] Creating event network-vif-deleted:6e0694c6-64d7-4519-9df3-63d7745badb5 for instance 428669f8-ae42-4320-b8b7-8d79c51a67ac on n-h1-465891-3 Jul 18 03:06:56.814818 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-4cb1a282-4906-443c-b803-bfd9c564c37b req-13e7ee14-c568-46e5-9ac0-a3e6846ced40 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085088 Jul 18 03:06:56.815424 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3179/6376] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:06:56.959346 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0c6233c9-6e23-42af-902b-16dbf23ced0f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:56.959992 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0c6233c9-6e23-42af-902b-16dbf23ced0f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:56.967784 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c6233c9-6e23-42af-902b-16dbf23ced0f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:56.968253 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c6233c9-6e23-42af-902b-16dbf23ced0f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:56.969067 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c6233c9-6e23-42af-902b-16dbf23ced0f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:56.969524 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c6233c9-6e23-42af-902b-16dbf23ced0f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:56.993248 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-173df915-fd7f-4e29-a42e-2105a62b5e7d tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:56.995232 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-173df915-fd7f-4e29-a42e-2105a62b5e7d tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: 428669f8-ae42-4320-b8b7-8d79c51a67ac] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:57.002838 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-173df915-fd7f-4e29-a42e-2105a62b5e7d tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:57.003295 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-173df915-fd7f-4e29-a42e-2105a62b5e7d tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:57.004074 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-173df915-fd7f-4e29-a42e-2105a62b5e7d tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:57.004508 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-173df915-fd7f-4e29-a42e-2105a62b5e7d tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:57.040479 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-173df915-fd7f-4e29-a42e-2105a62b5e7d tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:57.040949 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-173df915-fd7f-4e29-a42e-2105a62b5e7d tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:57.044764 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-173df915-fd7f-4e29-a42e-2105a62b5e7d tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lazy-loading 'fault' on Instance uuid 428669f8-ae42-4320-b8b7-8d79c51a67ac {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:06:57.110771 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-173df915-fd7f-4e29-a42e-2105a62b5e7d tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33388b46f7fb4c419ac0856245ad382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2ff16c129544f6a876a3371c1d02a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:57.120812 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-173df915-fd7f-4e29-a42e-2105a62b5e7d tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/428669f8-ae42-4320-b8b7-8d79c51a67ac" status: 200 len: 1338 microversion: 2.1 time: 0.131316 Jul 18 03:06:57.121999 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3180/6377] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:56 2022] GET /compute/v2.1/servers/428669f8-ae42-4320-b8b7-8d79c51a67ac => generated 1338 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:06:57.161278 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0c6233c9-6e23-42af-902b-16dbf23ced0f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:57.170013 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0c6233c9-6e23-42af-902b-16dbf23ced0f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1491 microversion: 2.1 time: 0.214431 Jul 18 03:06:57.170750 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3198/6378] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:56 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1491 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:57.187748 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7a1bfd50-1a57-4d9e-846e-3f0423f40540 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:06:57.188574 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7a1bfd50-1a57-4d9e-846e-3f0423f40540 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:57.196485 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7a1bfd50-1a57-4d9e-846e-3f0423f40540 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:57.196922 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7a1bfd50-1a57-4d9e-846e-3f0423f40540 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:57.198308 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7a1bfd50-1a57-4d9e-846e-3f0423f40540 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:57.198906 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7a1bfd50-1a57-4d9e-846e-3f0423f40540 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:57.225462 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-7a1bfd50-1a57-4d9e-846e-3f0423f40540 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] HTTP exception thrown: Cannot 'pause' instance 63632c37-5811-4473-a763-d8856e28e041 while it is in vm_state paused Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7a1bfd50-1a57-4d9e-846e-3f0423f40540 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041/action HTTP/1.1 Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 13 Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: {"pause": {}} Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: exception: Cannot 'pause' instance 63632c37-5811-4473-a763-d8856e28e041 while it is in vm_state paused Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '63632c37-5811-4473-a763-d8856e28e041', 'body': {'pause': {}}} Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 63632c37-5811-4473-a763-d8856e28e041 in vm_state paused. Cannot pause while the instance is in this state. Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 63632c37-5811-4473-a763-d8856e28e041 while it is in vm_state paused Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:57.227409 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:57.233472 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:57.233472 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:06:57.233472 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:06:57.233472 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 63632c37-5811-4473-a763-d8856e28e041 while it is in vm_state paused Jul 18 03:06:57.233472 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:57.233472 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7a1bfd50-1a57-4d9e-846e-3f0423f40540 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 409 to user: Cannot 'pause' instance 63632c37-5811-4473-a763-d8856e28e041 while it is in vm_state paused {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:06:57.233472 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7a1bfd50-1a57-4d9e-846e-3f0423f40540 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "POST /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041/action" status: 409 len: 143 microversion: 2.1 time: 0.045134 Jul 18 03:06:57.233472 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3181/6379] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:06:57 2022] POST /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041/action => generated 143 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 18 03:06:57.239106 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-01dee89b-2bc8-4d82-bf7f-8493450a6ba6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:06:57.239664 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-01dee89b-2bc8-4d82-bf7f-8493450a6ba6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:57.246778 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-01dee89b-2bc8-4d82-bf7f-8493450a6ba6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:57.247235 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-01dee89b-2bc8-4d82-bf7f-8493450a6ba6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:57.248021 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-01dee89b-2bc8-4d82-bf7f-8493450a6ba6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:57.248466 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-01dee89b-2bc8-4d82-bf7f-8493450a6ba6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:57.315417 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-01dee89b-2bc8-4d82-bf7f-8493450a6ba6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "POST /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041/action" status: 202 len: 0 microversion: 2.1 time: 0.080409 Jul 18 03:06:57.316751 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3199/6380] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:06:57 2022] POST /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:06:57.324752 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f9f93425-5a41-4ddf-9982-d27e7a53e997 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:57.325371 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f9f93425-5a41-4ddf-9982-d27e7a53e997 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:57.338095 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f9f93425-5a41-4ddf-9982-d27e7a53e997 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:57.338737 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f9f93425-5a41-4ddf-9982-d27e7a53e997 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:57.339622 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f9f93425-5a41-4ddf-9982-d27e7a53e997 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:57.340054 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f9f93425-5a41-4ddf-9982-d27e7a53e997 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:57.481721 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f9f93425-5a41-4ddf-9982-d27e7a53e997 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:57.489502 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f9f93425-5a41-4ddf-9982-d27e7a53e997 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1498 microversion: 2.1 time: 0.169178 Jul 18 03:06:57.490133 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3182/6381] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:57 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1498 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:58.139295 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0747df57-2215-4122-9467-793f78adaa98 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:58.140012 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0747df57-2215-4122-9467-793f78adaa98 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] [instance: 428669f8-ae42-4320-b8b7-8d79c51a67ac] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:58.147341 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0747df57-2215-4122-9467-793f78adaa98 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:58.147812 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0747df57-2215-4122-9467-793f78adaa98 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:58.148633 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0747df57-2215-4122-9467-793f78adaa98 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:58.149089 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0747df57-2215-4122-9467-793f78adaa98 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:58.163713 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-0747df57-2215-4122-9467-793f78adaa98 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] HTTP exception thrown: Instance 428669f8-ae42-4320-b8b7-8d79c51a67ac could not be found. Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0747df57-2215-4122-9467-793f78adaa98 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Request method failure captured: Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/428669f8-ae42-4320-b8b7-8d79c51a67ac HTTP/1.1 Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1M1fjxj2SWFoXW6Sb-0swIReqepB-2vZ8Rt0XBLXBRPz7xlUYKfNEu4m9Blh-cNBZR00jPQoO_lhqOHSne0eODxj2N7SOK9zjyQSeA0pKNgRsdckEpj2vSnWXuSELduvIk90pn84XzmSfUb_5axS-AdrG1LFffRoINHmpfwzIz7M6cw Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 1d2ff16c129544f6a876a3371c1d02a6 Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-TestNetworkBasicOps-1916468681 Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1d2ff16c129544f6a876a3371c1d02a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1d2ff16c129544f6a876a3371c1d02a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1d2ff16c129544f6a876a3371c1d02a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1d2ff16c129544f6a876a3371c1d02a6"}]}] Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-TestNetworkBasicOps-1916468681 Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 1d2ff16c129544f6a876a3371c1d02a6 Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-TestNetworkBasicOps-1916468681 Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-TestNetworkBasicOps-1916468681-project Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 33388b46f7fb4c419ac0856245ad382f Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-TestNetworkBasicOps-1916468681-project Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 428669f8-ae42-4320-b8b7-8d79c51a67ac could not be found. Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '428669f8-ae42-4320-b8b7-8d79c51a67ac'} Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 428669f8-ae42-4320-b8b7-8d79c51a67ac could not be found. Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 428669f8-ae42-4320-b8b7-8d79c51a67ac could not be found. Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:58.165403 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:58.171258 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:58.171258 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:58.171258 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:58.171258 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:06:58.171258 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:06:58.171258 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 428669f8-ae42-4320-b8b7-8d79c51a67ac could not be found. Jul 18 03:06:58.171258 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:58.171258 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0747df57-2215-4122-9467-793f78adaa98 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Returning 404 to user: Instance 428669f8-ae42-4320-b8b7-8d79c51a67ac could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:06:58.171258 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0747df57-2215-4122-9467-793f78adaa98 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "GET /compute/v2.1/servers/428669f8-ae42-4320-b8b7-8d79c51a67ac" status: 404 len: 111 microversion: 2.1 time: 0.032639 Jul 18 03:06:58.171258 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3200/6382] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:58 2022] GET /compute/v2.1/servers/428669f8-ae42-4320-b8b7-8d79c51a67ac => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:06:58.348471 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e1f16988-47af-4233-bdb8-5f81b51a7b15 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] Calling method '.version_select at 0x7ff4adc7a820>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:58.373177 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e1f16988-47af-4233-bdb8-5f81b51a7b15 tempest-TestNetworkBasicOps-1916468681 tempest-TestNetworkBasicOps-1916468681-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-676539992" status: 202 len: 0 microversion: 2.1 time: 0.028626 Jul 18 03:06:58.373961 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3183/6383] 10.222.0.57 () {58 vars in 1253 bytes} [Mon Jul 18 03:06:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-676539992 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:06:58.508893 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-904b6ec7-74b8-4034-aadf-2f483df7055d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:58.509437 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-904b6ec7-74b8-4034-aadf-2f483df7055d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:58.517109 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-904b6ec7-74b8-4034-aadf-2f483df7055d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:58.517573 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-904b6ec7-74b8-4034-aadf-2f483df7055d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:58.518405 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-904b6ec7-74b8-4034-aadf-2f483df7055d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:58.518855 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-904b6ec7-74b8-4034-aadf-2f483df7055d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:58.683261 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-904b6ec7-74b8-4034-aadf-2f483df7055d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:58.691274 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-904b6ec7-74b8-4034-aadf-2f483df7055d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.186480 Jul 18 03:06:58.691865 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3201/6384] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:58 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:58.711580 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9b39a46e-8c70-4aeb-b8aa-7943be8b5906 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:58.712191 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9b39a46e-8c70-4aeb-b8aa-7943be8b5906 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:58.718489 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9b39a46e-8c70-4aeb-b8aa-7943be8b5906 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:58.718935 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9b39a46e-8c70-4aeb-b8aa-7943be8b5906 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:58.719700 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9b39a46e-8c70-4aeb-b8aa-7943be8b5906 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:58.720133 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9b39a46e-8c70-4aeb-b8aa-7943be8b5906 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:58.871084 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9b39a46e-8c70-4aeb-b8aa-7943be8b5906 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:58.879119 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9b39a46e-8c70-4aeb-b8aa-7943be8b5906 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.171438 Jul 18 03:06:58.879715 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3184/6385] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:58 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:58.896431 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-80122e9b-a0dc-4688-83c2-5ac631fd6430 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:06:58.897723 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-80122e9b-a0dc-4688-83c2-5ac631fd6430 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 2a565242-f018-4078-a74c-18c3b8823c51] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:58.904690 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-80122e9b-a0dc-4688-83c2-5ac631fd6430 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:58.905272 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-80122e9b-a0dc-4688-83c2-5ac631fd6430 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:58.906226 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-80122e9b-a0dc-4688-83c2-5ac631fd6430 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:58.906806 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-80122e9b-a0dc-4688-83c2-5ac631fd6430 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:58.923260 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-80122e9b-a0dc-4688-83c2-5ac631fd6430 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] HTTP exception thrown: Instance 2a565242-f018-4078-a74c-18c3b8823c51 could not be found. Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-80122e9b-a0dc-4688-83c2-5ac631fd6430 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/servers/2a565242-f018-4078-a74c-18c3b8823c51/action HTTP/1.1 Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 28 Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: {"reboot": {"type": "SOFT"}} Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 2a565242-f018-4078-a74c-18c3b8823c51 could not be found. Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '2a565242-f018-4078-a74c-18c3b8823c51', 'body': {'reboot': {'type': 'SOFT'}}} Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a565242-f018-4078-a74c-18c3b8823c51 could not be found. Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:06:58.924943 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:06:58.930846 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a565242-f018-4078-a74c-18c3b8823c51 could not be found. Jul 18 03:06:58.930846 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:58.930846 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:58.930846 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:58.930846 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:58.930846 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:58.930846 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:58.930846 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:06:58.930846 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:06:58.930846 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a565242-f018-4078-a74c-18c3b8823c51 could not be found. Jul 18 03:06:58.930846 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:58.930846 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-80122e9b-a0dc-4688-83c2-5ac631fd6430 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 404 to user: Instance 2a565242-f018-4078-a74c-18c3b8823c51 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:06:58.930846 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-80122e9b-a0dc-4688-83c2-5ac631fd6430 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "POST /compute/v2.1/servers/2a565242-f018-4078-a74c-18c3b8823c51/action" status: 404 len: 111 microversion: 2.1 time: 0.034146 Jul 18 03:06:58.930846 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3202/6386] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:06:58 2022] POST /compute/v2.1/servers/2a565242-f018-4078-a74c-18c3b8823c51/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 03:06:58.942279 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-aa357b35-236a-4c3f-a07a-dd2160068c9c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:58.942895 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-aa357b35-236a-4c3f-a07a-dd2160068c9c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:58.950097 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aa357b35-236a-4c3f-a07a-dd2160068c9c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:58.950547 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aa357b35-236a-4c3f-a07a-dd2160068c9c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:58.951358 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aa357b35-236a-4c3f-a07a-dd2160068c9c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:58.951815 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aa357b35-236a-4c3f-a07a-dd2160068c9c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:59.096369 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-aa357b35-236a-4c3f-a07a-dd2160068c9c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:59.104621 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-aa357b35-236a-4c3f-a07a-dd2160068c9c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.166150 Jul 18 03:06:59.105226 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3185/6387] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:58 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:59.122644 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cc9e876e-a4d2-4a4a-9dd6-ba09b112601e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:59.123277 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cc9e876e-a4d2-4a4a-9dd6-ba09b112601e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:59.129595 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cc9e876e-a4d2-4a4a-9dd6-ba09b112601e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:59.130091 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cc9e876e-a4d2-4a4a-9dd6-ba09b112601e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:59.130886 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cc9e876e-a4d2-4a4a-9dd6-ba09b112601e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:59.131335 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cc9e876e-a4d2-4a4a-9dd6-ba09b112601e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:59.284701 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cc9e876e-a4d2-4a4a-9dd6-ba09b112601e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:59.298767 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cc9e876e-a4d2-4a4a-9dd6-ba09b112601e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.180897 Jul 18 03:06:59.299756 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3203/6388] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:59 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:59.317051 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ef3d5d07-7c0d-4591-85d7-a84c562ae687 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:06:59.318072 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ef3d5d07-7c0d-4591-85d7-a84c562ae687 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 9dd3a783-bd56-4fb8-bdf5-c08874a7e174] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:59.324402 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-ef3d5d07-7c0d-4591-85d7-a84c562ae687 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] HTTP exception thrown: Instance 9dd3a783-bd56-4fb8-bdf5-c08874a7e174 could not be found. Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ef3d5d07-7c0d-4591-85d7-a84c562ae687 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers/9dd3a783-bd56-4fb8-bdf5-c08874a7e174/action HTTP/1.1 Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 28 Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: {"reboot": {"type": "SOFT"}} Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 9dd3a783-bd56-4fb8-bdf5-c08874a7e174 could not be found. Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '9dd3a783-bd56-4fb8-bdf5-c08874a7e174', 'body': {'reboot': {'type': 'SOFT'}}} Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dd3a783-bd56-4fb8-bdf5-c08874a7e174 could not be found. Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dd3a783-bd56-4fb8-bdf5-c08874a7e174 could not be found. Jul 18 03:06:59.326060 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:59.332316 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:59.332316 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:59.332316 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:59.332316 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:59.332316 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:59.332316 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:06:59.332316 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:06:59.332316 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dd3a783-bd56-4fb8-bdf5-c08874a7e174 could not be found. Jul 18 03:06:59.332316 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:06:59.332316 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ef3d5d07-7c0d-4591-85d7-a84c562ae687 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 404 to user: Instance 9dd3a783-bd56-4fb8-bdf5-c08874a7e174 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:06:59.332316 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ef3d5d07-7c0d-4591-85d7-a84c562ae687 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "POST /compute/v2.1/servers/9dd3a783-bd56-4fb8-bdf5-c08874a7e174/action" status: 404 len: 111 microversion: 2.1 time: 0.014794 Jul 18 03:06:59.332316 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3186/6389] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:06:59 2022] POST /compute/v2.1/servers/9dd3a783-bd56-4fb8-bdf5-c08874a7e174/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:06:59.341431 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1c93b6fb-caba-4108-9113-907d7aeebb94 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:59.342198 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1c93b6fb-caba-4108-9113-907d7aeebb94 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:59.355176 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c93b6fb-caba-4108-9113-907d7aeebb94 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:59.355919 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c93b6fb-caba-4108-9113-907d7aeebb94 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:59.356957 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c93b6fb-caba-4108-9113-907d7aeebb94 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:59.357492 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c93b6fb-caba-4108-9113-907d7aeebb94 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:59.545076 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1c93b6fb-caba-4108-9113-907d7aeebb94 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:59.553836 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1c93b6fb-caba-4108-9113-907d7aeebb94 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.218831 Jul 18 03:06:59.555101 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3204/6390] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:59 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:06:59.572844 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9e73d3f9-1d27-4a79-8fa3-c396a2109e53 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:59.573473 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9e73d3f9-1d27-4a79-8fa3-c396a2109e53 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:59.582284 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9e73d3f9-1d27-4a79-8fa3-c396a2109e53 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:59.582742 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9e73d3f9-1d27-4a79-8fa3-c396a2109e53 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:59.583892 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9e73d3f9-1d27-4a79-8fa3-c396a2109e53 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:59.584338 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9e73d3f9-1d27-4a79-8fa3-c396a2109e53 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:59.740550 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9e73d3f9-1d27-4a79-8fa3-c396a2109e53 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:59.751509 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9e73d3f9-1d27-4a79-8fa3-c396a2109e53 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.182231 Jul 18 03:06:59.752665 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3187/6391] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:59 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:59.772103 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-511b91a0-cf9d-441c-a368-0fb733133d99 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:06:59.772908 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-511b91a0-cf9d-441c-a368-0fb733133d99 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 2a565242-f018-4078-a74c-18c3b8823c51] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:59.779986 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-511b91a0-cf9d-441c-a368-0fb733133d99 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:59.780469 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-511b91a0-cf9d-441c-a368-0fb733133d99 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:59.781277 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-511b91a0-cf9d-441c-a368-0fb733133d99 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:59.781760 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-511b91a0-cf9d-441c-a368-0fb733133d99 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:59.797512 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-511b91a0-cf9d-441c-a368-0fb733133d99 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] HTTP exception thrown: Instance 2a565242-f018-4078-a74c-18c3b8823c51 could not be found. Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-511b91a0-cf9d-441c-a368-0fb733133d99 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/servers/2a565242-f018-4078-a74c-18c3b8823c51/action HTTP/1.1 Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 65 Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: {"rebuild": {"imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36"}} Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 2a565242-f018-4078-a74c-18c3b8823c51 could not be found. Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '2a565242-f018-4078-a74c-18c3b8823c51', 'body': {'rebuild': {'imageRef': '3bb0a19f-5b69-48ee-a771-8fd416f92f36'}}} Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a565242-f018-4078-a74c-18c3b8823c51 could not be found. Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 18 03:06:59.799176 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 18 03:06:59.804455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 18 03:06:59.804455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:06:59.804455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:06:59.804455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:06:59.804455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:06:59.804455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a565242-f018-4078-a74c-18c3b8823c51 could not be found. Jul 18 03:06:59.804455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:59.804455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:59.804455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:59.804455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:59.804455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:59.804455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:59.804455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:06:59.804455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:06:59.804455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a565242-f018-4078-a74c-18c3b8823c51 could not be found. Jul 18 03:06:59.804455 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:06:59.804455 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-511b91a0-cf9d-441c-a368-0fb733133d99 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 404 to user: Instance 2a565242-f018-4078-a74c-18c3b8823c51 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:06:59.804455 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-511b91a0-cf9d-441c-a368-0fb733133d99 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "POST /compute/v2.1/servers/2a565242-f018-4078-a74c-18c3b8823c51/action" status: 404 len: 111 microversion: 2.1 time: 0.034713 Jul 18 03:06:59.804455 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3205/6392] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:06:59 2022] POST /compute/v2.1/servers/2a565242-f018-4078-a74c-18c3b8823c51/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:06:59.812435 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e2016201-25b1-4d24-bace-6946a8895ca0 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:59.813049 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e2016201-25b1-4d24-bace-6946a8895ca0 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:59.819366 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e2016201-25b1-4d24-bace-6946a8895ca0 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:59.819819 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e2016201-25b1-4d24-bace-6946a8895ca0 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:59.820602 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e2016201-25b1-4d24-bace-6946a8895ca0 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:59.821040 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e2016201-25b1-4d24-bace-6946a8895ca0 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:59.961175 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e2016201-25b1-4d24-bace-6946a8895ca0 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:59.964343 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=100 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:06:59.971297 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e2016201-25b1-4d24-bace-6946a8895ca0 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.162705 Jul 18 03:06:59.971906 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3188/6393] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:59 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:59.990395 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ded9c325-6668-4a8e-a7c0-bb215fc26d90 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:59.991043 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ded9c325-6668-4a8e-a7c0-bb215fc26d90 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:59.999103 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ded9c325-6668-4a8e-a7c0-bb215fc26d90 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:59.999574 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ded9c325-6668-4a8e-a7c0-bb215fc26d90 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:00.000386 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ded9c325-6668-4a8e-a7c0-bb215fc26d90 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:00.000846 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ded9c325-6668-4a8e-a7c0-bb215fc26d90 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:00.247466 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ded9c325-6668-4a8e-a7c0-bb215fc26d90 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:00.256743 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ded9c325-6668-4a8e-a7c0-bb215fc26d90 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.270510 Jul 18 03:07:00.259086 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3206/6394] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:59 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:00.285644 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f70c2779-1e52-4d9b-829a-aa32f3b61e63 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:07:00.288260 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f70c2779-1e52-4d9b-829a-aa32f3b61e63 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: f11d0acb-b29e-4c35-86b4-c0b047bce526] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:00.298670 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-f70c2779-1e52-4d9b-829a-aa32f3b61e63 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] HTTP exception thrown: Instance f11d0acb-b29e-4c35-86b4-c0b047bce526 could not be found. Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f70c2779-1e52-4d9b-829a-aa32f3b61e63 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers/f11d0acb-b29e-4c35-86b4-c0b047bce526/action HTTP/1.1 Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 65 Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: {"rebuild": {"imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36"}} Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance f11d0acb-b29e-4c35-86b4-c0b047bce526 could not be found. Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'f11d0acb-b29e-4c35-86b4-c0b047bce526', 'body': {'rebuild': {'imageRef': '3bb0a19f-5b69-48ee-a771-8fd416f92f36'}}} Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f11d0acb-b29e-4c35-86b4-c0b047bce526 could not be found. Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 18 03:07:00.301795 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:07:00.309843 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:07:00.309843 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:07:00.309843 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:07:00.309843 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f11d0acb-b29e-4c35-86b4-c0b047bce526 could not be found. Jul 18 03:07:00.309843 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:00.309843 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:00.309843 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:00.309843 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:00.309843 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:00.309843 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:00.309843 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:07:00.309843 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:07:00.309843 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f11d0acb-b29e-4c35-86b4-c0b047bce526 could not be found. Jul 18 03:07:00.309843 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:00.309843 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f70c2779-1e52-4d9b-829a-aa32f3b61e63 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 404 to user: Instance f11d0acb-b29e-4c35-86b4-c0b047bce526 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:07:00.309843 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f70c2779-1e52-4d9b-829a-aa32f3b61e63 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "POST /compute/v2.1/servers/f11d0acb-b29e-4c35-86b4-c0b047bce526/action" status: 404 len: 111 microversion: 2.1 time: 0.025382 Jul 18 03:07:00.314701 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3189/6395] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:07:00 2022] POST /compute/v2.1/servers/f11d0acb-b29e-4c35-86b4-c0b047bce526/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:07:00.318988 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a00f564a-93c9-4c66-bf4a-82b98751f52a tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:00.319985 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a00f564a-93c9-4c66-bf4a-82b98751f52a tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:00.330069 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a00f564a-93c9-4c66-bf4a-82b98751f52a tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:00.330809 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a00f564a-93c9-4c66-bf4a-82b98751f52a tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:00.332156 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a00f564a-93c9-4c66-bf4a-82b98751f52a tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:00.333125 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a00f564a-93c9-4c66-bf4a-82b98751f52a tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:00.601551 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a00f564a-93c9-4c66-bf4a-82b98751f52a tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:00.611024 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a00f564a-93c9-4c66-bf4a-82b98751f52a tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.299174 Jul 18 03:07:00.611919 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3207/6396] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:00 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:07:00.633141 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fe675261-9044-414f-80e5-8b26c1ed0aad tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:00.634493 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fe675261-9044-414f-80e5-8b26c1ed0aad tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:00.645518 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fe675261-9044-414f-80e5-8b26c1ed0aad tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:00.651801 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fe675261-9044-414f-80e5-8b26c1ed0aad tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:00.652661 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fe675261-9044-414f-80e5-8b26c1ed0aad tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:00.653179 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fe675261-9044-414f-80e5-8b26c1ed0aad tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:00.833311 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fe675261-9044-414f-80e5-8b26c1ed0aad tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:00.842042 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fe675261-9044-414f-80e5-8b26c1ed0aad tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.212657 Jul 18 03:07:00.843744 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3190/6397] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:00 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:07:00.861863 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0c230af7-61e2-48a7-a679-2544b7ef2c46 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:07:00.862690 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0c230af7-61e2-48a7-a679-2544b7ef2c46 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 6d3b4743-3fb5-4353-b3fc-e62078e1e296] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:00.869469 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-0c230af7-61e2-48a7-a679-2544b7ef2c46 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] HTTP exception thrown: Instance 6d3b4743-3fb5-4353-b3fc-e62078e1e296 could not be found. Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0c230af7-61e2-48a7-a679-2544b7ef2c46 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/servers/6d3b4743-3fb5-4353-b3fc-e62078e1e296/action HTTP/1.1 Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 15 Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: {"restore": {}} Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 6d3b4743-3fb5-4353-b3fc-e62078e1e296 could not be found. Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '6d3b4743-3fb5-4353-b3fc-e62078e1e296', 'body': {'restore': {}}} Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d3b4743-3fb5-4353-b3fc-e62078e1e296 could not be found. Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d3b4743-3fb5-4353-b3fc-e62078e1e296 could not be found. Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:00.871651 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:00.877149 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:07:00.877149 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:07:00.877149 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d3b4743-3fb5-4353-b3fc-e62078e1e296 could not be found. Jul 18 03:07:00.877149 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:00.878467 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0c230af7-61e2-48a7-a679-2544b7ef2c46 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 404 to user: Instance 6d3b4743-3fb5-4353-b3fc-e62078e1e296 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:07:00.879550 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0c230af7-61e2-48a7-a679-2544b7ef2c46 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "POST /compute/v2.1/servers/6d3b4743-3fb5-4353-b3fc-e62078e1e296/action" status: 404 len: 111 microversion: 2.1 time: 0.022195 Jul 18 03:07:00.880711 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3208/6398] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:07:00 2022] POST /compute/v2.1/servers/6d3b4743-3fb5-4353-b3fc-e62078e1e296/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:07:00.890182 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-634ab50b-2fbe-4388-b61f-12d9b58bef93 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:00.890844 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-634ab50b-2fbe-4388-b61f-12d9b58bef93 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:00.898673 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-634ab50b-2fbe-4388-b61f-12d9b58bef93 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:00.899029 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-634ab50b-2fbe-4388-b61f-12d9b58bef93 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:00.899883 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-634ab50b-2fbe-4388-b61f-12d9b58bef93 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:00.900302 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-634ab50b-2fbe-4388-b61f-12d9b58bef93 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:01.150955 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-634ab50b-2fbe-4388-b61f-12d9b58bef93 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:01.163433 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-634ab50b-2fbe-4388-b61f-12d9b58bef93 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.278335 Jul 18 03:07:01.164139 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3191/6399] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:00 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:01.184480 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9e69197f-05c0-4d4b-b8ca-1470006b16ff tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:01.185223 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9e69197f-05c0-4d4b-b8ca-1470006b16ff tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:01.194235 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e69197f-05c0-4d4b-b8ca-1470006b16ff tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:01.194807 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e69197f-05c0-4d4b-b8ca-1470006b16ff tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:01.195708 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e69197f-05c0-4d4b-b8ca-1470006b16ff tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:01.196173 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e69197f-05c0-4d4b-b8ca-1470006b16ff tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:01.360860 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9e69197f-05c0-4d4b-b8ca-1470006b16ff tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:01.376555 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9e69197f-05c0-4d4b-b8ca-1470006b16ff tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.197680 Jul 18 03:07:01.377735 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3209/6400] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:01 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:01.397849 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-366a5167-1fc0-4f0f-8603-7f3b4d62a65d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:07:01.399094 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-366a5167-1fc0-4f0f-8603-7f3b4d62a65d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:01.414296 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-366a5167-1fc0-4f0f-8603-7f3b4d62a65d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:01.415036 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-366a5167-1fc0-4f0f-8603-7f3b4d62a65d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:01.417058 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-366a5167-1fc0-4f0f-8603-7f3b4d62a65d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:01.417987 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-366a5167-1fc0-4f0f-8603-7f3b4d62a65d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:01.472183 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-366a5167-1fc0-4f0f-8603-7f3b4d62a65d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] HTTP exception thrown: Cannot 'restore' instance 63632c37-5811-4473-a763-d8856e28e041 while it is in vm_state active Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-366a5167-1fc0-4f0f-8603-7f3b4d62a65d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041/action HTTP/1.1 Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 15 Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: {"restore": {}} Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: exception: Cannot 'restore' instance 63632c37-5811-4473-a763-d8856e28e041 while it is in vm_state active Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '63632c37-5811-4473-a763-d8856e28e041', 'body': {'restore': {}}} Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 63632c37-5811-4473-a763-d8856e28e041 in vm_state active. Cannot restore while the instance is in this state. Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 63632c37-5811-4473-a763-d8856e28e041 while it is in vm_state active Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:01.476167 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:01.482220 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:01.482220 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:07:01.482220 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:07:01.482220 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 63632c37-5811-4473-a763-d8856e28e041 while it is in vm_state active Jul 18 03:07:01.482220 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:01.482220 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-366a5167-1fc0-4f0f-8603-7f3b4d62a65d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 409 to user: Cannot 'restore' instance 63632c37-5811-4473-a763-d8856e28e041 while it is in vm_state active {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:07:01.482220 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-366a5167-1fc0-4f0f-8603-7f3b4d62a65d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "POST /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041/action" status: 409 len: 145 microversion: 2.1 time: 0.088329 Jul 18 03:07:01.482220 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3192/6401] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:07:01 2022] POST /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041/action => generated 145 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 03:07:01.493687 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2dbc0625-7b53-41be-b9f5-516115c552c8 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:01.500396 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2dbc0625-7b53-41be-b9f5-516115c552c8 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:01.517258 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2dbc0625-7b53-41be-b9f5-516115c552c8 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:01.518064 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2dbc0625-7b53-41be-b9f5-516115c552c8 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:01.519372 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2dbc0625-7b53-41be-b9f5-516115c552c8 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:01.519828 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2dbc0625-7b53-41be-b9f5-516115c552c8 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:01.820941 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2dbc0625-7b53-41be-b9f5-516115c552c8 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:01.833422 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2dbc0625-7b53-41be-b9f5-516115c552c8 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.347546 Jul 18 03:07:01.845478 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3210/6402] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:01 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:01.856216 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0e3fa59f-36a3-471f-be8d-e1ede6f2d1e4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:01.857624 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0e3fa59f-36a3-471f-be8d-e1ede6f2d1e4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:01.873251 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0e3fa59f-36a3-471f-be8d-e1ede6f2d1e4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:01.874310 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0e3fa59f-36a3-471f-be8d-e1ede6f2d1e4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:01.876164 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0e3fa59f-36a3-471f-be8d-e1ede6f2d1e4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:01.877390 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0e3fa59f-36a3-471f-be8d-e1ede6f2d1e4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:02.113907 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0e3fa59f-36a3-471f-be8d-e1ede6f2d1e4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:02.127889 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0e3fa59f-36a3-471f-be8d-e1ede6f2d1e4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.279676 Jul 18 03:07:02.128970 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3193/6403] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:01 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:02.149690 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3143c138-2c26-439f-bb0e-53ee9045ec7e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:07:02.150376 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3143c138-2c26-439f-bb0e-53ee9045ec7e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: f74ab1b9-1ea9-40db-a1d9-338c2261a42e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:02.157737 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-3143c138-2c26-439f-bb0e-53ee9045ec7e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] HTTP exception thrown: Instance f74ab1b9-1ea9-40db-a1d9-338c2261a42e could not be found. Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3143c138-2c26-439f-bb0e-53ee9045ec7e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/servers/f74ab1b9-1ea9-40db-a1d9-338c2261a42e/action HTTP/1.1 Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 14 Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: {"resume": {}} Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance f74ab1b9-1ea9-40db-a1d9-338c2261a42e could not be found. Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'f74ab1b9-1ea9-40db-a1d9-338c2261a42e', 'body': {'resume': {}}} Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f74ab1b9-1ea9-40db-a1d9-338c2261a42e could not be found. Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f74ab1b9-1ea9-40db-a1d9-338c2261a42e could not be found. Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:02.170599 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:02.178815 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:07:02.178815 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:07:02.178815 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f74ab1b9-1ea9-40db-a1d9-338c2261a42e could not be found. Jul 18 03:07:02.178815 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:02.178815 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3143c138-2c26-439f-bb0e-53ee9045ec7e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 404 to user: Instance f74ab1b9-1ea9-40db-a1d9-338c2261a42e could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:07:02.178815 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3143c138-2c26-439f-bb0e-53ee9045ec7e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "POST /compute/v2.1/servers/f74ab1b9-1ea9-40db-a1d9-338c2261a42e/action" status: 404 len: 111 microversion: 2.1 time: 0.029467 Jul 18 03:07:02.178815 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3211/6404] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:07:02 2022] POST /compute/v2.1/servers/f74ab1b9-1ea9-40db-a1d9-338c2261a42e/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:07:02.189906 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3851dbe9-eea1-467d-bfdd-2c23e8eaabcb tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:02.191382 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3851dbe9-eea1-467d-bfdd-2c23e8eaabcb tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:02.202450 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3851dbe9-eea1-467d-bfdd-2c23e8eaabcb tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:02.203365 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3851dbe9-eea1-467d-bfdd-2c23e8eaabcb tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:02.205057 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3851dbe9-eea1-467d-bfdd-2c23e8eaabcb tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:02.206229 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3851dbe9-eea1-467d-bfdd-2c23e8eaabcb tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:02.412886 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3851dbe9-eea1-467d-bfdd-2c23e8eaabcb tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:02.428801 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3851dbe9-eea1-467d-bfdd-2c23e8eaabcb tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.250156 Jul 18 03:07:02.429944 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3194/6405] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:02 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:02.454014 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2eb3bf0b-d1d5-42e2-a7cc-218f7d78f4f0 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:02.455314 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2eb3bf0b-d1d5-42e2-a7cc-218f7d78f4f0 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:02.464345 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:07:02.472191 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2eb3bf0b-d1d5-42e2-a7cc-218f7d78f4f0 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:02.473130 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2eb3bf0b-d1d5-42e2-a7cc-218f7d78f4f0 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:02.474645 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2eb3bf0b-d1d5-42e2-a7cc-218f7d78f4f0 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:02.475561 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2eb3bf0b-d1d5-42e2-a7cc-218f7d78f4f0 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:02.636354 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2eb3bf0b-d1d5-42e2-a7cc-218f7d78f4f0 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:02.645096 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2eb3bf0b-d1d5-42e2-a7cc-218f7d78f4f0 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.200294 Jul 18 03:07:02.645738 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3212/6406] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:02 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:02.668597 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1de597dd-ea65-4b5d-a165-34fc8dd4135f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:07:02.669365 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1de597dd-ea65-4b5d-a165-34fc8dd4135f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:02.676296 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1de597dd-ea65-4b5d-a165-34fc8dd4135f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:02.676760 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1de597dd-ea65-4b5d-a165-34fc8dd4135f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:02.677560 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1de597dd-ea65-4b5d-a165-34fc8dd4135f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:02.678038 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1de597dd-ea65-4b5d-a165-34fc8dd4135f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:02.707162 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-1de597dd-ea65-4b5d-a165-34fc8dd4135f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] HTTP exception thrown: Cannot 'resume' instance 63632c37-5811-4473-a763-d8856e28e041 while it is in vm_state active Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1de597dd-ea65-4b5d-a165-34fc8dd4135f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041/action HTTP/1.1 Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 14 Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: {"resume": {}} Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: exception: Cannot 'resume' instance 63632c37-5811-4473-a763-d8856e28e041 while it is in vm_state active Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '63632c37-5811-4473-a763-d8856e28e041', 'body': {'resume': {}}} Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 63632c37-5811-4473-a763-d8856e28e041 in vm_state active. Cannot resume while the instance is in this state. Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 63632c37-5811-4473-a763-d8856e28e041 while it is in vm_state active Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:02.709050 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:02.718169 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:02.718169 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:07:02.718169 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:07:02.718169 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 63632c37-5811-4473-a763-d8856e28e041 while it is in vm_state active Jul 18 03:07:02.718169 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:02.718169 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1de597dd-ea65-4b5d-a165-34fc8dd4135f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 409 to user: Cannot 'resume' instance 63632c37-5811-4473-a763-d8856e28e041 while it is in vm_state active {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:07:02.718169 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1de597dd-ea65-4b5d-a165-34fc8dd4135f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "POST /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041/action" status: 409 len: 144 microversion: 2.1 time: 0.050966 Jul 18 03:07:02.718169 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3195/6407] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:07:02 2022] POST /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041/action => generated 144 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 03:07:02.724685 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cfe1c3f6-f061-4a62-8271-bb41c95b3c69 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:02.725419 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cfe1c3f6-f061-4a62-8271-bb41c95b3c69 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:02.733263 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cfe1c3f6-f061-4a62-8271-bb41c95b3c69 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:02.734066 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cfe1c3f6-f061-4a62-8271-bb41c95b3c69 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:02.735036 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cfe1c3f6-f061-4a62-8271-bb41c95b3c69 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:02.735712 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cfe1c3f6-f061-4a62-8271-bb41c95b3c69 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:02.912647 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cfe1c3f6-f061-4a62-8271-bb41c95b3c69 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:02.922021 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cfe1c3f6-f061-4a62-8271-bb41c95b3c69 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.201642 Jul 18 03:07:02.923217 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3213/6408] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:02 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:02.946388 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-68d8da48-a04d-4ab3-8189-f2a220090f01 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:02.948486 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-68d8da48-a04d-4ab3-8189-f2a220090f01 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:02.955624 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-68d8da48-a04d-4ab3-8189-f2a220090f01 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:02.956210 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-68d8da48-a04d-4ab3-8189-f2a220090f01 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:02.957064 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-68d8da48-a04d-4ab3-8189-f2a220090f01 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:02.957668 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-68d8da48-a04d-4ab3-8189-f2a220090f01 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:03.104552 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-68d8da48-a04d-4ab3-8189-f2a220090f01 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:03.114301 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-68d8da48-a04d-4ab3-8189-f2a220090f01 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.175901 Jul 18 03:07:03.115073 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3196/6409] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:02 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:07:03.299648 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-60b81d5d-f3aa-418f-91cd-1632bb89033d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "3a5db53b-d9ed-49e3-80b6-81d1af92080a"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-60b81d5d-f3aa-418f-91cd-1632bb89033d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 160 Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: {"server": {"name": "", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "3a5db53b-d9ed-49e3-80b6-81d1af92080a"}]}} Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'body': {'server': {'name': '', 'imageRef': '3bb0a19f-5b69-48ee-a771-8fd416f92f36', 'flavorRef': '452', 'networks': [{'uuid': '3a5db53b-d9ed-49e3-80b6-81d1af92080a'}]}}} Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise error Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi '' Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 03:07:03.305416 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 03:07:03.312894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 03:07:03.312894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 18 03:07:03.312894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:03.312894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:03.312894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:03.312894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:03.312894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:03.312894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:03.312894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 03:07:03.312894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 03:07:03.312894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 18 03:07:03.312894 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:03.312894 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-60b81d5d-f3aa-418f-91cd-1632bb89033d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:07:03.312894 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-60b81d5d-f3aa-418f-91cd-1632bb89033d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.021169 Jul 18 03:07:03.314294 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3214/6410] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:07:03 2022] POST /compute/v2.1/servers => generated 108 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 03:07:03.324413 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-82c0c58d-a045-409c-855c-d31b950b6a41 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:03.325078 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-82c0c58d-a045-409c-855c-d31b950b6a41 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:03.331523 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-82c0c58d-a045-409c-855c-d31b950b6a41 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:03.331982 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-82c0c58d-a045-409c-855c-d31b950b6a41 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:03.332777 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-82c0c58d-a045-409c-855c-d31b950b6a41 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:03.333221 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-82c0c58d-a045-409c-855c-d31b950b6a41 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:03.521183 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-82c0c58d-a045-409c-855c-d31b950b6a41 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:03.531180 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-82c0c58d-a045-409c-855c-d31b950b6a41 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.212549 Jul 18 03:07:03.531943 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3197/6411] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:03 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:03.568766 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-446da36d-dd66-4044-adb0-1ae40fcf21d3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:03.570072 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-446da36d-dd66-4044-adb0-1ae40fcf21d3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:03.581871 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-446da36d-dd66-4044-adb0-1ae40fcf21d3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:03.582964 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-446da36d-dd66-4044-adb0-1ae40fcf21d3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:03.584113 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-446da36d-dd66-4044-adb0-1ae40fcf21d3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:03.584783 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-446da36d-dd66-4044-adb0-1ae40fcf21d3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:03.737328 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-446da36d-dd66-4044-adb0-1ae40fcf21d3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:03.740448 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:07:03.751718 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-446da36d-dd66-4044-adb0-1ae40fcf21d3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.190007 Jul 18 03:07:03.752464 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3215/6412] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:03 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:03.768344 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fde20491-685c-4736-8d9c-697ec522178a tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:07:03.768891 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fde20491-685c-4736-8d9c-697ec522178a tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 406ec276-5427-4fdd-bd9f-fc2971443e8d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:03.774793 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-fde20491-685c-4736-8d9c-697ec522178a tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] HTTP exception thrown: Instance 406ec276-5427-4fdd-bd9f-fc2971443e8d could not be found. Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fde20491-685c-4736-8d9c-697ec522178a tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers/406ec276-5427-4fdd-bd9f-fc2971443e8d/action HTTP/1.1 Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 14 Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: {"shelve": {}} Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 406ec276-5427-4fdd-bd9f-fc2971443e8d could not be found. Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '406ec276-5427-4fdd-bd9f-fc2971443e8d', 'body': {'shelve': {}}} Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 406ec276-5427-4fdd-bd9f-fc2971443e8d could not be found. Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 406ec276-5427-4fdd-bd9f-fc2971443e8d could not be found. Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:03.782275 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:03.792760 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:07:03.792760 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:07:03.792760 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 406ec276-5427-4fdd-bd9f-fc2971443e8d could not be found. Jul 18 03:07:03.792760 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:03.792760 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fde20491-685c-4736-8d9c-697ec522178a tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 404 to user: Instance 406ec276-5427-4fdd-bd9f-fc2971443e8d could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:07:03.792760 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fde20491-685c-4736-8d9c-697ec522178a tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "POST /compute/v2.1/servers/406ec276-5427-4fdd-bd9f-fc2971443e8d/action" status: 404 len: 111 microversion: 2.1 time: 0.021430 Jul 18 03:07:03.792760 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3198/6413] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:07:03 2022] POST /compute/v2.1/servers/406ec276-5427-4fdd-bd9f-fc2971443e8d/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 03:07:03.802687 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e36e6f37-722d-49af-b6dd-58691152ff4e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:03.803965 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e36e6f37-722d-49af-b6dd-58691152ff4e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:03.811120 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e36e6f37-722d-49af-b6dd-58691152ff4e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:03.811590 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e36e6f37-722d-49af-b6dd-58691152ff4e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:03.812397 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e36e6f37-722d-49af-b6dd-58691152ff4e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:03.812854 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e36e6f37-722d-49af-b6dd-58691152ff4e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:03.981346 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e36e6f37-722d-49af-b6dd-58691152ff4e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:03.989739 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e36e6f37-722d-49af-b6dd-58691152ff4e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.194781 Jul 18 03:07:03.990329 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3216/6414] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:03 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:04.022871 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-74411866-4378-4559-9877-8b9b3ef96435 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:04.023766 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-74411866-4378-4559-9877-8b9b3ef96435 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:04.035330 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74411866-4378-4559-9877-8b9b3ef96435 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:04.035839 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74411866-4378-4559-9877-8b9b3ef96435 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:04.036741 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74411866-4378-4559-9877-8b9b3ef96435 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:04.037202 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74411866-4378-4559-9877-8b9b3ef96435 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:04.499318 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-74411866-4378-4559-9877-8b9b3ef96435 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:04.525845 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-74411866-4378-4559-9877-8b9b3ef96435 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.508243 Jul 18 03:07:04.529966 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3199/6415] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:04 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:04.562657 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4d5d660e-e4f4-4b23-8300-3c315ce462d6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:07:04.563972 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4d5d660e-e4f4-4b23-8300-3c315ce462d6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:04.578492 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4d5d660e-e4f4-4b23-8300-3c315ce462d6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:04.579259 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4d5d660e-e4f4-4b23-8300-3c315ce462d6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:04.580538 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4d5d660e-e4f4-4b23-8300-3c315ce462d6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:04.581125 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4d5d660e-e4f4-4b23-8300-3c315ce462d6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:04.619679 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-4d5d660e-e4f4-4b23-8300-3c315ce462d6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lazy-loading 'flavor' on Instance uuid 63632c37-5811-4473-a763-d8856e28e041 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:07:04.917645 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4d5d660e-e4f4-4b23-8300-3c315ce462d6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "POST /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041/action" status: 202 len: 0 microversion: 2.1 time: 0.361842 Jul 18 03:07:04.918703 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3217/6416] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:07:04 2022] POST /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041/action => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:07:04.926657 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-50d61fdb-6e38-4bc8-96ff-c00889772ee4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:04.927290 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-50d61fdb-6e38-4bc8-96ff-c00889772ee4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:04.935012 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-50d61fdb-6e38-4bc8-96ff-c00889772ee4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:04.935458 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-50d61fdb-6e38-4bc8-96ff-c00889772ee4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:04.936488 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-50d61fdb-6e38-4bc8-96ff-c00889772ee4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:04.936934 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-50d61fdb-6e38-4bc8-96ff-c00889772ee4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:05.131898 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-50d61fdb-6e38-4bc8-96ff-c00889772ee4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:05.141118 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-50d61fdb-6e38-4bc8-96ff-c00889772ee4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1512 microversion: 2.1 time: 0.218138 Jul 18 03:07:05.141968 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3200/6417] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:04 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1512 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:06.161776 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-179ac177-1f2c-496e-a4aa-f3aa123ee9f3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:06.162512 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-179ac177-1f2c-496e-a4aa-f3aa123ee9f3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:06.169679 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-179ac177-1f2c-496e-a4aa-f3aa123ee9f3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:06.170257 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-179ac177-1f2c-496e-a4aa-f3aa123ee9f3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:06.171065 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-179ac177-1f2c-496e-a4aa-f3aa123ee9f3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:06.171545 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-179ac177-1f2c-496e-a4aa-f3aa123ee9f3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:06.327661 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-179ac177-1f2c-496e-a4aa-f3aa123ee9f3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:06.335772 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-179ac177-1f2c-496e-a4aa-f3aa123ee9f3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1512 microversion: 2.1 time: 0.179780 Jul 18 03:07:06.336366 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3218/6418] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:06 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1512 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:07.357553 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3d807bf8-f961-4604-95f6-6be82637013d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:07.359434 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3d807bf8-f961-4604-95f6-6be82637013d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:07.367350 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3d807bf8-f961-4604-95f6-6be82637013d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:07.367810 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3d807bf8-f961-4604-95f6-6be82637013d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:07.368614 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3d807bf8-f961-4604-95f6-6be82637013d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:07.369729 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3d807bf8-f961-4604-95f6-6be82637013d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:07.528837 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3d807bf8-f961-4604-95f6-6be82637013d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:07.538144 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3d807bf8-f961-4604-95f6-6be82637013d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1512 microversion: 2.1 time: 0.187280 Jul 18 03:07:07.538903 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3201/6419] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:07 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1512 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:08.567903 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-55c59a7f-1ca9-49b8-b56d-4561174831e1 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:08.569077 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-55c59a7f-1ca9-49b8-b56d-4561174831e1 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:08.582446 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-55c59a7f-1ca9-49b8-b56d-4561174831e1 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:08.583295 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-55c59a7f-1ca9-49b8-b56d-4561174831e1 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:08.584755 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-55c59a7f-1ca9-49b8-b56d-4561174831e1 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:08.585619 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-55c59a7f-1ca9-49b8-b56d-4561174831e1 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:08.755622 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-55c59a7f-1ca9-49b8-b56d-4561174831e1 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:08.764876 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-55c59a7f-1ca9-49b8-b56d-4561174831e1 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1512 microversion: 2.1 time: 0.204439 Jul 18 03:07:08.765497 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3219/6420] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:08 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1512 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:09.782517 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-65bd3ccc-31b9-40de-bcfe-1d3a8dde2b19 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:09.783108 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-65bd3ccc-31b9-40de-bcfe-1d3a8dde2b19 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:09.792872 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65bd3ccc-31b9-40de-bcfe-1d3a8dde2b19 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:09.793324 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65bd3ccc-31b9-40de-bcfe-1d3a8dde2b19 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:09.794250 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65bd3ccc-31b9-40de-bcfe-1d3a8dde2b19 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:09.794739 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65bd3ccc-31b9-40de-bcfe-1d3a8dde2b19 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:09.955738 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-65bd3ccc-31b9-40de-bcfe-1d3a8dde2b19 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:09.964225 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-65bd3ccc-31b9-40de-bcfe-1d3a8dde2b19 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1512 microversion: 2.1 time: 0.185763 Jul 18 03:07:09.964816 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3202/6421] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:09 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1512 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:10.980836 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c09d032e-d048-4ebb-bb62-da4d4d1bc97e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:10.981468 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c09d032e-d048-4ebb-bb62-da4d4d1bc97e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:10.989925 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c09d032e-d048-4ebb-bb62-da4d4d1bc97e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:10.990399 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c09d032e-d048-4ebb-bb62-da4d4d1bc97e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:10.991214 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c09d032e-d048-4ebb-bb62-da4d4d1bc97e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:10.991675 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c09d032e-d048-4ebb-bb62-da4d4d1bc97e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:11.151798 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c09d032e-d048-4ebb-bb62-da4d4d1bc97e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:11.160087 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c09d032e-d048-4ebb-bb62-da4d4d1bc97e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1512 microversion: 2.1 time: 0.183279 Jul 18 03:07:11.160683 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3220/6422] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:10 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1512 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:12.178359 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-184b3796-d453-4af1-af47-04d68db3166c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:12.179213 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-184b3796-d453-4af1-af47-04d68db3166c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:12.187075 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-184b3796-d453-4af1-af47-04d68db3166c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:12.187542 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-184b3796-d453-4af1-af47-04d68db3166c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:12.188312 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-184b3796-d453-4af1-af47-04d68db3166c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:12.188747 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-184b3796-d453-4af1-af47-04d68db3166c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:12.340955 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-184b3796-d453-4af1-af47-04d68db3166c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:12.350476 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-184b3796-d453-4af1-af47-04d68db3166c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1512 microversion: 2.1 time: 0.176393 Jul 18 03:07:12.351066 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3203/6423] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:12 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1512 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:13.370333 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a7e0b3fb-c2aa-4080-a47a-8d4e4779c870 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:13.371278 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a7e0b3fb-c2aa-4080-a47a-8d4e4779c870 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:13.378863 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a7e0b3fb-c2aa-4080-a47a-8d4e4779c870 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:13.379334 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a7e0b3fb-c2aa-4080-a47a-8d4e4779c870 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:13.380138 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a7e0b3fb-c2aa-4080-a47a-8d4e4779c870 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:13.380597 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a7e0b3fb-c2aa-4080-a47a-8d4e4779c870 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:13.526997 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a7e0b3fb-c2aa-4080-a47a-8d4e4779c870 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:13.536358 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a7e0b3fb-c2aa-4080-a47a-8d4e4779c870 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1512 microversion: 2.1 time: 0.170338 Jul 18 03:07:13.537001 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3221/6424] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:13 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1512 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:14.554923 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-20a390b8-4bd1-4741-b52c-975ac52fbc60 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:14.557897 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-20a390b8-4bd1-4741-b52c-975ac52fbc60 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:14.564500 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-20a390b8-4bd1-4741-b52c-975ac52fbc60 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:14.564960 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-20a390b8-4bd1-4741-b52c-975ac52fbc60 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:14.565791 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-20a390b8-4bd1-4741-b52c-975ac52fbc60 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:14.566234 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-20a390b8-4bd1-4741-b52c-975ac52fbc60 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:14.714564 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-20a390b8-4bd1-4741-b52c-975ac52fbc60 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:14.722802 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-20a390b8-4bd1-4741-b52c-975ac52fbc60 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1512 microversion: 2.1 time: 0.171783 Jul 18 03:07:14.723409 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3204/6425] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:14 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1512 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:15.741304 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-afc4ab1b-30a7-4efc-a38f-547dd1364cba tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:15.742009 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-afc4ab1b-30a7-4efc-a38f-547dd1364cba tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:15.750458 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-afc4ab1b-30a7-4efc-a38f-547dd1364cba tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:15.750916 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-afc4ab1b-30a7-4efc-a38f-547dd1364cba tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:15.751715 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-afc4ab1b-30a7-4efc-a38f-547dd1364cba tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:15.752159 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-afc4ab1b-30a7-4efc-a38f-547dd1364cba tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:15.904555 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-afc4ab1b-30a7-4efc-a38f-547dd1364cba tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:15.912533 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-afc4ab1b-30a7-4efc-a38f-547dd1364cba tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1533 microversion: 2.1 time: 0.175382 Jul 18 03:07:15.913136 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3222/6426] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:15 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1533 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:16.934380 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-032019d9-c365-4943-8c24-1835b05e4086 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:16.935277 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-032019d9-c365-4943-8c24-1835b05e4086 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:16.943712 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-032019d9-c365-4943-8c24-1835b05e4086 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:16.944153 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-032019d9-c365-4943-8c24-1835b05e4086 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:16.944944 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-032019d9-c365-4943-8c24-1835b05e4086 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:16.945380 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-032019d9-c365-4943-8c24-1835b05e4086 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:17.090320 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-032019d9-c365-4943-8c24-1835b05e4086 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:17.098540 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-032019d9-c365-4943-8c24-1835b05e4086 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1533 microversion: 2.1 time: 0.170219 Jul 18 03:07:17.099157 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3205/6427] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:16 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1533 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:18.116754 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b08d1c33-d0d3-4806-aeef-2a94fb7a63fe tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:18.117444 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b08d1c33-d0d3-4806-aeef-2a94fb7a63fe tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:18.126583 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b08d1c33-d0d3-4806-aeef-2a94fb7a63fe tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:18.127102 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b08d1c33-d0d3-4806-aeef-2a94fb7a63fe tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:18.127947 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b08d1c33-d0d3-4806-aeef-2a94fb7a63fe tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:18.128467 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b08d1c33-d0d3-4806-aeef-2a94fb7a63fe tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:18.390152 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b08d1c33-d0d3-4806-aeef-2a94fb7a63fe tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:18.410237 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b08d1c33-d0d3-4806-aeef-2a94fb7a63fe tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1528 microversion: 2.1 time: 0.297681 Jul 18 03:07:18.411447 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3223/6428] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:18 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1528 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:07:19.437375 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6a1b5b48-7aae-4e53-bc89-e12da0747a31 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:19.438469 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6a1b5b48-7aae-4e53-bc89-e12da0747a31 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:19.455537 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6a1b5b48-7aae-4e53-bc89-e12da0747a31 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:19.457693 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6a1b5b48-7aae-4e53-bc89-e12da0747a31 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:19.460348 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6a1b5b48-7aae-4e53-bc89-e12da0747a31 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:19.461542 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6a1b5b48-7aae-4e53-bc89-e12da0747a31 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:19.695755 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6a1b5b48-7aae-4e53-bc89-e12da0747a31 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:19.708110 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6a1b5b48-7aae-4e53-bc89-e12da0747a31 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1528 microversion: 2.1 time: 0.280387 Jul 18 03:07:19.709081 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3206/6429] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:19 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1528 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:19.813048 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-2aa7c600-a7db-4bb6-9383-cab0a0cbf7d7 req-2de3ce56-6851-4b31-bb6f-2c539855be77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63632c37-5811-4473-a763-d8856e28e041", "name": "network-vif-plugged", "status": "completed", "tag": "4fccf55a-5892-41d7-b49b-4098586ab81b"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:07:19.836626 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-2aa7c600-a7db-4bb6-9383-cab0a0cbf7d7 req-2de3ce56-6851-4b31-bb6f-2c539855be77 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:19.837382 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-2aa7c600-a7db-4bb6-9383-cab0a0cbf7d7 req-2de3ce56-6851-4b31-bb6f-2c539855be77 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:19.865048 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-2aa7c600-a7db-4bb6-9383-cab0a0cbf7d7 req-2de3ce56-6851-4b31-bb6f-2c539855be77 service nova] Creating event network-vif-plugged:4fccf55a-5892-41d7-b49b-4098586ab81b for instance 63632c37-5811-4473-a763-d8856e28e041 on n-h2-465891-3 Jul 18 03:07:19.880660 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-2aa7c600-a7db-4bb6-9383-cab0a0cbf7d7 req-2de3ce56-6851-4b31-bb6f-2c539855be77 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079038 Jul 18 03:07:19.882913 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3224/6430] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:07:20.727477 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b22c2cd8-6653-438b-aaa1-4fa8c7ffc958 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:20.728174 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b22c2cd8-6653-438b-aaa1-4fa8c7ffc958 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:20.738247 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b22c2cd8-6653-438b-aaa1-4fa8c7ffc958 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:20.738755 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b22c2cd8-6653-438b-aaa1-4fa8c7ffc958 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:20.739893 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b22c2cd8-6653-438b-aaa1-4fa8c7ffc958 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:20.740344 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b22c2cd8-6653-438b-aaa1-4fa8c7ffc958 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:21.011086 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b22c2cd8-6653-438b-aaa1-4fa8c7ffc958 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:21.027508 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b22c2cd8-6653-438b-aaa1-4fa8c7ffc958 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1528 microversion: 2.1 time: 0.303668 Jul 18 03:07:21.030941 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3207/6431] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:20 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1528 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:07:22.056543 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-61ff27e4-0b66-415a-8234-f809d47e634d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:22.058282 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-61ff27e4-0b66-415a-8234-f809d47e634d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:22.067017 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-61ff27e4-0b66-415a-8234-f809d47e634d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:22.067960 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-61ff27e4-0b66-415a-8234-f809d47e634d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:22.069085 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-61ff27e4-0b66-415a-8234-f809d47e634d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:22.069836 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-61ff27e4-0b66-415a-8234-f809d47e634d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:22.297801 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-61ff27e4-0b66-415a-8234-f809d47e634d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:22.315668 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-61ff27e4-0b66-415a-8234-f809d47e634d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1528 microversion: 2.1 time: 0.265847 Jul 18 03:07:22.318095 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3225/6432] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:22 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1528 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:07:23.342024 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bf98f132-373f-44c3-9dbe-6abbd52da6c0 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:23.343808 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bf98f132-373f-44c3-9dbe-6abbd52da6c0 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:23.351378 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:07:23.356511 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bf98f132-373f-44c3-9dbe-6abbd52da6c0 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:23.357334 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bf98f132-373f-44c3-9dbe-6abbd52da6c0 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:23.358594 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bf98f132-373f-44c3-9dbe-6abbd52da6c0 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:23.359258 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bf98f132-373f-44c3-9dbe-6abbd52da6c0 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:23.363845 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=100 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:07:23.578072 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bf98f132-373f-44c3-9dbe-6abbd52da6c0 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:23.594483 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bf98f132-373f-44c3-9dbe-6abbd52da6c0 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1528 microversion: 2.1 time: 0.256491 Jul 18 03:07:23.610817 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3208/6433] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:23 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1528 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:24.628989 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-07915fb1-0d8f-42a6-824b-316e3010642d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:24.629626 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-07915fb1-0d8f-42a6-824b-316e3010642d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:24.639852 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-07915fb1-0d8f-42a6-824b-316e3010642d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:24.640428 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-07915fb1-0d8f-42a6-824b-316e3010642d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:24.641340 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-07915fb1-0d8f-42a6-824b-316e3010642d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:24.641915 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-07915fb1-0d8f-42a6-824b-316e3010642d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:24.835428 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-07915fb1-0d8f-42a6-824b-316e3010642d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:24.849763 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-07915fb1-0d8f-42a6-824b-316e3010642d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1528 microversion: 2.1 time: 0.225314 Jul 18 03:07:24.850793 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3226/6434] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:24 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1528 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:25.872065 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-adfd7605-736c-4a39-9453-5e9c06181c9e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:25.873969 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-adfd7605-736c-4a39-9453-5e9c06181c9e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:25.884616 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-adfd7605-736c-4a39-9453-5e9c06181c9e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:25.885417 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-adfd7605-736c-4a39-9453-5e9c06181c9e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:25.887370 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-adfd7605-736c-4a39-9453-5e9c06181c9e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:25.888146 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-adfd7605-736c-4a39-9453-5e9c06181c9e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:26.103357 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-adfd7605-736c-4a39-9453-5e9c06181c9e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:26.112851 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-adfd7605-736c-4a39-9453-5e9c06181c9e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1528 microversion: 2.1 time: 0.248298 Jul 18 03:07:26.113488 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3209/6435] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:25 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1528 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:27.131043 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f23b003c-e324-4590-91cc-ec442f47558b tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:27.131905 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f23b003c-e324-4590-91cc-ec442f47558b tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:27.139665 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f23b003c-e324-4590-91cc-ec442f47558b tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:27.140219 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f23b003c-e324-4590-91cc-ec442f47558b tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:27.141085 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f23b003c-e324-4590-91cc-ec442f47558b tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:27.141549 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f23b003c-e324-4590-91cc-ec442f47558b tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:27.305276 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f23b003c-e324-4590-91cc-ec442f47558b tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:27.313470 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f23b003c-e324-4590-91cc-ec442f47558b tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1528 microversion: 2.1 time: 0.186196 Jul 18 03:07:27.314137 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3227/6436] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:27 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1528 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:28.330777 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-85397103-ca02-4ea4-8e40-219f26a450a5 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:28.331394 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-85397103-ca02-4ea4-8e40-219f26a450a5 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:28.339485 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-85397103-ca02-4ea4-8e40-219f26a450a5 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:28.339937 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-85397103-ca02-4ea4-8e40-219f26a450a5 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:28.340719 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-85397103-ca02-4ea4-8e40-219f26a450a5 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:28.341161 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-85397103-ca02-4ea4-8e40-219f26a450a5 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:28.479677 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-85397103-ca02-4ea4-8e40-219f26a450a5 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:28.489569 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-85397103-ca02-4ea4-8e40-219f26a450a5 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1510 microversion: 2.1 time: 0.162612 Jul 18 03:07:28.490300 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3210/6437] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:28 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:29.509360 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a50c41c6-c901-422a-9156-4d41d63a652b tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:29.510087 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a50c41c6-c901-422a-9156-4d41d63a652b tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:29.517420 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a50c41c6-c901-422a-9156-4d41d63a652b tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:29.517913 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a50c41c6-c901-422a-9156-4d41d63a652b tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:29.518700 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a50c41c6-c901-422a-9156-4d41d63a652b tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:29.519150 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a50c41c6-c901-422a-9156-4d41d63a652b tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:29.667719 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a50c41c6-c901-422a-9156-4d41d63a652b tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:29.675647 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a50c41c6-c901-422a-9156-4d41d63a652b tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1510 microversion: 2.1 time: 0.171124 Jul 18 03:07:29.676244 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3228/6438] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:29 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1510 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:29.761014 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-282d62e2-7206-408b-a00e-47c42eea54cb req-77778f88-ff8c-44aa-9615-b745771f5074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63632c37-5811-4473-a763-d8856e28e041", "name": "network-vif-unplugged", "status": "completed", "tag": "4fccf55a-5892-41d7-b49b-4098586ab81b"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:07:29.770686 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-282d62e2-7206-408b-a00e-47c42eea54cb req-77778f88-ff8c-44aa-9615-b745771f5074 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:29.771136 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-282d62e2-7206-408b-a00e-47c42eea54cb req-77778f88-ff8c-44aa-9615-b745771f5074 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:29.783152 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-282d62e2-7206-408b-a00e-47c42eea54cb req-77778f88-ff8c-44aa-9615-b745771f5074 service nova] Creating event network-vif-unplugged:4fccf55a-5892-41d7-b49b-4098586ab81b for instance 63632c37-5811-4473-a763-d8856e28e041 on n-h2-465891-3 Jul 18 03:07:29.788447 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-282d62e2-7206-408b-a00e-47c42eea54cb req-77778f88-ff8c-44aa-9615-b745771f5074 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031733 Jul 18 03:07:29.789154 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3211/6439] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:07:30.694534 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4910ac83-c78a-4a9b-988a-bdb1a96284b3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:30.695139 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4910ac83-c78a-4a9b-988a-bdb1a96284b3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:30.702873 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4910ac83-c78a-4a9b-988a-bdb1a96284b3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:30.703333 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4910ac83-c78a-4a9b-988a-bdb1a96284b3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:30.704134 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4910ac83-c78a-4a9b-988a-bdb1a96284b3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:30.704586 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4910ac83-c78a-4a9b-988a-bdb1a96284b3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:30.847841 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4910ac83-c78a-4a9b-988a-bdb1a96284b3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:30.856546 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4910ac83-c78a-4a9b-988a-bdb1a96284b3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1513 microversion: 2.1 time: 0.165869 Jul 18 03:07:30.857153 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3229/6440] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:30 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:30.876679 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0d06e243-25b3-4bf9-b25d-8c2fde162e66 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:30.877430 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0d06e243-25b3-4bf9-b25d-8c2fde162e66 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:30.883912 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0d06e243-25b3-4bf9-b25d-8c2fde162e66 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:30.884362 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0d06e243-25b3-4bf9-b25d-8c2fde162e66 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:30.885145 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0d06e243-25b3-4bf9-b25d-8c2fde162e66 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:30.885593 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0d06e243-25b3-4bf9-b25d-8c2fde162e66 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:31.041237 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0d06e243-25b3-4bf9-b25d-8c2fde162e66 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:31.049219 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0d06e243-25b3-4bf9-b25d-8c2fde162e66 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1513 microversion: 2.1 time: 0.178635 Jul 18 03:07:31.049839 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3212/6441] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:30 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1513 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:31.094853 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a0a5ed47-0be5-4c20-816a-a4cd0716294f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:07:31.095439 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a0a5ed47-0be5-4c20-816a-a4cd0716294f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:31.101853 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a0a5ed47-0be5-4c20-816a-a4cd0716294f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:31.102313 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a0a5ed47-0be5-4c20-816a-a4cd0716294f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:31.103202 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a0a5ed47-0be5-4c20-816a-a4cd0716294f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:31.103650 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a0a5ed47-0be5-4c20-816a-a4cd0716294f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:31.131346 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-a0a5ed47-0be5-4c20-816a-a4cd0716294f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lazy-loading 'flavor' on Instance uuid 63632c37-5811-4473-a763-d8856e28e041 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:07:31.145602 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-a0a5ed47-0be5-4c20-816a-a4cd0716294f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] HTTP exception thrown: Cannot 'shelve' instance 63632c37-5811-4473-a763-d8856e28e041 while it is in vm_state shelved_offloaded Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a0a5ed47-0be5-4c20-816a-a4cd0716294f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041/action HTTP/1.1 Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 14 Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: {"shelve": {}} Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: exception: Cannot 'shelve' instance 63632c37-5811-4473-a763-d8856e28e041 while it is in vm_state shelved_offloaded Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '63632c37-5811-4473-a763-d8856e28e041', 'body': {'shelve': {}}} Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 63632c37-5811-4473-a763-d8856e28e041 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Jul 18 03:07:31.147763 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 03:07:31.156443 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 03:07:31.156443 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 03:07:31.156443 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 63632c37-5811-4473-a763-d8856e28e041 while it is in vm_state shelved_offloaded Jul 18 03:07:31.156443 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:31.156443 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:31.156443 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:31.156443 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:31.156443 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:31.156443 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:31.156443 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:07:31.156443 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:07:31.156443 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 63632c37-5811-4473-a763-d8856e28e041 while it is in vm_state shelved_offloaded Jul 18 03:07:31.156443 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:31.156443 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a0a5ed47-0be5-4c20-816a-a4cd0716294f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 409 to user: Cannot 'shelve' instance 63632c37-5811-4473-a763-d8856e28e041 while it is in vm_state shelved_offloaded {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:07:31.156443 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a0a5ed47-0be5-4c20-816a-a4cd0716294f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "POST /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041/action" status: 409 len: 155 microversion: 2.1 time: 0.058740 Jul 18 03:07:31.156443 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3230/6442] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:07:31 2022] POST /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041/action => generated 155 bytes in 60 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 03:07:31.163237 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-eda2af47-789c-44ec-bd03-ebfa081e89c3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:07:31.163807 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-eda2af47-789c-44ec-bd03-ebfa081e89c3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:31.171685 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eda2af47-789c-44ec-bd03-ebfa081e89c3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:31.172129 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eda2af47-789c-44ec-bd03-ebfa081e89c3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:31.172901 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eda2af47-789c-44ec-bd03-ebfa081e89c3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:31.173326 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eda2af47-789c-44ec-bd03-ebfa081e89c3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:31.300067 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-eda2af47-789c-44ec-bd03-ebfa081e89c3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "POST /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041/action" status: 202 len: 0 microversion: 2.1 time: 0.140590 Jul 18 03:07:31.300638 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3213/6443] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:07:31 2022] POST /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:07:31.314339 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-55c49a82-a07a-4687-8ef3-26d0f19286f3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:31.315405 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-55c49a82-a07a-4687-8ef3-26d0f19286f3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:31.325158 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-55c49a82-a07a-4687-8ef3-26d0f19286f3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:31.325659 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-55c49a82-a07a-4687-8ef3-26d0f19286f3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:31.326526 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-55c49a82-a07a-4687-8ef3-26d0f19286f3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:31.326992 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-55c49a82-a07a-4687-8ef3-26d0f19286f3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:31.330172 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:07:31.496525 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-55c49a82-a07a-4687-8ef3-26d0f19286f3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:31.504542 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-55c49a82-a07a-4687-8ef3-26d0f19286f3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1461 microversion: 2.1 time: 0.198030 Jul 18 03:07:31.505130 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3231/6444] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:31 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1461 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:32.530535 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-98536cdc-bea5-4010-b4eb-da84917f4f90 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:32.531168 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-98536cdc-bea5-4010-b4eb-da84917f4f90 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:32.537500 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-98536cdc-bea5-4010-b4eb-da84917f4f90 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:32.537983 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-98536cdc-bea5-4010-b4eb-da84917f4f90 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:32.538799 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-98536cdc-bea5-4010-b4eb-da84917f4f90 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:32.539547 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-98536cdc-bea5-4010-b4eb-da84917f4f90 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:32.716005 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-98536cdc-bea5-4010-b4eb-da84917f4f90 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:32.732494 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-98536cdc-bea5-4010-b4eb-da84917f4f90 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1463 microversion: 2.1 time: 0.206212 Jul 18 03:07:32.733578 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3214/6445] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:32 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1463 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:33.762143 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0e625c83-24d7-4e9a-a615-552af03c8b1e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:33.763257 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0e625c83-24d7-4e9a-a615-552af03c8b1e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:33.766674 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=38 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:07:33.779721 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0e625c83-24d7-4e9a-a615-552af03c8b1e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:33.780458 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0e625c83-24d7-4e9a-a615-552af03c8b1e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:33.781672 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0e625c83-24d7-4e9a-a615-552af03c8b1e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:33.782508 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0e625c83-24d7-4e9a-a615-552af03c8b1e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:34.009652 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0e625c83-24d7-4e9a-a615-552af03c8b1e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:34.031632 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0e625c83-24d7-4e9a-a615-552af03c8b1e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1519 microversion: 2.1 time: 0.274219 Jul 18 03:07:34.041939 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3232/6446] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:33 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1519 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:35.064521 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-efc975ed-be49-483a-9292-775d38e9d547 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:35.065443 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-efc975ed-be49-483a-9292-775d38e9d547 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:35.077180 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-efc975ed-be49-483a-9292-775d38e9d547 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:35.077981 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-efc975ed-be49-483a-9292-775d38e9d547 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:35.079011 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-efc975ed-be49-483a-9292-775d38e9d547 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:35.079646 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-efc975ed-be49-483a-9292-775d38e9d547 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:35.262785 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-efc975ed-be49-483a-9292-775d38e9d547 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:35.275783 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-efc975ed-be49-483a-9292-775d38e9d547 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1519 microversion: 2.1 time: 0.216087 Jul 18 03:07:35.276908 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3215/6447] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:35 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1519 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:36.297525 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f606677e-e67f-47ba-b998-d0d639ddc8c3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:36.298295 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f606677e-e67f-47ba-b998-d0d639ddc8c3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:36.315255 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f606677e-e67f-47ba-b998-d0d639ddc8c3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:36.316101 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f606677e-e67f-47ba-b998-d0d639ddc8c3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:36.319190 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f606677e-e67f-47ba-b998-d0d639ddc8c3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:36.320771 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f606677e-e67f-47ba-b998-d0d639ddc8c3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:36.502573 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f606677e-e67f-47ba-b998-d0d639ddc8c3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:36.514353 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f606677e-e67f-47ba-b998-d0d639ddc8c3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1519 microversion: 2.1 time: 0.221277 Jul 18 03:07:36.515278 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3233/6448] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:36 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1519 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:37.536166 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f710e685-74ca-446e-9f39-bf8c04798f7f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:37.537645 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f710e685-74ca-446e-9f39-bf8c04798f7f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:37.554009 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f710e685-74ca-446e-9f39-bf8c04798f7f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:37.555204 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f710e685-74ca-446e-9f39-bf8c04798f7f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:37.555961 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f710e685-74ca-446e-9f39-bf8c04798f7f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:37.556389 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f710e685-74ca-446e-9f39-bf8c04798f7f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:37.715927 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f710e685-74ca-446e-9f39-bf8c04798f7f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:37.724260 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f710e685-74ca-446e-9f39-bf8c04798f7f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1519 microversion: 2.1 time: 0.194719 Jul 18 03:07:37.724852 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3216/6449] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:37 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1519 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:38.743390 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4f8e071c-b828-4899-b25b-4c1eb205024f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:38.744227 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4f8e071c-b828-4899-b25b-4c1eb205024f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:38.752228 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4f8e071c-b828-4899-b25b-4c1eb205024f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:38.752795 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4f8e071c-b828-4899-b25b-4c1eb205024f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:38.753682 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4f8e071c-b828-4899-b25b-4c1eb205024f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:38.754170 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4f8e071c-b828-4899-b25b-4c1eb205024f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:38.923132 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4f8e071c-b828-4899-b25b-4c1eb205024f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:38.934538 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4f8e071c-b828-4899-b25b-4c1eb205024f tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1519 microversion: 2.1 time: 0.195932 Jul 18 03:07:38.935141 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3234/6450] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:38 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1519 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:39.953308 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ffc09bbb-fff9-4387-af00-e7c2133f1ad2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:39.954062 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ffc09bbb-fff9-4387-af00-e7c2133f1ad2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:39.962588 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ffc09bbb-fff9-4387-af00-e7c2133f1ad2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:39.963513 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ffc09bbb-fff9-4387-af00-e7c2133f1ad2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:39.964733 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ffc09bbb-fff9-4387-af00-e7c2133f1ad2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:39.965268 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ffc09bbb-fff9-4387-af00-e7c2133f1ad2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:40.161494 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ffc09bbb-fff9-4387-af00-e7c2133f1ad2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:40.171271 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ffc09bbb-fff9-4387-af00-e7c2133f1ad2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1519 microversion: 2.1 time: 0.222424 Jul 18 03:07:40.172090 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3217/6451] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:39 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1519 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:07:41.188857 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0a84f690-9919-4a05-8a7b-4d1269d4e2e4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:41.190153 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0a84f690-9919-4a05-8a7b-4d1269d4e2e4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:41.207217 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0a84f690-9919-4a05-8a7b-4d1269d4e2e4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:41.209409 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0a84f690-9919-4a05-8a7b-4d1269d4e2e4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:41.211399 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0a84f690-9919-4a05-8a7b-4d1269d4e2e4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:41.212307 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0a84f690-9919-4a05-8a7b-4d1269d4e2e4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:41.390188 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0a84f690-9919-4a05-8a7b-4d1269d4e2e4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:41.402095 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0a84f690-9919-4a05-8a7b-4d1269d4e2e4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1519 microversion: 2.1 time: 0.216432 Jul 18 03:07:41.402751 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3235/6452] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:41 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1519 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:07:42.424078 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ea6f19bd-2b6a-48bf-8cf3-ca588a2d8dc2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:42.424755 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ea6f19bd-2b6a-48bf-8cf3-ca588a2d8dc2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:42.437915 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea6f19bd-2b6a-48bf-8cf3-ca588a2d8dc2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:42.438725 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea6f19bd-2b6a-48bf-8cf3-ca588a2d8dc2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:42.440160 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea6f19bd-2b6a-48bf-8cf3-ca588a2d8dc2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:42.440956 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea6f19bd-2b6a-48bf-8cf3-ca588a2d8dc2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:42.629888 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ea6f19bd-2b6a-48bf-8cf3-ca588a2d8dc2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:42.638054 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ea6f19bd-2b6a-48bf-8cf3-ca588a2d8dc2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1519 microversion: 2.1 time: 0.218799 Jul 18 03:07:42.638638 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3218/6453] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:42 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1519 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:43.654552 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4431a9b1-a7be-4248-b9b7-29c3a32393ca tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:43.655180 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4431a9b1-a7be-4248-b9b7-29c3a32393ca tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:43.662226 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4431a9b1-a7be-4248-b9b7-29c3a32393ca tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:43.662689 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4431a9b1-a7be-4248-b9b7-29c3a32393ca tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:43.663484 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4431a9b1-a7be-4248-b9b7-29c3a32393ca tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:43.663930 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4431a9b1-a7be-4248-b9b7-29c3a32393ca tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:43.871529 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4431a9b1-a7be-4248-b9b7-29c3a32393ca tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:43.879408 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4431a9b1-a7be-4248-b9b7-29c3a32393ca tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1519 microversion: 2.1 time: 0.228835 Jul 18 03:07:43.880055 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3236/6454] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:43 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1519 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:44.897263 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-243f6401-9d82-4165-8c54-0c33d0888777 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:44.899249 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-243f6401-9d82-4165-8c54-0c33d0888777 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:44.906923 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-243f6401-9d82-4165-8c54-0c33d0888777 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:44.907371 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-243f6401-9d82-4165-8c54-0c33d0888777 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:44.908163 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-243f6401-9d82-4165-8c54-0c33d0888777 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:44.908603 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-243f6401-9d82-4165-8c54-0c33d0888777 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:45.053325 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-243f6401-9d82-4165-8c54-0c33d0888777 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:45.062735 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-243f6401-9d82-4165-8c54-0c33d0888777 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1519 microversion: 2.1 time: 0.169410 Jul 18 03:07:45.063345 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3219/6455] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:44 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:46.080768 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a1dc1d65-93c5-4479-b825-49b153c3fdc6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:46.081373 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a1dc1d65-93c5-4479-b825-49b153c3fdc6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:46.088574 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a1dc1d65-93c5-4479-b825-49b153c3fdc6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:46.089049 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a1dc1d65-93c5-4479-b825-49b153c3fdc6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:46.089882 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a1dc1d65-93c5-4479-b825-49b153c3fdc6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:46.090334 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a1dc1d65-93c5-4479-b825-49b153c3fdc6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:46.237429 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a1dc1d65-93c5-4479-b825-49b153c3fdc6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:46.246380 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a1dc1d65-93c5-4479-b825-49b153c3fdc6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1519 microversion: 2.1 time: 0.169481 Jul 18 03:07:46.246995 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3237/6456] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:46 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:47.265494 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b66839bb-2b93-4bff-a42c-893326760de0 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:47.266114 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b66839bb-2b93-4bff-a42c-893326760de0 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:47.276503 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b66839bb-2b93-4bff-a42c-893326760de0 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:47.277280 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b66839bb-2b93-4bff-a42c-893326760de0 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:47.278483 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b66839bb-2b93-4bff-a42c-893326760de0 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:47.279336 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b66839bb-2b93-4bff-a42c-893326760de0 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:47.433438 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b66839bb-2b93-4bff-a42c-893326760de0 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:47.441259 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b66839bb-2b93-4bff-a42c-893326760de0 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1519 microversion: 2.1 time: 0.179811 Jul 18 03:07:47.441878 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3220/6457] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:47 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1519 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:47.891396 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-d671a2c9-4f29-4f26-9f10-71c7b635a78c req-9fd8c1a5-d8dd-4ed4-b990-41b72eb45595 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63632c37-5811-4473-a763-d8856e28e041", "name": "network-vif-plugged", "status": "completed", "tag": "4fccf55a-5892-41d7-b49b-4098586ab81b"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:07:47.912605 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-d671a2c9-4f29-4f26-9f10-71c7b635a78c req-9fd8c1a5-d8dd-4ed4-b990-41b72eb45595 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:47.914508 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-d671a2c9-4f29-4f26-9f10-71c7b635a78c req-9fd8c1a5-d8dd-4ed4-b990-41b72eb45595 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:47.938584 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-d671a2c9-4f29-4f26-9f10-71c7b635a78c req-9fd8c1a5-d8dd-4ed4-b990-41b72eb45595 service nova] Creating event network-vif-plugged:4fccf55a-5892-41d7-b49b-4098586ab81b for instance 63632c37-5811-4473-a763-d8856e28e041 on n-h2-465891-3 Jul 18 03:07:47.947876 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-d671a2c9-4f29-4f26-9f10-71c7b635a78c req-9fd8c1a5-d8dd-4ed4-b990-41b72eb45595 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063267 Jul 18 03:07:47.948527 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3238/6458] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:07:48.459815 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cf41087d-4ee2-4fa3-b7ea-adf8365cd728 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:48.461221 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cf41087d-4ee2-4fa3-b7ea-adf8365cd728 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:48.468573 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cf41087d-4ee2-4fa3-b7ea-adf8365cd728 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:48.469032 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cf41087d-4ee2-4fa3-b7ea-adf8365cd728 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:48.469840 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cf41087d-4ee2-4fa3-b7ea-adf8365cd728 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:48.470281 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cf41087d-4ee2-4fa3-b7ea-adf8365cd728 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:48.610994 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-cf41087d-4ee2-4fa3-b7ea-adf8365cd728 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:48.621369 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cf41087d-4ee2-4fa3-b7ea-adf8365cd728 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1519 microversion: 2.1 time: 0.165487 Jul 18 03:07:48.622017 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3221/6459] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:48 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:49.642770 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ec6a8f73-096b-49e8-81ef-f2c19a08de0c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:49.644415 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ec6a8f73-096b-49e8-81ef-f2c19a08de0c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:49.656818 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ec6a8f73-096b-49e8-81ef-f2c19a08de0c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:49.657757 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ec6a8f73-096b-49e8-81ef-f2c19a08de0c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:49.659100 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ec6a8f73-096b-49e8-81ef-f2c19a08de0c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:49.659876 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ec6a8f73-096b-49e8-81ef-f2c19a08de0c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:49.888843 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ec6a8f73-096b-49e8-81ef-f2c19a08de0c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:49.904348 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ec6a8f73-096b-49e8-81ef-f2c19a08de0c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1519 microversion: 2.1 time: 0.268604 Jul 18 03:07:49.905458 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3239/6460] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:49 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1519 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:07:50.924068 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3eae2625-7898-4985-a741-4eee5bcac03d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:50.924963 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3eae2625-7898-4985-a741-4eee5bcac03d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:50.933791 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3eae2625-7898-4985-a741-4eee5bcac03d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:50.934337 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3eae2625-7898-4985-a741-4eee5bcac03d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:50.935202 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3eae2625-7898-4985-a741-4eee5bcac03d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:50.935799 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3eae2625-7898-4985-a741-4eee5bcac03d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:51.080254 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3eae2625-7898-4985-a741-4eee5bcac03d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:51.088157 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3eae2625-7898-4985-a741-4eee5bcac03d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.168113 Jul 18 03:07:51.088755 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3222/6461] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:50 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:51.105154 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3828e5bb-9beb-4b77-a30d-374bb4046d5c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:51.105821 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3828e5bb-9beb-4b77-a30d-374bb4046d5c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:51.115396 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3828e5bb-9beb-4b77-a30d-374bb4046d5c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:51.116505 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3828e5bb-9beb-4b77-a30d-374bb4046d5c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:51.117426 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3828e5bb-9beb-4b77-a30d-374bb4046d5c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:51.117822 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3828e5bb-9beb-4b77-a30d-374bb4046d5c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:51.266653 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3828e5bb-9beb-4b77-a30d-374bb4046d5c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:51.275505 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3828e5bb-9beb-4b77-a30d-374bb4046d5c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.174315 Jul 18 03:07:51.276113 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3240/6462] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:51 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:51.302965 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-49827558-1b6c-494a-b331-be27663dd4db tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:51.305225 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-49827558-1b6c-494a-b331-be27663dd4db tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:51.312620 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-49827558-1b6c-494a-b331-be27663dd4db tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:51.313078 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-49827558-1b6c-494a-b331-be27663dd4db tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:51.313928 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-49827558-1b6c-494a-b331-be27663dd4db tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:51.314374 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-49827558-1b6c-494a-b331-be27663dd4db tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:51.463888 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-49827558-1b6c-494a-b331-be27663dd4db tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:51.475003 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-49827558-1b6c-494a-b331-be27663dd4db tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.177279 Jul 18 03:07:51.476047 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3223/6463] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:51 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:07:51.496366 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4dea4e5e-af8e-44bc-ad53-abc18b68888c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:07:51.503567 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-4dea4e5e-af8e-44bc-ad53-abc18b68888c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] HTTP exception thrown: Instance a029691b-a87c-42c4-bf65-6a66d76fbf67 has no mapping to a cell. Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4dea4e5e-af8e-44bc-ad53-abc18b68888c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/servers/a029691b-a87c-42c4-bf65-6a66d76fbf67/action HTTP/1.1 Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 15 Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: {"os-stop": {}} Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance a029691b-a87c-42c4-bf65-6a66d76fbf67 has no mapping to a cell. Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'a029691b-a87c-42c4-bf65-6a66d76fbf67', 'body': {'os-stop': {}}} Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance a029691b-a87c-42c4-bf65-6a66d76fbf67 has no mapping to a cell. Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:07:51.512331 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a029691b-a87c-42c4-bf65-6a66d76fbf67 has no mapping to a cell. Jul 18 03:07:51.518665 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:51.518665 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:51.518665 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:51.518665 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:51.518665 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:51.518665 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:51.518665 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:07:51.518665 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:07:51.518665 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a029691b-a87c-42c4-bf65-6a66d76fbf67 has no mapping to a cell. Jul 18 03:07:51.518665 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:51.518665 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4dea4e5e-af8e-44bc-ad53-abc18b68888c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 404 to user: Instance a029691b-a87c-42c4-bf65-6a66d76fbf67 has no mapping to a cell. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:07:51.518665 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4dea4e5e-af8e-44bc-ad53-abc18b68888c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "POST /compute/v2.1/servers/a029691b-a87c-42c4-bf65-6a66d76fbf67/action" status: 404 len: 117 microversion: 2.1 time: 0.021976 Jul 18 03:07:51.518665 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3241/6464] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:07:51 2022] POST /compute/v2.1/servers/a029691b-a87c-42c4-bf65-6a66d76fbf67/action => generated 117 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:07:51.526435 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b88518e9-1721-4a14-a801-d906239dfe5c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:51.527052 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b88518e9-1721-4a14-a801-d906239dfe5c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:51.533489 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b88518e9-1721-4a14-a801-d906239dfe5c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:51.533967 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b88518e9-1721-4a14-a801-d906239dfe5c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:51.534756 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b88518e9-1721-4a14-a801-d906239dfe5c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:51.535191 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b88518e9-1721-4a14-a801-d906239dfe5c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:51.552061 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:07:51.696587 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b88518e9-1721-4a14-a801-d906239dfe5c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:51.711428 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b88518e9-1721-4a14-a801-d906239dfe5c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.189312 Jul 18 03:07:51.712820 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3224/6465] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:51 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:51.740965 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7d0b5534-9bac-4594-a074-4ac8aab079fb tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:51.743112 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7d0b5534-9bac-4594-a074-4ac8aab079fb tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:51.754465 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7d0b5534-9bac-4594-a074-4ac8aab079fb tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:51.755245 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7d0b5534-9bac-4594-a074-4ac8aab079fb tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:51.757385 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7d0b5534-9bac-4594-a074-4ac8aab079fb tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:51.758406 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7d0b5534-9bac-4594-a074-4ac8aab079fb tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:51.941974 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7d0b5534-9bac-4594-a074-4ac8aab079fb tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:51.955252 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7d0b5534-9bac-4594-a074-4ac8aab079fb tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.220404 Jul 18 03:07:51.956648 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3242/6466] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:51 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:51.982467 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b1bee948-dd5a-43ea-8f2f-af47ca3142aa tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:07:51.983336 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b1bee948-dd5a-43ea-8f2f-af47ca3142aa tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 5c9beac1-95f7-418c-ae92-7af5ceb93072] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:51.995722 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-b1bee948-dd5a-43ea-8f2f-af47ca3142aa tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] HTTP exception thrown: Instance 5c9beac1-95f7-418c-ae92-7af5ceb93072 could not be found. Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b1bee948-dd5a-43ea-8f2f-af47ca3142aa tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers/5c9beac1-95f7-418c-ae92-7af5ceb93072/action HTTP/1.1 Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 15 Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: {"suspend": {}} Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 5c9beac1-95f7-418c-ae92-7af5ceb93072 could not be found. Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '5c9beac1-95f7-418c-ae92-7af5ceb93072', 'body': {'suspend': {}}} Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c9beac1-95f7-418c-ae92-7af5ceb93072 could not be found. Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c9beac1-95f7-418c-ae92-7af5ceb93072 could not be found. Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:51.999098 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:52.004163 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:07:52.004163 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:07:52.004163 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c9beac1-95f7-418c-ae92-7af5ceb93072 could not be found. Jul 18 03:07:52.004163 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:52.004163 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b1bee948-dd5a-43ea-8f2f-af47ca3142aa tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 404 to user: Instance 5c9beac1-95f7-418c-ae92-7af5ceb93072 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:07:52.004163 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b1bee948-dd5a-43ea-8f2f-af47ca3142aa tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "POST /compute/v2.1/servers/5c9beac1-95f7-418c-ae92-7af5ceb93072/action" status: 404 len: 111 microversion: 2.1 time: 0.027801 Jul 18 03:07:52.004163 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3225/6467] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:07:51 2022] POST /compute/v2.1/servers/5c9beac1-95f7-418c-ae92-7af5ceb93072/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:07:52.012315 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9745fc3f-bf7a-439e-b769-31e169be7247 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:52.013002 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9745fc3f-bf7a-439e-b769-31e169be7247 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:52.020268 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9745fc3f-bf7a-439e-b769-31e169be7247 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:52.020731 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9745fc3f-bf7a-439e-b769-31e169be7247 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:52.021528 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9745fc3f-bf7a-439e-b769-31e169be7247 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:52.022009 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9745fc3f-bf7a-439e-b769-31e169be7247 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:52.183792 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9745fc3f-bf7a-439e-b769-31e169be7247 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:52.191899 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9745fc3f-bf7a-439e-b769-31e169be7247 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.184303 Jul 18 03:07:52.192504 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3243/6468] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:52 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:52.210336 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a6a40353-75d5-4dcd-a31a-378ef9636b61 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:52.211106 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a6a40353-75d5-4dcd-a31a-378ef9636b61 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:52.220916 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a6a40353-75d5-4dcd-a31a-378ef9636b61 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:52.221380 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a6a40353-75d5-4dcd-a31a-378ef9636b61 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:52.222215 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a6a40353-75d5-4dcd-a31a-378ef9636b61 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:52.222662 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a6a40353-75d5-4dcd-a31a-378ef9636b61 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:52.383788 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a6a40353-75d5-4dcd-a31a-378ef9636b61 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:52.391810 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a6a40353-75d5-4dcd-a31a-378ef9636b61 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.186269 Jul 18 03:07:52.392398 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3226/6469] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:52 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:52.410150 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6a6ff50b-95bd-4961-a10f-e079ee3623fc tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:07:52.410761 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6a6ff50b-95bd-4961-a10f-e079ee3623fc tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:52.419357 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a6ff50b-95bd-4961-a10f-e079ee3623fc tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:52.419953 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a6ff50b-95bd-4961-a10f-e079ee3623fc tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:52.420858 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a6ff50b-95bd-4961-a10f-e079ee3623fc tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:52.421300 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a6ff50b-95bd-4961-a10f-e079ee3623fc tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:52.451476 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-6a6ff50b-95bd-4961-a10f-e079ee3623fc tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lazy-loading 'flavor' on Instance uuid 63632c37-5811-4473-a763-d8856e28e041 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:07:52.534216 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6a6ff50b-95bd-4961-a10f-e079ee3623fc tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "POST /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041/action" status: 202 len: 0 microversion: 2.1 time: 0.127445 Jul 18 03:07:52.535452 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3244/6470] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:07:52 2022] POST /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:07:52.545724 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d47bc359-f4b8-49eb-a882-1cf115eeaf3c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:52.546881 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d47bc359-f4b8-49eb-a882-1cf115eeaf3c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:52.558736 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d47bc359-f4b8-49eb-a882-1cf115eeaf3c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:52.559820 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d47bc359-f4b8-49eb-a882-1cf115eeaf3c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:52.561476 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d47bc359-f4b8-49eb-a882-1cf115eeaf3c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:52.562677 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d47bc359-f4b8-49eb-a882-1cf115eeaf3c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:52.713428 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d47bc359-f4b8-49eb-a882-1cf115eeaf3c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:52.726204 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d47bc359-f4b8-49eb-a882-1cf115eeaf3c tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1514 microversion: 2.1 time: 0.185178 Jul 18 03:07:52.727569 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3227/6471] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:52 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1514 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:53.746458 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-52b5a035-64e0-439c-bd19-1ac8377a016e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:53.747266 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-52b5a035-64e0-439c-bd19-1ac8377a016e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:53.757060 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-52b5a035-64e0-439c-bd19-1ac8377a016e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:53.757613 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-52b5a035-64e0-439c-bd19-1ac8377a016e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:53.758689 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-52b5a035-64e0-439c-bd19-1ac8377a016e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:53.759243 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-52b5a035-64e0-439c-bd19-1ac8377a016e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:53.919850 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-52b5a035-64e0-439c-bd19-1ac8377a016e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:53.928658 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-52b5a035-64e0-439c-bd19-1ac8377a016e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1497 microversion: 2.1 time: 0.187082 Jul 18 03:07:53.929482 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3245/6472] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:53 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1497 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:53.947751 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-026f6fc3-dc9e-4693-b808-c71cdf7d009e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:07:53.948395 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-026f6fc3-dc9e-4693-b808-c71cdf7d009e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:53.951326 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=42 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:07:53.957439 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-026f6fc3-dc9e-4693-b808-c71cdf7d009e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:53.957932 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-026f6fc3-dc9e-4693-b808-c71cdf7d009e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:53.958724 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-026f6fc3-dc9e-4693-b808-c71cdf7d009e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:53.959155 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-026f6fc3-dc9e-4693-b808-c71cdf7d009e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:53.985441 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-026f6fc3-dc9e-4693-b808-c71cdf7d009e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lazy-loading 'flavor' on Instance uuid 63632c37-5811-4473-a763-d8856e28e041 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:07:53.999939 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-026f6fc3-dc9e-4693-b808-c71cdf7d009e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] HTTP exception thrown: Cannot 'suspend' instance 63632c37-5811-4473-a763-d8856e28e041 while it is in vm_state suspended Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-026f6fc3-dc9e-4693-b808-c71cdf7d009e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041/action HTTP/1.1 Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 15 Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: {"suspend": {}} Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: exception: Cannot 'suspend' instance 63632c37-5811-4473-a763-d8856e28e041 while it is in vm_state suspended Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '63632c37-5811-4473-a763-d8856e28e041', 'body': {'suspend': {}}} Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 63632c37-5811-4473-a763-d8856e28e041 in vm_state suspended. Cannot suspend while the instance is in this state. Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Jul 18 03:07:54.001482 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 03:07:54.007195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 03:07:54.007195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 03:07:54.007195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 63632c37-5811-4473-a763-d8856e28e041 while it is in vm_state suspended Jul 18 03:07:54.007195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:54.007195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:54.007195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:54.007195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:54.007195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:54.007195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:54.007195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:07:54.007195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:07:54.007195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 63632c37-5811-4473-a763-d8856e28e041 while it is in vm_state suspended Jul 18 03:07:54.007195 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:54.007195 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-026f6fc3-dc9e-4693-b808-c71cdf7d009e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 409 to user: Cannot 'suspend' instance 63632c37-5811-4473-a763-d8856e28e041 while it is in vm_state suspended {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:07:54.007195 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-026f6fc3-dc9e-4693-b808-c71cdf7d009e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "POST /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041/action" status: 409 len: 148 microversion: 2.1 time: 0.060022 Jul 18 03:07:54.007195 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3228/6473] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:07:53 2022] POST /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041/action => generated 148 bytes in 61 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 18 03:07:54.017529 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b2b92657-c38e-4f87-9559-50b54d3dd0a2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:07:54.018567 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b2b92657-c38e-4f87-9559-50b54d3dd0a2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:54.030012 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b2b92657-c38e-4f87-9559-50b54d3dd0a2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:54.030829 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b2b92657-c38e-4f87-9559-50b54d3dd0a2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:54.032244 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b2b92657-c38e-4f87-9559-50b54d3dd0a2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:54.033080 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b2b92657-c38e-4f87-9559-50b54d3dd0a2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:54.123243 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:07:54.141290 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b2b92657-c38e-4f87-9559-50b54d3dd0a2 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "POST /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041/action" status: 202 len: 0 microversion: 2.1 time: 0.130698 Jul 18 03:07:54.142550 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3246/6474] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:07:54 2022] POST /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:07:54.153101 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fbd37118-06c9-4820-8f18-902e80938ce5 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:54.154106 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fbd37118-06c9-4820-8f18-902e80938ce5 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:54.163186 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fbd37118-06c9-4820-8f18-902e80938ce5 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:54.163951 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fbd37118-06c9-4820-8f18-902e80938ce5 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:54.165230 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fbd37118-06c9-4820-8f18-902e80938ce5 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:54.165936 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fbd37118-06c9-4820-8f18-902e80938ce5 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:54.487829 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fbd37118-06c9-4820-8f18-902e80938ce5 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:54.497769 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fbd37118-06c9-4820-8f18-902e80938ce5 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1503 microversion: 2.1 time: 0.349283 Jul 18 03:07:54.498374 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3229/6475] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:54 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1503 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:07:54.561392 n-d-465891-3 devstack@n-api.service[119543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:07:54.561879 n-d-465891-3 devstack@n-api.service[119543]: Mon Jul 18 03:07:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:07:55.526209 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3b843577-ac21-49a3-a4f2-2844a9cca8b6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:55.527285 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3b843577-ac21-49a3-a4f2-2844a9cca8b6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:55.533762 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3b843577-ac21-49a3-a4f2-2844a9cca8b6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:55.534240 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3b843577-ac21-49a3-a4f2-2844a9cca8b6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:55.535036 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3b843577-ac21-49a3-a4f2-2844a9cca8b6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:55.535493 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3b843577-ac21-49a3-a4f2-2844a9cca8b6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:55.710330 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3b843577-ac21-49a3-a4f2-2844a9cca8b6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:55.718658 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3b843577-ac21-49a3-a4f2-2844a9cca8b6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1503 microversion: 2.1 time: 0.198963 Jul 18 03:07:55.719274 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3247/6476] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:55 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1503 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:56.737626 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-dc68f6c8-b3d3-4551-af86-83caf84afa0e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:56.738601 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-dc68f6c8-b3d3-4551-af86-83caf84afa0e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:56.747712 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dc68f6c8-b3d3-4551-af86-83caf84afa0e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:56.748283 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dc68f6c8-b3d3-4551-af86-83caf84afa0e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:56.749245 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dc68f6c8-b3d3-4551-af86-83caf84afa0e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:56.749685 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dc68f6c8-b3d3-4551-af86-83caf84afa0e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:56.896074 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-dc68f6c8-b3d3-4551-af86-83caf84afa0e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:56.904610 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-dc68f6c8-b3d3-4551-af86-83caf84afa0e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.172020 Jul 18 03:07:56.905217 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3230/6477] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:56 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:07:56.923793 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-206b51b2-4670-4bdf-9a40-62a8c1325418 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:56.924425 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-206b51b2-4670-4bdf-9a40-62a8c1325418 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:56.932841 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-206b51b2-4670-4bdf-9a40-62a8c1325418 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:56.933296 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-206b51b2-4670-4bdf-9a40-62a8c1325418 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:56.934179 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-206b51b2-4670-4bdf-9a40-62a8c1325418 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:56.934662 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-206b51b2-4670-4bdf-9a40-62a8c1325418 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:57.080788 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-206b51b2-4670-4bdf-9a40-62a8c1325418 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:57.089358 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-206b51b2-4670-4bdf-9a40-62a8c1325418 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.169442 Jul 18 03:07:57.089895 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3248/6478] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:56 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:57.106660 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5f97b740-a24a-4c1b-af6b-bf3da0010533 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:07:57.107198 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5f97b740-a24a-4c1b-af6b-bf3da0010533 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 23b4f923-9813-4cba-9c8b-c2cbe5d50119] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:57.112752 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-5f97b740-a24a-4c1b-af6b-bf3da0010533 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] HTTP exception thrown: Instance 23b4f923-9813-4cba-9c8b-c2cbe5d50119 could not be found. Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5f97b740-a24a-4c1b-af6b-bf3da0010533 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers/23b4f923-9813-4cba-9c8b-c2cbe5d50119/action HTTP/1.1 Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 15 Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: {"unpause": {}} Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 23b4f923-9813-4cba-9c8b-c2cbe5d50119 could not be found. Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '23b4f923-9813-4cba-9c8b-c2cbe5d50119', 'body': {'unpause': {}}} Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23b4f923-9813-4cba-9c8b-c2cbe5d50119 could not be found. Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23b4f923-9813-4cba-9c8b-c2cbe5d50119 could not be found. Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:57.114331 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:57.121363 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:07:57.121363 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:07:57.121363 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23b4f923-9813-4cba-9c8b-c2cbe5d50119 could not be found. Jul 18 03:07:57.121363 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:57.121363 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5f97b740-a24a-4c1b-af6b-bf3da0010533 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 404 to user: Instance 23b4f923-9813-4cba-9c8b-c2cbe5d50119 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:07:57.121363 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5f97b740-a24a-4c1b-af6b-bf3da0010533 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "POST /compute/v2.1/servers/23b4f923-9813-4cba-9c8b-c2cbe5d50119/action" status: 404 len: 111 microversion: 2.1 time: 0.013062 Jul 18 03:07:57.121363 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3231/6479] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:07:57 2022] POST /compute/v2.1/servers/23b4f923-9813-4cba-9c8b-c2cbe5d50119/action => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:07:57.126768 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-86fb3568-3267-440c-aa24-2e61b45a1590 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:57.127398 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-86fb3568-3267-440c-aa24-2e61b45a1590 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:57.134327 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-86fb3568-3267-440c-aa24-2e61b45a1590 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:57.134792 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-86fb3568-3267-440c-aa24-2e61b45a1590 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:57.135780 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-86fb3568-3267-440c-aa24-2e61b45a1590 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:57.136250 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-86fb3568-3267-440c-aa24-2e61b45a1590 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:57.299329 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-86fb3568-3267-440c-aa24-2e61b45a1590 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:57.307504 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-86fb3568-3267-440c-aa24-2e61b45a1590 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.184655 Jul 18 03:07:57.308106 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3249/6480] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:57 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:57.324905 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ce7de31c-7b96-4118-a58d-7b772511c2ba tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:57.325550 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ce7de31c-7b96-4118-a58d-7b772511c2ba tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:57.332913 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ce7de31c-7b96-4118-a58d-7b772511c2ba tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:57.333360 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ce7de31c-7b96-4118-a58d-7b772511c2ba tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:57.334193 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ce7de31c-7b96-4118-a58d-7b772511c2ba tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:57.335156 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ce7de31c-7b96-4118-a58d-7b772511c2ba tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:57.478056 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ce7de31c-7b96-4118-a58d-7b772511c2ba tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:57.485994 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ce7de31c-7b96-4118-a58d-7b772511c2ba tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.164964 Jul 18 03:07:57.486577 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3232/6481] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:57 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:57.502597 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5c6fd073-cbf0-452f-8b64-c8621b0254c6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:07:57.503150 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5c6fd073-cbf0-452f-8b64-c8621b0254c6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:57.510120 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5c6fd073-cbf0-452f-8b64-c8621b0254c6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:57.510585 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5c6fd073-cbf0-452f-8b64-c8621b0254c6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:57.511380 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5c6fd073-cbf0-452f-8b64-c8621b0254c6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:57.511836 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5c6fd073-cbf0-452f-8b64-c8621b0254c6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:57.540457 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-5c6fd073-cbf0-452f-8b64-c8621b0254c6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] HTTP exception thrown: Cannot 'unpause' instance 63632c37-5811-4473-a763-d8856e28e041 while it is in vm_state active Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5c6fd073-cbf0-452f-8b64-c8621b0254c6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041/action HTTP/1.1 Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 15 Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: {"unpause": {}} Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: exception: Cannot 'unpause' instance 63632c37-5811-4473-a763-d8856e28e041 while it is in vm_state active Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '63632c37-5811-4473-a763-d8856e28e041', 'body': {'unpause': {}}} Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 63632c37-5811-4473-a763-d8856e28e041 in vm_state active. Cannot unpause while the instance is in this state. Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 63632c37-5811-4473-a763-d8856e28e041 while it is in vm_state active Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:57.542370 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:57.547902 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:57.547902 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:07:57.547902 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:07:57.547902 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 63632c37-5811-4473-a763-d8856e28e041 while it is in vm_state active Jul 18 03:07:57.547902 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:57.547902 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5c6fd073-cbf0-452f-8b64-c8621b0254c6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 409 to user: Cannot 'unpause' instance 63632c37-5811-4473-a763-d8856e28e041 while it is in vm_state active {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:07:57.547902 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5c6fd073-cbf0-452f-8b64-c8621b0254c6 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "POST /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041/action" status: 409 len: 145 microversion: 2.1 time: 0.045285 Jul 18 03:07:57.547902 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3250/6482] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:07:57 2022] POST /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041/action => generated 145 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 03:07:57.555169 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1ed6c56b-2ca1-441e-95d5-e62993070913 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:57.556053 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1ed6c56b-2ca1-441e-95d5-e62993070913 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:57.562660 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ed6c56b-2ca1-441e-95d5-e62993070913 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:57.563112 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ed6c56b-2ca1-441e-95d5-e62993070913 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:57.563894 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ed6c56b-2ca1-441e-95d5-e62993070913 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:57.564329 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ed6c56b-2ca1-441e-95d5-e62993070913 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:57.707706 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1ed6c56b-2ca1-441e-95d5-e62993070913 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:57.718931 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1ed6c56b-2ca1-441e-95d5-e62993070913 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.168223 Jul 18 03:07:57.720284 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3233/6483] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:57 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:57.737661 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-271ce5f5-ef4c-4f0f-960b-7a47eb6de795 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:57.738347 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-271ce5f5-ef4c-4f0f-960b-7a47eb6de795 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:57.750856 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-271ce5f5-ef4c-4f0f-960b-7a47eb6de795 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:57.751441 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-271ce5f5-ef4c-4f0f-960b-7a47eb6de795 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:57.752422 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-271ce5f5-ef4c-4f0f-960b-7a47eb6de795 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:57.752959 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-271ce5f5-ef4c-4f0f-960b-7a47eb6de795 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:57.899311 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-271ce5f5-ef4c-4f0f-960b-7a47eb6de795 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:57.907658 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-271ce5f5-ef4c-4f0f-960b-7a47eb6de795 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.173897 Jul 18 03:07:57.908240 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3251/6484] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:57 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:57.926058 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b1b123e7-c289-4a9f-9e46-7d699501db3d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:07:57.926673 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b1b123e7-c289-4a9f-9e46-7d699501db3d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 752e746b-aed6-4c68-885e-5c879dc910c9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:57.934643 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-b1b123e7-c289-4a9f-9e46-7d699501db3d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] HTTP exception thrown: Instance 752e746b-aed6-4c68-885e-5c879dc910c9 could not be found. Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b1b123e7-c289-4a9f-9e46-7d699501db3d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers/752e746b-aed6-4c68-885e-5c879dc910c9/action HTTP/1.1 Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 18 Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: {"unshelve": null} Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 752e746b-aed6-4c68-885e-5c879dc910c9 could not be found. Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '752e746b-aed6-4c68-885e-5c879dc910c9', 'body': {'unshelve': None}} Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 752e746b-aed6-4c68-885e-5c879dc910c9 could not be found. Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 94, in _unshelve Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 752e746b-aed6-4c68-885e-5c879dc910c9 could not be found. Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:57.936214 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:57.941692 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:57.941692 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:07:57.941692 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:07:57.941692 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 752e746b-aed6-4c68-885e-5c879dc910c9 could not be found. Jul 18 03:07:57.941692 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:57.941692 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b1b123e7-c289-4a9f-9e46-7d699501db3d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 404 to user: Instance 752e746b-aed6-4c68-885e-5c879dc910c9 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:07:57.941692 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b1b123e7-c289-4a9f-9e46-7d699501db3d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "POST /compute/v2.1/servers/752e746b-aed6-4c68-885e-5c879dc910c9/action" status: 404 len: 111 microversion: 2.1 time: 0.015654 Jul 18 03:07:57.941692 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3234/6485] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:07:57 2022] POST /compute/v2.1/servers/752e746b-aed6-4c68-885e-5c879dc910c9/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 03:07:57.947885 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0ac7874e-825f-45a9-b301-8f764190eaa9 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:57.948527 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0ac7874e-825f-45a9-b301-8f764190eaa9 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:57.956317 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0ac7874e-825f-45a9-b301-8f764190eaa9 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:57.956770 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0ac7874e-825f-45a9-b301-8f764190eaa9 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:57.957572 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0ac7874e-825f-45a9-b301-8f764190eaa9 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:57.958135 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0ac7874e-825f-45a9-b301-8f764190eaa9 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:58.103431 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0ac7874e-825f-45a9-b301-8f764190eaa9 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:58.113636 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0ac7874e-825f-45a9-b301-8f764190eaa9 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.170407 Jul 18 03:07:58.114406 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3252/6486] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:57 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:07:58.133366 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d80c9a25-09d4-44fb-9162-37cab1ffef5e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:58.134099 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d80c9a25-09d4-44fb-9162-37cab1ffef5e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:58.147846 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d80c9a25-09d4-44fb-9162-37cab1ffef5e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:58.149309 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d80c9a25-09d4-44fb-9162-37cab1ffef5e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:58.150879 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d80c9a25-09d4-44fb-9162-37cab1ffef5e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:58.151320 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d80c9a25-09d4-44fb-9162-37cab1ffef5e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:58.293479 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d80c9a25-09d4-44fb-9162-37cab1ffef5e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:58.301548 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d80c9a25-09d4-44fb-9162-37cab1ffef5e tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.172790 Jul 18 03:07:58.302172 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3235/6487] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:58 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:07:58.320911 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a2ea08cd-a642-4c91-8d21-4b3054404ebb tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:07:58.321526 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a2ea08cd-a642-4c91-8d21-4b3054404ebb tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:58.328287 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a2ea08cd-a642-4c91-8d21-4b3054404ebb tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:58.328758 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a2ea08cd-a642-4c91-8d21-4b3054404ebb tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:58.329561 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a2ea08cd-a642-4c91-8d21-4b3054404ebb tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:58.330054 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a2ea08cd-a642-4c91-8d21-4b3054404ebb tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:58.427879 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-a2ea08cd-a642-4c91-8d21-4b3054404ebb tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] HTTP exception thrown: Cannot 'unshelve' instance 63632c37-5811-4473-a763-d8856e28e041 while it is in vm_state active Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a2ea08cd-a642-4c91-8d21-4b3054404ebb tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041/action HTTP/1.1 Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 18 Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: {"unshelve": null} Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: exception: Cannot 'unshelve' instance 63632c37-5811-4473-a763-d8856e28e041 while it is in vm_state active Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '63632c37-5811-4473-a763-d8856e28e041', 'body': {'unshelve': None}} Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 105, in _unshelve Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve(context, instance, new_az=new_az) Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 63632c37-5811-4473-a763-d8856e28e041 in vm_state active. Cannot unshelve while the instance is in this state. Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 111, in _unshelve Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 63632c37-5811-4473-a763-d8856e28e041 while it is in vm_state active Jul 18 03:07:58.429969 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:58.438200 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:58.438200 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:58.438200 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:58.438200 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:58.438200 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:58.438200 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:07:58.438200 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:07:58.438200 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 63632c37-5811-4473-a763-d8856e28e041 while it is in vm_state active Jul 18 03:07:58.438200 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:58.438200 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a2ea08cd-a642-4c91-8d21-4b3054404ebb tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 409 to user: Cannot 'unshelve' instance 63632c37-5811-4473-a763-d8856e28e041 while it is in vm_state active {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:07:58.438200 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a2ea08cd-a642-4c91-8d21-4b3054404ebb tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "POST /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041/action" status: 409 len: 146 microversion: 2.1 time: 0.116089 Jul 18 03:07:58.438200 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3253/6488] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:07:58 2022] POST /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041/action => generated 146 bytes in 117 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 03:07:58.442533 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9f8df832-3f70-4853-b160-d81f252e3440 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:58.443154 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9f8df832-3f70-4853-b160-d81f252e3440 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:58.450830 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9f8df832-3f70-4853-b160-d81f252e3440 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:58.451279 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9f8df832-3f70-4853-b160-d81f252e3440 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:58.452142 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9f8df832-3f70-4853-b160-d81f252e3440 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:58.452885 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9f8df832-3f70-4853-b160-d81f252e3440 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:58.609057 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9f8df832-3f70-4853-b160-d81f252e3440 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:58.617175 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9f8df832-3f70-4853-b160-d81f252e3440 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.178463 Jul 18 03:07:58.617787 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3236/6489] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:58 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:07:58.634734 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-eb7729a0-2a53-46c2-b38f-7b174f462bfc tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:58.635368 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-eb7729a0-2a53-46c2-b38f-7b174f462bfc tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:58.641963 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eb7729a0-2a53-46c2-b38f-7b174f462bfc tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:58.642431 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eb7729a0-2a53-46c2-b38f-7b174f462bfc tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:58.643232 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eb7729a0-2a53-46c2-b38f-7b174f462bfc tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:58.643681 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eb7729a0-2a53-46c2-b38f-7b174f462bfc tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:58.792969 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-eb7729a0-2a53-46c2-b38f-7b174f462bfc tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:58.801380 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-eb7729a0-2a53-46c2-b38f-7b174f462bfc tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.170479 Jul 18 03:07:58.801930 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3254/6490] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:58 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:58.819614 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-83bcb757-deb3-4e0e-856e-93fba72db6d3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-11707584_updated"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:07:58.821042 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-83bcb757-deb3-4e0e-856e-93fba72db6d3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 0baedf47-2a0f-4604-981a-4a42bdf27d39] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:58.827588 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-83bcb757-deb3-4e0e-856e-93fba72db6d3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] HTTP exception thrown: Instance 0baedf47-2a0f-4604-981a-4a42bdf27d39 could not be found. Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-83bcb757-deb3-4e0e-856e-93fba72db6d3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: request: PUT /compute/v2.1/servers/0baedf47-2a0f-4604-981a-4a42bdf27d39 HTTP/1.1 Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 79 Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-11707584_updated"}} Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 0baedf47-2a0f-4604-981a-4a42bdf27d39 could not be found. Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '0baedf47-2a0f-4604-981a-4a42bdf27d39', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-11707584_updated'}}} Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0baedf47-2a0f-4604-981a-4a42bdf27d39 could not be found. Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 18 03:07:58.829462 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:07:58.835456 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:07:58.835456 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:07:58.835456 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:07:58.835456 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0baedf47-2a0f-4604-981a-4a42bdf27d39 could not be found. Jul 18 03:07:58.835456 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:58.835456 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:58.835456 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:58.835456 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:58.835456 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:58.835456 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:58.835456 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:07:58.835456 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:07:58.835456 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0baedf47-2a0f-4604-981a-4a42bdf27d39 could not be found. Jul 18 03:07:58.835456 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:58.835456 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-83bcb757-deb3-4e0e-856e-93fba72db6d3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 404 to user: Instance 0baedf47-2a0f-4604-981a-4a42bdf27d39 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:07:58.835456 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-83bcb757-deb3-4e0e-856e-93fba72db6d3 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "PUT /compute/v2.1/servers/0baedf47-2a0f-4604-981a-4a42bdf27d39" status: 404 len: 111 microversion: 2.1 time: 0.016534 Jul 18 03:07:58.835456 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3237/6491] 10.222.0.57 () {60 vars in 1255 bytes} [Mon Jul 18 03:07:58 2022] PUT /compute/v2.1/servers/0baedf47-2a0f-4604-981a-4a42bdf27d39 => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 03:07:58.842154 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-392d92f4-7eaf-45b2-9a3b-1814862b99a1 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:58.842860 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-392d92f4-7eaf-45b2-9a3b-1814862b99a1 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:58.850179 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-392d92f4-7eaf-45b2-9a3b-1814862b99a1 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:58.850787 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-392d92f4-7eaf-45b2-9a3b-1814862b99a1 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:58.851739 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-392d92f4-7eaf-45b2-9a3b-1814862b99a1 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:58.852299 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-392d92f4-7eaf-45b2-9a3b-1814862b99a1 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:58.993966 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-392d92f4-7eaf-45b2-9a3b-1814862b99a1 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:59.002549 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-392d92f4-7eaf-45b2-9a3b-1814862b99a1 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.164202 Jul 18 03:07:59.003148 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3255/6492] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:58 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:59.020543 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5e8d7acf-453c-43cc-a3c4-b900d6591f61 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:59.021204 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5e8d7acf-453c-43cc-a3c4-b900d6591f61 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:59.030355 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5e8d7acf-453c-43cc-a3c4-b900d6591f61 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:59.030815 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5e8d7acf-453c-43cc-a3c4-b900d6591f61 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:59.031603 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5e8d7acf-453c-43cc-a3c4-b900d6591f61 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:59.032043 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5e8d7acf-453c-43cc-a3c4-b900d6591f61 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:59.188190 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5e8d7acf-453c-43cc-a3c4-b900d6591f61 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:59.200153 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5e8d7acf-453c-43cc-a3c4-b900d6591f61 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.183483 Jul 18 03:07:59.200748 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3238/6493] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:59 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:59.219749 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c7d302db-808a-4368-ab77-eba5cddfa218 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c7d302db-808a-4368-ab77-eba5cddfa218 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: request: PUT /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 HTTP/1.1 Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 280 Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '63632c37-5811-4473-a763-d8856e28e041', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise error Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:59.223026 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:59.230379 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:59.230379 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:59.230379 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:07:59.230379 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:07:59.230379 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:07:59.230379 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:07:59.230379 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:07:59.230379 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:07:59.230379 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 03:07:59.230379 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 03:07:59.230379 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 03:07:59.230379 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 03:07:59.230379 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 03:07:59.230379 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 03:07:59.230379 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 03:07:59.230379 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:59.230379 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:59.230379 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:59.230379 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:59.230379 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:59.230379 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:59.230379 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 03:07:59.230379 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 03:07:59.230379 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 03:07:59.230379 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:07:59.230379 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c7d302db-808a-4368-ab77-eba5cddfa218 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:07:59.230379 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c7d302db-808a-4368-ab77-eba5cddfa218 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "PUT /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 400 len: 619 microversion: 2.1 time: 0.010872 Jul 18 03:07:59.230379 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3256/6494] 10.222.0.57 () {60 vars in 1256 bytes} [Mon Jul 18 03:07:59 2022] PUT /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 619 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 03:07:59.237099 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3e8a154d-56fd-4a9f-8f4a-06b8c856ceb1 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:59.237804 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3e8a154d-56fd-4a9f-8f4a-06b8c856ceb1 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:59.247253 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3e8a154d-56fd-4a9f-8f4a-06b8c856ceb1 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:59.247885 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3e8a154d-56fd-4a9f-8f4a-06b8c856ceb1 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:59.249011 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3e8a154d-56fd-4a9f-8f4a-06b8c856ceb1 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:59.249537 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3e8a154d-56fd-4a9f-8f4a-06b8c856ceb1 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:59.402481 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3e8a154d-56fd-4a9f-8f4a-06b8c856ceb1 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:59.414314 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3e8a154d-56fd-4a9f-8f4a-06b8c856ceb1 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.181347 Jul 18 03:07:59.415221 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3239/6495] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:59 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:59.432635 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f1da6352-a010-482b-ac93-707ea3a0ea9a tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:59.433270 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f1da6352-a010-482b-ac93-707ea3a0ea9a tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:59.440953 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f1da6352-a010-482b-ac93-707ea3a0ea9a tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:59.441423 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f1da6352-a010-482b-ac93-707ea3a0ea9a tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:59.442268 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f1da6352-a010-482b-ac93-707ea3a0ea9a tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:59.442728 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f1da6352-a010-482b-ac93-707ea3a0ea9a tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:59.599217 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f1da6352-a010-482b-ac93-707ea3a0ea9a tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:59.607270 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f1da6352-a010-482b-ac93-707ea3a0ea9a tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.178463 Jul 18 03:07:59.607869 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3257/6496] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:59 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:59.631108 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c26a023a-6e59-47a5-a63d-cc2b9fec2cea tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c26a023a-6e59-47a5-a63d-cc2b9fec2cea tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: request: PUT /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 HTTP/1.1 Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 24 Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: {"server": {"name": ""}} Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '63632c37-5811-4473-a763-d8856e28e041', 'body': {'server': {'name': ''}}} Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise error Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi '' Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 03:07:59.635780 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 18 03:07:59.641864 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:59.641864 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:59.641864 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:59.641864 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:59.641864 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:59.641864 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:59.641864 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 03:07:59.641864 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 03:07:59.641864 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 18 03:07:59.641864 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:07:59.641864 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c26a023a-6e59-47a5-a63d-cc2b9fec2cea tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:07:59.641864 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c26a023a-6e59-47a5-a63d-cc2b9fec2cea tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "PUT /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 400 len: 108 microversion: 2.1 time: 0.014303 Jul 18 03:07:59.641864 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3240/6497] 10.222.0.57 () {60 vars in 1255 bytes} [Mon Jul 18 03:07:59 2022] PUT /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 108 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 03:07:59.649378 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b5b25384-150c-47d5-8431-29ceb3868baf tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:59.649993 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b5b25384-150c-47d5-8431-29ceb3868baf tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:59.656747 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b5b25384-150c-47d5-8431-29ceb3868baf tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:59.657220 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b5b25384-150c-47d5-8431-29ceb3868baf tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:59.658056 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b5b25384-150c-47d5-8431-29ceb3868baf tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:59.658512 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b5b25384-150c-47d5-8431-29ceb3868baf tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:59.814704 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b5b25384-150c-47d5-8431-29ceb3868baf tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:59.823040 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b5b25384-150c-47d5-8431-29ceb3868baf tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1506 microversion: 2.1 time: 0.177768 Jul 18 03:07:59.823653 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3258/6498] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:59 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1506 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:08:04.390034 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1c6ae734-8c35-405b-beaf-b35d7d7922bc tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:08:04.390639 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1c6ae734-8c35-405b-beaf-b35d7d7922bc tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 2a565242-f018-4078-a74c-18c3b8823c51] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:08:04.399384 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1c6ae734-8c35-405b-beaf-b35d7d7922bc tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:08:04.399848 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1c6ae734-8c35-405b-beaf-b35d7d7922bc tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:08:04.400647 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1c6ae734-8c35-405b-beaf-b35d7d7922bc tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:08:04.401089 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1c6ae734-8c35-405b-beaf-b35d7d7922bc tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:08:04.417427 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-1c6ae734-8c35-405b-beaf-b35d7d7922bc tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] HTTP exception thrown: Instance 2a565242-f018-4078-a74c-18c3b8823c51 could not be found. Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1c6ae734-8c35-405b-beaf-b35d7d7922bc tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/servers/2a565242-f018-4078-a74c-18c3b8823c51 HTTP/1.1 Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 2a565242-f018-4078-a74c-18c3b8823c51 could not be found. Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '2a565242-f018-4078-a74c-18c3b8823c51'} Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a565242-f018-4078-a74c-18c3b8823c51 could not be found. Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:08:04.419070 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:08:04.426499 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a565242-f018-4078-a74c-18c3b8823c51 could not be found. Jul 18 03:08:04.426499 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:08:04.426499 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:08:04.426499 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:08:04.426499 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:08:04.426499 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:08:04.426499 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:08:04.426499 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:08:04.426499 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:08:04.426499 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a565242-f018-4078-a74c-18c3b8823c51 could not be found. Jul 18 03:08:04.426499 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:08:04.426499 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1c6ae734-8c35-405b-beaf-b35d7d7922bc tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 404 to user: Instance 2a565242-f018-4078-a74c-18c3b8823c51 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:08:04.426499 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1c6ae734-8c35-405b-beaf-b35d7d7922bc tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2a565242-f018-4078-a74c-18c3b8823c51" status: 404 len: 111 microversion: 2.1 time: 0.035469 Jul 18 03:08:04.426499 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3241/6499] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:08:04 2022] DELETE /compute/v2.1/servers/2a565242-f018-4078-a74c-18c3b8823c51 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:08:04.432952 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-34f42de8-1b25-4e44-bef9-78e725f6dc6d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:08:04.433739 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-34f42de8-1b25-4e44-bef9-78e725f6dc6d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 2a565242-f018-4078-a74c-18c3b8823c51] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:08:04.436919 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=52 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:08:04.443656 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-34f42de8-1b25-4e44-bef9-78e725f6dc6d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:08:04.444161 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-34f42de8-1b25-4e44-bef9-78e725f6dc6d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:08:04.445098 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-34f42de8-1b25-4e44-bef9-78e725f6dc6d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:08:04.445801 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-34f42de8-1b25-4e44-bef9-78e725f6dc6d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:08:04.464178 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-34f42de8-1b25-4e44-bef9-78e725f6dc6d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] HTTP exception thrown: Instance 2a565242-f018-4078-a74c-18c3b8823c51 could not be found. Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-34f42de8-1b25-4e44-bef9-78e725f6dc6d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/2a565242-f018-4078-a74c-18c3b8823c51 HTTP/1.1 Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 2a565242-f018-4078-a74c-18c3b8823c51 could not be found. Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '2a565242-f018-4078-a74c-18c3b8823c51'} Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a565242-f018-4078-a74c-18c3b8823c51 could not be found. Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a565242-f018-4078-a74c-18c3b8823c51 could not be found. Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:08:04.465929 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:08:04.474320 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:08:04.474320 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:08:04.474320 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:08:04.474320 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:08:04.474320 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:08:04.474320 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a565242-f018-4078-a74c-18c3b8823c51 could not be found. Jul 18 03:08:04.474320 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:08:04.474320 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-34f42de8-1b25-4e44-bef9-78e725f6dc6d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 404 to user: Instance 2a565242-f018-4078-a74c-18c3b8823c51 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:08:04.474320 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-34f42de8-1b25-4e44-bef9-78e725f6dc6d tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/2a565242-f018-4078-a74c-18c3b8823c51" status: 404 len: 111 microversion: 2.1 time: 0.042041 Jul 18 03:08:04.474320 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3259/6500] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:08:04 2022] GET /compute/v2.1/servers/2a565242-f018-4078-a74c-18c3b8823c51 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:08:04.485285 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ef329671-3447-4834-af35-1471a84dba23 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:08:04.485285 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ef329671-3447-4834-af35-1471a84dba23 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:08:04.491727 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ef329671-3447-4834-af35-1471a84dba23 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:08:04.492052 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ef329671-3447-4834-af35-1471a84dba23 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:08:04.492986 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ef329671-3447-4834-af35-1471a84dba23 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:08:04.493427 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ef329671-3447-4834-af35-1471a84dba23 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:08:04.522937 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ef329671-3447-4834-af35-1471a84dba23 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:08:04.639035 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ef329671-3447-4834-af35-1471a84dba23 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "DELETE /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 204 len: 0 microversion: 2.1 time: 0.160633 Jul 18 03:08:04.641337 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3242/6501] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:08:04 2022] DELETE /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:08:04.650516 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ad944b3d-0ac0-4f4d-bd21-466908d2f5d4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:08:04.651259 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ad944b3d-0ac0-4f4d-bd21-466908d2f5d4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:08:04.659369 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ad944b3d-0ac0-4f4d-bd21-466908d2f5d4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:08:04.659841 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ad944b3d-0ac0-4f4d-bd21-466908d2f5d4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:08:04.660824 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ad944b3d-0ac0-4f4d-bd21-466908d2f5d4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:08:04.661345 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ad944b3d-0ac0-4f4d-bd21-466908d2f5d4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:08:04.875691 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ad944b3d-0ac0-4f4d-bd21-466908d2f5d4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:08:04.884592 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ad944b3d-0ac0-4f4d-bd21-466908d2f5d4 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1512 microversion: 2.1 time: 0.239213 Jul 18 03:08:04.885316 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3260/6502] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:08:04 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1512 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:08:05.904472 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-da14685a-39f6-4229-b501-a0ecae3d1b5a tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:08:05.905291 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-da14685a-39f6-4229-b501-a0ecae3d1b5a tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:08:05.913002 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-da14685a-39f6-4229-b501-a0ecae3d1b5a tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:08:05.913448 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-da14685a-39f6-4229-b501-a0ecae3d1b5a tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:08:05.914275 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-da14685a-39f6-4229-b501-a0ecae3d1b5a tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:08:05.914718 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-da14685a-39f6-4229-b501-a0ecae3d1b5a tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:08:06.071669 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-da14685a-39f6-4229-b501-a0ecae3d1b5a tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:08:06.080058 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-da14685a-39f6-4229-b501-a0ecae3d1b5a tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1512 microversion: 2.1 time: 0.180237 Jul 18 03:08:06.080677 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3243/6503] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:08:05 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1512 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:08:06.896838 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-058c7c4f-44b0-4a5a-b873-890e47af279c req-319b5237-2114-4c7c-9622-183881b81975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63632c37-5811-4473-a763-d8856e28e041", "name": "network-vif-deleted", "tag": "4fccf55a-5892-41d7-b49b-4098586ab81b"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:08:06.911823 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-058c7c4f-44b0-4a5a-b873-890e47af279c req-319b5237-2114-4c7c-9622-183881b81975 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:08:06.913649 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-058c7c4f-44b0-4a5a-b873-890e47af279c req-319b5237-2114-4c7c-9622-183881b81975 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:08:06.936836 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-058c7c4f-44b0-4a5a-b873-890e47af279c req-319b5237-2114-4c7c-9622-183881b81975 service nova] Creating event network-vif-deleted:4fccf55a-5892-41d7-b49b-4098586ab81b for instance 63632c37-5811-4473-a763-d8856e28e041 on n-h2-465891-3 Jul 18 03:08:06.946419 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-058c7c4f-44b0-4a5a-b873-890e47af279c req-319b5237-2114-4c7c-9622-183881b81975 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055171 Jul 18 03:08:06.947536 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3261/6504] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:08:07.098593 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3160ea5c-867a-4d19-a976-28addd086827 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:08:07.099269 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3160ea5c-867a-4d19-a976-28addd086827 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:08:07.107978 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3160ea5c-867a-4d19-a976-28addd086827 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:08:07.108481 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3160ea5c-867a-4d19-a976-28addd086827 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:08:07.109401 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3160ea5c-867a-4d19-a976-28addd086827 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:08:07.110123 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3160ea5c-867a-4d19-a976-28addd086827 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:08:07.156139 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3160ea5c-867a-4d19-a976-28addd086827 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:08:07.156565 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3160ea5c-867a-4d19-a976-28addd086827 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:08:07.157081 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-3160ea5c-867a-4d19-a976-28addd086827 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lazy-loading 'fault' on Instance uuid 63632c37-5811-4473-a763-d8856e28e041 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:08:07.202620 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3160ea5c-867a-4d19-a976-28addd086827 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290e0074b3c74da2acc07f86338760ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e79ebd986e14dab8eb215d3a956f67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:08:07.205524 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:08:07.215239 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3160ea5c-867a-4d19-a976-28addd086827 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 200 len: 1307 microversion: 2.1 time: 0.121110 Jul 18 03:08:07.215843 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3244/6505] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:08:07 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 1307 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:08:08.235070 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cd7c7ba7-9324-4584-9a9b-9f56085f2836 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:08:08.235818 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cd7c7ba7-9324-4584-9a9b-9f56085f2836 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] [instance: 63632c37-5811-4473-a763-d8856e28e041] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:08:08.244022 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cd7c7ba7-9324-4584-9a9b-9f56085f2836 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:08:08.244796 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cd7c7ba7-9324-4584-9a9b-9f56085f2836 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:08:08.245907 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cd7c7ba7-9324-4584-9a9b-9f56085f2836 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:08:08.246448 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cd7c7ba7-9324-4584-9a9b-9f56085f2836 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:08:08.263088 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-cd7c7ba7-9324-4584-9a9b-9f56085f2836 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] HTTP exception thrown: Instance 63632c37-5811-4473-a763-d8856e28e041 could not be found. Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cd7c7ba7-9324-4584-9a9b-9f56085f2836 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Request method failure captured: Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 HTTP/1.1 Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1M4qfSq9G1ixTimE8ufrJHngFg_mjgTWTZJFx10g2Ws9ueczWo2c7qP0lFOJ-guxmYNQibUYYgtBHh-2FDsBj3SpAxoo96CcKMlEU082bGIdOMs5c7o4nJ6ueRfeEoHfpPQW_e9p6-B4DbRqSVfUIVJdwkddoQFUMs3SsqTmiS2O4K8 Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1e79ebd986e14dab8eb215d3a956f67d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1e79ebd986e14dab8eb215d3a956f67d"}]}] Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 1e79ebd986e14dab8eb215d3a956f67d Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-469948297 Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 290e0074b3c74da2acc07f86338760ac Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersNegativeTestJSON-469948297-project Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 63632c37-5811-4473-a763-d8856e28e041 could not be found. Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '63632c37-5811-4473-a763-d8856e28e041'} Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63632c37-5811-4473-a763-d8856e28e041 could not be found. Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63632c37-5811-4473-a763-d8856e28e041 could not be found. Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:08:08.265346 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:08:08.274751 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:08:08.274751 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:08:08.274751 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:08:08.274751 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:08:08.274751 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:08:08.274751 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63632c37-5811-4473-a763-d8856e28e041 could not be found. Jul 18 03:08:08.274751 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:08:08.274751 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cd7c7ba7-9324-4584-9a9b-9f56085f2836 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Returning 404 to user: Instance 63632c37-5811-4473-a763-d8856e28e041 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:08:08.274751 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cd7c7ba7-9324-4584-9a9b-9f56085f2836 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041" status: 404 len: 111 microversion: 2.1 time: 0.037642 Jul 18 03:08:08.274751 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3262/6506] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:08:08 2022] GET /compute/v2.1/servers/63632c37-5811-4473-a763-d8856e28e041 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 03:08:13.680541 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3160ea5c-867a-4d19-a976-28addd086827 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:08:13.682014 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3160ea5c-867a-4d19-a976-28addd086827 tempest-ServersNegativeTestJSON-469948297 tempest-ServersNegativeTestJSON-469948297-project] 10.222.0.57 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001867 Jul 18 03:08:13.682515 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3245/6507] 10.222.0.57 () {56 vars in 885 bytes} [Mon Jul 18 03:08:13 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 18 03:09:32.195588 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:09:32.196400 n-d-465891-3 devstack@n-api.service[119544]: Mon Jul 18 03:09:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:09:46.822735 n-d-465891-3 devstack@n-api.service[119543]: ERROR oslo.messaging._drivers.impl_rabbit [-] [58d4ed9e-6c40-4e66-8cf1-b8f58c4998c2] AMQP server on 10.222.0.57:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 18 03:09:46.823910 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=7 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:09:46.824690 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=74 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:09:47.182811 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-966f44d7-9f7e-4ddd-93c1-37705003318a tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:09:47.183403 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-966f44d7-9f7e-4ddd-93c1-37705003318a tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] [instance: 9df430a2-54be-4e36-ad3f-5d3f0455e798] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:09:47.191015 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-966f44d7-9f7e-4ddd-93c1-37705003318a tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:47.191453 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-966f44d7-9f7e-4ddd-93c1-37705003318a tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:47.192245 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-966f44d7-9f7e-4ddd-93c1-37705003318a tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:47.192681 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-966f44d7-9f7e-4ddd-93c1-37705003318a tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:47.225303 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-966f44d7-9f7e-4ddd-93c1-37705003318a tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] [instance: 9df430a2-54be-4e36-ad3f-5d3f0455e798] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:09:47.325553 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-966f44d7-9f7e-4ddd-93c1-37705003318a tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798" status: 204 len: 0 microversion: 2.1 time: 0.504443 Jul 18 03:09:47.333958 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3263/6508] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:09:46 2022] DELETE /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:09:47.337240 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:09:47.342558 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d10db2fc-185c-42be-82e7-77ad9086de82 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:09:47.343201 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d10db2fc-185c-42be-82e7-77ad9086de82 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] [instance: 9df430a2-54be-4e36-ad3f-5d3f0455e798] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:09:47.351916 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d10db2fc-185c-42be-82e7-77ad9086de82 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:47.352727 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d10db2fc-185c-42be-82e7-77ad9086de82 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:47.353632 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d10db2fc-185c-42be-82e7-77ad9086de82 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:47.354095 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d10db2fc-185c-42be-82e7-77ad9086de82 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:47.517172 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d10db2fc-185c-42be-82e7-77ad9086de82 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b292cd0f2ac2413babe9e9aa482d0c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18601269ae5c48409ca994cb7d410213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:09:47.525527 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d10db2fc-185c-42be-82e7-77ad9086de82 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] 10.222.0.57 "GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798" status: 200 len: 1732 microversion: 2.1 time: 0.192936 Jul 18 03:09:47.526348 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3246/6509] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:09:47 2022] GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798 => generated 1732 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:09:48.558902 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-46d4dfaa-29bf-43ba-a6ff-ca0ec9da7c9b tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:09:48.559747 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-46d4dfaa-29bf-43ba-a6ff-ca0ec9da7c9b tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] [instance: 9df430a2-54be-4e36-ad3f-5d3f0455e798] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:09:48.570011 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-46d4dfaa-29bf-43ba-a6ff-ca0ec9da7c9b tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:48.570694 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-46d4dfaa-29bf-43ba-a6ff-ca0ec9da7c9b tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:48.571537 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-46d4dfaa-29bf-43ba-a6ff-ca0ec9da7c9b tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:48.571990 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-46d4dfaa-29bf-43ba-a6ff-ca0ec9da7c9b tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:48.582516 n-d-465891-3 devstack@n-api.service[119543]: INFO oslo.messaging._drivers.impl_rabbit [-] [58d4ed9e-6c40-4e66-8cf1-b8f58c4998c2] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 48794. Jul 18 03:09:48.760630 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-46d4dfaa-29bf-43ba-a6ff-ca0ec9da7c9b tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b292cd0f2ac2413babe9e9aa482d0c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18601269ae5c48409ca994cb7d410213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:09:48.779671 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-46d4dfaa-29bf-43ba-a6ff-ca0ec9da7c9b tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] 10.222.0.57 "GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798" status: 200 len: 1732 microversion: 2.1 time: 0.230196 Jul 18 03:09:48.781861 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3264/6510] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:09:48 2022] GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798 => generated 1732 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:09:49.468813 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-de415220-e107-41d3-932f-a90558623d07 req-23759a2f-3ac2-4d26-ae27-07c5cb81ae38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9df430a2-54be-4e36-ad3f-5d3f0455e798", "name": "network-vif-deleted", "tag": "e9714ca5-cc91-49c7-95b3-7065a9d51897"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:09:49.490673 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-de415220-e107-41d3-932f-a90558623d07 req-23759a2f-3ac2-4d26-ae27-07c5cb81ae38 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:49.491715 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-de415220-e107-41d3-932f-a90558623d07 req-23759a2f-3ac2-4d26-ae27-07c5cb81ae38 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:49.516577 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-de415220-e107-41d3-932f-a90558623d07 req-23759a2f-3ac2-4d26-ae27-07c5cb81ae38 service nova] Creating event network-vif-deleted:e9714ca5-cc91-49c7-95b3-7065a9d51897 for instance 9df430a2-54be-4e36-ad3f-5d3f0455e798 on n-h1-465891-3 Jul 18 03:09:49.527194 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-de415220-e107-41d3-932f-a90558623d07 req-23759a2f-3ac2-4d26-ae27-07c5cb81ae38 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065068 Jul 18 03:09:49.528686 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3247/6511] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:09:49.812130 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1cfd80db-1590-417a-bd13-3ed6b44c822f tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:09:49.814035 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1cfd80db-1590-417a-bd13-3ed6b44c822f tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] [instance: 9df430a2-54be-4e36-ad3f-5d3f0455e798] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:09:49.826595 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1cfd80db-1590-417a-bd13-3ed6b44c822f tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:49.827581 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1cfd80db-1590-417a-bd13-3ed6b44c822f tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:49.829405 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1cfd80db-1590-417a-bd13-3ed6b44c822f tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:49.830246 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1cfd80db-1590-417a-bd13-3ed6b44c822f tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:49.902776 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1cfd80db-1590-417a-bd13-3ed6b44c822f tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:49.903639 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1cfd80db-1590-417a-bd13-3ed6b44c822f tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:49.904476 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-1cfd80db-1590-417a-bd13-3ed6b44c822f tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lazy-loading 'fault' on Instance uuid 9df430a2-54be-4e36-ad3f-5d3f0455e798 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:09:49.978896 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1cfd80db-1590-417a-bd13-3ed6b44c822f tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b292cd0f2ac2413babe9e9aa482d0c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18601269ae5c48409ca994cb7d410213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:09:49.992149 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1cfd80db-1590-417a-bd13-3ed6b44c822f tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] 10.222.0.57 "GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798" status: 200 len: 1389 microversion: 2.1 time: 0.186798 Jul 18 03:09:49.993749 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3265/6512] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:09:49 2022] GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798 => generated 1389 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:09:51.015468 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c5206829-ee18-4d31-8311-43142507f17b tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:09:51.017002 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c5206829-ee18-4d31-8311-43142507f17b tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] [instance: 9df430a2-54be-4e36-ad3f-5d3f0455e798] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:09:51.024966 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c5206829-ee18-4d31-8311-43142507f17b tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:51.025444 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c5206829-ee18-4d31-8311-43142507f17b tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:51.026354 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c5206829-ee18-4d31-8311-43142507f17b tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:51.026789 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c5206829-ee18-4d31-8311-43142507f17b tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:51.043509 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-c5206829-ee18-4d31-8311-43142507f17b tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] HTTP exception thrown: Instance 9df430a2-54be-4e36-ad3f-5d3f0455e798 could not be found. Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c5206829-ee18-4d31-8311-43142507f17b tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Request method failure captured: Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798 HTTP/1.1 Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M2Qgdk9Ui5H3T8ijlj5RnrgRGc2qdoBJ7G9Hp4G34EKTZ6BmnIVOFr1j6AlzAQgMIw0YfFWE7kMYhJFONu38d0iCHEqUJeneX91-e54Ckb1OEpnDlbPCTH594Kps1FXrftQiCUoXqfVnmmLsDsk4P8hwx0Qyzyzl5h43J38sWcz2F0 Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 18601269ae5c48409ca994cb7d410213 Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-TestServerBasicOps-1758824811 Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_18601269ae5c48409ca994cb7d410213"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/18601269ae5c48409ca994cb7d410213"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/18601269ae5c48409ca994cb7d410213"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/18601269ae5c48409ca994cb7d410213"}]}] Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-TestServerBasicOps-1758824811 Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 18601269ae5c48409ca994cb7d410213 Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-TestServerBasicOps-1758824811 Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-TestServerBasicOps-1758824811-project Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: b292cd0f2ac2413babe9e9aa482d0c0b Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-TestServerBasicOps-1758824811-project Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 9df430a2-54be-4e36-ad3f-5d3f0455e798 could not be found. Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '9df430a2-54be-4e36-ad3f-5d3f0455e798'} Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9df430a2-54be-4e36-ad3f-5d3f0455e798 could not be found. Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9df430a2-54be-4e36-ad3f-5d3f0455e798 could not be found. Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:09:51.045213 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:09:51.049765 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:09:51.049765 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:09:51.049765 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:09:51.049765 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:09:51.049765 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:09:51.049765 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9df430a2-54be-4e36-ad3f-5d3f0455e798 could not be found. Jul 18 03:09:51.049765 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:09:51.049765 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c5206829-ee18-4d31-8311-43142507f17b tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Returning 404 to user: Instance 9df430a2-54be-4e36-ad3f-5d3f0455e798 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:09:51.049765 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c5206829-ee18-4d31-8311-43142507f17b tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] 10.222.0.57 "GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798" status: 404 len: 111 microversion: 2.1 time: 0.036390 Jul 18 03:09:51.049765 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3248/6513] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:09:51 2022] GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:09:51.567652 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e0b763fa-112d-427e-aae1-ed83b1b765df tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:09:51.568261 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e0b763fa-112d-427e-aae1-ed83b1b765df tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] [instance: 9df430a2-54be-4e36-ad3f-5d3f0455e798] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:09:51.575302 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e0b763fa-112d-427e-aae1-ed83b1b765df tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:51.575769 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e0b763fa-112d-427e-aae1-ed83b1b765df tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:51.576637 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e0b763fa-112d-427e-aae1-ed83b1b765df tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:51.577024 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e0b763fa-112d-427e-aae1-ed83b1b765df tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:51.592042 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-e0b763fa-112d-427e-aae1-ed83b1b765df tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] HTTP exception thrown: Instance 9df430a2-54be-4e36-ad3f-5d3f0455e798 could not be found. Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e0b763fa-112d-427e-aae1-ed83b1b765df tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Request method failure captured: Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798 HTTP/1.1 Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1M2Qgdk9Ui5H3T8ijlj5RnrgRGc2qdoBJ7G9Hp4G34EKTZ6BmnIVOFr1j6AlzAQgMIw0YfFWE7kMYhJFONu38d0iCHEqUJeneX91-e54Ckb1OEpnDlbPCTH594Kps1FXrftQiCUoXqfVnmmLsDsk4P8hwx0Qyzyzl5h43J38sWcz2F0 Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 18601269ae5c48409ca994cb7d410213 Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-TestServerBasicOps-1758824811 Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_18601269ae5c48409ca994cb7d410213"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/18601269ae5c48409ca994cb7d410213"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/18601269ae5c48409ca994cb7d410213"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/18601269ae5c48409ca994cb7d410213"}]}] Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-TestServerBasicOps-1758824811 Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 18601269ae5c48409ca994cb7d410213 Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-TestServerBasicOps-1758824811 Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-TestServerBasicOps-1758824811-project Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: b292cd0f2ac2413babe9e9aa482d0c0b Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-TestServerBasicOps-1758824811-project Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 9df430a2-54be-4e36-ad3f-5d3f0455e798 could not be found. Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '9df430a2-54be-4e36-ad3f-5d3f0455e798'} Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9df430a2-54be-4e36-ad3f-5d3f0455e798 could not be found. Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:09:51.593821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9df430a2-54be-4e36-ad3f-5d3f0455e798 could not be found. Jul 18 03:09:51.598203 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:09:51.598203 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:09:51.598203 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:09:51.598203 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:09:51.598203 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:09:51.598203 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:09:51.598203 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:09:51.598203 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:09:51.598203 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9df430a2-54be-4e36-ad3f-5d3f0455e798 could not be found. Jul 18 03:09:51.598203 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:09:51.598203 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e0b763fa-112d-427e-aae1-ed83b1b765df tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Returning 404 to user: Instance 9df430a2-54be-4e36-ad3f-5d3f0455e798 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:09:51.598203 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e0b763fa-112d-427e-aae1-ed83b1b765df tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798" status: 404 len: 111 microversion: 2.1 time: 0.033586 Jul 18 03:09:51.598203 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3266/6514] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:09:51 2022] DELETE /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:09:51.605805 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-36a96421-f541-46e7-a6e6-262f6b982b41 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:09:51.606424 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-36a96421-f541-46e7-a6e6-262f6b982b41 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] [instance: 9df430a2-54be-4e36-ad3f-5d3f0455e798] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:09:51.613870 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-36a96421-f541-46e7-a6e6-262f6b982b41 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:51.614322 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-36a96421-f541-46e7-a6e6-262f6b982b41 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:51.615100 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-36a96421-f541-46e7-a6e6-262f6b982b41 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:51.615542 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-36a96421-f541-46e7-a6e6-262f6b982b41 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:51.630189 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-36a96421-f541-46e7-a6e6-262f6b982b41 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] HTTP exception thrown: Instance 9df430a2-54be-4e36-ad3f-5d3f0455e798 could not be found. Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-36a96421-f541-46e7-a6e6-262f6b982b41 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Request method failure captured: Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798 HTTP/1.1 Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M2Qgdk9Ui5H3T8ijlj5RnrgRGc2qdoBJ7G9Hp4G34EKTZ6BmnIVOFr1j6AlzAQgMIw0YfFWE7kMYhJFONu38d0iCHEqUJeneX91-e54Ckb1OEpnDlbPCTH594Kps1FXrftQiCUoXqfVnmmLsDsk4P8hwx0Qyzyzl5h43J38sWcz2F0 Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 18601269ae5c48409ca994cb7d410213 Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-TestServerBasicOps-1758824811 Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_18601269ae5c48409ca994cb7d410213"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/18601269ae5c48409ca994cb7d410213"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/18601269ae5c48409ca994cb7d410213"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/18601269ae5c48409ca994cb7d410213"}]}] Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-TestServerBasicOps-1758824811 Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 18601269ae5c48409ca994cb7d410213 Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-TestServerBasicOps-1758824811 Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-TestServerBasicOps-1758824811-project Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: b292cd0f2ac2413babe9e9aa482d0c0b Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-TestServerBasicOps-1758824811-project Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 9df430a2-54be-4e36-ad3f-5d3f0455e798 could not be found. Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '9df430a2-54be-4e36-ad3f-5d3f0455e798'} Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9df430a2-54be-4e36-ad3f-5d3f0455e798 could not be found. Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9df430a2-54be-4e36-ad3f-5d3f0455e798 could not be found. Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:09:51.631785 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:09:51.635669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:09:51.635669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:09:51.635669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:09:51.635669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:09:51.635669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:09:51.635669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9df430a2-54be-4e36-ad3f-5d3f0455e798 could not be found. Jul 18 03:09:51.635669 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:09:51.635669 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-36a96421-f541-46e7-a6e6-262f6b982b41 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Returning 404 to user: Instance 9df430a2-54be-4e36-ad3f-5d3f0455e798 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:09:51.635669 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-36a96421-f541-46e7-a6e6-262f6b982b41 tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] 10.222.0.57 "GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798" status: 404 len: 111 microversion: 2.1 time: 0.031289 Jul 18 03:09:51.635669 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3249/6515] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:09:51 2022] GET /compute/v2.1/servers/9df430a2-54be-4e36-ad3f-5d3f0455e798 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:09:51.837967 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bb63c3dc-92e8-48d5-950f-c69c99f2e90e tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] Calling method '.version_select at 0x7ff49bb7d280>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:09:51.889079 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bb63c3dc-92e8-48d5-950f-c69c99f2e90e tempest-TestServerBasicOps-1758824811 tempest-TestServerBasicOps-1758824811-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1290381689" status: 202 len: 0 microversion: 2.1 time: 0.057659 Jul 18 03:09:51.891300 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3267/6516] 10.222.0.57 () {58 vars in 1253 bytes} [Mon Jul 18 03:09:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1290381689 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:10:18.791756 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=8 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:10:18.793047 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=13 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:10:18.953663 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9e463c81-f3b2-49b1-9b9c-2cc69987ad14 tempest-TestAggregatesBasicOps-34718986 tempest-TestAggregatesBasicOps-34718986-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-774223139", "availability_zone": "foo_zone"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:10:18.971652 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 03:10:18.971652 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 03:10:18.972862 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.aggregate [None req-9e463c81-f3b2-49b1-9b9c-2cc69987ad14 tempest-TestAggregatesBasicOps-34718986 tempest-TestAggregatesBasicOps-34718986-project-admin] Generated uuid 563a5d79-e4a3-4bb5-b84a-884d3cc3299d for aggregate {{(pid=119544) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 03:10:19.016328 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9e463c81-f3b2-49b1-9b9c-2cc69987ad14 tempest-TestAggregatesBasicOps-34718986 tempest-TestAggregatesBasicOps-34718986-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.229828 Jul 18 03:10:19.016974 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3250/6517] 10.222.0.57 () {60 vars in 1163 bytes} [Mon Jul 18 03:10:18 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:10:19.026864 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:10:19.028027 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:10:19.033982 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0e66fc71-49b5-4623-8db0-70af2f15954a tempest-TestAggregatesBasicOps-34718986 tempest-TestAggregatesBasicOps-34718986-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:10:19.040263 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 03:10:19.040263 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 03:10:19.086126 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0e66fc71-49b5-4623-8db0-70af2f15954a tempest-TestAggregatesBasicOps-34718986 tempest-TestAggregatesBasicOps-34718986-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.061735 Jul 18 03:10:19.087145 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3268/6518] 10.222.0.57 () {60 vars in 1193 bytes} [Mon Jul 18 03:10:19 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:10:19.098727 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-57210856-0951-420d-bf4b-7131f502db1c tempest-TestAggregatesBasicOps-34718986 tempest-TestAggregatesBasicOps-34718986-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:19.100869 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 03:10:19.100869 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 03:10:19.102340 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-57210856-0951-420d-bf4b-7131f502db1c tempest-TestAggregatesBasicOps-34718986 tempest-TestAggregatesBasicOps-34718986-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:19.102988 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-57210856-0951-420d-bf4b-7131f502db1c tempest-TestAggregatesBasicOps-34718986 tempest-TestAggregatesBasicOps-34718986-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:19.103834 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-57210856-0951-420d-bf4b-7131f502db1c tempest-TestAggregatesBasicOps-34718986 tempest-TestAggregatesBasicOps-34718986-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:19.104268 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-57210856-0951-420d-bf4b-7131f502db1c tempest-TestAggregatesBasicOps-34718986 tempest-TestAggregatesBasicOps-34718986-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:19.137965 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-57210856-0951-420d-bf4b-7131f502db1c tempest-TestAggregatesBasicOps-34718986 tempest-TestAggregatesBasicOps-34718986-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.043769 Jul 18 03:10:19.138978 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3251/6519] 10.222.0.57 () {58 vars in 1175 bytes} [Mon Jul 18 03:10:19 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:10:19.159176 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fc07bac4-962d-4919-b315-76b2131c1292 tempest-TestAggregatesBasicOps-34718986 tempest-TestAggregatesBasicOps-34718986-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:19.160886 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 03:10:19.160886 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 03:10:19.174442 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fc07bac4-962d-4919-b315-76b2131c1292 tempest-TestAggregatesBasicOps-34718986 tempest-TestAggregatesBasicOps-34718986-project-admin] 10.222.0.57 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.023036 Jul 18 03:10:19.175385 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3269/6520] 10.222.0.57 () {58 vars in 1142 bytes} [Mon Jul 18 03:10:19 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:10:19.190505 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c4a06903-2965-4f62-9667-cbc7f781fbc0 tempest-TestAggregatesBasicOps-34718986 tempest-TestAggregatesBasicOps-34718986-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-465891-3"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:10:19.191925 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 03:10:19.191925 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 03:10:19.200975 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c4a06903-2965-4f62-9667-cbc7f781fbc0 tempest-TestAggregatesBasicOps-34718986 tempest-TestAggregatesBasicOps-34718986-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:19.201420 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c4a06903-2965-4f62-9667-cbc7f781fbc0 tempest-TestAggregatesBasicOps-34718986 tempest-TestAggregatesBasicOps-34718986-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:19.503298 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c4a06903-2965-4f62-9667-cbc7f781fbc0 tempest-TestAggregatesBasicOps-34718986 tempest-TestAggregatesBasicOps-34718986-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.317656 Jul 18 03:10:19.503921 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3252/6521] 10.222.0.57 () {60 vars in 1193 bytes} [Mon Jul 18 03:10:19 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:10:19.517437 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b751104f-7bcc-41d3-bbbb-b3bd032dca5d tempest-TestAggregatesBasicOps-34718986 tempest-TestAggregatesBasicOps-34718986-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:19.518244 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 03:10:19.518244 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 03:10:19.527529 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b751104f-7bcc-41d3-bbbb-b3bd032dca5d tempest-TestAggregatesBasicOps-34718986 tempest-TestAggregatesBasicOps-34718986-project-admin] 10.222.0.57 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.013833 Jul 18 03:10:19.528132 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3270/6522] 10.222.0.57 () {58 vars in 1151 bytes} [Mon Jul 18 03:10:19 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:10:19.543986 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e413da53-951e-4f7b-b49d-f88e2e83ce10 tempest-TestAggregatesBasicOps-34718986 tempest-TestAggregatesBasicOps-34718986-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-23182000", "availability_zone": "foo_zone"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:10:19.638933 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 03:10:19.638933 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 03:10:19.695137 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e413da53-951e-4f7b-b49d-f88e2e83ce10 tempest-TestAggregatesBasicOps-34718986 tempest-TestAggregatesBasicOps-34718986-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 340 microversion: 2.1 time: 0.155175 Jul 18 03:10:19.695565 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3253/6523] 10.222.0.57 () {60 vars in 1172 bytes} [Mon Jul 18 03:10:19 2022] PUT /compute/v2.1/os-aggregates/19 => generated 340 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:10:19.706996 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f8750dc9-1bca-4a45-9e35-41fd2f4d234b tempest-TestAggregatesBasicOps-34718986 tempest-TestAggregatesBasicOps-34718986-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:10:19.708471 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 03:10:19.708471 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 03:10:19.746005 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f8750dc9-1bca-4a45-9e35-41fd2f4d234b tempest-TestAggregatesBasicOps-34718986 tempest-TestAggregatesBasicOps-34718986-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 354 microversion: 2.1 time: 0.042758 Jul 18 03:10:19.746668 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3271/6524] 10.222.0.57 () {60 vars in 1193 bytes} [Mon Jul 18 03:10:19 2022] POST /compute/v2.1/os-aggregates/19/action => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:10:19.758315 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-76b8e068-29e7-4a30-b861-65e9f9a2dde3 tempest-TestAggregatesBasicOps-34718986 tempest-TestAggregatesBasicOps-34718986-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:19.759148 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 03:10:19.759148 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 03:10:19.768012 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-76b8e068-29e7-4a30-b861-65e9f9a2dde3 tempest-TestAggregatesBasicOps-34718986 tempest-TestAggregatesBasicOps-34718986-project-admin] 10.222.0.57 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 354 microversion: 2.1 time: 0.013421 Jul 18 03:10:19.774191 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3254/6525] 10.222.0.57 () {58 vars in 1151 bytes} [Mon Jul 18 03:10:19 2022] GET /compute/v2.1/os-aggregates/19 => generated 354 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:10:19.779184 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b20566aa-ce8d-473e-a58e-67928993dfc7 tempest-TestAggregatesBasicOps-34718986 tempest-TestAggregatesBasicOps-34718986-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-465891-3"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:10:19.780664 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 03:10:19.780664 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 03:10:19.793588 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b20566aa-ce8d-473e-a58e-67928993dfc7 tempest-TestAggregatesBasicOps-34718986 tempest-TestAggregatesBasicOps-34718986-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:19.794472 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b20566aa-ce8d-473e-a58e-67928993dfc7 tempest-TestAggregatesBasicOps-34718986 tempest-TestAggregatesBasicOps-34718986-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:20.086604 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b20566aa-ce8d-473e-a58e-67928993dfc7 tempest-TestAggregatesBasicOps-34718986 tempest-TestAggregatesBasicOps-34718986-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 339 microversion: 2.1 time: 0.310950 Jul 18 03:10:20.089882 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3272/6526] 10.222.0.57 () {60 vars in 1193 bytes} [Mon Jul 18 03:10:19 2022] POST /compute/v2.1/os-aggregates/19/action => generated 339 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:10:20.101979 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-86c6a32a-861b-4a9d-80b5-7bc5ae8c3f34 tempest-TestAggregatesBasicOps-34718986 tempest-TestAggregatesBasicOps-34718986-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:20.102892 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 03:10:20.102892 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 03:10:20.138170 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-86c6a32a-861b-4a9d-80b5-7bc5ae8c3f34 tempest-TestAggregatesBasicOps-34718986 tempest-TestAggregatesBasicOps-34718986-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.040524 Jul 18 03:10:20.140344 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3255/6527] 10.222.0.57 () {58 vars in 1154 bytes} [Mon Jul 18 03:10:20 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 03:10:55.589679 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=4 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:10:55.590491 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:10:55.707491 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-60141f06-277f-46e0-b765-cd1a130c4b33 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-604738644", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:10:55.761971 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-60141f06-277f-46e0-b765-cd1a130c4b33 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] validate_networks() for None {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:10:56.057403 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-60141f06-277f-46e0-b765-cd1a130c4b33 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:10:56.058059 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-60141f06-277f-46e0-b765-cd1a130c4b33 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:10:56.058458 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-60141f06-277f-46e0-b765-cd1a130c4b33 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:10:56.058958 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-60141f06-277f-46e0-b765-cd1a130c4b33 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:10:56.059417 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-60141f06-277f-46e0-b765-cd1a130c4b33 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:10:56.072252 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60141f06-277f-46e0-b765-cd1a130c4b33 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:56.072721 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60141f06-277f-46e0-b765-cd1a130c4b33 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:56.073541 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60141f06-277f-46e0-b765-cd1a130c4b33 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:56.074024 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-60141f06-277f-46e0-b765-cd1a130c4b33 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:56.094584 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-60141f06-277f-46e0-b765-cd1a130c4b33 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Getting quotas for project 13916e11382349bea6dd232680cbbf59. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:10:56.100100 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-60141f06-277f-46e0-b765-cd1a130c4b33 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Getting quotas for user 1606ee19028947a69f8b9e432785a912 and project 13916e11382349bea6dd232680cbbf59. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:10:56.113249 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-60141f06-277f-46e0-b765-cd1a130c4b33 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:10:56.115583 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-60141f06-277f-46e0-b765-cd1a130c4b33 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] [instance: dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:10:56.161330 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-60141f06-277f-46e0-b765-cd1a130c4b33 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.573472 Jul 18 03:10:56.162038 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3273/6528] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:10:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:10:56.171297 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:10:56.172132 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:10:56.173044 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:10:56.177723 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9eb1ac50-50ce-493d-b5ad-39c42cd17f0a tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:56.178346 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9eb1ac50-50ce-493d-b5ad-39c42cd17f0a tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] [instance: dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:56.238804 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9eb1ac50-50ce-493d-b5ad-39c42cd17f0a tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1606ee19028947a69f8b9e432785a912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13916e11382349bea6dd232680cbbf59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:56.249081 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9eb1ac50-50ce-493d-b5ad-39c42cd17f0a tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] 10.222.0.57 "GET /compute/v2.1/servers/dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3" status: 200 len: 1221 microversion: 2.1 time: 0.080279 Jul 18 03:10:56.249668 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3256/6529] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:56 2022] GET /compute/v2.1/servers/dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3 => generated 1221 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:10:57.266854 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5853ac61-aa1d-4fe8-9385-2621f14a8a5f tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:57.267392 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5853ac61-aa1d-4fe8-9385-2621f14a8a5f tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] [instance: dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:57.275011 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5853ac61-aa1d-4fe8-9385-2621f14a8a5f tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:57.275488 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5853ac61-aa1d-4fe8-9385-2621f14a8a5f tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:57.276428 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5853ac61-aa1d-4fe8-9385-2621f14a8a5f tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:57.276975 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5853ac61-aa1d-4fe8-9385-2621f14a8a5f tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:57.351069 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5853ac61-aa1d-4fe8-9385-2621f14a8a5f tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1606ee19028947a69f8b9e432785a912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13916e11382349bea6dd232680cbbf59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:57.359403 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5853ac61-aa1d-4fe8-9385-2621f14a8a5f tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] 10.222.0.57 "GET /compute/v2.1/servers/dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3" status: 200 len: 1281 microversion: 2.1 time: 0.097017 Jul 18 03:10:57.360547 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3274/6530] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:57 2022] GET /compute/v2.1/servers/dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3 => generated 1281 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:10:58.378566 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-36a4271b-c82c-4f25-b917-eadd56b7bf07 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:58.379211 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-36a4271b-c82c-4f25-b917-eadd56b7bf07 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] [instance: dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:58.387550 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-36a4271b-c82c-4f25-b917-eadd56b7bf07 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:58.389410 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-36a4271b-c82c-4f25-b917-eadd56b7bf07 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:58.390268 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-36a4271b-c82c-4f25-b917-eadd56b7bf07 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:58.390721 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-36a4271b-c82c-4f25-b917-eadd56b7bf07 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:58.464914 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-36a4271b-c82c-4f25-b917-eadd56b7bf07 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1606ee19028947a69f8b9e432785a912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13916e11382349bea6dd232680cbbf59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:58.478351 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-36a4271b-c82c-4f25-b917-eadd56b7bf07 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] 10.222.0.57 "GET /compute/v2.1/servers/dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3" status: 200 len: 1279 microversion: 2.1 time: 0.103210 Jul 18 03:10:58.479403 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3257/6531] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:58 2022] GET /compute/v2.1/servers/dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3 => generated 1279 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:10:59.498682 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-31c505e0-00b4-4738-ad6e-c2bfa1bfa84b tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:59.499215 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-31c505e0-00b4-4738-ad6e-c2bfa1bfa84b tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] [instance: dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:59.507978 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-31c505e0-00b4-4738-ad6e-c2bfa1bfa84b tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:59.508885 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-31c505e0-00b4-4738-ad6e-c2bfa1bfa84b tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:59.509913 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-31c505e0-00b4-4738-ad6e-c2bfa1bfa84b tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:59.510520 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-31c505e0-00b4-4738-ad6e-c2bfa1bfa84b tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:59.660955 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-98be8d73-fa9d-45cf-b0c4-584aae76fdd3 req-58f385c5-272f-4a83-888a-10ff118ab261 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3", "tag": "5d24d76c-060f-4ade-b0a1-e15b2972e7a8"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:10:59.682753 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-31c505e0-00b4-4738-ad6e-c2bfa1bfa84b tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1606ee19028947a69f8b9e432785a912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13916e11382349bea6dd232680cbbf59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:59.690049 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-98be8d73-fa9d-45cf-b0c4-584aae76fdd3 req-58f385c5-272f-4a83-888a-10ff118ab261 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:59.690502 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-98be8d73-fa9d-45cf-b0c4-584aae76fdd3 req-58f385c5-272f-4a83-888a-10ff118ab261 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:59.698903 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-31c505e0-00b4-4738-ad6e-c2bfa1bfa84b tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] 10.222.0.57 "GET /compute/v2.1/servers/dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3" status: 200 len: 1321 microversion: 2.1 time: 0.205409 Jul 18 03:10:59.709405 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3275/6532] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:59 2022] GET /compute/v2.1/servers/dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3 => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:10:59.713406 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-98be8d73-fa9d-45cf-b0c4-584aae76fdd3 req-58f385c5-272f-4a83-888a-10ff118ab261 service nova] Creating event network-changed:5d24d76c-060f-4ade-b0a1-e15b2972e7a8 for instance dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3 on n-h1-465891-3 Jul 18 03:10:59.724516 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-98be8d73-fa9d-45cf-b0c4-584aae76fdd3 req-58f385c5-272f-4a83-888a-10ff118ab261 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069922 Jul 18 03:10:59.725936 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3258/6533] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:11:00.718130 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f51f9424-5de8-4ffd-9621-da84f9001cec tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:00.718780 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f51f9424-5de8-4ffd-9621-da84f9001cec tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] [instance: dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:00.726192 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f51f9424-5de8-4ffd-9621-da84f9001cec tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:00.726664 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f51f9424-5de8-4ffd-9621-da84f9001cec tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:00.727475 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f51f9424-5de8-4ffd-9621-da84f9001cec tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:00.727935 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f51f9424-5de8-4ffd-9621-da84f9001cec tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:01.017492 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f51f9424-5de8-4ffd-9621-da84f9001cec tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1606ee19028947a69f8b9e432785a912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13916e11382349bea6dd232680cbbf59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:01.025542 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f51f9424-5de8-4ffd-9621-da84f9001cec tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] 10.222.0.57 "GET /compute/v2.1/servers/dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3" status: 200 len: 1321 microversion: 2.1 time: 0.312162 Jul 18 03:11:01.026266 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3276/6534] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:00 2022] GET /compute/v2.1/servers/dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3 => generated 1321 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:11:02.046527 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3ffe745e-4267-49cc-a3ce-8a41f26c6c7d tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:02.047394 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3ffe745e-4267-49cc-a3ce-8a41f26c6c7d tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] [instance: dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:02.061048 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3ffe745e-4267-49cc-a3ce-8a41f26c6c7d tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:02.061588 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3ffe745e-4267-49cc-a3ce-8a41f26c6c7d tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:02.062509 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3ffe745e-4267-49cc-a3ce-8a41f26c6c7d tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:02.062939 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3ffe745e-4267-49cc-a3ce-8a41f26c6c7d tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:02.311521 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3ffe745e-4267-49cc-a3ce-8a41f26c6c7d tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1606ee19028947a69f8b9e432785a912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13916e11382349bea6dd232680cbbf59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:02.321361 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3ffe745e-4267-49cc-a3ce-8a41f26c6c7d tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] 10.222.0.57 "GET /compute/v2.1/servers/dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3" status: 200 len: 1321 microversion: 2.1 time: 0.281349 Jul 18 03:11:02.322148 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3259/6535] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:02 2022] GET /compute/v2.1/servers/dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3 => generated 1321 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:03.340823 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f23f71b5-299a-441d-9bfd-4bc01fce004d tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:03.341655 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f23f71b5-299a-441d-9bfd-4bc01fce004d tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] [instance: dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:03.349021 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f23f71b5-299a-441d-9bfd-4bc01fce004d tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:03.349488 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f23f71b5-299a-441d-9bfd-4bc01fce004d tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:03.350329 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f23f71b5-299a-441d-9bfd-4bc01fce004d tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:03.350778 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f23f71b5-299a-441d-9bfd-4bc01fce004d tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:03.493649 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f23f71b5-299a-441d-9bfd-4bc01fce004d tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1606ee19028947a69f8b9e432785a912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13916e11382349bea6dd232680cbbf59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:03.502477 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f23f71b5-299a-441d-9bfd-4bc01fce004d tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] 10.222.0.57 "GET /compute/v2.1/servers/dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3" status: 200 len: 1321 microversion: 2.1 time: 0.165550 Jul 18 03:11:03.503127 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3277/6536] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:03 2022] GET /compute/v2.1/servers/dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:04.520202 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5ca53187-99df-42d6-b2a8-2c11969b3485 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:04.520814 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5ca53187-99df-42d6-b2a8-2c11969b3485 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] [instance: dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:04.528957 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ca53187-99df-42d6-b2a8-2c11969b3485 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:04.529420 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ca53187-99df-42d6-b2a8-2c11969b3485 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:04.530261 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ca53187-99df-42d6-b2a8-2c11969b3485 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:04.530706 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ca53187-99df-42d6-b2a8-2c11969b3485 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:04.700719 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5ca53187-99df-42d6-b2a8-2c11969b3485 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1606ee19028947a69f8b9e432785a912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13916e11382349bea6dd232680cbbf59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:04.708848 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5ca53187-99df-42d6-b2a8-2c11969b3485 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] 10.222.0.57 "GET /compute/v2.1/servers/dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3" status: 200 len: 1321 microversion: 2.1 time: 0.192500 Jul 18 03:11:04.709447 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3260/6537] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:04 2022] GET /compute/v2.1/servers/dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3 => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:11:05.728612 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b28f4442-d5a4-47e7-bff6-6377b7bcd8f7 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:05.729246 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b28f4442-d5a4-47e7-bff6-6377b7bcd8f7 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] [instance: dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:05.736595 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b28f4442-d5a4-47e7-bff6-6377b7bcd8f7 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:05.737053 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b28f4442-d5a4-47e7-bff6-6377b7bcd8f7 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:05.737895 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b28f4442-d5a4-47e7-bff6-6377b7bcd8f7 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:05.738353 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b28f4442-d5a4-47e7-bff6-6377b7bcd8f7 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:05.879696 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b28f4442-d5a4-47e7-bff6-6377b7bcd8f7 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1606ee19028947a69f8b9e432785a912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13916e11382349bea6dd232680cbbf59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:05.888863 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b28f4442-d5a4-47e7-bff6-6377b7bcd8f7 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] 10.222.0.57 "GET /compute/v2.1/servers/dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3" status: 200 len: 1321 microversion: 2.1 time: 0.164108 Jul 18 03:11:05.889478 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3278/6538] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:05 2022] GET /compute/v2.1/servers/dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:06.759924 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-007ae1c8-bc79-4ba8-aedb-c8327f2f26a0 req-22e4bcaa-8767-4eae-aa09-42cf76dee91a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3", "name": "network-vif-plugged", "status": "completed", "tag": "5d24d76c-060f-4ade-b0a1-e15b2972e7a8"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:11:06.766647 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:11:06.774808 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-007ae1c8-bc79-4ba8-aedb-c8327f2f26a0 req-22e4bcaa-8767-4eae-aa09-42cf76dee91a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:06.775273 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-007ae1c8-bc79-4ba8-aedb-c8327f2f26a0 req-22e4bcaa-8767-4eae-aa09-42cf76dee91a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:06.791887 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-007ae1c8-bc79-4ba8-aedb-c8327f2f26a0 req-22e4bcaa-8767-4eae-aa09-42cf76dee91a service nova] Creating event network-vif-plugged:5d24d76c-060f-4ade-b0a1-e15b2972e7a8 for instance dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3 on n-h1-465891-3 Jul 18 03:11:06.795381 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-007ae1c8-bc79-4ba8-aedb-c8327f2f26a0 req-22e4bcaa-8767-4eae-aa09-42cf76dee91a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039829 Jul 18 03:11:06.796770 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3261/6539] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:11:06.906677 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e510c019-1796-46f3-b263-5bcfbc154a21 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:06.907367 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e510c019-1796-46f3-b263-5bcfbc154a21 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] [instance: dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:06.909386 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:11:06.910113 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:11:06.919243 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e510c019-1796-46f3-b263-5bcfbc154a21 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:06.919766 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e510c019-1796-46f3-b263-5bcfbc154a21 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:06.920588 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e510c019-1796-46f3-b263-5bcfbc154a21 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:06.921209 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e510c019-1796-46f3-b263-5bcfbc154a21 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:07.084910 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e510c019-1796-46f3-b263-5bcfbc154a21 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1606ee19028947a69f8b9e432785a912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13916e11382349bea6dd232680cbbf59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:07.093421 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e510c019-1796-46f3-b263-5bcfbc154a21 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] 10.222.0.57 "GET /compute/v2.1/servers/dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3" status: 200 len: 1321 microversion: 2.1 time: 0.190794 Jul 18 03:11:07.094064 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3279/6540] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:06 2022] GET /compute/v2.1/servers/dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3 => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:11:08.112215 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-41bc1ed9-080e-41ff-be93-d3bda49ce99e tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:08.112912 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-41bc1ed9-080e-41ff-be93-d3bda49ce99e tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] [instance: dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:08.120516 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-41bc1ed9-080e-41ff-be93-d3bda49ce99e tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:08.120963 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-41bc1ed9-080e-41ff-be93-d3bda49ce99e tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:08.121755 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-41bc1ed9-080e-41ff-be93-d3bda49ce99e tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:08.122223 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-41bc1ed9-080e-41ff-be93-d3bda49ce99e tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:08.268093 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-41bc1ed9-080e-41ff-be93-d3bda49ce99e tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1606ee19028947a69f8b9e432785a912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13916e11382349bea6dd232680cbbf59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:08.283139 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-41bc1ed9-080e-41ff-be93-d3bda49ce99e tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] 10.222.0.57 "GET /compute/v2.1/servers/dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3" status: 200 len: 1321 microversion: 2.1 time: 0.174625 Jul 18 03:11:08.284251 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3262/6541] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:08 2022] GET /compute/v2.1/servers/dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3 => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:09.301131 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e66a1a16-878f-445b-9c88-af579d7cd92c tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:09.301806 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e66a1a16-878f-445b-9c88-af579d7cd92c tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] [instance: dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:09.308660 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e66a1a16-878f-445b-9c88-af579d7cd92c tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:09.309118 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e66a1a16-878f-445b-9c88-af579d7cd92c tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:09.310528 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e66a1a16-878f-445b-9c88-af579d7cd92c tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:09.311174 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e66a1a16-878f-445b-9c88-af579d7cd92c tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:09.450022 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e66a1a16-878f-445b-9c88-af579d7cd92c tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1606ee19028947a69f8b9e432785a912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13916e11382349bea6dd232680cbbf59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:09.458345 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e66a1a16-878f-445b-9c88-af579d7cd92c tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] 10.222.0.57 "GET /compute/v2.1/servers/dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3" status: 200 len: 1471 microversion: 2.1 time: 0.160965 Jul 18 03:11:09.458956 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3280/6542] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:09 2022] GET /compute/v2.1/servers/dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3 => generated 1471 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:09.532141 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d8b4145f-42de-46e5-9782-889103d5ddb1 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] Calling method '.version_select at 0x7ff49b5af3a0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:09.611099 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d8b4145f-42de-46e5-9782-889103d5ddb1 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] 10.222.0.57 "GET /compute/v2.1/os-quota-sets/2fef2506d528459299fbfb2035f71936" status: 200 len: 371 microversion: 2.1 time: 0.136228 Jul 18 03:11:09.611706 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3263/6543] 10.222.0.57 () {58 vars in 1241 bytes} [Mon Jul 18 03:11:09 2022] GET /compute/v2.1/os-quota-sets/2fef2506d528459299fbfb2035f71936 => generated 371 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:11:09.624511 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-841a54c9-dd40-494a-9b4e-d2eebe2ac7d7 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-141543696", "id": 1011999136, "os-flavor-access:is_public": "True"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:11:09.626140 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 03:11:09.626140 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 03:11:09.646082 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-841a54c9-dd40-494a-9b4e-d2eebe2ac7d7 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.025464 Jul 18 03:11:09.646891 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3281/6544] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:11:09 2022] POST /compute/v2.1/flavors => generated 437 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:11:09.659255 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cbb694c4-fde0-4939-8a54-6e8a82598646 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1011999136"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:11:09.660522 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cbb694c4-fde0-4939-8a54-6e8a82598646 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] [instance: dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:09.667569 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cbb694c4-fde0-4939-8a54-6e8a82598646 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:09.668028 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cbb694c4-fde0-4939-8a54-6e8a82598646 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:09.669642 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cbb694c4-fde0-4939-8a54-6e8a82598646 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:09.671789 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cbb694c4-fde0-4939-8a54-6e8a82598646 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:09.777138 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-cbb694c4-fde0-4939-8a54-6e8a82598646 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0eef19f71b7445ea866a65cc901ee4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fef2506d528459299fbfb2035f71936', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:09.785224 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cbb694c4-fde0-4939-8a54-6e8a82598646 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] [instance: dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-141543696 {{(pid=119544) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 03:11:09.792487 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cbb694c4-fde0-4939-8a54-6e8a82598646 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:09.792923 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cbb694c4-fde0-4939-8a54-6e8a82598646 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:09.794354 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cbb694c4-fde0-4939-8a54-6e8a82598646 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:09.794815 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cbb694c4-fde0-4939-8a54-6e8a82598646 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:09.816408 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-cbb694c4-fde0-4939-8a54-6e8a82598646 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] Getting quotas for project 13916e11382349bea6dd232680cbbf59. Resources: {'cores', 'ram'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:11:09.821409 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-cbb694c4-fde0-4939-8a54-6e8a82598646 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] Getting quotas for user 1606ee19028947a69f8b9e432785a912 and project 13916e11382349bea6dd232680cbbf59. Resources: {'cores', 'ram'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:11:09.834137 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.compute.api [None req-cbb694c4-fde0-4939-8a54-6e8a82598646 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] ram quota exceeded for 2fef2506d528459299fbfb2035f71936, tried to resize instance. Jul 18 03:11:09.834669 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-cbb694c4-fde0-4939-8a54-6e8a82598646 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cbb694c4-fde0-4939-8a54-6e8a82598646 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] Request method failure captured: Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers/dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3/action HTTP/1.1 Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 39 Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M8__-_upqR45RbLJHcu_-fi3KYjjy-buvfVkBwKlHslHVeKueevS6eq2zSc2NY0Ugk8bTxWr1IbDEyOe5QTwoCbhmvZL-I3V6vzWmrbM_l2osc2HX9ShXLs1aJZXpnmXoPKU_gCrP_uRZhHTjreW-FP12jJH1FUdqz4FlvCR4HaY9A Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 2fef2506d528459299fbfb2035f71936 Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1762867145 Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,admin,reader Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,admin,reader Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2fef2506d528459299fbfb2035f71936"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2fef2506d528459299fbfb2035f71936"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2fef2506d528459299fbfb2035f71936"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2fef2506d528459299fbfb2035f71936"}]}] Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1762867145 Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 2fef2506d528459299fbfb2035f71936 Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1762867145 Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersAdminNegativeTestJSON-1762867145-project-admin Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 0eef19f71b7445ea866a65cc901ee4ed Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1762867145-project-admin Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: {"resize": {"flavorRef": "1011999136"}} Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3', 'body': {'resize': {'flavorRef': '1011999136'}}} Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 03:11:09.836746 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cbb694c4-fde0-4939-8a54-6e8a82598646 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:11:09.841528 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cbb694c4-fde0-4939-8a54-6e8a82598646 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3/action" status: 403 len: 118 microversion: 2.1 time: 0.183465 Jul 18 03:11:09.844103 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3264/6545] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:11:09 2022] POST /compute/v2.1/servers/dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3/action => generated 118 bytes in 190 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:11:09.847921 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e44a8e0b-9232-4101-ac37-07eeb5683c37 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:09.848685 n-d-465891-3 devstack@n-api.service[119543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 03:11:09.848685 n-d-465891-3 devstack@n-api.service[119543]: warnings.warn(msg) Jul 18 03:11:09.866478 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e44a8e0b-9232-4101-ac37-07eeb5683c37 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/1011999136" status: 202 len: 0 microversion: 2.1 time: 0.022036 Jul 18 03:11:09.867081 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3282/6546] 10.222.0.57 () {58 vars in 1160 bytes} [Mon Jul 18 03:11:09 2022] DELETE /compute/v2.1/flavors/1011999136 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 03:11:09.876917 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7cb8c78f-d2ab-4df6-9f9b-c8c75781fc84 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:09.896666 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7cb8c78f-d2ab-4df6-9f9b-c8c75781fc84 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024025 Jul 18 03:11:09.897264 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3265/6547] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 03:11:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:09.915003 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-da15f191-f6e1-4a96-ab82-3c4a31688815 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] Calling method '.version_select at 0x7ff49b954af0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:09.988419 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-da15f191-f6e1-4a96-ab82-3c4a31688815 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] 10.222.0.57 "GET /compute/v2.1/os-quota-sets/2fef2506d528459299fbfb2035f71936" status: 200 len: 371 microversion: 2.1 time: 0.077059 Jul 18 03:11:09.989017 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3283/6548] 10.222.0.57 () {58 vars in 1241 bytes} [Mon Jul 18 03:11:09 2022] GET /compute/v2.1/os-quota-sets/2fef2506d528459299fbfb2035f71936 => generated 371 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:11:10.000289 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-29841fac-d0a4-4498-97e3-67202b25bf26 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-423459714", "id": 403303267, "os-flavor-access:is_public": "True"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:11:10.002005 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 03:11:10.002005 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 03:11:10.017122 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-29841fac-d0a4-4498-97e3-67202b25bf26 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.021186 Jul 18 03:11:10.017736 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3266/6549] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:11:09 2022] POST /compute/v2.1/flavors => generated 433 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:11:10.028262 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0c516e15-0d82-4964-a173-9b4fff5d5047 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "403303267"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:11:10.029535 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0c516e15-0d82-4964-a173-9b4fff5d5047 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] [instance: dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:10.035819 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c516e15-0d82-4964-a173-9b4fff5d5047 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:10.036286 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c516e15-0d82-4964-a173-9b4fff5d5047 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:10.037147 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c516e15-0d82-4964-a173-9b4fff5d5047 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:10.037605 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c516e15-0d82-4964-a173-9b4fff5d5047 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:10.198160 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0c516e15-0d82-4964-a173-9b4fff5d5047 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0eef19f71b7445ea866a65cc901ee4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fef2506d528459299fbfb2035f71936', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:10.204916 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0c516e15-0d82-4964-a173-9b4fff5d5047 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] [instance: dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-423459714 {{(pid=119543) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 03:11:10.211404 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c516e15-0d82-4964-a173-9b4fff5d5047 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:10.211862 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c516e15-0d82-4964-a173-9b4fff5d5047 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:10.212665 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c516e15-0d82-4964-a173-9b4fff5d5047 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:10.213111 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c516e15-0d82-4964-a173-9b4fff5d5047 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:10.234996 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-0c516e15-0d82-4964-a173-9b4fff5d5047 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] Getting quotas for project 13916e11382349bea6dd232680cbbf59. Resources: {'cores', 'ram'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:11:10.240057 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-0c516e15-0d82-4964-a173-9b4fff5d5047 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] Getting quotas for user 1606ee19028947a69f8b9e432785a912 and project 13916e11382349bea6dd232680cbbf59. Resources: {'cores', 'ram'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:11:10.252594 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.compute.api [None req-0c516e15-0d82-4964-a173-9b4fff5d5047 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] cores quota exceeded for 2fef2506d528459299fbfb2035f71936, tried to resize instance. Jul 18 03:11:10.253140 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-0c516e15-0d82-4964-a173-9b4fff5d5047 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0c516e15-0d82-4964-a173-9b4fff5d5047 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] Request method failure captured: Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/servers/dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3/action HTTP/1.1 Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 38 Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1M8__-_upqR45RbLJHcu_-fi3KYjjy-buvfVkBwKlHslHVeKueevS6eq2zSc2NY0Ugk8bTxWr1IbDEyOe5QTwoCbhmvZL-I3V6vzWmrbM_l2osc2HX9ShXLs1aJZXpnmXoPKU_gCrP_uRZhHTjreW-FP12jJH1FUdqz4FlvCR4HaY9A Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 2fef2506d528459299fbfb2035f71936 Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1762867145 Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,admin,reader Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,admin,reader Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2fef2506d528459299fbfb2035f71936"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2fef2506d528459299fbfb2035f71936"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2fef2506d528459299fbfb2035f71936"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2fef2506d528459299fbfb2035f71936"}]}] Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1762867145 Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 2fef2506d528459299fbfb2035f71936 Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1762867145 Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersAdminNegativeTestJSON-1762867145-project-admin Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 0eef19f71b7445ea866a65cc901ee4ed Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1762867145-project-admin Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: {"resize": {"flavorRef": "403303267"}} Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3', 'body': {'resize': {'flavorRef': '403303267'}}} Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 03:11:10.255150 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0c516e15-0d82-4964-a173-9b4fff5d5047 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0c516e15-0d82-4964-a173-9b4fff5d5047 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3/action" status: 403 len: 113 microversion: 2.1 time: 0.232306 Jul 18 03:11:10.258520 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3284/6550] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:11:10 2022] POST /compute/v2.1/servers/dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3/action => generated 113 bytes in 233 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:11:10.265284 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-dcbf180c-32ec-41f7-aea8-f4813136b13c tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:10.266075 n-d-465891-3 devstack@n-api.service[119544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 03:11:10.266075 n-d-465891-3 devstack@n-api.service[119544]: warnings.warn(msg) Jul 18 03:11:10.284573 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-dcbf180c-32ec-41f7-aea8-f4813136b13c tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/403303267" status: 202 len: 0 microversion: 2.1 time: 0.022963 Jul 18 03:11:10.285177 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3267/6551] 10.222.0.57 () {58 vars in 1157 bytes} [Mon Jul 18 03:11:10 2022] DELETE /compute/v2.1/flavors/403303267 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:11:10.293339 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7796e872-74a0-43ae-b990-3e5f78cda108 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:10.314650 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7796e872-74a0-43ae-b990-3e5f78cda108 tempest-ServersAdminNegativeTestJSON-1762867145 tempest-ServersAdminNegativeTestJSON-1762867145-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024947 Jul 18 03:11:10.315321 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3285/6552] 10.222.0.57 () {58 vars in 1145 bytes} [Mon Jul 18 03:11:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:10.332100 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-15dccb1b-08aa-4f27-84c6-863ab70df9b1 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:10.332797 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-15dccb1b-08aa-4f27-84c6-863ab70df9b1 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] [instance: dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:10.338839 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-15dccb1b-08aa-4f27-84c6-863ab70df9b1 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:10.339292 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-15dccb1b-08aa-4f27-84c6-863ab70df9b1 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:10.340057 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-15dccb1b-08aa-4f27-84c6-863ab70df9b1 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:10.341033 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-15dccb1b-08aa-4f27-84c6-863ab70df9b1 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:10.369295 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-15dccb1b-08aa-4f27-84c6-863ab70df9b1 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] [instance: dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:11:10.461210 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-15dccb1b-08aa-4f27-84c6-863ab70df9b1 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] 10.222.0.57 "DELETE /compute/v2.1/servers/dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3" status: 204 len: 0 microversion: 2.1 time: 0.132657 Jul 18 03:11:10.461978 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3268/6553] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:11:10 2022] DELETE /compute/v2.1/servers/dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:11:10.470700 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a93b58fa-6b69-4cde-adda-916c114cab81 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:10.471329 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a93b58fa-6b69-4cde-adda-916c114cab81 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] [instance: dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:10.477572 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a93b58fa-6b69-4cde-adda-916c114cab81 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:10.478067 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a93b58fa-6b69-4cde-adda-916c114cab81 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:10.478904 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a93b58fa-6b69-4cde-adda-916c114cab81 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:10.479332 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a93b58fa-6b69-4cde-adda-916c114cab81 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:10.623496 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a93b58fa-6b69-4cde-adda-916c114cab81 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1606ee19028947a69f8b9e432785a912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13916e11382349bea6dd232680cbbf59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:10.631215 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a93b58fa-6b69-4cde-adda-916c114cab81 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] 10.222.0.57 "GET /compute/v2.1/servers/dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3" status: 200 len: 1477 microversion: 2.1 time: 0.164473 Jul 18 03:11:10.631788 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3286/6554] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:10 2022] GET /compute/v2.1/servers/dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3 => generated 1477 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:11:11.649019 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9e0e0e00-80a0-47d5-b566-e9a4fdb474c0 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:11.649740 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9e0e0e00-80a0-47d5-b566-e9a4fdb474c0 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] [instance: dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:11.657318 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9e0e0e00-80a0-47d5-b566-e9a4fdb474c0 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:11.657793 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9e0e0e00-80a0-47d5-b566-e9a4fdb474c0 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:11.658562 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9e0e0e00-80a0-47d5-b566-e9a4fdb474c0 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:11.658991 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9e0e0e00-80a0-47d5-b566-e9a4fdb474c0 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:11.805738 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9e0e0e00-80a0-47d5-b566-e9a4fdb474c0 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1606ee19028947a69f8b9e432785a912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13916e11382349bea6dd232680cbbf59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:11.816425 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9e0e0e00-80a0-47d5-b566-e9a4fdb474c0 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] 10.222.0.57 "GET /compute/v2.1/servers/dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3" status: 200 len: 1477 microversion: 2.1 time: 0.171910 Jul 18 03:11:11.816940 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3269/6555] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:11 2022] GET /compute/v2.1/servers/dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3 => generated 1477 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:12.435171 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-2a830a93-a2d2-40d4-8357-9c947c4f801e req-2e6f4c96-4e5c-406e-8e9b-0842992a679c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3", "name": "network-vif-deleted", "tag": "5d24d76c-060f-4ade-b0a1-e15b2972e7a8"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:11:12.446368 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-2a830a93-a2d2-40d4-8357-9c947c4f801e req-2e6f4c96-4e5c-406e-8e9b-0842992a679c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:12.446866 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-2a830a93-a2d2-40d4-8357-9c947c4f801e req-2e6f4c96-4e5c-406e-8e9b-0842992a679c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:12.468667 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-2a830a93-a2d2-40d4-8357-9c947c4f801e req-2e6f4c96-4e5c-406e-8e9b-0842992a679c service nova] Creating event network-vif-deleted:5d24d76c-060f-4ade-b0a1-e15b2972e7a8 for instance dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3 on n-h1-465891-3 Jul 18 03:11:12.474938 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-2a830a93-a2d2-40d4-8357-9c947c4f801e req-2e6f4c96-4e5c-406e-8e9b-0842992a679c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043099 Jul 18 03:11:12.485391 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3287/6556] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:11:12.836018 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d428ff8f-bfdb-4200-b2a5-bae87771d124 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:12.837047 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d428ff8f-bfdb-4200-b2a5-bae87771d124 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] [instance: dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:12.849353 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d428ff8f-bfdb-4200-b2a5-bae87771d124 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:12.849908 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d428ff8f-bfdb-4200-b2a5-bae87771d124 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:12.851288 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d428ff8f-bfdb-4200-b2a5-bae87771d124 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:12.852076 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d428ff8f-bfdb-4200-b2a5-bae87771d124 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:12.895889 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d428ff8f-bfdb-4200-b2a5-bae87771d124 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:12.896341 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d428ff8f-bfdb-4200-b2a5-bae87771d124 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:12.896797 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-d428ff8f-bfdb-4200-b2a5-bae87771d124 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lazy-loading 'fault' on Instance uuid dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:11:12.944959 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d428ff8f-bfdb-4200-b2a5-bae87771d124 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1606ee19028947a69f8b9e432785a912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13916e11382349bea6dd232680cbbf59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:12.958519 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d428ff8f-bfdb-4200-b2a5-bae87771d124 tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] 10.222.0.57 "GET /compute/v2.1/servers/dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3" status: 200 len: 1311 microversion: 2.1 time: 0.127663 Jul 18 03:11:12.959631 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3270/6557] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:12 2022] GET /compute/v2.1/servers/dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3 => generated 1311 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:13.984033 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-77be15a0-281a-4067-9ae1-1c62a73da3bc tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:13.984886 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-77be15a0-281a-4067-9ae1-1c62a73da3bc tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] [instance: dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:13.992264 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77be15a0-281a-4067-9ae1-1c62a73da3bc tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:13.992745 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77be15a0-281a-4067-9ae1-1c62a73da3bc tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:13.993549 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77be15a0-281a-4067-9ae1-1c62a73da3bc tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:13.994040 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77be15a0-281a-4067-9ae1-1c62a73da3bc tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:14.008055 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-77be15a0-281a-4067-9ae1-1c62a73da3bc tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] HTTP exception thrown: Instance dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3 could not be found. Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-77be15a0-281a-4067-9ae1-1c62a73da3bc tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Request method failure captured: Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3 HTTP/1.1 Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1M8-Qde1KW0oY1RWORkClQNmWIqw_lZjpNNYlLBP_zrE3V53YRKDgcG3mjj8Jrq0KKu7E0JPdfRle3q_bM3X6HzIewbkGe4ZArN2KaGZpybMLoRIvtvWqkab336U9xfqXhwrdCKN791GD84zUK_oz7vZ8aRNIk6-hEwreZYIHrS-L74 Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 13916e11382349bea6dd232680cbbf59 Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-954373918 Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_13916e11382349bea6dd232680cbbf59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/13916e11382349bea6dd232680cbbf59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/13916e11382349bea6dd232680cbbf59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/13916e11382349bea6dd232680cbbf59"}]}] Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersAdminNegativeTestJSON-954373918 Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 13916e11382349bea6dd232680cbbf59 Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-954373918 Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersAdminNegativeTestJSON-954373918-project Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 1606ee19028947a69f8b9e432785a912 Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersAdminNegativeTestJSON-954373918-project Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3 could not be found. Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3'} Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3 could not be found. Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3 could not be found. Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:11:14.009809 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:11:14.013541 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:11:14.013541 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:11:14.013541 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:11:14.013541 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:11:14.013541 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:11:14.013541 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3 could not be found. Jul 18 03:11:14.013541 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:11:14.013541 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-77be15a0-281a-4067-9ae1-1c62a73da3bc tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] Returning 404 to user: Instance dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:11:14.013541 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-77be15a0-281a-4067-9ae1-1c62a73da3bc tempest-ServersAdminNegativeTestJSON-954373918 tempest-ServersAdminNegativeTestJSON-954373918-project] 10.222.0.57 "GET /compute/v2.1/servers/dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3" status: 404 len: 111 microversion: 2.1 time: 0.034449 Jul 18 03:11:14.013541 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3288/6558] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:13 2022] GET /compute/v2.1/servers/dd5bd687-6f02-4db9-8a4a-ca2bc0b09ec3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:11:20.641508 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:11:20.642917 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:11:20.783879 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e0046eec-44db-4969-bbbd-33a5a2dec10f tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-46141424", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "7c994e08-0f0d-4390-92fd-70b272d230f2"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:11:20.839214 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-e0046eec-44db-4969-bbbd-33a5a2dec10f tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] validate_networks() for [('7c994e08-0f0d-4390-92fd-70b272d230f2', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:11:21.298659 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-e0046eec-44db-4969-bbbd-33a5a2dec10f tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:11:21.299048 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-e0046eec-44db-4969-bbbd-33a5a2dec10f tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:11:21.299875 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-e0046eec-44db-4969-bbbd-33a5a2dec10f tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:11:21.300045 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-e0046eec-44db-4969-bbbd-33a5a2dec10f tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:11:21.300364 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-e0046eec-44db-4969-bbbd-33a5a2dec10f tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:11:21.311323 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e0046eec-44db-4969-bbbd-33a5a2dec10f tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:21.311855 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e0046eec-44db-4969-bbbd-33a5a2dec10f tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:21.312676 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e0046eec-44db-4969-bbbd-33a5a2dec10f tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:21.313118 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e0046eec-44db-4969-bbbd-33a5a2dec10f tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:21.332959 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-e0046eec-44db-4969-bbbd-33a5a2dec10f tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Getting quotas for project 328bbbfaa67d46e3b2e20b7e9117f83a. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:11:21.338747 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-e0046eec-44db-4969-bbbd-33a5a2dec10f tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Getting quotas for user 0f151c216d154d9f85aa2575a937a8fb and project 328bbbfaa67d46e3b2e20b7e9117f83a. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:11:21.357426 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e0046eec-44db-4969-bbbd-33a5a2dec10f tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:11:21.361169 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e0046eec-44db-4969-bbbd-33a5a2dec10f tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:11:21.412642 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e0046eec-44db-4969-bbbd-33a5a2dec10f tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.776775 Jul 18 03:11:21.413318 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3271/6559] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:11:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:11:21.424639 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-39cc48f4-35af-43ac-a4bf-09280e36e57c tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:21.426234 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-39cc48f4-35af-43ac-a4bf-09280e36e57c tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:21.429350 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:11:21.430223 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:11:21.494701 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-39cc48f4-35af-43ac-a4bf-09280e36e57c tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:21.506009 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-39cc48f4-35af-43ac-a4bf-09280e36e57c tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 200 len: 1213 microversion: 2.1 time: 0.085245 Jul 18 03:11:21.507068 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3289/6560] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:21 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:11:22.527151 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a34d4e27-9d9e-4346-8072-efe59c68f249 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:22.538186 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a34d4e27-9d9e-4346-8072-efe59c68f249 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:22.552175 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a34d4e27-9d9e-4346-8072-efe59c68f249 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:22.552907 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a34d4e27-9d9e-4346-8072-efe59c68f249 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:22.554023 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a34d4e27-9d9e-4346-8072-efe59c68f249 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:22.554606 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a34d4e27-9d9e-4346-8072-efe59c68f249 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:22.635284 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a34d4e27-9d9e-4346-8072-efe59c68f249 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:22.644717 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a34d4e27-9d9e-4346-8072-efe59c68f249 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 200 len: 1273 microversion: 2.1 time: 0.123015 Jul 18 03:11:22.657819 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3272/6561] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:22 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 1273 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:23.668316 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9fe515cc-a07a-480a-b9cc-9bab3b2c9875 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:23.669554 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9fe515cc-a07a-480a-b9cc-9bab3b2c9875 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:23.698420 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9fe515cc-a07a-480a-b9cc-9bab3b2c9875 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:23.699111 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9fe515cc-a07a-480a-b9cc-9bab3b2c9875 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:23.705922 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9fe515cc-a07a-480a-b9cc-9bab3b2c9875 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:23.706438 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9fe515cc-a07a-480a-b9cc-9bab3b2c9875 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:23.927860 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9fe515cc-a07a-480a-b9cc-9bab3b2c9875 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:23.942351 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9fe515cc-a07a-480a-b9cc-9bab3b2c9875 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 200 len: 1313 microversion: 2.1 time: 0.281610 Jul 18 03:11:23.943223 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3290/6562] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:23 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 1313 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:24.442043 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-e66b5be5-5ef7-4aa7-8a31-6e2182655a66 req-9391bfe1-a8aa-4add-b4b6-0ebc51c358ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "770700f6-b648-4375-bf45-d3ec39ab8e9d", "tag": "3a7cb69c-565b-42f8-810d-3cb265fe2dea"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:11:24.470445 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-e66b5be5-5ef7-4aa7-8a31-6e2182655a66 req-9391bfe1-a8aa-4add-b4b6-0ebc51c358ae service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:24.470658 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-e66b5be5-5ef7-4aa7-8a31-6e2182655a66 req-9391bfe1-a8aa-4add-b4b6-0ebc51c358ae service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:24.483611 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-e66b5be5-5ef7-4aa7-8a31-6e2182655a66 req-9391bfe1-a8aa-4add-b4b6-0ebc51c358ae service nova] Creating event network-changed:3a7cb69c-565b-42f8-810d-3cb265fe2dea for instance 770700f6-b648-4375-bf45-d3ec39ab8e9d on n-h1-465891-3 Jul 18 03:11:24.494560 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-e66b5be5-5ef7-4aa7-8a31-6e2182655a66 req-9391bfe1-a8aa-4add-b4b6-0ebc51c358ae service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056645 Jul 18 03:11:24.496806 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3273/6563] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:11:24.960982 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c91368a4-161d-4c07-a36d-af570b823504 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:24.961658 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c91368a4-161d-4c07-a36d-af570b823504 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:24.972877 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c91368a4-161d-4c07-a36d-af570b823504 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:24.973634 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c91368a4-161d-4c07-a36d-af570b823504 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:24.974660 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c91368a4-161d-4c07-a36d-af570b823504 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:24.975422 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c91368a4-161d-4c07-a36d-af570b823504 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:25.124391 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c91368a4-161d-4c07-a36d-af570b823504 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:25.132933 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c91368a4-161d-4c07-a36d-af570b823504 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 200 len: 1313 microversion: 2.1 time: 0.176113 Jul 18 03:11:25.133657 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3291/6564] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:24 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:26.153118 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1b90122f-df76-4cd0-9f34-47e3dfe4d1bb tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:26.154094 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1b90122f-df76-4cd0-9f34-47e3dfe4d1bb tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:26.162846 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1b90122f-df76-4cd0-9f34-47e3dfe4d1bb tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:26.163294 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1b90122f-df76-4cd0-9f34-47e3dfe4d1bb tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:26.164082 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1b90122f-df76-4cd0-9f34-47e3dfe4d1bb tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:26.164922 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1b90122f-df76-4cd0-9f34-47e3dfe4d1bb tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:26.312625 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1b90122f-df76-4cd0-9f34-47e3dfe4d1bb tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:26.315102 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:11:26.322044 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1b90122f-df76-4cd0-9f34-47e3dfe4d1bb tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 200 len: 1313 microversion: 2.1 time: 0.174005 Jul 18 03:11:26.322653 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3274/6565] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:26 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:27.340316 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0a4aa198-67e3-4519-a118-3c1a055ab229 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:27.341082 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0a4aa198-67e3-4519-a118-3c1a055ab229 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:27.343594 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:11:27.349918 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0a4aa198-67e3-4519-a118-3c1a055ab229 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:27.350358 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0a4aa198-67e3-4519-a118-3c1a055ab229 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:27.351233 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0a4aa198-67e3-4519-a118-3c1a055ab229 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:27.351662 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0a4aa198-67e3-4519-a118-3c1a055ab229 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:27.355081 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=80 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:11:27.506009 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0a4aa198-67e3-4519-a118-3c1a055ab229 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:27.514480 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0a4aa198-67e3-4519-a118-3c1a055ab229 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 200 len: 1313 microversion: 2.1 time: 0.178474 Jul 18 03:11:27.515098 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3292/6566] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:27 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:28.534806 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f53eea8a-db2e-4f33-800d-e14e77beffb2 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:28.535428 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f53eea8a-db2e-4f33-800d-e14e77beffb2 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:28.537999 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:11:28.544718 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f53eea8a-db2e-4f33-800d-e14e77beffb2 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:28.545161 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f53eea8a-db2e-4f33-800d-e14e77beffb2 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:28.545961 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f53eea8a-db2e-4f33-800d-e14e77beffb2 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:28.546397 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f53eea8a-db2e-4f33-800d-e14e77beffb2 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:28.688598 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f53eea8a-db2e-4f33-800d-e14e77beffb2 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:28.696127 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f53eea8a-db2e-4f33-800d-e14e77beffb2 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 200 len: 1313 microversion: 2.1 time: 0.166046 Jul 18 03:11:28.696697 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3275/6567] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:28 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:29.714013 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8fcfbc50-1ad7-4050-8daf-134486d0cce5 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:29.714642 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8fcfbc50-1ad7-4050-8daf-134486d0cce5 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:29.723022 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8fcfbc50-1ad7-4050-8daf-134486d0cce5 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:29.723694 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8fcfbc50-1ad7-4050-8daf-134486d0cce5 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:29.724665 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8fcfbc50-1ad7-4050-8daf-134486d0cce5 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:29.725121 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8fcfbc50-1ad7-4050-8daf-134486d0cce5 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:29.867805 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8fcfbc50-1ad7-4050-8daf-134486d0cce5 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:29.876142 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8fcfbc50-1ad7-4050-8daf-134486d0cce5 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 200 len: 1313 microversion: 2.1 time: 0.166198 Jul 18 03:11:29.876722 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3293/6568] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:29 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:30.894360 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c821a078-be34-4969-b3c5-22d5d3d5152c tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:30.895013 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c821a078-be34-4969-b3c5-22d5d3d5152c tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:30.897163 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-81c8d751-64ff-4641-8bef-488900867c5b req-6cac0c82-feac-4e74-aafa-8f556ada5989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "770700f6-b648-4375-bf45-d3ec39ab8e9d", "name": "network-vif-plugged", "status": "completed", "tag": "3a7cb69c-565b-42f8-810d-3cb265fe2dea"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:11:30.903474 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c821a078-be34-4969-b3c5-22d5d3d5152c tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:30.904318 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c821a078-be34-4969-b3c5-22d5d3d5152c tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:30.904734 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c821a078-be34-4969-b3c5-22d5d3d5152c tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:30.905186 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c821a078-be34-4969-b3c5-22d5d3d5152c tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:30.908291 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-81c8d751-64ff-4641-8bef-488900867c5b req-6cac0c82-feac-4e74-aafa-8f556ada5989 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:30.908745 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-81c8d751-64ff-4641-8bef-488900867c5b req-6cac0c82-feac-4e74-aafa-8f556ada5989 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:30.928516 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-81c8d751-64ff-4641-8bef-488900867c5b req-6cac0c82-feac-4e74-aafa-8f556ada5989 service nova] Creating event network-vif-plugged:3a7cb69c-565b-42f8-810d-3cb265fe2dea for instance 770700f6-b648-4375-bf45-d3ec39ab8e9d on n-h1-465891-3 Jul 18 03:11:30.934843 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-81c8d751-64ff-4641-8bef-488900867c5b req-6cac0c82-feac-4e74-aafa-8f556ada5989 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113140 Jul 18 03:11:30.935479 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3276/6569] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:11:31.065470 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c821a078-be34-4969-b3c5-22d5d3d5152c tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:31.073672 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c821a078-be34-4969-b3c5-22d5d3d5152c tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 200 len: 1313 microversion: 2.1 time: 0.183687 Jul 18 03:11:31.075025 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3294/6570] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:30 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:32.088741 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:11:32.090106 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:11:32.095805 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c3d2d31e-1643-42b5-affb-af5e57670e31 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:32.096504 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c3d2d31e-1643-42b5-affb-af5e57670e31 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:32.103783 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c3d2d31e-1643-42b5-affb-af5e57670e31 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:32.104225 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c3d2d31e-1643-42b5-affb-af5e57670e31 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:32.104992 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c3d2d31e-1643-42b5-affb-af5e57670e31 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:32.105456 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c3d2d31e-1643-42b5-affb-af5e57670e31 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:32.237491 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c3d2d31e-1643-42b5-affb-af5e57670e31 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:32.245689 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c3d2d31e-1643-42b5-affb-af5e57670e31 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 200 len: 1313 microversion: 2.1 time: 0.157886 Jul 18 03:11:32.246841 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3277/6571] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:32 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:33.264138 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8f81de0f-1171-4810-92c6-f2073dfb5f22 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:33.265626 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8f81de0f-1171-4810-92c6-f2073dfb5f22 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:33.268069 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:11:33.277899 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8f81de0f-1171-4810-92c6-f2073dfb5f22 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:33.279031 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8f81de0f-1171-4810-92c6-f2073dfb5f22 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:33.279253 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8f81de0f-1171-4810-92c6-f2073dfb5f22 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:33.279703 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8f81de0f-1171-4810-92c6-f2073dfb5f22 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:33.421728 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8f81de0f-1171-4810-92c6-f2073dfb5f22 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:33.429980 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8f81de0f-1171-4810-92c6-f2073dfb5f22 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 200 len: 1500 microversion: 2.1 time: 0.171131 Jul 18 03:11:33.430589 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3295/6572] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:33 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 1500 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:33.451455 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b9a8a20e-3fc2-4c4f-a449-0d685b429a4c tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:11:33.452430 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b9a8a20e-3fc2-4c4f-a449-0d685b429a4c tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:33.459446 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b9a8a20e-3fc2-4c4f-a449-0d685b429a4c tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:33.459892 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b9a8a20e-3fc2-4c4f-a449-0d685b429a4c tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:33.460661 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b9a8a20e-3fc2-4c4f-a449-0d685b429a4c tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:33.461099 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b9a8a20e-3fc2-4c4f-a449-0d685b429a4c tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:33.493091 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b9a8a20e-3fc2-4c4f-a449-0d685b429a4c tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:33.500077 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b9a8a20e-3fc2-4c4f-a449-0d685b429a4c tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Old instance type m1.heat2, new instance type m1.heat {{(pid=119544) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 03:11:33.506514 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-b9a8a20e-3fc2-4c4f-a449-0d685b429a4c tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:11:33.506871 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-b9a8a20e-3fc2-4c4f-a449-0d685b429a4c tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:11:33.507337 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-b9a8a20e-3fc2-4c4f-a449-0d685b429a4c tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:11:33.507831 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-b9a8a20e-3fc2-4c4f-a449-0d685b429a4c tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:11:33.508196 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-b9a8a20e-3fc2-4c4f-a449-0d685b429a4c tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:11:33.573593 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b9a8a20e-3fc2-4c4f-a449-0d685b429a4c tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "POST /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d/action" status: 202 len: 0 microversion: 2.1 time: 0.126613 Jul 18 03:11:33.574847 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3278/6573] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:11:33 2022] POST /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:11:33.583480 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-20f01f4e-72dd-433b-a0aa-dac0e327696a tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:33.584101 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-20f01f4e-72dd-433b-a0aa-dac0e327696a tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:33.590209 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20f01f4e-72dd-433b-a0aa-dac0e327696a tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:33.590668 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20f01f4e-72dd-433b-a0aa-dac0e327696a tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:33.591482 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20f01f4e-72dd-433b-a0aa-dac0e327696a tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:33.591940 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20f01f4e-72dd-433b-a0aa-dac0e327696a tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:33.793480 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-20f01f4e-72dd-433b-a0aa-dac0e327696a tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:33.802584 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-20f01f4e-72dd-433b-a0aa-dac0e327696a tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 200 len: 1509 microversion: 2.1 time: 0.222964 Jul 18 03:11:33.803411 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3296/6574] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:33 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 1509 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:34.821924 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1373d672-4228-48b5-bc4f-52803e457de8 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:34.822622 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1373d672-4228-48b5-bc4f-52803e457de8 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:34.830451 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1373d672-4228-48b5-bc4f-52803e457de8 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:34.830956 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1373d672-4228-48b5-bc4f-52803e457de8 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:34.831736 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1373d672-4228-48b5-bc4f-52803e457de8 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:34.832171 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1373d672-4228-48b5-bc4f-52803e457de8 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:35.007107 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1373d672-4228-48b5-bc4f-52803e457de8 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:35.015237 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1373d672-4228-48b5-bc4f-52803e457de8 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 200 len: 1509 microversion: 2.1 time: 0.198668 Jul 18 03:11:35.015817 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3279/6575] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:34 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 1509 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:36.033599 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c1940745-92ec-411d-9032-c31454846d84 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:36.034340 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c1940745-92ec-411d-9032-c31454846d84 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:36.041472 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c1940745-92ec-411d-9032-c31454846d84 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:36.042024 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c1940745-92ec-411d-9032-c31454846d84 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:36.043437 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c1940745-92ec-411d-9032-c31454846d84 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:36.043883 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c1940745-92ec-411d-9032-c31454846d84 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:36.188593 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c1940745-92ec-411d-9032-c31454846d84 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:36.197444 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c1940745-92ec-411d-9032-c31454846d84 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 200 len: 1514 microversion: 2.1 time: 0.167691 Jul 18 03:11:36.198259 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3297/6576] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:36 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:37.217760 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-818290df-0490-40e4-bfa5-dd96e14698cb tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:37.218539 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-818290df-0490-40e4-bfa5-dd96e14698cb tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:37.225628 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-818290df-0490-40e4-bfa5-dd96e14698cb tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:37.226112 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-818290df-0490-40e4-bfa5-dd96e14698cb tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:37.226893 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-818290df-0490-40e4-bfa5-dd96e14698cb tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:37.227324 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-818290df-0490-40e4-bfa5-dd96e14698cb tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:37.374879 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-818290df-0490-40e4-bfa5-dd96e14698cb tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:37.386757 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-818290df-0490-40e4-bfa5-dd96e14698cb tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 200 len: 1514 microversion: 2.1 time: 0.173105 Jul 18 03:11:37.387998 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3280/6577] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:37 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:38.405393 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-54aecfdc-3b90-4df1-9cec-a5abd73fa102 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:38.406112 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-54aecfdc-3b90-4df1-9cec-a5abd73fa102 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:38.413152 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-54aecfdc-3b90-4df1-9cec-a5abd73fa102 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:38.413610 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-54aecfdc-3b90-4df1-9cec-a5abd73fa102 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:38.414441 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-54aecfdc-3b90-4df1-9cec-a5abd73fa102 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:38.414895 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-54aecfdc-3b90-4df1-9cec-a5abd73fa102 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:38.564516 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-54aecfdc-3b90-4df1-9cec-a5abd73fa102 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:38.572427 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-54aecfdc-3b90-4df1-9cec-a5abd73fa102 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 200 len: 1514 microversion: 2.1 time: 0.171615 Jul 18 03:11:38.573159 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3298/6578] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:38 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:39.591267 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3baa2ff3-7e32-412a-ac3f-a939842e8850 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:39.591981 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3baa2ff3-7e32-412a-ac3f-a939842e8850 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:39.599527 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3baa2ff3-7e32-412a-ac3f-a939842e8850 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:39.599983 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3baa2ff3-7e32-412a-ac3f-a939842e8850 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:39.600766 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3baa2ff3-7e32-412a-ac3f-a939842e8850 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:39.601205 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3baa2ff3-7e32-412a-ac3f-a939842e8850 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:39.753507 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3baa2ff3-7e32-412a-ac3f-a939842e8850 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:39.768591 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3baa2ff3-7e32-412a-ac3f-a939842e8850 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 200 len: 1514 microversion: 2.1 time: 0.181803 Jul 18 03:11:39.769665 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3281/6579] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:39 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 1514 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:11:40.791129 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1c55b0e6-086f-4c89-b726-e533f4cdc1c8 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:40.791992 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1c55b0e6-086f-4c89-b726-e533f4cdc1c8 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:40.800863 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c55b0e6-086f-4c89-b726-e533f4cdc1c8 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:40.801334 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c55b0e6-086f-4c89-b726-e533f4cdc1c8 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:40.802185 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c55b0e6-086f-4c89-b726-e533f4cdc1c8 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:40.802651 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c55b0e6-086f-4c89-b726-e533f4cdc1c8 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:40.962679 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1c55b0e6-086f-4c89-b726-e533f4cdc1c8 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:40.971084 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1c55b0e6-086f-4c89-b726-e533f4cdc1c8 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 200 len: 1514 microversion: 2.1 time: 0.183872 Jul 18 03:11:40.971667 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3299/6580] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:40 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 1514 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:41.988921 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ea7cde63-1c8b-4092-9432-33f4f037221a tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:41.989652 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ea7cde63-1c8b-4092-9432-33f4f037221a tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:41.997458 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea7cde63-1c8b-4092-9432-33f4f037221a tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:41.997840 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea7cde63-1c8b-4092-9432-33f4f037221a tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:41.998629 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea7cde63-1c8b-4092-9432-33f4f037221a tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:41.999067 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea7cde63-1c8b-4092-9432-33f4f037221a tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:42.134031 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ea7cde63-1c8b-4092-9432-33f4f037221a tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:42.142124 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ea7cde63-1c8b-4092-9432-33f4f037221a tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 200 len: 1514 microversion: 2.1 time: 0.157176 Jul 18 03:11:42.142711 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3282/6581] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:41 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:43.159807 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-919b0c45-eb26-4ff7-afa9-2803acf75444 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:43.160449 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-919b0c45-eb26-4ff7-afa9-2803acf75444 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:43.168653 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-919b0c45-eb26-4ff7-afa9-2803acf75444 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:43.168836 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-919b0c45-eb26-4ff7-afa9-2803acf75444 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:43.169562 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-919b0c45-eb26-4ff7-afa9-2803acf75444 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:43.170038 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-919b0c45-eb26-4ff7-afa9-2803acf75444 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:43.313910 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-919b0c45-eb26-4ff7-afa9-2803acf75444 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:43.321599 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-919b0c45-eb26-4ff7-afa9-2803acf75444 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 200 len: 1514 microversion: 2.1 time: 0.166060 Jul 18 03:11:43.322230 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3300/6582] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:43 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:44.340362 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ed617be9-c70c-40d1-bf53-dec16f4baf57 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:44.340972 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ed617be9-c70c-40d1-bf53-dec16f4baf57 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:44.348194 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ed617be9-c70c-40d1-bf53-dec16f4baf57 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:44.348642 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ed617be9-c70c-40d1-bf53-dec16f4baf57 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:44.349419 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ed617be9-c70c-40d1-bf53-dec16f4baf57 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:44.349898 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ed617be9-c70c-40d1-bf53-dec16f4baf57 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:44.492907 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ed617be9-c70c-40d1-bf53-dec16f4baf57 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:44.502358 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ed617be9-c70c-40d1-bf53-dec16f4baf57 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 200 len: 1514 microversion: 2.1 time: 0.166521 Jul 18 03:11:44.502959 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3283/6583] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:44 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:45.524979 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-baa7f699-9120-4d96-b293-9a7d17f771f5 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:45.525841 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-baa7f699-9120-4d96-b293-9a7d17f771f5 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:45.534579 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-baa7f699-9120-4d96-b293-9a7d17f771f5 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:45.535433 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-baa7f699-9120-4d96-b293-9a7d17f771f5 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:45.536512 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-baa7f699-9120-4d96-b293-9a7d17f771f5 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:45.536971 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-baa7f699-9120-4d96-b293-9a7d17f771f5 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:45.682297 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-baa7f699-9120-4d96-b293-9a7d17f771f5 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:45.690827 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-baa7f699-9120-4d96-b293-9a7d17f771f5 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 200 len: 1514 microversion: 2.1 time: 0.173743 Jul 18 03:11:45.691432 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3301/6584] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:45 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:46.708470 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-185ea379-adbb-46ad-8cd8-4de193ecbd25 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:46.709095 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-185ea379-adbb-46ad-8cd8-4de193ecbd25 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:46.717568 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-185ea379-adbb-46ad-8cd8-4de193ecbd25 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:46.718048 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-185ea379-adbb-46ad-8cd8-4de193ecbd25 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:46.718828 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-185ea379-adbb-46ad-8cd8-4de193ecbd25 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:46.719264 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-185ea379-adbb-46ad-8cd8-4de193ecbd25 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:47.192189 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-185ea379-adbb-46ad-8cd8-4de193ecbd25 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:47.203449 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-185ea379-adbb-46ad-8cd8-4de193ecbd25 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 200 len: 1514 microversion: 2.1 time: 0.498732 Jul 18 03:11:47.204413 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3284/6585] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:46 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 1514 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:48.224642 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-30b9af78-a52a-4161-b490-083b6a020866 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:48.225262 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-30b9af78-a52a-4161-b490-083b6a020866 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:48.233322 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-30b9af78-a52a-4161-b490-083b6a020866 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:48.233814 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-30b9af78-a52a-4161-b490-083b6a020866 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:48.234748 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-30b9af78-a52a-4161-b490-083b6a020866 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:48.235226 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-30b9af78-a52a-4161-b490-083b6a020866 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:48.382511 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-30b9af78-a52a-4161-b490-083b6a020866 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:48.392828 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-30b9af78-a52a-4161-b490-083b6a020866 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 200 len: 1514 microversion: 2.1 time: 0.172070 Jul 18 03:11:48.393772 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3302/6586] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:48 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:11:49.412105 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5c6fed9e-7890-4afb-8c59-32660649d8f3 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:49.412741 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5c6fed9e-7890-4afb-8c59-32660649d8f3 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:49.421107 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5c6fed9e-7890-4afb-8c59-32660649d8f3 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:49.421561 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5c6fed9e-7890-4afb-8c59-32660649d8f3 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:49.422408 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5c6fed9e-7890-4afb-8c59-32660649d8f3 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:49.422857 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5c6fed9e-7890-4afb-8c59-32660649d8f3 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:49.581022 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5c6fed9e-7890-4afb-8c59-32660649d8f3 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:49.589856 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5c6fed9e-7890-4afb-8c59-32660649d8f3 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 200 len: 1514 microversion: 2.1 time: 0.181069 Jul 18 03:11:49.590454 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3285/6587] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:49 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:50.608036 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bbd265cd-8700-40f9-a135-8e3e31bc51cc tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:50.608686 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bbd265cd-8700-40f9-a135-8e3e31bc51cc tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:50.616143 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bbd265cd-8700-40f9-a135-8e3e31bc51cc tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:50.616993 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bbd265cd-8700-40f9-a135-8e3e31bc51cc tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:50.618461 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bbd265cd-8700-40f9-a135-8e3e31bc51cc tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:50.619303 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bbd265cd-8700-40f9-a135-8e3e31bc51cc tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:50.767491 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bbd265cd-8700-40f9-a135-8e3e31bc51cc tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:50.775655 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bbd265cd-8700-40f9-a135-8e3e31bc51cc tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 200 len: 1514 microversion: 2.1 time: 0.172535 Jul 18 03:11:50.776269 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3303/6588] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:50 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:11:51.794819 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e66af446-9675-457a-86e3-94260500b2bb tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:51.795440 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e66af446-9675-457a-86e3-94260500b2bb tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:51.803079 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e66af446-9675-457a-86e3-94260500b2bb tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:51.803531 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e66af446-9675-457a-86e3-94260500b2bb tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:51.804321 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e66af446-9675-457a-86e3-94260500b2bb tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:51.804755 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e66af446-9675-457a-86e3-94260500b2bb tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:51.954600 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e66af446-9675-457a-86e3-94260500b2bb tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:51.962612 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e66af446-9675-457a-86e3-94260500b2bb tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 200 len: 1514 microversion: 2.1 time: 0.172018 Jul 18 03:11:51.963205 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3286/6589] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:51 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:52.984995 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4c68f93c-58c6-4284-819c-07465a12ac42 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:52.986363 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4c68f93c-58c6-4284-819c-07465a12ac42 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:53.000349 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4c68f93c-58c6-4284-819c-07465a12ac42 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:53.001175 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4c68f93c-58c6-4284-819c-07465a12ac42 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:53.002645 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4c68f93c-58c6-4284-819c-07465a12ac42 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:53.003483 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4c68f93c-58c6-4284-819c-07465a12ac42 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:53.193100 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4c68f93c-58c6-4284-819c-07465a12ac42 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:53.202454 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4c68f93c-58c6-4284-819c-07465a12ac42 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 200 len: 1514 microversion: 2.1 time: 0.224620 Jul 18 03:11:53.203165 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3304/6590] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:52 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 1514 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:54.224601 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-88a9590a-33ff-4f33-977a-bc9055f2f637 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:54.226066 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-88a9590a-33ff-4f33-977a-bc9055f2f637 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:54.239717 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-88a9590a-33ff-4f33-977a-bc9055f2f637 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:54.240687 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-88a9590a-33ff-4f33-977a-bc9055f2f637 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:54.242074 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-88a9590a-33ff-4f33-977a-bc9055f2f637 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:54.242843 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-88a9590a-33ff-4f33-977a-bc9055f2f637 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:54.399670 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-88a9590a-33ff-4f33-977a-bc9055f2f637 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:54.413423 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-88a9590a-33ff-4f33-977a-bc9055f2f637 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 200 len: 1514 microversion: 2.1 time: 0.195718 Jul 18 03:11:54.414597 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3287/6591] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:54 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 1514 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:55.433188 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fde6606a-3ebc-4f34-8ca4-11d4751f2352 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:55.433811 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fde6606a-3ebc-4f34-8ca4-11d4751f2352 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:55.441165 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fde6606a-3ebc-4f34-8ca4-11d4751f2352 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:55.441624 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fde6606a-3ebc-4f34-8ca4-11d4751f2352 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:55.442435 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fde6606a-3ebc-4f34-8ca4-11d4751f2352 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:55.442884 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fde6606a-3ebc-4f34-8ca4-11d4751f2352 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:55.591741 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fde6606a-3ebc-4f34-8ca4-11d4751f2352 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:55.600545 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fde6606a-3ebc-4f34-8ca4-11d4751f2352 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 200 len: 1514 microversion: 2.1 time: 0.171649 Jul 18 03:11:55.601240 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3305/6592] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:55 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:56.618593 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d49b3ac0-5f23-4c36-83ec-db0db1d0899d tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:56.619466 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d49b3ac0-5f23-4c36-83ec-db0db1d0899d tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:56.628630 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d49b3ac0-5f23-4c36-83ec-db0db1d0899d tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:56.629114 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d49b3ac0-5f23-4c36-83ec-db0db1d0899d tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:56.629974 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d49b3ac0-5f23-4c36-83ec-db0db1d0899d tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:56.630464 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d49b3ac0-5f23-4c36-83ec-db0db1d0899d tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:56.789354 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d49b3ac0-5f23-4c36-83ec-db0db1d0899d tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:56.797530 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d49b3ac0-5f23-4c36-83ec-db0db1d0899d tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 200 len: 1514 microversion: 2.1 time: 0.183408 Jul 18 03:11:56.798147 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3288/6593] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:56 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 1514 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:57.815129 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5d00645f-ef2f-4d74-a690-f5e6ba1a7a7d tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:57.815705 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5d00645f-ef2f-4d74-a690-f5e6ba1a7a7d tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:57.818400 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=28 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:11:57.824671 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5d00645f-ef2f-4d74-a690-f5e6ba1a7a7d tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:57.825137 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5d00645f-ef2f-4d74-a690-f5e6ba1a7a7d tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:57.825972 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5d00645f-ef2f-4d74-a690-f5e6ba1a7a7d tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:57.826427 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5d00645f-ef2f-4d74-a690-f5e6ba1a7a7d tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:57.829500 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=84 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:11:57.983200 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5d00645f-ef2f-4d74-a690-f5e6ba1a7a7d tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:57.991766 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5d00645f-ef2f-4d74-a690-f5e6ba1a7a7d tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 200 len: 1514 microversion: 2.1 time: 0.180697 Jul 18 03:11:57.992370 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3306/6594] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:57 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:11:59.010047 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-439cf984-bb6d-47b3-8cb6-5552e4d35af8 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:59.011346 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-439cf984-bb6d-47b3-8cb6-5552e4d35af8 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:59.014838 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=32 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:11:59.024781 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-439cf984-bb6d-47b3-8cb6-5552e4d35af8 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:59.025563 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-439cf984-bb6d-47b3-8cb6-5552e4d35af8 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:59.027055 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-439cf984-bb6d-47b3-8cb6-5552e4d35af8 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:59.028102 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-439cf984-bb6d-47b3-8cb6-5552e4d35af8 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:59.036619 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:11:59.207033 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-439cf984-bb6d-47b3-8cb6-5552e4d35af8 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:59.216758 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-439cf984-bb6d-47b3-8cb6-5552e4d35af8 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 200 len: 1514 microversion: 2.1 time: 0.210653 Jul 18 03:11:59.217379 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3289/6595] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:59 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 1514 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:00.236456 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5b341c84-a270-491e-9b5d-809c2bf14b0d tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:00.237084 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5b341c84-a270-491e-9b5d-809c2bf14b0d tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:00.245015 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5b341c84-a270-491e-9b5d-809c2bf14b0d tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:00.245477 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5b341c84-a270-491e-9b5d-809c2bf14b0d tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:00.246328 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5b341c84-a270-491e-9b5d-809c2bf14b0d tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:00.246783 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5b341c84-a270-491e-9b5d-809c2bf14b0d tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:00.398546 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5b341c84-a270-491e-9b5d-809c2bf14b0d tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:00.410168 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5b341c84-a270-491e-9b5d-809c2bf14b0d tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 200 len: 1514 microversion: 2.1 time: 0.178332 Jul 18 03:12:00.410781 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3307/6596] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:00 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 1514 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:12:01.428741 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-02f89bea-6c4b-4bb2-9c42-7988ba55510b tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:01.429308 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-02f89bea-6c4b-4bb2-9c42-7988ba55510b tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:01.437585 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-02f89bea-6c4b-4bb2-9c42-7988ba55510b tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:01.438066 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-02f89bea-6c4b-4bb2-9c42-7988ba55510b tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:01.438854 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-02f89bea-6c4b-4bb2-9c42-7988ba55510b tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:01.439298 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-02f89bea-6c4b-4bb2-9c42-7988ba55510b tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:01.613390 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-02f89bea-6c4b-4bb2-9c42-7988ba55510b tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:01.622930 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-02f89bea-6c4b-4bb2-9c42-7988ba55510b tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 200 len: 1514 microversion: 2.1 time: 0.198141 Jul 18 03:12:01.623540 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3290/6597] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:01 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 1514 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:02.641143 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9101e940-b37f-4408-aa42-629202be3678 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:02.641909 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9101e940-b37f-4408-aa42-629202be3678 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:02.649572 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9101e940-b37f-4408-aa42-629202be3678 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:02.650198 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9101e940-b37f-4408-aa42-629202be3678 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:02.651817 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9101e940-b37f-4408-aa42-629202be3678 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:02.652050 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9101e940-b37f-4408-aa42-629202be3678 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:02.813416 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9101e940-b37f-4408-aa42-629202be3678 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:02.821926 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9101e940-b37f-4408-aa42-629202be3678 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 200 len: 1514 microversion: 2.1 time: 0.184639 Jul 18 03:12:02.822552 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3308/6598] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:02 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 1514 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:03.844393 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-21b60d15-05d8-411b-9186-4a149b41ccb8 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:03.845055 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-21b60d15-05d8-411b-9186-4a149b41ccb8 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:03.853508 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-21b60d15-05d8-411b-9186-4a149b41ccb8 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:03.854962 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-21b60d15-05d8-411b-9186-4a149b41ccb8 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:03.855864 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-21b60d15-05d8-411b-9186-4a149b41ccb8 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:03.856331 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-21b60d15-05d8-411b-9186-4a149b41ccb8 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:03.878451 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-afed32b0-ede0-4acb-b816-35192836e6d2 req-538da416-73e8-41ed-a23a-beb3d497e85a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "770700f6-b648-4375-bf45-d3ec39ab8e9d", "name": "network-vif-unplugged", "status": "completed", "tag": "3a7cb69c-565b-42f8-810d-3cb265fe2dea"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:12:03.894813 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-afed32b0-ede0-4acb-b816-35192836e6d2 req-538da416-73e8-41ed-a23a-beb3d497e85a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:03.895586 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-afed32b0-ede0-4acb-b816-35192836e6d2 req-538da416-73e8-41ed-a23a-beb3d497e85a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:03.921875 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-afed32b0-ede0-4acb-b816-35192836e6d2 req-538da416-73e8-41ed-a23a-beb3d497e85a service nova] Creating event network-vif-unplugged:3a7cb69c-565b-42f8-810d-3cb265fe2dea for instance 770700f6-b648-4375-bf45-d3ec39ab8e9d on n-h2-465891-3 Jul 18 03:12:03.934827 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [req-afed32b0-ede0-4acb-b816-35192836e6d2 req-538da416-73e8-41ed-a23a-beb3d497e85a service nova] Instance 770700f6-b648-4375-bf45-d3ec39ab8e9d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3', 'n-h2-465891-3'} {{(pid=119544) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:12:03.959096 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-afed32b0-ede0-4acb-b816-35192836e6d2 req-538da416-73e8-41ed-a23a-beb3d497e85a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.180272 Jul 18 03:12:03.959925 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3291/6599] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:12:04.376582 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-21b60d15-05d8-411b-9186-4a149b41ccb8 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:04.389316 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-21b60d15-05d8-411b-9186-4a149b41ccb8 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 200 len: 1513 microversion: 2.1 time: 0.551206 Jul 18 03:12:04.390496 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3309/6600] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:03 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 1513 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:12:05.410193 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6566d6cf-bf62-4dff-ba8d-f9f30b44d872 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:05.410920 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6566d6cf-bf62-4dff-ba8d-f9f30b44d872 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:05.417638 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6566d6cf-bf62-4dff-ba8d-f9f30b44d872 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:05.418121 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6566d6cf-bf62-4dff-ba8d-f9f30b44d872 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:05.418907 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6566d6cf-bf62-4dff-ba8d-f9f30b44d872 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:05.419348 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6566d6cf-bf62-4dff-ba8d-f9f30b44d872 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:05.587988 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6566d6cf-bf62-4dff-ba8d-f9f30b44d872 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:05.597025 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6566d6cf-bf62-4dff-ba8d-f9f30b44d872 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 200 len: 1511 microversion: 2.1 time: 0.192159 Jul 18 03:12:05.597620 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3292/6601] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:05 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 1511 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:12:06.161728 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-9da82a58-2874-415d-8b19-8bfb8c1c39ec req-922ff224-fb68-40ef-8238-12189072c5e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "770700f6-b648-4375-bf45-d3ec39ab8e9d", "tag": "3a7cb69c-565b-42f8-810d-3cb265fe2dea"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:12:06.172200 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-9da82a58-2874-415d-8b19-8bfb8c1c39ec req-922ff224-fb68-40ef-8238-12189072c5e3 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:06.172657 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-9da82a58-2874-415d-8b19-8bfb8c1c39ec req-922ff224-fb68-40ef-8238-12189072c5e3 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:06.186312 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-9da82a58-2874-415d-8b19-8bfb8c1c39ec req-922ff224-fb68-40ef-8238-12189072c5e3 service nova] Creating event network-changed:3a7cb69c-565b-42f8-810d-3cb265fe2dea for instance 770700f6-b648-4375-bf45-d3ec39ab8e9d on n-h2-465891-3 Jul 18 03:12:06.192504 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [req-9da82a58-2874-415d-8b19-8bfb8c1c39ec req-922ff224-fb68-40ef-8238-12189072c5e3 service nova] Instance 770700f6-b648-4375-bf45-d3ec39ab8e9d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3', 'n-h2-465891-3'} {{(pid=119543) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:12:06.204781 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-9da82a58-2874-415d-8b19-8bfb8c1c39ec req-922ff224-fb68-40ef-8238-12189072c5e3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046817 Jul 18 03:12:06.205398 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3310/6602] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:12:06.620949 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-40cbcf3a-e156-42d0-9a5c-a7304d97fa04 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:06.622014 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-40cbcf3a-e156-42d0-9a5c-a7304d97fa04 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:06.632498 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-40cbcf3a-e156-42d0-9a5c-a7304d97fa04 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:06.641107 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-40cbcf3a-e156-42d0-9a5c-a7304d97fa04 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:06.649541 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-40cbcf3a-e156-42d0-9a5c-a7304d97fa04 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:06.650491 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-40cbcf3a-e156-42d0-9a5c-a7304d97fa04 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:07.082070 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-40cbcf3a-e156-42d0-9a5c-a7304d97fa04 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:07.097002 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-40cbcf3a-e156-42d0-9a5c-a7304d97fa04 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 200 len: 1511 microversion: 2.1 time: 0.484131 Jul 18 03:12:07.097985 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3293/6603] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:06 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 1511 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:08.117309 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d5768562-6ec1-4478-b71f-a7c3c053b569 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:08.118157 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d5768562-6ec1-4478-b71f-a7c3c053b569 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:08.126387 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5768562-6ec1-4478-b71f-a7c3c053b569 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:08.126837 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5768562-6ec1-4478-b71f-a7c3c053b569 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:08.127662 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5768562-6ec1-4478-b71f-a7c3c053b569 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:08.128124 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5768562-6ec1-4478-b71f-a7c3c053b569 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:08.292649 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d5768562-6ec1-4478-b71f-a7c3c053b569 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:08.306167 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d5768562-6ec1-4478-b71f-a7c3c053b569 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 200 len: 1508 microversion: 2.1 time: 0.194044 Jul 18 03:12:08.307252 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3311/6604] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:08 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 1508 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:12:08.325248 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1eec7125-9883-4496-9fe7-54c8295220df tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:08.325911 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1eec7125-9883-4496-9fe7-54c8295220df tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:08.333449 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1eec7125-9883-4496-9fe7-54c8295220df tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:08.333943 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1eec7125-9883-4496-9fe7-54c8295220df tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:08.334772 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1eec7125-9883-4496-9fe7-54c8295220df tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:08.335226 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1eec7125-9883-4496-9fe7-54c8295220df tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:08.367128 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1eec7125-9883-4496-9fe7-54c8295220df tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:12:08.426111 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.compute.api [None req-1eec7125-9883-4496-9fe7-54c8295220df tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Found an unconfirmed migration during delete, id: 16, status: finished Jul 18 03:12:08.910573 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-eb110c12-f3f8-4226-a572-85861e08639e req-0d8913e1-a920-4bd2-9a03-8f7c2a4edf90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "770700f6-b648-4375-bf45-d3ec39ab8e9d", "name": "network-vif-plugged", "status": "completed", "tag": "3a7cb69c-565b-42f8-810d-3cb265fe2dea"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:12:08.920216 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-eb110c12-f3f8-4226-a572-85861e08639e req-0d8913e1-a920-4bd2-9a03-8f7c2a4edf90 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:08.920961 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-eb110c12-f3f8-4226-a572-85861e08639e req-0d8913e1-a920-4bd2-9a03-8f7c2a4edf90 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:08.940255 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-eb110c12-f3f8-4226-a572-85861e08639e req-0d8913e1-a920-4bd2-9a03-8f7c2a4edf90 service nova] Creating event network-vif-plugged:3a7cb69c-565b-42f8-810d-3cb265fe2dea for instance 770700f6-b648-4375-bf45-d3ec39ab8e9d on n-h2-465891-3 Jul 18 03:12:08.952651 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [req-eb110c12-f3f8-4226-a572-85861e08639e req-0d8913e1-a920-4bd2-9a03-8f7c2a4edf90 service nova] Instance 770700f6-b648-4375-bf45-d3ec39ab8e9d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3', 'n-h2-465891-3'} {{(pid=119543) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:12:08.976432 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-eb110c12-f3f8-4226-a572-85861e08639e req-0d8913e1-a920-4bd2-9a03-8f7c2a4edf90 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068803 Jul 18 03:12:08.977954 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3312/6605] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:12:10.173557 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1eec7125-9883-4496-9fe7-54c8295220df tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "DELETE /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 204 len: 0 microversion: 2.1 time: 1.853006 Jul 18 03:12:10.175025 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3294/6606] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:12:08 2022] DELETE /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 0 bytes in 1856 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:12:10.187082 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9d17e8a3-b802-4423-b38c-ec4fe249b024 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:10.188018 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9d17e8a3-b802-4423-b38c-ec4fe249b024 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:10.196452 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9d17e8a3-b802-4423-b38c-ec4fe249b024 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:10.196910 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9d17e8a3-b802-4423-b38c-ec4fe249b024 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:10.198003 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9d17e8a3-b802-4423-b38c-ec4fe249b024 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:10.198473 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9d17e8a3-b802-4423-b38c-ec4fe249b024 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:10.362842 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9d17e8a3-b802-4423-b38c-ec4fe249b024 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:10.372925 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9d17e8a3-b802-4423-b38c-ec4fe249b024 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 200 len: 1500 microversion: 2.1 time: 0.191592 Jul 18 03:12:10.373596 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3313/6607] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:10 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 1500 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:11.393940 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-003264d1-e7f5-4427-aca0-0e42a9b11d01 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:11.394826 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-003264d1-e7f5-4427-aca0-0e42a9b11d01 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:11.404223 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-003264d1-e7f5-4427-aca0-0e42a9b11d01 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:11.404695 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-003264d1-e7f5-4427-aca0-0e42a9b11d01 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:11.405654 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-003264d1-e7f5-4427-aca0-0e42a9b11d01 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:11.406035 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-003264d1-e7f5-4427-aca0-0e42a9b11d01 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:11.565636 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-003264d1-e7f5-4427-aca0-0e42a9b11d01 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f151c216d154d9f85aa2575a937a8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328bbbfaa67d46e3b2e20b7e9117f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:11.575890 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-003264d1-e7f5-4427-aca0-0e42a9b11d01 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 200 len: 1500 microversion: 2.1 time: 0.187211 Jul 18 03:12:11.576534 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3295/6608] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:11 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 1500 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:12.127591 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-bd9b1bbb-3657-4fae-b6af-ee12dcbfc952 req-a89220f7-37cf-452c-95b7-e977e6423770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "770700f6-b648-4375-bf45-d3ec39ab8e9d", "name": "network-vif-deleted", "tag": "3a7cb69c-565b-42f8-810d-3cb265fe2dea"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:12:12.139374 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-bd9b1bbb-3657-4fae-b6af-ee12dcbfc952 req-a89220f7-37cf-452c-95b7-e977e6423770 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:12.139870 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-bd9b1bbb-3657-4fae-b6af-ee12dcbfc952 req-a89220f7-37cf-452c-95b7-e977e6423770 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:12.156656 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-bd9b1bbb-3657-4fae-b6af-ee12dcbfc952 req-a89220f7-37cf-452c-95b7-e977e6423770 service nova] Creating event network-vif-deleted:3a7cb69c-565b-42f8-810d-3cb265fe2dea for instance 770700f6-b648-4375-bf45-d3ec39ab8e9d on n-h2-465891-3 Jul 18 03:12:12.163493 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-bd9b1bbb-3657-4fae-b6af-ee12dcbfc952 req-a89220f7-37cf-452c-95b7-e977e6423770 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039410 Jul 18 03:12:12.164635 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3314/6609] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:12:12.593358 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f0154b0f-a1d3-4cc9-93bd-480ddd695a7a tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:12.594032 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f0154b0f-a1d3-4cc9-93bd-480ddd695a7a tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:12.601178 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f0154b0f-a1d3-4cc9-93bd-480ddd695a7a tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:12.601634 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f0154b0f-a1d3-4cc9-93bd-480ddd695a7a tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:12.602441 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f0154b0f-a1d3-4cc9-93bd-480ddd695a7a tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:12.602885 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f0154b0f-a1d3-4cc9-93bd-480ddd695a7a tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:12.618659 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-f0154b0f-a1d3-4cc9-93bd-480ddd695a7a tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] HTTP exception thrown: Instance 770700f6-b648-4375-bf45-d3ec39ab8e9d could not be found. Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f0154b0f-a1d3-4cc9-93bd-480ddd695a7a tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Request method failure captured: Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d HTTP/1.1 Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M9YM5c7oZ23ZBHi49s1n7Z5O0NmBuBnGU2-GCyUvveAm_t5KHes0XeokndOlFV-1bdQTitQe7A4Um0kTSvt7ZupkY87EKfr1F9q7yvrOARZ0vXPMtOwDz_fAOm4wtnZEKk86NWqtCyq16AEw2480ZQ_c_E8symr4pSoe2kszbY8GYM Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 328bbbfaa67d46e3b2e20b7e9117f83a Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-DeleteServersTestJSON-1743824235 Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_328bbbfaa67d46e3b2e20b7e9117f83a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/328bbbfaa67d46e3b2e20b7e9117f83a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/328bbbfaa67d46e3b2e20b7e9117f83a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/328bbbfaa67d46e3b2e20b7e9117f83a"}]}] Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-DeleteServersTestJSON-1743824235 Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 328bbbfaa67d46e3b2e20b7e9117f83a Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-DeleteServersTestJSON-1743824235 Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-DeleteServersTestJSON-1743824235-project Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 0f151c216d154d9f85aa2575a937a8fb Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-DeleteServersTestJSON-1743824235-project Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 770700f6-b648-4375-bf45-d3ec39ab8e9d could not be found. Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '770700f6-b648-4375-bf45-d3ec39ab8e9d'} Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 770700f6-b648-4375-bf45-d3ec39ab8e9d could not be found. Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 770700f6-b648-4375-bf45-d3ec39ab8e9d could not be found. Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:12:12.620722 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:12:12.625093 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:12:12.625093 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:12:12.625093 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:12:12.625093 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:12:12.625093 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:12:12.625093 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 770700f6-b648-4375-bf45-d3ec39ab8e9d could not be found. Jul 18 03:12:12.625093 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:12:12.625093 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f0154b0f-a1d3-4cc9-93bd-480ddd695a7a tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Returning 404 to user: Instance 770700f6-b648-4375-bf45-d3ec39ab8e9d could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:12:12.625093 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f0154b0f-a1d3-4cc9-93bd-480ddd695a7a tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 404 len: 111 microversion: 2.1 time: 0.032953 Jul 18 03:12:12.625093 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3296/6610] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:12 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:12:12.639167 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2758e7d8-27ae-4538-ba18-c11e3dacd199 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:12.639777 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2758e7d8-27ae-4538-ba18-c11e3dacd199 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:12.646543 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2758e7d8-27ae-4538-ba18-c11e3dacd199 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:12.647005 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2758e7d8-27ae-4538-ba18-c11e3dacd199 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:12.647818 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2758e7d8-27ae-4538-ba18-c11e3dacd199 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:12.648248 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2758e7d8-27ae-4538-ba18-c11e3dacd199 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:12.663374 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-2758e7d8-27ae-4538-ba18-c11e3dacd199 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] HTTP exception thrown: Instance 770700f6-b648-4375-bf45-d3ec39ab8e9d could not be found. Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2758e7d8-27ae-4538-ba18-c11e3dacd199 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Request method failure captured: Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d HTTP/1.1 Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1M9YM5c7oZ23ZBHi49s1n7Z5O0NmBuBnGU2-GCyUvveAm_t5KHes0XeokndOlFV-1bdQTitQe7A4Um0kTSvt7ZupkY87EKfr1F9q7yvrOARZ0vXPMtOwDz_fAOm4wtnZEKk86NWqtCyq16AEw2480ZQ_c_E8symr4pSoe2kszbY8GYM Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 328bbbfaa67d46e3b2e20b7e9117f83a Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-DeleteServersTestJSON-1743824235 Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_328bbbfaa67d46e3b2e20b7e9117f83a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/328bbbfaa67d46e3b2e20b7e9117f83a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/328bbbfaa67d46e3b2e20b7e9117f83a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/328bbbfaa67d46e3b2e20b7e9117f83a"}]}] Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-DeleteServersTestJSON-1743824235 Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 328bbbfaa67d46e3b2e20b7e9117f83a Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-DeleteServersTestJSON-1743824235 Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-DeleteServersTestJSON-1743824235-project Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 0f151c216d154d9f85aa2575a937a8fb Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-DeleteServersTestJSON-1743824235-project Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 770700f6-b648-4375-bf45-d3ec39ab8e9d could not be found. Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '770700f6-b648-4375-bf45-d3ec39ab8e9d'} Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 770700f6-b648-4375-bf45-d3ec39ab8e9d could not be found. Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:12:12.665110 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:12:12.669287 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 770700f6-b648-4375-bf45-d3ec39ab8e9d could not be found. Jul 18 03:12:12.669287 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:12:12.669287 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:12:12.669287 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:12:12.669287 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:12:12.669287 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:12:12.669287 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:12:12.669287 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:12:12.669287 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:12:12.669287 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 770700f6-b648-4375-bf45-d3ec39ab8e9d could not be found. Jul 18 03:12:12.669287 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:12:12.669287 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2758e7d8-27ae-4538-ba18-c11e3dacd199 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Returning 404 to user: Instance 770700f6-b648-4375-bf45-d3ec39ab8e9d could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:12:12.669287 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2758e7d8-27ae-4538-ba18-c11e3dacd199 tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "DELETE /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 404 len: 111 microversion: 2.1 time: 0.032095 Jul 18 03:12:12.669287 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3315/6611] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:12:12 2022] DELETE /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:12:12.679007 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-db6d588d-25d3-4056-95e9-4d6810d2f8dd tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:12.679630 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-db6d588d-25d3-4056-95e9-4d6810d2f8dd tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] [instance: 770700f6-b648-4375-bf45-d3ec39ab8e9d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:12.686235 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-db6d588d-25d3-4056-95e9-4d6810d2f8dd tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:12.686686 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-db6d588d-25d3-4056-95e9-4d6810d2f8dd tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:12.687551 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-db6d588d-25d3-4056-95e9-4d6810d2f8dd tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:12.687990 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-db6d588d-25d3-4056-95e9-4d6810d2f8dd tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:12.702856 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-db6d588d-25d3-4056-95e9-4d6810d2f8dd tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] HTTP exception thrown: Instance 770700f6-b648-4375-bf45-d3ec39ab8e9d could not be found. Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-db6d588d-25d3-4056-95e9-4d6810d2f8dd tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Request method failure captured: Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d HTTP/1.1 Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M9YM5c7oZ23ZBHi49s1n7Z5O0NmBuBnGU2-GCyUvveAm_t5KHes0XeokndOlFV-1bdQTitQe7A4Um0kTSvt7ZupkY87EKfr1F9q7yvrOARZ0vXPMtOwDz_fAOm4wtnZEKk86NWqtCyq16AEw2480ZQ_c_E8symr4pSoe2kszbY8GYM Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 328bbbfaa67d46e3b2e20b7e9117f83a Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-DeleteServersTestJSON-1743824235 Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_328bbbfaa67d46e3b2e20b7e9117f83a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/328bbbfaa67d46e3b2e20b7e9117f83a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/328bbbfaa67d46e3b2e20b7e9117f83a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/328bbbfaa67d46e3b2e20b7e9117f83a"}]}] Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-DeleteServersTestJSON-1743824235 Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 328bbbfaa67d46e3b2e20b7e9117f83a Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-DeleteServersTestJSON-1743824235 Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-DeleteServersTestJSON-1743824235-project Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 0f151c216d154d9f85aa2575a937a8fb Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-DeleteServersTestJSON-1743824235-project Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 770700f6-b648-4375-bf45-d3ec39ab8e9d could not be found. Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '770700f6-b648-4375-bf45-d3ec39ab8e9d'} Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 770700f6-b648-4375-bf45-d3ec39ab8e9d could not be found. Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 770700f6-b648-4375-bf45-d3ec39ab8e9d could not be found. Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:12:12.704432 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:12:12.708679 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:12:12.708679 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:12:12.708679 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:12:12.708679 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:12:12.708679 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:12:12.708679 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 770700f6-b648-4375-bf45-d3ec39ab8e9d could not be found. Jul 18 03:12:12.708679 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:12:12.708679 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-db6d588d-25d3-4056-95e9-4d6810d2f8dd tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] Returning 404 to user: Instance 770700f6-b648-4375-bf45-d3ec39ab8e9d could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:12:12.708679 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-db6d588d-25d3-4056-95e9-4d6810d2f8dd tempest-DeleteServersTestJSON-1743824235 tempest-DeleteServersTestJSON-1743824235-project] 10.222.0.57 "GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d" status: 404 len: 111 microversion: 2.1 time: 0.031029 Jul 18 03:12:12.708679 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3297/6612] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:12 2022] GET /compute/v2.1/servers/770700f6-b648-4375-bf45-d3ec39ab8e9d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:12:23.573773 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=19 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:12:23.575169 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=47 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:12:23.755012 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8a267d82-50a2-4633-8261-935976857df7 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1776006564", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "59edfca0-55b8-4172-8ddf-f7ac36233793"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:12:23.845105 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-8a267d82-50a2-4633-8261-935976857df7 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] validate_networks() for [('59edfca0-55b8-4172-8ddf-f7ac36233793', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:12:24.339411 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-8a267d82-50a2-4633-8261-935976857df7 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:12:24.339977 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-8a267d82-50a2-4633-8261-935976857df7 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:12:24.340595 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-8a267d82-50a2-4633-8261-935976857df7 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:12:24.341126 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-8a267d82-50a2-4633-8261-935976857df7 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:12:24.341663 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-8a267d82-50a2-4633-8261-935976857df7 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:12:24.355409 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8a267d82-50a2-4633-8261-935976857df7 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:24.356214 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8a267d82-50a2-4633-8261-935976857df7 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:24.357374 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8a267d82-50a2-4633-8261-935976857df7 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:24.357993 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8a267d82-50a2-4633-8261-935976857df7 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:24.381125 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-8a267d82-50a2-4633-8261-935976857df7 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Getting quotas for project 7a42cf3a445c4752bfb41d56e3010680. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:12:24.388660 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-8a267d82-50a2-4633-8261-935976857df7 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Getting quotas for user 7bcfafa141c64d23aa49e966ce9e25ef and project 7a42cf3a445c4752bfb41d56e3010680. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:12:24.409200 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8a267d82-50a2-4633-8261-935976857df7 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:12:24.413722 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8a267d82-50a2-4633-8261-935976857df7 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:12:24.499851 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8a267d82-50a2-4633-8261-935976857df7 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.938060 Jul 18 03:12:24.500778 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3316/6613] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:12:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:12:24.515448 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6c31699d-e006-4cf9-9d79-2b83bfe4a6da tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:24.516518 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6c31699d-e006-4cf9-9d79-2b83bfe4a6da tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:24.522115 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:12:24.523304 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:12:24.636638 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6c31699d-e006-4cf9-9d79-2b83bfe4a6da tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:24.645625 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6c31699d-e006-4cf9-9d79-2b83bfe4a6da tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1218 microversion: 2.1 time: 0.136492 Jul 18 03:12:24.646688 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3298/6614] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:24 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1218 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:25.681558 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6a629e23-37ad-4da3-960a-04010e926a77 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:25.684407 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6a629e23-37ad-4da3-960a-04010e926a77 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:25.700483 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a629e23-37ad-4da3-960a-04010e926a77 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:25.701287 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a629e23-37ad-4da3-960a-04010e926a77 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:25.702710 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a629e23-37ad-4da3-960a-04010e926a77 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:25.704057 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a629e23-37ad-4da3-960a-04010e926a77 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:25.815945 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6a629e23-37ad-4da3-960a-04010e926a77 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:25.826758 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6a629e23-37ad-4da3-960a-04010e926a77 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1270 microversion: 2.1 time: 0.158011 Jul 18 03:12:25.827718 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3317/6615] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:25 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1270 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:26.844775 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b94e0731-db11-49a5-8910-b5b88f6cbe1a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:26.845390 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b94e0731-db11-49a5-8910-b5b88f6cbe1a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:26.854089 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b94e0731-db11-49a5-8910-b5b88f6cbe1a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:26.854797 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b94e0731-db11-49a5-8910-b5b88f6cbe1a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:26.855732 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b94e0731-db11-49a5-8910-b5b88f6cbe1a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:26.856353 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b94e0731-db11-49a5-8910-b5b88f6cbe1a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:26.941856 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b94e0731-db11-49a5-8910-b5b88f6cbe1a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:26.951253 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b94e0731-db11-49a5-8910-b5b88f6cbe1a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1276 microversion: 2.1 time: 0.110474 Jul 18 03:12:26.952077 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3299/6616] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:26 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1276 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:27.973814 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e0fb2198-9fcd-4305-9704-adb6f3424310 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:27.975012 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e0fb2198-9fcd-4305-9704-adb6f3424310 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:28.006490 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e0fb2198-9fcd-4305-9704-adb6f3424310 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:28.007334 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e0fb2198-9fcd-4305-9704-adb6f3424310 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:28.008768 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e0fb2198-9fcd-4305-9704-adb6f3424310 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:28.009620 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e0fb2198-9fcd-4305-9704-adb6f3424310 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:28.205870 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-63a419d0-58ad-4636-85a4-e7b4344d23df req-9c3db8a1-93ad-408f-996d-71f6d345c66d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2846c44e-6ed6-40ce-a1ab-ab37ecc21132", "tag": "bba44850-410a-4d04-9e8a-a8e303874d26"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:12:28.221312 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-63a419d0-58ad-4636-85a4-e7b4344d23df req-9c3db8a1-93ad-408f-996d-71f6d345c66d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:28.222633 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-63a419d0-58ad-4636-85a4-e7b4344d23df req-9c3db8a1-93ad-408f-996d-71f6d345c66d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:28.249580 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-63a419d0-58ad-4636-85a4-e7b4344d23df req-9c3db8a1-93ad-408f-996d-71f6d345c66d service nova] Creating event network-changed:bba44850-410a-4d04-9e8a-a8e303874d26 for instance 2846c44e-6ed6-40ce-a1ab-ab37ecc21132 on n-h2-465891-3 Jul 18 03:12:28.261144 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-63a419d0-58ad-4636-85a4-e7b4344d23df req-9c3db8a1-93ad-408f-996d-71f6d345c66d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058159 Jul 18 03:12:28.263121 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3300/6617] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:12:28.287365 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e0fb2198-9fcd-4305-9704-adb6f3424310 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:28.300841 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e0fb2198-9fcd-4305-9704-adb6f3424310 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1318 microversion: 2.1 time: 0.334603 Jul 18 03:12:28.302205 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3318/6618] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:27 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1318 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:29.322902 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2c68f148-8b0b-4a42-a715-bdb67c685c41 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:29.323617 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2c68f148-8b0b-4a42-a715-bdb67c685c41 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:29.330550 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2c68f148-8b0b-4a42-a715-bdb67c685c41 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:29.331007 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2c68f148-8b0b-4a42-a715-bdb67c685c41 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:29.331838 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2c68f148-8b0b-4a42-a715-bdb67c685c41 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:29.332290 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2c68f148-8b0b-4a42-a715-bdb67c685c41 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:29.486916 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2c68f148-8b0b-4a42-a715-bdb67c685c41 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:29.500629 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2c68f148-8b0b-4a42-a715-bdb67c685c41 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1318 microversion: 2.1 time: 0.182563 Jul 18 03:12:29.501519 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3301/6619] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:29 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:30.519299 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2e0bd9f8-8e15-41fe-96ef-7e321bdb73cd tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:30.519923 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2e0bd9f8-8e15-41fe-96ef-7e321bdb73cd tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:30.527961 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2e0bd9f8-8e15-41fe-96ef-7e321bdb73cd tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:30.528369 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2e0bd9f8-8e15-41fe-96ef-7e321bdb73cd tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:30.529154 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2e0bd9f8-8e15-41fe-96ef-7e321bdb73cd tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:30.529605 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2e0bd9f8-8e15-41fe-96ef-7e321bdb73cd tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:30.665829 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2e0bd9f8-8e15-41fe-96ef-7e321bdb73cd tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:30.673532 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2e0bd9f8-8e15-41fe-96ef-7e321bdb73cd tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1318 microversion: 2.1 time: 0.158200 Jul 18 03:12:30.674151 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3319/6620] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:30 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:31.691270 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-21fc5f35-f4a3-46a5-ba9e-4d240d459fcd tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:31.691885 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-21fc5f35-f4a3-46a5-ba9e-4d240d459fcd tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:31.699531 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-21fc5f35-f4a3-46a5-ba9e-4d240d459fcd tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:31.699984 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-21fc5f35-f4a3-46a5-ba9e-4d240d459fcd tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:31.700753 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-21fc5f35-f4a3-46a5-ba9e-4d240d459fcd tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:31.701195 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-21fc5f35-f4a3-46a5-ba9e-4d240d459fcd tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:31.832296 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-21fc5f35-f4a3-46a5-ba9e-4d240d459fcd tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:31.840498 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-21fc5f35-f4a3-46a5-ba9e-4d240d459fcd tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1318 microversion: 2.1 time: 0.153162 Jul 18 03:12:31.841076 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3302/6621] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:31 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:32.858081 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-14c839d7-1798-462d-afb6-bf2412936e2c tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:32.858720 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-14c839d7-1798-462d-afb6-bf2412936e2c tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:32.866461 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14c839d7-1798-462d-afb6-bf2412936e2c tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:32.866928 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14c839d7-1798-462d-afb6-bf2412936e2c tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:32.867720 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14c839d7-1798-462d-afb6-bf2412936e2c tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:32.868176 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14c839d7-1798-462d-afb6-bf2412936e2c tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:33.018303 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-14c839d7-1798-462d-afb6-bf2412936e2c tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:33.027764 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-14c839d7-1798-462d-afb6-bf2412936e2c tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1318 microversion: 2.1 time: 0.174765 Jul 18 03:12:33.032757 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3320/6622] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:32 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:33.125229 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-3c66d6da-e932-475e-8343-747de33ef56d req-f1d834a0-957e-4ef7-b272-ab7e23831345 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2846c44e-6ed6-40ce-a1ab-ab37ecc21132", "name": "network-vif-plugged", "status": "completed", "tag": "bba44850-410a-4d04-9e8a-a8e303874d26"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:12:33.145651 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-3c66d6da-e932-475e-8343-747de33ef56d req-f1d834a0-957e-4ef7-b272-ab7e23831345 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:33.147711 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-3c66d6da-e932-475e-8343-747de33ef56d req-f1d834a0-957e-4ef7-b272-ab7e23831345 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:33.172565 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-3c66d6da-e932-475e-8343-747de33ef56d req-f1d834a0-957e-4ef7-b272-ab7e23831345 service nova] Creating event network-vif-plugged:bba44850-410a-4d04-9e8a-a8e303874d26 for instance 2846c44e-6ed6-40ce-a1ab-ab37ecc21132 on n-h2-465891-3 Jul 18 03:12:33.179604 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-3c66d6da-e932-475e-8343-747de33ef56d req-f1d834a0-957e-4ef7-b272-ab7e23831345 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057954 Jul 18 03:12:33.180475 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3303/6623] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:12:34.050246 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b14bb5bc-f193-4f39-81b6-22e751a3ca91 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:34.050887 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b14bb5bc-f193-4f39-81b6-22e751a3ca91 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:34.059687 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b14bb5bc-f193-4f39-81b6-22e751a3ca91 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:34.060156 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b14bb5bc-f193-4f39-81b6-22e751a3ca91 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:34.060966 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b14bb5bc-f193-4f39-81b6-22e751a3ca91 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:34.061420 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b14bb5bc-f193-4f39-81b6-22e751a3ca91 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:34.202107 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b14bb5bc-f193-4f39-81b6-22e751a3ca91 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:34.211462 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b14bb5bc-f193-4f39-81b6-22e751a3ca91 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1318 microversion: 2.1 time: 0.164887 Jul 18 03:12:34.212000 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3321/6624] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:34 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:35.230664 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:12:35.234853 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-14b39787-0ca9-4ccd-b040-20f67253abab tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:35.235573 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-14b39787-0ca9-4ccd-b040-20f67253abab tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:35.244310 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-14b39787-0ca9-4ccd-b040-20f67253abab tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:35.244777 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-14b39787-0ca9-4ccd-b040-20f67253abab tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:35.245552 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-14b39787-0ca9-4ccd-b040-20f67253abab tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:35.246020 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-14b39787-0ca9-4ccd-b040-20f67253abab tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:35.390312 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-14b39787-0ca9-4ccd-b040-20f67253abab tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:35.397886 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-14b39787-0ca9-4ccd-b040-20f67253abab tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1507 microversion: 2.1 time: 0.169367 Jul 18 03:12:35.398487 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3304/6625] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:35 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1507 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:35.414479 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e8ea8b30-d3a4-4e5c-a3a5-3010546e5dc6 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:35.415121 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e8ea8b30-d3a4-4e5c-a3a5-3010546e5dc6 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:35.416970 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:12:35.417682 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:12:35.424871 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e8ea8b30-d3a4-4e5c-a3a5-3010546e5dc6 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:35.425333 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e8ea8b30-d3a4-4e5c-a3a5-3010546e5dc6 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:35.426149 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e8ea8b30-d3a4-4e5c-a3a5-3010546e5dc6 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:35.426603 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e8ea8b30-d3a4-4e5c-a3a5-3010546e5dc6 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:35.561553 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e8ea8b30-d3a4-4e5c-a3a5-3010546e5dc6 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:35.569307 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e8ea8b30-d3a4-4e5c-a3a5-3010546e5dc6 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1507 microversion: 2.1 time: 0.158603 Jul 18 03:12:35.569921 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3322/6626] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:35 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:35.589630 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f5c0f314-a188-42d2-9ec0-3c551e6fd90a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:12:35.590807 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f5c0f314-a188-42d2-9ec0-3c551e6fd90a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:35.596956 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f5c0f314-a188-42d2-9ec0-3c551e6fd90a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:35.597412 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f5c0f314-a188-42d2-9ec0-3c551e6fd90a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:35.598221 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f5c0f314-a188-42d2-9ec0-3c551e6fd90a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:35.598661 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f5c0f314-a188-42d2-9ec0-3c551e6fd90a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:35.663349 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f5c0f314-a188-42d2-9ec0-3c551e6fd90a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "PUT /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1079 microversion: 2.1 time: 0.078652 Jul 18 03:12:35.663983 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3305/6627] 10.222.0.57 () {60 vars in 1255 bytes} [Mon Jul 18 03:12:35 2022] PUT /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1079 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:35.677588 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bc345864-322e-4d44-8579-4f3a6fef6674 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:35.678237 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bc345864-322e-4d44-8579-4f3a6fef6674 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:35.684501 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bc345864-322e-4d44-8579-4f3a6fef6674 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:35.684956 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bc345864-322e-4d44-8579-4f3a6fef6674 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:35.685745 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bc345864-322e-4d44-8579-4f3a6fef6674 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:35.686194 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bc345864-322e-4d44-8579-4f3a6fef6674 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:35.828719 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bc345864-322e-4d44-8579-4f3a6fef6674 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:35.836637 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bc345864-322e-4d44-8579-4f3a6fef6674 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1505 microversion: 2.1 time: 0.162757 Jul 18 03:12:35.837237 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3323/6628] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:35 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:35.853085 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b61fca70-bea6-4b9a-ad2a-510adf2e9362 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:35.853736 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b61fca70-bea6-4b9a-ad2a-510adf2e9362 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:35.860549 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b61fca70-bea6-4b9a-ad2a-510adf2e9362 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:35.860991 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b61fca70-bea6-4b9a-ad2a-510adf2e9362 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:35.861794 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b61fca70-bea6-4b9a-ad2a-510adf2e9362 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:35.862234 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b61fca70-bea6-4b9a-ad2a-510adf2e9362 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:36.005630 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b61fca70-bea6-4b9a-ad2a-510adf2e9362 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:36.020322 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b61fca70-bea6-4b9a-ad2a-510adf2e9362 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1505 microversion: 2.1 time: 0.171165 Jul 18 03:12:36.020853 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3306/6629] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:35 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1505 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:36.037136 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c0725d11-1aae-40fb-a76a-7b00ce7fa8be tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:12:36.038251 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c0725d11-1aae-40fb-a76a-7b00ce7fa8be tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:36.045112 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c0725d11-1aae-40fb-a76a-7b00ce7fa8be tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:36.045573 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c0725d11-1aae-40fb-a76a-7b00ce7fa8be tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:36.046396 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c0725d11-1aae-40fb-a76a-7b00ce7fa8be tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:36.046848 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c0725d11-1aae-40fb-a76a-7b00ce7fa8be tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:36.077359 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c0725d11-1aae-40fb-a76a-7b00ce7fa8be tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:36.083727 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c0725d11-1aae-40fb-a76a-7b00ce7fa8be tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Old instance type m1.heat2, new instance type m1.heat {{(pid=119543) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 03:12:36.090876 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-c0725d11-1aae-40fb-a76a-7b00ce7fa8be tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:12:36.091307 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-c0725d11-1aae-40fb-a76a-7b00ce7fa8be tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:12:36.091787 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-c0725d11-1aae-40fb-a76a-7b00ce7fa8be tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:12:36.092210 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-c0725d11-1aae-40fb-a76a-7b00ce7fa8be tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:12:36.092634 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-c0725d11-1aae-40fb-a76a-7b00ce7fa8be tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:12:36.156372 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c0725d11-1aae-40fb-a76a-7b00ce7fa8be tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "POST /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132/action" status: 202 len: 0 microversion: 2.1 time: 0.123184 Jul 18 03:12:36.157055 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3324/6630] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:12:36 2022] POST /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:12:36.165140 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b8a88a69-3ecd-4a85-af59-a7dec1069509 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:36.165795 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b8a88a69-3ecd-4a85-af59-a7dec1069509 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:36.172187 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b8a88a69-3ecd-4a85-af59-a7dec1069509 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:36.172645 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b8a88a69-3ecd-4a85-af59-a7dec1069509 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:36.173419 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b8a88a69-3ecd-4a85-af59-a7dec1069509 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:36.173898 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b8a88a69-3ecd-4a85-af59-a7dec1069509 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:36.342826 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b8a88a69-3ecd-4a85-af59-a7dec1069509 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:36.351276 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b8a88a69-3ecd-4a85-af59-a7dec1069509 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1516 microversion: 2.1 time: 0.189964 Jul 18 03:12:36.351849 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3307/6631] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:36 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1516 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:37.370663 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cefff233-0885-423c-9412-fa519e0a054b tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:37.371212 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cefff233-0885-423c-9412-fa519e0a054b tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:37.377934 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cefff233-0885-423c-9412-fa519e0a054b tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:37.378396 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cefff233-0885-423c-9412-fa519e0a054b tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:37.379204 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cefff233-0885-423c-9412-fa519e0a054b tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:37.379657 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cefff233-0885-423c-9412-fa519e0a054b tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:37.517024 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cefff233-0885-423c-9412-fa519e0a054b tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:37.524534 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cefff233-0885-423c-9412-fa519e0a054b tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1516 microversion: 2.1 time: 0.159952 Jul 18 03:12:37.525157 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3325/6632] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:37 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:38.542760 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-19106b2c-ba99-4432-b8c8-2826d5c2d30f tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:38.543933 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-19106b2c-ba99-4432-b8c8-2826d5c2d30f tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:38.551726 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-19106b2c-ba99-4432-b8c8-2826d5c2d30f tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:38.552318 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-19106b2c-ba99-4432-b8c8-2826d5c2d30f tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:38.553583 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-19106b2c-ba99-4432-b8c8-2826d5c2d30f tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:38.553727 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-19106b2c-ba99-4432-b8c8-2826d5c2d30f tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:38.775397 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-19106b2c-ba99-4432-b8c8-2826d5c2d30f tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:38.783525 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-19106b2c-ba99-4432-b8c8-2826d5c2d30f tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1521 microversion: 2.1 time: 0.245613 Jul 18 03:12:38.784316 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3308/6633] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:38 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:39.800573 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1eadac7d-e922-49c1-867f-68358cb5437c tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:39.801197 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1eadac7d-e922-49c1-867f-68358cb5437c tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:39.808386 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1eadac7d-e922-49c1-867f-68358cb5437c tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:39.808851 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1eadac7d-e922-49c1-867f-68358cb5437c tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:39.809637 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1eadac7d-e922-49c1-867f-68358cb5437c tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:39.810198 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1eadac7d-e922-49c1-867f-68358cb5437c tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:39.954709 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1eadac7d-e922-49c1-867f-68358cb5437c tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:39.963164 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1eadac7d-e922-49c1-867f-68358cb5437c tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1521 microversion: 2.1 time: 0.165861 Jul 18 03:12:39.963760 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3326/6634] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:39 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:40.981080 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0349031f-b0e4-41a5-9327-b0244e603097 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:40.981726 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0349031f-b0e4-41a5-9327-b0244e603097 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:40.989038 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0349031f-b0e4-41a5-9327-b0244e603097 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:40.989492 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0349031f-b0e4-41a5-9327-b0244e603097 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:40.990578 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0349031f-b0e4-41a5-9327-b0244e603097 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:40.991021 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0349031f-b0e4-41a5-9327-b0244e603097 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:41.144400 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0349031f-b0e4-41a5-9327-b0244e603097 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:41.161503 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0349031f-b0e4-41a5-9327-b0244e603097 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1521 microversion: 2.1 time: 0.184555 Jul 18 03:12:41.162678 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3309/6635] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:40 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:42.188135 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-84066125-ad6b-4b4b-b731-c517cc9c10f1 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:42.188781 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-84066125-ad6b-4b4b-b731-c517cc9c10f1 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:42.196128 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-84066125-ad6b-4b4b-b731-c517cc9c10f1 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:42.196669 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-84066125-ad6b-4b4b-b731-c517cc9c10f1 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:42.197489 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-84066125-ad6b-4b4b-b731-c517cc9c10f1 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:42.197973 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-84066125-ad6b-4b4b-b731-c517cc9c10f1 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:42.351409 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-84066125-ad6b-4b4b-b731-c517cc9c10f1 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:42.359977 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-84066125-ad6b-4b4b-b731-c517cc9c10f1 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1521 microversion: 2.1 time: 0.175883 Jul 18 03:12:42.360576 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3327/6636] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:42 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:43.386040 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3661714c-2832-4322-903d-cbd9e36fbfad tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:43.386658 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3661714c-2832-4322-903d-cbd9e36fbfad tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:43.394018 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3661714c-2832-4322-903d-cbd9e36fbfad tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:43.394464 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3661714c-2832-4322-903d-cbd9e36fbfad tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:43.395240 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3661714c-2832-4322-903d-cbd9e36fbfad tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:43.395674 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3661714c-2832-4322-903d-cbd9e36fbfad tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:43.545380 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3661714c-2832-4322-903d-cbd9e36fbfad tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:43.553277 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3661714c-2832-4322-903d-cbd9e36fbfad tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1521 microversion: 2.1 time: 0.171242 Jul 18 03:12:43.554189 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3310/6637] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:43 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:44.578423 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-961b5769-699b-4c4d-b93e-ee53bb1364f6 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:44.579056 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-961b5769-699b-4c4d-b93e-ee53bb1364f6 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:44.586406 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-961b5769-699b-4c4d-b93e-ee53bb1364f6 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:44.586866 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-961b5769-699b-4c4d-b93e-ee53bb1364f6 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:44.588302 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-961b5769-699b-4c4d-b93e-ee53bb1364f6 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:44.588755 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-961b5769-699b-4c4d-b93e-ee53bb1364f6 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:44.748514 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-961b5769-699b-4c4d-b93e-ee53bb1364f6 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:44.756585 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-961b5769-699b-4c4d-b93e-ee53bb1364f6 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1521 microversion: 2.1 time: 0.185480 Jul 18 03:12:44.757203 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3328/6638] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:44 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:45.775682 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-46b1966f-5ed0-4ce4-af9c-3097ee0a62a3 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:45.776588 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-46b1966f-5ed0-4ce4-af9c-3097ee0a62a3 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:45.784309 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-46b1966f-5ed0-4ce4-af9c-3097ee0a62a3 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:45.784767 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-46b1966f-5ed0-4ce4-af9c-3097ee0a62a3 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:45.785566 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-46b1966f-5ed0-4ce4-af9c-3097ee0a62a3 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:45.786042 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-46b1966f-5ed0-4ce4-af9c-3097ee0a62a3 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:45.938220 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-46b1966f-5ed0-4ce4-af9c-3097ee0a62a3 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:45.946620 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-46b1966f-5ed0-4ce4-af9c-3097ee0a62a3 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1521 microversion: 2.1 time: 0.175485 Jul 18 03:12:45.947841 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3311/6639] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:45 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:46.967815 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ac3801bd-86c7-49ae-b84a-45b884e2841b tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:46.968362 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ac3801bd-86c7-49ae-b84a-45b884e2841b tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:46.976135 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ac3801bd-86c7-49ae-b84a-45b884e2841b tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:46.976604 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ac3801bd-86c7-49ae-b84a-45b884e2841b tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:46.977410 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ac3801bd-86c7-49ae-b84a-45b884e2841b tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:46.977902 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ac3801bd-86c7-49ae-b84a-45b884e2841b tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:47.115560 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ac3801bd-86c7-49ae-b84a-45b884e2841b tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:47.123672 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ac3801bd-86c7-49ae-b84a-45b884e2841b tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1521 microversion: 2.1 time: 0.161701 Jul 18 03:12:47.124280 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3329/6640] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:46 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:48.141504 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-006b8c4d-e065-405b-a924-adedfafd1bdf tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:48.142134 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-006b8c4d-e065-405b-a924-adedfafd1bdf tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:48.149345 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-006b8c4d-e065-405b-a924-adedfafd1bdf tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:48.150453 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-006b8c4d-e065-405b-a924-adedfafd1bdf tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:48.151262 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-006b8c4d-e065-405b-a924-adedfafd1bdf tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:48.151701 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-006b8c4d-e065-405b-a924-adedfafd1bdf tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:48.288793 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-006b8c4d-e065-405b-a924-adedfafd1bdf tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:48.297234 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-006b8c4d-e065-405b-a924-adedfafd1bdf tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1521 microversion: 2.1 time: 0.159561 Jul 18 03:12:48.297863 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3312/6641] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:48 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:49.314666 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7db18fd8-a0d2-44d0-bff7-01ea93a8ea78 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:49.315308 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7db18fd8-a0d2-44d0-bff7-01ea93a8ea78 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:49.322669 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7db18fd8-a0d2-44d0-bff7-01ea93a8ea78 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:49.323133 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7db18fd8-a0d2-44d0-bff7-01ea93a8ea78 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:49.323947 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7db18fd8-a0d2-44d0-bff7-01ea93a8ea78 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:49.324399 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7db18fd8-a0d2-44d0-bff7-01ea93a8ea78 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:49.491924 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7db18fd8-a0d2-44d0-bff7-01ea93a8ea78 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:49.500399 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7db18fd8-a0d2-44d0-bff7-01ea93a8ea78 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1521 microversion: 2.1 time: 0.189777 Jul 18 03:12:49.500998 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3330/6642] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:49 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:50.522379 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-65d41519-84f8-4e20-9302-c1b4fc697185 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:50.523505 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-65d41519-84f8-4e20-9302-c1b4fc697185 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:50.534555 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65d41519-84f8-4e20-9302-c1b4fc697185 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:50.535324 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65d41519-84f8-4e20-9302-c1b4fc697185 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:50.536437 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65d41519-84f8-4e20-9302-c1b4fc697185 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:50.537052 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65d41519-84f8-4e20-9302-c1b4fc697185 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:50.704028 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-65d41519-84f8-4e20-9302-c1b4fc697185 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:50.711972 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-65d41519-84f8-4e20-9302-c1b4fc697185 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1521 microversion: 2.1 time: 0.196620 Jul 18 03:12:50.713154 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3313/6643] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:50 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:51.730792 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-38874c80-4060-416e-82f6-ad244218f7e0 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:51.731420 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-38874c80-4060-416e-82f6-ad244218f7e0 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:51.738538 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-38874c80-4060-416e-82f6-ad244218f7e0 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:51.739033 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-38874c80-4060-416e-82f6-ad244218f7e0 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:51.739811 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-38874c80-4060-416e-82f6-ad244218f7e0 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:51.740521 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-38874c80-4060-416e-82f6-ad244218f7e0 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:51.887590 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-38874c80-4060-416e-82f6-ad244218f7e0 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:51.891209 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:12:51.896380 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-38874c80-4060-416e-82f6-ad244218f7e0 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1521 microversion: 2.1 time: 0.170082 Jul 18 03:12:51.896981 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3331/6644] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:51 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:12:52.204507 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:12:52.205082 n-d-465891-3 devstack@n-api.service[119544]: Mon Jul 18 03:12:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:12:52.914736 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-076e092b-639a-4433-96f1-f836a24ed726 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:52.916017 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-076e092b-639a-4433-96f1-f836a24ed726 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:52.923844 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-076e092b-639a-4433-96f1-f836a24ed726 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:52.924291 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-076e092b-639a-4433-96f1-f836a24ed726 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:52.925218 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-076e092b-639a-4433-96f1-f836a24ed726 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:52.925714 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-076e092b-639a-4433-96f1-f836a24ed726 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:53.069554 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-076e092b-639a-4433-96f1-f836a24ed726 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:53.078229 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-076e092b-639a-4433-96f1-f836a24ed726 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1521 microversion: 2.1 time: 0.167422 Jul 18 03:12:53.078890 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3314/6645] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:52 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:54.096665 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-21b1ae79-fdb9-4983-8a44-dc60e5610c2f tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:54.097365 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-21b1ae79-fdb9-4983-8a44-dc60e5610c2f tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:54.101082 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:12:54.110113 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-21b1ae79-fdb9-4983-8a44-dc60e5610c2f tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:54.110683 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-21b1ae79-fdb9-4983-8a44-dc60e5610c2f tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:54.111549 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-21b1ae79-fdb9-4983-8a44-dc60e5610c2f tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:54.112042 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-21b1ae79-fdb9-4983-8a44-dc60e5610c2f tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:54.273040 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-21b1ae79-fdb9-4983-8a44-dc60e5610c2f tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:54.282783 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-21b1ae79-fdb9-4983-8a44-dc60e5610c2f tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1521 microversion: 2.1 time: 0.190005 Jul 18 03:12:54.283405 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3332/6646] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:54 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:54.574290 n-d-465891-3 devstack@n-api.service[119543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:12:54.574584 n-d-465891-3 devstack@n-api.service[119543]: Mon Jul 18 03:12:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:12:55.301609 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3efb6900-e838-4095-bb4f-4a28f633065c tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:55.302456 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3efb6900-e838-4095-bb4f-4a28f633065c tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:55.305051 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=37 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:12:55.311227 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3efb6900-e838-4095-bb4f-4a28f633065c tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:55.311680 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3efb6900-e838-4095-bb4f-4a28f633065c tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:55.312484 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3efb6900-e838-4095-bb4f-4a28f633065c tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:55.312926 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3efb6900-e838-4095-bb4f-4a28f633065c tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:55.316474 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:12:55.457142 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3efb6900-e838-4095-bb4f-4a28f633065c tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:55.466176 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3efb6900-e838-4095-bb4f-4a28f633065c tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1521 microversion: 2.1 time: 0.168554 Jul 18 03:12:55.466763 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3315/6647] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:55 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:56.484069 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7344663c-db2e-4706-a0d2-7122d2650112 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:56.484722 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7344663c-db2e-4706-a0d2-7122d2650112 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:56.491811 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7344663c-db2e-4706-a0d2-7122d2650112 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:56.492268 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7344663c-db2e-4706-a0d2-7122d2650112 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:56.493058 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7344663c-db2e-4706-a0d2-7122d2650112 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:56.494288 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7344663c-db2e-4706-a0d2-7122d2650112 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:56.675777 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7344663c-db2e-4706-a0d2-7122d2650112 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:56.684686 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7344663c-db2e-4706-a0d2-7122d2650112 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1521 microversion: 2.1 time: 0.204612 Jul 18 03:12:56.685284 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3333/6648] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:56 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:57.702419 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4095ae18-9ea2-4980-a79f-f5a35a0bdb8d tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:57.703037 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4095ae18-9ea2-4980-a79f-f5a35a0bdb8d tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:57.710557 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4095ae18-9ea2-4980-a79f-f5a35a0bdb8d tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:57.711001 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4095ae18-9ea2-4980-a79f-f5a35a0bdb8d tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:57.711785 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4095ae18-9ea2-4980-a79f-f5a35a0bdb8d tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:57.713374 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4095ae18-9ea2-4980-a79f-f5a35a0bdb8d tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:57.866572 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4095ae18-9ea2-4980-a79f-f5a35a0bdb8d tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:57.874857 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4095ae18-9ea2-4980-a79f-f5a35a0bdb8d tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1521 microversion: 2.1 time: 0.176536 Jul 18 03:12:57.875443 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3316/6649] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:57 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:58.893409 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9e78d0b4-4843-4467-80be-299dcb153dab tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:58.894195 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9e78d0b4-4843-4467-80be-299dcb153dab tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:58.902387 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e78d0b4-4843-4467-80be-299dcb153dab tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:58.902879 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e78d0b4-4843-4467-80be-299dcb153dab tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:58.903685 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e78d0b4-4843-4467-80be-299dcb153dab tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:58.904139 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e78d0b4-4843-4467-80be-299dcb153dab tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:59.047783 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9e78d0b4-4843-4467-80be-299dcb153dab tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:59.056370 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9e78d0b4-4843-4467-80be-299dcb153dab tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1521 microversion: 2.1 time: 0.167026 Jul 18 03:12:59.057206 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3334/6650] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:58 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:00.074525 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-137f23db-3f25-4ab0-bf8a-46d86c262427 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:00.075150 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-137f23db-3f25-4ab0-bf8a-46d86c262427 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:00.083299 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-137f23db-3f25-4ab0-bf8a-46d86c262427 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:00.083762 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-137f23db-3f25-4ab0-bf8a-46d86c262427 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:00.084573 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-137f23db-3f25-4ab0-bf8a-46d86c262427 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:00.085023 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-137f23db-3f25-4ab0-bf8a-46d86c262427 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:00.248855 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-137f23db-3f25-4ab0-bf8a-46d86c262427 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:00.256970 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-137f23db-3f25-4ab0-bf8a-46d86c262427 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1521 microversion: 2.1 time: 0.186440 Jul 18 03:13:00.257574 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3317/6651] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:00 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:01.275739 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-16ee5794-f1b0-4921-8b9e-7cfaec571d87 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:01.276455 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-16ee5794-f1b0-4921-8b9e-7cfaec571d87 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:01.285166 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-16ee5794-f1b0-4921-8b9e-7cfaec571d87 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:01.285654 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-16ee5794-f1b0-4921-8b9e-7cfaec571d87 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:01.286479 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-16ee5794-f1b0-4921-8b9e-7cfaec571d87 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:01.286943 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-16ee5794-f1b0-4921-8b9e-7cfaec571d87 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:01.438081 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-16ee5794-f1b0-4921-8b9e-7cfaec571d87 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:01.446649 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-16ee5794-f1b0-4921-8b9e-7cfaec571d87 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1521 microversion: 2.1 time: 0.175090 Jul 18 03:13:01.447149 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3335/6652] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:01 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:13:02.467675 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-12a8c009-5912-495d-812e-806fdd237597 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:02.468832 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-12a8c009-5912-495d-812e-806fdd237597 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:02.482042 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-12a8c009-5912-495d-812e-806fdd237597 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:02.482840 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-12a8c009-5912-495d-812e-806fdd237597 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:02.484271 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-12a8c009-5912-495d-812e-806fdd237597 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:02.484782 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-12a8c009-5912-495d-812e-806fdd237597 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:02.645058 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-12a8c009-5912-495d-812e-806fdd237597 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:02.654501 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-12a8c009-5912-495d-812e-806fdd237597 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1521 microversion: 2.1 time: 0.194670 Jul 18 03:13:02.655110 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3318/6653] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:02 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:03.672694 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d3779b96-d710-46a4-914a-fc9c47f3add1 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:03.673334 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d3779b96-d710-46a4-914a-fc9c47f3add1 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:03.681670 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d3779b96-d710-46a4-914a-fc9c47f3add1 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:03.682161 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d3779b96-d710-46a4-914a-fc9c47f3add1 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:03.682968 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d3779b96-d710-46a4-914a-fc9c47f3add1 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:03.683414 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d3779b96-d710-46a4-914a-fc9c47f3add1 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:03.850101 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d3779b96-d710-46a4-914a-fc9c47f3add1 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:03.860324 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d3779b96-d710-46a4-914a-fc9c47f3add1 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1521 microversion: 2.1 time: 0.191201 Jul 18 03:13:03.861136 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3336/6654] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:03 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:04.879509 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f3c252c7-a793-4c1e-8762-37d26e4702e6 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:04.880288 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f3c252c7-a793-4c1e-8762-37d26e4702e6 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:04.888130 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f3c252c7-a793-4c1e-8762-37d26e4702e6 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:04.888595 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f3c252c7-a793-4c1e-8762-37d26e4702e6 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:04.889392 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f3c252c7-a793-4c1e-8762-37d26e4702e6 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:04.889872 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f3c252c7-a793-4c1e-8762-37d26e4702e6 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:05.045041 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f3c252c7-a793-4c1e-8762-37d26e4702e6 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:05.053541 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f3c252c7-a793-4c1e-8762-37d26e4702e6 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1521 microversion: 2.1 time: 0.178083 Jul 18 03:13:05.054380 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3319/6655] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:04 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:06.078564 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-99132a67-3b12-4986-a894-7eb70ca43970 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:06.079864 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-99132a67-3b12-4986-a894-7eb70ca43970 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:06.088797 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-99132a67-3b12-4986-a894-7eb70ca43970 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:06.089574 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-99132a67-3b12-4986-a894-7eb70ca43970 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:06.090741 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-99132a67-3b12-4986-a894-7eb70ca43970 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:06.091395 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-99132a67-3b12-4986-a894-7eb70ca43970 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:06.119220 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-8a9aee35-3624-4be1-b9c1-265fa46022cf req-d29452ca-e8a8-4500-a96c-08db1a31d259 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2846c44e-6ed6-40ce-a1ab-ab37ecc21132", "name": "network-vif-unplugged", "status": "completed", "tag": "bba44850-410a-4d04-9e8a-a8e303874d26"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:13:06.144219 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-8a9aee35-3624-4be1-b9c1-265fa46022cf req-d29452ca-e8a8-4500-a96c-08db1a31d259 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:06.145086 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-8a9aee35-3624-4be1-b9c1-265fa46022cf req-d29452ca-e8a8-4500-a96c-08db1a31d259 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:06.161087 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-8a9aee35-3624-4be1-b9c1-265fa46022cf req-d29452ca-e8a8-4500-a96c-08db1a31d259 service nova] Creating event network-vif-unplugged:bba44850-410a-4d04-9e8a-a8e303874d26 for instance 2846c44e-6ed6-40ce-a1ab-ab37ecc21132 on n-h1-465891-3 Jul 18 03:13:06.168806 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [req-8a9aee35-3624-4be1-b9c1-265fa46022cf req-d29452ca-e8a8-4500-a96c-08db1a31d259 service nova] Instance 2846c44e-6ed6-40ce-a1ab-ab37ecc21132 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3', 'n-h2-465891-3'} {{(pid=119543) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:13:06.190873 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-8a9aee35-3624-4be1-b9c1-265fa46022cf req-d29452ca-e8a8-4500-a96c-08db1a31d259 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.177969 Jul 18 03:13:06.191680 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3337/6656] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:13:06.304766 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-99132a67-3b12-4986-a894-7eb70ca43970 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:06.314120 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-99132a67-3b12-4986-a894-7eb70ca43970 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1520 microversion: 2.1 time: 0.239341 Jul 18 03:13:06.315168 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3320/6657] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:06 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1520 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:07.334424 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1d763535-f54e-47c8-8850-168c594bc897 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:07.335216 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1d763535-f54e-47c8-8850-168c594bc897 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:07.343816 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1d763535-f54e-47c8-8850-168c594bc897 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:07.344294 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1d763535-f54e-47c8-8850-168c594bc897 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:07.345102 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1d763535-f54e-47c8-8850-168c594bc897 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:07.345562 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1d763535-f54e-47c8-8850-168c594bc897 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:07.496917 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1d763535-f54e-47c8-8850-168c594bc897 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:07.510304 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1d763535-f54e-47c8-8850-168c594bc897 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1518 microversion: 2.1 time: 0.180924 Jul 18 03:13:07.511229 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3338/6658] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:07 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1518 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:08.208701 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-5d606c1a-0af8-4ae8-a91c-dcb3491199fe req-b10e9c0c-1e35-45b5-8797-96b1f796626e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2846c44e-6ed6-40ce-a1ab-ab37ecc21132", "tag": "bba44850-410a-4d04-9e8a-a8e303874d26"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:13:08.218494 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-5d606c1a-0af8-4ae8-a91c-dcb3491199fe req-b10e9c0c-1e35-45b5-8797-96b1f796626e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:08.218937 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-5d606c1a-0af8-4ae8-a91c-dcb3491199fe req-b10e9c0c-1e35-45b5-8797-96b1f796626e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:08.231839 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-5d606c1a-0af8-4ae8-a91c-dcb3491199fe req-b10e9c0c-1e35-45b5-8797-96b1f796626e service nova] Creating event network-changed:bba44850-410a-4d04-9e8a-a8e303874d26 for instance 2846c44e-6ed6-40ce-a1ab-ab37ecc21132 on n-h1-465891-3 Jul 18 03:13:08.238201 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [req-5d606c1a-0af8-4ae8-a91c-dcb3491199fe req-b10e9c0c-1e35-45b5-8797-96b1f796626e service nova] Instance 2846c44e-6ed6-40ce-a1ab-ab37ecc21132 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3', 'n-h2-465891-3'} {{(pid=119544) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:13:08.250465 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-5d606c1a-0af8-4ae8-a91c-dcb3491199fe req-b10e9c0c-1e35-45b5-8797-96b1f796626e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045427 Jul 18 03:13:08.251072 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3321/6659] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:13:08.529139 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e1fca3f4-019c-4ccd-b36f-48c1b2ef214d tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:08.529829 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e1fca3f4-019c-4ccd-b36f-48c1b2ef214d tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:08.537565 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e1fca3f4-019c-4ccd-b36f-48c1b2ef214d tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:08.538055 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e1fca3f4-019c-4ccd-b36f-48c1b2ef214d tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:08.538847 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e1fca3f4-019c-4ccd-b36f-48c1b2ef214d tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:08.539371 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e1fca3f4-019c-4ccd-b36f-48c1b2ef214d tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:08.754883 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e1fca3f4-019c-4ccd-b36f-48c1b2ef214d tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:08.763329 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e1fca3f4-019c-4ccd-b36f-48c1b2ef214d tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1518 microversion: 2.1 time: 0.238568 Jul 18 03:13:08.764000 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3339/6660] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:08 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1518 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:09.782537 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8fb0e612-679b-4daa-8eed-9ccb5fccace0 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:09.783280 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8fb0e612-679b-4daa-8eed-9ccb5fccace0 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:09.790739 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8fb0e612-679b-4daa-8eed-9ccb5fccace0 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:09.791438 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8fb0e612-679b-4daa-8eed-9ccb5fccace0 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:09.792512 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8fb0e612-679b-4daa-8eed-9ccb5fccace0 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:09.793095 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8fb0e612-679b-4daa-8eed-9ccb5fccace0 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:09.958187 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8fb0e612-679b-4daa-8eed-9ccb5fccace0 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:09.967508 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8fb0e612-679b-4daa-8eed-9ccb5fccace0 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1518 microversion: 2.1 time: 0.190550 Jul 18 03:13:09.968094 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3322/6661] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:09 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1518 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:10.986216 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e682414c-5f41-4568-becb-de0279bb4390 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:10.986860 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e682414c-5f41-4568-becb-de0279bb4390 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:10.994841 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e682414c-5f41-4568-becb-de0279bb4390 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:10.995332 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e682414c-5f41-4568-becb-de0279bb4390 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:10.996123 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e682414c-5f41-4568-becb-de0279bb4390 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:10.996580 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e682414c-5f41-4568-becb-de0279bb4390 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:11.138031 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e682414c-5f41-4568-becb-de0279bb4390 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:11.145852 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e682414c-5f41-4568-becb-de0279bb4390 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1515 microversion: 2.1 time: 0.163502 Jul 18 03:13:11.146458 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3340/6662] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:10 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:11.168170 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8857cb93-b993-4231-be2b-233e631c2af2 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:13:11.169150 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8857cb93-b993-4231-be2b-233e631c2af2 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:11.181106 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8857cb93-b993-4231-be2b-233e631c2af2 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:11.181662 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8857cb93-b993-4231-be2b-233e631c2af2 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:11.182486 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8857cb93-b993-4231-be2b-233e631c2af2 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:11.182933 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8857cb93-b993-4231-be2b-233e631c2af2 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:11.249030 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8857cb93-b993-4231-be2b-233e631c2af2 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "POST /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132/action" status: 204 len: 0 microversion: 2.1 time: 0.088871 Jul 18 03:13:11.249972 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3323/6663] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:13:11 2022] POST /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132/action => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:13:11.258007 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0f3037ec-e3cb-4af0-a4e8-2b195545ec4c tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:11.258737 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0f3037ec-e3cb-4af0-a4e8-2b195545ec4c tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:11.265459 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0f3037ec-e3cb-4af0-a4e8-2b195545ec4c tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:11.265959 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0f3037ec-e3cb-4af0-a4e8-2b195545ec4c tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:11.266785 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0f3037ec-e3cb-4af0-a4e8-2b195545ec4c tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:11.267244 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0f3037ec-e3cb-4af0-a4e8-2b195545ec4c tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:11.532688 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0f3037ec-e3cb-4af0-a4e8-2b195545ec4c tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:11.541277 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0f3037ec-e3cb-4af0-a4e8-2b195545ec4c tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1515 microversion: 2.1 time: 0.287148 Jul 18 03:13:11.541998 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3341/6664] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:11 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1515 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:12.562223 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a4dac257-6185-4716-8449-3a7468908c86 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:12.563134 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a4dac257-6185-4716-8449-3a7468908c86 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:12.572899 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a4dac257-6185-4716-8449-3a7468908c86 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:12.573896 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a4dac257-6185-4716-8449-3a7468908c86 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:12.574291 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a4dac257-6185-4716-8449-3a7468908c86 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:12.575177 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a4dac257-6185-4716-8449-3a7468908c86 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:12.782836 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a4dac257-6185-4716-8449-3a7468908c86 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:12.792740 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a4dac257-6185-4716-8449-3a7468908c86 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1507 microversion: 2.1 time: 0.237138 Jul 18 03:13:12.793562 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3324/6665] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:12 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1507 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:12.812054 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dba2e4c0-a52a-4c5e-89b1-4677878202fd tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:12.812642 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-dba2e4c0-a52a-4c5e-89b1-4677878202fd tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:12.820804 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dba2e4c0-a52a-4c5e-89b1-4677878202fd tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:12.821403 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dba2e4c0-a52a-4c5e-89b1-4677878202fd tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:12.822304 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dba2e4c0-a52a-4c5e-89b1-4677878202fd tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:12.822759 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dba2e4c0-a52a-4c5e-89b1-4677878202fd tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:12.980976 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-dba2e4c0-a52a-4c5e-89b1-4677878202fd tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:12.989415 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-dba2e4c0-a52a-4c5e-89b1-4677878202fd tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1507 microversion: 2.1 time: 0.181581 Jul 18 03:13:12.990365 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3342/6666] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:12 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1507 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:13.011367 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6467f24b-2f4d-4ed2-ad48-18bad0ead71a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Action: 'create', calling method: .version_select at 0x7ff49be330d0>, body: {"keypair": {"name": "tempest-keypair-1909710978", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvly1uWC0nQZrUoaYb6B8N8mauIIBiBie6fqMeCxiqlUW2UiAZ9v4IICaa1PkkW/5IUBTMLn2NZUKfWiP8zttKadlgdPcdaxRNlPLAQn8chttBbjgd6mVBpIHpUd6NQfg=="}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:13:13.027308 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-6467f24b-2f4d-4ed2-ad48-18bad0ead71a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Getting quotas for project 7a42cf3a445c4752bfb41d56e3010680. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:13:13.032955 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-6467f24b-2f4d-4ed2-ad48-18bad0ead71a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Getting quotas for user 7bcfafa141c64d23aa49e966ce9e25ef and project 7a42cf3a445c4752bfb41d56e3010680. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:13:13.063716 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6467f24b-2f4d-4ed2-ad48-18bad0ead71a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056601 Jul 18 03:13:13.064322 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3325/6667] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 03:13:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:13:13.443872 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-44ebd06e-1855-4054-a697-6a212e501269 req-94c94e3e-88dc-4d55-a4c9-fd758550d52b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2846c44e-6ed6-40ce-a1ab-ab37ecc21132", "name": "network-vif-plugged", "status": "completed", "tag": "bba44850-410a-4d04-9e8a-a8e303874d26"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:13:13.453976 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-44ebd06e-1855-4054-a697-6a212e501269 req-94c94e3e-88dc-4d55-a4c9-fd758550d52b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:13.454550 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-44ebd06e-1855-4054-a697-6a212e501269 req-94c94e3e-88dc-4d55-a4c9-fd758550d52b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:13.472779 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-44ebd06e-1855-4054-a697-6a212e501269 req-94c94e3e-88dc-4d55-a4c9-fd758550d52b service nova] Creating event network-vif-plugged:bba44850-410a-4d04-9e8a-a8e303874d26 for instance 2846c44e-6ed6-40ce-a1ab-ab37ecc21132 on n-h1-465891-3 Jul 18 03:13:13.480782 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-44ebd06e-1855-4054-a697-6a212e501269 req-94c94e3e-88dc-4d55-a4c9-fd758550d52b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040597 Jul 18 03:13:13.483493 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3343/6668] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:13:14.483961 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bc23b23a-f860-4ede-93e4-d869818f2af3 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:14.484581 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bc23b23a-f860-4ede-93e4-d869818f2af3 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:14.491785 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bc23b23a-f860-4ede-93e4-d869818f2af3 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:14.492240 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bc23b23a-f860-4ede-93e4-d869818f2af3 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:14.493646 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bc23b23a-f860-4ede-93e4-d869818f2af3 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:14.493789 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bc23b23a-f860-4ede-93e4-d869818f2af3 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:14.637134 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bc23b23a-f860-4ede-93e4-d869818f2af3 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:14.645125 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bc23b23a-f860-4ede-93e4-d869818f2af3 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 200 len: 1507 microversion: 2.1 time: 0.166037 Jul 18 03:13:14.645737 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3326/6669] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:14 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:14.663914 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-99711e82-2571-4e04-be48-d40817543fd3 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:14.665125 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-99711e82-2571-4e04-be48-d40817543fd3 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:14.671931 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-99711e82-2571-4e04-be48-d40817543fd3 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:14.672401 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-99711e82-2571-4e04-be48-d40817543fd3 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:14.673195 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-99711e82-2571-4e04-be48-d40817543fd3 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:14.673650 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-99711e82-2571-4e04-be48-d40817543fd3 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:14.701641 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-99711e82-2571-4e04-be48-d40817543fd3 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:13:14.800786 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-99711e82-2571-4e04-be48-d40817543fd3 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 204 len: 0 microversion: 2.1 time: 0.141634 Jul 18 03:13:14.801652 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3344/6670] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:13:14 2022] DELETE /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:13:14.873664 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0b26d1a2-c455-494d-838c-bc1e74c41992 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-656305678", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "59edfca0-55b8-4172-8ddf-f7ac36233793"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:13:14.932881 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-0b26d1a2-c455-494d-838c-bc1e74c41992 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] validate_networks() for [('59edfca0-55b8-4172-8ddf-f7ac36233793', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:13:15.394317 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-0b26d1a2-c455-494d-838c-bc1e74c41992 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:13:15.394776 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-0b26d1a2-c455-494d-838c-bc1e74c41992 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:13:15.395411 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-0b26d1a2-c455-494d-838c-bc1e74c41992 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:13:15.395757 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-0b26d1a2-c455-494d-838c-bc1e74c41992 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:13:15.396178 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-0b26d1a2-c455-494d-838c-bc1e74c41992 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:13:15.406379 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0b26d1a2-c455-494d-838c-bc1e74c41992 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:15.406825 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0b26d1a2-c455-494d-838c-bc1e74c41992 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:15.407646 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0b26d1a2-c455-494d-838c-bc1e74c41992 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:15.408080 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0b26d1a2-c455-494d-838c-bc1e74c41992 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:15.425722 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-0b26d1a2-c455-494d-838c-bc1e74c41992 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Getting quotas for project 7a42cf3a445c4752bfb41d56e3010680. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:13:15.431545 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-0b26d1a2-c455-494d-838c-bc1e74c41992 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Getting quotas for user 7bcfafa141c64d23aa49e966ce9e25ef and project 7a42cf3a445c4752bfb41d56e3010680. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:13:15.444930 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0b26d1a2-c455-494d-838c-bc1e74c41992 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:13:15.448130 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0b26d1a2-c455-494d-838c-bc1e74c41992 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:13:15.495189 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0b26d1a2-c455-494d-838c-bc1e74c41992 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.626200 Jul 18 03:13:15.496182 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3327/6671] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:13:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:13:15.507048 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0e2d8303-357e-4b2d-b6a6-052627959e61 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:15.507941 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0e2d8303-357e-4b2d-b6a6-052627959e61 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:15.567572 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0e2d8303-357e-4b2d-b6a6-052627959e61 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:15.575471 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0e2d8303-357e-4b2d-b6a6-052627959e61 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1217 microversion: 2.1 time: 0.072904 Jul 18 03:13:15.576959 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3345/6672] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:15 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1217 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:13:16.594443 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cfa57d95-0545-4112-a930-0c8e0e6c0916 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:16.595071 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cfa57d95-0545-4112-a930-0c8e0e6c0916 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:16.602028 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cfa57d95-0545-4112-a930-0c8e0e6c0916 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:16.603483 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cfa57d95-0545-4112-a930-0c8e0e6c0916 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:16.604003 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cfa57d95-0545-4112-a930-0c8e0e6c0916 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:16.604447 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cfa57d95-0545-4112-a930-0c8e0e6c0916 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:16.675909 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-cfa57d95-0545-4112-a930-0c8e0e6c0916 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:16.683958 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cfa57d95-0545-4112-a930-0c8e0e6c0916 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1269 microversion: 2.1 time: 0.094446 Jul 18 03:13:16.684566 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3328/6673] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:16 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1269 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:16.896497 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-aa8465f8-13ae-4382-b967-b03c72fa0fdc req-a37899ce-e741-4db5-8c92-70498523b21a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2846c44e-6ed6-40ce-a1ab-ab37ecc21132", "name": "network-vif-deleted", "tag": "bba44850-410a-4d04-9e8a-a8e303874d26"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:13:16.915316 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-aa8465f8-13ae-4382-b967-b03c72fa0fdc req-a37899ce-e741-4db5-8c92-70498523b21a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:16.916137 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-aa8465f8-13ae-4382-b967-b03c72fa0fdc req-a37899ce-e741-4db5-8c92-70498523b21a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:16.932864 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-aa8465f8-13ae-4382-b967-b03c72fa0fdc req-a37899ce-e741-4db5-8c92-70498523b21a service nova] Creating event network-vif-deleted:bba44850-410a-4d04-9e8a-a8e303874d26 for instance 2846c44e-6ed6-40ce-a1ab-ab37ecc21132 on n-h1-465891-3 Jul 18 03:13:16.946607 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-aa8465f8-13ae-4382-b967-b03c72fa0fdc req-a37899ce-e741-4db5-8c92-70498523b21a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053663 Jul 18 03:13:16.947565 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3346/6674] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:13:17.702867 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b322e31e-188c-465a-b7d9-18435493d95f tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:17.704139 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b322e31e-188c-465a-b7d9-18435493d95f tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:17.714637 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b322e31e-188c-465a-b7d9-18435493d95f tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:17.715109 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b322e31e-188c-465a-b7d9-18435493d95f tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:17.716047 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b322e31e-188c-465a-b7d9-18435493d95f tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:17.716332 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b322e31e-188c-465a-b7d9-18435493d95f tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:17.937008 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b322e31e-188c-465a-b7d9-18435493d95f tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:17.949581 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b322e31e-188c-465a-b7d9-18435493d95f tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1317 microversion: 2.1 time: 0.250343 Jul 18 03:13:17.950696 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3329/6675] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:17 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:18.570023 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-4153a754-e931-4305-b453-26afe09b6fe1 req-2e03156f-616b-4697-a050-f527b2f90fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b78a750-e501-4dac-948e-8156168a6ec2", "tag": "0b37a1c0-1c5c-4fe8-8e4a-ba1b2b887b33"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:13:18.582417 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-4153a754-e931-4305-b453-26afe09b6fe1 req-2e03156f-616b-4697-a050-f527b2f90fb5 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:18.583151 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-4153a754-e931-4305-b453-26afe09b6fe1 req-2e03156f-616b-4697-a050-f527b2f90fb5 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:18.597786 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-4153a754-e931-4305-b453-26afe09b6fe1 req-2e03156f-616b-4697-a050-f527b2f90fb5 service nova] Creating event network-changed:0b37a1c0-1c5c-4fe8-8e4a-ba1b2b887b33 for instance 1b78a750-e501-4dac-948e-8156168a6ec2 on n-h1-465891-3 Jul 18 03:13:18.604212 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-4153a754-e931-4305-b453-26afe09b6fe1 req-2e03156f-616b-4697-a050-f527b2f90fb5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039860 Jul 18 03:13:18.604823 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3347/6676] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:13:18.974772 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-506efea8-8b74-446f-b5cd-29502f313d0d tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:18.975896 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-506efea8-8b74-446f-b5cd-29502f313d0d tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:18.988917 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-506efea8-8b74-446f-b5cd-29502f313d0d tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:18.989777 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-506efea8-8b74-446f-b5cd-29502f313d0d tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:18.991483 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-506efea8-8b74-446f-b5cd-29502f313d0d tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:18.992324 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-506efea8-8b74-446f-b5cd-29502f313d0d tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:19.155101 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-506efea8-8b74-446f-b5cd-29502f313d0d tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:19.163078 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-506efea8-8b74-446f-b5cd-29502f313d0d tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1317 microversion: 2.1 time: 0.193883 Jul 18 03:13:19.163675 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3330/6677] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:18 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:20.182796 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c07e91dc-70ac-4e2a-99cc-81666002fcdd tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:20.183555 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c07e91dc-70ac-4e2a-99cc-81666002fcdd tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:20.190373 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c07e91dc-70ac-4e2a-99cc-81666002fcdd tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:20.190921 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c07e91dc-70ac-4e2a-99cc-81666002fcdd tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:20.191767 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c07e91dc-70ac-4e2a-99cc-81666002fcdd tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:20.192260 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c07e91dc-70ac-4e2a-99cc-81666002fcdd tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:20.361139 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c07e91dc-70ac-4e2a-99cc-81666002fcdd tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:20.371469 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c07e91dc-70ac-4e2a-99cc-81666002fcdd tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1317 microversion: 2.1 time: 0.194480 Jul 18 03:13:20.372101 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3348/6678] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:20 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1317 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:13:21.393622 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-53731cd2-89c2-4434-8593-2805c1d9d435 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:21.395180 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-53731cd2-89c2-4434-8593-2805c1d9d435 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:21.409664 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-53731cd2-89c2-4434-8593-2805c1d9d435 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:21.410568 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-53731cd2-89c2-4434-8593-2805c1d9d435 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:21.412078 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-53731cd2-89c2-4434-8593-2805c1d9d435 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:21.413517 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-53731cd2-89c2-4434-8593-2805c1d9d435 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:21.664304 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-53731cd2-89c2-4434-8593-2805c1d9d435 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:21.674421 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-53731cd2-89c2-4434-8593-2805c1d9d435 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1317 microversion: 2.1 time: 0.287802 Jul 18 03:13:21.675248 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3331/6679] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:21 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1317 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:13:22.692699 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-01891306-8d8a-422f-849c-7bcc805c2bd1 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:22.693250 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-01891306-8d8a-422f-849c-7bcc805c2bd1 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:22.700791 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-01891306-8d8a-422f-849c-7bcc805c2bd1 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:22.701305 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-01891306-8d8a-422f-849c-7bcc805c2bd1 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:22.702139 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-01891306-8d8a-422f-849c-7bcc805c2bd1 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:22.702593 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-01891306-8d8a-422f-849c-7bcc805c2bd1 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:22.846942 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-01891306-8d8a-422f-849c-7bcc805c2bd1 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:22.855565 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-01891306-8d8a-422f-849c-7bcc805c2bd1 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1317 microversion: 2.1 time: 0.166760 Jul 18 03:13:22.856164 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3349/6680] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:22 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:23.477809 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-6037b3b7-2dcc-48f0-9599-344700d4f053 req-69fc04b0-6de2-4011-a3ee-7bae8dd86dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b78a750-e501-4dac-948e-8156168a6ec2", "name": "network-vif-plugged", "status": "completed", "tag": "0b37a1c0-1c5c-4fe8-8e4a-ba1b2b887b33"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:13:23.490855 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-6037b3b7-2dcc-48f0-9599-344700d4f053 req-69fc04b0-6de2-4011-a3ee-7bae8dd86dc2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:23.491347 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-6037b3b7-2dcc-48f0-9599-344700d4f053 req-69fc04b0-6de2-4011-a3ee-7bae8dd86dc2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:23.509237 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-6037b3b7-2dcc-48f0-9599-344700d4f053 req-69fc04b0-6de2-4011-a3ee-7bae8dd86dc2 service nova] Creating event network-vif-plugged:0b37a1c0-1c5c-4fe8-8e4a-ba1b2b887b33 for instance 1b78a750-e501-4dac-948e-8156168a6ec2 on n-h1-465891-3 Jul 18 03:13:23.517258 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-6037b3b7-2dcc-48f0-9599-344700d4f053 req-69fc04b0-6de2-4011-a3ee-7bae8dd86dc2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042892 Jul 18 03:13:23.518442 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3332/6681] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:13:23.876642 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-80ccf8b6-fd61-4548-b6e4-937b1ce53b25 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:23.877327 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-80ccf8b6-fd61-4548-b6e4-937b1ce53b25 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:23.885621 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-80ccf8b6-fd61-4548-b6e4-937b1ce53b25 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:23.886118 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-80ccf8b6-fd61-4548-b6e4-937b1ce53b25 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:23.886911 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-80ccf8b6-fd61-4548-b6e4-937b1ce53b25 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:23.887359 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-80ccf8b6-fd61-4548-b6e4-937b1ce53b25 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:23.893416 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:13:24.056433 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-80ccf8b6-fd61-4548-b6e4-937b1ce53b25 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:24.067307 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-80ccf8b6-fd61-4548-b6e4-937b1ce53b25 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1317 microversion: 2.1 time: 0.197182 Jul 18 03:13:24.068177 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3350/6682] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:23 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:25.089519 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2c30cf38-e569-4efc-a825-69c280054667 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:25.090262 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2c30cf38-e569-4efc-a825-69c280054667 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:25.098551 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2c30cf38-e569-4efc-a825-69c280054667 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:25.100898 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2c30cf38-e569-4efc-a825-69c280054667 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:25.101694 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2c30cf38-e569-4efc-a825-69c280054667 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:25.102813 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2c30cf38-e569-4efc-a825-69c280054667 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:25.111470 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:13:25.254044 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2c30cf38-e569-4efc-a825-69c280054667 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:25.262072 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2c30cf38-e569-4efc-a825-69c280054667 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1506 microversion: 2.1 time: 0.179548 Jul 18 03:13:25.262655 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3333/6683] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:25 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1506 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:25.278698 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4b9bb1b9-8605-4371-bd0b-579b29bb0113 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:25.279322 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4b9bb1b9-8605-4371-bd0b-579b29bb0113 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:25.282209 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:13:25.288007 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4b9bb1b9-8605-4371-bd0b-579b29bb0113 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:25.288467 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4b9bb1b9-8605-4371-bd0b-579b29bb0113 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:25.289350 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4b9bb1b9-8605-4371-bd0b-579b29bb0113 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:25.290488 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4b9bb1b9-8605-4371-bd0b-579b29bb0113 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:25.450589 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4b9bb1b9-8605-4371-bd0b-579b29bb0113 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:25.459013 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4b9bb1b9-8605-4371-bd0b-579b29bb0113 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1506 microversion: 2.1 time: 0.184184 Jul 18 03:13:25.459626 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3351/6684] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:25 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1506 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:25.475649 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-801f5951-d5c6-489c-8e40-3982ffe96027 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:13:25.476660 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-801f5951-d5c6-489c-8e40-3982ffe96027 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:25.478869 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:13:25.480307 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=10 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:13:25.480963 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:13:25.488939 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-801f5951-d5c6-489c-8e40-3982ffe96027 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:25.489390 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-801f5951-d5c6-489c-8e40-3982ffe96027 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:25.490488 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-801f5951-d5c6-489c-8e40-3982ffe96027 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:25.490930 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-801f5951-d5c6-489c-8e40-3982ffe96027 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:25.523453 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-801f5951-d5c6-489c-8e40-3982ffe96027 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:25.532345 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-801f5951-d5c6-489c-8e40-3982ffe96027 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Old instance type m1.heat2, new instance type m1.heat {{(pid=119544) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 03:13:25.544157 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-801f5951-d5c6-489c-8e40-3982ffe96027 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:13:25.544484 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-801f5951-d5c6-489c-8e40-3982ffe96027 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:13:25.544965 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-801f5951-d5c6-489c-8e40-3982ffe96027 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:13:25.545376 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-801f5951-d5c6-489c-8e40-3982ffe96027 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:13:25.545915 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-801f5951-d5c6-489c-8e40-3982ffe96027 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:13:25.631377 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-801f5951-d5c6-489c-8e40-3982ffe96027 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "POST /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2/action" status: 202 len: 0 microversion: 2.1 time: 0.159656 Jul 18 03:13:25.633072 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3334/6685] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:13:25 2022] POST /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 03:13:25.641040 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-87c34b1e-41fc-4464-ac79-4675c19adeae tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:25.641660 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-87c34b1e-41fc-4464-ac79-4675c19adeae tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:25.643582 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:13:25.649802 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-87c34b1e-41fc-4464-ac79-4675c19adeae tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:25.650316 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-87c34b1e-41fc-4464-ac79-4675c19adeae tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:25.651114 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-87c34b1e-41fc-4464-ac79-4675c19adeae tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:25.651562 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-87c34b1e-41fc-4464-ac79-4675c19adeae tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:25.842885 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-87c34b1e-41fc-4464-ac79-4675c19adeae tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:25.851152 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-87c34b1e-41fc-4464-ac79-4675c19adeae tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1513 microversion: 2.1 time: 0.213852 Jul 18 03:13:25.851766 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3352/6686] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:25 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1513 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:26.871285 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f650b0f3-03a1-48de-9731-33e4b483a28b tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:26.871882 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f650b0f3-03a1-48de-9731-33e4b483a28b tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:26.878333 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f650b0f3-03a1-48de-9731-33e4b483a28b tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:26.878779 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f650b0f3-03a1-48de-9731-33e4b483a28b tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:26.879541 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f650b0f3-03a1-48de-9731-33e4b483a28b tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:26.879984 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f650b0f3-03a1-48de-9731-33e4b483a28b tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:27.022182 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f650b0f3-03a1-48de-9731-33e4b483a28b tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:27.031258 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f650b0f3-03a1-48de-9731-33e4b483a28b tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1513 microversion: 2.1 time: 0.166018 Jul 18 03:13:27.031842 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3335/6687] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:26 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:28.048379 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-29584d2b-b0d8-4fa8-b61c-1c7a2834604e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:28.049009 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-29584d2b-b0d8-4fa8-b61c-1c7a2834604e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:28.056692 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-29584d2b-b0d8-4fa8-b61c-1c7a2834604e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:28.057149 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-29584d2b-b0d8-4fa8-b61c-1c7a2834604e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:28.057970 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-29584d2b-b0d8-4fa8-b61c-1c7a2834604e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:28.058419 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-29584d2b-b0d8-4fa8-b61c-1c7a2834604e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:28.197343 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-29584d2b-b0d8-4fa8-b61c-1c7a2834604e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:28.204969 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-29584d2b-b0d8-4fa8-b61c-1c7a2834604e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1518 microversion: 2.1 time: 0.160521 Jul 18 03:13:28.205541 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3353/6688] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:28 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:29.221453 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-55d26f99-a045-4b57-b4be-86c606716288 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:29.222095 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-55d26f99-a045-4b57-b4be-86c606716288 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:29.229840 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-55d26f99-a045-4b57-b4be-86c606716288 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:29.230295 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-55d26f99-a045-4b57-b4be-86c606716288 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:29.231070 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-55d26f99-a045-4b57-b4be-86c606716288 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:29.231509 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-55d26f99-a045-4b57-b4be-86c606716288 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:29.376407 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-55d26f99-a045-4b57-b4be-86c606716288 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:29.384035 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-55d26f99-a045-4b57-b4be-86c606716288 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1518 microversion: 2.1 time: 0.166543 Jul 18 03:13:29.384661 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3336/6689] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:29 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1518 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:30.402921 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8a1e15f1-3d0e-4c8c-b9fd-ec5d171ad8d2 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:30.403551 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8a1e15f1-3d0e-4c8c-b9fd-ec5d171ad8d2 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:30.410651 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8a1e15f1-3d0e-4c8c-b9fd-ec5d171ad8d2 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:30.411137 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8a1e15f1-3d0e-4c8c-b9fd-ec5d171ad8d2 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:30.411926 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8a1e15f1-3d0e-4c8c-b9fd-ec5d171ad8d2 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:30.412406 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8a1e15f1-3d0e-4c8c-b9fd-ec5d171ad8d2 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:30.553545 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8a1e15f1-3d0e-4c8c-b9fd-ec5d171ad8d2 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:30.562058 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8a1e15f1-3d0e-4c8c-b9fd-ec5d171ad8d2 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1518 microversion: 2.1 time: 0.164131 Jul 18 03:13:30.562650 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3354/6690] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:30 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:31.580002 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3b8d51fa-ec1d-4de8-8e25-dfeea2208473 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:31.580651 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3b8d51fa-ec1d-4de8-8e25-dfeea2208473 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:31.588034 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b8d51fa-ec1d-4de8-8e25-dfeea2208473 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:31.588483 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b8d51fa-ec1d-4de8-8e25-dfeea2208473 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:31.589253 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b8d51fa-ec1d-4de8-8e25-dfeea2208473 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:31.589689 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b8d51fa-ec1d-4de8-8e25-dfeea2208473 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:31.726373 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3b8d51fa-ec1d-4de8-8e25-dfeea2208473 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:31.735336 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3b8d51fa-ec1d-4de8-8e25-dfeea2208473 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1518 microversion: 2.1 time: 0.159318 Jul 18 03:13:31.735918 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3337/6691] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:31 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:32.752989 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ec5414fd-5fe0-41ac-b17d-ac8b4200783d tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:32.753597 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ec5414fd-5fe0-41ac-b17d-ac8b4200783d tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:32.761004 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ec5414fd-5fe0-41ac-b17d-ac8b4200783d tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:32.761507 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ec5414fd-5fe0-41ac-b17d-ac8b4200783d tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:32.762356 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ec5414fd-5fe0-41ac-b17d-ac8b4200783d tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:32.762881 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ec5414fd-5fe0-41ac-b17d-ac8b4200783d tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:32.902528 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ec5414fd-5fe0-41ac-b17d-ac8b4200783d tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:32.910143 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ec5414fd-5fe0-41ac-b17d-ac8b4200783d tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1518 microversion: 2.1 time: 0.161551 Jul 18 03:13:32.910729 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3355/6692] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:32 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:33.927808 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5925201e-10a2-440e-bf92-46b7b574c698 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:33.928507 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5925201e-10a2-440e-bf92-46b7b574c698 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:33.936281 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5925201e-10a2-440e-bf92-46b7b574c698 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:33.936759 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5925201e-10a2-440e-bf92-46b7b574c698 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:33.937525 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5925201e-10a2-440e-bf92-46b7b574c698 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:33.937991 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5925201e-10a2-440e-bf92-46b7b574c698 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:34.069926 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5925201e-10a2-440e-bf92-46b7b574c698 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:34.078344 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5925201e-10a2-440e-bf92-46b7b574c698 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1518 microversion: 2.1 time: 0.154507 Jul 18 03:13:34.078920 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3338/6693] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:33 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:35.096174 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-41d6812d-bc6e-4c16-a8d0-635767b7b86b tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:35.096830 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-41d6812d-bc6e-4c16-a8d0-635767b7b86b tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:35.104012 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41d6812d-bc6e-4c16-a8d0-635767b7b86b tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:35.104476 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41d6812d-bc6e-4c16-a8d0-635767b7b86b tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:35.105252 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41d6812d-bc6e-4c16-a8d0-635767b7b86b tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:35.105746 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41d6812d-bc6e-4c16-a8d0-635767b7b86b tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:35.529929 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-41d6812d-bc6e-4c16-a8d0-635767b7b86b tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:35.537554 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-41d6812d-bc6e-4c16-a8d0-635767b7b86b tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1518 microversion: 2.1 time: 0.445790 Jul 18 03:13:35.538160 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3356/6694] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:35 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1518 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:36.556214 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-061fd101-4515-4840-ad83-5baf50ea4cfb tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:36.556925 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-061fd101-4515-4840-ad83-5baf50ea4cfb tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:36.564471 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-061fd101-4515-4840-ad83-5baf50ea4cfb tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:36.564979 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-061fd101-4515-4840-ad83-5baf50ea4cfb tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:36.565779 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-061fd101-4515-4840-ad83-5baf50ea4cfb tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:36.566217 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-061fd101-4515-4840-ad83-5baf50ea4cfb tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:36.699341 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-061fd101-4515-4840-ad83-5baf50ea4cfb tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:36.707248 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-061fd101-4515-4840-ad83-5baf50ea4cfb tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1518 microversion: 2.1 time: 0.156232 Jul 18 03:13:36.707827 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3339/6695] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:36 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:37.724390 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-497d1012-4a21-4692-b496-865a4f2096d9 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:37.725014 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-497d1012-4a21-4692-b496-865a4f2096d9 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:37.732377 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-497d1012-4a21-4692-b496-865a4f2096d9 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:37.732834 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-497d1012-4a21-4692-b496-865a4f2096d9 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:37.733659 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-497d1012-4a21-4692-b496-865a4f2096d9 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:37.734128 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-497d1012-4a21-4692-b496-865a4f2096d9 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:37.873001 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-497d1012-4a21-4692-b496-865a4f2096d9 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:37.880528 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-497d1012-4a21-4692-b496-865a4f2096d9 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1518 microversion: 2.1 time: 0.160026 Jul 18 03:13:37.881103 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3357/6696] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:37 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:38.896888 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-73ea033d-d172-40fb-96fe-599595401b6e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:38.897506 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-73ea033d-d172-40fb-96fe-599595401b6e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:38.905105 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-73ea033d-d172-40fb-96fe-599595401b6e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:38.905559 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-73ea033d-d172-40fb-96fe-599595401b6e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:38.906360 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-73ea033d-d172-40fb-96fe-599595401b6e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:38.906805 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-73ea033d-d172-40fb-96fe-599595401b6e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:39.035439 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-73ea033d-d172-40fb-96fe-599595401b6e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:39.043886 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-73ea033d-d172-40fb-96fe-599595401b6e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1518 microversion: 2.1 time: 0.150890 Jul 18 03:13:39.044479 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3340/6697] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:38 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:40.061614 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9c28a053-a53b-437f-8462-4dba2af47d9a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:40.062269 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9c28a053-a53b-437f-8462-4dba2af47d9a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:40.069190 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9c28a053-a53b-437f-8462-4dba2af47d9a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:40.069652 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9c28a053-a53b-437f-8462-4dba2af47d9a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:40.071226 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9c28a053-a53b-437f-8462-4dba2af47d9a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:40.071713 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9c28a053-a53b-437f-8462-4dba2af47d9a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:40.204510 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9c28a053-a53b-437f-8462-4dba2af47d9a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:40.212968 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9c28a053-a53b-437f-8462-4dba2af47d9a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1518 microversion: 2.1 time: 0.155127 Jul 18 03:13:40.213564 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3358/6698] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:40 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:41.230427 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4e08d524-1aa8-428b-8a8a-54ba82788f02 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:41.231187 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4e08d524-1aa8-428b-8a8a-54ba82788f02 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:41.238629 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e08d524-1aa8-428b-8a8a-54ba82788f02 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:41.239077 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e08d524-1aa8-428b-8a8a-54ba82788f02 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:41.239858 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e08d524-1aa8-428b-8a8a-54ba82788f02 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:41.240567 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e08d524-1aa8-428b-8a8a-54ba82788f02 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:41.466970 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4e08d524-1aa8-428b-8a8a-54ba82788f02 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:41.474028 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4e08d524-1aa8-428b-8a8a-54ba82788f02 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1518 microversion: 2.1 time: 0.247848 Jul 18 03:13:41.474628 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3341/6699] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:41 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1518 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:42.491455 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d58ec060-3b11-40f3-9270-9b275bd00230 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:42.492113 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d58ec060-3b11-40f3-9270-9b275bd00230 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:42.499209 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d58ec060-3b11-40f3-9270-9b275bd00230 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:42.499669 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d58ec060-3b11-40f3-9270-9b275bd00230 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:42.500448 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d58ec060-3b11-40f3-9270-9b275bd00230 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:42.500901 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d58ec060-3b11-40f3-9270-9b275bd00230 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:42.633231 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d58ec060-3b11-40f3-9270-9b275bd00230 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:42.641482 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d58ec060-3b11-40f3-9270-9b275bd00230 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1518 microversion: 2.1 time: 0.154163 Jul 18 03:13:42.642099 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3359/6700] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:42 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:43.659292 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2ea3166e-f005-4cc0-925c-2e8fe36b7b6b tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:43.659902 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2ea3166e-f005-4cc0-925c-2e8fe36b7b6b tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:43.667758 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ea3166e-f005-4cc0-925c-2e8fe36b7b6b tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:43.668209 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ea3166e-f005-4cc0-925c-2e8fe36b7b6b tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:43.668976 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ea3166e-f005-4cc0-925c-2e8fe36b7b6b tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:43.669411 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ea3166e-f005-4cc0-925c-2e8fe36b7b6b tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:43.810229 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2ea3166e-f005-4cc0-925c-2e8fe36b7b6b tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:43.817784 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2ea3166e-f005-4cc0-925c-2e8fe36b7b6b tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1518 microversion: 2.1 time: 0.162373 Jul 18 03:13:43.818355 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3342/6701] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:43 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:44.838156 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6a12de0b-3c8b-4d26-b934-a8506305e035 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:44.838814 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6a12de0b-3c8b-4d26-b934-a8506305e035 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:44.846203 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a12de0b-3c8b-4d26-b934-a8506305e035 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:44.846663 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a12de0b-3c8b-4d26-b934-a8506305e035 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:44.847455 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a12de0b-3c8b-4d26-b934-a8506305e035 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:44.847903 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a12de0b-3c8b-4d26-b934-a8506305e035 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:45.008986 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6a12de0b-3c8b-4d26-b934-a8506305e035 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:45.019774 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6a12de0b-3c8b-4d26-b934-a8506305e035 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1518 microversion: 2.1 time: 0.187602 Jul 18 03:13:45.020378 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3360/6702] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:44 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1518 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:46.038168 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1ac9c1f2-d033-4c99-9bbc-91c51ed404a3 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:46.038833 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1ac9c1f2-d033-4c99-9bbc-91c51ed404a3 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:46.045779 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ac9c1f2-d033-4c99-9bbc-91c51ed404a3 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:46.046234 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ac9c1f2-d033-4c99-9bbc-91c51ed404a3 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:46.046995 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ac9c1f2-d033-4c99-9bbc-91c51ed404a3 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:46.047435 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1ac9c1f2-d033-4c99-9bbc-91c51ed404a3 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:46.186747 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1ac9c1f2-d033-4c99-9bbc-91c51ed404a3 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:46.194475 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1ac9c1f2-d033-4c99-9bbc-91c51ed404a3 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1518 microversion: 2.1 time: 0.160202 Jul 18 03:13:46.195622 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3343/6703] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:46 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:47.213364 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-16099b12-fece-4494-bb4a-714ebc205280 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:47.214024 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-16099b12-fece-4494-bb4a-714ebc205280 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:47.221119 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-16099b12-fece-4494-bb4a-714ebc205280 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:47.221578 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-16099b12-fece-4494-bb4a-714ebc205280 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:47.222395 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-16099b12-fece-4494-bb4a-714ebc205280 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:47.223110 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-16099b12-fece-4494-bb4a-714ebc205280 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:47.359489 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-16099b12-fece-4494-bb4a-714ebc205280 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:47.367957 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-16099b12-fece-4494-bb4a-714ebc205280 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1518 microversion: 2.1 time: 0.159175 Jul 18 03:13:47.368740 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3361/6704] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:47 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:48.386121 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e8e5cfa4-8fb8-41fd-9e19-18796aece12a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:48.386722 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e8e5cfa4-8fb8-41fd-9e19-18796aece12a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:48.393929 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e8e5cfa4-8fb8-41fd-9e19-18796aece12a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:48.394382 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e8e5cfa4-8fb8-41fd-9e19-18796aece12a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:48.395156 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e8e5cfa4-8fb8-41fd-9e19-18796aece12a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:48.395596 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e8e5cfa4-8fb8-41fd-9e19-18796aece12a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:48.534076 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e8e5cfa4-8fb8-41fd-9e19-18796aece12a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:48.542008 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e8e5cfa4-8fb8-41fd-9e19-18796aece12a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1518 microversion: 2.1 time: 0.160363 Jul 18 03:13:48.542937 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3344/6705] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:48 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:49.559563 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bf532e02-07a0-4fe2-8ce9-fc4103dadc44 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:49.560194 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bf532e02-07a0-4fe2-8ce9-fc4103dadc44 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:49.566861 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bf532e02-07a0-4fe2-8ce9-fc4103dadc44 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:49.567323 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bf532e02-07a0-4fe2-8ce9-fc4103dadc44 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:49.568171 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bf532e02-07a0-4fe2-8ce9-fc4103dadc44 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:49.568621 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bf532e02-07a0-4fe2-8ce9-fc4103dadc44 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:49.707992 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bf532e02-07a0-4fe2-8ce9-fc4103dadc44 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:49.716682 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bf532e02-07a0-4fe2-8ce9-fc4103dadc44 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1518 microversion: 2.1 time: 0.161206 Jul 18 03:13:49.717615 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3362/6706] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:49 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:50.733013 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4e4e19c3-4b47-43f4-ab39-8c983d0693fb tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:50.733678 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4e4e19c3-4b47-43f4-ab39-8c983d0693fb tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:50.741233 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e4e19c3-4b47-43f4-ab39-8c983d0693fb tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:50.741726 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e4e19c3-4b47-43f4-ab39-8c983d0693fb tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:50.742671 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e4e19c3-4b47-43f4-ab39-8c983d0693fb tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:50.743123 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e4e19c3-4b47-43f4-ab39-8c983d0693fb tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:50.880346 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4e4e19c3-4b47-43f4-ab39-8c983d0693fb tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:50.888837 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4e4e19c3-4b47-43f4-ab39-8c983d0693fb tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1518 microversion: 2.1 time: 0.159746 Jul 18 03:13:50.889432 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3345/6707] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:50 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:51.906942 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-43beb364-eb0a-42ff-a907-7ef783baf95e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:51.907605 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-43beb364-eb0a-42ff-a907-7ef783baf95e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:51.915393 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-43beb364-eb0a-42ff-a907-7ef783baf95e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:51.915866 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-43beb364-eb0a-42ff-a907-7ef783baf95e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:51.916665 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-43beb364-eb0a-42ff-a907-7ef783baf95e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:51.917118 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-43beb364-eb0a-42ff-a907-7ef783baf95e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:52.074566 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-43beb364-eb0a-42ff-a907-7ef783baf95e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:52.082501 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-43beb364-eb0a-42ff-a907-7ef783baf95e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1518 microversion: 2.1 time: 0.179485 Jul 18 03:13:52.083098 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3363/6708] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:51 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1518 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:53.100927 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-df9ec25f-9333-4313-8311-e4467b066f10 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:53.101897 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-df9ec25f-9333-4313-8311-e4467b066f10 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:53.109105 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-df9ec25f-9333-4313-8311-e4467b066f10 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:53.109598 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-df9ec25f-9333-4313-8311-e4467b066f10 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:53.110437 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-df9ec25f-9333-4313-8311-e4467b066f10 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:53.110915 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-df9ec25f-9333-4313-8311-e4467b066f10 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:53.254769 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-df9ec25f-9333-4313-8311-e4467b066f10 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:53.263489 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-df9ec25f-9333-4313-8311-e4467b066f10 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1518 microversion: 2.1 time: 0.166531 Jul 18 03:13:53.264078 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3346/6709] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:53 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1518 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:54.280630 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-99979fa2-d8d6-4a1e-9d5e-2d75399b4a33 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:54.281480 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-99979fa2-d8d6-4a1e-9d5e-2d75399b4a33 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:54.292736 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-99979fa2-d8d6-4a1e-9d5e-2d75399b4a33 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:54.293205 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-99979fa2-d8d6-4a1e-9d5e-2d75399b4a33 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:54.294053 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-99979fa2-d8d6-4a1e-9d5e-2d75399b4a33 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:54.294505 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-99979fa2-d8d6-4a1e-9d5e-2d75399b4a33 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:54.297417 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=83 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:13:54.438181 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-99979fa2-d8d6-4a1e-9d5e-2d75399b4a33 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:54.446875 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-99979fa2-d8d6-4a1e-9d5e-2d75399b4a33 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1518 microversion: 2.1 time: 0.170129 Jul 18 03:13:54.447495 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3364/6710] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:54 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1518 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:55.095233 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-858a5752-a70c-4ade-a8f3-4fec2dd4c2ae req-fc473488-612d-47dd-a334-08f132f20601 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b78a750-e501-4dac-948e-8156168a6ec2", "name": "network-vif-unplugged", "status": "completed", "tag": "0b37a1c0-1c5c-4fe8-8e4a-ba1b2b887b33"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:13:55.106053 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-858a5752-a70c-4ade-a8f3-4fec2dd4c2ae req-fc473488-612d-47dd-a334-08f132f20601 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:55.106602 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-858a5752-a70c-4ade-a8f3-4fec2dd4c2ae req-fc473488-612d-47dd-a334-08f132f20601 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:55.121127 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-858a5752-a70c-4ade-a8f3-4fec2dd4c2ae req-fc473488-612d-47dd-a334-08f132f20601 service nova] Creating event network-vif-unplugged:0b37a1c0-1c5c-4fe8-8e4a-ba1b2b887b33 for instance 1b78a750-e501-4dac-948e-8156168a6ec2 on n-h2-465891-3 Jul 18 03:13:55.126897 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [req-858a5752-a70c-4ade-a8f3-4fec2dd4c2ae req-fc473488-612d-47dd-a334-08f132f20601 service nova] Instance 1b78a750-e501-4dac-948e-8156168a6ec2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3', 'n-h2-465891-3'} {{(pid=119544) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:13:55.138903 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-858a5752-a70c-4ade-a8f3-4fec2dd4c2ae req-fc473488-612d-47dd-a334-08f132f20601 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047303 Jul 18 03:13:55.139537 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3347/6711] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:13:55.468773 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2cb3ab3d-a037-4644-bfa5-ed45e2b88896 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:55.469420 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2cb3ab3d-a037-4644-bfa5-ed45e2b88896 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:55.477071 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=28 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:13:55.478932 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2cb3ab3d-a037-4644-bfa5-ed45e2b88896 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:55.479402 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2cb3ab3d-a037-4644-bfa5-ed45e2b88896 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:55.480536 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2cb3ab3d-a037-4644-bfa5-ed45e2b88896 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:55.480992 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2cb3ab3d-a037-4644-bfa5-ed45e2b88896 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:55.728398 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2cb3ab3d-a037-4644-bfa5-ed45e2b88896 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:55.736247 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2cb3ab3d-a037-4644-bfa5-ed45e2b88896 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1517 microversion: 2.1 time: 0.271991 Jul 18 03:13:55.736838 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3365/6712] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:55 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1517 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:56.755577 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-568b89d5-f791-4c46-9fdc-89da56203066 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:56.756281 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-568b89d5-f791-4c46-9fdc-89da56203066 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:56.758814 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=32 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:13:56.764509 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-568b89d5-f791-4c46-9fdc-89da56203066 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:56.764966 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-568b89d5-f791-4c46-9fdc-89da56203066 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:56.765765 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-568b89d5-f791-4c46-9fdc-89da56203066 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:56.766208 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-568b89d5-f791-4c46-9fdc-89da56203066 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:56.769108 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:13:56.901914 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-568b89d5-f791-4c46-9fdc-89da56203066 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:56.911343 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-568b89d5-f791-4c46-9fdc-89da56203066 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1515 microversion: 2.1 time: 0.160890 Jul 18 03:13:56.912182 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3348/6713] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:56 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:57.153541 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-de589526-a9b0-4a7d-8e6f-e9cbaaa1eec8 req-c63187a0-68fd-4fba-bc1f-321d0cb51c7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b78a750-e501-4dac-948e-8156168a6ec2", "tag": "0b37a1c0-1c5c-4fe8-8e4a-ba1b2b887b33"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:13:57.162763 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-de589526-a9b0-4a7d-8e6f-e9cbaaa1eec8 req-c63187a0-68fd-4fba-bc1f-321d0cb51c7b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:57.163217 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-de589526-a9b0-4a7d-8e6f-e9cbaaa1eec8 req-c63187a0-68fd-4fba-bc1f-321d0cb51c7b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:57.175427 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-de589526-a9b0-4a7d-8e6f-e9cbaaa1eec8 req-c63187a0-68fd-4fba-bc1f-321d0cb51c7b service nova] Creating event network-changed:0b37a1c0-1c5c-4fe8-8e4a-ba1b2b887b33 for instance 1b78a750-e501-4dac-948e-8156168a6ec2 on n-h2-465891-3 Jul 18 03:13:57.182125 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [req-de589526-a9b0-4a7d-8e6f-e9cbaaa1eec8 req-c63187a0-68fd-4fba-bc1f-321d0cb51c7b service nova] Instance 1b78a750-e501-4dac-948e-8156168a6ec2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3', 'n-h2-465891-3'} {{(pid=119543) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:13:57.193250 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-de589526-a9b0-4a7d-8e6f-e9cbaaa1eec8 req-c63187a0-68fd-4fba-bc1f-321d0cb51c7b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043495 Jul 18 03:13:57.194437 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3366/6714] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:13:57.928576 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7bbd8ddb-7cfe-4bb6-84d9-b463d13b4bfa tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:57.929991 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7bbd8ddb-7cfe-4bb6-84d9-b463d13b4bfa tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:57.937513 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7bbd8ddb-7cfe-4bb6-84d9-b463d13b4bfa tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:57.937998 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7bbd8ddb-7cfe-4bb6-84d9-b463d13b4bfa tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:57.938789 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7bbd8ddb-7cfe-4bb6-84d9-b463d13b4bfa tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:57.939235 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7bbd8ddb-7cfe-4bb6-84d9-b463d13b4bfa tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:58.173885 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7bbd8ddb-7cfe-4bb6-84d9-b463d13b4bfa tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:58.182389 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7bbd8ddb-7cfe-4bb6-84d9-b463d13b4bfa tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1512 microversion: 2.1 time: 0.257767 Jul 18 03:13:58.183173 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3349/6715] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:57 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1512 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:58.202456 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e1360365-d60f-43b1-99f1-16b41f554531 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:13:58.203213 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e1360365-d60f-43b1-99f1-16b41f554531 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:58.209529 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e1360365-d60f-43b1-99f1-16b41f554531 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:58.210111 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e1360365-d60f-43b1-99f1-16b41f554531 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:58.211836 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e1360365-d60f-43b1-99f1-16b41f554531 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:58.212350 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e1360365-d60f-43b1-99f1-16b41f554531 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:58.278804 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e1360365-d60f-43b1-99f1-16b41f554531 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "POST /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2/action" status: 204 len: 0 microversion: 2.1 time: 0.081322 Jul 18 03:13:58.279500 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3367/6716] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:13:58 2022] POST /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2/action => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 03:13:58.288501 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1a6c07e3-1e86-485f-ac56-82369c725db8 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:58.289148 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1a6c07e3-1e86-485f-ac56-82369c725db8 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:58.298327 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1a6c07e3-1e86-485f-ac56-82369c725db8 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:58.298969 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1a6c07e3-1e86-485f-ac56-82369c725db8 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:58.299740 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1a6c07e3-1e86-485f-ac56-82369c725db8 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:58.300186 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1a6c07e3-1e86-485f-ac56-82369c725db8 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:58.521248 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1a6c07e3-1e86-485f-ac56-82369c725db8 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:58.531904 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1a6c07e3-1e86-485f-ac56-82369c725db8 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1512 microversion: 2.1 time: 0.247510 Jul 18 03:13:58.534929 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3350/6717] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:58 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1512 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:59.309515 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-b031f91a-4203-48f0-b57d-23346791a3e2 req-150db5e5-ff45-47e8-b298-74873e1c525a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b78a750-e501-4dac-948e-8156168a6ec2", "name": "network-vif-plugged", "status": "completed", "tag": "0b37a1c0-1c5c-4fe8-8e4a-ba1b2b887b33"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:13:59.321358 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-b031f91a-4203-48f0-b57d-23346791a3e2 req-150db5e5-ff45-47e8-b298-74873e1c525a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:59.321919 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-b031f91a-4203-48f0-b57d-23346791a3e2 req-150db5e5-ff45-47e8-b298-74873e1c525a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:59.334322 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-b031f91a-4203-48f0-b57d-23346791a3e2 req-150db5e5-ff45-47e8-b298-74873e1c525a service nova] Creating event network-vif-plugged:0b37a1c0-1c5c-4fe8-8e4a-ba1b2b887b33 for instance 1b78a750-e501-4dac-948e-8156168a6ec2 on n-h2-465891-3 Jul 18 03:13:59.340639 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [req-b031f91a-4203-48f0-b57d-23346791a3e2 req-150db5e5-ff45-47e8-b298-74873e1c525a service nova] Instance 1b78a750-e501-4dac-948e-8156168a6ec2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3', 'n-h2-465891-3'} {{(pid=119543) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:13:59.351644 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-b031f91a-4203-48f0-b57d-23346791a3e2 req-150db5e5-ff45-47e8-b298-74873e1c525a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050429 Jul 18 03:13:59.352274 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3368/6718] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:13:59.550515 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-72e9006d-e886-4261-becb-77c2bbc45736 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:59.551065 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-72e9006d-e886-4261-becb-77c2bbc45736 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:59.559898 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-72e9006d-e886-4261-becb-77c2bbc45736 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:59.560346 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-72e9006d-e886-4261-becb-77c2bbc45736 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:59.561170 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-72e9006d-e886-4261-becb-77c2bbc45736 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:59.561623 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-72e9006d-e886-4261-becb-77c2bbc45736 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:59.706752 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-72e9006d-e886-4261-becb-77c2bbc45736 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:59.715495 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-72e9006d-e886-4261-becb-77c2bbc45736 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1512 microversion: 2.1 time: 0.169215 Jul 18 03:13:59.716261 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3351/6719] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:59 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1512 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:00.734107 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bcb442db-017a-4cdd-a004-cac9e408a83f tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:00.734807 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bcb442db-017a-4cdd-a004-cac9e408a83f tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:00.741359 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bcb442db-017a-4cdd-a004-cac9e408a83f tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:00.742351 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bcb442db-017a-4cdd-a004-cac9e408a83f tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:00.743128 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bcb442db-017a-4cdd-a004-cac9e408a83f tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:00.743576 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bcb442db-017a-4cdd-a004-cac9e408a83f tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:00.873635 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bcb442db-017a-4cdd-a004-cac9e408a83f tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:00.881621 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bcb442db-017a-4cdd-a004-cac9e408a83f tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1504 microversion: 2.1 time: 0.152654 Jul 18 03:14:00.882904 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3369/6720] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:00 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:14:00.898653 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-eaad0354-53d6-4400-86e5-78812837a38a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:00.899277 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-eaad0354-53d6-4400-86e5-78812837a38a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:00.906590 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eaad0354-53d6-4400-86e5-78812837a38a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:00.907041 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eaad0354-53d6-4400-86e5-78812837a38a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:00.907810 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eaad0354-53d6-4400-86e5-78812837a38a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:00.908242 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eaad0354-53d6-4400-86e5-78812837a38a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:01.053471 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-eaad0354-53d6-4400-86e5-78812837a38a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:01.062043 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-eaad0354-53d6-4400-86e5-78812837a38a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1504 microversion: 2.1 time: 0.167560 Jul 18 03:14:01.062624 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3352/6721] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:00 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:01.078734 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-88afae24-36ef-4d05-853d-f22b1312bfa1 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:01.079424 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-88afae24-36ef-4d05-853d-f22b1312bfa1 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:01.086004 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-88afae24-36ef-4d05-853d-f22b1312bfa1 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:01.086476 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-88afae24-36ef-4d05-853d-f22b1312bfa1 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:01.087304 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-88afae24-36ef-4d05-853d-f22b1312bfa1 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:01.087949 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-88afae24-36ef-4d05-853d-f22b1312bfa1 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:01.220983 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-88afae24-36ef-4d05-853d-f22b1312bfa1 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:01.229778 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-88afae24-36ef-4d05-853d-f22b1312bfa1 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1504 microversion: 2.1 time: 0.155005 Jul 18 03:14:01.230366 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3370/6722] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:01 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:01.247832 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-72acbe21-80c4-4951-8041-c366cba94bb2 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:01.248334 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-72acbe21-80c4-4951-8041-c366cba94bb2 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:01.254576 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-72acbe21-80c4-4951-8041-c366cba94bb2 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:01.255033 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-72acbe21-80c4-4951-8041-c366cba94bb2 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:01.255806 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-72acbe21-80c4-4951-8041-c366cba94bb2 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:01.256251 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-72acbe21-80c4-4951-8041-c366cba94bb2 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:01.281865 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-72acbe21-80c4-4951-8041-c366cba94bb2 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:14:01.362594 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-72acbe21-80c4-4951-8041-c366cba94bb2 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "DELETE /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 204 len: 0 microversion: 2.1 time: 0.117854 Jul 18 03:14:01.363855 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3353/6723] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:14:01 2022] DELETE /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:14:01.379623 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-844120ca-2c50-4bdd-9149-a78aba80103c tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:01.380137 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-844120ca-2c50-4bdd-9149-a78aba80103c tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:01.386714 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-844120ca-2c50-4bdd-9149-a78aba80103c tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:01.387171 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-844120ca-2c50-4bdd-9149-a78aba80103c tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:01.387985 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-844120ca-2c50-4bdd-9149-a78aba80103c tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:01.388433 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-844120ca-2c50-4bdd-9149-a78aba80103c tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:01.414471 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-844120ca-2c50-4bdd-9149-a78aba80103c tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:14:01.462056 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.compute.api [None req-844120ca-2c50-4bdd-9149-a78aba80103c tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Instance is already in deleting state, ignoring this request Jul 18 03:14:01.462920 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-844120ca-2c50-4bdd-9149-a78aba80103c tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "DELETE /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 204 len: 0 microversion: 2.1 time: 0.087507 Jul 18 03:14:01.463471 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3371/6724] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:14:01 2022] DELETE /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:14:01.472206 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d84888f4-0ee3-49b9-908e-eba7cb8dd318 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:01.472908 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d84888f4-0ee3-49b9-908e-eba7cb8dd318 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:01.479980 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d84888f4-0ee3-49b9-908e-eba7cb8dd318 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:01.480428 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d84888f4-0ee3-49b9-908e-eba7cb8dd318 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:01.481206 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d84888f4-0ee3-49b9-908e-eba7cb8dd318 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:01.481640 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d84888f4-0ee3-49b9-908e-eba7cb8dd318 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:01.931461 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d84888f4-0ee3-49b9-908e-eba7cb8dd318 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:01.939053 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d84888f4-0ee3-49b9-908e-eba7cb8dd318 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1510 microversion: 2.1 time: 0.471118 Jul 18 03:14:01.939760 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3354/6725] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:01 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1510 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:02.957327 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5e82db13-ebf0-4c3f-bb89-fd6f23b3e8b6 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:02.957990 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5e82db13-ebf0-4c3f-bb89-fd6f23b3e8b6 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:02.966074 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5e82db13-ebf0-4c3f-bb89-fd6f23b3e8b6 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:02.966545 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5e82db13-ebf0-4c3f-bb89-fd6f23b3e8b6 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:02.967358 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5e82db13-ebf0-4c3f-bb89-fd6f23b3e8b6 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:02.967812 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5e82db13-ebf0-4c3f-bb89-fd6f23b3e8b6 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:03.159749 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5e82db13-ebf0-4c3f-bb89-fd6f23b3e8b6 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfafa141c64d23aa49e966ce9e25ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a42cf3a445c4752bfb41d56e3010680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:03.170336 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5e82db13-ebf0-4c3f-bb89-fd6f23b3e8b6 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 200 len: 1510 microversion: 2.1 time: 0.217422 Jul 18 03:14:03.170973 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3372/6726] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:02 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 1510 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:03.323277 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-3f13adc9-6afa-4b1a-8ee9-8fb1b791cbea req-7d841b74-0c8d-468d-ada4-0d852f9c813f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b78a750-e501-4dac-948e-8156168a6ec2", "name": "network-vif-deleted", "tag": "0b37a1c0-1c5c-4fe8-8e4a-ba1b2b887b33"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:14:03.334865 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-3f13adc9-6afa-4b1a-8ee9-8fb1b791cbea req-7d841b74-0c8d-468d-ada4-0d852f9c813f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:03.336015 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-3f13adc9-6afa-4b1a-8ee9-8fb1b791cbea req-7d841b74-0c8d-468d-ada4-0d852f9c813f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:03.357300 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-3f13adc9-6afa-4b1a-8ee9-8fb1b791cbea req-7d841b74-0c8d-468d-ada4-0d852f9c813f service nova] Creating event network-vif-deleted:0b37a1c0-1c5c-4fe8-8e4a-ba1b2b887b33 for instance 1b78a750-e501-4dac-948e-8156168a6ec2 on n-h2-465891-3 Jul 18 03:14:03.362845 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-3f13adc9-6afa-4b1a-8ee9-8fb1b791cbea req-7d841b74-0c8d-468d-ada4-0d852f9c813f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044003 Jul 18 03:14:03.363575 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3355/6727] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:14:04.186712 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-edb5b960-bc72-483e-b6dc-74bbe7d6a13e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:04.187339 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-edb5b960-bc72-483e-b6dc-74bbe7d6a13e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 1b78a750-e501-4dac-948e-8156168a6ec2] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:04.195122 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-edb5b960-bc72-483e-b6dc-74bbe7d6a13e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:04.195597 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-edb5b960-bc72-483e-b6dc-74bbe7d6a13e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:04.196395 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-edb5b960-bc72-483e-b6dc-74bbe7d6a13e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:04.196846 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-edb5b960-bc72-483e-b6dc-74bbe7d6a13e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:04.212784 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-edb5b960-bc72-483e-b6dc-74bbe7d6a13e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] HTTP exception thrown: Instance 1b78a750-e501-4dac-948e-8156168a6ec2 could not be found. Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-edb5b960-bc72-483e-b6dc-74bbe7d6a13e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Request method failure captured: Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 HTTP/1.1 Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1M-Xt-eHsofqAPNdnx-j8fQyy4-o6p6SIRzXPPFbnqP3vKoKqfvhV-m7wWtivNhPn4pLB5TrldMby0IxSL3bWeg3o12Z1bug6iID8MJjLaNGK27t5WgTD8iABPxdAg7uoyIhcNGO_Sl_t8a0rfpyz3NqrhKtXbpoULx9BfXVimZuP2Q Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 7a42cf3a445c4752bfb41d56e3010680 Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServerDiskConfigTestJSON-649592816 Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_7a42cf3a445c4752bfb41d56e3010680"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7a42cf3a445c4752bfb41d56e3010680"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7a42cf3a445c4752bfb41d56e3010680"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/7a42cf3a445c4752bfb41d56e3010680"}]}] Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServerDiskConfigTestJSON-649592816 Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 7a42cf3a445c4752bfb41d56e3010680 Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-649592816 Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServerDiskConfigTestJSON-649592816-project Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 7bcfafa141c64d23aa49e966ce9e25ef Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServerDiskConfigTestJSON-649592816-project Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 1b78a750-e501-4dac-948e-8156168a6ec2 could not be found. Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '1b78a750-e501-4dac-948e-8156168a6ec2'} Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b78a750-e501-4dac-948e-8156168a6ec2 could not be found. Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b78a750-e501-4dac-948e-8156168a6ec2 could not be found. Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:14:04.214556 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:14:04.221662 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:14:04.221662 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:14:04.221662 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:14:04.221662 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:14:04.221662 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:14:04.221662 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b78a750-e501-4dac-948e-8156168a6ec2 could not be found. Jul 18 03:14:04.221662 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:14:04.221662 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-edb5b960-bc72-483e-b6dc-74bbe7d6a13e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Returning 404 to user: Instance 1b78a750-e501-4dac-948e-8156168a6ec2 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:14:04.221662 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-edb5b960-bc72-483e-b6dc-74bbe7d6a13e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2" status: 404 len: 111 microversion: 2.1 time: 0.033207 Jul 18 03:14:04.221662 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3373/6728] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:04 2022] GET /compute/v2.1/servers/1b78a750-e501-4dac-948e-8156168a6ec2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:14:04.225395 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-476032d6-66ed-4dfb-a0a4-ce6dead1f729 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '.version_select at 0x7ff49be260d0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:04.247681 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-476032d6-66ed-4dfb-a0a4-ce6dead1f729 tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1909710978" status: 202 len: 0 microversion: 2.1 time: 0.026395 Jul 18 03:14:04.248505 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3356/6729] 10.222.0.57 () {58 vars in 1220 bytes} [Mon Jul 18 03:14:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1909710978 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:14:04.918793 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-47cd7d01-d4af-4149-b48e-e31281794e4a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:04.919309 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-47cd7d01-d4af-4149-b48e-e31281794e4a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:04.925787 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-47cd7d01-d4af-4149-b48e-e31281794e4a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:04.926260 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-47cd7d01-d4af-4149-b48e-e31281794e4a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:04.927050 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-47cd7d01-d4af-4149-b48e-e31281794e4a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:04.927578 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-47cd7d01-d4af-4149-b48e-e31281794e4a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:04.943019 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-47cd7d01-d4af-4149-b48e-e31281794e4a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] HTTP exception thrown: Instance 2846c44e-6ed6-40ce-a1ab-ab37ecc21132 could not be found. Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-47cd7d01-d4af-4149-b48e-e31281794e4a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Request method failure captured: Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 HTTP/1.1 Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1M-Xt-eHsofqAPNdnx-j8fQyy4-o6p6SIRzXPPFbnqP3vKoKqfvhV-m7wWtivNhPn4pLB5TrldMby0IxSL3bWeg3o12Z1bug6iID8MJjLaNGK27t5WgTD8iABPxdAg7uoyIhcNGO_Sl_t8a0rfpyz3NqrhKtXbpoULx9BfXVimZuP2Q Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 7a42cf3a445c4752bfb41d56e3010680 Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServerDiskConfigTestJSON-649592816 Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_7a42cf3a445c4752bfb41d56e3010680"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7a42cf3a445c4752bfb41d56e3010680"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7a42cf3a445c4752bfb41d56e3010680"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/7a42cf3a445c4752bfb41d56e3010680"}]}] Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServerDiskConfigTestJSON-649592816 Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 7a42cf3a445c4752bfb41d56e3010680 Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-649592816 Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServerDiskConfigTestJSON-649592816-project Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 7bcfafa141c64d23aa49e966ce9e25ef Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServerDiskConfigTestJSON-649592816-project Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 2846c44e-6ed6-40ce-a1ab-ab37ecc21132 could not be found. Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '2846c44e-6ed6-40ce-a1ab-ab37ecc21132'} Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2846c44e-6ed6-40ce-a1ab-ab37ecc21132 could not be found. Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:14:04.944824 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:14:04.949008 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2846c44e-6ed6-40ce-a1ab-ab37ecc21132 could not be found. Jul 18 03:14:04.949008 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:14:04.949008 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:14:04.949008 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:14:04.949008 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:14:04.949008 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:14:04.949008 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:14:04.949008 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:14:04.949008 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:14:04.949008 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2846c44e-6ed6-40ce-a1ab-ab37ecc21132 could not be found. Jul 18 03:14:04.949008 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:14:04.949008 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-47cd7d01-d4af-4149-b48e-e31281794e4a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Returning 404 to user: Instance 2846c44e-6ed6-40ce-a1ab-ab37ecc21132 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:14:04.949008 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-47cd7d01-d4af-4149-b48e-e31281794e4a tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 404 len: 111 microversion: 2.1 time: 0.031725 Jul 18 03:14:04.949008 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3374/6730] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:14:04 2022] DELETE /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:14:04.956451 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9aa417d6-d526-4d1e-a4f4-f0d01cc4435e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:04.957203 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9aa417d6-d526-4d1e-a4f4-f0d01cc4435e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] [instance: 2846c44e-6ed6-40ce-a1ab-ab37ecc21132] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:04.967109 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9aa417d6-d526-4d1e-a4f4-f0d01cc4435e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:04.967570 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9aa417d6-d526-4d1e-a4f4-f0d01cc4435e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:04.968357 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9aa417d6-d526-4d1e-a4f4-f0d01cc4435e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:04.968809 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9aa417d6-d526-4d1e-a4f4-f0d01cc4435e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:04.983755 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-9aa417d6-d526-4d1e-a4f4-f0d01cc4435e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] HTTP exception thrown: Instance 2846c44e-6ed6-40ce-a1ab-ab37ecc21132 could not be found. Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9aa417d6-d526-4d1e-a4f4-f0d01cc4435e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Request method failure captured: Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 HTTP/1.1 Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1M-Xt-eHsofqAPNdnx-j8fQyy4-o6p6SIRzXPPFbnqP3vKoKqfvhV-m7wWtivNhPn4pLB5TrldMby0IxSL3bWeg3o12Z1bug6iID8MJjLaNGK27t5WgTD8iABPxdAg7uoyIhcNGO_Sl_t8a0rfpyz3NqrhKtXbpoULx9BfXVimZuP2Q Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 7a42cf3a445c4752bfb41d56e3010680 Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServerDiskConfigTestJSON-649592816 Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_7a42cf3a445c4752bfb41d56e3010680"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7a42cf3a445c4752bfb41d56e3010680"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7a42cf3a445c4752bfb41d56e3010680"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/7a42cf3a445c4752bfb41d56e3010680"}]}] Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServerDiskConfigTestJSON-649592816 Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 7a42cf3a445c4752bfb41d56e3010680 Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-649592816 Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServerDiskConfigTestJSON-649592816-project Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 7bcfafa141c64d23aa49e966ce9e25ef Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServerDiskConfigTestJSON-649592816-project Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 2846c44e-6ed6-40ce-a1ab-ab37ecc21132 could not be found. Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '2846c44e-6ed6-40ce-a1ab-ab37ecc21132'} Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2846c44e-6ed6-40ce-a1ab-ab37ecc21132 could not be found. Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2846c44e-6ed6-40ce-a1ab-ab37ecc21132 could not be found. Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:14:04.985448 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:14:04.989287 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:14:04.989287 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:14:04.989287 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:14:04.989287 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:14:04.989287 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:14:04.989287 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2846c44e-6ed6-40ce-a1ab-ab37ecc21132 could not be found. Jul 18 03:14:04.989287 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:14:04.989287 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9aa417d6-d526-4d1e-a4f4-f0d01cc4435e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] Returning 404 to user: Instance 2846c44e-6ed6-40ce-a1ab-ab37ecc21132 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:14:04.989287 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9aa417d6-d526-4d1e-a4f4-f0d01cc4435e tempest-ServerDiskConfigTestJSON-649592816 tempest-ServerDiskConfigTestJSON-649592816-project] 10.222.0.57 "GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132" status: 404 len: 111 microversion: 2.1 time: 0.035427 Jul 18 03:14:04.989287 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3357/6731] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:04 2022] GET /compute/v2.1/servers/2846c44e-6ed6-40ce-a1ab-ab37ecc21132 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:14:14.593503 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-312e94ab-2c22-42c6-9103-a2dd0b0742e8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Action: 'create', calling method: .version_select at 0x7ff4add60b80>, body: {"keypair": {"name": "tempest-keypair-2023945870", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwguGBbfLJHzaFqc27ACUSiCI3Ihh6sCGBF7mY5QD95fIFsrWydz4t4HQddZcZZBFoT26myz7k+Ugnr2wdKS0gmDL5x2lbzkbJQSeajU81raLLjzXKRITv9Jh34Tb7/RA=="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:14:14.612998 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-312e94ab-2c22-42c6-9103-a2dd0b0742e8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Getting quotas for project 735af4c358a64b9cbc4a61a33985b9b1. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:14:14.620536 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-312e94ab-2c22-42c6-9103-a2dd0b0742e8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Getting quotas for user 16f0c35138a3430f97850934128310d1 and project 735af4c358a64b9cbc4a61a33985b9b1. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:14:14.658509 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-312e94ab-2c22-42c6-9103-a2dd0b0742e8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.251863 Jul 18 03:14:14.659129 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3375/6732] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 03:14:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:14:16.561931 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5d52a9bb-5969-4c6a-8866-73d75aa46ce9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1655530810", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8e69ecad-b2b9-49c6-8462-8ffe28d14bf7"}], "security_groups": [{"name": "tempest-securitygroup--1685166239"}], "key_name": "tempest-keypair-2023945870", "user_data": "}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:14:16.571773 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:14:16.572453 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:14:16.704116 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-5d52a9bb-5969-4c6a-8866-73d75aa46ce9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] validate_networks() for [('8e69ecad-b2b9-49c6-8462-8ffe28d14bf7', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:14:17.180778 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-5d52a9bb-5969-4c6a-8866-73d75aa46ce9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:14:17.181283 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-5d52a9bb-5969-4c6a-8866-73d75aa46ce9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:14:17.182054 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-5d52a9bb-5969-4c6a-8866-73d75aa46ce9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:14:17.182582 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-5d52a9bb-5969-4c6a-8866-73d75aa46ce9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:14:17.183206 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-5d52a9bb-5969-4c6a-8866-73d75aa46ce9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:14:17.196368 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5d52a9bb-5969-4c6a-8866-73d75aa46ce9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:17.196875 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5d52a9bb-5969-4c6a-8866-73d75aa46ce9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:17.197771 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5d52a9bb-5969-4c6a-8866-73d75aa46ce9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:17.198270 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5d52a9bb-5969-4c6a-8866-73d75aa46ce9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:17.221410 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-5d52a9bb-5969-4c6a-8866-73d75aa46ce9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Getting quotas for project 735af4c358a64b9cbc4a61a33985b9b1. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:14:17.228272 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-5d52a9bb-5969-4c6a-8866-73d75aa46ce9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Getting quotas for user 16f0c35138a3430f97850934128310d1 and project 735af4c358a64b9cbc4a61a33985b9b1. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:14:17.250229 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5d52a9bb-5969-4c6a-8866-73d75aa46ce9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:14:17.254763 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5d52a9bb-5969-4c6a-8866-73d75aa46ce9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:14:17.343661 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5d52a9bb-5969-4c6a-8866-73d75aa46ce9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.789858 Jul 18 03:14:17.345850 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3358/6733] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:14:16 2022] POST /compute/v2.1/servers => generated 409 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:14:17.358667 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:14:17.370992 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d5746e19-2ef4-4052-9fab-2d17be55d102 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:17.371548 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d5746e19-2ef4-4052-9fab-2d17be55d102 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:17.469439 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d5746e19-2ef4-4052-9fab-2d17be55d102 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:17.477663 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d5746e19-2ef4-4052-9fab-2d17be55d102 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 200 len: 1239 microversion: 2.1 time: 0.121427 Jul 18 03:14:17.478514 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3376/6734] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:17 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 1239 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:18.503856 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b6bbac9f-5957-438c-a180-3ada507a4de8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:18.508491 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b6bbac9f-5957-438c-a180-3ada507a4de8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:18.520936 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6bbac9f-5957-438c-a180-3ada507a4de8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:18.521967 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6bbac9f-5957-438c-a180-3ada507a4de8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:18.523364 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6bbac9f-5957-438c-a180-3ada507a4de8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:18.523996 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b6bbac9f-5957-438c-a180-3ada507a4de8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:18.626939 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b6bbac9f-5957-438c-a180-3ada507a4de8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:18.641972 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b6bbac9f-5957-438c-a180-3ada507a4de8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 200 len: 1291 microversion: 2.1 time: 0.148855 Jul 18 03:14:18.643054 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3359/6735] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:18 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 1291 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:19.665938 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8e1e8c58-441f-41d1-a192-db997511000e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:19.667141 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8e1e8c58-441f-41d1-a192-db997511000e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:19.675194 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8e1e8c58-441f-41d1-a192-db997511000e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:19.675906 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8e1e8c58-441f-41d1-a192-db997511000e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:19.676970 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8e1e8c58-441f-41d1-a192-db997511000e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:19.677528 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8e1e8c58-441f-41d1-a192-db997511000e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:19.790591 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8e1e8c58-441f-41d1-a192-db997511000e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:19.807571 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8e1e8c58-441f-41d1-a192-db997511000e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 200 len: 1297 microversion: 2.1 time: 0.146155 Jul 18 03:14:19.809059 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3377/6736] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:19 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 1297 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:14:20.827190 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-194bea40-40f0-4682-a723-3db40078803f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:20.828667 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-194bea40-40f0-4682-a723-3db40078803f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:20.844601 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-194bea40-40f0-4682-a723-3db40078803f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:20.845453 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-194bea40-40f0-4682-a723-3db40078803f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:20.847225 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-194bea40-40f0-4682-a723-3db40078803f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:20.848100 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-194bea40-40f0-4682-a723-3db40078803f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:21.149232 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-194bea40-40f0-4682-a723-3db40078803f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:21.157673 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-194bea40-40f0-4682-a723-3db40078803f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 200 len: 1365 microversion: 2.1 time: 0.335190 Jul 18 03:14:21.167726 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3360/6737] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:20 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 1365 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:21.394964 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-c7899c16-d8d2-47fe-a289-56a76bddf2b5 req-5b622ec2-75c8-4c74-b79c-21bff99da8a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4503a84-9a3f-492e-b70b-843c0479fca6", "tag": "5b3d1537-7129-4bd1-8a5f-a7d33e645acd"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:14:21.417694 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-c7899c16-d8d2-47fe-a289-56a76bddf2b5 req-5b622ec2-75c8-4c74-b79c-21bff99da8a8 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:21.419074 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-c7899c16-d8d2-47fe-a289-56a76bddf2b5 req-5b622ec2-75c8-4c74-b79c-21bff99da8a8 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:21.437059 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-c7899c16-d8d2-47fe-a289-56a76bddf2b5 req-5b622ec2-75c8-4c74-b79c-21bff99da8a8 service nova] Creating event network-changed:5b3d1537-7129-4bd1-8a5f-a7d33e645acd for instance d4503a84-9a3f-492e-b70b-843c0479fca6 on n-h2-465891-3 Jul 18 03:14:21.443223 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-c7899c16-d8d2-47fe-a289-56a76bddf2b5 req-5b622ec2-75c8-4c74-b79c-21bff99da8a8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056772 Jul 18 03:14:21.444253 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3378/6738] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:14:22.175772 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-68bba2f5-a8ee-4266-ad48-07604cc53aba tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:22.176392 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-68bba2f5-a8ee-4266-ad48-07604cc53aba tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:22.184074 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-68bba2f5-a8ee-4266-ad48-07604cc53aba tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:22.184525 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-68bba2f5-a8ee-4266-ad48-07604cc53aba tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:22.185315 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-68bba2f5-a8ee-4266-ad48-07604cc53aba tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:22.185790 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-68bba2f5-a8ee-4266-ad48-07604cc53aba tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:22.338272 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-68bba2f5-a8ee-4266-ad48-07604cc53aba tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:22.346180 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-68bba2f5-a8ee-4266-ad48-07604cc53aba tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 200 len: 1365 microversion: 2.1 time: 0.174398 Jul 18 03:14:22.346778 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3361/6739] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:22 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:23.366962 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-01c16d62-cacb-4281-99d1-a7008a03592f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:23.368159 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-01c16d62-cacb-4281-99d1-a7008a03592f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:23.375067 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-01c16d62-cacb-4281-99d1-a7008a03592f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:23.375855 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-01c16d62-cacb-4281-99d1-a7008a03592f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:23.376785 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-01c16d62-cacb-4281-99d1-a7008a03592f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:23.377352 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-01c16d62-cacb-4281-99d1-a7008a03592f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:23.552414 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-01c16d62-cacb-4281-99d1-a7008a03592f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:23.561284 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-01c16d62-cacb-4281-99d1-a7008a03592f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 200 len: 1365 microversion: 2.1 time: 0.200168 Jul 18 03:14:23.561906 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3379/6740] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:23 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 1365 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:24.581615 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bddd9ec3-9b0d-4d7b-9945-42fc3a3f07af tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:24.582335 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bddd9ec3-9b0d-4d7b-9945-42fc3a3f07af tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:24.589415 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bddd9ec3-9b0d-4d7b-9945-42fc3a3f07af tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:24.589893 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bddd9ec3-9b0d-4d7b-9945-42fc3a3f07af tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:24.590682 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bddd9ec3-9b0d-4d7b-9945-42fc3a3f07af tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:24.591118 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bddd9ec3-9b0d-4d7b-9945-42fc3a3f07af tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:24.754369 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bddd9ec3-9b0d-4d7b-9945-42fc3a3f07af tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:24.762700 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bddd9ec3-9b0d-4d7b-9945-42fc3a3f07af tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 200 len: 1365 microversion: 2.1 time: 0.185152 Jul 18 03:14:24.763455 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3362/6741] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:24 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 1365 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:25.402666 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-cf0cb64b-057f-4408-b536-0eed61ee3fb4 req-4ef27641-64b1-4f7c-8abe-f041add07b2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4503a84-9a3f-492e-b70b-843c0479fca6", "name": "network-vif-plugged", "status": "completed", "tag": "5b3d1537-7129-4bd1-8a5f-a7d33e645acd"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:14:25.415102 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-cf0cb64b-057f-4408-b536-0eed61ee3fb4 req-4ef27641-64b1-4f7c-8abe-f041add07b2d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:25.415994 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-cf0cb64b-057f-4408-b536-0eed61ee3fb4 req-4ef27641-64b1-4f7c-8abe-f041add07b2d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:25.428734 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-cf0cb64b-057f-4408-b536-0eed61ee3fb4 req-4ef27641-64b1-4f7c-8abe-f041add07b2d service nova] Creating event network-vif-plugged:5b3d1537-7129-4bd1-8a5f-a7d33e645acd for instance d4503a84-9a3f-492e-b70b-843c0479fca6 on n-h2-465891-3 Jul 18 03:14:25.435609 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-cf0cb64b-057f-4408-b536-0eed61ee3fb4 req-4ef27641-64b1-4f7c-8abe-f041add07b2d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037237 Jul 18 03:14:25.437006 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3380/6742] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:14:25.784998 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8a8fe8f6-ab48-4d88-85d1-d63d5773ae77 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:25.785809 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8a8fe8f6-ab48-4d88-85d1-d63d5773ae77 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:25.794794 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a8fe8f6-ab48-4d88-85d1-d63d5773ae77 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:25.795254 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a8fe8f6-ab48-4d88-85d1-d63d5773ae77 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:25.796064 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a8fe8f6-ab48-4d88-85d1-d63d5773ae77 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:25.796510 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a8fe8f6-ab48-4d88-85d1-d63d5773ae77 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:25.954652 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8a8fe8f6-ab48-4d88-85d1-d63d5773ae77 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:25.964456 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8a8fe8f6-ab48-4d88-85d1-d63d5773ae77 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 200 len: 1365 microversion: 2.1 time: 0.183494 Jul 18 03:14:25.965088 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3363/6743] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:25 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:26.982571 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5ae5baf9-cd9e-4956-b24d-0581ffa27550 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:26.983292 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5ae5baf9-cd9e-4956-b24d-0581ffa27550 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:26.986079 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:14:26.992649 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5ae5baf9-cd9e-4956-b24d-0581ffa27550 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:26.993237 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5ae5baf9-cd9e-4956-b24d-0581ffa27550 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:26.994207 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5ae5baf9-cd9e-4956-b24d-0581ffa27550 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:26.994875 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5ae5baf9-cd9e-4956-b24d-0581ffa27550 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:27.169645 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5ae5baf9-cd9e-4956-b24d-0581ffa27550 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:27.177934 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5ae5baf9-cd9e-4956-b24d-0581ffa27550 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 200 len: 1552 microversion: 2.1 time: 0.199426 Jul 18 03:14:27.178542 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3381/6744] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:26 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 1552 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:27.198264 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-724934d9-18b1-43a4-9feb-7e976899bcb4 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:27.199169 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-724934d9-18b1-43a4-9feb-7e976899bcb4 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:27.206304 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-724934d9-18b1-43a4-9feb-7e976899bcb4 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:27.206752 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-724934d9-18b1-43a4-9feb-7e976899bcb4 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:27.208304 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-724934d9-18b1-43a4-9feb-7e976899bcb4 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:27.208749 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-724934d9-18b1-43a4-9feb-7e976899bcb4 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:27.209239 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:14:27.243994 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:14:27.312180 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-724934d9-18b1-43a4-9feb-7e976899bcb4 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.118978 Jul 18 03:14:27.312794 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3364/6745] 10.222.0.57 () {58 vars in 1274 bytes} [Mon Jul 18 03:14:27 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:14:28.640991 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-8707f884-720d-4343-b348-4287b998ef83 req-47aab7b6-cd78-4517-bcd5-75dd78da6de5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4503a84-9a3f-492e-b70b-843c0479fca6", "tag": "5b3d1537-7129-4bd1-8a5f-a7d33e645acd"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:14:28.644408 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:14:28.652585 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-8707f884-720d-4343-b348-4287b998ef83 req-47aab7b6-cd78-4517-bcd5-75dd78da6de5 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:28.653040 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-8707f884-720d-4343-b348-4287b998ef83 req-47aab7b6-cd78-4517-bcd5-75dd78da6de5 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:28.665184 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-8707f884-720d-4343-b348-4287b998ef83 req-47aab7b6-cd78-4517-bcd5-75dd78da6de5 service nova] Creating event network-changed:5b3d1537-7129-4bd1-8a5f-a7d33e645acd for instance d4503a84-9a3f-492e-b70b-843c0479fca6 on n-h2-465891-3 Jul 18 03:14:28.670384 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-8707f884-720d-4343-b348-4287b998ef83 req-47aab7b6-cd78-4517-bcd5-75dd78da6de5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032947 Jul 18 03:14:28.671193 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3382/6746] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:15:04.567475 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:15:04.568287 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=36 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:15:04.572248 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-36ea9deb-85cb-43ac-8024-b5e8fbdfd2bb tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:04.572893 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-36ea9deb-85cb-43ac-8024-b5e8fbdfd2bb tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:04.581227 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-36ea9deb-85cb-43ac-8024-b5e8fbdfd2bb tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:04.581682 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-36ea9deb-85cb-43ac-8024-b5e8fbdfd2bb tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:04.582481 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-36ea9deb-85cb-43ac-8024-b5e8fbdfd2bb tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:04.582927 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-36ea9deb-85cb-43ac-8024-b5e8fbdfd2bb tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:04.719467 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-36ea9deb-85cb-43ac-8024-b5e8fbdfd2bb tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:04.727159 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-36ea9deb-85cb-43ac-8024-b5e8fbdfd2bb tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 200 len: 1671 microversion: 2.1 time: 0.161483 Jul 18 03:15:04.727729 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3365/6747] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:04 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:04.744458 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-71106472-106c-48be-9b9a-cdfe1c3a5688 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:04.745579 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-71106472-106c-48be-9b9a-cdfe1c3a5688 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:04.747826 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:15:04.748567 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=24 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:15:04.754557 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-71106472-106c-48be-9b9a-cdfe1c3a5688 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:04.755017 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-71106472-106c-48be-9b9a-cdfe1c3a5688 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:04.755868 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-71106472-106c-48be-9b9a-cdfe1c3a5688 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:04.756290 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-71106472-106c-48be-9b9a-cdfe1c3a5688 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:04.902739 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-71106472-106c-48be-9b9a-cdfe1c3a5688 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:04.910951 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-71106472-106c-48be-9b9a-cdfe1c3a5688 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 200 len: 1671 microversion: 2.1 time: 0.170987 Jul 18 03:15:04.911589 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3383/6748] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:04 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 1671 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:04.929507 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-941c5aca-e996-4f50-ac60-0eaaeedbf30f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:04.930066 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-941c5aca-e996-4f50-ac60-0eaaeedbf30f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:04.936543 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-941c5aca-e996-4f50-ac60-0eaaeedbf30f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:04.936991 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-941c5aca-e996-4f50-ac60-0eaaeedbf30f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:04.937795 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-941c5aca-e996-4f50-ac60-0eaaeedbf30f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:04.938234 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-941c5aca-e996-4f50-ac60-0eaaeedbf30f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:05.069056 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-941c5aca-e996-4f50-ac60-0eaaeedbf30f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:05.078393 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-941c5aca-e996-4f50-ac60-0eaaeedbf30f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 200 len: 1671 microversion: 2.1 time: 0.152937 Jul 18 03:15:05.078974 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3366/6749] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:04 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:05.098845 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5f1ec766-4fe4-43c9-93e3-636c19a8ec8a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:15:05.099826 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5f1ec766-4fe4-43c9-93e3-636c19a8ec8a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:05.106143 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5f1ec766-4fe4-43c9-93e3-636c19a8ec8a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:05.106629 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5f1ec766-4fe4-43c9-93e3-636c19a8ec8a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:05.107393 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5f1ec766-4fe4-43c9-93e3-636c19a8ec8a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:05.107842 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5f1ec766-4fe4-43c9-93e3-636c19a8ec8a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:05.140551 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5f1ec766-4fe4-43c9-93e3-636c19a8ec8a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:05.147716 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5f1ec766-4fe4-43c9-93e3-636c19a8ec8a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Old instance type m1.heat2, new instance type m1.heat {{(pid=119543) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 03:15:05.155336 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-5f1ec766-4fe4-43c9-93e3-636c19a8ec8a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:15:05.155770 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-5f1ec766-4fe4-43c9-93e3-636c19a8ec8a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:15:05.156252 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-5f1ec766-4fe4-43c9-93e3-636c19a8ec8a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:15:05.156673 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-5f1ec766-4fe4-43c9-93e3-636c19a8ec8a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:15:05.157097 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-5f1ec766-4fe4-43c9-93e3-636c19a8ec8a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:15:05.223031 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5f1ec766-4fe4-43c9-93e3-636c19a8ec8a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "POST /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6/action" status: 202 len: 0 microversion: 2.1 time: 0.128012 Jul 18 03:15:05.223545 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3384/6750] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:15:05 2022] POST /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:15:05.233633 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-35d3d66b-c561-46a5-8a19-6f6595441a04 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:05.234297 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-35d3d66b-c561-46a5-8a19-6f6595441a04 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:05.240902 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-35d3d66b-c561-46a5-8a19-6f6595441a04 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:05.241384 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-35d3d66b-c561-46a5-8a19-6f6595441a04 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:05.242503 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-35d3d66b-c561-46a5-8a19-6f6595441a04 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:05.242985 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-35d3d66b-c561-46a5-8a19-6f6595441a04 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:05.416243 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-35d3d66b-c561-46a5-8a19-6f6595441a04 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:05.424831 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-35d3d66b-c561-46a5-8a19-6f6595441a04 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 200 len: 1680 microversion: 2.1 time: 0.196215 Jul 18 03:15:05.425633 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3367/6751] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:05 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 1680 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:06.443363 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b00a44b8-9fb6-411e-9f4a-2d4083a21eab tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:06.443890 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b00a44b8-9fb6-411e-9f4a-2d4083a21eab tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:06.451043 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b00a44b8-9fb6-411e-9f4a-2d4083a21eab tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:06.451500 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b00a44b8-9fb6-411e-9f4a-2d4083a21eab tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:06.452274 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b00a44b8-9fb6-411e-9f4a-2d4083a21eab tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:06.452721 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b00a44b8-9fb6-411e-9f4a-2d4083a21eab tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:06.590311 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b00a44b8-9fb6-411e-9f4a-2d4083a21eab tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:06.598240 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b00a44b8-9fb6-411e-9f4a-2d4083a21eab tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 200 len: 1680 microversion: 2.1 time: 0.159854 Jul 18 03:15:06.598835 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3385/6752] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:06 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:07.618898 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a0b6dcb5-b034-473a-a017-84f415a7668f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:07.619581 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a0b6dcb5-b034-473a-a017-84f415a7668f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:07.627392 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a0b6dcb5-b034-473a-a017-84f415a7668f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:07.627989 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a0b6dcb5-b034-473a-a017-84f415a7668f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:07.628933 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a0b6dcb5-b034-473a-a017-84f415a7668f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:07.629454 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a0b6dcb5-b034-473a-a017-84f415a7668f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:07.772968 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a0b6dcb5-b034-473a-a017-84f415a7668f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:07.781385 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a0b6dcb5-b034-473a-a017-84f415a7668f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 200 len: 1685 microversion: 2.1 time: 0.167389 Jul 18 03:15:07.782006 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3368/6753] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:07 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 1685 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:08.799873 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-77e79484-4821-4ae0-8558-19a6fa157b79 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:08.800409 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-77e79484-4821-4ae0-8558-19a6fa157b79 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:08.807600 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77e79484-4821-4ae0-8558-19a6fa157b79 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:08.808085 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77e79484-4821-4ae0-8558-19a6fa157b79 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:08.808889 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77e79484-4821-4ae0-8558-19a6fa157b79 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:08.809489 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-77e79484-4821-4ae0-8558-19a6fa157b79 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:08.961455 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-77e79484-4821-4ae0-8558-19a6fa157b79 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:08.969607 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-77e79484-4821-4ae0-8558-19a6fa157b79 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 200 len: 1685 microversion: 2.1 time: 0.173852 Jul 18 03:15:08.970250 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3386/6754] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:08 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 1685 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:09.986992 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-23ff75f6-8f1e-4087-bf70-7cbfac70f8d8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:09.987596 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-23ff75f6-8f1e-4087-bf70-7cbfac70f8d8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:09.995095 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-23ff75f6-8f1e-4087-bf70-7cbfac70f8d8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:09.995539 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-23ff75f6-8f1e-4087-bf70-7cbfac70f8d8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:09.996297 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-23ff75f6-8f1e-4087-bf70-7cbfac70f8d8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:09.996728 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-23ff75f6-8f1e-4087-bf70-7cbfac70f8d8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:10.143549 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-23ff75f6-8f1e-4087-bf70-7cbfac70f8d8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:10.151265 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-23ff75f6-8f1e-4087-bf70-7cbfac70f8d8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 200 len: 1685 microversion: 2.1 time: 0.168272 Jul 18 03:15:10.151895 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3369/6755] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:09 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 1685 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:11.168316 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-82fd4bf5-8597-4b2f-820e-09e34201a1ab tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:11.169045 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-82fd4bf5-8597-4b2f-820e-09e34201a1ab tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:11.177117 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-82fd4bf5-8597-4b2f-820e-09e34201a1ab tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:11.177577 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-82fd4bf5-8597-4b2f-820e-09e34201a1ab tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:11.178391 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-82fd4bf5-8597-4b2f-820e-09e34201a1ab tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:11.178845 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-82fd4bf5-8597-4b2f-820e-09e34201a1ab tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:11.316277 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-82fd4bf5-8597-4b2f-820e-09e34201a1ab tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:11.324567 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-82fd4bf5-8597-4b2f-820e-09e34201a1ab tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 200 len: 1685 microversion: 2.1 time: 0.160175 Jul 18 03:15:11.325157 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3387/6756] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:11 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:12.342431 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c92ffdf1-7dc0-41c0-832b-4a0eaf61d962 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:12.343108 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c92ffdf1-7dc0-41c0-832b-4a0eaf61d962 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:12.351011 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c92ffdf1-7dc0-41c0-832b-4a0eaf61d962 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:12.351467 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c92ffdf1-7dc0-41c0-832b-4a0eaf61d962 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:12.352240 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c92ffdf1-7dc0-41c0-832b-4a0eaf61d962 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:12.352680 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c92ffdf1-7dc0-41c0-832b-4a0eaf61d962 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:12.487207 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c92ffdf1-7dc0-41c0-832b-4a0eaf61d962 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:12.495400 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c92ffdf1-7dc0-41c0-832b-4a0eaf61d962 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 200 len: 1685 microversion: 2.1 time: 0.157232 Jul 18 03:15:12.495974 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3370/6757] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:12 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 1685 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:13.514171 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4d3a42f8-20ac-4202-ab1f-72da2988918f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:13.514729 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4d3a42f8-20ac-4202-ab1f-72da2988918f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:13.522765 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4d3a42f8-20ac-4202-ab1f-72da2988918f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:13.523226 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4d3a42f8-20ac-4202-ab1f-72da2988918f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:13.524009 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4d3a42f8-20ac-4202-ab1f-72da2988918f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:13.524505 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4d3a42f8-20ac-4202-ab1f-72da2988918f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:13.668921 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4d3a42f8-20ac-4202-ab1f-72da2988918f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:13.677032 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4d3a42f8-20ac-4202-ab1f-72da2988918f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 200 len: 1685 microversion: 2.1 time: 0.166927 Jul 18 03:15:13.677613 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3388/6758] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:13 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 1685 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:14.695802 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b60358b2-6c18-4b1c-aeda-08c8adc19bd8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:14.696437 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b60358b2-6c18-4b1c-aeda-08c8adc19bd8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:14.704075 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b60358b2-6c18-4b1c-aeda-08c8adc19bd8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:14.704555 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b60358b2-6c18-4b1c-aeda-08c8adc19bd8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:14.705352 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b60358b2-6c18-4b1c-aeda-08c8adc19bd8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:14.705837 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b60358b2-6c18-4b1c-aeda-08c8adc19bd8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:14.857010 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b60358b2-6c18-4b1c-aeda-08c8adc19bd8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:14.867240 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b60358b2-6c18-4b1c-aeda-08c8adc19bd8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 200 len: 1685 microversion: 2.1 time: 0.176099 Jul 18 03:15:14.867859 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3371/6759] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:14 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 1685 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:15.887736 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-35d40a44-a315-4c18-8db4-d48e30cd652e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:15.888370 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-35d40a44-a315-4c18-8db4-d48e30cd652e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:15.896230 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-35d40a44-a315-4c18-8db4-d48e30cd652e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:15.896775 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-35d40a44-a315-4c18-8db4-d48e30cd652e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:15.897648 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-35d40a44-a315-4c18-8db4-d48e30cd652e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:15.898125 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-35d40a44-a315-4c18-8db4-d48e30cd652e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:16.032931 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-35d40a44-a315-4c18-8db4-d48e30cd652e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:16.041199 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-35d40a44-a315-4c18-8db4-d48e30cd652e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 200 len: 1685 microversion: 2.1 time: 0.158031 Jul 18 03:15:16.041805 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3389/6760] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:15 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:17.058657 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-857a1ef6-6268-4ffd-9ead-c50ca6bef55b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:17.059270 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-857a1ef6-6268-4ffd-9ead-c50ca6bef55b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:17.066376 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-857a1ef6-6268-4ffd-9ead-c50ca6bef55b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:17.066826 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-857a1ef6-6268-4ffd-9ead-c50ca6bef55b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:17.067627 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-857a1ef6-6268-4ffd-9ead-c50ca6bef55b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:17.068066 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-857a1ef6-6268-4ffd-9ead-c50ca6bef55b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:17.201783 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-857a1ef6-6268-4ffd-9ead-c50ca6bef55b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:17.210157 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-857a1ef6-6268-4ffd-9ead-c50ca6bef55b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 200 len: 1685 microversion: 2.1 time: 0.155392 Jul 18 03:15:17.210732 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3372/6761] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:17 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:15:18.226796 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b9ce0f61-3e33-470d-b8ff-8d3509d8ff28 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:18.227420 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b9ce0f61-3e33-470d-b8ff-8d3509d8ff28 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:18.234666 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b9ce0f61-3e33-470d-b8ff-8d3509d8ff28 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:18.235139 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b9ce0f61-3e33-470d-b8ff-8d3509d8ff28 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:18.235933 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b9ce0f61-3e33-470d-b8ff-8d3509d8ff28 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:18.236393 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b9ce0f61-3e33-470d-b8ff-8d3509d8ff28 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:18.371648 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b9ce0f61-3e33-470d-b8ff-8d3509d8ff28 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:18.379195 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b9ce0f61-3e33-470d-b8ff-8d3509d8ff28 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 200 len: 1685 microversion: 2.1 time: 0.156369 Jul 18 03:15:18.380420 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3390/6762] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:18 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 1685 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:19.397943 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a3173ea7-8993-443d-b3e5-942e8c90faf0 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:19.398561 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a3173ea7-8993-443d-b3e5-942e8c90faf0 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:19.406982 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a3173ea7-8993-443d-b3e5-942e8c90faf0 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:19.407433 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a3173ea7-8993-443d-b3e5-942e8c90faf0 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:19.408394 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a3173ea7-8993-443d-b3e5-942e8c90faf0 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:19.408826 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a3173ea7-8993-443d-b3e5-942e8c90faf0 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:19.551842 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a3173ea7-8993-443d-b3e5-942e8c90faf0 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:19.560974 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a3173ea7-8993-443d-b3e5-942e8c90faf0 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 200 len: 1685 microversion: 2.1 time: 0.167438 Jul 18 03:15:19.561988 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3373/6763] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:19 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 1685 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:15:20.579638 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-75466841-e177-40e0-9309-ba22caf49472 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:20.580256 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-75466841-e177-40e0-9309-ba22caf49472 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:20.587563 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-75466841-e177-40e0-9309-ba22caf49472 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:20.588023 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-75466841-e177-40e0-9309-ba22caf49472 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:20.588808 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-75466841-e177-40e0-9309-ba22caf49472 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:20.589252 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-75466841-e177-40e0-9309-ba22caf49472 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:20.719562 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-75466841-e177-40e0-9309-ba22caf49472 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:20.728246 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-75466841-e177-40e0-9309-ba22caf49472 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 200 len: 1685 microversion: 2.1 time: 0.152557 Jul 18 03:15:20.728835 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3391/6764] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:20 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:21.748027 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-abbf6856-cd09-427d-913d-b4eff3674d59 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:21.749185 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-abbf6856-cd09-427d-913d-b4eff3674d59 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:21.759804 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-abbf6856-cd09-427d-913d-b4eff3674d59 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:21.760563 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-abbf6856-cd09-427d-913d-b4eff3674d59 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:21.761999 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-abbf6856-cd09-427d-913d-b4eff3674d59 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:21.762642 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-abbf6856-cd09-427d-913d-b4eff3674d59 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:21.918586 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-abbf6856-cd09-427d-913d-b4eff3674d59 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:21.928810 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-abbf6856-cd09-427d-913d-b4eff3674d59 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 200 len: 1685 microversion: 2.1 time: 0.184834 Jul 18 03:15:21.929449 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3374/6765] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:21 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 1685 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:15:22.946794 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8c1e4198-043b-4f7e-b83a-ebf4bca69c84 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:22.947417 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8c1e4198-043b-4f7e-b83a-ebf4bca69c84 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:22.954703 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8c1e4198-043b-4f7e-b83a-ebf4bca69c84 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:22.955167 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8c1e4198-043b-4f7e-b83a-ebf4bca69c84 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:22.955952 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8c1e4198-043b-4f7e-b83a-ebf4bca69c84 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:22.956406 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8c1e4198-043b-4f7e-b83a-ebf4bca69c84 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:23.099926 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8c1e4198-043b-4f7e-b83a-ebf4bca69c84 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:23.108138 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8c1e4198-043b-4f7e-b83a-ebf4bca69c84 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 200 len: 1685 microversion: 2.1 time: 0.165760 Jul 18 03:15:23.108744 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3392/6766] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:22 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 1685 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:24.126813 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2a9bcff9-8c5f-4506-80c5-90414685f3d3 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:24.127555 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2a9bcff9-8c5f-4506-80c5-90414685f3d3 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:24.135459 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2a9bcff9-8c5f-4506-80c5-90414685f3d3 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:24.135977 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2a9bcff9-8c5f-4506-80c5-90414685f3d3 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:24.136703 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2a9bcff9-8c5f-4506-80c5-90414685f3d3 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:24.137146 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2a9bcff9-8c5f-4506-80c5-90414685f3d3 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:24.339572 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2a9bcff9-8c5f-4506-80c5-90414685f3d3 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:24.347573 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2a9bcff9-8c5f-4506-80c5-90414685f3d3 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 200 len: 1685 microversion: 2.1 time: 0.224812 Jul 18 03:15:24.348176 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3375/6767] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:24 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 1685 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:24.912969 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-e1b84c43-fcb1-4df3-92f0-e097ee443147 req-a4aaf8fc-d616-405b-98f1-2f6b34d3f6a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4503a84-9a3f-492e-b70b-843c0479fca6", "name": "network-vif-unplugged", "status": "completed", "tag": "5b3d1537-7129-4bd1-8a5f-a7d33e645acd"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:15:24.922939 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-e1b84c43-fcb1-4df3-92f0-e097ee443147 req-a4aaf8fc-d616-405b-98f1-2f6b34d3f6a3 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:24.923402 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-e1b84c43-fcb1-4df3-92f0-e097ee443147 req-a4aaf8fc-d616-405b-98f1-2f6b34d3f6a3 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:24.936322 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-e1b84c43-fcb1-4df3-92f0-e097ee443147 req-a4aaf8fc-d616-405b-98f1-2f6b34d3f6a3 service nova] Creating event network-vif-unplugged:5b3d1537-7129-4bd1-8a5f-a7d33e645acd for instance d4503a84-9a3f-492e-b70b-843c0479fca6 on n-h1-465891-3 Jul 18 03:15:24.942194 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [req-e1b84c43-fcb1-4df3-92f0-e097ee443147 req-a4aaf8fc-d616-405b-98f1-2f6b34d3f6a3 service nova] Instance d4503a84-9a3f-492e-b70b-843c0479fca6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3', 'n-h2-465891-3'} {{(pid=119543) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:15:24.954433 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-e1b84c43-fcb1-4df3-92f0-e097ee443147 req-a4aaf8fc-d616-405b-98f1-2f6b34d3f6a3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045326 Jul 18 03:15:24.955055 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3393/6768] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:15:25.367351 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fba9bd87-2501-406f-bc09-2503d9e6ffa2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:25.368117 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fba9bd87-2501-406f-bc09-2503d9e6ffa2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:25.377288 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fba9bd87-2501-406f-bc09-2503d9e6ffa2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:25.377789 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fba9bd87-2501-406f-bc09-2503d9e6ffa2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:25.378640 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fba9bd87-2501-406f-bc09-2503d9e6ffa2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:25.379090 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fba9bd87-2501-406f-bc09-2503d9e6ffa2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:25.682706 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fba9bd87-2501-406f-bc09-2503d9e6ffa2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:25.692011 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fba9bd87-2501-406f-bc09-2503d9e6ffa2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 200 len: 1684 microversion: 2.1 time: 0.329627 Jul 18 03:15:25.692794 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3376/6769] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:25 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 1684 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:26.714149 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d6b95880-4828-46a7-9039-b2894c890ae9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:26.715329 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d6b95880-4828-46a7-9039-b2894c890ae9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:26.724817 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d6b95880-4828-46a7-9039-b2894c890ae9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:26.725478 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d6b95880-4828-46a7-9039-b2894c890ae9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:26.726467 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d6b95880-4828-46a7-9039-b2894c890ae9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:26.726973 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d6b95880-4828-46a7-9039-b2894c890ae9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:26.875016 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d6b95880-4828-46a7-9039-b2894c890ae9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:26.883448 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d6b95880-4828-46a7-9039-b2894c890ae9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 200 len: 1682 microversion: 2.1 time: 0.176317 Jul 18 03:15:26.884098 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3394/6770] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:26 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:26.977117 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-eebd8581-5147-43db-9c22-9c4b7110b3bc req-6a891822-3f1c-421b-99b0-3d72a496f800 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4503a84-9a3f-492e-b70b-843c0479fca6", "tag": "5b3d1537-7129-4bd1-8a5f-a7d33e645acd"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:15:26.986509 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-eebd8581-5147-43db-9c22-9c4b7110b3bc req-6a891822-3f1c-421b-99b0-3d72a496f800 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:26.986953 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-eebd8581-5147-43db-9c22-9c4b7110b3bc req-6a891822-3f1c-421b-99b0-3d72a496f800 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:27.004448 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-eebd8581-5147-43db-9c22-9c4b7110b3bc req-6a891822-3f1c-421b-99b0-3d72a496f800 service nova] Creating event network-changed:5b3d1537-7129-4bd1-8a5f-a7d33e645acd for instance d4503a84-9a3f-492e-b70b-843c0479fca6 on n-h1-465891-3 Jul 18 03:15:27.011665 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [req-eebd8581-5147-43db-9c22-9c4b7110b3bc req-6a891822-3f1c-421b-99b0-3d72a496f800 service nova] Instance d4503a84-9a3f-492e-b70b-843c0479fca6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3', 'n-h2-465891-3'} {{(pid=119544) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:15:27.023505 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-eebd8581-5147-43db-9c22-9c4b7110b3bc req-6a891822-3f1c-421b-99b0-3d72a496f800 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051090 Jul 18 03:15:27.024123 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3377/6771] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:15:27.904771 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-14a91efc-75ce-4dc8-9a3d-7b3f235feac7 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:27.905396 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-14a91efc-75ce-4dc8-9a3d-7b3f235feac7 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:27.913246 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14a91efc-75ce-4dc8-9a3d-7b3f235feac7 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:27.913722 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14a91efc-75ce-4dc8-9a3d-7b3f235feac7 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:27.914517 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14a91efc-75ce-4dc8-9a3d-7b3f235feac7 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:27.914961 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14a91efc-75ce-4dc8-9a3d-7b3f235feac7 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:28.053668 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-14a91efc-75ce-4dc8-9a3d-7b3f235feac7 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:28.061252 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-14a91efc-75ce-4dc8-9a3d-7b3f235feac7 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 200 len: 1682 microversion: 2.1 time: 0.160374 Jul 18 03:15:28.061856 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3395/6772] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:27 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:15:29.081124 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9a42f46e-2f06-44e2-a517-e5a1be2bfc7a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:29.081858 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9a42f46e-2f06-44e2-a517-e5a1be2bfc7a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:29.088959 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9a42f46e-2f06-44e2-a517-e5a1be2bfc7a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:29.089479 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9a42f46e-2f06-44e2-a517-e5a1be2bfc7a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:29.090437 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9a42f46e-2f06-44e2-a517-e5a1be2bfc7a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:29.090884 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9a42f46e-2f06-44e2-a517-e5a1be2bfc7a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:29.229567 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9a42f46e-2f06-44e2-a517-e5a1be2bfc7a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:29.237295 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9a42f46e-2f06-44e2-a517-e5a1be2bfc7a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 200 len: 1682 microversion: 2.1 time: 0.161426 Jul 18 03:15:29.237900 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3378/6773] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:29 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:30.256001 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2a9eb8d8-bc1c-4aa0-bf38-7b8ab8d75028 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:30.256670 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2a9eb8d8-bc1c-4aa0-bf38-7b8ab8d75028 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:30.264112 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2a9eb8d8-bc1c-4aa0-bf38-7b8ab8d75028 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:30.264583 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2a9eb8d8-bc1c-4aa0-bf38-7b8ab8d75028 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:30.265386 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2a9eb8d8-bc1c-4aa0-bf38-7b8ab8d75028 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:30.265882 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2a9eb8d8-bc1c-4aa0-bf38-7b8ab8d75028 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:30.417135 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2a9eb8d8-bc1c-4aa0-bf38-7b8ab8d75028 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:30.424823 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2a9eb8d8-bc1c-4aa0-bf38-7b8ab8d75028 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 200 len: 1679 microversion: 2.1 time: 0.173371 Jul 18 03:15:30.425421 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3396/6774] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:30 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:30.441587 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e535aebd-f4da-48dd-b517-8f5297887289 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:15:30.442539 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e535aebd-f4da-48dd-b517-8f5297887289 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:30.450561 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e535aebd-f4da-48dd-b517-8f5297887289 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:30.451017 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e535aebd-f4da-48dd-b517-8f5297887289 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:30.451799 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e535aebd-f4da-48dd-b517-8f5297887289 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:30.452243 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e535aebd-f4da-48dd-b517-8f5297887289 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:30.516221 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e535aebd-f4da-48dd-b517-8f5297887289 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "POST /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6/action" status: 204 len: 0 microversion: 2.1 time: 0.078321 Jul 18 03:15:30.516975 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3379/6775] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:15:30 2022] POST /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:15:30.525341 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0902c17f-97bb-40c7-ae56-bf65f5a5e69e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:30.526021 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0902c17f-97bb-40c7-ae56-bf65f5a5e69e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:30.533331 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0902c17f-97bb-40c7-ae56-bf65f5a5e69e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:30.534183 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0902c17f-97bb-40c7-ae56-bf65f5a5e69e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:30.535053 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0902c17f-97bb-40c7-ae56-bf65f5a5e69e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:30.535525 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0902c17f-97bb-40c7-ae56-bf65f5a5e69e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:30.764473 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0902c17f-97bb-40c7-ae56-bf65f5a5e69e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:30.772478 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0902c17f-97bb-40c7-ae56-bf65f5a5e69e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 200 len: 1679 microversion: 2.1 time: 0.250944 Jul 18 03:15:30.773080 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3397/6776] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:30 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 1679 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:31.791580 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0e6edf43-22ad-4d0c-b143-5e3bdeabc2ce tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:31.792276 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0e6edf43-22ad-4d0c-b143-5e3bdeabc2ce tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:31.798697 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0e6edf43-22ad-4d0c-b143-5e3bdeabc2ce tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:31.799148 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0e6edf43-22ad-4d0c-b143-5e3bdeabc2ce tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:31.799917 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0e6edf43-22ad-4d0c-b143-5e3bdeabc2ce tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:31.800354 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0e6edf43-22ad-4d0c-b143-5e3bdeabc2ce tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:31.968175 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0e6edf43-22ad-4d0c-b143-5e3bdeabc2ce tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:31.971445 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:15:31.986437 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0e6edf43-22ad-4d0c-b143-5e3bdeabc2ce tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 200 len: 1671 microversion: 2.1 time: 0.199845 Jul 18 03:15:31.997723 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3380/6777] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:31 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 1671 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:32.005974 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c43f655f-7816-451b-bdea-bffdda6340f3 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:32.006719 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c43f655f-7816-451b-bdea-bffdda6340f3 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:32.015050 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c43f655f-7816-451b-bdea-bffdda6340f3 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:32.015955 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c43f655f-7816-451b-bdea-bffdda6340f3 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:32.016474 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c43f655f-7816-451b-bdea-bffdda6340f3 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:32.016941 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c43f655f-7816-451b-bdea-bffdda6340f3 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:32.038952 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:15:32.166672 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-1a21c5ef-eb2e-490b-a0ee-3fbc41b73582 req-609b17d5-01f3-4566-8673-e979c1a87820 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4503a84-9a3f-492e-b70b-843c0479fca6", "name": "network-vif-plugged", "status": "completed", "tag": "5b3d1537-7129-4bd1-8a5f-a7d33e645acd"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:15:32.175465 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-1a21c5ef-eb2e-490b-a0ee-3fbc41b73582 req-609b17d5-01f3-4566-8673-e979c1a87820 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:32.175910 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-1a21c5ef-eb2e-490b-a0ee-3fbc41b73582 req-609b17d5-01f3-4566-8673-e979c1a87820 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:32.180343 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c43f655f-7816-451b-bdea-bffdda6340f3 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:32.189801 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c43f655f-7816-451b-bdea-bffdda6340f3 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 200 len: 1671 microversion: 2.1 time: 0.188106 Jul 18 03:15:32.190653 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3398/6778] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:32 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 1671 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:15:32.190787 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-1a21c5ef-eb2e-490b-a0ee-3fbc41b73582 req-609b17d5-01f3-4566-8673-e979c1a87820 service nova] Creating event network-vif-plugged:5b3d1537-7129-4bd1-8a5f-a7d33e645acd for instance d4503a84-9a3f-492e-b70b-843c0479fca6 on n-h1-465891-3 Jul 18 03:15:32.196862 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-1a21c5ef-eb2e-490b-a0ee-3fbc41b73582 req-609b17d5-01f3-4566-8673-e979c1a87820 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034053 Jul 18 03:15:32.197724 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3381/6779] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:15:32.206777 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-042e5e79-119a-449c-b5b8-f2f6b3fe444b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:32.207431 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-042e5e79-119a-449c-b5b8-f2f6b3fe444b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:32.214372 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-042e5e79-119a-449c-b5b8-f2f6b3fe444b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:32.214843 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-042e5e79-119a-449c-b5b8-f2f6b3fe444b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:32.215636 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-042e5e79-119a-449c-b5b8-f2f6b3fe444b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:32.216090 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-042e5e79-119a-449c-b5b8-f2f6b3fe444b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:32.355918 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-042e5e79-119a-449c-b5b8-f2f6b3fe444b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:32.364764 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-042e5e79-119a-449c-b5b8-f2f6b3fe444b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 200 len: 1671 microversion: 2.1 time: 0.161260 Jul 18 03:15:32.365673 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3399/6780] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:32 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:32.382523 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3a6857b4-7d2a-4dc5-bfeb-066b13a466da tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:32.383074 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3a6857b4-7d2a-4dc5-bfeb-066b13a466da tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:32.389370 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3a6857b4-7d2a-4dc5-bfeb-066b13a466da tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:32.389867 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3a6857b4-7d2a-4dc5-bfeb-066b13a466da tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:32.390630 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3a6857b4-7d2a-4dc5-bfeb-066b13a466da tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:32.391072 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3a6857b4-7d2a-4dc5-bfeb-066b13a466da tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:32.415914 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3a6857b4-7d2a-4dc5-bfeb-066b13a466da tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:15:32.495283 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3a6857b4-7d2a-4dc5-bfeb-066b13a466da tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 204 len: 0 microversion: 2.1 time: 0.117457 Jul 18 03:15:32.495888 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3382/6781] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:15:32 2022] DELETE /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:15:32.504345 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-71b2e1e2-0495-42e3-9d97-a0096a0b5787 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:32.505619 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-71b2e1e2-0495-42e3-9d97-a0096a0b5787 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:32.511987 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-71b2e1e2-0495-42e3-9d97-a0096a0b5787 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:32.512459 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-71b2e1e2-0495-42e3-9d97-a0096a0b5787 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:32.513217 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-71b2e1e2-0495-42e3-9d97-a0096a0b5787 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:32.513663 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-71b2e1e2-0495-42e3-9d97-a0096a0b5787 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:32.643728 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-71b2e1e2-0495-42e3-9d97-a0096a0b5787 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:32.651982 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-71b2e1e2-0495-42e3-9d97-a0096a0b5787 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 200 len: 1677 microversion: 2.1 time: 0.151744 Jul 18 03:15:32.652564 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3400/6782] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:32 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:33.669381 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bb2972c6-3eac-45da-8b59-1d4c16bb8b69 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:33.670433 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bb2972c6-3eac-45da-8b59-1d4c16bb8b69 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:33.678030 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb2972c6-3eac-45da-8b59-1d4c16bb8b69 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:33.678574 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb2972c6-3eac-45da-8b59-1d4c16bb8b69 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:33.679580 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb2972c6-3eac-45da-8b59-1d4c16bb8b69 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:33.680023 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb2972c6-3eac-45da-8b59-1d4c16bb8b69 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:33.824416 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bb2972c6-3eac-45da-8b59-1d4c16bb8b69 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:33.832370 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bb2972c6-3eac-45da-8b59-1d4c16bb8b69 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 200 len: 1677 microversion: 2.1 time: 0.167303 Jul 18 03:15:33.833000 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3383/6783] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:33 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:34.851222 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-61a01dd9-9fbb-4aea-9f32-8dba5353654a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:34.851958 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-61a01dd9-9fbb-4aea-9f32-8dba5353654a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:34.854994 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=41 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:15:34.861482 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-61a01dd9-9fbb-4aea-9f32-8dba5353654a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:34.861984 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-61a01dd9-9fbb-4aea-9f32-8dba5353654a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:34.863183 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-61a01dd9-9fbb-4aea-9f32-8dba5353654a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:34.864095 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-61a01dd9-9fbb-4aea-9f32-8dba5353654a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:34.940989 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-61a01dd9-9fbb-4aea-9f32-8dba5353654a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:34.949370 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-61a01dd9-9fbb-4aea-9f32-8dba5353654a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 200 len: 1609 microversion: 2.1 time: 0.103234 Jul 18 03:15:34.950006 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3401/6784] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:34 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 1609 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:35.059594 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-2bb9a4ae-f8ed-4765-ac2b-613d25e8da3e req-19bda2a0-d6c7-41a0-86c8-101d57540b1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4503a84-9a3f-492e-b70b-843c0479fca6", "name": "network-vif-deleted", "tag": "5b3d1537-7129-4bd1-8a5f-a7d33e645acd"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:15:35.068924 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:15:35.075463 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-2bb9a4ae-f8ed-4765-ac2b-613d25e8da3e req-19bda2a0-d6c7-41a0-86c8-101d57540b1b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:35.075830 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-2bb9a4ae-f8ed-4765-ac2b-613d25e8da3e req-19bda2a0-d6c7-41a0-86c8-101d57540b1b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:35.088880 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-2bb9a4ae-f8ed-4765-ac2b-613d25e8da3e req-19bda2a0-d6c7-41a0-86c8-101d57540b1b service nova] Creating event network-vif-deleted:5b3d1537-7129-4bd1-8a5f-a7d33e645acd for instance d4503a84-9a3f-492e-b70b-843c0479fca6 on n-h1-465891-3 Jul 18 03:15:35.094328 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-2bb9a4ae-f8ed-4765-ac2b-613d25e8da3e req-19bda2a0-d6c7-41a0-86c8-101d57540b1b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038516 Jul 18 03:15:35.095489 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3384/6785] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:15:35.967291 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4e3debc3-92da-4b33-ab36-d2eb7927ea39 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:35.967963 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4e3debc3-92da-4b33-ab36-d2eb7927ea39 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:35.975956 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4e3debc3-92da-4b33-ab36-d2eb7927ea39 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:35.976418 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4e3debc3-92da-4b33-ab36-d2eb7927ea39 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:35.977220 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4e3debc3-92da-4b33-ab36-d2eb7927ea39 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:35.977669 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4e3debc3-92da-4b33-ab36-d2eb7927ea39 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:35.993066 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-4e3debc3-92da-4b33-ab36-d2eb7927ea39 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] HTTP exception thrown: Instance d4503a84-9a3f-492e-b70b-843c0479fca6 could not be found. Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4e3debc3-92da-4b33-ab36-d2eb7927ea39 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Request method failure captured: Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 HTTP/1.1 Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1NAG6n_J2rNfvjGE6tf7j0WubnLjYbUZkg89AdB_m51VufhJ39XnIb0TmV_VVToQ_i_5-V0sK6RpZIQpSTqBKYIT5BrJJ7toLiPDmvP9k5QSxkcWvnshbbMUZbr7tAQNfRbL8QooouumBDZt90piJMD7xS5_3rIJ9QUoKQLsChc4eY8 Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 735af4c358a64b9cbc4a61a33985b9b1 Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServerActionsTestJSON-695654908 Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/735af4c358a64b9cbc4a61a33985b9b1"}]}] Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServerActionsTestJSON-695654908 Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 735af4c358a64b9cbc4a61a33985b9b1 Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServerActionsTestJSON-695654908 Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServerActionsTestJSON-695654908-project Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 16f0c35138a3430f97850934128310d1 Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServerActionsTestJSON-695654908-project Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance d4503a84-9a3f-492e-b70b-843c0479fca6 could not be found. Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'd4503a84-9a3f-492e-b70b-843c0479fca6'} Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4503a84-9a3f-492e-b70b-843c0479fca6 could not be found. Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4503a84-9a3f-492e-b70b-843c0479fca6 could not be found. Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:15:35.994767 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:15:35.999532 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:15:35.999532 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:15:35.999532 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:15:35.999532 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:15:35.999532 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:15:35.999532 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4503a84-9a3f-492e-b70b-843c0479fca6 could not be found. Jul 18 03:15:35.999532 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:15:35.999532 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4e3debc3-92da-4b33-ab36-d2eb7927ea39 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Returning 404 to user: Instance d4503a84-9a3f-492e-b70b-843c0479fca6 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:15:35.999532 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4e3debc3-92da-4b33-ab36-d2eb7927ea39 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 404 len: 111 microversion: 2.1 time: 0.032943 Jul 18 03:15:35.999532 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3402/6786] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:35 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:15:36.009870 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-997a0ca7-f48f-44ac-810a-1a043c6cc78e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:36.010593 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-997a0ca7-f48f-44ac-810a-1a043c6cc78e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:36.018045 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-997a0ca7-f48f-44ac-810a-1a043c6cc78e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:36.018419 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-997a0ca7-f48f-44ac-810a-1a043c6cc78e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:36.019216 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-997a0ca7-f48f-44ac-810a-1a043c6cc78e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:36.019663 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-997a0ca7-f48f-44ac-810a-1a043c6cc78e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:36.036075 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-997a0ca7-f48f-44ac-810a-1a043c6cc78e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] HTTP exception thrown: Instance d4503a84-9a3f-492e-b70b-843c0479fca6 could not be found. Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-997a0ca7-f48f-44ac-810a-1a043c6cc78e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Request method failure captured: Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 HTTP/1.1 Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1NAG6n_J2rNfvjGE6tf7j0WubnLjYbUZkg89AdB_m51VufhJ39XnIb0TmV_VVToQ_i_5-V0sK6RpZIQpSTqBKYIT5BrJJ7toLiPDmvP9k5QSxkcWvnshbbMUZbr7tAQNfRbL8QooouumBDZt90piJMD7xS5_3rIJ9QUoKQLsChc4eY8 Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 735af4c358a64b9cbc4a61a33985b9b1 Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServerActionsTestJSON-695654908 Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/735af4c358a64b9cbc4a61a33985b9b1"}]}] Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServerActionsTestJSON-695654908 Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 735af4c358a64b9cbc4a61a33985b9b1 Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServerActionsTestJSON-695654908 Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServerActionsTestJSON-695654908-project Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 16f0c35138a3430f97850934128310d1 Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServerActionsTestJSON-695654908-project Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance d4503a84-9a3f-492e-b70b-843c0479fca6 could not be found. Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'd4503a84-9a3f-492e-b70b-843c0479fca6'} Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4503a84-9a3f-492e-b70b-843c0479fca6 could not be found. Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4503a84-9a3f-492e-b70b-843c0479fca6 could not be found. Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:15:36.039122 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:15:36.042873 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:15:36.042873 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:15:36.042873 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:15:36.042873 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:15:36.042873 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:15:36.042873 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4503a84-9a3f-492e-b70b-843c0479fca6 could not be found. Jul 18 03:15:36.042873 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:15:36.042873 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-997a0ca7-f48f-44ac-810a-1a043c6cc78e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Returning 404 to user: Instance d4503a84-9a3f-492e-b70b-843c0479fca6 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:15:36.042873 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-997a0ca7-f48f-44ac-810a-1a043c6cc78e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 404 len: 111 microversion: 2.1 time: 0.035425 Jul 18 03:15:36.042873 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3385/6787] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:36 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:15:36.093118 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e7286585-758c-4b4f-b49d-13f57c6703c8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1061360527", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "8e69ecad-b2b9-49c6-8462-8ffe28d14bf7"}], "security_groups": [{"name": "tempest-securitygroup--1685166239"}], "key_name": "tempest-keypair-2023945870", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:15:36.201463 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-e7286585-758c-4b4f-b49d-13f57c6703c8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] validate_networks() for [('8e69ecad-b2b9-49c6-8462-8ffe28d14bf7', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:15:36.606686 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-e7286585-758c-4b4f-b49d-13f57c6703c8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:15:36.607119 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-e7286585-758c-4b4f-b49d-13f57c6703c8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:15:36.607606 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-e7286585-758c-4b4f-b49d-13f57c6703c8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:15:36.608017 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-e7286585-758c-4b4f-b49d-13f57c6703c8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:15:36.608436 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-e7286585-758c-4b4f-b49d-13f57c6703c8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:15:36.618882 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e7286585-758c-4b4f-b49d-13f57c6703c8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:36.619342 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e7286585-758c-4b4f-b49d-13f57c6703c8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:36.620149 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e7286585-758c-4b4f-b49d-13f57c6703c8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:36.620598 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e7286585-758c-4b4f-b49d-13f57c6703c8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:36.638198 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-e7286585-758c-4b4f-b49d-13f57c6703c8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Getting quotas for project 735af4c358a64b9cbc4a61a33985b9b1. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:15:36.643631 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-e7286585-758c-4b4f-b49d-13f57c6703c8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Getting quotas for user 16f0c35138a3430f97850934128310d1 and project 735af4c358a64b9cbc4a61a33985b9b1. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:15:36.657359 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e7286585-758c-4b4f-b49d-13f57c6703c8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:15:36.659726 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e7286585-758c-4b4f-b49d-13f57c6703c8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:15:36.708464 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e7286585-758c-4b4f-b49d-13f57c6703c8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.618662 Jul 18 03:15:36.710379 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3403/6788] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:15:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:15:36.720274 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d65a135d-b979-4325-843d-415ca29559ad tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:36.720977 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d65a135d-b979-4325-843d-415ca29559ad tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:36.778518 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d65a135d-b979-4325-843d-415ca29559ad tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:36.785880 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d65a135d-b979-4325-843d-415ca29559ad tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 200 len: 1239 microversion: 2.1 time: 0.069906 Jul 18 03:15:36.787274 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3386/6789] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:36 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 1239 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:37.805336 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5a78e45e-d40e-42d6-a676-158fc098d9eb tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:37.805995 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5a78e45e-d40e-42d6-a676-158fc098d9eb tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:37.813771 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5a78e45e-d40e-42d6-a676-158fc098d9eb tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:37.814231 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5a78e45e-d40e-42d6-a676-158fc098d9eb tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:37.815042 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5a78e45e-d40e-42d6-a676-158fc098d9eb tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:37.815490 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5a78e45e-d40e-42d6-a676-158fc098d9eb tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:37.877080 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5a78e45e-d40e-42d6-a676-158fc098d9eb tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:37.885307 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5a78e45e-d40e-42d6-a676-158fc098d9eb tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 200 len: 1291 microversion: 2.1 time: 0.085239 Jul 18 03:15:37.885930 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3404/6790] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:37 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 1291 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:38.903292 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9c4ff325-0bf6-4a00-b5aa-617ba6d90a05 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:38.904090 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9c4ff325-0bf6-4a00-b5aa-617ba6d90a05 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:38.912840 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9c4ff325-0bf6-4a00-b5aa-617ba6d90a05 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:38.913298 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9c4ff325-0bf6-4a00-b5aa-617ba6d90a05 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:38.914138 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9c4ff325-0bf6-4a00-b5aa-617ba6d90a05 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:38.914959 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9c4ff325-0bf6-4a00-b5aa-617ba6d90a05 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:39.408435 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9c4ff325-0bf6-4a00-b5aa-617ba6d90a05 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:39.417021 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9c4ff325-0bf6-4a00-b5aa-617ba6d90a05 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 200 len: 1365 microversion: 2.1 time: 0.517646 Jul 18 03:15:39.417733 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3387/6791] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:38 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 1365 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:40.037295 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-9684580f-3db8-4138-9dcc-a21684b243da req-fe8e9ebb-40c7-4195-bc11-4386972dd749 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bc080aa-5510-4c63-8558-26ccc6e5024a", "tag": "8bb98e39-4381-4331-ae25-1b41a345d1b2"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:15:40.050443 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-9684580f-3db8-4138-9dcc-a21684b243da req-fe8e9ebb-40c7-4195-bc11-4386972dd749 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:40.050863 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-9684580f-3db8-4138-9dcc-a21684b243da req-fe8e9ebb-40c7-4195-bc11-4386972dd749 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:40.088441 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-9684580f-3db8-4138-9dcc-a21684b243da req-fe8e9ebb-40c7-4195-bc11-4386972dd749 service nova] Creating event network-changed:8bb98e39-4381-4331-ae25-1b41a345d1b2 for instance 0bc080aa-5510-4c63-8558-26ccc6e5024a on n-h2-465891-3 Jul 18 03:15:40.096092 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-9684580f-3db8-4138-9dcc-a21684b243da req-fe8e9ebb-40c7-4195-bc11-4386972dd749 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063314 Jul 18 03:15:40.096752 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3405/6792] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:15:40.435093 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-012be613-2471-4d9d-ae22-1a05ea3a40db tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:40.435716 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-012be613-2471-4d9d-ae22-1a05ea3a40db tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:40.443880 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-012be613-2471-4d9d-ae22-1a05ea3a40db tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:40.444345 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-012be613-2471-4d9d-ae22-1a05ea3a40db tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:40.445140 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-012be613-2471-4d9d-ae22-1a05ea3a40db tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:40.445589 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-012be613-2471-4d9d-ae22-1a05ea3a40db tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:40.611322 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-012be613-2471-4d9d-ae22-1a05ea3a40db tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:40.620373 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-012be613-2471-4d9d-ae22-1a05ea3a40db tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 200 len: 1365 microversion: 2.1 time: 0.189199 Jul 18 03:15:40.620950 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3388/6793] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:40 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 1365 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:41.639236 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-90e38377-c88f-4988-9dca-b0af3657c0c2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:41.640293 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-90e38377-c88f-4988-9dca-b0af3657c0c2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:41.647723 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-90e38377-c88f-4988-9dca-b0af3657c0c2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:41.648182 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-90e38377-c88f-4988-9dca-b0af3657c0c2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:41.648973 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-90e38377-c88f-4988-9dca-b0af3657c0c2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:41.649682 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-90e38377-c88f-4988-9dca-b0af3657c0c2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:41.870038 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-90e38377-c88f-4988-9dca-b0af3657c0c2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:41.878037 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-90e38377-c88f-4988-9dca-b0af3657c0c2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 200 len: 1365 microversion: 2.1 time: 0.244322 Jul 18 03:15:41.878808 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3406/6794] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:41 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 1365 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:42.896712 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-005d0052-8db9-4015-8d32-4b229d1b3a5e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:42.897324 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-005d0052-8db9-4015-8d32-4b229d1b3a5e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:42.904435 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-005d0052-8db9-4015-8d32-4b229d1b3a5e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:42.904886 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-005d0052-8db9-4015-8d32-4b229d1b3a5e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:42.905658 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-005d0052-8db9-4015-8d32-4b229d1b3a5e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:42.906117 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-005d0052-8db9-4015-8d32-4b229d1b3a5e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:43.047489 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-005d0052-8db9-4015-8d32-4b229d1b3a5e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:43.057759 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-005d0052-8db9-4015-8d32-4b229d1b3a5e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 200 len: 1365 microversion: 2.1 time: 0.165349 Jul 18 03:15:43.058359 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3389/6795] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:42 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:44.075872 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f311378d-7ef8-46e7-b1d7-26a7542bab82 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:44.076700 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f311378d-7ef8-46e7-b1d7-26a7542bab82 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:44.085846 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f311378d-7ef8-46e7-b1d7-26a7542bab82 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:44.086286 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f311378d-7ef8-46e7-b1d7-26a7542bab82 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:44.086990 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f311378d-7ef8-46e7-b1d7-26a7542bab82 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:44.087441 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f311378d-7ef8-46e7-b1d7-26a7542bab82 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:44.228751 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f311378d-7ef8-46e7-b1d7-26a7542bab82 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:44.238047 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f311378d-7ef8-46e7-b1d7-26a7542bab82 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 200 len: 1365 microversion: 2.1 time: 0.165026 Jul 18 03:15:44.238336 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3407/6796] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:44 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:45.261367 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-144b1be1-fc8f-4b3d-ac07-c2ab72777f33 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:45.262036 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-144b1be1-fc8f-4b3d-ac07-c2ab72777f33 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:45.277178 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-144b1be1-fc8f-4b3d-ac07-c2ab72777f33 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:45.277624 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-144b1be1-fc8f-4b3d-ac07-c2ab72777f33 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:45.278443 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-144b1be1-fc8f-4b3d-ac07-c2ab72777f33 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:45.278879 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-144b1be1-fc8f-4b3d-ac07-c2ab72777f33 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:45.435272 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-144b1be1-fc8f-4b3d-ac07-c2ab72777f33 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:45.443794 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-144b1be1-fc8f-4b3d-ac07-c2ab72777f33 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 200 len: 1365 microversion: 2.1 time: 0.185809 Jul 18 03:15:45.443794 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3390/6797] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:45 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 1365 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:45.908323 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-5d33255c-bb15-4a1e-baa1-6dafa7a2cb95 req-698ae20e-02f5-4934-910b-0f8ef3f0ad8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bc080aa-5510-4c63-8558-26ccc6e5024a", "name": "network-vif-plugged", "status": "completed", "tag": "8bb98e39-4381-4331-ae25-1b41a345d1b2"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:15:45.918778 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-5d33255c-bb15-4a1e-baa1-6dafa7a2cb95 req-698ae20e-02f5-4934-910b-0f8ef3f0ad8c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:45.919368 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-5d33255c-bb15-4a1e-baa1-6dafa7a2cb95 req-698ae20e-02f5-4934-910b-0f8ef3f0ad8c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:45.932487 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-5d33255c-bb15-4a1e-baa1-6dafa7a2cb95 req-698ae20e-02f5-4934-910b-0f8ef3f0ad8c service nova] Creating event network-vif-plugged:8bb98e39-4381-4331-ae25-1b41a345d1b2 for instance 0bc080aa-5510-4c63-8558-26ccc6e5024a on n-h2-465891-3 Jul 18 03:15:45.937952 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-5d33255c-bb15-4a1e-baa1-6dafa7a2cb95 req-698ae20e-02f5-4934-910b-0f8ef3f0ad8c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033327 Jul 18 03:15:45.938553 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3408/6798] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:15:46.461394 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e53bb6e6-7882-433d-a514-f8db54abd69f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:46.461974 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e53bb6e6-7882-433d-a514-f8db54abd69f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:46.469412 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e53bb6e6-7882-433d-a514-f8db54abd69f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:46.469905 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e53bb6e6-7882-433d-a514-f8db54abd69f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:46.470679 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e53bb6e6-7882-433d-a514-f8db54abd69f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:46.471113 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e53bb6e6-7882-433d-a514-f8db54abd69f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:46.618521 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e53bb6e6-7882-433d-a514-f8db54abd69f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:46.626334 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e53bb6e6-7882-433d-a514-f8db54abd69f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 200 len: 1365 microversion: 2.1 time: 0.169622 Jul 18 03:15:46.626957 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3391/6799] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:46 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:47.640647 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:15:47.641399 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:15:47.649619 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-41b33060-309c-4b8e-bee9-e0f68ecfc517 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:47.650378 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-41b33060-309c-4b8e-bee9-e0f68ecfc517 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:47.657914 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41b33060-309c-4b8e-bee9-e0f68ecfc517 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:47.658397 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41b33060-309c-4b8e-bee9-e0f68ecfc517 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:47.659474 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41b33060-309c-4b8e-bee9-e0f68ecfc517 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:47.659994 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41b33060-309c-4b8e-bee9-e0f68ecfc517 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:47.808914 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-41b33060-309c-4b8e-bee9-e0f68ecfc517 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:47.816956 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-41b33060-309c-4b8e-bee9-e0f68ecfc517 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 200 len: 1552 microversion: 2.1 time: 0.177337 Jul 18 03:15:47.817573 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3409/6800] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:47 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 1552 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:47.835233 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6b774ce0-0e77-4c81-81a0-695319137c02 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:47.835966 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6b774ce0-0e77-4c81-81a0-695319137c02 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:47.838522 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:15:47.847333 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b774ce0-0e77-4c81-81a0-695319137c02 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:47.847791 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b774ce0-0e77-4c81-81a0-695319137c02 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:47.849202 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b774ce0-0e77-4c81-81a0-695319137c02 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:47.849645 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b774ce0-0e77-4c81-81a0-695319137c02 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:47.946390 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6b774ce0-0e77-4c81-81a0-695319137c02 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.115042 Jul 18 03:15:47.947567 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3392/6801] 10.222.0.57 () {58 vars in 1274 bytes} [Mon Jul 18 03:15:47 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:15:49.534272 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-d1d4fe04-a4a2-4567-be16-695a4599edd2 req-a2d95761-8e1b-4d80-bc0a-6f721aaced40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bc080aa-5510-4c63-8558-26ccc6e5024a", "tag": "8bb98e39-4381-4331-ae25-1b41a345d1b2"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:15:49.550860 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-d1d4fe04-a4a2-4567-be16-695a4599edd2 req-a2d95761-8e1b-4d80-bc0a-6f721aaced40 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:49.551911 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-d1d4fe04-a4a2-4567-be16-695a4599edd2 req-a2d95761-8e1b-4d80-bc0a-6f721aaced40 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:49.565999 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-d1d4fe04-a4a2-4567-be16-695a4599edd2 req-a2d95761-8e1b-4d80-bc0a-6f721aaced40 service nova] Creating event network-changed:8bb98e39-4381-4331-ae25-1b41a345d1b2 for instance 0bc080aa-5510-4c63-8558-26ccc6e5024a on n-h2-465891-3 Jul 18 03:15:49.572516 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-d1d4fe04-a4a2-4567-be16-695a4599edd2 req-a2d95761-8e1b-4d80-bc0a-6f721aaced40 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042010 Jul 18 03:15:49.573136 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3410/6802] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:16:25.135710 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-74a159dd-e5f7-4dc6-8202-1c1e47728f9a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:16:25.139274 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=19 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:16:25.140016 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:16:25.148772 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74a159dd-e5f7-4dc6-8202-1c1e47728f9a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:25.149238 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74a159dd-e5f7-4dc6-8202-1c1e47728f9a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:25.175444 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-74a159dd-e5f7-4dc6-8202-1c1e47728f9a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Going to try to stop instance {{(pid=119544) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 03:16:25.225059 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-74a159dd-e5f7-4dc6-8202-1c1e47728f9a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "POST /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a/action" status: 202 len: 0 microversion: 2.1 time: 0.093889 Jul 18 03:16:25.225930 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3393/6803] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:16:25 2022] POST /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:16:25.232657 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:16:25.233545 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=54 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:16:25.237889 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c2de800e-6428-42f1-b024-ae505f82d7cd tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:25.238657 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c2de800e-6428-42f1-b024-ae505f82d7cd tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:25.247108 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c2de800e-6428-42f1-b024-ae505f82d7cd tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:25.247575 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c2de800e-6428-42f1-b024-ae505f82d7cd tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:25.248373 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c2de800e-6428-42f1-b024-ae505f82d7cd tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:25.248825 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c2de800e-6428-42f1-b024-ae505f82d7cd tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:25.519658 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c2de800e-6428-42f1-b024-ae505f82d7cd tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:25.528858 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c2de800e-6428-42f1-b024-ae505f82d7cd tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 200 len: 1681 microversion: 2.1 time: 0.298361 Jul 18 03:16:25.529492 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3411/6804] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:25 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 1681 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:26.548262 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f50edc2a-d3e5-4bf0-8e53-828ca763b12f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:26.548968 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f50edc2a-d3e5-4bf0-8e53-828ca763b12f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:26.557193 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f50edc2a-d3e5-4bf0-8e53-828ca763b12f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:26.557642 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f50edc2a-d3e5-4bf0-8e53-828ca763b12f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:26.558473 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f50edc2a-d3e5-4bf0-8e53-828ca763b12f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:26.558913 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f50edc2a-d3e5-4bf0-8e53-828ca763b12f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:26.784824 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f50edc2a-d3e5-4bf0-8e53-828ca763b12f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:26.793826 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f50edc2a-d3e5-4bf0-8e53-828ca763b12f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 200 len: 1681 microversion: 2.1 time: 0.250710 Jul 18 03:16:26.794431 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3394/6805] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:26 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 1681 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:27.817376 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c91a7bde-2ec5-4057-a037-4a629800b984 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:27.818846 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c91a7bde-2ec5-4057-a037-4a629800b984 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:27.825141 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c91a7bde-2ec5-4057-a037-4a629800b984 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:27.825605 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c91a7bde-2ec5-4057-a037-4a629800b984 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:27.826420 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c91a7bde-2ec5-4057-a037-4a629800b984 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:27.826866 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c91a7bde-2ec5-4057-a037-4a629800b984 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:28.002507 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c91a7bde-2ec5-4057-a037-4a629800b984 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:28.012943 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c91a7bde-2ec5-4057-a037-4a629800b984 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 200 len: 1681 microversion: 2.1 time: 0.199891 Jul 18 03:16:28.013574 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3412/6806] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:27 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 1681 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:29.031606 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-62dbf06b-9ad5-4028-8d60-3140fa2aab33 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:29.032238 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-62dbf06b-9ad5-4028-8d60-3140fa2aab33 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:29.039808 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-62dbf06b-9ad5-4028-8d60-3140fa2aab33 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:29.040411 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-62dbf06b-9ad5-4028-8d60-3140fa2aab33 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:29.041029 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-62dbf06b-9ad5-4028-8d60-3140fa2aab33 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:29.041497 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-62dbf06b-9ad5-4028-8d60-3140fa2aab33 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:29.183005 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-62dbf06b-9ad5-4028-8d60-3140fa2aab33 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:29.190894 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-62dbf06b-9ad5-4028-8d60-3140fa2aab33 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 200 len: 1681 microversion: 2.1 time: 0.163129 Jul 18 03:16:29.191598 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3395/6807] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:29 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:30.210301 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-856f5415-e40d-4647-ac63-5b593bfae547 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:30.210924 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-856f5415-e40d-4647-ac63-5b593bfae547 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:30.217835 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-856f5415-e40d-4647-ac63-5b593bfae547 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:30.218304 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-856f5415-e40d-4647-ac63-5b593bfae547 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:30.219084 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-856f5415-e40d-4647-ac63-5b593bfae547 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:30.219531 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-856f5415-e40d-4647-ac63-5b593bfae547 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:30.353771 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-856f5415-e40d-4647-ac63-5b593bfae547 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:30.361334 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-856f5415-e40d-4647-ac63-5b593bfae547 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 200 len: 1681 microversion: 2.1 time: 0.154970 Jul 18 03:16:30.361947 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3413/6808] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:30 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:31.378712 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7fc017e9-2425-4566-b346-4a8a9d5792db tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:31.379331 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7fc017e9-2425-4566-b346-4a8a9d5792db tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:31.387146 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7fc017e9-2425-4566-b346-4a8a9d5792db tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:31.387601 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7fc017e9-2425-4566-b346-4a8a9d5792db tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:31.388384 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7fc017e9-2425-4566-b346-4a8a9d5792db tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:31.388825 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7fc017e9-2425-4566-b346-4a8a9d5792db tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:31.528450 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7fc017e9-2425-4566-b346-4a8a9d5792db tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:31.536662 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7fc017e9-2425-4566-b346-4a8a9d5792db tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 200 len: 1681 microversion: 2.1 time: 0.161207 Jul 18 03:16:31.537403 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3396/6809] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:31 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:32.554092 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4029cb62-3525-4f78-bf9b-1469d55e8de2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:32.554722 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4029cb62-3525-4f78-bf9b-1469d55e8de2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:32.563106 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4029cb62-3525-4f78-bf9b-1469d55e8de2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:32.563575 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4029cb62-3525-4f78-bf9b-1469d55e8de2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:32.564385 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4029cb62-3525-4f78-bf9b-1469d55e8de2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:32.564874 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4029cb62-3525-4f78-bf9b-1469d55e8de2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:32.698851 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4029cb62-3525-4f78-bf9b-1469d55e8de2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:32.706385 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4029cb62-3525-4f78-bf9b-1469d55e8de2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 200 len: 1681 microversion: 2.1 time: 0.156327 Jul 18 03:16:32.706966 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3414/6810] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:32 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:33.724006 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ca785a8f-ce37-41ba-838b-268432f92143 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:33.724688 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ca785a8f-ce37-41ba-838b-268432f92143 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:33.731777 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ca785a8f-ce37-41ba-838b-268432f92143 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:33.732226 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ca785a8f-ce37-41ba-838b-268432f92143 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:33.733004 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ca785a8f-ce37-41ba-838b-268432f92143 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:33.733442 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ca785a8f-ce37-41ba-838b-268432f92143 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:33.866367 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ca785a8f-ce37-41ba-838b-268432f92143 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:33.874201 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ca785a8f-ce37-41ba-838b-268432f92143 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 200 len: 1681 microversion: 2.1 time: 0.154828 Jul 18 03:16:33.874792 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3397/6811] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:33 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:34.892817 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6cdfa8e8-cc49-4876-9a62-d02d476db836 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:34.893523 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6cdfa8e8-cc49-4876-9a62-d02d476db836 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:34.901336 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6cdfa8e8-cc49-4876-9a62-d02d476db836 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:34.901839 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6cdfa8e8-cc49-4876-9a62-d02d476db836 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:34.902625 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6cdfa8e8-cc49-4876-9a62-d02d476db836 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:34.903075 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6cdfa8e8-cc49-4876-9a62-d02d476db836 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:35.038889 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6cdfa8e8-cc49-4876-9a62-d02d476db836 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:35.046473 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6cdfa8e8-cc49-4876-9a62-d02d476db836 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 200 len: 1681 microversion: 2.1 time: 0.158405 Jul 18 03:16:35.047053 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3415/6812] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:34 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:36.064386 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-34b9a973-39c7-404d-8e16-b4c0808d11f9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:36.064922 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-34b9a973-39c7-404d-8e16-b4c0808d11f9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:36.072345 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-34b9a973-39c7-404d-8e16-b4c0808d11f9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:36.072781 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-34b9a973-39c7-404d-8e16-b4c0808d11f9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:36.073571 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-34b9a973-39c7-404d-8e16-b4c0808d11f9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:36.074043 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-34b9a973-39c7-404d-8e16-b4c0808d11f9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:36.206690 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-34b9a973-39c7-404d-8e16-b4c0808d11f9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:36.214639 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-34b9a973-39c7-404d-8e16-b4c0808d11f9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 200 len: 1658 microversion: 2.1 time: 0.154385 Jul 18 03:16:36.215229 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3398/6813] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:36 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 1658 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:36.231379 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ba6eaddb-ec79-452f-977c-ee98e2cab777 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:16:36.232396 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ba6eaddb-ec79-452f-977c-ee98e2cab777 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:36.239542 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ba6eaddb-ec79-452f-977c-ee98e2cab777 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:36.240031 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ba6eaddb-ec79-452f-977c-ee98e2cab777 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:36.241595 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ba6eaddb-ec79-452f-977c-ee98e2cab777 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:36.242083 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ba6eaddb-ec79-452f-977c-ee98e2cab777 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:36.270408 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ba6eaddb-ec79-452f-977c-ee98e2cab777 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:36.276456 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ba6eaddb-ec79-452f-977c-ee98e2cab777 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Old instance type m1.heat2, new instance type m1.heat {{(pid=119543) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 03:16:36.283541 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-ba6eaddb-ec79-452f-977c-ee98e2cab777 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:16:36.283969 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-ba6eaddb-ec79-452f-977c-ee98e2cab777 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:16:36.284444 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-ba6eaddb-ec79-452f-977c-ee98e2cab777 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:16:36.284870 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-ba6eaddb-ec79-452f-977c-ee98e2cab777 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:16:36.285284 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-ba6eaddb-ec79-452f-977c-ee98e2cab777 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:16:36.351488 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ba6eaddb-ec79-452f-977c-ee98e2cab777 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "POST /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a/action" status: 202 len: 0 microversion: 2.1 time: 0.123777 Jul 18 03:16:36.352113 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3416/6814] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:16:36 2022] POST /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:16:36.362724 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-279518af-06fa-4e49-b5e0-971f76e36452 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:36.363518 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-279518af-06fa-4e49-b5e0-971f76e36452 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:36.370837 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-279518af-06fa-4e49-b5e0-971f76e36452 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:36.371565 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-279518af-06fa-4e49-b5e0-971f76e36452 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:36.372340 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-279518af-06fa-4e49-b5e0-971f76e36452 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:36.372837 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-279518af-06fa-4e49-b5e0-971f76e36452 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:36.551517 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-279518af-06fa-4e49-b5e0-971f76e36452 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:36.564932 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-279518af-06fa-4e49-b5e0-971f76e36452 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 200 len: 1681 microversion: 2.1 time: 0.205949 Jul 18 03:16:36.565533 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3399/6815] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:36 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 1681 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:37.582765 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-097347d5-12b1-4091-8bb7-25cff1569cc9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:37.583423 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-097347d5-12b1-4091-8bb7-25cff1569cc9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:37.591853 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-097347d5-12b1-4091-8bb7-25cff1569cc9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:37.592313 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-097347d5-12b1-4091-8bb7-25cff1569cc9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:37.593090 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-097347d5-12b1-4091-8bb7-25cff1569cc9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:37.593534 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-097347d5-12b1-4091-8bb7-25cff1569cc9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:37.738238 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-097347d5-12b1-4091-8bb7-25cff1569cc9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:37.746446 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-097347d5-12b1-4091-8bb7-25cff1569cc9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 200 len: 1681 microversion: 2.1 time: 0.167515 Jul 18 03:16:37.747051 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3417/6816] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:37 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:38.764414 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-56d89dfb-787e-4391-bba3-74fd88fe171a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:38.764951 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-56d89dfb-787e-4391-bba3-74fd88fe171a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:38.773008 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-56d89dfb-787e-4391-bba3-74fd88fe171a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:38.773416 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-56d89dfb-787e-4391-bba3-74fd88fe171a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:38.774267 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-56d89dfb-787e-4391-bba3-74fd88fe171a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:38.774715 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-56d89dfb-787e-4391-bba3-74fd88fe171a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:38.907250 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-56d89dfb-787e-4391-bba3-74fd88fe171a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:38.915697 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-56d89dfb-787e-4391-bba3-74fd88fe171a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 200 len: 1686 microversion: 2.1 time: 0.155362 Jul 18 03:16:38.916275 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3400/6817] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:38 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 1686 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:39.932662 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-957cb86f-958e-46f2-8cf5-2e5ad4b6a0a9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:39.933290 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-957cb86f-958e-46f2-8cf5-2e5ad4b6a0a9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:39.940145 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-957cb86f-958e-46f2-8cf5-2e5ad4b6a0a9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:39.940601 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-957cb86f-958e-46f2-8cf5-2e5ad4b6a0a9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:39.941370 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-957cb86f-958e-46f2-8cf5-2e5ad4b6a0a9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:39.941847 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-957cb86f-958e-46f2-8cf5-2e5ad4b6a0a9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:40.081124 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-957cb86f-958e-46f2-8cf5-2e5ad4b6a0a9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:40.088773 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-957cb86f-958e-46f2-8cf5-2e5ad4b6a0a9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 200 len: 1686 microversion: 2.1 time: 0.160587 Jul 18 03:16:40.089357 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3418/6818] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:39 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 1686 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:41.106737 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e14a0fb6-b3c9-4fdc-a29d-ffc81541438e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:41.107362 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e14a0fb6-b3c9-4fdc-a29d-ffc81541438e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:41.114591 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e14a0fb6-b3c9-4fdc-a29d-ffc81541438e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:41.115040 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e14a0fb6-b3c9-4fdc-a29d-ffc81541438e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:41.116697 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e14a0fb6-b3c9-4fdc-a29d-ffc81541438e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:41.117229 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e14a0fb6-b3c9-4fdc-a29d-ffc81541438e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:41.197080 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-d257c6ea-e69d-47e4-bbd4-ddd0964d02a4 req-ea0aacab-a0b2-4b67-b460-3cfb63517c37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bc080aa-5510-4c63-8558-26ccc6e5024a", "name": "network-vif-unplugged", "status": "completed", "tag": "8bb98e39-4381-4331-ae25-1b41a345d1b2"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:16:41.206680 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-d257c6ea-e69d-47e4-bbd4-ddd0964d02a4 req-ea0aacab-a0b2-4b67-b460-3cfb63517c37 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:41.207428 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-d257c6ea-e69d-47e4-bbd4-ddd0964d02a4 req-ea0aacab-a0b2-4b67-b460-3cfb63517c37 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:41.219588 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-d257c6ea-e69d-47e4-bbd4-ddd0964d02a4 req-ea0aacab-a0b2-4b67-b460-3cfb63517c37 service nova] Creating event network-vif-unplugged:8bb98e39-4381-4331-ae25-1b41a345d1b2 for instance 0bc080aa-5510-4c63-8558-26ccc6e5024a on n-h1-465891-3 Jul 18 03:16:41.225168 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [req-d257c6ea-e69d-47e4-bbd4-ddd0964d02a4 req-ea0aacab-a0b2-4b67-b460-3cfb63517c37 service nova] Instance 0bc080aa-5510-4c63-8558-26ccc6e5024a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3', 'n-h2-465891-3'} {{(pid=119543) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:16:41.236764 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-d257c6ea-e69d-47e4-bbd4-ddd0964d02a4 req-ea0aacab-a0b2-4b67-b460-3cfb63517c37 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044157 Jul 18 03:16:41.237475 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3419/6819] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:16:41.392515 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e14a0fb6-b3c9-4fdc-a29d-ffc81541438e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:41.401491 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e14a0fb6-b3c9-4fdc-a29d-ffc81541438e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 200 len: 1685 microversion: 2.1 time: 0.298696 Jul 18 03:16:41.402115 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3401/6820] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:41 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 1685 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:42.422111 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-17299b71-5fdb-4eac-9457-5f53817274c5 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:42.423575 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-17299b71-5fdb-4eac-9457-5f53817274c5 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:42.432404 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-17299b71-5fdb-4eac-9457-5f53817274c5 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:42.432863 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-17299b71-5fdb-4eac-9457-5f53817274c5 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:42.433661 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-17299b71-5fdb-4eac-9457-5f53817274c5 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:42.434152 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-17299b71-5fdb-4eac-9457-5f53817274c5 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:42.574083 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-17299b71-5fdb-4eac-9457-5f53817274c5 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:42.581966 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-17299b71-5fdb-4eac-9457-5f53817274c5 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 200 len: 1683 microversion: 2.1 time: 0.166556 Jul 18 03:16:42.582548 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3420/6821] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:42 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:43.254910 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-6b8b2c0e-f28d-48f1-bf64-bf3a6c163ff9 req-d2d43114-b5d2-4cac-b89d-7668f4168375 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bc080aa-5510-4c63-8558-26ccc6e5024a", "tag": "8bb98e39-4381-4331-ae25-1b41a345d1b2"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:16:43.264584 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-6b8b2c0e-f28d-48f1-bf64-bf3a6c163ff9 req-d2d43114-b5d2-4cac-b89d-7668f4168375 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:43.265042 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-6b8b2c0e-f28d-48f1-bf64-bf3a6c163ff9 req-d2d43114-b5d2-4cac-b89d-7668f4168375 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:43.277757 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-6b8b2c0e-f28d-48f1-bf64-bf3a6c163ff9 req-d2d43114-b5d2-4cac-b89d-7668f4168375 service nova] Creating event network-changed:8bb98e39-4381-4331-ae25-1b41a345d1b2 for instance 0bc080aa-5510-4c63-8558-26ccc6e5024a on n-h1-465891-3 Jul 18 03:16:43.284067 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [req-6b8b2c0e-f28d-48f1-bf64-bf3a6c163ff9 req-d2d43114-b5d2-4cac-b89d-7668f4168375 service nova] Instance 0bc080aa-5510-4c63-8558-26ccc6e5024a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3', 'n-h2-465891-3'} {{(pid=119544) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:16:43.295891 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-6b8b2c0e-f28d-48f1-bf64-bf3a6c163ff9 req-d2d43114-b5d2-4cac-b89d-7668f4168375 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044934 Jul 18 03:16:43.296505 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3402/6822] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:16:43.601310 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c1c0ac93-f73e-4ff3-918e-10cfef9023c9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:43.601959 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c1c0ac93-f73e-4ff3-918e-10cfef9023c9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:43.608926 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c1c0ac93-f73e-4ff3-918e-10cfef9023c9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:43.609388 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c1c0ac93-f73e-4ff3-918e-10cfef9023c9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:43.610206 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c1c0ac93-f73e-4ff3-918e-10cfef9023c9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:43.610657 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c1c0ac93-f73e-4ff3-918e-10cfef9023c9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:43.823984 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c1c0ac93-f73e-4ff3-918e-10cfef9023c9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:43.831649 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c1c0ac93-f73e-4ff3-918e-10cfef9023c9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 200 len: 1683 microversion: 2.1 time: 0.235007 Jul 18 03:16:43.832238 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3421/6823] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:43 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 1683 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:44.851919 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e88c4c6b-8a1f-4710-8ac7-3c6b3973ae9a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:44.852654 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e88c4c6b-8a1f-4710-8ac7-3c6b3973ae9a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:44.860217 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e88c4c6b-8a1f-4710-8ac7-3c6b3973ae9a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:44.860673 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e88c4c6b-8a1f-4710-8ac7-3c6b3973ae9a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:44.861453 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e88c4c6b-8a1f-4710-8ac7-3c6b3973ae9a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:44.861928 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e88c4c6b-8a1f-4710-8ac7-3c6b3973ae9a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:44.999220 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e88c4c6b-8a1f-4710-8ac7-3c6b3973ae9a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:45.007021 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e88c4c6b-8a1f-4710-8ac7-3c6b3973ae9a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 200 len: 1683 microversion: 2.1 time: 0.162040 Jul 18 03:16:45.007605 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3403/6824] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:44 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:46.026541 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bc778228-a604-4569-bad3-e70db836f802 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:46.027087 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bc778228-a604-4569-bad3-e70db836f802 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:46.034364 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bc778228-a604-4569-bad3-e70db836f802 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:46.034870 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bc778228-a604-4569-bad3-e70db836f802 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:46.035611 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bc778228-a604-4569-bad3-e70db836f802 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:46.036056 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bc778228-a604-4569-bad3-e70db836f802 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:46.252912 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bc778228-a604-4569-bad3-e70db836f802 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:46.261232 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bc778228-a604-4569-bad3-e70db836f802 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 200 len: 1679 microversion: 2.1 time: 0.239293 Jul 18 03:16:46.261937 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3422/6825] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:46 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 1679 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:16:46.277815 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-12363afc-d04b-4e5e-9485-ead2638b20d9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:16:46.278335 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-12363afc-d04b-4e5e-9485-ead2638b20d9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:46.285562 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-12363afc-d04b-4e5e-9485-ead2638b20d9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:46.286063 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-12363afc-d04b-4e5e-9485-ead2638b20d9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:46.286849 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-12363afc-d04b-4e5e-9485-ead2638b20d9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:46.287327 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-12363afc-d04b-4e5e-9485-ead2638b20d9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:46.346346 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-12363afc-d04b-4e5e-9485-ead2638b20d9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "POST /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a/action" status: 204 len: 0 microversion: 2.1 time: 0.072367 Jul 18 03:16:46.347034 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3404/6826] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:16:46 2022] POST /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:16:46.355308 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d93e4fb8-6b06-4461-96a2-f58adedbea00 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:46.355830 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d93e4fb8-6b06-4461-96a2-f58adedbea00 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:46.362131 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d93e4fb8-6b06-4461-96a2-f58adedbea00 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:46.362600 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d93e4fb8-6b06-4461-96a2-f58adedbea00 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:46.363387 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d93e4fb8-6b06-4461-96a2-f58adedbea00 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:46.363841 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d93e4fb8-6b06-4461-96a2-f58adedbea00 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:46.594876 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d93e4fb8-6b06-4461-96a2-f58adedbea00 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:46.608115 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-5aacf159-6a5d-408c-b1e1-bd827935ad5a req-fee759a4-38ce-4316-91cc-78c68e8fc17b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bc080aa-5510-4c63-8558-26ccc6e5024a", "name": "network-vif-plugged", "status": "completed", "tag": "8bb98e39-4381-4331-ae25-1b41a345d1b2"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:16:46.608783 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d93e4fb8-6b06-4461-96a2-f58adedbea00 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 200 len: 1679 microversion: 2.1 time: 0.257329 Jul 18 03:16:46.609377 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3423/6827] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:46 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 1679 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:46.618364 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-5aacf159-6a5d-408c-b1e1-bd827935ad5a req-fee759a4-38ce-4316-91cc-78c68e8fc17b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:46.618810 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-5aacf159-6a5d-408c-b1e1-bd827935ad5a req-fee759a4-38ce-4316-91cc-78c68e8fc17b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:46.631868 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-5aacf159-6a5d-408c-b1e1-bd827935ad5a req-fee759a4-38ce-4316-91cc-78c68e8fc17b service nova] Creating event network-vif-plugged:8bb98e39-4381-4331-ae25-1b41a345d1b2 for instance 0bc080aa-5510-4c63-8558-26ccc6e5024a on n-h1-465891-3 Jul 18 03:16:46.638160 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [req-5aacf159-6a5d-408c-b1e1-bd827935ad5a req-fee759a4-38ce-4316-91cc-78c68e8fc17b service nova] Instance 0bc080aa-5510-4c63-8558-26ccc6e5024a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3', 'n-h2-465891-3'} {{(pid=119544) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:16:46.650120 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-5aacf159-6a5d-408c-b1e1-bd827935ad5a req-fee759a4-38ce-4316-91cc-78c68e8fc17b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130542 Jul 18 03:16:46.651007 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3405/6828] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:16:47.628282 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ce08ec0c-23f9-493d-8e31-db02f883bfb1 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:47.629069 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ce08ec0c-23f9-493d-8e31-db02f883bfb1 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:47.637322 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ce08ec0c-23f9-493d-8e31-db02f883bfb1 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:47.637841 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ce08ec0c-23f9-493d-8e31-db02f883bfb1 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:47.638655 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ce08ec0c-23f9-493d-8e31-db02f883bfb1 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:47.639175 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ce08ec0c-23f9-493d-8e31-db02f883bfb1 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:47.780567 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ce08ec0c-23f9-493d-8e31-db02f883bfb1 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:47.790593 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ce08ec0c-23f9-493d-8e31-db02f883bfb1 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 200 len: 1679 microversion: 2.1 time: 0.166490 Jul 18 03:16:47.791396 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3424/6829] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:47 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:16:48.811772 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2d67163f-0877-4894-9332-d2230d4caf27 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:48.812473 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2d67163f-0877-4894-9332-d2230d4caf27 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:48.820532 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2d67163f-0877-4894-9332-d2230d4caf27 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:48.821038 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2d67163f-0877-4894-9332-d2230d4caf27 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:48.821936 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2d67163f-0877-4894-9332-d2230d4caf27 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:48.822442 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2d67163f-0877-4894-9332-d2230d4caf27 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:48.973632 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2d67163f-0877-4894-9332-d2230d4caf27 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:48.982063 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2d67163f-0877-4894-9332-d2230d4caf27 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 200 len: 1658 microversion: 2.1 time: 0.176746 Jul 18 03:16:48.982664 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3406/6830] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:48 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 1658 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:48.999392 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a0c3a7e7-42d7-419f-9b55-1d93f1c32fec tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:49.000037 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a0c3a7e7-42d7-419f-9b55-1d93f1c32fec tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:49.006710 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a0c3a7e7-42d7-419f-9b55-1d93f1c32fec tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:49.007166 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a0c3a7e7-42d7-419f-9b55-1d93f1c32fec tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:49.007958 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a0c3a7e7-42d7-419f-9b55-1d93f1c32fec tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:49.008406 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a0c3a7e7-42d7-419f-9b55-1d93f1c32fec tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:49.145052 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a0c3a7e7-42d7-419f-9b55-1d93f1c32fec tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:49.153410 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a0c3a7e7-42d7-419f-9b55-1d93f1c32fec tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 200 len: 1658 microversion: 2.1 time: 0.158023 Jul 18 03:16:49.154032 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3425/6831] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:48 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 1658 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:49.170122 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f2be02bd-944f-4e8f-9c21-aae64ae0f5fc tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:16:49.176464 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f2be02bd-944f-4e8f-9c21-aae64ae0f5fc tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:49.176914 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f2be02bd-944f-4e8f-9c21-aae64ae0f5fc tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:49.201176 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f2be02bd-944f-4e8f-9c21-aae64ae0f5fc tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Going to try to start instance {{(pid=119544) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 03:16:49.216950 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:16:49.249311 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f2be02bd-944f-4e8f-9c21-aae64ae0f5fc tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "POST /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a/action" status: 202 len: 0 microversion: 2.1 time: 0.082958 Jul 18 03:16:49.249995 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3407/6832] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:16:49 2022] POST /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:16:49.259858 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5c96a2ed-cefd-4306-b6e3-1cb9d72e0dce tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:49.260504 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5c96a2ed-cefd-4306-b6e3-1cb9d72e0dce tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:49.267096 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5c96a2ed-cefd-4306-b6e3-1cb9d72e0dce tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:49.267604 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5c96a2ed-cefd-4306-b6e3-1cb9d72e0dce tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:49.268482 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5c96a2ed-cefd-4306-b6e3-1cb9d72e0dce tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:49.268971 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5c96a2ed-cefd-4306-b6e3-1cb9d72e0dce tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:49.290292 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:16:49.486761 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5c96a2ed-cefd-4306-b6e3-1cb9d72e0dce tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:49.498385 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5c96a2ed-cefd-4306-b6e3-1cb9d72e0dce tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 200 len: 1667 microversion: 2.1 time: 0.242952 Jul 18 03:16:49.499076 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3426/6833] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:49 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 1667 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:50.520025 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a90dae7b-04e6-4e5e-93f3-13fd6deb7952 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:50.520828 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a90dae7b-04e6-4e5e-93f3-13fd6deb7952 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:50.527698 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a90dae7b-04e6-4e5e-93f3-13fd6deb7952 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:50.528129 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a90dae7b-04e6-4e5e-93f3-13fd6deb7952 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:50.528929 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a90dae7b-04e6-4e5e-93f3-13fd6deb7952 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:50.529380 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a90dae7b-04e6-4e5e-93f3-13fd6deb7952 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:50.677718 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a90dae7b-04e6-4e5e-93f3-13fd6deb7952 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:50.687848 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a90dae7b-04e6-4e5e-93f3-13fd6deb7952 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 200 len: 1667 microversion: 2.1 time: 0.173371 Jul 18 03:16:50.688430 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3408/6834] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:50 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 1667 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:51.704831 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e08643a0-318f-46b2-b352-0dc73d101cab tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:51.705459 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e08643a0-318f-46b2-b352-0dc73d101cab tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:51.712551 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e08643a0-318f-46b2-b352-0dc73d101cab tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:51.713010 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e08643a0-318f-46b2-b352-0dc73d101cab tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:51.713822 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e08643a0-318f-46b2-b352-0dc73d101cab tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:51.714265 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e08643a0-318f-46b2-b352-0dc73d101cab tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:51.847404 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e08643a0-318f-46b2-b352-0dc73d101cab tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:51.855668 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e08643a0-318f-46b2-b352-0dc73d101cab tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 200 len: 1671 microversion: 2.1 time: 0.154745 Jul 18 03:16:51.856248 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3427/6835] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:51 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:51.873208 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0a59fae7-823f-4961-a406-83f4a72e87b5 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:51.873761 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0a59fae7-823f-4961-a406-83f4a72e87b5 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:51.880721 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a59fae7-823f-4961-a406-83f4a72e87b5 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:51.881172 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a59fae7-823f-4961-a406-83f4a72e87b5 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:51.881967 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a59fae7-823f-4961-a406-83f4a72e87b5 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:51.882414 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a59fae7-823f-4961-a406-83f4a72e87b5 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:51.907596 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0a59fae7-823f-4961-a406-83f4a72e87b5 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:16:51.984587 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0a59fae7-823f-4961-a406-83f4a72e87b5 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "DELETE /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 204 len: 0 microversion: 2.1 time: 0.115492 Jul 18 03:16:51.985175 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3409/6836] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:16:51 2022] DELETE /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:16:51.996182 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bacc1a49-9920-42de-bab2-dc43aefc370c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:51.996810 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bacc1a49-9920-42de-bab2-dc43aefc370c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:52.003203 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bacc1a49-9920-42de-bab2-dc43aefc370c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:52.003691 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bacc1a49-9920-42de-bab2-dc43aefc370c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:52.004459 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bacc1a49-9920-42de-bab2-dc43aefc370c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:52.004913 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bacc1a49-9920-42de-bab2-dc43aefc370c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:52.137791 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bacc1a49-9920-42de-bab2-dc43aefc370c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:52.145550 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bacc1a49-9920-42de-bab2-dc43aefc370c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 200 len: 1677 microversion: 2.1 time: 0.155802 Jul 18 03:16:52.146181 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3428/6837] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:51 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:53.163517 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-02c8077b-52ed-4a47-bd0d-895c3c243c0b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:53.164826 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-02c8077b-52ed-4a47-bd0d-895c3c243c0b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:53.172137 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-02c8077b-52ed-4a47-bd0d-895c3c243c0b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:53.172591 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-02c8077b-52ed-4a47-bd0d-895c3c243c0b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:53.173364 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-02c8077b-52ed-4a47-bd0d-895c3c243c0b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:53.173826 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-02c8077b-52ed-4a47-bd0d-895c3c243c0b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:53.312231 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-02c8077b-52ed-4a47-bd0d-895c3c243c0b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:53.320445 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-02c8077b-52ed-4a47-bd0d-895c3c243c0b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 200 len: 1677 microversion: 2.1 time: 0.160706 Jul 18 03:16:53.321168 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3410/6838] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:53 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:16:54.338341 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c6f25f18-a44c-4cd5-a192-05d02c4f6a7b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:54.339133 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c6f25f18-a44c-4cd5-a192-05d02c4f6a7b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:54.347169 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c6f25f18-a44c-4cd5-a192-05d02c4f6a7b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:54.347783 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c6f25f18-a44c-4cd5-a192-05d02c4f6a7b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:54.348699 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c6f25f18-a44c-4cd5-a192-05d02c4f6a7b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:54.349216 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c6f25f18-a44c-4cd5-a192-05d02c4f6a7b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:54.363293 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-411f86a1-176e-457e-92fe-5021aa39ebe3 req-dc4b7520-2118-4679-8db4-9aa33b76a0fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bc080aa-5510-4c63-8558-26ccc6e5024a", "name": "network-vif-deleted", "tag": "8bb98e39-4381-4331-ae25-1b41a345d1b2"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:16:54.384675 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-411f86a1-176e-457e-92fe-5021aa39ebe3 req-dc4b7520-2118-4679-8db4-9aa33b76a0fa service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:54.399772 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-411f86a1-176e-457e-92fe-5021aa39ebe3 req-dc4b7520-2118-4679-8db4-9aa33b76a0fa service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:54.418989 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-411f86a1-176e-457e-92fe-5021aa39ebe3 req-dc4b7520-2118-4679-8db4-9aa33b76a0fa service nova] Creating event network-vif-deleted:8bb98e39-4381-4331-ae25-1b41a345d1b2 for instance 0bc080aa-5510-4c63-8558-26ccc6e5024a on n-h1-465891-3 Jul 18 03:16:54.432747 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-411f86a1-176e-457e-92fe-5021aa39ebe3 req-dc4b7520-2118-4679-8db4-9aa33b76a0fa service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073799 Jul 18 03:16:54.434399 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3411/6839] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:16:54.464309 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c6f25f18-a44c-4cd5-a192-05d02c4f6a7b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:54.480354 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c6f25f18-a44c-4cd5-a192-05d02c4f6a7b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 200 len: 1609 microversion: 2.1 time: 0.145493 Jul 18 03:16:54.482001 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3429/6840] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:54 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 1609 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:55.499984 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-91e18bc7-1f15-4f20-ab75-ef5e7ba5548c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:55.500695 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-91e18bc7-1f15-4f20-ab75-ef5e7ba5548c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:55.502905 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:16:55.509470 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91e18bc7-1f15-4f20-ab75-ef5e7ba5548c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:55.509950 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91e18bc7-1f15-4f20-ab75-ef5e7ba5548c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:55.510746 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91e18bc7-1f15-4f20-ab75-ef5e7ba5548c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:55.511182 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91e18bc7-1f15-4f20-ab75-ef5e7ba5548c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:55.530662 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-91e18bc7-1f15-4f20-ab75-ef5e7ba5548c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] HTTP exception thrown: Instance 0bc080aa-5510-4c63-8558-26ccc6e5024a could not be found. Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-91e18bc7-1f15-4f20-ab75-ef5e7ba5548c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Request method failure captured: Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a HTTP/1.1 Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1NAG6n_J2rNfvjGE6tf7j0WubnLjYbUZkg89AdB_m51VufhJ39XnIb0TmV_VVToQ_i_5-V0sK6RpZIQpSTqBKYIT5BrJJ7toLiPDmvP9k5QSxkcWvnshbbMUZbr7tAQNfRbL8QooouumBDZt90piJMD7xS5_3rIJ9QUoKQLsChc4eY8 Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 735af4c358a64b9cbc4a61a33985b9b1 Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServerActionsTestJSON-695654908 Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/735af4c358a64b9cbc4a61a33985b9b1"}]}] Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServerActionsTestJSON-695654908 Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 735af4c358a64b9cbc4a61a33985b9b1 Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServerActionsTestJSON-695654908 Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServerActionsTestJSON-695654908-project Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 16f0c35138a3430f97850934128310d1 Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServerActionsTestJSON-695654908-project Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 0bc080aa-5510-4c63-8558-26ccc6e5024a could not be found. Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '0bc080aa-5510-4c63-8558-26ccc6e5024a'} Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bc080aa-5510-4c63-8558-26ccc6e5024a could not be found. Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bc080aa-5510-4c63-8558-26ccc6e5024a could not be found. Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:16:55.532262 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:16:55.536053 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:16:55.536053 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:16:55.536053 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:16:55.536053 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:16:55.536053 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:16:55.536053 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bc080aa-5510-4c63-8558-26ccc6e5024a could not be found. Jul 18 03:16:55.536053 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:16:55.536053 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-91e18bc7-1f15-4f20-ab75-ef5e7ba5548c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Returning 404 to user: Instance 0bc080aa-5510-4c63-8558-26ccc6e5024a could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:16:55.536053 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-91e18bc7-1f15-4f20-ab75-ef5e7ba5548c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 404 len: 111 microversion: 2.1 time: 0.039067 Jul 18 03:16:55.536053 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3412/6841] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:55 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:16:55.555610 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-915bb9f4-45d0-4bda-8c6d-4f04594f6476 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:55.556331 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-915bb9f4-45d0-4bda-8c6d-4f04594f6476 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:55.562885 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=43 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:16:55.565054 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-915bb9f4-45d0-4bda-8c6d-4f04594f6476 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:55.565607 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-915bb9f4-45d0-4bda-8c6d-4f04594f6476 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:55.566526 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-915bb9f4-45d0-4bda-8c6d-4f04594f6476 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:55.567054 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-915bb9f4-45d0-4bda-8c6d-4f04594f6476 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:55.583155 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-915bb9f4-45d0-4bda-8c6d-4f04594f6476 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] HTTP exception thrown: Instance 0bc080aa-5510-4c63-8558-26ccc6e5024a could not be found. Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-915bb9f4-45d0-4bda-8c6d-4f04594f6476 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Request method failure captured: Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a HTTP/1.1 Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1NAG6n_J2rNfvjGE6tf7j0WubnLjYbUZkg89AdB_m51VufhJ39XnIb0TmV_VVToQ_i_5-V0sK6RpZIQpSTqBKYIT5BrJJ7toLiPDmvP9k5QSxkcWvnshbbMUZbr7tAQNfRbL8QooouumBDZt90piJMD7xS5_3rIJ9QUoKQLsChc4eY8 Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 735af4c358a64b9cbc4a61a33985b9b1 Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServerActionsTestJSON-695654908 Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/735af4c358a64b9cbc4a61a33985b9b1"}]}] Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServerActionsTestJSON-695654908 Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 735af4c358a64b9cbc4a61a33985b9b1 Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServerActionsTestJSON-695654908 Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServerActionsTestJSON-695654908-project Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 16f0c35138a3430f97850934128310d1 Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServerActionsTestJSON-695654908-project Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 0bc080aa-5510-4c63-8558-26ccc6e5024a could not be found. Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '0bc080aa-5510-4c63-8558-26ccc6e5024a'} Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bc080aa-5510-4c63-8558-26ccc6e5024a could not be found. Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bc080aa-5510-4c63-8558-26ccc6e5024a could not be found. Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:16:55.585108 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:16:55.590293 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:16:55.590293 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:16:55.590293 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:16:55.590293 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:16:55.590293 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:16:55.590293 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bc080aa-5510-4c63-8558-26ccc6e5024a could not be found. Jul 18 03:16:55.590293 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:16:55.590293 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-915bb9f4-45d0-4bda-8c6d-4f04594f6476 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Returning 404 to user: Instance 0bc080aa-5510-4c63-8558-26ccc6e5024a could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:16:55.590293 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-915bb9f4-45d0-4bda-8c6d-4f04594f6476 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 404 len: 111 microversion: 2.1 time: 0.037720 Jul 18 03:16:55.591706 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3430/6842] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:55 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:16:55.640432 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-925725fb-38e3-479d-8376-ada2eb7604bc tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-502365710", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "8e69ecad-b2b9-49c6-8462-8ffe28d14bf7"}], "security_groups": [{"name": "tempest-securitygroup--1685166239"}], "key_name": "tempest-keypair-2023945870", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:16:55.749495 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-925725fb-38e3-479d-8376-ada2eb7604bc tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] validate_networks() for [('8e69ecad-b2b9-49c6-8462-8ffe28d14bf7', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:16:56.126598 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-925725fb-38e3-479d-8376-ada2eb7604bc tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:16:56.127101 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-925725fb-38e3-479d-8376-ada2eb7604bc tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:16:56.127522 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-925725fb-38e3-479d-8376-ada2eb7604bc tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:16:56.127901 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-925725fb-38e3-479d-8376-ada2eb7604bc tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:16:56.128311 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-925725fb-38e3-479d-8376-ada2eb7604bc tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:16:56.137869 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-925725fb-38e3-479d-8376-ada2eb7604bc tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:56.138315 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-925725fb-38e3-479d-8376-ada2eb7604bc tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:56.139107 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-925725fb-38e3-479d-8376-ada2eb7604bc tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:56.139560 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-925725fb-38e3-479d-8376-ada2eb7604bc tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:56.157516 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-925725fb-38e3-479d-8376-ada2eb7604bc tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Getting quotas for project 735af4c358a64b9cbc4a61a33985b9b1. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:16:56.163249 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-925725fb-38e3-479d-8376-ada2eb7604bc tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Getting quotas for user 16f0c35138a3430f97850934128310d1 and project 735af4c358a64b9cbc4a61a33985b9b1. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:16:56.176059 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-925725fb-38e3-479d-8376-ada2eb7604bc tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:16:56.178373 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-925725fb-38e3-479d-8376-ada2eb7604bc tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:16:56.228120 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-925725fb-38e3-479d-8376-ada2eb7604bc tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.591529 Jul 18 03:16:56.228788 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3413/6843] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:16:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:16:56.238967 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e8597539-be4c-4324-88eb-49551d9a06fc tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:56.239595 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e8597539-be4c-4324-88eb-49551d9a06fc tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:56.296008 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e8597539-be4c-4324-88eb-49551d9a06fc tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:56.303260 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e8597539-be4c-4324-88eb-49551d9a06fc tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 200 len: 1238 microversion: 2.1 time: 0.068290 Jul 18 03:16:56.303836 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3431/6844] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:56 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:57.321687 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5f56a99d-eba7-4238-b36e-0825f111451f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:57.322341 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5f56a99d-eba7-4238-b36e-0825f111451f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:57.330076 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5f56a99d-eba7-4238-b36e-0825f111451f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:57.330802 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5f56a99d-eba7-4238-b36e-0825f111451f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:57.331804 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5f56a99d-eba7-4238-b36e-0825f111451f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:57.332488 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5f56a99d-eba7-4238-b36e-0825f111451f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:57.412050 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5f56a99d-eba7-4238-b36e-0825f111451f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:57.420177 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5f56a99d-eba7-4238-b36e-0825f111451f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 200 len: 1308 microversion: 2.1 time: 0.102894 Jul 18 03:16:57.420761 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3414/6845] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:57 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 1308 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:58.437877 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0e132175-c6ba-481f-b07a-c3074f1f9fc3 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:58.438498 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0e132175-c6ba-481f-b07a-c3074f1f9fc3 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:58.447999 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0e132175-c6ba-481f-b07a-c3074f1f9fc3 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:58.448534 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0e132175-c6ba-481f-b07a-c3074f1f9fc3 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:58.453220 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0e132175-c6ba-481f-b07a-c3074f1f9fc3 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:58.453891 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0e132175-c6ba-481f-b07a-c3074f1f9fc3 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:58.653803 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0e132175-c6ba-481f-b07a-c3074f1f9fc3 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:58.662712 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0e132175-c6ba-481f-b07a-c3074f1f9fc3 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 200 len: 1364 microversion: 2.1 time: 0.228443 Jul 18 03:16:58.663820 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3432/6846] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:58 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 1364 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:58.764687 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-7b92b936-cab0-4791-b3ce-ad2975a33c2d req-8320c8cd-fa69-43a0-848a-348e85c13bdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c630e4c-54bc-4ddf-84d5-e9a38af2adbd", "tag": "924f42e5-64e4-4312-b987-dc8df78a5007"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:16:58.777996 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-7b92b936-cab0-4791-b3ce-ad2975a33c2d req-8320c8cd-fa69-43a0-848a-348e85c13bdc service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:58.778442 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-7b92b936-cab0-4791-b3ce-ad2975a33c2d req-8320c8cd-fa69-43a0-848a-348e85c13bdc service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:58.801436 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-7b92b936-cab0-4791-b3ce-ad2975a33c2d req-8320c8cd-fa69-43a0-848a-348e85c13bdc service nova] Creating event network-changed:924f42e5-64e4-4312-b987-dc8df78a5007 for instance 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd on n-h1-465891-3 Jul 18 03:16:58.807364 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-7b92b936-cab0-4791-b3ce-ad2975a33c2d req-8320c8cd-fa69-43a0-848a-348e85c13bdc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046700 Jul 18 03:16:58.808025 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3415/6847] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:16:59.681715 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4405a1cd-c832-4ac4-b9d2-57e040ba7413 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:59.682349 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4405a1cd-c832-4ac4-b9d2-57e040ba7413 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:59.689321 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4405a1cd-c832-4ac4-b9d2-57e040ba7413 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:59.689834 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4405a1cd-c832-4ac4-b9d2-57e040ba7413 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:59.690652 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4405a1cd-c832-4ac4-b9d2-57e040ba7413 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:59.691067 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4405a1cd-c832-4ac4-b9d2-57e040ba7413 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:59.825085 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4405a1cd-c832-4ac4-b9d2-57e040ba7413 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:59.832643 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4405a1cd-c832-4ac4-b9d2-57e040ba7413 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 200 len: 1364 microversion: 2.1 time: 0.155678 Jul 18 03:16:59.833431 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3433/6848] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:59 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:17:00.853900 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2888087e-f987-4b25-a284-fc450c794075 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:17:00.854595 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2888087e-f987-4b25-a284-fc450c794075 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:17:00.860931 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2888087e-f987-4b25-a284-fc450c794075 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:17:00.861390 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2888087e-f987-4b25-a284-fc450c794075 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:17:00.862186 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2888087e-f987-4b25-a284-fc450c794075 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:17:00.862636 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2888087e-f987-4b25-a284-fc450c794075 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:17:01.001648 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2888087e-f987-4b25-a284-fc450c794075 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:17:01.009863 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2888087e-f987-4b25-a284-fc450c794075 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 200 len: 1364 microversion: 2.1 time: 0.162325 Jul 18 03:17:01.010444 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3416/6849] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:17:00 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:17:02.028094 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-33cc0a47-0521-4e33-9a93-ffb821c5443b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:17:02.028652 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-33cc0a47-0521-4e33-9a93-ffb821c5443b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:17:02.035568 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-33cc0a47-0521-4e33-9a93-ffb821c5443b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:17:02.036030 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-33cc0a47-0521-4e33-9a93-ffb821c5443b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:17:02.036812 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-33cc0a47-0521-4e33-9a93-ffb821c5443b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:17:02.037266 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-33cc0a47-0521-4e33-9a93-ffb821c5443b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:17:02.167822 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-33cc0a47-0521-4e33-9a93-ffb821c5443b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:17:02.175198 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-33cc0a47-0521-4e33-9a93-ffb821c5443b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 200 len: 1364 microversion: 2.1 time: 0.151092 Jul 18 03:17:02.175769 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3434/6850] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:17:02 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:17:03.193100 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e62eb53e-7dd4-4d40-90b9-651e04e2df92 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:17:03.193645 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e62eb53e-7dd4-4d40-90b9-651e04e2df92 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:17:03.201322 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e62eb53e-7dd4-4d40-90b9-651e04e2df92 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:17:03.201834 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e62eb53e-7dd4-4d40-90b9-651e04e2df92 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:17:03.202573 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e62eb53e-7dd4-4d40-90b9-651e04e2df92 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:17:03.203013 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e62eb53e-7dd4-4d40-90b9-651e04e2df92 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:17:03.338224 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e62eb53e-7dd4-4d40-90b9-651e04e2df92 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:17:03.345908 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e62eb53e-7dd4-4d40-90b9-651e04e2df92 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 200 len: 1364 microversion: 2.1 time: 0.156794 Jul 18 03:17:03.346391 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3417/6851] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:17:03 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:17:04.363428 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b879b823-210a-4be8-a8f9-112a71c7d0bb tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:17:04.364046 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b879b823-210a-4be8-a8f9-112a71c7d0bb tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:17:04.372090 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b879b823-210a-4be8-a8f9-112a71c7d0bb tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:17:04.372555 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b879b823-210a-4be8-a8f9-112a71c7d0bb tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:17:04.373333 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b879b823-210a-4be8-a8f9-112a71c7d0bb tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:17:04.373816 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b879b823-210a-4be8-a8f9-112a71c7d0bb tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:17:04.508634 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b879b823-210a-4be8-a8f9-112a71c7d0bb tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:17:04.516139 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b879b823-210a-4be8-a8f9-112a71c7d0bb tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 200 len: 1364 microversion: 2.1 time: 0.156589 Jul 18 03:17:04.516724 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3435/6852] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:17:04 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:17:04.592191 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-94078f6b-89d5-4e78-8faf-875073689331 req-bcb0d2f3-8834-4648-8b8d-90d1a0f5af4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c630e4c-54bc-4ddf-84d5-e9a38af2adbd", "name": "network-vif-plugged", "status": "completed", "tag": "924f42e5-64e4-4312-b987-dc8df78a5007"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:17:04.603182 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-94078f6b-89d5-4e78-8faf-875073689331 req-bcb0d2f3-8834-4648-8b8d-90d1a0f5af4f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:17:04.603665 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-94078f6b-89d5-4e78-8faf-875073689331 req-bcb0d2f3-8834-4648-8b8d-90d1a0f5af4f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:17:04.615714 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-94078f6b-89d5-4e78-8faf-875073689331 req-bcb0d2f3-8834-4648-8b8d-90d1a0f5af4f service nova] Creating event network-vif-plugged:924f42e5-64e4-4312-b987-dc8df78a5007 for instance 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd on n-h1-465891-3 Jul 18 03:17:04.622486 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-94078f6b-89d5-4e78-8faf-875073689331 req-bcb0d2f3-8834-4648-8b8d-90d1a0f5af4f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034032 Jul 18 03:17:04.623121 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3418/6853] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:17:05.533727 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e88f6a1e-ba7c-4315-bd47-64d67f9af4c4 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:17:05.534411 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e88f6a1e-ba7c-4315-bd47-64d67f9af4c4 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:17:05.541612 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e88f6a1e-ba7c-4315-bd47-64d67f9af4c4 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:17:05.542104 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e88f6a1e-ba7c-4315-bd47-64d67f9af4c4 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:17:05.542893 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e88f6a1e-ba7c-4315-bd47-64d67f9af4c4 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:17:05.543343 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e88f6a1e-ba7c-4315-bd47-64d67f9af4c4 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:17:05.677001 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e88f6a1e-ba7c-4315-bd47-64d67f9af4c4 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:17:05.685140 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e88f6a1e-ba7c-4315-bd47-64d67f9af4c4 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 200 len: 1364 microversion: 2.1 time: 0.155286 Jul 18 03:17:05.685745 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3436/6854] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:17:05 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:17:06.700543 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:17:06.701311 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:17:06.705595 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5ac45153-1c81-43a1-9997-a4f870845a86 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:17:06.706290 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5ac45153-1c81-43a1-9997-a4f870845a86 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:17:06.714500 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ac45153-1c81-43a1-9997-a4f870845a86 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:17:06.714932 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ac45153-1c81-43a1-9997-a4f870845a86 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:17:06.715700 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ac45153-1c81-43a1-9997-a4f870845a86 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:17:06.716140 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ac45153-1c81-43a1-9997-a4f870845a86 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:17:06.850043 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5ac45153-1c81-43a1-9997-a4f870845a86 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:17:06.857682 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5ac45153-1c81-43a1-9997-a4f870845a86 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 200 len: 1551 microversion: 2.1 time: 0.159034 Jul 18 03:17:06.858277 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3419/6855] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:17:06 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 1551 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:17:06.874583 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9e88ac82-1928-47ad-99a9-49d0d03b1589 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:17:06.875102 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9e88ac82-1928-47ad-99a9-49d0d03b1589 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:17:06.876995 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:17:06.883733 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e88ac82-1928-47ad-99a9-49d0d03b1589 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:17:06.884191 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e88ac82-1928-47ad-99a9-49d0d03b1589 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:17:06.884968 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e88ac82-1928-47ad-99a9-49d0d03b1589 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:17:06.885411 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e88ac82-1928-47ad-99a9-49d0d03b1589 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:17:06.962790 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9e88ac82-1928-47ad-99a9-49d0d03b1589 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092017 Jul 18 03:17:06.963400 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3437/6856] 10.222.0.57 () {58 vars in 1274 bytes} [Mon Jul 18 03:17:06 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:17:08.292719 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-b39ede24-a757-4e9a-8007-d7b21b5b1ffa req-710030b1-5ecb-4f18-9537-2732f342c5c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c630e4c-54bc-4ddf-84d5-e9a38af2adbd", "tag": "924f42e5-64e4-4312-b987-dc8df78a5007"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:17:08.300944 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-b39ede24-a757-4e9a-8007-d7b21b5b1ffa req-710030b1-5ecb-4f18-9537-2732f342c5c9 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:17:08.301390 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-b39ede24-a757-4e9a-8007-d7b21b5b1ffa req-710030b1-5ecb-4f18-9537-2732f342c5c9 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:17:08.316221 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-b39ede24-a757-4e9a-8007-d7b21b5b1ffa req-710030b1-5ecb-4f18-9537-2732f342c5c9 service nova] Creating event network-changed:924f42e5-64e4-4312-b987-dc8df78a5007 for instance 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd on n-h1-465891-3 Jul 18 03:17:08.322118 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-b39ede24-a757-4e9a-8007-d7b21b5b1ffa req-710030b1-5ecb-4f18-9537-2732f342c5c9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092746 Jul 18 03:17:08.322758 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3420/6857] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:18:22.625063 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=17 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:18:22.625899 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=56 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:18:22.630540 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-eccc8fc5-adfc-415a-a2b4-2a4b1c5266fa tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:18:22.631520 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-eccc8fc5-adfc-415a-a2b4-2a4b1c5266fa tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:22.638752 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eccc8fc5-adfc-415a-a2b4-2a4b1c5266fa tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:22.639220 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eccc8fc5-adfc-415a-a2b4-2a4b1c5266fa tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:22.640025 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eccc8fc5-adfc-415a-a2b4-2a4b1c5266fa tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:22.640472 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-eccc8fc5-adfc-415a-a2b4-2a4b1c5266fa tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:22.669915 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-eccc8fc5-adfc-415a-a2b4-2a4b1c5266fa tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:22.676789 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-eccc8fc5-adfc-415a-a2b4-2a4b1c5266fa tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Old instance type m1.heat2, new instance type m1.heat {{(pid=119543) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 03:18:22.683923 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-eccc8fc5-adfc-415a-a2b4-2a4b1c5266fa tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:18:22.684354 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-eccc8fc5-adfc-415a-a2b4-2a4b1c5266fa tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:18:22.685624 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-eccc8fc5-adfc-415a-a2b4-2a4b1c5266fa tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:18:22.686337 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-eccc8fc5-adfc-415a-a2b4-2a4b1c5266fa tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:18:22.686441 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-eccc8fc5-adfc-415a-a2b4-2a4b1c5266fa tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:18:22.757050 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-eccc8fc5-adfc-415a-a2b4-2a4b1c5266fa tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "POST /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd/action" status: 202 len: 0 microversion: 2.1 time: 0.134860 Jul 18 03:18:22.757672 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3438/6858] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:18:22 2022] POST /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:18:22.765172 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:18:22.766035 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:18:22.771359 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d279951b-22b6-4fe2-9209-cf82079a00b4 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:22.772179 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d279951b-22b6-4fe2-9209-cf82079a00b4 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:22.781476 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d279951b-22b6-4fe2-9209-cf82079a00b4 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:22.781947 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d279951b-22b6-4fe2-9209-cf82079a00b4 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:22.782898 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d279951b-22b6-4fe2-9209-cf82079a00b4 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:22.783450 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d279951b-22b6-4fe2-9209-cf82079a00b4 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:22.967292 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d279951b-22b6-4fe2-9209-cf82079a00b4 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:22.983532 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d279951b-22b6-4fe2-9209-cf82079a00b4 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 200 len: 1679 microversion: 2.1 time: 0.217244 Jul 18 03:18:22.983532 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3421/6859] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:22 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 1679 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:24.005622 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-89ad4acc-c78e-487b-bb73-482320e066ec tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:24.006727 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-89ad4acc-c78e-487b-bb73-482320e066ec tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:24.017086 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-89ad4acc-c78e-487b-bb73-482320e066ec tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:24.017823 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-89ad4acc-c78e-487b-bb73-482320e066ec tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:24.018724 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-89ad4acc-c78e-487b-bb73-482320e066ec tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:24.019226 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-89ad4acc-c78e-487b-bb73-482320e066ec tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:24.163505 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-89ad4acc-c78e-487b-bb73-482320e066ec tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:24.172561 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-89ad4acc-c78e-487b-bb73-482320e066ec tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 200 len: 1679 microversion: 2.1 time: 0.176701 Jul 18 03:18:24.173174 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3439/6860] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:23 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 1679 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:25.190712 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3b13c78d-a687-4fc7-afa9-ea4ac24c2991 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:25.192141 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3b13c78d-a687-4fc7-afa9-ea4ac24c2991 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:25.199267 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b13c78d-a687-4fc7-afa9-ea4ac24c2991 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:25.199717 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b13c78d-a687-4fc7-afa9-ea4ac24c2991 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:25.201154 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b13c78d-a687-4fc7-afa9-ea4ac24c2991 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:25.201738 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3b13c78d-a687-4fc7-afa9-ea4ac24c2991 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:25.348513 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3b13c78d-a687-4fc7-afa9-ea4ac24c2991 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:25.356134 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3b13c78d-a687-4fc7-afa9-ea4ac24c2991 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 200 len: 1684 microversion: 2.1 time: 0.169322 Jul 18 03:18:25.356879 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3422/6861] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:25 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 1684 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:26.373616 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2bba9aa6-8646-4060-ae8d-99f5f9252f71 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:26.374262 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2bba9aa6-8646-4060-ae8d-99f5f9252f71 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:26.381102 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2bba9aa6-8646-4060-ae8d-99f5f9252f71 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:26.381560 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2bba9aa6-8646-4060-ae8d-99f5f9252f71 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:26.382369 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2bba9aa6-8646-4060-ae8d-99f5f9252f71 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:26.382817 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2bba9aa6-8646-4060-ae8d-99f5f9252f71 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:26.516796 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2bba9aa6-8646-4060-ae8d-99f5f9252f71 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:26.524556 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2bba9aa6-8646-4060-ae8d-99f5f9252f71 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 200 len: 1684 microversion: 2.1 time: 0.154989 Jul 18 03:18:26.525147 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3440/6862] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:26 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:27.542888 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8c3872cc-3562-438e-bdb3-038d7ae3606b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:27.543503 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8c3872cc-3562-438e-bdb3-038d7ae3606b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:27.551402 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8c3872cc-3562-438e-bdb3-038d7ae3606b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:27.551845 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8c3872cc-3562-438e-bdb3-038d7ae3606b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:27.552620 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8c3872cc-3562-438e-bdb3-038d7ae3606b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:27.553050 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8c3872cc-3562-438e-bdb3-038d7ae3606b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:27.702080 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8c3872cc-3562-438e-bdb3-038d7ae3606b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:27.709720 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8c3872cc-3562-438e-bdb3-038d7ae3606b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 200 len: 1684 microversion: 2.1 time: 0.170748 Jul 18 03:18:27.710300 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3423/6863] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:27 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 1684 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:18:28.728686 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-37b811f1-c406-428c-bbd0-75398cc1371b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:28.729368 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-37b811f1-c406-428c-bbd0-75398cc1371b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:28.737084 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-37b811f1-c406-428c-bbd0-75398cc1371b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:28.737555 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-37b811f1-c406-428c-bbd0-75398cc1371b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:28.738380 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-37b811f1-c406-428c-bbd0-75398cc1371b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:28.738830 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-37b811f1-c406-428c-bbd0-75398cc1371b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:28.881344 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-37b811f1-c406-428c-bbd0-75398cc1371b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:28.889204 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-37b811f1-c406-428c-bbd0-75398cc1371b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 200 len: 1684 microversion: 2.1 time: 0.165247 Jul 18 03:18:28.889807 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3441/6864] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:28 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 1684 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:29.906948 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-00be054c-d95b-4d95-aa34-5e94c2bd9ba9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:29.907596 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-00be054c-d95b-4d95-aa34-5e94c2bd9ba9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:29.914879 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-00be054c-d95b-4d95-aa34-5e94c2bd9ba9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:29.915321 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-00be054c-d95b-4d95-aa34-5e94c2bd9ba9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:29.916185 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-00be054c-d95b-4d95-aa34-5e94c2bd9ba9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:29.916710 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-00be054c-d95b-4d95-aa34-5e94c2bd9ba9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:30.052619 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-00be054c-d95b-4d95-aa34-5e94c2bd9ba9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:30.060919 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-00be054c-d95b-4d95-aa34-5e94c2bd9ba9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 200 len: 1684 microversion: 2.1 time: 0.158397 Jul 18 03:18:30.061502 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3424/6865] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:29 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:31.079298 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-24a2b35f-4e69-470f-aec6-cdbb45d42c9f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:31.079980 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-24a2b35f-4e69-470f-aec6-cdbb45d42c9f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:31.088089 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-24a2b35f-4e69-470f-aec6-cdbb45d42c9f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:31.088583 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-24a2b35f-4e69-470f-aec6-cdbb45d42c9f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:31.089377 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-24a2b35f-4e69-470f-aec6-cdbb45d42c9f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:31.089874 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-24a2b35f-4e69-470f-aec6-cdbb45d42c9f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:31.245004 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-24a2b35f-4e69-470f-aec6-cdbb45d42c9f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:31.253837 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-24a2b35f-4e69-470f-aec6-cdbb45d42c9f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 200 len: 1684 microversion: 2.1 time: 0.179212 Jul 18 03:18:31.254436 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3442/6866] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:31 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 1684 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:32.271470 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5593685c-24ce-48f8-ab82-474f2ae6b46a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:32.272212 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5593685c-24ce-48f8-ab82-474f2ae6b46a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:32.279898 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5593685c-24ce-48f8-ab82-474f2ae6b46a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:32.280830 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5593685c-24ce-48f8-ab82-474f2ae6b46a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:32.281353 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5593685c-24ce-48f8-ab82-474f2ae6b46a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:32.281821 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5593685c-24ce-48f8-ab82-474f2ae6b46a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:32.434084 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5593685c-24ce-48f8-ab82-474f2ae6b46a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:32.442620 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5593685c-24ce-48f8-ab82-474f2ae6b46a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 200 len: 1684 microversion: 2.1 time: 0.175159 Jul 18 03:18:32.443209 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3425/6867] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:32 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 1684 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:33.460357 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4e4a97e7-d19b-4bf9-97b8-7bbeaf85de44 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:33.460984 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4e4a97e7-d19b-4bf9-97b8-7bbeaf85de44 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:33.468256 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4e4a97e7-d19b-4bf9-97b8-7bbeaf85de44 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:33.468723 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4e4a97e7-d19b-4bf9-97b8-7bbeaf85de44 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:33.469518 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4e4a97e7-d19b-4bf9-97b8-7bbeaf85de44 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:33.470006 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4e4a97e7-d19b-4bf9-97b8-7bbeaf85de44 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:33.620133 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4e4a97e7-d19b-4bf9-97b8-7bbeaf85de44 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:33.634823 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4e4a97e7-d19b-4bf9-97b8-7bbeaf85de44 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 200 len: 1684 microversion: 2.1 time: 0.172527 Jul 18 03:18:33.634823 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3443/6868] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:33 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 1684 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:34.647505 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fdd6b873-a55e-452f-95ef-0d659cec5b6e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:34.648122 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fdd6b873-a55e-452f-95ef-0d659cec5b6e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:34.655896 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fdd6b873-a55e-452f-95ef-0d659cec5b6e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:34.656355 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fdd6b873-a55e-452f-95ef-0d659cec5b6e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:34.657127 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fdd6b873-a55e-452f-95ef-0d659cec5b6e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:34.657569 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fdd6b873-a55e-452f-95ef-0d659cec5b6e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:34.797177 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fdd6b873-a55e-452f-95ef-0d659cec5b6e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:34.805027 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fdd6b873-a55e-452f-95ef-0d659cec5b6e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 200 len: 1684 microversion: 2.1 time: 0.161486 Jul 18 03:18:34.805618 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3426/6869] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:34 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 1684 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:35.821526 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-abfa21b2-ce98-4856-854f-8fe216013754 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:35.822237 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-abfa21b2-ce98-4856-854f-8fe216013754 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:35.829910 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-abfa21b2-ce98-4856-854f-8fe216013754 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:35.830375 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-abfa21b2-ce98-4856-854f-8fe216013754 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:35.831165 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-abfa21b2-ce98-4856-854f-8fe216013754 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:35.831617 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-abfa21b2-ce98-4856-854f-8fe216013754 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:35.961146 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-abfa21b2-ce98-4856-854f-8fe216013754 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:35.968833 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-abfa21b2-ce98-4856-854f-8fe216013754 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 200 len: 1684 microversion: 2.1 time: 0.151238 Jul 18 03:18:35.969406 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3444/6870] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:35 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:36.989899 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-12381e40-b013-4ae1-a9b6-5ac5b731c852 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:36.991368 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-12381e40-b013-4ae1-a9b6-5ac5b731c852 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:36.998358 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-12381e40-b013-4ae1-a9b6-5ac5b731c852 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:36.998806 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-12381e40-b013-4ae1-a9b6-5ac5b731c852 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:36.999583 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-12381e40-b013-4ae1-a9b6-5ac5b731c852 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:37.000038 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-12381e40-b013-4ae1-a9b6-5ac5b731c852 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:37.201992 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-12381e40-b013-4ae1-a9b6-5ac5b731c852 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:37.209601 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-12381e40-b013-4ae1-a9b6-5ac5b731c852 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 200 len: 1683 microversion: 2.1 time: 0.227365 Jul 18 03:18:37.210211 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3427/6871] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:36 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 1683 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:37.512680 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-e642fd35-98e1-4ce5-a7f5-aba38bdca50c req-4eff5ab9-606e-42f7-be7c-8af5a107e6ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c630e4c-54bc-4ddf-84d5-e9a38af2adbd", "name": "network-vif-unplugged", "status": "completed", "tag": "924f42e5-64e4-4312-b987-dc8df78a5007"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:18:37.522917 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-e642fd35-98e1-4ce5-a7f5-aba38bdca50c req-4eff5ab9-606e-42f7-be7c-8af5a107e6ab service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:37.523606 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-e642fd35-98e1-4ce5-a7f5-aba38bdca50c req-4eff5ab9-606e-42f7-be7c-8af5a107e6ab service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:37.537463 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-e642fd35-98e1-4ce5-a7f5-aba38bdca50c req-4eff5ab9-606e-42f7-be7c-8af5a107e6ab service nova] Creating event network-vif-unplugged:924f42e5-64e4-4312-b987-dc8df78a5007 for instance 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd on n-h2-465891-3 Jul 18 03:18:37.543178 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [req-e642fd35-98e1-4ce5-a7f5-aba38bdca50c req-4eff5ab9-606e-42f7-be7c-8af5a107e6ab service nova] Instance 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3', 'n-h2-465891-3'} {{(pid=119543) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:18:37.556717 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-e642fd35-98e1-4ce5-a7f5-aba38bdca50c req-4eff5ab9-606e-42f7-be7c-8af5a107e6ab service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047934 Jul 18 03:18:37.557751 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3445/6872] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:18:38.227897 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-37b661a9-7450-48d5-b063-20d30cc39104 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:38.228440 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-37b661a9-7450-48d5-b063-20d30cc39104 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:38.236882 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-37b661a9-7450-48d5-b063-20d30cc39104 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:38.237330 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-37b661a9-7450-48d5-b063-20d30cc39104 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:38.238137 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-37b661a9-7450-48d5-b063-20d30cc39104 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:38.238567 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-37b661a9-7450-48d5-b063-20d30cc39104 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:38.434857 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-37b661a9-7450-48d5-b063-20d30cc39104 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:38.442814 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-37b661a9-7450-48d5-b063-20d30cc39104 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 200 len: 1683 microversion: 2.1 time: 0.218925 Jul 18 03:18:38.443617 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3428/6873] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:38 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 1683 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:39.461259 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8d43b6f5-5644-4662-82c7-b398c428f597 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:39.462003 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8d43b6f5-5644-4662-82c7-b398c428f597 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:39.469422 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8d43b6f5-5644-4662-82c7-b398c428f597 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:39.469916 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8d43b6f5-5644-4662-82c7-b398c428f597 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:39.470853 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8d43b6f5-5644-4662-82c7-b398c428f597 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:39.471304 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8d43b6f5-5644-4662-82c7-b398c428f597 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:39.570909 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-10b91a13-30bd-4f70-8f66-6d4de3b1d925 req-b308bc12-cea3-40b2-b9bb-28453b565f87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c630e4c-54bc-4ddf-84d5-e9a38af2adbd", "tag": "924f42e5-64e4-4312-b987-dc8df78a5007"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:18:39.580464 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-10b91a13-30bd-4f70-8f66-6d4de3b1d925 req-b308bc12-cea3-40b2-b9bb-28453b565f87 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:39.580908 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-10b91a13-30bd-4f70-8f66-6d4de3b1d925 req-b308bc12-cea3-40b2-b9bb-28453b565f87 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:39.593079 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-10b91a13-30bd-4f70-8f66-6d4de3b1d925 req-b308bc12-cea3-40b2-b9bb-28453b565f87 service nova] Creating event network-changed:924f42e5-64e4-4312-b987-dc8df78a5007 for instance 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd on n-h2-465891-3 Jul 18 03:18:39.598818 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [req-10b91a13-30bd-4f70-8f66-6d4de3b1d925 req-b308bc12-cea3-40b2-b9bb-28453b565f87 service nova] Instance 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3', 'n-h2-465891-3'} {{(pid=119544) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:18:39.610469 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-10b91a13-30bd-4f70-8f66-6d4de3b1d925 req-b308bc12-cea3-40b2-b9bb-28453b565f87 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043122 Jul 18 03:18:39.611095 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3429/6874] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:18:39.615944 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8d43b6f5-5644-4662-82c7-b398c428f597 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:39.625663 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8d43b6f5-5644-4662-82c7-b398c428f597 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 200 len: 1681 microversion: 2.1 time: 0.167674 Jul 18 03:18:39.625663 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3446/6875] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:39 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:40.643345 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8f6fa016-bff6-4e45-b0f4-fc75c9a327bd tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:40.644077 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8f6fa016-bff6-4e45-b0f4-fc75c9a327bd tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:40.650447 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8f6fa016-bff6-4e45-b0f4-fc75c9a327bd tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:40.651057 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8f6fa016-bff6-4e45-b0f4-fc75c9a327bd tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:40.651895 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8f6fa016-bff6-4e45-b0f4-fc75c9a327bd tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:40.652407 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8f6fa016-bff6-4e45-b0f4-fc75c9a327bd tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:40.786281 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8f6fa016-bff6-4e45-b0f4-fc75c9a327bd tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:40.793810 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8f6fa016-bff6-4e45-b0f4-fc75c9a327bd tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 200 len: 1678 microversion: 2.1 time: 0.156015 Jul 18 03:18:40.794389 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3430/6876] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:40 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:40.810286 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-64aea700-f68e-4aad-ab77-f778661ed46c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:18:40.810831 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-64aea700-f68e-4aad-ab77-f778661ed46c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:40.817720 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-64aea700-f68e-4aad-ab77-f778661ed46c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:40.818207 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-64aea700-f68e-4aad-ab77-f778661ed46c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:40.818993 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-64aea700-f68e-4aad-ab77-f778661ed46c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:40.819451 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-64aea700-f68e-4aad-ab77-f778661ed46c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:40.857364 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-64aea700-f68e-4aad-ab77-f778661ed46c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:40.857876 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-64aea700-f68e-4aad-ab77-f778661ed46c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:40.858702 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-64aea700-f68e-4aad-ab77-f778661ed46c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:40.859158 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-64aea700-f68e-4aad-ab77-f778661ed46c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:40.879650 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-64aea700-f68e-4aad-ab77-f778661ed46c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Getting quotas for project 735af4c358a64b9cbc4a61a33985b9b1. Resources: {'cores', 'ram'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:18:40.884851 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-64aea700-f68e-4aad-ab77-f778661ed46c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Getting quotas for user 16f0c35138a3430f97850934128310d1 and project 735af4c358a64b9cbc4a61a33985b9b1. Resources: {'cores', 'ram'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:18:40.986433 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-64aea700-f68e-4aad-ab77-f778661ed46c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "POST /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd/action" status: 202 len: 0 microversion: 2.1 time: 0.179726 Jul 18 03:18:40.986965 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3447/6877] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:18:40 2022] POST /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:18:40.996017 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3dd4f6c6-c4ed-4f2c-b5ae-eac0cabbaafc tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:40.996634 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3dd4f6c6-c4ed-4f2c-b5ae-eac0cabbaafc tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:41.003352 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3dd4f6c6-c4ed-4f2c-b5ae-eac0cabbaafc tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:41.003956 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3dd4f6c6-c4ed-4f2c-b5ae-eac0cabbaafc tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:41.004747 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3dd4f6c6-c4ed-4f2c-b5ae-eac0cabbaafc tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:41.005269 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3dd4f6c6-c4ed-4f2c-b5ae-eac0cabbaafc tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:41.219993 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3dd4f6c6-c4ed-4f2c-b5ae-eac0cabbaafc tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:41.227938 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3dd4f6c6-c4ed-4f2c-b5ae-eac0cabbaafc tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 200 len: 1677 microversion: 2.1 time: 0.236620 Jul 18 03:18:41.228535 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3431/6878] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:40 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 1677 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:42.247481 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8cff95b3-7ca8-4b45-8a96-a53913f28267 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:42.248157 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8cff95b3-7ca8-4b45-8a96-a53913f28267 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:42.254438 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8cff95b3-7ca8-4b45-8a96-a53913f28267 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:42.254896 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8cff95b3-7ca8-4b45-8a96-a53913f28267 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:42.255665 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8cff95b3-7ca8-4b45-8a96-a53913f28267 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:42.256162 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8cff95b3-7ca8-4b45-8a96-a53913f28267 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:42.403529 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8cff95b3-7ca8-4b45-8a96-a53913f28267 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:42.412049 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8cff95b3-7ca8-4b45-8a96-a53913f28267 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 200 len: 1677 microversion: 2.1 time: 0.169996 Jul 18 03:18:42.412648 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3448/6879] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:42 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:43.430407 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8bb6777a-b07e-48b5-b9fe-f266ca02f604 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:43.431228 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8bb6777a-b07e-48b5-b9fe-f266ca02f604 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:43.439870 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8bb6777a-b07e-48b5-b9fe-f266ca02f604 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:43.440326 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8bb6777a-b07e-48b5-b9fe-f266ca02f604 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:43.441130 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8bb6777a-b07e-48b5-b9fe-f266ca02f604 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:43.441806 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8bb6777a-b07e-48b5-b9fe-f266ca02f604 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:43.645149 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8bb6777a-b07e-48b5-b9fe-f266ca02f604 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:43.653037 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8bb6777a-b07e-48b5-b9fe-f266ca02f604 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 200 len: 1677 microversion: 2.1 time: 0.226888 Jul 18 03:18:43.653613 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3432/6880] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:43 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 1677 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:44.671526 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3578e985-74aa-4986-984f-bee1c5e532c6 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:44.672243 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3578e985-74aa-4986-984f-bee1c5e532c6 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:44.679700 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3578e985-74aa-4986-984f-bee1c5e532c6 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:44.680169 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3578e985-74aa-4986-984f-bee1c5e532c6 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:44.681232 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3578e985-74aa-4986-984f-bee1c5e532c6 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:44.681695 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3578e985-74aa-4986-984f-bee1c5e532c6 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:44.901935 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3578e985-74aa-4986-984f-bee1c5e532c6 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:44.910661 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3578e985-74aa-4986-984f-bee1c5e532c6 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 200 len: 1677 microversion: 2.1 time: 0.243959 Jul 18 03:18:44.911242 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3449/6881] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:44 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 1677 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:44.982126 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-40f689d0-3968-49b4-9cb3-a726b342613a req-84e969ab-fe0b-4847-8bfc-a97e678cfbf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c630e4c-54bc-4ddf-84d5-e9a38af2adbd", "tag": "924f42e5-64e4-4312-b987-dc8df78a5007"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:18:44.997043 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-40f689d0-3968-49b4-9cb3-a726b342613a req-84e969ab-fe0b-4847-8bfc-a97e678cfbf9 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:44.998595 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-40f689d0-3968-49b4-9cb3-a726b342613a req-84e969ab-fe0b-4847-8bfc-a97e678cfbf9 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:45.011721 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-40f689d0-3968-49b4-9cb3-a726b342613a req-84e969ab-fe0b-4847-8bfc-a97e678cfbf9 service nova] Creating event network-changed:924f42e5-64e4-4312-b987-dc8df78a5007 for instance 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd on n-h1-465891-3 Jul 18 03:18:45.024012 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [req-40f689d0-3968-49b4-9cb3-a726b342613a req-84e969ab-fe0b-4847-8bfc-a97e678cfbf9 service nova] Instance 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3', 'n-h2-465891-3'} {{(pid=119544) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:18:45.037790 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-40f689d0-3968-49b4-9cb3-a726b342613a req-84e969ab-fe0b-4847-8bfc-a97e678cfbf9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059611 Jul 18 03:18:45.038778 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3433/6882] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:18:45.928303 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9d97fdba-fdba-4cac-a177-226f5d908e9c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:45.928966 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9d97fdba-fdba-4cac-a177-226f5d908e9c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:45.936283 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9d97fdba-fdba-4cac-a177-226f5d908e9c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:45.936743 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9d97fdba-fdba-4cac-a177-226f5d908e9c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:45.937541 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9d97fdba-fdba-4cac-a177-226f5d908e9c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:45.938023 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9d97fdba-fdba-4cac-a177-226f5d908e9c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:45.958870 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:18:46.079217 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9d97fdba-fdba-4cac-a177-226f5d908e9c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:46.087287 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9d97fdba-fdba-4cac-a177-226f5d908e9c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 200 len: 1677 microversion: 2.1 time: 0.162856 Jul 18 03:18:46.087885 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3450/6883] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:45 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:47.108587 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e27a2184-dbfa-48da-9151-f30d0a3ab052 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:47.109432 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e27a2184-dbfa-48da-9151-f30d0a3ab052 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:47.117174 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e27a2184-dbfa-48da-9151-f30d0a3ab052 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:47.117731 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e27a2184-dbfa-48da-9151-f30d0a3ab052 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:47.118528 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e27a2184-dbfa-48da-9151-f30d0a3ab052 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:47.118969 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e27a2184-dbfa-48da-9151-f30d0a3ab052 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:47.262218 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e27a2184-dbfa-48da-9151-f30d0a3ab052 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:47.271819 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e27a2184-dbfa-48da-9151-f30d0a3ab052 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 200 len: 1677 microversion: 2.1 time: 0.169316 Jul 18 03:18:47.272436 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3434/6884] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:47 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:48.288627 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ddf7fdb7-887d-43fe-917e-dd2da11aa951 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:48.289199 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ddf7fdb7-887d-43fe-917e-dd2da11aa951 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:48.298033 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ddf7fdb7-887d-43fe-917e-dd2da11aa951 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:48.298504 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ddf7fdb7-887d-43fe-917e-dd2da11aa951 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:48.299386 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ddf7fdb7-887d-43fe-917e-dd2da11aa951 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:48.299846 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ddf7fdb7-887d-43fe-917e-dd2da11aa951 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:48.539060 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ddf7fdb7-887d-43fe-917e-dd2da11aa951 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:48.547661 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ddf7fdb7-887d-43fe-917e-dd2da11aa951 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 200 len: 1677 microversion: 2.1 time: 0.262982 Jul 18 03:18:48.548250 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3451/6885] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:48 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 1677 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:49.564939 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c57f8800-5360-4515-8cca-0d5c0e8cf663 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:49.565558 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c57f8800-5360-4515-8cca-0d5c0e8cf663 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:49.572892 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c57f8800-5360-4515-8cca-0d5c0e8cf663 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:49.573340 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c57f8800-5360-4515-8cca-0d5c0e8cf663 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:49.574141 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c57f8800-5360-4515-8cca-0d5c0e8cf663 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:49.574574 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c57f8800-5360-4515-8cca-0d5c0e8cf663 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:49.749295 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c57f8800-5360-4515-8cca-0d5c0e8cf663 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:49.757294 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c57f8800-5360-4515-8cca-0d5c0e8cf663 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 200 len: 1670 microversion: 2.1 time: 0.196604 Jul 18 03:18:49.757920 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3435/6886] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:49 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 1670 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:49.775039 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fe4f1021-9954-40b4-98ce-a25bced045d9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:49.776035 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fe4f1021-9954-40b4-98ce-a25bced045d9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:49.783902 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fe4f1021-9954-40b4-98ce-a25bced045d9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:49.784360 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fe4f1021-9954-40b4-98ce-a25bced045d9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:49.785146 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fe4f1021-9954-40b4-98ce-a25bced045d9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:49.785589 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fe4f1021-9954-40b4-98ce-a25bced045d9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:49.928267 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fe4f1021-9954-40b4-98ce-a25bced045d9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:49.936684 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fe4f1021-9954-40b4-98ce-a25bced045d9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 200 len: 1670 microversion: 2.1 time: 0.165680 Jul 18 03:18:49.937203 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3452/6887] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:49 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 1670 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:49.953503 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6e84b3cd-37ae-497d-86dc-5339577606d6 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:49.954201 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6e84b3cd-37ae-497d-86dc-5339577606d6 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:49.960492 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6e84b3cd-37ae-497d-86dc-5339577606d6 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:49.960944 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6e84b3cd-37ae-497d-86dc-5339577606d6 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:49.961743 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6e84b3cd-37ae-497d-86dc-5339577606d6 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:49.962184 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6e84b3cd-37ae-497d-86dc-5339577606d6 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:50.095420 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6e84b3cd-37ae-497d-86dc-5339577606d6 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:50.103393 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6e84b3cd-37ae-497d-86dc-5339577606d6 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 200 len: 1670 microversion: 2.1 time: 0.154725 Jul 18 03:18:50.103987 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3436/6888] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:49 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:50.119717 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-868ae586-4066-4218-bb47-2e7beeda0924 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:50.120260 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-868ae586-4066-4218-bb47-2e7beeda0924 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:50.126910 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-868ae586-4066-4218-bb47-2e7beeda0924 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:50.127371 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-868ae586-4066-4218-bb47-2e7beeda0924 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:50.128149 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-868ae586-4066-4218-bb47-2e7beeda0924 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:50.128598 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-868ae586-4066-4218-bb47-2e7beeda0924 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:50.155064 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-868ae586-4066-4218-bb47-2e7beeda0924 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:18:50.239616 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-868ae586-4066-4218-bb47-2e7beeda0924 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 204 len: 0 microversion: 2.1 time: 0.120160 Jul 18 03:18:50.240166 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3453/6889] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:18:50 2022] DELETE /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:18:50.249158 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f7d1d818-262e-4e0e-8165-68b624c7897c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:50.249799 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f7d1d818-262e-4e0e-8165-68b624c7897c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:50.256304 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f7d1d818-262e-4e0e-8165-68b624c7897c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:50.256752 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f7d1d818-262e-4e0e-8165-68b624c7897c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:50.257547 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f7d1d818-262e-4e0e-8165-68b624c7897c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:50.258273 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f7d1d818-262e-4e0e-8165-68b624c7897c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:50.399919 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f7d1d818-262e-4e0e-8165-68b624c7897c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:50.408315 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f7d1d818-262e-4e0e-8165-68b624c7897c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 200 len: 1676 microversion: 2.1 time: 0.163578 Jul 18 03:18:50.408914 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3437/6890] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:50 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:18:51.426304 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-923ea840-dd65-4824-a4e9-873aa8b89171 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:51.427014 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-923ea840-dd65-4824-a4e9-873aa8b89171 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:51.429878 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:18:51.436935 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-923ea840-dd65-4824-a4e9-873aa8b89171 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:51.437392 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-923ea840-dd65-4824-a4e9-873aa8b89171 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:51.438212 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-923ea840-dd65-4824-a4e9-873aa8b89171 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:51.438652 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-923ea840-dd65-4824-a4e9-873aa8b89171 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:51.578023 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-923ea840-dd65-4824-a4e9-873aa8b89171 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:51.585910 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-923ea840-dd65-4824-a4e9-873aa8b89171 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 200 len: 1676 microversion: 2.1 time: 0.163788 Jul 18 03:18:51.586503 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3454/6891] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:51 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:18:52.619210 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2c47a556-10c0-4805-8db3-a722c6bf06d4 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:52.621260 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2c47a556-10c0-4805-8db3-a722c6bf06d4 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:52.630078 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2c47a556-10c0-4805-8db3-a722c6bf06d4 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:52.631024 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2c47a556-10c0-4805-8db3-a722c6bf06d4 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:52.632039 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2c47a556-10c0-4805-8db3-a722c6bf06d4 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:52.632707 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2c47a556-10c0-4805-8db3-a722c6bf06d4 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:52.638871 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=100 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:18:52.910426 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2c47a556-10c0-4805-8db3-a722c6bf06d4 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:52.918481 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2c47a556-10c0-4805-8db3-a722c6bf06d4 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 200 len: 1608 microversion: 2.1 time: 0.303833 Jul 18 03:18:52.919080 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3438/6892] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:52 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 1608 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:18:53.102459 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-f736d35d-d99b-455a-bf16-5b788f59477b req-68ef8aed-824d-4b59-8681-296f6b373f5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c630e4c-54bc-4ddf-84d5-e9a38af2adbd", "name": "network-vif-deleted", "tag": "924f42e5-64e4-4312-b987-dc8df78a5007"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:18:53.108773 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:18:53.116835 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-f736d35d-d99b-455a-bf16-5b788f59477b req-68ef8aed-824d-4b59-8681-296f6b373f5e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:53.117294 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-f736d35d-d99b-455a-bf16-5b788f59477b req-68ef8aed-824d-4b59-8681-296f6b373f5e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:53.133745 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-f736d35d-d99b-455a-bf16-5b788f59477b req-68ef8aed-824d-4b59-8681-296f6b373f5e service nova] Creating event network-vif-deleted:924f42e5-64e4-4312-b987-dc8df78a5007 for instance 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd on n-h1-465891-3 Jul 18 03:18:53.139778 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-f736d35d-d99b-455a-bf16-5b788f59477b req-68ef8aed-824d-4b59-8681-296f6b373f5e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041761 Jul 18 03:18:53.141093 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3455/6893] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:18:53.937258 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-37cf4ce6-2363-47d3-9c9a-3ae2fd6d8378 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:53.938126 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-37cf4ce6-2363-47d3-9c9a-3ae2fd6d8378 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:53.940531 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=37 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:18:53.946182 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-37cf4ce6-2363-47d3-9c9a-3ae2fd6d8378 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:53.946624 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-37cf4ce6-2363-47d3-9c9a-3ae2fd6d8378 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:53.947412 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-37cf4ce6-2363-47d3-9c9a-3ae2fd6d8378 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:53.947853 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-37cf4ce6-2363-47d3-9c9a-3ae2fd6d8378 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:53.963561 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-37cf4ce6-2363-47d3-9c9a-3ae2fd6d8378 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] HTTP exception thrown: Instance 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd could not be found. Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-37cf4ce6-2363-47d3-9c9a-3ae2fd6d8378 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Request method failure captured: Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd HTTP/1.1 Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1NAG6n_J2rNfvjGE6tf7j0WubnLjYbUZkg89AdB_m51VufhJ39XnIb0TmV_VVToQ_i_5-V0sK6RpZIQpSTqBKYIT5BrJJ7toLiPDmvP9k5QSxkcWvnshbbMUZbr7tAQNfRbL8QooouumBDZt90piJMD7xS5_3rIJ9QUoKQLsChc4eY8 Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 735af4c358a64b9cbc4a61a33985b9b1 Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServerActionsTestJSON-695654908 Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/735af4c358a64b9cbc4a61a33985b9b1"}]}] Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServerActionsTestJSON-695654908 Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 735af4c358a64b9cbc4a61a33985b9b1 Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServerActionsTestJSON-695654908 Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServerActionsTestJSON-695654908-project Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 16f0c35138a3430f97850934128310d1 Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServerActionsTestJSON-695654908-project Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd could not be found. Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '3c630e4c-54bc-4ddf-84d5-e9a38af2adbd'} Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd could not be found. Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd could not be found. Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:18:53.965268 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:18:53.970187 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:18:53.970187 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:18:53.970187 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:18:53.970187 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:18:53.970187 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:18:53.970187 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd could not be found. Jul 18 03:18:53.970187 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:18:53.970187 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-37cf4ce6-2363-47d3-9c9a-3ae2fd6d8378 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Returning 404 to user: Instance 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:18:53.970187 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-37cf4ce6-2363-47d3-9c9a-3ae2fd6d8378 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 404 len: 111 microversion: 2.1 time: 0.034247 Jul 18 03:18:53.971264 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3439/6894] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:53 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:18:53.986647 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ef97192d-4c3b-4576-ba8b-3aeb78c96264 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:53.987357 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ef97192d-4c3b-4576-ba8b-3aeb78c96264 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:53.994240 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ef97192d-4c3b-4576-ba8b-3aeb78c96264 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:53.994743 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ef97192d-4c3b-4576-ba8b-3aeb78c96264 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:53.995546 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ef97192d-4c3b-4576-ba8b-3aeb78c96264 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:53.996002 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ef97192d-4c3b-4576-ba8b-3aeb78c96264 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:54.010324 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-ef97192d-4c3b-4576-ba8b-3aeb78c96264 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] HTTP exception thrown: Instance 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd could not be found. Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ef97192d-4c3b-4576-ba8b-3aeb78c96264 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Request method failure captured: Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd HTTP/1.1 Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1NAG6n_J2rNfvjGE6tf7j0WubnLjYbUZkg89AdB_m51VufhJ39XnIb0TmV_VVToQ_i_5-V0sK6RpZIQpSTqBKYIT5BrJJ7toLiPDmvP9k5QSxkcWvnshbbMUZbr7tAQNfRbL8QooouumBDZt90piJMD7xS5_3rIJ9QUoKQLsChc4eY8 Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 735af4c358a64b9cbc4a61a33985b9b1 Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServerActionsTestJSON-695654908 Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/735af4c358a64b9cbc4a61a33985b9b1"}]}] Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServerActionsTestJSON-695654908 Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 735af4c358a64b9cbc4a61a33985b9b1 Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServerActionsTestJSON-695654908 Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServerActionsTestJSON-695654908-project Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 16f0c35138a3430f97850934128310d1 Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServerActionsTestJSON-695654908-project Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd could not be found. Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '3c630e4c-54bc-4ddf-84d5-e9a38af2adbd'} Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd could not be found. Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd could not be found. Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:18:54.012027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:18:54.016583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:18:54.016583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:18:54.016583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:18:54.016583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:18:54.016583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:18:54.016583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd could not be found. Jul 18 03:18:54.016583 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:18:54.016583 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ef97192d-4c3b-4576-ba8b-3aeb78c96264 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Returning 404 to user: Instance 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:18:54.016583 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ef97192d-4c3b-4576-ba8b-3aeb78c96264 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 404 len: 111 microversion: 2.1 time: 0.031923 Jul 18 03:18:54.016583 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3456/6895] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:53 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:18:54.065549 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a7f9defe-3597-499d-a732-881bc8638df2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2022710729", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "8e69ecad-b2b9-49c6-8462-8ffe28d14bf7"}], "security_groups": [{"name": "tempest-securitygroup--1685166239"}], "key_name": "tempest-keypair-2023945870", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:18:54.174095 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-a7f9defe-3597-499d-a732-881bc8638df2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] validate_networks() for [('8e69ecad-b2b9-49c6-8462-8ffe28d14bf7', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:18:54.617277 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-a7f9defe-3597-499d-a732-881bc8638df2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:18:54.617990 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-a7f9defe-3597-499d-a732-881bc8638df2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:18:54.618464 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-a7f9defe-3597-499d-a732-881bc8638df2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:18:54.618866 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-a7f9defe-3597-499d-a732-881bc8638df2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:18:54.619271 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-a7f9defe-3597-499d-a732-881bc8638df2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:18:54.628773 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a7f9defe-3597-499d-a732-881bc8638df2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:54.629218 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a7f9defe-3597-499d-a732-881bc8638df2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:54.630057 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a7f9defe-3597-499d-a732-881bc8638df2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:54.630521 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a7f9defe-3597-499d-a732-881bc8638df2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:54.648105 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-a7f9defe-3597-499d-a732-881bc8638df2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Getting quotas for project 735af4c358a64b9cbc4a61a33985b9b1. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:18:54.653366 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-a7f9defe-3597-499d-a732-881bc8638df2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Getting quotas for user 16f0c35138a3430f97850934128310d1 and project 735af4c358a64b9cbc4a61a33985b9b1. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:18:54.666649 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a7f9defe-3597-499d-a732-881bc8638df2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:18:54.668896 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a7f9defe-3597-499d-a732-881bc8638df2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:18:54.715367 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a7f9defe-3597-499d-a732-881bc8638df2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.654617 Jul 18 03:18:54.716288 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3440/6896] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:18:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:18:54.727414 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-34f66bb9-f063-4a3b-8347-6c20448dc4fa tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:54.728137 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-34f66bb9-f063-4a3b-8347-6c20448dc4fa tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:54.791119 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-34f66bb9-f063-4a3b-8347-6c20448dc4fa tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:54.799850 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-34f66bb9-f063-4a3b-8347-6c20448dc4fa tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1239 microversion: 2.1 time: 0.076221 Jul 18 03:18:54.800435 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3457/6897] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:54 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1239 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:55.818722 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-12fbd670-6a42-4e82-ae89-c4dcb7c7e068 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:55.819353 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-12fbd670-6a42-4e82-ae89-c4dcb7c7e068 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:55.828766 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-12fbd670-6a42-4e82-ae89-c4dcb7c7e068 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:55.829220 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-12fbd670-6a42-4e82-ae89-c4dcb7c7e068 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:55.830046 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-12fbd670-6a42-4e82-ae89-c4dcb7c7e068 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:55.831577 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-12fbd670-6a42-4e82-ae89-c4dcb7c7e068 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:55.925254 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-12fbd670-6a42-4e82-ae89-c4dcb7c7e068 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:55.933149 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-12fbd670-6a42-4e82-ae89-c4dcb7c7e068 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1299 microversion: 2.1 time: 0.119346 Jul 18 03:18:55.933745 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3441/6898] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:55 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1299 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:56.952242 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5ebabab0-f3b8-4866-96f3-0ae8915561b1 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:56.952996 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5ebabab0-f3b8-4866-96f3-0ae8915561b1 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:56.960003 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5ebabab0-f3b8-4866-96f3-0ae8915561b1 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:56.960428 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5ebabab0-f3b8-4866-96f3-0ae8915561b1 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:56.961213 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5ebabab0-f3b8-4866-96f3-0ae8915561b1 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:56.961670 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5ebabab0-f3b8-4866-96f3-0ae8915561b1 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:57.203508 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5ebabab0-f3b8-4866-96f3-0ae8915561b1 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:57.211072 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5ebabab0-f3b8-4866-96f3-0ae8915561b1 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1365 microversion: 2.1 time: 0.263363 Jul 18 03:18:57.211655 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3458/6899] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:56 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1365 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:57.344198 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-af8e59b3-72a7-4a61-af09-6c458d2e28d7 req-23a03b06-ae5b-4e49-b0a9-793495e8cae0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cee99d7f-bb90-48d5-a676-52708eaf89ea", "tag": "22125498-7019-4f58-8d02-88a5992819a9"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:18:57.357145 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-af8e59b3-72a7-4a61-af09-6c458d2e28d7 req-23a03b06-ae5b-4e49-b0a9-793495e8cae0 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:57.358464 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-af8e59b3-72a7-4a61-af09-6c458d2e28d7 req-23a03b06-ae5b-4e49-b0a9-793495e8cae0 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:57.380697 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-af8e59b3-72a7-4a61-af09-6c458d2e28d7 req-23a03b06-ae5b-4e49-b0a9-793495e8cae0 service nova] Creating event network-changed:22125498-7019-4f58-8d02-88a5992819a9 for instance cee99d7f-bb90-48d5-a676-52708eaf89ea on n-h1-465891-3 Jul 18 03:18:57.385939 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-af8e59b3-72a7-4a61-af09-6c458d2e28d7 req-23a03b06-ae5b-4e49-b0a9-793495e8cae0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046109 Jul 18 03:18:57.386562 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3442/6900] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:18:58.229798 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d8642174-6fe5-4611-b993-eb19c582bd9f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:58.230429 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d8642174-6fe5-4611-b993-eb19c582bd9f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:58.238085 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d8642174-6fe5-4611-b993-eb19c582bd9f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:58.238548 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d8642174-6fe5-4611-b993-eb19c582bd9f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:58.239356 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d8642174-6fe5-4611-b993-eb19c582bd9f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:58.239804 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d8642174-6fe5-4611-b993-eb19c582bd9f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:58.378776 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d8642174-6fe5-4611-b993-eb19c582bd9f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:58.386283 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d8642174-6fe5-4611-b993-eb19c582bd9f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1365 microversion: 2.1 time: 0.160361 Jul 18 03:18:58.386860 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3459/6901] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:58 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:59.405573 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c86a1dd2-20be-48ea-bd4b-67152c7aa3a9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:59.406303 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c86a1dd2-20be-48ea-bd4b-67152c7aa3a9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:59.412678 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c86a1dd2-20be-48ea-bd4b-67152c7aa3a9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:59.413130 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c86a1dd2-20be-48ea-bd4b-67152c7aa3a9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:59.413935 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c86a1dd2-20be-48ea-bd4b-67152c7aa3a9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:59.414378 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c86a1dd2-20be-48ea-bd4b-67152c7aa3a9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:59.546005 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c86a1dd2-20be-48ea-bd4b-67152c7aa3a9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:59.553672 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c86a1dd2-20be-48ea-bd4b-67152c7aa3a9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1365 microversion: 2.1 time: 0.153398 Jul 18 03:18:59.554269 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3443/6902] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:59 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:19:00.572006 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b8e2025a-6d48-40e5-bc98-0c2c0af82540 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:19:00.572604 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b8e2025a-6d48-40e5-bc98-0c2c0af82540 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:19:00.580623 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b8e2025a-6d48-40e5-bc98-0c2c0af82540 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:19:00.581095 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b8e2025a-6d48-40e5-bc98-0c2c0af82540 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:19:00.581939 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b8e2025a-6d48-40e5-bc98-0c2c0af82540 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:19:00.582398 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b8e2025a-6d48-40e5-bc98-0c2c0af82540 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:19:00.789513 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b8e2025a-6d48-40e5-bc98-0c2c0af82540 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:19:00.797794 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b8e2025a-6d48-40e5-bc98-0c2c0af82540 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1365 microversion: 2.1 time: 0.229810 Jul 18 03:19:00.798380 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3460/6903] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:19:00 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1365 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:19:01.816910 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-76d5dc3f-ca98-402a-87c9-0debb50b1535 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:19:01.818053 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-76d5dc3f-ca98-402a-87c9-0debb50b1535 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:19:01.826684 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-76d5dc3f-ca98-402a-87c9-0debb50b1535 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:19:01.827246 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-76d5dc3f-ca98-402a-87c9-0debb50b1535 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:19:01.828034 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-76d5dc3f-ca98-402a-87c9-0debb50b1535 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:19:01.828485 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-76d5dc3f-ca98-402a-87c9-0debb50b1535 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:19:01.976464 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-76d5dc3f-ca98-402a-87c9-0debb50b1535 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:19:01.984291 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-76d5dc3f-ca98-402a-87c9-0debb50b1535 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1365 microversion: 2.1 time: 0.172031 Jul 18 03:19:01.984877 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3444/6904] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:19:01 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:19:03.001350 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-23fcd382-434b-4219-a8ed-ccaf4553f3bb tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:19:03.002008 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-23fcd382-434b-4219-a8ed-ccaf4553f3bb tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:19:03.009094 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-23fcd382-434b-4219-a8ed-ccaf4553f3bb tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:19:03.009558 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-23fcd382-434b-4219-a8ed-ccaf4553f3bb tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:19:03.010377 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-23fcd382-434b-4219-a8ed-ccaf4553f3bb tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:19:03.010857 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-23fcd382-434b-4219-a8ed-ccaf4553f3bb tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:19:03.150826 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-23fcd382-434b-4219-a8ed-ccaf4553f3bb tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:19:03.159113 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-23fcd382-434b-4219-a8ed-ccaf4553f3bb tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1365 microversion: 2.1 time: 0.161708 Jul 18 03:19:03.159698 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3461/6905] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:19:02 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:19:04.177979 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-79d02cf8-4580-4eb6-b5e0-cc77bc690280 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:19:04.178529 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-79d02cf8-4580-4eb6-b5e0-cc77bc690280 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:19:04.186979 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-79d02cf8-4580-4eb6-b5e0-cc77bc690280 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:19:04.187436 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-79d02cf8-4580-4eb6-b5e0-cc77bc690280 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:19:04.188228 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-79d02cf8-4580-4eb6-b5e0-cc77bc690280 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:19:04.188675 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-79d02cf8-4580-4eb6-b5e0-cc77bc690280 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:19:04.326810 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-79d02cf8-4580-4eb6-b5e0-cc77bc690280 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:19:04.334423 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-79d02cf8-4580-4eb6-b5e0-cc77bc690280 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1365 microversion: 2.1 time: 0.161478 Jul 18 03:19:04.335357 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3445/6906] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:19:04 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:19:05.283056 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-c69b526c-e446-443a-ba4d-982728d4bb3e req-58fa6340-19d5-465b-8452-48b7748cbb38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cee99d7f-bb90-48d5-a676-52708eaf89ea", "name": "network-vif-plugged", "status": "completed", "tag": "22125498-7019-4f58-8d02-88a5992819a9"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:19:05.291050 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:19:05.294042 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-c69b526c-e446-443a-ba4d-982728d4bb3e req-58fa6340-19d5-465b-8452-48b7748cbb38 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:19:05.295494 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-c69b526c-e446-443a-ba4d-982728d4bb3e req-58fa6340-19d5-465b-8452-48b7748cbb38 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:19:05.307889 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-c69b526c-e446-443a-ba4d-982728d4bb3e req-58fa6340-19d5-465b-8452-48b7748cbb38 service nova] Creating event network-vif-plugged:22125498-7019-4f58-8d02-88a5992819a9 for instance cee99d7f-bb90-48d5-a676-52708eaf89ea on n-h1-465891-3 Jul 18 03:19:05.314371 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-c69b526c-e446-443a-ba4d-982728d4bb3e req-58fa6340-19d5-465b-8452-48b7748cbb38 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035163 Jul 18 03:19:05.314992 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3462/6907] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:19:05.353438 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2e112ea6-a967-40df-9422-fdd4293df60f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:19:05.354772 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2e112ea6-a967-40df-9422-fdd4293df60f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:19:05.357306 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:19:05.358041 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:19:05.365271 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2e112ea6-a967-40df-9422-fdd4293df60f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:19:05.365742 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2e112ea6-a967-40df-9422-fdd4293df60f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:19:05.366711 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2e112ea6-a967-40df-9422-fdd4293df60f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:19:05.367153 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2e112ea6-a967-40df-9422-fdd4293df60f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:19:05.563734 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2e112ea6-a967-40df-9422-fdd4293df60f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:19:05.571284 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2e112ea6-a967-40df-9422-fdd4293df60f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1365 microversion: 2.1 time: 0.222187 Jul 18 03:19:05.571872 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3446/6908] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:19:05 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1365 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:19:06.590644 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a398f1f7-aa72-4903-9477-06f29f001e7e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:19:06.591363 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a398f1f7-aa72-4903-9477-06f29f001e7e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:19:06.597955 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a398f1f7-aa72-4903-9477-06f29f001e7e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:19:06.598423 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a398f1f7-aa72-4903-9477-06f29f001e7e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:19:06.599349 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a398f1f7-aa72-4903-9477-06f29f001e7e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:19:06.599810 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a398f1f7-aa72-4903-9477-06f29f001e7e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:19:06.734068 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a398f1f7-aa72-4903-9477-06f29f001e7e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:19:06.744270 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a398f1f7-aa72-4903-9477-06f29f001e7e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1365 microversion: 2.1 time: 0.158639 Jul 18 03:19:06.745508 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3463/6909] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:19:06 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:19:07.763765 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-04f9fe00-9cb9-4900-836d-25e7f2730d08 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:19:07.764502 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-04f9fe00-9cb9-4900-836d-25e7f2730d08 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:19:07.773968 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-04f9fe00-9cb9-4900-836d-25e7f2730d08 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:19:07.774598 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-04f9fe00-9cb9-4900-836d-25e7f2730d08 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:19:07.775491 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-04f9fe00-9cb9-4900-836d-25e7f2730d08 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:19:07.776044 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-04f9fe00-9cb9-4900-836d-25e7f2730d08 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:19:07.913300 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-04f9fe00-9cb9-4900-836d-25e7f2730d08 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:19:07.921548 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-04f9fe00-9cb9-4900-836d-25e7f2730d08 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1553 microversion: 2.1 time: 0.162515 Jul 18 03:19:07.922797 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3447/6910] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:19:07 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:19:07.939304 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7dac901f-6f41-4e2d-a721-8d196fc00620 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:19:07.939834 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7dac901f-6f41-4e2d-a721-8d196fc00620 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:19:07.946689 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7dac901f-6f41-4e2d-a721-8d196fc00620 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:19:07.947151 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7dac901f-6f41-4e2d-a721-8d196fc00620 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:19:07.947940 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7dac901f-6f41-4e2d-a721-8d196fc00620 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:19:07.948382 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7dac901f-6f41-4e2d-a721-8d196fc00620 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:19:08.033675 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7dac901f-6f41-4e2d-a721-8d196fc00620 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098810 Jul 18 03:19:08.034331 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3464/6911] 10.222.0.57 () {58 vars in 1274 bytes} [Mon Jul 18 03:19:07 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:19:08.964232 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-8d6edf6c-aa95-489d-956f-a1aa5d9219bd req-2716ca8e-1333-4297-b1e1-566c82d078b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cee99d7f-bb90-48d5-a676-52708eaf89ea", "tag": "22125498-7019-4f58-8d02-88a5992819a9"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:19:08.974257 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-8d6edf6c-aa95-489d-956f-a1aa5d9219bd req-2716ca8e-1333-4297-b1e1-566c82d078b9 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:19:08.974783 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-8d6edf6c-aa95-489d-956f-a1aa5d9219bd req-2716ca8e-1333-4297-b1e1-566c82d078b9 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:19:08.987148 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-8d6edf6c-aa95-489d-956f-a1aa5d9219bd req-2716ca8e-1333-4297-b1e1-566c82d078b9 service nova] Creating event network-changed:22125498-7019-4f58-8d02-88a5992819a9 for instance cee99d7f-bb90-48d5-a676-52708eaf89ea on n-h1-465891-3 Jul 18 03:19:08.992362 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-8d6edf6c-aa95-489d-956f-a1aa5d9219bd req-2716ca8e-1333-4297-b1e1-566c82d078b9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031786 Jul 18 03:19:08.993244 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3448/6912] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:19:32.217585 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:19:32.218320 n-d-465891-3 devstack@n-api.service[119544]: Mon Jul 18 03:19:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:19:34.588828 n-d-465891-3 devstack@n-api.service[119543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:19:34.589387 n-d-465891-3 devstack@n-api.service[119543]: Mon Jul 18 03:19:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:20:22.751337 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=21 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:20:22.752194 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:20:22.756775 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d7923811-dd8b-467f-b37e-c3eb903db005 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:20:22.757491 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d7923811-dd8b-467f-b37e-c3eb903db005 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:20:22.764857 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d7923811-dd8b-467f-b37e-c3eb903db005 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:22.765403 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d7923811-dd8b-467f-b37e-c3eb903db005 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:22.766290 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d7923811-dd8b-467f-b37e-c3eb903db005 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:22.766686 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d7923811-dd8b-467f-b37e-c3eb903db005 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:22.910998 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d7923811-dd8b-467f-b37e-c3eb903db005 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:20:22.919653 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d7923811-dd8b-467f-b37e-c3eb903db005 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1672 microversion: 2.1 time: 0.170892 Jul 18 03:20:22.920234 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3465/6913] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:20:22 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1672 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:20:22.938967 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:20:22.940276 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=48 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:20:22.948481 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-91c2bac5-07b4-4e72-afb2-9400040866b5 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "904ee158-7907-4c0c-a8ac-18d422f1ddb5"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:20:22.949939 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-91c2bac5-07b4-4e72-afb2-9400040866b5 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:20:22.967449 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91c2bac5-07b4-4e72-afb2-9400040866b5 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:22.968399 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91c2bac5-07b4-4e72-afb2-9400040866b5 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:22.969670 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91c2bac5-07b4-4e72-afb2-9400040866b5 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:22.970499 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91c2bac5-07b4-4e72-afb2-9400040866b5 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:23.249682 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-91c2bac5-07b4-4e72-afb2-9400040866b5 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "POST /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.315414 Jul 18 03:20:23.250346 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3449/6914] 10.222.0.57 () {60 vars in 1322 bytes} [Mon Jul 18 03:20:22 2022] POST /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea/os-volume_attachments => generated 194 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:20:35.061423 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7d0274b6-ff31-4a8b-b294-5add5f18d195 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:20:35.062933 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7d0274b6-ff31-4a8b-b294-5add5f18d195 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:20:35.067207 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:20:35.068258 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:20:35.078721 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7d0274b6-ff31-4a8b-b294-5add5f18d195 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:35.079487 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7d0274b6-ff31-4a8b-b294-5add5f18d195 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:35.080885 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7d0274b6-ff31-4a8b-b294-5add5f18d195 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:35.081694 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7d0274b6-ff31-4a8b-b294-5add5f18d195 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:35.121075 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7d0274b6-ff31-4a8b-b294-5add5f18d195 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:20:35.128002 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7d0274b6-ff31-4a8b-b294-5add5f18d195 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Old instance type m1.heat2, new instance type m1.heat {{(pid=119543) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 03:20:35.135813 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-7d0274b6-ff31-4a8b-b294-5add5f18d195 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:20:35.136247 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-7d0274b6-ff31-4a8b-b294-5add5f18d195 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:20:35.136733 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-7d0274b6-ff31-4a8b-b294-5add5f18d195 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:20:35.137157 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-7d0274b6-ff31-4a8b-b294-5add5f18d195 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:20:35.137606 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-7d0274b6-ff31-4a8b-b294-5add5f18d195 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:20:35.495953 n-d-465891-3 devstack@n-api.service[119543]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7d0274b6-ff31-4a8b-b294-5add5f18d195 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [b2893d04-05b6-4e6b-bff9-dfc603076094] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 03:20:36.503346 n-d-465891-3 devstack@n-api.service[119543]: INFO oslo.messaging._drivers.impl_rabbit [None req-7d0274b6-ff31-4a8b-b294-5add5f18d195 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [b2893d04-05b6-4e6b-bff9-dfc603076094] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 50756. Jul 18 03:20:36.507178 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7d0274b6-ff31-4a8b-b294-5add5f18d195 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "POST /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea/action" status: 202 len: 0 microversion: 2.1 time: 1.453591 Jul 18 03:20:36.507905 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3466/6915] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:20:35 2022] POST /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea/action => generated 0 bytes in 1455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:20:36.514149 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:20:36.515120 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:20:36.519535 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8ed0fe49-95fe-4857-9027-5cbd8552d390 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:20:36.520130 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8ed0fe49-95fe-4857-9027-5cbd8552d390 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:20:36.528253 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8ed0fe49-95fe-4857-9027-5cbd8552d390 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:36.528697 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8ed0fe49-95fe-4857-9027-5cbd8552d390 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:36.529529 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8ed0fe49-95fe-4857-9027-5cbd8552d390 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:36.529996 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8ed0fe49-95fe-4857-9027-5cbd8552d390 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:36.697225 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8ed0fe49-95fe-4857-9027-5cbd8552d390 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:20:36.706510 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8ed0fe49-95fe-4857-9027-5cbd8552d390 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1727 microversion: 2.1 time: 0.194181 Jul 18 03:20:36.707501 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3450/6916] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:20:36 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1727 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:20:37.725093 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-47069b9c-7a28-4f93-bc44-474cff5ee1f3 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:20:37.726957 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-47069b9c-7a28-4f93-bc44-474cff5ee1f3 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:20:37.733238 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-47069b9c-7a28-4f93-bc44-474cff5ee1f3 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:37.733721 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-47069b9c-7a28-4f93-bc44-474cff5ee1f3 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:37.734518 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-47069b9c-7a28-4f93-bc44-474cff5ee1f3 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:37.734970 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-47069b9c-7a28-4f93-bc44-474cff5ee1f3 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:37.889961 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-47069b9c-7a28-4f93-bc44-474cff5ee1f3 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:20:37.899172 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-47069b9c-7a28-4f93-bc44-474cff5ee1f3 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1727 microversion: 2.1 time: 0.178658 Jul 18 03:20:37.899769 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3467/6917] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:20:37 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1727 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:20:38.917745 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6f3123d6-0b52-4351-919a-d2846f67168d tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:20:38.918355 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6f3123d6-0b52-4351-919a-d2846f67168d tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:20:38.927440 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6f3123d6-0b52-4351-919a-d2846f67168d tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:38.927892 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6f3123d6-0b52-4351-919a-d2846f67168d tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:38.928707 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6f3123d6-0b52-4351-919a-d2846f67168d tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:38.929151 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6f3123d6-0b52-4351-919a-d2846f67168d tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:39.073136 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6f3123d6-0b52-4351-919a-d2846f67168d tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:20:39.081543 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6f3123d6-0b52-4351-919a-d2846f67168d tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1732 microversion: 2.1 time: 0.168562 Jul 18 03:20:39.082162 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3451/6918] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:20:38 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:20:40.099684 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-06a5b931-9a12-4d09-83cf-b8f719c93a16 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:20:40.100305 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-06a5b931-9a12-4d09-83cf-b8f719c93a16 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:20:40.107851 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-06a5b931-9a12-4d09-83cf-b8f719c93a16 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:40.108313 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-06a5b931-9a12-4d09-83cf-b8f719c93a16 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:40.109092 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-06a5b931-9a12-4d09-83cf-b8f719c93a16 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:40.109544 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-06a5b931-9a12-4d09-83cf-b8f719c93a16 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:40.242599 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-06a5b931-9a12-4d09-83cf-b8f719c93a16 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:20:40.250896 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-06a5b931-9a12-4d09-83cf-b8f719c93a16 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1732 microversion: 2.1 time: 0.155176 Jul 18 03:20:40.251452 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3468/6919] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:20:40 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:20:41.268764 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-45f2f7b6-b228-43d5-98c2-e0e3bb50f0c5 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:20:41.269370 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-45f2f7b6-b228-43d5-98c2-e0e3bb50f0c5 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:20:41.277312 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-45f2f7b6-b228-43d5-98c2-e0e3bb50f0c5 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:41.277794 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-45f2f7b6-b228-43d5-98c2-e0e3bb50f0c5 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:41.278578 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-45f2f7b6-b228-43d5-98c2-e0e3bb50f0c5 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:41.279017 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-45f2f7b6-b228-43d5-98c2-e0e3bb50f0c5 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:41.414258 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-45f2f7b6-b228-43d5-98c2-e0e3bb50f0c5 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:20:41.422288 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-45f2f7b6-b228-43d5-98c2-e0e3bb50f0c5 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1732 microversion: 2.1 time: 0.157836 Jul 18 03:20:41.422866 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3452/6920] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:20:41 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:20:42.440788 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-811c79a0-e823-4518-aa82-9abfc16fd566 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:20:42.441393 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-811c79a0-e823-4518-aa82-9abfc16fd566 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:20:42.449568 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-811c79a0-e823-4518-aa82-9abfc16fd566 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:42.450045 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-811c79a0-e823-4518-aa82-9abfc16fd566 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:42.450835 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-811c79a0-e823-4518-aa82-9abfc16fd566 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:42.451362 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-811c79a0-e823-4518-aa82-9abfc16fd566 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:42.597057 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-811c79a0-e823-4518-aa82-9abfc16fd566 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:20:42.605847 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-811c79a0-e823-4518-aa82-9abfc16fd566 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1732 microversion: 2.1 time: 0.169209 Jul 18 03:20:42.606424 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3469/6921] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:20:42 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:20:43.624286 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-df603f3b-60d6-4c4e-85fd-4147f7a514e5 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:20:43.624910 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-df603f3b-60d6-4c4e-85fd-4147f7a514e5 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:20:43.632073 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-df603f3b-60d6-4c4e-85fd-4147f7a514e5 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:43.632533 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-df603f3b-60d6-4c4e-85fd-4147f7a514e5 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:43.633332 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-df603f3b-60d6-4c4e-85fd-4147f7a514e5 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:43.633807 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-df603f3b-60d6-4c4e-85fd-4147f7a514e5 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:43.774433 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-df603f3b-60d6-4c4e-85fd-4147f7a514e5 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:20:43.782748 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-df603f3b-60d6-4c4e-85fd-4147f7a514e5 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1732 microversion: 2.1 time: 0.162639 Jul 18 03:20:43.783324 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3453/6922] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:20:43 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:20:44.800129 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5a6c1c15-cc58-4bb1-baf0-edd91a710b36 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:20:44.800757 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5a6c1c15-cc58-4bb1-baf0-edd91a710b36 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:20:44.808278 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5a6c1c15-cc58-4bb1-baf0-edd91a710b36 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:44.808738 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5a6c1c15-cc58-4bb1-baf0-edd91a710b36 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:44.809579 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5a6c1c15-cc58-4bb1-baf0-edd91a710b36 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:44.810008 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5a6c1c15-cc58-4bb1-baf0-edd91a710b36 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:44.943906 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5a6c1c15-cc58-4bb1-baf0-edd91a710b36 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:20:44.952624 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5a6c1c15-cc58-4bb1-baf0-edd91a710b36 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1732 microversion: 2.1 time: 0.156376 Jul 18 03:20:44.953192 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3470/6923] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:20:44 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:20:45.969961 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ee558e91-a939-4771-b15b-2715d2aceba1 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:20:45.970580 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ee558e91-a939-4771-b15b-2715d2aceba1 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:20:45.978406 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ee558e91-a939-4771-b15b-2715d2aceba1 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:45.978869 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ee558e91-a939-4771-b15b-2715d2aceba1 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:45.979652 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ee558e91-a939-4771-b15b-2715d2aceba1 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:45.980096 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ee558e91-a939-4771-b15b-2715d2aceba1 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:46.128788 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ee558e91-a939-4771-b15b-2715d2aceba1 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:20:46.136894 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ee558e91-a939-4771-b15b-2715d2aceba1 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1732 microversion: 2.1 time: 0.170942 Jul 18 03:20:46.137465 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3454/6924] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:20:45 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:20:47.154660 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ee104591-94d6-4235-96de-11e8ce04bbc8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:20:47.155291 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ee104591-94d6-4235-96de-11e8ce04bbc8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:20:47.162382 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ee104591-94d6-4235-96de-11e8ce04bbc8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:47.162847 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ee104591-94d6-4235-96de-11e8ce04bbc8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:47.163629 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ee104591-94d6-4235-96de-11e8ce04bbc8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:47.164725 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ee104591-94d6-4235-96de-11e8ce04bbc8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:47.305955 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ee104591-94d6-4235-96de-11e8ce04bbc8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:20:47.314164 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ee104591-94d6-4235-96de-11e8ce04bbc8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1732 microversion: 2.1 time: 0.163392 Jul 18 03:20:47.314739 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3471/6925] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:20:47 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:20:48.331274 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d7b15081-0ca3-4736-ae43-e66aa3139c5d tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:20:48.331896 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d7b15081-0ca3-4736-ae43-e66aa3139c5d tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:20:48.339085 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d7b15081-0ca3-4736-ae43-e66aa3139c5d tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:48.339537 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d7b15081-0ca3-4736-ae43-e66aa3139c5d tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:48.340314 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d7b15081-0ca3-4736-ae43-e66aa3139c5d tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:48.340752 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d7b15081-0ca3-4736-ae43-e66aa3139c5d tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:48.473440 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d7b15081-0ca3-4736-ae43-e66aa3139c5d tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:20:48.482448 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d7b15081-0ca3-4736-ae43-e66aa3139c5d tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1732 microversion: 2.1 time: 0.155073 Jul 18 03:20:48.483035 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3455/6926] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:20:48 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:20:49.499534 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-610ebd48-a7e6-4153-81b8-c43beaa0084a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:20:49.500826 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-610ebd48-a7e6-4153-81b8-c43beaa0084a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:20:49.507628 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-610ebd48-a7e6-4153-81b8-c43beaa0084a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:49.508313 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-610ebd48-a7e6-4153-81b8-c43beaa0084a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:49.509123 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-610ebd48-a7e6-4153-81b8-c43beaa0084a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:49.509570 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-610ebd48-a7e6-4153-81b8-c43beaa0084a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:49.739722 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-610ebd48-a7e6-4153-81b8-c43beaa0084a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:20:49.749364 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-610ebd48-a7e6-4153-81b8-c43beaa0084a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1732 microversion: 2.1 time: 0.253907 Jul 18 03:20:49.750002 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3472/6927] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:20:49 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1732 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:20:50.766900 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-feba1269-0842-46cf-ae10-eecea5ceaf23 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:20:50.767533 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-feba1269-0842-46cf-ae10-eecea5ceaf23 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:20:50.775150 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-feba1269-0842-46cf-ae10-eecea5ceaf23 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:50.775602 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-feba1269-0842-46cf-ae10-eecea5ceaf23 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:50.776366 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-feba1269-0842-46cf-ae10-eecea5ceaf23 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:50.776808 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-feba1269-0842-46cf-ae10-eecea5ceaf23 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:50.913564 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-feba1269-0842-46cf-ae10-eecea5ceaf23 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:20:50.921963 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-feba1269-0842-46cf-ae10-eecea5ceaf23 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1732 microversion: 2.1 time: 0.158922 Jul 18 03:20:50.922545 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3456/6928] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:20:50 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:20:51.938821 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-62310696-390a-4296-9f11-c26313a36762 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:20:51.939480 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-62310696-390a-4296-9f11-c26313a36762 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:20:51.947865 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-62310696-390a-4296-9f11-c26313a36762 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:51.948335 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-62310696-390a-4296-9f11-c26313a36762 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:51.949137 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-62310696-390a-4296-9f11-c26313a36762 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:51.949596 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-62310696-390a-4296-9f11-c26313a36762 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:52.087082 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-62310696-390a-4296-9f11-c26313a36762 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:20:52.095303 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-62310696-390a-4296-9f11-c26313a36762 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1732 microversion: 2.1 time: 0.160387 Jul 18 03:20:52.095885 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3473/6929] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:20:51 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:20:53.112064 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d60828af-f570-47c5-999e-4ae702a18982 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:20:53.112708 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d60828af-f570-47c5-999e-4ae702a18982 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:20:53.120885 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d60828af-f570-47c5-999e-4ae702a18982 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:53.121337 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d60828af-f570-47c5-999e-4ae702a18982 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:53.122160 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d60828af-f570-47c5-999e-4ae702a18982 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:53.122590 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d60828af-f570-47c5-999e-4ae702a18982 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:53.271187 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d60828af-f570-47c5-999e-4ae702a18982 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:20:53.281743 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d60828af-f570-47c5-999e-4ae702a18982 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1732 microversion: 2.1 time: 0.173464 Jul 18 03:20:53.282347 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3457/6930] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:20:53 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:20:54.308114 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a2399cc3-849a-42b3-b7a2-e45586528663 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:20:54.308713 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a2399cc3-849a-42b3-b7a2-e45586528663 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:20:54.316112 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a2399cc3-849a-42b3-b7a2-e45586528663 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:54.316581 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a2399cc3-849a-42b3-b7a2-e45586528663 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:54.317395 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a2399cc3-849a-42b3-b7a2-e45586528663 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:54.317899 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a2399cc3-849a-42b3-b7a2-e45586528663 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:54.476570 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a2399cc3-849a-42b3-b7a2-e45586528663 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:20:54.485531 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a2399cc3-849a-42b3-b7a2-e45586528663 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1732 microversion: 2.1 time: 0.182292 Jul 18 03:20:54.486140 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3474/6931] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:20:54 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1732 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:20:55.503223 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-64000bd1-6535-4c13-afaa-404a9268fd2b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:20:55.503995 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-64000bd1-6535-4c13-afaa-404a9268fd2b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:20:55.510971 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-64000bd1-6535-4c13-afaa-404a9268fd2b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:55.511429 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-64000bd1-6535-4c13-afaa-404a9268fd2b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:55.513013 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-64000bd1-6535-4c13-afaa-404a9268fd2b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:55.513013 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-64000bd1-6535-4c13-afaa-404a9268fd2b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:55.652077 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-64000bd1-6535-4c13-afaa-404a9268fd2b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:20:55.660302 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-64000bd1-6535-4c13-afaa-404a9268fd2b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1732 microversion: 2.1 time: 0.161060 Jul 18 03:20:55.660878 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3458/6932] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:20:55 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:20:56.677603 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c6f851e4-00f7-4541-818a-edd5e926c04f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:20:56.678330 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c6f851e4-00f7-4541-818a-edd5e926c04f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:20:56.686514 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c6f851e4-00f7-4541-818a-edd5e926c04f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:56.686988 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c6f851e4-00f7-4541-818a-edd5e926c04f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:56.687812 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c6f851e4-00f7-4541-818a-edd5e926c04f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:56.688280 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c6f851e4-00f7-4541-818a-edd5e926c04f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:56.836643 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c6f851e4-00f7-4541-818a-edd5e926c04f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:20:56.846051 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c6f851e4-00f7-4541-818a-edd5e926c04f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1732 microversion: 2.1 time: 0.172475 Jul 18 03:20:56.846658 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3475/6933] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:20:56 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:20:57.863441 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-19bdf65d-2633-4533-8e14-c316a3fed3ad tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:20:57.864080 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-19bdf65d-2633-4533-8e14-c316a3fed3ad tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:20:57.871375 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-19bdf65d-2633-4533-8e14-c316a3fed3ad tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:57.871816 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-19bdf65d-2633-4533-8e14-c316a3fed3ad tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:57.872584 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-19bdf65d-2633-4533-8e14-c316a3fed3ad tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:57.873024 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-19bdf65d-2633-4533-8e14-c316a3fed3ad tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:58.113016 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-19bdf65d-2633-4533-8e14-c316a3fed3ad tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:20:58.122065 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-19bdf65d-2633-4533-8e14-c316a3fed3ad tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1731 microversion: 2.1 time: 0.262428 Jul 18 03:20:58.122646 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3459/6934] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:20:57 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1731 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:20:58.261873 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-1e8c1732-9ed4-426a-832c-f0b7fb8d3424 req-7fa24bca-5c1d-4d97-a678-5c55493f23f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cee99d7f-bb90-48d5-a676-52708eaf89ea", "name": "network-vif-unplugged", "status": "completed", "tag": "22125498-7019-4f58-8d02-88a5992819a9"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:20:58.270938 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-1e8c1732-9ed4-426a-832c-f0b7fb8d3424 req-7fa24bca-5c1d-4d97-a678-5c55493f23f4 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:58.271402 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-1e8c1732-9ed4-426a-832c-f0b7fb8d3424 req-7fa24bca-5c1d-4d97-a678-5c55493f23f4 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:58.284459 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-1e8c1732-9ed4-426a-832c-f0b7fb8d3424 req-7fa24bca-5c1d-4d97-a678-5c55493f23f4 service nova] Creating event network-vif-unplugged:22125498-7019-4f58-8d02-88a5992819a9 for instance cee99d7f-bb90-48d5-a676-52708eaf89ea on n-h2-465891-3 Jul 18 03:20:58.290562 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [req-1e8c1732-9ed4-426a-832c-f0b7fb8d3424 req-7fa24bca-5c1d-4d97-a678-5c55493f23f4 service nova] Instance cee99d7f-bb90-48d5-a676-52708eaf89ea is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3', 'n-h2-465891-3'} {{(pid=119543) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:20:58.301956 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-1e8c1732-9ed4-426a-832c-f0b7fb8d3424 req-7fa24bca-5c1d-4d97-a678-5c55493f23f4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044499 Jul 18 03:20:58.302620 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3476/6935] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:20:59.139455 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8688f289-44d8-4f48-a619-f0cbb8af2711 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:20:59.140059 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8688f289-44d8-4f48-a619-f0cbb8af2711 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:20:59.147246 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8688f289-44d8-4f48-a619-f0cbb8af2711 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:59.148150 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8688f289-44d8-4f48-a619-f0cbb8af2711 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:59.149000 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8688f289-44d8-4f48-a619-f0cbb8af2711 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:59.149445 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8688f289-44d8-4f48-a619-f0cbb8af2711 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:59.318936 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8688f289-44d8-4f48-a619-f0cbb8af2711 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:20:59.327871 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8688f289-44d8-4f48-a619-f0cbb8af2711 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1731 microversion: 2.1 time: 0.192253 Jul 18 03:20:59.328461 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3460/6936] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:20:59 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1731 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:21:00.326203 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-88c76df1-a134-42c8-a83b-8e797d0909e2 req-5b699bee-e446-47ce-859d-5ba562bc81a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cee99d7f-bb90-48d5-a676-52708eaf89ea", "tag": "22125498-7019-4f58-8d02-88a5992819a9"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:21:00.334869 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-88c76df1-a134-42c8-a83b-8e797d0909e2 req-5b699bee-e446-47ce-859d-5ba562bc81a7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:00.335267 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-88c76df1-a134-42c8-a83b-8e797d0909e2 req-5b699bee-e446-47ce-859d-5ba562bc81a7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:00.346141 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2b4bbcd7-3768-49e4-b1fd-f05e84b18d02 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:00.347056 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2b4bbcd7-3768-49e4-b1fd-f05e84b18d02 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:00.352877 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-88c76df1-a134-42c8-a83b-8e797d0909e2 req-5b699bee-e446-47ce-859d-5ba562bc81a7 service nova] Creating event network-changed:22125498-7019-4f58-8d02-88a5992819a9 for instance cee99d7f-bb90-48d5-a676-52708eaf89ea on n-h2-465891-3 Jul 18 03:21:00.355435 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2b4bbcd7-3768-49e4-b1fd-f05e84b18d02 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:00.355987 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2b4bbcd7-3768-49e4-b1fd-f05e84b18d02 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:00.357045 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2b4bbcd7-3768-49e4-b1fd-f05e84b18d02 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:00.357585 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2b4bbcd7-3768-49e4-b1fd-f05e84b18d02 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:00.358632 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [req-88c76df1-a134-42c8-a83b-8e797d0909e2 req-5b699bee-e446-47ce-859d-5ba562bc81a7 service nova] Instance cee99d7f-bb90-48d5-a676-52708eaf89ea is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3', 'n-h2-465891-3'} {{(pid=119543) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:21:00.370075 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-88c76df1-a134-42c8-a83b-8e797d0909e2 req-5b699bee-e446-47ce-859d-5ba562bc81a7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049007 Jul 18 03:21:00.370888 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3477/6937] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:21:00.672913 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2b4bbcd7-3768-49e4-b1fd-f05e84b18d02 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:21:00.682169 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2b4bbcd7-3768-49e4-b1fd-f05e84b18d02 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1729 microversion: 2.1 time: 0.340472 Jul 18 03:21:00.692487 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3461/6938] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:00 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1729 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:21:01.702552 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5c3d22b6-77fc-486f-aa51-7a3d3e998945 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:01.704086 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5c3d22b6-77fc-486f-aa51-7a3d3e998945 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:01.714658 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5c3d22b6-77fc-486f-aa51-7a3d3e998945 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:01.715291 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5c3d22b6-77fc-486f-aa51-7a3d3e998945 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:01.716833 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5c3d22b6-77fc-486f-aa51-7a3d3e998945 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:01.717414 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5c3d22b6-77fc-486f-aa51-7a3d3e998945 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:01.957692 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5c3d22b6-77fc-486f-aa51-7a3d3e998945 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:21:01.972270 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5c3d22b6-77fc-486f-aa51-7a3d3e998945 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1729 microversion: 2.1 time: 0.275078 Jul 18 03:21:01.972889 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3478/6939] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:01 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1729 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:21:02.990748 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-575922e6-f939-4854-af76-65afb24c3b50 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:02.991368 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-575922e6-f939-4854-af76-65afb24c3b50 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:02.999047 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-575922e6-f939-4854-af76-65afb24c3b50 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:02.999499 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-575922e6-f939-4854-af76-65afb24c3b50 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:03.000275 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-575922e6-f939-4854-af76-65afb24c3b50 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:03.000713 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-575922e6-f939-4854-af76-65afb24c3b50 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:03.135940 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-575922e6-f939-4854-af76-65afb24c3b50 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:21:03.144089 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-575922e6-f939-4854-af76-65afb24c3b50 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1729 microversion: 2.1 time: 0.157255 Jul 18 03:21:03.144661 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3462/6940] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:02 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:21:04.162660 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-16aac976-443c-410f-95e1-33dd8d81eda9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:04.163300 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-16aac976-443c-410f-95e1-33dd8d81eda9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:04.170972 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-16aac976-443c-410f-95e1-33dd8d81eda9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:04.171126 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-16aac976-443c-410f-95e1-33dd8d81eda9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:04.171920 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-16aac976-443c-410f-95e1-33dd8d81eda9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:04.172379 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-16aac976-443c-410f-95e1-33dd8d81eda9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:04.312002 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-16aac976-443c-410f-95e1-33dd8d81eda9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:21:04.320006 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-16aac976-443c-410f-95e1-33dd8d81eda9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1729 microversion: 2.1 time: 0.161339 Jul 18 03:21:04.321410 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3479/6941] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:04 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:21:05.338479 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0c40e60e-a86e-4796-8b99-96cd7980f939 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:05.339084 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0c40e60e-a86e-4796-8b99-96cd7980f939 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:05.345967 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c40e60e-a86e-4796-8b99-96cd7980f939 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:05.346419 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c40e60e-a86e-4796-8b99-96cd7980f939 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:05.347175 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c40e60e-a86e-4796-8b99-96cd7980f939 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:05.347609 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c40e60e-a86e-4796-8b99-96cd7980f939 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:05.483638 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0c40e60e-a86e-4796-8b99-96cd7980f939 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:21:05.492675 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0c40e60e-a86e-4796-8b99-96cd7980f939 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1729 microversion: 2.1 time: 0.157578 Jul 18 03:21:05.493331 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3463/6942] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:05 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:21:06.510069 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-51b6408f-1a0a-4ef0-9974-d66625811f21 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:06.510694 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-51b6408f-1a0a-4ef0-9974-d66625811f21 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:06.513464 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=33 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:21:06.519362 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-51b6408f-1a0a-4ef0-9974-d66625811f21 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:06.519824 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-51b6408f-1a0a-4ef0-9974-d66625811f21 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:06.520604 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-51b6408f-1a0a-4ef0-9974-d66625811f21 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:06.521057 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-51b6408f-1a0a-4ef0-9974-d66625811f21 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:06.524633 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:21:06.657599 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-51b6408f-1a0a-4ef0-9974-d66625811f21 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:21:06.666439 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-51b6408f-1a0a-4ef0-9974-d66625811f21 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1729 microversion: 2.1 time: 0.160883 Jul 18 03:21:06.667020 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3480/6943] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:06 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:21:07.683761 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2948700b-90dd-4711-b7e4-f28905c06284 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:07.684370 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2948700b-90dd-4711-b7e4-f28905c06284 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:07.686910 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=29 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:21:07.692891 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2948700b-90dd-4711-b7e4-f28905c06284 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:07.693345 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2948700b-90dd-4711-b7e4-f28905c06284 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:07.694151 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2948700b-90dd-4711-b7e4-f28905c06284 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:07.694602 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2948700b-90dd-4711-b7e4-f28905c06284 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:07.698014 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=85 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:21:07.827148 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2948700b-90dd-4711-b7e4-f28905c06284 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:21:07.835500 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2948700b-90dd-4711-b7e4-f28905c06284 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1729 microversion: 2.1 time: 0.155625 Jul 18 03:21:07.837380 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3464/6944] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:07 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:21:08.855690 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a7279983-22b2-4344-8502-77b5760fbb1b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:08.856325 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a7279983-22b2-4344-8502-77b5760fbb1b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:08.864842 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a7279983-22b2-4344-8502-77b5760fbb1b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:08.865302 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a7279983-22b2-4344-8502-77b5760fbb1b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:08.866375 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a7279983-22b2-4344-8502-77b5760fbb1b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:08.867310 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a7279983-22b2-4344-8502-77b5760fbb1b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:09.006158 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a7279983-22b2-4344-8502-77b5760fbb1b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:21:09.016423 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a7279983-22b2-4344-8502-77b5760fbb1b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1729 microversion: 2.1 time: 0.164486 Jul 18 03:21:09.017264 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3481/6945] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:08 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:21:10.034747 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6941bfa7-44e0-4b45-8cf1-140341ac8024 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:10.035463 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6941bfa7-44e0-4b45-8cf1-140341ac8024 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:10.044118 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6941bfa7-44e0-4b45-8cf1-140341ac8024 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:10.044563 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6941bfa7-44e0-4b45-8cf1-140341ac8024 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:10.045330 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6941bfa7-44e0-4b45-8cf1-140341ac8024 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:10.045789 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6941bfa7-44e0-4b45-8cf1-140341ac8024 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:10.179871 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6941bfa7-44e0-4b45-8cf1-140341ac8024 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:21:10.188590 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6941bfa7-44e0-4b45-8cf1-140341ac8024 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1729 microversion: 2.1 time: 0.157758 Jul 18 03:21:10.189110 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3465/6946] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:10 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:21:11.206097 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e8ba549a-783b-4739-a521-a426ab853231 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:11.206763 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e8ba549a-783b-4739-a521-a426ab853231 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:11.214842 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e8ba549a-783b-4739-a521-a426ab853231 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:11.215308 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e8ba549a-783b-4739-a521-a426ab853231 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:11.216219 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e8ba549a-783b-4739-a521-a426ab853231 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:11.216559 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e8ba549a-783b-4739-a521-a426ab853231 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:11.350958 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e8ba549a-783b-4739-a521-a426ab853231 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:21:11.359083 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e8ba549a-783b-4739-a521-a426ab853231 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1729 microversion: 2.1 time: 0.157022 Jul 18 03:21:11.359666 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3482/6947] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:11 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:21:12.377512 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ce5fe665-84c4-4d49-b04c-8518f1ac213a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:12.378313 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ce5fe665-84c4-4d49-b04c-8518f1ac213a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:12.386441 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ce5fe665-84c4-4d49-b04c-8518f1ac213a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:12.387526 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ce5fe665-84c4-4d49-b04c-8518f1ac213a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:12.388324 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ce5fe665-84c4-4d49-b04c-8518f1ac213a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:12.388764 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ce5fe665-84c4-4d49-b04c-8518f1ac213a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:12.535155 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ce5fe665-84c4-4d49-b04c-8518f1ac213a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:21:12.543723 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ce5fe665-84c4-4d49-b04c-8518f1ac213a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1726 microversion: 2.1 time: 0.170439 Jul 18 03:21:12.544533 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3466/6948] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:12 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:21:12.562612 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-25fc60fd-078b-4822-9a88-81449613011b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:21:12.563177 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-25fc60fd-078b-4822-9a88-81449613011b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:12.570435 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-25fc60fd-078b-4822-9a88-81449613011b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:12.570905 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-25fc60fd-078b-4822-9a88-81449613011b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:12.571735 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-25fc60fd-078b-4822-9a88-81449613011b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:12.572294 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-25fc60fd-078b-4822-9a88-81449613011b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:12.612081 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-25fc60fd-078b-4822-9a88-81449613011b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:12.612606 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-25fc60fd-078b-4822-9a88-81449613011b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:12.613631 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-25fc60fd-078b-4822-9a88-81449613011b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:12.614116 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-25fc60fd-078b-4822-9a88-81449613011b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:12.637811 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-25fc60fd-078b-4822-9a88-81449613011b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Getting quotas for project 735af4c358a64b9cbc4a61a33985b9b1. Resources: {'cores', 'ram'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:21:12.643215 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-25fc60fd-078b-4822-9a88-81449613011b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Getting quotas for user 16f0c35138a3430f97850934128310d1 and project 735af4c358a64b9cbc4a61a33985b9b1. Resources: {'cores', 'ram'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:21:12.752813 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-25fc60fd-078b-4822-9a88-81449613011b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "POST /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea/action" status: 202 len: 0 microversion: 2.1 time: 0.195335 Jul 18 03:21:12.753437 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3483/6949] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:21:12 2022] POST /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:21:12.762521 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5fdbe182-4ad7-4356-ae84-41aafc9f8257 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:12.763141 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5fdbe182-4ad7-4356-ae84-41aafc9f8257 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:12.769419 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5fdbe182-4ad7-4356-ae84-41aafc9f8257 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:12.769908 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5fdbe182-4ad7-4356-ae84-41aafc9f8257 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:12.770705 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5fdbe182-4ad7-4356-ae84-41aafc9f8257 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:12.771127 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5fdbe182-4ad7-4356-ae84-41aafc9f8257 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:12.980797 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5fdbe182-4ad7-4356-ae84-41aafc9f8257 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:21:12.989070 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5fdbe182-4ad7-4356-ae84-41aafc9f8257 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1725 microversion: 2.1 time: 0.231335 Jul 18 03:21:12.989684 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3467/6950] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:12 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1725 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:21:14.009666 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bb4b609f-c71f-4be0-8747-5a4b058eab34 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:14.010428 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bb4b609f-c71f-4be0-8747-5a4b058eab34 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:14.021440 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bb4b609f-c71f-4be0-8747-5a4b058eab34 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:14.021935 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bb4b609f-c71f-4be0-8747-5a4b058eab34 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:14.022739 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bb4b609f-c71f-4be0-8747-5a4b058eab34 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:14.023191 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bb4b609f-c71f-4be0-8747-5a4b058eab34 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:14.162774 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bb4b609f-c71f-4be0-8747-5a4b058eab34 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:21:14.170942 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bb4b609f-c71f-4be0-8747-5a4b058eab34 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1725 microversion: 2.1 time: 0.166439 Jul 18 03:21:14.171532 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3484/6951] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:14 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:21:15.187460 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-bab132b3-6493-4bd7-80e0-57126e354682 req-61e62e62-87cb-4601-bb21-d4b126cd06f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cee99d7f-bb90-48d5-a676-52708eaf89ea", "name": "network-vif-plugged", "status": "completed", "tag": "22125498-7019-4f58-8d02-88a5992819a9"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:21:15.193423 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9b57e11b-eb5f-45d1-a41f-d82cfa75bb65 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:15.194113 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9b57e11b-eb5f-45d1-a41f-d82cfa75bb65 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:15.202103 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9b57e11b-eb5f-45d1-a41f-d82cfa75bb65 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:15.202574 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9b57e11b-eb5f-45d1-a41f-d82cfa75bb65 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:15.203388 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9b57e11b-eb5f-45d1-a41f-d82cfa75bb65 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:15.203844 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9b57e11b-eb5f-45d1-a41f-d82cfa75bb65 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:15.206793 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-bab132b3-6493-4bd7-80e0-57126e354682 req-61e62e62-87cb-4601-bb21-d4b126cd06f1 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:15.207301 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-bab132b3-6493-4bd7-80e0-57126e354682 req-61e62e62-87cb-4601-bb21-d4b126cd06f1 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:15.226473 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-bab132b3-6493-4bd7-80e0-57126e354682 req-61e62e62-87cb-4601-bb21-d4b126cd06f1 service nova] Creating event network-vif-plugged:22125498-7019-4f58-8d02-88a5992819a9 for instance cee99d7f-bb90-48d5-a676-52708eaf89ea on n-h2-465891-3 Jul 18 03:21:15.234448 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [req-bab132b3-6493-4bd7-80e0-57126e354682 req-61e62e62-87cb-4601-bb21-d4b126cd06f1 service nova] Instance cee99d7f-bb90-48d5-a676-52708eaf89ea is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3', 'n-h2-465891-3'} {{(pid=119544) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:21:15.250818 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-bab132b3-6493-4bd7-80e0-57126e354682 req-61e62e62-87cb-4601-bb21-d4b126cd06f1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067482 Jul 18 03:21:15.251694 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3468/6952] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:21:15.359132 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9b57e11b-eb5f-45d1-a41f-d82cfa75bb65 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:21:15.367434 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9b57e11b-eb5f-45d1-a41f-d82cfa75bb65 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1725 microversion: 2.1 time: 0.178106 Jul 18 03:21:15.368015 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3485/6953] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:15 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:21:16.386535 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f63a96eb-8e18-4b5f-99b7-d8bb24a1f87f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:16.387245 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f63a96eb-8e18-4b5f-99b7-d8bb24a1f87f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:16.393658 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f63a96eb-8e18-4b5f-99b7-d8bb24a1f87f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:16.394203 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f63a96eb-8e18-4b5f-99b7-d8bb24a1f87f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:16.394979 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f63a96eb-8e18-4b5f-99b7-d8bb24a1f87f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:16.395422 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f63a96eb-8e18-4b5f-99b7-d8bb24a1f87f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:16.537601 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f63a96eb-8e18-4b5f-99b7-d8bb24a1f87f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:21:16.546733 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f63a96eb-8e18-4b5f-99b7-d8bb24a1f87f tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1725 microversion: 2.1 time: 0.165964 Jul 18 03:21:16.547326 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3469/6954] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:16 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:21:17.564099 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-aaea668b-4992-4049-bb43-cdb9525611ee tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:17.564739 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-aaea668b-4992-4049-bb43-cdb9525611ee tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:17.572139 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aaea668b-4992-4049-bb43-cdb9525611ee tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:17.572725 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aaea668b-4992-4049-bb43-cdb9525611ee tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:17.574520 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aaea668b-4992-4049-bb43-cdb9525611ee tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:17.574664 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aaea668b-4992-4049-bb43-cdb9525611ee tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:17.715409 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-aaea668b-4992-4049-bb43-cdb9525611ee tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:21:17.723740 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-aaea668b-4992-4049-bb43-cdb9525611ee tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1725 microversion: 2.1 time: 0.163526 Jul 18 03:21:17.724349 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3486/6955] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:17 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:21:18.200895 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-9c1b9a29-9003-43d0-b221-b02c8ea22484 req-7b17a119-ec1d-418b-b63f-a32a0d1a14d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cee99d7f-bb90-48d5-a676-52708eaf89ea", "name": "network-vif-unplugged", "status": "completed", "tag": "22125498-7019-4f58-8d02-88a5992819a9"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:21:18.210391 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-9c1b9a29-9003-43d0-b221-b02c8ea22484 req-7b17a119-ec1d-418b-b63f-a32a0d1a14d4 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:18.210948 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-9c1b9a29-9003-43d0-b221-b02c8ea22484 req-7b17a119-ec1d-418b-b63f-a32a0d1a14d4 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:18.224641 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-9c1b9a29-9003-43d0-b221-b02c8ea22484 req-7b17a119-ec1d-418b-b63f-a32a0d1a14d4 service nova] Creating event network-vif-unplugged:22125498-7019-4f58-8d02-88a5992819a9 for instance cee99d7f-bb90-48d5-a676-52708eaf89ea on n-h1-465891-3 Jul 18 03:21:18.230533 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [req-9c1b9a29-9003-43d0-b221-b02c8ea22484 req-7b17a119-ec1d-418b-b63f-a32a0d1a14d4 service nova] Instance cee99d7f-bb90-48d5-a676-52708eaf89ea is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3', 'n-h2-465891-3'} {{(pid=119544) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:21:18.241445 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-9c1b9a29-9003-43d0-b221-b02c8ea22484 req-7b17a119-ec1d-418b-b63f-a32a0d1a14d4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044882 Jul 18 03:21:18.242258 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3470/6956] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:21:18.741678 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4db42d81-9368-4a8c-9daf-1041d5194039 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:18.742391 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4db42d81-9368-4a8c-9daf-1041d5194039 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:18.751492 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4db42d81-9368-4a8c-9daf-1041d5194039 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:18.752250 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4db42d81-9368-4a8c-9daf-1041d5194039 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:18.753069 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4db42d81-9368-4a8c-9daf-1041d5194039 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:18.753713 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4db42d81-9368-4a8c-9daf-1041d5194039 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:18.959770 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4db42d81-9368-4a8c-9daf-1041d5194039 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:21:18.968449 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4db42d81-9368-4a8c-9daf-1041d5194039 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1725 microversion: 2.1 time: 0.230734 Jul 18 03:21:18.969029 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3487/6957] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:18 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1725 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:21:19.989064 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0d11b633-36fb-4c7a-8a66-acfb1328e2fe tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:19.989796 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0d11b633-36fb-4c7a-8a66-acfb1328e2fe tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:19.997734 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0d11b633-36fb-4c7a-8a66-acfb1328e2fe tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:19.998195 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0d11b633-36fb-4c7a-8a66-acfb1328e2fe tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:19.999103 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0d11b633-36fb-4c7a-8a66-acfb1328e2fe tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:19.999564 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0d11b633-36fb-4c7a-8a66-acfb1328e2fe tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:20.135949 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0d11b633-36fb-4c7a-8a66-acfb1328e2fe tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:21:20.144774 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0d11b633-36fb-4c7a-8a66-acfb1328e2fe tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1725 microversion: 2.1 time: 0.161673 Jul 18 03:21:20.145346 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3471/6958] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:19 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:21:20.256907 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-8fab3e78-ce47-4818-88e3-d7987cf54272 req-7072b4fb-291c-4d0b-91bd-71e5d6a7846c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cee99d7f-bb90-48d5-a676-52708eaf89ea", "tag": "22125498-7019-4f58-8d02-88a5992819a9"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:21:20.266599 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-8fab3e78-ce47-4818-88e3-d7987cf54272 req-7072b4fb-291c-4d0b-91bd-71e5d6a7846c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:20.267144 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-8fab3e78-ce47-4818-88e3-d7987cf54272 req-7072b4fb-291c-4d0b-91bd-71e5d6a7846c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:20.286677 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-8fab3e78-ce47-4818-88e3-d7987cf54272 req-7072b4fb-291c-4d0b-91bd-71e5d6a7846c service nova] Creating event network-changed:22125498-7019-4f58-8d02-88a5992819a9 for instance cee99d7f-bb90-48d5-a676-52708eaf89ea on n-h1-465891-3 Jul 18 03:21:20.295196 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [req-8fab3e78-ce47-4818-88e3-d7987cf54272 req-7072b4fb-291c-4d0b-91bd-71e5d6a7846c service nova] Instance cee99d7f-bb90-48d5-a676-52708eaf89ea is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3', 'n-h2-465891-3'} {{(pid=119543) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:21:20.306432 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-8fab3e78-ce47-4818-88e3-d7987cf54272 req-7072b4fb-291c-4d0b-91bd-71e5d6a7846c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053268 Jul 18 03:21:20.307054 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3488/6959] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:21:21.162702 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cab5b663-44f5-4951-a1b6-008c79ed8cdc tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:21.163312 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cab5b663-44f5-4951-a1b6-008c79ed8cdc tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:21.171400 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cab5b663-44f5-4951-a1b6-008c79ed8cdc tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:21.171837 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cab5b663-44f5-4951-a1b6-008c79ed8cdc tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:21.172805 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cab5b663-44f5-4951-a1b6-008c79ed8cdc tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:21.173239 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cab5b663-44f5-4951-a1b6-008c79ed8cdc tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:21.330623 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-cab5b663-44f5-4951-a1b6-008c79ed8cdc tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:21:21.339712 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cab5b663-44f5-4951-a1b6-008c79ed8cdc tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1725 microversion: 2.1 time: 0.180327 Jul 18 03:21:21.340350 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3472/6960] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:21 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:21:22.359197 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7ce23115-f3eb-4ca0-abdd-dd7648a31560 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:22.359947 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7ce23115-f3eb-4ca0-abdd-dd7648a31560 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:22.366852 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7ce23115-f3eb-4ca0-abdd-dd7648a31560 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:22.367328 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7ce23115-f3eb-4ca0-abdd-dd7648a31560 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:22.368133 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7ce23115-f3eb-4ca0-abdd-dd7648a31560 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:22.368588 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7ce23115-f3eb-4ca0-abdd-dd7648a31560 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:22.503541 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7ce23115-f3eb-4ca0-abdd-dd7648a31560 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:21:22.511963 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7ce23115-f3eb-4ca0-abdd-dd7648a31560 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1725 microversion: 2.1 time: 0.158663 Jul 18 03:21:22.512831 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3489/6961] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:22 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:21:23.529902 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e0bf024a-f11c-4722-855a-7269582d7f5b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:23.530483 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e0bf024a-f11c-4722-855a-7269582d7f5b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:23.537559 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e0bf024a-f11c-4722-855a-7269582d7f5b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:23.538036 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e0bf024a-f11c-4722-855a-7269582d7f5b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:23.544282 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e0bf024a-f11c-4722-855a-7269582d7f5b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:23.544282 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e0bf024a-f11c-4722-855a-7269582d7f5b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:23.676971 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e0bf024a-f11c-4722-855a-7269582d7f5b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:21:23.686031 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e0bf024a-f11c-4722-855a-7269582d7f5b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1725 microversion: 2.1 time: 0.160869 Jul 18 03:21:23.686622 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3473/6962] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:23 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:21:24.703357 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-749f195a-553a-4402-99d7-087d2f32ca83 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:24.703992 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-749f195a-553a-4402-99d7-087d2f32ca83 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:24.706033 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:21:24.712258 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-749f195a-553a-4402-99d7-087d2f32ca83 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:24.712736 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-749f195a-553a-4402-99d7-087d2f32ca83 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:24.713524 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-749f195a-553a-4402-99d7-087d2f32ca83 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:24.714284 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-749f195a-553a-4402-99d7-087d2f32ca83 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:24.849099 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-749f195a-553a-4402-99d7-087d2f32ca83 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:21:24.858311 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-749f195a-553a-4402-99d7-087d2f32ca83 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1725 microversion: 2.1 time: 0.158910 Jul 18 03:21:24.858893 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3490/6963] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:24 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:21:25.876005 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-634eb910-a2cd-45c6-8232-e828e369f67a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:25.876609 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-634eb910-a2cd-45c6-8232-e828e369f67a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:25.883625 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-634eb910-a2cd-45c6-8232-e828e369f67a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:25.884069 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-634eb910-a2cd-45c6-8232-e828e369f67a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:25.884831 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-634eb910-a2cd-45c6-8232-e828e369f67a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:25.885273 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-634eb910-a2cd-45c6-8232-e828e369f67a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:26.023361 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-634eb910-a2cd-45c6-8232-e828e369f67a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:21:26.032284 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-634eb910-a2cd-45c6-8232-e828e369f67a tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1725 microversion: 2.1 time: 0.160205 Jul 18 03:21:26.032878 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3474/6964] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:25 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:21:27.049660 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2f875032-63e1-41f7-a110-cede894a996c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:27.050307 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2f875032-63e1-41f7-a110-cede894a996c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:27.056972 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2f875032-63e1-41f7-a110-cede894a996c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:27.057445 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2f875032-63e1-41f7-a110-cede894a996c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:27.058242 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2f875032-63e1-41f7-a110-cede894a996c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:27.058693 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2f875032-63e1-41f7-a110-cede894a996c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:27.239073 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2f875032-63e1-41f7-a110-cede894a996c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:21:27.247507 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2f875032-63e1-41f7-a110-cede894a996c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1725 microversion: 2.1 time: 0.201926 Jul 18 03:21:27.248088 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3491/6965] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:27 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1725 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:21:28.265827 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fcd64fa1-fc96-4357-9ff4-6f13b99e688d tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:28.266382 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fcd64fa1-fc96-4357-9ff4-6f13b99e688d tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:28.273201 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fcd64fa1-fc96-4357-9ff4-6f13b99e688d tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:28.273648 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fcd64fa1-fc96-4357-9ff4-6f13b99e688d tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:28.274452 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fcd64fa1-fc96-4357-9ff4-6f13b99e688d tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:28.274918 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-fcd64fa1-fc96-4357-9ff4-6f13b99e688d tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:28.451745 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fcd64fa1-fc96-4357-9ff4-6f13b99e688d tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:21:28.460000 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fcd64fa1-fc96-4357-9ff4-6f13b99e688d tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1725 microversion: 2.1 time: 0.199122 Jul 18 03:21:28.460572 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3475/6966] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:28 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1725 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:21:29.477849 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5ea7b193-0f8b-4021-99f0-7f7274afed52 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:29.478485 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5ea7b193-0f8b-4021-99f0-7f7274afed52 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:29.485761 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5ea7b193-0f8b-4021-99f0-7f7274afed52 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:29.486235 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5ea7b193-0f8b-4021-99f0-7f7274afed52 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:29.487017 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5ea7b193-0f8b-4021-99f0-7f7274afed52 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:29.487479 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5ea7b193-0f8b-4021-99f0-7f7274afed52 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:29.622098 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5ea7b193-0f8b-4021-99f0-7f7274afed52 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:21:29.630151 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5ea7b193-0f8b-4021-99f0-7f7274afed52 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1725 microversion: 2.1 time: 0.156363 Jul 18 03:21:29.630720 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3492/6967] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:29 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:21:30.646568 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-296fc69d-a2c5-48a8-b7a5-1382636a7843 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:30.647182 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-296fc69d-a2c5-48a8-b7a5-1382636a7843 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:30.654669 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-296fc69d-a2c5-48a8-b7a5-1382636a7843 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:30.655130 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-296fc69d-a2c5-48a8-b7a5-1382636a7843 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:30.655908 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-296fc69d-a2c5-48a8-b7a5-1382636a7843 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:30.656353 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-296fc69d-a2c5-48a8-b7a5-1382636a7843 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:30.788790 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-296fc69d-a2c5-48a8-b7a5-1382636a7843 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:21:30.797587 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-296fc69d-a2c5-48a8-b7a5-1382636a7843 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1725 microversion: 2.1 time: 0.154978 Jul 18 03:21:30.798191 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3476/6968] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:30 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:21:31.815000 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-74cd4120-ab87-4358-8c7b-ecd5e4803131 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:31.815538 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-74cd4120-ab87-4358-8c7b-ecd5e4803131 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:31.822503 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-74cd4120-ab87-4358-8c7b-ecd5e4803131 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:31.822972 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-74cd4120-ab87-4358-8c7b-ecd5e4803131 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:31.823751 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-74cd4120-ab87-4358-8c7b-ecd5e4803131 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:31.824207 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-74cd4120-ab87-4358-8c7b-ecd5e4803131 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:31.960015 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-74cd4120-ab87-4358-8c7b-ecd5e4803131 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:21:31.968187 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-74cd4120-ab87-4358-8c7b-ecd5e4803131 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1725 microversion: 2.1 time: 0.157236 Jul 18 03:21:31.968783 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3493/6969] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:31 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:21:32.985195 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e60bb77f-dd6d-4f4d-88ee-74188a5d35d2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:32.986002 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e60bb77f-dd6d-4f4d-88ee-74188a5d35d2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:32.993036 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e60bb77f-dd6d-4f4d-88ee-74188a5d35d2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:32.993483 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e60bb77f-dd6d-4f4d-88ee-74188a5d35d2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:32.994290 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e60bb77f-dd6d-4f4d-88ee-74188a5d35d2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:32.994732 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e60bb77f-dd6d-4f4d-88ee-74188a5d35d2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:33.140426 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e60bb77f-dd6d-4f4d-88ee-74188a5d35d2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:21:33.149826 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e60bb77f-dd6d-4f4d-88ee-74188a5d35d2 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1718 microversion: 2.1 time: 0.168477 Jul 18 03:21:33.150422 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3477/6970] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:32 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1718 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:21:33.167962 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a8e61dd2-aa21-447f-a19d-a7183bfc0126 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:33.169042 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a8e61dd2-aa21-447f-a19d-a7183bfc0126 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:33.175930 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a8e61dd2-aa21-447f-a19d-a7183bfc0126 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:33.176399 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a8e61dd2-aa21-447f-a19d-a7183bfc0126 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:33.177187 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a8e61dd2-aa21-447f-a19d-a7183bfc0126 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:33.177632 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a8e61dd2-aa21-447f-a19d-a7183bfc0126 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:33.180403 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:21:33.331222 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a8e61dd2-aa21-447f-a19d-a7183bfc0126 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:21:33.341843 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a8e61dd2-aa21-447f-a19d-a7183bfc0126 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1718 microversion: 2.1 time: 0.177720 Jul 18 03:21:33.342436 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3494/6971] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:33 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1718 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:21:33.362877 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0c840588-183f-4d89-8f6b-02e779c45c6e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:33.363488 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0c840588-183f-4d89-8f6b-02e779c45c6e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:33.370457 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c840588-183f-4d89-8f6b-02e779c45c6e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:33.370915 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c840588-183f-4d89-8f6b-02e779c45c6e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:33.372375 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c840588-183f-4d89-8f6b-02e779c45c6e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:33.372837 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0c840588-183f-4d89-8f6b-02e779c45c6e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:33.858304 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0c840588-183f-4d89-8f6b-02e779c45c6e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:21:33.867443 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0c840588-183f-4d89-8f6b-02e779c45c6e tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1718 microversion: 2.1 time: 0.508608 Jul 18 03:21:33.868199 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3478/6972] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:33 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1718 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:21:33.885416 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9ae4dafc-786b-4e5a-93b3-a055cec3dbe9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:33.885966 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9ae4dafc-786b-4e5a-93b3-a055cec3dbe9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:33.894088 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9ae4dafc-786b-4e5a-93b3-a055cec3dbe9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:33.894610 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9ae4dafc-786b-4e5a-93b3-a055cec3dbe9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:33.895625 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9ae4dafc-786b-4e5a-93b3-a055cec3dbe9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:33.896088 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9ae4dafc-786b-4e5a-93b3-a055cec3dbe9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:33.926684 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9ae4dafc-786b-4e5a-93b3-a055cec3dbe9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:21:34.021972 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9ae4dafc-786b-4e5a-93b3-a055cec3dbe9 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "DELETE /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 204 len: 0 microversion: 2.1 time: 0.140241 Jul 18 03:21:34.022932 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3495/6973] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:21:33 2022] DELETE /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:21:34.034224 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d36315ca-af0f-4bf0-9fe1-a3c270c6038b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:34.034937 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d36315ca-af0f-4bf0-9fe1-a3c270c6038b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:34.050532 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d36315ca-af0f-4bf0-9fe1-a3c270c6038b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:34.051435 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d36315ca-af0f-4bf0-9fe1-a3c270c6038b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:34.052845 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d36315ca-af0f-4bf0-9fe1-a3c270c6038b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:34.053154 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d36315ca-af0f-4bf0-9fe1-a3c270c6038b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:34.219327 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d36315ca-af0f-4bf0-9fe1-a3c270c6038b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:21:34.227951 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d36315ca-af0f-4bf0-9fe1-a3c270c6038b tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1724 microversion: 2.1 time: 0.200619 Jul 18 03:21:34.228551 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3479/6974] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:34 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:21:35.247275 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1cd54948-7c9b-4b5d-906b-5f4eed32db57 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:35.248092 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1cd54948-7c9b-4b5d-906b-5f4eed32db57 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:35.255206 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1cd54948-7c9b-4b5d-906b-5f4eed32db57 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:35.255676 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1cd54948-7c9b-4b5d-906b-5f4eed32db57 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:35.256465 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1cd54948-7c9b-4b5d-906b-5f4eed32db57 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:35.256917 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1cd54948-7c9b-4b5d-906b-5f4eed32db57 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:35.397447 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1cd54948-7c9b-4b5d-906b-5f4eed32db57 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:21:35.406444 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1cd54948-7c9b-4b5d-906b-5f4eed32db57 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1724 microversion: 2.1 time: 0.164218 Jul 18 03:21:35.406997 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3496/6975] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:35 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:21:36.135295 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-051f270c-3947-4d14-9b31-8e22449d1695 req-d5ee3580-276d-4c5e-9573-a4cac27df3e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cee99d7f-bb90-48d5-a676-52708eaf89ea", "name": "network-vif-plugged", "status": "completed", "tag": "22125498-7019-4f58-8d02-88a5992819a9"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:21:36.144767 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-051f270c-3947-4d14-9b31-8e22449d1695 req-d5ee3580-276d-4c5e-9573-a4cac27df3e3 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:36.145189 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-051f270c-3947-4d14-9b31-8e22449d1695 req-d5ee3580-276d-4c5e-9573-a4cac27df3e3 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:36.164627 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-051f270c-3947-4d14-9b31-8e22449d1695 req-d5ee3580-276d-4c5e-9573-a4cac27df3e3 service nova] Creating event network-vif-plugged:22125498-7019-4f58-8d02-88a5992819a9 for instance cee99d7f-bb90-48d5-a676-52708eaf89ea on n-h1-465891-3 Jul 18 03:21:36.170953 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-051f270c-3947-4d14-9b31-8e22449d1695 req-d5ee3580-276d-4c5e-9573-a4cac27df3e3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041230 Jul 18 03:21:36.171625 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3480/6976] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:21:36.424480 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cb1ea318-032a-4678-ade5-f70e83a70308 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:36.425111 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cb1ea318-032a-4678-ade5-f70e83a70308 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:36.432295 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cb1ea318-032a-4678-ade5-f70e83a70308 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:36.432764 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cb1ea318-032a-4678-ade5-f70e83a70308 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:36.433564 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cb1ea318-032a-4678-ade5-f70e83a70308 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:36.434059 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cb1ea318-032a-4678-ade5-f70e83a70308 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:36.550381 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cb1ea318-032a-4678-ade5-f70e83a70308 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:21:36.560647 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cb1ea318-032a-4678-ade5-f70e83a70308 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1656 microversion: 2.1 time: 0.139155 Jul 18 03:21:36.561618 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3497/6977] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:36 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1656 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:21:36.824420 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-000ab0f4-733c-4202-880a-2776dd821469 req-4012a762-c405-4bbf-88e8-1c29b67e9b21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cee99d7f-bb90-48d5-a676-52708eaf89ea", "name": "network-vif-deleted", "tag": "22125498-7019-4f58-8d02-88a5992819a9"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:21:36.841182 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-000ab0f4-733c-4202-880a-2776dd821469 req-4012a762-c405-4bbf-88e8-1c29b67e9b21 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:36.841853 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-000ab0f4-733c-4202-880a-2776dd821469 req-4012a762-c405-4bbf-88e8-1c29b67e9b21 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:36.854174 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-000ab0f4-733c-4202-880a-2776dd821469 req-4012a762-c405-4bbf-88e8-1c29b67e9b21 service nova] Creating event network-vif-deleted:22125498-7019-4f58-8d02-88a5992819a9 for instance cee99d7f-bb90-48d5-a676-52708eaf89ea on n-h1-465891-3 Jul 18 03:21:36.860198 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-000ab0f4-733c-4202-880a-2776dd821469 req-4012a762-c405-4bbf-88e8-1c29b67e9b21 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043831 Jul 18 03:21:36.860826 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3481/6978] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:21:37.578733 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c0e73d22-e0ae-43ca-b6eb-e3fdace8e2cb tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:37.579374 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c0e73d22-e0ae-43ca-b6eb-e3fdace8e2cb tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:37.582389 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:21:37.589289 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c0e73d22-e0ae-43ca-b6eb-e3fdace8e2cb tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:37.589769 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c0e73d22-e0ae-43ca-b6eb-e3fdace8e2cb tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:37.594098 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c0e73d22-e0ae-43ca-b6eb-e3fdace8e2cb tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:37.594729 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c0e73d22-e0ae-43ca-b6eb-e3fdace8e2cb tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:37.665559 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c0e73d22-e0ae-43ca-b6eb-e3fdace8e2cb tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:21:37.676606 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c0e73d22-e0ae-43ca-b6eb-e3fdace8e2cb tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1370 microversion: 2.1 time: 0.102054 Jul 18 03:21:37.678618 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3498/6979] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:37 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1370 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:21:38.694562 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-68cbbe2a-8e3a-43d4-92af-058677ad2ff7 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:38.695189 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-68cbbe2a-8e3a-43d4-92af-058677ad2ff7 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:38.697399 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=36 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:21:38.705900 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-68cbbe2a-8e3a-43d4-92af-058677ad2ff7 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:38.706772 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-68cbbe2a-8e3a-43d4-92af-058677ad2ff7 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:38.708006 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-68cbbe2a-8e3a-43d4-92af-058677ad2ff7 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:38.708385 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-68cbbe2a-8e3a-43d4-92af-058677ad2ff7 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:38.714662 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=96 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:21:38.775896 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-68cbbe2a-8e3a-43d4-92af-058677ad2ff7 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:21:38.785220 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-68cbbe2a-8e3a-43d4-92af-058677ad2ff7 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1370 microversion: 2.1 time: 0.096071 Jul 18 03:21:38.785825 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3482/6980] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:38 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1370 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:21:39.803125 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-95a48683-be4b-416f-8d4b-aa3d880705ce tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:39.803652 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-95a48683-be4b-416f-8d4b-aa3d880705ce tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:39.811637 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-95a48683-be4b-416f-8d4b-aa3d880705ce tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:39.812107 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-95a48683-be4b-416f-8d4b-aa3d880705ce tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:39.812916 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-95a48683-be4b-416f-8d4b-aa3d880705ce tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:39.813374 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-95a48683-be4b-416f-8d4b-aa3d880705ce tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:39.882329 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-95a48683-be4b-416f-8d4b-aa3d880705ce tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:21:39.890613 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-95a48683-be4b-416f-8d4b-aa3d880705ce tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1370 microversion: 2.1 time: 0.091578 Jul 18 03:21:39.891194 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3499/6981] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:39 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1370 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:21:40.908829 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f634c1e3-e907-4078-92c0-685e651d4745 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:40.909464 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f634c1e3-e907-4078-92c0-685e651d4745 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:40.917677 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f634c1e3-e907-4078-92c0-685e651d4745 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:40.918155 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f634c1e3-e907-4078-92c0-685e651d4745 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:40.920021 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f634c1e3-e907-4078-92c0-685e651d4745 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:40.920697 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f634c1e3-e907-4078-92c0-685e651d4745 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:40.988844 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f634c1e3-e907-4078-92c0-685e651d4745 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f0c35138a3430f97850934128310d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735af4c358a64b9cbc4a61a33985b9b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:21:40.998112 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f634c1e3-e907-4078-92c0-685e651d4745 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 200 len: 1370 microversion: 2.1 time: 0.093375 Jul 18 03:21:40.998697 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3483/6982] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:40 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 1370 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:21:42.014902 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0c58b193-9585-4e5a-b095-24443f6f536c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:42.015529 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0c58b193-9585-4e5a-b095-24443f6f536c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:42.023002 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c58b193-9585-4e5a-b095-24443f6f536c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:42.023465 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c58b193-9585-4e5a-b095-24443f6f536c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:42.024249 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c58b193-9585-4e5a-b095-24443f6f536c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:42.024700 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c58b193-9585-4e5a-b095-24443f6f536c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:42.039378 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-0c58b193-9585-4e5a-b095-24443f6f536c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] HTTP exception thrown: Instance cee99d7f-bb90-48d5-a676-52708eaf89ea could not be found. Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0c58b193-9585-4e5a-b095-24443f6f536c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Request method failure captured: Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea HTTP/1.1 Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1NAG6n_J2rNfvjGE6tf7j0WubnLjYbUZkg89AdB_m51VufhJ39XnIb0TmV_VVToQ_i_5-V0sK6RpZIQpSTqBKYIT5BrJJ7toLiPDmvP9k5QSxkcWvnshbbMUZbr7tAQNfRbL8QooouumBDZt90piJMD7xS5_3rIJ9QUoKQLsChc4eY8 Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 735af4c358a64b9cbc4a61a33985b9b1 Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServerActionsTestJSON-695654908 Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/735af4c358a64b9cbc4a61a33985b9b1"}]}] Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServerActionsTestJSON-695654908 Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 735af4c358a64b9cbc4a61a33985b9b1 Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServerActionsTestJSON-695654908 Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServerActionsTestJSON-695654908-project Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 16f0c35138a3430f97850934128310d1 Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServerActionsTestJSON-695654908-project Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance cee99d7f-bb90-48d5-a676-52708eaf89ea could not be found. Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'cee99d7f-bb90-48d5-a676-52708eaf89ea'} Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cee99d7f-bb90-48d5-a676-52708eaf89ea could not be found. Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cee99d7f-bb90-48d5-a676-52708eaf89ea could not be found. Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:21:42.041387 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:21:42.046027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:21:42.046027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:21:42.046027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:21:42.046027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:21:42.046027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:21:42.046027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cee99d7f-bb90-48d5-a676-52708eaf89ea could not be found. Jul 18 03:21:42.046027 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:21:42.046027 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0c58b193-9585-4e5a-b095-24443f6f536c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Returning 404 to user: Instance cee99d7f-bb90-48d5-a676-52708eaf89ea could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:21:42.046027 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0c58b193-9585-4e5a-b095-24443f6f536c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 404 len: 111 microversion: 2.1 time: 0.032247 Jul 18 03:21:42.046027 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3500/6983] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:42 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:21:42.105117 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-98d2d787-8ab3-4bbe-ad9a-416135544fe8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:42.106127 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-98d2d787-8ab3-4bbe-ad9a-416135544fe8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:42.114027 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-98d2d787-8ab3-4bbe-ad9a-416135544fe8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:42.114472 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-98d2d787-8ab3-4bbe-ad9a-416135544fe8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:42.115242 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-98d2d787-8ab3-4bbe-ad9a-416135544fe8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:42.115687 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-98d2d787-8ab3-4bbe-ad9a-416135544fe8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:42.129497 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-98d2d787-8ab3-4bbe-ad9a-416135544fe8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] HTTP exception thrown: Instance cee99d7f-bb90-48d5-a676-52708eaf89ea could not be found. Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-98d2d787-8ab3-4bbe-ad9a-416135544fe8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Request method failure captured: Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea/os-volume_attachments HTTP/1.1 Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1NAG6n_J2rNfvjGE6tf7j0WubnLjYbUZkg89AdB_m51VufhJ39XnIb0TmV_VVToQ_i_5-V0sK6RpZIQpSTqBKYIT5BrJJ7toLiPDmvP9k5QSxkcWvnshbbMUZbr7tAQNfRbL8QooouumBDZt90piJMD7xS5_3rIJ9QUoKQLsChc4eY8 Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 735af4c358a64b9cbc4a61a33985b9b1 Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServerActionsTestJSON-695654908 Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/735af4c358a64b9cbc4a61a33985b9b1"}]}] Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServerActionsTestJSON-695654908 Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 735af4c358a64b9cbc4a61a33985b9b1 Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServerActionsTestJSON-695654908 Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServerActionsTestJSON-695654908-project Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 16f0c35138a3430f97850934128310d1 Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServerActionsTestJSON-695654908-project Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance cee99d7f-bb90-48d5-a676-52708eaf89ea could not be found. Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'server_id': 'cee99d7f-bb90-48d5-a676-52708eaf89ea'} Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cee99d7f-bb90-48d5-a676-52708eaf89ea could not be found. Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:21:42.131158 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cee99d7f-bb90-48d5-a676-52708eaf89ea could not be found. Jul 18 03:21:42.136316 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:21:42.136316 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:21:42.136316 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:21:42.136316 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:21:42.136316 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:21:42.136316 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:21:42.136316 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:21:42.136316 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:21:42.136316 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cee99d7f-bb90-48d5-a676-52708eaf89ea could not be found. Jul 18 03:21:42.136316 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:21:42.136316 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-98d2d787-8ab3-4bbe-ad9a-416135544fe8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Returning 404 to user: Instance cee99d7f-bb90-48d5-a676-52708eaf89ea could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:21:42.136316 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-98d2d787-8ab3-4bbe-ad9a-416135544fe8 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031523 Jul 18 03:21:42.136316 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3484/6984] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 03:21:42 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:21:45.454326 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-85bc4c6d-ca2d-431f-8643-ad5a9cdd11af tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:45.454863 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-85bc4c6d-ca2d-431f-8643-ad5a9cdd11af tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:45.462303 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85bc4c6d-ca2d-431f-8643-ad5a9cdd11af tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:45.462772 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85bc4c6d-ca2d-431f-8643-ad5a9cdd11af tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:45.463575 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85bc4c6d-ca2d-431f-8643-ad5a9cdd11af tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:45.464032 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85bc4c6d-ca2d-431f-8643-ad5a9cdd11af tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:45.480054 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-85bc4c6d-ca2d-431f-8643-ad5a9cdd11af tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] HTTP exception thrown: Instance cee99d7f-bb90-48d5-a676-52708eaf89ea could not be found. Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-85bc4c6d-ca2d-431f-8643-ad5a9cdd11af tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Request method failure captured: Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea HTTP/1.1 Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1NAG6n_J2rNfvjGE6tf7j0WubnLjYbUZkg89AdB_m51VufhJ39XnIb0TmV_VVToQ_i_5-V0sK6RpZIQpSTqBKYIT5BrJJ7toLiPDmvP9k5QSxkcWvnshbbMUZbr7tAQNfRbL8QooouumBDZt90piJMD7xS5_3rIJ9QUoKQLsChc4eY8 Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 735af4c358a64b9cbc4a61a33985b9b1 Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServerActionsTestJSON-695654908 Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/735af4c358a64b9cbc4a61a33985b9b1"}]}] Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServerActionsTestJSON-695654908 Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 735af4c358a64b9cbc4a61a33985b9b1 Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServerActionsTestJSON-695654908 Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServerActionsTestJSON-695654908-project Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 16f0c35138a3430f97850934128310d1 Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServerActionsTestJSON-695654908-project Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance cee99d7f-bb90-48d5-a676-52708eaf89ea could not be found. Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'cee99d7f-bb90-48d5-a676-52708eaf89ea'} Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cee99d7f-bb90-48d5-a676-52708eaf89ea could not be found. Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:21:45.481658 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:21:45.486807 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cee99d7f-bb90-48d5-a676-52708eaf89ea could not be found. Jul 18 03:21:45.486807 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:21:45.486807 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:21:45.486807 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:21:45.486807 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:21:45.486807 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:21:45.486807 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:21:45.486807 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:21:45.486807 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:21:45.486807 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cee99d7f-bb90-48d5-a676-52708eaf89ea could not be found. Jul 18 03:21:45.486807 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:21:45.486807 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-85bc4c6d-ca2d-431f-8643-ad5a9cdd11af tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Returning 404 to user: Instance cee99d7f-bb90-48d5-a676-52708eaf89ea could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:21:45.486807 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-85bc4c6d-ca2d-431f-8643-ad5a9cdd11af tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "DELETE /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 404 len: 111 microversion: 2.1 time: 0.033951 Jul 18 03:21:45.486807 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3501/6985] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:21:45 2022] DELETE /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:21:45.492662 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7636815a-b407-47ff-b2d4-ae14af589819 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:45.493280 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7636815a-b407-47ff-b2d4-ae14af589819 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: cee99d7f-bb90-48d5-a676-52708eaf89ea] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:45.501559 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7636815a-b407-47ff-b2d4-ae14af589819 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:45.502058 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7636815a-b407-47ff-b2d4-ae14af589819 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:45.503679 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7636815a-b407-47ff-b2d4-ae14af589819 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:45.504428 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7636815a-b407-47ff-b2d4-ae14af589819 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:45.519262 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-7636815a-b407-47ff-b2d4-ae14af589819 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] HTTP exception thrown: Instance cee99d7f-bb90-48d5-a676-52708eaf89ea could not be found. Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7636815a-b407-47ff-b2d4-ae14af589819 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Request method failure captured: Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea HTTP/1.1 Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1NAG6n_J2rNfvjGE6tf7j0WubnLjYbUZkg89AdB_m51VufhJ39XnIb0TmV_VVToQ_i_5-V0sK6RpZIQpSTqBKYIT5BrJJ7toLiPDmvP9k5QSxkcWvnshbbMUZbr7tAQNfRbL8QooouumBDZt90piJMD7xS5_3rIJ9QUoKQLsChc4eY8 Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 735af4c358a64b9cbc4a61a33985b9b1 Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServerActionsTestJSON-695654908 Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/735af4c358a64b9cbc4a61a33985b9b1"}]}] Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServerActionsTestJSON-695654908 Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 735af4c358a64b9cbc4a61a33985b9b1 Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServerActionsTestJSON-695654908 Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServerActionsTestJSON-695654908-project Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 16f0c35138a3430f97850934128310d1 Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServerActionsTestJSON-695654908-project Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance cee99d7f-bb90-48d5-a676-52708eaf89ea could not be found. Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'cee99d7f-bb90-48d5-a676-52708eaf89ea'} Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cee99d7f-bb90-48d5-a676-52708eaf89ea could not be found. Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cee99d7f-bb90-48d5-a676-52708eaf89ea could not be found. Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:21:45.520822 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:21:45.524450 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:21:45.524450 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:21:45.524450 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:21:45.524450 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:21:45.524450 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:21:45.524450 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cee99d7f-bb90-48d5-a676-52708eaf89ea could not be found. Jul 18 03:21:45.524450 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:21:45.524450 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7636815a-b407-47ff-b2d4-ae14af589819 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Returning 404 to user: Instance cee99d7f-bb90-48d5-a676-52708eaf89ea could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:21:45.524450 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7636815a-b407-47ff-b2d4-ae14af589819 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea" status: 404 len: 111 microversion: 2.1 time: 0.033612 Jul 18 03:21:45.524450 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3485/6986] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:45 2022] GET /compute/v2.1/servers/cee99d7f-bb90-48d5-a676-52708eaf89ea => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:21:45.531683 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b3a90084-175f-425e-88bd-4d45197eab39 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:45.532293 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b3a90084-175f-425e-88bd-4d45197eab39 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:45.538907 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b3a90084-175f-425e-88bd-4d45197eab39 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:45.539375 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b3a90084-175f-425e-88bd-4d45197eab39 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:45.540177 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b3a90084-175f-425e-88bd-4d45197eab39 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:45.540636 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b3a90084-175f-425e-88bd-4d45197eab39 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:45.555308 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-b3a90084-175f-425e-88bd-4d45197eab39 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] HTTP exception thrown: Instance 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd could not be found. Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b3a90084-175f-425e-88bd-4d45197eab39 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Request method failure captured: Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd HTTP/1.1 Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1NAG6n_J2rNfvjGE6tf7j0WubnLjYbUZkg89AdB_m51VufhJ39XnIb0TmV_VVToQ_i_5-V0sK6RpZIQpSTqBKYIT5BrJJ7toLiPDmvP9k5QSxkcWvnshbbMUZbr7tAQNfRbL8QooouumBDZt90piJMD7xS5_3rIJ9QUoKQLsChc4eY8 Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 735af4c358a64b9cbc4a61a33985b9b1 Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServerActionsTestJSON-695654908 Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/735af4c358a64b9cbc4a61a33985b9b1"}]}] Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServerActionsTestJSON-695654908 Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 735af4c358a64b9cbc4a61a33985b9b1 Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServerActionsTestJSON-695654908 Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServerActionsTestJSON-695654908-project Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 16f0c35138a3430f97850934128310d1 Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServerActionsTestJSON-695654908-project Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd could not be found. Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '3c630e4c-54bc-4ddf-84d5-e9a38af2adbd'} Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd could not be found. Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:21:45.556916 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:21:45.561040 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd could not be found. Jul 18 03:21:45.561040 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:21:45.561040 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:21:45.561040 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:21:45.561040 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:21:45.561040 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:21:45.561040 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:21:45.561040 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:21:45.561040 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:21:45.561040 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd could not be found. Jul 18 03:21:45.561040 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:21:45.561040 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b3a90084-175f-425e-88bd-4d45197eab39 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Returning 404 to user: Instance 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:21:45.561040 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b3a90084-175f-425e-88bd-4d45197eab39 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 404 len: 111 microversion: 2.1 time: 0.031552 Jul 18 03:21:45.561040 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3502/6987] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:21:45 2022] DELETE /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:21:45.567739 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-210b863e-0edd-4f4f-a061-d1bbe486a184 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:45.568350 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-210b863e-0edd-4f4f-a061-d1bbe486a184 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:45.574908 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-210b863e-0edd-4f4f-a061-d1bbe486a184 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:45.575367 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-210b863e-0edd-4f4f-a061-d1bbe486a184 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:45.576724 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-210b863e-0edd-4f4f-a061-d1bbe486a184 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:45.577285 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-210b863e-0edd-4f4f-a061-d1bbe486a184 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:45.592924 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-210b863e-0edd-4f4f-a061-d1bbe486a184 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] HTTP exception thrown: Instance 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd could not be found. Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-210b863e-0edd-4f4f-a061-d1bbe486a184 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Request method failure captured: Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd HTTP/1.1 Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1NAG6n_J2rNfvjGE6tf7j0WubnLjYbUZkg89AdB_m51VufhJ39XnIb0TmV_VVToQ_i_5-V0sK6RpZIQpSTqBKYIT5BrJJ7toLiPDmvP9k5QSxkcWvnshbbMUZbr7tAQNfRbL8QooouumBDZt90piJMD7xS5_3rIJ9QUoKQLsChc4eY8 Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 735af4c358a64b9cbc4a61a33985b9b1 Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServerActionsTestJSON-695654908 Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/735af4c358a64b9cbc4a61a33985b9b1"}]}] Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServerActionsTestJSON-695654908 Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 735af4c358a64b9cbc4a61a33985b9b1 Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServerActionsTestJSON-695654908 Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServerActionsTestJSON-695654908-project Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 16f0c35138a3430f97850934128310d1 Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServerActionsTestJSON-695654908-project Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd could not be found. Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '3c630e4c-54bc-4ddf-84d5-e9a38af2adbd'} Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd could not be found. Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd could not be found. Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:21:45.594566 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:21:45.598828 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:21:45.598828 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:21:45.598828 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:21:45.598828 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:21:45.598828 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:21:45.598828 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd could not be found. Jul 18 03:21:45.598828 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:21:45.598828 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-210b863e-0edd-4f4f-a061-d1bbe486a184 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Returning 404 to user: Instance 3c630e4c-54bc-4ddf-84d5-e9a38af2adbd could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:21:45.598828 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-210b863e-0edd-4f4f-a061-d1bbe486a184 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd" status: 404 len: 111 microversion: 2.1 time: 0.032290 Jul 18 03:21:45.599731 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3486/6988] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:45 2022] GET /compute/v2.1/servers/3c630e4c-54bc-4ddf-84d5-e9a38af2adbd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:21:45.605017 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ab772120-b653-45cc-b213-14aff39b1343 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:45.605525 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ab772120-b653-45cc-b213-14aff39b1343 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:45.612052 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ab772120-b653-45cc-b213-14aff39b1343 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:45.612526 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ab772120-b653-45cc-b213-14aff39b1343 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:45.613314 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ab772120-b653-45cc-b213-14aff39b1343 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:45.613787 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ab772120-b653-45cc-b213-14aff39b1343 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:45.628918 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-ab772120-b653-45cc-b213-14aff39b1343 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] HTTP exception thrown: Instance 0bc080aa-5510-4c63-8558-26ccc6e5024a could not be found. Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ab772120-b653-45cc-b213-14aff39b1343 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Request method failure captured: Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a HTTP/1.1 Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1NAG6n_J2rNfvjGE6tf7j0WubnLjYbUZkg89AdB_m51VufhJ39XnIb0TmV_VVToQ_i_5-V0sK6RpZIQpSTqBKYIT5BrJJ7toLiPDmvP9k5QSxkcWvnshbbMUZbr7tAQNfRbL8QooouumBDZt90piJMD7xS5_3rIJ9QUoKQLsChc4eY8 Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 735af4c358a64b9cbc4a61a33985b9b1 Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServerActionsTestJSON-695654908 Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/735af4c358a64b9cbc4a61a33985b9b1"}]}] Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServerActionsTestJSON-695654908 Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 735af4c358a64b9cbc4a61a33985b9b1 Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServerActionsTestJSON-695654908 Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServerActionsTestJSON-695654908-project Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 16f0c35138a3430f97850934128310d1 Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServerActionsTestJSON-695654908-project Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 0bc080aa-5510-4c63-8558-26ccc6e5024a could not be found. Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '0bc080aa-5510-4c63-8558-26ccc6e5024a'} Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bc080aa-5510-4c63-8558-26ccc6e5024a could not be found. Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:21:45.630630 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:21:45.635821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bc080aa-5510-4c63-8558-26ccc6e5024a could not be found. Jul 18 03:21:45.635821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:21:45.635821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:21:45.635821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:21:45.635821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:21:45.635821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:21:45.635821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:21:45.635821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:21:45.635821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:21:45.635821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bc080aa-5510-4c63-8558-26ccc6e5024a could not be found. Jul 18 03:21:45.635821 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:21:45.635821 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ab772120-b653-45cc-b213-14aff39b1343 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Returning 404 to user: Instance 0bc080aa-5510-4c63-8558-26ccc6e5024a could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:21:45.635821 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ab772120-b653-45cc-b213-14aff39b1343 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "DELETE /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 404 len: 111 microversion: 2.1 time: 0.031120 Jul 18 03:21:45.635821 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3503/6989] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:21:45 2022] DELETE /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:21:45.641582 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cf00ed86-0a90-4ea4-9b3d-4f756ca9bf3c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:45.642229 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cf00ed86-0a90-4ea4-9b3d-4f756ca9bf3c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: 0bc080aa-5510-4c63-8558-26ccc6e5024a] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:45.648678 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cf00ed86-0a90-4ea4-9b3d-4f756ca9bf3c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:45.649133 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cf00ed86-0a90-4ea4-9b3d-4f756ca9bf3c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:45.649955 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cf00ed86-0a90-4ea4-9b3d-4f756ca9bf3c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:45.650395 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cf00ed86-0a90-4ea4-9b3d-4f756ca9bf3c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:45.665591 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-cf00ed86-0a90-4ea4-9b3d-4f756ca9bf3c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] HTTP exception thrown: Instance 0bc080aa-5510-4c63-8558-26ccc6e5024a could not be found. Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cf00ed86-0a90-4ea4-9b3d-4f756ca9bf3c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Request method failure captured: Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a HTTP/1.1 Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1NAG6n_J2rNfvjGE6tf7j0WubnLjYbUZkg89AdB_m51VufhJ39XnIb0TmV_VVToQ_i_5-V0sK6RpZIQpSTqBKYIT5BrJJ7toLiPDmvP9k5QSxkcWvnshbbMUZbr7tAQNfRbL8QooouumBDZt90piJMD7xS5_3rIJ9QUoKQLsChc4eY8 Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 735af4c358a64b9cbc4a61a33985b9b1 Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServerActionsTestJSON-695654908 Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/735af4c358a64b9cbc4a61a33985b9b1"}]}] Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServerActionsTestJSON-695654908 Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 735af4c358a64b9cbc4a61a33985b9b1 Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServerActionsTestJSON-695654908 Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServerActionsTestJSON-695654908-project Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 16f0c35138a3430f97850934128310d1 Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServerActionsTestJSON-695654908-project Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 0bc080aa-5510-4c63-8558-26ccc6e5024a could not be found. Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '0bc080aa-5510-4c63-8558-26ccc6e5024a'} Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bc080aa-5510-4c63-8558-26ccc6e5024a could not be found. Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bc080aa-5510-4c63-8558-26ccc6e5024a could not be found. Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:21:45.667176 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:21:45.672399 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:21:45.672399 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:21:45.672399 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:21:45.672399 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:21:45.672399 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:21:45.672399 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bc080aa-5510-4c63-8558-26ccc6e5024a could not be found. Jul 18 03:21:45.672399 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:21:45.672399 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cf00ed86-0a90-4ea4-9b3d-4f756ca9bf3c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Returning 404 to user: Instance 0bc080aa-5510-4c63-8558-26ccc6e5024a could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:21:45.672399 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cf00ed86-0a90-4ea4-9b3d-4f756ca9bf3c tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a" status: 404 len: 111 microversion: 2.1 time: 0.031605 Jul 18 03:21:45.672399 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3487/6990] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:45 2022] GET /compute/v2.1/servers/0bc080aa-5510-4c63-8558-26ccc6e5024a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 03:21:45.678297 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d6e639d4-f0e6-4a4a-a00e-ac106466d270 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:45.678732 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d6e639d4-f0e6-4a4a-a00e-ac106466d270 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:45.685122 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d6e639d4-f0e6-4a4a-a00e-ac106466d270 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:45.686242 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d6e639d4-f0e6-4a4a-a00e-ac106466d270 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:45.687053 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d6e639d4-f0e6-4a4a-a00e-ac106466d270 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:45.687514 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d6e639d4-f0e6-4a4a-a00e-ac106466d270 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:45.702084 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-d6e639d4-f0e6-4a4a-a00e-ac106466d270 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] HTTP exception thrown: Instance d4503a84-9a3f-492e-b70b-843c0479fca6 could not be found. Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d6e639d4-f0e6-4a4a-a00e-ac106466d270 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Request method failure captured: Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 HTTP/1.1 Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1NAG6n_J2rNfvjGE6tf7j0WubnLjYbUZkg89AdB_m51VufhJ39XnIb0TmV_VVToQ_i_5-V0sK6RpZIQpSTqBKYIT5BrJJ7toLiPDmvP9k5QSxkcWvnshbbMUZbr7tAQNfRbL8QooouumBDZt90piJMD7xS5_3rIJ9QUoKQLsChc4eY8 Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 735af4c358a64b9cbc4a61a33985b9b1 Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServerActionsTestJSON-695654908 Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/735af4c358a64b9cbc4a61a33985b9b1"}]}] Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServerActionsTestJSON-695654908 Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 735af4c358a64b9cbc4a61a33985b9b1 Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServerActionsTestJSON-695654908 Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServerActionsTestJSON-695654908-project Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 16f0c35138a3430f97850934128310d1 Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServerActionsTestJSON-695654908-project Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance d4503a84-9a3f-492e-b70b-843c0479fca6 could not be found. Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'd4503a84-9a3f-492e-b70b-843c0479fca6'} Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4503a84-9a3f-492e-b70b-843c0479fca6 could not be found. Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:21:45.703660 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:21:45.707600 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4503a84-9a3f-492e-b70b-843c0479fca6 could not be found. Jul 18 03:21:45.707600 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:21:45.707600 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:21:45.707600 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:21:45.707600 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:21:45.707600 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:21:45.707600 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:21:45.707600 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:21:45.707600 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:21:45.707600 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4503a84-9a3f-492e-b70b-843c0479fca6 could not be found. Jul 18 03:21:45.707600 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:21:45.707600 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d6e639d4-f0e6-4a4a-a00e-ac106466d270 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Returning 404 to user: Instance d4503a84-9a3f-492e-b70b-843c0479fca6 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:21:45.707600 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d6e639d4-f0e6-4a4a-a00e-ac106466d270 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 404 len: 111 microversion: 2.1 time: 0.030836 Jul 18 03:21:45.707600 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3504/6991] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:21:45 2022] DELETE /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:21:45.713734 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-230f1dbd-4962-40bd-bc9e-00eb58c81754 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:45.714351 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-230f1dbd-4962-40bd-bc9e-00eb58c81754 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] [instance: d4503a84-9a3f-492e-b70b-843c0479fca6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:45.720952 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-230f1dbd-4962-40bd-bc9e-00eb58c81754 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:45.721408 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-230f1dbd-4962-40bd-bc9e-00eb58c81754 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:45.722214 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-230f1dbd-4962-40bd-bc9e-00eb58c81754 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:45.722661 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-230f1dbd-4962-40bd-bc9e-00eb58c81754 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:45.736888 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-230f1dbd-4962-40bd-bc9e-00eb58c81754 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] HTTP exception thrown: Instance d4503a84-9a3f-492e-b70b-843c0479fca6 could not be found. Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-230f1dbd-4962-40bd-bc9e-00eb58c81754 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Request method failure captured: Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 HTTP/1.1 Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1NAG6n_J2rNfvjGE6tf7j0WubnLjYbUZkg89AdB_m51VufhJ39XnIb0TmV_VVToQ_i_5-V0sK6RpZIQpSTqBKYIT5BrJJ7toLiPDmvP9k5QSxkcWvnshbbMUZbr7tAQNfRbL8QooouumBDZt90piJMD7xS5_3rIJ9QUoKQLsChc4eY8 Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 735af4c358a64b9cbc4a61a33985b9b1 Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServerActionsTestJSON-695654908 Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/735af4c358a64b9cbc4a61a33985b9b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/735af4c358a64b9cbc4a61a33985b9b1"}]}] Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServerActionsTestJSON-695654908 Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 735af4c358a64b9cbc4a61a33985b9b1 Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServerActionsTestJSON-695654908 Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServerActionsTestJSON-695654908-project Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 16f0c35138a3430f97850934128310d1 Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServerActionsTestJSON-695654908-project Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance d4503a84-9a3f-492e-b70b-843c0479fca6 could not be found. Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'd4503a84-9a3f-492e-b70b-843c0479fca6'} Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4503a84-9a3f-492e-b70b-843c0479fca6 could not be found. Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4503a84-9a3f-492e-b70b-843c0479fca6 could not be found. Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:21:45.738465 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:21:45.744467 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:21:45.744467 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:21:45.744467 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:21:45.744467 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:21:45.744467 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:21:45.744467 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4503a84-9a3f-492e-b70b-843c0479fca6 could not be found. Jul 18 03:21:45.744467 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:21:45.744467 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-230f1dbd-4962-40bd-bc9e-00eb58c81754 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Returning 404 to user: Instance d4503a84-9a3f-492e-b70b-843c0479fca6 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:21:45.744467 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-230f1dbd-4962-40bd-bc9e-00eb58c81754 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6" status: 404 len: 111 microversion: 2.1 time: 0.030008 Jul 18 03:21:45.744467 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3488/6992] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:45 2022] GET /compute/v2.1/servers/d4503a84-9a3f-492e-b70b-843c0479fca6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:21:45.749741 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8f0d973e-ac2b-4004-9dfc-89505e02e557 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] Calling method '.version_select at 0x7ff4a880bdc0>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:45.772726 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8f0d973e-ac2b-4004-9dfc-89505e02e557 tempest-ServerActionsTestJSON-695654908 tempest-ServerActionsTestJSON-695654908-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2023945870" status: 202 len: 0 microversion: 2.1 time: 0.027537 Jul 18 03:21:45.773335 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3505/6993] 10.222.0.57 () {58 vars in 1220 bytes} [Mon Jul 18 03:21:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2023945870 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:21:55.455200 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-75261682-e5fb-4146-b092-b4763dcdcabd tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-519877723", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "4e1e67a0-ff9b-4944-9f01-60a4f9d1c065"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:21:55.508115 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-75261682-e5fb-4146-b092-b4763dcdcabd tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] validate_networks() for [('4e1e67a0-ff9b-4944-9f01-60a4f9d1c065', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:21:55.727743 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=21 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:21:55.915691 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-75261682-e5fb-4146-b092-b4763dcdcabd tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:21:55.916114 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-75261682-e5fb-4146-b092-b4763dcdcabd tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:21:55.916584 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-75261682-e5fb-4146-b092-b4763dcdcabd tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:21:55.916988 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-75261682-e5fb-4146-b092-b4763dcdcabd tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:21:55.917398 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-75261682-e5fb-4146-b092-b4763dcdcabd tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:21:55.926983 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-75261682-e5fb-4146-b092-b4763dcdcabd tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:55.927429 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-75261682-e5fb-4146-b092-b4763dcdcabd tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:55.928226 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-75261682-e5fb-4146-b092-b4763dcdcabd tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:55.928658 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-75261682-e5fb-4146-b092-b4763dcdcabd tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:55.945439 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-75261682-e5fb-4146-b092-b4763dcdcabd tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Getting quotas for project d54eedd92cc646abbe37ad4128f203bb. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:21:55.950861 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-75261682-e5fb-4146-b092-b4763dcdcabd tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Getting quotas for user 31f7e35708974bd293df9bcb94c6969f and project d54eedd92cc646abbe37ad4128f203bb. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:21:55.966557 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-75261682-e5fb-4146-b092-b4763dcdcabd tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:21:55.968862 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-75261682-e5fb-4146-b092-b4763dcdcabd tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 92b41430-5d9d-49a7-93af-67d8fda9b2a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:21:56.017414 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-75261682-e5fb-4146-b092-b4763dcdcabd tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.693853 Jul 18 03:21:56.018316 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3489/6994] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:21:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:21:56.026109 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:21:56.027277 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:21:56.032213 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-66861f32-fe0c-413a-8070-9633acfe8a4c tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:56.033069 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-66861f32-fe0c-413a-8070-9633acfe8a4c tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 92b41430-5d9d-49a7-93af-67d8fda9b2a9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:56.099326 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-66861f32-fe0c-413a-8070-9633acfe8a4c tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f7e35708974bd293df9bcb94c6969f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54eedd92cc646abbe37ad4128f203bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:21:56.110688 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-66861f32-fe0c-413a-8070-9633acfe8a4c tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "GET /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9" status: 200 len: 1216 microversion: 2.1 time: 0.082528 Jul 18 03:21:56.111490 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3506/6995] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:56 2022] GET /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9 => generated 1216 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:21:57.129318 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0e21b696-e0ee-4d34-a92e-29d984bd9a2b tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:57.130720 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0e21b696-e0ee-4d34-a92e-29d984bd9a2b tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 92b41430-5d9d-49a7-93af-67d8fda9b2a9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:57.145558 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0e21b696-e0ee-4d34-a92e-29d984bd9a2b tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:57.146109 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0e21b696-e0ee-4d34-a92e-29d984bd9a2b tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:57.146932 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0e21b696-e0ee-4d34-a92e-29d984bd9a2b tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:57.147608 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0e21b696-e0ee-4d34-a92e-29d984bd9a2b tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:57.270639 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0e21b696-e0ee-4d34-a92e-29d984bd9a2b tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f7e35708974bd293df9bcb94c6969f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54eedd92cc646abbe37ad4128f203bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:21:57.282047 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0e21b696-e0ee-4d34-a92e-29d984bd9a2b tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "GET /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9" status: 200 len: 1276 microversion: 2.1 time: 0.157501 Jul 18 03:21:57.283351 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3490/6996] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:57 2022] GET /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9 => generated 1276 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:21:58.301073 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c52e633a-96dd-478c-a35e-0c524b042d9b tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:58.302451 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c52e633a-96dd-478c-a35e-0c524b042d9b tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 92b41430-5d9d-49a7-93af-67d8fda9b2a9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:58.310328 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c52e633a-96dd-478c-a35e-0c524b042d9b tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:58.311769 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c52e633a-96dd-478c-a35e-0c524b042d9b tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:58.313417 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c52e633a-96dd-478c-a35e-0c524b042d9b tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:58.314151 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c52e633a-96dd-478c-a35e-0c524b042d9b tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:58.548366 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c52e633a-96dd-478c-a35e-0c524b042d9b tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f7e35708974bd293df9bcb94c6969f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54eedd92cc646abbe37ad4128f203bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:21:58.562969 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c52e633a-96dd-478c-a35e-0c524b042d9b tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "GET /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9" status: 200 len: 1316 microversion: 2.1 time: 0.265973 Jul 18 03:21:58.563660 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3507/6997] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:58 2022] GET /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9 => generated 1316 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:21:58.868580 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-b5ea06ca-3bfe-4f5b-8db2-af40435cbc96 req-7d91cfde-e704-4a3b-af41-cc71484b30fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92b41430-5d9d-49a7-93af-67d8fda9b2a9", "tag": "3f8e8974-c7ae-48ce-bf99-7f763c654b04"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:21:58.906148 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-b5ea06ca-3bfe-4f5b-8db2-af40435cbc96 req-7d91cfde-e704-4a3b-af41-cc71484b30fc service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:58.906604 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-b5ea06ca-3bfe-4f5b-8db2-af40435cbc96 req-7d91cfde-e704-4a3b-af41-cc71484b30fc service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:58.924961 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-b5ea06ca-3bfe-4f5b-8db2-af40435cbc96 req-7d91cfde-e704-4a3b-af41-cc71484b30fc service nova] Creating event network-changed:3f8e8974-c7ae-48ce-bf99-7f763c654b04 for instance 92b41430-5d9d-49a7-93af-67d8fda9b2a9 on n-h2-465891-3 Jul 18 03:21:58.930851 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-b5ea06ca-3bfe-4f5b-8db2-af40435cbc96 req-7d91cfde-e704-4a3b-af41-cc71484b30fc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073811 Jul 18 03:21:58.931800 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3491/6998] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:21:59.580396 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f6a53b45-042b-4b8d-ad7d-c08a0787e2d8 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:21:59.581022 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f6a53b45-042b-4b8d-ad7d-c08a0787e2d8 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 92b41430-5d9d-49a7-93af-67d8fda9b2a9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:21:59.588026 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f6a53b45-042b-4b8d-ad7d-c08a0787e2d8 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:59.588480 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f6a53b45-042b-4b8d-ad7d-c08a0787e2d8 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:59.589252 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f6a53b45-042b-4b8d-ad7d-c08a0787e2d8 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:21:59.589721 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f6a53b45-042b-4b8d-ad7d-c08a0787e2d8 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:21:59.723526 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f6a53b45-042b-4b8d-ad7d-c08a0787e2d8 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f7e35708974bd293df9bcb94c6969f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54eedd92cc646abbe37ad4128f203bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:21:59.731023 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f6a53b45-042b-4b8d-ad7d-c08a0787e2d8 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "GET /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9" status: 200 len: 1316 microversion: 2.1 time: 0.154813 Jul 18 03:21:59.731594 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3508/6999] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:21:59 2022] GET /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9 => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:22:00.750354 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ae362243-4a76-4770-b4e6-9db44fe2d693 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:00.751079 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ae362243-4a76-4770-b4e6-9db44fe2d693 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 92b41430-5d9d-49a7-93af-67d8fda9b2a9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:00.757685 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ae362243-4a76-4770-b4e6-9db44fe2d693 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:00.758170 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ae362243-4a76-4770-b4e6-9db44fe2d693 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:00.758954 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ae362243-4a76-4770-b4e6-9db44fe2d693 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:00.759400 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ae362243-4a76-4770-b4e6-9db44fe2d693 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:00.896544 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ae362243-4a76-4770-b4e6-9db44fe2d693 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f7e35708974bd293df9bcb94c6969f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54eedd92cc646abbe37ad4128f203bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:00.904291 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ae362243-4a76-4770-b4e6-9db44fe2d693 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "GET /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9" status: 200 len: 1316 microversion: 2.1 time: 0.160123 Jul 18 03:22:00.904863 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3492/7000] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:00 2022] GET /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9 => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:22:01.922095 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3677022d-a06c-4315-8071-4352dab2921f tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:01.922725 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3677022d-a06c-4315-8071-4352dab2921f tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 92b41430-5d9d-49a7-93af-67d8fda9b2a9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:01.929813 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3677022d-a06c-4315-8071-4352dab2921f tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:01.930284 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3677022d-a06c-4315-8071-4352dab2921f tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:01.931074 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3677022d-a06c-4315-8071-4352dab2921f tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:01.931549 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3677022d-a06c-4315-8071-4352dab2921f tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:02.068883 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3677022d-a06c-4315-8071-4352dab2921f tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f7e35708974bd293df9bcb94c6969f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54eedd92cc646abbe37ad4128f203bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:02.076524 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3677022d-a06c-4315-8071-4352dab2921f tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "GET /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9" status: 200 len: 1316 microversion: 2.1 time: 0.158783 Jul 18 03:22:02.077935 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3509/7001] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:01 2022] GET /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9 => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:22:03.094093 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4e389b12-17e5-45f4-b32b-37b7e450d403 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:03.094712 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4e389b12-17e5-45f4-b32b-37b7e450d403 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 92b41430-5d9d-49a7-93af-67d8fda9b2a9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:03.101758 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e389b12-17e5-45f4-b32b-37b7e450d403 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:03.102217 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e389b12-17e5-45f4-b32b-37b7e450d403 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:03.102989 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e389b12-17e5-45f4-b32b-37b7e450d403 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:03.103429 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e389b12-17e5-45f4-b32b-37b7e450d403 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:03.238710 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4e389b12-17e5-45f4-b32b-37b7e450d403 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f7e35708974bd293df9bcb94c6969f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54eedd92cc646abbe37ad4128f203bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:03.246420 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4e389b12-17e5-45f4-b32b-37b7e450d403 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "GET /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9" status: 200 len: 1316 microversion: 2.1 time: 0.156377 Jul 18 03:22:03.246990 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3493/7002] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:03 2022] GET /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:22:03.508303 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-f70b0bb9-3c0a-45e7-ad9f-3277d27c9620 req-6b8c0ef9-aba0-41c2-94d6-ffa4f64a2f83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92b41430-5d9d-49a7-93af-67d8fda9b2a9", "name": "network-vif-plugged", "status": "completed", "tag": "3f8e8974-c7ae-48ce-bf99-7f763c654b04"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:22:03.516621 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-f70b0bb9-3c0a-45e7-ad9f-3277d27c9620 req-6b8c0ef9-aba0-41c2-94d6-ffa4f64a2f83 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:03.517089 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-f70b0bb9-3c0a-45e7-ad9f-3277d27c9620 req-6b8c0ef9-aba0-41c2-94d6-ffa4f64a2f83 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:03.528075 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-f70b0bb9-3c0a-45e7-ad9f-3277d27c9620 req-6b8c0ef9-aba0-41c2-94d6-ffa4f64a2f83 service nova] Creating event network-vif-plugged:3f8e8974-c7ae-48ce-bf99-7f763c654b04 for instance 92b41430-5d9d-49a7-93af-67d8fda9b2a9 on n-h2-465891-3 Jul 18 03:22:03.533147 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-f70b0bb9-3c0a-45e7-ad9f-3277d27c9620 req-6b8c0ef9-aba0-41c2-94d6-ffa4f64a2f83 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097396 Jul 18 03:22:03.533766 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3510/7003] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:22:04.264840 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-08206239-84d5-4b6a-ae73-7a1e3a883f7e tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:04.265500 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-08206239-84d5-4b6a-ae73-7a1e3a883f7e tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 92b41430-5d9d-49a7-93af-67d8fda9b2a9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:04.272398 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-08206239-84d5-4b6a-ae73-7a1e3a883f7e tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:04.272851 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-08206239-84d5-4b6a-ae73-7a1e3a883f7e tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:04.273616 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-08206239-84d5-4b6a-ae73-7a1e3a883f7e tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:04.274078 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-08206239-84d5-4b6a-ae73-7a1e3a883f7e tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:04.406684 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-08206239-84d5-4b6a-ae73-7a1e3a883f7e tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f7e35708974bd293df9bcb94c6969f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54eedd92cc646abbe37ad4128f203bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:04.414167 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-08206239-84d5-4b6a-ae73-7a1e3a883f7e tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "GET /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9" status: 200 len: 1316 microversion: 2.1 time: 0.153861 Jul 18 03:22:04.414744 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3494/7004] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:04 2022] GET /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9 => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:22:05.432488 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1ff96942-442b-428d-ab75-b9a9094e3f23 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:05.433148 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1ff96942-442b-428d-ab75-b9a9094e3f23 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 92b41430-5d9d-49a7-93af-67d8fda9b2a9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:05.439638 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1ff96942-442b-428d-ab75-b9a9094e3f23 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:05.440106 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1ff96942-442b-428d-ab75-b9a9094e3f23 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:05.440884 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1ff96942-442b-428d-ab75-b9a9094e3f23 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:05.441330 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1ff96942-442b-428d-ab75-b9a9094e3f23 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:05.581080 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1ff96942-442b-428d-ab75-b9a9094e3f23 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f7e35708974bd293df9bcb94c6969f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54eedd92cc646abbe37ad4128f203bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:05.588734 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1ff96942-442b-428d-ab75-b9a9094e3f23 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "GET /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9" status: 200 len: 1506 microversion: 2.1 time: 0.161442 Jul 18 03:22:05.589344 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3511/7005] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:05 2022] GET /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9 => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:22:05.645581 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f898988d-8f77-4543-b55d-a3f925d60c99 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2021489573", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "4e1e67a0-ff9b-4944-9f01-60a4f9d1c065"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:22:05.697179 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-f898988d-8f77-4543-b55d-a3f925d60c99 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] validate_networks() for [('4e1e67a0-ff9b-4944-9f01-60a4f9d1c065', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:22:05.937545 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:22:05.958193 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:22:06.070454 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-f898988d-8f77-4543-b55d-a3f925d60c99 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:22:06.070868 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-f898988d-8f77-4543-b55d-a3f925d60c99 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:22:06.071347 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-f898988d-8f77-4543-b55d-a3f925d60c99 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:22:06.071762 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-f898988d-8f77-4543-b55d-a3f925d60c99 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:22:06.072195 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-f898988d-8f77-4543-b55d-a3f925d60c99 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:22:06.082457 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f898988d-8f77-4543-b55d-a3f925d60c99 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:06.082916 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f898988d-8f77-4543-b55d-a3f925d60c99 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:06.083725 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f898988d-8f77-4543-b55d-a3f925d60c99 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:06.084165 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f898988d-8f77-4543-b55d-a3f925d60c99 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:06.101537 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-f898988d-8f77-4543-b55d-a3f925d60c99 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Getting quotas for project d54eedd92cc646abbe37ad4128f203bb. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:22:06.106972 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-f898988d-8f77-4543-b55d-a3f925d60c99 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Getting quotas for user 31f7e35708974bd293df9bcb94c6969f and project d54eedd92cc646abbe37ad4128f203bb. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:22:06.119940 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f898988d-8f77-4543-b55d-a3f925d60c99 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:22:06.122513 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f898988d-8f77-4543-b55d-a3f925d60c99 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 3326503b-7d53-43c1-a57b-d91fb1e2954e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:22:06.169339 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f898988d-8f77-4543-b55d-a3f925d60c99 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527545 Jul 18 03:22:06.170034 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3495/7006] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:22:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:22:06.180467 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-64ae9251-28b7-4b6c-ada6-b1510598fdac tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:06.181098 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-64ae9251-28b7-4b6c-ada6-b1510598fdac tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 3326503b-7d53-43c1-a57b-d91fb1e2954e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:06.183424 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:22:06.238394 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-64ae9251-28b7-4b6c-ada6-b1510598fdac tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f7e35708974bd293df9bcb94c6969f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54eedd92cc646abbe37ad4128f203bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:06.245114 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-64ae9251-28b7-4b6c-ada6-b1510598fdac tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "GET /compute/v2.1/servers/3326503b-7d53-43c1-a57b-d91fb1e2954e" status: 200 len: 1217 microversion: 2.1 time: 0.068525 Jul 18 03:22:06.245977 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3512/7007] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:06 2022] GET /compute/v2.1/servers/3326503b-7d53-43c1-a57b-d91fb1e2954e => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:22:07.264595 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ba33e0ff-7e69-4919-8837-b9ced1dc0c2e tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:07.265770 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ba33e0ff-7e69-4919-8837-b9ced1dc0c2e tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 3326503b-7d53-43c1-a57b-d91fb1e2954e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:07.275954 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba33e0ff-7e69-4919-8837-b9ced1dc0c2e tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:07.276485 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba33e0ff-7e69-4919-8837-b9ced1dc0c2e tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:07.277275 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba33e0ff-7e69-4919-8837-b9ced1dc0c2e tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:07.277887 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba33e0ff-7e69-4919-8837-b9ced1dc0c2e tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:07.382326 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ba33e0ff-7e69-4919-8837-b9ced1dc0c2e tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f7e35708974bd293df9bcb94c6969f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54eedd92cc646abbe37ad4128f203bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:07.390086 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ba33e0ff-7e69-4919-8837-b9ced1dc0c2e tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "GET /compute/v2.1/servers/3326503b-7d53-43c1-a57b-d91fb1e2954e" status: 200 len: 1277 microversion: 2.1 time: 0.130191 Jul 18 03:22:07.390689 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3496/7008] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:07 2022] GET /compute/v2.1/servers/3326503b-7d53-43c1-a57b-d91fb1e2954e => generated 1277 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:22:08.407334 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ceab5e76-2127-478e-a2a0-5ee43305c102 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:08.408132 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ceab5e76-2127-478e-a2a0-5ee43305c102 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 3326503b-7d53-43c1-a57b-d91fb1e2954e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:08.416786 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ceab5e76-2127-478e-a2a0-5ee43305c102 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:08.417161 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ceab5e76-2127-478e-a2a0-5ee43305c102 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:08.418006 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ceab5e76-2127-478e-a2a0-5ee43305c102 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:08.418459 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ceab5e76-2127-478e-a2a0-5ee43305c102 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:08.833948 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ceab5e76-2127-478e-a2a0-5ee43305c102 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f7e35708974bd293df9bcb94c6969f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54eedd92cc646abbe37ad4128f203bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:08.841525 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ceab5e76-2127-478e-a2a0-5ee43305c102 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "GET /compute/v2.1/servers/3326503b-7d53-43c1-a57b-d91fb1e2954e" status: 200 len: 1317 microversion: 2.1 time: 0.438497 Jul 18 03:22:08.842157 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3513/7009] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:08 2022] GET /compute/v2.1/servers/3326503b-7d53-43c1-a57b-d91fb1e2954e => generated 1317 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:22:09.240753 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-c647deaf-b234-454b-9d0d-f4fcea6fbe08 req-d2947e9c-f910-4d71-a73f-0cf5a5ac886a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3326503b-7d53-43c1-a57b-d91fb1e2954e", "tag": "786285e9-6469-4a34-83fc-3b32c5d280b8"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:22:09.244594 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:22:09.253331 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-c647deaf-b234-454b-9d0d-f4fcea6fbe08 req-d2947e9c-f910-4d71-a73f-0cf5a5ac886a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:09.254778 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-c647deaf-b234-454b-9d0d-f4fcea6fbe08 req-d2947e9c-f910-4d71-a73f-0cf5a5ac886a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:09.272929 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-c647deaf-b234-454b-9d0d-f4fcea6fbe08 req-d2947e9c-f910-4d71-a73f-0cf5a5ac886a service nova] Creating event network-changed:786285e9-6469-4a34-83fc-3b32c5d280b8 for instance 3326503b-7d53-43c1-a57b-d91fb1e2954e on n-h1-465891-3 Jul 18 03:22:09.279495 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-c647deaf-b234-454b-9d0d-f4fcea6fbe08 req-d2947e9c-f910-4d71-a73f-0cf5a5ac886a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126381 Jul 18 03:22:09.282442 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3497/7010] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:22:09.859995 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d0b60d18-d995-461f-aa1a-93556caa6691 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:09.860671 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d0b60d18-d995-461f-aa1a-93556caa6691 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 3326503b-7d53-43c1-a57b-d91fb1e2954e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:09.867820 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d0b60d18-d995-461f-aa1a-93556caa6691 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:09.868287 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d0b60d18-d995-461f-aa1a-93556caa6691 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:09.869087 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d0b60d18-d995-461f-aa1a-93556caa6691 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:09.869571 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d0b60d18-d995-461f-aa1a-93556caa6691 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:10.006726 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d0b60d18-d995-461f-aa1a-93556caa6691 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f7e35708974bd293df9bcb94c6969f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54eedd92cc646abbe37ad4128f203bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:10.014260 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d0b60d18-d995-461f-aa1a-93556caa6691 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "GET /compute/v2.1/servers/3326503b-7d53-43c1-a57b-d91fb1e2954e" status: 200 len: 1317 microversion: 2.1 time: 0.158896 Jul 18 03:22:10.016111 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3514/7011] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:09 2022] GET /compute/v2.1/servers/3326503b-7d53-43c1-a57b-d91fb1e2954e => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:22:11.033417 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1de3acf7-61ae-48ab-8835-0d5fb8194e86 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:11.034153 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1de3acf7-61ae-48ab-8835-0d5fb8194e86 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 3326503b-7d53-43c1-a57b-d91fb1e2954e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:11.041245 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1de3acf7-61ae-48ab-8835-0d5fb8194e86 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:11.041687 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1de3acf7-61ae-48ab-8835-0d5fb8194e86 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:11.042473 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1de3acf7-61ae-48ab-8835-0d5fb8194e86 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:11.042905 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1de3acf7-61ae-48ab-8835-0d5fb8194e86 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:11.179411 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1de3acf7-61ae-48ab-8835-0d5fb8194e86 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f7e35708974bd293df9bcb94c6969f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54eedd92cc646abbe37ad4128f203bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:11.187601 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1de3acf7-61ae-48ab-8835-0d5fb8194e86 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "GET /compute/v2.1/servers/3326503b-7d53-43c1-a57b-d91fb1e2954e" status: 200 len: 1317 microversion: 2.1 time: 0.159029 Jul 18 03:22:11.188558 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3498/7012] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:11 2022] GET /compute/v2.1/servers/3326503b-7d53-43c1-a57b-d91fb1e2954e => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:22:12.205003 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dd89d92e-7870-4d19-bf43-fc4384e5c613 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:12.205641 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-dd89d92e-7870-4d19-bf43-fc4384e5c613 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 3326503b-7d53-43c1-a57b-d91fb1e2954e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:12.212610 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dd89d92e-7870-4d19-bf43-fc4384e5c613 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:12.213070 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dd89d92e-7870-4d19-bf43-fc4384e5c613 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:12.213892 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dd89d92e-7870-4d19-bf43-fc4384e5c613 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:12.214347 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dd89d92e-7870-4d19-bf43-fc4384e5c613 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:12.347733 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-dd89d92e-7870-4d19-bf43-fc4384e5c613 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f7e35708974bd293df9bcb94c6969f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54eedd92cc646abbe37ad4128f203bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:12.355415 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-dd89d92e-7870-4d19-bf43-fc4384e5c613 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "GET /compute/v2.1/servers/3326503b-7d53-43c1-a57b-d91fb1e2954e" status: 200 len: 1317 microversion: 2.1 time: 0.154907 Jul 18 03:22:12.355929 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3515/7013] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:12 2022] GET /compute/v2.1/servers/3326503b-7d53-43c1-a57b-d91fb1e2954e => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:22:13.372909 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1bf3e381-e5b7-4e8a-a2a1-4047a2f3f7df tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:13.373548 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1bf3e381-e5b7-4e8a-a2a1-4047a2f3f7df tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 3326503b-7d53-43c1-a57b-d91fb1e2954e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:13.381256 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1bf3e381-e5b7-4e8a-a2a1-4047a2f3f7df tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:13.381719 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1bf3e381-e5b7-4e8a-a2a1-4047a2f3f7df tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:13.382486 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1bf3e381-e5b7-4e8a-a2a1-4047a2f3f7df tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:13.382919 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1bf3e381-e5b7-4e8a-a2a1-4047a2f3f7df tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:13.513342 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1bf3e381-e5b7-4e8a-a2a1-4047a2f3f7df tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f7e35708974bd293df9bcb94c6969f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54eedd92cc646abbe37ad4128f203bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:13.521767 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1bf3e381-e5b7-4e8a-a2a1-4047a2f3f7df tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "GET /compute/v2.1/servers/3326503b-7d53-43c1-a57b-d91fb1e2954e" status: 200 len: 1317 microversion: 2.1 time: 0.152985 Jul 18 03:22:13.522441 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3499/7014] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:13 2022] GET /compute/v2.1/servers/3326503b-7d53-43c1-a57b-d91fb1e2954e => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:22:14.541611 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e8fe1752-7b2f-4fe9-8da9-1cdd354cf411 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:14.542173 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e8fe1752-7b2f-4fe9-8da9-1cdd354cf411 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 3326503b-7d53-43c1-a57b-d91fb1e2954e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:14.549968 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e8fe1752-7b2f-4fe9-8da9-1cdd354cf411 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:14.550435 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e8fe1752-7b2f-4fe9-8da9-1cdd354cf411 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:14.551227 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e8fe1752-7b2f-4fe9-8da9-1cdd354cf411 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:14.551701 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e8fe1752-7b2f-4fe9-8da9-1cdd354cf411 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:14.688657 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e8fe1752-7b2f-4fe9-8da9-1cdd354cf411 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f7e35708974bd293df9bcb94c6969f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54eedd92cc646abbe37ad4128f203bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:14.696307 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e8fe1752-7b2f-4fe9-8da9-1cdd354cf411 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "GET /compute/v2.1/servers/3326503b-7d53-43c1-a57b-d91fb1e2954e" status: 200 len: 1317 microversion: 2.1 time: 0.158767 Jul 18 03:22:14.696903 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3516/7015] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:14 2022] GET /compute/v2.1/servers/3326503b-7d53-43c1-a57b-d91fb1e2954e => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:22:15.713416 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e42504f3-e366-43ef-984e-65f170d3b876 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:15.714042 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e42504f3-e366-43ef-984e-65f170d3b876 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 3326503b-7d53-43c1-a57b-d91fb1e2954e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:15.722268 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e42504f3-e366-43ef-984e-65f170d3b876 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:15.722713 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e42504f3-e366-43ef-984e-65f170d3b876 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:15.723473 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e42504f3-e366-43ef-984e-65f170d3b876 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:15.723904 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e42504f3-e366-43ef-984e-65f170d3b876 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:15.853105 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e42504f3-e366-43ef-984e-65f170d3b876 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f7e35708974bd293df9bcb94c6969f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54eedd92cc646abbe37ad4128f203bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:15.861478 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e42504f3-e366-43ef-984e-65f170d3b876 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "GET /compute/v2.1/servers/3326503b-7d53-43c1-a57b-d91fb1e2954e" status: 200 len: 1317 microversion: 2.1 time: 0.151967 Jul 18 03:22:15.862097 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3500/7016] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:15 2022] GET /compute/v2.1/servers/3326503b-7d53-43c1-a57b-d91fb1e2954e => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:22:16.268115 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-4bbdea63-4a71-4ad0-b03a-e06293428e0f req-96677c4f-82db-402e-822d-d871d607a933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3326503b-7d53-43c1-a57b-d91fb1e2954e", "name": "network-vif-plugged", "status": "completed", "tag": "786285e9-6469-4a34-83fc-3b32c5d280b8"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:22:16.272579 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:22:16.280500 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-4bbdea63-4a71-4ad0-b03a-e06293428e0f req-96677c4f-82db-402e-822d-d871d607a933 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:16.281280 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-4bbdea63-4a71-4ad0-b03a-e06293428e0f req-96677c4f-82db-402e-822d-d871d607a933 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:16.293611 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-4bbdea63-4a71-4ad0-b03a-e06293428e0f req-96677c4f-82db-402e-822d-d871d607a933 service nova] Creating event network-vif-plugged:786285e9-6469-4a34-83fc-3b32c5d280b8 for instance 3326503b-7d53-43c1-a57b-d91fb1e2954e on n-h1-465891-3 Jul 18 03:22:16.298999 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-4bbdea63-4a71-4ad0-b03a-e06293428e0f req-96677c4f-82db-402e-822d-d871d607a933 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035373 Jul 18 03:22:16.299618 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3517/7017] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:22:16.878339 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-dcd23c03-7733-46bc-aa94-54db97a95a6f tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:16.878984 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-dcd23c03-7733-46bc-aa94-54db97a95a6f tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 3326503b-7d53-43c1-a57b-d91fb1e2954e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:16.880954 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:22:16.881805 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:22:16.888323 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dcd23c03-7733-46bc-aa94-54db97a95a6f tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:16.888767 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dcd23c03-7733-46bc-aa94-54db97a95a6f tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:16.890051 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dcd23c03-7733-46bc-aa94-54db97a95a6f tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:16.890488 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dcd23c03-7733-46bc-aa94-54db97a95a6f tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:17.024829 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-dcd23c03-7733-46bc-aa94-54db97a95a6f tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f7e35708974bd293df9bcb94c6969f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54eedd92cc646abbe37ad4128f203bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:17.033175 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-dcd23c03-7733-46bc-aa94-54db97a95a6f tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "GET /compute/v2.1/servers/3326503b-7d53-43c1-a57b-d91fb1e2954e" status: 200 len: 1317 microversion: 2.1 time: 0.158654 Jul 18 03:22:17.033777 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3501/7018] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:16 2022] GET /compute/v2.1/servers/3326503b-7d53-43c1-a57b-d91fb1e2954e => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:22:18.051377 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b0c32c95-9ba2-463b-a857-2ec18c6dfc6e tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:18.052102 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b0c32c95-9ba2-463b-a857-2ec18c6dfc6e tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 3326503b-7d53-43c1-a57b-d91fb1e2954e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:18.058627 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b0c32c95-9ba2-463b-a857-2ec18c6dfc6e tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:18.059091 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b0c32c95-9ba2-463b-a857-2ec18c6dfc6e tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:18.059882 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b0c32c95-9ba2-463b-a857-2ec18c6dfc6e tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:18.060332 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b0c32c95-9ba2-463b-a857-2ec18c6dfc6e tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:18.190597 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b0c32c95-9ba2-463b-a857-2ec18c6dfc6e tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f7e35708974bd293df9bcb94c6969f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54eedd92cc646abbe37ad4128f203bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:18.198206 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b0c32c95-9ba2-463b-a857-2ec18c6dfc6e tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "GET /compute/v2.1/servers/3326503b-7d53-43c1-a57b-d91fb1e2954e" status: 200 len: 1507 microversion: 2.1 time: 0.152353 Jul 18 03:22:18.198791 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3518/7019] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:18 2022] GET /compute/v2.1/servers/3326503b-7d53-43c1-a57b-d91fb1e2954e => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:22:18.215375 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-69c60d92-8491-4ef1-a398-e87631d3666a tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:18.215915 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-69c60d92-8491-4ef1-a398-e87631d3666a tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 3326503b-7d53-43c1-a57b-d91fb1e2954e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:18.222874 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69c60d92-8491-4ef1-a398-e87631d3666a tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:18.223343 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69c60d92-8491-4ef1-a398-e87631d3666a tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:18.224089 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69c60d92-8491-4ef1-a398-e87631d3666a tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:18.224532 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69c60d92-8491-4ef1-a398-e87631d3666a tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:18.250642 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-69c60d92-8491-4ef1-a398-e87631d3666a tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 3326503b-7d53-43c1-a57b-d91fb1e2954e] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:22:18.327078 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-69c60d92-8491-4ef1-a398-e87631d3666a tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3326503b-7d53-43c1-a57b-d91fb1e2954e" status: 204 len: 0 microversion: 2.1 time: 0.115288 Jul 18 03:22:18.331243 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3502/7020] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:22:18 2022] DELETE /compute/v2.1/servers/3326503b-7d53-43c1-a57b-d91fb1e2954e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:22:18.336568 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9949e94f-e81c-4c63-9e62-e865b07f2868 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:18.337229 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9949e94f-e81c-4c63-9e62-e865b07f2868 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 3326503b-7d53-43c1-a57b-d91fb1e2954e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:18.343885 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9949e94f-e81c-4c63-9e62-e865b07f2868 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:18.344368 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9949e94f-e81c-4c63-9e62-e865b07f2868 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:18.345142 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9949e94f-e81c-4c63-9e62-e865b07f2868 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:18.345597 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9949e94f-e81c-4c63-9e62-e865b07f2868 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:18.478970 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9949e94f-e81c-4c63-9e62-e865b07f2868 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f7e35708974bd293df9bcb94c6969f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54eedd92cc646abbe37ad4128f203bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:18.487047 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9949e94f-e81c-4c63-9e62-e865b07f2868 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "GET /compute/v2.1/servers/3326503b-7d53-43c1-a57b-d91fb1e2954e" status: 200 len: 1513 microversion: 2.1 time: 0.154498 Jul 18 03:22:18.487630 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3519/7021] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:18 2022] GET /compute/v2.1/servers/3326503b-7d53-43c1-a57b-d91fb1e2954e => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:22:19.505642 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0d8c6af4-8377-43e5-83fc-1242ffbe5303 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:19.506285 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0d8c6af4-8377-43e5-83fc-1242ffbe5303 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 3326503b-7d53-43c1-a57b-d91fb1e2954e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:19.513152 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0d8c6af4-8377-43e5-83fc-1242ffbe5303 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:19.513602 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0d8c6af4-8377-43e5-83fc-1242ffbe5303 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:19.514404 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0d8c6af4-8377-43e5-83fc-1242ffbe5303 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:19.514948 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0d8c6af4-8377-43e5-83fc-1242ffbe5303 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:19.648812 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0d8c6af4-8377-43e5-83fc-1242ffbe5303 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f7e35708974bd293df9bcb94c6969f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54eedd92cc646abbe37ad4128f203bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:19.657538 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0d8c6af4-8377-43e5-83fc-1242ffbe5303 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "GET /compute/v2.1/servers/3326503b-7d53-43c1-a57b-d91fb1e2954e" status: 200 len: 1513 microversion: 2.1 time: 0.156331 Jul 18 03:22:19.658176 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3503/7022] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:19 2022] GET /compute/v2.1/servers/3326503b-7d53-43c1-a57b-d91fb1e2954e => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:22:20.288282 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-a2fe51ce-ccdf-4d34-9464-5d9dc7af1266 req-c723d358-6043-4769-8d62-398ba7cee487 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3326503b-7d53-43c1-a57b-d91fb1e2954e", "name": "network-vif-deleted", "tag": "786285e9-6469-4a34-83fc-3b32c5d280b8"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:22:20.312312 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-a2fe51ce-ccdf-4d34-9464-5d9dc7af1266 req-c723d358-6043-4769-8d62-398ba7cee487 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:20.313064 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-a2fe51ce-ccdf-4d34-9464-5d9dc7af1266 req-c723d358-6043-4769-8d62-398ba7cee487 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:20.326560 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-a2fe51ce-ccdf-4d34-9464-5d9dc7af1266 req-c723d358-6043-4769-8d62-398ba7cee487 service nova] Creating event network-vif-deleted:786285e9-6469-4a34-83fc-3b32c5d280b8 for instance 3326503b-7d53-43c1-a57b-d91fb1e2954e on n-h1-465891-3 Jul 18 03:22:20.332399 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-a2fe51ce-ccdf-4d34-9464-5d9dc7af1266 req-c723d358-6043-4769-8d62-398ba7cee487 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047812 Jul 18 03:22:20.333291 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3520/7023] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:22:20.674779 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-54213e74-5b9a-431c-89fd-8399ae8422b9 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:20.675387 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-54213e74-5b9a-431c-89fd-8399ae8422b9 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 3326503b-7d53-43c1-a57b-d91fb1e2954e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:20.682315 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54213e74-5b9a-431c-89fd-8399ae8422b9 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:20.682762 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54213e74-5b9a-431c-89fd-8399ae8422b9 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:20.683518 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54213e74-5b9a-431c-89fd-8399ae8422b9 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:20.683977 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54213e74-5b9a-431c-89fd-8399ae8422b9 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:20.716837 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54213e74-5b9a-431c-89fd-8399ae8422b9 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:20.717289 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54213e74-5b9a-431c-89fd-8399ae8422b9 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:20.718572 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-54213e74-5b9a-431c-89fd-8399ae8422b9 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lazy-loading 'fault' on Instance uuid 3326503b-7d53-43c1-a57b-d91fb1e2954e {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:22:20.760630 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-54213e74-5b9a-431c-89fd-8399ae8422b9 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f7e35708974bd293df9bcb94c6969f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54eedd92cc646abbe37ad4128f203bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:20.769674 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-54213e74-5b9a-431c-89fd-8399ae8422b9 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "GET /compute/v2.1/servers/3326503b-7d53-43c1-a57b-d91fb1e2954e" status: 200 len: 1307 microversion: 2.1 time: 0.098955 Jul 18 03:22:20.770305 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3504/7024] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:20 2022] GET /compute/v2.1/servers/3326503b-7d53-43c1-a57b-d91fb1e2954e => generated 1307 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:22:21.789215 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a857a328-e0f3-43d7-9961-2b7957f81f33 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:21.789968 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a857a328-e0f3-43d7-9961-2b7957f81f33 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 3326503b-7d53-43c1-a57b-d91fb1e2954e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:21.796324 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a857a328-e0f3-43d7-9961-2b7957f81f33 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:21.796851 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a857a328-e0f3-43d7-9961-2b7957f81f33 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:21.797603 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a857a328-e0f3-43d7-9961-2b7957f81f33 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:21.798082 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a857a328-e0f3-43d7-9961-2b7957f81f33 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:21.812795 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-a857a328-e0f3-43d7-9961-2b7957f81f33 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] HTTP exception thrown: Instance 3326503b-7d53-43c1-a57b-d91fb1e2954e could not be found. Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a857a328-e0f3-43d7-9961-2b7957f81f33 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Request method failure captured: Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/3326503b-7d53-43c1-a57b-d91fb1e2954e HTTP/1.1 Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1NHTT-1i4m5X-iS7OJtaSdrWLM__zEUDZdw2BIGxUIemV0Ks1t3y6sA7816_9ZIAW0eqE9Efs0b4TqXBZhxkqEZlypJ0hnrB3Gxt-hVWpJiVgIYLyKzGPIfrZ2wg0rvvW1G3R5T0rxmRdzKTq_rz-HfEm0ME5o9GhO-tE8AJtM_HTH4 Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: d54eedd92cc646abbe37ad4128f203bb Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersNegativeTestJSON-1984631272 Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d54eedd92cc646abbe37ad4128f203bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d54eedd92cc646abbe37ad4128f203bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d54eedd92cc646abbe37ad4128f203bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d54eedd92cc646abbe37ad4128f203bb"}]}] Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersNegativeTestJSON-1984631272 Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: d54eedd92cc646abbe37ad4128f203bb Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1984631272 Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersNegativeTestJSON-1984631272-project Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 31f7e35708974bd293df9bcb94c6969f Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersNegativeTestJSON-1984631272-project Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 3326503b-7d53-43c1-a57b-d91fb1e2954e could not be found. Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '3326503b-7d53-43c1-a57b-d91fb1e2954e'} Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3326503b-7d53-43c1-a57b-d91fb1e2954e could not be found. Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3326503b-7d53-43c1-a57b-d91fb1e2954e could not be found. Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:22:21.814425 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:22:21.819598 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:22:21.819598 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:22:21.819598 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:22:21.819598 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:22:21.819598 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:22:21.819598 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3326503b-7d53-43c1-a57b-d91fb1e2954e could not be found. Jul 18 03:22:21.819598 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:22:21.819598 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a857a328-e0f3-43d7-9961-2b7957f81f33 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Returning 404 to user: Instance 3326503b-7d53-43c1-a57b-d91fb1e2954e could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:22:21.819598 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a857a328-e0f3-43d7-9961-2b7957f81f33 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "GET /compute/v2.1/servers/3326503b-7d53-43c1-a57b-d91fb1e2954e" status: 404 len: 111 microversion: 2.1 time: 0.031847 Jul 18 03:22:21.819598 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3521/7025] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:21 2022] GET /compute/v2.1/servers/3326503b-7d53-43c1-a57b-d91fb1e2954e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:22:21.824919 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-63f89f32-4819-4c9e-a590-17cf154a97a7 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:21.825532 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-63f89f32-4819-4c9e-a590-17cf154a97a7 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 92b41430-5d9d-49a7-93af-67d8fda9b2a9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:21.833257 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-63f89f32-4819-4c9e-a590-17cf154a97a7 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:21.833726 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-63f89f32-4819-4c9e-a590-17cf154a97a7 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:21.834497 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-63f89f32-4819-4c9e-a590-17cf154a97a7 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:21.834938 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-63f89f32-4819-4c9e-a590-17cf154a97a7 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:21.981438 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-63f89f32-4819-4c9e-a590-17cf154a97a7 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f7e35708974bd293df9bcb94c6969f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54eedd92cc646abbe37ad4128f203bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:21.989779 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-63f89f32-4819-4c9e-a590-17cf154a97a7 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "GET /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9" status: 200 len: 1506 microversion: 2.1 time: 0.168617 Jul 18 03:22:21.990468 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3505/7026] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:21 2022] GET /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9 => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:22:22.007465 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-46bac9c7-ae28-43cc-b647-5666416a657f tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:22:22.008678 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-46bac9c7-ae28-43cc-b647-5666416a657f tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 69ac3f81-9a92-4eab-ba24-2d55e4cbd6a1] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:22.014077 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-46bac9c7-ae28-43cc-b647-5666416a657f tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] HTTP exception thrown: Instance 69ac3f81-9a92-4eab-ba24-2d55e4cbd6a1 could not be found. Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-46bac9c7-ae28-43cc-b647-5666416a657f tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Request method failure captured: Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/servers/69ac3f81-9a92-4eab-ba24-2d55e4cbd6a1/action HTTP/1.1 Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 32 Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1NHTT-1i4m5X-iS7OJtaSdrWLM__zEUDZdw2BIGxUIemV0Ks1t3y6sA7816_9ZIAW0eqE9Efs0b4TqXBZhxkqEZlypJ0hnrB3Gxt-hVWpJiVgIYLyKzGPIfrZ2wg0rvvW1G3R5T0rxmRdzKTq_rz-HfEm0ME5o9GhO-tE8AJtM_HTH4 Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: d54eedd92cc646abbe37ad4128f203bb Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersNegativeTestJSON-1984631272 Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d54eedd92cc646abbe37ad4128f203bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d54eedd92cc646abbe37ad4128f203bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d54eedd92cc646abbe37ad4128f203bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d54eedd92cc646abbe37ad4128f203bb"}]}] Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersNegativeTestJSON-1984631272 Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: d54eedd92cc646abbe37ad4128f203bb Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1984631272 Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersNegativeTestJSON-1984631272-project Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 31f7e35708974bd293df9bcb94c6969f Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersNegativeTestJSON-1984631272-project Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: {"resize": {"flavorRef": "452"}} Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 69ac3f81-9a92-4eab-ba24-2d55e4cbd6a1 could not be found. Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '69ac3f81-9a92-4eab-ba24-2d55e4cbd6a1', 'body': {'resize': {'flavorRef': '452'}}} Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69ac3f81-9a92-4eab-ba24-2d55e4cbd6a1 could not be found. Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:22:22.015673 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:22:22.020284 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69ac3f81-9a92-4eab-ba24-2d55e4cbd6a1 could not be found. Jul 18 03:22:22.020284 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:22:22.020284 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:22:22.020284 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:22:22.020284 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:22:22.020284 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:22:22.020284 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:22:22.020284 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:22:22.020284 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:22:22.020284 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69ac3f81-9a92-4eab-ba24-2d55e4cbd6a1 could not be found. Jul 18 03:22:22.020284 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:22:22.020284 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-46bac9c7-ae28-43cc-b647-5666416a657f tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Returning 404 to user: Instance 69ac3f81-9a92-4eab-ba24-2d55e4cbd6a1 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:22:22.020284 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-46bac9c7-ae28-43cc-b647-5666416a657f tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "POST /compute/v2.1/servers/69ac3f81-9a92-4eab-ba24-2d55e4cbd6a1/action" status: 404 len: 111 microversion: 2.1 time: 0.013636 Jul 18 03:22:22.020284 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3522/7027] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:22:22 2022] POST /compute/v2.1/servers/69ac3f81-9a92-4eab-ba24-2d55e4cbd6a1/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:22:22.025655 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-341aa8d3-0aa0-4aff-90ab-1d3f42d71152 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:22.026299 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-341aa8d3-0aa0-4aff-90ab-1d3f42d71152 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 92b41430-5d9d-49a7-93af-67d8fda9b2a9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:22.032581 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-341aa8d3-0aa0-4aff-90ab-1d3f42d71152 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:22.033033 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-341aa8d3-0aa0-4aff-90ab-1d3f42d71152 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:22.033817 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-341aa8d3-0aa0-4aff-90ab-1d3f42d71152 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:22.034266 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-341aa8d3-0aa0-4aff-90ab-1d3f42d71152 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:22.038367 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:22:22.164452 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-341aa8d3-0aa0-4aff-90ab-1d3f42d71152 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f7e35708974bd293df9bcb94c6969f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54eedd92cc646abbe37ad4128f203bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:22.172678 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-341aa8d3-0aa0-4aff-90ab-1d3f42d71152 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "GET /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9" status: 200 len: 1506 microversion: 2.1 time: 0.150805 Jul 18 03:22:22.173286 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3506/7028] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:22 2022] GET /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:22:22.190092 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f6de497e-ca87-4603-855f-abc9e7cf0d96 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:22.190720 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f6de497e-ca87-4603-855f-abc9e7cf0d96 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 92b41430-5d9d-49a7-93af-67d8fda9b2a9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:22.197742 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f6de497e-ca87-4603-855f-abc9e7cf0d96 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:22.198206 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f6de497e-ca87-4603-855f-abc9e7cf0d96 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:22.198985 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f6de497e-ca87-4603-855f-abc9e7cf0d96 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:22.199433 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f6de497e-ca87-4603-855f-abc9e7cf0d96 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:22.354154 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f6de497e-ca87-4603-855f-abc9e7cf0d96 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f7e35708974bd293df9bcb94c6969f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54eedd92cc646abbe37ad4128f203bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:22.363638 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f6de497e-ca87-4603-855f-abc9e7cf0d96 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "GET /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9" status: 200 len: 1506 microversion: 2.1 time: 0.177851 Jul 18 03:22:22.364132 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3523/7029] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:22 2022] GET /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9 => generated 1506 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:22:22.381119 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4e28edce-5e84-4d03-8205-204801d44ccc tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "7f47cad2-72ce-461c-bc4d-a6f7e4f54d1d"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:22:22.382188 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4e28edce-5e84-4d03-8205-204801d44ccc tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 92b41430-5d9d-49a7-93af-67d8fda9b2a9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:22.388650 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e28edce-5e84-4d03-8205-204801d44ccc tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:22.389109 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e28edce-5e84-4d03-8205-204801d44ccc tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:22.390024 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e28edce-5e84-4d03-8205-204801d44ccc tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:22.390464 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e28edce-5e84-4d03-8205-204801d44ccc tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:22.433537 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4e28edce-5e84-4d03-8205-204801d44ccc tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '31f7e35708974bd293df9bcb94c6969f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54eedd92cc646abbe37ad4128f203bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:22.439541 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-4e28edce-5e84-4d03-8205-204801d44ccc tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] HTTP exception thrown: Flavor 7f47cad2-72ce-461c-bc4d-a6f7e4f54d1d could not be found. Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4e28edce-5e84-4d03-8205-204801d44ccc tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Request method failure captured: Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: request: POST /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9/action HTTP/1.1 Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 65 Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1NHTT-1i4m5X-iS7OJtaSdrWLM__zEUDZdw2BIGxUIemV0Ks1t3y6sA7816_9ZIAW0eqE9Efs0b4TqXBZhxkqEZlypJ0hnrB3Gxt-hVWpJiVgIYLyKzGPIfrZ2wg0rvvW1G3R5T0rxmRdzKTq_rz-HfEm0ME5o9GhO-tE8AJtM_HTH4 Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: d54eedd92cc646abbe37ad4128f203bb Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersNegativeTestJSON-1984631272 Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d54eedd92cc646abbe37ad4128f203bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d54eedd92cc646abbe37ad4128f203bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d54eedd92cc646abbe37ad4128f203bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d54eedd92cc646abbe37ad4128f203bb"}]}] Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersNegativeTestJSON-1984631272 Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: d54eedd92cc646abbe37ad4128f203bb Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1984631272 Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersNegativeTestJSON-1984631272-project Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 31f7e35708974bd293df9bcb94c6969f Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersNegativeTestJSON-1984631272-project Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: {"resize": {"flavorRef": "7f47cad2-72ce-461c-bc4d-a6f7e4f54d1d"}} Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: exception: Flavor 7f47cad2-72ce-461c-bc4d-a6f7e4f54d1d could not be found. Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '92b41430-5d9d-49a7-93af-67d8fda9b2a9', 'body': {'resize': {'flavorRef': '7f47cad2-72ce-461c-bc4d-a6f7e4f54d1d'}}} Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4146, in resize Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 03:22:22.449261 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 03:22:22.454218 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:22:22.454218 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 03:22:22.454218 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 03:22:22.454218 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 7f47cad2-72ce-461c-bc4d-a6f7e4f54d1d could not be found. Jul 18 03:22:22.454218 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:22:22.454218 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:22:22.454218 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:22:22.454218 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:22:22.454218 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:22:22.454218 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:22:22.454218 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:22:22.454218 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:22:22.454218 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:22:22.454218 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:22:22.454218 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:22:22.454218 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:22:22.454218 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 18 03:22:22.454218 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 18 03:22:22.454218 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Jul 18 03:22:22.454218 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 03:22:22.454218 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 7f47cad2-72ce-461c-bc4d-a6f7e4f54d1d could not be found. Jul 18 03:22:22.454218 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:22:22.454218 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:22:22.454218 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:22:22.454218 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:22:22.454218 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:22:22.454218 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:22:22.454218 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:22:22.454218 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:22:22.454218 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 7f47cad2-72ce-461c-bc4d-a6f7e4f54d1d could not be found. Jul 18 03:22:22.454218 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:22:22.454218 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4e28edce-5e84-4d03-8205-204801d44ccc tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Returning 400 to user: Flavor 7f47cad2-72ce-461c-bc4d-a6f7e4f54d1d could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:22:22.454218 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4e28edce-5e84-4d03-8205-204801d44ccc tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "POST /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9/action" status: 400 len: 107 microversion: 2.1 time: 0.073771 Jul 18 03:22:22.454218 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3507/7030] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:22:22 2022] POST /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9/action => generated 107 bytes in 75 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 18 03:22:22.459845 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c51ae642-6614-4f39-8f27-0eac785c0a44 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:22.460502 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c51ae642-6614-4f39-8f27-0eac785c0a44 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 92b41430-5d9d-49a7-93af-67d8fda9b2a9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:22.466957 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c51ae642-6614-4f39-8f27-0eac785c0a44 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:22.467418 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c51ae642-6614-4f39-8f27-0eac785c0a44 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:22.468789 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c51ae642-6614-4f39-8f27-0eac785c0a44 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:22.469247 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c51ae642-6614-4f39-8f27-0eac785c0a44 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:22.609347 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c51ae642-6614-4f39-8f27-0eac785c0a44 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f7e35708974bd293df9bcb94c6969f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54eedd92cc646abbe37ad4128f203bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:22.617454 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c51ae642-6614-4f39-8f27-0eac785c0a44 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "GET /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9" status: 200 len: 1506 microversion: 2.1 time: 0.161381 Jul 18 03:22:22.618040 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3524/7031] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:22 2022] GET /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9 => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:22:22.635752 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9f10195b-59ae-43f4-8038-1eb174a6ab1d tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:22.636356 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9f10195b-59ae-43f4-8038-1eb174a6ab1d tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 92b41430-5d9d-49a7-93af-67d8fda9b2a9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:22.643262 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9f10195b-59ae-43f4-8038-1eb174a6ab1d tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:22.643714 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9f10195b-59ae-43f4-8038-1eb174a6ab1d tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:22.644488 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9f10195b-59ae-43f4-8038-1eb174a6ab1d tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:22.645046 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9f10195b-59ae-43f4-8038-1eb174a6ab1d tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:22.785821 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9f10195b-59ae-43f4-8038-1eb174a6ab1d tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f7e35708974bd293df9bcb94c6969f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54eedd92cc646abbe37ad4128f203bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:22.793433 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9f10195b-59ae-43f4-8038-1eb174a6ab1d tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "GET /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9" status: 200 len: 1506 microversion: 2.1 time: 0.161552 Jul 18 03:22:22.794035 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3508/7032] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:22 2022] GET /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9 => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:22:22.809768 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-abe093f1-1c0d-43d8-89c6-57151978eaa7 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-abe093f1-1c0d-43d8-89c6-57151978eaa7 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Request method failure captured: Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: request: POST /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9/action HTTP/1.1 Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 29 Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1NHTT-1i4m5X-iS7OJtaSdrWLM__zEUDZdw2BIGxUIemV0Ks1t3y6sA7816_9ZIAW0eqE9Efs0b4TqXBZhxkqEZlypJ0hnrB3Gxt-hVWpJiVgIYLyKzGPIfrZ2wg0rvvW1G3R5T0rxmRdzKTq_rz-HfEm0ME5o9GhO-tE8AJtM_HTH4 Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: d54eedd92cc646abbe37ad4128f203bb Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersNegativeTestJSON-1984631272 Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d54eedd92cc646abbe37ad4128f203bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d54eedd92cc646abbe37ad4128f203bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d54eedd92cc646abbe37ad4128f203bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d54eedd92cc646abbe37ad4128f203bb"}]}] Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersNegativeTestJSON-1984631272 Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: d54eedd92cc646abbe37ad4128f203bb Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1984631272 Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersNegativeTestJSON-1984631272-project Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 31f7e35708974bd293df9bcb94c6969f Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersNegativeTestJSON-1984631272-project Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: {"resize": {"flavorRef": ""}} Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '92b41430-5d9d-49a7-93af-67d8fda9b2a9', 'body': {'resize': {'flavorRef': ''}}} Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise error Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi On instance['resize']: Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi '' Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:22:22.812111 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:22:22.816503 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:22:22.816503 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:22:22.816503 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:22:22.816503 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:22:22.816503 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 03:22:22.816503 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 03:22:22.816503 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 18 03:22:22.816503 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:22:22.816503 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-abe093f1-1c0d-43d8-89c6-57151978eaa7 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:22:22.816503 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-abe093f1-1c0d-43d8-89c6-57151978eaa7 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "POST /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9/action" status: 400 len: 113 microversion: 2.1 time: 0.007824 Jul 18 03:22:22.816503 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3525/7033] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:22:22 2022] POST /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9/action => generated 113 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 03:22:22.822200 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1fb589e1-ad9c-465c-a0f0-5b32a80c2880 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:22.822811 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1fb589e1-ad9c-465c-a0f0-5b32a80c2880 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 92b41430-5d9d-49a7-93af-67d8fda9b2a9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:22.830698 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1fb589e1-ad9c-465c-a0f0-5b32a80c2880 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:22.831306 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1fb589e1-ad9c-465c-a0f0-5b32a80c2880 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:22.831897 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1fb589e1-ad9c-465c-a0f0-5b32a80c2880 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:22.832327 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1fb589e1-ad9c-465c-a0f0-5b32a80c2880 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:23.006572 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1fb589e1-ad9c-465c-a0f0-5b32a80c2880 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f7e35708974bd293df9bcb94c6969f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54eedd92cc646abbe37ad4128f203bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:23.015650 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1fb589e1-ad9c-465c-a0f0-5b32a80c2880 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "GET /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9" status: 200 len: 1506 microversion: 2.1 time: 0.196578 Jul 18 03:22:23.016364 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3509/7034] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:22 2022] GET /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9 => generated 1506 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:22:23.038259 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dae1e4d2-ec9a-4242-8d58-4a903f9a94b3 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:23.038775 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-dae1e4d2-ec9a-4242-8d58-4a903f9a94b3 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 3326503b-7d53-43c1-a57b-d91fb1e2954e] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:23.046898 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dae1e4d2-ec9a-4242-8d58-4a903f9a94b3 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:23.047565 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dae1e4d2-ec9a-4242-8d58-4a903f9a94b3 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:23.048370 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dae1e4d2-ec9a-4242-8d58-4a903f9a94b3 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:23.048828 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dae1e4d2-ec9a-4242-8d58-4a903f9a94b3 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:23.063425 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-dae1e4d2-ec9a-4242-8d58-4a903f9a94b3 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] HTTP exception thrown: Instance 3326503b-7d53-43c1-a57b-d91fb1e2954e could not be found. Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dae1e4d2-ec9a-4242-8d58-4a903f9a94b3 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Request method failure captured: Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: request: DELETE /compute/v2.1/servers/3326503b-7d53-43c1-a57b-d91fb1e2954e HTTP/1.1 Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1NHTT-1i4m5X-iS7OJtaSdrWLM__zEUDZdw2BIGxUIemV0Ks1t3y6sA7816_9ZIAW0eqE9Efs0b4TqXBZhxkqEZlypJ0hnrB3Gxt-hVWpJiVgIYLyKzGPIfrZ2wg0rvvW1G3R5T0rxmRdzKTq_rz-HfEm0ME5o9GhO-tE8AJtM_HTH4 Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: d54eedd92cc646abbe37ad4128f203bb Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-ServersNegativeTestJSON-1984631272 Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d54eedd92cc646abbe37ad4128f203bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d54eedd92cc646abbe37ad4128f203bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d54eedd92cc646abbe37ad4128f203bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d54eedd92cc646abbe37ad4128f203bb"}]}] Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-ServersNegativeTestJSON-1984631272 Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: d54eedd92cc646abbe37ad4128f203bb Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1984631272 Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-ServersNegativeTestJSON-1984631272-project Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 31f7e35708974bd293df9bcb94c6969f Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-ServersNegativeTestJSON-1984631272-project Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 3326503b-7d53-43c1-a57b-d91fb1e2954e could not be found. Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '3326503b-7d53-43c1-a57b-d91fb1e2954e'} Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3326503b-7d53-43c1-a57b-d91fb1e2954e could not be found. Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:22:23.065035 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:22:23.069358 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3326503b-7d53-43c1-a57b-d91fb1e2954e could not be found. Jul 18 03:22:23.069358 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:22:23.069358 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:22:23.069358 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:22:23.069358 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:22:23.069358 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:22:23.069358 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:22:23.069358 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:22:23.069358 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:22:23.069358 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3326503b-7d53-43c1-a57b-d91fb1e2954e could not be found. Jul 18 03:22:23.069358 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:22:23.069358 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dae1e4d2-ec9a-4242-8d58-4a903f9a94b3 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Returning 404 to user: Instance 3326503b-7d53-43c1-a57b-d91fb1e2954e could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:22:23.069358 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-dae1e4d2-ec9a-4242-8d58-4a903f9a94b3 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3326503b-7d53-43c1-a57b-d91fb1e2954e" status: 404 len: 111 microversion: 2.1 time: 0.033002 Jul 18 03:22:23.069358 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3526/7035] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:22:23 2022] DELETE /compute/v2.1/servers/3326503b-7d53-43c1-a57b-d91fb1e2954e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:22:23.075574 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8aae6aac-19e0-45a3-8137-94a5cd85afe5 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:23.076234 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8aae6aac-19e0-45a3-8137-94a5cd85afe5 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 3326503b-7d53-43c1-a57b-d91fb1e2954e] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:23.082723 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8aae6aac-19e0-45a3-8137-94a5cd85afe5 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:23.083179 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8aae6aac-19e0-45a3-8137-94a5cd85afe5 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:23.084022 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8aae6aac-19e0-45a3-8137-94a5cd85afe5 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:23.084464 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8aae6aac-19e0-45a3-8137-94a5cd85afe5 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:23.099146 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-8aae6aac-19e0-45a3-8137-94a5cd85afe5 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] HTTP exception thrown: Instance 3326503b-7d53-43c1-a57b-d91fb1e2954e could not be found. Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8aae6aac-19e0-45a3-8137-94a5cd85afe5 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Request method failure captured: Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/3326503b-7d53-43c1-a57b-d91fb1e2954e HTTP/1.1 Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1NHTT-1i4m5X-iS7OJtaSdrWLM__zEUDZdw2BIGxUIemV0Ks1t3y6sA7816_9ZIAW0eqE9Efs0b4TqXBZhxkqEZlypJ0hnrB3Gxt-hVWpJiVgIYLyKzGPIfrZ2wg0rvvW1G3R5T0rxmRdzKTq_rz-HfEm0ME5o9GhO-tE8AJtM_HTH4 Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: d54eedd92cc646abbe37ad4128f203bb Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersNegativeTestJSON-1984631272 Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d54eedd92cc646abbe37ad4128f203bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d54eedd92cc646abbe37ad4128f203bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d54eedd92cc646abbe37ad4128f203bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d54eedd92cc646abbe37ad4128f203bb"}]}] Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersNegativeTestJSON-1984631272 Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: d54eedd92cc646abbe37ad4128f203bb Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1984631272 Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersNegativeTestJSON-1984631272-project Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 31f7e35708974bd293df9bcb94c6969f Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersNegativeTestJSON-1984631272-project Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 3326503b-7d53-43c1-a57b-d91fb1e2954e could not be found. Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '3326503b-7d53-43c1-a57b-d91fb1e2954e'} Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3326503b-7d53-43c1-a57b-d91fb1e2954e could not be found. Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3326503b-7d53-43c1-a57b-d91fb1e2954e could not be found. Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:22:23.100711 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:22:23.105588 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:22:23.105588 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:22:23.105588 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:22:23.105588 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:22:23.105588 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:22:23.105588 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3326503b-7d53-43c1-a57b-d91fb1e2954e could not be found. Jul 18 03:22:23.105588 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:22:23.105588 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8aae6aac-19e0-45a3-8137-94a5cd85afe5 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Returning 404 to user: Instance 3326503b-7d53-43c1-a57b-d91fb1e2954e could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:22:23.105588 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8aae6aac-19e0-45a3-8137-94a5cd85afe5 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "GET /compute/v2.1/servers/3326503b-7d53-43c1-a57b-d91fb1e2954e" status: 404 len: 111 microversion: 2.1 time: 0.030437 Jul 18 03:22:23.105588 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3510/7036] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:23 2022] GET /compute/v2.1/servers/3326503b-7d53-43c1-a57b-d91fb1e2954e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 03:22:23.111843 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-467890df-eeb1-4ce0-a7d3-d1a2a6f39c25 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:23.112360 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-467890df-eeb1-4ce0-a7d3-d1a2a6f39c25 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 92b41430-5d9d-49a7-93af-67d8fda9b2a9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:23.118537 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-467890df-eeb1-4ce0-a7d3-d1a2a6f39c25 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:23.118997 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-467890df-eeb1-4ce0-a7d3-d1a2a6f39c25 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:23.119778 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-467890df-eeb1-4ce0-a7d3-d1a2a6f39c25 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:23.120224 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-467890df-eeb1-4ce0-a7d3-d1a2a6f39c25 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:23.149000 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-467890df-eeb1-4ce0-a7d3-d1a2a6f39c25 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 92b41430-5d9d-49a7-93af-67d8fda9b2a9] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:22:23.236872 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-467890df-eeb1-4ce0-a7d3-d1a2a6f39c25 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "DELETE /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9" status: 204 len: 0 microversion: 2.1 time: 0.129136 Jul 18 03:22:23.237941 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3527/7037] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:22:23 2022] DELETE /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:22:23.247841 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-288b3aa9-d8bc-474f-b7ac-825e3ae28ae8 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:23.248632 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-288b3aa9-d8bc-474f-b7ac-825e3ae28ae8 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 92b41430-5d9d-49a7-93af-67d8fda9b2a9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:23.258466 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-288b3aa9-d8bc-474f-b7ac-825e3ae28ae8 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:23.258922 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-288b3aa9-d8bc-474f-b7ac-825e3ae28ae8 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:23.259711 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-288b3aa9-d8bc-474f-b7ac-825e3ae28ae8 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:23.260150 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-288b3aa9-d8bc-474f-b7ac-825e3ae28ae8 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:23.430080 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-288b3aa9-d8bc-474f-b7ac-825e3ae28ae8 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f7e35708974bd293df9bcb94c6969f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54eedd92cc646abbe37ad4128f203bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:23.437800 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-288b3aa9-d8bc-474f-b7ac-825e3ae28ae8 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "GET /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9" status: 200 len: 1512 microversion: 2.1 time: 0.195632 Jul 18 03:22:23.438372 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3511/7038] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:23 2022] GET /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9 => generated 1512 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:22:24.455743 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6fc5ced0-8107-4706-b675-a39da3c65b3d tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:24.456537 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6fc5ced0-8107-4706-b675-a39da3c65b3d tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 92b41430-5d9d-49a7-93af-67d8fda9b2a9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:24.464031 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6fc5ced0-8107-4706-b675-a39da3c65b3d tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:24.464498 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6fc5ced0-8107-4706-b675-a39da3c65b3d tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:24.465304 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6fc5ced0-8107-4706-b675-a39da3c65b3d tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:24.465776 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6fc5ced0-8107-4706-b675-a39da3c65b3d tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:24.471723 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:22:24.610975 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6fc5ced0-8107-4706-b675-a39da3c65b3d tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f7e35708974bd293df9bcb94c6969f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54eedd92cc646abbe37ad4128f203bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:24.618825 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6fc5ced0-8107-4706-b675-a39da3c65b3d tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "GET /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9" status: 200 len: 1512 microversion: 2.1 time: 0.167528 Jul 18 03:22:24.619421 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3528/7039] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:24 2022] GET /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9 => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:22:25.144865 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-67b7fa0b-d156-439d-9858-431519020a76 req-ae406895-6c0b-4b65-a90f-057fb4f51659 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92b41430-5d9d-49a7-93af-67d8fda9b2a9", "name": "network-vif-deleted", "tag": "3f8e8974-c7ae-48ce-bf99-7f763c654b04"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:22:25.156779 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-67b7fa0b-d156-439d-9858-431519020a76 req-ae406895-6c0b-4b65-a90f-057fb4f51659 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:25.157625 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-67b7fa0b-d156-439d-9858-431519020a76 req-ae406895-6c0b-4b65-a90f-057fb4f51659 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:25.171315 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-67b7fa0b-d156-439d-9858-431519020a76 req-ae406895-6c0b-4b65-a90f-057fb4f51659 service nova] Creating event network-vif-deleted:3f8e8974-c7ae-48ce-bf99-7f763c654b04 for instance 92b41430-5d9d-49a7-93af-67d8fda9b2a9 on n-h2-465891-3 Jul 18 03:22:25.177294 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-67b7fa0b-d156-439d-9858-431519020a76 req-ae406895-6c0b-4b65-a90f-057fb4f51659 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036927 Jul 18 03:22:25.178333 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3512/7040] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:22:25.636977 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-23d858fb-1213-4f01-a5b9-2a6941e0cfb5 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:25.637823 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-23d858fb-1213-4f01-a5b9-2a6941e0cfb5 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 92b41430-5d9d-49a7-93af-67d8fda9b2a9] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:25.646395 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-23d858fb-1213-4f01-a5b9-2a6941e0cfb5 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:25.647136 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-23d858fb-1213-4f01-a5b9-2a6941e0cfb5 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:25.647961 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-23d858fb-1213-4f01-a5b9-2a6941e0cfb5 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:25.648423 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-23d858fb-1213-4f01-a5b9-2a6941e0cfb5 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:25.687671 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-23d858fb-1213-4f01-a5b9-2a6941e0cfb5 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:25.688850 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-23d858fb-1213-4f01-a5b9-2a6941e0cfb5 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:25.689343 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-23d858fb-1213-4f01-a5b9-2a6941e0cfb5 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lazy-loading 'fault' on Instance uuid 92b41430-5d9d-49a7-93af-67d8fda9b2a9 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:22:25.733952 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-23d858fb-1213-4f01-a5b9-2a6941e0cfb5 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f7e35708974bd293df9bcb94c6969f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54eedd92cc646abbe37ad4128f203bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:25.741390 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-23d858fb-1213-4f01-a5b9-2a6941e0cfb5 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "GET /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9" status: 200 len: 1306 microversion: 2.1 time: 0.108397 Jul 18 03:22:25.742012 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3529/7041] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:25 2022] GET /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9 => generated 1306 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:22:26.760896 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3a210fa6-b026-4810-9209-39a348074b29 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:26.761587 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3a210fa6-b026-4810-9209-39a348074b29 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] [instance: 92b41430-5d9d-49a7-93af-67d8fda9b2a9] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:26.768144 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3a210fa6-b026-4810-9209-39a348074b29 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:26.768593 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3a210fa6-b026-4810-9209-39a348074b29 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:26.769359 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3a210fa6-b026-4810-9209-39a348074b29 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:26.769819 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3a210fa6-b026-4810-9209-39a348074b29 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:26.785009 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-3a210fa6-b026-4810-9209-39a348074b29 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] HTTP exception thrown: Instance 92b41430-5d9d-49a7-93af-67d8fda9b2a9 could not be found. Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3a210fa6-b026-4810-9209-39a348074b29 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Request method failure captured: Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9 HTTP/1.1 Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1NHTT-1i4m5X-iS7OJtaSdrWLM__zEUDZdw2BIGxUIemV0Ks1t3y6sA7816_9ZIAW0eqE9Efs0b4TqXBZhxkqEZlypJ0hnrB3Gxt-hVWpJiVgIYLyKzGPIfrZ2wg0rvvW1G3R5T0rxmRdzKTq_rz-HfEm0ME5o9GhO-tE8AJtM_HTH4 Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: d54eedd92cc646abbe37ad4128f203bb Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-ServersNegativeTestJSON-1984631272 Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d54eedd92cc646abbe37ad4128f203bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d54eedd92cc646abbe37ad4128f203bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d54eedd92cc646abbe37ad4128f203bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d54eedd92cc646abbe37ad4128f203bb"}]}] Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-ServersNegativeTestJSON-1984631272 Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: d54eedd92cc646abbe37ad4128f203bb Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1984631272 Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-ServersNegativeTestJSON-1984631272-project Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 31f7e35708974bd293df9bcb94c6969f Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-ServersNegativeTestJSON-1984631272-project Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 92b41430-5d9d-49a7-93af-67d8fda9b2a9 could not be found. Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '92b41430-5d9d-49a7-93af-67d8fda9b2a9'} Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92b41430-5d9d-49a7-93af-67d8fda9b2a9 could not be found. Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92b41430-5d9d-49a7-93af-67d8fda9b2a9 could not be found. Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:22:26.787012 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:22:26.791522 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:22:26.791522 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:22:26.791522 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:22:26.791522 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:22:26.791522 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:22:26.791522 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92b41430-5d9d-49a7-93af-67d8fda9b2a9 could not be found. Jul 18 03:22:26.791522 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:22:26.791522 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3a210fa6-b026-4810-9209-39a348074b29 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] Returning 404 to user: Instance 92b41430-5d9d-49a7-93af-67d8fda9b2a9 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:22:26.791522 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3a210fa6-b026-4810-9209-39a348074b29 tempest-ServersNegativeTestJSON-1984631272 tempest-ServersNegativeTestJSON-1984631272-project] 10.222.0.57 "GET /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9" status: 404 len: 111 microversion: 2.1 time: 0.032614 Jul 18 03:22:26.791522 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3513/7042] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:26 2022] GET /compute/v2.1/servers/92b41430-5d9d-49a7-93af-67d8fda9b2a9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:22:52.228408 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:22:52.229855 n-d-465891-3 devstack@n-api.service[119544]: Mon Jul 18 03:22:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:23:00.823925 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:23:00.826904 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=12 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:23:01.001198 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3382b021-3432-46ac-a818-11e3de33a1a1 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Action: 'create', calling method: .version_select at 0x7ff49ba6a5e0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1243469757", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQ5cVmz+jp6LzbfBmQi2DhOUpWCAYH+kXPmQrnjy0p7xYS0kzmHOjPcDepdFn9GAdy3RRz3CvSHyeuui+C4osuHOfGgS0+TYzIXuESjV8EOZnz52T1w8gIomI1Dpq/Z2A=="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:23:01.016580 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-3382b021-3432-46ac-a818-11e3de33a1a1 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Getting quotas for project bf01bce203a54dfb94b67e08e3e1440c. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:23:01.022217 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-3382b021-3432-46ac-a818-11e3de33a1a1 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Getting quotas for user 780aa7b07e3f45a588ce2219d027a036 and project bf01bce203a54dfb94b67e08e3e1440c. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:23:01.050837 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3382b021-3432-46ac-a818-11e3de33a1a1 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.232004 Jul 18 03:23:01.051634 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3530/7043] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 03:23:00 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:23:01.106890 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f6713123-250d-456b-b939-ecbee943f912 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1026316333", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1243469757", "networks": [{"uuid": "c52ea33b-6c0c-4828-b7c3-a2d636a08125"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:23:01.117273 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:23:01.117964 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=32 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:23:01.170772 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-f6713123-250d-456b-b939-ecbee943f912 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] validate_networks() for [('c52ea33b-6c0c-4828-b7c3-a2d636a08125', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:23:01.606551 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-f6713123-250d-456b-b939-ecbee943f912 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:23:01.607020 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-f6713123-250d-456b-b939-ecbee943f912 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:23:01.607505 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-f6713123-250d-456b-b939-ecbee943f912 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:23:01.607921 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-f6713123-250d-456b-b939-ecbee943f912 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:23:01.608341 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-f6713123-250d-456b-b939-ecbee943f912 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:23:01.620009 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f6713123-250d-456b-b939-ecbee943f912 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:01.620461 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f6713123-250d-456b-b939-ecbee943f912 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:01.621291 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f6713123-250d-456b-b939-ecbee943f912 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:01.622027 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f6713123-250d-456b-b939-ecbee943f912 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:01.643594 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-f6713123-250d-456b-b939-ecbee943f912 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Getting quotas for project bf01bce203a54dfb94b67e08e3e1440c. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:23:01.650125 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-f6713123-250d-456b-b939-ecbee943f912 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Getting quotas for user 780aa7b07e3f45a588ce2219d027a036 and project bf01bce203a54dfb94b67e08e3e1440c. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:23:01.664906 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f6713123-250d-456b-b939-ecbee943f912 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:23:01.667311 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f6713123-250d-456b-b939-ecbee943f912 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: 60f2b103-1a6a-4719-ad67-6d4160dba490] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:23:01.720357 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f6713123-250d-456b-b939-ecbee943f912 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.617304 Jul 18 03:23:01.721094 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3514/7044] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:23:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 03:23:01.731203 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dc64fa32-88bf-4732-b397-7c1a1686a427 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:01.731845 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-dc64fa32-88bf-4732-b397-7c1a1686a427 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: 60f2b103-1a6a-4719-ad67-6d4160dba490] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:01.826428 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-dc64fa32-88bf-4732-b397-7c1a1686a427 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780aa7b07e3f45a588ce2219d027a036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf01bce203a54dfb94b67e08e3e1440c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:01.836514 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-dc64fa32-88bf-4732-b397-7c1a1686a427 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490" status: 200 len: 1263 microversion: 2.1 time: 0.109225 Jul 18 03:23:01.837117 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3531/7045] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:01 2022] GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490 => generated 1263 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:23:02.856753 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ba63c1f6-0920-4a73-8472-bd8e76758ba1 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:02.857848 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ba63c1f6-0920-4a73-8472-bd8e76758ba1 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: 60f2b103-1a6a-4719-ad67-6d4160dba490] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:02.870446 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba63c1f6-0920-4a73-8472-bd8e76758ba1 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:02.871316 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba63c1f6-0920-4a73-8472-bd8e76758ba1 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:02.872846 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba63c1f6-0920-4a73-8472-bd8e76758ba1 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:02.873622 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba63c1f6-0920-4a73-8472-bd8e76758ba1 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:02.976046 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ba63c1f6-0920-4a73-8472-bd8e76758ba1 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780aa7b07e3f45a588ce2219d027a036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf01bce203a54dfb94b67e08e3e1440c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:02.984940 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ba63c1f6-0920-4a73-8472-bd8e76758ba1 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490" status: 200 len: 1259 microversion: 2.1 time: 0.133913 Jul 18 03:23:02.985628 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3515/7046] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:02 2022] GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490 => generated 1259 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:04.005033 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9e8d43a6-e3cc-4ec7-8ce1-6125ff5bdf58 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:04.005827 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9e8d43a6-e3cc-4ec7-8ce1-6125ff5bdf58 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: 60f2b103-1a6a-4719-ad67-6d4160dba490] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:04.013430 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e8d43a6-e3cc-4ec7-8ce1-6125ff5bdf58 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:04.014086 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e8d43a6-e3cc-4ec7-8ce1-6125ff5bdf58 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:04.014989 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e8d43a6-e3cc-4ec7-8ce1-6125ff5bdf58 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:04.015803 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9e8d43a6-e3cc-4ec7-8ce1-6125ff5bdf58 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:04.245583 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9e8d43a6-e3cc-4ec7-8ce1-6125ff5bdf58 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780aa7b07e3f45a588ce2219d027a036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf01bce203a54dfb94b67e08e3e1440c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:04.255524 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9e8d43a6-e3cc-4ec7-8ce1-6125ff5bdf58 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490" status: 200 len: 1363 microversion: 2.1 time: 0.256498 Jul 18 03:23:04.256052 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3532/7047] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:03 2022] GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490 => generated 1363 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:05.058973 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-066df777-e2ff-43da-85cd-0b6236a0214f req-0f31cb5a-8f99-482a-ae3a-70a4e0bb55f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60f2b103-1a6a-4719-ad67-6d4160dba490", "tag": "9e14e255-8203-4448-9da0-828927026eb6"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:23:05.073111 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-066df777-e2ff-43da-85cd-0b6236a0214f req-0f31cb5a-8f99-482a-ae3a-70a4e0bb55f3 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:05.073853 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-066df777-e2ff-43da-85cd-0b6236a0214f req-0f31cb5a-8f99-482a-ae3a-70a4e0bb55f3 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:05.087357 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-066df777-e2ff-43da-85cd-0b6236a0214f req-0f31cb5a-8f99-482a-ae3a-70a4e0bb55f3 service nova] Creating event network-changed:9e14e255-8203-4448-9da0-828927026eb6 for instance 60f2b103-1a6a-4719-ad67-6d4160dba490 on n-h1-465891-3 Jul 18 03:23:05.092791 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-066df777-e2ff-43da-85cd-0b6236a0214f req-0f31cb5a-8f99-482a-ae3a-70a4e0bb55f3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037997 Jul 18 03:23:05.094078 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3516/7048] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:23:05.273085 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cb2a509f-1c5e-4ba9-ac7a-62817c352d1f tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:05.274433 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cb2a509f-1c5e-4ba9-ac7a-62817c352d1f tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: 60f2b103-1a6a-4719-ad67-6d4160dba490] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:05.283919 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cb2a509f-1c5e-4ba9-ac7a-62817c352d1f tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:05.284171 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cb2a509f-1c5e-4ba9-ac7a-62817c352d1f tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:05.285167 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cb2a509f-1c5e-4ba9-ac7a-62817c352d1f tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:05.285826 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cb2a509f-1c5e-4ba9-ac7a-62817c352d1f tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:05.526981 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cb2a509f-1c5e-4ba9-ac7a-62817c352d1f tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780aa7b07e3f45a588ce2219d027a036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf01bce203a54dfb94b67e08e3e1440c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:05.536514 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cb2a509f-1c5e-4ba9-ac7a-62817c352d1f tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490" status: 200 len: 1363 microversion: 2.1 time: 0.267703 Jul 18 03:23:05.545818 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3533/7049] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:05 2022] GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490 => generated 1363 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:06.555304 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b212688a-3904-46b7-a978-09ae3a607a59 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:06.556008 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b212688a-3904-46b7-a978-09ae3a607a59 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: 60f2b103-1a6a-4719-ad67-6d4160dba490] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:06.562494 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b212688a-3904-46b7-a978-09ae3a607a59 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:06.562941 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b212688a-3904-46b7-a978-09ae3a607a59 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:06.564361 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b212688a-3904-46b7-a978-09ae3a607a59 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:06.564794 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b212688a-3904-46b7-a978-09ae3a607a59 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:06.712100 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b212688a-3904-46b7-a978-09ae3a607a59 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780aa7b07e3f45a588ce2219d027a036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf01bce203a54dfb94b67e08e3e1440c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:06.722045 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b212688a-3904-46b7-a978-09ae3a607a59 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490" status: 200 len: 1363 microversion: 2.1 time: 0.171421 Jul 18 03:23:06.722422 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3517/7050] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:06 2022] GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:07.748651 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6a3510b2-1e10-4cd4-a117-1a5a74b6dc1c tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:07.749314 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6a3510b2-1e10-4cd4-a117-1a5a74b6dc1c tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: 60f2b103-1a6a-4719-ad67-6d4160dba490] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:07.756265 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a3510b2-1e10-4cd4-a117-1a5a74b6dc1c tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:07.756733 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a3510b2-1e10-4cd4-a117-1a5a74b6dc1c tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:07.758702 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a3510b2-1e10-4cd4-a117-1a5a74b6dc1c tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:07.758702 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a3510b2-1e10-4cd4-a117-1a5a74b6dc1c tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:07.906337 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6a3510b2-1e10-4cd4-a117-1a5a74b6dc1c tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780aa7b07e3f45a588ce2219d027a036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf01bce203a54dfb94b67e08e3e1440c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:07.915816 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6a3510b2-1e10-4cd4-a117-1a5a74b6dc1c tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490" status: 200 len: 1363 microversion: 2.1 time: 0.171138 Jul 18 03:23:07.916486 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3534/7051] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:07 2022] GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:08.934987 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e2ab4cc0-af11-47d7-b09e-08260d16ca18 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:08.935599 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e2ab4cc0-af11-47d7-b09e-08260d16ca18 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: 60f2b103-1a6a-4719-ad67-6d4160dba490] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:08.943304 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e2ab4cc0-af11-47d7-b09e-08260d16ca18 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:08.943753 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e2ab4cc0-af11-47d7-b09e-08260d16ca18 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:08.944516 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e2ab4cc0-af11-47d7-b09e-08260d16ca18 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:08.944949 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e2ab4cc0-af11-47d7-b09e-08260d16ca18 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:09.078743 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e2ab4cc0-af11-47d7-b09e-08260d16ca18 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780aa7b07e3f45a588ce2219d027a036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf01bce203a54dfb94b67e08e3e1440c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:09.088270 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e2ab4cc0-af11-47d7-b09e-08260d16ca18 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490" status: 200 len: 1363 microversion: 2.1 time: 0.157072 Jul 18 03:23:09.088780 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3518/7052] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:08 2022] GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:10.105624 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-17b7b748-10bd-4051-a13a-8c407414513e tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:10.106294 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-17b7b748-10bd-4051-a13a-8c407414513e tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: 60f2b103-1a6a-4719-ad67-6d4160dba490] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:10.114489 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-17b7b748-10bd-4051-a13a-8c407414513e tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:10.114959 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-17b7b748-10bd-4051-a13a-8c407414513e tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:10.115771 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-17b7b748-10bd-4051-a13a-8c407414513e tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:10.116230 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-17b7b748-10bd-4051-a13a-8c407414513e tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:10.264188 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-17b7b748-10bd-4051-a13a-8c407414513e tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780aa7b07e3f45a588ce2219d027a036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf01bce203a54dfb94b67e08e3e1440c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:10.273274 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-17b7b748-10bd-4051-a13a-8c407414513e tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490" status: 200 len: 1363 microversion: 2.1 time: 0.171590 Jul 18 03:23:10.273973 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3535/7053] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:10 2022] GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:11.290786 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8a7e4264-3777-45ff-b5a2-35c9373001f8 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:11.291433 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8a7e4264-3777-45ff-b5a2-35c9373001f8 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: 60f2b103-1a6a-4719-ad67-6d4160dba490] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:11.299346 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a7e4264-3777-45ff-b5a2-35c9373001f8 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:11.299712 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a7e4264-3777-45ff-b5a2-35c9373001f8 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:11.300501 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a7e4264-3777-45ff-b5a2-35c9373001f8 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:11.300976 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a7e4264-3777-45ff-b5a2-35c9373001f8 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:11.441756 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8a7e4264-3777-45ff-b5a2-35c9373001f8 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780aa7b07e3f45a588ce2219d027a036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf01bce203a54dfb94b67e08e3e1440c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:11.449414 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8a7e4264-3777-45ff-b5a2-35c9373001f8 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490" status: 200 len: 1363 microversion: 2.1 time: 0.162689 Jul 18 03:23:11.450041 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3519/7054] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:11 2022] GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:12.404465 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-01d08ece-1f8e-479a-a9ff-7550222ff97c req-954e3af3-8c6d-40bc-bff4-d3f2c3ce5da3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60f2b103-1a6a-4719-ad67-6d4160dba490", "name": "network-vif-plugged", "status": "completed", "tag": "9e14e255-8203-4448-9da0-828927026eb6"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:23:12.421224 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:23:12.426147 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-01d08ece-1f8e-479a-a9ff-7550222ff97c req-954e3af3-8c6d-40bc-bff4-d3f2c3ce5da3 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:12.426985 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-01d08ece-1f8e-479a-a9ff-7550222ff97c req-954e3af3-8c6d-40bc-bff4-d3f2c3ce5da3 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:12.444937 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-01d08ece-1f8e-479a-a9ff-7550222ff97c req-954e3af3-8c6d-40bc-bff4-d3f2c3ce5da3 service nova] Creating event network-vif-plugged:9e14e255-8203-4448-9da0-828927026eb6 for instance 60f2b103-1a6a-4719-ad67-6d4160dba490 on n-h1-465891-3 Jul 18 03:23:12.450757 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-01d08ece-1f8e-479a-a9ff-7550222ff97c req-954e3af3-8c6d-40bc-bff4-d3f2c3ce5da3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053604 Jul 18 03:23:12.451403 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3536/7055] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:23:12.467505 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a2d631c7-3f67-4160-99b1-a2836c297e15 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:12.473118 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a2d631c7-3f67-4160-99b1-a2836c297e15 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: 60f2b103-1a6a-4719-ad67-6d4160dba490] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:12.475580 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:23:12.476314 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:23:12.483691 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a2d631c7-3f67-4160-99b1-a2836c297e15 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:12.484157 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a2d631c7-3f67-4160-99b1-a2836c297e15 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:12.484946 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a2d631c7-3f67-4160-99b1-a2836c297e15 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:12.485497 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a2d631c7-3f67-4160-99b1-a2836c297e15 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:12.693530 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a2d631c7-3f67-4160-99b1-a2836c297e15 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780aa7b07e3f45a588ce2219d027a036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf01bce203a54dfb94b67e08e3e1440c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:12.701218 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a2d631c7-3f67-4160-99b1-a2836c297e15 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490" status: 200 len: 1363 microversion: 2.1 time: 0.237591 Jul 18 03:23:12.701840 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3520/7056] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:12 2022] GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490 => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:13.720327 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c94332ae-b650-4e3b-be8c-657e86c7b943 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:13.721121 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c94332ae-b650-4e3b-be8c-657e86c7b943 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: 60f2b103-1a6a-4719-ad67-6d4160dba490] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:13.728327 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c94332ae-b650-4e3b-be8c-657e86c7b943 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:13.728817 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c94332ae-b650-4e3b-be8c-657e86c7b943 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:13.729636 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c94332ae-b650-4e3b-be8c-657e86c7b943 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:13.730128 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c94332ae-b650-4e3b-be8c-657e86c7b943 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:13.882053 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c94332ae-b650-4e3b-be8c-657e86c7b943 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780aa7b07e3f45a588ce2219d027a036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf01bce203a54dfb94b67e08e3e1440c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:13.892125 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c94332ae-b650-4e3b-be8c-657e86c7b943 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490" status: 200 len: 1363 microversion: 2.1 time: 0.177000 Jul 18 03:23:13.892768 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3537/7057] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:13 2022] GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:14.916175 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-18c783e0-ac82-4fd2-87f5-b305dc13c7e3 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:14.916821 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-18c783e0-ac82-4fd2-87f5-b305dc13c7e3 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: 60f2b103-1a6a-4719-ad67-6d4160dba490] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:14.924669 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-18c783e0-ac82-4fd2-87f5-b305dc13c7e3 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:14.925100 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-18c783e0-ac82-4fd2-87f5-b305dc13c7e3 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:14.925907 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-18c783e0-ac82-4fd2-87f5-b305dc13c7e3 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:14.926344 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-18c783e0-ac82-4fd2-87f5-b305dc13c7e3 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:15.062731 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-18c783e0-ac82-4fd2-87f5-b305dc13c7e3 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780aa7b07e3f45a588ce2219d027a036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf01bce203a54dfb94b67e08e3e1440c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:15.071010 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-18c783e0-ac82-4fd2-87f5-b305dc13c7e3 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490" status: 200 len: 1556 microversion: 2.1 time: 0.158733 Jul 18 03:23:15.071596 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3521/7058] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:14 2022] GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490 => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:15.087760 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-61daa4f2-810c-49f8-8b52-b1388bda97ef tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:15.088395 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-61daa4f2-810c-49f8-8b52-b1388bda97ef tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: 60f2b103-1a6a-4719-ad67-6d4160dba490] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:15.095610 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-61daa4f2-810c-49f8-8b52-b1388bda97ef tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:15.096086 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-61daa4f2-810c-49f8-8b52-b1388bda97ef tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:15.096883 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-61daa4f2-810c-49f8-8b52-b1388bda97ef tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:15.097340 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-61daa4f2-810c-49f8-8b52-b1388bda97ef tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:15.228954 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-61daa4f2-810c-49f8-8b52-b1388bda97ef tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780aa7b07e3f45a588ce2219d027a036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf01bce203a54dfb94b67e08e3e1440c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:15.237807 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-61daa4f2-810c-49f8-8b52-b1388bda97ef tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490" status: 200 len: 1556 microversion: 2.1 time: 0.153893 Jul 18 03:23:15.238400 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3538/7059] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:15 2022] GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490 => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:16.835915 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8f627de6-258d-4315-a4a0-2dd22b325429 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "243bf792-abfb-4103-9959-8cfc92f770a4"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:23:16.836941 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8f627de6-258d-4315-a4a0-2dd22b325429 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: 60f2b103-1a6a-4719-ad67-6d4160dba490] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:16.845791 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8f627de6-258d-4315-a4a0-2dd22b325429 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:16.846253 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8f627de6-258d-4315-a4a0-2dd22b325429 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:16.847077 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8f627de6-258d-4315-a4a0-2dd22b325429 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:16.847522 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8f627de6-258d-4315-a4a0-2dd22b325429 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:17.116217 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8f627de6-258d-4315-a4a0-2dd22b325429 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "POST /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288108 Jul 18 03:23:17.116848 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3522/7060] 10.222.0.57 () {60 vars in 1322 bytes} [Mon Jul 18 03:23:16 2022] POST /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:23:28.890066 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e39fdefb-37b2-46f3-9c9f-583ac226798f tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:28.890628 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e39fdefb-37b2-46f3-9c9f-583ac226798f tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: 60f2b103-1a6a-4719-ad67-6d4160dba490] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:28.893177 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:23:28.894027 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=38 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:23:28.899845 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e39fdefb-37b2-46f3-9c9f-583ac226798f tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:28.900321 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e39fdefb-37b2-46f3-9c9f-583ac226798f tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:28.901126 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e39fdefb-37b2-46f3-9c9f-583ac226798f tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:28.901612 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e39fdefb-37b2-46f3-9c9f-583ac226798f tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:28.992660 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-e39fdefb-37b2-46f3-9c9f-583ac226798f tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lazy-loading 'services' on Instance uuid 60f2b103-1a6a-4719-ad67-6d4160dba490 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:23:29.068056 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e39fdefb-37b2-46f3-9c9f-583ac226798f tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "DELETE /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490/os-volume_attachments/243bf792-abfb-4103-9959-8cfc92f770a4" status: 202 len: 0 microversion: 2.1 time: 0.181901 Jul 18 03:23:29.068767 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3539/7061] 10.222.0.57 () {58 vars in 1415 bytes} [Mon Jul 18 03:23:28 2022] DELETE /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490/os-volume_attachments/243bf792-abfb-4103-9959-8cfc92f770a4 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:23:29.076561 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:23:29.077507 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:23:29.083233 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-69aa4a0a-6cf7-463f-9704-c25c5ab51eae tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:29.084180 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-69aa4a0a-6cf7-463f-9704-c25c5ab51eae tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: 60f2b103-1a6a-4719-ad67-6d4160dba490] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:29.096261 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69aa4a0a-6cf7-463f-9704-c25c5ab51eae tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:29.096711 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69aa4a0a-6cf7-463f-9704-c25c5ab51eae tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:29.097498 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69aa4a0a-6cf7-463f-9704-c25c5ab51eae tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:29.097954 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-69aa4a0a-6cf7-463f-9704-c25c5ab51eae tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:29.139491 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-69aa4a0a-6cf7-463f-9704-c25c5ab51eae tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064801 Jul 18 03:23:29.140092 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3523/7062] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 03:23:29 2022] GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:23:30.155182 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e1004fd7-0b23-42c2-a4e9-f13bb99b1eba tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:30.156302 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e1004fd7-0b23-42c2-a4e9-f13bb99b1eba tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: 60f2b103-1a6a-4719-ad67-6d4160dba490] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:30.166455 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e1004fd7-0b23-42c2-a4e9-f13bb99b1eba tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:30.166939 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e1004fd7-0b23-42c2-a4e9-f13bb99b1eba tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:30.167769 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e1004fd7-0b23-42c2-a4e9-f13bb99b1eba tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:30.168227 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e1004fd7-0b23-42c2-a4e9-f13bb99b1eba tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:30.203553 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e1004fd7-0b23-42c2-a4e9-f13bb99b1eba tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055154 Jul 18 03:23:30.204708 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3540/7063] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 03:23:30 2022] GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:23:31.216061 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-294b55d7-37d0-4d7f-bede-2ee3d56313bf tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:31.217089 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-294b55d7-37d0-4d7f-bede-2ee3d56313bf tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: 60f2b103-1a6a-4719-ad67-6d4160dba490] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:31.226438 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-294b55d7-37d0-4d7f-bede-2ee3d56313bf tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:31.226905 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-294b55d7-37d0-4d7f-bede-2ee3d56313bf tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:31.227724 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-294b55d7-37d0-4d7f-bede-2ee3d56313bf tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:31.228173 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-294b55d7-37d0-4d7f-bede-2ee3d56313bf tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:31.262440 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-294b55d7-37d0-4d7f-bede-2ee3d56313bf tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050282 Jul 18 03:23:31.262907 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3524/7064] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 03:23:31 2022] GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:23:32.275792 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-96d532b1-78ea-4ec7-819d-74ff0c6c9cac tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:32.277207 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-96d532b1-78ea-4ec7-819d-74ff0c6c9cac tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: 60f2b103-1a6a-4719-ad67-6d4160dba490] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:32.287442 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-96d532b1-78ea-4ec7-819d-74ff0c6c9cac tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:32.288088 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-96d532b1-78ea-4ec7-819d-74ff0c6c9cac tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:32.289898 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-96d532b1-78ea-4ec7-819d-74ff0c6c9cac tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:32.290750 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-96d532b1-78ea-4ec7-819d-74ff0c6c9cac tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:32.327692 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-96d532b1-78ea-4ec7-819d-74ff0c6c9cac tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056641 Jul 18 03:23:32.328306 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3541/7065] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 03:23:32 2022] GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:23:33.342280 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a2d261e6-4b84-466b-9610-b1825c47f6b6 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:33.343884 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a2d261e6-4b84-466b-9610-b1825c47f6b6 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: 60f2b103-1a6a-4719-ad67-6d4160dba490] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:33.352636 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a2d261e6-4b84-466b-9610-b1825c47f6b6 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:33.353177 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a2d261e6-4b84-466b-9610-b1825c47f6b6 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:33.362889 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a2d261e6-4b84-466b-9610-b1825c47f6b6 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:33.363422 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a2d261e6-4b84-466b-9610-b1825c47f6b6 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:33.404573 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a2d261e6-4b84-466b-9610-b1825c47f6b6 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067203 Jul 18 03:23:33.405301 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3525/7066] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 03:23:33 2022] GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:23:34.418452 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-329978c1-bbf5-4863-b602-0ec993426b19 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:34.419412 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-329978c1-bbf5-4863-b602-0ec993426b19 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: 60f2b103-1a6a-4719-ad67-6d4160dba490] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:34.426783 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-329978c1-bbf5-4863-b602-0ec993426b19 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:34.427243 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-329978c1-bbf5-4863-b602-0ec993426b19 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:34.428028 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-329978c1-bbf5-4863-b602-0ec993426b19 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:34.428473 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-329978c1-bbf5-4863-b602-0ec993426b19 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:34.460073 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-329978c1-bbf5-4863-b602-0ec993426b19 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045657 Jul 18 03:23:34.460734 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3542/7067] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 03:23:34 2022] GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 03:23:34.471099 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-abd65b4a-db9c-48fc-8063-bcc2d4e373c6 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:34.471795 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-abd65b4a-db9c-48fc-8063-bcc2d4e373c6 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: 60f2b103-1a6a-4719-ad67-6d4160dba490] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:34.479053 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-abd65b4a-db9c-48fc-8063-bcc2d4e373c6 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:34.479586 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-abd65b4a-db9c-48fc-8063-bcc2d4e373c6 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:34.480487 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-abd65b4a-db9c-48fc-8063-bcc2d4e373c6 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:34.480980 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-abd65b4a-db9c-48fc-8063-bcc2d4e373c6 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:34.566571 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-abd65b4a-db9c-48fc-8063-bcc2d4e373c6 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] HTTP exception thrown: Instance 60f2b103-1a6a-4719-ad67-6d4160dba490 is not attached to volume 243bf792-abfb-4103-9959-8cfc92f770a4 Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-abd65b4a-db9c-48fc-8063-bcc2d4e373c6 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Request method failure captured: Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490/os-volume_attachments/243bf792-abfb-4103-9959-8cfc92f770a4 HTTP/1.1 Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1NIOIQVeR9UBcYNurKNhcihPriYRr9PNvOqf4pomxvkzH97krhitgzHp_gmlBWhXTYYrHlinwGaKQs-hbRE2CWKGuKXD3Ecwwm_ybXOMGdDR6qJAX3Gx9mJEGhiwUB20cARYxRxNzSDQFo23Fx_pqTNi5ecxUYo0q3MkePOgFxyZQqk Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: bf01bce203a54dfb94b67e08e3e1440c Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1404995367 Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_bf01bce203a54dfb94b67e08e3e1440c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bf01bce203a54dfb94b67e08e3e1440c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bf01bce203a54dfb94b67e08e3e1440c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/bf01bce203a54dfb94b67e08e3e1440c"}]}] Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-TestEncryptedCinderVolumes-1404995367 Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: bf01bce203a54dfb94b67e08e3e1440c Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1404995367 Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-TestEncryptedCinderVolumes-1404995367-project Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 780aa7b07e3f45a588ce2219d027a036 Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-TestEncryptedCinderVolumes-1404995367-project Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 60f2b103-1a6a-4719-ad67-6d4160dba490 is not attached to volume 243bf792-abfb-4103-9959-8cfc92f770a4 Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'server_id': '60f2b103-1a6a-4719-ad67-6d4160dba490', 'id': '243bf792-abfb-4103-9959-8cfc92f770a4'} Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 243bf792-abfb-4103-9959-8cfc92f770a4. Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60f2b103-1a6a-4719-ad67-6d4160dba490 is not attached to volume 243bf792-abfb-4103-9959-8cfc92f770a4 Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:23:34.574893 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:23:34.580756 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:23:34.580756 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:23:34.580756 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60f2b103-1a6a-4719-ad67-6d4160dba490 is not attached to volume 243bf792-abfb-4103-9959-8cfc92f770a4 Jul 18 03:23:34.580756 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:23:34.580756 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-abd65b4a-db9c-48fc-8063-bcc2d4e373c6 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Returning 404 to user: Instance 60f2b103-1a6a-4719-ad67-6d4160dba490 is not attached to volume 243bf792-abfb-4103-9959-8cfc92f770a4 {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:23:34.580756 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-abd65b4a-db9c-48fc-8063-bcc2d4e373c6 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "DELETE /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490/os-volume_attachments/243bf792-abfb-4103-9959-8cfc92f770a4" status: 404 len: 154 microversion: 2.1 time: 0.110304 Jul 18 03:23:34.580756 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3526/7068] 10.222.0.57 () {58 vars in 1415 bytes} [Mon Jul 18 03:23:34 2022] DELETE /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490/os-volume_attachments/243bf792-abfb-4103-9959-8cfc92f770a4 => generated 154 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:23:37.993416 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5d45bdad-3a8a-43b5-8fe7-7bc282e4ee7e tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:37.994109 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5d45bdad-3a8a-43b5-8fe7-7bc282e4ee7e tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: 60f2b103-1a6a-4719-ad67-6d4160dba490] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:38.002510 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5d45bdad-3a8a-43b5-8fe7-7bc282e4ee7e tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:38.003269 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5d45bdad-3a8a-43b5-8fe7-7bc282e4ee7e tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:38.003997 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5d45bdad-3a8a-43b5-8fe7-7bc282e4ee7e tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:38.004445 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5d45bdad-3a8a-43b5-8fe7-7bc282e4ee7e tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:38.030750 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5d45bdad-3a8a-43b5-8fe7-7bc282e4ee7e tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: 60f2b103-1a6a-4719-ad67-6d4160dba490] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:23:38.115084 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5d45bdad-3a8a-43b5-8fe7-7bc282e4ee7e tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "DELETE /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490" status: 204 len: 0 microversion: 2.1 time: 0.124900 Jul 18 03:23:38.115802 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3543/7069] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:23:37 2022] DELETE /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:23:38.125296 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-110d3078-f00a-4cdf-b1e0-81052b63dc4f tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:38.126477 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-110d3078-f00a-4cdf-b1e0-81052b63dc4f tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: 60f2b103-1a6a-4719-ad67-6d4160dba490] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:38.133809 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-110d3078-f00a-4cdf-b1e0-81052b63dc4f tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:38.134264 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-110d3078-f00a-4cdf-b1e0-81052b63dc4f tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:38.135049 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-110d3078-f00a-4cdf-b1e0-81052b63dc4f tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:38.135487 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-110d3078-f00a-4cdf-b1e0-81052b63dc4f tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:38.288669 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-110d3078-f00a-4cdf-b1e0-81052b63dc4f tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780aa7b07e3f45a588ce2219d027a036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf01bce203a54dfb94b67e08e3e1440c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:38.297328 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-110d3078-f00a-4cdf-b1e0-81052b63dc4f tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490" status: 200 len: 1562 microversion: 2.1 time: 0.176303 Jul 18 03:23:38.298346 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3527/7070] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:38 2022] GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490 => generated 1562 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:39.316267 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cad8a937-45c1-4188-9c8d-04dde2b02d93 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:39.316945 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cad8a937-45c1-4188-9c8d-04dde2b02d93 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: 60f2b103-1a6a-4719-ad67-6d4160dba490] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:39.324144 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cad8a937-45c1-4188-9c8d-04dde2b02d93 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:39.324600 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cad8a937-45c1-4188-9c8d-04dde2b02d93 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:39.325392 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cad8a937-45c1-4188-9c8d-04dde2b02d93 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:39.325877 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cad8a937-45c1-4188-9c8d-04dde2b02d93 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:39.467417 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cad8a937-45c1-4188-9c8d-04dde2b02d93 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780aa7b07e3f45a588ce2219d027a036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf01bce203a54dfb94b67e08e3e1440c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:39.476022 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cad8a937-45c1-4188-9c8d-04dde2b02d93 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490" status: 200 len: 1562 microversion: 2.1 time: 0.164090 Jul 18 03:23:39.476627 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3544/7071] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:39 2022] GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490 => generated 1562 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:40.472046 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-41f09bfe-8b9c-421f-a562-3312a051f7df req-70884590-2fb5-4b5e-b201-cc53c457d383 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60f2b103-1a6a-4719-ad67-6d4160dba490", "name": "network-vif-deleted", "tag": "9e14e255-8203-4448-9da0-828927026eb6"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:23:40.481006 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-41f09bfe-8b9c-421f-a562-3312a051f7df req-70884590-2fb5-4b5e-b201-cc53c457d383 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:40.481453 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-41f09bfe-8b9c-421f-a562-3312a051f7df req-70884590-2fb5-4b5e-b201-cc53c457d383 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:40.493955 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-102a8392-add7-4ad8-87d8-17402b613521 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:40.494605 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-102a8392-add7-4ad8-87d8-17402b613521 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: 60f2b103-1a6a-4719-ad67-6d4160dba490] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:40.497269 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-41f09bfe-8b9c-421f-a562-3312a051f7df req-70884590-2fb5-4b5e-b201-cc53c457d383 service nova] Creating event network-vif-deleted:9e14e255-8203-4448-9da0-828927026eb6 for instance 60f2b103-1a6a-4719-ad67-6d4160dba490 on n-h1-465891-3 Jul 18 03:23:40.504803 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-41f09bfe-8b9c-421f-a562-3312a051f7df req-70884590-2fb5-4b5e-b201-cc53c457d383 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037784 Jul 18 03:23:40.505030 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-102a8392-add7-4ad8-87d8-17402b613521 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:40.505218 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-102a8392-add7-4ad8-87d8-17402b613521 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:40.505994 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-102a8392-add7-4ad8-87d8-17402b613521 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:40.507825 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-102a8392-add7-4ad8-87d8-17402b613521 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:40.508936 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3528/7072] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:23:40.578727 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-102a8392-add7-4ad8-87d8-17402b613521 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780aa7b07e3f45a588ce2219d027a036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf01bce203a54dfb94b67e08e3e1440c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:40.587517 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-102a8392-add7-4ad8-87d8-17402b613521 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490" status: 200 len: 1348 microversion: 2.1 time: 0.097366 Jul 18 03:23:40.588113 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3545/7073] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:40 2022] GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490 => generated 1348 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:23:41.605008 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-659805ad-5201-4a1d-b247-d9189d414b8b tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:41.605733 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-659805ad-5201-4a1d-b247-d9189d414b8b tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: 60f2b103-1a6a-4719-ad67-6d4160dba490] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:41.613310 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-659805ad-5201-4a1d-b247-d9189d414b8b tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:41.613792 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-659805ad-5201-4a1d-b247-d9189d414b8b tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:41.614555 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-659805ad-5201-4a1d-b247-d9189d414b8b tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:41.614993 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-659805ad-5201-4a1d-b247-d9189d414b8b tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:41.629589 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-659805ad-5201-4a1d-b247-d9189d414b8b tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] HTTP exception thrown: Instance 60f2b103-1a6a-4719-ad67-6d4160dba490 could not be found. Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-659805ad-5201-4a1d-b247-d9189d414b8b tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Request method failure captured: Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490 HTTP/1.1 Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1NIOIQVeR9UBcYNurKNhcihPriYRr9PNvOqf4pomxvkzH97krhitgzHp_gmlBWhXTYYrHlinwGaKQs-hbRE2CWKGuKXD3Ecwwm_ybXOMGdDR6qJAX3Gx9mJEGhiwUB20cARYxRxNzSDQFo23Fx_pqTNi5ecxUYo0q3MkePOgFxyZQqk Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: bf01bce203a54dfb94b67e08e3e1440c Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1404995367 Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_bf01bce203a54dfb94b67e08e3e1440c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bf01bce203a54dfb94b67e08e3e1440c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bf01bce203a54dfb94b67e08e3e1440c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/bf01bce203a54dfb94b67e08e3e1440c"}]}] Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-TestEncryptedCinderVolumes-1404995367 Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: bf01bce203a54dfb94b67e08e3e1440c Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1404995367 Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-TestEncryptedCinderVolumes-1404995367-project Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 780aa7b07e3f45a588ce2219d027a036 Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-TestEncryptedCinderVolumes-1404995367-project Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 60f2b103-1a6a-4719-ad67-6d4160dba490 could not be found. Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '60f2b103-1a6a-4719-ad67-6d4160dba490'} Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60f2b103-1a6a-4719-ad67-6d4160dba490 could not be found. Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60f2b103-1a6a-4719-ad67-6d4160dba490 could not be found. Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:23:41.631288 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:23:41.636219 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:23:41.636219 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:23:41.636219 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:23:41.636219 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:23:41.636219 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:23:41.636219 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60f2b103-1a6a-4719-ad67-6d4160dba490 could not be found. Jul 18 03:23:41.636219 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:23:41.636219 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-659805ad-5201-4a1d-b247-d9189d414b8b tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Returning 404 to user: Instance 60f2b103-1a6a-4719-ad67-6d4160dba490 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:23:41.636219 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-659805ad-5201-4a1d-b247-d9189d414b8b tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490" status: 404 len: 111 microversion: 2.1 time: 0.031953 Jul 18 03:23:41.636219 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3529/7074] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:41 2022] GET /compute/v2.1/servers/60f2b103-1a6a-4719-ad67-6d4160dba490 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:23:41.641596 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e59b261d-585a-481f-9b90-f200c8cdb730 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '.version_select at 0x7ff49b5dff70>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:41.661184 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e59b261d-585a-481f-9b90-f200c8cdb730 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1243469757" status: 202 len: 0 microversion: 2.1 time: 0.023361 Jul 18 03:23:41.661799 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3546/7075] 10.222.0.57 () {58 vars in 1277 bytes} [Mon Jul 18 03:23:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1243469757 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:23:41.679675 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-91c85d3a-1a66-45c1-8806-caaa7831cf23 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Action: 'create', calling method: .version_select at 0x7ff4a8376af0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-14080464", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhArICCZiml6rCn80RMrYI6EpuDrGPrhPL6VqKtfTvA0nxtB2VF+UjbCs50ZbUHfetDqXHu7rW3mtAH8+ZX/5vTzo3PZQqxihslen744Z8yUcdqsZtiQ0bUCkAlLicHdA=="}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:23:41.693936 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-91c85d3a-1a66-45c1-8806-caaa7831cf23 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Getting quotas for project bf01bce203a54dfb94b67e08e3e1440c. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:23:41.700250 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-91c85d3a-1a66-45c1-8806-caaa7831cf23 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Getting quotas for user 780aa7b07e3f45a588ce2219d027a036 and project bf01bce203a54dfb94b67e08e3e1440c. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:23:41.727895 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-91c85d3a-1a66-45c1-8806-caaa7831cf23 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.052142 Jul 18 03:23:41.728522 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3530/7076] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 03:23:41 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:23:41.778201 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-44d77b7a-8191-44d2-9c38-404178f9bbc9 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-328530829", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-14080464", "networks": [{"uuid": "c52ea33b-6c0c-4828-b7c3-a2d636a08125"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:23:41.837281 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-44d77b7a-8191-44d2-9c38-404178f9bbc9 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] validate_networks() for [('c52ea33b-6c0c-4828-b7c3-a2d636a08125', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:23:42.327614 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-44d77b7a-8191-44d2-9c38-404178f9bbc9 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:23:42.328047 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-44d77b7a-8191-44d2-9c38-404178f9bbc9 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:23:42.328565 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-44d77b7a-8191-44d2-9c38-404178f9bbc9 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:23:42.328983 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-44d77b7a-8191-44d2-9c38-404178f9bbc9 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:23:42.329404 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-44d77b7a-8191-44d2-9c38-404178f9bbc9 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:23:42.338968 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-44d77b7a-8191-44d2-9c38-404178f9bbc9 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:42.339425 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-44d77b7a-8191-44d2-9c38-404178f9bbc9 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:42.340303 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-44d77b7a-8191-44d2-9c38-404178f9bbc9 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:42.340680 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-44d77b7a-8191-44d2-9c38-404178f9bbc9 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:42.358465 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-44d77b7a-8191-44d2-9c38-404178f9bbc9 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Getting quotas for project bf01bce203a54dfb94b67e08e3e1440c. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:23:42.363727 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-44d77b7a-8191-44d2-9c38-404178f9bbc9 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Getting quotas for user 780aa7b07e3f45a588ce2219d027a036 and project bf01bce203a54dfb94b67e08e3e1440c. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:23:42.376462 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-44d77b7a-8191-44d2-9c38-404178f9bbc9 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:23:42.378974 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-44d77b7a-8191-44d2-9c38-404178f9bbc9 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: a5743af7-4638-4451-8633-e52454bb8296] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:23:42.425870 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-44d77b7a-8191-44d2-9c38-404178f9bbc9 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.651474 Jul 18 03:23:42.426526 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3547/7077] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:23:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:23:42.436405 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f0388e9d-0925-4737-8823-0b261a3cc5fc tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:42.437025 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f0388e9d-0925-4737-8823-0b261a3cc5fc tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: a5743af7-4638-4451-8633-e52454bb8296] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:42.494233 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f0388e9d-0925-4737-8823-0b261a3cc5fc tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780aa7b07e3f45a588ce2219d027a036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf01bce203a54dfb94b67e08e3e1440c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:42.501365 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f0388e9d-0925-4737-8823-0b261a3cc5fc tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296" status: 200 len: 1260 microversion: 2.1 time: 0.068983 Jul 18 03:23:42.502328 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3531/7078] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:42 2022] GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296 => generated 1260 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:43.519374 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fb4a40e1-9a23-4fd5-9ce8-9363f04d55f8 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:43.520329 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fb4a40e1-9a23-4fd5-9ce8-9363f04d55f8 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: a5743af7-4638-4451-8633-e52454bb8296] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:43.528354 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fb4a40e1-9a23-4fd5-9ce8-9363f04d55f8 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:43.529078 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fb4a40e1-9a23-4fd5-9ce8-9363f04d55f8 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:43.530095 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fb4a40e1-9a23-4fd5-9ce8-9363f04d55f8 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:43.530374 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fb4a40e1-9a23-4fd5-9ce8-9363f04d55f8 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:43.617835 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fb4a40e1-9a23-4fd5-9ce8-9363f04d55f8 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780aa7b07e3f45a588ce2219d027a036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf01bce203a54dfb94b67e08e3e1440c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:43.627200 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fb4a40e1-9a23-4fd5-9ce8-9363f04d55f8 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296" status: 200 len: 1330 microversion: 2.1 time: 0.112366 Jul 18 03:23:43.627831 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3548/7079] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:43 2022] GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296 => generated 1330 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:44.644953 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4e8e5109-bec8-42ff-b54e-c91807f29dac tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:44.645674 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4e8e5109-bec8-42ff-b54e-c91807f29dac tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: a5743af7-4638-4451-8633-e52454bb8296] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:44.653236 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e8e5109-bec8-42ff-b54e-c91807f29dac tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:44.653859 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e8e5109-bec8-42ff-b54e-c91807f29dac tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:44.654734 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e8e5109-bec8-42ff-b54e-c91807f29dac tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:44.655391 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e8e5109-bec8-42ff-b54e-c91807f29dac tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:44.859473 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4e8e5109-bec8-42ff-b54e-c91807f29dac tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780aa7b07e3f45a588ce2219d027a036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf01bce203a54dfb94b67e08e3e1440c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:44.868429 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4e8e5109-bec8-42ff-b54e-c91807f29dac tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296" status: 200 len: 1360 microversion: 2.1 time: 0.227626 Jul 18 03:23:44.870208 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3532/7080] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:44 2022] GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296 => generated 1360 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:44.927881 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-e29d5072-cbc7-4059-92b0-709a82da2274 req-30cf1da2-1d22-4dc4-84a2-e58e2639a286 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5743af7-4638-4451-8633-e52454bb8296", "tag": "216669b1-efaf-40ef-87b5-4c7ef7c764a4"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:23:44.939856 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-e29d5072-cbc7-4059-92b0-709a82da2274 req-30cf1da2-1d22-4dc4-84a2-e58e2639a286 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:44.940333 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-e29d5072-cbc7-4059-92b0-709a82da2274 req-30cf1da2-1d22-4dc4-84a2-e58e2639a286 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:44.967684 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-e29d5072-cbc7-4059-92b0-709a82da2274 req-30cf1da2-1d22-4dc4-84a2-e58e2639a286 service nova] Creating event network-changed:216669b1-efaf-40ef-87b5-4c7ef7c764a4 for instance a5743af7-4638-4451-8633-e52454bb8296 on n-h1-465891-3 Jul 18 03:23:44.975053 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-e29d5072-cbc7-4059-92b0-709a82da2274 req-30cf1da2-1d22-4dc4-84a2-e58e2639a286 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051547 Jul 18 03:23:44.976053 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3549/7081] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:23:45.886273 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-91564ee0-dbc6-4d08-bdc3-343dd0003acd tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:45.887027 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-91564ee0-dbc6-4d08-bdc3-343dd0003acd tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: a5743af7-4638-4451-8633-e52454bb8296] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:45.895418 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91564ee0-dbc6-4d08-bdc3-343dd0003acd tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:45.895874 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91564ee0-dbc6-4d08-bdc3-343dd0003acd tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:45.896665 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91564ee0-dbc6-4d08-bdc3-343dd0003acd tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:45.897106 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91564ee0-dbc6-4d08-bdc3-343dd0003acd tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:46.035110 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-91564ee0-dbc6-4d08-bdc3-343dd0003acd tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780aa7b07e3f45a588ce2219d027a036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf01bce203a54dfb94b67e08e3e1440c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:46.044333 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-91564ee0-dbc6-4d08-bdc3-343dd0003acd tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296" status: 200 len: 1360 microversion: 2.1 time: 0.161666 Jul 18 03:23:46.045134 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3533/7082] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:45 2022] GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296 => generated 1360 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:47.063336 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-abc937f0-6b8e-4458-85f1-1b71853f30e8 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:47.064711 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-abc937f0-6b8e-4458-85f1-1b71853f30e8 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: a5743af7-4638-4451-8633-e52454bb8296] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:47.071527 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-abc937f0-6b8e-4458-85f1-1b71853f30e8 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:47.071989 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-abc937f0-6b8e-4458-85f1-1b71853f30e8 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:47.072771 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-abc937f0-6b8e-4458-85f1-1b71853f30e8 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:47.073222 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-abc937f0-6b8e-4458-85f1-1b71853f30e8 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:47.208520 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-abc937f0-6b8e-4458-85f1-1b71853f30e8 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780aa7b07e3f45a588ce2219d027a036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf01bce203a54dfb94b67e08e3e1440c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:47.217516 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-abc937f0-6b8e-4458-85f1-1b71853f30e8 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296" status: 200 len: 1360 microversion: 2.1 time: 0.159411 Jul 18 03:23:47.218134 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3550/7083] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:47 2022] GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296 => generated 1360 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:48.234803 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-caffe3d6-e7a8-48e4-ae5c-f7eef6b9ab15 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:48.235515 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-caffe3d6-e7a8-48e4-ae5c-f7eef6b9ab15 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: a5743af7-4638-4451-8633-e52454bb8296] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:48.242438 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-caffe3d6-e7a8-48e4-ae5c-f7eef6b9ab15 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:48.242887 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-caffe3d6-e7a8-48e4-ae5c-f7eef6b9ab15 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:48.243658 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-caffe3d6-e7a8-48e4-ae5c-f7eef6b9ab15 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:48.244092 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-caffe3d6-e7a8-48e4-ae5c-f7eef6b9ab15 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:48.378124 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-caffe3d6-e7a8-48e4-ae5c-f7eef6b9ab15 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780aa7b07e3f45a588ce2219d027a036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf01bce203a54dfb94b67e08e3e1440c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:48.385610 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-caffe3d6-e7a8-48e4-ae5c-f7eef6b9ab15 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296" status: 200 len: 1360 microversion: 2.1 time: 0.154719 Jul 18 03:23:48.386218 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3534/7084] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:48 2022] GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296 => generated 1360 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:49.403486 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e70f7a62-14cf-4216-b3e2-5c7b2ec13bca tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:49.404108 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e70f7a62-14cf-4216-b3e2-5c7b2ec13bca tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: a5743af7-4638-4451-8633-e52454bb8296] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:49.411482 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e70f7a62-14cf-4216-b3e2-5c7b2ec13bca tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:49.411986 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e70f7a62-14cf-4216-b3e2-5c7b2ec13bca tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:49.412931 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e70f7a62-14cf-4216-b3e2-5c7b2ec13bca tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:49.413420 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e70f7a62-14cf-4216-b3e2-5c7b2ec13bca tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:49.544862 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e70f7a62-14cf-4216-b3e2-5c7b2ec13bca tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780aa7b07e3f45a588ce2219d027a036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf01bce203a54dfb94b67e08e3e1440c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:49.552642 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e70f7a62-14cf-4216-b3e2-5c7b2ec13bca tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296" status: 200 len: 1360 microversion: 2.1 time: 0.153075 Jul 18 03:23:49.553387 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3551/7085] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:49 2022] GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296 => generated 1360 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:50.569652 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2fc31ff7-fef5-45e5-97b8-ef7dc7124083 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:50.570439 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2fc31ff7-fef5-45e5-97b8-ef7dc7124083 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: a5743af7-4638-4451-8633-e52454bb8296] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:50.573837 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-3de5d2ca-39c5-413a-8f86-98b9366c2e63 req-6dd15276-3eec-45e7-b94e-6c7eaa9fedc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5743af7-4638-4451-8633-e52454bb8296", "name": "network-vif-plugged", "status": "completed", "tag": "216669b1-efaf-40ef-87b5-4c7ef7c764a4"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:23:50.578157 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2fc31ff7-fef5-45e5-97b8-ef7dc7124083 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:50.578692 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2fc31ff7-fef5-45e5-97b8-ef7dc7124083 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:50.579606 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2fc31ff7-fef5-45e5-97b8-ef7dc7124083 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:50.580273 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2fc31ff7-fef5-45e5-97b8-ef7dc7124083 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:50.586116 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-3de5d2ca-39c5-413a-8f86-98b9366c2e63 req-6dd15276-3eec-45e7-b94e-6c7eaa9fedc4 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:50.586612 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-3de5d2ca-39c5-413a-8f86-98b9366c2e63 req-6dd15276-3eec-45e7-b94e-6c7eaa9fedc4 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:50.602538 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-3de5d2ca-39c5-413a-8f86-98b9366c2e63 req-6dd15276-3eec-45e7-b94e-6c7eaa9fedc4 service nova] Creating event network-vif-plugged:216669b1-efaf-40ef-87b5-4c7ef7c764a4 for instance a5743af7-4638-4451-8633-e52454bb8296 on n-h1-465891-3 Jul 18 03:23:50.608080 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-3de5d2ca-39c5-413a-8f86-98b9366c2e63 req-6dd15276-3eec-45e7-b94e-6c7eaa9fedc4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038959 Jul 18 03:23:50.609020 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3552/7086] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:23:50.750348 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2fc31ff7-fef5-45e5-97b8-ef7dc7124083 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780aa7b07e3f45a588ce2219d027a036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf01bce203a54dfb94b67e08e3e1440c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:50.758034 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2fc31ff7-fef5-45e5-97b8-ef7dc7124083 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296" status: 200 len: 1360 microversion: 2.1 time: 0.192353 Jul 18 03:23:50.758644 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3535/7087] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:50 2022] GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296 => generated 1360 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:51.775283 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b80398de-51db-466a-9291-06d0756edab5 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:51.775986 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b80398de-51db-466a-9291-06d0756edab5 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: a5743af7-4638-4451-8633-e52454bb8296] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:51.783302 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b80398de-51db-466a-9291-06d0756edab5 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:51.783769 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b80398de-51db-466a-9291-06d0756edab5 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:51.784572 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b80398de-51db-466a-9291-06d0756edab5 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:51.785021 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b80398de-51db-466a-9291-06d0756edab5 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:51.924486 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b80398de-51db-466a-9291-06d0756edab5 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780aa7b07e3f45a588ce2219d027a036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf01bce203a54dfb94b67e08e3e1440c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:51.932006 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b80398de-51db-466a-9291-06d0756edab5 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296" status: 200 len: 1360 microversion: 2.1 time: 0.161197 Jul 18 03:23:51.932580 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3553/7088] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:51 2022] GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296 => generated 1360 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:52.949548 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-39e61135-0ff3-4c6b-888f-5063fc7838bb tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:52.950221 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-39e61135-0ff3-4c6b-888f-5063fc7838bb tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: a5743af7-4638-4451-8633-e52454bb8296] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:52.953079 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:23:52.958565 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-39e61135-0ff3-4c6b-888f-5063fc7838bb tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:52.959017 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-39e61135-0ff3-4c6b-888f-5063fc7838bb tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:52.959787 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-39e61135-0ff3-4c6b-888f-5063fc7838bb tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:52.960220 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-39e61135-0ff3-4c6b-888f-5063fc7838bb tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:53.092279 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-39e61135-0ff3-4c6b-888f-5063fc7838bb tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780aa7b07e3f45a588ce2219d027a036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf01bce203a54dfb94b67e08e3e1440c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:53.101340 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-39e61135-0ff3-4c6b-888f-5063fc7838bb tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296" status: 200 len: 1552 microversion: 2.1 time: 0.155836 Jul 18 03:23:53.101965 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3536/7089] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:52 2022] GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296 => generated 1552 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:53.117274 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fdd0efe0-209c-48a8-8cd6-4f5af6590288 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:53.117932 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fdd0efe0-209c-48a8-8cd6-4f5af6590288 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: a5743af7-4638-4451-8633-e52454bb8296] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:53.119926 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:23:53.120603 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:23:53.128331 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fdd0efe0-209c-48a8-8cd6-4f5af6590288 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:53.128982 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fdd0efe0-209c-48a8-8cd6-4f5af6590288 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:53.129837 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fdd0efe0-209c-48a8-8cd6-4f5af6590288 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:53.130298 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fdd0efe0-209c-48a8-8cd6-4f5af6590288 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:53.258685 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fdd0efe0-209c-48a8-8cd6-4f5af6590288 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780aa7b07e3f45a588ce2219d027a036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf01bce203a54dfb94b67e08e3e1440c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:53.266469 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fdd0efe0-209c-48a8-8cd6-4f5af6590288 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296" status: 200 len: 1552 microversion: 2.1 time: 0.153004 Jul 18 03:23:53.267052 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3554/7090] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:53 2022] GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296 => generated 1552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:54.740663 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4dbd0930-ba9a-40ef-95bc-3a0a378ffa51 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa5d6910-df73-4d2b-89cf-2b04625e4c0a"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:23:54.741863 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4dbd0930-ba9a-40ef-95bc-3a0a378ffa51 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: a5743af7-4638-4451-8633-e52454bb8296] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:54.748893 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4dbd0930-ba9a-40ef-95bc-3a0a378ffa51 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:54.749351 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4dbd0930-ba9a-40ef-95bc-3a0a378ffa51 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:54.750158 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4dbd0930-ba9a-40ef-95bc-3a0a378ffa51 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:54.750607 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4dbd0930-ba9a-40ef-95bc-3a0a378ffa51 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:55.007999 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4dbd0930-ba9a-40ef-95bc-3a0a378ffa51 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "POST /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271743 Jul 18 03:23:55.008640 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3537/7091] 10.222.0.57 () {60 vars in 1322 bytes} [Mon Jul 18 03:23:54 2022] POST /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:24:06.740769 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-20684925-f8e1-4797-838a-cd652b32303b tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:06.741326 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-20684925-f8e1-4797-838a-cd652b32303b tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: a5743af7-4638-4451-8633-e52454bb8296] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:06.743993 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:24:06.744782 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:24:06.751083 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20684925-f8e1-4797-838a-cd652b32303b tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:06.751550 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20684925-f8e1-4797-838a-cd652b32303b tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:06.752340 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20684925-f8e1-4797-838a-cd652b32303b tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:06.752799 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20684925-f8e1-4797-838a-cd652b32303b tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:06.836122 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-20684925-f8e1-4797-838a-cd652b32303b tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lazy-loading 'services' on Instance uuid a5743af7-4638-4451-8633-e52454bb8296 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:24:06.910766 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-20684925-f8e1-4797-838a-cd652b32303b tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296/os-volume_attachments/fa5d6910-df73-4d2b-89cf-2b04625e4c0a" status: 202 len: 0 microversion: 2.1 time: 0.173693 Jul 18 03:24:06.911415 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3555/7092] 10.222.0.57 () {58 vars in 1415 bytes} [Mon Jul 18 03:24:06 2022] DELETE /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296/os-volume_attachments/fa5d6910-df73-4d2b-89cf-2b04625e4c0a => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:24:06.918274 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:24:06.919047 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:24:06.924910 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c77f2314-bc27-487a-b44e-b205b6a662a2 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:06.926776 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c77f2314-bc27-487a-b44e-b205b6a662a2 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: a5743af7-4638-4451-8633-e52454bb8296] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:06.934276 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c77f2314-bc27-487a-b44e-b205b6a662a2 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:06.934873 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c77f2314-bc27-487a-b44e-b205b6a662a2 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:06.935844 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c77f2314-bc27-487a-b44e-b205b6a662a2 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:06.936255 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c77f2314-bc27-487a-b44e-b205b6a662a2 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:06.975429 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c77f2314-bc27-487a-b44e-b205b6a662a2 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059343 Jul 18 03:24:06.976029 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3538/7093] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 03:24:06 2022] GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:24:07.990674 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-71e724cf-929d-4630-8a7c-702b36fae344 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:07.990674 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-71e724cf-929d-4630-8a7c-702b36fae344 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: a5743af7-4638-4451-8633-e52454bb8296] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:07.997204 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-71e724cf-929d-4630-8a7c-702b36fae344 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:07.997675 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-71e724cf-929d-4630-8a7c-702b36fae344 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:07.998772 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-71e724cf-929d-4630-8a7c-702b36fae344 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:07.999227 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-71e724cf-929d-4630-8a7c-702b36fae344 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:08.031356 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-71e724cf-929d-4630-8a7c-702b36fae344 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047919 Jul 18 03:24:08.031956 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3556/7094] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 03:24:07 2022] GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:24:09.043511 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ce2d8a17-fceb-4b5c-80a4-221469787711 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:09.044466 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ce2d8a17-fceb-4b5c-80a4-221469787711 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: a5743af7-4638-4451-8633-e52454bb8296] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:09.052747 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ce2d8a17-fceb-4b5c-80a4-221469787711 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:09.053208 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ce2d8a17-fceb-4b5c-80a4-221469787711 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:09.054039 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ce2d8a17-fceb-4b5c-80a4-221469787711 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:09.054481 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ce2d8a17-fceb-4b5c-80a4-221469787711 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:09.086437 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ce2d8a17-fceb-4b5c-80a4-221469787711 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046896 Jul 18 03:24:09.087290 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3539/7095] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 03:24:09 2022] GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:24:10.098749 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4b26aef6-02cc-4f93-aef8-5365d6d8fdac tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:10.099732 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4b26aef6-02cc-4f93-aef8-5365d6d8fdac tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: a5743af7-4638-4451-8633-e52454bb8296] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:10.106895 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4b26aef6-02cc-4f93-aef8-5365d6d8fdac tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:10.107362 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4b26aef6-02cc-4f93-aef8-5365d6d8fdac tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:10.108157 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4b26aef6-02cc-4f93-aef8-5365d6d8fdac tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:10.108642 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4b26aef6-02cc-4f93-aef8-5365d6d8fdac tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:10.139917 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4b26aef6-02cc-4f93-aef8-5365d6d8fdac tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046004 Jul 18 03:24:10.140496 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3557/7096] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 03:24:10 2022] GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:24:11.151900 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-daffb749-43de-4410-aeb5-793e87a48733 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:11.152829 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-daffb749-43de-4410-aeb5-793e87a48733 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: a5743af7-4638-4451-8633-e52454bb8296] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:11.159853 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-daffb749-43de-4410-aeb5-793e87a48733 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:11.160333 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-daffb749-43de-4410-aeb5-793e87a48733 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:11.161113 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-daffb749-43de-4410-aeb5-793e87a48733 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:11.161550 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-daffb749-43de-4410-aeb5-793e87a48733 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:11.194486 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-daffb749-43de-4410-aeb5-793e87a48733 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046629 Jul 18 03:24:11.195082 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3540/7097] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 03:24:11 2022] GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:24:12.206698 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-47054a81-8418-4256-a226-b806d6d591cc tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:12.207693 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-47054a81-8418-4256-a226-b806d6d591cc tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: a5743af7-4638-4451-8633-e52454bb8296] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:12.215617 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-47054a81-8418-4256-a226-b806d6d591cc tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:12.216084 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-47054a81-8418-4256-a226-b806d6d591cc tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:12.216881 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-47054a81-8418-4256-a226-b806d6d591cc tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:12.217329 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-47054a81-8418-4256-a226-b806d6d591cc tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:12.250547 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-47054a81-8418-4256-a226-b806d6d591cc tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047817 Jul 18 03:24:12.251157 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3558/7098] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 03:24:12 2022] GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 03:24:12.261828 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-261fe9f8-e671-4201-a469-a453c926bdb4 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:12.262337 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-261fe9f8-e671-4201-a469-a453c926bdb4 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: a5743af7-4638-4451-8633-e52454bb8296] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:12.269139 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-261fe9f8-e671-4201-a469-a453c926bdb4 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:12.269759 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-261fe9f8-e671-4201-a469-a453c926bdb4 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:12.270528 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-261fe9f8-e671-4201-a469-a453c926bdb4 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:12.270959 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-261fe9f8-e671-4201-a469-a453c926bdb4 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:12.349029 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-261fe9f8-e671-4201-a469-a453c926bdb4 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] HTTP exception thrown: Instance a5743af7-4638-4451-8633-e52454bb8296 is not attached to volume fa5d6910-df73-4d2b-89cf-2b04625e4c0a Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-261fe9f8-e671-4201-a469-a453c926bdb4 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Request method failure captured: Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296/os-volume_attachments/fa5d6910-df73-4d2b-89cf-2b04625e4c0a HTTP/1.1 Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1NIOIQVeR9UBcYNurKNhcihPriYRr9PNvOqf4pomxvkzH97krhitgzHp_gmlBWhXTYYrHlinwGaKQs-hbRE2CWKGuKXD3Ecwwm_ybXOMGdDR6qJAX3Gx9mJEGhiwUB20cARYxRxNzSDQFo23Fx_pqTNi5ecxUYo0q3MkePOgFxyZQqk Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: bf01bce203a54dfb94b67e08e3e1440c Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1404995367 Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_bf01bce203a54dfb94b67e08e3e1440c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bf01bce203a54dfb94b67e08e3e1440c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bf01bce203a54dfb94b67e08e3e1440c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/bf01bce203a54dfb94b67e08e3e1440c"}]}] Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-TestEncryptedCinderVolumes-1404995367 Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: bf01bce203a54dfb94b67e08e3e1440c Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1404995367 Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-TestEncryptedCinderVolumes-1404995367-project Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 780aa7b07e3f45a588ce2219d027a036 Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-TestEncryptedCinderVolumes-1404995367-project Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance a5743af7-4638-4451-8633-e52454bb8296 is not attached to volume fa5d6910-df73-4d2b-89cf-2b04625e4c0a Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'server_id': 'a5743af7-4638-4451-8633-e52454bb8296', 'id': 'fa5d6910-df73-4d2b-89cf-2b04625e4c0a'} Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id fa5d6910-df73-4d2b-89cf-2b04625e4c0a. Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5743af7-4638-4451-8633-e52454bb8296 is not attached to volume fa5d6910-df73-4d2b-89cf-2b04625e4c0a Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:24:12.350677 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:24:12.354576 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:24:12.354576 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:24:12.354576 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5743af7-4638-4451-8633-e52454bb8296 is not attached to volume fa5d6910-df73-4d2b-89cf-2b04625e4c0a Jul 18 03:24:12.354576 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:24:12.354576 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-261fe9f8-e671-4201-a469-a453c926bdb4 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Returning 404 to user: Instance a5743af7-4638-4451-8633-e52454bb8296 is not attached to volume fa5d6910-df73-4d2b-89cf-2b04625e4c0a {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:24:12.354576 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-261fe9f8-e671-4201-a469-a453c926bdb4 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296/os-volume_attachments/fa5d6910-df73-4d2b-89cf-2b04625e4c0a" status: 404 len: 154 microversion: 2.1 time: 0.094310 Jul 18 03:24:12.354576 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3541/7099] 10.222.0.57 () {58 vars in 1415 bytes} [Mon Jul 18 03:24:12 2022] DELETE /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296/os-volume_attachments/fa5d6910-df73-4d2b-89cf-2b04625e4c0a => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:24:15.705870 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bc726068-a5ce-4f93-86ea-84da43476c55 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:15.707384 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bc726068-a5ce-4f93-86ea-84da43476c55 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: a5743af7-4638-4451-8633-e52454bb8296] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:15.717230 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bc726068-a5ce-4f93-86ea-84da43476c55 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:15.717739 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bc726068-a5ce-4f93-86ea-84da43476c55 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:15.718544 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bc726068-a5ce-4f93-86ea-84da43476c55 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:15.719002 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bc726068-a5ce-4f93-86ea-84da43476c55 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:15.749494 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bc726068-a5ce-4f93-86ea-84da43476c55 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: a5743af7-4638-4451-8633-e52454bb8296] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:24:15.846497 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bc726068-a5ce-4f93-86ea-84da43476c55 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296" status: 204 len: 0 microversion: 2.1 time: 0.147883 Jul 18 03:24:15.848184 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3559/7100] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:24:15 2022] DELETE /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:24:15.857310 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9c837798-a45e-49ba-9614-d31e540d472a tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:15.858197 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9c837798-a45e-49ba-9614-d31e540d472a tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: a5743af7-4638-4451-8633-e52454bb8296] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:15.866644 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9c837798-a45e-49ba-9614-d31e540d472a tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:15.867212 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9c837798-a45e-49ba-9614-d31e540d472a tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:15.868037 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9c837798-a45e-49ba-9614-d31e540d472a tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:15.868477 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9c837798-a45e-49ba-9614-d31e540d472a tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:16.013483 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9c837798-a45e-49ba-9614-d31e540d472a tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780aa7b07e3f45a588ce2219d027a036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf01bce203a54dfb94b67e08e3e1440c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:16.024412 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9c837798-a45e-49ba-9614-d31e540d472a tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296" status: 200 len: 1558 microversion: 2.1 time: 0.171159 Jul 18 03:24:16.024998 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3542/7101] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:15 2022] GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296 => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:24:17.042462 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-75391a7b-2639-47b2-aa84-3526043ebd6b tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:17.043175 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-75391a7b-2639-47b2-aa84-3526043ebd6b tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: a5743af7-4638-4451-8633-e52454bb8296] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:17.050629 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-75391a7b-2639-47b2-aa84-3526043ebd6b tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:17.051014 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-75391a7b-2639-47b2-aa84-3526043ebd6b tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:17.051819 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-75391a7b-2639-47b2-aa84-3526043ebd6b tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:17.052265 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-75391a7b-2639-47b2-aa84-3526043ebd6b tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:17.185745 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-75391a7b-2639-47b2-aa84-3526043ebd6b tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780aa7b07e3f45a588ce2219d027a036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf01bce203a54dfb94b67e08e3e1440c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:17.194261 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-75391a7b-2639-47b2-aa84-3526043ebd6b tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296" status: 200 len: 1558 microversion: 2.1 time: 0.156086 Jul 18 03:24:17.194863 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3560/7102] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:17 2022] GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:18.055935 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-435bc511-cdc0-4473-805e-7f46b877377e req-db18e1a2-3c82-48b0-85f8-60275fb6ba8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5743af7-4638-4451-8633-e52454bb8296", "name": "network-vif-deleted", "tag": "216669b1-efaf-40ef-87b5-4c7ef7c764a4"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:24:18.065850 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-435bc511-cdc0-4473-805e-7f46b877377e req-db18e1a2-3c82-48b0-85f8-60275fb6ba8a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:18.066843 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-435bc511-cdc0-4473-805e-7f46b877377e req-db18e1a2-3c82-48b0-85f8-60275fb6ba8a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:18.081836 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-435bc511-cdc0-4473-805e-7f46b877377e req-db18e1a2-3c82-48b0-85f8-60275fb6ba8a service nova] Creating event network-vif-deleted:216669b1-efaf-40ef-87b5-4c7ef7c764a4 for instance a5743af7-4638-4451-8633-e52454bb8296 on n-h1-465891-3 Jul 18 03:24:18.090012 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-435bc511-cdc0-4473-805e-7f46b877377e req-db18e1a2-3c82-48b0-85f8-60275fb6ba8a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037408 Jul 18 03:24:18.090796 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3543/7103] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:24:18.212331 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3dc9cf1d-a8aa-4d14-90e1-2b8208537f21 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:18.212969 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3dc9cf1d-a8aa-4d14-90e1-2b8208537f21 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: a5743af7-4638-4451-8633-e52454bb8296] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:18.220734 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3dc9cf1d-a8aa-4d14-90e1-2b8208537f21 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:18.220734 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3dc9cf1d-a8aa-4d14-90e1-2b8208537f21 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:18.221288 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3dc9cf1d-a8aa-4d14-90e1-2b8208537f21 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:18.222386 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3dc9cf1d-a8aa-4d14-90e1-2b8208537f21 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:18.255363 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3dc9cf1d-a8aa-4d14-90e1-2b8208537f21 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:18.255743 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3dc9cf1d-a8aa-4d14-90e1-2b8208537f21 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:18.256205 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-3dc9cf1d-a8aa-4d14-90e1-2b8208537f21 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lazy-loading 'fault' on Instance uuid a5743af7-4638-4451-8633-e52454bb8296 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:24:18.298953 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3dc9cf1d-a8aa-4d14-90e1-2b8208537f21 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780aa7b07e3f45a588ce2219d027a036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf01bce203a54dfb94b67e08e3e1440c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:18.306907 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3dc9cf1d-a8aa-4d14-90e1-2b8208537f21 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296" status: 200 len: 1350 microversion: 2.1 time: 0.098528 Jul 18 03:24:18.307511 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3561/7104] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:18 2022] GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296 => generated 1350 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:19.325623 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8a3a2b0e-a93e-4521-9c16-234fc692bfe1 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:19.326360 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8a3a2b0e-a93e-4521-9c16-234fc692bfe1 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] [instance: a5743af7-4638-4451-8633-e52454bb8296] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:19.332873 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a3a2b0e-a93e-4521-9c16-234fc692bfe1 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:19.333327 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a3a2b0e-a93e-4521-9c16-234fc692bfe1 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:19.334126 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a3a2b0e-a93e-4521-9c16-234fc692bfe1 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:19.334573 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8a3a2b0e-a93e-4521-9c16-234fc692bfe1 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:19.348688 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-8a3a2b0e-a93e-4521-9c16-234fc692bfe1 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] HTTP exception thrown: Instance a5743af7-4638-4451-8633-e52454bb8296 could not be found. Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8a3a2b0e-a93e-4521-9c16-234fc692bfe1 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Request method failure captured: Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296 HTTP/1.1 Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1NIOIQVeR9UBcYNurKNhcihPriYRr9PNvOqf4pomxvkzH97krhitgzHp_gmlBWhXTYYrHlinwGaKQs-hbRE2CWKGuKXD3Ecwwm_ybXOMGdDR6qJAX3Gx9mJEGhiwUB20cARYxRxNzSDQFo23Fx_pqTNi5ecxUYo0q3MkePOgFxyZQqk Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: bf01bce203a54dfb94b67e08e3e1440c Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1404995367 Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_bf01bce203a54dfb94b67e08e3e1440c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bf01bce203a54dfb94b67e08e3e1440c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bf01bce203a54dfb94b67e08e3e1440c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/bf01bce203a54dfb94b67e08e3e1440c"}]}] Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-TestEncryptedCinderVolumes-1404995367 Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: bf01bce203a54dfb94b67e08e3e1440c Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1404995367 Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-TestEncryptedCinderVolumes-1404995367-project Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 780aa7b07e3f45a588ce2219d027a036 Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-TestEncryptedCinderVolumes-1404995367-project Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance a5743af7-4638-4451-8633-e52454bb8296 could not be found. Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'a5743af7-4638-4451-8633-e52454bb8296'} Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5743af7-4638-4451-8633-e52454bb8296 could not be found. Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5743af7-4638-4451-8633-e52454bb8296 could not be found. Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:24:19.350372 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:24:19.354534 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:24:19.354534 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:24:19.354534 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:24:19.354534 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:24:19.354534 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:24:19.354534 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5743af7-4638-4451-8633-e52454bb8296 could not be found. Jul 18 03:24:19.354534 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:24:19.354534 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8a3a2b0e-a93e-4521-9c16-234fc692bfe1 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Returning 404 to user: Instance a5743af7-4638-4451-8633-e52454bb8296 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:24:19.354534 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8a3a2b0e-a93e-4521-9c16-234fc692bfe1 tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296" status: 404 len: 111 microversion: 2.1 time: 0.031292 Jul 18 03:24:19.354534 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3544/7105] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:19 2022] GET /compute/v2.1/servers/a5743af7-4638-4451-8633-e52454bb8296 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:24:19.360522 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6cfa94de-c9e0-455e-8330-2e17b1c5560d tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] Calling method '.version_select at 0x7ff49b5f0670>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:19.381866 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6cfa94de-c9e0-455e-8330-2e17b1c5560d tempest-TestEncryptedCinderVolumes-1404995367 tempest-TestEncryptedCinderVolumes-1404995367-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-14080464" status: 202 len: 0 microversion: 2.1 time: 0.025055 Jul 18 03:24:19.382457 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3562/7106] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 03:24:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-14080464 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:24:48.672300 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2918e55a-39db-4705-a74b-210a4bb46a66 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Action: 'create', calling method: .version_select at 0x7ff4a8376d30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1855412318", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDesb51FJlXjt+DrDj8bDsNDOzpPrx+RhiDIAuId7PZ3/Ny91tlzeaKARKjR7HH+WCi7HofG9l57KGOaHk687kyBlEokJKAObsMzxnoFi06so++J60Pn/JjDNq/ghpVI1Q=="}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:24:48.677100 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=14 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:24:48.677776 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=34 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:24:48.690220 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-2918e55a-39db-4705-a74b-210a4bb46a66 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Getting quotas for project f4b72a832ce748028e574fc91b4dae21. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:24:48.697071 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-2918e55a-39db-4705-a74b-210a4bb46a66 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Getting quotas for user a0d6e0c353ca47939c9ba0da92794704 and project f4b72a832ce748028e574fc91b4dae21. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:24:48.721622 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2918e55a-39db-4705-a74b-210a4bb46a66 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.053255 Jul 18 03:24:48.722827 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3545/7107] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 03:24:48 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:24:48.774277 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:24:48.775112 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:24:48.779564 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cf23b6c0-89bf-48de-99b5-79611953cc60 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-250330283", "imageRef": "bf0d2ea4-869a-4f88-af3b-eff351457c31", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1855412318", "networks": [{"uuid": "f4beb76a-8db1-4e57-aa47-b084828f17cb"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:24:48.838060 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-cf23b6c0-89bf-48de-99b5-79611953cc60 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] validate_networks() for [('f4beb76a-8db1-4e57-aa47-b084828f17cb', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:24:49.245470 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-cf23b6c0-89bf-48de-99b5-79611953cc60 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:24:49.245972 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-cf23b6c0-89bf-48de-99b5-79611953cc60 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:24:49.246461 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-cf23b6c0-89bf-48de-99b5-79611953cc60 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:24:49.246880 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-cf23b6c0-89bf-48de-99b5-79611953cc60 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:24:49.247330 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-cf23b6c0-89bf-48de-99b5-79611953cc60 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:24:49.257781 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cf23b6c0-89bf-48de-99b5-79611953cc60 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:49.258240 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cf23b6c0-89bf-48de-99b5-79611953cc60 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:49.259049 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cf23b6c0-89bf-48de-99b5-79611953cc60 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:49.259498 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cf23b6c0-89bf-48de-99b5-79611953cc60 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:49.277103 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-cf23b6c0-89bf-48de-99b5-79611953cc60 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Getting quotas for project f4b72a832ce748028e574fc91b4dae21. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:24:49.282883 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-cf23b6c0-89bf-48de-99b5-79611953cc60 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Getting quotas for user a0d6e0c353ca47939c9ba0da92794704 and project f4b72a832ce748028e574fc91b4dae21. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:24:49.296445 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cf23b6c0-89bf-48de-99b5-79611953cc60 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:24:49.299170 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cf23b6c0-89bf-48de-99b5-79611953cc60 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf0d2ea4-869a-4f88-af3b-eff351457c31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:24:49.345781 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cf23b6c0-89bf-48de-99b5-79611953cc60 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.573370 Jul 18 03:24:49.346826 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3563/7108] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:24:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:24:49.357686 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e781e932-7fe3-4c97-9eeb-d4aa69af2c98 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:49.358345 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e781e932-7fe3-4c97-9eeb-d4aa69af2c98 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:49.424104 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e781e932-7fe3-4c97-9eeb-d4aa69af2c98 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:49.436992 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e781e932-7fe3-4c97-9eeb-d4aa69af2c98 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b" status: 200 len: 1258 microversion: 2.1 time: 0.082855 Jul 18 03:24:49.440699 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3546/7109] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:49 2022] GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b => generated 1258 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:50.464070 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1a36143e-5dbe-4cd7-8368-5ccee8d755be tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:50.464715 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1a36143e-5dbe-4cd7-8368-5ccee8d755be tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:50.472056 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1a36143e-5dbe-4cd7-8368-5ccee8d755be tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:50.472522 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1a36143e-5dbe-4cd7-8368-5ccee8d755be tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:50.473325 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1a36143e-5dbe-4cd7-8368-5ccee8d755be tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:50.473814 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1a36143e-5dbe-4cd7-8368-5ccee8d755be tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:50.561094 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1a36143e-5dbe-4cd7-8368-5ccee8d755be tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:50.572175 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1a36143e-5dbe-4cd7-8368-5ccee8d755be tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b" status: 200 len: 1310 microversion: 2.1 time: 0.112712 Jul 18 03:24:50.572768 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3564/7110] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:50 2022] GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b => generated 1310 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:51.590329 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-33347668-f0af-4727-867f-8d34d8a258ef tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:51.590997 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-33347668-f0af-4727-867f-8d34d8a258ef tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:51.599713 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-33347668-f0af-4727-867f-8d34d8a258ef tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:51.600290 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-33347668-f0af-4727-867f-8d34d8a258ef tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:51.601289 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-33347668-f0af-4727-867f-8d34d8a258ef tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:51.602038 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-33347668-f0af-4727-867f-8d34d8a258ef tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:51.794198 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-33347668-f0af-4727-867f-8d34d8a258ef tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:51.806843 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-33347668-f0af-4727-867f-8d34d8a258ef tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b" status: 200 len: 1358 microversion: 2.1 time: 0.220454 Jul 18 03:24:51.808309 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3547/7111] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:51 2022] GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b => generated 1358 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:52.829764 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a6dd7d50-6806-418d-95ff-c7528d01e961 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:52.830391 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a6dd7d50-6806-418d-95ff-c7528d01e961 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:52.837645 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a6dd7d50-6806-418d-95ff-c7528d01e961 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:52.838131 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a6dd7d50-6806-418d-95ff-c7528d01e961 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:52.838938 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a6dd7d50-6806-418d-95ff-c7528d01e961 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:52.839384 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a6dd7d50-6806-418d-95ff-c7528d01e961 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:53.004117 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a6dd7d50-6806-418d-95ff-c7528d01e961 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:53.014557 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a6dd7d50-6806-418d-95ff-c7528d01e961 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b" status: 200 len: 1358 microversion: 2.1 time: 0.188597 Jul 18 03:24:53.016444 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3565/7112] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:52 2022] GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:54.032675 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c644f91c-cbc7-4fa5-bd5c-03294a6cfe51 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:54.034079 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c644f91c-cbc7-4fa5-bd5c-03294a6cfe51 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:54.042303 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c644f91c-cbc7-4fa5-bd5c-03294a6cfe51 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:54.042844 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c644f91c-cbc7-4fa5-bd5c-03294a6cfe51 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:54.043634 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c644f91c-cbc7-4fa5-bd5c-03294a6cfe51 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:54.044074 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c644f91c-cbc7-4fa5-bd5c-03294a6cfe51 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:54.177798 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c644f91c-cbc7-4fa5-bd5c-03294a6cfe51 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:54.185290 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c644f91c-cbc7-4fa5-bd5c-03294a6cfe51 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b" status: 200 len: 1358 microversion: 2.1 time: 0.156563 Jul 18 03:24:54.185894 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3548/7113] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:54 2022] GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:55.202725 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bd295089-c5a2-4916-a304-ba4f43df91f9 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:55.203296 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bd295089-c5a2-4916-a304-ba4f43df91f9 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:55.211764 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bd295089-c5a2-4916-a304-ba4f43df91f9 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:55.212336 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bd295089-c5a2-4916-a304-ba4f43df91f9 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:55.213156 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bd295089-c5a2-4916-a304-ba4f43df91f9 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:55.213610 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bd295089-c5a2-4916-a304-ba4f43df91f9 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:55.351487 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bd295089-c5a2-4916-a304-ba4f43df91f9 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:55.359553 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bd295089-c5a2-4916-a304-ba4f43df91f9 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b" status: 200 len: 1358 microversion: 2.1 time: 0.160879 Jul 18 03:24:55.360147 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3566/7114] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:55 2022] GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:56.382346 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-abc77d04-a970-4e14-946c-034a6bb4d0a8 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:56.383932 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-abc77d04-a970-4e14-946c-034a6bb4d0a8 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:56.394020 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-abc77d04-a970-4e14-946c-034a6bb4d0a8 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:56.394476 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-abc77d04-a970-4e14-946c-034a6bb4d0a8 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:56.395944 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-abc77d04-a970-4e14-946c-034a6bb4d0a8 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:56.396425 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-abc77d04-a970-4e14-946c-034a6bb4d0a8 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:56.559763 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-abc77d04-a970-4e14-946c-034a6bb4d0a8 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:56.570250 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-abc77d04-a970-4e14-946c-034a6bb4d0a8 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b" status: 200 len: 1358 microversion: 2.1 time: 0.197079 Jul 18 03:24:56.573790 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3549/7115] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:56 2022] GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:57.588600 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c7bf3130-7dc2-495b-8044-6439ae37ffbd tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:57.589510 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c7bf3130-7dc2-495b-8044-6439ae37ffbd tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:57.596721 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c7bf3130-7dc2-495b-8044-6439ae37ffbd tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:57.597185 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c7bf3130-7dc2-495b-8044-6439ae37ffbd tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:57.599209 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c7bf3130-7dc2-495b-8044-6439ae37ffbd tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:57.600106 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c7bf3130-7dc2-495b-8044-6439ae37ffbd tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:58.076207 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c7bf3130-7dc2-495b-8044-6439ae37ffbd tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:58.086030 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c7bf3130-7dc2-495b-8044-6439ae37ffbd tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b" status: 200 len: 1358 microversion: 2.1 time: 0.501084 Jul 18 03:24:58.095349 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3567/7116] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:57 2022] GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b => generated 1358 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:59.105168 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-49e37d54-8bb4-43a6-8b10-4fd0a5dfd9ca tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:59.105853 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-49e37d54-8bb4-43a6-8b10-4fd0a5dfd9ca tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:59.115854 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-49e37d54-8bb4-43a6-8b10-4fd0a5dfd9ca tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:59.115854 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-49e37d54-8bb4-43a6-8b10-4fd0a5dfd9ca tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:59.116389 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-49e37d54-8bb4-43a6-8b10-4fd0a5dfd9ca tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:59.116845 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-49e37d54-8bb4-43a6-8b10-4fd0a5dfd9ca tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:59.268109 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-49e37d54-8bb4-43a6-8b10-4fd0a5dfd9ca tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:59.276000 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-49e37d54-8bb4-43a6-8b10-4fd0a5dfd9ca tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b" status: 200 len: 1358 microversion: 2.1 time: 0.174819 Jul 18 03:24:59.276577 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3550/7117] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:59 2022] GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:00.293323 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-45980f3d-a0a3-4619-bff1-a6cd71a4c9dd tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:00.293911 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-45980f3d-a0a3-4619-bff1-a6cd71a4c9dd tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:00.296679 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:25:00.297391 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:25:00.304612 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-45980f3d-a0a3-4619-bff1-a6cd71a4c9dd tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:00.305103 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-45980f3d-a0a3-4619-bff1-a6cd71a4c9dd tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:00.305992 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-45980f3d-a0a3-4619-bff1-a6cd71a4c9dd tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:00.306444 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-45980f3d-a0a3-4619-bff1-a6cd71a4c9dd tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:00.444438 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-45980f3d-a0a3-4619-bff1-a6cd71a4c9dd tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:00.451967 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-45980f3d-a0a3-4619-bff1-a6cd71a4c9dd tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b" status: 200 len: 1358 microversion: 2.1 time: 0.162695 Jul 18 03:25:00.452539 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3568/7118] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:00 2022] GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:01.468864 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a1bc7fb6-9fa9-4f12-a66c-28fc7df676fe tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:01.469585 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a1bc7fb6-9fa9-4f12-a66c-28fc7df676fe tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:01.471542 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:25:01.478186 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a1bc7fb6-9fa9-4f12-a66c-28fc7df676fe tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:01.478637 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a1bc7fb6-9fa9-4f12-a66c-28fc7df676fe tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:01.479426 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a1bc7fb6-9fa9-4f12-a66c-28fc7df676fe tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:01.479868 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a1bc7fb6-9fa9-4f12-a66c-28fc7df676fe tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:01.614990 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a1bc7fb6-9fa9-4f12-a66c-28fc7df676fe tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:01.622570 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a1bc7fb6-9fa9-4f12-a66c-28fc7df676fe tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b" status: 200 len: 1358 microversion: 2.1 time: 0.158145 Jul 18 03:25:01.623158 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3551/7119] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:01 2022] GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:02.640403 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d16f6dcb-73f9-4f7c-a720-a5d926f14022 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:02.641034 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d16f6dcb-73f9-4f7c-a720-a5d926f14022 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:02.649204 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d16f6dcb-73f9-4f7c-a720-a5d926f14022 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:02.649671 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d16f6dcb-73f9-4f7c-a720-a5d926f14022 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:02.650496 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d16f6dcb-73f9-4f7c-a720-a5d926f14022 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:02.650951 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d16f6dcb-73f9-4f7c-a720-a5d926f14022 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:02.792197 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d16f6dcb-73f9-4f7c-a720-a5d926f14022 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:02.799911 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d16f6dcb-73f9-4f7c-a720-a5d926f14022 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b" status: 200 len: 1358 microversion: 2.1 time: 0.163591 Jul 18 03:25:02.800497 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3569/7120] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:02 2022] GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:25:03.547664 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-2cc91aea-7c0c-416d-9061-c3d96ead3567 req-38f6bb89-c511-4491-bbe4-da093621f76e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0244b9e-0e23-4289-91dd-2c0eb793677b", "tag": "9fdc8798-aa35-4b51-a765-b26a40104819"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:25:03.556966 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-2cc91aea-7c0c-416d-9061-c3d96ead3567 req-38f6bb89-c511-4491-bbe4-da093621f76e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:03.557628 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-2cc91aea-7c0c-416d-9061-c3d96ead3567 req-38f6bb89-c511-4491-bbe4-da093621f76e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:03.571758 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-2cc91aea-7c0c-416d-9061-c3d96ead3567 req-38f6bb89-c511-4491-bbe4-da093621f76e service nova] Creating event network-changed:9fdc8798-aa35-4b51-a765-b26a40104819 for instance e0244b9e-0e23-4289-91dd-2c0eb793677b on n-h1-465891-3 Jul 18 03:25:03.577100 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-2cc91aea-7c0c-416d-9061-c3d96ead3567 req-38f6bb89-c511-4491-bbe4-da093621f76e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035277 Jul 18 03:25:03.577974 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3552/7121] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:25:03.818430 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1c8f9024-8e24-4f8e-b7c3-6a50ac11d12d tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:03.819124 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1c8f9024-8e24-4f8e-b7c3-6a50ac11d12d tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:03.826427 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c8f9024-8e24-4f8e-b7c3-6a50ac11d12d tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:03.827001 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c8f9024-8e24-4f8e-b7c3-6a50ac11d12d tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:03.827879 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c8f9024-8e24-4f8e-b7c3-6a50ac11d12d tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:03.828408 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c8f9024-8e24-4f8e-b7c3-6a50ac11d12d tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:04.048913 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1c8f9024-8e24-4f8e-b7c3-6a50ac11d12d tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:04.057381 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1c8f9024-8e24-4f8e-b7c3-6a50ac11d12d tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b" status: 200 len: 1358 microversion: 2.1 time: 0.243909 Jul 18 03:25:04.058194 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3570/7122] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:03 2022] GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b => generated 1358 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:05.075929 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e1cbb585-0f72-4452-882a-789668abdf27 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:05.076921 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e1cbb585-0f72-4452-882a-789668abdf27 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:05.084215 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e1cbb585-0f72-4452-882a-789668abdf27 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:05.084667 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e1cbb585-0f72-4452-882a-789668abdf27 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:05.085540 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e1cbb585-0f72-4452-882a-789668abdf27 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:05.086024 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e1cbb585-0f72-4452-882a-789668abdf27 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:05.227044 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e1cbb585-0f72-4452-882a-789668abdf27 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:05.234604 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e1cbb585-0f72-4452-882a-789668abdf27 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b" status: 200 len: 1358 microversion: 2.1 time: 0.163829 Jul 18 03:25:05.235177 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3553/7123] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:05 2022] GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:06.253931 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-066764df-b110-43ed-a239-f864735ed6c3 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:06.254623 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-066764df-b110-43ed-a239-f864735ed6c3 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:06.262455 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-066764df-b110-43ed-a239-f864735ed6c3 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:06.262913 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-066764df-b110-43ed-a239-f864735ed6c3 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:06.263705 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-066764df-b110-43ed-a239-f864735ed6c3 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:06.264151 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-066764df-b110-43ed-a239-f864735ed6c3 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:06.403112 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-066764df-b110-43ed-a239-f864735ed6c3 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:06.411151 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-066764df-b110-43ed-a239-f864735ed6c3 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b" status: 200 len: 1358 microversion: 2.1 time: 0.161400 Jul 18 03:25:06.412347 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3571/7124] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:06 2022] GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:07.429527 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c0577875-d389-4bed-b1ae-f9826cf0ed98 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:07.430174 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c0577875-d389-4bed-b1ae-f9826cf0ed98 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:07.437129 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c0577875-d389-4bed-b1ae-f9826cf0ed98 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:07.437580 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c0577875-d389-4bed-b1ae-f9826cf0ed98 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:07.438387 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c0577875-d389-4bed-b1ae-f9826cf0ed98 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:07.438830 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c0577875-d389-4bed-b1ae-f9826cf0ed98 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:07.577195 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c0577875-d389-4bed-b1ae-f9826cf0ed98 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:07.587004 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c0577875-d389-4bed-b1ae-f9826cf0ed98 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b" status: 200 len: 1358 microversion: 2.1 time: 0.162168 Jul 18 03:25:07.587753 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3554/7125] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:07 2022] GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:08.604239 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4dd46261-de42-49a6-86aa-3153e01c0e4d tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:08.604902 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4dd46261-de42-49a6-86aa-3153e01c0e4d tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:08.612269 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4dd46261-de42-49a6-86aa-3153e01c0e4d tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:08.612734 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4dd46261-de42-49a6-86aa-3153e01c0e4d tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:08.613529 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4dd46261-de42-49a6-86aa-3153e01c0e4d tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:08.614025 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4dd46261-de42-49a6-86aa-3153e01c0e4d tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:08.746378 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4dd46261-de42-49a6-86aa-3153e01c0e4d tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:08.754156 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4dd46261-de42-49a6-86aa-3153e01c0e4d tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b" status: 200 len: 1358 microversion: 2.1 time: 0.153845 Jul 18 03:25:08.754744 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3572/7126] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:08 2022] GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:09.772617 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-474583a4-3e2e-4cf2-8031-36279c56a60a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:09.773156 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-474583a4-3e2e-4cf2-8031-36279c56a60a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:09.780414 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-474583a4-3e2e-4cf2-8031-36279c56a60a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:09.780860 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-474583a4-3e2e-4cf2-8031-36279c56a60a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:09.781632 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-474583a4-3e2e-4cf2-8031-36279c56a60a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:09.782099 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-474583a4-3e2e-4cf2-8031-36279c56a60a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:09.920550 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-474583a4-3e2e-4cf2-8031-36279c56a60a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:09.929345 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-474583a4-3e2e-4cf2-8031-36279c56a60a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b" status: 200 len: 1358 microversion: 2.1 time: 0.160745 Jul 18 03:25:09.929945 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3555/7127] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:09 2022] GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:10.895147 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-b10e9502-56ac-4bbb-8184-b3f1468f2aad req-a383d025-2773-46be-bf7d-dade0a564461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0244b9e-0e23-4289-91dd-2c0eb793677b", "name": "network-vif-plugged", "status": "completed", "tag": "9fdc8798-aa35-4b51-a765-b26a40104819"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:25:10.906106 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-b10e9502-56ac-4bbb-8184-b3f1468f2aad req-a383d025-2773-46be-bf7d-dade0a564461 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:10.906562 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-b10e9502-56ac-4bbb-8184-b3f1468f2aad req-a383d025-2773-46be-bf7d-dade0a564461 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:10.920455 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-b10e9502-56ac-4bbb-8184-b3f1468f2aad req-a383d025-2773-46be-bf7d-dade0a564461 service nova] Creating event network-vif-plugged:9fdc8798-aa35-4b51-a765-b26a40104819 for instance e0244b9e-0e23-4289-91dd-2c0eb793677b on n-h1-465891-3 Jul 18 03:25:10.925622 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-b10e9502-56ac-4bbb-8184-b3f1468f2aad req-a383d025-2773-46be-bf7d-dade0a564461 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034304 Jul 18 03:25:10.926272 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3573/7128] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:25:10.947622 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0a6cdd17-7afb-487f-abbc-641829f2ef8c tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:10.948335 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0a6cdd17-7afb-487f-abbc-641829f2ef8c tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:10.955177 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a6cdd17-7afb-487f-abbc-641829f2ef8c tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:10.955634 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a6cdd17-7afb-487f-abbc-641829f2ef8c tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:10.956410 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a6cdd17-7afb-487f-abbc-641829f2ef8c tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:10.956846 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0a6cdd17-7afb-487f-abbc-641829f2ef8c tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:11.139650 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0a6cdd17-7afb-487f-abbc-641829f2ef8c tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:11.148150 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0a6cdd17-7afb-487f-abbc-641829f2ef8c tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b" status: 200 len: 1358 microversion: 2.1 time: 0.205672 Jul 18 03:25:11.148844 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3556/7129] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:10 2022] GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:12.166543 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-aa18667a-02bf-4683-95c1-efd2cc791708 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:12.167266 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-aa18667a-02bf-4683-95c1-efd2cc791708 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:12.174248 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aa18667a-02bf-4683-95c1-efd2cc791708 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:12.174804 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aa18667a-02bf-4683-95c1-efd2cc791708 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:12.175833 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aa18667a-02bf-4683-95c1-efd2cc791708 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:12.176380 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aa18667a-02bf-4683-95c1-efd2cc791708 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:12.320745 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-aa18667a-02bf-4683-95c1-efd2cc791708 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:12.329153 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-aa18667a-02bf-4683-95c1-efd2cc791708 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b" status: 200 len: 1358 microversion: 2.1 time: 0.168331 Jul 18 03:25:12.329802 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3574/7130] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:12 2022] GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:13.346511 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-57f361ff-403b-4f6c-b380-900eeb98ed83 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:13.346919 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-57f361ff-403b-4f6c-b380-900eeb98ed83 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:13.354725 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-57f361ff-403b-4f6c-b380-900eeb98ed83 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:13.355172 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-57f361ff-403b-4f6c-b380-900eeb98ed83 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:13.355945 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-57f361ff-403b-4f6c-b380-900eeb98ed83 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:13.356378 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-57f361ff-403b-4f6c-b380-900eeb98ed83 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:13.491129 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-57f361ff-403b-4f6c-b380-900eeb98ed83 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:13.498638 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-57f361ff-403b-4f6c-b380-900eeb98ed83 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b" status: 200 len: 1547 microversion: 2.1 time: 0.156669 Jul 18 03:25:13.499216 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3557/7131] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:13 2022] GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b => generated 1547 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:13.515735 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4d6382ff-c8f6-414b-9cb8-3283d2ca47df tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:13.516395 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4d6382ff-c8f6-414b-9cb8-3283d2ca47df tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:13.523440 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4d6382ff-c8f6-414b-9cb8-3283d2ca47df tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:13.523893 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4d6382ff-c8f6-414b-9cb8-3283d2ca47df tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:13.524673 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4d6382ff-c8f6-414b-9cb8-3283d2ca47df tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:13.525119 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4d6382ff-c8f6-414b-9cb8-3283d2ca47df tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:13.659421 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4d6382ff-c8f6-414b-9cb8-3283d2ca47df tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:13.667047 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4d6382ff-c8f6-414b-9cb8-3283d2ca47df tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b" status: 200 len: 1547 microversion: 2.1 time: 0.155342 Jul 18 03:25:13.667622 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3575/7132] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:13 2022] GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b => generated 1547 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:13.682737 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-58588523-26b8-4343-8cde-4a2176004f6e tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:13.686014 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-58588523-26b8-4343-8cde-4a2176004f6e tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:13.686775 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-58588523-26b8-4343-8cde-4a2176004f6e tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Searching by: {'deleted': False, 'project_id': 'f4b72a832ce748028e574fc91b4dae21'} {{(pid=119544) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 03:25:13.692131 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-58588523-26b8-4343-8cde-4a2176004f6e tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:13.693094 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-58588523-26b8-4343-8cde-4a2176004f6e tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:13.693939 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-58588523-26b8-4343-8cde-4a2176004f6e tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:13.694381 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-58588523-26b8-4343-8cde-4a2176004f6e tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:13.718526 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.multi_cell_list [None req-58588523-26b8-4343-8cde-4a2176004f6e tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119544) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 03:25:13.746173 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-58588523-26b8-4343-8cde-4a2176004f6e tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.067214 Jul 18 03:25:13.746765 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3558/7133] 10.222.0.57 () {58 vars in 1124 bytes} [Mon Jul 18 03:25:13 2022] GET /compute/v2.1/servers => generated 342 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:25:13.758127 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-df1fc165-4d8a-48fb-8070-cdeeb5b86369 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:13.758760 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-df1fc165-4d8a-48fb-8070-cdeeb5b86369 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:13.764920 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-df1fc165-4d8a-48fb-8070-cdeeb5b86369 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:13.765382 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-df1fc165-4d8a-48fb-8070-cdeeb5b86369 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:13.766200 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-df1fc165-4d8a-48fb-8070-cdeeb5b86369 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:13.766653 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-df1fc165-4d8a-48fb-8070-cdeeb5b86369 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:13.895567 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-df1fc165-4d8a-48fb-8070-cdeeb5b86369 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:13.903709 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-df1fc165-4d8a-48fb-8070-cdeeb5b86369 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b" status: 200 len: 1547 microversion: 2.1 time: 0.150104 Jul 18 03:25:13.904282 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3576/7134] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:13 2022] GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:15.434770 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-eb4b5b13-c1da-4119-a846-04493809f086 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8bf8aa8-4fd6-45d6-b118-a902c3bf968b"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:25:15.435852 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-eb4b5b13-c1da-4119-a846-04493809f086 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:15.443450 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eb4b5b13-c1da-4119-a846-04493809f086 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:15.443906 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eb4b5b13-c1da-4119-a846-04493809f086 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:15.444687 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eb4b5b13-c1da-4119-a846-04493809f086 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:15.445120 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-eb4b5b13-c1da-4119-a846-04493809f086 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:15.719984 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-eb4b5b13-c1da-4119-a846-04493809f086 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "POST /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289028 Jul 18 03:25:15.720622 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3559/7135] 10.222.0.57 () {60 vars in 1322 bytes} [Mon Jul 18 03:25:15 2022] POST /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:25:29.874594 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c742903c-51eb-4249-8b0f-30a8a365f152 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:29.875623 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c742903c-51eb-4249-8b0f-30a8a365f152 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:29.877773 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:25:29.878602 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=76 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:25:29.886364 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c742903c-51eb-4249-8b0f-30a8a365f152 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:29.886834 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c742903c-51eb-4249-8b0f-30a8a365f152 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:29.887624 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c742903c-51eb-4249-8b0f-30a8a365f152 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:29.888081 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c742903c-51eb-4249-8b0f-30a8a365f152 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:30.017736 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c742903c-51eb-4249-8b0f-30a8a365f152 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:30.026757 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c742903c-51eb-4249-8b0f-30a8a365f152 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b" status: 200 len: 1593 microversion: 2.1 time: 0.156295 Jul 18 03:25:30.027353 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3577/7136] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:29 2022] GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b => generated 1593 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:31.793316 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-1722fe98-7e51-4623-aa70-3119f2f7fb3a req-42d91c16-6b6d-436d-924f-ab139d697214 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0244b9e-0e23-4289-91dd-2c0eb793677b", "tag": "9fdc8798-aa35-4b51-a765-b26a40104819"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:25:31.797936 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:25:31.798611 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:25:31.799258 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:25:31.806117 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-1722fe98-7e51-4623-aa70-3119f2f7fb3a req-42d91c16-6b6d-436d-924f-ab139d697214 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:31.806571 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-1722fe98-7e51-4623-aa70-3119f2f7fb3a req-42d91c16-6b6d-436d-924f-ab139d697214 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:31.823032 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-1722fe98-7e51-4623-aa70-3119f2f7fb3a req-42d91c16-6b6d-436d-924f-ab139d697214 service nova] Creating event network-changed:9fdc8798-aa35-4b51-a765-b26a40104819 for instance e0244b9e-0e23-4289-91dd-2c0eb793677b on n-h1-465891-3 Jul 18 03:25:31.828671 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-1722fe98-7e51-4623-aa70-3119f2f7fb3a req-42d91c16-6b6d-436d-924f-ab139d697214 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039785 Jul 18 03:25:31.829289 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3560/7137] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:25:33.085846 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b4aa7f92-04c1-40a4-9b0a-45c4a65ee34e tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-482547500"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:25:33.087117 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b4aa7f92-04c1-40a4-9b0a-45c4a65ee34e tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:33.095427 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b4aa7f92-04c1-40a4-9b0a-45c4a65ee34e tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:33.096277 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b4aa7f92-04c1-40a4-9b0a-45c4a65ee34e tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:33.097079 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b4aa7f92-04c1-40a4-9b0a-45c4a65ee34e tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:33.097693 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b4aa7f92-04c1-40a4-9b0a-45c4a65ee34e tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:33.236222 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.network.security_group_api [None req-b4aa7f92-04c1-40a4-9b0a-45c4a65ee34e tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Adding security group 4b985616-1fb3-46de-9639-ee97aaf2360f to port 9fdc8798-aa35-4b51-a765-b26a40104819 Jul 18 03:25:33.648043 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b4aa7f92-04c1-40a4-9b0a-45c4a65ee34e tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "POST /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b/action" status: 202 len: 0 microversion: 2.1 time: 0.566508 Jul 18 03:25:33.654448 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3578/7138] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:25:33 2022] POST /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b/action => generated 0 bytes in 574 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:25:33.661163 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-12773bbc-30d0-4fb4-8f8e-a274baac5671 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:33.661924 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-12773bbc-30d0-4fb4-8f8e-a274baac5671 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:33.668857 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-12773bbc-30d0-4fb4-8f8e-a274baac5671 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:33.669794 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-12773bbc-30d0-4fb4-8f8e-a274baac5671 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:33.671132 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-12773bbc-30d0-4fb4-8f8e-a274baac5671 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:33.671825 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-12773bbc-30d0-4fb4-8f8e-a274baac5671 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:33.847146 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-b2ce1759-20c1-4dd0-90d8-8ca40e2b46c0 req-e37d578b-0c3f-4148-9716-505718fb544c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0244b9e-0e23-4289-91dd-2c0eb793677b", "tag": "9fdc8798-aa35-4b51-a765-b26a40104819"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:25:33.861060 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-b2ce1759-20c1-4dd0-90d8-8ca40e2b46c0 req-e37d578b-0c3f-4148-9716-505718fb544c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:33.861930 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-b2ce1759-20c1-4dd0-90d8-8ca40e2b46c0 req-e37d578b-0c3f-4148-9716-505718fb544c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:33.900727 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-b2ce1759-20c1-4dd0-90d8-8ca40e2b46c0 req-e37d578b-0c3f-4148-9716-505718fb544c service nova] Creating event network-changed:9fdc8798-aa35-4b51-a765-b26a40104819 for instance e0244b9e-0e23-4289-91dd-2c0eb793677b on n-h1-465891-3 Jul 18 03:25:33.907634 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-12773bbc-30d0-4fb4-8f8e-a274baac5671 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:33.912022 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-b2ce1759-20c1-4dd0-90d8-8ca40e2b46c0 req-e37d578b-0c3f-4148-9716-505718fb544c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068242 Jul 18 03:25:33.912902 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3579/7139] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:25:33.920494 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-12773bbc-30d0-4fb4-8f8e-a274baac5671 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b" status: 200 len: 1758 microversion: 2.1 time: 0.264942 Jul 18 03:25:33.921116 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3561/7140] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:33 2022] GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b => generated 1758 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:26:12.294341 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:26:12.295706 n-d-465891-3 devstack@n-api.service[119544]: Mon Jul 18 03:26:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:27:46.013141 n-d-465891-3 devstack@n-api.service[119543]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5744c86a-1c72-444c-9f09-2dc127b8032d] AMQP server on 10.222.0.57:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 18 03:27:46.014166 n-d-465891-3 devstack@n-api.service[119543]: ERROR oslo.messaging._drivers.impl_rabbit [-] [58d4ed9e-6c40-4e66-8cf1-b8f58c4998c2] AMQP server on 10.222.0.57:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 18 03:27:46.014759 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:27:46.015777 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=12 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:27:46.020933 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-75a31079-42de-4c03-af85-bcdbbfde929f tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:27:46.022038 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-75a31079-42de-4c03-af85-bcdbbfde929f tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:27:46.029097 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-75a31079-42de-4c03-af85-bcdbbfde929f tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:27:46.029593 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-75a31079-42de-4c03-af85-bcdbbfde929f tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:27:46.030408 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-75a31079-42de-4c03-af85-bcdbbfde929f tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:27:46.030858 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-75a31079-42de-4c03-af85-bcdbbfde929f tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:27:46.116285 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-75a31079-42de-4c03-af85-bcdbbfde929f tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "POST /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b/action" status: 202 len: 0 microversion: 2.1 time: 0.105874 Jul 18 03:27:46.116942 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3580/7141] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:27:46 2022] POST /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:27:46.123886 n-d-465891-3 devstack@n-api.service[119544]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bec20902-d336-4ab9-99dd-48825093cebe] AMQP server on 10.222.0.57:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 18 03:27:46.124439 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:27:46.125107 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=8 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:27:46.130374 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5250c016-9b98-486f-bde3-80072e42c39a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:27:46.130998 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5250c016-9b98-486f-bde3-80072e42c39a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:27:46.138095 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5250c016-9b98-486f-bde3-80072e42c39a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:27:46.138551 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5250c016-9b98-486f-bde3-80072e42c39a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:27:46.139338 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5250c016-9b98-486f-bde3-80072e42c39a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:27:46.139773 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5250c016-9b98-486f-bde3-80072e42c39a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:27:46.559419 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5250c016-9b98-486f-bde3-80072e42c39a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:27:46.568600 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5250c016-9b98-486f-bde3-80072e42c39a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b" status: 200 len: 1760 microversion: 2.1 time: 0.447169 Jul 18 03:27:46.578116 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3562/7142] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:27:46 2022] GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b => generated 1760 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:27:47.591992 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-725fed79-8be0-4faf-9284-b655c8ccc4ab tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:27:47.592704 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-725fed79-8be0-4faf-9284-b655c8ccc4ab tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:27:47.603641 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-725fed79-8be0-4faf-9284-b655c8ccc4ab tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:27:47.604107 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-725fed79-8be0-4faf-9284-b655c8ccc4ab tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:27:47.604885 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-725fed79-8be0-4faf-9284-b655c8ccc4ab tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:27:47.605332 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-725fed79-8be0-4faf-9284-b655c8ccc4ab tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:27:47.609547 n-d-465891-3 devstack@n-api.service[119543]: INFO oslo.messaging._drivers.impl_rabbit [-] [5744c86a-1c72-444c-9f09-2dc127b8032d] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 52122. Jul 18 03:27:47.612769 n-d-465891-3 devstack@n-api.service[119543]: INFO oslo.messaging._drivers.impl_rabbit [-] [58d4ed9e-6c40-4e66-8cf1-b8f58c4998c2] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 52124. Jul 18 03:27:47.806617 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-725fed79-8be0-4faf-9284-b655c8ccc4ab tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:27:47.815321 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-725fed79-8be0-4faf-9284-b655c8ccc4ab tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b" status: 200 len: 1758 microversion: 2.1 time: 0.229177 Jul 18 03:27:47.815957 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3581/7143] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:27:47 2022] GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b => generated 1758 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:27:52.248476 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:27:52.249126 n-d-465891-3 devstack@n-api.service[119544]: Mon Jul 18 03:27:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:27:54.630061 n-d-465891-3 devstack@n-api.service[119543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:27:54.630636 n-d-465891-3 devstack@n-api.service[119543]: Mon Jul 18 03:27:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:28:16.731282 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:28:16.732112 n-d-465891-3 devstack@n-api.service[119544]: Mon Jul 18 03:28:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:29:27.013354 n-d-465891-3 devstack@n-api.service[119544]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2195f790-7bbc-4111-8106-e7ea837c20fc] AMQP server on 10.222.0.57:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 18 03:29:27.015576 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:29:27.016315 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:29:27.021955 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-02cc124e-9737-4790-a204-66c7806e13b3 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-482547500"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:29:27.022505 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-02cc124e-9737-4790-a204-66c7806e13b3 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:29:27.032079 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-02cc124e-9737-4790-a204-66c7806e13b3 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:27.032541 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-02cc124e-9737-4790-a204-66c7806e13b3 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:27.033304 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-02cc124e-9737-4790-a204-66c7806e13b3 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:27.033767 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-02cc124e-9737-4790-a204-66c7806e13b3 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:27.039851 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [-] [bec20902-d336-4ab9-99dd-48825093cebe] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 52168. Jul 18 03:29:27.165523 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.network.security_group_api [None req-02cc124e-9737-4790-a204-66c7806e13b3 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Removing security group 4b985616-1fb3-46de-9639-ee97aaf2360f from port 9fdc8798-aa35-4b51-a765-b26a40104819 Jul 18 03:29:27.515737 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-02cc124e-9737-4790-a204-66c7806e13b3 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "POST /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b/action" status: 202 len: 0 microversion: 2.1 time: 0.503924 Jul 18 03:29:27.516578 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3563/7144] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:29:27 2022] POST /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b/action => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:29:27.526206 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=4 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:29:27.527341 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:29:27.633774 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-d6264dc2-a678-48ae-849b-758ebbf7df4e req-23625760-13b0-47ac-861c-1569695b3802 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0244b9e-0e23-4289-91dd-2c0eb793677b", "tag": "9fdc8798-aa35-4b51-a765-b26a40104819"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:29:27.643666 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-d6264dc2-a678-48ae-849b-758ebbf7df4e req-23625760-13b0-47ac-861c-1569695b3802 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:27.644335 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-d6264dc2-a678-48ae-849b-758ebbf7df4e req-23625760-13b0-47ac-861c-1569695b3802 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:27.657354 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-d6264dc2-a678-48ae-849b-758ebbf7df4e req-23625760-13b0-47ac-861c-1569695b3802 service nova] Creating event network-changed:9fdc8798-aa35-4b51-a765-b26a40104819 for instance e0244b9e-0e23-4289-91dd-2c0eb793677b on n-h1-465891-3 Jul 18 03:29:27.662883 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-d6264dc2-a678-48ae-849b-758ebbf7df4e req-23625760-13b0-47ac-861c-1569695b3802 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139266 Jul 18 03:29:27.665275 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3582/7145] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:29:28.936598 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [-] [2195f790-7bbc-4111-8106-e7ea837c20fc] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 52190. Jul 18 03:29:28.962749 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0e5a434b-667c-4a57-a6d3-8af5a19843c9 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:29:28.963358 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0e5a434b-667c-4a57-a6d3-8af5a19843c9 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:29:28.971347 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0e5a434b-667c-4a57-a6d3-8af5a19843c9 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:28.972009 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0e5a434b-667c-4a57-a6d3-8af5a19843c9 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:28.972977 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0e5a434b-667c-4a57-a6d3-8af5a19843c9 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:28.973597 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0e5a434b-667c-4a57-a6d3-8af5a19843c9 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:28.987242 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-75464ca4-d9e7-4568-9525-5af43ab70d90 req-54a0a8a2-65cf-4954-966d-ae4065c490e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0244b9e-0e23-4289-91dd-2c0eb793677b", "tag": "9fdc8798-aa35-4b51-a765-b26a40104819"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:29:28.997095 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-75464ca4-d9e7-4568-9525-5af43ab70d90 req-54a0a8a2-65cf-4954-966d-ae4065c490e5 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:28.997541 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-75464ca4-d9e7-4568-9525-5af43ab70d90 req-54a0a8a2-65cf-4954-966d-ae4065c490e5 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:29.010732 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-75464ca4-d9e7-4568-9525-5af43ab70d90 req-54a0a8a2-65cf-4954-966d-ae4065c490e5 service nova] Creating event network-changed:9fdc8798-aa35-4b51-a765-b26a40104819 for instance e0244b9e-0e23-4289-91dd-2c0eb793677b on n-h1-465891-3 Jul 18 03:29:29.018111 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-75464ca4-d9e7-4568-9525-5af43ab70d90 req-54a0a8a2-65cf-4954-966d-ae4065c490e5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105927 Jul 18 03:29:29.018917 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3564/7146] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:29:29.066209 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-0e5a434b-667c-4a57-a6d3-8af5a19843c9 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lazy-loading 'services' on Instance uuid e0244b9e-0e23-4289-91dd-2c0eb793677b {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:29:29.146225 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0e5a434b-667c-4a57-a6d3-8af5a19843c9 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "DELETE /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b/os-volume_attachments/e8bf8aa8-4fd6-45d6-b118-a902c3bf968b" status: 202 len: 0 microversion: 2.1 time: 0.192059 Jul 18 03:29:29.147324 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3583/7147] 10.222.0.57 () {58 vars in 1415 bytes} [Mon Jul 18 03:29:28 2022] DELETE /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b/os-volume_attachments/e8bf8aa8-4fd6-45d6-b118-a902c3bf968b => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 03:29:29.171264 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e6a1ce63-9882-4040-ab7f-8311714dfe51 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:29:29.173352 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e6a1ce63-9882-4040-ab7f-8311714dfe51 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:29:29.183447 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e6a1ce63-9882-4040-ab7f-8311714dfe51 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:29.184172 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e6a1ce63-9882-4040-ab7f-8311714dfe51 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:29.184962 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e6a1ce63-9882-4040-ab7f-8311714dfe51 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:29.185407 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e6a1ce63-9882-4040-ab7f-8311714dfe51 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:29.223779 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e6a1ce63-9882-4040-ab7f-8311714dfe51 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069938 Jul 18 03:29:29.224886 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3565/7148] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 03:29:29 2022] GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:29:30.237907 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-93fb7ed9-cff1-4ef7-ab49-e5b1a03a753d tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:29:30.238886 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-93fb7ed9-cff1-4ef7-ab49-e5b1a03a753d tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:29:30.246399 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-93fb7ed9-cff1-4ef7-ab49-e5b1a03a753d tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:30.246887 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-93fb7ed9-cff1-4ef7-ab49-e5b1a03a753d tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:30.247702 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-93fb7ed9-cff1-4ef7-ab49-e5b1a03a753d tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:30.248169 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-93fb7ed9-cff1-4ef7-ab49-e5b1a03a753d tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:30.278863 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-93fb7ed9-cff1-4ef7-ab49-e5b1a03a753d tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046265 Jul 18 03:29:30.279448 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3584/7149] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 03:29:30 2022] GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:29:31.291056 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-651df46f-6fdc-4bd4-a2e3-93ecc0b123ab tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:29:31.291994 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-651df46f-6fdc-4bd4-a2e3-93ecc0b123ab tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:29:31.299238 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-651df46f-6fdc-4bd4-a2e3-93ecc0b123ab tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:31.299696 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-651df46f-6fdc-4bd4-a2e3-93ecc0b123ab tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:31.300479 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-651df46f-6fdc-4bd4-a2e3-93ecc0b123ab tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:31.300921 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-651df46f-6fdc-4bd4-a2e3-93ecc0b123ab tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:31.333103 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-651df46f-6fdc-4bd4-a2e3-93ecc0b123ab tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046897 Jul 18 03:29:31.333720 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3566/7150] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 03:29:31 2022] GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:29:32.304292 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:29:32.304960 n-d-465891-3 devstack@n-api.service[119544]: Mon Jul 18 03:29:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:29:32.344560 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bb27b1de-2703-4b7b-9b9f-ed37517b86ff tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:29:32.345497 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bb27b1de-2703-4b7b-9b9f-ed37517b86ff tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:29:32.352692 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bb27b1de-2703-4b7b-9b9f-ed37517b86ff tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:32.353150 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bb27b1de-2703-4b7b-9b9f-ed37517b86ff tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:32.353995 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bb27b1de-2703-4b7b-9b9f-ed37517b86ff tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:32.354427 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bb27b1de-2703-4b7b-9b9f-ed37517b86ff tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:32.386200 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bb27b1de-2703-4b7b-9b9f-ed37517b86ff tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045465 Jul 18 03:29:32.386840 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3585/7151] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 03:29:32 2022] GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:29:33.398508 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-35007f4d-6a64-4bb9-b691-ef17c2da4dbe tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:29:33.400208 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-35007f4d-6a64-4bb9-b691-ef17c2da4dbe tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:29:33.407498 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-35007f4d-6a64-4bb9-b691-ef17c2da4dbe tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:33.407953 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-35007f4d-6a64-4bb9-b691-ef17c2da4dbe tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:33.408720 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-35007f4d-6a64-4bb9-b691-ef17c2da4dbe tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:33.409157 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-35007f4d-6a64-4bb9-b691-ef17c2da4dbe tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:33.441313 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-35007f4d-6a64-4bb9-b691-ef17c2da4dbe tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047564 Jul 18 03:29:33.445421 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3567/7152] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 03:29:33 2022] GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:29:34.454268 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e4e1de18-4920-4199-953e-2f2bffe77d11 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:29:34.455094 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e4e1de18-4920-4199-953e-2f2bffe77d11 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:29:34.463531 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e4e1de18-4920-4199-953e-2f2bffe77d11 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:34.463991 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e4e1de18-4920-4199-953e-2f2bffe77d11 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:34.464768 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e4e1de18-4920-4199-953e-2f2bffe77d11 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:34.465216 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e4e1de18-4920-4199-953e-2f2bffe77d11 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:34.494741 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e4e1de18-4920-4199-953e-2f2bffe77d11 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044557 Jul 18 03:29:34.495317 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3586/7153] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 03:29:34 2022] GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 03:29:34.505086 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c5202d65-12db-442f-adbd-5cfe5ed07765 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:29:34.505595 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c5202d65-12db-442f-adbd-5cfe5ed07765 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:29:34.513446 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c5202d65-12db-442f-adbd-5cfe5ed07765 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:34.513942 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c5202d65-12db-442f-adbd-5cfe5ed07765 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:34.514706 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c5202d65-12db-442f-adbd-5cfe5ed07765 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:34.515147 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c5202d65-12db-442f-adbd-5cfe5ed07765 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:34.592258 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-c5202d65-12db-442f-adbd-5cfe5ed07765 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] HTTP exception thrown: Instance e0244b9e-0e23-4289-91dd-2c0eb793677b is not attached to volume e8bf8aa8-4fd6-45d6-b118-a902c3bf968b Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c5202d65-12db-442f-adbd-5cfe5ed07765 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Request method failure captured: Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b/os-volume_attachments/e8bf8aa8-4fd6-45d6-b118-a902c3bf968b HTTP/1.1 Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1NJwYm6gk5iUC6LdmmRMHQ_GEeg-3VK3XTXeeZuTX2bX-ssDHhGrv94-2U4ZhAmgMOEFa3YvNksNDG0-UZViJTnxP4QehBWqqz3a_CsZ5IB1_KhRWktxDkJMe0ZF25o0HjFUVMx6BlMuCJAfUTtr9gBBU3t54ARw0hxXOLVa1Q8wZi4 Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: f4b72a832ce748028e574fc91b4dae21 Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-TestMinimumBasicScenario-1607100642 Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f4b72a832ce748028e574fc91b4dae21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f4b72a832ce748028e574fc91b4dae21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f4b72a832ce748028e574fc91b4dae21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f4b72a832ce748028e574fc91b4dae21"}]}] Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-TestMinimumBasicScenario-1607100642 Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: f4b72a832ce748028e574fc91b4dae21 Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1607100642 Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-TestMinimumBasicScenario-1607100642-project Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: a0d6e0c353ca47939c9ba0da92794704 Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-TestMinimumBasicScenario-1607100642-project Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance e0244b9e-0e23-4289-91dd-2c0eb793677b is not attached to volume e8bf8aa8-4fd6-45d6-b118-a902c3bf968b Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'server_id': 'e0244b9e-0e23-4289-91dd-2c0eb793677b', 'id': 'e8bf8aa8-4fd6-45d6-b118-a902c3bf968b'} Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e8bf8aa8-4fd6-45d6-b118-a902c3bf968b. Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0244b9e-0e23-4289-91dd-2c0eb793677b is not attached to volume e8bf8aa8-4fd6-45d6-b118-a902c3bf968b Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:29:34.593923 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:29:34.598483 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:29:34.598483 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:29:34.598483 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0244b9e-0e23-4289-91dd-2c0eb793677b is not attached to volume e8bf8aa8-4fd6-45d6-b118-a902c3bf968b Jul 18 03:29:34.598483 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:29:34.598483 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c5202d65-12db-442f-adbd-5cfe5ed07765 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Returning 404 to user: Instance e0244b9e-0e23-4289-91dd-2c0eb793677b is not attached to volume e8bf8aa8-4fd6-45d6-b118-a902c3bf968b {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:29:34.598483 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c5202d65-12db-442f-adbd-5cfe5ed07765 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "DELETE /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b/os-volume_attachments/e8bf8aa8-4fd6-45d6-b118-a902c3bf968b" status: 404 len: 154 microversion: 2.1 time: 0.094335 Jul 18 03:29:34.598483 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3568/7154] 10.222.0.57 () {58 vars in 1415 bytes} [Mon Jul 18 03:29:34 2022] DELETE /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b/os-volume_attachments/e8bf8aa8-4fd6-45d6-b118-a902c3bf968b => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:29:34.605896 n-d-465891-3 devstack@n-api.service[119543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:29:34.606337 n-d-465891-3 devstack@n-api.service[119543]: Mon Jul 18 03:29:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:29:37.852452 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5df569ca-5a7b-419f-9f47-1b7acdc75d52 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:29:37.853197 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5df569ca-5a7b-419f-9f47-1b7acdc75d52 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:29:37.860124 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5df569ca-5a7b-419f-9f47-1b7acdc75d52 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:37.860611 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5df569ca-5a7b-419f-9f47-1b7acdc75d52 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:37.861403 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5df569ca-5a7b-419f-9f47-1b7acdc75d52 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:37.861885 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5df569ca-5a7b-419f-9f47-1b7acdc75d52 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:37.893073 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5df569ca-5a7b-419f-9f47-1b7acdc75d52 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:29:37.968768 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5df569ca-5a7b-419f-9f47-1b7acdc75d52 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "DELETE /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b" status: 204 len: 0 microversion: 2.1 time: 0.119945 Jul 18 03:29:37.969581 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3587/7155] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:29:37 2022] DELETE /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:29:37.979901 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c8e00195-4edd-48d6-bd21-14307f8c72bf tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:29:37.980632 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c8e00195-4edd-48d6-bd21-14307f8c72bf tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:29:37.988499 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c8e00195-4edd-48d6-bd21-14307f8c72bf tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:37.988945 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c8e00195-4edd-48d6-bd21-14307f8c72bf tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:37.989757 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c8e00195-4edd-48d6-bd21-14307f8c72bf tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:37.990176 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c8e00195-4edd-48d6-bd21-14307f8c72bf tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:38.176804 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c8e00195-4edd-48d6-bd21-14307f8c72bf tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:29:38.185395 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c8e00195-4edd-48d6-bd21-14307f8c72bf tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b" status: 200 len: 1553 microversion: 2.1 time: 0.210615 Jul 18 03:29:38.186033 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3569/7156] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:29:37 2022] GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b => generated 1553 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:29:39.204293 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bc0f78f2-a580-451c-921d-345c59668367 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:29:39.205212 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bc0f78f2-a580-451c-921d-345c59668367 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:29:39.213171 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bc0f78f2-a580-451c-921d-345c59668367 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:39.213639 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bc0f78f2-a580-451c-921d-345c59668367 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:39.214448 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bc0f78f2-a580-451c-921d-345c59668367 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:39.214992 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bc0f78f2-a580-451c-921d-345c59668367 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:39.348866 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bc0f78f2-a580-451c-921d-345c59668367 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:29:39.357348 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bc0f78f2-a580-451c-921d-345c59668367 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b" status: 200 len: 1553 microversion: 2.1 time: 0.157515 Jul 18 03:29:39.357958 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3588/7157] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:29:39 2022] GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:29:40.375509 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c2c22084-6779-4d77-affd-d9afcaa7a694 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:29:40.376115 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c2c22084-6779-4d77-affd-d9afcaa7a694 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:29:40.384610 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c2c22084-6779-4d77-affd-d9afcaa7a694 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:40.385121 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c2c22084-6779-4d77-affd-d9afcaa7a694 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:40.385914 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c2c22084-6779-4d77-affd-d9afcaa7a694 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:40.386347 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c2c22084-6779-4d77-affd-d9afcaa7a694 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:40.478023 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c2c22084-6779-4d77-affd-d9afcaa7a694 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:29:40.486144 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c2c22084-6779-4d77-affd-d9afcaa7a694 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b" status: 200 len: 1511 microversion: 2.1 time: 0.114710 Jul 18 03:29:40.496588 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3570/7158] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:29:40 2022] GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b => generated 1511 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:29:40.500381 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-90b2929d-0846-4f64-8df7-454dfff01a77 req-bb55f408-9423-49fe-b4d4-3d6650a28fdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0244b9e-0e23-4289-91dd-2c0eb793677b", "name": "network-vif-deleted", "tag": "9fdc8798-aa35-4b51-a765-b26a40104819"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:29:40.509985 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-90b2929d-0846-4f64-8df7-454dfff01a77 req-bb55f408-9423-49fe-b4d4-3d6650a28fdd service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:40.510450 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-90b2929d-0846-4f64-8df7-454dfff01a77 req-bb55f408-9423-49fe-b4d4-3d6650a28fdd service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:40.522498 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-90b2929d-0846-4f64-8df7-454dfff01a77 req-bb55f408-9423-49fe-b4d4-3d6650a28fdd service nova] Creating event network-vif-deleted:9fdc8798-aa35-4b51-a765-b26a40104819 for instance e0244b9e-0e23-4289-91dd-2c0eb793677b on n-h1-465891-3 Jul 18 03:29:40.527830 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-90b2929d-0846-4f64-8df7-454dfff01a77 req-bb55f408-9423-49fe-b4d4-3d6650a28fdd service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042448 Jul 18 03:29:40.528441 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3589/7159] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:29:41.505184 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7d024c26-2686-401d-83c1-8bab9520812e tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:29:41.505803 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7d024c26-2686-401d-83c1-8bab9520812e tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: e0244b9e-0e23-4289-91dd-2c0eb793677b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:29:41.513837 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7d024c26-2686-401d-83c1-8bab9520812e tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:41.514339 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7d024c26-2686-401d-83c1-8bab9520812e tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:41.515036 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7d024c26-2686-401d-83c1-8bab9520812e tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:41.515470 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7d024c26-2686-401d-83c1-8bab9520812e tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:41.528784 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-7d024c26-2686-401d-83c1-8bab9520812e tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] HTTP exception thrown: Instance e0244b9e-0e23-4289-91dd-2c0eb793677b could not be found. Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7d024c26-2686-401d-83c1-8bab9520812e tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Request method failure captured: Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b HTTP/1.1 Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1NJwYm6gk5iUC6LdmmRMHQ_GEeg-3VK3XTXeeZuTX2bX-ssDHhGrv94-2U4ZhAmgMOEFa3YvNksNDG0-UZViJTnxP4QehBWqqz3a_CsZ5IB1_KhRWktxDkJMe0ZF25o0HjFUVMx6BlMuCJAfUTtr9gBBU3t54ARw0hxXOLVa1Q8wZi4 Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: f4b72a832ce748028e574fc91b4dae21 Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-TestMinimumBasicScenario-1607100642 Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f4b72a832ce748028e574fc91b4dae21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f4b72a832ce748028e574fc91b4dae21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f4b72a832ce748028e574fc91b4dae21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f4b72a832ce748028e574fc91b4dae21"}]}] Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-TestMinimumBasicScenario-1607100642 Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: f4b72a832ce748028e574fc91b4dae21 Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1607100642 Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-TestMinimumBasicScenario-1607100642-project Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: a0d6e0c353ca47939c9ba0da92794704 Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-TestMinimumBasicScenario-1607100642-project Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance e0244b9e-0e23-4289-91dd-2c0eb793677b could not be found. Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'e0244b9e-0e23-4289-91dd-2c0eb793677b'} Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0244b9e-0e23-4289-91dd-2c0eb793677b could not be found. Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0244b9e-0e23-4289-91dd-2c0eb793677b could not be found. Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:29:41.530349 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:29:41.535187 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:29:41.535187 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:29:41.535187 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:29:41.535187 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:29:41.535187 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:29:41.535187 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0244b9e-0e23-4289-91dd-2c0eb793677b could not be found. Jul 18 03:29:41.535187 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:29:41.535187 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7d024c26-2686-401d-83c1-8bab9520812e tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Returning 404 to user: Instance e0244b9e-0e23-4289-91dd-2c0eb793677b could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:29:41.535187 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7d024c26-2686-401d-83c1-8bab9520812e tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b" status: 404 len: 111 microversion: 2.1 time: 0.030454 Jul 18 03:29:41.535187 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3571/7160] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:29:41 2022] GET /compute/v2.1/servers/e0244b9e-0e23-4289-91dd-2c0eb793677b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:29:41.542026 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-78785cd0-5c0a-4afe-addc-dd66ec0c5c6b tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '.version_select at 0x7ff49bb64820>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:29:41.565319 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-78785cd0-5c0a-4afe-addc-dd66ec0c5c6b tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1855412318" status: 202 len: 0 microversion: 2.1 time: 0.028314 Jul 18 03:29:41.565951 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3590/7161] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 03:29:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1855412318 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:29:50.416670 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b92c0437-cf75-454f-8eda-ff2b4d56b3a5 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Action: 'create', calling method: .version_select at 0x7ff4adb2fa60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1612337742", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKdqqw4f5+jVrHqEjppGkykPGzIbTqVJaoNixCZRhUU5K2OGeQQ2mPPiyDhc75TJJ5xSkTAw9aEGCxWNsqd45siQCoyrS00iZRXZ5I+ZP38F2KuNa4ADJFBNYsLSiy7aA=="}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:29:50.433065 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-b92c0437-cf75-454f-8eda-ff2b4d56b3a5 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Getting quotas for project f4b72a832ce748028e574fc91b4dae21. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:29:50.439071 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-b92c0437-cf75-454f-8eda-ff2b4d56b3a5 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Getting quotas for user a0d6e0c353ca47939c9ba0da92794704 and project f4b72a832ce748028e574fc91b4dae21. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:29:50.466505 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b92c0437-cf75-454f-8eda-ff2b4d56b3a5 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.053878 Jul 18 03:29:50.467115 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3572/7162] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 03:29:50 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:29:50.516369 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e829ca3c-e84f-4baf-aa25-663272f9680a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1326591120", "imageRef": "232b483f-fd15-4677-87c0-c633fa80d708", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1612337742", "networks": [{"uuid": "f4beb76a-8db1-4e57-aa47-b084828f17cb"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:29:50.524447 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:29:50.569688 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-e829ca3c-e84f-4baf-aa25-663272f9680a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] validate_networks() for [('f4beb76a-8db1-4e57-aa47-b084828f17cb', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:29:51.019736 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-e829ca3c-e84f-4baf-aa25-663272f9680a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:29:51.020208 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-e829ca3c-e84f-4baf-aa25-663272f9680a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:29:51.020696 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-e829ca3c-e84f-4baf-aa25-663272f9680a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:29:51.021123 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-e829ca3c-e84f-4baf-aa25-663272f9680a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:29:51.021568 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-e829ca3c-e84f-4baf-aa25-663272f9680a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:29:51.031456 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e829ca3c-e84f-4baf-aa25-663272f9680a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:51.031915 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e829ca3c-e84f-4baf-aa25-663272f9680a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:51.032738 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e829ca3c-e84f-4baf-aa25-663272f9680a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:51.033192 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e829ca3c-e84f-4baf-aa25-663272f9680a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:51.050658 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-e829ca3c-e84f-4baf-aa25-663272f9680a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Getting quotas for project f4b72a832ce748028e574fc91b4dae21. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:29:51.056563 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-e829ca3c-e84f-4baf-aa25-663272f9680a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Getting quotas for user a0d6e0c353ca47939c9ba0da92794704 and project f4b72a832ce748028e574fc91b4dae21. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:29:51.069958 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e829ca3c-e84f-4baf-aa25-663272f9680a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:29:51.072665 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e829ca3c-e84f-4baf-aa25-663272f9680a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='232b483f-fd15-4677-87c0-c633fa80d708',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:29:51.124334 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e829ca3c-e84f-4baf-aa25-663272f9680a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.613024 Jul 18 03:29:51.124993 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3591/7163] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:29:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:29:51.137035 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f2c1b2f2-c175-448d-8ecc-1696498a3fc7 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:29:51.138203 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f2c1b2f2-c175-448d-8ecc-1696498a3fc7 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:29:51.199047 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f2c1b2f2-c175-448d-8ecc-1696498a3fc7 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:29:51.205875 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f2c1b2f2-c175-448d-8ecc-1696498a3fc7 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8" status: 200 len: 1259 microversion: 2.1 time: 0.074803 Jul 18 03:29:51.206447 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3573/7164] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:29:51 2022] GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8 => generated 1259 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:29:52.224893 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6594525d-de5d-4321-9e6a-275c239aed54 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:29:52.225668 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6594525d-de5d-4321-9e6a-275c239aed54 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:29:52.233759 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6594525d-de5d-4321-9e6a-275c239aed54 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:52.234280 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6594525d-de5d-4321-9e6a-275c239aed54 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:52.235086 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6594525d-de5d-4321-9e6a-275c239aed54 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:52.235674 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6594525d-de5d-4321-9e6a-275c239aed54 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:52.310980 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6594525d-de5d-4321-9e6a-275c239aed54 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:29:52.320389 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6594525d-de5d-4321-9e6a-275c239aed54 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8" status: 200 len: 1319 microversion: 2.1 time: 0.100523 Jul 18 03:29:52.321656 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3592/7165] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:29:52 2022] GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8 => generated 1319 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:29:53.339882 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a05a2aba-aaa6-4823-9b37-52d6a2f0b2ba tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:29:53.340544 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a05a2aba-aaa6-4823-9b37-52d6a2f0b2ba tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:29:53.343250 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=44 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:29:53.349838 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a05a2aba-aaa6-4823-9b37-52d6a2f0b2ba tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:53.350304 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a05a2aba-aaa6-4823-9b37-52d6a2f0b2ba tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:53.351085 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a05a2aba-aaa6-4823-9b37-52d6a2f0b2ba tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:53.351716 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a05a2aba-aaa6-4823-9b37-52d6a2f0b2ba tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:53.857800 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a05a2aba-aaa6-4823-9b37-52d6a2f0b2ba tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:29:53.866473 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a05a2aba-aaa6-4823-9b37-52d6a2f0b2ba tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8" status: 200 len: 1359 microversion: 2.1 time: 0.531769 Jul 18 03:29:53.868445 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3574/7166] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:29:53 2022] GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8 => generated 1359 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:29:54.885897 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f11ff45e-4213-49e4-a735-19e3f85d56f8 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:29:54.887299 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f11ff45e-4213-49e4-a735-19e3f85d56f8 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:29:54.895758 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f11ff45e-4213-49e4-a735-19e3f85d56f8 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:54.896249 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f11ff45e-4213-49e4-a735-19e3f85d56f8 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:54.897653 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f11ff45e-4213-49e4-a735-19e3f85d56f8 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:54.898600 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f11ff45e-4213-49e4-a735-19e3f85d56f8 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:55.044999 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f11ff45e-4213-49e4-a735-19e3f85d56f8 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:29:55.053484 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f11ff45e-4213-49e4-a735-19e3f85d56f8 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8" status: 200 len: 1359 microversion: 2.1 time: 0.172339 Jul 18 03:29:55.054601 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3593/7167] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:29:54 2022] GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:29:56.071421 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-28994ede-5f74-42a1-96fd-1441d1c2eaae tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:29:56.072218 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-28994ede-5f74-42a1-96fd-1441d1c2eaae tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:29:56.079767 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-28994ede-5f74-42a1-96fd-1441d1c2eaae tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:56.080170 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-28994ede-5f74-42a1-96fd-1441d1c2eaae tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:56.080963 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-28994ede-5f74-42a1-96fd-1441d1c2eaae tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:56.081400 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-28994ede-5f74-42a1-96fd-1441d1c2eaae tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:56.231826 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-28994ede-5f74-42a1-96fd-1441d1c2eaae tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:29:56.240013 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-28994ede-5f74-42a1-96fd-1441d1c2eaae tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8" status: 200 len: 1359 microversion: 2.1 time: 0.172636 Jul 18 03:29:56.250122 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3575/7168] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:29:56 2022] GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8 => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:29:57.257594 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b83cff00-aa9d-418d-bcba-ed353c6354de tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:29:57.258291 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b83cff00-aa9d-418d-bcba-ed353c6354de tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:29:57.265967 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b83cff00-aa9d-418d-bcba-ed353c6354de tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:57.266432 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b83cff00-aa9d-418d-bcba-ed353c6354de tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:57.267238 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b83cff00-aa9d-418d-bcba-ed353c6354de tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:57.267689 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b83cff00-aa9d-418d-bcba-ed353c6354de tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:57.410195 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b83cff00-aa9d-418d-bcba-ed353c6354de tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:29:57.422464 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b83cff00-aa9d-418d-bcba-ed353c6354de tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8" status: 200 len: 1359 microversion: 2.1 time: 0.168211 Jul 18 03:29:57.423545 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3594/7169] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:29:57 2022] GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:29:58.441748 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b9accbb5-b458-4a13-a68a-3d93fc686c6a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:29:58.443036 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b9accbb5-b458-4a13-a68a-3d93fc686c6a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:29:58.445494 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:29:58.451735 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b9accbb5-b458-4a13-a68a-3d93fc686c6a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:58.452198 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b9accbb5-b458-4a13-a68a-3d93fc686c6a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:58.452989 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b9accbb5-b458-4a13-a68a-3d93fc686c6a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:58.453434 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b9accbb5-b458-4a13-a68a-3d93fc686c6a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:58.605624 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b9accbb5-b458-4a13-a68a-3d93fc686c6a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:29:58.613867 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b9accbb5-b458-4a13-a68a-3d93fc686c6a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8" status: 200 len: 1359 microversion: 2.1 time: 0.176725 Jul 18 03:29:58.614671 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3576/7170] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:29:58 2022] GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:29:59.633505 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b160170b-707b-4207-90bc-e8d2a5fee901 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:29:59.634532 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b160170b-707b-4207-90bc-e8d2a5fee901 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:29:59.637332 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:29:59.643990 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b160170b-707b-4207-90bc-e8d2a5fee901 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:59.644454 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b160170b-707b-4207-90bc-e8d2a5fee901 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:59.645245 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b160170b-707b-4207-90bc-e8d2a5fee901 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:29:59.645692 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b160170b-707b-4207-90bc-e8d2a5fee901 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:29:59.796525 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b160170b-707b-4207-90bc-e8d2a5fee901 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:29:59.804633 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b160170b-707b-4207-90bc-e8d2a5fee901 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8" status: 200 len: 1359 microversion: 2.1 time: 0.176036 Jul 18 03:29:59.805431 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3595/7171] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:29:59 2022] GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:00.822392 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-085a6e83-b1ee-4eaf-a7f8-b085e59c31bb tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:00.823003 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-085a6e83-b1ee-4eaf-a7f8-b085e59c31bb tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:00.829861 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-085a6e83-b1ee-4eaf-a7f8-b085e59c31bb tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:00.830306 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-085a6e83-b1ee-4eaf-a7f8-b085e59c31bb tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:00.831107 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-085a6e83-b1ee-4eaf-a7f8-b085e59c31bb tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:00.831546 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-085a6e83-b1ee-4eaf-a7f8-b085e59c31bb tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:01.067233 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-085a6e83-b1ee-4eaf-a7f8-b085e59c31bb tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:01.076137 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-085a6e83-b1ee-4eaf-a7f8-b085e59c31bb tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8" status: 200 len: 1359 microversion: 2.1 time: 0.258332 Jul 18 03:30:01.076669 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3577/7172] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:00 2022] GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8 => generated 1359 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:01.356997 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-387ccdef-b16a-4401-9ff8-eedaefac6de7 req-aaa8d27b-dede-4f2a-b873-98504eff5a27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eda04c73-b877-435f-9722-29c2ff9c2cb8", "tag": "068ab293-3044-47a4-8488-75e5f9e0bf7e"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:30:01.362190 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:30:01.363562 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:30:01.370337 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-387ccdef-b16a-4401-9ff8-eedaefac6de7 req-aaa8d27b-dede-4f2a-b873-98504eff5a27 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:01.370868 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-387ccdef-b16a-4401-9ff8-eedaefac6de7 req-aaa8d27b-dede-4f2a-b873-98504eff5a27 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:01.390767 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-387ccdef-b16a-4401-9ff8-eedaefac6de7 req-aaa8d27b-dede-4f2a-b873-98504eff5a27 service nova] Creating event network-changed:068ab293-3044-47a4-8488-75e5f9e0bf7e for instance eda04c73-b877-435f-9722-29c2ff9c2cb8 on n-h2-465891-3 Jul 18 03:30:01.396152 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-387ccdef-b16a-4401-9ff8-eedaefac6de7 req-aaa8d27b-dede-4f2a-b873-98504eff5a27 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043110 Jul 18 03:30:01.397393 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3596/7173] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:30:02.093709 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0f913112-e0a5-4a37-b686-933e8f38723c tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:02.094317 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0f913112-e0a5-4a37-b686-933e8f38723c tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:02.096204 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:30:02.102300 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f913112-e0a5-4a37-b686-933e8f38723c tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:02.102867 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f913112-e0a5-4a37-b686-933e8f38723c tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:02.103630 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f913112-e0a5-4a37-b686-933e8f38723c tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:02.104063 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0f913112-e0a5-4a37-b686-933e8f38723c tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:02.239563 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0f913112-e0a5-4a37-b686-933e8f38723c tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:02.248114 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0f913112-e0a5-4a37-b686-933e8f38723c tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8" status: 200 len: 1359 microversion: 2.1 time: 0.158236 Jul 18 03:30:02.248706 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3578/7174] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:02 2022] GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:03.270475 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cf5abc18-ae7d-4d66-b23a-12127c6eab31 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:03.271043 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cf5abc18-ae7d-4d66-b23a-12127c6eab31 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:03.278618 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cf5abc18-ae7d-4d66-b23a-12127c6eab31 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:03.279417 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cf5abc18-ae7d-4d66-b23a-12127c6eab31 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:03.280650 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cf5abc18-ae7d-4d66-b23a-12127c6eab31 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:03.280650 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cf5abc18-ae7d-4d66-b23a-12127c6eab31 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:03.454470 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cf5abc18-ae7d-4d66-b23a-12127c6eab31 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:03.464558 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cf5abc18-ae7d-4d66-b23a-12127c6eab31 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8" status: 200 len: 1359 microversion: 2.1 time: 0.201597 Jul 18 03:30:03.465183 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3597/7175] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:03 2022] GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8 => generated 1359 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:04.483559 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c813cb95-3631-49ff-a0e3-2b048f0cacd4 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:04.484608 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c813cb95-3631-49ff-a0e3-2b048f0cacd4 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:04.490995 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c813cb95-3631-49ff-a0e3-2b048f0cacd4 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:04.491467 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c813cb95-3631-49ff-a0e3-2b048f0cacd4 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:04.492325 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c813cb95-3631-49ff-a0e3-2b048f0cacd4 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:04.493150 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c813cb95-3631-49ff-a0e3-2b048f0cacd4 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:04.675231 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c813cb95-3631-49ff-a0e3-2b048f0cacd4 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:04.686730 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c813cb95-3631-49ff-a0e3-2b048f0cacd4 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8" status: 200 len: 1359 microversion: 2.1 time: 0.208127 Jul 18 03:30:04.687329 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3579/7176] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:04 2022] GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8 => generated 1359 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:30:05.704460 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-03c72b8e-af6c-4b81-a0fd-7a908a436283 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:05.705083 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-03c72b8e-af6c-4b81-a0fd-7a908a436283 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:05.714009 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-03c72b8e-af6c-4b81-a0fd-7a908a436283 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:05.714471 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-03c72b8e-af6c-4b81-a0fd-7a908a436283 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:05.715248 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-03c72b8e-af6c-4b81-a0fd-7a908a436283 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:05.715695 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-03c72b8e-af6c-4b81-a0fd-7a908a436283 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:05.866701 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-03c72b8e-af6c-4b81-a0fd-7a908a436283 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:05.877987 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-03c72b8e-af6c-4b81-a0fd-7a908a436283 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8" status: 200 len: 1359 microversion: 2.1 time: 0.177237 Jul 18 03:30:05.878618 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3598/7177] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:05 2022] GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8 => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:06.895157 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-617991a0-e476-409c-9276-55f97c60c227 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:06.895804 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-617991a0-e476-409c-9276-55f97c60c227 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:06.903618 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-617991a0-e476-409c-9276-55f97c60c227 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:06.904072 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-617991a0-e476-409c-9276-55f97c60c227 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:06.904836 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-617991a0-e476-409c-9276-55f97c60c227 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:06.905271 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-617991a0-e476-409c-9276-55f97c60c227 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:07.034153 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-617991a0-e476-409c-9276-55f97c60c227 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:07.042746 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-617991a0-e476-409c-9276-55f97c60c227 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8" status: 200 len: 1359 microversion: 2.1 time: 0.151530 Jul 18 03:30:07.043329 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3580/7178] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:06 2022] GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:07.986330 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-2e6d7536-3398-450a-8143-37071387f29a req-1fe85e16-b047-4427-9edb-972cef796686 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eda04c73-b877-435f-9722-29c2ff9c2cb8", "name": "network-vif-plugged", "status": "completed", "tag": "068ab293-3044-47a4-8488-75e5f9e0bf7e"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:30:07.995072 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-2e6d7536-3398-450a-8143-37071387f29a req-1fe85e16-b047-4427-9edb-972cef796686 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:07.995530 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-2e6d7536-3398-450a-8143-37071387f29a req-1fe85e16-b047-4427-9edb-972cef796686 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:08.006887 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-2e6d7536-3398-450a-8143-37071387f29a req-1fe85e16-b047-4427-9edb-972cef796686 service nova] Creating event network-vif-plugged:068ab293-3044-47a4-8488-75e5f9e0bf7e for instance eda04c73-b877-435f-9722-29c2ff9c2cb8 on n-h2-465891-3 Jul 18 03:30:08.012402 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-2e6d7536-3398-450a-8143-37071387f29a req-1fe85e16-b047-4427-9edb-972cef796686 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094656 Jul 18 03:30:08.013013 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3599/7179] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:30:08.061362 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f539e808-5946-40e6-95b1-59c5d4b1e9e8 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:08.061949 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f539e808-5946-40e6-95b1-59c5d4b1e9e8 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:08.069012 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f539e808-5946-40e6-95b1-59c5d4b1e9e8 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:08.069470 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f539e808-5946-40e6-95b1-59c5d4b1e9e8 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:08.070288 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f539e808-5946-40e6-95b1-59c5d4b1e9e8 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:08.070727 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f539e808-5946-40e6-95b1-59c5d4b1e9e8 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:08.255302 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f539e808-5946-40e6-95b1-59c5d4b1e9e8 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:08.263821 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f539e808-5946-40e6-95b1-59c5d4b1e9e8 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8" status: 200 len: 1359 microversion: 2.1 time: 0.207815 Jul 18 03:30:08.264402 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3581/7180] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:08 2022] GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8 => generated 1359 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:09.282029 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3101b749-7d4e-4707-9d18-b6abf6bb94a2 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:09.282628 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3101b749-7d4e-4707-9d18-b6abf6bb94a2 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:09.289165 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3101b749-7d4e-4707-9d18-b6abf6bb94a2 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:09.289629 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3101b749-7d4e-4707-9d18-b6abf6bb94a2 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:09.290447 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3101b749-7d4e-4707-9d18-b6abf6bb94a2 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:09.290902 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3101b749-7d4e-4707-9d18-b6abf6bb94a2 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:09.432107 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3101b749-7d4e-4707-9d18-b6abf6bb94a2 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:09.440078 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3101b749-7d4e-4707-9d18-b6abf6bb94a2 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8" status: 200 len: 1359 microversion: 2.1 time: 0.163266 Jul 18 03:30:09.440802 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3600/7181] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:09 2022] GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:10.457371 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0aaae92f-649f-42de-9f78-ea7a326c21b2 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:10.458109 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0aaae92f-649f-42de-9f78-ea7a326c21b2 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:10.464993 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0aaae92f-649f-42de-9f78-ea7a326c21b2 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:10.465435 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0aaae92f-649f-42de-9f78-ea7a326c21b2 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:10.466219 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0aaae92f-649f-42de-9f78-ea7a326c21b2 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:10.466654 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0aaae92f-649f-42de-9f78-ea7a326c21b2 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:10.620288 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0aaae92f-649f-42de-9f78-ea7a326c21b2 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:10.628113 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0aaae92f-649f-42de-9f78-ea7a326c21b2 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8" status: 200 len: 1549 microversion: 2.1 time: 0.174594 Jul 18 03:30:10.628695 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3582/7182] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:10 2022] GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8 => generated 1549 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:10.645853 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a93a1e2b-40c0-42af-bf15-d456fa493b53 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:10.647059 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a93a1e2b-40c0-42af-bf15-d456fa493b53 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:10.654913 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a93a1e2b-40c0-42af-bf15-d456fa493b53 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:10.655376 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a93a1e2b-40c0-42af-bf15-d456fa493b53 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:10.656168 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a93a1e2b-40c0-42af-bf15-d456fa493b53 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:10.656624 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a93a1e2b-40c0-42af-bf15-d456fa493b53 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:10.794487 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a93a1e2b-40c0-42af-bf15-d456fa493b53 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:10.802450 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a93a1e2b-40c0-42af-bf15-d456fa493b53 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8" status: 200 len: 1549 microversion: 2.1 time: 0.161568 Jul 18 03:30:10.803055 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3601/7183] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:10 2022] GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8 => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:10.818866 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-097ca203-97dd-48fa-b477-57ef517eb736 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:10.823914 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-097ca203-97dd-48fa-b477-57ef517eb736 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:10.824828 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-097ca203-97dd-48fa-b477-57ef517eb736 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Searching by: {'deleted': False, 'project_id': 'f4b72a832ce748028e574fc91b4dae21'} {{(pid=119544) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 03:30:10.831258 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-097ca203-97dd-48fa-b477-57ef517eb736 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:10.831704 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-097ca203-97dd-48fa-b477-57ef517eb736 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:10.832492 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-097ca203-97dd-48fa-b477-57ef517eb736 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:10.832923 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-097ca203-97dd-48fa-b477-57ef517eb736 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:10.859975 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.multi_cell_list [None req-097ca203-97dd-48fa-b477-57ef517eb736 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119544) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 03:30:10.892056 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-097ca203-97dd-48fa-b477-57ef517eb736 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.077012 Jul 18 03:30:10.892813 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3583/7184] 10.222.0.57 () {58 vars in 1124 bytes} [Mon Jul 18 03:30:10 2022] GET /compute/v2.1/servers => generated 343 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:30:10.904294 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3b89f22d-1e9b-4356-8be2-46c4b1c47bfc tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:10.905169 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3b89f22d-1e9b-4356-8be2-46c4b1c47bfc tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:10.911439 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3b89f22d-1e9b-4356-8be2-46c4b1c47bfc tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:10.911833 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3b89f22d-1e9b-4356-8be2-46c4b1c47bfc tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:10.912616 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3b89f22d-1e9b-4356-8be2-46c4b1c47bfc tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:10.913064 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3b89f22d-1e9b-4356-8be2-46c4b1c47bfc tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:11.052958 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3b89f22d-1e9b-4356-8be2-46c4b1c47bfc tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:11.061916 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3b89f22d-1e9b-4356-8be2-46c4b1c47bfc tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8" status: 200 len: 1549 microversion: 2.1 time: 0.162331 Jul 18 03:30:11.062517 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3602/7185] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:10 2022] GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8 => generated 1549 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:12.575343 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e35b5a8c-10ca-4fd1-9a18-d55707be368a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "894b878f-05f3-4cdd-98f4-4e1cab507b03"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:30:12.576404 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e35b5a8c-10ca-4fd1-9a18-d55707be368a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:12.583660 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e35b5a8c-10ca-4fd1-9a18-d55707be368a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:12.584100 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e35b5a8c-10ca-4fd1-9a18-d55707be368a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:12.584870 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e35b5a8c-10ca-4fd1-9a18-d55707be368a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:12.585298 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e35b5a8c-10ca-4fd1-9a18-d55707be368a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:12.831659 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e35b5a8c-10ca-4fd1-9a18-d55707be368a tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "POST /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260858 Jul 18 03:30:12.832317 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3584/7186] 10.222.0.57 () {60 vars in 1322 bytes} [Mon Jul 18 03:30:12 2022] POST /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:30:23.577159 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-53b80ff7-907c-430c-aa46-1a3b3e3e0a9b tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:23.577808 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-53b80ff7-907c-430c-aa46-1a3b3e3e0a9b tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:23.580156 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=15 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:30:23.581017 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=60 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:30:23.586558 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-53b80ff7-907c-430c-aa46-1a3b3e3e0a9b tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:23.587015 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-53b80ff7-907c-430c-aa46-1a3b3e3e0a9b tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:23.587800 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-53b80ff7-907c-430c-aa46-1a3b3e3e0a9b tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:23.588251 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-53b80ff7-907c-430c-aa46-1a3b3e3e0a9b tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:23.722573 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-53b80ff7-907c-430c-aa46-1a3b3e3e0a9b tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:23.730951 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-53b80ff7-907c-430c-aa46-1a3b3e3e0a9b tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8" status: 200 len: 1595 microversion: 2.1 time: 0.157942 Jul 18 03:30:23.731546 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3603/7187] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:23 2022] GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8 => generated 1595 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:25.362174 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:30:25.364558 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=17 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:30:25.366175 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:30:25.375296 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-48c1d5a2-5f7d-491e-a5fa-d9204609c4f0 req-a8a7837a-0c5c-464a-bb5b-ce95bc796c80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eda04c73-b877-435f-9722-29c2ff9c2cb8", "tag": "068ab293-3044-47a4-8488-75e5f9e0bf7e"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:30:25.392846 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-48c1d5a2-5f7d-491e-a5fa-d9204609c4f0 req-a8a7837a-0c5c-464a-bb5b-ce95bc796c80 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:25.392846 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-48c1d5a2-5f7d-491e-a5fa-d9204609c4f0 req-a8a7837a-0c5c-464a-bb5b-ce95bc796c80 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:25.406662 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-48c1d5a2-5f7d-491e-a5fa-d9204609c4f0 req-a8a7837a-0c5c-464a-bb5b-ce95bc796c80 service nova] Creating event network-changed:068ab293-3044-47a4-8488-75e5f9e0bf7e for instance eda04c73-b877-435f-9722-29c2ff9c2cb8 on n-h2-465891-3 Jul 18 03:30:25.412796 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-48c1d5a2-5f7d-491e-a5fa-d9204609c4f0 req-a8a7837a-0c5c-464a-bb5b-ce95bc796c80 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051743 Jul 18 03:30:25.413880 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3585/7188] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:30:26.600047 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4b3b1e84-9e36-4503-9905-2cc601ab64ea tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-154044156"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:30:26.600581 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4b3b1e84-9e36-4503-9905-2cc601ab64ea tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:26.608506 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4b3b1e84-9e36-4503-9905-2cc601ab64ea tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:26.608969 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4b3b1e84-9e36-4503-9905-2cc601ab64ea tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:26.609801 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4b3b1e84-9e36-4503-9905-2cc601ab64ea tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:26.610267 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4b3b1e84-9e36-4503-9905-2cc601ab64ea tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:26.744070 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.network.security_group_api [None req-4b3b1e84-9e36-4503-9905-2cc601ab64ea tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Adding security group d135bcc3-4cd8-4358-876a-cd1c486e2481 to port 068ab293-3044-47a4-8488-75e5f9e0bf7e Jul 18 03:30:27.126169 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4b3b1e84-9e36-4503-9905-2cc601ab64ea tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "POST /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8/action" status: 202 len: 0 microversion: 2.1 time: 0.530268 Jul 18 03:30:27.126964 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3604/7189] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:30:26 2022] POST /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8/action => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:30:27.135216 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-be1aa6fa-5cbe-48a3-987c-bc258e13bf5d req-2c3ed4b8-3e8c-413e-b0fc-ce6c63022303 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eda04c73-b877-435f-9722-29c2ff9c2cb8", "tag": "068ab293-3044-47a4-8488-75e5f9e0bf7e"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:30:27.139964 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1d696b67-cff7-450e-a105-2ad831b73091 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:27.140727 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1d696b67-cff7-450e-a105-2ad831b73091 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:27.148742 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1d696b67-cff7-450e-a105-2ad831b73091 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:27.149342 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1d696b67-cff7-450e-a105-2ad831b73091 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:27.150285 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1d696b67-cff7-450e-a105-2ad831b73091 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:27.150979 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1d696b67-cff7-450e-a105-2ad831b73091 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:27.159372 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-be1aa6fa-5cbe-48a3-987c-bc258e13bf5d req-2c3ed4b8-3e8c-413e-b0fc-ce6c63022303 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:27.160335 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-be1aa6fa-5cbe-48a3-987c-bc258e13bf5d req-2c3ed4b8-3e8c-413e-b0fc-ce6c63022303 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:27.177492 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-be1aa6fa-5cbe-48a3-987c-bc258e13bf5d req-2c3ed4b8-3e8c-413e-b0fc-ce6c63022303 service nova] Creating event network-changed:068ab293-3044-47a4-8488-75e5f9e0bf7e for instance eda04c73-b877-435f-9722-29c2ff9c2cb8 on n-h2-465891-3 Jul 18 03:30:27.185409 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-be1aa6fa-5cbe-48a3-987c-bc258e13bf5d req-2c3ed4b8-3e8c-413e-b0fc-ce6c63022303 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052820 Jul 18 03:30:27.186343 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3586/7190] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:30:27.502215 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1d696b67-cff7-450e-a105-2ad831b73091 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:27.513173 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1d696b67-cff7-450e-a105-2ad831b73091 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8" status: 200 len: 1758 microversion: 2.1 time: 0.379047 Jul 18 03:30:27.514031 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3605/7191] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:27 2022] GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8 => generated 1758 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:43.485046 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:30:43.485991 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:30:43.490613 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6b51ff68-18d6-4a58-af13-7bddb52de76f tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:30:43.491682 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6b51ff68-18d6-4a58-af13-7bddb52de76f tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:43.500307 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b51ff68-18d6-4a58-af13-7bddb52de76f tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:43.500838 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b51ff68-18d6-4a58-af13-7bddb52de76f tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:43.501627 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b51ff68-18d6-4a58-af13-7bddb52de76f tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:43.502097 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6b51ff68-18d6-4a58-af13-7bddb52de76f tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:43.583506 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6b51ff68-18d6-4a58-af13-7bddb52de76f tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "POST /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8/action" status: 202 len: 0 microversion: 2.1 time: 0.100134 Jul 18 03:30:43.587631 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3587/7192] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:30:43 2022] POST /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:30:43.596062 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f4fffc17-53e4-420d-8954-85097919a2dd tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:43.596643 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f4fffc17-53e4-420d-8954-85097919a2dd tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:43.599864 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:30:43.600647 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=16 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:30:43.608814 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f4fffc17-53e4-420d-8954-85097919a2dd tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:43.609575 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f4fffc17-53e4-420d-8954-85097919a2dd tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:43.610685 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f4fffc17-53e4-420d-8954-85097919a2dd tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:43.611271 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f4fffc17-53e4-420d-8954-85097919a2dd tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:43.864317 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f4fffc17-53e4-420d-8954-85097919a2dd tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:43.873319 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f4fffc17-53e4-420d-8954-85097919a2dd tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8" status: 200 len: 1750 microversion: 2.1 time: 0.284117 Jul 18 03:30:43.873949 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3606/7193] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:43 2022] GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8 => generated 1750 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:44.894150 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6e646294-f3bb-43f1-9dde-ae0e7cc0dc2b tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:44.895052 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6e646294-f3bb-43f1-9dde-ae0e7cc0dc2b tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:44.901873 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6e646294-f3bb-43f1-9dde-ae0e7cc0dc2b tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:44.902426 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6e646294-f3bb-43f1-9dde-ae0e7cc0dc2b tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:44.903403 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6e646294-f3bb-43f1-9dde-ae0e7cc0dc2b tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:44.903844 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6e646294-f3bb-43f1-9dde-ae0e7cc0dc2b tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:45.052491 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6e646294-f3bb-43f1-9dde-ae0e7cc0dc2b tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:45.061101 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6e646294-f3bb-43f1-9dde-ae0e7cc0dc2b tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8" status: 200 len: 1755 microversion: 2.1 time: 0.172028 Jul 18 03:30:45.061685 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3588/7194] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:44 2022] GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:46.079309 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1519964d-4e78-4526-bc2b-c692a998c39f tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:46.079956 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1519964d-4e78-4526-bc2b-c692a998c39f tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:46.087421 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1519964d-4e78-4526-bc2b-c692a998c39f tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:46.087882 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1519964d-4e78-4526-bc2b-c692a998c39f tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:46.088676 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1519964d-4e78-4526-bc2b-c692a998c39f tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:46.089121 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1519964d-4e78-4526-bc2b-c692a998c39f tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:46.240012 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1519964d-4e78-4526-bc2b-c692a998c39f tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:46.248714 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1519964d-4e78-4526-bc2b-c692a998c39f tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8" status: 200 len: 1755 microversion: 2.1 time: 0.173324 Jul 18 03:30:46.249320 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3607/7195] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:46 2022] GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:30:47.267562 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-96c1ea91-0f74-4880-92fc-999d342d6348 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:47.268171 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-96c1ea91-0f74-4880-92fc-999d342d6348 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:47.275220 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-96c1ea91-0f74-4880-92fc-999d342d6348 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:47.275666 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-96c1ea91-0f74-4880-92fc-999d342d6348 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:47.276440 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-96c1ea91-0f74-4880-92fc-999d342d6348 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:47.276884 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-96c1ea91-0f74-4880-92fc-999d342d6348 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:47.431037 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-96c1ea91-0f74-4880-92fc-999d342d6348 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:47.439409 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-96c1ea91-0f74-4880-92fc-999d342d6348 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8" status: 200 len: 1755 microversion: 2.1 time: 0.175732 Jul 18 03:30:47.440007 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3589/7196] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:47 2022] GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8 => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:48.458083 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1c79c49e-bd7e-4ef7-baf4-d6ee7b93cd36 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:48.458739 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1c79c49e-bd7e-4ef7-baf4-d6ee7b93cd36 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:48.464921 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c79c49e-bd7e-4ef7-baf4-d6ee7b93cd36 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:48.465386 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c79c49e-bd7e-4ef7-baf4-d6ee7b93cd36 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:48.466818 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c79c49e-bd7e-4ef7-baf4-d6ee7b93cd36 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:48.467274 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1c79c49e-bd7e-4ef7-baf4-d6ee7b93cd36 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:48.612938 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1c79c49e-bd7e-4ef7-baf4-d6ee7b93cd36 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:48.620982 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1c79c49e-bd7e-4ef7-baf4-d6ee7b93cd36 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8" status: 200 len: 1755 microversion: 2.1 time: 0.167276 Jul 18 03:30:48.621564 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3608/7197] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:48 2022] GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:49.638816 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1b1122e4-aa8a-4ae1-8d42-253952edfbd9 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:49.639451 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1b1122e4-aa8a-4ae1-8d42-253952edfbd9 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:49.646421 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1b1122e4-aa8a-4ae1-8d42-253952edfbd9 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:49.646864 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1b1122e4-aa8a-4ae1-8d42-253952edfbd9 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:49.647632 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1b1122e4-aa8a-4ae1-8d42-253952edfbd9 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:49.648067 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1b1122e4-aa8a-4ae1-8d42-253952edfbd9 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:49.795648 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1b1122e4-aa8a-4ae1-8d42-253952edfbd9 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:49.803861 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1b1122e4-aa8a-4ae1-8d42-253952edfbd9 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8" status: 200 len: 1755 microversion: 2.1 time: 0.169479 Jul 18 03:30:49.804438 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3590/7198] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:49 2022] GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:50.822189 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e6da32cb-e704-49a2-85db-da5c6958b10b tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:50.822812 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e6da32cb-e704-49a2-85db-da5c6958b10b tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:50.830205 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e6da32cb-e704-49a2-85db-da5c6958b10b tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:50.830671 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e6da32cb-e704-49a2-85db-da5c6958b10b tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:50.831460 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e6da32cb-e704-49a2-85db-da5c6958b10b tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:50.831899 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e6da32cb-e704-49a2-85db-da5c6958b10b tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:50.973779 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e6da32cb-e704-49a2-85db-da5c6958b10b tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:50.983178 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e6da32cb-e704-49a2-85db-da5c6958b10b tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8" status: 200 len: 1755 microversion: 2.1 time: 0.164858 Jul 18 03:30:50.983765 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3609/7199] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:50 2022] GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:52.000720 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-24b61d2f-c9b7-4ab6-a2e3-5f6d807c0577 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:52.001306 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-24b61d2f-c9b7-4ab6-a2e3-5f6d807c0577 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:52.008528 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-24b61d2f-c9b7-4ab6-a2e3-5f6d807c0577 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:52.008974 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-24b61d2f-c9b7-4ab6-a2e3-5f6d807c0577 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:52.009770 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-24b61d2f-c9b7-4ab6-a2e3-5f6d807c0577 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:52.010212 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-24b61d2f-c9b7-4ab6-a2e3-5f6d807c0577 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:52.159934 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-24b61d2f-c9b7-4ab6-a2e3-5f6d807c0577 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:52.168179 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-24b61d2f-c9b7-4ab6-a2e3-5f6d807c0577 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8" status: 200 len: 1755 microversion: 2.1 time: 0.171913 Jul 18 03:30:52.168747 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3591/7200] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:51 2022] GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:53.186587 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-41510b1d-3eda-4951-b9c7-c359171f5f57 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:53.187208 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-41510b1d-3eda-4951-b9c7-c359171f5f57 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:53.194188 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41510b1d-3eda-4951-b9c7-c359171f5f57 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:53.194621 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41510b1d-3eda-4951-b9c7-c359171f5f57 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:53.195405 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41510b1d-3eda-4951-b9c7-c359171f5f57 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:53.195853 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-41510b1d-3eda-4951-b9c7-c359171f5f57 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:53.341848 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-41510b1d-3eda-4951-b9c7-c359171f5f57 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:53.350063 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-41510b1d-3eda-4951-b9c7-c359171f5f57 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8" status: 200 len: 1755 microversion: 2.1 time: 0.168114 Jul 18 03:30:53.350653 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3610/7201] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:53 2022] GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:54.368227 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9ce4a267-b75a-4a78-8bca-54fe0b217464 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:54.368875 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9ce4a267-b75a-4a78-8bca-54fe0b217464 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:54.376647 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9ce4a267-b75a-4a78-8bca-54fe0b217464 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:54.377103 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9ce4a267-b75a-4a78-8bca-54fe0b217464 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:54.377912 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9ce4a267-b75a-4a78-8bca-54fe0b217464 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:54.378352 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9ce4a267-b75a-4a78-8bca-54fe0b217464 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:54.527435 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9ce4a267-b75a-4a78-8bca-54fe0b217464 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:54.535537 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9ce4a267-b75a-4a78-8bca-54fe0b217464 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8" status: 200 len: 1755 microversion: 2.1 time: 0.171186 Jul 18 03:30:54.536109 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3592/7202] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:54 2022] GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:55.552534 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d2a3ce06-35e8-4064-81e7-d293b3bdeca4 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:55.553166 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d2a3ce06-35e8-4064-81e7-d293b3bdeca4 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:55.560967 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d2a3ce06-35e8-4064-81e7-d293b3bdeca4 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:55.561445 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d2a3ce06-35e8-4064-81e7-d293b3bdeca4 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:55.562268 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d2a3ce06-35e8-4064-81e7-d293b3bdeca4 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:55.562723 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d2a3ce06-35e8-4064-81e7-d293b3bdeca4 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:55.716997 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d2a3ce06-35e8-4064-81e7-d293b3bdeca4 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:55.724967 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d2a3ce06-35e8-4064-81e7-d293b3bdeca4 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8" status: 200 len: 1758 microversion: 2.1 time: 0.176439 Jul 18 03:30:55.725543 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3611/7203] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:55 2022] GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8 => generated 1758 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:31:28.011277 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e48191de-0424-4d13-9544-e3ba2888d8aa tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-154044156"}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:31:28.011902 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e48191de-0424-4d13-9544-e3ba2888d8aa tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:31:28.014315 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=12 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:31:28.015037 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:31:28.021486 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e48191de-0424-4d13-9544-e3ba2888d8aa tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:31:28.021956 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e48191de-0424-4d13-9544-e3ba2888d8aa tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:31:28.022719 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e48191de-0424-4d13-9544-e3ba2888d8aa tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:31:28.023151 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e48191de-0424-4d13-9544-e3ba2888d8aa tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:31:28.157659 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.network.security_group_api [None req-e48191de-0424-4d13-9544-e3ba2888d8aa tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Removing security group d135bcc3-4cd8-4358-876a-cd1c486e2481 from port 068ab293-3044-47a4-8488-75e5f9e0bf7e Jul 18 03:31:28.821197 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e48191de-0424-4d13-9544-e3ba2888d8aa tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "POST /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8/action" status: 202 len: 0 microversion: 2.1 time: 0.814058 Jul 18 03:31:28.822080 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3593/7204] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:31:28 2022] POST /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8/action => generated 0 bytes in 816 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 03:31:28.830705 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-ae109438-16f1-4c54-96b5-60bcdd38551c req-07d45f90-4e41-4a58-a6fc-27be224cac19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eda04c73-b877-435f-9722-29c2ff9c2cb8", "tag": "068ab293-3044-47a4-8488-75e5f9e0bf7e"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:31:28.841074 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=12 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:31:28.842716 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=36 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:31:28.847024 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-ae109438-16f1-4c54-96b5-60bcdd38551c req-07d45f90-4e41-4a58-a6fc-27be224cac19 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:31:28.848067 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-ae109438-16f1-4c54-96b5-60bcdd38551c req-07d45f90-4e41-4a58-a6fc-27be224cac19 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:31:28.888053 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-ae109438-16f1-4c54-96b5-60bcdd38551c req-07d45f90-4e41-4a58-a6fc-27be224cac19 service nova] Creating event network-changed:068ab293-3044-47a4-8488-75e5f9e0bf7e for instance eda04c73-b877-435f-9722-29c2ff9c2cb8 on n-h2-465891-3 Jul 18 03:31:28.895396 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-ae109438-16f1-4c54-96b5-60bcdd38551c req-07d45f90-4e41-4a58-a6fc-27be224cac19 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070327 Jul 18 03:31:28.900110 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3612/7205] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:31:30.224036 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1eb321a5-07be-4ce7-87f8-c5df0a8ff542 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:31:30.224596 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1eb321a5-07be-4ce7-87f8-c5df0a8ff542 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:31:30.230732 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1eb321a5-07be-4ce7-87f8-c5df0a8ff542 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:31:30.231180 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1eb321a5-07be-4ce7-87f8-c5df0a8ff542 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:31:30.231940 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1eb321a5-07be-4ce7-87f8-c5df0a8ff542 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:31:30.232900 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1eb321a5-07be-4ce7-87f8-c5df0a8ff542 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:31:30.316843 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-1eb321a5-07be-4ce7-87f8-c5df0a8ff542 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lazy-loading 'services' on Instance uuid eda04c73-b877-435f-9722-29c2ff9c2cb8 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:31:30.391295 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1eb321a5-07be-4ce7-87f8-c5df0a8ff542 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "DELETE /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8/os-volume_attachments/894b878f-05f3-4cdd-98f4-4e1cab507b03" status: 202 len: 0 microversion: 2.1 time: 0.172137 Jul 18 03:31:30.391897 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3594/7206] 10.222.0.57 () {58 vars in 1415 bytes} [Mon Jul 18 03:31:30 2022] DELETE /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8/os-volume_attachments/894b878f-05f3-4cdd-98f4-4e1cab507b03 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:31:30.402636 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-84d1a26b-a021-4750-aa87-ac87c66139e3 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:31:30.403946 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-84d1a26b-a021-4750-aa87-ac87c66139e3 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:31:30.411231 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-84d1a26b-a021-4750-aa87-ac87c66139e3 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:31:30.411878 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-84d1a26b-a021-4750-aa87-ac87c66139e3 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:31:30.412669 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-84d1a26b-a021-4750-aa87-ac87c66139e3 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:31:30.413148 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-84d1a26b-a021-4750-aa87-ac87c66139e3 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:31:30.445422 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-84d1a26b-a021-4750-aa87-ac87c66139e3 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048653 Jul 18 03:31:30.446242 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3613/7207] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 03:31:30 2022] GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:31:30.912689 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-89e84412-74b8-4f5a-b6ad-89f59ce10411 req-f18ad5a6-f97a-43eb-84de-ad4271ec3c55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eda04c73-b877-435f-9722-29c2ff9c2cb8", "tag": "068ab293-3044-47a4-8488-75e5f9e0bf7e"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:31:30.922197 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-89e84412-74b8-4f5a-b6ad-89f59ce10411 req-f18ad5a6-f97a-43eb-84de-ad4271ec3c55 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:31:30.922653 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-89e84412-74b8-4f5a-b6ad-89f59ce10411 req-f18ad5a6-f97a-43eb-84de-ad4271ec3c55 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:31:30.936161 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-89e84412-74b8-4f5a-b6ad-89f59ce10411 req-f18ad5a6-f97a-43eb-84de-ad4271ec3c55 service nova] Creating event network-changed:068ab293-3044-47a4-8488-75e5f9e0bf7e for instance eda04c73-b877-435f-9722-29c2ff9c2cb8 on n-h2-465891-3 Jul 18 03:31:30.942232 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-89e84412-74b8-4f5a-b6ad-89f59ce10411 req-f18ad5a6-f97a-43eb-84de-ad4271ec3c55 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035261 Jul 18 03:31:30.942885 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3595/7208] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:31:31.458204 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-79a3cf5e-f9e5-466b-83ed-c9d41e9331da tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:31:31.459277 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-79a3cf5e-f9e5-466b-83ed-c9d41e9331da tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:31:31.466702 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-79a3cf5e-f9e5-466b-83ed-c9d41e9331da tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:31:31.467253 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-79a3cf5e-f9e5-466b-83ed-c9d41e9331da tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:31:31.468283 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-79a3cf5e-f9e5-466b-83ed-c9d41e9331da tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:31:31.468816 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-79a3cf5e-f9e5-466b-83ed-c9d41e9331da tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:31:31.512488 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-79a3cf5e-f9e5-466b-83ed-c9d41e9331da tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059621 Jul 18 03:31:31.513956 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3614/7209] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 03:31:31 2022] GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:31:32.525396 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d44ff1d6-2f55-49ec-acf1-640cedbde8b8 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:31:32.526499 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d44ff1d6-2f55-49ec-acf1-640cedbde8b8 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:31:32.533952 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d44ff1d6-2f55-49ec-acf1-640cedbde8b8 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:31:32.534416 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d44ff1d6-2f55-49ec-acf1-640cedbde8b8 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:31:32.535210 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d44ff1d6-2f55-49ec-acf1-640cedbde8b8 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:31:32.535653 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d44ff1d6-2f55-49ec-acf1-640cedbde8b8 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:31:32.571836 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d44ff1d6-2f55-49ec-acf1-640cedbde8b8 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050828 Jul 18 03:31:32.572428 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3596/7210] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 03:31:32 2022] GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:31:33.585480 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9edc9eb1-3374-4626-8bc8-5d36d44a4646 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:31:33.586588 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9edc9eb1-3374-4626-8bc8-5d36d44a4646 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:31:33.593997 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9edc9eb1-3374-4626-8bc8-5d36d44a4646 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:31:33.594464 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9edc9eb1-3374-4626-8bc8-5d36d44a4646 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:31:33.596768 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9edc9eb1-3374-4626-8bc8-5d36d44a4646 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:31:33.597137 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9edc9eb1-3374-4626-8bc8-5d36d44a4646 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:31:33.628223 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9edc9eb1-3374-4626-8bc8-5d36d44a4646 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048313 Jul 18 03:31:33.628840 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3615/7211] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 03:31:33 2022] GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:31:34.640225 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2ea0a98b-d13a-49d1-915a-65c6dc32a726 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:31:34.641159 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2ea0a98b-d13a-49d1-915a-65c6dc32a726 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:31:34.648304 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ea0a98b-d13a-49d1-915a-65c6dc32a726 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:31:34.648757 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ea0a98b-d13a-49d1-915a-65c6dc32a726 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:31:34.649529 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ea0a98b-d13a-49d1-915a-65c6dc32a726 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:31:34.650003 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ea0a98b-d13a-49d1-915a-65c6dc32a726 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:31:34.680703 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2ea0a98b-d13a-49d1-915a-65c6dc32a726 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044465 Jul 18 03:31:34.681280 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3597/7212] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 03:31:34 2022] GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:31:35.692462 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c5d81eb2-3bf2-4697-b359-6aa6bee4fa80 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:31:35.693435 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c5d81eb2-3bf2-4697-b359-6aa6bee4fa80 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:31:35.700438 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c5d81eb2-3bf2-4697-b359-6aa6bee4fa80 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:31:35.700962 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c5d81eb2-3bf2-4697-b359-6aa6bee4fa80 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:31:35.701777 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c5d81eb2-3bf2-4697-b359-6aa6bee4fa80 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:31:35.702237 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c5d81eb2-3bf2-4697-b359-6aa6bee4fa80 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:31:35.731329 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c5d81eb2-3bf2-4697-b359-6aa6bee4fa80 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043612 Jul 18 03:31:35.731891 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3616/7213] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 03:31:35 2022] GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 03:31:35.742419 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8c02abd4-1e68-4d9a-b865-3229269aa09d tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:31:35.742954 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8c02abd4-1e68-4d9a-b865-3229269aa09d tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:31:35.749834 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8c02abd4-1e68-4d9a-b865-3229269aa09d tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:31:35.750282 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8c02abd4-1e68-4d9a-b865-3229269aa09d tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:31:35.751033 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8c02abd4-1e68-4d9a-b865-3229269aa09d tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:31:35.751465 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8c02abd4-1e68-4d9a-b865-3229269aa09d tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:31:35.825725 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-8c02abd4-1e68-4d9a-b865-3229269aa09d tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] HTTP exception thrown: Instance eda04c73-b877-435f-9722-29c2ff9c2cb8 is not attached to volume 894b878f-05f3-4cdd-98f4-4e1cab507b03 Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8c02abd4-1e68-4d9a-b865-3229269aa09d tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Request method failure captured: Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: request: DELETE /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8/os-volume_attachments/894b878f-05f3-4cdd-98f4-4e1cab507b03 HTTP/1.1 Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1NJwYm6gk5iUC6LdmmRMHQ_GEeg-3VK3XTXeeZuTX2bX-ssDHhGrv94-2U4ZhAmgMOEFa3YvNksNDG0-UZViJTnxP4QehBWqqz3a_CsZ5IB1_KhRWktxDkJMe0ZF25o0HjFUVMx6BlMuCJAfUTtr9gBBU3t54ARw0hxXOLVa1Q8wZi4 Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: f4b72a832ce748028e574fc91b4dae21 Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-TestMinimumBasicScenario-1607100642 Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f4b72a832ce748028e574fc91b4dae21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f4b72a832ce748028e574fc91b4dae21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f4b72a832ce748028e574fc91b4dae21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f4b72a832ce748028e574fc91b4dae21"}]}] Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-TestMinimumBasicScenario-1607100642 Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: f4b72a832ce748028e574fc91b4dae21 Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1607100642 Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-TestMinimumBasicScenario-1607100642-project Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: a0d6e0c353ca47939c9ba0da92794704 Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-TestMinimumBasicScenario-1607100642-project Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance eda04c73-b877-435f-9722-29c2ff9c2cb8 is not attached to volume 894b878f-05f3-4cdd-98f4-4e1cab507b03 Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'server_id': 'eda04c73-b877-435f-9722-29c2ff9c2cb8', 'id': '894b878f-05f3-4cdd-98f4-4e1cab507b03'} Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 894b878f-05f3-4cdd-98f4-4e1cab507b03. Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eda04c73-b877-435f-9722-29c2ff9c2cb8 is not attached to volume 894b878f-05f3-4cdd-98f4-4e1cab507b03 Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:31:35.827384 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:31:35.832597 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:31:35.832597 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:31:35.832597 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eda04c73-b877-435f-9722-29c2ff9c2cb8 is not attached to volume 894b878f-05f3-4cdd-98f4-4e1cab507b03 Jul 18 03:31:35.832597 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:31:35.832597 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8c02abd4-1e68-4d9a-b865-3229269aa09d tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Returning 404 to user: Instance eda04c73-b877-435f-9722-29c2ff9c2cb8 is not attached to volume 894b878f-05f3-4cdd-98f4-4e1cab507b03 {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:31:35.832597 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8c02abd4-1e68-4d9a-b865-3229269aa09d tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "DELETE /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8/os-volume_attachments/894b878f-05f3-4cdd-98f4-4e1cab507b03" status: 404 len: 154 microversion: 2.1 time: 0.090925 Jul 18 03:31:35.832597 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3598/7214] 10.222.0.57 () {58 vars in 1415 bytes} [Mon Jul 18 03:31:35 2022] DELETE /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8/os-volume_attachments/894b878f-05f3-4cdd-98f4-4e1cab507b03 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:31:39.102318 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f1cee510-a7be-4758-a602-f68f49c749cb tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:31:39.103449 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f1cee510-a7be-4758-a602-f68f49c749cb tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:31:39.110720 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f1cee510-a7be-4758-a602-f68f49c749cb tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:31:39.111192 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f1cee510-a7be-4758-a602-f68f49c749cb tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:31:39.112005 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f1cee510-a7be-4758-a602-f68f49c749cb tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:31:39.112710 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f1cee510-a7be-4758-a602-f68f49c749cb tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:31:39.138585 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f1cee510-a7be-4758-a602-f68f49c749cb tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:31:39.221694 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f1cee510-a7be-4758-a602-f68f49c749cb tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "DELETE /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8" status: 204 len: 0 microversion: 2.1 time: 0.123201 Jul 18 03:31:39.222926 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3617/7215] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:31:39 2022] DELETE /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:31:39.232047 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-84f6e34e-401e-4654-bb63-b560747e5b15 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:31:39.232666 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-84f6e34e-401e-4654-bb63-b560747e5b15 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:31:39.243954 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-84f6e34e-401e-4654-bb63-b560747e5b15 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:31:39.244411 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-84f6e34e-401e-4654-bb63-b560747e5b15 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:31:39.245202 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-84f6e34e-401e-4654-bb63-b560747e5b15 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:31:39.245641 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-84f6e34e-401e-4654-bb63-b560747e5b15 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:31:39.385472 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-84f6e34e-401e-4654-bb63-b560747e5b15 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:31:39.393407 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-84f6e34e-401e-4654-bb63-b560747e5b15 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8" status: 200 len: 1555 microversion: 2.1 time: 0.165400 Jul 18 03:31:39.394037 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3599/7216] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:31:39 2022] GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8 => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:31:40.411309 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-28dd278e-e2cc-46ca-ad48-9eebd8b159e9 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:31:40.412021 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-28dd278e-e2cc-46ca-ad48-9eebd8b159e9 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:31:40.419655 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-28dd278e-e2cc-46ca-ad48-9eebd8b159e9 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:31:40.420124 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-28dd278e-e2cc-46ca-ad48-9eebd8b159e9 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:31:40.420907 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-28dd278e-e2cc-46ca-ad48-9eebd8b159e9 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:31:40.421361 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-28dd278e-e2cc-46ca-ad48-9eebd8b159e9 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:31:40.552744 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-28dd278e-e2cc-46ca-ad48-9eebd8b159e9 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:31:40.560568 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-28dd278e-e2cc-46ca-ad48-9eebd8b159e9 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8" status: 200 len: 1555 microversion: 2.1 time: 0.153613 Jul 18 03:31:40.561188 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3618/7217] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:31:40 2022] GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8 => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:31:41.548320 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-542d8809-4c61-4710-ad62-c12f0a7b1425 req-f1c383d2-be59-464c-924a-2bae810f00f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eda04c73-b877-435f-9722-29c2ff9c2cb8", "name": "network-vif-deleted", "tag": "068ab293-3044-47a4-8488-75e5f9e0bf7e"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:31:41.560084 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-542d8809-4c61-4710-ad62-c12f0a7b1425 req-f1c383d2-be59-464c-924a-2bae810f00f2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:31:41.560548 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-542d8809-4c61-4710-ad62-c12f0a7b1425 req-f1c383d2-be59-464c-924a-2bae810f00f2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:31:41.574858 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-542d8809-4c61-4710-ad62-c12f0a7b1425 req-f1c383d2-be59-464c-924a-2bae810f00f2 service nova] Creating event network-vif-deleted:068ab293-3044-47a4-8488-75e5f9e0bf7e for instance eda04c73-b877-435f-9722-29c2ff9c2cb8 on n-h2-465891-3 Jul 18 03:31:41.582540 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fc08e237-e29e-4a9a-b9ff-ff18e193da4f tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:31:41.583275 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-542d8809-4c61-4710-ad62-c12f0a7b1425 req-f1c383d2-be59-464c-924a-2bae810f00f2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038753 Jul 18 03:31:41.583636 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fc08e237-e29e-4a9a-b9ff-ff18e193da4f tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:31:41.584252 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3600/7218] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:31:41.593149 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fc08e237-e29e-4a9a-b9ff-ff18e193da4f tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:31:41.593694 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fc08e237-e29e-4a9a-b9ff-ff18e193da4f tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:31:41.594790 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fc08e237-e29e-4a9a-b9ff-ff18e193da4f tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:31:41.596166 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fc08e237-e29e-4a9a-b9ff-ff18e193da4f tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:31:41.681503 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fc08e237-e29e-4a9a-b9ff-ff18e193da4f tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d6e0c353ca47939c9ba0da92794704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b72a832ce748028e574fc91b4dae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:31:41.689648 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fc08e237-e29e-4a9a-b9ff-ff18e193da4f tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8" status: 200 len: 1344 microversion: 2.1 time: 0.114254 Jul 18 03:31:41.690422 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3619/7219] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:31:41 2022] GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8 => generated 1344 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:31:42.707983 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ba44427b-f835-4bbb-8c01-f12701155551 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:31:42.708670 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ba44427b-f835-4bbb-8c01-f12701155551 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] [instance: eda04c73-b877-435f-9722-29c2ff9c2cb8] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:31:42.715872 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba44427b-f835-4bbb-8c01-f12701155551 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:31:42.716314 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba44427b-f835-4bbb-8c01-f12701155551 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:31:42.717077 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba44427b-f835-4bbb-8c01-f12701155551 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:31:42.717508 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba44427b-f835-4bbb-8c01-f12701155551 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:31:42.731400 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-ba44427b-f835-4bbb-8c01-f12701155551 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] HTTP exception thrown: Instance eda04c73-b877-435f-9722-29c2ff9c2cb8 could not be found. Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ba44427b-f835-4bbb-8c01-f12701155551 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Request method failure captured: Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8 HTTP/1.1 Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1NJwYm6gk5iUC6LdmmRMHQ_GEeg-3VK3XTXeeZuTX2bX-ssDHhGrv94-2U4ZhAmgMOEFa3YvNksNDG0-UZViJTnxP4QehBWqqz3a_CsZ5IB1_KhRWktxDkJMe0ZF25o0HjFUVMx6BlMuCJAfUTtr9gBBU3t54ARw0hxXOLVa1Q8wZi4 Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: f4b72a832ce748028e574fc91b4dae21 Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-TestMinimumBasicScenario-1607100642 Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f4b72a832ce748028e574fc91b4dae21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f4b72a832ce748028e574fc91b4dae21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f4b72a832ce748028e574fc91b4dae21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f4b72a832ce748028e574fc91b4dae21"}]}] Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-TestMinimumBasicScenario-1607100642 Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: f4b72a832ce748028e574fc91b4dae21 Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1607100642 Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-TestMinimumBasicScenario-1607100642-project Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: a0d6e0c353ca47939c9ba0da92794704 Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-TestMinimumBasicScenario-1607100642-project Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance eda04c73-b877-435f-9722-29c2ff9c2cb8 could not be found. Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'eda04c73-b877-435f-9722-29c2ff9c2cb8'} Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eda04c73-b877-435f-9722-29c2ff9c2cb8 could not be found. Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eda04c73-b877-435f-9722-29c2ff9c2cb8 could not be found. Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:31:42.733037 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:31:42.738518 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:31:42.738518 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:31:42.738518 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:31:42.738518 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:31:42.738518 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:31:42.738518 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eda04c73-b877-435f-9722-29c2ff9c2cb8 could not be found. Jul 18 03:31:42.738518 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:31:42.738518 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ba44427b-f835-4bbb-8c01-f12701155551 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Returning 404 to user: Instance eda04c73-b877-435f-9722-29c2ff9c2cb8 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:31:42.738518 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ba44427b-f835-4bbb-8c01-f12701155551 tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8" status: 404 len: 111 microversion: 2.1 time: 0.031538 Jul 18 03:31:42.738518 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3601/7220] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:31:42 2022] GET /compute/v2.1/servers/eda04c73-b877-435f-9722-29c2ff9c2cb8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:31:42.743575 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cfb958bb-4aa0-4ae3-8e7d-bb08637a1c1e tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] Calling method '.version_select at 0x7ff49bb6d160>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:31:42.762979 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cfb958bb-4aa0-4ae3-8e7d-bb08637a1c1e tempest-TestMinimumBasicScenario-1607100642 tempest-TestMinimumBasicScenario-1607100642-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1612337742" status: 202 len: 0 microversion: 2.1 time: 0.023143 Jul 18 03:31:42.763562 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3620/7221] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 03:31:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1612337742 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 03:31:52.207820 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e35e67fb-563d-41ff-8e85-112607125be3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Action: 'create', calling method: .version_select at 0x7ff4a8518b80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-218041353", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrR/hNvn8pONfiKxDfulPceoq9Q2i4jbtOwUeEkK6s+xFmwToKqrS4BVLBongMkniZ3nKlRct10O1nIECeZyPK4zcGNUyKIYrq2Qm+TSAyYEPYQycbbL8GQlQYHLVAsJg=="}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:31:52.223740 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-e35e67fb-563d-41ff-8e85-112607125be3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Getting quotas for project 2d9c17c023e1420c8d90b96e2af98172. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:31:52.228900 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-e35e67fb-563d-41ff-8e85-112607125be3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Getting quotas for user 921716a730f64ccdbbced6d4bbf715b0 and project 2d9c17c023e1420c8d90b96e2af98172. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:31:52.252976 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e35e67fb-563d-41ff-8e85-112607125be3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.210808 Jul 18 03:31:52.253591 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3602/7222] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 03:31:52 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:31:58.623144 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:31:58.623934 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:31:58.629480 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-72df0732-29c8-4610-852b-fc6307280b65 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-629309209", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "91a54846-ea4a-458f-aa01-1bb1362381e8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-218041353", "security_groups": [{"name": "tempest-secgroup-smoke-1738749300"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:31:58.839644 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-72df0732-29c8-4610-852b-fc6307280b65 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] validate_networks() for [('91a54846-ea4a-458f-aa01-1bb1362381e8', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:31:59.321905 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-72df0732-29c8-4610-852b-fc6307280b65 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:31:59.322371 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-72df0732-29c8-4610-852b-fc6307280b65 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:31:59.322862 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-72df0732-29c8-4610-852b-fc6307280b65 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:31:59.323286 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-72df0732-29c8-4610-852b-fc6307280b65 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:31:59.323716 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-72df0732-29c8-4610-852b-fc6307280b65 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:31:59.333517 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-72df0732-29c8-4610-852b-fc6307280b65 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:31:59.334015 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-72df0732-29c8-4610-852b-fc6307280b65 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:31:59.335043 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-72df0732-29c8-4610-852b-fc6307280b65 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:31:59.335662 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-72df0732-29c8-4610-852b-fc6307280b65 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:31:59.357129 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-72df0732-29c8-4610-852b-fc6307280b65 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Getting quotas for project 2d9c17c023e1420c8d90b96e2af98172. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:31:59.362859 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-72df0732-29c8-4610-852b-fc6307280b65 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Getting quotas for user 921716a730f64ccdbbced6d4bbf715b0 and project 2d9c17c023e1420c8d90b96e2af98172. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:31:59.375745 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-72df0732-29c8-4610-852b-fc6307280b65 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:31:59.378767 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-72df0732-29c8-4610-852b-fc6307280b65 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: a97981e5-ab6c-4fab-9cff-94446840e03b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:31:59.426022 n-d-465891-3 devstack@n-api.service[119543]: ERROR oslo.messaging._drivers.impl_rabbit [None req-72df0732-29c8-4610-852b-fc6307280b65 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [b2893d04-05b6-4e6b-bff9-dfc603076094] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 03:32:00.435231 n-d-465891-3 devstack@n-api.service[119543]: INFO oslo.messaging._drivers.impl_rabbit [None req-72df0732-29c8-4610-852b-fc6307280b65 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [b2893d04-05b6-4e6b-bff9-dfc603076094] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 52796. Jul 18 03:32:00.440257 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-72df0732-29c8-4610-852b-fc6307280b65 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.819717 Jul 18 03:32:00.441379 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3621/7223] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:31:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 1821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:32:00.448398 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:32:00.454020 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-17e83209-c184-4dc3-a8a5-15a3d3f4d996 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:00.454770 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-17e83209-c184-4dc3-a8a5-15a3d3f4d996 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: a97981e5-ab6c-4fab-9cff-94446840e03b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:00.456980 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:32:00.523881 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-17e83209-c184-4dc3-a8a5-15a3d3f4d996 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:00.532222 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-17e83209-c184-4dc3-a8a5-15a3d3f4d996 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b" status: 200 len: 1265 microversion: 2.1 time: 0.084569 Jul 18 03:32:00.533197 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3603/7224] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:00 2022] GET /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b => generated 1265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:01.551067 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e507542b-6580-4251-a514-a820f094735b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:01.551704 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e507542b-6580-4251-a514-a820f094735b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: a97981e5-ab6c-4fab-9cff-94446840e03b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:01.558478 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e507542b-6580-4251-a514-a820f094735b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:01.559497 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e507542b-6580-4251-a514-a820f094735b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:01.559736 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e507542b-6580-4251-a514-a820f094735b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:01.560197 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e507542b-6580-4251-a514-a820f094735b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:01.625144 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e507542b-6580-4251-a514-a820f094735b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:01.633721 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e507542b-6580-4251-a514-a820f094735b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b" status: 200 len: 1317 microversion: 2.1 time: 0.087672 Jul 18 03:32:01.634383 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3622/7225] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:01 2022] GET /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b => generated 1317 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:02.652365 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b49214b4-5f11-4186-bbe8-d00d3f75fa9c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:02.652838 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b49214b4-5f11-4186-bbe8-d00d3f75fa9c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: a97981e5-ab6c-4fab-9cff-94446840e03b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:02.662031 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b49214b4-5f11-4186-bbe8-d00d3f75fa9c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:02.662491 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b49214b4-5f11-4186-bbe8-d00d3f75fa9c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:02.663266 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b49214b4-5f11-4186-bbe8-d00d3f75fa9c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:02.663713 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b49214b4-5f11-4186-bbe8-d00d3f75fa9c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:02.923386 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b49214b4-5f11-4186-bbe8-d00d3f75fa9c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:02.931463 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b49214b4-5f11-4186-bbe8-d00d3f75fa9c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b" status: 200 len: 1391 microversion: 2.1 time: 0.283455 Jul 18 03:32:02.932060 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3604/7226] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:02 2022] GET /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b => generated 1391 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:03.256762 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-d72b1d37-2c27-44ac-b4bc-bab8a54e6ac9 req-b4dc31c5-59f3-4d14-b747-8f722630f512 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a97981e5-ab6c-4fab-9cff-94446840e03b", "tag": "6bc7199d-bfc5-4f0c-856f-86577e620c56"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:32:03.276877 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-d72b1d37-2c27-44ac-b4bc-bab8a54e6ac9 req-b4dc31c5-59f3-4d14-b747-8f722630f512 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:03.277356 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-d72b1d37-2c27-44ac-b4bc-bab8a54e6ac9 req-b4dc31c5-59f3-4d14-b747-8f722630f512 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:03.289842 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-d72b1d37-2c27-44ac-b4bc-bab8a54e6ac9 req-b4dc31c5-59f3-4d14-b747-8f722630f512 service nova] Creating event network-changed:6bc7199d-bfc5-4f0c-856f-86577e620c56 for instance a97981e5-ab6c-4fab-9cff-94446840e03b on n-h1-465891-3 Jul 18 03:32:03.296609 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-d72b1d37-2c27-44ac-b4bc-bab8a54e6ac9 req-b4dc31c5-59f3-4d14-b747-8f722630f512 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044623 Jul 18 03:32:03.300847 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3623/7227] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:32:03.949248 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-29a6ab9c-d74f-40a9-86c2-d9f469c6bd35 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:03.949829 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-29a6ab9c-d74f-40a9-86c2-d9f469c6bd35 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: a97981e5-ab6c-4fab-9cff-94446840e03b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:03.957792 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-29a6ab9c-d74f-40a9-86c2-d9f469c6bd35 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:03.958243 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-29a6ab9c-d74f-40a9-86c2-d9f469c6bd35 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:03.959017 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-29a6ab9c-d74f-40a9-86c2-d9f469c6bd35 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:03.959446 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-29a6ab9c-d74f-40a9-86c2-d9f469c6bd35 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:04.104411 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-29a6ab9c-d74f-40a9-86c2-d9f469c6bd35 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:04.113355 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-29a6ab9c-d74f-40a9-86c2-d9f469c6bd35 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b" status: 200 len: 1391 microversion: 2.1 time: 0.167574 Jul 18 03:32:04.114062 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3605/7228] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:03 2022] GET /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:05.132072 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0edf62e3-4e75-4eef-bd65-29d883a51692 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:05.132811 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0edf62e3-4e75-4eef-bd65-29d883a51692 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: a97981e5-ab6c-4fab-9cff-94446840e03b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:05.139368 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0edf62e3-4e75-4eef-bd65-29d883a51692 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:05.139828 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0edf62e3-4e75-4eef-bd65-29d883a51692 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:05.140602 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0edf62e3-4e75-4eef-bd65-29d883a51692 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:05.141049 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0edf62e3-4e75-4eef-bd65-29d883a51692 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:05.281876 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0edf62e3-4e75-4eef-bd65-29d883a51692 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:05.291194 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0edf62e3-4e75-4eef-bd65-29d883a51692 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b" status: 200 len: 1391 microversion: 2.1 time: 0.164407 Jul 18 03:32:05.291797 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3624/7229] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:05 2022] GET /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:06.310339 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8792f1c4-db39-4fda-90e4-13ef0b96ee83 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:06.310989 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8792f1c4-db39-4fda-90e4-13ef0b96ee83 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: a97981e5-ab6c-4fab-9cff-94446840e03b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:06.319482 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8792f1c4-db39-4fda-90e4-13ef0b96ee83 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:06.320260 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8792f1c4-db39-4fda-90e4-13ef0b96ee83 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:06.320756 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8792f1c4-db39-4fda-90e4-13ef0b96ee83 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:06.321197 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8792f1c4-db39-4fda-90e4-13ef0b96ee83 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:06.491720 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8792f1c4-db39-4fda-90e4-13ef0b96ee83 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:06.503774 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8792f1c4-db39-4fda-90e4-13ef0b96ee83 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b" status: 200 len: 1391 microversion: 2.1 time: 0.197411 Jul 18 03:32:06.504375 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3606/7230] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:06 2022] GET /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b => generated 1391 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:32:07.520801 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dd8d8e35-8f3f-4380-8558-757a56bc4da7 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:07.521422 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-dd8d8e35-8f3f-4380-8558-757a56bc4da7 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: a97981e5-ab6c-4fab-9cff-94446840e03b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:07.528413 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dd8d8e35-8f3f-4380-8558-757a56bc4da7 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:07.528873 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dd8d8e35-8f3f-4380-8558-757a56bc4da7 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:07.529650 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dd8d8e35-8f3f-4380-8558-757a56bc4da7 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:07.530120 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dd8d8e35-8f3f-4380-8558-757a56bc4da7 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:07.665153 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-dd8d8e35-8f3f-4380-8558-757a56bc4da7 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:07.672724 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-dd8d8e35-8f3f-4380-8558-757a56bc4da7 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b" status: 200 len: 1391 microversion: 2.1 time: 0.155938 Jul 18 03:32:07.673307 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3625/7231] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:07 2022] GET /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:32:08.690694 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-81d8f586-a7b4-43b6-bee2-f96c70a6837a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:08.691309 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-81d8f586-a7b4-43b6-bee2-f96c70a6837a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: a97981e5-ab6c-4fab-9cff-94446840e03b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:08.698292 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-81d8f586-a7b4-43b6-bee2-f96c70a6837a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:08.698745 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-81d8f586-a7b4-43b6-bee2-f96c70a6837a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:08.699951 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-81d8f586-a7b4-43b6-bee2-f96c70a6837a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:08.699951 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-81d8f586-a7b4-43b6-bee2-f96c70a6837a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:08.834333 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-81d8f586-a7b4-43b6-bee2-f96c70a6837a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:08.841807 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-81d8f586-a7b4-43b6-bee2-f96c70a6837a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b" status: 200 len: 1391 microversion: 2.1 time: 0.155681 Jul 18 03:32:08.842384 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3607/7232] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:08 2022] GET /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:09.121724 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-28b02652-e2f1-495e-95a3-2694d42a81b1 req-0078057b-0c72-40dd-beeb-aa34f084dbc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a97981e5-ab6c-4fab-9cff-94446840e03b", "name": "network-vif-plugged", "status": "completed", "tag": "6bc7199d-bfc5-4f0c-856f-86577e620c56"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:32:09.131523 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-28b02652-e2f1-495e-95a3-2694d42a81b1 req-0078057b-0c72-40dd-beeb-aa34f084dbc0 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:09.132230 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-28b02652-e2f1-495e-95a3-2694d42a81b1 req-0078057b-0c72-40dd-beeb-aa34f084dbc0 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:09.148958 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-28b02652-e2f1-495e-95a3-2694d42a81b1 req-0078057b-0c72-40dd-beeb-aa34f084dbc0 service nova] Creating event network-vif-plugged:6bc7199d-bfc5-4f0c-856f-86577e620c56 for instance a97981e5-ab6c-4fab-9cff-94446840e03b on n-h1-465891-3 Jul 18 03:32:09.154360 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-28b02652-e2f1-495e-95a3-2694d42a81b1 req-0078057b-0c72-40dd-beeb-aa34f084dbc0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036367 Jul 18 03:32:09.154997 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3626/7233] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:32:09.859277 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-98c108bf-2e20-415c-897a-a1913e109cc8 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:09.859885 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-98c108bf-2e20-415c-897a-a1913e109cc8 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: a97981e5-ab6c-4fab-9cff-94446840e03b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:09.868035 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-98c108bf-2e20-415c-897a-a1913e109cc8 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:09.868485 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-98c108bf-2e20-415c-897a-a1913e109cc8 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:09.869244 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-98c108bf-2e20-415c-897a-a1913e109cc8 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:09.869681 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-98c108bf-2e20-415c-897a-a1913e109cc8 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:10.003413 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-98c108bf-2e20-415c-897a-a1913e109cc8 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:10.011242 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-98c108bf-2e20-415c-897a-a1913e109cc8 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b" status: 200 len: 1391 microversion: 2.1 time: 0.155820 Jul 18 03:32:10.011825 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3608/7234] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:09 2022] GET /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:11.025652 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:32:11.026467 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:32:11.031641 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c02cc9c7-1458-4bf6-b6ed-adede5cee4db tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:11.032345 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c02cc9c7-1458-4bf6-b6ed-adede5cee4db tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: a97981e5-ab6c-4fab-9cff-94446840e03b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:11.040315 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c02cc9c7-1458-4bf6-b6ed-adede5cee4db tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:11.040774 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c02cc9c7-1458-4bf6-b6ed-adede5cee4db tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:11.041552 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c02cc9c7-1458-4bf6-b6ed-adede5cee4db tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:11.042030 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c02cc9c7-1458-4bf6-b6ed-adede5cee4db tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:11.180707 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c02cc9c7-1458-4bf6-b6ed-adede5cee4db tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:11.188390 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c02cc9c7-1458-4bf6-b6ed-adede5cee4db tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b" status: 200 len: 1562 microversion: 2.1 time: 0.163671 Jul 18 03:32:11.189562 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3627/7235] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:11 2022] GET /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b => generated 1562 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:11.205530 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d9bab2d2-b6c0-48b3-ab86-7fb01df3b1a6 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:11.206246 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d9bab2d2-b6c0-48b3-ab86-7fb01df3b1a6 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: a97981e5-ab6c-4fab-9cff-94446840e03b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:11.208461 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:32:11.214960 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d9bab2d2-b6c0-48b3-ab86-7fb01df3b1a6 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:11.215422 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d9bab2d2-b6c0-48b3-ab86-7fb01df3b1a6 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:11.216249 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d9bab2d2-b6c0-48b3-ab86-7fb01df3b1a6 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:11.216614 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d9bab2d2-b6c0-48b3-ab86-7fb01df3b1a6 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:11.351320 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d9bab2d2-b6c0-48b3-ab86-7fb01df3b1a6 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:11.359388 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d9bab2d2-b6c0-48b3-ab86-7fb01df3b1a6 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b" status: 200 len: 1562 microversion: 2.1 time: 0.158217 Jul 18 03:32:11.359964 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3609/7236] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:11 2022] GET /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:12.965531 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-882ae4a4-bc6f-4de5-b0d5-1e32e3099460 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:12.966585 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-882ae4a4-bc6f-4de5-b0d5-1e32e3099460 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: a97981e5-ab6c-4fab-9cff-94446840e03b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:12.978189 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-882ae4a4-bc6f-4de5-b0d5-1e32e3099460 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:12.978429 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-6119aa47-4765-4f7c-ab89-f3814d149b3c req-7e7eadd2-382b-47f0-9f0b-b092bd2b6612 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a97981e5-ab6c-4fab-9cff-94446840e03b", "tag": "6bc7199d-bfc5-4f0c-856f-86577e620c56"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:32:12.978919 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-882ae4a4-bc6f-4de5-b0d5-1e32e3099460 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:12.979940 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-882ae4a4-bc6f-4de5-b0d5-1e32e3099460 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:12.980591 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-882ae4a4-bc6f-4de5-b0d5-1e32e3099460 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:12.991281 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-6119aa47-4765-4f7c-ab89-f3814d149b3c req-7e7eadd2-382b-47f0-9f0b-b092bd2b6612 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:12.991732 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-6119aa47-4765-4f7c-ab89-f3814d149b3c req-7e7eadd2-382b-47f0-9f0b-b092bd2b6612 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:13.006571 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-6119aa47-4765-4f7c-ab89-f3814d149b3c req-7e7eadd2-382b-47f0-9f0b-b092bd2b6612 service nova] Creating event network-changed:6bc7199d-bfc5-4f0c-856f-86577e620c56 for instance a97981e5-ab6c-4fab-9cff-94446840e03b on n-h1-465891-3 Jul 18 03:32:13.012631 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-6119aa47-4765-4f7c-ab89-f3814d149b3c req-7e7eadd2-382b-47f0-9f0b-b092bd2b6612 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043260 Jul 18 03:32:13.013991 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3610/7237] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:32:13.192412 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-882ae4a4-bc6f-4de5-b0d5-1e32e3099460 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:13.200483 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-882ae4a4-bc6f-4de5-b0d5-1e32e3099460 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b" status: 200 len: 1562 microversion: 2.1 time: 0.240129 Jul 18 03:32:13.201183 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3628/7238] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:12 2022] GET /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b => generated 1562 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:46.494252 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4e56af9f-d0f0-418e-af6a-43ece95d63cf tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:32:46.495709 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4e56af9f-d0f0-418e-af6a-43ece95d63cf tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: a97981e5-ab6c-4fab-9cff-94446840e03b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:46.498633 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=17 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:32:46.499288 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=38 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:32:46.507934 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e56af9f-d0f0-418e-af6a-43ece95d63cf tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:46.508393 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e56af9f-d0f0-418e-af6a-43ece95d63cf tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:46.509187 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e56af9f-d0f0-418e-af6a-43ece95d63cf tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:46.509628 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4e56af9f-d0f0-418e-af6a-43ece95d63cf tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:46.572707 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4e56af9f-d0f0-418e-af6a-43ece95d63cf tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "POST /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b/action" status: 200 len: 24567 microversion: 2.1 time: 0.082618 Jul 18 03:32:46.573395 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3611/7239] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:32:46 2022] POST /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b/action => generated 24567 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 03:32:52.320140 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:32:52.321071 n-d-465891-3 devstack@n-api.service[119544]: Mon Jul 18 03:32:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:33:16.931122 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:33:16.933220 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=36 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:33:16.936216 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e66192cc-ce02-4ea2-8f84-afdc2100c4d0 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:33:16.936769 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e66192cc-ce02-4ea2-8f84-afdc2100c4d0 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: a97981e5-ab6c-4fab-9cff-94446840e03b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:33:16.946601 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e66192cc-ce02-4ea2-8f84-afdc2100c4d0 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:16.947070 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e66192cc-ce02-4ea2-8f84-afdc2100c4d0 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:16.947867 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e66192cc-ce02-4ea2-8f84-afdc2100c4d0 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:16.948319 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e66192cc-ce02-4ea2-8f84-afdc2100c4d0 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:17.019230 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e66192cc-ce02-4ea2-8f84-afdc2100c4d0 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "POST /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b/action" status: 202 len: 0 microversion: 2.1 time: 0.089706 Jul 18 03:33:17.020199 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3629/7240] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:33:16 2022] POST /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:33:17.029782 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-129ae9ab-bfd4-4952-ad37-37504b8beb4b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:33:17.030515 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-129ae9ab-bfd4-4952-ad37-37504b8beb4b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: a97981e5-ab6c-4fab-9cff-94446840e03b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:33:17.032939 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:33:17.033846 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:33:17.043499 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-129ae9ab-bfd4-4952-ad37-37504b8beb4b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:17.043946 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-129ae9ab-bfd4-4952-ad37-37504b8beb4b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:17.044719 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-129ae9ab-bfd4-4952-ad37-37504b8beb4b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:17.045155 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-129ae9ab-bfd4-4952-ad37-37504b8beb4b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:17.271994 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-129ae9ab-bfd4-4952-ad37-37504b8beb4b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:33:17.279635 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-129ae9ab-bfd4-4952-ad37-37504b8beb4b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b" status: 200 len: 1686 microversion: 2.1 time: 0.254400 Jul 18 03:33:17.280222 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3612/7241] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:33:17 2022] GET /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b => generated 1686 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:33:18.300559 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-008b1d77-2280-48ac-aa96-5a03d77507f2 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:33:18.301497 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-008b1d77-2280-48ac-aa96-5a03d77507f2 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: a97981e5-ab6c-4fab-9cff-94446840e03b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:33:18.307925 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-008b1d77-2280-48ac-aa96-5a03d77507f2 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:18.308386 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-008b1d77-2280-48ac-aa96-5a03d77507f2 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:18.309164 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-008b1d77-2280-48ac-aa96-5a03d77507f2 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:18.309643 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-008b1d77-2280-48ac-aa96-5a03d77507f2 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:18.493341 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-008b1d77-2280-48ac-aa96-5a03d77507f2 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:33:18.501044 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-008b1d77-2280-48ac-aa96-5a03d77507f2 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b" status: 200 len: 1666 microversion: 2.1 time: 0.205889 Jul 18 03:33:18.501628 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3630/7242] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:33:18 2022] GET /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b => generated 1666 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:33:19.594225 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ea18c2a8-62f8-4c16-9f73-7d6948375fe9 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:33:19.595148 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ea18c2a8-62f8-4c16-9f73-7d6948375fe9 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: a97981e5-ab6c-4fab-9cff-94446840e03b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:33:19.603369 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea18c2a8-62f8-4c16-9f73-7d6948375fe9 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:19.603815 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea18c2a8-62f8-4c16-9f73-7d6948375fe9 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:19.604576 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea18c2a8-62f8-4c16-9f73-7d6948375fe9 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:19.605009 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ea18c2a8-62f8-4c16-9f73-7d6948375fe9 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:19.677441 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ea18c2a8-62f8-4c16-9f73-7d6948375fe9 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "POST /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b/action" status: 200 len: 32642 microversion: 2.1 time: 0.086868 Jul 18 03:33:19.678048 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3613/7243] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:33:19 2022] POST /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b/action => generated 32642 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 03:33:19.689108 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-93b8eec0-56b6-484d-aeb3-f0f161f0a3db tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:33:19.689641 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-93b8eec0-56b6-484d-aeb3-f0f161f0a3db tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: a97981e5-ab6c-4fab-9cff-94446840e03b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:33:19.696669 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-93b8eec0-56b6-484d-aeb3-f0f161f0a3db tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:19.697133 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-93b8eec0-56b6-484d-aeb3-f0f161f0a3db tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:19.697952 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-93b8eec0-56b6-484d-aeb3-f0f161f0a3db tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:19.698406 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-93b8eec0-56b6-484d-aeb3-f0f161f0a3db tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:19.765266 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-93b8eec0-56b6-484d-aeb3-f0f161f0a3db tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "POST /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b/action" status: 202 len: 0 microversion: 2.1 time: 0.079780 Jul 18 03:33:19.765984 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3631/7244] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:33:19 2022] POST /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:33:19.775450 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0e88bcc8-6736-4d3f-901f-b0b145ce1241 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:33:19.776279 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0e88bcc8-6736-4d3f-901f-b0b145ce1241 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: a97981e5-ab6c-4fab-9cff-94446840e03b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:33:19.783462 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0e88bcc8-6736-4d3f-901f-b0b145ce1241 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:19.784024 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0e88bcc8-6736-4d3f-901f-b0b145ce1241 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:19.784834 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0e88bcc8-6736-4d3f-901f-b0b145ce1241 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:19.786043 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0e88bcc8-6736-4d3f-901f-b0b145ce1241 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:19.923430 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0e88bcc8-6736-4d3f-901f-b0b145ce1241 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:33:19.931353 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0e88bcc8-6736-4d3f-901f-b0b145ce1241 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b" status: 200 len: 1673 microversion: 2.1 time: 0.160180 Jul 18 03:33:19.931930 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3614/7245] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:33:19 2022] GET /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:33:20.950224 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-85bd8d93-ca91-45ca-b91b-d26e62bd6de8 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:33:20.950951 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-85bd8d93-ca91-45ca-b91b-d26e62bd6de8 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: a97981e5-ab6c-4fab-9cff-94446840e03b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:33:20.958367 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85bd8d93-ca91-45ca-b91b-d26e62bd6de8 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:20.959452 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85bd8d93-ca91-45ca-b91b-d26e62bd6de8 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:20.960340 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85bd8d93-ca91-45ca-b91b-d26e62bd6de8 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:20.960809 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-85bd8d93-ca91-45ca-b91b-d26e62bd6de8 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:21.100247 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-85bd8d93-ca91-45ca-b91b-d26e62bd6de8 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:33:21.108084 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-85bd8d93-ca91-45ca-b91b-d26e62bd6de8 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b" status: 200 len: 1681 microversion: 2.1 time: 0.162339 Jul 18 03:33:21.108671 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3632/7246] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:33:20 2022] GET /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:33:21.200238 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a8844dbd-7a02-4433-82c9-695606401d5c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:33:21.201083 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a8844dbd-7a02-4433-82c9-695606401d5c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: a97981e5-ab6c-4fab-9cff-94446840e03b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:33:21.208957 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a8844dbd-7a02-4433-82c9-695606401d5c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:21.209615 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a8844dbd-7a02-4433-82c9-695606401d5c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:21.210254 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a8844dbd-7a02-4433-82c9-695606401d5c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:21.210687 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a8844dbd-7a02-4433-82c9-695606401d5c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:21.266206 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a8844dbd-7a02-4433-82c9-695606401d5c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "POST /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b/action" status: 200 len: 38427 microversion: 2.1 time: 0.069797 Jul 18 03:33:21.266866 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3615/7247] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:33:21 2022] POST /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b/action => generated 38427 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 03:33:22.250384 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0b9f0211-3ea2-408f-9a97-f1830ef5c843 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:33:22.250890 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0b9f0211-3ea2-408f-9a97-f1830ef5c843 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: a97981e5-ab6c-4fab-9cff-94446840e03b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:33:22.253437 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-27545602-5d60-44f1-8a83-13a5a783831a req-c78959e2-7a65-4f99-bc3b-17eb18736806 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a97981e5-ab6c-4fab-9cff-94446840e03b", "tag": "6bc7199d-bfc5-4f0c-856f-86577e620c56"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:33:22.258390 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0b9f0211-3ea2-408f-9a97-f1830ef5c843 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:22.259133 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0b9f0211-3ea2-408f-9a97-f1830ef5c843 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:22.260308 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0b9f0211-3ea2-408f-9a97-f1830ef5c843 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:22.260830 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0b9f0211-3ea2-408f-9a97-f1830ef5c843 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:22.263609 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-27545602-5d60-44f1-8a83-13a5a783831a req-c78959e2-7a65-4f99-bc3b-17eb18736806 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:22.264275 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-27545602-5d60-44f1-8a83-13a5a783831a req-c78959e2-7a65-4f99-bc3b-17eb18736806 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:22.277082 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-27545602-5d60-44f1-8a83-13a5a783831a req-c78959e2-7a65-4f99-bc3b-17eb18736806 service nova] Creating event network-changed:6bc7199d-bfc5-4f0c-856f-86577e620c56 for instance a97981e5-ab6c-4fab-9cff-94446840e03b on n-h1-465891-3 Jul 18 03:33:22.282244 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-27545602-5d60-44f1-8a83-13a5a783831a req-c78959e2-7a65-4f99-bc3b-17eb18736806 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033230 Jul 18 03:33:22.282870 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3616/7248] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:33:22.296533 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0b9f0211-3ea2-408f-9a97-f1830ef5c843 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: a97981e5-ab6c-4fab-9cff-94446840e03b] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:33:22.396682 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0b9f0211-3ea2-408f-9a97-f1830ef5c843 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b" status: 204 len: 0 microversion: 2.1 time: 0.149377 Jul 18 03:33:22.397852 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3633/7249] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:33:22 2022] DELETE /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:33:22.414179 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-dcf43165-d157-472a-83b8-5df1a6fc359b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:33:22.415402 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-dcf43165-d157-472a-83b8-5df1a6fc359b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: a97981e5-ab6c-4fab-9cff-94446840e03b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:33:22.423539 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dcf43165-d157-472a-83b8-5df1a6fc359b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:22.423991 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dcf43165-d157-472a-83b8-5df1a6fc359b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:22.424985 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dcf43165-d157-472a-83b8-5df1a6fc359b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:22.425589 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dcf43165-d157-472a-83b8-5df1a6fc359b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:22.581102 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-dcf43165-d157-472a-83b8-5df1a6fc359b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:33:22.588958 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-dcf43165-d157-472a-83b8-5df1a6fc359b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b" status: 200 len: 1687 microversion: 2.1 time: 0.184682 Jul 18 03:33:22.589647 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3617/7250] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:33:22 2022] GET /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b => generated 1687 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:33:23.608215 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ae9ea0e2-471b-41ff-9bfc-a563e1c475ce tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:33:23.608930 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ae9ea0e2-471b-41ff-9bfc-a563e1c475ce tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: a97981e5-ab6c-4fab-9cff-94446840e03b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:33:23.616808 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ae9ea0e2-471b-41ff-9bfc-a563e1c475ce tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:23.617265 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ae9ea0e2-471b-41ff-9bfc-a563e1c475ce tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:23.618129 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ae9ea0e2-471b-41ff-9bfc-a563e1c475ce tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:23.618520 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ae9ea0e2-471b-41ff-9bfc-a563e1c475ce tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:23.823666 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ae9ea0e2-471b-41ff-9bfc-a563e1c475ce tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:33:23.831436 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ae9ea0e2-471b-41ff-9bfc-a563e1c475ce tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b" status: 200 len: 1687 microversion: 2.1 time: 0.228426 Jul 18 03:33:23.832066 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3634/7251] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:33:23 2022] GET /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b => generated 1687 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:33:24.628457 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-21b9064f-8696-4ff5-a89d-dfe48ed54a1c req-a91e58c4-a4d4-4007-bee1-38f6316a7ebe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a97981e5-ab6c-4fab-9cff-94446840e03b", "name": "network-vif-deleted", "tag": "6bc7199d-bfc5-4f0c-856f-86577e620c56"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:33:24.638964 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-21b9064f-8696-4ff5-a89d-dfe48ed54a1c req-a91e58c4-a4d4-4007-bee1-38f6316a7ebe service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:24.639403 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-21b9064f-8696-4ff5-a89d-dfe48ed54a1c req-a91e58c4-a4d4-4007-bee1-38f6316a7ebe service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:24.652048 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-21b9064f-8696-4ff5-a89d-dfe48ed54a1c req-a91e58c4-a4d4-4007-bee1-38f6316a7ebe service nova] Creating event network-vif-deleted:6bc7199d-bfc5-4f0c-856f-86577e620c56 for instance a97981e5-ab6c-4fab-9cff-94446840e03b on n-h1-465891-3 Jul 18 03:33:24.657730 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-21b9064f-8696-4ff5-a89d-dfe48ed54a1c req-a91e58c4-a4d4-4007-bee1-38f6316a7ebe service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032612 Jul 18 03:33:24.658396 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3618/7252] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:33:24.848655 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c72071d7-9f87-465d-a064-79786efedf57 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:33:24.849827 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c72071d7-9f87-465d-a064-79786efedf57 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: a97981e5-ab6c-4fab-9cff-94446840e03b] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:33:24.856750 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c72071d7-9f87-465d-a064-79786efedf57 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:24.857209 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c72071d7-9f87-465d-a064-79786efedf57 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:24.858034 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c72071d7-9f87-465d-a064-79786efedf57 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:24.858483 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c72071d7-9f87-465d-a064-79786efedf57 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:24.890013 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c72071d7-9f87-465d-a064-79786efedf57 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:24.890522 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c72071d7-9f87-465d-a064-79786efedf57 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:24.891009 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-c72071d7-9f87-465d-a064-79786efedf57 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lazy-loading 'fault' on Instance uuid a97981e5-ab6c-4fab-9cff-94446840e03b {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:33:24.935453 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c72071d7-9f87-465d-a064-79786efedf57 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:33:24.943492 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c72071d7-9f87-465d-a064-79786efedf57 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b" status: 200 len: 1355 microversion: 2.1 time: 0.098716 Jul 18 03:33:24.944083 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3635/7253] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:33:24 2022] GET /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b => generated 1355 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:33:25.961781 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-aa952dea-c7a7-41c4-8a28-a14a4249b67c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:33:25.962477 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-aa952dea-c7a7-41c4-8a28-a14a4249b67c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: a97981e5-ab6c-4fab-9cff-94446840e03b] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:33:25.969590 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aa952dea-c7a7-41c4-8a28-a14a4249b67c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:25.970072 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aa952dea-c7a7-41c4-8a28-a14a4249b67c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:25.970830 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aa952dea-c7a7-41c4-8a28-a14a4249b67c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:25.971261 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aa952dea-c7a7-41c4-8a28-a14a4249b67c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:25.984466 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-aa952dea-c7a7-41c4-8a28-a14a4249b67c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] HTTP exception thrown: Instance a97981e5-ab6c-4fab-9cff-94446840e03b could not be found. Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-aa952dea-c7a7-41c4-8a28-a14a4249b67c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Request method failure captured: Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b HTTP/1.1 Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1NQn25Nv2CWVcqUB7Jli7-n6pu90utlDXaCYfmF3mQfgKsu7CU9h4Qgbxu3IIS2bQPi7DmlwnQeENXcFmebHsSlw-o4GKxkvJck1gJGsOn4xtry1F0sEpYLtQaLLoR_0JXssRBl37TNYHSvAfTOqzePvi79-HEbaRAqO169pHpwd49Q Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 2d9c17c023e1420c8d90b96e2af98172 Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1294373808 Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2d9c17c023e1420c8d90b96e2af98172"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2d9c17c023e1420c8d90b96e2af98172"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2d9c17c023e1420c8d90b96e2af98172"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2d9c17c023e1420c8d90b96e2af98172"}]}] Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1294373808 Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 2d9c17c023e1420c8d90b96e2af98172 Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1294373808 Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-TestNetworkAdvancedServerOps-1294373808-project Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 921716a730f64ccdbbced6d4bbf715b0 Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1294373808-project Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance a97981e5-ab6c-4fab-9cff-94446840e03b could not be found. Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'a97981e5-ab6c-4fab-9cff-94446840e03b'} Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a97981e5-ab6c-4fab-9cff-94446840e03b could not be found. Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a97981e5-ab6c-4fab-9cff-94446840e03b could not be found. Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:33:25.986123 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:33:25.990570 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:33:25.990570 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:33:25.990570 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:33:25.990570 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:33:25.990570 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:33:25.990570 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:33:25.990570 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a97981e5-ab6c-4fab-9cff-94446840e03b could not be found. Jul 18 03:33:25.990570 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:33:25.990570 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-aa952dea-c7a7-41c4-8a28-a14a4249b67c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Returning 404 to user: Instance a97981e5-ab6c-4fab-9cff-94446840e03b could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:33:25.990570 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-aa952dea-c7a7-41c4-8a28-a14a4249b67c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b" status: 404 len: 111 microversion: 2.1 time: 0.030596 Jul 18 03:33:25.990570 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3619/7254] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:33:25 2022] GET /compute/v2.1/servers/a97981e5-ab6c-4fab-9cff-94446840e03b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:33:29.394956 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b8fa190b-ac45-44fb-8138-46ba08658a36 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '.version_select at 0x7ff49bb7d700>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:33:29.415218 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b8fa190b-ac45-44fb-8138-46ba08658a36 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-218041353" status: 202 len: 0 microversion: 2.1 time: 0.023856 Jul 18 03:33:29.416010 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3636/7255] 10.222.0.57 () {58 vars in 1280 bytes} [Mon Jul 18 03:33:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-218041353 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:33:29.444081 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-233b23e9-b048-477c-9fb2-e0c02f9c63e4 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Action: 'create', calling method: .version_select at 0x7ff49bdb4f70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-355387027", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzKkFEeAdrx4MOQD5eL4Ys4h+ZeGM3F5vSRAVuicsf2zliFeNcR9y4jzPdv/0mXvj56jMlmb9wXsw9NNlr3mjt+598eOE2I75c5G7PKuPVKljneR7ruv/yN/AsmXc0LLw=="}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:33:29.458828 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-233b23e9-b048-477c-9fb2-e0c02f9c63e4 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Getting quotas for project 2d9c17c023e1420c8d90b96e2af98172. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:33:29.468172 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-233b23e9-b048-477c-9fb2-e0c02f9c63e4 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Getting quotas for user 921716a730f64ccdbbced6d4bbf715b0 and project 2d9c17c023e1420c8d90b96e2af98172. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:33:29.494156 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-233b23e9-b048-477c-9fb2-e0c02f9c63e4 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.053887 Jul 18 03:33:29.496997 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3620/7256] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 03:33:29 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:33:35.315194 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d38e01a4-d70e-4e29-adbe-861e47641e4d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-799189015", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "20813511-2429-4271-89b9-3c412e211ca0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-355387027", "security_groups": [{"name": "tempest-secgroup-smoke-1744438152"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:33:35.324282 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:33:35.450257 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-d38e01a4-d70e-4e29-adbe-861e47641e4d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] validate_networks() for [('20813511-2429-4271-89b9-3c412e211ca0', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:33:35.876219 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-d38e01a4-d70e-4e29-adbe-861e47641e4d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:33:35.876569 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-d38e01a4-d70e-4e29-adbe-861e47641e4d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:33:35.877087 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-d38e01a4-d70e-4e29-adbe-861e47641e4d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:33:35.877516 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-d38e01a4-d70e-4e29-adbe-861e47641e4d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:33:35.877985 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-d38e01a4-d70e-4e29-adbe-861e47641e4d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:33:35.888601 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d38e01a4-d70e-4e29-adbe-861e47641e4d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:35.888814 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d38e01a4-d70e-4e29-adbe-861e47641e4d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:35.889839 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d38e01a4-d70e-4e29-adbe-861e47641e4d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:35.890133 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d38e01a4-d70e-4e29-adbe-861e47641e4d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:35.908882 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-d38e01a4-d70e-4e29-adbe-861e47641e4d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Getting quotas for project 2d9c17c023e1420c8d90b96e2af98172. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:33:35.916556 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-d38e01a4-d70e-4e29-adbe-861e47641e4d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Getting quotas for user 921716a730f64ccdbbced6d4bbf715b0 and project 2d9c17c023e1420c8d90b96e2af98172. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:33:35.931923 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d38e01a4-d70e-4e29-adbe-861e47641e4d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:33:35.934306 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d38e01a4-d70e-4e29-adbe-861e47641e4d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: f626c6e4-e55a-4017-b80f-51aee6063d3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:33:35.988096 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d38e01a4-d70e-4e29-adbe-861e47641e4d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.676699 Jul 18 03:33:35.990381 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3637/7257] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:33:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:33:35.998690 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=32 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:33:36.017951 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e7214559-3256-4498-b387-c9e0da321cee tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:33:36.018583 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e7214559-3256-4498-b387-c9e0da321cee tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: f626c6e4-e55a-4017-b80f-51aee6063d3d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:33:36.086700 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e7214559-3256-4498-b387-c9e0da321cee tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:33:36.095183 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e7214559-3256-4498-b387-c9e0da321cee tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d" status: 200 len: 1265 microversion: 2.1 time: 0.098169 Jul 18 03:33:36.095779 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3621/7258] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:33:35 2022] GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d => generated 1265 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:33:37.113581 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-26dee516-8167-4f44-bb3b-ea28eed63e9a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:33:37.114375 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-26dee516-8167-4f44-bb3b-ea28eed63e9a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: f626c6e4-e55a-4017-b80f-51aee6063d3d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:33:37.125545 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-26dee516-8167-4f44-bb3b-ea28eed63e9a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:37.126324 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-26dee516-8167-4f44-bb3b-ea28eed63e9a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:37.127320 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-26dee516-8167-4f44-bb3b-ea28eed63e9a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:37.128082 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-26dee516-8167-4f44-bb3b-ea28eed63e9a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:37.236275 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-26dee516-8167-4f44-bb3b-ea28eed63e9a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:33:37.246105 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-26dee516-8167-4f44-bb3b-ea28eed63e9a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d" status: 200 len: 1335 microversion: 2.1 time: 0.137178 Jul 18 03:33:37.246988 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3638/7259] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:33:37 2022] GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d => generated 1335 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:33:38.264139 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ad5ca63e-82ef-4c8d-9439-a6e306b3da42 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:33:38.264780 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ad5ca63e-82ef-4c8d-9439-a6e306b3da42 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: f626c6e4-e55a-4017-b80f-51aee6063d3d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:33:38.272603 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ad5ca63e-82ef-4c8d-9439-a6e306b3da42 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:38.273061 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ad5ca63e-82ef-4c8d-9439-a6e306b3da42 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:38.274089 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ad5ca63e-82ef-4c8d-9439-a6e306b3da42 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:38.274535 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ad5ca63e-82ef-4c8d-9439-a6e306b3da42 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:38.524094 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ad5ca63e-82ef-4c8d-9439-a6e306b3da42 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:33:38.533521 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ad5ca63e-82ef-4c8d-9439-a6e306b3da42 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d" status: 200 len: 1391 microversion: 2.1 time: 0.273604 Jul 18 03:33:38.534520 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3622/7260] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:33:38 2022] GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d => generated 1391 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:33:38.768703 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-a975d4bd-ae0d-4ea2-b496-62828adc78da req-debf4026-e1f5-4ac3-afea-39e3fc9041cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f626c6e4-e55a-4017-b80f-51aee6063d3d", "tag": "46be07ff-ef78-4100-b063-e7c4d5a1bdd3"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:33:38.781171 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-a975d4bd-ae0d-4ea2-b496-62828adc78da req-debf4026-e1f5-4ac3-afea-39e3fc9041cb service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:38.781716 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-a975d4bd-ae0d-4ea2-b496-62828adc78da req-debf4026-e1f5-4ac3-afea-39e3fc9041cb service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:38.794960 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-a975d4bd-ae0d-4ea2-b496-62828adc78da req-debf4026-e1f5-4ac3-afea-39e3fc9041cb service nova] Creating event network-changed:46be07ff-ef78-4100-b063-e7c4d5a1bdd3 for instance f626c6e4-e55a-4017-b80f-51aee6063d3d on n-h1-465891-3 Jul 18 03:33:38.801444 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-a975d4bd-ae0d-4ea2-b496-62828adc78da req-debf4026-e1f5-4ac3-afea-39e3fc9041cb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045921 Jul 18 03:33:38.802197 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3639/7261] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:33:39.551562 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c5c0d6e5-3676-45e9-b49b-c5a1696741b9 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:33:39.552186 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c5c0d6e5-3676-45e9-b49b-c5a1696741b9 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: f626c6e4-e55a-4017-b80f-51aee6063d3d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:33:39.559958 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c5c0d6e5-3676-45e9-b49b-c5a1696741b9 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:39.560387 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c5c0d6e5-3676-45e9-b49b-c5a1696741b9 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:39.561167 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c5c0d6e5-3676-45e9-b49b-c5a1696741b9 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:39.561609 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c5c0d6e5-3676-45e9-b49b-c5a1696741b9 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:39.698684 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c5c0d6e5-3676-45e9-b49b-c5a1696741b9 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:33:39.706128 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c5c0d6e5-3676-45e9-b49b-c5a1696741b9 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d" status: 200 len: 1391 microversion: 2.1 time: 0.158489 Jul 18 03:33:39.706713 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3623/7262] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:33:39 2022] GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:33:40.724641 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9f576300-1c0e-4afa-b487-ead9595d9e5e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:33:40.725355 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9f576300-1c0e-4afa-b487-ead9595d9e5e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: f626c6e4-e55a-4017-b80f-51aee6063d3d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:33:40.733414 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9f576300-1c0e-4afa-b487-ead9595d9e5e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:40.733919 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9f576300-1c0e-4afa-b487-ead9595d9e5e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:40.734736 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9f576300-1c0e-4afa-b487-ead9595d9e5e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:40.735160 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9f576300-1c0e-4afa-b487-ead9595d9e5e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:40.867905 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9f576300-1c0e-4afa-b487-ead9595d9e5e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:33:40.875430 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9f576300-1c0e-4afa-b487-ead9595d9e5e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d" status: 200 len: 1391 microversion: 2.1 time: 0.155078 Jul 18 03:33:40.876017 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3640/7263] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:33:40 2022] GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:33:41.892722 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-594b4919-cb67-46bc-bcbf-eeae0c8bd9d0 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:33:41.893329 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-594b4919-cb67-46bc-bcbf-eeae0c8bd9d0 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: f626c6e4-e55a-4017-b80f-51aee6063d3d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:33:41.901007 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-594b4919-cb67-46bc-bcbf-eeae0c8bd9d0 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:41.901456 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-594b4919-cb67-46bc-bcbf-eeae0c8bd9d0 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:41.902243 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-594b4919-cb67-46bc-bcbf-eeae0c8bd9d0 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:41.902679 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-594b4919-cb67-46bc-bcbf-eeae0c8bd9d0 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:42.039385 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-594b4919-cb67-46bc-bcbf-eeae0c8bd9d0 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:33:42.047389 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-594b4919-cb67-46bc-bcbf-eeae0c8bd9d0 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d" status: 200 len: 1391 microversion: 2.1 time: 0.158564 Jul 18 03:33:42.048025 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3624/7264] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:33:41 2022] GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:33:43.064589 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-303642ba-37e0-49d3-9d30-8e312d2d28f1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:33:43.065247 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-303642ba-37e0-49d3-9d30-8e312d2d28f1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: f626c6e4-e55a-4017-b80f-51aee6063d3d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:33:43.072385 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-303642ba-37e0-49d3-9d30-8e312d2d28f1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:43.072854 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-303642ba-37e0-49d3-9d30-8e312d2d28f1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:43.073631 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-303642ba-37e0-49d3-9d30-8e312d2d28f1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:43.074101 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-303642ba-37e0-49d3-9d30-8e312d2d28f1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:43.214389 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-303642ba-37e0-49d3-9d30-8e312d2d28f1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:33:43.223054 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-303642ba-37e0-49d3-9d30-8e312d2d28f1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d" status: 200 len: 1391 microversion: 2.1 time: 0.162379 Jul 18 03:33:43.223641 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3641/7265] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:33:43 2022] GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:33:44.240907 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0b754fab-707b-41cb-a2b7-9af444319491 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:33:44.241563 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0b754fab-707b-41cb-a2b7-9af444319491 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: f626c6e4-e55a-4017-b80f-51aee6063d3d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:33:44.248673 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0b754fab-707b-41cb-a2b7-9af444319491 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:44.249122 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0b754fab-707b-41cb-a2b7-9af444319491 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:44.249943 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0b754fab-707b-41cb-a2b7-9af444319491 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:44.250383 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0b754fab-707b-41cb-a2b7-9af444319491 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:44.386886 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0b754fab-707b-41cb-a2b7-9af444319491 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:33:44.394660 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0b754fab-707b-41cb-a2b7-9af444319491 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d" status: 200 len: 1391 microversion: 2.1 time: 0.157880 Jul 18 03:33:44.395238 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3625/7266] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:33:44 2022] GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:33:45.411896 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ebc9a023-9070-4a3e-93e3-36c712b1a253 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:33:45.413270 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ebc9a023-9070-4a3e-93e3-36c712b1a253 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: f626c6e4-e55a-4017-b80f-51aee6063d3d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:33:45.420204 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ebc9a023-9070-4a3e-93e3-36c712b1a253 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:45.420667 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ebc9a023-9070-4a3e-93e3-36c712b1a253 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:45.421453 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ebc9a023-9070-4a3e-93e3-36c712b1a253 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:45.421930 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ebc9a023-9070-4a3e-93e3-36c712b1a253 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:45.489404 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-4f8aab58-cb05-42c1-b338-adf4b99f98ed req-2989f78a-7ad0-4d71-8d70-2db4893afbf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f626c6e4-e55a-4017-b80f-51aee6063d3d", "name": "network-vif-plugged", "status": "completed", "tag": "46be07ff-ef78-4100-b063-e7c4d5a1bdd3"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:33:45.500290 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-4f8aab58-cb05-42c1-b338-adf4b99f98ed req-2989f78a-7ad0-4d71-8d70-2db4893afbf7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:45.500842 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-4f8aab58-cb05-42c1-b338-adf4b99f98ed req-2989f78a-7ad0-4d71-8d70-2db4893afbf7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:45.516176 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-4f8aab58-cb05-42c1-b338-adf4b99f98ed req-2989f78a-7ad0-4d71-8d70-2db4893afbf7 service nova] Creating event network-vif-plugged:46be07ff-ef78-4100-b063-e7c4d5a1bdd3 for instance f626c6e4-e55a-4017-b80f-51aee6063d3d on n-h1-465891-3 Jul 18 03:33:45.521695 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-4f8aab58-cb05-42c1-b338-adf4b99f98ed req-2989f78a-7ad0-4d71-8d70-2db4893afbf7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035747 Jul 18 03:33:45.522472 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3626/7267] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:33:45.578799 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ebc9a023-9070-4a3e-93e3-36c712b1a253 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:33:45.587740 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ebc9a023-9070-4a3e-93e3-36c712b1a253 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d" status: 200 len: 1391 microversion: 2.1 time: 0.179790 Jul 18 03:33:45.588343 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3642/7268] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:33:45 2022] GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d => generated 1391 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:33:46.605211 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ba4a60ef-e904-4e15-96dc-5949fcba9f83 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:33:46.605924 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ba4a60ef-e904-4e15-96dc-5949fcba9f83 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: f626c6e4-e55a-4017-b80f-51aee6063d3d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:33:46.607957 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:33:46.614422 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba4a60ef-e904-4e15-96dc-5949fcba9f83 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:46.614869 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba4a60ef-e904-4e15-96dc-5949fcba9f83 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:46.615623 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba4a60ef-e904-4e15-96dc-5949fcba9f83 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:46.616057 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ba4a60ef-e904-4e15-96dc-5949fcba9f83 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:46.749208 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ba4a60ef-e904-4e15-96dc-5949fcba9f83 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:33:46.756915 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ba4a60ef-e904-4e15-96dc-5949fcba9f83 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d" status: 200 len: 1391 microversion: 2.1 time: 0.156157 Jul 18 03:33:46.757536 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3627/7269] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:33:46 2022] GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:33:47.774330 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a9350ba3-c951-44ca-947b-ec0650dcbe3f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:33:47.774992 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a9350ba3-c951-44ca-947b-ec0650dcbe3f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: f626c6e4-e55a-4017-b80f-51aee6063d3d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:33:47.777223 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:33:47.778102 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:33:47.778766 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:33:47.784815 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9350ba3-c951-44ca-947b-ec0650dcbe3f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:47.785283 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9350ba3-c951-44ca-947b-ec0650dcbe3f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:47.786104 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9350ba3-c951-44ca-947b-ec0650dcbe3f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:47.786563 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a9350ba3-c951-44ca-947b-ec0650dcbe3f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:47.928008 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a9350ba3-c951-44ca-947b-ec0650dcbe3f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:33:47.936680 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a9350ba3-c951-44ca-947b-ec0650dcbe3f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d" status: 200 len: 1564 microversion: 2.1 time: 0.167095 Jul 18 03:33:47.937267 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3643/7270] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:33:47 2022] GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d => generated 1564 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:33:47.952925 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ef3e9372-16aa-4757-b587-18d2be62a291 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:33:47.953532 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ef3e9372-16aa-4757-b587-18d2be62a291 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: f626c6e4-e55a-4017-b80f-51aee6063d3d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:33:47.956260 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:33:47.961539 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ef3e9372-16aa-4757-b587-18d2be62a291 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:47.962019 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ef3e9372-16aa-4757-b587-18d2be62a291 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:47.962783 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ef3e9372-16aa-4757-b587-18d2be62a291 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:47.963214 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ef3e9372-16aa-4757-b587-18d2be62a291 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:48.098385 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ef3e9372-16aa-4757-b587-18d2be62a291 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:33:48.107345 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ef3e9372-16aa-4757-b587-18d2be62a291 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d" status: 200 len: 1564 microversion: 2.1 time: 0.158487 Jul 18 03:33:48.107935 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3628/7271] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:33:47 2022] GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:33:49.724056 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-70df7f1a-448a-4b31-ad44-90f14b9986b4 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:33:49.724693 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-70df7f1a-448a-4b31-ad44-90f14b9986b4 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: f626c6e4-e55a-4017-b80f-51aee6063d3d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:33:49.730602 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-ad00f82b-5b74-4911-bf9b-027d6bc38856 req-03998b2f-ee09-4fcc-a4c6-486996fa9945 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f626c6e4-e55a-4017-b80f-51aee6063d3d", "tag": "46be07ff-ef78-4100-b063-e7c4d5a1bdd3"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:33:49.740684 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-ad00f82b-5b74-4911-bf9b-027d6bc38856 req-03998b2f-ee09-4fcc-a4c6-486996fa9945 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:49.741495 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-ad00f82b-5b74-4911-bf9b-027d6bc38856 req-03998b2f-ee09-4fcc-a4c6-486996fa9945 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:49.743391 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-70df7f1a-448a-4b31-ad44-90f14b9986b4 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:49.744078 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-70df7f1a-448a-4b31-ad44-90f14b9986b4 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:49.745121 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-70df7f1a-448a-4b31-ad44-90f14b9986b4 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:33:49.745582 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-70df7f1a-448a-4b31-ad44-90f14b9986b4 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:33:49.753820 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-ad00f82b-5b74-4911-bf9b-027d6bc38856 req-03998b2f-ee09-4fcc-a4c6-486996fa9945 service nova] Creating event network-changed:46be07ff-ef78-4100-b063-e7c4d5a1bdd3 for instance f626c6e4-e55a-4017-b80f-51aee6063d3d on n-h1-465891-3 Jul 18 03:33:49.760065 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-ad00f82b-5b74-4911-bf9b-027d6bc38856 req-03998b2f-ee09-4fcc-a4c6-486996fa9945 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033860 Jul 18 03:33:49.761027 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3629/7272] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:33:49.984169 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-70df7f1a-448a-4b31-ad44-90f14b9986b4 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:33:49.992993 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-70df7f1a-448a-4b31-ad44-90f14b9986b4 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d" status: 200 len: 1564 microversion: 2.1 time: 0.272814 Jul 18 03:33:49.993606 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3644/7273] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:33:49 2022] GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d => generated 1564 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:34:21.267566 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b9be207f-457d-48a0-b388-0ce85e14674c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:34:21.268579 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b9be207f-457d-48a0-b388-0ce85e14674c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: f626c6e4-e55a-4017-b80f-51aee6063d3d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:21.271081 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:34:21.271724 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=40 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:34:21.278556 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b9be207f-457d-48a0-b388-0ce85e14674c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:21.279300 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b9be207f-457d-48a0-b388-0ce85e14674c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:21.280446 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b9be207f-457d-48a0-b388-0ce85e14674c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:21.280887 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b9be207f-457d-48a0-b388-0ce85e14674c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:21.343122 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b9be207f-457d-48a0-b388-0ce85e14674c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "POST /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d/action" status: 200 len: 24570 microversion: 2.1 time: 0.080548 Jul 18 03:34:21.343803 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3630/7274] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:34:21 2022] POST /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d/action => generated 24570 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 03:34:51.784244 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:34:51.785035 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=40 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:34:51.789874 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f11b6d3b-015f-4411-a15e-ffbbcd2c2c12 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:34:51.790878 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f11b6d3b-015f-4411-a15e-ffbbcd2c2c12 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: f626c6e4-e55a-4017-b80f-51aee6063d3d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:51.799062 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f11b6d3b-015f-4411-a15e-ffbbcd2c2c12 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:51.799586 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f11b6d3b-015f-4411-a15e-ffbbcd2c2c12 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:51.800398 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f11b6d3b-015f-4411-a15e-ffbbcd2c2c12 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:51.800850 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f11b6d3b-015f-4411-a15e-ffbbcd2c2c12 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:51.885887 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f11b6d3b-015f-4411-a15e-ffbbcd2c2c12 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "POST /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d/action" status: 202 len: 0 microversion: 2.1 time: 0.103851 Jul 18 03:34:51.889627 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3645/7275] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:34:51 2022] POST /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:34:51.895945 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c8bf8a60-5b58-43e3-9705-5eb59582d4cd tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:51.896659 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c8bf8a60-5b58-43e3-9705-5eb59582d4cd tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: f626c6e4-e55a-4017-b80f-51aee6063d3d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:51.899309 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:34:51.899966 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:34:51.907457 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c8bf8a60-5b58-43e3-9705-5eb59582d4cd tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:51.908362 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c8bf8a60-5b58-43e3-9705-5eb59582d4cd tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:51.908823 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c8bf8a60-5b58-43e3-9705-5eb59582d4cd tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:51.909264 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c8bf8a60-5b58-43e3-9705-5eb59582d4cd tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:52.136831 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c8bf8a60-5b58-43e3-9705-5eb59582d4cd tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:52.145603 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c8bf8a60-5b58-43e3-9705-5eb59582d4cd tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d" status: 200 len: 1674 microversion: 2.1 time: 0.254160 Jul 18 03:34:52.146224 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3631/7276] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:51 2022] GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d => generated 1674 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:34:53.165833 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7f9737a9-ec18-4ff4-900f-781e7c13024e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:53.166545 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7f9737a9-ec18-4ff4-900f-781e7c13024e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: f626c6e4-e55a-4017-b80f-51aee6063d3d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:53.173000 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7f9737a9-ec18-4ff4-900f-781e7c13024e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:53.173460 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7f9737a9-ec18-4ff4-900f-781e7c13024e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:53.174283 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7f9737a9-ec18-4ff4-900f-781e7c13024e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:53.174731 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7f9737a9-ec18-4ff4-900f-781e7c13024e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:53.318482 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7f9737a9-ec18-4ff4-900f-781e7c13024e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:53.326596 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7f9737a9-ec18-4ff4-900f-781e7c13024e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d" status: 200 len: 1679 microversion: 2.1 time: 0.166081 Jul 18 03:34:53.327189 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3646/7277] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:53 2022] GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:34:54.344238 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-9f8cc8bd-1154-46e8-92c3-2bd95a72298b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:54.345012 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-9f8cc8bd-1154-46e8-92c3-2bd95a72298b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: f626c6e4-e55a-4017-b80f-51aee6063d3d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:54.353039 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9f8cc8bd-1154-46e8-92c3-2bd95a72298b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:54.353487 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9f8cc8bd-1154-46e8-92c3-2bd95a72298b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:54.354297 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9f8cc8bd-1154-46e8-92c3-2bd95a72298b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:54.354730 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-9f8cc8bd-1154-46e8-92c3-2bd95a72298b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:54.489779 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-9f8cc8bd-1154-46e8-92c3-2bd95a72298b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:54.497363 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-9f8cc8bd-1154-46e8-92c3-2bd95a72298b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d" status: 200 len: 1679 microversion: 2.1 time: 0.157431 Jul 18 03:34:54.497968 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3632/7278] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:54 2022] GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:34:55.515592 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7b87e149-2d90-456d-8c42-3fae890679b3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:55.516181 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7b87e149-2d90-456d-8c42-3fae890679b3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: f626c6e4-e55a-4017-b80f-51aee6063d3d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:55.523725 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7b87e149-2d90-456d-8c42-3fae890679b3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:55.524220 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7b87e149-2d90-456d-8c42-3fae890679b3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:55.525004 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7b87e149-2d90-456d-8c42-3fae890679b3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:55.525467 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7b87e149-2d90-456d-8c42-3fae890679b3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:55.661811 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7b87e149-2d90-456d-8c42-3fae890679b3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:55.669390 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7b87e149-2d90-456d-8c42-3fae890679b3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d" status: 200 len: 1679 microversion: 2.1 time: 0.158122 Jul 18 03:34:55.669994 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3647/7279] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:55 2022] GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:34:56.686624 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-cbd785a6-1ecc-409a-84a3-f480fa46ef1b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:56.687269 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-cbd785a6-1ecc-409a-84a3-f480fa46ef1b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: f626c6e4-e55a-4017-b80f-51aee6063d3d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:56.694825 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cbd785a6-1ecc-409a-84a3-f480fa46ef1b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:56.695277 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cbd785a6-1ecc-409a-84a3-f480fa46ef1b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:56.696035 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cbd785a6-1ecc-409a-84a3-f480fa46ef1b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:56.696471 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-cbd785a6-1ecc-409a-84a3-f480fa46ef1b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:56.828446 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-cbd785a6-1ecc-409a-84a3-f480fa46ef1b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:56.836035 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-cbd785a6-1ecc-409a-84a3-f480fa46ef1b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d" status: 200 len: 1679 microversion: 2.1 time: 0.153312 Jul 18 03:34:56.836610 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3633/7280] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:56 2022] GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:34:57.853139 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7ee890ba-0a5d-4cc4-9be9-fda4f993351b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:57.853814 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7ee890ba-0a5d-4cc4-9be9-fda4f993351b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: f626c6e4-e55a-4017-b80f-51aee6063d3d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:57.861412 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7ee890ba-0a5d-4cc4-9be9-fda4f993351b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:57.862176 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7ee890ba-0a5d-4cc4-9be9-fda4f993351b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:57.862894 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7ee890ba-0a5d-4cc4-9be9-fda4f993351b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:57.863340 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7ee890ba-0a5d-4cc4-9be9-fda4f993351b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:57.996839 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7ee890ba-0a5d-4cc4-9be9-fda4f993351b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:58.004494 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7ee890ba-0a5d-4cc4-9be9-fda4f993351b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d" status: 200 len: 1679 microversion: 2.1 time: 0.155567 Jul 18 03:34:58.005068 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3648/7281] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:57 2022] GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:34:59.022348 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-86f9576e-706d-4f04-880e-85ef39fcca5c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:59.022968 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-86f9576e-706d-4f04-880e-85ef39fcca5c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: f626c6e4-e55a-4017-b80f-51aee6063d3d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:59.029104 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-86f9576e-706d-4f04-880e-85ef39fcca5c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:59.029557 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-86f9576e-706d-4f04-880e-85ef39fcca5c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:59.030353 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-86f9576e-706d-4f04-880e-85ef39fcca5c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:59.030794 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-86f9576e-706d-4f04-880e-85ef39fcca5c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:59.167251 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-86f9576e-706d-4f04-880e-85ef39fcca5c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:59.175252 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-86f9576e-706d-4f04-880e-85ef39fcca5c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d" status: 200 len: 1679 microversion: 2.1 time: 0.157167 Jul 18 03:34:59.175823 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3634/7282] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:59 2022] GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:00.192375 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-525869e1-ae58-4450-8391-f07d7b8c1aed tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:00.192925 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-525869e1-ae58-4450-8391-f07d7b8c1aed tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: f626c6e4-e55a-4017-b80f-51aee6063d3d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:00.199987 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-525869e1-ae58-4450-8391-f07d7b8c1aed tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:00.200455 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-525869e1-ae58-4450-8391-f07d7b8c1aed tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:00.201240 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-525869e1-ae58-4450-8391-f07d7b8c1aed tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:00.201687 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-525869e1-ae58-4450-8391-f07d7b8c1aed tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:00.334547 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-525869e1-ae58-4450-8391-f07d7b8c1aed tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:00.342114 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-525869e1-ae58-4450-8391-f07d7b8c1aed tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d" status: 200 len: 1679 microversion: 2.1 time: 0.154239 Jul 18 03:35:00.342687 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3649/7283] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:00 2022] GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:01.359787 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e771e63b-e75b-4410-b1b9-6c6243ae3aac tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:01.361567 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e771e63b-e75b-4410-b1b9-6c6243ae3aac tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: f626c6e4-e55a-4017-b80f-51aee6063d3d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:01.368491 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e771e63b-e75b-4410-b1b9-6c6243ae3aac tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:01.369197 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e771e63b-e75b-4410-b1b9-6c6243ae3aac tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:01.370221 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e771e63b-e75b-4410-b1b9-6c6243ae3aac tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:01.370865 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e771e63b-e75b-4410-b1b9-6c6243ae3aac tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:01.582316 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e771e63b-e75b-4410-b1b9-6c6243ae3aac tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:01.590035 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e771e63b-e75b-4410-b1b9-6c6243ae3aac tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d" status: 200 len: 1679 microversion: 2.1 time: 0.234075 Jul 18 03:35:01.590626 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3635/7284] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:01 2022] GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d => generated 1679 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:02.609359 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-93d596a6-abbc-484a-8971-d6f8d6400c0a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:02.610526 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-93d596a6-abbc-484a-8971-d6f8d6400c0a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: f626c6e4-e55a-4017-b80f-51aee6063d3d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:02.617665 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-93d596a6-abbc-484a-8971-d6f8d6400c0a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:02.618161 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-93d596a6-abbc-484a-8971-d6f8d6400c0a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:02.618949 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-93d596a6-abbc-484a-8971-d6f8d6400c0a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:02.619399 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-93d596a6-abbc-484a-8971-d6f8d6400c0a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:02.751597 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-93d596a6-abbc-484a-8971-d6f8d6400c0a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:02.759315 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-93d596a6-abbc-484a-8971-d6f8d6400c0a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d" status: 200 len: 1679 microversion: 2.1 time: 0.155109 Jul 18 03:35:02.759888 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3650/7285] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:02 2022] GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:03.776832 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b1a590aa-94b4-44d9-823b-9b04850d76f2 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:03.777393 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b1a590aa-94b4-44d9-823b-9b04850d76f2 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: f626c6e4-e55a-4017-b80f-51aee6063d3d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:03.785199 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b1a590aa-94b4-44d9-823b-9b04850d76f2 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:03.785644 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b1a590aa-94b4-44d9-823b-9b04850d76f2 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:03.786508 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b1a590aa-94b4-44d9-823b-9b04850d76f2 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:03.786952 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b1a590aa-94b4-44d9-823b-9b04850d76f2 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:03.934215 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b1a590aa-94b4-44d9-823b-9b04850d76f2 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:03.943703 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b1a590aa-94b4-44d9-823b-9b04850d76f2 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d" status: 200 len: 1682 microversion: 2.1 time: 0.170825 Jul 18 03:35:03.944342 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3636/7286] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:03 2022] GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:35:38.171503 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c6de176f-b22e-4e3a-bde0-a1b3853e3eb1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:35:38.173075 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c6de176f-b22e-4e3a-bde0-a1b3853e3eb1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: f626c6e4-e55a-4017-b80f-51aee6063d3d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:38.175546 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=12 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:35:38.176218 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:35:38.182734 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c6de176f-b22e-4e3a-bde0-a1b3853e3eb1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:38.183198 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c6de176f-b22e-4e3a-bde0-a1b3853e3eb1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:38.184035 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c6de176f-b22e-4e3a-bde0-a1b3853e3eb1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:38.184544 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c6de176f-b22e-4e3a-bde0-a1b3853e3eb1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:38.258837 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c6de176f-b22e-4e3a-bde0-a1b3853e3eb1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "POST /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d/action" status: 200 len: 69085 microversion: 2.1 time: 0.092253 Jul 18 03:35:38.259535 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3651/7287] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:35:38 2022] POST /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d/action => generated 69085 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 03:35:55.775657 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1b61ed54-7c19-49ed-9007-40104d33ad8e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:55.776208 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1b61ed54-7c19-49ed-9007-40104d33ad8e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: f626c6e4-e55a-4017-b80f-51aee6063d3d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:55.778584 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=12 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:35:55.779375 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:35:55.779814 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=36 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:35:55.780328 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=4 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:35:55.787134 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1b61ed54-7c19-49ed-9007-40104d33ad8e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:55.787584 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1b61ed54-7c19-49ed-9007-40104d33ad8e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:55.788872 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1b61ed54-7c19-49ed-9007-40104d33ad8e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:55.789320 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1b61ed54-7c19-49ed-9007-40104d33ad8e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:55.816746 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1b61ed54-7c19-49ed-9007-40104d33ad8e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: f626c6e4-e55a-4017-b80f-51aee6063d3d] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:35:55.850982 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-2446a069-9670-4348-9a66-84f84c6deec4 req-547e1baf-ca75-4827-91ad-7702168c719b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f626c6e4-e55a-4017-b80f-51aee6063d3d", "tag": "46be07ff-ef78-4100-b063-e7c4d5a1bdd3"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:35:55.861326 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-2446a069-9670-4348-9a66-84f84c6deec4 req-547e1baf-ca75-4827-91ad-7702168c719b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:55.861860 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-2446a069-9670-4348-9a66-84f84c6deec4 req-547e1baf-ca75-4827-91ad-7702168c719b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:55.873547 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-2446a069-9670-4348-9a66-84f84c6deec4 req-547e1baf-ca75-4827-91ad-7702168c719b service nova] Creating event network-changed:46be07ff-ef78-4100-b063-e7c4d5a1bdd3 for instance f626c6e4-e55a-4017-b80f-51aee6063d3d on n-h1-465891-3 Jul 18 03:35:55.879931 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-2446a069-9670-4348-9a66-84f84c6deec4 req-547e1baf-ca75-4827-91ad-7702168c719b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105923 Jul 18 03:35:55.881983 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3652/7288] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:35:55.900554 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1b61ed54-7c19-49ed-9007-40104d33ad8e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d" status: 204 len: 0 microversion: 2.1 time: 0.128911 Jul 18 03:35:55.901150 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3637/7289] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:35:55 2022] DELETE /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:35:55.910126 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ba5f6a8b-99a6-4b38-abdc-b3029bb5825f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:55.910931 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ba5f6a8b-99a6-4b38-abdc-b3029bb5825f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: f626c6e4-e55a-4017-b80f-51aee6063d3d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:55.917297 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ba5f6a8b-99a6-4b38-abdc-b3029bb5825f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:55.917878 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ba5f6a8b-99a6-4b38-abdc-b3029bb5825f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:55.918677 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ba5f6a8b-99a6-4b38-abdc-b3029bb5825f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:55.919135 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ba5f6a8b-99a6-4b38-abdc-b3029bb5825f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:56.102257 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ba5f6a8b-99a6-4b38-abdc-b3029bb5825f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:56.110062 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ba5f6a8b-99a6-4b38-abdc-b3029bb5825f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d" status: 200 len: 1688 microversion: 2.1 time: 0.204364 Jul 18 03:35:56.110740 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3653/7290] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:55 2022] GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d => generated 1688 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:35:57.129275 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6673c4a1-4e0d-448f-b711-62eee99dceaf tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:57.130186 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6673c4a1-4e0d-448f-b711-62eee99dceaf tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: f626c6e4-e55a-4017-b80f-51aee6063d3d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:57.137080 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6673c4a1-4e0d-448f-b711-62eee99dceaf tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:57.137537 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6673c4a1-4e0d-448f-b711-62eee99dceaf tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:57.138361 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6673c4a1-4e0d-448f-b711-62eee99dceaf tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:57.138869 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6673c4a1-4e0d-448f-b711-62eee99dceaf tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:57.367161 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6673c4a1-4e0d-448f-b711-62eee99dceaf tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:57.374747 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6673c4a1-4e0d-448f-b711-62eee99dceaf tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d" status: 200 len: 1688 microversion: 2.1 time: 0.250733 Jul 18 03:35:57.375335 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3638/7291] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:57 2022] GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d => generated 1688 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:58.228210 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-753cb6eb-3584-434b-ab93-69c6450a8289 req-1b069e20-5c79-4f4e-9532-2447ee3fd298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f626c6e4-e55a-4017-b80f-51aee6063d3d", "name": "network-vif-deleted", "tag": "46be07ff-ef78-4100-b063-e7c4d5a1bdd3"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:35:58.237833 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-753cb6eb-3584-434b-ab93-69c6450a8289 req-1b069e20-5c79-4f4e-9532-2447ee3fd298 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:58.238294 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-753cb6eb-3584-434b-ab93-69c6450a8289 req-1b069e20-5c79-4f4e-9532-2447ee3fd298 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:58.249875 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-753cb6eb-3584-434b-ab93-69c6450a8289 req-1b069e20-5c79-4f4e-9532-2447ee3fd298 service nova] Creating event network-vif-deleted:46be07ff-ef78-4100-b063-e7c4d5a1bdd3 for instance f626c6e4-e55a-4017-b80f-51aee6063d3d on n-h1-465891-3 Jul 18 03:35:58.256076 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-753cb6eb-3584-434b-ab93-69c6450a8289 req-1b069e20-5c79-4f4e-9532-2447ee3fd298 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033659 Jul 18 03:35:58.256619 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3654/7292] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:35:58.392300 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-18f59ddf-3530-43dc-885f-dae5e0707912 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:58.393585 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-18f59ddf-3530-43dc-885f-dae5e0707912 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: f626c6e4-e55a-4017-b80f-51aee6063d3d] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:58.400616 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-18f59ddf-3530-43dc-885f-dae5e0707912 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:58.401067 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-18f59ddf-3530-43dc-885f-dae5e0707912 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:58.401863 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-18f59ddf-3530-43dc-885f-dae5e0707912 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:58.402294 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-18f59ddf-3530-43dc-885f-dae5e0707912 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:58.433601 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-18f59ddf-3530-43dc-885f-dae5e0707912 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:58.434008 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-18f59ddf-3530-43dc-885f-dae5e0707912 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:58.434459 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-18f59ddf-3530-43dc-885f-dae5e0707912 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lazy-loading 'fault' on Instance uuid f626c6e4-e55a-4017-b80f-51aee6063d3d {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:35:58.475286 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-18f59ddf-3530-43dc-885f-dae5e0707912 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:58.483062 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-18f59ddf-3530-43dc-885f-dae5e0707912 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d" status: 200 len: 1355 microversion: 2.1 time: 0.094858 Jul 18 03:35:58.483683 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3639/7293] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:58 2022] GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d => generated 1355 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:59.505423 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6dffdcc3-6420-4f05-ab89-b7d1e942912a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:59.506141 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6dffdcc3-6420-4f05-ab89-b7d1e942912a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: f626c6e4-e55a-4017-b80f-51aee6063d3d] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:59.512839 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6dffdcc3-6420-4f05-ab89-b7d1e942912a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:59.513302 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6dffdcc3-6420-4f05-ab89-b7d1e942912a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:59.514123 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6dffdcc3-6420-4f05-ab89-b7d1e942912a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:59.514575 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6dffdcc3-6420-4f05-ab89-b7d1e942912a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:59.528807 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-6dffdcc3-6420-4f05-ab89-b7d1e942912a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] HTTP exception thrown: Instance f626c6e4-e55a-4017-b80f-51aee6063d3d could not be found. Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6dffdcc3-6420-4f05-ab89-b7d1e942912a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Request method failure captured: Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d HTTP/1.1 Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1NQn25Nv2CWVcqUB7Jli7-n6pu90utlDXaCYfmF3mQfgKsu7CU9h4Qgbxu3IIS2bQPi7DmlwnQeENXcFmebHsSlw-o4GKxkvJck1gJGsOn4xtry1F0sEpYLtQaLLoR_0JXssRBl37TNYHSvAfTOqzePvi79-HEbaRAqO169pHpwd49Q Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 2d9c17c023e1420c8d90b96e2af98172 Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1294373808 Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2d9c17c023e1420c8d90b96e2af98172"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2d9c17c023e1420c8d90b96e2af98172"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2d9c17c023e1420c8d90b96e2af98172"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2d9c17c023e1420c8d90b96e2af98172"}]}] Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1294373808 Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 2d9c17c023e1420c8d90b96e2af98172 Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1294373808 Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-TestNetworkAdvancedServerOps-1294373808-project Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: 921716a730f64ccdbbced6d4bbf715b0 Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1294373808-project Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance f626c6e4-e55a-4017-b80f-51aee6063d3d could not be found. Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'f626c6e4-e55a-4017-b80f-51aee6063d3d'} Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f626c6e4-e55a-4017-b80f-51aee6063d3d could not be found. Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f626c6e4-e55a-4017-b80f-51aee6063d3d could not be found. Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:35:59.530528 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:35:59.535151 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:35:59.535151 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:35:59.535151 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:35:59.535151 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:35:59.535151 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:35:59.535151 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:35:59.535151 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f626c6e4-e55a-4017-b80f-51aee6063d3d could not be found. Jul 18 03:35:59.535151 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:35:59.535151 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6dffdcc3-6420-4f05-ab89-b7d1e942912a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Returning 404 to user: Instance f626c6e4-e55a-4017-b80f-51aee6063d3d could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:35:59.535151 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6dffdcc3-6420-4f05-ab89-b7d1e942912a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d" status: 404 len: 111 microversion: 2.1 time: 0.032527 Jul 18 03:35:59.535151 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3655/7294] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:59 2022] GET /compute/v2.1/servers/f626c6e4-e55a-4017-b80f-51aee6063d3d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:36:03.218166 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e35110c1-7919-48b6-820b-d375f43b5d88 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '.version_select at 0x7ff49bd903a0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:03.221862 n-d-465891-3 devstack@n-api.service[119544]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e35110c1-7919-48b6-820b-d375f43b5d88 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [9b614394-4ee4-4928-af3b-503f636175bf] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 03:36:04.228849 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [None req-e35110c1-7919-48b6-820b-d375f43b5d88 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [9b614394-4ee4-4928-af3b-503f636175bf] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 53146. Jul 18 03:36:04.248593 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e35110c1-7919-48b6-820b-d375f43b5d88 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-355387027" status: 202 len: 0 microversion: 2.1 time: 1.035087 Jul 18 03:36:04.249179 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3640/7295] 10.222.0.57 () {58 vars in 1280 bytes} [Mon Jul 18 03:36:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-355387027 => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:36:04.280388 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-da04f1e9-6789-4218-9893-4d1ad176301c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Action: 'create', calling method: .version_select at 0x7ff49b966280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1282394239", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbwFrI/TwkbwdzBsUj4L1pqKbL20hgd6v0SSI0HKezzivTAgJs5YB/BBMMPJXx2UDH/6AVi1nEAPn76EHXBRxJSEC5l1vmkH+J0gRqAWZNzqewfjbF1mnqpYoSH+Ch/Lg=="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:36:04.295897 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-da04f1e9-6789-4218-9893-4d1ad176301c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Getting quotas for project 2d9c17c023e1420c8d90b96e2af98172. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:36:04.304159 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-da04f1e9-6789-4218-9893-4d1ad176301c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Getting quotas for user 921716a730f64ccdbbced6d4bbf715b0 and project 2d9c17c023e1420c8d90b96e2af98172. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:36:04.317930 n-d-465891-3 devstack@n-api.service[119543]: ERROR oslo.messaging._drivers.impl_rabbit [None req-da04f1e9-6789-4218-9893-4d1ad176301c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [6c446bb4-9d53-4b4c-9076-95dab63577c9] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 03:36:05.325429 n-d-465891-3 devstack@n-api.service[119543]: INFO oslo.messaging._drivers.impl_rabbit [None req-da04f1e9-6789-4218-9893-4d1ad176301c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [6c446bb4-9d53-4b4c-9076-95dab63577c9] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 53150. Jul 18 03:36:05.341301 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-da04f1e9-6789-4218-9893-4d1ad176301c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.064785 Jul 18 03:36:05.341961 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3656/7296] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 03:36:04 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:36:11.183466 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0cfe8bb8-f597-4716-808d-9ccea844e888 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-351585748", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "7e89b05e-efd9-4e9a-9c57-ca1b2518ae2a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1282394239", "security_groups": [{"name": "tempest-secgroup-smoke-1461877598"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:36:11.193524 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:36:11.339684 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-0cfe8bb8-f597-4716-808d-9ccea844e888 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] validate_networks() for [('7e89b05e-efd9-4e9a-9c57-ca1b2518ae2a', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:36:11.903536 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-0cfe8bb8-f597-4716-808d-9ccea844e888 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:36:11.903966 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-0cfe8bb8-f597-4716-808d-9ccea844e888 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:36:11.904486 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-0cfe8bb8-f597-4716-808d-9ccea844e888 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:36:11.905845 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-0cfe8bb8-f597-4716-808d-9ccea844e888 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:36:11.906278 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-0cfe8bb8-f597-4716-808d-9ccea844e888 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:36:11.917511 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0cfe8bb8-f597-4716-808d-9ccea844e888 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:11.918001 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0cfe8bb8-f597-4716-808d-9ccea844e888 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:11.918818 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0cfe8bb8-f597-4716-808d-9ccea844e888 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:11.919854 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0cfe8bb8-f597-4716-808d-9ccea844e888 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:11.942783 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-0cfe8bb8-f597-4716-808d-9ccea844e888 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Getting quotas for project 2d9c17c023e1420c8d90b96e2af98172. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:36:11.948739 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-0cfe8bb8-f597-4716-808d-9ccea844e888 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Getting quotas for user 921716a730f64ccdbbced6d4bbf715b0 and project 2d9c17c023e1420c8d90b96e2af98172. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:36:11.964494 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0cfe8bb8-f597-4716-808d-9ccea844e888 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:36:11.966838 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0cfe8bb8-f597-4716-808d-9ccea844e888 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:36:12.030859 n-d-465891-3 devstack@n-api.service[119544]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0cfe8bb8-f597-4716-808d-9ccea844e888 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [d1db53c4-5096-4d88-96cb-2be3ad77b75e] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 03:36:13.042684 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [None req-0cfe8bb8-f597-4716-808d-9ccea844e888 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [d1db53c4-5096-4d88-96cb-2be3ad77b75e] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 53198. Jul 18 03:36:13.067374 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0cfe8bb8-f597-4716-808d-9ccea844e888 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.887912 Jul 18 03:36:13.071155 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3641/7297] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:36:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 1892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 03:36:13.083241 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-806f3565-6f97-43e4-bccb-6cbff1c93d76 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:13.083800 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-806f3565-6f97-43e4-bccb-6cbff1c93d76 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:13.098684 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=12 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:36:13.201489 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-806f3565-6f97-43e4-bccb-6cbff1c93d76 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:36:13.213451 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-806f3565-6f97-43e4-bccb-6cbff1c93d76 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26" status: 200 len: 1266 microversion: 2.1 time: 0.135251 Jul 18 03:36:13.214093 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3657/7298] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:13 2022] GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26 => generated 1266 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:36:14.232798 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8e2653ef-0dbe-4870-9113-3b819b3c025d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:14.233406 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8e2653ef-0dbe-4870-9113-3b819b3c025d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:14.239994 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8e2653ef-0dbe-4870-9113-3b819b3c025d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:14.240442 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8e2653ef-0dbe-4870-9113-3b819b3c025d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:14.241223 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8e2653ef-0dbe-4870-9113-3b819b3c025d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:14.241660 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8e2653ef-0dbe-4870-9113-3b819b3c025d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:14.316709 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8e2653ef-0dbe-4870-9113-3b819b3c025d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:36:14.324464 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8e2653ef-0dbe-4870-9113-3b819b3c025d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26" status: 200 len: 1318 microversion: 2.1 time: 0.096432 Jul 18 03:36:14.325052 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3642/7299] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:14 2022] GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26 => generated 1318 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:36:14.642836 n-d-465891-3 devstack@n-api.service[119543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:36:14.643913 n-d-465891-3 devstack@n-api.service[119543]: Mon Jul 18 03:36:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:36:15.342879 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2ad3dc8b-4d15-4312-893a-840b5ff46087 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:15.343870 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2ad3dc8b-4d15-4312-893a-840b5ff46087 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:15.354018 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2ad3dc8b-4d15-4312-893a-840b5ff46087 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:15.354986 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2ad3dc8b-4d15-4312-893a-840b5ff46087 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:15.356332 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2ad3dc8b-4d15-4312-893a-840b5ff46087 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:15.357070 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2ad3dc8b-4d15-4312-893a-840b5ff46087 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:15.520450 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2ad3dc8b-4d15-4312-893a-840b5ff46087 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:36:15.532250 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2ad3dc8b-4d15-4312-893a-840b5ff46087 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26" status: 200 len: 1392 microversion: 2.1 time: 0.189914 Jul 18 03:36:15.532250 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3658/7300] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:15 2022] GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26 => generated 1392 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:36:15.987437 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-04b40af6-d410-4749-a887-1ab3fa57cd46 req-94b63da1-bcc2-4c3f-8c00-ba1c03608316 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d08e7fb-90d6-4c3a-b832-435c2fa18d26", "tag": "4db63053-38ce-436d-915b-d854a13d38b6"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:36:16.013152 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-04b40af6-d410-4749-a887-1ab3fa57cd46 req-94b63da1-bcc2-4c3f-8c00-ba1c03608316 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:16.013598 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-04b40af6-d410-4749-a887-1ab3fa57cd46 req-94b63da1-bcc2-4c3f-8c00-ba1c03608316 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:16.028938 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-04b40af6-d410-4749-a887-1ab3fa57cd46 req-94b63da1-bcc2-4c3f-8c00-ba1c03608316 service nova] Creating event network-changed:4db63053-38ce-436d-915b-d854a13d38b6 for instance 7d08e7fb-90d6-4c3a-b832-435c2fa18d26 on n-h1-465891-3 Jul 18 03:36:16.036058 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-04b40af6-d410-4749-a887-1ab3fa57cd46 req-94b63da1-bcc2-4c3f-8c00-ba1c03608316 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052604 Jul 18 03:36:16.037315 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3643/7301] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:36:16.547175 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-be00aa64-c5a3-4e84-909d-e43b281345c2 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:16.547800 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-be00aa64-c5a3-4e84-909d-e43b281345c2 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:16.555669 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-be00aa64-c5a3-4e84-909d-e43b281345c2 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:16.556130 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-be00aa64-c5a3-4e84-909d-e43b281345c2 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:16.556956 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-be00aa64-c5a3-4e84-909d-e43b281345c2 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:16.557406 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-be00aa64-c5a3-4e84-909d-e43b281345c2 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:16.692761 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-be00aa64-c5a3-4e84-909d-e43b281345c2 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:36:16.701141 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-be00aa64-c5a3-4e84-909d-e43b281345c2 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26" status: 200 len: 1392 microversion: 2.1 time: 0.157928 Jul 18 03:36:16.701751 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3659/7302] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:16 2022] GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:36:17.718747 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-304e1f8c-c90f-4a2f-83f8-bf2213cc35af tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:17.719442 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-304e1f8c-c90f-4a2f-83f8-bf2213cc35af tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:17.726643 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-304e1f8c-c90f-4a2f-83f8-bf2213cc35af tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:17.727095 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-304e1f8c-c90f-4a2f-83f8-bf2213cc35af tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:17.727858 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-304e1f8c-c90f-4a2f-83f8-bf2213cc35af tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:17.728288 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-304e1f8c-c90f-4a2f-83f8-bf2213cc35af tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:17.879288 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-304e1f8c-c90f-4a2f-83f8-bf2213cc35af tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:36:17.887552 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-304e1f8c-c90f-4a2f-83f8-bf2213cc35af tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26" status: 200 len: 1392 microversion: 2.1 time: 0.172914 Jul 18 03:36:17.888162 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3644/7303] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:17 2022] GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26 => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:36:18.913067 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-597aad0f-ff30-47bc-93b3-59c48f97ce1c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:18.914366 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-597aad0f-ff30-47bc-93b3-59c48f97ce1c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:18.920624 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-597aad0f-ff30-47bc-93b3-59c48f97ce1c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:18.921085 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-597aad0f-ff30-47bc-93b3-59c48f97ce1c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:18.921912 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-597aad0f-ff30-47bc-93b3-59c48f97ce1c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:18.922534 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-597aad0f-ff30-47bc-93b3-59c48f97ce1c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:19.059846 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-597aad0f-ff30-47bc-93b3-59c48f97ce1c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:36:19.068281 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-597aad0f-ff30-47bc-93b3-59c48f97ce1c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26" status: 200 len: 1392 microversion: 2.1 time: 0.159747 Jul 18 03:36:19.068875 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3660/7304] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:18 2022] GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:36:20.084349 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e51543df-af85-4023-a052-9ad6714f07d3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:20.084965 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e51543df-af85-4023-a052-9ad6714f07d3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:20.092409 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e51543df-af85-4023-a052-9ad6714f07d3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:20.092593 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e51543df-af85-4023-a052-9ad6714f07d3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:20.093388 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e51543df-af85-4023-a052-9ad6714f07d3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:20.093860 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e51543df-af85-4023-a052-9ad6714f07d3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:20.242714 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e51543df-af85-4023-a052-9ad6714f07d3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:36:20.250598 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e51543df-af85-4023-a052-9ad6714f07d3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26" status: 200 len: 1392 microversion: 2.1 time: 0.170113 Jul 18 03:36:20.251211 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3645/7305] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:20 2022] GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26 => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:36:21.268473 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c42080ab-33ed-4973-b5da-325b43e895d1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:21.269118 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c42080ab-33ed-4973-b5da-325b43e895d1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:21.276594 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c42080ab-33ed-4973-b5da-325b43e895d1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:21.277066 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c42080ab-33ed-4973-b5da-325b43e895d1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:21.277925 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c42080ab-33ed-4973-b5da-325b43e895d1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:21.278383 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c42080ab-33ed-4973-b5da-325b43e895d1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:21.424483 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c42080ab-33ed-4973-b5da-325b43e895d1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:36:21.433447 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c42080ab-33ed-4973-b5da-325b43e895d1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26" status: 200 len: 1392 microversion: 2.1 time: 0.169245 Jul 18 03:36:21.434081 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3661/7306] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:21 2022] GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26 => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:36:22.279667 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:36:22.280432 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:36:22.348733 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-92712f61-9f72-4dea-bf97-8e47fc8623ad req-ba739643-68e4-4a74-ad86-c65175168d6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d08e7fb-90d6-4c3a-b832-435c2fa18d26", "name": "network-vif-plugged", "status": "completed", "tag": "4db63053-38ce-436d-915b-d854a13d38b6"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:36:22.357894 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-92712f61-9f72-4dea-bf97-8e47fc8623ad req-ba739643-68e4-4a74-ad86-c65175168d6a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:22.358443 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-92712f61-9f72-4dea-bf97-8e47fc8623ad req-ba739643-68e4-4a74-ad86-c65175168d6a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:22.371396 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-92712f61-9f72-4dea-bf97-8e47fc8623ad req-ba739643-68e4-4a74-ad86-c65175168d6a service nova] Creating event network-vif-plugged:4db63053-38ce-436d-915b-d854a13d38b6 for instance 7d08e7fb-90d6-4c3a-b832-435c2fa18d26 on n-h1-465891-3 Jul 18 03:36:22.376665 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-92712f61-9f72-4dea-bf97-8e47fc8623ad req-ba739643-68e4-4a74-ad86-c65175168d6a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102529 Jul 18 03:36:22.377290 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3646/7307] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:36:22.455756 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d6433518-3711-4082-8416-6bf591d1ab45 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:22.457561 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d6433518-3711-4082-8416-6bf591d1ab45 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:22.467216 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d6433518-3711-4082-8416-6bf591d1ab45 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:22.467689 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d6433518-3711-4082-8416-6bf591d1ab45 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:22.468501 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d6433518-3711-4082-8416-6bf591d1ab45 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:22.468955 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d6433518-3711-4082-8416-6bf591d1ab45 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:22.623091 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d6433518-3711-4082-8416-6bf591d1ab45 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:36:22.632036 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d6433518-3711-4082-8416-6bf591d1ab45 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26" status: 200 len: 1392 microversion: 2.1 time: 0.183978 Jul 18 03:36:22.632722 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3662/7308] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:22 2022] GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26 => generated 1392 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:36:23.650741 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e0cd5c29-5c49-49ed-9663-3b0b2bf740b3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:23.651480 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e0cd5c29-5c49-49ed-9663-3b0b2bf740b3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:23.658014 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e0cd5c29-5c49-49ed-9663-3b0b2bf740b3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:23.658470 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e0cd5c29-5c49-49ed-9663-3b0b2bf740b3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:23.659243 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e0cd5c29-5c49-49ed-9663-3b0b2bf740b3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:23.659728 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e0cd5c29-5c49-49ed-9663-3b0b2bf740b3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:23.806391 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e0cd5c29-5c49-49ed-9663-3b0b2bf740b3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:36:23.814358 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e0cd5c29-5c49-49ed-9663-3b0b2bf740b3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26" status: 200 len: 1392 microversion: 2.1 time: 0.168775 Jul 18 03:36:23.814949 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3647/7309] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:23 2022] GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26 => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:36:24.832048 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-00d4093d-180e-48b9-a83e-18a3f0d48818 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:24.832695 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-00d4093d-180e-48b9-a83e-18a3f0d48818 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:24.834734 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:36:24.840932 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-00d4093d-180e-48b9-a83e-18a3f0d48818 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:24.841399 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-00d4093d-180e-48b9-a83e-18a3f0d48818 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:24.842242 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-00d4093d-180e-48b9-a83e-18a3f0d48818 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:24.842699 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-00d4093d-180e-48b9-a83e-18a3f0d48818 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:24.974397 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-00d4093d-180e-48b9-a83e-18a3f0d48818 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:36:24.982175 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-00d4093d-180e-48b9-a83e-18a3f0d48818 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26" status: 200 len: 1563 microversion: 2.1 time: 0.154528 Jul 18 03:36:24.982757 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3663/7310] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:24 2022] GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:36:24.998573 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-05f513ad-64b9-4faa-a35f-247ab1c363a1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:24.999180 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-05f513ad-64b9-4faa-a35f-247ab1c363a1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:25.006850 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-05f513ad-64b9-4faa-a35f-247ab1c363a1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:25.007298 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-05f513ad-64b9-4faa-a35f-247ab1c363a1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:25.008054 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-05f513ad-64b9-4faa-a35f-247ab1c363a1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:25.008491 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-05f513ad-64b9-4faa-a35f-247ab1c363a1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:25.144276 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-05f513ad-64b9-4faa-a35f-247ab1c363a1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:36:25.151868 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-05f513ad-64b9-4faa-a35f-247ab1c363a1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26" status: 200 len: 1563 microversion: 2.1 time: 0.157242 Jul 18 03:36:25.152450 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3648/7311] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:24 2022] GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:36:26.754712 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-56eb7980-63a7-451d-977d-72532d042113 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:26.755350 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-56eb7980-63a7-451d-977d-72532d042113 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:26.758135 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:36:26.767111 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56eb7980-63a7-451d-977d-72532d042113 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:26.767592 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56eb7980-63a7-451d-977d-72532d042113 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:26.768478 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56eb7980-63a7-451d-977d-72532d042113 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:26.768968 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-56eb7980-63a7-451d-977d-72532d042113 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:26.827040 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-e1630ce2-530e-4d13-9346-190db28e598b req-532ea8df-087e-400d-a3ed-d71ebd837866 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d08e7fb-90d6-4c3a-b832-435c2fa18d26", "tag": "4db63053-38ce-436d-915b-d854a13d38b6"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:36:26.830664 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:36:26.842869 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-e1630ce2-530e-4d13-9346-190db28e598b req-532ea8df-087e-400d-a3ed-d71ebd837866 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:26.843751 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-e1630ce2-530e-4d13-9346-190db28e598b req-532ea8df-087e-400d-a3ed-d71ebd837866 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:26.856104 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-e1630ce2-530e-4d13-9346-190db28e598b req-532ea8df-087e-400d-a3ed-d71ebd837866 service nova] Creating event network-changed:4db63053-38ce-436d-915b-d854a13d38b6 for instance 7d08e7fb-90d6-4c3a-b832-435c2fa18d26 on n-h1-465891-3 Jul 18 03:36:26.862112 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-e1630ce2-530e-4d13-9346-190db28e598b req-532ea8df-087e-400d-a3ed-d71ebd837866 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108638 Jul 18 03:36:26.864307 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3649/7312] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:36:26.934035 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-56eb7980-63a7-451d-977d-72532d042113 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:36:26.943897 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-56eb7980-63a7-451d-977d-72532d042113 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26" status: 200 len: 1563 microversion: 2.1 time: 0.193095 Jul 18 03:36:26.945481 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3664/7313] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:26 2022] GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26 => generated 1563 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:37:00.238518 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=38 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:37:00.289511 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-61abf6d1-c8be-4e8f-8482-2852b73c9659 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:37:00.290544 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-61abf6d1-c8be-4e8f-8482-2852b73c9659 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:00.296937 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-61abf6d1-c8be-4e8f-8482-2852b73c9659 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:00.297399 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-61abf6d1-c8be-4e8f-8482-2852b73c9659 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:00.298218 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-61abf6d1-c8be-4e8f-8482-2852b73c9659 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:00.298650 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-61abf6d1-c8be-4e8f-8482-2852b73c9659 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:00.361308 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-61abf6d1-c8be-4e8f-8482-2852b73c9659 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "POST /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26/action" status: 200 len: 24571 microversion: 2.1 time: 0.124806 Jul 18 03:37:00.362100 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3650/7314] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:37:00 2022] POST /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26/action => generated 24571 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 03:37:30.791747 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:37:30.792516 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=42 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:37:30.797255 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f9289fe7-b67a-441d-86b4-db7a929ac32d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:37:30.798556 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f9289fe7-b67a-441d-86b4-db7a929ac32d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:30.806901 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f9289fe7-b67a-441d-86b4-db7a929ac32d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:30.807367 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f9289fe7-b67a-441d-86b4-db7a929ac32d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:30.808295 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f9289fe7-b67a-441d-86b4-db7a929ac32d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:30.808764 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f9289fe7-b67a-441d-86b4-db7a929ac32d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:30.903795 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f9289fe7-b67a-441d-86b4-db7a929ac32d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:37:30.910497 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f9289fe7-b67a-441d-86b4-db7a929ac32d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Old instance type m1.heat2, new instance type m1.heat {{(pid=119543) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 03:37:30.917832 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-f9289fe7-b67a-441d-86b4-db7a929ac32d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:37:30.918270 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-f9289fe7-b67a-441d-86b4-db7a929ac32d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:37:30.918761 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-f9289fe7-b67a-441d-86b4-db7a929ac32d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:37:30.919182 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-f9289fe7-b67a-441d-86b4-db7a929ac32d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:37:30.919610 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-f9289fe7-b67a-441d-86b4-db7a929ac32d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:37:30.989244 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f9289fe7-b67a-441d-86b4-db7a929ac32d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "POST /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26/action" status: 202 len: 0 microversion: 2.1 time: 0.199011 Jul 18 03:37:30.990112 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3665/7315] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:37:30 2022] POST /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:37:30.999495 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d8fa8d90-c78e-40fc-9dc0-5f550d21c323 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:31.000117 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d8fa8d90-c78e-40fc-9dc0-5f550d21c323 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:31.003192 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:37:31.004022 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:37:31.011062 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d8fa8d90-c78e-40fc-9dc0-5f550d21c323 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:31.011592 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d8fa8d90-c78e-40fc-9dc0-5f550d21c323 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:31.012371 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d8fa8d90-c78e-40fc-9dc0-5f550d21c323 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:31.012826 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d8fa8d90-c78e-40fc-9dc0-5f550d21c323 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:31.172941 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d8fa8d90-c78e-40fc-9dc0-5f550d21c323 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:37:31.182853 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d8fa8d90-c78e-40fc-9dc0-5f550d21c323 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26" status: 200 len: 1691 microversion: 2.1 time: 0.187492 Jul 18 03:37:31.183773 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3651/7316] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:37:30 2022] GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26 => generated 1691 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:37:32.204590 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ccd3ae20-a895-4009-a24e-1bb6974d7da6 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:32.205150 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ccd3ae20-a895-4009-a24e-1bb6974d7da6 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:32.218130 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ccd3ae20-a895-4009-a24e-1bb6974d7da6 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:32.218130 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ccd3ae20-a895-4009-a24e-1bb6974d7da6 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:32.218823 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ccd3ae20-a895-4009-a24e-1bb6974d7da6 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:32.219280 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ccd3ae20-a895-4009-a24e-1bb6974d7da6 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:32.357689 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ccd3ae20-a895-4009-a24e-1bb6974d7da6 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:37:32.367661 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ccd3ae20-a895-4009-a24e-1bb6974d7da6 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26" status: 200 len: 1691 microversion: 2.1 time: 0.166817 Jul 18 03:37:32.368258 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3666/7317] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:37:32 2022] GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26 => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:37:33.385305 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7155a05f-fdc7-4b6d-97cd-cd22a41eedb0 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:33.386037 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7155a05f-fdc7-4b6d-97cd-cd22a41eedb0 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:33.393778 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7155a05f-fdc7-4b6d-97cd-cd22a41eedb0 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:33.394237 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7155a05f-fdc7-4b6d-97cd-cd22a41eedb0 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:33.395068 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7155a05f-fdc7-4b6d-97cd-cd22a41eedb0 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:33.395503 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7155a05f-fdc7-4b6d-97cd-cd22a41eedb0 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:33.547001 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7155a05f-fdc7-4b6d-97cd-cd22a41eedb0 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:37:33.555508 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7155a05f-fdc7-4b6d-97cd-cd22a41eedb0 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26" status: 200 len: 1696 microversion: 2.1 time: 0.174846 Jul 18 03:37:33.556025 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3652/7318] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:37:33 2022] GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26 => generated 1696 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:37:34.573775 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a79d6299-6ca7-4d7e-a13f-1632e59087c3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:34.574415 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a79d6299-6ca7-4d7e-a13f-1632e59087c3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:34.580869 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a79d6299-6ca7-4d7e-a13f-1632e59087c3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:34.581329 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a79d6299-6ca7-4d7e-a13f-1632e59087c3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:34.582171 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a79d6299-6ca7-4d7e-a13f-1632e59087c3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:34.582626 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a79d6299-6ca7-4d7e-a13f-1632e59087c3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:34.732855 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a79d6299-6ca7-4d7e-a13f-1632e59087c3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:37:34.741947 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a79d6299-6ca7-4d7e-a13f-1632e59087c3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26" status: 200 len: 1696 microversion: 2.1 time: 0.173163 Jul 18 03:37:34.742568 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3667/7319] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:37:34 2022] GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26 => generated 1696 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:37:35.760308 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-467525e0-a912-4e0b-bb76-f40288dd7538 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:35.760914 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-467525e0-a912-4e0b-bb76-f40288dd7538 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:35.767952 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-467525e0-a912-4e0b-bb76-f40288dd7538 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:35.768395 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-467525e0-a912-4e0b-bb76-f40288dd7538 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:35.769429 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-467525e0-a912-4e0b-bb76-f40288dd7538 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:35.769894 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-467525e0-a912-4e0b-bb76-f40288dd7538 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:35.909964 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-467525e0-a912-4e0b-bb76-f40288dd7538 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:37:35.918091 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-467525e0-a912-4e0b-bb76-f40288dd7538 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26" status: 200 len: 1696 microversion: 2.1 time: 0.162332 Jul 18 03:37:35.918696 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3653/7320] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:37:35 2022] GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26 => generated 1696 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:37:36.935749 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0a2e1e9b-953b-4179-8828-daea3e12a2e7 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:36.936520 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0a2e1e9b-953b-4179-8828-daea3e12a2e7 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:36.943447 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0a2e1e9b-953b-4179-8828-daea3e12a2e7 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:36.944182 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0a2e1e9b-953b-4179-8828-daea3e12a2e7 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:36.945024 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0a2e1e9b-953b-4179-8828-daea3e12a2e7 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:36.945475 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0a2e1e9b-953b-4179-8828-daea3e12a2e7 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:37.423583 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0a2e1e9b-953b-4179-8828-daea3e12a2e7 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:37:37.431312 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0a2e1e9b-953b-4179-8828-daea3e12a2e7 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26" status: 200 len: 1696 microversion: 2.1 time: 0.499580 Jul 18 03:37:37.431892 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3668/7321] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:37:36 2022] GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26 => generated 1696 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:37:38.449761 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-76323f6c-357a-403e-95be-c2fede4c7a8d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:38.450422 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-76323f6c-357a-403e-95be-c2fede4c7a8d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:38.458352 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-76323f6c-357a-403e-95be-c2fede4c7a8d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:38.458798 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-76323f6c-357a-403e-95be-c2fede4c7a8d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:38.459742 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-76323f6c-357a-403e-95be-c2fede4c7a8d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:38.460057 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-76323f6c-357a-403e-95be-c2fede4c7a8d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:38.596749 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-76323f6c-357a-403e-95be-c2fede4c7a8d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:37:38.605011 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-76323f6c-357a-403e-95be-c2fede4c7a8d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26" status: 200 len: 1696 microversion: 2.1 time: 0.159193 Jul 18 03:37:38.605581 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3654/7322] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:37:38 2022] GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26 => generated 1696 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:37:39.622971 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-81b79dab-de55-4965-8d1a-a8b33adacaac tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:39.623596 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-81b79dab-de55-4965-8d1a-a8b33adacaac tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:39.630703 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-81b79dab-de55-4965-8d1a-a8b33adacaac tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:39.631164 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-81b79dab-de55-4965-8d1a-a8b33adacaac tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:39.631994 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-81b79dab-de55-4965-8d1a-a8b33adacaac tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:39.632499 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-81b79dab-de55-4965-8d1a-a8b33adacaac tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:39.773113 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-81b79dab-de55-4965-8d1a-a8b33adacaac tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:37:39.780830 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-81b79dab-de55-4965-8d1a-a8b33adacaac tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26" status: 200 len: 1696 microversion: 2.1 time: 0.161753 Jul 18 03:37:39.781406 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3669/7323] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:37:39 2022] GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26 => generated 1696 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:37:40.799591 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7a07bd2f-2aaf-4e88-9021-579625b44714 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:40.800254 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7a07bd2f-2aaf-4e88-9021-579625b44714 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:40.808071 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7a07bd2f-2aaf-4e88-9021-579625b44714 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:40.808517 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7a07bd2f-2aaf-4e88-9021-579625b44714 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:40.809249 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7a07bd2f-2aaf-4e88-9021-579625b44714 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:40.809693 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7a07bd2f-2aaf-4e88-9021-579625b44714 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:40.945488 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7a07bd2f-2aaf-4e88-9021-579625b44714 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:37:40.953497 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7a07bd2f-2aaf-4e88-9021-579625b44714 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26" status: 200 len: 1696 microversion: 2.1 time: 0.157751 Jul 18 03:37:40.954117 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3655/7324] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:37:40 2022] GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26 => generated 1696 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:37:41.971701 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6b73813c-21a1-4075-ab70-78f0dd760276 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:41.972336 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6b73813c-21a1-4075-ab70-78f0dd760276 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:41.980434 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6b73813c-21a1-4075-ab70-78f0dd760276 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:41.980900 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6b73813c-21a1-4075-ab70-78f0dd760276 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:41.981722 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6b73813c-21a1-4075-ab70-78f0dd760276 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:41.982170 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6b73813c-21a1-4075-ab70-78f0dd760276 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:42.130026 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6b73813c-21a1-4075-ab70-78f0dd760276 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:37:42.138298 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6b73813c-21a1-4075-ab70-78f0dd760276 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26" status: 200 len: 1696 microversion: 2.1 time: 0.170568 Jul 18 03:37:42.138880 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3670/7325] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:37:41 2022] GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26 => generated 1696 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:37:43.156788 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2ee3f04b-3bcb-45b5-b1b8-d77ef60c576d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:43.157386 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2ee3f04b-3bcb-45b5-b1b8-d77ef60c576d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:43.165943 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ee3f04b-3bcb-45b5-b1b8-d77ef60c576d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:43.166393 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ee3f04b-3bcb-45b5-b1b8-d77ef60c576d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:43.167171 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ee3f04b-3bcb-45b5-b1b8-d77ef60c576d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:43.167609 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ee3f04b-3bcb-45b5-b1b8-d77ef60c576d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:43.315188 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2ee3f04b-3bcb-45b5-b1b8-d77ef60c576d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:37:43.323010 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2ee3f04b-3bcb-45b5-b1b8-d77ef60c576d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26" status: 200 len: 1696 microversion: 2.1 time: 0.170171 Jul 18 03:37:43.323637 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3656/7326] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:37:43 2022] GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26 => generated 1696 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:37:44.340786 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2a896a13-39c5-4d08-a28b-96e94f3d33fa tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:44.341409 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2a896a13-39c5-4d08-a28b-96e94f3d33fa tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:44.348477 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2a896a13-39c5-4d08-a28b-96e94f3d33fa tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:44.348941 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2a896a13-39c5-4d08-a28b-96e94f3d33fa tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:44.349748 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2a896a13-39c5-4d08-a28b-96e94f3d33fa tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:44.350260 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2a896a13-39c5-4d08-a28b-96e94f3d33fa tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:44.485666 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2a896a13-39c5-4d08-a28b-96e94f3d33fa tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:37:44.494868 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2a896a13-39c5-4d08-a28b-96e94f3d33fa tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26" status: 200 len: 1696 microversion: 2.1 time: 0.157981 Jul 18 03:37:44.495469 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3671/7327] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:37:44 2022] GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26 => generated 1696 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:37:45.513121 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5f123a79-d018-4cb4-a14d-ae56c468f34d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:45.513971 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5f123a79-d018-4cb4-a14d-ae56c468f34d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:45.521305 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5f123a79-d018-4cb4-a14d-ae56c468f34d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:45.521823 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5f123a79-d018-4cb4-a14d-ae56c468f34d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:45.523356 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5f123a79-d018-4cb4-a14d-ae56c468f34d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:45.523831 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5f123a79-d018-4cb4-a14d-ae56c468f34d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:45.753736 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5f123a79-d018-4cb4-a14d-ae56c468f34d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:37:45.762241 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5f123a79-d018-4cb4-a14d-ae56c468f34d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26" status: 200 len: 1695 microversion: 2.1 time: 0.253048 Jul 18 03:37:45.762837 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3657/7328] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:37:45 2022] GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26 => generated 1695 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:37:46.048633 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-a980256b-50fd-465b-8b22-e9f663ee3df0 req-669b58af-293f-4f89-a750-a509d82e7c8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d08e7fb-90d6-4c3a-b832-435c2fa18d26", "name": "network-vif-unplugged", "status": "completed", "tag": "4db63053-38ce-436d-915b-d854a13d38b6"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:37:46.071516 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-a980256b-50fd-465b-8b22-e9f663ee3df0 req-669b58af-293f-4f89-a750-a509d82e7c8e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:46.072287 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-a980256b-50fd-465b-8b22-e9f663ee3df0 req-669b58af-293f-4f89-a750-a509d82e7c8e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:46.090547 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-a980256b-50fd-465b-8b22-e9f663ee3df0 req-669b58af-293f-4f89-a750-a509d82e7c8e service nova] Creating event network-vif-unplugged:4db63053-38ce-436d-915b-d854a13d38b6 for instance 7d08e7fb-90d6-4c3a-b832-435c2fa18d26 on n-h2-465891-3 Jul 18 03:37:46.097751 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [req-a980256b-50fd-465b-8b22-e9f663ee3df0 req-669b58af-293f-4f89-a750-a509d82e7c8e service nova] Instance 7d08e7fb-90d6-4c3a-b832-435c2fa18d26 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3', 'n-h2-465891-3'} {{(pid=119543) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:37:46.115306 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-a980256b-50fd-465b-8b22-e9f663ee3df0 req-669b58af-293f-4f89-a750-a509d82e7c8e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070843 Jul 18 03:37:46.117113 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3672/7329] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:37:46.779973 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5f283e37-bb63-4e11-8906-65bcf53a7765 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:46.780543 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5f283e37-bb63-4e11-8906-65bcf53a7765 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:46.787947 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5f283e37-bb63-4e11-8906-65bcf53a7765 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:46.788401 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5f283e37-bb63-4e11-8906-65bcf53a7765 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:46.789193 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5f283e37-bb63-4e11-8906-65bcf53a7765 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:46.789635 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5f283e37-bb63-4e11-8906-65bcf53a7765 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:47.005154 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5f283e37-bb63-4e11-8906-65bcf53a7765 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:37:47.014708 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5f283e37-bb63-4e11-8906-65bcf53a7765 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26" status: 200 len: 1695 microversion: 2.1 time: 0.238690 Jul 18 03:37:47.015492 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3658/7330] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:37:46 2022] GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26 => generated 1695 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:37:48.033651 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b2f6f35e-8e83-419e-acbd-d09bfea86db5 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:48.034410 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b2f6f35e-8e83-419e-acbd-d09bfea86db5 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:48.041675 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b2f6f35e-8e83-419e-acbd-d09bfea86db5 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:48.042170 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b2f6f35e-8e83-419e-acbd-d09bfea86db5 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:48.042954 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b2f6f35e-8e83-419e-acbd-d09bfea86db5 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:48.043401 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b2f6f35e-8e83-419e-acbd-d09bfea86db5 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:48.131842 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-034fe417-0296-4d49-b970-f620d76aad0d req-8220c1e5-0bbb-4522-9d41-92a7891b99aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d08e7fb-90d6-4c3a-b832-435c2fa18d26", "tag": "4db63053-38ce-436d-915b-d854a13d38b6"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:37:48.140898 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-034fe417-0296-4d49-b970-f620d76aad0d req-8220c1e5-0bbb-4522-9d41-92a7891b99aa service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:48.141341 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-034fe417-0296-4d49-b970-f620d76aad0d req-8220c1e5-0bbb-4522-9d41-92a7891b99aa service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:48.154879 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-034fe417-0296-4d49-b970-f620d76aad0d req-8220c1e5-0bbb-4522-9d41-92a7891b99aa service nova] Creating event network-changed:4db63053-38ce-436d-915b-d854a13d38b6 for instance 7d08e7fb-90d6-4c3a-b832-435c2fa18d26 on n-h2-465891-3 Jul 18 03:37:48.160745 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [req-034fe417-0296-4d49-b970-f620d76aad0d req-8220c1e5-0bbb-4522-9d41-92a7891b99aa service nova] Instance 7d08e7fb-90d6-4c3a-b832-435c2fa18d26 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-465891-3', 'n-h2-465891-3'} {{(pid=119544) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:37:48.172944 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-034fe417-0296-4d49-b970-f620d76aad0d req-8220c1e5-0bbb-4522-9d41-92a7891b99aa service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044970 Jul 18 03:37:48.173568 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3659/7331] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:37:48.196854 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b2f6f35e-8e83-419e-acbd-d09bfea86db5 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:37:48.205384 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b2f6f35e-8e83-419e-acbd-d09bfea86db5 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26" status: 200 len: 1693 microversion: 2.1 time: 0.176136 Jul 18 03:37:48.206031 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3673/7332] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:37:48 2022] GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26 => generated 1693 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:37:49.225941 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d3df23fc-4b96-4ddf-9265-509ae75699b0 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:49.226654 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d3df23fc-4b96-4ddf-9265-509ae75699b0 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:49.234573 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d3df23fc-4b96-4ddf-9265-509ae75699b0 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:49.235033 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d3df23fc-4b96-4ddf-9265-509ae75699b0 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:49.235830 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d3df23fc-4b96-4ddf-9265-509ae75699b0 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:49.236271 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d3df23fc-4b96-4ddf-9265-509ae75699b0 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:49.390178 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d3df23fc-4b96-4ddf-9265-509ae75699b0 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:37:49.398948 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d3df23fc-4b96-4ddf-9265-509ae75699b0 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26" status: 200 len: 1690 microversion: 2.1 time: 0.178244 Jul 18 03:37:49.399553 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3660/7333] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:37:49 2022] GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26 => generated 1690 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:37:49.415868 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fc9154a8-f577-4430-9293-52ff099ffc71 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:37:49.416687 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fc9154a8-f577-4430-9293-52ff099ffc71 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:49.423670 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fc9154a8-f577-4430-9293-52ff099ffc71 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:49.424049 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fc9154a8-f577-4430-9293-52ff099ffc71 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:49.424844 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fc9154a8-f577-4430-9293-52ff099ffc71 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:49.425292 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fc9154a8-f577-4430-9293-52ff099ffc71 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:49.495407 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fc9154a8-f577-4430-9293-52ff099ffc71 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "POST /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26/action" status: 204 len: 0 microversion: 2.1 time: 0.083879 Jul 18 03:37:49.496119 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3674/7334] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:37:49 2022] POST /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26/action => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:37:49.504372 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f655f982-2c51-4a04-89db-e6a6af67e656 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:49.504989 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f655f982-2c51-4a04-89db-e6a6af67e656 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:49.511417 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f655f982-2c51-4a04-89db-e6a6af67e656 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:49.511905 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f655f982-2c51-4a04-89db-e6a6af67e656 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:49.512772 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f655f982-2c51-4a04-89db-e6a6af67e656 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:49.513217 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f655f982-2c51-4a04-89db-e6a6af67e656 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:49.677584 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f655f982-2c51-4a04-89db-e6a6af67e656 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:37:49.686196 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f655f982-2c51-4a04-89db-e6a6af67e656 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26" status: 200 len: 1690 microversion: 2.1 time: 0.185595 Jul 18 03:37:49.686798 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3661/7335] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:37:49 2022] GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26 => generated 1690 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:37:49.703693 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ffcdee9d-1ee5-4005-ad58-297ab7a9683e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:49.704414 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ffcdee9d-1ee5-4005-ad58-297ab7a9683e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:49.712184 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ffcdee9d-1ee5-4005-ad58-297ab7a9683e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:49.712650 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ffcdee9d-1ee5-4005-ad58-297ab7a9683e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:49.713455 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ffcdee9d-1ee5-4005-ad58-297ab7a9683e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:49.713955 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ffcdee9d-1ee5-4005-ad58-297ab7a9683e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:49.857503 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ffcdee9d-1ee5-4005-ad58-297ab7a9683e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:37:49.865555 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ffcdee9d-1ee5-4005-ad58-297ab7a9683e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26" status: 200 len: 1690 microversion: 2.1 time: 0.166087 Jul 18 03:37:49.866527 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3675/7336] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:37:49 2022] GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26 => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:37:50.883447 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-53e995ad-e838-40ec-a6e2-f5dcb8fdd31a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:50.884141 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-53e995ad-e838-40ec-a6e2-f5dcb8fdd31a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:50.890698 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-53e995ad-e838-40ec-a6e2-f5dcb8fdd31a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:50.891152 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-53e995ad-e838-40ec-a6e2-f5dcb8fdd31a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:50.891922 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-53e995ad-e838-40ec-a6e2-f5dcb8fdd31a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:50.892370 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-53e995ad-e838-40ec-a6e2-f5dcb8fdd31a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:51.035741 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-53e995ad-e838-40ec-a6e2-f5dcb8fdd31a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:37:51.044687 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-53e995ad-e838-40ec-a6e2-f5dcb8fdd31a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26" status: 200 len: 1682 microversion: 2.1 time: 0.165191 Jul 18 03:37:51.045536 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3662/7337] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:37:50 2022] GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:37:53.903790 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-1f30fbf4-9c34-4494-a052-a5741a44a075 req-f791a4fc-494e-452f-8f69-213a59fcf765 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d08e7fb-90d6-4c3a-b832-435c2fa18d26", "name": "network-vif-plugged", "status": "completed", "tag": "4db63053-38ce-436d-915b-d854a13d38b6"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:37:53.914423 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-1f30fbf4-9c34-4494-a052-a5741a44a075 req-f791a4fc-494e-452f-8f69-213a59fcf765 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:53.914930 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-1f30fbf4-9c34-4494-a052-a5741a44a075 req-f791a4fc-494e-452f-8f69-213a59fcf765 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:53.927161 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-1f30fbf4-9c34-4494-a052-a5741a44a075 req-f791a4fc-494e-452f-8f69-213a59fcf765 service nova] Creating event network-vif-plugged:4db63053-38ce-436d-915b-d854a13d38b6 for instance 7d08e7fb-90d6-4c3a-b832-435c2fa18d26 on n-h2-465891-3 Jul 18 03:37:53.932973 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-1f30fbf4-9c34-4494-a052-a5741a44a075 req-f791a4fc-494e-452f-8f69-213a59fcf765 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032934 Jul 18 03:37:53.933587 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3676/7338] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:38:15.242385 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-29156bab-1456-487f-a54b-c06c96624c39 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:38:15.243370 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-29156bab-1456-487f-a54b-c06c96624c39 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:15.245689 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=24 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:38:15.246521 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=70 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:38:15.252588 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-29156bab-1456-487f-a54b-c06c96624c39 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:15.253070 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-29156bab-1456-487f-a54b-c06c96624c39 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:15.253905 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-29156bab-1456-487f-a54b-c06c96624c39 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:15.254344 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-29156bab-1456-487f-a54b-c06c96624c39 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:15.319055 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-29156bab-1456-487f-a54b-c06c96624c39 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "POST /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26/action" status: 200 len: 24572 microversion: 2.1 time: 0.081684 Jul 18 03:38:15.319755 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3663/7339] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:38:15 2022] POST /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26/action => generated 24572 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 03:38:22.520489 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=28 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:38:22.523609 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:38:22.529748 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-228fda79-1a2b-4eeb-ad32-9c6bd92a1f8e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:22.530453 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-228fda79-1a2b-4eeb-ad32-9c6bd92a1f8e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:22.534643 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-2be5a95d-95c6-4664-a724-2587a145260d req-c01ac359-ecbf-46df-b0f7-2d246aab46d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d08e7fb-90d6-4c3a-b832-435c2fa18d26", "tag": "4db63053-38ce-436d-915b-d854a13d38b6"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:38:22.549177 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-228fda79-1a2b-4eeb-ad32-9c6bd92a1f8e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:22.549780 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-228fda79-1a2b-4eeb-ad32-9c6bd92a1f8e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:22.559289 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-2be5a95d-95c6-4664-a724-2587a145260d req-c01ac359-ecbf-46df-b0f7-2d246aab46d3 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:22.560107 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-2be5a95d-95c6-4664-a724-2587a145260d req-c01ac359-ecbf-46df-b0f7-2d246aab46d3 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:22.560481 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-228fda79-1a2b-4eeb-ad32-9c6bd92a1f8e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:22.561843 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-228fda79-1a2b-4eeb-ad32-9c6bd92a1f8e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:22.577295 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-2be5a95d-95c6-4664-a724-2587a145260d req-c01ac359-ecbf-46df-b0f7-2d246aab46d3 service nova] Creating event network-changed:4db63053-38ce-436d-915b-d854a13d38b6 for instance 7d08e7fb-90d6-4c3a-b832-435c2fa18d26 on n-h2-465891-3 Jul 18 03:38:22.583614 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-2be5a95d-95c6-4664-a724-2587a145260d req-c01ac359-ecbf-46df-b0f7-2d246aab46d3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058202 Jul 18 03:38:22.584444 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3664/7340] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:38:22.607892 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-228fda79-1a2b-4eeb-ad32-9c6bd92a1f8e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:38:22.714721 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-228fda79-1a2b-4eeb-ad32-9c6bd92a1f8e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26" status: 204 len: 0 microversion: 2.1 time: 0.196815 Jul 18 03:38:22.716140 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3677/7341] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:38:22 2022] DELETE /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:38:22.726608 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6d61c4e5-b6fc-4096-b057-3371cd3f38a5 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:22.727781 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6d61c4e5-b6fc-4096-b057-3371cd3f38a5 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:22.736257 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6d61c4e5-b6fc-4096-b057-3371cd3f38a5 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:22.737202 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6d61c4e5-b6fc-4096-b057-3371cd3f38a5 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:22.738292 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6d61c4e5-b6fc-4096-b057-3371cd3f38a5 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:22.739284 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6d61c4e5-b6fc-4096-b057-3371cd3f38a5 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:23.019700 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6d61c4e5-b6fc-4096-b057-3371cd3f38a5 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:38:23.031227 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6d61c4e5-b6fc-4096-b057-3371cd3f38a5 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26" status: 200 len: 1688 microversion: 2.1 time: 0.310302 Jul 18 03:38:23.031835 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3665/7342] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:38:22 2022] GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26 => generated 1688 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:38:24.049091 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9a40d3b0-426b-48e1-ad52-ff491c963d45 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:24.049935 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9a40d3b0-426b-48e1-ad52-ff491c963d45 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:24.058319 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9a40d3b0-426b-48e1-ad52-ff491c963d45 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:24.058813 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9a40d3b0-426b-48e1-ad52-ff491c963d45 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:24.059638 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9a40d3b0-426b-48e1-ad52-ff491c963d45 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:24.060104 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9a40d3b0-426b-48e1-ad52-ff491c963d45 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:24.341653 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9a40d3b0-426b-48e1-ad52-ff491c963d45 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:38:24.350578 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9a40d3b0-426b-48e1-ad52-ff491c963d45 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26" status: 200 len: 1688 microversion: 2.1 time: 0.305593 Jul 18 03:38:24.351505 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3678/7343] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:38:24 2022] GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26 => generated 1688 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:38:24.839148 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-64726e82-c7ce-416c-a2a5-5559c00fa331 req-d124df36-a388-4095-932d-3c19ab1e8bca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d08e7fb-90d6-4c3a-b832-435c2fa18d26", "name": "network-vif-deleted", "tag": "4db63053-38ce-436d-915b-d854a13d38b6"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:38:24.860378 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-64726e82-c7ce-416c-a2a5-5559c00fa331 req-d124df36-a388-4095-932d-3c19ab1e8bca service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:24.861281 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-64726e82-c7ce-416c-a2a5-5559c00fa331 req-d124df36-a388-4095-932d-3c19ab1e8bca service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:24.891059 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-64726e82-c7ce-416c-a2a5-5559c00fa331 req-d124df36-a388-4095-932d-3c19ab1e8bca service nova] Creating event network-vif-deleted:4db63053-38ce-436d-915b-d854a13d38b6 for instance 7d08e7fb-90d6-4c3a-b832-435c2fa18d26 on n-h2-465891-3 Jul 18 03:38:24.900931 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-64726e82-c7ce-416c-a2a5-5559c00fa331 req-d124df36-a388-4095-932d-3c19ab1e8bca service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068958 Jul 18 03:38:24.902038 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3666/7344] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:38:25.375887 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f6227a6d-e31f-4596-b08d-ba78f7aa3811 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:25.376892 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f6227a6d-e31f-4596-b08d-ba78f7aa3811 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:25.388341 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f6227a6d-e31f-4596-b08d-ba78f7aa3811 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:25.389145 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f6227a6d-e31f-4596-b08d-ba78f7aa3811 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:25.390634 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f6227a6d-e31f-4596-b08d-ba78f7aa3811 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:25.391103 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f6227a6d-e31f-4596-b08d-ba78f7aa3811 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:25.443502 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f6227a6d-e31f-4596-b08d-ba78f7aa3811 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:25.444897 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f6227a6d-e31f-4596-b08d-ba78f7aa3811 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:25.445427 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-f6227a6d-e31f-4596-b08d-ba78f7aa3811 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lazy-loading 'fault' on Instance uuid 7d08e7fb-90d6-4c3a-b832-435c2fa18d26 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:38:25.498615 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f6227a6d-e31f-4596-b08d-ba78f7aa3811 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:38:25.508066 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f6227a6d-e31f-4596-b08d-ba78f7aa3811 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26" status: 200 len: 1356 microversion: 2.1 time: 0.142492 Jul 18 03:38:25.508710 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3679/7345] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:38:25 2022] GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26 => generated 1356 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:38:26.527941 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0d14e517-6cfa-4ec2-940c-c309d550f9fc tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:26.528863 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0d14e517-6cfa-4ec2-940c-c309d550f9fc tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: 7d08e7fb-90d6-4c3a-b832-435c2fa18d26] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:26.537096 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0d14e517-6cfa-4ec2-940c-c309d550f9fc tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:26.537552 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0d14e517-6cfa-4ec2-940c-c309d550f9fc tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:26.538374 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0d14e517-6cfa-4ec2-940c-c309d550f9fc tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:26.538815 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0d14e517-6cfa-4ec2-940c-c309d550f9fc tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:26.555919 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-0d14e517-6cfa-4ec2-940c-c309d550f9fc tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] HTTP exception thrown: Instance 7d08e7fb-90d6-4c3a-b832-435c2fa18d26 could not be found. Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0d14e517-6cfa-4ec2-940c-c309d550f9fc tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Request method failure captured: Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26 HTTP/1.1 Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1NQn25Nv2CWVcqUB7Jli7-n6pu90utlDXaCYfmF3mQfgKsu7CU9h4Qgbxu3IIS2bQPi7DmlwnQeENXcFmebHsSlw-o4GKxkvJck1gJGsOn4xtry1F0sEpYLtQaLLoR_0JXssRBl37TNYHSvAfTOqzePvi79-HEbaRAqO169pHpwd49Q Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 2d9c17c023e1420c8d90b96e2af98172 Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1294373808 Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2d9c17c023e1420c8d90b96e2af98172"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2d9c17c023e1420c8d90b96e2af98172"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2d9c17c023e1420c8d90b96e2af98172"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2d9c17c023e1420c8d90b96e2af98172"}]}] Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1294373808 Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 2d9c17c023e1420c8d90b96e2af98172 Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1294373808 Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-TestNetworkAdvancedServerOps-1294373808-project Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 921716a730f64ccdbbced6d4bbf715b0 Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1294373808-project Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance 7d08e7fb-90d6-4c3a-b832-435c2fa18d26 could not be found. Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': '7d08e7fb-90d6-4c3a-b832-435c2fa18d26'} Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d08e7fb-90d6-4c3a-b832-435c2fa18d26 could not be found. Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d08e7fb-90d6-4c3a-b832-435c2fa18d26 could not be found. Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:38:26.558014 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:38:26.565566 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:38:26.565566 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:38:26.565566 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:38:26.565566 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:38:26.565566 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:38:26.565566 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:38:26.565566 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d08e7fb-90d6-4c3a-b832-435c2fa18d26 could not be found. Jul 18 03:38:26.565566 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:38:26.565566 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0d14e517-6cfa-4ec2-940c-c309d550f9fc tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Returning 404 to user: Instance 7d08e7fb-90d6-4c3a-b832-435c2fa18d26 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:38:26.565566 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0d14e517-6cfa-4ec2-940c-c309d550f9fc tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26" status: 404 len: 111 microversion: 2.1 time: 0.037119 Jul 18 03:38:26.565566 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3667/7346] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:38:26 2022] GET /compute/v2.1/servers/7d08e7fb-90d6-4c3a-b832-435c2fa18d26 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 03:38:30.248214 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c9652e6e-0086-4daf-be36-e9da731f9549 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '.version_select at 0x7ff4a9051b80>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:30.281017 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c9652e6e-0086-4daf-be36-e9da731f9549 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1282394239" status: 202 len: 0 microversion: 2.1 time: 0.040366 Jul 18 03:38:30.282331 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3680/7347] 10.222.0.57 () {58 vars in 1283 bytes} [Mon Jul 18 03:38:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1282394239 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:38:30.318536 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7b29ef4c-4939-4273-8ffe-8a9f41e8cf3b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Action: 'create', calling method: .version_select at 0x7ff4a86053a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2116349666", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA49xPubVPZndVn15vB45rI66aLs061GSQ/wDvsVnNnwQi114is/k53u7XqOeOP2ZtUeDLJ1LNrCOMPk2kzkaScGuLJIB8qpXyknKL+Zqr9Sv9TDa1SFbScjwoGnkSYzDg=="}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:38:30.337598 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-7b29ef4c-4939-4273-8ffe-8a9f41e8cf3b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Getting quotas for project 2d9c17c023e1420c8d90b96e2af98172. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:38:30.344898 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-7b29ef4c-4939-4273-8ffe-8a9f41e8cf3b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Getting quotas for user 921716a730f64ccdbbced6d4bbf715b0 and project 2d9c17c023e1420c8d90b96e2af98172. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:38:30.377022 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7b29ef4c-4939-4273-8ffe-8a9f41e8cf3b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.063109 Jul 18 03:38:30.378105 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3668/7348] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 03:38:30 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:38:37.422931 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4b296d6e-b8ed-4fe5-b6a9-59b2e2b5be3d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1141463882", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "d4082b60-abc0-4a46-947d-b93d59612086"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2116349666", "security_groups": [{"name": "tempest-secgroup-smoke-1339194937"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:38:37.432856 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:38:37.936914 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-4b296d6e-b8ed-4fe5-b6a9-59b2e2b5be3d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] validate_networks() for [('d4082b60-abc0-4a46-947d-b93d59612086', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:38:38.365302 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-4b296d6e-b8ed-4fe5-b6a9-59b2e2b5be3d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:38:38.366400 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-4b296d6e-b8ed-4fe5-b6a9-59b2e2b5be3d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:38:38.366895 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-4b296d6e-b8ed-4fe5-b6a9-59b2e2b5be3d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:38:38.367330 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-4b296d6e-b8ed-4fe5-b6a9-59b2e2b5be3d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:38:38.367787 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-4b296d6e-b8ed-4fe5-b6a9-59b2e2b5be3d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:38:38.377947 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4b296d6e-b8ed-4fe5-b6a9-59b2e2b5be3d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:38.378453 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4b296d6e-b8ed-4fe5-b6a9-59b2e2b5be3d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:38.379272 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4b296d6e-b8ed-4fe5-b6a9-59b2e2b5be3d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:38.379723 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4b296d6e-b8ed-4fe5-b6a9-59b2e2b5be3d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:38.398056 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-4b296d6e-b8ed-4fe5-b6a9-59b2e2b5be3d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Getting quotas for project 2d9c17c023e1420c8d90b96e2af98172. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:38:38.403710 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-4b296d6e-b8ed-4fe5-b6a9-59b2e2b5be3d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Getting quotas for user 921716a730f64ccdbbced6d4bbf715b0 and project 2d9c17c023e1420c8d90b96e2af98172. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:38:38.418598 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4b296d6e-b8ed-4fe5-b6a9-59b2e2b5be3d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:38:38.420919 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4b296d6e-b8ed-4fe5-b6a9-59b2e2b5be3d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:38:38.470718 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4b296d6e-b8ed-4fe5-b6a9-59b2e2b5be3d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.052726 Jul 18 03:38:38.477651 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3681/7349] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:38:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 1054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:38:38.483635 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=16 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:38:38.488751 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-33855b25-716e-4fb5-9e93-5a214197d657 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:38.489445 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-33855b25-716e-4fb5-9e93-5a214197d657 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:38.565737 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-33855b25-716e-4fb5-9e93-5a214197d657 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:38:38.575925 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-33855b25-716e-4fb5-9e93-5a214197d657 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138" status: 200 len: 1267 microversion: 2.1 time: 0.096655 Jul 18 03:38:38.576514 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3669/7350] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:38:38 2022] GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 => generated 1267 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:38:39.605496 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5c575bc6-1518-4c0d-a9a1-b2cbed750bdd tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:39.607581 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5c575bc6-1518-4c0d-a9a1-b2cbed750bdd tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:39.617695 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5c575bc6-1518-4c0d-a9a1-b2cbed750bdd tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:39.618640 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5c575bc6-1518-4c0d-a9a1-b2cbed750bdd tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:39.635168 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5c575bc6-1518-4c0d-a9a1-b2cbed750bdd tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:39.636020 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5c575bc6-1518-4c0d-a9a1-b2cbed750bdd tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:39.737728 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5c575bc6-1518-4c0d-a9a1-b2cbed750bdd tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:38:39.765736 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5c575bc6-1518-4c0d-a9a1-b2cbed750bdd tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138" status: 200 len: 1319 microversion: 2.1 time: 0.168653 Jul 18 03:38:39.766793 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3682/7351] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:38:39 2022] GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:38:40.792588 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-78150d4f-9e67-4ede-b292-c8f2c89a3db5 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:40.794260 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-78150d4f-9e67-4ede-b292-c8f2c89a3db5 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:40.805857 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-78150d4f-9e67-4ede-b292-c8f2c89a3db5 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:40.807038 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-78150d4f-9e67-4ede-b292-c8f2c89a3db5 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:40.807863 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-78150d4f-9e67-4ede-b292-c8f2c89a3db5 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:40.808307 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-78150d4f-9e67-4ede-b292-c8f2c89a3db5 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:41.030080 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-78150d4f-9e67-4ede-b292-c8f2c89a3db5 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:38:41.041392 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-78150d4f-9e67-4ede-b292-c8f2c89a3db5 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138" status: 200 len: 1393 microversion: 2.1 time: 0.253186 Jul 18 03:38:41.052165 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3670/7352] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:38:40 2022] GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 => generated 1393 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:38:41.820553 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-c10da59e-77f8-4ee4-be96-b96760e22c39 req-7bc9fc24-9f18-44a2-82fd-4a345a0a61e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138", "tag": "7cc7a658-e1a5-4263-8d85-9731c48eb260"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:38:41.831785 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-c10da59e-77f8-4ee4-be96-b96760e22c39 req-7bc9fc24-9f18-44a2-82fd-4a345a0a61e6 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:41.832251 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-c10da59e-77f8-4ee4-be96-b96760e22c39 req-7bc9fc24-9f18-44a2-82fd-4a345a0a61e6 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:41.851976 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-c10da59e-77f8-4ee4-be96-b96760e22c39 req-7bc9fc24-9f18-44a2-82fd-4a345a0a61e6 service nova] Creating event network-changed:7cc7a658-e1a5-4263-8d85-9731c48eb260 for instance c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 on n-h1-465891-3 Jul 18 03:38:41.858900 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-c10da59e-77f8-4ee4-be96-b96760e22c39 req-7bc9fc24-9f18-44a2-82fd-4a345a0a61e6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048519 Jul 18 03:38:41.859770 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3683/7353] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:38:42.059478 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-828cc181-bb42-49a4-afd0-961231c8b92d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:42.060047 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-828cc181-bb42-49a4-afd0-961231c8b92d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:42.067248 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-828cc181-bb42-49a4-afd0-961231c8b92d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:42.067774 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-828cc181-bb42-49a4-afd0-961231c8b92d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:42.068563 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-828cc181-bb42-49a4-afd0-961231c8b92d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:42.070108 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-828cc181-bb42-49a4-afd0-961231c8b92d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:42.226018 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-828cc181-bb42-49a4-afd0-961231c8b92d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:38:42.233922 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-828cc181-bb42-49a4-afd0-961231c8b92d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138" status: 200 len: 1393 microversion: 2.1 time: 0.178502 Jul 18 03:38:42.234519 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3671/7354] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:38:42 2022] GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 => generated 1393 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:38:43.255639 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6d931523-641f-4b67-a345-0a43346bbc0e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:43.257091 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6d931523-641f-4b67-a345-0a43346bbc0e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:43.263800 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6d931523-641f-4b67-a345-0a43346bbc0e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:43.264297 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6d931523-641f-4b67-a345-0a43346bbc0e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:43.265160 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6d931523-641f-4b67-a345-0a43346bbc0e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:43.265774 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6d931523-641f-4b67-a345-0a43346bbc0e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:43.428562 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6d931523-641f-4b67-a345-0a43346bbc0e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:38:43.437290 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6d931523-641f-4b67-a345-0a43346bbc0e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138" status: 200 len: 1393 microversion: 2.1 time: 0.186911 Jul 18 03:38:43.437929 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3684/7355] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:38:43 2022] GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 => generated 1393 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:38:44.455108 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e0b9ab3d-bd2c-4e9e-bd83-dc5efde1e2c7 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:44.455949 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e0b9ab3d-bd2c-4e9e-bd83-dc5efde1e2c7 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:44.464138 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e0b9ab3d-bd2c-4e9e-bd83-dc5efde1e2c7 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:44.464597 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e0b9ab3d-bd2c-4e9e-bd83-dc5efde1e2c7 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:44.465393 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e0b9ab3d-bd2c-4e9e-bd83-dc5efde1e2c7 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:44.465870 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e0b9ab3d-bd2c-4e9e-bd83-dc5efde1e2c7 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:44.663955 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e0b9ab3d-bd2c-4e9e-bd83-dc5efde1e2c7 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:38:44.672087 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e0b9ab3d-bd2c-4e9e-bd83-dc5efde1e2c7 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138" status: 200 len: 1393 microversion: 2.1 time: 0.220888 Jul 18 03:38:44.673027 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3672/7356] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:38:44 2022] GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 => generated 1393 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:38:45.690100 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d91efe92-8b88-405b-8f4e-ac44599d184b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:45.690742 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d91efe92-8b88-405b-8f4e-ac44599d184b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:45.698685 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d91efe92-8b88-405b-8f4e-ac44599d184b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:45.699166 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d91efe92-8b88-405b-8f4e-ac44599d184b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:45.699973 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d91efe92-8b88-405b-8f4e-ac44599d184b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:45.700426 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d91efe92-8b88-405b-8f4e-ac44599d184b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:45.841651 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d91efe92-8b88-405b-8f4e-ac44599d184b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:38:45.849260 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d91efe92-8b88-405b-8f4e-ac44599d184b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138" status: 200 len: 1393 microversion: 2.1 time: 0.163206 Jul 18 03:38:45.849874 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3685/7357] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:38:45 2022] GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 => generated 1393 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:38:46.867386 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0932e5bc-e7c2-469d-9312-e66abb89a06f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:46.867982 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0932e5bc-e7c2-469d-9312-e66abb89a06f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:46.870842 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:38:46.876564 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0932e5bc-e7c2-469d-9312-e66abb89a06f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:46.877008 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0932e5bc-e7c2-469d-9312-e66abb89a06f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:46.877800 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0932e5bc-e7c2-469d-9312-e66abb89a06f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:46.878233 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0932e5bc-e7c2-469d-9312-e66abb89a06f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:47.026011 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0932e5bc-e7c2-469d-9312-e66abb89a06f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:38:47.033480 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0932e5bc-e7c2-469d-9312-e66abb89a06f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138" status: 200 len: 1393 microversion: 2.1 time: 0.170537 Jul 18 03:38:47.034093 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3673/7358] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:38:46 2022] GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 => generated 1393 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:38:48.051530 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-94f5e0a5-0ff3-40ad-9d62-cd271e49f3ae tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:48.052165 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-94f5e0a5-0ff3-40ad-9d62-cd271e49f3ae tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:48.058566 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-94f5e0a5-0ff3-40ad-9d62-cd271e49f3ae tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:48.059034 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-94f5e0a5-0ff3-40ad-9d62-cd271e49f3ae tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:48.059818 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-94f5e0a5-0ff3-40ad-9d62-cd271e49f3ae tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:48.060272 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-94f5e0a5-0ff3-40ad-9d62-cd271e49f3ae tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:48.191360 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-94f5e0a5-0ff3-40ad-9d62-cd271e49f3ae tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:38:48.199493 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-94f5e0a5-0ff3-40ad-9d62-cd271e49f3ae tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138" status: 200 len: 1393 microversion: 2.1 time: 0.152110 Jul 18 03:38:48.200060 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3686/7359] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:38:48 2022] GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 => generated 1393 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:38:48.893025 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-86fd96ed-457c-49c5-b19c-6fb3accc92fd req-b8640f09-c549-4804-802d-7d0d3dff05bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138", "name": "network-vif-plugged", "status": "completed", "tag": "7cc7a658-e1a5-4263-8d85-9731c48eb260"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:38:48.900048 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:38:48.905472 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-86fd96ed-457c-49c5-b19c-6fb3accc92fd req-b8640f09-c549-4804-802d-7d0d3dff05bf service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:48.906393 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-86fd96ed-457c-49c5-b19c-6fb3accc92fd req-b8640f09-c549-4804-802d-7d0d3dff05bf service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:48.918330 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-86fd96ed-457c-49c5-b19c-6fb3accc92fd req-b8640f09-c549-4804-802d-7d0d3dff05bf service nova] Creating event network-vif-plugged:7cc7a658-e1a5-4263-8d85-9731c48eb260 for instance c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 on n-h1-465891-3 Jul 18 03:38:48.923544 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-86fd96ed-457c-49c5-b19c-6fb3accc92fd req-b8640f09-c549-4804-802d-7d0d3dff05bf service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034199 Jul 18 03:38:48.924435 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3674/7360] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:38:49.216686 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5e68e60a-87ff-4a6c-844f-0a161f47f01b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:49.217424 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5e68e60a-87ff-4a6c-844f-0a161f47f01b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:49.219457 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:38:49.220146 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:38:49.227369 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5e68e60a-87ff-4a6c-844f-0a161f47f01b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:49.227831 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5e68e60a-87ff-4a6c-844f-0a161f47f01b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:49.228644 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5e68e60a-87ff-4a6c-844f-0a161f47f01b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:49.229105 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5e68e60a-87ff-4a6c-844f-0a161f47f01b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:49.372601 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5e68e60a-87ff-4a6c-844f-0a161f47f01b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:38:49.380444 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5e68e60a-87ff-4a6c-844f-0a161f47f01b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138" status: 200 len: 1393 microversion: 2.1 time: 0.167602 Jul 18 03:38:49.380960 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3687/7361] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:38:49 2022] GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 => generated 1393 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:38:50.399564 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a1cdc0d0-0555-43ee-a3ea-854a35761dc3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:50.400248 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a1cdc0d0-0555-43ee-a3ea-854a35761dc3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:50.406648 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a1cdc0d0-0555-43ee-a3ea-854a35761dc3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:50.407098 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a1cdc0d0-0555-43ee-a3ea-854a35761dc3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:50.407860 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a1cdc0d0-0555-43ee-a3ea-854a35761dc3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:50.408294 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a1cdc0d0-0555-43ee-a3ea-854a35761dc3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:50.550521 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a1cdc0d0-0555-43ee-a3ea-854a35761dc3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:38:50.564250 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a1cdc0d0-0555-43ee-a3ea-854a35761dc3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138" status: 200 len: 1393 microversion: 2.1 time: 0.170022 Jul 18 03:38:50.564842 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3675/7362] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:38:50 2022] GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 => generated 1393 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:38:51.580850 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e522d860-9033-4969-905c-074b73fe8382 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:51.581537 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e522d860-9033-4969-905c-074b73fe8382 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:51.589932 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e522d860-9033-4969-905c-074b73fe8382 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:51.590401 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e522d860-9033-4969-905c-074b73fe8382 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:51.591192 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e522d860-9033-4969-905c-074b73fe8382 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:51.591641 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e522d860-9033-4969-905c-074b73fe8382 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:51.745470 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e522d860-9033-4969-905c-074b73fe8382 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:38:51.760443 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e522d860-9033-4969-905c-074b73fe8382 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138" status: 200 len: 1564 microversion: 2.1 time: 0.183150 Jul 18 03:38:51.761550 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3688/7363] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:38:51 2022] GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 => generated 1564 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:38:51.792757 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f97b1f51-fc52-4ad8-b65e-2644c2ec53c4 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:51.793944 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f97b1f51-fc52-4ad8-b65e-2644c2ec53c4 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:51.806660 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f97b1f51-fc52-4ad8-b65e-2644c2ec53c4 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:51.807476 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f97b1f51-fc52-4ad8-b65e-2644c2ec53c4 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:51.808875 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f97b1f51-fc52-4ad8-b65e-2644c2ec53c4 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:51.809569 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f97b1f51-fc52-4ad8-b65e-2644c2ec53c4 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:51.957027 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f97b1f51-fc52-4ad8-b65e-2644c2ec53c4 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:38:51.965648 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f97b1f51-fc52-4ad8-b65e-2644c2ec53c4 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138" status: 200 len: 1564 microversion: 2.1 time: 0.180968 Jul 18 03:38:51.966257 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3676/7364] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:38:51 2022] GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 => generated 1564 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:38:53.885057 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e8930b53-c1c4-47a8-b5cc-c1ce4b1678d3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:53.885896 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e8930b53-c1c4-47a8-b5cc-c1ce4b1678d3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:53.887025 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-6d979f7f-2db5-4096-aa92-0841e7c75ff6 req-179e8ef1-e568-4915-b272-c74e69b933bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138", "tag": "7cc7a658-e1a5-4263-8d85-9731c48eb260"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:38:53.888777 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:38:53.894274 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e8930b53-c1c4-47a8-b5cc-c1ce4b1678d3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:53.894747 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e8930b53-c1c4-47a8-b5cc-c1ce4b1678d3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:53.895551 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e8930b53-c1c4-47a8-b5cc-c1ce4b1678d3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:53.896532 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e8930b53-c1c4-47a8-b5cc-c1ce4b1678d3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:53.898801 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-6d979f7f-2db5-4096-aa92-0841e7c75ff6 req-179e8ef1-e568-4915-b272-c74e69b933bb service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:53.899274 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-6d979f7f-2db5-4096-aa92-0841e7c75ff6 req-179e8ef1-e568-4915-b272-c74e69b933bb service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:53.911544 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-6d979f7f-2db5-4096-aa92-0841e7c75ff6 req-179e8ef1-e568-4915-b272-c74e69b933bb service nova] Creating event network-changed:7cc7a658-e1a5-4263-8d85-9731c48eb260 for instance c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 on n-h1-465891-3 Jul 18 03:38:53.917783 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-6d979f7f-2db5-4096-aa92-0841e7c75ff6 req-179e8ef1-e568-4915-b272-c74e69b933bb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034335 Jul 18 03:38:53.918712 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3677/7365] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:38:54.043220 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e8930b53-c1c4-47a8-b5cc-c1ce4b1678d3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:38:54.051213 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e8930b53-c1c4-47a8-b5cc-c1ce4b1678d3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138" status: 200 len: 1564 microversion: 2.1 time: 0.170453 Jul 18 03:38:54.051801 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3689/7366] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:38:53 2022] GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 => generated 1564 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:39:27.352253 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-15cbc6fb-32cd-40f0-bbe6-fbdf6ded329c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:39:27.354175 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-15cbc6fb-32cd-40f0-bbe6-fbdf6ded329c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:39:27.356565 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=9 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:39:27.357226 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=40 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:39:27.363960 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-15cbc6fb-32cd-40f0-bbe6-fbdf6ded329c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:39:27.364408 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-15cbc6fb-32cd-40f0-bbe6-fbdf6ded329c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:39:27.365203 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-15cbc6fb-32cd-40f0-bbe6-fbdf6ded329c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:39:27.365670 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-15cbc6fb-32cd-40f0-bbe6-fbdf6ded329c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:39:27.430588 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-15cbc6fb-32cd-40f0-bbe6-fbdf6ded329c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "POST /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138/action" status: 200 len: 24565 microversion: 2.1 time: 0.082773 Jul 18 03:39:27.431310 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3678/7367] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:39:27 2022] POST /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138/action => generated 24565 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 03:39:57.878764 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:39:57.879548 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=46 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:39:57.883896 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2a70aa01-0579-40a0-aa85-05c58931ec89 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:39:57.891311 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2a70aa01-0579-40a0-aa85-05c58931ec89 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:39:57.891780 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2a70aa01-0579-40a0-aa85-05c58931ec89 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:39:57.915306 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2a70aa01-0579-40a0-aa85-05c58931ec89 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Going to try to stop instance {{(pid=119543) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 03:39:57.958338 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2a70aa01-0579-40a0-aa85-05c58931ec89 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "POST /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138/action" status: 202 len: 0 microversion: 2.1 time: 0.081225 Jul 18 03:39:57.958985 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3690/7368] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:39:57 2022] POST /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 03:39:57.968526 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d2e8ece9-c5ae-4c63-8dec-31f4bf8192a8 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:39:57.969235 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d2e8ece9-c5ae-4c63-8dec-31f4bf8192a8 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:39:57.974140 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:39:57.974742 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:39:57.981127 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d2e8ece9-c5ae-4c63-8dec-31f4bf8192a8 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:39:57.981663 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d2e8ece9-c5ae-4c63-8dec-31f4bf8192a8 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:39:57.982465 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d2e8ece9-c5ae-4c63-8dec-31f4bf8192a8 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:39:57.982894 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d2e8ece9-c5ae-4c63-8dec-31f4bf8192a8 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:39:58.120546 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d2e8ece9-c5ae-4c63-8dec-31f4bf8192a8 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:39:58.128925 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d2e8ece9-c5ae-4c63-8dec-31f4bf8192a8 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138" status: 200 len: 1693 microversion: 2.1 time: 0.165100 Jul 18 03:39:58.129442 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3679/7369] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:39:57 2022] GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 => generated 1693 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:39:59.148883 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-afc708df-c040-4ddf-9712-0f5626d0d9a2 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:39:59.149599 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-afc708df-c040-4ddf-9712-0f5626d0d9a2 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:39:59.156649 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-afc708df-c040-4ddf-9712-0f5626d0d9a2 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:39:59.157116 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-afc708df-c040-4ddf-9712-0f5626d0d9a2 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:39:59.157945 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-afc708df-c040-4ddf-9712-0f5626d0d9a2 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:39:59.158398 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-afc708df-c040-4ddf-9712-0f5626d0d9a2 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:39:59.295241 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-afc708df-c040-4ddf-9712-0f5626d0d9a2 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:39:59.303416 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-afc708df-c040-4ddf-9712-0f5626d0d9a2 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138" status: 200 len: 1693 microversion: 2.1 time: 0.160072 Jul 18 03:39:59.304012 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3691/7370] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:39:59 2022] GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:40:00.320624 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ce598522-aec9-4483-9897-a4739a09742d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:40:00.321239 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ce598522-aec9-4483-9897-a4739a09742d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:40:00.328713 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ce598522-aec9-4483-9897-a4739a09742d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:40:00.329172 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ce598522-aec9-4483-9897-a4739a09742d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:40:00.329962 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ce598522-aec9-4483-9897-a4739a09742d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:40:00.330402 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ce598522-aec9-4483-9897-a4739a09742d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:40:00.467413 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ce598522-aec9-4483-9897-a4739a09742d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:40:00.474946 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ce598522-aec9-4483-9897-a4739a09742d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138" status: 200 len: 1693 microversion: 2.1 time: 0.158439 Jul 18 03:40:00.475530 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3680/7371] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:40:00 2022] GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:40:01.491883 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cc98114d-a452-463e-8ab0-a27eab26659f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:40:01.492486 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cc98114d-a452-463e-8ab0-a27eab26659f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:40:01.499556 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cc98114d-a452-463e-8ab0-a27eab26659f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:40:01.500157 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cc98114d-a452-463e-8ab0-a27eab26659f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:40:01.500965 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cc98114d-a452-463e-8ab0-a27eab26659f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:40:01.501422 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cc98114d-a452-463e-8ab0-a27eab26659f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:40:01.641682 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cc98114d-a452-463e-8ab0-a27eab26659f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:40:01.649556 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cc98114d-a452-463e-8ab0-a27eab26659f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138" status: 200 len: 1693 microversion: 2.1 time: 0.161650 Jul 18 03:40:01.650161 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3692/7372] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:40:01 2022] GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:40:02.667823 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-296cc475-449e-4ca5-a021-7ca78c328340 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:40:02.668442 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-296cc475-449e-4ca5-a021-7ca78c328340 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:40:02.676599 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-296cc475-449e-4ca5-a021-7ca78c328340 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:40:02.677051 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-296cc475-449e-4ca5-a021-7ca78c328340 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:40:02.677873 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-296cc475-449e-4ca5-a021-7ca78c328340 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:40:02.678487 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-296cc475-449e-4ca5-a021-7ca78c328340 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:40:02.814285 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-296cc475-449e-4ca5-a021-7ca78c328340 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:40:02.821811 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-296cc475-449e-4ca5-a021-7ca78c328340 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138" status: 200 len: 1693 microversion: 2.1 time: 0.158072 Jul 18 03:40:02.822385 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3681/7373] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:40:02 2022] GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:40:03.839641 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-322caa3e-9571-4626-b4bd-bcd88e8acd90 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:40:03.840296 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-322caa3e-9571-4626-b4bd-bcd88e8acd90 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:40:03.848747 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-322caa3e-9571-4626-b4bd-bcd88e8acd90 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:40:03.849218 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-322caa3e-9571-4626-b4bd-bcd88e8acd90 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:40:03.850121 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-322caa3e-9571-4626-b4bd-bcd88e8acd90 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:40:03.850583 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-322caa3e-9571-4626-b4bd-bcd88e8acd90 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:40:03.987266 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-322caa3e-9571-4626-b4bd-bcd88e8acd90 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:40:03.994835 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-322caa3e-9571-4626-b4bd-bcd88e8acd90 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138" status: 200 len: 1693 microversion: 2.1 time: 0.159148 Jul 18 03:40:03.995407 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3693/7374] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:40:03 2022] GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:40:05.012343 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b59e20db-02de-47f9-a201-d98e41ea6a53 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:40:05.012946 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b59e20db-02de-47f9-a201-d98e41ea6a53 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:40:05.020568 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b59e20db-02de-47f9-a201-d98e41ea6a53 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:40:05.021022 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b59e20db-02de-47f9-a201-d98e41ea6a53 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:40:05.021828 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b59e20db-02de-47f9-a201-d98e41ea6a53 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:40:05.022288 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b59e20db-02de-47f9-a201-d98e41ea6a53 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:40:05.162176 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b59e20db-02de-47f9-a201-d98e41ea6a53 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:40:05.169801 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b59e20db-02de-47f9-a201-d98e41ea6a53 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138" status: 200 len: 1693 microversion: 2.1 time: 0.161268 Jul 18 03:40:05.170387 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3682/7375] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:40:05 2022] GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:40:06.187799 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-334ac67a-624f-4217-8af1-9c2fa637ee83 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:40:06.188416 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-334ac67a-624f-4217-8af1-9c2fa637ee83 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:40:06.195544 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-334ac67a-624f-4217-8af1-9c2fa637ee83 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:40:06.196001 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-334ac67a-624f-4217-8af1-9c2fa637ee83 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:40:06.196776 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-334ac67a-624f-4217-8af1-9c2fa637ee83 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:40:06.197225 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-334ac67a-624f-4217-8af1-9c2fa637ee83 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:40:06.331292 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-334ac67a-624f-4217-8af1-9c2fa637ee83 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:40:06.338861 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-334ac67a-624f-4217-8af1-9c2fa637ee83 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138" status: 200 len: 1693 microversion: 2.1 time: 0.155550 Jul 18 03:40:06.339447 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3694/7376] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:40:06 2022] GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:40:07.356963 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-764a6c2a-2ee2-43e3-bb54-507eb167a389 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:40:07.357579 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-764a6c2a-2ee2-43e3-bb54-507eb167a389 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:40:07.365528 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-764a6c2a-2ee2-43e3-bb54-507eb167a389 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:40:07.366029 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-764a6c2a-2ee2-43e3-bb54-507eb167a389 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:40:07.366822 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-764a6c2a-2ee2-43e3-bb54-507eb167a389 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:40:07.367268 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-764a6c2a-2ee2-43e3-bb54-507eb167a389 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:40:07.503788 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-764a6c2a-2ee2-43e3-bb54-507eb167a389 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:40:07.511406 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-764a6c2a-2ee2-43e3-bb54-507eb167a389 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138" status: 200 len: 1693 microversion: 2.1 time: 0.158489 Jul 18 03:40:07.511992 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3683/7377] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:40:07 2022] GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:40:08.529011 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-588850ea-d54b-4e4a-84d6-e1ca8dfbec9c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:40:08.530299 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-588850ea-d54b-4e4a-84d6-e1ca8dfbec9c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:40:08.537365 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-588850ea-d54b-4e4a-84d6-e1ca8dfbec9c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:40:08.537862 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-588850ea-d54b-4e4a-84d6-e1ca8dfbec9c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:40:08.538647 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-588850ea-d54b-4e4a-84d6-e1ca8dfbec9c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:40:08.539103 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-588850ea-d54b-4e4a-84d6-e1ca8dfbec9c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:40:08.680538 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-588850ea-d54b-4e4a-84d6-e1ca8dfbec9c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:40:08.688978 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-588850ea-d54b-4e4a-84d6-e1ca8dfbec9c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138" status: 200 len: 1693 microversion: 2.1 time: 0.163954 Jul 18 03:40:08.689572 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3695/7378] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:40:08 2022] GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:40:09.707664 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-173cb107-d44f-4a46-8389-45ee18dc4b71 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:40:09.708200 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-173cb107-d44f-4a46-8389-45ee18dc4b71 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:40:09.715377 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-173cb107-d44f-4a46-8389-45ee18dc4b71 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:40:09.715834 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-173cb107-d44f-4a46-8389-45ee18dc4b71 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:40:09.716605 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-173cb107-d44f-4a46-8389-45ee18dc4b71 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:40:09.717045 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-173cb107-d44f-4a46-8389-45ee18dc4b71 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:40:09.856092 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-173cb107-d44f-4a46-8389-45ee18dc4b71 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:40:09.863827 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-173cb107-d44f-4a46-8389-45ee18dc4b71 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138" status: 200 len: 1693 microversion: 2.1 time: 0.161343 Jul 18 03:40:09.864401 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3684/7379] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:40:09 2022] GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:40:10.882010 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-cc7a0a46-887c-473a-b893-4bac86f0bdb1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:40:10.882636 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-cc7a0a46-887c-473a-b893-4bac86f0bdb1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:40:10.889941 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cc7a0a46-887c-473a-b893-4bac86f0bdb1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:40:10.890650 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cc7a0a46-887c-473a-b893-4bac86f0bdb1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:40:10.891855 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cc7a0a46-887c-473a-b893-4bac86f0bdb1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:40:10.892355 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-cc7a0a46-887c-473a-b893-4bac86f0bdb1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:40:11.028647 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-cc7a0a46-887c-473a-b893-4bac86f0bdb1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:40:11.036682 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-cc7a0a46-887c-473a-b893-4bac86f0bdb1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138" status: 200 len: 1693 microversion: 2.1 time: 0.158750 Jul 18 03:40:11.037488 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3696/7380] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:40:10 2022] GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:40:12.055041 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d12a78da-0c89-4457-81b7-cf1021d1c6a1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:40:12.055657 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d12a78da-0c89-4457-81b7-cf1021d1c6a1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:40:12.062718 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d12a78da-0c89-4457-81b7-cf1021d1c6a1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:40:12.063168 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d12a78da-0c89-4457-81b7-cf1021d1c6a1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:40:12.063935 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d12a78da-0c89-4457-81b7-cf1021d1c6a1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:40:12.064372 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d12a78da-0c89-4457-81b7-cf1021d1c6a1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:40:12.196015 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d12a78da-0c89-4457-81b7-cf1021d1c6a1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:40:12.204240 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d12a78da-0c89-4457-81b7-cf1021d1c6a1 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138" status: 200 len: 1693 microversion: 2.1 time: 0.152958 Jul 18 03:40:12.204822 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3685/7381] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:40:12 2022] GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 => generated 1693 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:40:13.221163 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-627ea6d7-9cf5-4adc-b905-6f1f81b66886 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:40:13.221892 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-627ea6d7-9cf5-4adc-b905-6f1f81b66886 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:40:13.229336 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-627ea6d7-9cf5-4adc-b905-6f1f81b66886 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:40:13.229835 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-627ea6d7-9cf5-4adc-b905-6f1f81b66886 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:40:13.230646 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-627ea6d7-9cf5-4adc-b905-6f1f81b66886 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:40:13.231099 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-627ea6d7-9cf5-4adc-b905-6f1f81b66886 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:40:13.406603 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-627ea6d7-9cf5-4adc-b905-6f1f81b66886 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:40:13.417995 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-627ea6d7-9cf5-4adc-b905-6f1f81b66886 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138" status: 200 len: 1693 microversion: 2.1 time: 0.199812 Jul 18 03:40:13.418769 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3697/7382] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:40:13 2022] GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 => generated 1693 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:40:14.438777 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c11015d1-d727-438b-bcea-6873eeb3f327 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:40:14.439488 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c11015d1-d727-438b-bcea-6873eeb3f327 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:40:14.446496 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c11015d1-d727-438b-bcea-6873eeb3f327 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:40:14.446949 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c11015d1-d727-438b-bcea-6873eeb3f327 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:40:14.447713 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c11015d1-d727-438b-bcea-6873eeb3f327 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:40:14.448150 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c11015d1-d727-438b-bcea-6873eeb3f327 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:40:14.585735 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c11015d1-d727-438b-bcea-6873eeb3f327 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:40:14.593429 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c11015d1-d727-438b-bcea-6873eeb3f327 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138" status: 200 len: 1670 microversion: 2.1 time: 0.158960 Jul 18 03:40:14.594073 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3686/7383] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:40:14 2022] GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 => generated 1670 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:40:15.689273 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8b26170d-f49b-43c0-8267-37a324081b20 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:40:15.690244 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8b26170d-f49b-43c0-8267-37a324081b20 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:40:15.697610 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8b26170d-f49b-43c0-8267-37a324081b20 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:40:15.698121 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8b26170d-f49b-43c0-8267-37a324081b20 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:40:15.698912 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8b26170d-f49b-43c0-8267-37a324081b20 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:40:15.699359 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8b26170d-f49b-43c0-8267-37a324081b20 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:40:15.757146 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8b26170d-f49b-43c0-8267-37a324081b20 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "POST /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138/action" status: 200 len: 36070 microversion: 2.1 time: 0.072198 Jul 18 03:40:15.757838 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3698/7384] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:40:15 2022] POST /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138/action => generated 36070 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 03:40:15.769480 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5735413d-3140-4046-9692-957e1ecc83d4 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:40:15.776718 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5735413d-3140-4046-9692-957e1ecc83d4 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:40:15.777166 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5735413d-3140-4046-9692-957e1ecc83d4 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:40:15.800846 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5735413d-3140-4046-9692-957e1ecc83d4 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Going to try to start instance {{(pid=119544) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 03:40:15.842339 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5735413d-3140-4046-9692-957e1ecc83d4 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "POST /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138/action" status: 202 len: 0 microversion: 2.1 time: 0.076442 Jul 18 03:40:15.842984 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3687/7385] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:40:15 2022] POST /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 03:40:15.851973 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8b2d684d-aee3-41ca-acc2-ef96d7214f1a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:40:15.852692 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8b2d684d-aee3-41ca-acc2-ef96d7214f1a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:40:15.860518 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8b2d684d-aee3-41ca-acc2-ef96d7214f1a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:40:15.860991 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8b2d684d-aee3-41ca-acc2-ef96d7214f1a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:40:15.861856 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8b2d684d-aee3-41ca-acc2-ef96d7214f1a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:40:15.862316 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8b2d684d-aee3-41ca-acc2-ef96d7214f1a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:40:16.009512 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8b2d684d-aee3-41ca-acc2-ef96d7214f1a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:40:16.018061 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8b2d684d-aee3-41ca-acc2-ef96d7214f1a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138" status: 200 len: 1679 microversion: 2.1 time: 0.170285 Jul 18 03:40:16.018652 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3699/7386] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:40:15 2022] GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:40:17.036627 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d0f39ac2-1363-4cfb-bc14-d265877fe9d9 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:40:17.037330 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d0f39ac2-1363-4cfb-bc14-d265877fe9d9 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:40:17.043679 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d0f39ac2-1363-4cfb-bc14-d265877fe9d9 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:40:17.044130 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d0f39ac2-1363-4cfb-bc14-d265877fe9d9 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:40:17.044908 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d0f39ac2-1363-4cfb-bc14-d265877fe9d9 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:40:17.045385 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d0f39ac2-1363-4cfb-bc14-d265877fe9d9 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:40:17.196415 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d0f39ac2-1363-4cfb-bc14-d265877fe9d9 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:40:17.204160 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d0f39ac2-1363-4cfb-bc14-d265877fe9d9 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138" status: 200 len: 1679 microversion: 2.1 time: 0.172795 Jul 18 03:40:17.204748 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3688/7387] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:40:17 2022] GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:40:18.220574 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2999c3eb-48c3-492c-8ebf-39f16cfb77c7 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:40:18.221203 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2999c3eb-48c3-492c-8ebf-39f16cfb77c7 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:40:18.228054 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2999c3eb-48c3-492c-8ebf-39f16cfb77c7 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:40:18.228512 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2999c3eb-48c3-492c-8ebf-39f16cfb77c7 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:40:18.229300 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2999c3eb-48c3-492c-8ebf-39f16cfb77c7 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:40:18.229767 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2999c3eb-48c3-492c-8ebf-39f16cfb77c7 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:40:18.364531 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2999c3eb-48c3-492c-8ebf-39f16cfb77c7 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:40:18.372192 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2999c3eb-48c3-492c-8ebf-39f16cfb77c7 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138" status: 200 len: 1683 microversion: 2.1 time: 0.155668 Jul 18 03:40:18.372775 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3700/7388] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:40:18 2022] GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:40:50.592497 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-74644d35-0c14-4e64-821d-9fe340991a38 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:40:50.594082 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-74644d35-0c14-4e64-821d-9fe340991a38 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:40:50.596761 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=20 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:40:50.597415 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:40:50.604508 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74644d35-0c14-4e64-821d-9fe340991a38 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:40:50.604952 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74644d35-0c14-4e64-821d-9fe340991a38 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:40:50.605721 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74644d35-0c14-4e64-821d-9fe340991a38 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:40:50.606182 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74644d35-0c14-4e64-821d-9fe340991a38 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:40:50.677662 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-74644d35-0c14-4e64-821d-9fe340991a38 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "POST /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138/action" status: 200 len: 60628 microversion: 2.1 time: 0.088900 Jul 18 03:40:50.678367 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3689/7389] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:40:50 2022] POST /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138/action => generated 60628 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 03:41:07.860972 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ddb6808c-8f56-431f-a8f4-9398597b9ce3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:41:07.862062 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ddb6808c-8f56-431f-a8f4-9398597b9ce3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:41:07.864605 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=22 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:41:07.865280 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:41:07.865424 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:41:07.867020 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:41:07.870970 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ddb6808c-8f56-431f-a8f4-9398597b9ce3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:07.871475 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ddb6808c-8f56-431f-a8f4-9398597b9ce3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:07.872232 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ddb6808c-8f56-431f-a8f4-9398597b9ce3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:07.872687 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ddb6808c-8f56-431f-a8f4-9398597b9ce3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:07.903150 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ddb6808c-8f56-431f-a8f4-9398597b9ce3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:41:07.930634 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-2d3ab985-2b83-49d4-9fb2-d0dc7f51b7b0 req-7cae904b-e25d-48d5-96ac-8a33d26c577b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138", "tag": "7cc7a658-e1a5-4263-8d85-9731c48eb260"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:41:07.944457 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-2d3ab985-2b83-49d4-9fb2-d0dc7f51b7b0 req-7cae904b-e25d-48d5-96ac-8a33d26c577b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:07.945109 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-2d3ab985-2b83-49d4-9fb2-d0dc7f51b7b0 req-7cae904b-e25d-48d5-96ac-8a33d26c577b service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:07.959813 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-2d3ab985-2b83-49d4-9fb2-d0dc7f51b7b0 req-7cae904b-e25d-48d5-96ac-8a33d26c577b service nova] Creating event network-changed:7cc7a658-e1a5-4263-8d85-9731c48eb260 for instance c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 on n-h1-465891-3 Jul 18 03:41:07.966258 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-2d3ab985-2b83-49d4-9fb2-d0dc7f51b7b0 req-7cae904b-e25d-48d5-96ac-8a33d26c577b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107143 Jul 18 03:41:07.967829 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3690/7390] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:41:07.989568 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ddb6808c-8f56-431f-a8f4-9398597b9ce3 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138" status: 204 len: 0 microversion: 2.1 time: 0.132622 Jul 18 03:41:07.990211 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3701/7391] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:41:07 2022] DELETE /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:41:08.000735 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a6e4fedf-bc01-4ccd-827c-69dba49122bc tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:41:08.003816 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a6e4fedf-bc01-4ccd-827c-69dba49122bc tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:41:08.012581 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a6e4fedf-bc01-4ccd-827c-69dba49122bc tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:08.013140 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a6e4fedf-bc01-4ccd-827c-69dba49122bc tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:08.014242 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a6e4fedf-bc01-4ccd-827c-69dba49122bc tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:08.014944 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a6e4fedf-bc01-4ccd-827c-69dba49122bc tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:08.164076 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a6e4fedf-bc01-4ccd-827c-69dba49122bc tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:41:08.171890 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a6e4fedf-bc01-4ccd-827c-69dba49122bc tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138" status: 200 len: 1689 microversion: 2.1 time: 0.176996 Jul 18 03:41:08.172481 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3691/7392] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:41:07 2022] GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 => generated 1689 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:41:09.190248 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-45801bb5-8039-4d65-85d3-3f5448e8d3b9 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:41:09.191148 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-45801bb5-8039-4d65-85d3-3f5448e8d3b9 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:41:09.198213 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-45801bb5-8039-4d65-85d3-3f5448e8d3b9 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:09.198680 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-45801bb5-8039-4d65-85d3-3f5448e8d3b9 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:09.199463 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-45801bb5-8039-4d65-85d3-3f5448e8d3b9 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:09.199916 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-45801bb5-8039-4d65-85d3-3f5448e8d3b9 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:09.338094 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-45801bb5-8039-4d65-85d3-3f5448e8d3b9 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:41:09.346012 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-45801bb5-8039-4d65-85d3-3f5448e8d3b9 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138" status: 200 len: 1689 microversion: 2.1 time: 0.160607 Jul 18 03:41:09.346835 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3702/7393] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:41:09 2022] GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:41:10.249262 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-71a88abf-6c1f-4912-8c09-99047d1aa4cf req-97ccdb04-7960-4f2d-b29a-41ebdb7c6e78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138", "name": "network-vif-deleted", "tag": "7cc7a658-e1a5-4263-8d85-9731c48eb260"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:41:10.259609 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-71a88abf-6c1f-4912-8c09-99047d1aa4cf req-97ccdb04-7960-4f2d-b29a-41ebdb7c6e78 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:10.260057 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-71a88abf-6c1f-4912-8c09-99047d1aa4cf req-97ccdb04-7960-4f2d-b29a-41ebdb7c6e78 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:10.271703 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-71a88abf-6c1f-4912-8c09-99047d1aa4cf req-97ccdb04-7960-4f2d-b29a-41ebdb7c6e78 service nova] Creating event network-vif-deleted:7cc7a658-e1a5-4263-8d85-9731c48eb260 for instance c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 on n-h1-465891-3 Jul 18 03:41:10.277330 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-71a88abf-6c1f-4912-8c09-99047d1aa4cf req-97ccdb04-7960-4f2d-b29a-41ebdb7c6e78 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031745 Jul 18 03:41:10.278005 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3692/7394] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:41:10.365406 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6b632a64-5a5f-4dae-bad9-4555c9a31bf8 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:41:10.366071 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6b632a64-5a5f-4dae-bad9-4555c9a31bf8 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:41:10.373173 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6b632a64-5a5f-4dae-bad9-4555c9a31bf8 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:10.373640 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6b632a64-5a5f-4dae-bad9-4555c9a31bf8 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:10.374462 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6b632a64-5a5f-4dae-bad9-4555c9a31bf8 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:10.374916 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6b632a64-5a5f-4dae-bad9-4555c9a31bf8 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:10.408224 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6b632a64-5a5f-4dae-bad9-4555c9a31bf8 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:10.408610 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6b632a64-5a5f-4dae-bad9-4555c9a31bf8 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:10.409180 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-6b632a64-5a5f-4dae-bad9-4555c9a31bf8 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lazy-loading 'fault' on Instance uuid c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:41:10.455152 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6b632a64-5a5f-4dae-bad9-4555c9a31bf8 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:41:10.462849 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6b632a64-5a5f-4dae-bad9-4555c9a31bf8 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138" status: 200 len: 1357 microversion: 2.1 time: 0.101949 Jul 18 03:41:10.463424 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3703/7395] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:41:10 2022] GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 => generated 1357 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:41:11.482443 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-dbb13e76-23ab-43b5-b606-553096017b7b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:41:11.483138 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-dbb13e76-23ab-43b5-b606-553096017b7b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:41:11.490711 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dbb13e76-23ab-43b5-b606-553096017b7b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:11.491169 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dbb13e76-23ab-43b5-b606-553096017b7b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:11.492019 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dbb13e76-23ab-43b5-b606-553096017b7b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:11.492476 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-dbb13e76-23ab-43b5-b606-553096017b7b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:11.509595 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-dbb13e76-23ab-43b5-b606-553096017b7b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] HTTP exception thrown: Instance c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 could not be found. Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-dbb13e76-23ab-43b5-b606-553096017b7b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Request method failure captured: Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 HTTP/1.1 Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1NQn25Nv2CWVcqUB7Jli7-n6pu90utlDXaCYfmF3mQfgKsu7CU9h4Qgbxu3IIS2bQPi7DmlwnQeENXcFmebHsSlw-o4GKxkvJck1gJGsOn4xtry1F0sEpYLtQaLLoR_0JXssRBl37TNYHSvAfTOqzePvi79-HEbaRAqO169pHpwd49Q Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 2d9c17c023e1420c8d90b96e2af98172 Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1294373808 Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2d9c17c023e1420c8d90b96e2af98172"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2d9c17c023e1420c8d90b96e2af98172"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2d9c17c023e1420c8d90b96e2af98172"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2d9c17c023e1420c8d90b96e2af98172"}]}] Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1294373808 Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 2d9c17c023e1420c8d90b96e2af98172 Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1294373808 Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-TestNetworkAdvancedServerOps-1294373808-project Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 921716a730f64ccdbbced6d4bbf715b0 Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1294373808-project Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 could not be found. Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138'} Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 could not be found. Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 could not be found. Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:41:11.511373 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:41:11.523334 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:41:11.523334 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:41:11.523334 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:41:11.523334 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:41:11.523334 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:41:11.523334 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:41:11.523334 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 could not be found. Jul 18 03:41:11.523334 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:41:11.523334 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-dbb13e76-23ab-43b5-b606-553096017b7b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Returning 404 to user: Instance c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:41:11.523334 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-dbb13e76-23ab-43b5-b606-553096017b7b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138" status: 404 len: 111 microversion: 2.1 time: 0.035445 Jul 18 03:41:11.523334 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3693/7396] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:41:11 2022] GET /compute/v2.1/servers/c33d7f84-b5c5-4af4-bc0c-0b9cb71b7138 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:41:12.269737 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:41:12.269985 n-d-465891-3 devstack@n-api.service[119544]: Mon Jul 18 03:41:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:41:13.073898 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:41:13.074599 n-d-465891-3 devstack@n-api.service[119544]: Mon Jul 18 03:41:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:41:14.626725 n-d-465891-3 devstack@n-api.service[119543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:41:14.627266 n-d-465891-3 devstack@n-api.service[119543]: Mon Jul 18 03:41:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:41:14.654140 n-d-465891-3 devstack@n-api.service[119543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:41:14.654350 n-d-465891-3 devstack@n-api.service[119543]: Mon Jul 18 03:41:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:41:15.056301 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-265b046a-3699-46d9-8ee5-d954d75404fe tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '.version_select at 0x7ff49bc4f040>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:41:15.082798 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-265b046a-3699-46d9-8ee5-d954d75404fe tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2116349666" status: 202 len: 0 microversion: 2.1 time: 0.030360 Jul 18 03:41:15.083406 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3704/7397] 10.222.0.57 () {58 vars in 1283 bytes} [Mon Jul 18 03:41:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2116349666 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:41:15.116558 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c853fc32-dd37-4ba4-a3de-d4a76022642a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Action: 'create', calling method: .version_select at 0x7ff4a834e310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1861712159", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMf18ejUVILmIjkUr/pugGQBoluCRRxUCKH31hMce3rHQcguUHL5JB3RWh3vBDriXx366M16WF3T+7nNvf/wxVO5jafcqryvs4wle6dRoEsdDI2xA3rDlkrbPE2exGk20w=="}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:41:15.135979 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-c853fc32-dd37-4ba4-a3de-d4a76022642a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Getting quotas for project 2d9c17c023e1420c8d90b96e2af98172. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:41:15.141040 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-c853fc32-dd37-4ba4-a3de-d4a76022642a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Getting quotas for user 921716a730f64ccdbbced6d4bbf715b0 and project 2d9c17c023e1420c8d90b96e2af98172. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:41:15.170465 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c853fc32-dd37-4ba4-a3de-d4a76022642a tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.057817 Jul 18 03:41:15.171023 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3694/7398] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 03:41:15 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:41:20.917943 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:41:20.923163 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-aaa48231-51b1-4756-91bd-61ebd9136beb tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1478111522", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "networks": [{"uuid": "e8d25900-1fc6-4de2-be20-b8dc9aa34553"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1861712159", "security_groups": [{"name": "tempest-secgroup-smoke-178544046"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:41:21.047203 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-aaa48231-51b1-4756-91bd-61ebd9136beb tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] validate_networks() for [('e8d25900-1fc6-4de2-be20-b8dc9aa34553', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:41:21.531136 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-aaa48231-51b1-4756-91bd-61ebd9136beb tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:41:21.531900 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-aaa48231-51b1-4756-91bd-61ebd9136beb tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:41:21.532707 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-aaa48231-51b1-4756-91bd-61ebd9136beb tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:41:21.533382 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-aaa48231-51b1-4756-91bd-61ebd9136beb tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:41:21.541635 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-aaa48231-51b1-4756-91bd-61ebd9136beb tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:41:21.555620 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aaa48231-51b1-4756-91bd-61ebd9136beb tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:21.556594 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aaa48231-51b1-4756-91bd-61ebd9136beb tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:21.558002 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aaa48231-51b1-4756-91bd-61ebd9136beb tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:21.559718 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-aaa48231-51b1-4756-91bd-61ebd9136beb tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:21.601976 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-aaa48231-51b1-4756-91bd-61ebd9136beb tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Getting quotas for project 2d9c17c023e1420c8d90b96e2af98172. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:41:21.610787 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-aaa48231-51b1-4756-91bd-61ebd9136beb tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Getting quotas for user 921716a730f64ccdbbced6d4bbf715b0 and project 2d9c17c023e1420c8d90b96e2af98172. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:41:21.630031 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-aaa48231-51b1-4756-91bd-61ebd9136beb tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:41:21.633237 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-aaa48231-51b1-4756-91bd-61ebd9136beb tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: bc945fb5-82b2-446d-bd45-1203ee2e3a29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:41:21.707181 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-aaa48231-51b1-4756-91bd-61ebd9136beb tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.791092 Jul 18 03:41:21.711296 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3705/7399] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:41:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:41:21.717744 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-fd5848cf-6ba4-4f6d-b402-291147b15cd5 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:41:21.718364 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-fd5848cf-6ba4-4f6d-b402-291147b15cd5 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: bc945fb5-82b2-446d-bd45-1203ee2e3a29] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:41:21.723126 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=12 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:41:21.814961 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-fd5848cf-6ba4-4f6d-b402-291147b15cd5 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:41:21.821941 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-fd5848cf-6ba4-4f6d-b402-291147b15cd5 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29" status: 200 len: 1267 microversion: 2.1 time: 0.108047 Jul 18 03:41:21.834336 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3695/7400] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:41:21 2022] GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29 => generated 1267 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:41:22.841411 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d9ceaec9-37dc-4b00-88de-f8e358dc9377 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:41:22.842091 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d9ceaec9-37dc-4b00-88de-f8e358dc9377 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: bc945fb5-82b2-446d-bd45-1203ee2e3a29] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:41:22.869723 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d9ceaec9-37dc-4b00-88de-f8e358dc9377 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:22.870190 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d9ceaec9-37dc-4b00-88de-f8e358dc9377 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:22.871555 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d9ceaec9-37dc-4b00-88de-f8e358dc9377 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:22.872192 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d9ceaec9-37dc-4b00-88de-f8e358dc9377 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:22.986863 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d9ceaec9-37dc-4b00-88de-f8e358dc9377 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:41:22.998803 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d9ceaec9-37dc-4b00-88de-f8e358dc9377 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29" status: 200 len: 1327 microversion: 2.1 time: 0.161083 Jul 18 03:41:23.001512 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3706/7401] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:41:22 2022] GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29 => generated 1327 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:41:24.019581 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2c92fbd8-9cf7-4dc4-b740-dfaeab71f2dd tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:41:24.020110 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2c92fbd8-9cf7-4dc4-b740-dfaeab71f2dd tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: bc945fb5-82b2-446d-bd45-1203ee2e3a29] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:41:24.028254 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2c92fbd8-9cf7-4dc4-b740-dfaeab71f2dd tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:24.029008 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2c92fbd8-9cf7-4dc4-b740-dfaeab71f2dd tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:24.029877 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2c92fbd8-9cf7-4dc4-b740-dfaeab71f2dd tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:24.030322 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2c92fbd8-9cf7-4dc4-b740-dfaeab71f2dd tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:24.310565 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2c92fbd8-9cf7-4dc4-b740-dfaeab71f2dd tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:41:24.318931 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2c92fbd8-9cf7-4dc4-b740-dfaeab71f2dd tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29" status: 200 len: 1392 microversion: 2.1 time: 0.304641 Jul 18 03:41:24.320097 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3696/7402] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:41:24 2022] GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29 => generated 1392 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:41:24.587785 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-724270f6-8197-4327-922d-bb705f014611 req-a407db85-ebb5-488d-ac17-e736abf3cd94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc945fb5-82b2-446d-bd45-1203ee2e3a29", "tag": "c6ae3cc9-fc23-4582-85c0-2cffffc618ae"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:41:24.597757 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-724270f6-8197-4327-922d-bb705f014611 req-a407db85-ebb5-488d-ac17-e736abf3cd94 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:24.598617 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-724270f6-8197-4327-922d-bb705f014611 req-a407db85-ebb5-488d-ac17-e736abf3cd94 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:24.612170 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-724270f6-8197-4327-922d-bb705f014611 req-a407db85-ebb5-488d-ac17-e736abf3cd94 service nova] Creating event network-changed:c6ae3cc9-fc23-4582-85c0-2cffffc618ae for instance bc945fb5-82b2-446d-bd45-1203ee2e3a29 on n-h1-465891-3 Jul 18 03:41:24.619058 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-724270f6-8197-4327-922d-bb705f014611 req-a407db85-ebb5-488d-ac17-e736abf3cd94 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035332 Jul 18 03:41:24.619912 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3707/7403] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:41:25.336928 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2ed42ff2-196a-4d45-82a1-baddc480c50f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:41:25.337520 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2ed42ff2-196a-4d45-82a1-baddc480c50f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: bc945fb5-82b2-446d-bd45-1203ee2e3a29] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:41:25.344656 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ed42ff2-196a-4d45-82a1-baddc480c50f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:25.345100 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ed42ff2-196a-4d45-82a1-baddc480c50f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:25.345899 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ed42ff2-196a-4d45-82a1-baddc480c50f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:25.346336 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2ed42ff2-196a-4d45-82a1-baddc480c50f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:25.481074 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-2ed42ff2-196a-4d45-82a1-baddc480c50f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:41:25.489173 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2ed42ff2-196a-4d45-82a1-baddc480c50f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29" status: 200 len: 1392 microversion: 2.1 time: 0.156082 Jul 18 03:41:25.489769 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3697/7404] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:41:25 2022] GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:41:26.506425 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f902671a-6259-4189-bdd2-7e816478adc5 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:41:26.507168 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f902671a-6259-4189-bdd2-7e816478adc5 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: bc945fb5-82b2-446d-bd45-1203ee2e3a29] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:41:26.513491 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f902671a-6259-4189-bdd2-7e816478adc5 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:26.513982 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f902671a-6259-4189-bdd2-7e816478adc5 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:26.514763 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f902671a-6259-4189-bdd2-7e816478adc5 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:26.515218 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f902671a-6259-4189-bdd2-7e816478adc5 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:26.653660 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f902671a-6259-4189-bdd2-7e816478adc5 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:41:26.661981 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f902671a-6259-4189-bdd2-7e816478adc5 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29" status: 200 len: 1392 microversion: 2.1 time: 0.160586 Jul 18 03:41:26.662555 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3708/7405] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:41:26 2022] GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:41:27.678998 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4dd493eb-8ca8-4d45-83b8-be82d1303997 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:41:27.679629 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4dd493eb-8ca8-4d45-83b8-be82d1303997 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: bc945fb5-82b2-446d-bd45-1203ee2e3a29] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:41:27.686219 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4dd493eb-8ca8-4d45-83b8-be82d1303997 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:27.686670 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4dd493eb-8ca8-4d45-83b8-be82d1303997 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:27.687978 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4dd493eb-8ca8-4d45-83b8-be82d1303997 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:27.688412 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4dd493eb-8ca8-4d45-83b8-be82d1303997 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:27.825102 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4dd493eb-8ca8-4d45-83b8-be82d1303997 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:41:27.833057 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4dd493eb-8ca8-4d45-83b8-be82d1303997 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29" status: 200 len: 1392 microversion: 2.1 time: 0.157890 Jul 18 03:41:27.833919 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3698/7406] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:41:27 2022] GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:41:28.850664 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3a23da40-964b-4be7-8757-f69e1548d678 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:41:28.851286 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3a23da40-964b-4be7-8757-f69e1548d678 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: bc945fb5-82b2-446d-bd45-1203ee2e3a29] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:41:28.859030 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3a23da40-964b-4be7-8757-f69e1548d678 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:28.859549 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3a23da40-964b-4be7-8757-f69e1548d678 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:28.860497 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3a23da40-964b-4be7-8757-f69e1548d678 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:28.860981 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3a23da40-964b-4be7-8757-f69e1548d678 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:29.008893 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3a23da40-964b-4be7-8757-f69e1548d678 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:41:29.017726 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3a23da40-964b-4be7-8757-f69e1548d678 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29" status: 200 len: 1392 microversion: 2.1 time: 0.170755 Jul 18 03:41:29.018347 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3709/7407] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:41:28 2022] GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29 => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:41:29.817480 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-243f329c-3a13-42b8-88af-bde7876bd048 req-27ea6754-6c0f-467a-9186-100a7fe8aa69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc945fb5-82b2-446d-bd45-1203ee2e3a29", "name": "network-vif-plugged", "status": "completed", "tag": "c6ae3cc9-fc23-4582-85c0-2cffffc618ae"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:41:29.825469 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-243f329c-3a13-42b8-88af-bde7876bd048 req-27ea6754-6c0f-467a-9186-100a7fe8aa69 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:29.825932 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-243f329c-3a13-42b8-88af-bde7876bd048 req-27ea6754-6c0f-467a-9186-100a7fe8aa69 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:29.837522 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-243f329c-3a13-42b8-88af-bde7876bd048 req-27ea6754-6c0f-467a-9186-100a7fe8aa69 service nova] Creating event network-vif-plugged:c6ae3cc9-fc23-4582-85c0-2cffffc618ae for instance bc945fb5-82b2-446d-bd45-1203ee2e3a29 on n-h1-465891-3 Jul 18 03:41:29.842438 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-243f329c-3a13-42b8-88af-bde7876bd048 req-27ea6754-6c0f-467a-9186-100a7fe8aa69 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081541 Jul 18 03:41:29.843044 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3699/7408] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:41:30.035210 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1630e59b-446b-4038-a15b-fafa55b95aba tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:41:30.035874 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1630e59b-446b-4038-a15b-fafa55b95aba tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: bc945fb5-82b2-446d-bd45-1203ee2e3a29] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:41:30.042780 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1630e59b-446b-4038-a15b-fafa55b95aba tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:30.043246 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1630e59b-446b-4038-a15b-fafa55b95aba tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:30.044039 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1630e59b-446b-4038-a15b-fafa55b95aba tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:30.044497 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1630e59b-446b-4038-a15b-fafa55b95aba tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:30.175802 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1630e59b-446b-4038-a15b-fafa55b95aba tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:41:30.183430 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1630e59b-446b-4038-a15b-fafa55b95aba tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29" status: 200 len: 1392 microversion: 2.1 time: 0.152797 Jul 18 03:41:30.184007 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3710/7409] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:41:30 2022] GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:41:31.202296 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-15f92a17-3e61-426b-950f-a30c92f2e076 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:41:31.203512 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-15f92a17-3e61-426b-950f-a30c92f2e076 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: bc945fb5-82b2-446d-bd45-1203ee2e3a29] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:41:31.210061 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-15f92a17-3e61-426b-950f-a30c92f2e076 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:31.210538 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-15f92a17-3e61-426b-950f-a30c92f2e076 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:31.211294 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-15f92a17-3e61-426b-950f-a30c92f2e076 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:31.211740 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-15f92a17-3e61-426b-950f-a30c92f2e076 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:31.355923 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-15f92a17-3e61-426b-950f-a30c92f2e076 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:41:31.363719 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-15f92a17-3e61-426b-950f-a30c92f2e076 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29" status: 200 len: 1392 microversion: 2.1 time: 0.166642 Jul 18 03:41:31.364587 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3700/7410] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:41:31 2022] GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:41:32.381386 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8428a7eb-b7ff-4db6-b44d-89d21267b521 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:41:32.381953 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8428a7eb-b7ff-4db6-b44d-89d21267b521 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: bc945fb5-82b2-446d-bd45-1203ee2e3a29] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:41:32.384743 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:41:32.385666 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:41:32.391644 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8428a7eb-b7ff-4db6-b44d-89d21267b521 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:32.392379 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8428a7eb-b7ff-4db6-b44d-89d21267b521 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:32.393181 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8428a7eb-b7ff-4db6-b44d-89d21267b521 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:32.393627 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8428a7eb-b7ff-4db6-b44d-89d21267b521 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:32.527244 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8428a7eb-b7ff-4db6-b44d-89d21267b521 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:41:32.535266 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8428a7eb-b7ff-4db6-b44d-89d21267b521 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29" status: 200 len: 1565 microversion: 2.1 time: 0.157978 Jul 18 03:41:32.535841 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3711/7411] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:41:32 2022] GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:41:32.551843 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5d5734a5-f760-4542-a401-998b8116300b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:41:32.552458 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5d5734a5-f760-4542-a401-998b8116300b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: bc945fb5-82b2-446d-bd45-1203ee2e3a29] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:41:32.554653 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:41:32.561120 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5d5734a5-f760-4542-a401-998b8116300b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:32.561570 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5d5734a5-f760-4542-a401-998b8116300b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:32.562778 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5d5734a5-f760-4542-a401-998b8116300b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:32.563061 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5d5734a5-f760-4542-a401-998b8116300b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:32.698047 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5d5734a5-f760-4542-a401-998b8116300b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:41:32.706364 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5d5734a5-f760-4542-a401-998b8116300b tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29" status: 200 len: 1565 microversion: 2.1 time: 0.158386 Jul 18 03:41:32.706936 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3701/7412] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:41:32 2022] GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:41:34.691573 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5bda7125-60af-43a2-88eb-70b5a942fa9f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:41:34.692360 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5bda7125-60af-43a2-88eb-70b5a942fa9f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: bc945fb5-82b2-446d-bd45-1203ee2e3a29] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:41:34.701592 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5bda7125-60af-43a2-88eb-70b5a942fa9f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:34.702420 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5bda7125-60af-43a2-88eb-70b5a942fa9f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:34.703278 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5bda7125-60af-43a2-88eb-70b5a942fa9f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:34.703988 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5bda7125-60af-43a2-88eb-70b5a942fa9f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:34.750077 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-64b2c2d2-0f25-4c89-8c96-9e4376b44559 req-3e62b71c-9833-4dbb-b416-7732f73c32e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc945fb5-82b2-446d-bd45-1203ee2e3a29", "tag": "c6ae3cc9-fc23-4582-85c0-2cffffc618ae"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:41:34.759944 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-64b2c2d2-0f25-4c89-8c96-9e4376b44559 req-3e62b71c-9833-4dbb-b416-7732f73c32e8 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:34.760386 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-64b2c2d2-0f25-4c89-8c96-9e4376b44559 req-3e62b71c-9833-4dbb-b416-7732f73c32e8 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:34.775800 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-64b2c2d2-0f25-4c89-8c96-9e4376b44559 req-3e62b71c-9833-4dbb-b416-7732f73c32e8 service nova] Creating event network-changed:c6ae3cc9-fc23-4582-85c0-2cffffc618ae for instance bc945fb5-82b2-446d-bd45-1203ee2e3a29 on n-h1-465891-3 Jul 18 03:41:34.781713 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-64b2c2d2-0f25-4c89-8c96-9e4376b44559 req-3e62b71c-9833-4dbb-b416-7732f73c32e8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091319 Jul 18 03:41:34.782693 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3702/7413] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:41:34.883882 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5bda7125-60af-43a2-88eb-70b5a942fa9f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:41:34.895280 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5bda7125-60af-43a2-88eb-70b5a942fa9f tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29" status: 200 len: 1565 microversion: 2.1 time: 0.207921 Jul 18 03:41:34.895892 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3712/7414] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:41:34 2022] GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29 => generated 1565 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:42:08.175922 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:42:08.176650 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=34 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:42:08.383525 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-749ec275-742f-4d4c-b448-2423567e4429 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:42:08.384699 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-749ec275-742f-4d4c-b448-2423567e4429 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: bc945fb5-82b2-446d-bd45-1203ee2e3a29] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:42:08.391716 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-749ec275-742f-4d4c-b448-2423567e4429 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:42:08.392369 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-749ec275-742f-4d4c-b448-2423567e4429 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:42:08.393157 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-749ec275-742f-4d4c-b448-2423567e4429 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:42:08.393604 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-749ec275-742f-4d4c-b448-2423567e4429 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:42:08.461246 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-749ec275-742f-4d4c-b448-2423567e4429 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "POST /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29/action" status: 200 len: 24573 microversion: 2.1 time: 0.291057 Jul 18 03:42:08.461943 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3703/7415] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:42:08 2022] POST /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29/action => generated 24573 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 03:42:38.863068 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:42:38.863826 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=40 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:42:38.867889 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-680858d2-5f1d-4510-b250-c3382b35c6a6 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:42:38.868430 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-680858d2-5f1d-4510-b250-c3382b35c6a6 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: bc945fb5-82b2-446d-bd45-1203ee2e3a29] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:42:38.876412 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-680858d2-5f1d-4510-b250-c3382b35c6a6 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:42:38.876874 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-680858d2-5f1d-4510-b250-c3382b35c6a6 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:42:38.877650 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-680858d2-5f1d-4510-b250-c3382b35c6a6 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:42:38.878121 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-680858d2-5f1d-4510-b250-c3382b35c6a6 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:42:38.903134 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-680858d2-5f1d-4510-b250-c3382b35c6a6 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lazy-loading 'flavor' on Instance uuid bc945fb5-82b2-446d-bd45-1203ee2e3a29 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:42:38.969238 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-680858d2-5f1d-4510-b250-c3382b35c6a6 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "POST /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29/action" status: 202 len: 0 microversion: 2.1 time: 0.107916 Jul 18 03:42:38.970623 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3713/7416] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:42:38 2022] POST /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:42:38.978715 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c288a18e-6340-422f-a53b-270f13a05ac0 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:42:38.979419 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c288a18e-6340-422f-a53b-270f13a05ac0 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: bc945fb5-82b2-446d-bd45-1203ee2e3a29] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:42:38.982153 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:42:38.982800 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=4 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:42:38.990683 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c288a18e-6340-422f-a53b-270f13a05ac0 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:42:38.991137 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c288a18e-6340-422f-a53b-270f13a05ac0 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:42:38.991914 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c288a18e-6340-422f-a53b-270f13a05ac0 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:42:38.992354 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c288a18e-6340-422f-a53b-270f13a05ac0 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:42:39.135361 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c288a18e-6340-422f-a53b-270f13a05ac0 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:42:39.143810 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c288a18e-6340-422f-a53b-270f13a05ac0 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29" status: 200 len: 1692 microversion: 2.1 time: 0.169416 Jul 18 03:42:39.144381 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3704/7417] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:42:38 2022] GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29 => generated 1692 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:42:40.163104 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4696b186-0fd3-4854-9f80-c7ce454db14e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:42:40.163805 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4696b186-0fd3-4854-9f80-c7ce454db14e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: bc945fb5-82b2-446d-bd45-1203ee2e3a29] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:42:40.170300 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4696b186-0fd3-4854-9f80-c7ce454db14e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:42:40.170769 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4696b186-0fd3-4854-9f80-c7ce454db14e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:42:40.172204 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4696b186-0fd3-4854-9f80-c7ce454db14e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:42:40.172739 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4696b186-0fd3-4854-9f80-c7ce454db14e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:42:40.307124 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4696b186-0fd3-4854-9f80-c7ce454db14e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:42:40.315395 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4696b186-0fd3-4854-9f80-c7ce454db14e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29" status: 200 len: 1692 microversion: 2.1 time: 0.157938 Jul 18 03:42:40.315970 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3714/7418] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:42:40 2022] GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:42:41.333103 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e5b23964-cccd-4035-bd24-b91b2535b9f7 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:42:41.333731 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e5b23964-cccd-4035-bd24-b91b2535b9f7 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: bc945fb5-82b2-446d-bd45-1203ee2e3a29] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:42:41.340839 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e5b23964-cccd-4035-bd24-b91b2535b9f7 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:42:41.341293 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e5b23964-cccd-4035-bd24-b91b2535b9f7 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:42:41.342096 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e5b23964-cccd-4035-bd24-b91b2535b9f7 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:42:41.342535 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e5b23964-cccd-4035-bd24-b91b2535b9f7 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:42:41.481919 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e5b23964-cccd-4035-bd24-b91b2535b9f7 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:42:41.489941 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e5b23964-cccd-4035-bd24-b91b2535b9f7 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29" status: 200 len: 1675 microversion: 2.1 time: 0.160781 Jul 18 03:42:41.490515 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3705/7419] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:42:41 2022] GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29 => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:42:42.582421 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-32a2e219-bbc2-498a-94f6-892b142922c2 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:42:42.583369 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-32a2e219-bbc2-498a-94f6-892b142922c2 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: bc945fb5-82b2-446d-bd45-1203ee2e3a29] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:42:42.590405 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-32a2e219-bbc2-498a-94f6-892b142922c2 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:42:42.590881 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-32a2e219-bbc2-498a-94f6-892b142922c2 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:42:42.591705 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-32a2e219-bbc2-498a-94f6-892b142922c2 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:42:42.592361 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-32a2e219-bbc2-498a-94f6-892b142922c2 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:42:42.652982 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-32a2e219-bbc2-498a-94f6-892b142922c2 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "POST /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29/action" status: 200 len: 36330 microversion: 2.1 time: 0.074317 Jul 18 03:42:42.653645 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3715/7420] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:42:42 2022] POST /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29/action => generated 36330 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 03:42:42.665368 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6a553fe4-6a10-432a-a8b6-71702c2c34ed tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:42:42.666013 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6a553fe4-6a10-432a-a8b6-71702c2c34ed tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: bc945fb5-82b2-446d-bd45-1203ee2e3a29] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:42:42.673628 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6a553fe4-6a10-432a-a8b6-71702c2c34ed tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:42:42.674105 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6a553fe4-6a10-432a-a8b6-71702c2c34ed tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:42:42.674872 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6a553fe4-6a10-432a-a8b6-71702c2c34ed tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:42:42.675312 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6a553fe4-6a10-432a-a8b6-71702c2c34ed tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:42:42.743347 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6a553fe4-6a10-432a-a8b6-71702c2c34ed tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "POST /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29/action" status: 202 len: 0 microversion: 2.1 time: 0.081629 Jul 18 03:42:42.743905 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3706/7421] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:42:42 2022] POST /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:42:42.753315 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d4c05fac-993e-4450-ad42-c99b2322fb0c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:42:42.754050 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d4c05fac-993e-4450-ad42-c99b2322fb0c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: bc945fb5-82b2-446d-bd45-1203ee2e3a29] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:42:42.762444 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d4c05fac-993e-4450-ad42-c99b2322fb0c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:42:42.763171 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d4c05fac-993e-4450-ad42-c99b2322fb0c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:42:42.764020 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d4c05fac-993e-4450-ad42-c99b2322fb0c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:42:42.764482 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d4c05fac-993e-4450-ad42-c99b2322fb0c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:42:42.961237 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d4c05fac-993e-4450-ad42-c99b2322fb0c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:42:42.969211 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d4c05fac-993e-4450-ad42-c99b2322fb0c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29" status: 200 len: 1681 microversion: 2.1 time: 0.220724 Jul 18 03:42:42.970167 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3716/7422] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:42:42 2022] GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29 => generated 1681 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:42:43.988721 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-165cd516-1a6d-4e49-b3b6-0ca2b32329fa tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:42:43.989422 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-165cd516-1a6d-4e49-b3b6-0ca2b32329fa tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: bc945fb5-82b2-446d-bd45-1203ee2e3a29] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:42:43.995789 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-165cd516-1a6d-4e49-b3b6-0ca2b32329fa tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:42:43.996241 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-165cd516-1a6d-4e49-b3b6-0ca2b32329fa tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:42:43.997006 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-165cd516-1a6d-4e49-b3b6-0ca2b32329fa tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:42:43.997441 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-165cd516-1a6d-4e49-b3b6-0ca2b32329fa tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:42:44.139097 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-165cd516-1a6d-4e49-b3b6-0ca2b32329fa tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:42:44.147286 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-165cd516-1a6d-4e49-b3b6-0ca2b32329fa tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29" status: 200 len: 1681 microversion: 2.1 time: 0.163945 Jul 18 03:42:44.147892 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3707/7423] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:42:43 2022] GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:42:45.165050 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f82b326e-6156-4149-8f15-679b00c2f323 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:42:45.165678 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f82b326e-6156-4149-8f15-679b00c2f323 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: bc945fb5-82b2-446d-bd45-1203ee2e3a29] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:42:45.173550 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f82b326e-6156-4149-8f15-679b00c2f323 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:42:45.174073 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f82b326e-6156-4149-8f15-679b00c2f323 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:42:45.174880 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f82b326e-6156-4149-8f15-679b00c2f323 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:42:45.175366 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f82b326e-6156-4149-8f15-679b00c2f323 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:42:45.311199 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f82b326e-6156-4149-8f15-679b00c2f323 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:42:45.318880 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f82b326e-6156-4149-8f15-679b00c2f323 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29" status: 200 len: 1684 microversion: 2.1 time: 0.157786 Jul 18 03:42:45.319459 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3717/7424] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:42:45 2022] GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:42:45.412648 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-aa288726-dd93-49b0-a259-11e1e3c69a02 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:42:45.413578 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-aa288726-dd93-49b0-a259-11e1e3c69a02 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: bc945fb5-82b2-446d-bd45-1203ee2e3a29] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:42:45.420928 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aa288726-dd93-49b0-a259-11e1e3c69a02 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:42:45.421436 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aa288726-dd93-49b0-a259-11e1e3c69a02 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:42:45.422233 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aa288726-dd93-49b0-a259-11e1e3c69a02 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:42:45.422674 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aa288726-dd93-49b0-a259-11e1e3c69a02 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:42:45.477436 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-aa288726-dd93-49b0-a259-11e1e3c69a02 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "POST /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29/action" status: 200 len: 36330 microversion: 2.1 time: 0.068581 Jul 18 03:42:45.478125 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3708/7425] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:42:45 2022] POST /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29/action => generated 36330 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 03:42:46.527104 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0e95aa1f-3587-411d-803e-f5bc99ddef1e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:42:46.527659 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0e95aa1f-3587-411d-803e-f5bc99ddef1e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: bc945fb5-82b2-446d-bd45-1203ee2e3a29] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:42:46.530756 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-31eb4038-d3e4-40cb-8913-1fce1759d9d0 req-9cacf8bf-3920-4dcf-9d94-63836667b6d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc945fb5-82b2-446d-bd45-1203ee2e3a29", "tag": "c6ae3cc9-fc23-4582-85c0-2cffffc618ae"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:42:46.535019 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0e95aa1f-3587-411d-803e-f5bc99ddef1e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:42:46.535482 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0e95aa1f-3587-411d-803e-f5bc99ddef1e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:42:46.536263 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0e95aa1f-3587-411d-803e-f5bc99ddef1e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:42:46.536712 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0e95aa1f-3587-411d-803e-f5bc99ddef1e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:42:46.541592 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-31eb4038-d3e4-40cb-8913-1fce1759d9d0 req-9cacf8bf-3920-4dcf-9d94-63836667b6d5 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:42:46.542151 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-31eb4038-d3e4-40cb-8913-1fce1759d9d0 req-9cacf8bf-3920-4dcf-9d94-63836667b6d5 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:42:46.559891 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-31eb4038-d3e4-40cb-8913-1fce1759d9d0 req-9cacf8bf-3920-4dcf-9d94-63836667b6d5 service nova] Creating event network-changed:c6ae3cc9-fc23-4582-85c0-2cffffc618ae for instance bc945fb5-82b2-446d-bd45-1203ee2e3a29 on n-h1-465891-3 Jul 18 03:42:46.566092 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-31eb4038-d3e4-40cb-8913-1fce1759d9d0 req-9cacf8bf-3920-4dcf-9d94-63836667b6d5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040133 Jul 18 03:42:46.566718 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3709/7426] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:42:46.569364 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0e95aa1f-3587-411d-803e-f5bc99ddef1e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: bc945fb5-82b2-446d-bd45-1203ee2e3a29] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:42:46.658115 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0e95aa1f-3587-411d-803e-f5bc99ddef1e tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "DELETE /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29" status: 204 len: 0 microversion: 2.1 time: 0.134646 Jul 18 03:42:46.662776 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3718/7427] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:42:46 2022] DELETE /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:42:46.672031 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4f5f4030-248d-4cab-a220-bedfcc9a717c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:42:46.672829 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4f5f4030-248d-4cab-a220-bedfcc9a717c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: bc945fb5-82b2-446d-bd45-1203ee2e3a29] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:42:46.679273 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4f5f4030-248d-4cab-a220-bedfcc9a717c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:42:46.679812 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4f5f4030-248d-4cab-a220-bedfcc9a717c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:42:46.680643 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4f5f4030-248d-4cab-a220-bedfcc9a717c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:42:46.681148 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4f5f4030-248d-4cab-a220-bedfcc9a717c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:42:46.821736 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4f5f4030-248d-4cab-a220-bedfcc9a717c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:42:46.829804 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4f5f4030-248d-4cab-a220-bedfcc9a717c tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29" status: 200 len: 1690 microversion: 2.1 time: 0.162467 Jul 18 03:42:46.830385 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3710/7428] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:42:46 2022] GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29 => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:42:47.848716 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6e27bd9b-e709-4cc6-ad28-fec7ee846bcc tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:42:47.849434 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6e27bd9b-e709-4cc6-ad28-fec7ee846bcc tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: bc945fb5-82b2-446d-bd45-1203ee2e3a29] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:42:47.856306 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e27bd9b-e709-4cc6-ad28-fec7ee846bcc tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:42:47.856767 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e27bd9b-e709-4cc6-ad28-fec7ee846bcc tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:42:47.857549 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e27bd9b-e709-4cc6-ad28-fec7ee846bcc tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:42:47.858694 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e27bd9b-e709-4cc6-ad28-fec7ee846bcc tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:42:48.050121 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6e27bd9b-e709-4cc6-ad28-fec7ee846bcc tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:42:48.057832 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6e27bd9b-e709-4cc6-ad28-fec7ee846bcc tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29" status: 200 len: 1690 microversion: 2.1 time: 0.213327 Jul 18 03:42:48.058970 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3719/7429] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:42:47 2022] GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29 => generated 1690 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:42:49.076065 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-32323cac-eb58-4b14-8c92-de2f3d51f920 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:42:49.077362 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-32323cac-eb58-4b14-8c92-de2f3d51f920 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: bc945fb5-82b2-446d-bd45-1203ee2e3a29] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:42:49.084583 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-32323cac-eb58-4b14-8c92-de2f3d51f920 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:42:49.085038 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-32323cac-eb58-4b14-8c92-de2f3d51f920 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:42:49.085841 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-32323cac-eb58-4b14-8c92-de2f3d51f920 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:42:49.086283 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-32323cac-eb58-4b14-8c92-de2f3d51f920 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:42:49.152504 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-32323cac-eb58-4b14-8c92-de2f3d51f920 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921716a730f64ccdbbced6d4bbf715b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c17c023e1420c8d90b96e2af98172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:42:49.162713 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-32323cac-eb58-4b14-8c92-de2f3d51f920 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29" status: 200 len: 1504 microversion: 2.1 time: 0.090170 Jul 18 03:42:49.163185 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3711/7430] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:42:49 2022] GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29 => generated 1504 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:42:49.226342 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-08b0dbd0-9d44-41de-9523-4861ef412183 req-71c3de5e-52b9-4073-b8da-1c626cd1bdc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc945fb5-82b2-446d-bd45-1203ee2e3a29", "name": "network-vif-deleted", "tag": "c6ae3cc9-fc23-4582-85c0-2cffffc618ae"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:42:49.237262 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-08b0dbd0-9d44-41de-9523-4861ef412183 req-71c3de5e-52b9-4073-b8da-1c626cd1bdc2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:42:49.237746 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-08b0dbd0-9d44-41de-9523-4861ef412183 req-71c3de5e-52b9-4073-b8da-1c626cd1bdc2 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:42:49.253304 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-08b0dbd0-9d44-41de-9523-4861ef412183 req-71c3de5e-52b9-4073-b8da-1c626cd1bdc2 service nova] Creating event network-vif-deleted:c6ae3cc9-fc23-4582-85c0-2cffffc618ae for instance bc945fb5-82b2-446d-bd45-1203ee2e3a29 on n-h1-465891-3 Jul 18 03:42:49.262872 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-08b0dbd0-9d44-41de-9523-4861ef412183 req-71c3de5e-52b9-4073-b8da-1c626cd1bdc2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039817 Jul 18 03:42:49.263545 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3720/7431] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:42:50.179751 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-65be79ec-effa-4076-a95c-5af8f7723b6d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:42:50.180365 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-65be79ec-effa-4076-a95c-5af8f7723b6d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] [instance: bc945fb5-82b2-446d-bd45-1203ee2e3a29] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:42:50.188095 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65be79ec-effa-4076-a95c-5af8f7723b6d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:42:50.188547 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65be79ec-effa-4076-a95c-5af8f7723b6d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:42:50.189320 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65be79ec-effa-4076-a95c-5af8f7723b6d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:42:50.189818 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-65be79ec-effa-4076-a95c-5af8f7723b6d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:42:50.204274 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-65be79ec-effa-4076-a95c-5af8f7723b6d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] HTTP exception thrown: Instance bc945fb5-82b2-446d-bd45-1203ee2e3a29 could not be found. Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-65be79ec-effa-4076-a95c-5af8f7723b6d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Request method failure captured: Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29 HTTP/1.1 Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1NQn25Nv2CWVcqUB7Jli7-n6pu90utlDXaCYfmF3mQfgKsu7CU9h4Qgbxu3IIS2bQPi7DmlwnQeENXcFmebHsSlw-o4GKxkvJck1gJGsOn4xtry1F0sEpYLtQaLLoR_0JXssRBl37TNYHSvAfTOqzePvi79-HEbaRAqO169pHpwd49Q Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 2d9c17c023e1420c8d90b96e2af98172 Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1294373808 Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2d9c17c023e1420c8d90b96e2af98172"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2d9c17c023e1420c8d90b96e2af98172"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2d9c17c023e1420c8d90b96e2af98172"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2d9c17c023e1420c8d90b96e2af98172"}]}] Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1294373808 Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 2d9c17c023e1420c8d90b96e2af98172 Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1294373808 Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-TestNetworkAdvancedServerOps-1294373808-project Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: 921716a730f64ccdbbced6d4bbf715b0 Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1294373808-project Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance bc945fb5-82b2-446d-bd45-1203ee2e3a29 could not be found. Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'bc945fb5-82b2-446d-bd45-1203ee2e3a29'} Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc945fb5-82b2-446d-bd45-1203ee2e3a29 could not be found. Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc945fb5-82b2-446d-bd45-1203ee2e3a29 could not be found. Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:42:50.205978 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:42:50.210528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:42:50.210528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:42:50.210528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:42:50.210528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:42:50.210528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:42:50.210528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:42:50.210528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc945fb5-82b2-446d-bd45-1203ee2e3a29 could not be found. Jul 18 03:42:50.210528 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:42:50.210528 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-65be79ec-effa-4076-a95c-5af8f7723b6d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Returning 404 to user: Instance bc945fb5-82b2-446d-bd45-1203ee2e3a29 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:42:50.210528 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-65be79ec-effa-4076-a95c-5af8f7723b6d tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29" status: 404 len: 111 microversion: 2.1 time: 0.031568 Jul 18 03:42:50.210528 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3712/7432] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:42:50 2022] GET /compute/v2.1/servers/bc945fb5-82b2-446d-bd45-1203ee2e3a29 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:42:53.260759 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-83b1a246-8d58-4573-88a1-ef6e43f5e820 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] Calling method '.version_select at 0x7ff49b966790>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:42:53.286904 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-83b1a246-8d58-4573-88a1-ef6e43f5e820 tempest-TestNetworkAdvancedServerOps-1294373808 tempest-TestNetworkAdvancedServerOps-1294373808-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1861712159" status: 202 len: 0 microversion: 2.1 time: 0.030090 Jul 18 03:42:53.287528 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3721/7433] 10.222.0.57 () {58 vars in 1283 bytes} [Mon Jul 18 03:42:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1861712159 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 03:43:05.212466 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=18 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:43:05.213208 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:43:05.391872 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b3210aa7-b0b6-4dd1-9b4c-593bfdb1e41a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Action: 'create', calling method: .version_select at 0x7ff49b524f70>, body: {"keypair": {"name": "tempest-TestShelveInstance-331961619", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJfcEQjdTJb9BCF7aqn9uc8gqFNhgWZQDoIlkfUsoHUpSUAyJOa7Vgd3IGQjn7Mkp6m5FT5B8EqQ2KL9ofGEqzVZsqbiTRQlFxC0WA98OJ2r+Rf7xhaQ8zorAd+o2xhSQ=="}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:43:05.405948 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-b3210aa7-b0b6-4dd1-9b4c-593bfdb1e41a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Getting quotas for project 2f05e19f28ee40c58936bcc9fc8baedd. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:43:05.411102 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-b3210aa7-b0b6-4dd1-9b4c-593bfdb1e41a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Getting quotas for user ac8fcf3285d647cb9fb9f126531750d7 and project 2f05e19f28ee40c58936bcc9fc8baedd. Resources: {'key_pairs'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:43:05.436902 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b3210aa7-b0b6-4dd1-9b4c-593bfdb1e41a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.229677 Jul 18 03:43:05.437509 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3713/7434] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 03:43:05 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:43:06.453044 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-02d0dd8c-f04f-4944-9aec-df98c1a4ab9b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-991886379", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-331961619", "security_groups": [{"name": "tempest-secgroup-smoke-1051974556"}], "networks": [{"uuid": "5ef69a67-1386-4c11-bd7b-9722a65ad786"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:43:06.462297 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:43:06.463799 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:43:06.572589 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-02d0dd8c-f04f-4944-9aec-df98c1a4ab9b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] validate_networks() for [('5ef69a67-1386-4c11-bd7b-9722a65ad786', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:43:07.056535 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-02d0dd8c-f04f-4944-9aec-df98c1a4ab9b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:43:07.056970 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-02d0dd8c-f04f-4944-9aec-df98c1a4ab9b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:43:07.057525 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-02d0dd8c-f04f-4944-9aec-df98c1a4ab9b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:43:07.057972 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-02d0dd8c-f04f-4944-9aec-df98c1a4ab9b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:43:07.058553 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-02d0dd8c-f04f-4944-9aec-df98c1a4ab9b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:43:07.068595 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-02d0dd8c-f04f-4944-9aec-df98c1a4ab9b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:07.069054 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-02d0dd8c-f04f-4944-9aec-df98c1a4ab9b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:07.070042 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-02d0dd8c-f04f-4944-9aec-df98c1a4ab9b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:07.071183 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-02d0dd8c-f04f-4944-9aec-df98c1a4ab9b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:07.088401 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-02d0dd8c-f04f-4944-9aec-df98c1a4ab9b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Getting quotas for project 2f05e19f28ee40c58936bcc9fc8baedd. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:43:07.095202 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-02d0dd8c-f04f-4944-9aec-df98c1a4ab9b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Getting quotas for user ac8fcf3285d647cb9fb9f126531750d7 and project 2f05e19f28ee40c58936bcc9fc8baedd. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:43:07.109286 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-02d0dd8c-f04f-4944-9aec-df98c1a4ab9b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:43:07.111764 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-02d0dd8c-f04f-4944-9aec-df98c1a4ab9b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:43:07.165764 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-02d0dd8c-f04f-4944-9aec-df98c1a4ab9b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.717692 Jul 18 03:43:07.168705 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3722/7435] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:43:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:43:07.178483 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-352faf2e-6d0d-4ef8-81b1-6b745b95b0d8 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:43:07.179691 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-352faf2e-6d0d-4ef8-81b1-6b745b95b0d8 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:43:07.243295 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-352faf2e-6d0d-4ef8-81b1-6b745b95b0d8 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:43:07.251771 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-352faf2e-6d0d-4ef8-81b1-6b745b95b0d8 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1245 microversion: 2.1 time: 0.077251 Jul 18 03:43:07.252641 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3714/7436] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:43:07 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1245 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:43:08.269819 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c328585c-5a62-43eb-8b3c-6a986b4d8f27 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:43:08.270380 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c328585c-5a62-43eb-8b3c-6a986b4d8f27 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:43:08.279007 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c328585c-5a62-43eb-8b3c-6a986b4d8f27 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:08.279728 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c328585c-5a62-43eb-8b3c-6a986b4d8f27 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:08.280732 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c328585c-5a62-43eb-8b3c-6a986b4d8f27 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:08.281186 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c328585c-5a62-43eb-8b3c-6a986b4d8f27 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:08.351721 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c328585c-5a62-43eb-8b3c-6a986b4d8f27 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:43:08.364851 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c328585c-5a62-43eb-8b3c-6a986b4d8f27 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1305 microversion: 2.1 time: 0.097754 Jul 18 03:43:08.366085 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3723/7437] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:43:08 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1305 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:43:09.382253 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-938d9890-a3d2-4a53-8cda-5ff29fc07257 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:43:09.382998 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-938d9890-a3d2-4a53-8cda-5ff29fc07257 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:43:09.392234 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-938d9890-a3d2-4a53-8cda-5ff29fc07257 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:09.392849 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-938d9890-a3d2-4a53-8cda-5ff29fc07257 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:09.393858 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-938d9890-a3d2-4a53-8cda-5ff29fc07257 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:09.394371 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-938d9890-a3d2-4a53-8cda-5ff29fc07257 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:09.554461 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-938d9890-a3d2-4a53-8cda-5ff29fc07257 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:43:09.569193 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-938d9890-a3d2-4a53-8cda-5ff29fc07257 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1371 microversion: 2.1 time: 0.190783 Jul 18 03:43:09.571360 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3715/7438] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:43:09 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1371 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:43:09.841236 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-238852bd-dfa8-4a9f-9e74-690bcb6b7ff2 req-2f430991-2b73-4fdc-99e5-eac3c564668d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84344bf4-bd58-4ce1-94a7-5fde01815ef6", "tag": "b10bc7a9-be68-426f-b4ce-a77032e7e136"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:43:09.865787 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-238852bd-dfa8-4a9f-9e74-690bcb6b7ff2 req-2f430991-2b73-4fdc-99e5-eac3c564668d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:09.865978 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-238852bd-dfa8-4a9f-9e74-690bcb6b7ff2 req-2f430991-2b73-4fdc-99e5-eac3c564668d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:09.885531 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-238852bd-dfa8-4a9f-9e74-690bcb6b7ff2 req-2f430991-2b73-4fdc-99e5-eac3c564668d service nova] Creating event network-changed:b10bc7a9-be68-426f-b4ce-a77032e7e136 for instance 84344bf4-bd58-4ce1-94a7-5fde01815ef6 on n-h1-465891-3 Jul 18 03:43:09.891818 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-238852bd-dfa8-4a9f-9e74-690bcb6b7ff2 req-2f430991-2b73-4fdc-99e5-eac3c564668d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054958 Jul 18 03:43:09.892667 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3724/7439] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:43:10.586763 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-90277ab7-9375-42b9-bd3b-786c4f682ec1 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:43:10.588347 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-90277ab7-9375-42b9-bd3b-786c4f682ec1 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:43:10.596967 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-90277ab7-9375-42b9-bd3b-786c4f682ec1 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:10.597683 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-90277ab7-9375-42b9-bd3b-786c4f682ec1 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:10.599211 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-90277ab7-9375-42b9-bd3b-786c4f682ec1 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:10.599907 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-90277ab7-9375-42b9-bd3b-786c4f682ec1 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:10.738267 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-90277ab7-9375-42b9-bd3b-786c4f682ec1 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:43:10.745745 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-90277ab7-9375-42b9-bd3b-786c4f682ec1 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1371 microversion: 2.1 time: 0.162940 Jul 18 03:43:10.746327 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3716/7440] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:43:10 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:43:11.765292 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-19feeee9-4c7c-4350-ad5b-7646dc284da4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:43:11.765947 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-19feeee9-4c7c-4350-ad5b-7646dc284da4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:43:11.772217 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-19feeee9-4c7c-4350-ad5b-7646dc284da4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:11.772671 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-19feeee9-4c7c-4350-ad5b-7646dc284da4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:11.773445 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-19feeee9-4c7c-4350-ad5b-7646dc284da4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:11.773921 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-19feeee9-4c7c-4350-ad5b-7646dc284da4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:11.916066 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-19feeee9-4c7c-4350-ad5b-7646dc284da4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:43:11.924332 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-19feeee9-4c7c-4350-ad5b-7646dc284da4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1371 microversion: 2.1 time: 0.164997 Jul 18 03:43:11.924910 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3725/7441] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:43:11 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:43:12.940695 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5525177d-5e44-4ae0-91f2-1cd02067d507 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:43:12.941287 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5525177d-5e44-4ae0-91f2-1cd02067d507 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:43:12.948258 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5525177d-5e44-4ae0-91f2-1cd02067d507 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:12.948703 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5525177d-5e44-4ae0-91f2-1cd02067d507 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:12.949466 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5525177d-5e44-4ae0-91f2-1cd02067d507 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:12.950633 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5525177d-5e44-4ae0-91f2-1cd02067d507 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:13.094001 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5525177d-5e44-4ae0-91f2-1cd02067d507 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:43:13.102443 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5525177d-5e44-4ae0-91f2-1cd02067d507 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1371 microversion: 2.1 time: 0.165667 Jul 18 03:43:13.112305 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3717/7442] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:43:12 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:43:14.123691 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c693871a-6a50-47db-a8b9-99ddd4bb5bb7 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:43:14.124823 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c693871a-6a50-47db-a8b9-99ddd4bb5bb7 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:43:14.134113 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c693871a-6a50-47db-a8b9-99ddd4bb5bb7 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:14.134572 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c693871a-6a50-47db-a8b9-99ddd4bb5bb7 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:14.135358 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c693871a-6a50-47db-a8b9-99ddd4bb5bb7 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:14.135988 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c693871a-6a50-47db-a8b9-99ddd4bb5bb7 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:14.279081 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c693871a-6a50-47db-a8b9-99ddd4bb5bb7 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:43:14.289270 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c693871a-6a50-47db-a8b9-99ddd4bb5bb7 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1371 microversion: 2.1 time: 0.172642 Jul 18 03:43:14.289936 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3726/7443] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:43:14 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:43:15.311255 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8cb82bd6-d956-412f-8db2-1b38b6bac71e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:43:15.311812 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8cb82bd6-d956-412f-8db2-1b38b6bac71e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:43:15.319189 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8cb82bd6-d956-412f-8db2-1b38b6bac71e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:15.319641 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8cb82bd6-d956-412f-8db2-1b38b6bac71e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:15.320421 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8cb82bd6-d956-412f-8db2-1b38b6bac71e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:15.320859 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8cb82bd6-d956-412f-8db2-1b38b6bac71e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:15.500115 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8cb82bd6-d956-412f-8db2-1b38b6bac71e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:43:15.509439 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8cb82bd6-d956-412f-8db2-1b38b6bac71e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1371 microversion: 2.1 time: 0.203190 Jul 18 03:43:15.510066 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3718/7444] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:43:15 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1371 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:43:16.287375 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-dacfb09a-8dc8-474f-bd03-1f34c4b94b88 req-7ec92cc4-3ffa-458d-a0ae-8a95249ec3ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84344bf4-bd58-4ce1-94a7-5fde01815ef6", "name": "network-vif-plugged", "status": "completed", "tag": "b10bc7a9-be68-426f-b4ce-a77032e7e136"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:43:16.297307 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-dacfb09a-8dc8-474f-bd03-1f34c4b94b88 req-7ec92cc4-3ffa-458d-a0ae-8a95249ec3ff service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:16.297913 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-dacfb09a-8dc8-474f-bd03-1f34c4b94b88 req-7ec92cc4-3ffa-458d-a0ae-8a95249ec3ff service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:16.310839 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-dacfb09a-8dc8-474f-bd03-1f34c4b94b88 req-7ec92cc4-3ffa-458d-a0ae-8a95249ec3ff service nova] Creating event network-vif-plugged:b10bc7a9-be68-426f-b4ce-a77032e7e136 for instance 84344bf4-bd58-4ce1-94a7-5fde01815ef6 on n-h1-465891-3 Jul 18 03:43:16.315913 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-dacfb09a-8dc8-474f-bd03-1f34c4b94b88 req-7ec92cc4-3ffa-458d-a0ae-8a95249ec3ff service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032322 Jul 18 03:43:16.316687 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3727/7445] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:43:16.534871 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8ccee9af-39ea-4ef9-95c3-227cb76fcbff tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:43:16.535751 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8ccee9af-39ea-4ef9-95c3-227cb76fcbff tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:43:16.545372 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8ccee9af-39ea-4ef9-95c3-227cb76fcbff tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:16.545993 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8ccee9af-39ea-4ef9-95c3-227cb76fcbff tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:16.546864 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8ccee9af-39ea-4ef9-95c3-227cb76fcbff tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:16.547392 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8ccee9af-39ea-4ef9-95c3-227cb76fcbff tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:16.693992 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8ccee9af-39ea-4ef9-95c3-227cb76fcbff tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:43:16.702164 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8ccee9af-39ea-4ef9-95c3-227cb76fcbff tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1371 microversion: 2.1 time: 0.174032 Jul 18 03:43:16.702743 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3719/7446] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:43:16 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:43:17.717042 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:43:17.717912 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:43:17.723305 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6e8f0737-d835-4e3f-8720-a67774fccfa5 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:43:17.724020 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6e8f0737-d835-4e3f-8720-a67774fccfa5 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:43:17.731142 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e8f0737-d835-4e3f-8720-a67774fccfa5 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:17.731830 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e8f0737-d835-4e3f-8720-a67774fccfa5 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:17.732620 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e8f0737-d835-4e3f-8720-a67774fccfa5 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:17.733076 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6e8f0737-d835-4e3f-8720-a67774fccfa5 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:17.866988 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6e8f0737-d835-4e3f-8720-a67774fccfa5 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:43:17.875650 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6e8f0737-d835-4e3f-8720-a67774fccfa5 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1371 microversion: 2.1 time: 0.159538 Jul 18 03:43:17.879861 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3728/7447] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:43:17 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:43:18.893821 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ff2267d6-cf7f-4a58-a704-651dcd37a137 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:43:18.894444 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ff2267d6-cf7f-4a58-a704-651dcd37a137 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:43:18.896303 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:43:18.902774 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ff2267d6-cf7f-4a58-a704-651dcd37a137 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:18.903221 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ff2267d6-cf7f-4a58-a704-651dcd37a137 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:18.903979 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ff2267d6-cf7f-4a58-a704-651dcd37a137 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:18.905065 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ff2267d6-cf7f-4a58-a704-651dcd37a137 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:19.047642 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ff2267d6-cf7f-4a58-a704-651dcd37a137 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:43:19.055155 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ff2267d6-cf7f-4a58-a704-651dcd37a137 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1555 microversion: 2.1 time: 0.165436 Jul 18 03:43:19.055729 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3720/7448] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:43:18 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:43:19.071137 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b5974fc8-e46d-420a-89cf-86bd220835bb tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:43:19.071762 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b5974fc8-e46d-420a-89cf-86bd220835bb tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:43:19.079532 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b5974fc8-e46d-420a-89cf-86bd220835bb tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:19.079994 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b5974fc8-e46d-420a-89cf-86bd220835bb tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:19.080767 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b5974fc8-e46d-420a-89cf-86bd220835bb tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:19.081216 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b5974fc8-e46d-420a-89cf-86bd220835bb tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:19.215304 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b5974fc8-e46d-420a-89cf-86bd220835bb tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:43:19.223004 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b5974fc8-e46d-420a-89cf-86bd220835bb tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1555 microversion: 2.1 time: 0.155692 Jul 18 03:43:19.223774 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3729/7449] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:43:19 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:43:21.176596 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-880fbe61-d425-448c-bd4e-06c61b34ba58 req-59f62d14-bde4-4363-b54d-89dfbf624208 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84344bf4-bd58-4ce1-94a7-5fde01815ef6", "tag": "b10bc7a9-be68-426f-b4ce-a77032e7e136"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:43:21.185832 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-880fbe61-d425-448c-bd4e-06c61b34ba58 req-59f62d14-bde4-4363-b54d-89dfbf624208 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:21.186731 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-880fbe61-d425-448c-bd4e-06c61b34ba58 req-59f62d14-bde4-4363-b54d-89dfbf624208 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:21.198532 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-880fbe61-d425-448c-bd4e-06c61b34ba58 req-59f62d14-bde4-4363-b54d-89dfbf624208 service nova] Creating event network-changed:b10bc7a9-be68-426f-b4ce-a77032e7e136 for instance 84344bf4-bd58-4ce1-94a7-5fde01815ef6 on n-h1-465891-3 Jul 18 03:43:21.205023 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-880fbe61-d425-448c-bd4e-06c61b34ba58 req-59f62d14-bde4-4363-b54d-89dfbf624208 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031717 Jul 18 03:43:21.205633 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3721/7450] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:44:33.084533 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:44:33.085279 n-d-465891-3 devstack@n-api.service[119544]: Mon Jul 18 03:44:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:45:48.095440 n-d-465891-3 devstack@n-api.service[119543]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5744c86a-1c72-444c-9f09-2dc127b8032d] AMQP server on 10.222.0.57:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 18 03:45:48.096622 n-d-465891-3 devstack@n-api.service[119543]: ERROR oslo.messaging._drivers.impl_rabbit [-] [58d4ed9e-6c40-4e66-8cf1-b8f58c4998c2] AMQP server on 10.222.0.57:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 18 03:45:48.097181 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:45:48.097960 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=36 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:45:48.102392 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-164d08cb-2166-46a0-ac51-d767694f75f3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:45:48.102936 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-164d08cb-2166-46a0-ac51-d767694f75f3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:45:48.110678 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-164d08cb-2166-46a0-ac51-d767694f75f3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:48.111138 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-164d08cb-2166-46a0-ac51-d767694f75f3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:48.111913 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-164d08cb-2166-46a0-ac51-d767694f75f3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:48.112359 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-164d08cb-2166-46a0-ac51-d767694f75f3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:48.136579 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-164d08cb-2166-46a0-ac51-d767694f75f3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lazy-loading 'flavor' on Instance uuid 84344bf4-bd58-4ce1-94a7-5fde01815ef6 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:45:48.526293 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-164d08cb-2166-46a0-ac51-d767694f75f3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "POST /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6/action" status: 202 len: 0 microversion: 2.1 time: 0.432741 Jul 18 03:45:48.526932 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3730/7451] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:45:48 2022] POST /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6/action => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:45:48.533873 n-d-465891-3 devstack@n-api.service[119544]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2195f790-7bbc-4111-8106-e7ea837c20fc] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 03:45:48.534679 n-d-465891-3 devstack@n-api.service[119544]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bec20902-d336-4ab9-99dd-48825093cebe] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 03:45:48.535307 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:45:48.536047 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=38 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:45:48.544034 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ccb6a8fe-3948-46e5-b38c-760f4469481e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:45:48.544034 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ccb6a8fe-3948-46e5-b38c-760f4469481e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:45:48.551221 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ccb6a8fe-3948-46e5-b38c-760f4469481e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:48.551659 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ccb6a8fe-3948-46e5-b38c-760f4469481e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:48.552416 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ccb6a8fe-3948-46e5-b38c-760f4469481e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:48.552860 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ccb6a8fe-3948-46e5-b38c-760f4469481e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:48.742649 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ccb6a8fe-3948-46e5-b38c-760f4469481e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:45:48.755839 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ccb6a8fe-3948-46e5-b38c-760f4469481e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1680 microversion: 2.1 time: 0.218176 Jul 18 03:45:48.755839 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3722/7452] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:45:48 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1680 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:45:49.771179 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0cd95e8b-0dff-4996-a0a5-d60c9b570b00 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:45:49.771890 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0cd95e8b-0dff-4996-a0a5-d60c9b570b00 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:45:49.784157 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0cd95e8b-0dff-4996-a0a5-d60c9b570b00 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:49.784992 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0cd95e8b-0dff-4996-a0a5-d60c9b570b00 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:49.787447 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0cd95e8b-0dff-4996-a0a5-d60c9b570b00 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:49.788207 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0cd95e8b-0dff-4996-a0a5-d60c9b570b00 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:49.796887 n-d-465891-3 devstack@n-api.service[119543]: INFO oslo.messaging._drivers.impl_rabbit [-] [58d4ed9e-6c40-4e66-8cf1-b8f58c4998c2] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 54068. Jul 18 03:45:49.798423 n-d-465891-3 devstack@n-api.service[119543]: INFO oslo.messaging._drivers.impl_rabbit [-] [5744c86a-1c72-444c-9f09-2dc127b8032d] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 54066. Jul 18 03:45:49.939881 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0cd95e8b-0dff-4996-a0a5-d60c9b570b00 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:45:49.948130 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0cd95e8b-0dff-4996-a0a5-d60c9b570b00 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1680 microversion: 2.1 time: 0.183863 Jul 18 03:45:49.948724 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3731/7453] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:45:49 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1680 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:45:50.966085 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d49d2847-c8fa-489d-86bc-cb1da2b1cfca tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:45:50.966701 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d49d2847-c8fa-489d-86bc-cb1da2b1cfca tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:45:50.982389 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [-] [bec20902-d336-4ab9-99dd-48825093cebe] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 54074. Jul 18 03:45:50.987174 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [-] [2195f790-7bbc-4111-8106-e7ea837c20fc] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 54072. Jul 18 03:45:50.989389 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d49d2847-c8fa-489d-86bc-cb1da2b1cfca tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:50.989872 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d49d2847-c8fa-489d-86bc-cb1da2b1cfca tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:50.990662 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d49d2847-c8fa-489d-86bc-cb1da2b1cfca tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:50.991082 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d49d2847-c8fa-489d-86bc-cb1da2b1cfca tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:51.124666 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d49d2847-c8fa-489d-86bc-cb1da2b1cfca tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:45:51.132545 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d49d2847-c8fa-489d-86bc-cb1da2b1cfca tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1680 microversion: 2.1 time: 0.170340 Jul 18 03:45:51.133032 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3723/7454] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:45:50 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:45:52.149562 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-498d2549-8597-4db3-a8ee-b0ec4ccee1a2 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:45:52.150265 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-498d2549-8597-4db3-a8ee-b0ec4ccee1a2 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:45:52.157691 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-498d2549-8597-4db3-a8ee-b0ec4ccee1a2 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:52.158172 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-498d2549-8597-4db3-a8ee-b0ec4ccee1a2 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:52.158949 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-498d2549-8597-4db3-a8ee-b0ec4ccee1a2 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:52.159397 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-498d2549-8597-4db3-a8ee-b0ec4ccee1a2 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:52.294727 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-498d2549-8597-4db3-a8ee-b0ec4ccee1a2 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:45:52.303061 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-498d2549-8597-4db3-a8ee-b0ec4ccee1a2 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1680 microversion: 2.1 time: 0.157433 Jul 18 03:45:52.303635 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3732/7455] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:45:52 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:45:53.320077 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6975d520-add7-42a5-a860-a2a4fd1a2e2e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:45:53.320680 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6975d520-add7-42a5-a860-a2a4fd1a2e2e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:45:53.327603 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6975d520-add7-42a5-a860-a2a4fd1a2e2e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:53.328188 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6975d520-add7-42a5-a860-a2a4fd1a2e2e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:53.328946 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6975d520-add7-42a5-a860-a2a4fd1a2e2e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:53.329374 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6975d520-add7-42a5-a860-a2a4fd1a2e2e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:53.467225 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6975d520-add7-42a5-a860-a2a4fd1a2e2e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:45:53.475477 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6975d520-add7-42a5-a860-a2a4fd1a2e2e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1680 microversion: 2.1 time: 0.159449 Jul 18 03:45:53.476058 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3724/7456] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:45:53 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:45:54.492583 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0e6fa12c-3012-41fc-9a38-4c8e42f74b70 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:45:54.493239 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0e6fa12c-3012-41fc-9a38-4c8e42f74b70 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:45:54.500479 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0e6fa12c-3012-41fc-9a38-4c8e42f74b70 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:54.500946 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0e6fa12c-3012-41fc-9a38-4c8e42f74b70 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:54.501753 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0e6fa12c-3012-41fc-9a38-4c8e42f74b70 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:54.502211 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0e6fa12c-3012-41fc-9a38-4c8e42f74b70 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:54.636669 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-0e6fa12c-3012-41fc-9a38-4c8e42f74b70 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:45:54.645764 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0e6fa12c-3012-41fc-9a38-4c8e42f74b70 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1680 microversion: 2.1 time: 0.157062 Jul 18 03:45:54.646356 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3733/7457] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:45:54 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:45:55.663110 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5eeeb90e-c08a-40c2-a2a2-c692749afeb4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:45:55.663711 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5eeeb90e-c08a-40c2-a2a2-c692749afeb4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:45:55.670640 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5eeeb90e-c08a-40c2-a2a2-c692749afeb4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:55.671083 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5eeeb90e-c08a-40c2-a2a2-c692749afeb4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:55.671962 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5eeeb90e-c08a-40c2-a2a2-c692749afeb4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:55.672387 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5eeeb90e-c08a-40c2-a2a2-c692749afeb4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:55.803415 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5eeeb90e-c08a-40c2-a2a2-c692749afeb4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:45:55.810960 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5eeeb90e-c08a-40c2-a2a2-c692749afeb4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1680 microversion: 2.1 time: 0.151801 Jul 18 03:45:55.811517 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3725/7458] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:45:55 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:45:56.828992 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3b41c317-e026-4c14-96fd-f0afb5e5893d tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:45:56.829621 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3b41c317-e026-4c14-96fd-f0afb5e5893d tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:45:56.836537 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3b41c317-e026-4c14-96fd-f0afb5e5893d tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:56.836994 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3b41c317-e026-4c14-96fd-f0afb5e5893d tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:56.837788 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3b41c317-e026-4c14-96fd-f0afb5e5893d tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:56.838238 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3b41c317-e026-4c14-96fd-f0afb5e5893d tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:56.974516 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3b41c317-e026-4c14-96fd-f0afb5e5893d tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:45:56.982380 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3b41c317-e026-4c14-96fd-f0afb5e5893d tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1680 microversion: 2.1 time: 0.157848 Jul 18 03:45:56.982958 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3734/7459] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:45:56 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:45:57.999640 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ac9960c2-52c6-47bb-8137-2524b5d4bd96 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:45:58.000256 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ac9960c2-52c6-47bb-8137-2524b5d4bd96 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:45:58.007405 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ac9960c2-52c6-47bb-8137-2524b5d4bd96 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:58.007848 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ac9960c2-52c6-47bb-8137-2524b5d4bd96 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:58.008602 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ac9960c2-52c6-47bb-8137-2524b5d4bd96 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:58.009031 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ac9960c2-52c6-47bb-8137-2524b5d4bd96 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:58.138682 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ac9960c2-52c6-47bb-8137-2524b5d4bd96 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:45:58.146466 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ac9960c2-52c6-47bb-8137-2524b5d4bd96 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1680 microversion: 2.1 time: 0.150767 Jul 18 03:45:58.147041 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3726/7460] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:45:57 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:45:59.164237 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ef915a42-78c2-4527-80ae-fde4de27b380 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:45:59.164866 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ef915a42-78c2-4527-80ae-fde4de27b380 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:45:59.173087 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ef915a42-78c2-4527-80ae-fde4de27b380 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:59.173542 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ef915a42-78c2-4527-80ae-fde4de27b380 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:59.174350 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ef915a42-78c2-4527-80ae-fde4de27b380 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:59.174794 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ef915a42-78c2-4527-80ae-fde4de27b380 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:59.311600 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ef915a42-78c2-4527-80ae-fde4de27b380 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:45:59.319987 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ef915a42-78c2-4527-80ae-fde4de27b380 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1680 microversion: 2.1 time: 0.159722 Jul 18 03:45:59.320569 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3735/7461] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:45:59 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:46:00.337536 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7cb42b2b-715c-4738-bed4-a546f2b0a449 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:00.338199 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7cb42b2b-715c-4738-bed4-a546f2b0a449 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:00.346035 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7cb42b2b-715c-4738-bed4-a546f2b0a449 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:00.346483 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7cb42b2b-715c-4738-bed4-a546f2b0a449 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:00.347259 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7cb42b2b-715c-4738-bed4-a546f2b0a449 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:00.347680 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7cb42b2b-715c-4738-bed4-a546f2b0a449 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:00.485362 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7cb42b2b-715c-4738-bed4-a546f2b0a449 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:46:00.492918 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7cb42b2b-715c-4738-bed4-a546f2b0a449 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1701 microversion: 2.1 time: 0.159430 Jul 18 03:46:00.493493 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3727/7462] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:46:00 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1701 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:46:01.511390 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-412b0edc-7c02-4266-98d8-5a9a50d881aa tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:01.511968 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-412b0edc-7c02-4266-98d8-5a9a50d881aa tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:01.520417 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-412b0edc-7c02-4266-98d8-5a9a50d881aa tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:01.520885 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-412b0edc-7c02-4266-98d8-5a9a50d881aa tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:01.521689 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-412b0edc-7c02-4266-98d8-5a9a50d881aa tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:01.522365 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-412b0edc-7c02-4266-98d8-5a9a50d881aa tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:01.660700 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-412b0edc-7c02-4266-98d8-5a9a50d881aa tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:46:01.668328 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-412b0edc-7c02-4266-98d8-5a9a50d881aa tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1701 microversion: 2.1 time: 0.161027 Jul 18 03:46:01.668898 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3736/7463] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:46:01 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1701 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:46:02.685239 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1d694667-b1c4-442a-bcce-6d346acc37a8 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:02.685880 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1d694667-b1c4-442a-bcce-6d346acc37a8 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:02.692831 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1d694667-b1c4-442a-bcce-6d346acc37a8 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:02.693286 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1d694667-b1c4-442a-bcce-6d346acc37a8 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:02.694078 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1d694667-b1c4-442a-bcce-6d346acc37a8 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:02.694516 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1d694667-b1c4-442a-bcce-6d346acc37a8 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:02.829424 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1d694667-b1c4-442a-bcce-6d346acc37a8 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:46:02.837638 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1d694667-b1c4-442a-bcce-6d346acc37a8 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1701 microversion: 2.1 time: 0.156276 Jul 18 03:46:02.838251 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3728/7464] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:46:02 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1701 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:46:03.149908 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-66991709-9f54-42e0-8fbe-00adeb474ef8 req-fcf093fa-7c13-44c2-8287-366decd3983d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84344bf4-bd58-4ce1-94a7-5fde01815ef6", "name": "network-vif-plugged", "status": "completed", "tag": "b10bc7a9-be68-426f-b4ce-a77032e7e136"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:46:03.159405 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-66991709-9f54-42e0-8fbe-00adeb474ef8 req-fcf093fa-7c13-44c2-8287-366decd3983d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:03.159810 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-66991709-9f54-42e0-8fbe-00adeb474ef8 req-fcf093fa-7c13-44c2-8287-366decd3983d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:03.172078 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-66991709-9f54-42e0-8fbe-00adeb474ef8 req-fcf093fa-7c13-44c2-8287-366decd3983d service nova] Creating event network-vif-plugged:b10bc7a9-be68-426f-b4ce-a77032e7e136 for instance 84344bf4-bd58-4ce1-94a7-5fde01815ef6 on n-h1-465891-3 Jul 18 03:46:03.177543 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-66991709-9f54-42e0-8fbe-00adeb474ef8 req-fcf093fa-7c13-44c2-8287-366decd3983d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031178 Jul 18 03:46:03.178297 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3737/7465] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:46:03.855513 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-55a8eb1e-ffb0-4dcb-bb5d-feca2d8f954e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:03.856123 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-55a8eb1e-ffb0-4dcb-bb5d-feca2d8f954e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:03.863366 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-55a8eb1e-ffb0-4dcb-bb5d-feca2d8f954e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:03.863811 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-55a8eb1e-ffb0-4dcb-bb5d-feca2d8f954e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:03.864567 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-55a8eb1e-ffb0-4dcb-bb5d-feca2d8f954e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:03.864996 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-55a8eb1e-ffb0-4dcb-bb5d-feca2d8f954e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:03.995561 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-55a8eb1e-ffb0-4dcb-bb5d-feca2d8f954e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:46:04.003710 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-55a8eb1e-ffb0-4dcb-bb5d-feca2d8f954e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1701 microversion: 2.1 time: 0.152109 Jul 18 03:46:04.004299 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3729/7466] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:46:03 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1701 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:46:05.023394 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7a5b05e4-3c05-436a-9710-f1939ac8a004 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:05.024115 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7a5b05e4-3c05-436a-9710-f1939ac8a004 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:05.034696 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7a5b05e4-3c05-436a-9710-f1939ac8a004 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:05.035171 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7a5b05e4-3c05-436a-9710-f1939ac8a004 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:05.035979 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7a5b05e4-3c05-436a-9710-f1939ac8a004 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:05.036435 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7a5b05e4-3c05-436a-9710-f1939ac8a004 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:05.183991 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7a5b05e4-3c05-436a-9710-f1939ac8a004 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:46:05.192648 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7a5b05e4-3c05-436a-9710-f1939ac8a004 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1696 microversion: 2.1 time: 0.175150 Jul 18 03:46:05.193226 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3738/7467] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:46:05 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1696 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:46:06.212874 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4cbf6276-0b36-4112-90d3-743ce01f7bdd tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:06.214191 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4cbf6276-0b36-4112-90d3-743ce01f7bdd tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:06.222053 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4cbf6276-0b36-4112-90d3-743ce01f7bdd tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:06.222504 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4cbf6276-0b36-4112-90d3-743ce01f7bdd tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:06.223314 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4cbf6276-0b36-4112-90d3-743ce01f7bdd tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:06.224177 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4cbf6276-0b36-4112-90d3-743ce01f7bdd tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:06.387548 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4cbf6276-0b36-4112-90d3-743ce01f7bdd tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:46:06.395947 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4cbf6276-0b36-4112-90d3-743ce01f7bdd tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1696 microversion: 2.1 time: 0.187509 Jul 18 03:46:06.402512 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3730/7468] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:46:06 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1696 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:46:07.419252 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-acb36b5c-0975-4a00-9130-f6ef0891cb3d tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:07.420025 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-acb36b5c-0975-4a00-9130-f6ef0891cb3d tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:07.437590 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-acb36b5c-0975-4a00-9130-f6ef0891cb3d tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:07.438930 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-acb36b5c-0975-4a00-9130-f6ef0891cb3d tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:07.439913 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-acb36b5c-0975-4a00-9130-f6ef0891cb3d tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:07.440522 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-acb36b5c-0975-4a00-9130-f6ef0891cb3d tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:07.603133 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-acb36b5c-0975-4a00-9130-f6ef0891cb3d tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:46:07.612693 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-acb36b5c-0975-4a00-9130-f6ef0891cb3d tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1696 microversion: 2.1 time: 0.201519 Jul 18 03:46:07.613379 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3739/7469] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:46:07 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1696 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:46:08.641766 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-74514f44-e629-4706-a0c7-3cc8e6d000f8 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:08.642332 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-74514f44-e629-4706-a0c7-3cc8e6d000f8 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:08.650425 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74514f44-e629-4706-a0c7-3cc8e6d000f8 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:08.650965 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74514f44-e629-4706-a0c7-3cc8e6d000f8 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:08.651818 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74514f44-e629-4706-a0c7-3cc8e6d000f8 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:08.652317 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-74514f44-e629-4706-a0c7-3cc8e6d000f8 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:08.825086 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-74514f44-e629-4706-a0c7-3cc8e6d000f8 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:46:08.835177 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-74514f44-e629-4706-a0c7-3cc8e6d000f8 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1696 microversion: 2.1 time: 0.208673 Jul 18 03:46:08.835879 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3731/7470] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:46:08 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1696 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:46:09.855134 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-30e715a0-d2b4-4fa6-8d1d-7127cdb3d3d5 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:09.855916 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-30e715a0-d2b4-4fa6-8d1d-7127cdb3d3d5 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:09.863922 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-30e715a0-d2b4-4fa6-8d1d-7127cdb3d3d5 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:09.864622 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-30e715a0-d2b4-4fa6-8d1d-7127cdb3d3d5 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:09.865585 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-30e715a0-d2b4-4fa6-8d1d-7127cdb3d3d5 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:09.866082 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-30e715a0-d2b4-4fa6-8d1d-7127cdb3d3d5 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:10.017475 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-30e715a0-d2b4-4fa6-8d1d-7127cdb3d3d5 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:46:10.032580 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-30e715a0-d2b4-4fa6-8d1d-7127cdb3d3d5 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1696 microversion: 2.1 time: 0.181705 Jul 18 03:46:10.033199 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3740/7471] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:46:09 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1696 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:46:11.057082 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d4375a7e-1456-45ab-99dd-ab0b8f0a986f tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:11.059029 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d4375a7e-1456-45ab-99dd-ab0b8f0a986f tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:11.068409 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d4375a7e-1456-45ab-99dd-ab0b8f0a986f tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:11.068859 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d4375a7e-1456-45ab-99dd-ab0b8f0a986f tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:11.069642 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d4375a7e-1456-45ab-99dd-ab0b8f0a986f tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:11.070107 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d4375a7e-1456-45ab-99dd-ab0b8f0a986f tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:11.247027 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d4375a7e-1456-45ab-99dd-ab0b8f0a986f tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:46:11.255958 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d4375a7e-1456-45ab-99dd-ab0b8f0a986f tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1696 microversion: 2.1 time: 0.207240 Jul 18 03:46:11.265614 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3732/7472] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:46:11 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1696 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:46:12.274047 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-20e566c5-93b5-40da-9a53-1602d35769f4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:12.274782 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-20e566c5-93b5-40da-9a53-1602d35769f4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:12.281118 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:46:12.281769 n-d-465891-3 devstack@n-api.service[119544]: Mon Jul 18 03:46:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:46:12.282132 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20e566c5-93b5-40da-9a53-1602d35769f4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:12.282872 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20e566c5-93b5-40da-9a53-1602d35769f4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:12.284617 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20e566c5-93b5-40da-9a53-1602d35769f4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:12.285688 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-20e566c5-93b5-40da-9a53-1602d35769f4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:12.500766 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-20e566c5-93b5-40da-9a53-1602d35769f4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:46:12.513022 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-20e566c5-93b5-40da-9a53-1602d35769f4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1696 microversion: 2.1 time: 0.242921 Jul 18 03:46:12.514162 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3741/7473] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:46:12 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1696 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:46:13.533219 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-54ae89a9-cf72-4166-909d-47cc0e7ced2a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:13.533785 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-54ae89a9-cf72-4166-909d-47cc0e7ced2a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:13.541714 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54ae89a9-cf72-4166-909d-47cc0e7ced2a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:13.542260 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54ae89a9-cf72-4166-909d-47cc0e7ced2a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:13.543146 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54ae89a9-cf72-4166-909d-47cc0e7ced2a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:13.543949 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-54ae89a9-cf72-4166-909d-47cc0e7ced2a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:13.744756 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-54ae89a9-cf72-4166-909d-47cc0e7ced2a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:46:13.753414 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-54ae89a9-cf72-4166-909d-47cc0e7ced2a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1696 microversion: 2.1 time: 0.225235 Jul 18 03:46:13.754195 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3733/7474] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:46:13 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1696 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:46:14.664374 n-d-465891-3 devstack@n-api.service[119543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:46:14.664947 n-d-465891-3 devstack@n-api.service[119543]: Mon Jul 18 03:46:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:46:14.772395 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d11a712b-0692-4933-afdb-b1102e7ebe69 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:14.773016 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d11a712b-0692-4933-afdb-b1102e7ebe69 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:14.780082 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d11a712b-0692-4933-afdb-b1102e7ebe69 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:14.780537 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d11a712b-0692-4933-afdb-b1102e7ebe69 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:14.781650 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d11a712b-0692-4933-afdb-b1102e7ebe69 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:14.782136 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d11a712b-0692-4933-afdb-b1102e7ebe69 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:14.923463 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d11a712b-0692-4933-afdb-b1102e7ebe69 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:46:14.931157 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d11a712b-0692-4933-afdb-b1102e7ebe69 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1696 microversion: 2.1 time: 0.163236 Jul 18 03:46:14.931724 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3742/7475] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:46:14 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1696 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:46:15.948917 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-92c59db1-4d67-42f8-b637-3e7515d34446 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:15.949514 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-92c59db1-4d67-42f8-b637-3e7515d34446 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:15.957179 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-92c59db1-4d67-42f8-b637-3e7515d34446 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:15.957631 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-92c59db1-4d67-42f8-b637-3e7515d34446 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:15.958422 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-92c59db1-4d67-42f8-b637-3e7515d34446 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:15.958852 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-92c59db1-4d67-42f8-b637-3e7515d34446 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:16.095801 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-92c59db1-4d67-42f8-b637-3e7515d34446 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:46:16.103252 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-92c59db1-4d67-42f8-b637-3e7515d34446 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1678 microversion: 2.1 time: 0.158236 Jul 18 03:46:16.103826 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3734/7476] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:46:15 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:46:17.121163 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-82dfc198-d0ab-4eed-ad96-fce68f3b50a3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:17.121892 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-82dfc198-d0ab-4eed-ad96-fce68f3b50a3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:17.136119 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-12b78dbb-8dc2-42c8-b25c-dfc4d67a88dc req-c29e77fe-5d5a-46ba-9c9a-9aa5fae45b86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84344bf4-bd58-4ce1-94a7-5fde01815ef6", "name": "network-vif-unplugged", "status": "completed", "tag": "b10bc7a9-be68-426f-b4ce-a77032e7e136"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:46:17.143756 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-82dfc198-d0ab-4eed-ad96-fce68f3b50a3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:17.144222 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-82dfc198-d0ab-4eed-ad96-fce68f3b50a3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:17.144953 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-12b78dbb-8dc2-42c8-b25c-dfc4d67a88dc req-c29e77fe-5d5a-46ba-9c9a-9aa5fae45b86 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:17.145118 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-82dfc198-d0ab-4eed-ad96-fce68f3b50a3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:17.145446 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-82dfc198-d0ab-4eed-ad96-fce68f3b50a3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:17.145744 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-12b78dbb-8dc2-42c8-b25c-dfc4d67a88dc req-c29e77fe-5d5a-46ba-9c9a-9aa5fae45b86 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:17.160306 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-12b78dbb-8dc2-42c8-b25c-dfc4d67a88dc req-c29e77fe-5d5a-46ba-9c9a-9aa5fae45b86 service nova] Creating event network-vif-unplugged:b10bc7a9-be68-426f-b4ce-a77032e7e136 for instance 84344bf4-bd58-4ce1-94a7-5fde01815ef6 on n-h1-465891-3 Jul 18 03:46:17.164371 n-d-465891-3 devstack@n-api.service[119544]: ERROR oslo.messaging._drivers.impl_rabbit [req-12b78dbb-8dc2-42c8-b25c-dfc4d67a88dc req-c29e77fe-5d5a-46ba-9c9a-9aa5fae45b86 service nova] [58ef0d44-7e5e-4d8b-848a-b6f7d92e0d93] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 03:46:17.316922 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-82dfc198-d0ab-4eed-ad96-fce68f3b50a3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:46:17.328075 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-82dfc198-d0ab-4eed-ad96-fce68f3b50a3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1678 microversion: 2.1 time: 0.210718 Jul 18 03:46:17.337214 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3743/7477] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:46:17 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1678 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:46:18.173039 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [req-12b78dbb-8dc2-42c8-b25c-dfc4d67a88dc req-c29e77fe-5d5a-46ba-9c9a-9aa5fae45b86 service nova] [58ef0d44-7e5e-4d8b-848a-b6f7d92e0d93] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 54182. Jul 18 03:46:18.177209 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-12b78dbb-8dc2-42c8-b25c-dfc4d67a88dc req-c29e77fe-5d5a-46ba-9c9a-9aa5fae45b86 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 1.045722 Jul 18 03:46:18.177848 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3735/7478] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:46:18.346607 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8d08b2fe-293c-4eb0-8b66-1faef73b916d tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:18.347238 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8d08b2fe-293c-4eb0-8b66-1faef73b916d tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:18.350071 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=29 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:46:18.355559 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8d08b2fe-293c-4eb0-8b66-1faef73b916d tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:18.356024 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8d08b2fe-293c-4eb0-8b66-1faef73b916d tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:18.356821 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8d08b2fe-293c-4eb0-8b66-1faef73b916d tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:18.357272 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8d08b2fe-293c-4eb0-8b66-1faef73b916d tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:18.360332 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:46:18.497294 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8d08b2fe-293c-4eb0-8b66-1faef73b916d tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:46:18.506280 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8d08b2fe-293c-4eb0-8b66-1faef73b916d tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1621 microversion: 2.1 time: 0.164089 Jul 18 03:46:18.506874 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3744/7479] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:46:18 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1621 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:46:18.523889 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4190bd6e-05af-4e7a-bb50-9be619f4e75b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:46:18.524550 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4190bd6e-05af-4e7a-bb50-9be619f4e75b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:18.531665 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4190bd6e-05af-4e7a-bb50-9be619f4e75b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:18.532477 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4190bd6e-05af-4e7a-bb50-9be619f4e75b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:18.532941 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4190bd6e-05af-4e7a-bb50-9be619f4e75b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:18.533369 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4190bd6e-05af-4e7a-bb50-9be619f4e75b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:18.549397 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=83 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:46:18.634409 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=31 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:46:18.692042 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4190bd6e-05af-4e7a-bb50-9be619f4e75b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "POST /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6/action" status: 202 len: 0 microversion: 2.1 time: 0.172221 Jul 18 03:46:18.692590 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3736/7480] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:46:18 2022] POST /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:46:18.701164 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e36ebedf-fdf7-426a-950d-435216e469b6 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:18.701969 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e36ebedf-fdf7-426a-950d-435216e469b6 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:18.709005 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e36ebedf-fdf7-426a-950d-435216e469b6 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:18.709547 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e36ebedf-fdf7-426a-950d-435216e469b6 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:18.710378 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e36ebedf-fdf7-426a-950d-435216e469b6 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:18.710830 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e36ebedf-fdf7-426a-950d-435216e469b6 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:18.858234 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e36ebedf-fdf7-426a-950d-435216e469b6 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:46:18.867736 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e36ebedf-fdf7-426a-950d-435216e469b6 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1629 microversion: 2.1 time: 0.170657 Jul 18 03:46:18.868314 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3745/7481] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:46:18 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1629 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:46:19.887828 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-d4a7cd1b-21b7-459f-883f-ae4aa673f023 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:19.888437 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-d4a7cd1b-21b7-459f-883f-ae4aa673f023 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:19.894993 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d4a7cd1b-21b7-459f-883f-ae4aa673f023 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:19.895438 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d4a7cd1b-21b7-459f-883f-ae4aa673f023 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:19.896192 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d4a7cd1b-21b7-459f-883f-ae4aa673f023 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:19.896622 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-d4a7cd1b-21b7-459f-883f-ae4aa673f023 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:20.029484 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-d4a7cd1b-21b7-459f-883f-ae4aa673f023 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:46:20.037827 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-d4a7cd1b-21b7-459f-883f-ae4aa673f023 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1629 microversion: 2.1 time: 0.154636 Jul 18 03:46:20.038413 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3737/7482] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:46:19 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1629 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:46:21.056121 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-43864048-2d98-462a-b868-2f26cfe02060 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:21.056771 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-43864048-2d98-462a-b868-2f26cfe02060 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:21.063316 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-43864048-2d98-462a-b868-2f26cfe02060 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:21.063781 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-43864048-2d98-462a-b868-2f26cfe02060 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:21.064562 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-43864048-2d98-462a-b868-2f26cfe02060 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:21.065017 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-43864048-2d98-462a-b868-2f26cfe02060 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:21.199713 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-43864048-2d98-462a-b868-2f26cfe02060 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:46:21.207997 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-43864048-2d98-462a-b868-2f26cfe02060 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1629 microversion: 2.1 time: 0.155996 Jul 18 03:46:21.208580 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3746/7483] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:46:21 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1629 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:46:22.225837 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-3f5c48a9-54fe-4c38-b007-85aea43d02db tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:22.226477 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-3f5c48a9-54fe-4c38-b007-85aea43d02db tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:22.232635 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3f5c48a9-54fe-4c38-b007-85aea43d02db tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:22.233090 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3f5c48a9-54fe-4c38-b007-85aea43d02db tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:22.234489 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3f5c48a9-54fe-4c38-b007-85aea43d02db tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:22.234931 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-3f5c48a9-54fe-4c38-b007-85aea43d02db tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:22.373966 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-3f5c48a9-54fe-4c38-b007-85aea43d02db tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:46:22.382391 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-3f5c48a9-54fe-4c38-b007-85aea43d02db tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1687 microversion: 2.1 time: 0.160830 Jul 18 03:46:22.389222 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3738/7484] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:46:22 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:46:23.404803 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-07a3777d-d094-4019-a514-cddc5fba4be3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:23.405439 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-07a3777d-d094-4019-a514-cddc5fba4be3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:23.413280 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-07a3777d-d094-4019-a514-cddc5fba4be3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:23.413773 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-07a3777d-d094-4019-a514-cddc5fba4be3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:23.414573 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-07a3777d-d094-4019-a514-cddc5fba4be3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:23.415214 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-07a3777d-d094-4019-a514-cddc5fba4be3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:23.570026 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-07a3777d-d094-4019-a514-cddc5fba4be3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:46:23.578809 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-07a3777d-d094-4019-a514-cddc5fba4be3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1687 microversion: 2.1 time: 0.177090 Jul 18 03:46:23.579780 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3747/7485] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:46:23 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1687 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:46:24.601886 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8f464b9c-27cd-46f6-972f-5ee51c2e3caf tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:24.602640 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8f464b9c-27cd-46f6-972f-5ee51c2e3caf tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:24.610114 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8f464b9c-27cd-46f6-972f-5ee51c2e3caf tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:24.610562 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8f464b9c-27cd-46f6-972f-5ee51c2e3caf tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:24.611339 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8f464b9c-27cd-46f6-972f-5ee51c2e3caf tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:24.611770 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8f464b9c-27cd-46f6-972f-5ee51c2e3caf tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:24.759512 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8f464b9c-27cd-46f6-972f-5ee51c2e3caf tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:46:24.768439 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8f464b9c-27cd-46f6-972f-5ee51c2e3caf tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1687 microversion: 2.1 time: 0.171591 Jul 18 03:46:24.777267 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3739/7486] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:46:24 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1687 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:46:25.786531 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-442de080-8c37-4839-9e91-f46e6d8bb577 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:25.787077 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-442de080-8c37-4839-9e91-f46e6d8bb577 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:25.794067 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-442de080-8c37-4839-9e91-f46e6d8bb577 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:25.794532 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-442de080-8c37-4839-9e91-f46e6d8bb577 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:25.795315 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-442de080-8c37-4839-9e91-f46e6d8bb577 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:25.795771 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-442de080-8c37-4839-9e91-f46e6d8bb577 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:25.944908 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-442de080-8c37-4839-9e91-f46e6d8bb577 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:46:25.955194 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-442de080-8c37-4839-9e91-f46e6d8bb577 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1687 microversion: 2.1 time: 0.172778 Jul 18 03:46:25.955919 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3748/7487] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:46:25 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1687 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:46:26.971926 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-03f826c6-22fb-4473-a9cf-92b109a4af97 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:26.972558 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-03f826c6-22fb-4473-a9cf-92b109a4af97 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:26.980566 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-03f826c6-22fb-4473-a9cf-92b109a4af97 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:26.981016 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-03f826c6-22fb-4473-a9cf-92b109a4af97 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:26.981825 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-03f826c6-22fb-4473-a9cf-92b109a4af97 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:26.982259 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-03f826c6-22fb-4473-a9cf-92b109a4af97 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:27.132003 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-03f826c6-22fb-4473-a9cf-92b109a4af97 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:46:27.141057 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-03f826c6-22fb-4473-a9cf-92b109a4af97 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1687 microversion: 2.1 time: 0.171942 Jul 18 03:46:27.142339 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3740/7488] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:46:26 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1687 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:46:28.159234 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ccef740a-3bb0-40d8-bbf5-22d8b0a04f01 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:28.159849 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ccef740a-3bb0-40d8-bbf5-22d8b0a04f01 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:28.167704 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ccef740a-3bb0-40d8-bbf5-22d8b0a04f01 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:28.168183 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ccef740a-3bb0-40d8-bbf5-22d8b0a04f01 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:28.168962 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ccef740a-3bb0-40d8-bbf5-22d8b0a04f01 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:28.169404 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ccef740a-3bb0-40d8-bbf5-22d8b0a04f01 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:28.330178 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ccef740a-3bb0-40d8-bbf5-22d8b0a04f01 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:46:28.339897 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ccef740a-3bb0-40d8-bbf5-22d8b0a04f01 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1687 microversion: 2.1 time: 0.185003 Jul 18 03:46:28.340749 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3749/7489] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:46:28 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1687 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:46:29.358450 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-31c67ffb-0220-4551-b787-d5981d2fbaae tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:29.359863 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-31c67ffb-0220-4551-b787-d5981d2fbaae tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:29.367893 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-31c67ffb-0220-4551-b787-d5981d2fbaae tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:29.368347 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-31c67ffb-0220-4551-b787-d5981d2fbaae tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:29.369129 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-31c67ffb-0220-4551-b787-d5981d2fbaae tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:29.369693 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-31c67ffb-0220-4551-b787-d5981d2fbaae tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:29.581314 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-31c67ffb-0220-4551-b787-d5981d2fbaae tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:46:29.589348 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-31c67ffb-0220-4551-b787-d5981d2fbaae tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1687 microversion: 2.1 time: 0.235094 Jul 18 03:46:29.590357 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3741/7490] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:46:29 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1687 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:46:30.606527 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9a0718b7-b0e3-4bd9-a1a4-893f715d4e66 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:30.607159 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9a0718b7-b0e3-4bd9-a1a4-893f715d4e66 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:30.614353 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9a0718b7-b0e3-4bd9-a1a4-893f715d4e66 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:30.614820 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9a0718b7-b0e3-4bd9-a1a4-893f715d4e66 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:30.615610 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9a0718b7-b0e3-4bd9-a1a4-893f715d4e66 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:30.616065 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9a0718b7-b0e3-4bd9-a1a4-893f715d4e66 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:30.751247 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9a0718b7-b0e3-4bd9-a1a4-893f715d4e66 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:46:30.759052 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9a0718b7-b0e3-4bd9-a1a4-893f715d4e66 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1687 microversion: 2.1 time: 0.156518 Jul 18 03:46:30.759664 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3750/7491] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:46:30 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:46:31.776634 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f1255c65-5cf0-4c9f-8b13-8bc9ba472e1a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:31.777207 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f1255c65-5cf0-4c9f-8b13-8bc9ba472e1a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:31.784147 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f1255c65-5cf0-4c9f-8b13-8bc9ba472e1a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:31.784597 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f1255c65-5cf0-4c9f-8b13-8bc9ba472e1a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:31.785365 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f1255c65-5cf0-4c9f-8b13-8bc9ba472e1a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:31.785839 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f1255c65-5cf0-4c9f-8b13-8bc9ba472e1a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:31.920700 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f1255c65-5cf0-4c9f-8b13-8bc9ba472e1a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:46:31.928821 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f1255c65-5cf0-4c9f-8b13-8bc9ba472e1a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1687 microversion: 2.1 time: 0.156187 Jul 18 03:46:31.929395 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3742/7492] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:46:31 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1687 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:46:32.946614 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e4e87cbe-4907-480a-8783-2cf1752d3864 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:32.947237 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e4e87cbe-4907-480a-8783-2cf1752d3864 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:32.954618 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e4e87cbe-4907-480a-8783-2cf1752d3864 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:32.955087 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e4e87cbe-4907-480a-8783-2cf1752d3864 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:32.955872 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e4e87cbe-4907-480a-8783-2cf1752d3864 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:32.956326 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e4e87cbe-4907-480a-8783-2cf1752d3864 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:33.096295 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e4e87cbe-4907-480a-8783-2cf1752d3864 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:46:33.103941 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e4e87cbe-4907-480a-8783-2cf1752d3864 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1687 microversion: 2.1 time: 0.161235 Jul 18 03:46:33.104520 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3751/7493] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:46:32 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1687 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:46:34.121868 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-aa45e472-dc6b-4d44-b8cd-72c2120ad2a5 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:34.122491 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-aa45e472-dc6b-4d44-b8cd-72c2120ad2a5 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:34.130776 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aa45e472-dc6b-4d44-b8cd-72c2120ad2a5 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:34.131220 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aa45e472-dc6b-4d44-b8cd-72c2120ad2a5 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:34.131986 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aa45e472-dc6b-4d44-b8cd-72c2120ad2a5 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:34.132417 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-aa45e472-dc6b-4d44-b8cd-72c2120ad2a5 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:34.274605 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-aa45e472-dc6b-4d44-b8cd-72c2120ad2a5 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:46:34.283220 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-aa45e472-dc6b-4d44-b8cd-72c2120ad2a5 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1687 microversion: 2.1 time: 0.165249 Jul 18 03:46:34.283960 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3743/7494] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:46:34 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:46:35.300954 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ab5de003-26d7-4019-aa1c-dcc038e4cac4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:35.301589 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ab5de003-26d7-4019-aa1c-dcc038e4cac4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:35.308890 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ab5de003-26d7-4019-aa1c-dcc038e4cac4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:35.309449 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ab5de003-26d7-4019-aa1c-dcc038e4cac4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:35.310412 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ab5de003-26d7-4019-aa1c-dcc038e4cac4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:35.310865 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ab5de003-26d7-4019-aa1c-dcc038e4cac4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:35.447156 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ab5de003-26d7-4019-aa1c-dcc038e4cac4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:46:35.454780 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ab5de003-26d7-4019-aa1c-dcc038e4cac4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1687 microversion: 2.1 time: 0.158672 Jul 18 03:46:35.455370 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3752/7495] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:46:35 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1687 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:46:36.472052 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-59277f62-5d22-41db-bd06-20443b9f359b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:36.472672 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-59277f62-5d22-41db-bd06-20443b9f359b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:36.479608 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-59277f62-5d22-41db-bd06-20443b9f359b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:36.480051 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-59277f62-5d22-41db-bd06-20443b9f359b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:36.480804 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-59277f62-5d22-41db-bd06-20443b9f359b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:36.481237 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-59277f62-5d22-41db-bd06-20443b9f359b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:36.621594 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-59277f62-5d22-41db-bd06-20443b9f359b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:46:36.630230 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-59277f62-5d22-41db-bd06-20443b9f359b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1687 microversion: 2.1 time: 0.162124 Jul 18 03:46:36.630806 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3744/7496] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:46:36 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:46:37.649039 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-38a253be-2984-445a-87f7-e90c13673423 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:37.649764 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-38a253be-2984-445a-87f7-e90c13673423 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:37.659235 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-38a253be-2984-445a-87f7-e90c13673423 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:37.659723 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-38a253be-2984-445a-87f7-e90c13673423 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:37.660524 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-38a253be-2984-445a-87f7-e90c13673423 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:37.660979 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-38a253be-2984-445a-87f7-e90c13673423 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:37.791661 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-38a253be-2984-445a-87f7-e90c13673423 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:46:37.800003 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-38a253be-2984-445a-87f7-e90c13673423 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1687 microversion: 2.1 time: 0.155004 Jul 18 03:46:37.800602 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3753/7497] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:46:37 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1687 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:46:38.816691 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-0b679163-95e9-4baa-aac4-813114ac8326 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:38.817242 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-0b679163-95e9-4baa-aac4-813114ac8326 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:38.824414 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0b679163-95e9-4baa-aac4-813114ac8326 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:38.824856 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0b679163-95e9-4baa-aac4-813114ac8326 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:38.825613 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0b679163-95e9-4baa-aac4-813114ac8326 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:38.826068 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-0b679163-95e9-4baa-aac4-813114ac8326 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:38.959829 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-0b679163-95e9-4baa-aac4-813114ac8326 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:46:38.967371 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-0b679163-95e9-4baa-aac4-813114ac8326 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1687 microversion: 2.1 time: 0.154825 Jul 18 03:46:38.967942 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3745/7498] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:46:38 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1687 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:46:39.371369 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-aad3a571-40b1-4d95-9ada-9ec68d1473c3 req-ca45dc77-5d8a-49a5-af8f-2a7cb30574e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84344bf4-bd58-4ce1-94a7-5fde01815ef6", "name": "network-vif-plugged", "status": "completed", "tag": "b10bc7a9-be68-426f-b4ce-a77032e7e136"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:46:39.380833 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-aad3a571-40b1-4d95-9ada-9ec68d1473c3 req-ca45dc77-5d8a-49a5-af8f-2a7cb30574e1 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:39.381286 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-aad3a571-40b1-4d95-9ada-9ec68d1473c3 req-ca45dc77-5d8a-49a5-af8f-2a7cb30574e1 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:39.393004 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-aad3a571-40b1-4d95-9ada-9ec68d1473c3 req-ca45dc77-5d8a-49a5-af8f-2a7cb30574e1 service nova] Creating event network-vif-plugged:b10bc7a9-be68-426f-b4ce-a77032e7e136 for instance 84344bf4-bd58-4ce1-94a7-5fde01815ef6 on n-h1-465891-3 Jul 18 03:46:39.398494 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-aad3a571-40b1-4d95-9ada-9ec68d1473c3 req-ca45dc77-5d8a-49a5-af8f-2a7cb30574e1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096552 Jul 18 03:46:39.399030 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3754/7499] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:46:39.986313 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-050d23c4-d25e-4e69-a843-732e20166f39 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:39.986870 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-050d23c4-d25e-4e69-a843-732e20166f39 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:39.993768 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-050d23c4-d25e-4e69-a843-732e20166f39 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:39.994223 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-050d23c4-d25e-4e69-a843-732e20166f39 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:39.994980 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-050d23c4-d25e-4e69-a843-732e20166f39 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:39.995416 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-050d23c4-d25e-4e69-a843-732e20166f39 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:40.127217 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-050d23c4-d25e-4e69-a843-732e20166f39 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:46:40.135021 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-050d23c4-d25e-4e69-a843-732e20166f39 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1687 microversion: 2.1 time: 0.153375 Jul 18 03:46:40.135604 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3746/7500] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:46:39 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:46:41.152886 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-afee93ad-7339-4030-903d-b381d0297c8e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:41.153669 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-afee93ad-7339-4030-903d-b381d0297c8e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:41.161450 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-afee93ad-7339-4030-903d-b381d0297c8e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:41.161982 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-afee93ad-7339-4030-903d-b381d0297c8e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:41.162864 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-afee93ad-7339-4030-903d-b381d0297c8e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:41.163188 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-afee93ad-7339-4030-903d-b381d0297c8e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:41.303982 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-afee93ad-7339-4030-903d-b381d0297c8e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:46:41.311833 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-afee93ad-7339-4030-903d-b381d0297c8e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1687 microversion: 2.1 time: 0.163078 Jul 18 03:46:41.314189 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3755/7501] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:46:41 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:46:42.331888 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7f86f08a-ae84-4e27-9003-9bdcd5ff4582 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:42.332538 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7f86f08a-ae84-4e27-9003-9bdcd5ff4582 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:42.339503 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7f86f08a-ae84-4e27-9003-9bdcd5ff4582 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:42.339956 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7f86f08a-ae84-4e27-9003-9bdcd5ff4582 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:42.340718 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7f86f08a-ae84-4e27-9003-9bdcd5ff4582 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:42.341155 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7f86f08a-ae84-4e27-9003-9bdcd5ff4582 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:42.478178 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7f86f08a-ae84-4e27-9003-9bdcd5ff4582 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:46:42.486868 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7f86f08a-ae84-4e27-9003-9bdcd5ff4582 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1674 microversion: 2.1 time: 0.158940 Jul 18 03:46:42.487448 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3747/7502] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:46:42 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:47:54.638866 n-d-465891-3 devstack@n-api.service[119543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:47:54.639440 n-d-465891-3 devstack@n-api.service[119543]: Mon Jul 18 03:47:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:48:28.047864 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=23 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:48:28.048425 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f37390b7-fee1-4d59-afc6-a623361a25d8 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:48:28.048792 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f37390b7-fee1-4d59-afc6-a623361a25d8 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:48:28.048884 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:48:28.051346 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=23 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:48:28.052295 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=67 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:48:28.062767 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f37390b7-fee1-4d59-afc6-a623361a25d8 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:28.063241 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f37390b7-fee1-4d59-afc6-a623361a25d8 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:28.064048 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f37390b7-fee1-4d59-afc6-a623361a25d8 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:28.064937 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f37390b7-fee1-4d59-afc6-a623361a25d8 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:28.092953 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f37390b7-fee1-4d59-afc6-a623361a25d8 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:48:28.178543 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-7c7e7d0d-b4d7-473b-b28f-917c40265a17 req-7f714e41-13cb-44ef-8c51-5dc8e6b1d8bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84344bf4-bd58-4ce1-94a7-5fde01815ef6", "tag": "b10bc7a9-be68-426f-b4ce-a77032e7e136"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:48:28.179721 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f37390b7-fee1-4d59-afc6-a623361a25d8 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "DELETE /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 204 len: 0 microversion: 2.1 time: 0.136301 Jul 18 03:48:28.184501 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3756/7503] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:48:28 2022] DELETE /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:48:28.190076 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-7c7e7d0d-b4d7-473b-b28f-917c40265a17 req-7f714e41-13cb-44ef-8c51-5dc8e6b1d8bf service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:28.190367 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a2040215-900f-4f66-bdab-70de1b79ffa2 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:48:28.190520 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-7c7e7d0d-b4d7-473b-b28f-917c40265a17 req-7f714e41-13cb-44ef-8c51-5dc8e6b1d8bf service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:28.191388 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a2040215-900f-4f66-bdab-70de1b79ffa2 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:48:28.198341 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a2040215-900f-4f66-bdab-70de1b79ffa2 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:28.199261 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a2040215-900f-4f66-bdab-70de1b79ffa2 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:28.200306 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a2040215-900f-4f66-bdab-70de1b79ffa2 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:28.200921 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a2040215-900f-4f66-bdab-70de1b79ffa2 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:28.205069 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-7c7e7d0d-b4d7-473b-b28f-917c40265a17 req-7f714e41-13cb-44ef-8c51-5dc8e6b1d8bf service nova] Creating event network-changed:b10bc7a9-be68-426f-b4ce-a77032e7e136 for instance 84344bf4-bd58-4ce1-94a7-5fde01815ef6 on n-h1-465891-3 Jul 18 03:48:28.210921 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-7c7e7d0d-b4d7-473b-b28f-917c40265a17 req-7f714e41-13cb-44ef-8c51-5dc8e6b1d8bf service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165002 Jul 18 03:48:28.211791 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3748/7504] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:48:28.344736 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a2040215-900f-4f66-bdab-70de1b79ffa2 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:48:28.352500 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a2040215-900f-4f66-bdab-70de1b79ffa2 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1680 microversion: 2.1 time: 0.166671 Jul 18 03:48:28.353174 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3757/7505] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:48:28 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:48:29.372558 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e78d8a68-8d1e-47cd-bc5e-0d6dd235e606 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:48:29.373252 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e78d8a68-8d1e-47cd-bc5e-0d6dd235e606 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:48:29.380841 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e78d8a68-8d1e-47cd-bc5e-0d6dd235e606 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:29.381317 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e78d8a68-8d1e-47cd-bc5e-0d6dd235e606 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:29.382093 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e78d8a68-8d1e-47cd-bc5e-0d6dd235e606 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:29.382524 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e78d8a68-8d1e-47cd-bc5e-0d6dd235e606 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:29.529454 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e78d8a68-8d1e-47cd-bc5e-0d6dd235e606 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:48:29.537012 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e78d8a68-8d1e-47cd-bc5e-0d6dd235e606 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1680 microversion: 2.1 time: 0.169316 Jul 18 03:48:29.537589 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3749/7506] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:48:29 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:48:30.244313 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-6279abf6-abe4-43ae-afe7-cd51170963bc req-3e71ef11-1316-44b8-963e-1a0be7a1ec97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84344bf4-bd58-4ce1-94a7-5fde01815ef6", "name": "network-vif-deleted", "tag": "b10bc7a9-be68-426f-b4ce-a77032e7e136"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:48:30.255721 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-6279abf6-abe4-43ae-afe7-cd51170963bc req-3e71ef11-1316-44b8-963e-1a0be7a1ec97 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:30.256327 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-6279abf6-abe4-43ae-afe7-cd51170963bc req-3e71ef11-1316-44b8-963e-1a0be7a1ec97 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:30.275404 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-6279abf6-abe4-43ae-afe7-cd51170963bc req-3e71ef11-1316-44b8-963e-1a0be7a1ec97 service nova] Creating event network-vif-deleted:b10bc7a9-be68-426f-b4ce-a77032e7e136 for instance 84344bf4-bd58-4ce1-94a7-5fde01815ef6 on n-h1-465891-3 Jul 18 03:48:30.281447 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-6279abf6-abe4-43ae-afe7-cd51170963bc req-3e71ef11-1316-44b8-963e-1a0be7a1ec97 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116582 Jul 18 03:48:30.282382 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3758/7507] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:48:30.558309 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-66e7359b-68a5-40da-8ac4-913569f710f1 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:48:30.558958 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-66e7359b-68a5-40da-8ac4-913569f710f1 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:48:30.570015 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-66e7359b-68a5-40da-8ac4-913569f710f1 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:30.570464 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-66e7359b-68a5-40da-8ac4-913569f710f1 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:30.571437 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-66e7359b-68a5-40da-8ac4-913569f710f1 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:30.571873 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-66e7359b-68a5-40da-8ac4-913569f710f1 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:30.609812 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-66e7359b-68a5-40da-8ac4-913569f710f1 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:30.610432 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-66e7359b-68a5-40da-8ac4-913569f710f1 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:30.611260 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-66e7359b-68a5-40da-8ac4-913569f710f1 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lazy-loading 'fault' on Instance uuid 84344bf4-bd58-4ce1-94a7-5fde01815ef6 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:48:30.994770 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-66e7359b-68a5-40da-8ac4-913569f710f1 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:48:31.001830 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-66e7359b-68a5-40da-8ac4-913569f710f1 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 200 len: 1335 microversion: 2.1 time: 0.450103 Jul 18 03:48:31.002404 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3750/7508] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:48:30 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 1335 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:48:32.020187 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0c530327-577c-44ff-a716-c6aa6931a17a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:48:32.020895 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-0c530327-577c-44ff-a716-c6aa6931a17a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 84344bf4-bd58-4ce1-94a7-5fde01815ef6] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:48:32.027469 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c530327-577c-44ff-a716-c6aa6931a17a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:32.027929 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c530327-577c-44ff-a716-c6aa6931a17a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:32.028701 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c530327-577c-44ff-a716-c6aa6931a17a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:32.029147 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-0c530327-577c-44ff-a716-c6aa6931a17a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:32.043463 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-0c530327-577c-44ff-a716-c6aa6931a17a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] HTTP exception thrown: Instance 84344bf4-bd58-4ce1-94a7-5fde01815ef6 could not be found. Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0c530327-577c-44ff-a716-c6aa6931a17a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Request method failure captured: Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 HTTP/1.1 Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1NbD53RkWfrwhkk4fYBrVD9N2mrcTUF-q2b2EiXe47fLGj5Jk4xHKANkWBr47rqDTv047pOfYhXRBkngyHomGKqMIOtbHIn4SNp6R6bbNzv5z4_brcrsk51dKk07cje1ixdXdeZMZwmYbrmhb4Y_QrRDNdYeRkNM1KfIJgzfwtjlIM8 Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 2f05e19f28ee40c58936bcc9fc8baedd Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-TestShelveInstance-1751999859 Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2f05e19f28ee40c58936bcc9fc8baedd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2f05e19f28ee40c58936bcc9fc8baedd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2f05e19f28ee40c58936bcc9fc8baedd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2f05e19f28ee40c58936bcc9fc8baedd"}]}] Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-TestShelveInstance-1751999859 Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 2f05e19f28ee40c58936bcc9fc8baedd Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-TestShelveInstance-1751999859 Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-TestShelveInstance-1751999859-project Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: ac8fcf3285d647cb9fb9f126531750d7 Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-TestShelveInstance-1751999859-project Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 84344bf4-bd58-4ce1-94a7-5fde01815ef6 could not be found. Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '84344bf4-bd58-4ce1-94a7-5fde01815ef6'} Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84344bf4-bd58-4ce1-94a7-5fde01815ef6 could not be found. Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84344bf4-bd58-4ce1-94a7-5fde01815ef6 could not be found. Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:48:32.045116 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:48:32.050404 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:48:32.050404 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:48:32.050404 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:48:32.050404 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:48:32.050404 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:48:32.050404 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84344bf4-bd58-4ce1-94a7-5fde01815ef6 could not be found. Jul 18 03:48:32.050404 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:48:32.050404 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-0c530327-577c-44ff-a716-c6aa6931a17a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Returning 404 to user: Instance 84344bf4-bd58-4ce1-94a7-5fde01815ef6 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:48:32.050404 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-0c530327-577c-44ff-a716-c6aa6931a17a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6" status: 404 len: 111 microversion: 2.1 time: 0.031447 Jul 18 03:48:32.050404 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3759/7509] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:48:32 2022] GET /compute/v2.1/servers/84344bf4-bd58-4ce1-94a7-5fde01815ef6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:48:32.208236 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-209ef1a9-774c-474d-8aff-e3df39d61f2e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '.version_select at 0x7ff49b574790>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:48:32.246289 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-209ef1a9-774c-474d-8aff-e3df39d61f2e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-331961619" status: 202 len: 0 microversion: 2.1 time: 0.042362 Jul 18 03:48:32.246864 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3751/7510] 10.222.0.57 () {58 vars in 1250 bytes} [Mon Jul 18 03:48:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-331961619 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:48:32.272242 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5c46b2d6-1ff2-413d-89c8-f0da08a3a9ce tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Action: 'create', calling method: .version_select at 0x7ff49bc791f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-609460364", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA0FDUi0X12Xma1MHl8z8JcY8UVLNzKeUDdt1BNI10BZE61wB96oM2UchqkS38ASkQmgQFQd09RB40KjIcma6fcOFgh+Ot16pWJSWXMjKaUgZpIQCqVfChRe/h/elKJHzQ=="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:48:32.286835 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-5c46b2d6-1ff2-413d-89c8-f0da08a3a9ce tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Getting quotas for project 2f05e19f28ee40c58936bcc9fc8baedd. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:48:32.292648 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-5c46b2d6-1ff2-413d-89c8-f0da08a3a9ce tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Getting quotas for user ac8fcf3285d647cb9fb9f126531750d7 and project 2f05e19f28ee40c58936bcc9fc8baedd. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:48:32.319189 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5c46b2d6-1ff2-413d-89c8-f0da08a3a9ce tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.050830 Jul 18 03:48:32.319765 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3760/7511] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 03:48:32 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:48:49.606233 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=16 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:48:49.607481 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:48:49.611823 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-63cb7baf-fe5e-4fe0-b159-e8946473436c tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1288780374", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-609460364", "security_groups": [{"name": "tempest-secgroup-smoke-1401950810"}], "networks": [{"uuid": "5ef69a67-1386-4c11-bd7b-9722a65ad786"}], "block_device_mapping_v2": [{"uuid": "4ea56d39-3b91-47d5-bd36-791d5317e14c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:48:49.740580 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-63cb7baf-fe5e-4fe0-b159-e8946473436c tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] validate_networks() for [('5ef69a67-1386-4c11-bd7b-9722a65ad786', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:48:50.208385 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-63cb7baf-fe5e-4fe0-b159-e8946473436c tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:48:50.208812 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-63cb7baf-fe5e-4fe0-b159-e8946473436c tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:48:50.209285 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-63cb7baf-fe5e-4fe0-b159-e8946473436c tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:48:50.209716 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-63cb7baf-fe5e-4fe0-b159-e8946473436c tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:48:50.210140 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-63cb7baf-fe5e-4fe0-b159-e8946473436c tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:48:50.220317 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-63cb7baf-fe5e-4fe0-b159-e8946473436c tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:50.220766 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-63cb7baf-fe5e-4fe0-b159-e8946473436c tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:50.221578 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-63cb7baf-fe5e-4fe0-b159-e8946473436c tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:50.222134 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-63cb7baf-fe5e-4fe0-b159-e8946473436c tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:50.242182 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-63cb7baf-fe5e-4fe0-b159-e8946473436c tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Getting quotas for project 2f05e19f28ee40c58936bcc9fc8baedd. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:48:50.249311 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-63cb7baf-fe5e-4fe0-b159-e8946473436c tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Getting quotas for user ac8fcf3285d647cb9fb9f126531750d7 and project 2f05e19f28ee40c58936bcc9fc8baedd. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:48:50.317546 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-63cb7baf-fe5e-4fe0-b159-e8946473436c tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:48:50.319723 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-63cb7baf-fe5e-4fe0-b159-e8946473436c tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4ea56d39-3b91-47d5-bd36-791d5317e14c',volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:48:50.491217 n-d-465891-3 devstack@n-api.service[119544]: ERROR oslo.messaging._drivers.impl_rabbit [None req-63cb7baf-fe5e-4fe0-b159-e8946473436c tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [d1db53c4-5096-4d88-96cb-2be3ad77b75e] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 03:48:51.500384 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [None req-63cb7baf-fe5e-4fe0-b159-e8946473436c tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [d1db53c4-5096-4d88-96cb-2be3ad77b75e] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 54550. Jul 18 03:48:51.505527 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-63cb7baf-fe5e-4fe0-b159-e8946473436c tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.901026 Jul 18 03:48:51.506272 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3752/7512] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:48:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 1903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:48:51.518801 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:48:51.521405 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=4 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:48:51.523340 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:48:51.532562 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9b85be25-187d-42d3-ba9b-1b67a77f31a3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:48:51.533216 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9b85be25-187d-42d3-ba9b-1b67a77f31a3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:48:51.605236 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9b85be25-187d-42d3-ba9b-1b67a77f31a3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:48:51.617589 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9b85be25-187d-42d3-ba9b-1b67a77f31a3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1088 microversion: 2.1 time: 0.102236 Jul 18 03:48:51.619909 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3761/7513] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:48:51 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1088 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:48:52.641165 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-133516cf-a410-4c13-b580-a4042bda19a0 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:48:52.642114 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-133516cf-a410-4c13-b580-a4042bda19a0 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:48:52.648773 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-133516cf-a410-4c13-b580-a4042bda19a0 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:52.649304 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-133516cf-a410-4c13-b580-a4042bda19a0 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:52.650941 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-133516cf-a410-4c13-b580-a4042bda19a0 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:52.651406 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-133516cf-a410-4c13-b580-a4042bda19a0 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:52.779426 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-133516cf-a410-4c13-b580-a4042bda19a0 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:48:52.787441 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-133516cf-a410-4c13-b580-a4042bda19a0 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1194 microversion: 2.1 time: 0.151181 Jul 18 03:48:52.788288 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3753/7514] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:48:52 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1194 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:48:53.813732 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f0c0a986-993f-4ea9-9785-0bb3dd11de01 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:48:53.814583 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f0c0a986-993f-4ea9-9785-0bb3dd11de01 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:48:53.831250 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f0c0a986-993f-4ea9-9785-0bb3dd11de01 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:53.838857 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f0c0a986-993f-4ea9-9785-0bb3dd11de01 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:53.840028 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f0c0a986-993f-4ea9-9785-0bb3dd11de01 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:53.841459 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f0c0a986-993f-4ea9-9785-0bb3dd11de01 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:54.161613 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f0c0a986-993f-4ea9-9785-0bb3dd11de01 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:48:54.174315 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f0c0a986-993f-4ea9-9785-0bb3dd11de01 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1272 microversion: 2.1 time: 0.371866 Jul 18 03:48:54.175344 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3762/7515] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:48:53 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1272 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:48:54.613447 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-04ea6348-3af6-4b5e-874a-98575a3fd432 req-c192c83e-0057-43f2-bf89-70fbe137a0e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8067855a-0f46-4fc9-8735-e829583c3024", "tag": "dfd79978-9919-4021-b8cf-877904b8e11a"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:48:54.632308 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-04ea6348-3af6-4b5e-874a-98575a3fd432 req-c192c83e-0057-43f2-bf89-70fbe137a0e8 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:54.633250 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-04ea6348-3af6-4b5e-874a-98575a3fd432 req-c192c83e-0057-43f2-bf89-70fbe137a0e8 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:54.663666 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-04ea6348-3af6-4b5e-874a-98575a3fd432 req-c192c83e-0057-43f2-bf89-70fbe137a0e8 service nova] Creating event network-changed:dfd79978-9919-4021-b8cf-877904b8e11a for instance 8067855a-0f46-4fc9-8735-e829583c3024 on n-h1-465891-3 Jul 18 03:48:54.677559 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-04ea6348-3af6-4b5e-874a-98575a3fd432 req-c192c83e-0057-43f2-bf89-70fbe137a0e8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070643 Jul 18 03:48:54.679852 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3754/7516] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:48:55.197890 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dd9dfb08-2158-4009-8ac1-b375a95593cf tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:48:55.198636 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-dd9dfb08-2158-4009-8ac1-b375a95593cf tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:48:55.207129 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dd9dfb08-2158-4009-8ac1-b375a95593cf tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:55.207600 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dd9dfb08-2158-4009-8ac1-b375a95593cf tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:55.208467 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dd9dfb08-2158-4009-8ac1-b375a95593cf tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:55.208917 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-dd9dfb08-2158-4009-8ac1-b375a95593cf tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:55.492708 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-dd9dfb08-2158-4009-8ac1-b375a95593cf tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:48:55.503011 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-dd9dfb08-2158-4009-8ac1-b375a95593cf tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1272 microversion: 2.1 time: 0.311700 Jul 18 03:48:55.503637 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3763/7517] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:48:55 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1272 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:48:56.523199 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4b585674-1e1a-4359-ba7f-636c3d7a4f2e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:48:56.524091 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4b585674-1e1a-4359-ba7f-636c3d7a4f2e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:48:56.531460 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4b585674-1e1a-4359-ba7f-636c3d7a4f2e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:56.531921 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4b585674-1e1a-4359-ba7f-636c3d7a4f2e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:56.532721 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4b585674-1e1a-4359-ba7f-636c3d7a4f2e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:56.533164 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4b585674-1e1a-4359-ba7f-636c3d7a4f2e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:56.715980 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4b585674-1e1a-4359-ba7f-636c3d7a4f2e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:48:56.725322 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4b585674-1e1a-4359-ba7f-636c3d7a4f2e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1272 microversion: 2.1 time: 0.207742 Jul 18 03:48:56.725952 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3755/7518] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:48:56 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1272 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:48:57.743567 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4bd85415-4c17-4024-8129-51db810d7048 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:48:57.744204 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4bd85415-4c17-4024-8129-51db810d7048 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:48:57.751532 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4bd85415-4c17-4024-8129-51db810d7048 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:57.751999 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4bd85415-4c17-4024-8129-51db810d7048 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:57.752790 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4bd85415-4c17-4024-8129-51db810d7048 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:57.753246 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4bd85415-4c17-4024-8129-51db810d7048 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:57.888892 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4bd85415-4c17-4024-8129-51db810d7048 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:48:57.896863 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4bd85415-4c17-4024-8129-51db810d7048 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1272 microversion: 2.1 time: 0.157297 Jul 18 03:48:57.897733 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3764/7519] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:48:57 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1272 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:48:58.914062 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6fcbe359-6210-4c93-8742-5897e9b15a15 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:48:58.914682 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6fcbe359-6210-4c93-8742-5897e9b15a15 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:48:58.921684 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6fcbe359-6210-4c93-8742-5897e9b15a15 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:58.922158 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6fcbe359-6210-4c93-8742-5897e9b15a15 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:58.922915 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6fcbe359-6210-4c93-8742-5897e9b15a15 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:58.923372 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6fcbe359-6210-4c93-8742-5897e9b15a15 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:59.063464 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6fcbe359-6210-4c93-8742-5897e9b15a15 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:48:59.071669 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6fcbe359-6210-4c93-8742-5897e9b15a15 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1260 microversion: 2.1 time: 0.161345 Jul 18 03:48:59.072573 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3756/7520] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:48:58 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:49:00.089003 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-97844b43-ae8a-46c6-91d3-775150030b3f tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:49:00.089664 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-97844b43-ae8a-46c6-91d3-775150030b3f tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:49:00.096826 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-97844b43-ae8a-46c6-91d3-775150030b3f tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:00.097293 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-97844b43-ae8a-46c6-91d3-775150030b3f tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:00.098107 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-97844b43-ae8a-46c6-91d3-775150030b3f tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:00.098564 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-97844b43-ae8a-46c6-91d3-775150030b3f tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:00.231174 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-97844b43-ae8a-46c6-91d3-775150030b3f tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:49:00.238820 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-97844b43-ae8a-46c6-91d3-775150030b3f tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1260 microversion: 2.1 time: 0.154027 Jul 18 03:49:00.239399 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3765/7521] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:49:00 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:49:01.257317 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-32b5c73d-4f1a-4d52-a5f7-01781fcc12af tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:49:01.257980 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-32b5c73d-4f1a-4d52-a5f7-01781fcc12af tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:49:01.260866 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:49:01.261540 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:49:01.268659 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-32b5c73d-4f1a-4d52-a5f7-01781fcc12af tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:01.269100 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-32b5c73d-4f1a-4d52-a5f7-01781fcc12af tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:01.269903 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-32b5c73d-4f1a-4d52-a5f7-01781fcc12af tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:01.270336 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-32b5c73d-4f1a-4d52-a5f7-01781fcc12af tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:01.411730 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-32b5c73d-4f1a-4d52-a5f7-01781fcc12af tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:49:01.420869 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-32b5c73d-4f1a-4d52-a5f7-01781fcc12af tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1260 microversion: 2.1 time: 0.167475 Jul 18 03:49:01.421474 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3757/7522] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:49:01 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:49:02.438531 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-10bd44bb-f416-4527-bf03-5945fa53741e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:49:02.439119 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-10bd44bb-f416-4527-bf03-5945fa53741e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:49:02.441839 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:49:02.448281 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-10bd44bb-f416-4527-bf03-5945fa53741e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:02.448746 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-10bd44bb-f416-4527-bf03-5945fa53741e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:02.449541 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-10bd44bb-f416-4527-bf03-5945fa53741e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:02.450024 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-10bd44bb-f416-4527-bf03-5945fa53741e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:02.588316 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-10bd44bb-f416-4527-bf03-5945fa53741e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:49:02.596284 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-10bd44bb-f416-4527-bf03-5945fa53741e tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1260 microversion: 2.1 time: 0.162449 Jul 18 03:49:02.596886 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3766/7523] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:49:02 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:49:03.613227 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-35e0cb94-f385-4382-8289-fab8c836b725 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:49:03.613882 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-35e0cb94-f385-4382-8289-fab8c836b725 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:49:03.620876 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-35e0cb94-f385-4382-8289-fab8c836b725 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:03.622028 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-35e0cb94-f385-4382-8289-fab8c836b725 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:03.622813 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-35e0cb94-f385-4382-8289-fab8c836b725 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:03.623258 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-35e0cb94-f385-4382-8289-fab8c836b725 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:03.758097 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-35e0cb94-f385-4382-8289-fab8c836b725 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:49:03.766149 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-35e0cb94-f385-4382-8289-fab8c836b725 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1260 microversion: 2.1 time: 0.156777 Jul 18 03:49:03.766749 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3758/7524] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:49:03 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:49:04.783191 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2a866064-5758-44d2-8b84-33f532afa5ce tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:49:04.783813 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2a866064-5758-44d2-8b84-33f532afa5ce tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:49:04.791159 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2a866064-5758-44d2-8b84-33f532afa5ce tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:04.791780 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2a866064-5758-44d2-8b84-33f532afa5ce tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:04.792564 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2a866064-5758-44d2-8b84-33f532afa5ce tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:04.793010 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2a866064-5758-44d2-8b84-33f532afa5ce tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:04.929208 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-2a866064-5758-44d2-8b84-33f532afa5ce tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:49:04.937835 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2a866064-5758-44d2-8b84-33f532afa5ce tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1260 microversion: 2.1 time: 0.158500 Jul 18 03:49:04.938411 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3767/7525] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:49:04 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:49:05.955544 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-de9dca1e-80ad-4f27-b251-64d1d1e55bb3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:49:05.956170 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-de9dca1e-80ad-4f27-b251-64d1d1e55bb3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:49:05.963540 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-de9dca1e-80ad-4f27-b251-64d1d1e55bb3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:05.963990 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-de9dca1e-80ad-4f27-b251-64d1d1e55bb3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:05.964764 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-de9dca1e-80ad-4f27-b251-64d1d1e55bb3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:05.965353 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-de9dca1e-80ad-4f27-b251-64d1d1e55bb3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:06.101472 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-de9dca1e-80ad-4f27-b251-64d1d1e55bb3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:49:06.110272 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-de9dca1e-80ad-4f27-b251-64d1d1e55bb3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1260 microversion: 2.1 time: 0.158456 Jul 18 03:49:06.110864 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3759/7526] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:49:05 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:49:07.128647 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6dc5ebcb-3e07-4631-ad76-f71ae60c3cab tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:49:07.129306 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6dc5ebcb-3e07-4631-ad76-f71ae60c3cab tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:49:07.136937 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6dc5ebcb-3e07-4631-ad76-f71ae60c3cab tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:07.137272 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6dc5ebcb-3e07-4631-ad76-f71ae60c3cab tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:07.138193 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6dc5ebcb-3e07-4631-ad76-f71ae60c3cab tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:07.138667 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6dc5ebcb-3e07-4631-ad76-f71ae60c3cab tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:07.282451 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6dc5ebcb-3e07-4631-ad76-f71ae60c3cab tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:49:07.290321 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6dc5ebcb-3e07-4631-ad76-f71ae60c3cab tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1260 microversion: 2.1 time: 0.165938 Jul 18 03:49:07.290912 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3768/7527] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:49:07 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:49:08.308186 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6d73be67-49d5-45e2-8bb7-8df850b7518c tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:49:08.310393 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6d73be67-49d5-45e2-8bb7-8df850b7518c tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:49:08.316870 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6d73be67-49d5-45e2-8bb7-8df850b7518c tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:08.317318 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6d73be67-49d5-45e2-8bb7-8df850b7518c tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:08.318121 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6d73be67-49d5-45e2-8bb7-8df850b7518c tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:08.318559 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6d73be67-49d5-45e2-8bb7-8df850b7518c tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:08.463355 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6d73be67-49d5-45e2-8bb7-8df850b7518c tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:49:08.471578 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6d73be67-49d5-45e2-8bb7-8df850b7518c tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1260 microversion: 2.1 time: 0.167227 Jul 18 03:49:08.472173 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3760/7528] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:49:08 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:49:09.489934 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6a592420-f127-4220-9d4b-e867804c7876 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:49:09.490558 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6a592420-f127-4220-9d4b-e867804c7876 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:49:09.497522 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a592420-f127-4220-9d4b-e867804c7876 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:09.498014 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a592420-f127-4220-9d4b-e867804c7876 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:09.498789 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a592420-f127-4220-9d4b-e867804c7876 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:09.499235 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a592420-f127-4220-9d4b-e867804c7876 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:09.639581 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6a592420-f127-4220-9d4b-e867804c7876 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:49:09.647558 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6a592420-f127-4220-9d4b-e867804c7876 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1260 microversion: 2.1 time: 0.161526 Jul 18 03:49:09.648144 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3769/7529] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:49:09 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:49:10.027379 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-43a9b42e-6a84-4ac1-98a0-13d9aff6ffde req-15a49515-3bde-457f-8b82-5fa00c8fe54a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8067855a-0f46-4fc9-8735-e829583c3024", "name": "network-vif-plugged", "status": "completed", "tag": "dfd79978-9919-4021-b8cf-877904b8e11a"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:49:10.036660 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-43a9b42e-6a84-4ac1-98a0-13d9aff6ffde req-15a49515-3bde-457f-8b82-5fa00c8fe54a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:10.037305 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-43a9b42e-6a84-4ac1-98a0-13d9aff6ffde req-15a49515-3bde-457f-8b82-5fa00c8fe54a service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:10.051190 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-43a9b42e-6a84-4ac1-98a0-13d9aff6ffde req-15a49515-3bde-457f-8b82-5fa00c8fe54a service nova] Creating event network-vif-plugged:dfd79978-9919-4021-b8cf-877904b8e11a for instance 8067855a-0f46-4fc9-8735-e829583c3024 on n-h1-465891-3 Jul 18 03:49:10.056592 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-43a9b42e-6a84-4ac1-98a0-13d9aff6ffde req-15a49515-3bde-457f-8b82-5fa00c8fe54a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033007 Jul 18 03:49:10.057564 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3761/7530] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:49:10.664737 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-15070432-36d6-4f9e-afd6-e588531bf079 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:49:10.665368 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-15070432-36d6-4f9e-afd6-e588531bf079 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:49:10.672607 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-15070432-36d6-4f9e-afd6-e588531bf079 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:10.673074 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-15070432-36d6-4f9e-afd6-e588531bf079 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:10.673884 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-15070432-36d6-4f9e-afd6-e588531bf079 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:10.674350 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-15070432-36d6-4f9e-afd6-e588531bf079 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:10.805018 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-15070432-36d6-4f9e-afd6-e588531bf079 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:49:10.813586 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-15070432-36d6-4f9e-afd6-e588531bf079 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1260 microversion: 2.1 time: 0.152646 Jul 18 03:49:10.814159 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3770/7531] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:49:10 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:49:11.831624 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5a18b767-39c5-4599-8f76-9df49b70def0 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:49:11.832323 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5a18b767-39c5-4599-8f76-9df49b70def0 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:49:11.839760 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5a18b767-39c5-4599-8f76-9df49b70def0 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:11.840815 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5a18b767-39c5-4599-8f76-9df49b70def0 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:11.841603 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5a18b767-39c5-4599-8f76-9df49b70def0 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:11.842066 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5a18b767-39c5-4599-8f76-9df49b70def0 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:11.990236 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5a18b767-39c5-4599-8f76-9df49b70def0 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:49:12.000388 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5a18b767-39c5-4599-8f76-9df49b70def0 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1444 microversion: 2.1 time: 0.173135 Jul 18 03:49:12.001443 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3762/7532] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:49:11 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1444 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:49:12.022263 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a01d8f22-addc-4e64-8d37-877f58c91eeb tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:49:12.022970 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a01d8f22-addc-4e64-8d37-877f58c91eeb tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:49:12.035739 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a01d8f22-addc-4e64-8d37-877f58c91eeb tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:12.036202 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a01d8f22-addc-4e64-8d37-877f58c91eeb tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:12.037264 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a01d8f22-addc-4e64-8d37-877f58c91eeb tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:12.037787 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a01d8f22-addc-4e64-8d37-877f58c91eeb tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:12.180320 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a01d8f22-addc-4e64-8d37-877f58c91eeb tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:49:12.189017 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a01d8f22-addc-4e64-8d37-877f58c91eeb tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1444 microversion: 2.1 time: 0.171686 Jul 18 03:49:12.189604 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3771/7533] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:49:12 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1444 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:49:13.855935 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-1a2be6af-70c5-47e6-9219-f834035afe16 req-8360c8c3-acf0-4e26-b21d-726b98f6a05d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8067855a-0f46-4fc9-8735-e829583c3024", "tag": "dfd79978-9919-4021-b8cf-877904b8e11a"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:49:13.865005 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-1a2be6af-70c5-47e6-9219-f834035afe16 req-8360c8c3-acf0-4e26-b21d-726b98f6a05d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:13.865532 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-1a2be6af-70c5-47e6-9219-f834035afe16 req-8360c8c3-acf0-4e26-b21d-726b98f6a05d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:13.877555 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-1a2be6af-70c5-47e6-9219-f834035afe16 req-8360c8c3-acf0-4e26-b21d-726b98f6a05d service nova] Creating event network-changed:dfd79978-9919-4021-b8cf-877904b8e11a for instance 8067855a-0f46-4fc9-8735-e829583c3024 on n-h1-465891-3 Jul 18 03:49:13.882714 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-1a2be6af-70c5-47e6-9219-f834035afe16 req-8360c8c3-acf0-4e26-b21d-726b98f6a05d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030487 Jul 18 03:49:13.883312 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3763/7534] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:49:34.672052 n-d-465891-3 devstack@n-api.service[119543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:49:34.672656 n-d-465891-3 devstack@n-api.service[119543]: Mon Jul 18 03:49:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:51:06.273053 n-d-465891-3 devstack@n-api.service[119543]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5744c86a-1c72-444c-9f09-2dc127b8032d] AMQP server on 10.222.0.57:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 18 03:51:06.274249 n-d-465891-3 devstack@n-api.service[119543]: ERROR oslo.messaging._drivers.impl_rabbit [-] [58d4ed9e-6c40-4e66-8cf1-b8f58c4998c2] AMQP server on 10.222.0.57:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 18 03:51:06.274839 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=24 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:51:06.275639 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=60 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:51:06.280758 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-14913018-9dde-451a-8948-6ef73e0ff238 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:51:06.281389 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-14913018-9dde-451a-8948-6ef73e0ff238 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:06.288548 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14913018-9dde-451a-8948-6ef73e0ff238 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:06.289013 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14913018-9dde-451a-8948-6ef73e0ff238 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:06.289838 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14913018-9dde-451a-8948-6ef73e0ff238 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:06.290292 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-14913018-9dde-451a-8948-6ef73e0ff238 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:06.315263 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-14913018-9dde-451a-8948-6ef73e0ff238 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lazy-loading 'flavor' on Instance uuid 8067855a-0f46-4fc9-8735-e829583c3024 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:51:06.397808 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-14913018-9dde-451a-8948-6ef73e0ff238 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "POST /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024/action" status: 202 len: 0 microversion: 2.1 time: 0.126110 Jul 18 03:51:06.398785 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3772/7535] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:51:06 2022] POST /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:51:06.406625 n-d-465891-3 devstack@n-api.service[119544]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2195f790-7bbc-4111-8106-e7ea837c20fc] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 03:51:06.407721 n-d-465891-3 devstack@n-api.service[119544]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bec20902-d336-4ab9-99dd-48825093cebe] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 03:51:06.408623 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:51:06.409458 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=56 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:51:06.414611 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-32c2d2fa-551a-4485-b8a6-70aee322503b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:06.415640 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-32c2d2fa-551a-4485-b8a6-70aee322503b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:06.425813 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-32c2d2fa-551a-4485-b8a6-70aee322503b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:06.426272 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-32c2d2fa-551a-4485-b8a6-70aee322503b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:06.427053 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-32c2d2fa-551a-4485-b8a6-70aee322503b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:06.427490 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-32c2d2fa-551a-4485-b8a6-70aee322503b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:06.629199 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-32c2d2fa-551a-4485-b8a6-70aee322503b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:06.637217 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-32c2d2fa-551a-4485-b8a6-70aee322503b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1569 microversion: 2.1 time: 0.232352 Jul 18 03:51:06.637846 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3764/7536] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:06 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1569 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:51:07.656339 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7b0689ae-13f5-4824-8dee-51d6a68a9f2b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:07.657059 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7b0689ae-13f5-4824-8dee-51d6a68a9f2b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:07.665979 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7b0689ae-13f5-4824-8dee-51d6a68a9f2b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:07.666437 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7b0689ae-13f5-4824-8dee-51d6a68a9f2b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:07.667285 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7b0689ae-13f5-4824-8dee-51d6a68a9f2b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:07.667821 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7b0689ae-13f5-4824-8dee-51d6a68a9f2b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:07.678862 n-d-465891-3 devstack@n-api.service[119543]: INFO oslo.messaging._drivers.impl_rabbit [-] [58d4ed9e-6c40-4e66-8cf1-b8f58c4998c2] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 54656. Jul 18 03:51:07.696864 n-d-465891-3 devstack@n-api.service[119543]: INFO oslo.messaging._drivers.impl_rabbit [-] [5744c86a-1c72-444c-9f09-2dc127b8032d] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 54654. Jul 18 03:51:07.858987 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-7b0689ae-13f5-4824-8dee-51d6a68a9f2b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:07.866662 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7b0689ae-13f5-4824-8dee-51d6a68a9f2b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1569 microversion: 2.1 time: 0.215781 Jul 18 03:51:07.867238 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3773/7537] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:07 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1569 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:51:08.884919 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-faffd81e-c0aa-40ac-bc04-d5ac5da6c0f1 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:08.885535 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-faffd81e-c0aa-40ac-bc04-d5ac5da6c0f1 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:08.895936 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-faffd81e-c0aa-40ac-bc04-d5ac5da6c0f1 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:08.896390 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-faffd81e-c0aa-40ac-bc04-d5ac5da6c0f1 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:08.897156 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-faffd81e-c0aa-40ac-bc04-d5ac5da6c0f1 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:08.897593 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-faffd81e-c0aa-40ac-bc04-d5ac5da6c0f1 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:08.902127 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [-] [2195f790-7bbc-4111-8106-e7ea837c20fc] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 54662. Jul 18 03:51:08.902861 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [-] [bec20902-d336-4ab9-99dd-48825093cebe] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 54664. Jul 18 03:51:09.038019 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-faffd81e-c0aa-40ac-bc04-d5ac5da6c0f1 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:09.045973 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-faffd81e-c0aa-40ac-bc04-d5ac5da6c0f1 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1569 microversion: 2.1 time: 0.165005 Jul 18 03:51:09.046564 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3765/7538] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:08 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:51:10.063179 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-588f2c2f-6824-4325-a96d-500dbc52e755 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:10.063799 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-588f2c2f-6824-4325-a96d-500dbc52e755 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:10.070811 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-588f2c2f-6824-4325-a96d-500dbc52e755 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:10.071279 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-588f2c2f-6824-4325-a96d-500dbc52e755 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:10.072066 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-588f2c2f-6824-4325-a96d-500dbc52e755 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:10.072516 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-588f2c2f-6824-4325-a96d-500dbc52e755 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:10.205881 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-588f2c2f-6824-4325-a96d-500dbc52e755 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:10.213436 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-588f2c2f-6824-4325-a96d-500dbc52e755 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1569 microversion: 2.1 time: 0.154503 Jul 18 03:51:10.214127 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3774/7539] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:10 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:51:11.230833 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e554ec0b-3219-482b-b7d6-e19b19d9a313 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:11.231423 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e554ec0b-3219-482b-b7d6-e19b19d9a313 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:11.238389 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e554ec0b-3219-482b-b7d6-e19b19d9a313 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:11.238847 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e554ec0b-3219-482b-b7d6-e19b19d9a313 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:11.239627 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e554ec0b-3219-482b-b7d6-e19b19d9a313 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:11.240064 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e554ec0b-3219-482b-b7d6-e19b19d9a313 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:11.379801 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e554ec0b-3219-482b-b7d6-e19b19d9a313 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:11.388305 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e554ec0b-3219-482b-b7d6-e19b19d9a313 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1569 microversion: 2.1 time: 0.161760 Jul 18 03:51:11.388894 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3766/7540] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:11 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:51:12.294589 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:51:12.295244 n-d-465891-3 devstack@n-api.service[119544]: Mon Jul 18 03:51:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:51:12.404612 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bceca326-1064-483e-a245-e4f93d06f26b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:12.405266 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bceca326-1064-483e-a245-e4f93d06f26b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:12.412291 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bceca326-1064-483e-a245-e4f93d06f26b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:12.412756 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bceca326-1064-483e-a245-e4f93d06f26b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:12.413531 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bceca326-1064-483e-a245-e4f93d06f26b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:12.414009 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bceca326-1064-483e-a245-e4f93d06f26b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:12.553555 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bceca326-1064-483e-a245-e4f93d06f26b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:12.562399 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bceca326-1064-483e-a245-e4f93d06f26b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1569 microversion: 2.1 time: 0.161865 Jul 18 03:51:12.562990 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3775/7541] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:12 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:51:13.580025 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-abc66e15-7beb-4a58-aeb3-285152fb8d41 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:13.580632 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-abc66e15-7beb-4a58-aeb3-285152fb8d41 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:13.587534 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-abc66e15-7beb-4a58-aeb3-285152fb8d41 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:13.587980 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-abc66e15-7beb-4a58-aeb3-285152fb8d41 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:13.588736 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-abc66e15-7beb-4a58-aeb3-285152fb8d41 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:13.589968 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-abc66e15-7beb-4a58-aeb3-285152fb8d41 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:13.719895 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-abc66e15-7beb-4a58-aeb3-285152fb8d41 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:13.727594 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-abc66e15-7beb-4a58-aeb3-285152fb8d41 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1569 microversion: 2.1 time: 0.151629 Jul 18 03:51:13.728159 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3767/7542] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:13 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:51:14.647280 n-d-465891-3 devstack@n-api.service[119543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:51:14.647831 n-d-465891-3 devstack@n-api.service[119543]: Mon Jul 18 03:51:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:51:14.744347 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4f3b61ca-3bc2-47f3-a0dc-776d78da2f76 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:14.745074 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4f3b61ca-3bc2-47f3-a0dc-776d78da2f76 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:14.753368 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4f3b61ca-3bc2-47f3-a0dc-776d78da2f76 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:14.753875 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4f3b61ca-3bc2-47f3-a0dc-776d78da2f76 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:14.754957 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4f3b61ca-3bc2-47f3-a0dc-776d78da2f76 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:14.755402 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4f3b61ca-3bc2-47f3-a0dc-776d78da2f76 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:14.893505 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4f3b61ca-3bc2-47f3-a0dc-776d78da2f76 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:14.901149 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4f3b61ca-3bc2-47f3-a0dc-776d78da2f76 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1569 microversion: 2.1 time: 0.160669 Jul 18 03:51:14.902429 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3776/7543] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:14 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:51:15.919934 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f5b8357c-8c2c-4456-b0f0-2d7a0b646484 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:15.920563 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f5b8357c-8c2c-4456-b0f0-2d7a0b646484 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:15.927629 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f5b8357c-8c2c-4456-b0f0-2d7a0b646484 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:15.928059 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f5b8357c-8c2c-4456-b0f0-2d7a0b646484 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:15.928812 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f5b8357c-8c2c-4456-b0f0-2d7a0b646484 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:15.929241 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f5b8357c-8c2c-4456-b0f0-2d7a0b646484 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:16.098541 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-f5b8357c-8c2c-4456-b0f0-2d7a0b646484 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:16.108802 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f5b8357c-8c2c-4456-b0f0-2d7a0b646484 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1569 microversion: 2.1 time: 0.193700 Jul 18 03:51:16.109466 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3768/7544] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:15 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1569 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:51:17.126581 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-fa4fff49-f4e5-474b-a4e7-c4d63883bf83 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:17.127225 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-fa4fff49-f4e5-474b-a4e7-c4d63883bf83 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:17.136157 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fa4fff49-f4e5-474b-a4e7-c4d63883bf83 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:17.136673 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fa4fff49-f4e5-474b-a4e7-c4d63883bf83 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:17.137891 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fa4fff49-f4e5-474b-a4e7-c4d63883bf83 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:17.138355 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-fa4fff49-f4e5-474b-a4e7-c4d63883bf83 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:17.296491 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-fa4fff49-f4e5-474b-a4e7-c4d63883bf83 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:17.304953 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-fa4fff49-f4e5-474b-a4e7-c4d63883bf83 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1569 microversion: 2.1 time: 0.182604 Jul 18 03:51:17.305535 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3777/7545] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:17 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:51:18.322072 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-41882a55-2e8d-4e76-b6d1-b8a1d747609a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:18.322677 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-41882a55-2e8d-4e76-b6d1-b8a1d747609a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:18.329984 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-41882a55-2e8d-4e76-b6d1-b8a1d747609a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:18.330439 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-41882a55-2e8d-4e76-b6d1-b8a1d747609a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:18.331201 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-41882a55-2e8d-4e76-b6d1-b8a1d747609a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:18.331636 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-41882a55-2e8d-4e76-b6d1-b8a1d747609a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:18.462242 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-41882a55-2e8d-4e76-b6d1-b8a1d747609a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:18.470091 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-41882a55-2e8d-4e76-b6d1-b8a1d747609a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1569 microversion: 2.1 time: 0.151819 Jul 18 03:51:18.470674 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3769/7546] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:18 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:51:19.487564 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-ec2f24ad-5a92-4e86-81aa-c33b196ab7bc tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:19.488331 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-ec2f24ad-5a92-4e86-81aa-c33b196ab7bc tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:19.495338 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ec2f24ad-5a92-4e86-81aa-c33b196ab7bc tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:19.495808 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ec2f24ad-5a92-4e86-81aa-c33b196ab7bc tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:19.496602 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ec2f24ad-5a92-4e86-81aa-c33b196ab7bc tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:19.498384 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-ec2f24ad-5a92-4e86-81aa-c33b196ab7bc tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:19.650632 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-ec2f24ad-5a92-4e86-81aa-c33b196ab7bc tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:19.659419 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-ec2f24ad-5a92-4e86-81aa-c33b196ab7bc tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1569 microversion: 2.1 time: 0.175629 Jul 18 03:51:19.660020 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3778/7547] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:19 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:51:20.676931 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-4598ee5d-7ec9-4d1f-b4c7-c5fc38b33bfd tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:20.677532 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-4598ee5d-7ec9-4d1f-b4c7-c5fc38b33bfd tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:20.685299 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4598ee5d-7ec9-4d1f-b4c7-c5fc38b33bfd tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:20.685903 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4598ee5d-7ec9-4d1f-b4c7-c5fc38b33bfd tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:20.686683 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4598ee5d-7ec9-4d1f-b4c7-c5fc38b33bfd tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:20.687122 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-4598ee5d-7ec9-4d1f-b4c7-c5fc38b33bfd tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:20.818750 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-4598ee5d-7ec9-4d1f-b4c7-c5fc38b33bfd tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:20.827039 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-4598ee5d-7ec9-4d1f-b4c7-c5fc38b33bfd tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1570 microversion: 2.1 time: 0.153951 Jul 18 03:51:20.827643 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3770/7548] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:20 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:51:20.843497 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-934505ae-1b06-4685-89a4-7cf2f41bc7ac tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:51:20.844078 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-934505ae-1b06-4685-89a4-7cf2f41bc7ac tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:20.851015 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-934505ae-1b06-4685-89a4-7cf2f41bc7ac tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:20.851475 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-934505ae-1b06-4685-89a4-7cf2f41bc7ac tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:20.852246 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-934505ae-1b06-4685-89a4-7cf2f41bc7ac tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:20.852694 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-934505ae-1b06-4685-89a4-7cf2f41bc7ac tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:20.987985 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-934505ae-1b06-4685-89a4-7cf2f41bc7ac tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "POST /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024/action" status: 202 len: 0 microversion: 2.1 time: 0.148142 Jul 18 03:51:20.988681 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3779/7549] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:51:20 2022] POST /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 03:51:20.999222 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6972a2bb-2209-4254-a112-d643def3a5f3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:21.000474 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6972a2bb-2209-4254-a112-d643def3a5f3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:21.011500 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6972a2bb-2209-4254-a112-d643def3a5f3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:21.012028 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6972a2bb-2209-4254-a112-d643def3a5f3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:21.019033 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6972a2bb-2209-4254-a112-d643def3a5f3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:21.019581 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6972a2bb-2209-4254-a112-d643def3a5f3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:21.166253 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6972a2bb-2209-4254-a112-d643def3a5f3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:21.174247 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6972a2bb-2209-4254-a112-d643def3a5f3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1518 microversion: 2.1 time: 0.180925 Jul 18 03:51:21.174835 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3771/7550] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:20 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1518 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:51:22.195920 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-46edf07c-3dc7-4a54-956e-469137e636b4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:22.197003 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-46edf07c-3dc7-4a54-956e-469137e636b4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:22.203897 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-46edf07c-3dc7-4a54-956e-469137e636b4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:22.204406 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-46edf07c-3dc7-4a54-956e-469137e636b4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:22.205317 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-46edf07c-3dc7-4a54-956e-469137e636b4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:22.205657 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-46edf07c-3dc7-4a54-956e-469137e636b4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:22.379334 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-46edf07c-3dc7-4a54-956e-469137e636b4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:22.393001 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-46edf07c-3dc7-4a54-956e-469137e636b4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1518 microversion: 2.1 time: 0.204493 Jul 18 03:51:22.394416 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3780/7551] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:22 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1518 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:51:22.664095 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-d9df93a8-cc40-43d9-aab5-585fe36a2364 req-cabba995-2ab0-4b98-ad5c-76535b2b5c89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8067855a-0f46-4fc9-8735-e829583c3024", "name": "network-vif-unplugged", "status": "completed", "tag": "dfd79978-9919-4021-b8cf-877904b8e11a"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:51:22.674291 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-d9df93a8-cc40-43d9-aab5-585fe36a2364 req-cabba995-2ab0-4b98-ad5c-76535b2b5c89 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:22.674701 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-d9df93a8-cc40-43d9-aab5-585fe36a2364 req-cabba995-2ab0-4b98-ad5c-76535b2b5c89 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:22.687487 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.compute.server_external_events [req-d9df93a8-cc40-43d9-aab5-585fe36a2364 req-cabba995-2ab0-4b98-ad5c-76535b2b5c89 service nova] Unable to find a host for instance 8067855a-0f46-4fc9-8735-e829583c3024. Dropping event network-vif-unplugged {{(pid=119544) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 18 03:51:22.688372 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-d9df93a8-cc40-43d9-aab5-585fe36a2364 req-cabba995-2ab0-4b98-ad5c-76535b2b5c89 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028412 Jul 18 03:51:22.688974 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3772/7552] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 18 03:51:23.410967 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-98557fc5-7100-4b7f-b765-9a8aff4228df tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:23.411615 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-98557fc5-7100-4b7f-b765-9a8aff4228df tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:23.418595 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-98557fc5-7100-4b7f-b765-9a8aff4228df tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:23.419056 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-98557fc5-7100-4b7f-b765-9a8aff4228df tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:23.419860 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-98557fc5-7100-4b7f-b765-9a8aff4228df tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:23.420301 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-98557fc5-7100-4b7f-b765-9a8aff4228df tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:23.550860 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-98557fc5-7100-4b7f-b765-9a8aff4228df tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:23.564106 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-98557fc5-7100-4b7f-b765-9a8aff4228df tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1518 microversion: 2.1 time: 0.156898 Jul 18 03:51:23.565532 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3781/7553] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:23 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:51:24.585549 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-019907b8-0f77-4f05-adaa-20a92dce009c tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:24.586530 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-019907b8-0f77-4f05-adaa-20a92dce009c tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:24.594642 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-019907b8-0f77-4f05-adaa-20a92dce009c tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:24.595100 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-019907b8-0f77-4f05-adaa-20a92dce009c tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:24.595886 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-019907b8-0f77-4f05-adaa-20a92dce009c tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:24.596326 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-019907b8-0f77-4f05-adaa-20a92dce009c tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:24.735509 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-019907b8-0f77-4f05-adaa-20a92dce009c tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:24.743400 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-019907b8-0f77-4f05-adaa-20a92dce009c tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1520 microversion: 2.1 time: 0.163887 Jul 18 03:51:24.743983 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3773/7554] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:24 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:51:25.761236 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bf5f19a3-47d6-4964-81cc-99ed5731b6b2 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:25.761902 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bf5f19a3-47d6-4964-81cc-99ed5731b6b2 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:25.769352 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bf5f19a3-47d6-4964-81cc-99ed5731b6b2 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:25.769850 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bf5f19a3-47d6-4964-81cc-99ed5731b6b2 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:25.772003 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bf5f19a3-47d6-4964-81cc-99ed5731b6b2 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:25.772460 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bf5f19a3-47d6-4964-81cc-99ed5731b6b2 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:25.916043 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bf5f19a3-47d6-4964-81cc-99ed5731b6b2 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:25.924098 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bf5f19a3-47d6-4964-81cc-99ed5731b6b2 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1520 microversion: 2.1 time: 0.166607 Jul 18 03:51:25.924694 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3782/7555] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:25 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:51:26.941506 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e4a72d13-c72c-49d7-a111-24db9afa9337 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:26.942187 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e4a72d13-c72c-49d7-a111-24db9afa9337 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:26.949389 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e4a72d13-c72c-49d7-a111-24db9afa9337 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:26.949868 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e4a72d13-c72c-49d7-a111-24db9afa9337 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:26.950642 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e4a72d13-c72c-49d7-a111-24db9afa9337 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:26.951074 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e4a72d13-c72c-49d7-a111-24db9afa9337 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:27.095409 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e4a72d13-c72c-49d7-a111-24db9afa9337 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:27.103253 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e4a72d13-c72c-49d7-a111-24db9afa9337 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1520 microversion: 2.1 time: 0.166484 Jul 18 03:51:27.103838 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3774/7556] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:26 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:51:28.120510 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d5e1927f-dff8-40b7-b09d-10d7009206db tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:28.121158 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d5e1927f-dff8-40b7-b09d-10d7009206db tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:28.129813 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5e1927f-dff8-40b7-b09d-10d7009206db tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:28.130287 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5e1927f-dff8-40b7-b09d-10d7009206db tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:28.131080 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5e1927f-dff8-40b7-b09d-10d7009206db tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:28.131537 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d5e1927f-dff8-40b7-b09d-10d7009206db tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:28.269782 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d5e1927f-dff8-40b7-b09d-10d7009206db tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:28.277907 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d5e1927f-dff8-40b7-b09d-10d7009206db tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1520 microversion: 2.1 time: 0.161193 Jul 18 03:51:28.278499 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3783/7557] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:28 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:51:29.295929 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b5afb7e6-b1f2-4d82-b696-aa46c536ddd3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:29.296686 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b5afb7e6-b1f2-4d82-b696-aa46c536ddd3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:29.304496 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b5afb7e6-b1f2-4d82-b696-aa46c536ddd3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:29.304947 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b5afb7e6-b1f2-4d82-b696-aa46c536ddd3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:29.305736 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b5afb7e6-b1f2-4d82-b696-aa46c536ddd3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:29.306173 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b5afb7e6-b1f2-4d82-b696-aa46c536ddd3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:29.521159 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b5afb7e6-b1f2-4d82-b696-aa46c536ddd3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:29.530639 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b5afb7e6-b1f2-4d82-b696-aa46c536ddd3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1576 microversion: 2.1 time: 0.239212 Jul 18 03:51:29.531256 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3775/7558] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:29 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1576 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:51:30.548830 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-da8aa9d2-a3c2-44c1-bf88-c62d411c9447 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:30.549567 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-da8aa9d2-a3c2-44c1-bf88-c62d411c9447 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:30.556745 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-da8aa9d2-a3c2-44c1-bf88-c62d411c9447 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:30.557209 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-da8aa9d2-a3c2-44c1-bf88-c62d411c9447 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:30.558030 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-da8aa9d2-a3c2-44c1-bf88-c62d411c9447 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:30.558483 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-da8aa9d2-a3c2-44c1-bf88-c62d411c9447 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:30.708331 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-da8aa9d2-a3c2-44c1-bf88-c62d411c9447 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:30.715947 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-da8aa9d2-a3c2-44c1-bf88-c62d411c9447 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1576 microversion: 2.1 time: 0.171887 Jul 18 03:51:30.716536 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3784/7559] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:30 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:51:31.734708 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1c0c91ea-7de4-4dcc-acd4-09ead515e2b3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:31.735533 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1c0c91ea-7de4-4dcc-acd4-09ead515e2b3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:31.742064 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1c0c91ea-7de4-4dcc-acd4-09ead515e2b3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:31.742513 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1c0c91ea-7de4-4dcc-acd4-09ead515e2b3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:31.743281 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1c0c91ea-7de4-4dcc-acd4-09ead515e2b3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:31.743718 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1c0c91ea-7de4-4dcc-acd4-09ead515e2b3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:31.879548 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1c0c91ea-7de4-4dcc-acd4-09ead515e2b3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:31.887280 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1c0c91ea-7de4-4dcc-acd4-09ead515e2b3 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1576 microversion: 2.1 time: 0.157390 Jul 18 03:51:31.887869 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3776/7560] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:31 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:51:32.906299 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-4b060dca-1c95-42d7-9b36-756ad83def8b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:32.906956 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-4b060dca-1c95-42d7-9b36-756ad83def8b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:32.914116 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4b060dca-1c95-42d7-9b36-756ad83def8b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:32.914569 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4b060dca-1c95-42d7-9b36-756ad83def8b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:32.915342 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4b060dca-1c95-42d7-9b36-756ad83def8b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:32.915782 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-4b060dca-1c95-42d7-9b36-756ad83def8b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:32.935138 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:51:33.064736 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-4b060dca-1c95-42d7-9b36-756ad83def8b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:33.072790 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-4b060dca-1c95-42d7-9b36-756ad83def8b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1576 microversion: 2.1 time: 0.171513 Jul 18 03:51:33.073394 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3785/7561] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:32 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:51:34.090284 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-19c6579c-d451-4d8e-a55e-62c56cce0301 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:34.090878 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-19c6579c-d451-4d8e-a55e-62c56cce0301 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:34.098993 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-19c6579c-d451-4d8e-a55e-62c56cce0301 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:34.099447 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-19c6579c-d451-4d8e-a55e-62c56cce0301 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:34.100245 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-19c6579c-d451-4d8e-a55e-62c56cce0301 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:34.100687 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-19c6579c-d451-4d8e-a55e-62c56cce0301 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:34.242882 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-19c6579c-d451-4d8e-a55e-62c56cce0301 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:34.251069 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-19c6579c-d451-4d8e-a55e-62c56cce0301 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1576 microversion: 2.1 time: 0.164648 Jul 18 03:51:34.251650 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3777/7562] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:34 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:51:35.268416 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e24e6e0c-d89c-4ff1-bf2e-d3803d1aa65a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:35.269042 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e24e6e0c-d89c-4ff1-bf2e-d3803d1aa65a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:35.276320 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e24e6e0c-d89c-4ff1-bf2e-d3803d1aa65a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:35.276782 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e24e6e0c-d89c-4ff1-bf2e-d3803d1aa65a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:35.277576 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e24e6e0c-d89c-4ff1-bf2e-d3803d1aa65a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:35.278052 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e24e6e0c-d89c-4ff1-bf2e-d3803d1aa65a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:35.417315 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e24e6e0c-d89c-4ff1-bf2e-d3803d1aa65a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:35.425645 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e24e6e0c-d89c-4ff1-bf2e-d3803d1aa65a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1576 microversion: 2.1 time: 0.161070 Jul 18 03:51:35.426256 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3786/7563] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:35 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:51:36.443682 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-6f9755f5-192e-4d03-ba42-225f8de919e4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:36.444291 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-6f9755f5-192e-4d03-ba42-225f8de919e4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:36.447080 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=29 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:51:36.453119 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6f9755f5-192e-4d03-ba42-225f8de919e4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:36.453571 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6f9755f5-192e-4d03-ba42-225f8de919e4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:36.454372 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6f9755f5-192e-4d03-ba42-225f8de919e4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:36.454808 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-6f9755f5-192e-4d03-ba42-225f8de919e4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:36.457960 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=81 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:51:36.602585 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-6f9755f5-192e-4d03-ba42-225f8de919e4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:36.613215 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-6f9755f5-192e-4d03-ba42-225f8de919e4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1576 microversion: 2.1 time: 0.173939 Jul 18 03:51:36.613885 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3778/7564] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:36 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:51:36.760641 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:51:36.760949 n-d-465891-3 devstack@n-api.service[119544]: Mon Jul 18 03:51:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:51:37.631449 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-b7ba9567-89c2-4715-9f7b-13f6ed21bad4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:37.632362 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-b7ba9567-89c2-4715-9f7b-13f6ed21bad4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:37.636346 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=33 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:51:37.643580 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b7ba9567-89c2-4715-9f7b-13f6ed21bad4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:37.644049 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b7ba9567-89c2-4715-9f7b-13f6ed21bad4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:37.644855 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b7ba9567-89c2-4715-9f7b-13f6ed21bad4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:37.645305 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-b7ba9567-89c2-4715-9f7b-13f6ed21bad4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:37.789830 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-b7ba9567-89c2-4715-9f7b-13f6ed21bad4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:37.800523 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-b7ba9567-89c2-4715-9f7b-13f6ed21bad4 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1576 microversion: 2.1 time: 0.173172 Jul 18 03:51:37.801139 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3787/7565] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:37 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:51:38.820858 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ac603eb1-60a1-41f8-b906-1a66376aec86 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:38.821464 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-ac603eb1-60a1-41f8-b906-1a66376aec86 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:38.829427 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ac603eb1-60a1-41f8-b906-1a66376aec86 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:38.829908 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ac603eb1-60a1-41f8-b906-1a66376aec86 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:38.830690 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ac603eb1-60a1-41f8-b906-1a66376aec86 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:38.831162 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-ac603eb1-60a1-41f8-b906-1a66376aec86 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:38.976269 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-ac603eb1-60a1-41f8-b906-1a66376aec86 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:38.984170 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ac603eb1-60a1-41f8-b906-1a66376aec86 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1576 microversion: 2.1 time: 0.167441 Jul 18 03:51:38.984720 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3779/7566] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:38 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:51:40.002041 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-751fd973-09c9-4190-938b-01216d817d86 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:40.002725 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-751fd973-09c9-4190-938b-01216d817d86 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:40.010027 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-751fd973-09c9-4190-938b-01216d817d86 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:40.010494 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-751fd973-09c9-4190-938b-01216d817d86 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:40.011288 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-751fd973-09c9-4190-938b-01216d817d86 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:40.011744 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-751fd973-09c9-4190-938b-01216d817d86 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:40.147309 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-751fd973-09c9-4190-938b-01216d817d86 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:40.155569 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-751fd973-09c9-4190-938b-01216d817d86 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1576 microversion: 2.1 time: 0.158275 Jul 18 03:51:40.156150 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3788/7567] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:39 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:51:40.865376 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-1abd8c34-b1e2-4cb7-ad98-44dfd194acf4 req-6d7129bb-d366-42d4-b562-b7adc9e6fb12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8067855a-0f46-4fc9-8735-e829583c3024", "name": "network-vif-plugged", "status": "completed", "tag": "dfd79978-9919-4021-b8cf-877904b8e11a"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:51:40.874857 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-1abd8c34-b1e2-4cb7-ad98-44dfd194acf4 req-6d7129bb-d366-42d4-b562-b7adc9e6fb12 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:40.875310 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-1abd8c34-b1e2-4cb7-ad98-44dfd194acf4 req-6d7129bb-d366-42d4-b562-b7adc9e6fb12 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:40.887671 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-1abd8c34-b1e2-4cb7-ad98-44dfd194acf4 req-6d7129bb-d366-42d4-b562-b7adc9e6fb12 service nova] Creating event network-vif-plugged:dfd79978-9919-4021-b8cf-877904b8e11a for instance 8067855a-0f46-4fc9-8735-e829583c3024 on n-h1-465891-3 Jul 18 03:51:40.894362 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-1abd8c34-b1e2-4cb7-ad98-44dfd194acf4 req-6d7129bb-d366-42d4-b562-b7adc9e6fb12 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090801 Jul 18 03:51:40.895207 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3780/7568] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:51:41.173605 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-248de30e-6038-4f03-992c-e3155da8f912 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:41.174498 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-248de30e-6038-4f03-992c-e3155da8f912 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:41.186041 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-248de30e-6038-4f03-992c-e3155da8f912 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:41.186704 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-248de30e-6038-4f03-992c-e3155da8f912 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:41.188492 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-248de30e-6038-4f03-992c-e3155da8f912 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:41.189020 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-248de30e-6038-4f03-992c-e3155da8f912 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:41.340627 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-248de30e-6038-4f03-992c-e3155da8f912 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:41.349848 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-248de30e-6038-4f03-992c-e3155da8f912 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1576 microversion: 2.1 time: 0.181077 Jul 18 03:51:41.350451 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3789/7569] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:41 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1576 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:51:42.369545 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8af69794-878e-4095-af7d-2f71c091ae3c tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:42.370467 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8af69794-878e-4095-af7d-2f71c091ae3c tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:42.380697 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8af69794-878e-4095-af7d-2f71c091ae3c tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:42.381294 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8af69794-878e-4095-af7d-2f71c091ae3c tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:42.382245 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8af69794-878e-4095-af7d-2f71c091ae3c tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:42.382852 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8af69794-878e-4095-af7d-2f71c091ae3c tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:42.555930 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8af69794-878e-4095-af7d-2f71c091ae3c tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:42.574283 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8af69794-878e-4095-af7d-2f71c091ae3c tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1576 microversion: 2.1 time: 0.209846 Jul 18 03:51:42.575109 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3781/7570] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:42 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1576 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:51:43.594467 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-f1751982-daf2-48de-9287-d90ac6d13afa tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:43.595178 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-f1751982-daf2-48de-9287-d90ac6d13afa tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:43.602556 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f1751982-daf2-48de-9287-d90ac6d13afa tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:43.603014 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f1751982-daf2-48de-9287-d90ac6d13afa tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:43.603820 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f1751982-daf2-48de-9287-d90ac6d13afa tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:43.604299 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-f1751982-daf2-48de-9287-d90ac6d13afa tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:43.763313 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-f1751982-daf2-48de-9287-d90ac6d13afa tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:43.775906 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-f1751982-daf2-48de-9287-d90ac6d13afa tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1563 microversion: 2.1 time: 0.185168 Jul 18 03:51:43.776781 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3790/7571] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:43 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1563 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:53:00.369358 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=7 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:53:00.372510 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=7 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:53:00.373263 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=32 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:53:00.374963 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=19 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:53:00.379118 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-7e32963a-23f3-4c0d-99a9-7c8b9b526838 req-3ceaa568-3550-44b8-bd6b-cf3bd165c3cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8067855a-0f46-4fc9-8735-e829583c3024", "tag": "dfd79978-9919-4021-b8cf-877904b8e11a"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:53:00.390324 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-f04991e3-9006-4216-89dd-076965a67711 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:53:00.390817 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f04991e3-9006-4216-89dd-076965a67711 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:00.397740 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-7e32963a-23f3-4c0d-99a9-7c8b9b526838 req-3ceaa568-3550-44b8-bd6b-cf3bd165c3cd service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:00.398355 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-7e32963a-23f3-4c0d-99a9-7c8b9b526838 req-3ceaa568-3550-44b8-bd6b-cf3bd165c3cd service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:00.400651 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f04991e3-9006-4216-89dd-076965a67711 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:00.401246 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f04991e3-9006-4216-89dd-076965a67711 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:00.402210 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f04991e3-9006-4216-89dd-076965a67711 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:00.402652 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-f04991e3-9006-4216-89dd-076965a67711 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:00.410211 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-7e32963a-23f3-4c0d-99a9-7c8b9b526838 req-3ceaa568-3550-44b8-bd6b-cf3bd165c3cd service nova] Creating event network-changed:dfd79978-9919-4021-b8cf-877904b8e11a for instance 8067855a-0f46-4fc9-8735-e829583c3024 on n-h1-465891-3 Jul 18 03:53:00.416064 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-7e32963a-23f3-4c0d-99a9-7c8b9b526838 req-3ceaa568-3550-44b8-bd6b-cf3bd165c3cd service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045118 Jul 18 03:53:00.416991 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3791/7572] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:53:00.433097 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-f04991e3-9006-4216-89dd-076965a67711 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Going to try to terminate instance {{(pid=119544) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:53:00.517261 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-f04991e3-9006-4216-89dd-076965a67711 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 204 len: 0 microversion: 2.1 time: 0.149438 Jul 18 03:53:00.521171 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3782/7573] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:53:00 2022] DELETE /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:53:00.527697 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8338af2c-ef53-4e68-ba24-5dbd5464cce7 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:53:00.528416 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8338af2c-ef53-4e68-ba24-5dbd5464cce7 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:00.534909 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8338af2c-ef53-4e68-ba24-5dbd5464cce7 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:00.535366 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8338af2c-ef53-4e68-ba24-5dbd5464cce7 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:00.536352 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8338af2c-ef53-4e68-ba24-5dbd5464cce7 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:00.536803 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8338af2c-ef53-4e68-ba24-5dbd5464cce7 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:00.718599 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8338af2c-ef53-4e68-ba24-5dbd5464cce7 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:53:00.727647 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8338af2c-ef53-4e68-ba24-5dbd5464cce7 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1569 microversion: 2.1 time: 0.203930 Jul 18 03:53:00.728667 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3792/7574] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:53:00 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1569 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:53:01.746195 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e9e24f8a-c1c8-476c-a190-fe6f41fcba29 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:53:01.747583 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e9e24f8a-c1c8-476c-a190-fe6f41fcba29 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:01.757435 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e9e24f8a-c1c8-476c-a190-fe6f41fcba29 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:01.757910 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e9e24f8a-c1c8-476c-a190-fe6f41fcba29 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:01.758697 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e9e24f8a-c1c8-476c-a190-fe6f41fcba29 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:01.759625 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e9e24f8a-c1c8-476c-a190-fe6f41fcba29 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:01.894117 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e9e24f8a-c1c8-476c-a190-fe6f41fcba29 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:53:01.902496 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e9e24f8a-c1c8-476c-a190-fe6f41fcba29 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1569 microversion: 2.1 time: 0.160650 Jul 18 03:53:01.903077 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3783/7575] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:53:01 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:53:02.752109 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-7b377739-a739-4280-98f2-b3fe3d881f3b req-cf9d5e02-3fe2-4084-bf20-5ba265c38f0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8067855a-0f46-4fc9-8735-e829583c3024", "name": "network-vif-deleted", "tag": "dfd79978-9919-4021-b8cf-877904b8e11a"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:53:02.761763 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-7b377739-a739-4280-98f2-b3fe3d881f3b req-cf9d5e02-3fe2-4084-bf20-5ba265c38f0d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:02.762231 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-7b377739-a739-4280-98f2-b3fe3d881f3b req-cf9d5e02-3fe2-4084-bf20-5ba265c38f0d service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:02.773836 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-7b377739-a739-4280-98f2-b3fe3d881f3b req-cf9d5e02-3fe2-4084-bf20-5ba265c38f0d service nova] Creating event network-vif-deleted:dfd79978-9919-4021-b8cf-877904b8e11a for instance 8067855a-0f46-4fc9-8735-e829583c3024 on n-h1-465891-3 Jul 18 03:53:02.779013 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-7b377739-a739-4280-98f2-b3fe3d881f3b req-cf9d5e02-3fe2-4084-bf20-5ba265c38f0d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030831 Jul 18 03:53:02.779620 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3793/7576] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:53:02.919838 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-8d230ef2-8869-4c73-b2f6-d090ba28c190 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:53:02.920491 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-8d230ef2-8869-4c73-b2f6-d090ba28c190 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:02.927548 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8d230ef2-8869-4c73-b2f6-d090ba28c190 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:02.928575 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8d230ef2-8869-4c73-b2f6-d090ba28c190 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:02.929364 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8d230ef2-8869-4c73-b2f6-d090ba28c190 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:02.929848 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-8d230ef2-8869-4c73-b2f6-d090ba28c190 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:02.996448 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-8d230ef2-8869-4c73-b2f6-d090ba28c190 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:53:03.005607 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-8d230ef2-8869-4c73-b2f6-d090ba28c190 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1219 microversion: 2.1 time: 0.089713 Jul 18 03:53:03.007473 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3784/7577] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:53:02 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:53:04.025908 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-95dce225-ed01-459a-b3b2-e2b286ad2ac6 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:53:04.027221 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-95dce225-ed01-459a-b3b2-e2b286ad2ac6 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:04.035321 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-95dce225-ed01-459a-b3b2-e2b286ad2ac6 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:04.035793 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-95dce225-ed01-459a-b3b2-e2b286ad2ac6 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:04.036603 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-95dce225-ed01-459a-b3b2-e2b286ad2ac6 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:04.038089 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-95dce225-ed01-459a-b3b2-e2b286ad2ac6 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:04.106975 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-95dce225-ed01-459a-b3b2-e2b286ad2ac6 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:53:04.116712 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-95dce225-ed01-459a-b3b2-e2b286ad2ac6 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1219 microversion: 2.1 time: 0.094519 Jul 18 03:53:04.117314 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3794/7578] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:53:04 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:53:05.134545 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e0985547-281e-41b1-bda9-f0a289278113 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:53:05.135177 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e0985547-281e-41b1-bda9-f0a289278113 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:05.142372 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e0985547-281e-41b1-bda9-f0a289278113 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:05.142823 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e0985547-281e-41b1-bda9-f0a289278113 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:05.143601 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e0985547-281e-41b1-bda9-f0a289278113 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:05.144037 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e0985547-281e-41b1-bda9-f0a289278113 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:05.210856 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e0985547-281e-41b1-bda9-f0a289278113 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:53:05.218803 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e0985547-281e-41b1-bda9-f0a289278113 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1219 microversion: 2.1 time: 0.088848 Jul 18 03:53:05.219399 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3785/7579] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:53:05 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:53:06.235591 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6752edda-f118-46e3-82fd-b1c18c86bf6b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:53:06.236226 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6752edda-f118-46e3-82fd-b1c18c86bf6b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:06.243795 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6752edda-f118-46e3-82fd-b1c18c86bf6b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:06.244263 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6752edda-f118-46e3-82fd-b1c18c86bf6b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:06.245064 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6752edda-f118-46e3-82fd-b1c18c86bf6b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:06.245526 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6752edda-f118-46e3-82fd-b1c18c86bf6b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:06.311963 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6752edda-f118-46e3-82fd-b1c18c86bf6b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:53:06.320233 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6752edda-f118-46e3-82fd-b1c18c86bf6b tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1219 microversion: 2.1 time: 0.088546 Jul 18 03:53:06.321400 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3795/7580] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:53:06 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:53:07.338282 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-795cc414-3613-4ea0-b558-e956ab313841 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:53:07.339025 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-795cc414-3613-4ea0-b558-e956ab313841 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:07.346064 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-795cc414-3613-4ea0-b558-e956ab313841 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:07.346517 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-795cc414-3613-4ea0-b558-e956ab313841 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:07.347323 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-795cc414-3613-4ea0-b558-e956ab313841 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:07.347760 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-795cc414-3613-4ea0-b558-e956ab313841 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:07.387291 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-795cc414-3613-4ea0-b558-e956ab313841 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:07.387652 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-795cc414-3613-4ea0-b558-e956ab313841 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:07.388101 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.objects.instance [None req-795cc414-3613-4ea0-b558-e956ab313841 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lazy-loading 'fault' on Instance uuid 8067855a-0f46-4fc9-8735-e829583c3024 {{(pid=119544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:53:07.438490 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-795cc414-3613-4ea0-b558-e956ab313841 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8fcf3285d647cb9fb9f126531750d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f05e19f28ee40c58936bcc9fc8baedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:53:07.446471 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-795cc414-3613-4ea0-b558-e956ab313841 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 200 len: 1178 microversion: 2.1 time: 0.112541 Jul 18 03:53:07.452553 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3786/7581] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:53:07 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 1178 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:53:08.470258 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7f42bdf3-8ea6-4297-b29c-b517a2c5178a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:53:08.470902 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-7f42bdf3-8ea6-4297-b29c-b517a2c5178a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] [instance: 8067855a-0f46-4fc9-8735-e829583c3024] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:08.477511 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7f42bdf3-8ea6-4297-b29c-b517a2c5178a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:08.478146 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7f42bdf3-8ea6-4297-b29c-b517a2c5178a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:08.479479 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7f42bdf3-8ea6-4297-b29c-b517a2c5178a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:08.480294 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-7f42bdf3-8ea6-4297-b29c-b517a2c5178a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:08.499030 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-7f42bdf3-8ea6-4297-b29c-b517a2c5178a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] HTTP exception thrown: Instance 8067855a-0f46-4fc9-8735-e829583c3024 could not be found. Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7f42bdf3-8ea6-4297-b29c-b517a2c5178a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Request method failure captured: Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 HTTP/1.1 Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1NbD53RkWfrwhkk4fYBrVD9N2mrcTUF-q2b2EiXe47fLGj5Jk4xHKANkWBr47rqDTv047pOfYhXRBkngyHomGKqMIOtbHIn4SNp6R6bbNzv5z4_brcrsk51dKk07cje1ixdXdeZMZwmYbrmhb4Y_QrRDNdYeRkNM1KfIJgzfwtjlIM8 Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 2f05e19f28ee40c58936bcc9fc8baedd Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-TestShelveInstance-1751999859 Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2f05e19f28ee40c58936bcc9fc8baedd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2f05e19f28ee40c58936bcc9fc8baedd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2f05e19f28ee40c58936bcc9fc8baedd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2f05e19f28ee40c58936bcc9fc8baedd"}]}] Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-TestShelveInstance-1751999859 Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 2f05e19f28ee40c58936bcc9fc8baedd Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-TestShelveInstance-1751999859 Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-TestShelveInstance-1751999859-project Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: ac8fcf3285d647cb9fb9f126531750d7 Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-TestShelveInstance-1751999859-project Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance 8067855a-0f46-4fc9-8735-e829583c3024 could not be found. Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': '8067855a-0f46-4fc9-8735-e829583c3024'} Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8067855a-0f46-4fc9-8735-e829583c3024 could not be found. Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8067855a-0f46-4fc9-8735-e829583c3024 could not be found. Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:53:08.500695 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:53:08.510247 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:53:08.510247 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:53:08.510247 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:53:08.510247 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:53:08.510247 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:53:08.510247 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8067855a-0f46-4fc9-8735-e829583c3024 could not be found. Jul 18 03:53:08.510247 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:53:08.510247 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-7f42bdf3-8ea6-4297-b29c-b517a2c5178a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Returning 404 to user: Instance 8067855a-0f46-4fc9-8735-e829583c3024 could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:53:08.510247 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-7f42bdf3-8ea6-4297-b29c-b517a2c5178a tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024" status: 404 len: 111 microversion: 2.1 time: 0.036187 Jul 18 03:53:08.510247 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3796/7582] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:53:08 2022] GET /compute/v2.1/servers/8067855a-0f46-4fc9-8735-e829583c3024 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:53:08.678461 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b341c65b-71e6-42bf-833e-be1b4b8eafc8 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] Calling method '.version_select at 0x7ff49b492b80>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:53:08.703054 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b341c65b-71e6-42bf-833e-be1b4b8eafc8 tempest-TestShelveInstance-1751999859 tempest-TestShelveInstance-1751999859-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-609460364" status: 202 len: 0 microversion: 2.1 time: 0.029741 Jul 18 03:53:08.703982 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3787/7583] 10.222.0.57 () {58 vars in 1250 bytes} [Mon Jul 18 03:53:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-609460364 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:53:27.582890 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=12 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:53:27.585502 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=24 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:53:27.772061 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-dab1c52c-7c0b-4950-9ef0-1c10fe35a780 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Action: 'create', calling method: .version_select at 0x7ff49b77de50>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1261471965", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQNj13+RKCGwSV2M9HIUlSqBhgMzUuh9GYvBAV+UbLWaP3MW0dLxRzLVDSv3OGFGdxwDHjPaAWGsB93iO9Jx75UCc+ITlS9Ty4p+Tl7lyiPXtRXiPTLYME23usvwCtq6g=="}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:53:27.790237 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-dab1c52c-7c0b-4950-9ef0-1c10fe35a780 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Getting quotas for project 2ed6d16471b3475a8da48c5538594811. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:53:27.796511 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-dab1c52c-7c0b-4950-9ef0-1c10fe35a780 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Getting quotas for user f571e5614eb1448f987e50f8c6c23c93 and project 2ed6d16471b3475a8da48c5538594811. Resources: {'key_pairs'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:53:27.834749 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-dab1c52c-7c0b-4950-9ef0-1c10fe35a780 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.257443 Jul 18 03:53:27.840422 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3797/7584] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 03:53:27 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:53:29.043383 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-2d0d8746-13d1-4af4-b607-c58d2752393d tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1463680466", "imageRef": "3bb0a19f-5b69-48ee-a771-8fd416f92f36", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1261471965", "security_groups": [{"name": "tempest-secgroup-smoke-1867914693"}], "networks": [{"uuid": "3423ee4e-bf3a-45e2-bf75-aff43487d7a2"}]}} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:53:29.051706 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:53:29.052677 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:53:29.167121 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.network.neutron [None req-2d0d8746-13d1-4af4-b607-c58d2752393d tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] validate_networks() for [('3423ee4e-bf3a-45e2-bf75-aff43487d7a2', None, None, None, None, None)] {{(pid=119544) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:53:29.676134 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-2d0d8746-13d1-4af4-b607-c58d2752393d tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Flavor limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:53:29.677240 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-2d0d8746-13d1-4af4-b607-c58d2752393d tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Image limits 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:53:29.677965 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-2d0d8746-13d1-4af4-b607-c58d2752393d tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Flavor pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:53:29.678631 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-2d0d8746-13d1-4af4-b607-c58d2752393d tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Image pref 0:0:0 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:53:29.679271 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.virt.hardware [None req-2d0d8746-13d1-4af4-b607-c58d2752393d tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:53:29.690428 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2d0d8746-13d1-4af4-b607-c58d2752393d tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:29.692436 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2d0d8746-13d1-4af4-b607-c58d2752393d tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:29.693779 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2d0d8746-13d1-4af4-b607-c58d2752393d tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:29.694537 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-2d0d8746-13d1-4af4-b607-c58d2752393d tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:29.715736 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-2d0d8746-13d1-4af4-b607-c58d2752393d tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Getting quotas for project 2ed6d16471b3475a8da48c5538594811. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:53:29.722552 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.quota [None req-2d0d8746-13d1-4af4-b607-c58d2752393d tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Getting quotas for user f571e5614eb1448f987e50f8c6c23c93 and project 2ed6d16471b3475a8da48c5538594811. Resources: {'cores', 'ram', 'instances'} {{(pid=119544) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:53:29.738765 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2d0d8746-13d1-4af4-b607-c58d2752393d tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Going to run 1 instances... {{(pid=119544) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:53:29.741795 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-2d0d8746-13d1-4af4-b607-c58d2752393d tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: f6140f2d-6889-4616-a6b4-822f75ad7bfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bb0a19f-5b69-48ee-a771-8fd416f92f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:53:29.806687 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-2d0d8746-13d1-4af4-b607-c58d2752393d tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.766741 Jul 18 03:53:29.807961 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3788/7585] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:53:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:53:29.820972 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-29a8759b-5f3d-47b5-96a8-f4e1f503fa34 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:53:29.822661 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-29a8759b-5f3d-47b5-96a8-f4e1f503fa34 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: f6140f2d-6889-4616-a6b4-822f75ad7bfc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:29.937441 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-29a8759b-5f3d-47b5-96a8-f4e1f503fa34 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571e5614eb1448f987e50f8c6c23c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed6d16471b3475a8da48c5538594811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:53:29.948510 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-29a8759b-5f3d-47b5-96a8-f4e1f503fa34 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "GET /compute/v2.1/servers/f6140f2d-6889-4616-a6b4-822f75ad7bfc" status: 200 len: 1249 microversion: 2.1 time: 0.133639 Jul 18 03:53:29.962825 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3798/7586] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:53:29 2022] GET /compute/v2.1/servers/f6140f2d-6889-4616-a6b4-822f75ad7bfc => generated 1249 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:53:30.968498 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-05b560d6-6301-4ff1-9c3c-a17289a36f48 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:53:30.969950 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-05b560d6-6301-4ff1-9c3c-a17289a36f48 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: f6140f2d-6889-4616-a6b4-822f75ad7bfc] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:30.978231 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-05b560d6-6301-4ff1-9c3c-a17289a36f48 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:30.979093 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-05b560d6-6301-4ff1-9c3c-a17289a36f48 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:30.980140 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-05b560d6-6301-4ff1-9c3c-a17289a36f48 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:30.980643 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-05b560d6-6301-4ff1-9c3c-a17289a36f48 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:31.061181 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-05b560d6-6301-4ff1-9c3c-a17289a36f48 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571e5614eb1448f987e50f8c6c23c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed6d16471b3475a8da48c5538594811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:53:31.073668 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-05b560d6-6301-4ff1-9c3c-a17289a36f48 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "GET /compute/v2.1/servers/f6140f2d-6889-4616-a6b4-822f75ad7bfc" status: 200 len: 1301 microversion: 2.1 time: 0.110319 Jul 18 03:53:31.074338 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3789/7587] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:53:30 2022] GET /compute/v2.1/servers/f6140f2d-6889-4616-a6b4-822f75ad7bfc => generated 1301 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:53:32.096127 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-e0272828-e45f-4330-b61f-cdccd5e8c115 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:53:32.098755 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-e0272828-e45f-4330-b61f-cdccd5e8c115 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: f6140f2d-6889-4616-a6b4-822f75ad7bfc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:32.111377 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e0272828-e45f-4330-b61f-cdccd5e8c115 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:32.112261 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e0272828-e45f-4330-b61f-cdccd5e8c115 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:32.113680 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e0272828-e45f-4330-b61f-cdccd5e8c115 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:32.116377 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-e0272828-e45f-4330-b61f-cdccd5e8c115 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:32.459608 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-e0272828-e45f-4330-b61f-cdccd5e8c115 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571e5614eb1448f987e50f8c6c23c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed6d16471b3475a8da48c5538594811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:53:32.467706 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-e0272828-e45f-4330-b61f-cdccd5e8c115 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "GET /compute/v2.1/servers/f6140f2d-6889-4616-a6b4-822f75ad7bfc" status: 200 len: 1375 microversion: 2.1 time: 0.379578 Jul 18 03:53:32.468286 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3799/7588] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:53:32 2022] GET /compute/v2.1/servers/f6140f2d-6889-4616-a6b4-822f75ad7bfc => generated 1375 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:53:32.912628 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-8d5a2c64-af38-4ee2-883b-6faf38e52351 req-94f936c9-4ddd-4c4d-b87e-0aeafaabca83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6140f2d-6889-4616-a6b4-822f75ad7bfc", "tag": "36bacd63-1a8f-43a7-9ee9-4d7d03709318"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:53:32.921976 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-8d5a2c64-af38-4ee2-883b-6faf38e52351 req-94f936c9-4ddd-4c4d-b87e-0aeafaabca83 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:32.923430 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-8d5a2c64-af38-4ee2-883b-6faf38e52351 req-94f936c9-4ddd-4c4d-b87e-0aeafaabca83 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:33.245722 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-8d5a2c64-af38-4ee2-883b-6faf38e52351 req-94f936c9-4ddd-4c4d-b87e-0aeafaabca83 service nova] Creating event network-changed:36bacd63-1a8f-43a7-9ee9-4d7d03709318 for instance f6140f2d-6889-4616-a6b4-822f75ad7bfc on n-h1-465891-3 Jul 18 03:53:33.252292 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-8d5a2c64-af38-4ee2-883b-6faf38e52351 req-94f936c9-4ddd-4c4d-b87e-0aeafaabca83 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.428849 Jul 18 03:53:33.253162 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3790/7589] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:53:33.485892 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-074f8901-b1e2-4e53-8343-ae07b58c9b6d tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:53:33.486524 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-074f8901-b1e2-4e53-8343-ae07b58c9b6d tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: f6140f2d-6889-4616-a6b4-822f75ad7bfc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:33.494697 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-074f8901-b1e2-4e53-8343-ae07b58c9b6d tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:33.495161 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-074f8901-b1e2-4e53-8343-ae07b58c9b6d tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:33.495960 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-074f8901-b1e2-4e53-8343-ae07b58c9b6d tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:33.496412 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-074f8901-b1e2-4e53-8343-ae07b58c9b6d tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:33.654790 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-074f8901-b1e2-4e53-8343-ae07b58c9b6d tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571e5614eb1448f987e50f8c6c23c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed6d16471b3475a8da48c5538594811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:53:33.663141 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-074f8901-b1e2-4e53-8343-ae07b58c9b6d tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "GET /compute/v2.1/servers/f6140f2d-6889-4616-a6b4-822f75ad7bfc" status: 200 len: 1375 microversion: 2.1 time: 0.181359 Jul 18 03:53:33.663784 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3800/7590] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:53:33 2022] GET /compute/v2.1/servers/f6140f2d-6889-4616-a6b4-822f75ad7bfc => generated 1375 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:53:34.682304 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-653f3ea6-c2de-4b52-97a8-4695cabfc456 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:53:34.683103 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-653f3ea6-c2de-4b52-97a8-4695cabfc456 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: f6140f2d-6889-4616-a6b4-822f75ad7bfc] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:34.689329 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-653f3ea6-c2de-4b52-97a8-4695cabfc456 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:34.689816 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-653f3ea6-c2de-4b52-97a8-4695cabfc456 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:34.690583 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-653f3ea6-c2de-4b52-97a8-4695cabfc456 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:34.691011 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-653f3ea6-c2de-4b52-97a8-4695cabfc456 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:34.828441 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-653f3ea6-c2de-4b52-97a8-4695cabfc456 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571e5614eb1448f987e50f8c6c23c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed6d16471b3475a8da48c5538594811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:53:34.836758 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-653f3ea6-c2de-4b52-97a8-4695cabfc456 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "GET /compute/v2.1/servers/f6140f2d-6889-4616-a6b4-822f75ad7bfc" status: 200 len: 1375 microversion: 2.1 time: 0.160187 Jul 18 03:53:34.837318 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3791/7591] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:53:34 2022] GET /compute/v2.1/servers/f6140f2d-6889-4616-a6b4-822f75ad7bfc => generated 1375 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:53:35.854461 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-5422b7d7-10dc-40db-82aa-66183e342900 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:53:35.855114 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-5422b7d7-10dc-40db-82aa-66183e342900 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: f6140f2d-6889-4616-a6b4-822f75ad7bfc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:35.862098 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5422b7d7-10dc-40db-82aa-66183e342900 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:35.862566 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5422b7d7-10dc-40db-82aa-66183e342900 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:35.863414 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5422b7d7-10dc-40db-82aa-66183e342900 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:35.863865 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-5422b7d7-10dc-40db-82aa-66183e342900 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:36.000289 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-5422b7d7-10dc-40db-82aa-66183e342900 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571e5614eb1448f987e50f8c6c23c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed6d16471b3475a8da48c5538594811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:53:36.008066 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-5422b7d7-10dc-40db-82aa-66183e342900 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "GET /compute/v2.1/servers/f6140f2d-6889-4616-a6b4-822f75ad7bfc" status: 200 len: 1375 microversion: 2.1 time: 0.157633 Jul 18 03:53:36.008652 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3801/7592] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:53:35 2022] GET /compute/v2.1/servers/f6140f2d-6889-4616-a6b4-822f75ad7bfc => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:53:37.025143 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-7e6f6aaf-e03c-4da9-a977-d01b13bc3ea7 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:53:37.025764 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-7e6f6aaf-e03c-4da9-a977-d01b13bc3ea7 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: f6140f2d-6889-4616-a6b4-822f75ad7bfc] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:37.032682 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7e6f6aaf-e03c-4da9-a977-d01b13bc3ea7 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:37.033124 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7e6f6aaf-e03c-4da9-a977-d01b13bc3ea7 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:37.033913 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7e6f6aaf-e03c-4da9-a977-d01b13bc3ea7 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:37.034350 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-7e6f6aaf-e03c-4da9-a977-d01b13bc3ea7 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:37.168825 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-7e6f6aaf-e03c-4da9-a977-d01b13bc3ea7 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571e5614eb1448f987e50f8c6c23c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed6d16471b3475a8da48c5538594811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:53:37.176719 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-7e6f6aaf-e03c-4da9-a977-d01b13bc3ea7 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "GET /compute/v2.1/servers/f6140f2d-6889-4616-a6b4-822f75ad7bfc" status: 200 len: 1375 microversion: 2.1 time: 0.155203 Jul 18 03:53:37.178031 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3792/7593] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:53:37 2022] GET /compute/v2.1/servers/f6140f2d-6889-4616-a6b4-822f75ad7bfc => generated 1375 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:53:38.195741 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-bbd1a96d-e4b8-4ff9-ab04-aaca4cbb40f4 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:53:38.196367 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-bbd1a96d-e4b8-4ff9-ab04-aaca4cbb40f4 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: f6140f2d-6889-4616-a6b4-822f75ad7bfc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:38.202857 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bbd1a96d-e4b8-4ff9-ab04-aaca4cbb40f4 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:38.203322 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bbd1a96d-e4b8-4ff9-ab04-aaca4cbb40f4 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:38.204106 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bbd1a96d-e4b8-4ff9-ab04-aaca4cbb40f4 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:38.204559 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-bbd1a96d-e4b8-4ff9-ab04-aaca4cbb40f4 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:38.341118 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-bbd1a96d-e4b8-4ff9-ab04-aaca4cbb40f4 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571e5614eb1448f987e50f8c6c23c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed6d16471b3475a8da48c5538594811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:53:38.349082 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-bbd1a96d-e4b8-4ff9-ab04-aaca4cbb40f4 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "GET /compute/v2.1/servers/f6140f2d-6889-4616-a6b4-822f75ad7bfc" status: 200 len: 1375 microversion: 2.1 time: 0.157703 Jul 18 03:53:38.349658 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3802/7594] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:53:38 2022] GET /compute/v2.1/servers/f6140f2d-6889-4616-a6b4-822f75ad7bfc => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:53:39.367251 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-853b6bb4-e910-4854-bb9d-a87f27a58140 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:53:39.367812 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-853b6bb4-e910-4854-bb9d-a87f27a58140 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: f6140f2d-6889-4616-a6b4-822f75ad7bfc] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:39.374507 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-853b6bb4-e910-4854-bb9d-a87f27a58140 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:39.375006 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-853b6bb4-e910-4854-bb9d-a87f27a58140 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:39.375936 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-853b6bb4-e910-4854-bb9d-a87f27a58140 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:39.376373 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-853b6bb4-e910-4854-bb9d-a87f27a58140 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:39.448386 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-076cf47e-0cb7-4c1b-91b0-585f73029a9a req-ad369cdf-7ea2-4db9-a808-0a0cca43f3bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6140f2d-6889-4616-a6b4-822f75ad7bfc", "name": "network-vif-plugged", "status": "completed", "tag": "36bacd63-1a8f-43a7-9ee9-4d7d03709318"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:53:39.460682 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-076cf47e-0cb7-4c1b-91b0-585f73029a9a req-ad369cdf-7ea2-4db9-a808-0a0cca43f3bd service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:39.461347 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-076cf47e-0cb7-4c1b-91b0-585f73029a9a req-ad369cdf-7ea2-4db9-a808-0a0cca43f3bd service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:39.474058 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-076cf47e-0cb7-4c1b-91b0-585f73029a9a req-ad369cdf-7ea2-4db9-a808-0a0cca43f3bd service nova] Creating event network-vif-plugged:36bacd63-1a8f-43a7-9ee9-4d7d03709318 for instance f6140f2d-6889-4616-a6b4-822f75ad7bfc on n-h1-465891-3 Jul 18 03:53:39.479448 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-076cf47e-0cb7-4c1b-91b0-585f73029a9a req-ad369cdf-7ea2-4db9-a808-0a0cca43f3bd service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035826 Jul 18 03:53:39.480098 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3803/7595] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:53:39.514633 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-853b6bb4-e910-4854-bb9d-a87f27a58140 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571e5614eb1448f987e50f8c6c23c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed6d16471b3475a8da48c5538594811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:53:39.528203 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-853b6bb4-e910-4854-bb9d-a87f27a58140 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "GET /compute/v2.1/servers/f6140f2d-6889-4616-a6b4-822f75ad7bfc" status: 200 len: 1375 microversion: 2.1 time: 0.165760 Jul 18 03:53:39.528782 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3793/7596] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:53:39 2022] GET /compute/v2.1/servers/f6140f2d-6889-4616-a6b4-822f75ad7bfc => generated 1375 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:53:40.542764 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:53:40.547753 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-af69d7b1-b683-42f1-8477-8d49369ad0ad tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:53:40.548461 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-af69d7b1-b683-42f1-8477-8d49369ad0ad tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: f6140f2d-6889-4616-a6b4-822f75ad7bfc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:40.555947 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-af69d7b1-b683-42f1-8477-8d49369ad0ad tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:40.556407 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-af69d7b1-b683-42f1-8477-8d49369ad0ad tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:40.557221 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-af69d7b1-b683-42f1-8477-8d49369ad0ad tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:40.557673 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-af69d7b1-b683-42f1-8477-8d49369ad0ad tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:40.690165 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-af69d7b1-b683-42f1-8477-8d49369ad0ad tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571e5614eb1448f987e50f8c6c23c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed6d16471b3475a8da48c5538594811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:53:40.697822 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-af69d7b1-b683-42f1-8477-8d49369ad0ad tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "GET /compute/v2.1/servers/f6140f2d-6889-4616-a6b4-822f75ad7bfc" status: 200 len: 1375 microversion: 2.1 time: 0.156013 Jul 18 03:53:40.698405 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3804/7597] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:53:40 2022] GET /compute/v2.1/servers/f6140f2d-6889-4616-a6b4-822f75ad7bfc => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:53:41.715298 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-28a5f47f-c141-4e84-890d-004b2098048a tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:53:41.715852 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-28a5f47f-c141-4e84-890d-004b2098048a tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: f6140f2d-6889-4616-a6b4-822f75ad7bfc] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:41.717780 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:53:41.718723 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=6 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:53:41.726708 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-28a5f47f-c141-4e84-890d-004b2098048a tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:41.727166 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-28a5f47f-c141-4e84-890d-004b2098048a tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:41.727926 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-28a5f47f-c141-4e84-890d-004b2098048a tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:41.728367 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-28a5f47f-c141-4e84-890d-004b2098048a tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:41.863675 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-28a5f47f-c141-4e84-890d-004b2098048a tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571e5614eb1448f987e50f8c6c23c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed6d16471b3475a8da48c5538594811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:53:41.871827 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-28a5f47f-c141-4e84-890d-004b2098048a tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "GET /compute/v2.1/servers/f6140f2d-6889-4616-a6b4-822f75ad7bfc" status: 200 len: 1560 microversion: 2.1 time: 0.160408 Jul 18 03:53:41.872368 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3794/7598] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:53:41 2022] GET /compute/v2.1/servers/f6140f2d-6889-4616-a6b4-822f75ad7bfc => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:53:41.888906 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-c252f061-9dd7-4b1f-8924-9099b4a9f0ce tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:53:41.889530 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-c252f061-9dd7-4b1f-8924-9099b4a9f0ce tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: f6140f2d-6889-4616-a6b4-822f75ad7bfc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:41.896603 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c252f061-9dd7-4b1f-8924-9099b4a9f0ce tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:41.897069 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c252f061-9dd7-4b1f-8924-9099b4a9f0ce tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:41.898450 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c252f061-9dd7-4b1f-8924-9099b4a9f0ce tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:41.898979 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-c252f061-9dd7-4b1f-8924-9099b4a9f0ce tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:42.053217 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-c252f061-9dd7-4b1f-8924-9099b4a9f0ce tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571e5614eb1448f987e50f8c6c23c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed6d16471b3475a8da48c5538594811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:53:42.067353 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-c252f061-9dd7-4b1f-8924-9099b4a9f0ce tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "GET /compute/v2.1/servers/f6140f2d-6889-4616-a6b4-822f75ad7bfc" status: 200 len: 1560 microversion: 2.1 time: 0.181963 Jul 18 03:53:42.068492 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3805/7599] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:53:41 2022] GET /compute/v2.1/servers/f6140f2d-6889-4616-a6b4-822f75ad7bfc => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:53:44.055990 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-a00e4162-3d35-4d4b-9165-276b2eacf872 req-25090384-ada2-4de3-9a82-017d5c2e28c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6140f2d-6889-4616-a6b4-822f75ad7bfc", "tag": "36bacd63-1a8f-43a7-9ee9-4d7d03709318"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:53:44.065566 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-a00e4162-3d35-4d4b-9165-276b2eacf872 req-25090384-ada2-4de3-9a82-017d5c2e28c7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:44.066169 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-a00e4162-3d35-4d4b-9165-276b2eacf872 req-25090384-ada2-4de3-9a82-017d5c2e28c7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:44.078128 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-a00e4162-3d35-4d4b-9165-276b2eacf872 req-25090384-ada2-4de3-9a82-017d5c2e28c7 service nova] Creating event network-changed:36bacd63-1a8f-43a7-9ee9-4d7d03709318 for instance f6140f2d-6889-4616-a6b4-822f75ad7bfc on n-h1-465891-3 Jul 18 03:53:44.084359 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-a00e4162-3d35-4d4b-9165-276b2eacf872 req-25090384-ada2-4de3-9a82-017d5c2e28c7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032205 Jul 18 03:53:44.084968 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3795/7600] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:54:34.682670 n-d-465891-3 devstack@n-api.service[119543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:54:34.683308 n-d-465891-3 devstack@n-api.service[119543]: Mon Jul 18 03:54:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:56:10.257012 n-d-465891-3 devstack@n-api.service[119543]: ERROR oslo.messaging._drivers.impl_rabbit [-] [58d4ed9e-6c40-4e66-8cf1-b8f58c4998c2] AMQP server on 10.222.0.57:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 18 03:56:10.257909 n-d-465891-3 devstack@n-api.service[119543]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5744c86a-1c72-444c-9f09-2dc127b8032d] AMQP server on 10.222.0.57:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 18 03:56:10.258537 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:56:10.259302 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=38 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:56:10.263303 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a24f5f00-c205-45f1-a6a4-6eb07883ac0c tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1568447592"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:56:10.264374 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a24f5f00-c205-45f1-a6a4-6eb07883ac0c tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: f6140f2d-6889-4616-a6b4-822f75ad7bfc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:56:10.273694 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a24f5f00-c205-45f1-a6a4-6eb07883ac0c tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:10.274274 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a24f5f00-c205-45f1-a6a4-6eb07883ac0c tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:10.275115 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a24f5f00-c205-45f1-a6a4-6eb07883ac0c tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:10.275610 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a24f5f00-c205-45f1-a6a4-6eb07883ac0c tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:10.740341 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a24f5f00-c205-45f1-a6a4-6eb07883ac0c tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "POST /compute/v2.1/servers/f6140f2d-6889-4616-a6b4-822f75ad7bfc/action" status: 202 len: 0 microversion: 2.1 time: 0.485193 Jul 18 03:56:10.740981 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3806/7601] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:56:10 2022] POST /compute/v2.1/servers/f6140f2d-6889-4616-a6b4-822f75ad7bfc/action => generated 0 bytes in 487 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 18 03:56:12.305270 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:56:12.305891 n-d-465891-3 devstack@n-api.service[119544]: Mon Jul 18 03:56:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:56:13.102671 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:56:13.102951 n-d-465891-3 devstack@n-api.service[119544]: Mon Jul 18 03:56:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:56:14.658469 n-d-465891-3 devstack@n-api.service[119543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:56:14.659076 n-d-465891-3 devstack@n-api.service[119543]: Mon Jul 18 03:56:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:56:18.269271 n-d-465891-3 devstack@n-api.service[119544]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bec20902-d336-4ab9-99dd-48825093cebe] AMQP server on 10.222.0.57:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 18 03:56:18.271080 n-d-465891-3 devstack@n-api.service[119544]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2195f790-7bbc-4111-8106-e7ea837c20fc] AMQP server on 10.222.0.57:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 18 03:56:18.271683 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:56:18.272464 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=36 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:56:18.277452 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-374b1106-8b17-4b8d-9fae-b5655c05f735 req-5bb81944-ed8b-487d-9b5d-2a5fb90e166c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6140f2d-6889-4616-a6b4-822f75ad7bfc", "name": "network-vif-plugged", "status": "completed", "tag": "36bacd63-1a8f-43a7-9ee9-4d7d03709318"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:56:18.290315 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-374b1106-8b17-4b8d-9fae-b5655c05f735 req-5bb81944-ed8b-487d-9b5d-2a5fb90e166c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:18.290763 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-374b1106-8b17-4b8d-9fae-b5655c05f735 req-5bb81944-ed8b-487d-9b5d-2a5fb90e166c service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:18.302573 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-374b1106-8b17-4b8d-9fae-b5655c05f735 req-5bb81944-ed8b-487d-9b5d-2a5fb90e166c service nova] Creating event network-vif-plugged:36bacd63-1a8f-43a7-9ee9-4d7d03709318 for instance f6140f2d-6889-4616-a6b4-822f75ad7bfc on n-h1-465891-3 Jul 18 03:56:18.307724 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-374b1106-8b17-4b8d-9fae-b5655c05f735 req-5bb81944-ed8b-487d-9b5d-2a5fb90e166c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040055 Jul 18 03:56:18.308748 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3796/7602] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:56:28.376293 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:56:28.377073 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:56:28.381986 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-238d114e-d4b7-40d0-98ed-c65e82c1a821 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-879670818", "imageRef": "444d6a46-2dea-48ad-b3b7-61055378655f", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1261471965", "security_groups": [{"name": "tempest-secgroup-smoke-1867914693"}], "networks": [{"uuid": "3423ee4e-bf3a-45e2-bf75-aff43487d7a2"}]}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:56:28.406890 n-d-465891-3 devstack@n-api.service[119543]: INFO oslo.messaging._drivers.impl_rabbit [-] [58d4ed9e-6c40-4e66-8cf1-b8f58c4998c2] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 55228. Jul 18 03:56:28.408135 n-d-465891-3 devstack@n-api.service[119543]: INFO oslo.messaging._drivers.impl_rabbit [-] [5744c86a-1c72-444c-9f09-2dc127b8032d] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 55230. Jul 18 03:56:28.506152 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.network.neutron [None req-238d114e-d4b7-40d0-98ed-c65e82c1a821 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] validate_networks() for [('3423ee4e-bf3a-45e2-bf75-aff43487d7a2', None, None, None, None, None)] {{(pid=119543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:56:29.003505 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-238d114e-d4b7-40d0-98ed-c65e82c1a821 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Flavor limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:56:29.004604 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-238d114e-d4b7-40d0-98ed-c65e82c1a821 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Image limits 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:56:29.004604 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-238d114e-d4b7-40d0-98ed-c65e82c1a821 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Flavor pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:56:29.004604 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-238d114e-d4b7-40d0-98ed-c65e82c1a821 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Image pref 0:0:0 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:56:29.006763 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.virt.hardware [None req-238d114e-d4b7-40d0-98ed-c65e82c1a821 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:56:29.019575 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-238d114e-d4b7-40d0-98ed-c65e82c1a821 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:29.020311 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-238d114e-d4b7-40d0-98ed-c65e82c1a821 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:29.021163 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-238d114e-d4b7-40d0-98ed-c65e82c1a821 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:29.021620 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-238d114e-d4b7-40d0-98ed-c65e82c1a821 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:29.042306 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-238d114e-d4b7-40d0-98ed-c65e82c1a821 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Getting quotas for project 2ed6d16471b3475a8da48c5538594811. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:56:29.047687 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.quota [None req-238d114e-d4b7-40d0-98ed-c65e82c1a821 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Getting quotas for user f571e5614eb1448f987e50f8c6c23c93 and project 2ed6d16471b3475a8da48c5538594811. Resources: {'cores', 'ram', 'instances'} {{(pid=119543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:56:29.062033 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-238d114e-d4b7-40d0-98ed-c65e82c1a821 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Going to run 1 instances... {{(pid=119543) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:56:29.065193 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-238d114e-d4b7-40d0-98ed-c65e82c1a821 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: e9f4469e-0215-4b7d-80d5-6c60df59cc79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='444d6a46-2dea-48ad-b3b7-61055378655f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:56:29.119980 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-238d114e-d4b7-40d0-98ed-c65e82c1a821 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.745943 Jul 18 03:56:29.120629 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3807/7603] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 03:56:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:56:29.132595 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-788be0de-0d64-4135-a833-12d5d437412f tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:56:29.133404 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-788be0de-0d64-4135-a833-12d5d437412f tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: e9f4469e-0215-4b7d-80d5-6c60df59cc79] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:56:29.139254 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:56:29.139965 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:56:29.167130 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [-] [bec20902-d336-4ab9-99dd-48825093cebe] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 55244. Jul 18 03:56:29.184550 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [-] [2195f790-7bbc-4111-8106-e7ea837c20fc] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 55246. Jul 18 03:56:29.296303 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-788be0de-0d64-4135-a833-12d5d437412f tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571e5614eb1448f987e50f8c6c23c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed6d16471b3475a8da48c5538594811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:56:29.307515 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-788be0de-0d64-4135-a833-12d5d437412f tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79" status: 200 len: 1248 microversion: 2.1 time: 0.179551 Jul 18 03:56:29.308186 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3797/7604] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:56:29 2022] GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79 => generated 1248 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:56:30.325619 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8ff80f64-bc48-4be4-8787-3f846db1d82f tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:56:30.326455 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8ff80f64-bc48-4be4-8787-3f846db1d82f tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: e9f4469e-0215-4b7d-80d5-6c60df59cc79] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:56:30.335163 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8ff80f64-bc48-4be4-8787-3f846db1d82f tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:30.335871 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8ff80f64-bc48-4be4-8787-3f846db1d82f tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:30.337256 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8ff80f64-bc48-4be4-8787-3f846db1d82f tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:30.337746 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8ff80f64-bc48-4be4-8787-3f846db1d82f tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:30.424511 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8ff80f64-bc48-4be4-8787-3f846db1d82f tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571e5614eb1448f987e50f8c6c23c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed6d16471b3475a8da48c5538594811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:56:30.438537 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8ff80f64-bc48-4be4-8787-3f846db1d82f tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79" status: 200 len: 1308 microversion: 2.1 time: 0.117212 Jul 18 03:56:30.439955 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3808/7605] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:56:30 2022] GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79 => generated 1308 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:56:31.471469 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-c3242cd2-8293-4e16-a928-46762e32dc69 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:56:31.472034 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-c3242cd2-8293-4e16-a928-46762e32dc69 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: e9f4469e-0215-4b7d-80d5-6c60df59cc79] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:56:31.491302 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c3242cd2-8293-4e16-a928-46762e32dc69 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:31.491924 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c3242cd2-8293-4e16-a928-46762e32dc69 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:31.492828 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c3242cd2-8293-4e16-a928-46762e32dc69 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:31.493416 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-c3242cd2-8293-4e16-a928-46762e32dc69 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:31.702218 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-c3242cd2-8293-4e16-a928-46762e32dc69 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571e5614eb1448f987e50f8c6c23c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed6d16471b3475a8da48c5538594811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:56:31.723594 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-c3242cd2-8293-4e16-a928-46762e32dc69 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79" status: 200 len: 1374 microversion: 2.1 time: 0.256658 Jul 18 03:56:31.724297 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3798/7606] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:56:31 2022] GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79 => generated 1374 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:56:32.295324 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [req-611afd8c-1597-481f-9176-d25d3e511808 req-0fdeff72-fea9-445a-80b0-f00714bd8d4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6140f2d-6889-4616-a6b4-822f75ad7bfc", "name": "network-vif-unplugged", "status": "completed", "tag": "36bacd63-1a8f-43a7-9ee9-4d7d03709318"}]} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:56:32.312108 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-611afd8c-1597-481f-9176-d25d3e511808 req-0fdeff72-fea9-445a-80b0-f00714bd8d4e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:32.312935 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [req-611afd8c-1597-481f-9176-d25d3e511808 req-0fdeff72-fea9-445a-80b0-f00714bd8d4e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:32.326801 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.compute.server_external_events [req-611afd8c-1597-481f-9176-d25d3e511808 req-0fdeff72-fea9-445a-80b0-f00714bd8d4e service nova] Creating event network-vif-unplugged:36bacd63-1a8f-43a7-9ee9-4d7d03709318 for instance f6140f2d-6889-4616-a6b4-822f75ad7bfc on n-h1-465891-3 Jul 18 03:56:32.333328 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [req-611afd8c-1597-481f-9176-d25d3e511808 req-0fdeff72-fea9-445a-80b0-f00714bd8d4e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042124 Jul 18 03:56:32.334882 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3809/7607] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:56:32.741409 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-a57a267a-02c3-4e4e-a3ca-a7bb98ba7830 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:56:32.742064 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-a57a267a-02c3-4e4e-a3ca-a7bb98ba7830 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: e9f4469e-0215-4b7d-80d5-6c60df59cc79] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:56:32.749433 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a57a267a-02c3-4e4e-a3ca-a7bb98ba7830 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:32.749998 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a57a267a-02c3-4e4e-a3ca-a7bb98ba7830 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:32.750739 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a57a267a-02c3-4e4e-a3ca-a7bb98ba7830 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:32.751146 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-a57a267a-02c3-4e4e-a3ca-a7bb98ba7830 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:32.918443 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-a57a267a-02c3-4e4e-a3ca-a7bb98ba7830 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571e5614eb1448f987e50f8c6c23c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed6d16471b3475a8da48c5538594811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:56:32.927383 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-a57a267a-02c3-4e4e-a3ca-a7bb98ba7830 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79" status: 200 len: 1374 microversion: 2.1 time: 0.190811 Jul 18 03:56:32.928540 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3799/7608] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:56:32 2022] GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79 => generated 1374 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:56:33.947108 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-6a799ad4-cdd0-40d3-ae94-d93cef90fc71 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:56:33.947831 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-6a799ad4-cdd0-40d3-ae94-d93cef90fc71 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: e9f4469e-0215-4b7d-80d5-6c60df59cc79] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:56:33.954279 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a799ad4-cdd0-40d3-ae94-d93cef90fc71 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:33.954753 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a799ad4-cdd0-40d3-ae94-d93cef90fc71 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:33.955556 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a799ad4-cdd0-40d3-ae94-d93cef90fc71 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:33.956243 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-6a799ad4-cdd0-40d3-ae94-d93cef90fc71 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:34.142518 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-6a799ad4-cdd0-40d3-ae94-d93cef90fc71 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571e5614eb1448f987e50f8c6c23c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed6d16471b3475a8da48c5538594811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:56:34.151957 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-6a799ad4-cdd0-40d3-ae94-d93cef90fc71 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79" status: 200 len: 1374 microversion: 2.1 time: 0.211046 Jul 18 03:56:34.163609 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3810/7609] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:56:33 2022] GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79 => generated 1374 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:56:35.170886 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-bb73b5cb-9c47-4701-a4dc-a38e9e7e136d tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:56:35.171798 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-bb73b5cb-9c47-4701-a4dc-a38e9e7e136d tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: e9f4469e-0215-4b7d-80d5-6c60df59cc79] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:56:35.179763 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb73b5cb-9c47-4701-a4dc-a38e9e7e136d tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:35.180595 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb73b5cb-9c47-4701-a4dc-a38e9e7e136d tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:35.181601 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb73b5cb-9c47-4701-a4dc-a38e9e7e136d tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:35.182147 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-bb73b5cb-9c47-4701-a4dc-a38e9e7e136d tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:35.337164 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-bb73b5cb-9c47-4701-a4dc-a38e9e7e136d tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571e5614eb1448f987e50f8c6c23c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed6d16471b3475a8da48c5538594811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:56:35.346904 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-bb73b5cb-9c47-4701-a4dc-a38e9e7e136d tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79" status: 200 len: 1374 microversion: 2.1 time: 0.179727 Jul 18 03:56:35.348179 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3800/7610] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:56:35 2022] GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79 => generated 1374 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:56:36.364792 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-d73cfeac-89da-4f4c-b762-550de6ed5afb tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:56:36.365403 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-d73cfeac-89da-4f4c-b762-550de6ed5afb tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: e9f4469e-0215-4b7d-80d5-6c60df59cc79] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:56:36.372896 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d73cfeac-89da-4f4c-b762-550de6ed5afb tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:36.373371 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d73cfeac-89da-4f4c-b762-550de6ed5afb tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:36.374448 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d73cfeac-89da-4f4c-b762-550de6ed5afb tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:36.374900 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-d73cfeac-89da-4f4c-b762-550de6ed5afb tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:36.530278 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-d73cfeac-89da-4f4c-b762-550de6ed5afb tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571e5614eb1448f987e50f8c6c23c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed6d16471b3475a8da48c5538594811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:56:36.544807 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-d73cfeac-89da-4f4c-b762-550de6ed5afb tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79" status: 200 len: 1374 microversion: 2.1 time: 0.179569 Jul 18 03:56:36.544807 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3811/7611] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:56:36 2022] GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79 => generated 1374 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:56:37.571098 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-5ec93d4b-5d02-47e7-88f9-2746e445de25 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:56:37.571098 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-5ec93d4b-5d02-47e7-88f9-2746e445de25 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: e9f4469e-0215-4b7d-80d5-6c60df59cc79] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:56:37.577938 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ec93d4b-5d02-47e7-88f9-2746e445de25 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:37.578388 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ec93d4b-5d02-47e7-88f9-2746e445de25 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:37.579342 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ec93d4b-5d02-47e7-88f9-2746e445de25 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:37.579784 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-5ec93d4b-5d02-47e7-88f9-2746e445de25 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:37.724694 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-5ec93d4b-5d02-47e7-88f9-2746e445de25 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571e5614eb1448f987e50f8c6c23c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed6d16471b3475a8da48c5538594811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:56:37.733350 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-5ec93d4b-5d02-47e7-88f9-2746e445de25 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79" status: 200 len: 1374 microversion: 2.1 time: 0.168400 Jul 18 03:56:37.734218 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3801/7612] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:56:37 2022] GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79 => generated 1374 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:56:38.751665 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3dcebf84-1859-476f-a29e-6549073b4e1d tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:56:38.752260 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3dcebf84-1859-476f-a29e-6549073b4e1d tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: e9f4469e-0215-4b7d-80d5-6c60df59cc79] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:56:38.760421 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3dcebf84-1859-476f-a29e-6549073b4e1d tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:38.760880 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3dcebf84-1859-476f-a29e-6549073b4e1d tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:38.761658 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3dcebf84-1859-476f-a29e-6549073b4e1d tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:38.762123 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3dcebf84-1859-476f-a29e-6549073b4e1d tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:38.892383 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3dcebf84-1859-476f-a29e-6549073b4e1d tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571e5614eb1448f987e50f8c6c23c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed6d16471b3475a8da48c5538594811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:56:38.900541 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3dcebf84-1859-476f-a29e-6549073b4e1d tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79" status: 200 len: 1374 microversion: 2.1 time: 0.153173 Jul 18 03:56:38.901150 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3812/7613] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:56:38 2022] GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79 => generated 1374 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:56:39.795668 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-aae26d40-6863-4552-aafc-b37bdbb92940 req-d6f779d0-fa36-46f9-b9f6-2e2d1b2fc70f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9f4469e-0215-4b7d-80d5-6c60df59cc79", "tag": "5fdbb75c-70ff-48d1-8a72-e127116bdf03"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:56:39.803378 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell0:SELECT=2 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:56:39.809511 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-aae26d40-6863-4552-aafc-b37bdbb92940 req-d6f779d0-fa36-46f9-b9f6-2e2d1b2fc70f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:39.810890 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-aae26d40-6863-4552-aafc-b37bdbb92940 req-d6f779d0-fa36-46f9-b9f6-2e2d1b2fc70f service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:39.826449 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-aae26d40-6863-4552-aafc-b37bdbb92940 req-d6f779d0-fa36-46f9-b9f6-2e2d1b2fc70f service nova] Creating event network-changed:5fdbb75c-70ff-48d1-8a72-e127116bdf03 for instance e9f4469e-0215-4b7d-80d5-6c60df59cc79 on n-h2-465891-3 Jul 18 03:56:39.833519 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-aae26d40-6863-4552-aafc-b37bdbb92940 req-d6f779d0-fa36-46f9-b9f6-2e2d1b2fc70f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041536 Jul 18 03:56:39.835059 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3802/7614] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:56:39.917579 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-379404c8-4519-4f3a-89c7-f1b889faab38 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:56:39.918242 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-379404c8-4519-4f3a-89c7-f1b889faab38 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: e9f4469e-0215-4b7d-80d5-6c60df59cc79] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:56:39.920427 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:56:39.921322 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell0:SELECT=6 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:56:39.929492 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-379404c8-4519-4f3a-89c7-f1b889faab38 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:39.929984 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-379404c8-4519-4f3a-89c7-f1b889faab38 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:39.930787 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-379404c8-4519-4f3a-89c7-f1b889faab38 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:39.931232 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-379404c8-4519-4f3a-89c7-f1b889faab38 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:40.123671 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-379404c8-4519-4f3a-89c7-f1b889faab38 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571e5614eb1448f987e50f8c6c23c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed6d16471b3475a8da48c5538594811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:56:40.132280 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-379404c8-4519-4f3a-89c7-f1b889faab38 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79" status: 200 len: 1374 microversion: 2.1 time: 0.219067 Jul 18 03:56:40.132897 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3813/7615] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:56:39 2022] GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79 => generated 1374 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:56:41.150816 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-b1baad4b-1be2-4066-8b53-7db82fb7acd3 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:56:41.151535 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-b1baad4b-1be2-4066-8b53-7db82fb7acd3 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: e9f4469e-0215-4b7d-80d5-6c60df59cc79] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:56:41.158752 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b1baad4b-1be2-4066-8b53-7db82fb7acd3 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:41.159203 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b1baad4b-1be2-4066-8b53-7db82fb7acd3 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:41.160006 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b1baad4b-1be2-4066-8b53-7db82fb7acd3 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:41.160439 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-b1baad4b-1be2-4066-8b53-7db82fb7acd3 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:41.343293 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-b1baad4b-1be2-4066-8b53-7db82fb7acd3 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571e5614eb1448f987e50f8c6c23c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed6d16471b3475a8da48c5538594811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:56:41.350884 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-b1baad4b-1be2-4066-8b53-7db82fb7acd3 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79" status: 200 len: 1374 microversion: 2.1 time: 0.204520 Jul 18 03:56:41.351452 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3803/7616] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:56:41 2022] GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79 => generated 1374 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:56:42.368289 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-1811527c-37ab-40a2-acea-3b3c4cdd7700 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:56:42.368915 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-1811527c-37ab-40a2-acea-3b3c4cdd7700 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: e9f4469e-0215-4b7d-80d5-6c60df59cc79] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:56:42.376167 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1811527c-37ab-40a2-acea-3b3c4cdd7700 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:42.376634 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1811527c-37ab-40a2-acea-3b3c4cdd7700 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:42.377417 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1811527c-37ab-40a2-acea-3b3c4cdd7700 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:42.377902 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-1811527c-37ab-40a2-acea-3b3c4cdd7700 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:42.514987 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-1811527c-37ab-40a2-acea-3b3c4cdd7700 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571e5614eb1448f987e50f8c6c23c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed6d16471b3475a8da48c5538594811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:56:42.522858 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-1811527c-37ab-40a2-acea-3b3c4cdd7700 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79" status: 200 len: 1374 microversion: 2.1 time: 0.158478 Jul 18 03:56:42.523436 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3814/7617] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:56:42 2022] GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79 => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:56:43.539967 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-e0fde3aa-f69d-44a2-9e2b-73bd32cc95a6 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:56:43.541238 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-e0fde3aa-f69d-44a2-9e2b-73bd32cc95a6 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: e9f4469e-0215-4b7d-80d5-6c60df59cc79] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:56:43.548244 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e0fde3aa-f69d-44a2-9e2b-73bd32cc95a6 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:43.548702 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e0fde3aa-f69d-44a2-9e2b-73bd32cc95a6 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:43.549485 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e0fde3aa-f69d-44a2-9e2b-73bd32cc95a6 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:43.549951 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-e0fde3aa-f69d-44a2-9e2b-73bd32cc95a6 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:43.685781 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-e0fde3aa-f69d-44a2-9e2b-73bd32cc95a6 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571e5614eb1448f987e50f8c6c23c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed6d16471b3475a8da48c5538594811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:56:43.693361 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-e0fde3aa-f69d-44a2-9e2b-73bd32cc95a6 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79" status: 200 len: 1374 microversion: 2.1 time: 0.157312 Jul 18 03:56:43.693979 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3804/7618] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:56:43 2022] GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79 => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:56:44.711049 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a4ec526e-9f9a-4535-8771-8196e5883ab0 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:56:44.711703 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a4ec526e-9f9a-4535-8771-8196e5883ab0 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: e9f4469e-0215-4b7d-80d5-6c60df59cc79] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:56:44.718641 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a4ec526e-9f9a-4535-8771-8196e5883ab0 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:44.719099 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a4ec526e-9f9a-4535-8771-8196e5883ab0 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:44.719872 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a4ec526e-9f9a-4535-8771-8196e5883ab0 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:44.720313 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a4ec526e-9f9a-4535-8771-8196e5883ab0 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:44.855045 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-a4ec526e-9f9a-4535-8771-8196e5883ab0 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571e5614eb1448f987e50f8c6c23c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed6d16471b3475a8da48c5538594811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:56:44.862733 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a4ec526e-9f9a-4535-8771-8196e5883ab0 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79" status: 200 len: 1374 microversion: 2.1 time: 0.156207 Jul 18 03:56:44.863328 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3815/7619] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:56:44 2022] GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79 => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:56:45.082274 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-ef87ffe6-e60e-40ef-9259-ce6e8e054472 req-a01fcf7c-ca26-4942-9b67-f75305d0b8ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9f4469e-0215-4b7d-80d5-6c60df59cc79", "name": "network-vif-plugged", "status": "completed", "tag": "5fdbb75c-70ff-48d1-8a72-e127116bdf03"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:56:45.092216 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-ef87ffe6-e60e-40ef-9259-ce6e8e054472 req-a01fcf7c-ca26-4942-9b67-f75305d0b8ef service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:45.093329 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-ef87ffe6-e60e-40ef-9259-ce6e8e054472 req-a01fcf7c-ca26-4942-9b67-f75305d0b8ef service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:45.104671 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-ef87ffe6-e60e-40ef-9259-ce6e8e054472 req-a01fcf7c-ca26-4942-9b67-f75305d0b8ef service nova] Creating event network-vif-plugged:5fdbb75c-70ff-48d1-8a72-e127116bdf03 for instance e9f4469e-0215-4b7d-80d5-6c60df59cc79 on n-h2-465891-3 Jul 18 03:56:45.110111 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-ef87ffe6-e60e-40ef-9259-ce6e8e054472 req-a01fcf7c-ca26-4942-9b67-f75305d0b8ef service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091735 Jul 18 03:56:45.110721 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3805/7620] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:56:45.879079 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-852b2750-e103-4af9-9ecf-1e11dcb013fa tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:56:45.879696 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-852b2750-e103-4af9-9ecf-1e11dcb013fa tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: e9f4469e-0215-4b7d-80d5-6c60df59cc79] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:56:45.886682 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-852b2750-e103-4af9-9ecf-1e11dcb013fa tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:45.887141 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-852b2750-e103-4af9-9ecf-1e11dcb013fa tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:45.887920 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-852b2750-e103-4af9-9ecf-1e11dcb013fa tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:45.888366 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-852b2750-e103-4af9-9ecf-1e11dcb013fa tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:46.023364 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-852b2750-e103-4af9-9ecf-1e11dcb013fa tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571e5614eb1448f987e50f8c6c23c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed6d16471b3475a8da48c5538594811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:56:46.031186 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-852b2750-e103-4af9-9ecf-1e11dcb013fa tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79" status: 200 len: 1374 microversion: 2.1 time: 0.156006 Jul 18 03:56:46.031758 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3816/7621] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:56:45 2022] GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79 => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:56:47.049232 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-91596779-5c66-4370-a626-fd3f09770526 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:56:47.049969 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-91596779-5c66-4370-a626-fd3f09770526 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: e9f4469e-0215-4b7d-80d5-6c60df59cc79] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:56:47.057936 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91596779-5c66-4370-a626-fd3f09770526 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:47.058381 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91596779-5c66-4370-a626-fd3f09770526 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:47.059138 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91596779-5c66-4370-a626-fd3f09770526 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:47.059570 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-91596779-5c66-4370-a626-fd3f09770526 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:47.198368 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-91596779-5c66-4370-a626-fd3f09770526 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571e5614eb1448f987e50f8c6c23c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed6d16471b3475a8da48c5538594811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:56:47.205941 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-91596779-5c66-4370-a626-fd3f09770526 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79" status: 200 len: 1560 microversion: 2.1 time: 0.160954 Jul 18 03:56:47.206522 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3806/7622] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:56:47 2022] GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:56:47.222660 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9a21aff6-c91c-4e1b-a56c-1df7dc3e0818 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:56:47.223337 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9a21aff6-c91c-4e1b-a56c-1df7dc3e0818 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: e9f4469e-0215-4b7d-80d5-6c60df59cc79] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:56:47.231132 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9a21aff6-c91c-4e1b-a56c-1df7dc3e0818 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:47.231588 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9a21aff6-c91c-4e1b-a56c-1df7dc3e0818 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:47.232370 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9a21aff6-c91c-4e1b-a56c-1df7dc3e0818 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:47.232888 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9a21aff6-c91c-4e1b-a56c-1df7dc3e0818 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:47.368018 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-9a21aff6-c91c-4e1b-a56c-1df7dc3e0818 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571e5614eb1448f987e50f8c6c23c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed6d16471b3475a8da48c5538594811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:56:47.376080 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9a21aff6-c91c-4e1b-a56c-1df7dc3e0818 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79" status: 200 len: 1560 microversion: 2.1 time: 0.157446 Jul 18 03:56:47.376671 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3817/7623] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:56:47 2022] GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:56:49.057203 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-167c08ee-b126-42ea-a6df-f22aaf2d2fe8 req-93766fb0-136d-4e68-a9ff-a9f3594bbc7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9f4469e-0215-4b7d-80d5-6c60df59cc79", "tag": "5fdbb75c-70ff-48d1-8a72-e127116bdf03"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:56:49.065851 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-167c08ee-b126-42ea-a6df-f22aaf2d2fe8 req-93766fb0-136d-4e68-a9ff-a9f3594bbc7e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:49.066308 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-167c08ee-b126-42ea-a6df-f22aaf2d2fe8 req-93766fb0-136d-4e68-a9ff-a9f3594bbc7e service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:49.078472 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-167c08ee-b126-42ea-a6df-f22aaf2d2fe8 req-93766fb0-136d-4e68-a9ff-a9f3594bbc7e service nova] Creating event network-changed:5fdbb75c-70ff-48d1-8a72-e127116bdf03 for instance e9f4469e-0215-4b7d-80d5-6c60df59cc79 on n-h2-465891-3 Jul 18 03:56:49.084996 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-167c08ee-b126-42ea-a6df-f22aaf2d2fe8 req-93766fb0-136d-4e68-a9ff-a9f3594bbc7e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092162 Jul 18 03:56:49.085619 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3807/7624] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:58:17.369391 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:58:17.370208 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=58 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:58:17.375639 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-2abcca18-9263-424c-9343-0418078380cd tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-2113812561"}} {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:58:17.376748 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-2abcca18-9263-424c-9343-0418078380cd tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: e9f4469e-0215-4b7d-80d5-6c60df59cc79] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:58:17.384208 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2abcca18-9263-424c-9343-0418078380cd tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:58:17.384709 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2abcca18-9263-424c-9343-0418078380cd tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:58:17.385503 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2abcca18-9263-424c-9343-0418078380cd tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:58:17.386044 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-2abcca18-9263-424c-9343-0418078380cd tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:58:17.673460 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-2abcca18-9263-424c-9343-0418078380cd tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "POST /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79/action" status: 202 len: 0 microversion: 2.1 time: 0.305760 Jul 18 03:58:17.674136 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3818/7625] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 03:58:17 2022] POST /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 18 03:58:23.508032 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_api:SELECT=24 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:58:23.509669 n-d-465891-3 devstack@n-api.service[119544]: DEBUG dbcounter [-] [119544] Writing DB stats nova_cell1:SELECT=48 {{(pid=119544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:58:23.514621 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-898aeb5d-9f70-4b5d-9b6a-67e4ece738ad req-e8267ebe-76de-4510-b45e-0e8c3a44a893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9f4469e-0215-4b7d-80d5-6c60df59cc79", "name": "network-vif-plugged", "status": "completed", "tag": "5fdbb75c-70ff-48d1-8a72-e127116bdf03"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:58:23.529645 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-898aeb5d-9f70-4b5d-9b6a-67e4ece738ad req-e8267ebe-76de-4510-b45e-0e8c3a44a893 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:58:23.530279 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-898aeb5d-9f70-4b5d-9b6a-67e4ece738ad req-e8267ebe-76de-4510-b45e-0e8c3a44a893 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:58:23.557863 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-898aeb5d-9f70-4b5d-9b6a-67e4ece738ad req-e8267ebe-76de-4510-b45e-0e8c3a44a893 service nova] Creating event network-vif-plugged:5fdbb75c-70ff-48d1-8a72-e127116bdf03 for instance e9f4469e-0215-4b7d-80d5-6c60df59cc79 on n-h2-465891-3 Jul 18 03:58:23.567152 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-898aeb5d-9f70-4b5d-9b6a-67e4ece738ad req-e8267ebe-76de-4510-b45e-0e8c3a44a893 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062044 Jul 18 03:58:23.568031 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3808/7626] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:58:32.633469 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-a5a337d6-1e08-4311-a539-7bd9a802e4d8 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:58:32.634929 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a5a337d6-1e08-4311-a539-7bd9a802e4d8 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: e9f4469e-0215-4b7d-80d5-6c60df59cc79] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:58:32.635423 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-8d7b3967-0bd9-4fc1-9195-ec412ba2a478 req-43233e4a-227f-4cb0-b673-2a0356e035e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9f4469e-0215-4b7d-80d5-6c60df59cc79", "tag": "5fdbb75c-70ff-48d1-8a72-e127116bdf03"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:58:32.637258 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_api:SELECT=2 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:58:32.642146 n-d-465891-3 devstack@n-api.service[119543]: DEBUG dbcounter [-] [119543] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:58:32.649084 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-8d7b3967-0bd9-4fc1-9195-ec412ba2a478 req-43233e4a-227f-4cb0-b673-2a0356e035e9 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:58:32.649897 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-8d7b3967-0bd9-4fc1-9195-ec412ba2a478 req-43233e4a-227f-4cb0-b673-2a0356e035e9 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:58:32.650218 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a5a337d6-1e08-4311-a539-7bd9a802e4d8 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:58:32.650924 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a5a337d6-1e08-4311-a539-7bd9a802e4d8 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:58:32.651902 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a5a337d6-1e08-4311-a539-7bd9a802e4d8 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:58:32.652350 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-a5a337d6-1e08-4311-a539-7bd9a802e4d8 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:58:32.666025 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-8d7b3967-0bd9-4fc1-9195-ec412ba2a478 req-43233e4a-227f-4cb0-b673-2a0356e035e9 service nova] Creating event network-changed:5fdbb75c-70ff-48d1-8a72-e127116bdf03 for instance e9f4469e-0215-4b7d-80d5-6c60df59cc79 on n-h2-465891-3 Jul 18 03:58:32.673486 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-8d7b3967-0bd9-4fc1-9195-ec412ba2a478 req-43233e4a-227f-4cb0-b673-2a0356e035e9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042030 Jul 18 03:58:32.674659 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3809/7627] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:58:32.683273 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-a5a337d6-1e08-4311-a539-7bd9a802e4d8 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: e9f4469e-0215-4b7d-80d5-6c60df59cc79] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:58:32.790827 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-a5a337d6-1e08-4311-a539-7bd9a802e4d8 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "DELETE /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79" status: 204 len: 0 microversion: 2.1 time: 0.161522 Jul 18 03:58:32.791731 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3819/7628] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:58:32 2022] DELETE /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:58:32.801853 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-66ff7669-c76b-4f3c-88ed-05fce98a895f tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:58:32.802858 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-66ff7669-c76b-4f3c-88ed-05fce98a895f tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: e9f4469e-0215-4b7d-80d5-6c60df59cc79] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:58:32.810488 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-66ff7669-c76b-4f3c-88ed-05fce98a895f tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:58:32.810951 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-66ff7669-c76b-4f3c-88ed-05fce98a895f tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:58:32.812824 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-66ff7669-c76b-4f3c-88ed-05fce98a895f tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:58:32.813596 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-66ff7669-c76b-4f3c-88ed-05fce98a895f tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:58:32.975469 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-66ff7669-c76b-4f3c-88ed-05fce98a895f tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571e5614eb1448f987e50f8c6c23c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed6d16471b3475a8da48c5538594811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:58:32.983230 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-66ff7669-c76b-4f3c-88ed-05fce98a895f tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79" status: 200 len: 1685 microversion: 2.1 time: 0.186418 Jul 18 03:58:32.984344 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3810/7629] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:58:32 2022] GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79 => generated 1685 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:58:34.002064 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-05ea3c89-60c8-49e3-8fd1-21fd5549e4f0 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:58:34.004130 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-05ea3c89-60c8-49e3-8fd1-21fd5549e4f0 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: e9f4469e-0215-4b7d-80d5-6c60df59cc79] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:58:34.011398 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-05ea3c89-60c8-49e3-8fd1-21fd5549e4f0 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:58:34.011855 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-05ea3c89-60c8-49e3-8fd1-21fd5549e4f0 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:58:34.012629 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-05ea3c89-60c8-49e3-8fd1-21fd5549e4f0 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:58:34.013070 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-05ea3c89-60c8-49e3-8fd1-21fd5549e4f0 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:58:34.165344 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-05ea3c89-60c8-49e3-8fd1-21fd5549e4f0 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571e5614eb1448f987e50f8c6c23c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed6d16471b3475a8da48c5538594811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:58:34.174660 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-05ea3c89-60c8-49e3-8fd1-21fd5549e4f0 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79" status: 200 len: 1685 microversion: 2.1 time: 0.177581 Jul 18 03:58:34.175255 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3820/7630] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:58:33 2022] GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79 => generated 1685 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:58:35.165768 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-3e86ec42-1d7a-4b96-9312-9f10d3f8b156 req-abcf0325-3b71-4625-aa71-641758c266de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9f4469e-0215-4b7d-80d5-6c60df59cc79", "name": "network-vif-deleted", "tag": "5fdbb75c-70ff-48d1-8a72-e127116bdf03"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:58:35.175065 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-3e86ec42-1d7a-4b96-9312-9f10d3f8b156 req-abcf0325-3b71-4625-aa71-641758c266de service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:58:35.175635 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-3e86ec42-1d7a-4b96-9312-9f10d3f8b156 req-abcf0325-3b71-4625-aa71-641758c266de service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:58:35.189593 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-3e86ec42-1d7a-4b96-9312-9f10d3f8b156 req-abcf0325-3b71-4625-aa71-641758c266de service nova] Creating event network-vif-deleted:5fdbb75c-70ff-48d1-8a72-e127116bdf03 for instance e9f4469e-0215-4b7d-80d5-6c60df59cc79 on n-h2-465891-3 Jul 18 03:58:35.193377 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-8b51d081-fb98-4b7b-8030-a5755f007c05 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:58:35.194120 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-8b51d081-fb98-4b7b-8030-a5755f007c05 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: e9f4469e-0215-4b7d-80d5-6c60df59cc79] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:58:35.201594 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8b51d081-fb98-4b7b-8030-a5755f007c05 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:58:35.202048 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-3e86ec42-1d7a-4b96-9312-9f10d3f8b156 req-abcf0325-3b71-4625-aa71-641758c266de service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108554 Jul 18 03:58:35.202431 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8b51d081-fb98-4b7b-8030-a5755f007c05 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:58:35.203170 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3811/7631] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:58:35.203333 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8b51d081-fb98-4b7b-8030-a5755f007c05 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:58:35.203857 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8b51d081-fb98-4b7b-8030-a5755f007c05 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:58:35.239829 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8b51d081-fb98-4b7b-8030-a5755f007c05 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:58:35.240294 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-8b51d081-fb98-4b7b-8030-a5755f007c05 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:58:35.240762 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.objects.instance [None req-8b51d081-fb98-4b7b-8030-a5755f007c05 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lazy-loading 'fault' on Instance uuid e9f4469e-0215-4b7d-80d5-6c60df59cc79 {{(pid=119543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:58:35.285748 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-8b51d081-fb98-4b7b-8030-a5755f007c05 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571e5614eb1448f987e50f8c6c23c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed6d16471b3475a8da48c5538594811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:58:35.293840 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-8b51d081-fb98-4b7b-8030-a5755f007c05 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79" status: 200 len: 1338 microversion: 2.1 time: 0.104455 Jul 18 03:58:35.294425 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3821/7632] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:58:35 2022] GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79 => generated 1338 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:58:36.314373 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-46ac349e-60f5-4965-9769-26fa1c0d0cc2 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:58:36.315015 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-46ac349e-60f5-4965-9769-26fa1c0d0cc2 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: e9f4469e-0215-4b7d-80d5-6c60df59cc79] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:58:36.321312 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-46ac349e-60f5-4965-9769-26fa1c0d0cc2 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:58:36.321792 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-46ac349e-60f5-4965-9769-26fa1c0d0cc2 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:58:36.322559 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-46ac349e-60f5-4965-9769-26fa1c0d0cc2 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:58:36.322994 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-46ac349e-60f5-4965-9769-26fa1c0d0cc2 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:58:36.336853 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.wsgi [None req-46ac349e-60f5-4965-9769-26fa1c0d0cc2 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] HTTP exception thrown: Instance e9f4469e-0215-4b7d-80d5-6c60df59cc79 could not be found. Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-46ac349e-60f5-4965-9769-26fa1c0d0cc2 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Request method failure captured: Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: request: GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79 HTTP/1.1 Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: Accept: application/json Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: Accept-Encoding: identity Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: Connection: close Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: Content-Length: 0 Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: Content-Type: application/json Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: Host: 10.222.0.57 Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: Openstack-System-Scope: None Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: User-Agent: python-urllib3/1.26.9 Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: X-Auth-Token: gAAAAABi1NkxzDn_6VhfdxAdKcg_5GLwovLSbzNDrrv0m-b1Fqpa6hoeXVMEiFDZzRcsCEWcGOXHBStDmNNgNECkLFsjo90euXkqvnCNJ2CTHuUudcDqN6phM6RxC7jmHUnpb7YPeeRRF7pyQ7305hNul49WaeqMVrWwsL4XhVWtwXL8MsOFaTw Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Id: None Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: X-Domain-Name: None Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: X-Identity-Status: Confirmed Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: X-Is-Admin-Project: True Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Id: default Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Domain-Name: Default Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Id: 2ed6d16471b3475a8da48c5538594811 Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: X-Project-Name: tempest-TestSnapshotPattern-755228347 Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: X-Role: member,reader Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: X-Roles: member,reader Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2ed6d16471b3475a8da48c5538594811"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2ed6d16471b3475a8da48c5538594811"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2ed6d16471b3475a8da48c5538594811"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2ed6d16471b3475a8da48c5538594811"}]}] Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant: tempest-TestSnapshotPattern-755228347 Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Id: 2ed6d16471b3475a8da48c5538594811 Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: X-Tenant-Name: tempest-TestSnapshotPattern-755228347 Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: X-User: tempest-TestSnapshotPattern-755228347-project Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Id: default Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: X-User-Domain-Name: Default Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: X-User-Id: f571e5614eb1448f987e50f8c6c23c93 Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: X-User-Name: tempest-TestSnapshotPattern-755228347-project Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: method: > Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: exception: Instance e9f4469e-0215-4b7d-80d5-6c60df59cc79 could not be found. Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: action_args: {'id': 'e9f4469e-0215-4b7d-80d5-6c60df59cc79'} Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9f4469e-0215-4b7d-80d5-6c60df59cc79 could not be found. Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9f4469e-0215-4b7d-80d5-6c60df59cc79 could not be found. Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:58:36.338540 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:58:36.344423 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:58:36.344423 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:58:36.344423 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:58:36.344423 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:58:36.344423 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:58:36.344423 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9f4469e-0215-4b7d-80d5-6c60df59cc79 could not be found. Jul 18 03:58:36.344423 n-d-465891-3 devstack@n-api.service[119544]: ERROR nova.api.openstack.wsgi Jul 18 03:58:36.344423 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-46ac349e-60f5-4965-9769-26fa1c0d0cc2 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Returning 404 to user: Instance e9f4469e-0215-4b7d-80d5-6c60df59cc79 could not be found. {{(pid=119544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:58:36.344423 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-46ac349e-60f5-4965-9769-26fa1c0d0cc2 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79" status: 404 len: 111 microversion: 2.1 time: 0.031287 Jul 18 03:58:36.344423 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3812/7633] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:58:36 2022] GET /compute/v2.1/servers/e9f4469e-0215-4b7d-80d5-6c60df59cc79 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:58:38.041372 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3e991e7d-f7a5-4e0e-b2d5-b0117d8ebf66 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:58:38.041955 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3e991e7d-f7a5-4e0e-b2d5-b0117d8ebf66 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: f6140f2d-6889-4616-a6b4-822f75ad7bfc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:58:38.043131 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-3d1f4377-0ea0-471f-a24d-a099fcfe7ef0 req-b3f9fb04-8462-47e9-89f9-bdf01eb961c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6140f2d-6889-4616-a6b4-822f75ad7bfc", "tag": "36bacd63-1a8f-43a7-9ee9-4d7d03709318"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:58:38.050164 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3e991e7d-f7a5-4e0e-b2d5-b0117d8ebf66 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:58:38.050674 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3e991e7d-f7a5-4e0e-b2d5-b0117d8ebf66 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:58:38.051466 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3e991e7d-f7a5-4e0e-b2d5-b0117d8ebf66 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:58:38.051919 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3e991e7d-f7a5-4e0e-b2d5-b0117d8ebf66 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:58:38.057186 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-3d1f4377-0ea0-471f-a24d-a099fcfe7ef0 req-b3f9fb04-8462-47e9-89f9-bdf01eb961c7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:58:38.057647 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-3d1f4377-0ea0-471f-a24d-a099fcfe7ef0 req-b3f9fb04-8462-47e9-89f9-bdf01eb961c7 service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:58:38.069411 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-3d1f4377-0ea0-471f-a24d-a099fcfe7ef0 req-b3f9fb04-8462-47e9-89f9-bdf01eb961c7 service nova] Creating event network-changed:36bacd63-1a8f-43a7-9ee9-4d7d03709318 for instance f6140f2d-6889-4616-a6b4-822f75ad7bfc on n-h1-465891-3 Jul 18 03:58:38.075341 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-3d1f4377-0ea0-471f-a24d-a099fcfe7ef0 req-b3f9fb04-8462-47e9-89f9-bdf01eb961c7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035397 Jul 18 03:58:38.076362 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3813/7634] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:58:38.079390 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3e991e7d-f7a5-4e0e-b2d5-b0117d8ebf66 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: f6140f2d-6889-4616-a6b4-822f75ad7bfc] Going to try to terminate instance {{(pid=119543) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:58:38.163600 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3e991e7d-f7a5-4e0e-b2d5-b0117d8ebf66 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f6140f2d-6889-4616-a6b4-822f75ad7bfc" status: 204 len: 0 microversion: 2.1 time: 0.126085 Jul 18 03:58:38.167640 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3822/7635] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 03:58:38 2022] DELETE /compute/v2.1/servers/f6140f2d-6889-4616-a6b4-822f75ad7bfc => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:58:38.175028 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-1d9f0927-df12-43d6-97af-2e08174ece48 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Calling method '>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:58:38.176132 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.compute.api [None req-1d9f0927-df12-43d6-97af-2e08174ece48 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: f6140f2d-6889-4616-a6b4-822f75ad7bfc] Fetching instance by UUID {{(pid=119544) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:58:38.189340 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1d9f0927-df12-43d6-97af-2e08174ece48 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:58:38.189838 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1d9f0927-df12-43d6-97af-2e08174ece48 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:58:38.190651 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1d9f0927-df12-43d6-97af-2e08174ece48 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:58:38.191083 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [None req-1d9f0927-df12-43d6-97af-2e08174ece48 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:58:38.379373 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.policy [None req-1d9f0927-df12-43d6-97af-2e08174ece48 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571e5614eb1448f987e50f8c6c23c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed6d16471b3475a8da48c5538594811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119544) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:58:38.387173 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-1d9f0927-df12-43d6-97af-2e08174ece48 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "GET /compute/v2.1/servers/f6140f2d-6889-4616-a6b4-822f75ad7bfc" status: 200 len: 1685 microversion: 2.1 time: 0.217371 Jul 18 03:58:38.387747 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3814/7636] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:58:38 2022] GET /compute/v2.1/servers/f6140f2d-6889-4616-a6b4-822f75ad7bfc => generated 1685 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:58:39.405907 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-3f8307a4-a9b5-422b-a4e1-ae56fc5d13e2 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:58:39.406625 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-3f8307a4-a9b5-422b-a4e1-ae56fc5d13e2 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: f6140f2d-6889-4616-a6b4-822f75ad7bfc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:58:39.413490 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3f8307a4-a9b5-422b-a4e1-ae56fc5d13e2 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:58:39.413987 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3f8307a4-a9b5-422b-a4e1-ae56fc5d13e2 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:58:39.414772 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3f8307a4-a9b5-422b-a4e1-ae56fc5d13e2 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:58:39.415224 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-3f8307a4-a9b5-422b-a4e1-ae56fc5d13e2 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:58:39.643050 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.policy [None req-3f8307a4-a9b5-422b-a4e1-ae56fc5d13e2 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571e5614eb1448f987e50f8c6c23c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed6d16471b3475a8da48c5538594811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119543) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:58:39.651307 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-3f8307a4-a9b5-422b-a4e1-ae56fc5d13e2 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "GET /compute/v2.1/servers/f6140f2d-6889-4616-a6b4-822f75ad7bfc" status: 200 len: 1566 microversion: 2.1 time: 0.249707 Jul 18 03:58:39.662011 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3823/7637] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:58:39 2022] GET /compute/v2.1/servers/f6140f2d-6889-4616-a6b4-822f75ad7bfc => generated 1566 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:58:40.090302 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [req-e0f0862d-06c8-4539-948d-4849a2359c88 req-58104052-cef4-4111-ae40-b598d2b1dbaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6140f2d-6889-4616-a6b4-822f75ad7bfc", "name": "network-vif-deleted", "tag": "36bacd63-1a8f-43a7-9ee9-4d7d03709318"}]} {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:58:40.099864 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-e0f0862d-06c8-4539-948d-4849a2359c88 req-58104052-cef4-4111-ae40-b598d2b1dbaf service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:58:40.100317 n-d-465891-3 devstack@n-api.service[119544]: DEBUG oslo_concurrency.lockutils [req-e0f0862d-06c8-4539-948d-4849a2359c88 req-58104052-cef4-4111-ae40-b598d2b1dbaf service nova] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:58:40.114006 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.compute.server_external_events [req-e0f0862d-06c8-4539-948d-4849a2359c88 req-58104052-cef4-4111-ae40-b598d2b1dbaf service nova] Creating event network-vif-deleted:36bacd63-1a8f-43a7-9ee9-4d7d03709318 for instance f6140f2d-6889-4616-a6b4-822f75ad7bfc on n-h1-465891-3 Jul 18 03:58:40.119009 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [req-e0f0862d-06c8-4539-948d-4849a2359c88 req-58104052-cef4-4111-ae40-b598d2b1dbaf service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032433 Jul 18 03:58:40.119797 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3815/7638] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 03:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:58:40.670430 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9fafaa4d-a8d7-4a8c-8631-839cb19b0677 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Calling method '>' {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:58:40.671885 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.compute.api [None req-9fafaa4d-a8d7-4a8c-8631-839cb19b0677 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] [instance: f6140f2d-6889-4616-a6b4-822f75ad7bfc] Fetching instance by UUID {{(pid=119543) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:58:40.678563 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9fafaa4d-a8d7-4a8c-8631-839cb19b0677 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:58:40.679024 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9fafaa4d-a8d7-4a8c-8631-839cb19b0677 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:58:40.679801 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9fafaa4d-a8d7-4a8c-8631-839cb19b0677 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:58:40.680252 n-d-465891-3 devstack@n-api.service[119543]: DEBUG oslo_concurrency.lockutils [None req-9fafaa4d-a8d7-4a8c-8631-839cb19b0677 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Lock "2a4b42c4-bf71-4fae-804a-3632602c55fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:58:40.693551 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.wsgi [None req-9fafaa4d-a8d7-4a8c-8631-839cb19b0677 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] HTTP exception thrown: Instance f6140f2d-6889-4616-a6b4-822f75ad7bfc could not be found. Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9fafaa4d-a8d7-4a8c-8631-839cb19b0677 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Request method failure captured: Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: request: GET /compute/v2.1/servers/f6140f2d-6889-4616-a6b4-822f75ad7bfc HTTP/1.1 Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: Accept: application/json Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: Accept-Encoding: identity Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: Connection: close Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: Content-Length: 0 Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: Content-Type: application/json Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: Host: 10.222.0.57 Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: Openstack-System-Scope: None Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: User-Agent: python-urllib3/1.26.9 Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: X-Auth-Token: gAAAAABi1NkxzDn_6VhfdxAdKcg_5GLwovLSbzNDrrv0m-b1Fqpa6hoeXVMEiFDZzRcsCEWcGOXHBStDmNNgNECkLFsjo90euXkqvnCNJ2CTHuUudcDqN6phM6RxC7jmHUnpb7YPeeRRF7pyQ7305hNul49WaeqMVrWwsL4XhVWtwXL8MsOFaTw Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Id: None Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: X-Domain-Name: None Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: X-Identity-Status: Confirmed Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: X-Is-Admin-Project: True Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Id: default Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Domain-Name: Default Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Id: 2ed6d16471b3475a8da48c5538594811 Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: X-Project-Name: tempest-TestSnapshotPattern-755228347 Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: X-Role: member,reader Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: X-Roles: member,reader Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2ed6d16471b3475a8da48c5538594811"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2ed6d16471b3475a8da48c5538594811"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2ed6d16471b3475a8da48c5538594811"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2ed6d16471b3475a8da48c5538594811"}]}] Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant: tempest-TestSnapshotPattern-755228347 Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Id: 2ed6d16471b3475a8da48c5538594811 Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: X-Tenant-Name: tempest-TestSnapshotPattern-755228347 Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: X-User: tempest-TestSnapshotPattern-755228347-project Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Id: default Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: X-User-Domain-Name: Default Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: X-User-Id: f571e5614eb1448f987e50f8c6c23c93 Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: X-User-Name: tempest-TestSnapshotPattern-755228347-project Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: method: > Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: exception: Instance f6140f2d-6889-4616-a6b4-822f75ad7bfc could not be found. Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: action_args: {'id': 'f6140f2d-6889-4616-a6b4-822f75ad7bfc'} Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: {{(pid=119543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6140f2d-6889-4616-a6b4-822f75ad7bfc could not be found. Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6140f2d-6889-4616-a6b4-822f75ad7bfc could not be found. Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:58:40.695234 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:58:40.700173 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:58:40.700173 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:58:40.700173 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:58:40.700173 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:58:40.700173 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:58:40.700173 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6140f2d-6889-4616-a6b4-822f75ad7bfc could not be found. Jul 18 03:58:40.700173 n-d-465891-3 devstack@n-api.service[119543]: ERROR nova.api.openstack.wsgi Jul 18 03:58:40.700173 n-d-465891-3 devstack@n-api.service[119543]: DEBUG nova.api.openstack.wsgi [None req-9fafaa4d-a8d7-4a8c-8631-839cb19b0677 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Returning 404 to user: Instance f6140f2d-6889-4616-a6b4-822f75ad7bfc could not be found. {{(pid=119543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:58:40.700173 n-d-465891-3 devstack@n-api.service[119543]: INFO nova.api.openstack.requestlog [None req-9fafaa4d-a8d7-4a8c-8631-839cb19b0677 tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "GET /compute/v2.1/servers/f6140f2d-6889-4616-a6b4-822f75ad7bfc" status: 404 len: 111 microversion: 2.1 time: 0.030308 Jul 18 03:58:40.700173 n-d-465891-3 devstack@n-api.service[119543]: [pid: 119543|app: 0|req: 3824/7639] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 03:58:40 2022] GET /compute/v2.1/servers/f6140f2d-6889-4616-a6b4-822f75ad7bfc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:58:40.865770 n-d-465891-3 devstack@n-api.service[119544]: DEBUG nova.api.openstack.wsgi [None req-ef76eaac-8f54-4396-aeb9-6deb20fee03c tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] Calling method '.version_select at 0x7ff49b4d8dc0>' {{(pid=119544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:58:40.889966 n-d-465891-3 devstack@n-api.service[119544]: INFO nova.api.openstack.requestlog [None req-ef76eaac-8f54-4396-aeb9-6deb20fee03c tempest-TestSnapshotPattern-755228347 tempest-TestSnapshotPattern-755228347-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1261471965" status: 202 len: 0 microversion: 2.1 time: 0.027679 Jul 18 03:58:40.890916 n-d-465891-3 devstack@n-api.service[119544]: [pid: 119544|app: 0|req: 3816/7640] 10.222.0.57 () {58 vars in 1256 bytes} [Mon Jul 18 03:58:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1261471965 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:59:33.111164 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:59:33.111975 n-d-465891-3 devstack@n-api.service[119544]: Mon Jul 18 03:59:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:59:34.668214 n-d-465891-3 devstack@n-api.service[119543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:59:34.668863 n-d-465891-3 devstack@n-api.service[119543]: Mon Jul 18 03:59:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:59:34.694284 n-d-465891-3 devstack@n-api.service[119543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:59:34.694515 n-d-465891-3 devstack@n-api.service[119543]: Mon Jul 18 03:59:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 04:01:12.315960 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 04:01:12.316601 n-d-465891-3 devstack@n-api.service[119544]: Mon Jul 18 04:01:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 04:01:36.776711 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 04:01:36.777399 n-d-465891-3 devstack@n-api.service[119544]: Mon Jul 18 04:01:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 04:01:46.976703 n-d-465891-3 devstack@n-api.service[119543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 04:01:46.977333 n-d-465891-3 devstack@n-api.service[119543]: Mon Jul 18 04:01:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 04:02:53.122187 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 04:02:53.122187 n-d-465891-3 devstack@n-api.service[119544]: Mon Jul 18 04:02:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 04:02:54.678076 n-d-465891-3 devstack@n-api.service[119543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 04:02:54.678729 n-d-465891-3 devstack@n-api.service[119543]: Mon Jul 18 04:02:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 04:02:54.703773 n-d-465891-3 devstack@n-api.service[119543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 04:02:54.704038 n-d-465891-3 devstack@n-api.service[119543]: Mon Jul 18 04:02:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 04:04:32.324061 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 04:04:32.324692 n-d-465891-3 devstack@n-api.service[119544]: Mon Jul 18 04:04:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 04:04:56.784839 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 04:04:56.785762 n-d-465891-3 devstack@n-api.service[119544]: Mon Jul 18 04:04:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 04:05:06.985305 n-d-465891-3 devstack@n-api.service[119543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 04:05:06.985993 n-d-465891-3 devstack@n-api.service[119543]: Mon Jul 18 04:05:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 04:06:13.131045 n-d-465891-3 devstack@n-api.service[119544]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 04:06:13.131696 n-d-465891-3 devstack@n-api.service[119544]: Mon Jul 18 04:06:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 04:06:14.687958 n-d-465891-3 devstack@n-api.service[119543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 04:06:14.688564 n-d-465891-3 devstack@n-api.service[119543]: Mon Jul 18 04:06:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 04:06:14.713659 n-d-465891-3 devstack@n-api.service[119543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 04:06:14.713877 n-d-465891-3 devstack@n-api.service[119543]: Mon Jul 18 04:06:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!